CN116777750A - Focusing stack parallax dimension super-resolution method and device based on parallax dimension filtering - Google Patents

Focusing stack parallax dimension super-resolution method and device based on parallax dimension filtering Download PDF

Info

Publication number
CN116777750A
CN116777750A CN202310943431.0A CN202310943431A CN116777750A CN 116777750 A CN116777750 A CN 116777750A CN 202310943431 A CN202310943431 A CN 202310943431A CN 116777750 A CN116777750 A CN 116777750A
Authority
CN
China
Prior art keywords
parallax
stack
dimension
spectrum
focusing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202310943431.0A
Other languages
Chinese (zh)
Other versions
CN116777750B (en
Inventor
王安东
刘畅
张树岩
张希涛
于海玲
王昱凯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Yellow River Delta National Nature Reserve Management Committee
Beijing Information Science and Technology University
Original Assignee
Shandong Yellow River Delta National Nature Reserve Management Committee
Beijing Information Science and Technology University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Yellow River Delta National Nature Reserve Management Committee, Beijing Information Science and Technology University filed Critical Shandong Yellow River Delta National Nature Reserve Management Committee
Priority to CN202310943431.0A priority Critical patent/CN116777750B/en
Publication of CN116777750A publication Critical patent/CN116777750A/en
Application granted granted Critical
Publication of CN116777750B publication Critical patent/CN116777750B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/20—Image enhancement or restoration using local operators
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20048—Transform domain processing
    • G06T2207/20056—Discrete and fast Fourier transform, [DFT, FFT]

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Automatic Focus Adjustment (AREA)

Abstract

The invention discloses a focusing stack parallax dimension super-resolution method and device based on parallax dimension filtering, comprising the following steps: s1, passing through a low-pass filterFor low parallax resolution focus stack spectrumPerforming parallax dimension filtering and outputting; s2, filtering the focus stack spectrum output by S1Performing three-dimensional inverse Fourier transform to obtain focusing stack with high parallax resolution. The invention obtains the focusing pile with high parallax resolutionThe stack can provide data support for computing imaging applications such as disparity estimation. The invention belongs to the technical field of computational imaging and computer vision.

Description

Focusing stack parallax dimension super-resolution method and device based on parallax dimension filtering
Technical Field
The invention relates to the fields of computational imaging, machine vision and digital image processing, in particular to a focusing stack parallax dimension super-resolution method and device based on parallax dimension filtering.
Background
Light field imaging has become an important means of computational imaging and computer vision. Light field imaging techniques include disparity estimation, light field reconstruction, three-dimensional reconstruction, and the like. There are many light field models based on four-dimensional light fields, such as sub-aperture images, polar plane images, etc., and have been applied to various light field imaging techniques.
The focal stack is a sequence of images resulting from refocusing the light field in different parallax (depth) planes. The manner of acquiring the focal stack data can be divided into two types, one type is that digital refocusing is performed by light field data to obtain the focal stack data indirectly, and the other type is that a sequence of setting a focal imaging plane is directly obtained by an imaging system. Refocusing images of any imaging plane can be obtained through calculation of light field data, so that focusing stack data of dense parallax dimension sampling is obtained, but the light field data size is huge, and great challenges are brought to data acquisition, storage and transmission. In the process of directly acquiring the focusing stack data, the imaging equipment is used for acquiring the dense focusing stack data, related parameters are required to be set in advance, an imaging plane is strictly controlled, and the operation difficulty is high. The focus stack data is limited by low parallax dimension resolution, so that the focus stack calculation imaging has low precision and poor robustness, and the requirements of fine reconstruction and reproduction of various application scenes cannot be met. The invention provides a focusing stack spectrum construction method, which realizes focusing stack parallax dimension super resolution based on parallax dimension filtering and provides high-quality data support for computing imaging scene reconstruction technologies such as dense parallax estimation, full focusing imaging, light field reconstruction and the like.
Disclosure of Invention
The invention aims to provide a focusing stack parallax dimension super-resolution method and device based on parallax dimension filtering, which can provide data for practical applications such as parallax estimation, light field reconstruction and the like.
In order to achieve the above object, the present invention provides a focusing stack parallax dimension super resolution method based on parallax dimension filtering, which includes:
s1, a low-pass filter represented by the following formula (1)For low parallax resolution focus stack spectrumPerforming parallax dimension filtering and outputting;
（1）
wherein, the liquid crystal display device comprises a liquid crystal display device,for parallax (I)>Representing the spectral components of the disparity dimension>Representing spatial dimension spectral components, < >>Represents the central position of a periodic spectrum, +.>Is the bandwidth of the focal stack spectrum.
S2, filtering the focus stack spectrum output by S1Performing three-dimensional inverse Fourier transformFocusing stack for obtaining high parallax resolution>。
Further, the low parallax resolution focus stack spectrum of S1The acquisition method of (1) comprises the following steps:
s11, constructing a focusing stack space dimension spectrumThe method specifically comprises the following steps:
s111, constructing a focusing stack described in the following formula (2) by adopting a digital refocusing method：
（2）
Wherein, the liquid crystal display device comprises a liquid crystal display device,representing a four-dimensional light field>The spatial dimension coordinates are represented and,representing the viewpoint coordinates +.>Representing a reference viewpoint;
s112, focusing stackPerforming three-dimensional Fourier transform to obtain a focusing stack spectrum +.>。
S113, performing two-dimensional Fourier transform on the space dimension of the focusing stack,obtaining a focal stack spatial dimension spectrum。
S12, firstly acquiring a focusing stack frequency spectrum according to the following (4)Then obtaining the low parallax resolution focusing stack spectrum according to the following formula (5)>；
（4）
（5）
Wherein, the liquid crystal display device comprises a liquid crystal display device,representing the sampling interval, +.>Is an integer>Representation->Move +.>The subsequent spectrum.
Further, the focal stack spatial dimension spectrumDescribed as the following formula (6-1) (6-2), (6-3) or (6-4):
（6-1）
（6-2）
（6-3）
（6-4）
wherein, the liquid crystal display device comprises a liquid crystal display device,representing a four-dimensional light field>For four-dimensional light field spectrumIs>Representation of a four-dimensional light fieldTwo-dimensional slicing is performed, namely->Representing spatial coordinates>And->Respectively indicate->And->Frequency domain parameters of (a).
Further, the focusing stack is prepared by using the following formula (3-1) or (3-2)Performing three-dimensional Fourier transform to obtain a focusing stack spectrum +.>：
（3-1）
（3-2）。
The invention also provides a focusing stack parallax dimension super-resolution device based on parallax dimension filtering, which comprises:
a parallax dimension filtering unit for a low-pass filter represented by the following formula (1)Focusing stack spectrum for low parallax resolution>Performing parallax dimension filtering and outputting;
（1）
wherein, the liquid crystal display device comprises a liquid crystal display device,for parallax (I)>Representing the spectral components of the disparity dimension>Representing spatial dimension spectral components, < >>Represents the central position of a periodic spectrum, +.>To focus onThe bandwidth of the stacked spectrum;
a focusing stack acquisition unit with high parallax resolution for outputting the filtered focusing stack spectrum from the parallax dimension filtering unitPerforming three-dimensional inverse Fourier transform to obtain focusing stack with high parallax resolution。
Further, the disparity dimensional filtering unit includes:
a focusing stack space dimension spectrum subunit for constructing a focusing stack space dimension spectrumThe method specifically comprises the following steps:
digital refocusing Jiao Mokuai for constructing a focusing stack described by the following formula (2) using a digital refocusing method：
（2）
Wherein, the liquid crystal display device comprises a liquid crystal display device,representing a four-dimensional light field>The spatial dimension coordinates are represented and,representing the viewpoint coordinates +.>Representing a reference viewpoint;
a three-dimensional Fourier transform module for focusing the stack by adopting the following (3-1)Performing three-dimensional Fourier transform to obtain a focusing stack spectrum +.>：
（3-1）
The two-dimensional Fourier transform module is used for carrying out two-dimensional Fourier transform on the space dimension of the focusing stack to obtain the space dimension frequency spectrum of the focusing stack；
The parallax dimension filtering unit further comprises a low parallax resolution focusing stack spectrum subunit for acquiring a focusing stack spectrum according to the following formula (4)Then obtaining the low parallax resolution focusing stack spectrum according to the following formula (5)；
（4）
（5）
Wherein, the liquid crystal display device comprises a liquid crystal display device,representing the sampling interval, +.>Is an integer>Representation->Move +.>The subsequent spectrum.
Further, the focal stack spatial dimension spectrumDescribed as the following formula (6-1), (6-2), (6-3) or (6-4):
（6-1）
（6-2）
（6-3）
（6-4）
wherein, the liquid crystal display device comprises a liquid crystal display device,representing a four-dimensional light field>For four-dimensional light field spectrumIs>Representation of a four-dimensional light fieldTwo-dimensional slicing is performed, namely->Representing spatial coordinates>And->Respectively indicate->And->Frequency domain parameters of (a).
Further, the focusing stack is prepared by using the following formula (3-1) or (3-2)Performing three-dimensional Fourier transform to obtain a focusing stack spectrum +.>：
（3-1）
（3-2）。
Due to the adoption of the technical scheme, the invention has the following advantages:
aiming at the problem of low parallax resolution of a focusing stack, the invention realizes focusing stack parallax dimension super-resolution based on parallax dimension filtering by a focusing stack spectrum construction method, and provides high-quality data support for dense parallax estimation, full focusing imaging, light field reconstruction and other computing imaging scene reconstruction technologies.
Drawings
Fig. 1 is a schematic diagram of a focusing stack parallax dimension super-resolution method based on parallax dimension filtering.
Detailed Description
In the drawings, the same or similar reference numerals are used to designate the same or similar elements or elements having the same or similar functions, and embodiments of the present invention are described in detail below with reference to the drawings.
As shown in fig. 1, the focusing stack parallax dimension super-resolution method based on parallax dimension filtering provided by the embodiment of the invention includes:
s1, a low-pass filter represented by the following formula (1)For low parallax resolution focus stack spectrumPerforming parallax dimension filtering and outputting;
（1）
wherein, the liquid crystal display device comprises a liquid crystal display device,for parallax (I)>Representing the spectral components of the disparity dimension>Representing spatial dimension spectral components, < >>Represents the central position of a periodic spectrum, +.>Is the bandwidth of the focal stack spectrum.
S2, filtering the focus stack spectrum output by S1Performing three-dimensional inverse Fourier transform to obtain focusing stack with high parallax resolution>。
In one embodiment, the low parallax resolution focus stack spectrum of S1The acquisition method of (1) comprises the following steps:
s11, constructing a focusing stack space dimension spectrumThe method specifically comprises the following steps:
s111, constructing a focusing stack described in the following formula (2) by adopting a digital refocusing method：
（2）
Wherein, the liquid crystal display device comprises a liquid crystal display device,representing a four-dimensional light field>The spatial dimension coordinates are represented and,representing the viewpoint coordinates +.>Representing a reference viewpoint, selecting a reference viewpoint +.>When selected as a center viewpoint in general but not limited to.
S112, focusing stackPerforming three-dimensional Fourier transform to obtain a focusing stack spectrum +.>。
S113, performing two-dimensional Fourier transform on the space dimension of the focusing stack to obtain a focusing stack space dimension spectrum。
S12, firstly according to the following formula (4)Acquiring a focus stack spectrumThen obtaining the low parallax resolution focusing stack spectrum according to the following formula (5)>；
（4）
（5）
Wherein, the liquid crystal display device comprises a liquid crystal display device,representing the sampling interval, +.>Is an integer>Representation->Moving in the parallax dimensionThe subsequent spectrum.
The focus stack used in the low parallax resolution focus stack spectrum of S1 is an image sequence obtained by performing light field projection on four-dimensional light field data and an image sequence obtained by directly shooting by an imaging device, and of course, the low parallax resolution focus stack spectrum may be obtained by directly using the image sequence obtained by directly shooting by the imaging device, or any other existing method may be used.
In one embodiment, the spatial dimension of the focusing stack is subjected to a two-dimensional Fourier transform to obtain a spatial dimension spectrum of the focusing stack represented by the following equation (6-1)Namely image spectrum:
（6-1）
wherein the spatial dimension of the focal stack can be expressed as。
In another embodiment, to more intuitively reflect the equivalence of the real-domain integration process and the frequency-domain slicing process when generating a focal stack from a light field, the focal stack spatial dimension spectrumCan also be represented by the following formula (6-2):
（6-2）
wherein, the liquid crystal display device comprises a liquid crystal display device,for four-dimensional light field>The spatial coordinates are represented as such,representation of four-dimensional light field->Two-dimensional slicing is performed, namely->Representing spatial coordinates>And->Respectively indicate->And->Frequency domain parameters of (a).
In one embodiment, due toEqual toThe focal stack space dimension spectrum +.>Can also be represented by the following formula (6-3):
（6-3）
wherein, the liquid crystal display device comprises a liquid crystal display device,is four-dimensional light field spectrum->Is a two-dimensional slice of (c).
Preferably, takeThe focal stack space dimension spectrum +.>Can be represented by the following formula (6-4):
（6-4）
it can be seen that with parallaxFor four-dimensional light field spectrum->Two-dimensional slicing is performed to obtain spatial dimension spectra of multiple parallax layers>。
In one embodiment, the focusing stack is formed using the following formulas (3-1) or (3-2)Performing three-dimensional Fourier transform to obtain a focusing stack spectrum +.>：
（3-1）
（3-2）。
In one embodiment, the low pass filter of S1The acquisition method of the method specifically comprises the following steps:
setting a low parallax sampling rateIs>A parallax frequency range of one period: />Wherein->Represents the central position of a periodic spectrum, +.>Is the bandwidth of the focal stack spectrum.
The low-pass filter may be, for example, a one-dimensional gaussian filter represented by the following formula (7):
（7）
wherein, the liquid crystal display device comprises a liquid crystal display device,representing the filter parameters, typically the empirical values are 1.5 to 2.0.
The low-pass filter thus obtainedExpressed by formula (1).
Then the filtered focal stack spectrum of the S1 outputRepresented by the following formula (8):
（8）。
after the filtering is completed, the focusing stack spectrum is again usedPerforming three-dimensional inverse Fourier transform to obtain focusing stack with high parallax resolution>Focusing stack with high parallax resolution>The method can be used for calculating imaging scene reconstruction such as dense parallax estimation, full focus imaging, light field reconstruction and the like.
The invention also provides a focusing stack parallax dimension super-resolution device based on parallax dimension filtering, which comprises a parallax dimension filtering unit and a focusing stack acquisition unit with high parallax resolution, wherein: the parallax dimension filtering unit is used for a low-pass filter represented by the above formula (1)Focusing stack spectrum for low parallax resolution>And performing parallax dimension filtering and outputting.
The focusing stack acquisition unit with high parallax resolution is used for outputting the filtered focusing stack frequency spectrum output by the parallax dimension filtering unitPerforming three-dimensional inverse Fourier transform to obtain focusing stack with high parallax resolution>。
In one embodiment, the disparity-dimensional filtering unit comprises a focus-stack spatial-dimensional spectral sub-unit and a low-disparity-resolution focus-stack spectral sub-unit, wherein: the focusing stack space dimension spectrum subunit is used for constructing a focusing stack space dimension spectrum。
In one embodiment, the focusing stack spatial dimension spectrum subunit specifically includes a digital refocusing module, a three-dimensional fourier transform module, and a two-dimensional fourier transform module, wherein: the digital refocusing module is used for constructing the focusing stack described in the (2) above by adopting a digital refocusing method。
The three-dimensional Fourier transform module is used for focusing the stack by adopting the above formula (3-1)Performing three-dimensional Fourier transform to obtain a focusing stack spectrum +.>。
The two-dimensional Fourier transform module is used for carrying out two-dimensional Fourier transform on the space dimension of the focusing stack to obtain the space dimension spectrum of the focusing stack。
The low parallax resolution focus stack spectrum subunit is used for acquiring the focus stack spectrum according to the above formula (4)Obtaining a low parallax resolution focus stack spectrum according to the above formula (5)>。
The focusing stack with high parallax resolution can be reconstructed by adopting the focusing stack parallax dimension super-resolution method based on parallax dimension filtering, which is provided by the invention, so that light field data can be provided for the existing imaging technology.
Finally, it should be pointed out that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting. Those of ordinary skill in the art will appreciate that: the technical schemes described in the foregoing embodiments may be modified or some of the technical features may be replaced equivalently; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (8)

1. The focusing stack parallax dimension super-resolution method based on parallax dimension filtering is characterized by comprising the following steps of:
s1, a low-pass filter represented by the following formula (1)For low parallax resolution focus stack spectrumPerforming parallax dimension filtering and outputting;
wherein s is parallax, ω s Representing the spectral components of the disparity dimension, (ω) x ，ω y ) Representing spatial dimensional spectral components, omega F Represents the center position of a periodic spectrum, Δω F Bandwidth for the focal stack spectrum;
s2, filtering the focus stack spectrum output by S1Performing three-dimensional inverse Fourier transform to obtain a focusing stack f with high parallax resolution CG (s，x，y)。
2. The focus stack parallax dimension super resolution method based on parallax dimension filtering according to claim 1, wherein the low parallax resolution focus stack spectrum of S1The acquisition method of (1) comprises the following steps:
s11, constructing a focusing stack space dimension spectrumThe method specifically comprises the following steps of;
s111, constructing a focusing stack f (S, x, y) described by the following formula (2) by adopting a digital refocusing method:
f(s，x，y)＝∫∫L(u，v，x+s(u-u 0 )，y+s(v-v 0 ))dudv (2)
wherein L (u, v, x+s (u-u) 0 )，y+s(v-v 0 ) (ii) represents a four-dimensional light field, (x, y) represents a spatial dimension coordinate, (u, v) represents a viewpoint coordinate, (u) 0 ，v 0 ) Representing a reference viewpoint;
s112, performing three-dimensional Fourier transform on the focusing stack f (S, x, y) to obtain a focusing stack frequency spectrum
S113, performing two-dimensional Fourier transform on the space dimension of the focusing stack to obtain a focusing stack space dimension spectrum
S12, firstly acquiring a focusing stack frequency spectrum according to the following (4)Then obtaining the low parallax resolution focusing stack spectrum according to the following formula (5)>
Where deltas represents the sampling interval, n is an integer,representation->Moving in the parallax dimensionThe subsequent spectrum.
3. The focusing stack parallax dimension super resolution method based on parallax dimension filtering according to claim 2, wherein the focusing stack space dimension spectrumDescribed as the following formula (6-1), (6-2), (6-3) or (6-4):
wherein L (u, v, x) s ，y s ) Representing a four-dimensional light field,for four-dimensional light field spectrumIs a two-dimensional slice of delta (x) s -x-s(u-u 0 )，y s -y-s(v-v 0 ) Representation of four-dimensional light field L (u, v, x) s ，y s ) Two-dimensional slicing (x) s ，y s ) Representing the spatial coordinates omega u And omega v The frequency domain parameters for u and v are represented, respectively.
4. The focusing stack parallax dimension super resolution method based on parallax dimension filtering according to claim 2, characterized in that the focusing stack f (x, x, y) is subjected to three-dimensional fourier transformation by the following formula (3-1) or (3-2) to obtain a focusing stack spectrum
5. A focusing stack parallax dimension super-resolution device based on parallax dimension filtering, comprising:
a parallax dimension filtering unit for a low-pass filter represented by the following formula (1)Focusing stack spectrum for low parallax resolution>Performing parallax dimension filtering and outputting;
wherein s is parallax, ω S Representing the spectral components of the disparity dimension, (ω) x ，ω y ) Representing spatial dimensional spectral components, omega F Represents the center position of a periodic spectrum, Δω F Bandwidth for the focal stack spectrum;
a focusing stack acquisition unit with high parallax resolution for outputting the filtered focusing stack spectrum from the parallax dimension filtering unitPerforming three-dimensional inverse Fourier transform to obtain a focusing stack f with high parallax resolution CG (s，x，y)。
6. The focusing stack parallax dimension super resolution device based on the parallax dimension filtering according to claim 5, wherein the parallax dimension filtering unit comprises:
focusing stack spaceA dimension spectrum subunit for constructing a focusing stack space dimension spectrumThe method specifically comprises the following steps:
digital refocusing Jiao Mokuai for constructing a focus stack f (s, x, y) described by the following formula (2) using a digital refocusing method:
f(s，x，y)＝∫∫L(u，v，x+s(u-u 0 )，y+s(v-v 0 ))dudv (2)
wherein L (u, v, x+s (u-u) 0 )，y+s(v-v 0 ) (ii) represents a four-dimensional light field, (x, y) represents a spatial dimension coordinate, (u, v) represents a viewpoint coordinate, (u) 0 ，v 0 ) Representing a reference viewpoint;
the three-dimensional Fourier transform module is used for performing three-dimensional Fourier transform on the focusing stack f (s, x, y) by adopting the following formula (3-1) to obtain a focusing stack frequency spectrum
The two-dimensional Fourier transform module is used for carrying out two-dimensional Fourier transform on the space dimension of the focusing stack to obtain the space dimension frequency spectrum of the focusing stack
The parallax dimension filtering unit further comprises a low parallax resolution focusing stack spectrum subunit for acquiring a focusing stack spectrum according to the following formula (4)Then obtaining the low parallax resolution focusing stack spectrum according to the following formula (5)>
Where deltas represents the sampling interval, n is an integer,representation->Move +.>The subsequent spectrum.
7. The focusing-stack parallax-dimension super-resolution device based on parallax-dimension filtering of claim 6, wherein the focusing-stack spatial-dimension spectrumDescribed as the following formula (6-1), (6-2), (6-3) or (6-4):
wherein L (u, v, x) s ，y s ) Representing a four-dimensional light field,is four-dimensional light field spectrum->Is a two-dimensional slice of delta (x) s -x-s(u-u 0 )，y s -y-s(v-v 0 ) Representation of four-dimensional light field L (u, v, x) s ，y s ) Two-dimensional slicing (x) s ，y s ) Representing the spatial coordinates omega u And omega v The frequency domain parameters for u and v are represented, respectively.
8. The focusing-stack parallax dimension super-resolution device based on parallax dimension filtering according to claim 6, wherein the focusing stack f (s, x, y) is subjected to three-dimensional fourier transform by the following formula (3-1) or (3-2) to obtain a focusing-stack spectrum
CN202310943431.0A 2023-07-31 2023-07-31 Focusing stack parallax dimension super-resolution method and device based on parallax dimension filtering Active CN116777750B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310943431.0A CN116777750B (en) 2023-07-31 2023-07-31 Focusing stack parallax dimension super-resolution method and device based on parallax dimension filtering

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310943431.0A CN116777750B (en) 2023-07-31 2023-07-31 Focusing stack parallax dimension super-resolution method and device based on parallax dimension filtering

Publications (2)

Publication Number Publication Date
CN116777750A true CN116777750A (en) 2023-09-19
CN116777750B CN116777750B (en) 2023-12-26

Family

ID=88013526

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310943431.0A Active CN116777750B (en) 2023-07-31 2023-07-31 Focusing stack parallax dimension super-resolution method and device based on parallax dimension filtering

Country Status (1)

Country Link
CN (1) CN116777750B (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013026844A (en) * 2011-07-21 2013-02-04 Nikon Corp Image generation method and device, program, recording medium, and electronic camera
CN104407507A (en) * 2014-09-18 2015-03-11 河北工程大学 Hilbert transform based high-precision digital holography phase reconstruction method
CN106934110A (en) * 2016-12-14 2017-07-07 北京信息科技大学 A kind of filtered back-projection method and device that light field is rebuild by focusing storehouse
CN109164691A (en) * 2018-08-22 2019-01-08 天津大学 It is a kind of to realize the off-axis digital holography phase conjugation method focused through scattering medium
CN109360212A (en) * 2018-11-02 2019-02-19 太原科技大学 A kind of frequency domain light field number refocusing algorithm can inhibit resampling error
CN109580457A (en) * 2018-11-01 2019-04-05 南京理工大学 Three dimensional diffraction based on LED array coded illumination chromatographs micro imaging method
CN110866874A (en) * 2019-10-21 2020-03-06 南京大学 Method for removing periodic noise in light field reconstruction image based on frequency domain
CN110996104A (en) * 2019-12-05 2020-04-10 华中科技大学 Light field focus stack image sequence encoding and decoding method, device and system
CN113805175A (en) * 2021-09-17 2021-12-17 北京工商大学 Stripe mode SAR imaging refocusing method
CN113935404A (en) * 2021-09-24 2022-01-14 杭州电子科技大学 Method for evaluating definition of light field significance detection data set

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013026844A (en) * 2011-07-21 2013-02-04 Nikon Corp Image generation method and device, program, recording medium, and electronic camera
CN104407507A (en) * 2014-09-18 2015-03-11 河北工程大学 Hilbert transform based high-precision digital holography phase reconstruction method
CN106934110A (en) * 2016-12-14 2017-07-07 北京信息科技大学 A kind of filtered back-projection method and device that light field is rebuild by focusing storehouse
CN109164691A (en) * 2018-08-22 2019-01-08 天津大学 It is a kind of to realize the off-axis digital holography phase conjugation method focused through scattering medium
CN109580457A (en) * 2018-11-01 2019-04-05 南京理工大学 Three dimensional diffraction based on LED array coded illumination chromatographs micro imaging method
CN109360212A (en) * 2018-11-02 2019-02-19 太原科技大学 A kind of frequency domain light field number refocusing algorithm can inhibit resampling error
CN110866874A (en) * 2019-10-21 2020-03-06 南京大学 Method for removing periodic noise in light field reconstruction image based on frequency domain
CN110996104A (en) * 2019-12-05 2020-04-10 华中科技大学 Light field focus stack image sequence encoding and decoding method, device and system
CN113805175A (en) * 2021-09-17 2021-12-17 北京工商大学 Stripe mode SAR imaging refocusing method
CN113935404A (en) * 2021-09-24 2022-01-14 杭州电子科技大学 Method for evaluating definition of light field significance detection data set

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
MIKAËL LE PENDU ET AL: "A Fourier Disparity Layer Representation for Light Fields", 《 IEEE TRANSACTIONS ON IMAGE PROCESSING》, vol. 28, no. 11, XP011743005, DOI: 10.1109/TIP.2019.2922099 *
刘润兴: "基于四维光场计算成像的物体检测技术研究", 刘润兴, vol. 2020, no. 1 *
喻鹤翔: "基于光场和数字重聚焦的近景三维重建", 《中国优秀硕士学位论文全文数据库电子期刊 信息科技辑》, vol. 2017, no. 12 *
王昱凯 等: "基于聚焦堆栈视差维超分辨的视差估计方法", 王昱凯 等, pages 2 *
陈琦: "聚焦型光场成像技术研究及其在形貌测量中的应用", 《中国博士学位论文全文数据库电子期刊 基础科学辑》, vol. 2020, no. 2 *

Also Published As

Publication number Publication date
CN116777750B (en) 2023-12-26

Similar Documents

Publication Publication Date Title
Zhou et al. Coded aperture pairs for depth from defocus and defocus deblurring
US10944960B2 (en) Free-viewpoint video generating method and free-viewpoint video generating system
US9013477B2 (en) Method and system for producing a virtual output image from data obtained by an array of image capturing devices
JP5887267B2 (en) 3D image interpolation apparatus, 3D imaging apparatus, and 3D image interpolation method
CN109919911B (en) Mobile three-dimensional reconstruction method based on multi-view photometric stereo
CN111288925B (en) Three-dimensional reconstruction method and device based on digital focusing structure illumination light field
JP7479729B2 (en) Three-dimensional representation method and device
KR20190086964A (en) System and Method for Removing Distortion of Fisheye Lens and Omnidirectional Image
CN103905746A (en) Method and device for localization and superposition of sub-pixel-level image offset and video device
CN107421640B (en) Expand the multispectral light-field imaging system and method for principle based on color difference
Zhang et al. Synthetic aperture based on plenoptic camera for seeing through occlusions
CN116777750B (en) Focusing stack parallax dimension super-resolution method and device based on parallax dimension filtering
Jiao et al. Dual-camera enabled real-time three-dimensional integral imaging pick-up and display
WO2015115946A1 (en) Methods for encoding and decoding three-dimensional video content
Huang et al. Performance enhanced elemental array generation for integral image display using pixel fusion
Drexler et al. Digital adaptive optics for turbulence mitigation
CN106934110B (en) Back projection method and device for reconstructing light field by focusing stack
WO2023221969A1 (en) Method for capturing 3d picture, and 3d photographic system
CN109155822B (en) Image processing method and device
CN110086994A (en) A kind of integrated system of the panorama light field based on camera array
Mao et al. Elemental image array generation algorithm with accurate depth information for integral imaging
JP4091455B2 (en) Three-dimensional shape measuring method, three-dimensional shape measuring apparatus, processing program therefor, and recording medium
Zhang et al. A simultaneous method for 3D video super-resolution and high-quality depth estimation.
Zhou et al. 3D reconstruction from structured light field by Fourier transformation profilometry
Li et al. Extending depth of field by varifocal multi-view computational imaging for metaverse

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant