CN110047430A - Light field data reconstructing method, light field data restructing device and light field display device - Google Patents
Light field data reconstructing method, light field data restructing device and light field display device Download PDFInfo
- Publication number
- CN110047430A CN110047430A CN201910343960.0A CN201910343960A CN110047430A CN 110047430 A CN110047430 A CN 110047430A CN 201910343960 A CN201910343960 A CN 201910343960A CN 110047430 A CN110047430 A CN 110047430A
- Authority
- CN
- China
- Prior art keywords
- light field
- target image
- image
- axis direction
- coordinate axis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/22—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
- G09G3/30—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
- G09G3/32—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/22—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
- G09G3/30—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
- G09G3/32—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]
- G09G3/3208—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED]
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/36—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals
- G09G3/3611—Control of matrices with row and column drivers
Abstract
The present invention provides a kind of light field data reconstructing method, light field data restructing device and light field display device, the light field data reconstructing method includes: the 2D original image for obtaining and acquiring in optical field acquisition point, optical field acquisition point is located in UV plane right-angle coordinate, optical field acquisition point is the matrix of M × N, and the quantity of optical field acquisition point is less than the quantity for generating the target image of 4D light field data；Respectively in U coordinate axis direction and V change in coordinate axis direction, interpolation processing is carried out to M × N number of optical field acquisition point acquisition 2D original image, obtains X × Y target image；According to X × Y target image, 4D light field data is obtained.In the present invention, 2D original image is acquired using the optical field acquisition point of negligible amounts, interpolation processing is carried out to the 2D original image of acquisition, obtain the biggish target image of quantity, and continuous and more visible 4D light field data is reconstructed according to the biggish target image of quantity, significantly reduce the collection capacity of 2D initial data.
Description
Technical field
The present invention relates to field of display technology more particularly to a kind of light field data reconstructing methods, light field data restructing device
And light field display device.
Background technique
4D light field data has recorded the information for the same object observed in different location, is as shown in Figure 1 a 4D light field
The schematic diagram of data, in Fig. 1, face UV has recorded the location information of optical field acquisition point, and face ST has recorded each optical field acquisition respectively
The Pixel Information of point acquisition.The matrix that the point of optical field acquisition shown in Fig. 1 is 5 × 5.
Light field data L (u, v, s, t) can be recorded by following formula:
L (u, v, s, t)=M × N × Row × Column
Wherein, u, v, s, t are integer, and as the index of light field data, u, v indicate the position of optical field acquisition point, and light field is adopted
Integrate the matrix a little as M × N, s, t indicate the Pixel Information of single optical field acquisition point acquisition, the picture of each optical field acquisition point acquisition
The quantity of element is Row × Column.L (u, v, s, t) is to correspond in Fig. 1 in the value l (u, v, s, t) that point (u, v, s, t) records
The Pixel Information of optical field acquisition point.
To generate continuous image information, preferably M × N=Row × Column.General pattern resolution ratio be HD (high definition,
720 × 1280), FHD (full HD, 1080 × 1920) etc., this just needs optical field acquisition point to be similarly 720 × 1280 or 1080
× 1920, hence it is evident that increase the difficulty of data acquisition.
Summary of the invention
In view of this, the present invention provides a kind of light field data reconstructing method, light field data restructing device and light field display dress
It sets, for solving the problems, such as that data acquisition difficulty is big when obtaining 4D light field data.
In order to solve the above technical problems, the present invention provides a kind of light field data reconstructing method, comprising:
The 2D original image acquired in optical field acquisition point is obtained, the optical field acquisition point is located at UV plane right-angle coordinate
Interior, the optical field acquisition point is the matrix of M × N, and the quantity of the optical field acquisition point is less than the mesh for generating 4D light field data
The quantity of logo image；
Respectively in U coordinate axis direction and V change in coordinate axis direction, to M × N number of optical field acquisition point acquisition 2D original graph
As carrying out interpolation processing, X × Y target image is obtained；
According to the X × Y target image, the 4D light field data is obtained.
Optionally, described respectively in U coordinate axis direction and V change in coordinate axis direction, M × N number of optical field acquisition point is adopted
The 2D original image of collection carries out interpolation processing, and obtaining X × Y target image includes:
In U coordinate axis direction, the N M optical field acquisition points for arranging each column in the optical field acquisition point are acquired
2D original image carry out interpolation processing, obtain X × N number of target image；
On V change in coordinate axis direction, interpolation processing is carried out to N number of target image of every a line in X row target image, is obtained
X × Y target image；
Or
On V change in coordinate axis direction, N number of optical field acquisition point acquisition of every a line in the point of the optical field acquisition described in M row
2D original image carry out interpolation processing, obtain M × Y target image；
In U coordinate axis direction, interpolation processing is carried out to M target image of each column in Y column target image, is obtained
X × Y target image.
Optionally, the interpolation processing includes:
For a target image to be obtained, by interpolation algorithm in U coordinate axis direction or V change in coordinate axis direction is upper
Two image interpolations in the target image two sides to be obtained obtain.
Optionally, the interpolation algorithm is linear interpolation algorithm, carries out interpolation using following formula:
Insert_image.j=alph (image.i)+bet (image. (i+1))
Wherein, Insert_image.j is target image to be obtained, and image.i and image. (i+1) are in U coordinate axis
It is located at the image of target image two sides to be obtained on direction or on V change in coordinate axis direction, the sum of alph and bet are a determining number
Value.
Optionally, one of X and Y are the line number of the pixel of the target image, another picture for the target image
The columns of element.
Optionally, in U coordinate axis direction, N arranges the M optical field acquisition points of each column in the optical field acquisition point
It is spacedly distributed, between N number of described optical field acquisition point of every a line on V change in coordinate axis direction in the point of optical field acquisition described in M row etc.
Every distribution.
The present invention also provides a kind of light field data restructing devices, comprising:
Module is obtained, for obtaining the 2D original image in the acquisition of optical field acquisition point, the optical field acquisition point is flat positioned at UV
In the rectangular coordinate system of face, the optical field acquisition point is the matrix of M × N, and the quantity of the optical field acquisition point is less than for generating 4D
The quantity of the target image of light field data；
Interpolating module is used for respectively in U coordinate axis direction and V change in coordinate axis direction, to M × N number of optical field acquisition point
The 2D original image of acquisition carries out interpolation processing, obtains X × Y target image；
Module is obtained, for obtaining the 4D light field data according to the X × Y target image.
The present invention also provides a kind of light field display devices, including above-mentioned light field data restructing device.
Optionally, the light field display device further include:
At least two layers of display screen；
Decomposing module is connect with the light field data restructing device, for obtain the light field data restructing device
4D light field data resolves at least two display images, and at least two displays image is sent respectively to described at least two
Layer display screen is shown.
Optionally, it is X × Y that the resolution ratio of at least two layers display screen is identical.
The advantageous effects of the above technical solutions of the present invention are as follows:
In the embodiment of the present invention, 2D original image is acquired using the optical field acquisition point of negligible amounts, it is original to the 2D of acquisition
Image carries out interpolation processing, obtains the biggish target image of quantity, and it is continuous according to the biggish target image reconstruct of quantity and compared with
Clearly 4D light field data significantly reduces the collection capacity of 2D initial data, such that light field is shown, to realize
Comfortable 3D experience true to nature.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below by institute in the description to the embodiment of the present invention
Attached drawing to be used is needed to be briefly described, it should be apparent that, the accompanying drawings in the following description is only some implementations of the invention
Example, for those of ordinary skill in the art, without any creative labor, can also be according to these attached drawings
Obtain other attached drawings.
Fig. 1 is the schematic diagram of 4D light field data；
Fig. 2 is the flow diagram of the light field data reconstructing method of the embodiment of the present invention；
Fig. 3 is schematic diagram of the optical field acquisition point of the embodiment of the present invention in UV coordinate system；
Fig. 4 is schematic diagram of the original image of the optical field acquisition point acquisition of the embodiment of the present invention in UV coordinate system；
Fig. 5 is the interpolation method schematic diagram in U coordinate axis direction of one embodiment of the invention；
Fig. 6 is the interpolation method schematic diagram on V change in coordinate axis direction of one embodiment of the invention；
Fig. 7 is the interpolation method schematic diagram on V change in coordinate axis direction of another embodiment of the present invention；
Fig. 8 is the interpolation method schematic diagram in U coordinate axis direction of another embodiment of the present invention；
Fig. 9 is the interpolation method schematic diagram of further embodiment of this invention；
Figure 10 is to be shown compared with the polar figure for interpolation method not being used to obtain using the interpolation method of the embodiment of the present invention
It is intended to；
Figure 11 is the structural schematic diagram of the light field data restructing device of the embodiment of the present invention；
Figure 12 is that the light field display device of the embodiment of the present invention carries out the flow diagram that light field is shown；
Figure 13 is the light field display schematic diagram of the light field display device with two layers of display screen of the embodiment of the present invention；
Figure 14 is the schematic diagram for the picture that the light field display device with two layers of display screen of the embodiment of the present invention is shown；
Figure 15 is the structural schematic diagram of the light field display device of the embodiment of the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
Attached drawing, the technical solution of the embodiment of the present invention is clearly and completely described.Obviously, described embodiment is this hair
Bright a part of the embodiment, instead of all the embodiments.Based on described the embodiment of the present invention, ordinary skill
Personnel's every other embodiment obtained, shall fall within the protection scope of the present invention.
Data acquisition difficulty is big when to solve the problems, such as existing acquisition 4D light field data, referring to FIG. 2, the present invention is implemented
Example provides a kind of light field data reconstructing method, comprising:
Step 21: obtaining the 2D original image acquired in optical field acquisition point, the optical field acquisition point is located at UV flat square
In coordinate system, the optical field acquisition point is the matrix of M × N, and the quantity of the optical field acquisition point is less than for generating 4D light field number
According to target image quantity；
In the embodiment of the present invention, 2D original image (true acquisition) can be acquired by camera, alternatively, passing through rendering life
At 2D original image (analog acquisition).
In the embodiment of the present invention, in UV plane right-angle coordinate, U can be ordinate, and V is abscissa, and certainly, U can also
Think that abscissa, V are ordinate.
Referring to FIG. 3, U is ordinate in embodiment shown in Fig. 3, V is abscissa, and the quantity of optical field acquisition point 30 is 3
× 4 (M=3, N=4).
Step 22: respectively in U coordinate axis direction and V change in coordinate axis direction, to M × N number of optical field acquisition point acquisition
2D original image carries out interpolation processing, obtains X × Y target image；
It, can be first in the enterprising row interpolation processing of U coordinate axis direction, then in V change in coordinate axis direction in the embodiment of the present invention
Enterprising row interpolation processing, it is of course also possible to first in the enterprising row interpolation processing of V change in coordinate axis direction, it is then enterprising in U coordinate axis direction
Row interpolation processing.
Step 23: according to the X × Y target image, obtaining the 4D light field data.
In the embodiment of the present invention, 2D original image is acquired using the optical field acquisition point of negligible amounts, it is original to the 2D of acquisition
Image carries out interpolation processing, obtains the biggish target image of quantity, and it is continuous according to the biggish target image reconstruct of quantity and compared with
Clearly 4D light field data significantly reduces the collection capacity of 2D initial data, such that light field is shown, to realize
Comfortable 3D experience true to nature.
In the embodiment of the present invention, it is preferable that M and N is the positive integer less than 10, i.e. the quantity and target of optical field acquisition point
The quantity of image is compared to much smaller, so as to greatly reduce the collection capacity of 2D initial data.For example, optical field acquisition point
Quantity can for 5 × 5,7 × 7 perhaps 5 × 7 etc. and the quantity of target image is usually 720 × 1280 or 1080 × 1920
Deng.
The method of interpolation processing is described in detail below.
In some embodiments of the invention, above-mentioned steps 22 may include:
Step 221a: in U coordinate axis direction, the N M light fields for arranging each column in the optical field acquisition point are adopted
The 2D original image of collection point acquisition carries out interpolation processing, obtains X × N number of target image；
Step 222a: on V change in coordinate axis direction, interpolation is carried out to N number of target image of every a line in X row target image
Processing, obtains X × Y target image；
Referring to FIG. 4, in embodiment shown in Fig. 4, it is assumed that optical field acquisition point is the matrix of 3 × 4 (i.e. M=3, N=4),
Need to obtain the target image of 8 × 9 (i.e. X=8, Y=9).In UV plane right-angle coordinate, the 2D of optical field acquisition point acquisition is former
Beginning image 41 is also 3 × 4 matrix, when carrying out interpolation, referring to FIG. 5, adopting first in U coordinate axis direction to 4 column light fields
The 2D original image of 3 optical field acquisition points acquisition of each column in collection point carries out interpolation processing, obtains 8 × 4 target images
42.Referring to FIG. 6, then, on V change in coordinate axis direction, being carried out to 4 target images of every a line in 8 row target images 42
Interpolation processing obtains 8 × 9 target images.
In other embodiment of the invention, above-mentioned steps 22 also may include:
Step 221b: on V change in coordinate axis direction, N number of light field of every a line in the point of the optical field acquisition described in M row is adopted
The 2D original image of collection point acquisition carries out interpolation processing, obtains M × Y target image；
Step 222b: in U coordinate axis direction, interpolation is carried out to M target image of each column in Y column target image
Processing, obtains X × Y target image.
Referring to FIG. 7, first on V change in coordinate axis direction, described in 4 of every a line in the point of the optical field acquisition described in 3 rows
The 2D original image of optical field acquisition point acquisition carries out interpolation processing, obtains 3 × 9 target images.Then, referring to FIG. 8, in U
On change in coordinate axis direction, interpolation processing is carried out to 3 target images of each column in 9 column target images, obtains 8 × 9 targets
Image.
In the embodiment of the present invention, above-mentioned interpolation processing may include: to be calculated for a target image to be obtained by interpolation
Method is to two image interpolations for being located at the target image two sides to be obtained in U coordinate axis direction or on V change in coordinate axis direction
It obtains.For example, referring to FIG. 5, the target image 42 that the dotted line frame in Fig. 5 frames, is by the 2D for being located at its two sides
41 interpolation of original image obtains.Referring to FIG. 6, the target image 42 that the dotted line frame in Fig. 6 frames, is by positioned at its two sides
Two (lateral) target images, 42 interpolation obtain.Certainly, it in some other embodiment of the invention, is also not excluded for using it
His interpolation process method.
In the embodiment of the present invention, it is preferable that in U coordinate axis direction, N arranges the M of each column in the optical field acquisition point
A optical field acquisition point is spacedly distributed, on V change in coordinate axis direction, N number of institute of every a line in the point of optical field acquisition described in M row
It states optical field acquisition point to be spacedly distributed, so that interpolation algorithm is simple.In the case of this kind, when interpolation processing, in U coordinate axis side
Upwards or on V change in coordinate axis direction, the quantity for the target image being inserted between two adjacent images is identical.For example, please join
Fig. 5 is examined, in U coordinate axis direction, the number for the target image 42 being inserted between two adjacent 2D original images 41 is 4
It is a.Referring to FIG. 6, on V change in coordinate axis direction, be inserted between two adjacent (lateral) target images 42 (vertical) mesh
The number of logo image 42 is 3.
Certainly, in some other embodiment of the invention, N is arranged described in M of each column in the optical field acquisition point
Optical field acquisition point can also be distributed with unequal interval, likewise, N number of light field of every a line in the point of optical field acquisition described in M row
Collection point can also be distributed with unequal interval.
In the embodiment of the present invention, the interpolation algorithm used can be linear interpolation algorithm, can be carried out using following formula
Interpolation:
Insert_image.j=alph (image.i)+bet (image. (i+1))
Wherein, Insert_image.j is target image to be obtained, and image.i and image. (i+1) are in U coordinate axis
It is located at the image of target image two sides to be obtained on direction or on V change in coordinate axis direction, the sum of alph and bet are a determining number
Value.
Specifically, according to target image to be obtained at a distance from two images of its two sides, to determine two images
Weight (alph and bet).
In an alternative embodiment of the invention, the sum of alph and bet can be 1.
Above-mentioned interpolation method in the embodiment of the present invention, it is possible to understand that are as follows:
In some embodiments, in U coordinate axis direction, X target image of each column to be obtained is divided into M-1
Part, for every portion X/ (M-1) a target image to be obtained, interpolation processing is carried out by the 2D original image to its two sides and is obtained
It arrives.On V change in coordinate axis direction, the Y target image of every a line to be obtained is divided into N-1 parts, it is to be obtained for every portion
Y/ (N-1) a target image, by target image to its two sides, (target image is in U coordinate axis direction at interpolation
Manage obtained target image) it carries out interpolation processing and obtains.
Alternatively,
In some embodiments, on V change in coordinate axis direction, the Y target image of every a line to be obtained is divided into N-1
Part, for every portion Y/ (N-1) a target image to be obtained, interpolation processing is carried out by the 2D original image to its two sides and is obtained
It arrives.In U coordinate axis direction, X target image of each column to be obtained is divided into M-1 parts, it is to be obtained for every portion
X/ (M-1) a target image, by target image to its two sides, (target image is on V change in coordinate axis direction at interpolation
Manage obtained target image) it carries out interpolation processing and obtains.
For every portion X/ (M-1) a target image to be obtained, optionally:
Alph=j/ (X/ (M-1))；
Bet=((X/ (M-1))-j)/(X/ (M-1))；
Wherein, j is that (j is equivalent to the image with two sides to the serial number of target image to be obtained in the target image of place part
Distance), value be 1~X/ (M-1)；
For every portion Y/ (N-1) a target image to be obtained, optionally:
Alph=j/ (Y/ (N-1))；
Bet=((Y/ (N-1))-j)/(Y/ (N-1))；
Wherein, j is that (j is equivalent to the image with two sides to the serial number of target image to be obtained in the target image of place part
Distance), value be 1~Y/ (N-1).
Above-mentioned linear interpolation algorithm can be executed by following procedure:
It is calculated in the enterprising row interpolation of U coordinate axis direction:
X target image to be obtained is divided into M-1 parts by For i From 1to (M-1) #, to M-1 parts of target images
Linear interpolation calculating is carried out respectively
For j From 1to X/ (M-1) # linearly inserts portion target image every in M-1 parts of target images respectively
Value calculates
Insert_image.j=alph (image.i)+bet (image. (i+1)) # is between 2D original image i and i+1
X/ (M-1) new images are inserted into, the Pixel Information in new images is opened 2D original image linear interpolation by front and back two and obtained.
END For
End For
Similarly, the interpolation calculation in an other direction is carried out on V change in coordinate axis direction:
Y target image to be obtained is divided into N-1 parts by For i From 1to (N-1) #, to N-1 parts of target images
Linear interpolation calculating is carried out respectively
For j From 1to Y/ (N-1) # linearly inserts portion target image every in N-1 parts of target images respectively
Value calculates
Insert_image.j=alph (image.i)+bet (image. (i+1)) # is obtained in U coordinate axis direction
Y/ (N-1) new images are inserted between target image i and i+1, the Pixel Information in new images opens target image line by front and back two
Property interpolation obtain, please refer to Fig. 9.
END For
End For
A M × N number of 2D original image can thus be expanded as X × Y 2D target image, final 4D light field
The dimension of data L (u, v, s, t) is X × Y × X × Y.
In the embodiment of the present invention, optionally, one of X and Y are the line number of the pixel of the target image, another for institute
State the columns of the pixel of target image.Assuming that the line number of the pixel of target image is Row, the columns of the pixel of target image is
Column, then the number of the target image for generating 4D light field data is Row × Column.
In the embodiment of the present invention, referring to FIG. 10, being represented in polar figure by the image that above-mentioned interpolation algorithm obtains
Good continuity.In Figure 10, (a) is original image, and the vertical line in original image is that (polar figure is to be with U to polar figure
Abscissa, using S as ordinate, or using V as abscissa, the figure that is obtained using T as ordinate) tangent position, (b) for without inserting
The polar figure of value-based algorithm conversion is (c) polar figure by the interpolation algorithm conversion in the embodiment of the present invention, from can be in (c)
See apparent edge optimization.
Figure 11 is please referred to, the embodiment of the present invention also provides a kind of light field data restructing device, comprising:
Module is obtained, for obtaining the 2D original image in the acquisition of optical field acquisition point, the optical field acquisition point is flat positioned at UV
In the rectangular coordinate system of face, the optical field acquisition point is the matrix of M × N, and the quantity of the optical field acquisition point is less than for generating 4D
The quantity of the target image of light field data；
Interpolating module is used for respectively in U coordinate axis direction and V change in coordinate axis direction, to M × N number of optical field acquisition point
The 2D original image of acquisition carries out interpolation processing, obtains X × Y target image；
Module is obtained, for obtaining the 4D light field data according to the X × Y target image.
In the embodiment of the present invention, 2D original image is acquired using the optical field acquisition point of negligible amounts, it is original to the 2D of acquisition
Image carries out interpolation processing, obtains the biggish target image of quantity, and it is continuous according to the biggish target image reconstruct of quantity and compared with
Clearly 4D light field data significantly reduces the collection capacity of 2D initial data, such that light field is shown, to realize
Comfortable 3D experience true to nature.
Optionally, described respectively in U coordinate axis direction and V change in coordinate axis direction, M × N number of optical field acquisition point is adopted
The 2D original image of collection carries out interpolation processing, and obtaining X × Y target image includes:
In U coordinate axis direction, the N M optical field acquisition points for arranging each column in the optical field acquisition point are acquired
2D original image carry out interpolation processing, obtain X × N number of target image；
On V change in coordinate axis direction, interpolation processing is carried out to N number of target image of every a line in X row target image, is obtained
X × Y target image；
Or
On V change in coordinate axis direction, N number of optical field acquisition point acquisition of every a line in the point of the optical field acquisition described in M row
2D original image carry out interpolation processing, obtain M × Y target image；
In U coordinate axis direction, interpolation processing is carried out to M target image of each column in Y column target image, is obtained
X × Y target image.
Optionally, the interpolation processing includes:
For a target image to be obtained, by interpolation algorithm in U coordinate axis direction or V change in coordinate axis direction is upper
Two image interpolations in the target image two sides to be obtained obtain.
Optionally, the interpolation algorithm is linear interpolation algorithm, carries out interpolation using following formula:
Insert_image.j=alph (image.i)+bet (image. (i+1))
Wherein, Insert_image.j is target image to be obtained, and image.i and image. (i+1) are in U coordinate axis
It is located at the image of target image two sides to be obtained on direction or on V change in coordinate axis direction, the sum of alph and bet are a determining number
Value.
Optionally, one of X and Y are the line number of the pixel of the target image, another picture for the target image
The columns of element.
Optionally, in U coordinate axis direction, N arranges the M optical field acquisition points of each column in the optical field acquisition point
It is spacedly distributed, between N number of described optical field acquisition point of every a line on V change in coordinate axis direction in the point of optical field acquisition described in M row etc.
Every distribution.
The embodiment of the present invention also provides a kind of light field display device, including above-mentioned light field data restructing device.
In some embodiments of the invention, the light field display device further include:
At least two layers of display screen；
Decomposing module is connect with the light field data restructing device, for obtain the light field data restructing device
4D light field data resolves at least two display images, and at least two displays image is sent respectively to described at least two
Layer display screen is shown.
Figure 12 is please referred to, Figure 12 is that the light field display device of the embodiment of the present invention carries out the flow diagram that light field is shown,
Light field data restructing device generates 4D light field data according to the 2D original image of acquisition first, and 4D light field data is sent to point
Module is solved, the 4D light field data that the light field data restructing device obtains is resolved at least two display images by decomposing module
(two display images image1 and image2 are shown in figure), and by least two display images be sent respectively to it is described at least
Two layers of display screen is shown.
In the embodiment of the present invention, picture that at least two layers of display screen simultaneous display decomposites.
Wherein, the display screen can be liquid crystal display (LCD), or other kinds of display screen, such as have
Machine light emitting diode (OLED), miniLED, microLED display screen etc..
The theory shown below to the light field of the light field display device with two layers of display screen is illustrated:
Figure 13 is please referred to, it is every to penetrate one by the light of (u, v) point and (s, t) point on display screen 2 on display screen 1
Layer display, light intensity successively reduce, and the value of l (u, v, s, t) is (u, v) point and (s, t) on display screen 2 on display screen 1
Product, it may be assumed that
L (u, v, s, t)=f (u, v) * g (s, t)
Wherein, f, g are the transmitance distribution function of display screen 1 and display screen 2.
As shown in figure 14, Tu14Zhong is followed successively by picture 1, picture 2 and reconstruction picture from left to right.Picture 1 is exported to aobvious
Display screen 1, the output of picture 2 to display screen 2, obtains reconstruction picture, and the reconstruction picture in the embodiment of the present invention is 0 ° of 0 ° of visual angle (light field
Collection point the opposite angle (level angle and pitch angle be 0) with observation image of optical field acquisition point in the planes), it is corresponding
UV coordinate is the image of (3,3) in 5 × 5 images in Fig. 1, other visual angles are seen by display screen 1 and 2 different angle of display screen
It examines.
In the embodiment of the present invention, optionally, the identical resolution ratio of at least two layers display screen is X × Y, this kind design
It is fairly simple.
In the embodiment of the present invention, Figure 15 is please referred to, light field display device includes two layers of display screen 151, two layers of display screen 151
Between can be supported by spacer material 152.The thickness of spacer material 152 can be 5 millimeters -20 millimeters.Reality shown in figure 15
It applies in example, it further includes backlight 153 that display screen 151, which is liquid crystal display,.In order to guarantee the precise structure of light field display device,
Light field display device can also include plane supporting structure 154, positioned at the outside of backlight 153 and display screen 151.
In the embodiment of the present invention, light field display device can also include polaroid (POL), two layers adjacent of display screen
Between polaroid can share or polarizing axis is parallel.
When light field display device includes three layers of display screen, 4D light field data can be indicated using following formula:
Wherein, i, j indicate that the point on display screen 1, k, l indicate that point on the display screen 2, g, h indicate on display screen 3
Point, UiVjIndicate the transmitted light of the point i, j on display screen 1, SkTlIndicate the transmitted light of the point k, l on display screen 2, IgJh
Indicate the transmitted light of the point g, h on display screen 3.
When light field display device includes two layers of display screen, 4D light field data can be indicated using following formula:
Wherein, i, j indicate that the point on display screen 1, k, l indicate point on the display screen 2,iVjIt indicates on display screen 1
The transmitted light of point i, j, SkTlIndicate the transmitted light of the point k, l on display screen 2.
Unless otherwise defined, technical term or scientific term used in the present invention are should be in fields of the present invention
The ordinary meaning that personage with general technical ability is understood." first ", " second " used in the present invention and similar word
It is not offered as any sequence, quantity or importance, and is used only to distinguish different component parts." connection " or " connected "
It is not limited to physics or mechanical connection etc. similar word, but may include electrical connection, either directly
Or it is indirect."upper", "lower", "left", "right" etc. are only used for indicating relative positional relationship, when the absolute position for being described object
After setting change, then the relative positional relationship also correspondingly changes.
The above is a preferred embodiment of the present invention, it is noted that for those skilled in the art
For, without departing from the principles of the present invention, it can also make several improvements and retouch, these improvements and modifications
It should be regarded as protection scope of the present invention.
Claims (10)
1. a kind of light field data reconstructing method characterized by comprising
The 2D original image acquired in optical field acquisition point is obtained, the optical field acquisition point is located in UV plane right-angle coordinate, institute
The matrix that optical field acquisition point is M × N is stated, the quantity of the optical field acquisition point is less than the target image for generating 4D light field data
Quantity；
Respectively in U coordinate axis direction and V change in coordinate axis direction, to the 2D original image of M × N number of optical field acquisition point acquisition into
Row interpolation processing, obtains X × Y target image；
According to the X × Y target image, the 4D light field data is obtained.
2. light field data reconstructing method according to claim 1, which is characterized in that described respectively in U coordinate axis direction and V
On change in coordinate axis direction, interpolation processing is carried out to M × N number of optical field acquisition point acquisition 2D original image, obtains X × Y mesh
Logo image includes:
In U coordinate axis direction, the 2D of the M optical field acquisition point acquisitions of each column in the optical field acquisition point is arranged N
Original image carries out interpolation processing, obtains X × N number of target image；
On V change in coordinate axis direction, interpolation processing is carried out to N number of target image of every a line in X row target image, obtains X × Y
A target image；
Or
On V change in coordinate axis direction, the 2D of N number of optical field acquisition point acquisition of every a line in the point of the optical field acquisition described in M row
Original image carries out interpolation processing, obtains M × Y target image；
In U coordinate axis direction, interpolation processing is carried out to M target image of each column in Y column target image, obtains X × Y
A target image.
3. light field data reconstructing method according to claim 2, which is characterized in that the interpolation processing includes:
For a target image to be obtained, by interpolation algorithm to being located at institute in U coordinate axis direction or on V change in coordinate axis direction
Two image interpolations for stating target image two sides to be obtained obtain.
4. light field data reconstructing method according to claim 3, which is characterized in that the interpolation algorithm is linear interpolation calculation
Method carries out interpolation using following formula:
Insert_image.j=alph (image.i)+bet (image. (i+1))
Wherein, Insert_image.j is target image to be obtained, and image.i and image. (i+1) are in U coordinate axis direction
It is located at the image of target image two sides to be obtained on upper or V change in coordinate axis direction, the sum of alph and bet are a determining numerical value.
5. light field data reconstructing method according to claim 1, which is characterized in that one of X and Y are the target figure
The line number of the pixel of picture, the columns of another pixel for the target image.
6. light field data reconstructing method according to claim 1, which is characterized in that in U coordinate axis direction, described in N column
The M optical field acquisition points of each column in optical field acquisition point are spacedly distributed, the light field described in M row on V change in coordinate axis direction
N number of optical field acquisition point of every a line in collection point is spacedly distributed.
7. a kind of light field data restructing device characterized by comprising
Module is obtained, for obtaining the 2D original image in the acquisition of optical field acquisition point, it is straight that the optical field acquisition point is located at UV plane
In angular coordinate system, the optical field acquisition point is the matrix of M × N, and the quantity of the optical field acquisition point is less than for generating 4D light field
The quantity of the target image of data；
Interpolating module, in U coordinate axis direction and V change in coordinate axis direction, being acquired respectively to M × N number of optical field acquisition point
2D original image carry out interpolation processing, obtain X × Y target image；
Module is obtained, for obtaining the 4D light field data according to the X × Y target image.
8. a kind of light field display device, which is characterized in that including light field data restructing device as claimed in claim 7.
9. light field display device according to claim 8, which is characterized in that further include:
At least two layers of display screen；
Decomposing module is connect with the light field data restructing device, the 4D light for obtaining the light field data restructing device
Field data resolves at least two display images, and at least two displays image is sent respectively to described at least two layers and is shown
Display screen is shown.
10. light field display device according to claim 9, which is characterized in that the resolution ratio of at least two layers display screen
Identical is X × Y.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910343960.0A CN110047430B (en) | 2019-04-26 | 2019-04-26 | Light field data reconstruction method, light field data reconstruction device and light field display device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910343960.0A CN110047430B (en) | 2019-04-26 | 2019-04-26 | Light field data reconstruction method, light field data reconstruction device and light field display device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110047430A true CN110047430A (en) | 2019-07-23 |
| CN110047430B CN110047430B (en) | 2020-11-06 |
Family
ID=67279682
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910343960.0A Active CN110047430B (en) | 2019-04-26 | 2019-04-26 | Light field data reconstruction method, light field data reconstruction device and light field display device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110047430B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110989154A (en) * | 2019-11-22 | 2020-04-10 | 北京大学 | Reconstruction method for microscopic optical field volume imaging and positive process and back projection acquisition method thereof |
| CN111080774A (en) * | 2019-12-16 | 2020-04-28 | 首都师范大学 | Method and system for reconstructing light field by applying depth sampling |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080044078A1 (en) * | 2006-08-18 | 2008-02-21 | William Edward Mantzel | Data Structure Representing a Plenoptic Function via Compressible Layered Orthographic Projections from Multiple Orientations |
| CN102694972A (en) * | 2011-03-24 | 2012-09-26 | 卡西欧计算机株式会社 | Device and method including function for reconstituting image |
| US20130120319A1 (en) * | 2005-10-31 | 2013-05-16 | Extreme Reality Ltd. | Methods, Systems, Apparatuses, Circuits and Associated Computer Executable Code for Detecting Motion, Position and/or Orientation of Objects Within a Defined Spatial Region |
| US20140079336A1 (en) * | 2012-09-14 | 2014-03-20 | Pelican Imaging Corporation | Systems and methods for correcting user identified artifacts in light field images |
| CN104851129A (en) * | 2015-05-21 | 2015-08-19 | 成都绿野起点科技有限公司 | Multi-view-based 3D reconstruction method |
| CN105323423A (en) * | 2014-08-01 | 2016-02-10 | 佳能株式会社 | Image processing method, image processing apparatus, and image pickup apparatus |
| CN105607453A (en) * | 2016-03-31 | 2016-05-25 | 四川大学 | Optical scanning holographic technique without mechanical motion scanning |
| CN106161922A (en) * | 2015-04-22 | 2016-11-23 | 北京智谷睿拓技术服务有限公司 | Image acquisition control method and device |
| CN107977938A (en) * | 2017-11-24 | 2018-05-01 | 北京航空航天大学 | A kind of Kinect depth image restorative procedure based on light field |
| CN108242065A (en) * | 2017-12-26 | 2018-07-03 | 天津大学 | A kind of light field image compression sensing method based on LDPC matrixes |
| CN108364309A (en) * | 2018-02-09 | 2018-08-03 | 清华大学深圳研究生院 | A kind of spatial light field restoration methods based on hand-held light-field camera |
| CN108983483A (en) * | 2018-07-27 | 2018-12-11 | 京东方科技集团股份有限公司 | A kind of display device |
| US20190088023A1 (en) * | 2016-05-25 | 2019-03-21 | Google Llc | Light-field viewpoint and pixel culling for a head mounted display device |
| CN109510977A (en) * | 2017-09-15 | 2019-03-22 | 英特尔公司 | Three-dimensional light field panorama is generated using concentric observation circle |
-
2019
- 2019-04-26 CN CN201910343960.0A patent/CN110047430B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130120319A1 (en) * | 2005-10-31 | 2013-05-16 | Extreme Reality Ltd. | Methods, Systems, Apparatuses, Circuits and Associated Computer Executable Code for Detecting Motion, Position and/or Orientation of Objects Within a Defined Spatial Region |
| US20080044078A1 (en) * | 2006-08-18 | 2008-02-21 | William Edward Mantzel | Data Structure Representing a Plenoptic Function via Compressible Layered Orthographic Projections from Multiple Orientations |
| CN102694972A (en) * | 2011-03-24 | 2012-09-26 | 卡西欧计算机株式会社 | Device and method including function for reconstituting image |
| US20120242855A1 (en) * | 2011-03-24 | 2012-09-27 | Casio Computer Co., Ltd. | Device and method including function for reconstituting an image, and storage medium |
| US20140079336A1 (en) * | 2012-09-14 | 2014-03-20 | Pelican Imaging Corporation | Systems and methods for correcting user identified artifacts in light field images |
| CN105323423A (en) * | 2014-08-01 | 2016-02-10 | 佳能株式会社 | Image processing method, image processing apparatus, and image pickup apparatus |
| CN106161922A (en) * | 2015-04-22 | 2016-11-23 | 北京智谷睿拓技术服务有限公司 | Image acquisition control method and device |
| CN104851129A (en) * | 2015-05-21 | 2015-08-19 | 成都绿野起点科技有限公司 | Multi-view-based 3D reconstruction method |
| CN105607453A (en) * | 2016-03-31 | 2016-05-25 | 四川大学 | Optical scanning holographic technique without mechanical motion scanning |
| US20190088023A1 (en) * | 2016-05-25 | 2019-03-21 | Google Llc | Light-field viewpoint and pixel culling for a head mounted display device |
| CN109510977A (en) * | 2017-09-15 | 2019-03-22 | 英特尔公司 | Three-dimensional light field panorama is generated using concentric observation circle |
| CN107977938A (en) * | 2017-11-24 | 2018-05-01 | 北京航空航天大学 | A kind of Kinect depth image restorative procedure based on light field |
| CN108242065A (en) * | 2017-12-26 | 2018-07-03 | 天津大学 | A kind of light field image compression sensing method based on LDPC matrixes |
| CN108364309A (en) * | 2018-02-09 | 2018-08-03 | 清华大学深圳研究生院 | A kind of spatial light field restoration methods based on hand-held light-field camera |
| CN108983483A (en) * | 2018-07-27 | 2018-12-11 | 京东方科技集团股份有限公司 | A kind of display device |
Non-Patent Citations (2)
| Title |
|---|
| DAVID M. KRAMER等: "A General Algorithm for Oblique Image Reconstruction", 《IEEE COMPUTER GRAPHICS AND APPLICATIONS》 * |
| 周广福等: "基于小波变换与稀疏傅里叶变换相结合的光场重构方法", 《电子学报》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110989154A (en) * | 2019-11-22 | 2020-04-10 | 北京大学 | Reconstruction method for microscopic optical field volume imaging and positive process and back projection acquisition method thereof |
| CN111080774A (en) * | 2019-12-16 | 2020-04-28 | 首都师范大学 | Method and system for reconstructing light field by applying depth sampling |
| WO2021121037A1 (en) * | 2019-12-16 | 2021-06-24 | 首都师范大学 | Method and system for reconstructing light field by applying depth sampling |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110047430B (en) | 2020-11-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9924153B2 (en) | Parallel scaling engine for multi-view 3DTV display and method thereof | |
| DE102015003525B4 (en) | Super-resolution display using cascaded panels | |
| CN108776388B (en) | Double-view 3D display device and method based on gradient slit grating | |
| CN105182555B (en) | Based on gradual-change bore diameter pinhole array without crosstalk integration imaging 3D display device | |
| CN112987332B (en) | High-resolution grating stereo display device | |
| CN110047430A (en) | Light field data reconstructing method, light field data restructing device and light field display device | |
| CN111856774B (en) | High-resolution and high-optical-efficiency double-vision 3D display device and method | |
| CN104104939A (en) | Wide viewing angle integrated imaging three-dimensional display system | |
| CN104811686A (en) | Hardware implementation method for floating-point type multi-view naked-eye three-dimensional synthetic image | |
| CN102238411A (en) | Image display method for reflecting three-dimensional display | |
| CN104574507A (en) | Three-dimensional entity construction method based on multiple tomography images | |
| CN110322424A (en) | High-definition picture processing method and device, VR image display method and VR equipment | |
| CN106991637B (en) | Method for realizing multi-resolution light field decomposition by utilizing GPU (graphics processing Unit) parallel computation | |
| CN112866676B (en) | Naked eye three-dimensional display algorithm based on single-pixel multi-view reconstruction | |
| Guarnieri et al. | Image-splitting techniques for a dual-layer high dynamic range LCD display | |
| CN209946543U (en) | High-resolution double-vision 3D display device | |
| CN209311807U (en) | High-resolution integration imaging 3D display device without crosstalk | |
| CN105629492A (en) | Integrated imaging double-vision 3D display device and integrated imaging double-vision 3D display system based on polarizing film and polarized glasses | |
| CN212276128U (en) | High-resolution and high-optical-efficiency dual-view 3D display device | |
| CN114879377A (en) | Parameter determination method, device and equipment of horizontal parallax three-dimensional light field display system | |
| CN108919506B (en) | Dual-view 3D display device and method | |
| CN111781745A (en) | High resolution and full parallax 3D display device and method | |
| CN111781734A (en) | Double-view 3D display device and method based on double display screens | |
| CN214751138U (en) | Device based on compound ladder gradual change pinhole array | |
| CN105721816B (en) | Display data processing method and display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |