CN106154567B - A kind of imaging method and device of 3 d light fields display system - Google Patents

A kind of imaging method and device of 3 d light fields display system Download PDF

Info

Publication number
CN106154567B
CN106154567B CN201610565597.3A CN201610565597A CN106154567B CN 106154567 B CN106154567 B CN 106154567B CN 201610565597 A CN201610565597 A CN 201610565597A CN 106154567 B CN106154567 B CN 106154567B
Authority
CN
China
Prior art keywords
parallax image
pixel
index
light field
preset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610565597.3A
Other languages
Chinese (zh)
Other versions
CN106154567A (en
Inventor
桑新柱
于迅博
邢树军
余重秀
颜玢玢
王葵如
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing University of Posts and Telecommunications
Original Assignee
Beijing University of Posts and Telecommunications
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing University of Posts and Telecommunications filed Critical Beijing University of Posts and Telecommunications
Priority to CN201610565597.3A priority Critical patent/CN106154567B/en
Publication of CN106154567A publication Critical patent/CN106154567A/en
Application granted granted Critical
Publication of CN106154567B publication Critical patent/CN106154567B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/26Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
    • G02B30/27Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type involving lenticular arrays

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

本发明实施例提供了一种三维光场显示系统的成像方法及装置,其中,成像方法包括:获取并根据光场显示信息,通过第一预设关系,确定采集信息;根据光场显示信息及采集信息,设置三维光场显示系统,并采集得到视差图像阵列;根据视差图像的数目及预先建立的第一像素索引,通过预设索引公式,确定与第一像素索引对应的视差图像索引;根据视差图像阵列中视差图像的预设像素数目、液晶显示面板信息及第一像素索引,通过预设像素确定公式,确定与第一像素索引对应的视差图像像素索引;将视差图像像素索引对应的像素值,填充至第一像素索引处,得到并三维显示成像图像。应用本发明实施例,得到的三维图像无深度翻转现象,且结构简单、成像误差小。

Embodiments of the present invention provide an imaging method and device for a three-dimensional light field display system, wherein the imaging method includes: acquiring and displaying information according to the light field, and determining the collection information through a first preset relationship; displaying information according to the light field and Collecting information, setting up a three-dimensional light field display system, and collecting a parallax image array; according to the number of parallax images and the pre-established first pixel index, through a preset index formula, determine the parallax image index corresponding to the first pixel index; The number of preset pixels of the parallax image in the parallax image array, the information of the liquid crystal display panel and the first pixel index, determine the pixel index of the parallax image corresponding to the first pixel index through the preset pixel determination formula; the corresponding pixel of the parallax image pixel index The value is filled to the first pixel index, and the imaging image is obtained and displayed in 3D. By applying the embodiment of the present invention, the obtained three-dimensional image has no depth reversal phenomenon, and has a simple structure and small imaging error.

Description

一种三维光场显示系统的成像方法及装置Imaging method and device for a three-dimensional light field display system

技术领域technical field

本发明涉及三维光场显示技术领域,特别涉及一种三维光场显示系统的成像方法及装置。The invention relates to the technical field of three-dimensional light field display, in particular to an imaging method and device for a three-dimensional light field display system.

背景技术Background technique

随着当今科学技术的飞速发展,传统的二维平面显示技术已经远远无法满足目前各个行业领域对于深度数据与空间立体感的需求。越来越多的应用领域,如医学成像、科学研究、外太空探索、重要远程会议和军事等,要求能够实现三维场景的真实重建,从而使得观看者可以更加精确的捕获相关信息,准确的进行现场判断。自由立体显示技术可以使观看者通过肉眼直接体验三维视觉,使三维图像更加逼真显示真实图像。With the rapid development of today's science and technology, the traditional two-dimensional flat display technology is far from being able to meet the current needs of various industries for depth data and three-dimensional space. More and more application fields, such as medical imaging, scientific research, outer space exploration, important teleconferences and military affairs, etc., require the real reconstruction of 3D scenes, so that the viewer can capture relevant information more accurately and accurately conduct Judgment on the spot. Autostereoscopic display technology can enable viewers to directly experience three-dimensional vision through the naked eye, making three-dimensional images more realistic and displaying real images.

光场显示作为自由立体显示技术的一种,代表是集成成像三维显示,由Lippmann提出的IP(integral photography,集成摄影)技术发展而来,该技术可以为观众提供全视差的自由立体效果。图1为现有技术的集成成像的原理图,采集子系统101利用透镜阵列和感光元件捕获空间中的三维光场,重建子系统102将编码图像加载到显示设备上,并通过透镜阵列显示,可以再现记录的三维场景。现有技术的集成成像在重建三维场景时会出现深度翻转的现象。针对解决深度翻转的现象的方案,实现方式复杂,且具有较大的成像误差。As a kind of autostereoscopic display technology, light field display is represented by integrated imaging three-dimensional display, developed from the IP (integral photography, integrated photography) technology proposed by Lippmann, which can provide viewers with full parallax autostereoscopic effect. FIG. 1 is a schematic diagram of integrated imaging in the prior art. The acquisition subsystem 101 uses lens arrays and photosensitive elements to capture the three-dimensional light field in space, and the reconstruction subsystem 102 loads the coded image onto the display device and displays it through the lens array. Recorded 3D scenes can be reproduced. In the integrated imaging of the prior art, depth flipping occurs when reconstructing a 3D scene. For the solution to the phenomenon of depth flipping, the implementation method is complicated and has a large imaging error.

发明内容Contents of the invention

本发明实施例的目的在于提供一种三维光场显示系统的成像方法及装置,能够实现结构简单且误差小的无深度翻转现象的三维光场显示。The purpose of the embodiments of the present invention is to provide an imaging method and device for a three-dimensional light field display system, which can realize a three-dimensional light field display with simple structure and small error without depth flip phenomenon.

为达到上述目的,本发明实施例公开了一种三维光场显示系统的成像方法,包括:To achieve the above purpose, an embodiment of the present invention discloses an imaging method for a three-dimensional light field display system, including:

获取并根据光场显示信息,通过第一预设关系,确定光场显示系统的采集信息,其中,所述光场显示信息至少包括:每个透镜下覆盖的像素数目,所述第一预设关系为所述光场显示信息与所述采集信息的关系;Acquiring and determining the collection information of the light field display system according to the light field display information through a first preset relationship, wherein the light field display information at least includes: the number of pixels covered by each lens, the first preset The relationship is the relationship between the light field display information and the collected information;

根据所述光场显示信息及所述采集信息,设置所述三维光场显示系统;Setting the three-dimensional light field display system according to the light field display information and the collection information;

在所述三维光场显示系统中,采集得到视差图像阵列,其中,所述视差图像阵列由包含有预设数目个像素的多个视差图像排列组成,所述视差图像的数目与所述每个透镜下覆盖的像素数目相同;In the three-dimensional light field display system, a parallax image array is collected, wherein the parallax image array is composed of a plurality of parallax image arrangements containing a preset number of pixels, and the number of the parallax images is the same as that of each The number of pixels covered under the lens is the same;

根据所述视差图像的数目及预先建立的第一像素索引,通过预设索引公式,确定与所述第一像素索引对应的视差图像索引,其中,所述第一像素索引为待成像图像中的任一像素位置;According to the number of the parallax images and the pre-established first pixel index, the parallax image index corresponding to the first pixel index is determined through a preset index formula, wherein the first pixel index is the image to be imaged any pixel position;

根据所述视差图像阵列中所述视差图像的预设像素数目、液晶显示面板信息及所述第一像素索引,通过预设像素确定公式,确定与所述第一像素索引对应的视差图像像素索引,其中,所述视差图像像素索引为所述视差图像索引对应的视差图像中任一像素位置;According to the preset pixel number of the parallax image in the parallax image array, the liquid crystal display panel information and the first pixel index, determine the parallax image pixel index corresponding to the first pixel index through a preset pixel determination formula , wherein the parallax image pixel index is any pixel position in the parallax image corresponding to the parallax image index;

将所述视差图像像素索引对应的像素值,填充至所述第一像素索引处,得到并三维显示成像图像。Filling the pixel value corresponding to the parallax image pixel index to the first pixel index to obtain and three-dimensionally display the imaging image.

较佳的,所述光场显示信息至少还包括:透镜阵列的总宽度,成像区域的总宽度及所述透镜阵列到所述成像区域的距离;Preferably, the light field display information at least further includes: the total width of the lens array, the total width of the imaging area, and the distance from the lens array to the imaging area;

所述采集信息至少包括:被采集的三维场景的宽度、相机阵列的总宽度、所述相机阵列中所有相机的光轴交点到所述相机阵列的距离及所述相机的数目;以及The collection information includes at least: the width of the three-dimensional scene to be collected, the total width of the camera array, the distance from the intersection of the optical axes of all cameras in the camera array to the camera array, and the number of cameras; and

所述液晶显示面板信息至少包括:液晶显示面板宽度及液晶显示面板高度。The liquid crystal display panel information at least includes: the width of the liquid crystal display panel and the height of the liquid crystal display panel.

较佳的,所述第一预设关系为:Preferably, the first preset relationship is:

以及 as well as

M=M0M=M 0 ,

其中,所述D为透镜阵列的总宽度,所述D0为被采集的三维场景的宽度,所述W为成像区域的总宽度,所述W0为相机阵列的总宽度,所述L为所述透镜阵列到所述成像区域的距离,所述L0为所述相机阵列中所有相机的光轴交点到所述相机阵列的距离,所述M为所述相机的数目,所述M0为所述每个透镜下覆盖的像素数目。Wherein, the D is the total width of the lens array, the D 0 is the width of the collected three-dimensional scene, the W is the total width of the imaging area, the W 0 is the total width of the camera array, and the L is The distance from the lens array to the imaging area, the L 0 is the distance from the intersection of the optical axes of all cameras in the camera array to the camera array, the M is the number of the cameras, and the M 0 is the number of pixels covered under each lens.

较佳的,所述在所述三维光场显示系统中,采集得到视差图像阵列,包括:Preferably, in the 3D light field display system, the collected parallax image array includes:

在所述三维光场显示系统中,通过相机离轴拍摄采集得到视差图像阵列。In the three-dimensional light field display system, a parallax image array is obtained by off-axis shooting with a camera.

较佳的,所述透镜阵列的排列形状为矩形。Preferably, the arrangement shape of the lens array is a rectangle.

较佳的,所述视差图像阵列的排列形状与所述透镜阵列的排列形状相同。Preferably, the arrangement shape of the parallax image array is the same as the arrangement shape of the lens array.

较佳的,所述预设索引公式为:Preferably, the preset index formula is:

(i,j)=(y-(y-1)mod[N]·N,x-(x-1)mod[N]·N),(i,j)=(y-(y-1)mod[N] N, x-(x-1)mod[N] N),

其中,所述(i,j)为所述视差图像索引且为所述视差图像在所述视差图像阵列中第i行、第j列的位置,所述y为所述第一像素索引中的纵向位置编号,所述N为所述视差图像的数目的横向数据或纵向数据,所述x为所述第一像素索引中的横向位置编号,所述i、所述j、所述x、所述y及所述N分别为大于0的自然数。Wherein, the (i, j) is the parallax image index and is the position of the parallax image in the i-th row and the j-th column in the parallax image array, and the y is in the first pixel index The vertical position number, the N is the horizontal data or the vertical data of the number of the parallax image, the x is the horizontal position number in the first pixel index, the i, the j, the x, the The y and the N are natural numbers greater than 0 respectively.

较佳的,所述预设像素确定公式为:Preferably, the preset pixel determination formula is:

其中,所述(x0,y0)为与所述第一像素索引对应的视差图像像素索引且为所述视差图像索引对应的视差图像中任一像素在所述视差图像中的第x0行、第y0列的位置,所述x为所述第一像素索引中的横向位置编号,所述wcode为液晶显示面板的宽度,所述w为所述预设像素数目的横向数据,所述y为所述第一像素索引中的纵向位置编号,所述h为所述预设像素数目的纵向数据,所述hcode为液晶显示面板的高度,所述x0、所述y0、所述x、所述y、所述w、所述h、所述wcode及所述hcode分别为大于0的自然数。Wherein, the (x 0 , y 0 ) is the parallax image pixel index corresponding to the first pixel index and is the x 0th of any pixel in the parallax image corresponding to the parallax image index in the parallax image The position of the row and the y0th column, the x is the horizontal position number in the first pixel index, the w code is the width of the liquid crystal display panel, and the w is the horizontal data of the preset number of pixels, The y is the vertical position number in the first pixel index, the h is the vertical data of the preset number of pixels, the h code is the height of the liquid crystal display panel, the x 0 and the y 0 , the x, the y, the w, the h, the w code and the h code are respectively natural numbers greater than 0.

较佳的,所述将所述视差图像像素对应的像素值,填充至所述第一像素索引处,得到并三维显示成像图像,包括:Preferably, filling the pixel values corresponding to the parallax image pixels to the first pixel index to obtain and three-dimensionally display the imaging image includes:

将所述视差图像像素对应的像素值,填充至所述第一像素索引处,得到成像图像,并通过透镜阵列三维显示所述成像图像。Filling the pixel values corresponding to the parallax image pixels to the first pixel index to obtain an imaging image, and three-dimensionally displaying the imaging image through a lens array.

为达到上述目的,本发明实施例还公开了一种三维光场显示系统的成像装置,包括:To achieve the above purpose, the embodiment of the present invention also discloses an imaging device for a three-dimensional light field display system, including:

采集信息确定模块,用于获取并根据光场显示信息,通过第一预设关系,确定光场显示系统的采集信息,其中,所述光场显示信息至少包括:每个透镜下覆盖的像素数目,所述第一预设关系为所述光场显示信息与所述采集信息的关系;The acquisition information determination module is configured to obtain and determine the acquisition information of the light field display system according to the light field display information through a first preset relationship, wherein the light field display information at least includes: the number of pixels covered by each lens , the first preset relationship is the relationship between the light field display information and the collection information;

系统设置模块,用于根据所述光场显示信息及所述采集信息,设置所述三维光场显示系统;A system setting module, configured to set the three-dimensional light field display system according to the light field display information and the collection information;

视差图像采集模块,用于在所述三维光场显示系统中,采集得到视差图像阵列,其中,所述视差图像阵列由包含有预设数目个像素的多个视差图像排列组成,所述视差图像的数目与所述每个透镜下覆盖的像素数目相同;A parallax image acquisition module, configured to acquire a parallax image array in the three-dimensional light field display system, wherein the parallax image array is composed of a plurality of parallax image arrangements containing a preset number of pixels, and the parallax image The number is the same as the number of pixels covered under each lens;

第一索引确定模块,用于根据所述视差图像的数目及预先建立的第一像素索引,通过预设索引公式,确定与所述第一像素索引对应的视差图像索引,其中,所述第一像素索引为待成像图像中的任一像素位置;The first index determination module is configured to determine the parallax image index corresponding to the first pixel index through a preset index formula according to the number of the parallax images and the pre-established first pixel index, wherein the first The pixel index is any pixel position in the image to be imaged;

第二索引确定模块,用于根据所述视差图像阵列中所述视差图像的预设像素数目、液晶显示面板信息及所述第一像素索引,通过预设像素确定公式,确定与所述第一像素索引对应的视差图像像素索引,其中,所述视差图像像素索引为所述视差图像索引对应的视差图像中任一像素位置;The second index determination module is configured to determine the number of pixels related to the first pixel by a preset pixel determination formula according to the preset number of pixels of the parallax image in the parallax image array, the information of the liquid crystal display panel, and the first pixel index. A parallax image pixel index corresponding to the pixel index, wherein the parallax image pixel index is any pixel position in the parallax image corresponding to the parallax image index;

三维显示模块,用于将所述视差图像像素索引对应的像素值,填充至所述第一像素索引处,得到并三维显示成像图像。The three-dimensional display module is configured to fill the pixel value corresponding to the pixel index of the parallax image into the first pixel index to obtain and three-dimensionally display the imaging image.

由上述的技术方案可见,本发明实施例通过预设第一关系采集得到视差图像阵列,利用预设的索引关系经像素填充得到了成像图像的三维显示,采集的视差图像阵列只通过索引关系便可得到三维图像,得到的三维图像无深度翻转的问题,由于成像过程不需要进行二次成像,因此本方案的结构简单,并且因为只通过一个透镜阵列成像,有效的减小了成像误差。当然,实施本发明的第一产品或方法必不一定需要同时达到以上所述的所有优点。It can be seen from the above technical solution that the embodiment of the present invention acquires the parallax image array by presetting the first relationship, and obtains the three-dimensional display of the imaging image through pixel filling by using the preset index relationship, and the collected parallax image array can be easily Three-dimensional images can be obtained, and the obtained three-dimensional images do not have the problem of depth flipping. Since the imaging process does not require secondary imaging, the structure of this solution is simple, and because only one lens array is used for imaging, the imaging error is effectively reduced. Of course, implementing the first product or method of the present invention does not necessarily need to achieve all the above-mentioned advantages at the same time.

附图说明Description of drawings

为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

图1为现有技术的集成成像的原理图;Fig. 1 is the schematic diagram of the integrated imaging of prior art;

图2为本发明实施例的三维光场显示系统的成像方法的流程示意图;2 is a schematic flowchart of an imaging method of a three-dimensional light field display system according to an embodiment of the present invention;

图3为本发明实施例的光场显示系统的显示端示意图;3 is a schematic diagram of a display terminal of a light field display system according to an embodiment of the present invention;

图4为本发明实施例的光场显示系统的采集端示意图;FIG. 4 is a schematic diagram of an acquisition end of a light field display system according to an embodiment of the present invention;

图5为本发明实施例的视差图像阵列与待成像图像示意图;5 is a schematic diagram of a parallax image array and an image to be imaged according to an embodiment of the present invention;

图6为本发明实施例的三维光场显示系统的成像装置的结构示意图。FIG. 6 is a schematic structural diagram of an imaging device of a three-dimensional light field display system according to an embodiment of the present invention.

具体实施方式Detailed ways

下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

图2为本发明实施例的三维光场显示系统的成像方法的流程示意图,成像方法包括:FIG. 2 is a schematic flow chart of an imaging method of a three-dimensional light field display system according to an embodiment of the present invention. The imaging method includes:

步骤201,获取并根据光场显示信息,通过第一预设关系,确定光场显示系统的采集信息。Step 201, acquire and determine the collection information of the light field display system according to the light field display information through a first preset relationship.

优选的,所述光场显示信息至少包括:每个透镜下覆盖的像素数目,所述第一预设关系为所述光场显示信息与所述采集信息的关系。Preferably, the light field display information at least includes: the number of pixels covered by each lens, and the first preset relationship is the relationship between the light field display information and the collection information.

本发明实施例中,采用第一预设关系,确定系统的采集信息,用于给系统的布置提供条件,采集得到所需要的视差图像阵列。In the embodiment of the present invention, the first preset relationship is used to determine the acquisition information of the system, which is used to provide conditions for the arrangement of the system, and acquire the required parallax image array.

步骤202,根据所述光场显示信息及所述采集信息,设置所述三维光场显示系统。Step 202, setting the 3D light field display system according to the light field display information and the collection information.

步骤203,在所述三维光场显示系统中,采集得到视差图像阵列。Step 203, in the 3D light field display system, acquire a parallax image array.

优选的,所述视差图像阵列由包含有预设数目个像素的多个视差图像排列组成,所述视差图像的数目与所述每个透镜下覆盖的像素数目相同。Preferably, the parallax image array is composed of a plurality of parallax image arrangements including a preset number of pixels, and the number of the parallax images is the same as the number of pixels covered by each lens.

步骤204,根据所述视差图像的数目及预先建立的第一像素索引,通过预设索引公式,确定与所述第一像素索引对应的视差图像索引。Step 204, according to the number of the parallax images and the pre-established first pixel index, determine the parallax image index corresponding to the first pixel index through a preset index formula.

优选的,所述第一像素索引为待成像图像中的任一像素位置。Preferably, the first pixel index is any pixel position in the image to be imaged.

步骤205,根据所述视差图像阵列中所述视差图像的预设像素数目、液晶显示面板信息及所述第一像素索引,通过预设像素确定公式,确定与所述第一像素索引对应的视差图像像素索引。Step 205, according to the preset number of pixels of the parallax image in the parallax image array, the information of the liquid crystal display panel and the first pixel index, determine the parallax corresponding to the first pixel index through a preset pixel determination formula Image pixel index.

优选的,所述视差图像像素索引为所述视差图像索引对应的视差图像中任一像素位置。Preferably, the parallax image pixel index is any pixel position in the parallax image corresponding to the parallax image index.

本发明实施例中,通过预先建立的第一像素索引,将待成像图像的任一个像素位置索引到视差图像阵列中的任一视差图像位置,再通过像素确定公式,确定所述任一视差图像中的任一像素位置,本实施例不需要通过复杂的硬件实现,结构简单,减小了硬件成本。In the embodiment of the present invention, any pixel position of the image to be imaged is indexed to any parallax image position in the parallax image array through the pre-established first pixel index, and then any parallax image is determined through the pixel determination formula Any pixel position in this embodiment does not need to be realized by complicated hardware, and has a simple structure, which reduces hardware cost.

步骤206,将所述视差图像像素索引对应的像素值,填充至所述第一像素索引处,得到并三维显示成像图像。Step 206, filling the pixel value corresponding to the pixel index of the parallax image to the first pixel index to obtain and three-dimensionally display the imaging image.

本发明实施例,采用第一预设关系,确定系统的采集信息,用于给系统的布置提供条件,这样采集得到需要的视差图像阵列,通过预先建立的第一像素索引,将待成像图像的任一个像素位置索引到视差图像阵列中的任一视差图像位置,再通过像素确定公式,确定所述任一视差图像中的任一像素位置,再将所述任一像素位置的像素值填充至待成像图像,得到并三维显示成像图像,上述的过程不需要通过复杂的硬件实现,结构简单,减小了硬件成本,并且本发明实施例只需经过一次透镜成像,能够有效的减小成像误差且成像为实像。In the embodiment of the present invention, the first preset relationship is used to determine the acquisition information of the system, which is used to provide conditions for the arrangement of the system, so that the required parallax image array is obtained by acquisition, and the image to be imaged is divided by the pre-established first pixel index Any pixel position is indexed to any parallax image position in the parallax image array, and then any pixel position in any parallax image is determined through the pixel determination formula, and then the pixel value of any pixel position is filled into The image to be imaged is obtained and three-dimensionally displayed. The above-mentioned process does not need to be realized by complex hardware, the structure is simple, and the hardware cost is reduced. In addition, the embodiment of the present invention only needs to go through lens imaging once, which can effectively reduce the imaging error. And the image is a real image.

图3为本发明实施例的光场显示系统的显示端示意图。FIG. 3 is a schematic diagram of a display terminal of a light field display system according to an embodiment of the present invention.

图中给出了光场显示信息,M0为透镜阵列302中每个透镜下覆盖的像素数目,D为透镜阵列302的总宽度,W为成像区域的总宽度,所述L为透镜阵列302到所述成像区域的距离。The light field display information is given in the figure, M 0 is the number of pixels covered under each lens in the lens array 302, D is the total width of the lens array 302, W is the total width of the imaging area, and the L is the lens array 302 The distance to the imaging area.

优选的,本发明实施例中,透镜阵列302的排列形状为矩形,且透镜阵列302中每个透镜下覆盖的像素数目为N×N。Preferably, in the embodiment of the present invention, the lens array 302 is arranged in a rectangular shape, and the number of pixels covered by each lens in the lens array 302 is N×N.

当然,本领域的技术人员可以得知,除了上述透镜阵列的排列形状为矩形以外,透镜阵列的排列形状还可以为例如蜂窝形的其它形状,在此不一一举例。Of course, those skilled in the art can know that, in addition to the arrangement shape of the above-mentioned lens array being rectangular, the arrangement shape of the lens array can also be other shapes such as a honeycomb shape, which will not be exemplified here.

本发明实施例中,获取上述数据,为了通过预设关系得到光场显示系统的采集信息,根据采集信息及显示信息,采集得到的视差图像阵列,可以通过预设索引关系,进行像素填充得到液晶显示面板301上的成像图像,成像图像经透镜阵列302呈现三维图像。In the embodiment of the present invention, to obtain the above data, in order to obtain the acquisition information of the light field display system through the preset relationship, the parallax image array acquired according to the acquisition information and display information can be filled with pixels through the preset index relationship to obtain the liquid crystal The imaging image on the display panel 301 presents a three-dimensional image through the lens array 302 .

图4为本发明实施例的光场显示系统的采集端示意图。FIG. 4 is a schematic diagram of a collection end of a light field display system according to an embodiment of the present invention.

图中给出了光场显示系统的采集信息,D0为被采集的三维场景401的宽度,W0为相机阵列402的总宽度,L0为所述相机阵列402中所有相机的光轴交点到所述相机阵列402的距离。The figure shows the acquisition information of the light field display system, D 0 is the width of the captured three-dimensional scene 401, W 0 is the total width of the camera array 402, L 0 is the intersection point of the optical axes of all cameras in the camera array 402 The distance to the camera array 402.

本发明实施例中的采集信息,根据光场显示信息及第一预设关系得到。The collection information in the embodiment of the present invention is obtained according to the light field display information and the first preset relationship.

优选的,所述第一预设关系为:Preferably, the first preset relationship is:

以及 as well as

M=M0M=M 0 ,

其中,所述D为透镜阵列302的总宽度,所述D0为被采集的三维场景401的宽度,所述W为成像区域的总宽度,所述W0为相机阵列402的总宽度,所述L为透镜阵列302到所述成像区域的距离,所述L0为相机阵列402中所有相机的光轴交点到相机阵列402的距离,所述M为相机阵列402中相机的数目,所述M0为透镜阵列302中每个透镜下覆盖的像素数目。Wherein, the D is the total width of the lens array 302, the D 0 is the width of the collected three-dimensional scene 401, the W is the total width of the imaging area, and the W 0 is the total width of the camera array 402, so Said L is the distance from the lens array 302 to the imaging area, said L0 is the distance from the intersection of the optical axes of all cameras in the camera array 402 to the camera array 402, and said M is the number of cameras in the camera array 402, said M 0 is the number of pixels covered by each lens in the lens array 302 .

本发明实施例中,根据光场显示信息,通过第一预设关系,得到光场显示系统的采集信息,根据采集信息及显示信息,离轴采集得到的视差图像阵列,可以通过预设索引关系,进行像素填充得到液晶显示面板301上的成像图像,经透镜阵列302呈现三维图像。In the embodiment of the present invention, according to the light field display information, the acquisition information of the light field display system is obtained through the first preset relationship, and the parallax image array obtained by off-axis acquisition according to the acquisition information and display information can be obtained through the preset index relationship , pixel filling is performed to obtain an imaging image on the liquid crystal display panel 301 , and a three-dimensional image is presented through the lens array 302 .

优选的,本发明实施例中,通过相机离轴拍摄采集得到视差图像阵列。Preferably, in the embodiment of the present invention, the parallax image array is obtained by off-axis shooting with the camera.

当然,本领域的技术人员可以得知,除了上述通过相机离轴拍摄采集得到视差图像阵列以外,还可以通过其他方式拍摄,然后将拍摄的图像矫正为离轴效果的方式采集得到视差图像阵列。Of course, those skilled in the art can know that, in addition to the parallax image array obtained by off-axis shooting with the camera, the parallax image array can also be obtained by shooting in other ways, and then correcting the captured image to an off-axis effect.

优选的,本发明实施例中,视差图像阵列的排列形状与透镜阵列的排列形状相同,视差图像的数目与所述每个透镜下覆盖的像素数目相同。Preferably, in the embodiment of the present invention, the arrangement shape of the parallax image array is the same as that of the lens array, and the number of parallax images is the same as the number of pixels covered by each lens.

图5为本发明实施例的视差图像阵列与待成像图像示意图。FIG. 5 is a schematic diagram of a parallax image array and an image to be imaged according to an embodiment of the present invention.

本发明实施例提供了根据采集得到的视差图像阵列,通过索引关系得到液晶显示面板上的成像图像,所述成像图像通过透镜阵列进行三维显示,得到没有深度翻转现象的三维图像。根据所述视差图像阵列得到所述成像图像的过程包括:The embodiment of the present invention provides that according to the collected parallax image array, the imaging image on the liquid crystal display panel is obtained through the index relationship, and the imaging image is three-dimensionally displayed through the lens array to obtain a three-dimensional image without depth flipping phenomenon. The process of obtaining the imaging image according to the parallax image array includes:

首先,根据视差图像阵列501中视差图像的数目N×N及预先建立的第一像素索引(x,y),通过预设索引公式,确定与第一像素索引(x,y)对应的视差图像索引。First, according to the number N×N of parallax images in the parallax image array 501 and the pre-established first pixel index (x, y), the parallax image corresponding to the first pixel index (x, y) is determined through a preset index formula index.

优选的,所述第一像素索引(x,y)为待成像图像502中的任一像素位置。Preferably, the first pixel index (x, y) is any pixel position in the image to be imaged 502 .

优选的,所述预设索引公式为:Preferably, the preset index formula is:

(i,j)=(y-(y-1)mod[N]·N,x-(x-1)mod[N]·N),(i,j)=(y-(y-1)mod[N] N, x-(x-1)mod[N] N),

其中,所述(i,j)为视差图像索引且为视差图像在视差图像阵列501中第i行、第j列的位置,所述y为第一像素索引中的纵向位置编号,所述N为所述视差图像的数目的横向数据或纵向数据,所述x为所述第一像素索引中的横向位置编号,所述i、所述j、所述x、所述y及所述N分别为大于0的自然数。Wherein, the (i, j) is the parallax image index and is the position of the i-th row and the j-th column of the parallax image in the parallax image array 501, the y is the vertical position number in the first pixel index, and the N is the horizontal data or vertical data of the number of parallax images, the x is the horizontal position number in the first pixel index, the i, the j, the x, the y and the N are respectively is a natural number greater than 0.

其次,根据视差图像阵列501中视差图像的预设像素数目、液晶显示面板信息及所述第一像素索引,通过预设像素确定公式,确定与所述第一像素索引对应的视差图像像素索引。Secondly, according to the preset pixel number of the parallax image in the parallax image array 501 , the information of the liquid crystal display panel and the first pixel index, the parallax image pixel index corresponding to the first pixel index is determined through a preset pixel determination formula.

优选的,所述预设像素确定公式为:Preferably, the preset pixel determination formula is:

其中,所述(x0,y0)为与第一像素索引对应的视差图像像素索引且为所述视差图像索引对应的视差图像中任一像素在所述视差图像中的第x0行、第y0列的位置,所述x为所述第一像素索引中的横向位置编号,所述wcode为液晶显示面板的宽度,所述w为所述预设像素数目的横向数据,所述y为所述第一像素索引中的纵向位置编号,所述h为所述预设像素数目的纵向数据,所述hcode为液晶显示面板的高度,所述x0、所述y0、所述x、所述y、所述w、所述h、所述wcode及所述hcode分别为大于0的自然数。Wherein, the (x 0 , y 0 ) is the parallax image pixel index corresponding to the first pixel index and is the x 0th row of any pixel in the parallax image corresponding to the parallax image index in the parallax image, The position of the y 0th column, the x is the horizontal position number in the first pixel index, the w code is the width of the liquid crystal display panel, the w is the horizontal data of the preset number of pixels, the y is the vertical position number in the first pixel index, the h is the vertical data of the preset number of pixels, the h code is the height of the liquid crystal display panel, the x 0 , the y 0 , the The x, the y, the w, the h, the w code and the h code are natural numbers greater than 0, respectively.

再次,将所述视差图像像素索引对应的像素值,填充至所述第一像素索引处,得到液晶显示面板上的成像图像Again, filling the pixel value corresponding to the pixel index of the parallax image to the first pixel index to obtain the imaging image on the liquid crystal display panel

本发明实施例,通过预设索引公式,将待成像图像的任一个像素位置索引到视差图像阵列中的任一视差图像位置,再通过预设像素确定公式,确定所述任一视差图像中的任一像素位置,再将所述任一像素位置的像素值填充至待成像图像中,得到并三维显示成像图像,上述的索引关系不需要通过复杂的硬件实现,结构简单,减小了硬件成本,并且本发明实施例只需经过一次透镜成像,能够有效的减小成像误差且成像为实像。In the embodiment of the present invention, any pixel position of the image to be imaged is indexed to any parallax image position in the parallax image array by a preset index formula, and then the pixel position in any parallax image is determined by a preset pixel determination formula. Any pixel position, and then fill the pixel value of any pixel position into the image to be imaged to obtain and three-dimensionally display the imaged image, the above-mentioned index relationship does not need to be realized by complex hardware, the structure is simple, and the hardware cost is reduced , and the embodiment of the present invention only needs one lens imaging, which can effectively reduce the imaging error and form a real image.

图6为本发明实施例的三维光场显示系统的成像装置的结构示意图,包括:6 is a schematic structural diagram of an imaging device of a three-dimensional light field display system according to an embodiment of the present invention, including:

采集信息确定模块601,用于获取并根据光场显示信息,通过第一预设关系,确定光场显示系统的采集信息,其中,所述光场显示信息至少包括:每个透镜下覆盖的像素数目,所述第一预设关系为所述光场显示信息与所述采集信息的关系。The acquisition information determination module 601 is configured to obtain and determine the acquisition information of the light field display system according to the light field display information through a first preset relationship, wherein the light field display information at least includes: pixels covered under each lens number, the first preset relationship is the relationship between the light field display information and the collection information.

系统设置模块602,用于根据所述光场显示信息及所述采集信息,设置所述三维光场显示系统。A system setting module 602, configured to set the 3D light field display system according to the light field display information and the collection information.

视差图像采集模块603,用于在所述三维光场显示系统中,采集得到视差图像阵列,其中,所述视差图像阵列由包含有预设数目个像素的多个视差图像排列组成,所述视差图像的数目与所述每个透镜下覆盖的像素数目相同。The parallax image acquisition module 603 is configured to acquire a parallax image array in the three-dimensional light field display system, wherein the parallax image array is composed of a plurality of parallax image arrangements including a preset number of pixels, and the parallax image The number of images is the same as the number of pixels covered under each lens.

第一索引确定模块604,用于根据所述视差图像的数目及预先建立的第一像素索引,通过预设索引公式,确定与所述第一像素索引对应的视差图像索引,其中,所述第一像素索引为待成像图像中的任一像素位置。The first index determination module 604 is configured to determine a parallax image index corresponding to the first pixel index according to the number of the parallax images and the pre-established first pixel index, through a preset index formula, wherein the first pixel index A pixel index is any pixel position in the image to be imaged.

第二索引确定模块605,用于根据所述视差图像阵列中所述视差图像的预设像素数目、液晶显示面板信息及所述第一像素索引,通过预设像素确定公式,确定与所述第一像素索引对应的视差图像像素索引,其中,所述视差图像像素索引为所述视差图像索引对应的视差图像中任一像素位置。The second index determination module 605 is configured to determine, according to the preset number of pixels of the parallax image in the parallax image array, the information of the liquid crystal display panel, and the first pixel index, through a preset pixel determination formula, to determine the number of pixels corresponding to the first pixel. A parallax image pixel index corresponding to a pixel index, wherein the parallax image pixel index is any pixel position in the parallax image corresponding to the parallax image index.

三维显示模块606,用于将所述视差图像像素索引对应的像素值,填充至所述第一像素索引处,得到并三维显示成像图像。The three-dimensional display module 606 is configured to fill the pixel value corresponding to the pixel index of the parallax image to the first pixel index to obtain and three-dimensionally display the imaging image.

本发明实施例,采用第一预设关系,确定系统的采集信息,用于给系统的布置提供条件,这样采集得到的即为所需要的视差图像阵列,通过预先建立的第一像素索引,将待成像图像的任一个像素位置索引到视差图像阵列中的任一视差图像位置,再通过像素确定公式,确定所述任一视差图像中的任一像素位置,再将所述任一像素位置的像素值填充至待成像图像,得到并三维显示成像图像,上述的过程不需要通过硬件实现,结构简单,减小了硬件成本,并且本发明实施例只需经过一次透镜成像,能够有效的减小成像误差且成像为实像。In the embodiment of the present invention, the first preset relationship is used to determine the acquisition information of the system, which is used to provide conditions for the layout of the system, so that the acquired parallax image array is the required parallax image array, and through the pre-established first pixel index, the Any pixel position of the image to be imaged is indexed to any parallax image position in the parallax image array, and then any pixel position in the any parallax image is determined through the pixel determination formula, and then the any pixel position is The pixel values are filled into the image to be imaged to obtain and three-dimensionally display the imaged image. The above process does not need to be realized by hardware, the structure is simple, and the hardware cost is reduced. In addition, the embodiment of the present invention only needs to go through lens imaging once, which can effectively reduce the Imaging error and the imaging is a real image.

需要说明的是,本发明实施例的装置是应用上述三维光场显示系统的成像方法的装置,则上述三维光场显示系统的成像方法的所有实施例均适用于该装置,且均能达到相同或相似的有益效果。It should be noted that the device of the embodiment of the present invention is a device applying the imaging method of the above-mentioned three-dimensional light field display system, and all the embodiments of the above-mentioned imaging method of the three-dimensional light field display system are applicable to the device, and can achieve the same or similar beneficial effects.

本发明的又一实施例的三维光场显示系统的成像装置中,所述光场显示信息至少还包括:透镜阵列的总宽度,成像区域的总宽度及所述透镜阵列到所述成像区域的距离;In the imaging device of the three-dimensional light field display system according to another embodiment of the present invention, the light field display information at least further includes: the total width of the lens array, the total width of the imaging area, and the distance from the lens array to the imaging area distance;

所述采集信息至少包括:被采集的三维场景的宽度、相机阵列的总宽度、所述相机阵列中所有相机的光轴交点到所述相机阵列的距离及所述相机的数目;以及The collection information includes at least: the width of the three-dimensional scene to be collected, the total width of the camera array, the distance from the intersection of the optical axes of all cameras in the camera array to the camera array, and the number of cameras; and

所述液晶显示面板信息至少包括:液晶显示面板宽度及液晶显示面板高度。The liquid crystal display panel information at least includes: the width of the liquid crystal display panel and the height of the liquid crystal display panel.

本发明的又一实施例的三维光场显示系统的成像装置中,所述第一预设关系为:In the imaging device of the 3D light field display system according to another embodiment of the present invention, the first preset relationship is:

以及 as well as

M=M0M=M 0 ,

其中,所述D为透镜阵列的总宽度,所述D0为被采集的三维场景的宽度,所述W为成像区域的总宽度,所述W0为相机阵列的总宽度,所述L为所述透镜阵列到所述成像区域的距离,所述L0为所述相机阵列中所有相机的光轴交点到所述相机阵列的距离,所述M为所述相机的数目,所述M0为所述每个透镜下覆盖的像素数目。Wherein, the D is the total width of the lens array, the D 0 is the width of the collected three-dimensional scene, the W is the total width of the imaging area, the W 0 is the total width of the camera array, and the L is The distance from the lens array to the imaging area, the L 0 is the distance from the intersection of the optical axes of all cameras in the camera array to the camera array, the M is the number of the cameras, and the M 0 is the number of pixels covered under each lens.

本发明的又一实施例的三维光场显示系统的成像装置中,所述视差图像采集模块603,包括:In the imaging device of the 3D light field display system according to another embodiment of the present invention, the parallax image acquisition module 603 includes:

在所述三维光场显示系统中,通过相机离轴拍摄采集得到视差图像阵列。In the three-dimensional light field display system, a parallax image array is obtained by off-axis shooting with a camera.

本发明的又一实施例的三维光场显示系统的成像装置中,所述透镜阵列的排列形状为矩形。In the imaging device of the three-dimensional light field display system according to another embodiment of the present invention, the arrangement shape of the lens array is a rectangle.

本发明的又一实施例的三维光场显示系统的成像装置中,所述视差图像阵列的排列形状与所述透镜阵列的排列形状相同。In the imaging device of the three-dimensional light field display system according to another embodiment of the present invention, the arrangement shape of the parallax image array is the same as the arrangement shape of the lens array.

本发明的又一实施例的三维光场显示系统的成像装置中,所述预设索引公式为:In the imaging device of the three-dimensional light field display system according to another embodiment of the present invention, the preset index formula is:

(i,j)=(y-(y-1)mod[N]·N,x-(x-1)mod[N]·N),(i,j)=(y-(y-1)mod[N] N, x-(x-1)mod[N] N),

其中,所述(i,j)为所述视差图像索引且为所述视差图像在所述视差图像阵列中第i行、第j列的位置,所述y为所述第一像素索引中的纵向位置编号,所述N为所述视差图像的数目的横向数据或纵向数据,所述x为所述第一像素索引中的横向位置编号,所述i、所述j、所述x、所述y及所述N分别为大于0的自然数。Wherein, the (i, j) is the parallax image index and is the position of the parallax image in the i-th row and the j-th column in the parallax image array, and the y is in the first pixel index The vertical position number, the N is the horizontal data or the vertical data of the number of the parallax image, the x is the horizontal position number in the first pixel index, the i, the j, the x, the The y and the N are natural numbers greater than 0 respectively.

本发明的又一实施例的三维光场显示系统的成像装置中,所述预设像素确定公式为:In the imaging device of the three-dimensional light field display system according to another embodiment of the present invention, the formula for determining the preset pixel is:

其中,所述(x0,y0)为与所述第一像素索引对应的视差图像像素索引且为所述视差图像索引对应的视差图像中任一像素在所述视差图像中的第x0行、第y0列的位置,所述x为所述第一像素索引中的横向位置编号,所述wcode为液晶显示面板的宽度,所述w为所述预设像素数目的横向数据,所述y为所述第一像素索引中的纵向位置编号,所述h为所述预设像素数目的纵向数据,所述hcode为液晶显示面板的高度,所述x0、所述y0、所述x、所述y、所述w、所述h、所述wcode及所述hcode分别为大于0的自然数。Wherein, the (x 0 , y 0 ) is the parallax image pixel index corresponding to the first pixel index and is the x 0th of any pixel in the parallax image corresponding to the parallax image index in the parallax image The position of the row and the y0th column, the x is the horizontal position number in the first pixel index, the w code is the width of the liquid crystal display panel, and the w is the horizontal data of the preset number of pixels, The y is the vertical position number in the first pixel index, the h is the vertical data of the preset number of pixels, the h code is the height of the liquid crystal display panel, the x 0 and the y 0 , the x, the y, the w, the h, the w code and the h code are respectively natural numbers greater than 0.

本发明的又一实施例的三维光场显示系统的成像装置中,所述三维显示模块606,包括:In the imaging device of the 3D light field display system in another embodiment of the present invention, the 3D display module 606 includes:

将所述视差图像像素对应的像素值,填充至所述第一像素索引处,得到成像图像,并通过透镜阵列三维显示所述成像图像。Filling the pixel values corresponding to the parallax image pixels to the first pixel index to obtain an imaging image, and three-dimensionally displaying the imaging image through a lens array.

需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is a relationship between these entities or operations. any such actual relationship or order exists between them. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.

本说明书中的各个实施例均采用相关的方式描述,各个实施例之间相同相似的部分互相参见即可,每个实施例重点说明的都是与其他实施例的不同之处。尤其,对于系统实施例而言,由于其基本相似于方法实施例,所以描述的比较简单,相关之处参见方法实施例的部分说明即可。Each embodiment in this specification is described in a related manner, the same and similar parts of each embodiment can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for relevant parts, refer to part of the description of the method embodiment.

以上所述仅为本发明的较佳实施例而已,并非用于限定本发明的保护范围。凡在本发明的精神和原则之内所作的任何修改、等同替换、改进等,均包含在本发明的保护范围内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present invention are included in the protection scope of the present invention.

Claims (8)

1.一种三维光场显示系统的成像方法,其特征在于,包括:1. An imaging method for a three-dimensional light field display system, comprising: 获取并根据光场显示信息,通过第一预设关系,确定光场显示系统的采集信息,其中,所述光场显示信息至少包括:每个透镜下覆盖的像素数目,所述第一预设关系为所述光场显示信息与所述采集信息的关系;Acquiring and determining the collection information of the light field display system according to the light field display information through a first preset relationship, wherein the light field display information at least includes: the number of pixels covered by each lens, the first preset The relationship is the relationship between the light field display information and the collected information; 根据所述光场显示信息及所述采集信息,设置所述三维光场显示系统;Setting the three-dimensional light field display system according to the light field display information and the collection information; 在所述三维光场显示系统中,采集得到视差图像阵列,其中,所述视差图像阵列由包含有预设数目个像素的多个视差图像排列组成,所述视差图像的数目与所述每个透镜下覆盖的像素数目相同;In the three-dimensional light field display system, a parallax image array is collected, wherein the parallax image array is composed of a plurality of parallax image arrangements containing a preset number of pixels, and the number of the parallax images is the same as that of each The number of pixels covered under the lens is the same; 根据所述视差图像的数目及预先建立的第一像素索引,通过预设索引公式,确定与所述第一像素索引对应的视差图像索引,其中,所述第一像素索引为待成像图像中的任一像素位置,所述预设索引公式为:According to the number of the parallax images and the pre-established first pixel index, the parallax image index corresponding to the first pixel index is determined through a preset index formula, wherein the first pixel index is the image to be imaged Any pixel position, the preset index formula is: (i,j)=(y-(y-1)mod[N]·N,x-(x-1)mod[N]·N),(i,j)=(y-(y-1)mod[N] N, x-(x-1)mod[N] N), 其中,所述(i,j)为所述视差图像索引且为所述视差图像在所述视差图像阵列中第i行、第j列的位置,所述y为所述第一像素索引中的纵向位置编号,所述N为所述视差图像的数目的横向数据或纵向数据,所述x为所述第一像素索引中的横向位置编号,所述i、所述j、所述x、所述y及所述N分别为大于0的自然数;Wherein, the (i, j) is the parallax image index and is the position of the parallax image in the i-th row and the j-th column in the parallax image array, and the y is in the first pixel index The vertical position number, the N is the horizontal data or the vertical data of the number of the parallax image, the x is the horizontal position number in the first pixel index, the i, the j, the x, the Said y and said N are natural numbers greater than 0 respectively; 根据所述视差图像阵列中所述视差图像的预设像素数目、液晶显示面板信息及所述第一像素索引,通过预设像素确定公式,确定与所述第一像素索引对应的视差图像像素索引,其中,所述视差图像像素索引为所述视差图像索引对应的视差图像中任一像素位置,所述预设像素确定公式为:According to the preset pixel number of the parallax image in the parallax image array, the liquid crystal display panel information and the first pixel index, determine the parallax image pixel index corresponding to the first pixel index through a preset pixel determination formula , wherein the parallax image pixel index is any pixel position in the parallax image corresponding to the parallax image index, and the preset pixel determination formula is: 其中,所述(x0,y0)为与所述第一像素索引对应的视差图像像素索引且为所述视差图像索引对应的视差图像中任一像素在所述视差图像中的第x0行、第y0列的位置,所述x为所述第一像素索引中的横向位置编号,所述wcode为液晶显示面板的宽度,所述w为所述预设像素数目的横向数据,所述y为所述第一像素索引中的纵向位置编号,所述h为所述预设像素数目的纵向数据,所述hcode为液晶显示面板的高度,所述x0、所述y0、所述x、所述y、所述w、所述h、所述wcode及所述hcode分别为大于0的自然数;Wherein, the (x 0 , y 0 ) is the parallax image pixel index corresponding to the first pixel index and is the x 0th of any pixel in the parallax image corresponding to the parallax image index in the parallax image The position of the row and the y0th column, the x is the horizontal position number in the first pixel index, the w code is the width of the liquid crystal display panel, and the w is the horizontal data of the preset number of pixels, The y is the vertical position number in the first pixel index, the h is the vertical data of the preset number of pixels, the h code is the height of the liquid crystal display panel, the x 0 and the y 0 , the x, the y, the w, the h, the w code and the h code are respectively a natural number greater than 0; 将所述视差图像像素索引对应的像素值,填充至所述第一像素索引处,得到并三维显示成像图像。Filling the pixel value corresponding to the parallax image pixel index to the first pixel index to obtain and three-dimensionally display the imaging image. 2.根据权利要求1所述的三维光场显示系统的成像方法,其特征在于,所述光场显示信息至少还包括:透镜阵列的总宽度,成像区域的总宽度及所述透镜阵列到所述成像区域的距离;2. The imaging method of the three-dimensional light field display system according to claim 1, wherein the light field display information at least further includes: the total width of the lens array, the total width of the imaging area, and the distance from the lens array to the The distance of the imaging area; 所述采集信息至少包括:被采集的三维场景的宽度、相机阵列的总宽度、所述相机阵列中所有相机的光轴交点到所述相机阵列的距离及所述相机的数目;以及The collection information includes at least: the width of the three-dimensional scene to be collected, the total width of the camera array, the distance from the intersection of the optical axes of all cameras in the camera array to the camera array, and the number of cameras; and 所述液晶显示面板信息至少包括:液晶显示面板宽度及液晶显示面板高度。The liquid crystal display panel information at least includes: the width of the liquid crystal display panel and the height of the liquid crystal display panel. 3.根据权利要求1所述的三维光场显示系统的成像方法,其特征在于,所述第一预设关系为:3. The imaging method of the three-dimensional light field display system according to claim 1, wherein the first preset relationship is: 以及 as well as M=M0M=M 0 , 其中,所述D为透镜阵列的总宽度,所述D0为被采集的三维场景的宽度,所述W为成像区域的总宽度,所述W0为相机阵列的总宽度,所述L为所述透镜阵列到所述成像区域的距离,所述L0为所述相机阵列中所有相机的光轴交点到所述相机阵列的距离,所述M为所述相机的数目,所述M0为所述每个透镜下覆盖的像素数目。Wherein, the D is the total width of the lens array, the D 0 is the width of the collected three-dimensional scene, the W is the total width of the imaging area, the W 0 is the total width of the camera array, and the L is The distance from the lens array to the imaging area, the L 0 is the distance from the intersection of the optical axes of all cameras in the camera array to the camera array, the M is the number of the cameras, and the M 0 is the number of pixels covered under each lens. 4.根据权利要求1至3任一项所述的三维光场显示系统的成像方法,其特征在于,所述在所述三维光场显示系统中,采集得到视差图像阵列,包括:4. The imaging method of the three-dimensional light field display system according to any one of claims 1 to 3, characterized in that, in the three-dimensional light field display system, the parallax image array is collected, comprising: 在所述三维光场显示系统中,通过相机离轴拍摄采集得到视差图像阵列。In the three-dimensional light field display system, a parallax image array is obtained by off-axis shooting with a camera. 5.根据权利要求2或3所述的三维光场显示系统的成像方法,其特征在于,所述透镜阵列的排列形状为矩形。5. The imaging method for a three-dimensional light field display system according to claim 2 or 3, wherein the array of lenses is arranged in a rectangular shape. 6.根据权利要求5所述的三维光场显示系统的成像方法,其特征在于,所述视差图像阵列的排列形状与所述透镜阵列的排列形状相同。6 . The imaging method of a three-dimensional light field display system according to claim 5 , wherein the arrangement shape of the parallax image array is the same as the arrangement shape of the lens array. 7.根据权利要求1所述的三维光场显示系统的成像方法,其特征在于,所述将所述视差图像像素对应的像素值,填充至所述第一像素索引处,得到并三维显示成像图像,包括:7. The imaging method of the three-dimensional light field display system according to claim 1, wherein the pixel value corresponding to the parallax image pixel is filled into the first pixel index to obtain and three-dimensionally display the imaging method images, including: 将所述视差图像像素对应的像素值,填充至所述第一像素索引处,得到成像图像,并通过透镜阵列三维显示所述成像图像。Filling the pixel values corresponding to the parallax image pixels to the first pixel index to obtain an imaging image, and three-dimensionally displaying the imaging image through a lens array. 8.一种三维光场显示系统的成像装置,其特征在于,包括:8. An imaging device for a three-dimensional light field display system, comprising: 采集信息确定模块,用于获取并根据光场显示信息,通过第一预设关系,确定光场显示系统的采集信息,其中,所述光场显示信息至少包括:每个透镜下覆盖的像素数目,所述第一预设关系为所述光场显示信息与所述采集信息的关系;The acquisition information determination module is configured to obtain and determine the acquisition information of the light field display system according to the light field display information through a first preset relationship, wherein the light field display information at least includes: the number of pixels covered by each lens , the first preset relationship is the relationship between the light field display information and the collection information; 系统设置模块,用于根据所述光场显示信息及所述采集信息,设置所述三维光场显示系统;A system setting module, configured to set the three-dimensional light field display system according to the light field display information and the collection information; 视差图像采集模块,用于在所述三维光场显示系统中,采集得到视差图像阵列,其中,所述视差图像阵列由包含有预设数目个像素的多个视差图像排列组成,所述视差图像的数目与所述每个透镜下覆盖的像素数目相同;A parallax image acquisition module, configured to acquire a parallax image array in the three-dimensional light field display system, wherein the parallax image array is composed of a plurality of parallax image arrangements containing a preset number of pixels, and the parallax image The number is the same as the number of pixels covered under each lens; 第一索引确定模块,用于根据所述视差图像的数目及预先建立的第一像素索引,通过预设索引公式,确定与所述第一像素索引对应的视差图像索引,其中,所述第一像素索引为待成像图像中的任一像素位置,所述预设索引公式为:The first index determination module is configured to determine the parallax image index corresponding to the first pixel index through a preset index formula according to the number of the parallax images and the pre-established first pixel index, wherein the first The pixel index is any pixel position in the image to be imaged, and the preset index formula is: (i,j)=(y-(y-1)mod[N]·N,x-(x-1)mod[N]·N),(i,j)=(y-(y-1)mod[N] N, x-(x-1)mod[N] N), 其中,所述(i,j)为所述视差图像索引且为所述视差图像在所述视差图像阵列中第i行、第j列的位置,所述y为所述第一像素索引中的纵向位置编号,所述N为所述视差图像的数目的横向数据或纵向数据,所述x为所述第一像素索引中的横向位置编号,所述i、所述j、所述x、所述y及所述N分别为大于0的自然数;Wherein, the (i, j) is the parallax image index and is the position of the parallax image in the i-th row and the j-th column in the parallax image array, and the y is in the first pixel index The vertical position number, the N is the horizontal data or the vertical data of the number of the parallax image, the x is the horizontal position number in the first pixel index, the i, the j, the x, the Said y and said N are natural numbers greater than 0 respectively; 第二索引确定模块,用于根据所述视差图像阵列中所述视差图像的预设像素数目、液晶显示面板信息及所述第一像素索引,通过预设像素确定公式,确定与所述第一像素索引对应的视差图像像素索引,其中,所述视差图像像素索引为所述视差图像索引对应的视差图像中任一像素位置,所述预设像素确定公式为:The second index determination module is configured to determine the number of pixels related to the first pixel by a preset pixel determination formula according to the preset number of pixels of the parallax image in the parallax image array, the information of the liquid crystal display panel, and the first pixel index. A parallax image pixel index corresponding to the pixel index, wherein the parallax image pixel index is any pixel position in the parallax image corresponding to the parallax image index, and the preset pixel determination formula is: 其中,所述(x0,y0)为与所述第一像素索引对应的视差图像像素索引且为所述视差图像索引对应的视差图像中任一像素在所述视差图像中的第x0行、第y0列的位置,所述x为所述第一像素索引中的横向位置编号,所述wcode为液晶显示面板的宽度,所述w为所述预设像素数目的横向数据,所述y为所述第一像素索引中的纵向位置编号,所述h为所述预设像素数目的纵向数据,所述hcode为液晶显示面板的高度,所述x0、所述y0、所述x、所述y、所述w、所述h、所述wcode及所述hcode分别为大于0的自然数;Wherein, the (x 0 , y 0 ) is the parallax image pixel index corresponding to the first pixel index and is the x 0th of any pixel in the parallax image corresponding to the parallax image index in the parallax image The position of the row and the y0th column, the x is the horizontal position number in the first pixel index, the w code is the width of the liquid crystal display panel, and the w is the horizontal data of the preset number of pixels, The y is the vertical position number in the first pixel index, the h is the vertical data of the preset number of pixels, the h code is the height of the liquid crystal display panel, the x 0 and the y 0 , the x, the y, the w, the h, the w code and the h code are respectively a natural number greater than 0; 三维显示模块,用于将所述视差图像像素索引对应的像素值,填充至所述第一像素索引处,得到并三维显示成像图像。The three-dimensional display module is configured to fill the pixel value corresponding to the pixel index of the parallax image into the first pixel index to obtain and three-dimensionally display the imaging image.
CN201610565597.3A 2016-07-18 2016-07-18 A kind of imaging method and device of 3 d light fields display system Active CN106154567B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610565597.3A CN106154567B (en) 2016-07-18 2016-07-18 A kind of imaging method and device of 3 d light fields display system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610565597.3A CN106154567B (en) 2016-07-18 2016-07-18 A kind of imaging method and device of 3 d light fields display system

Publications (2)

Publication Number Publication Date
CN106154567A CN106154567A (en) 2016-11-23
CN106154567B true CN106154567B (en) 2018-12-04

Family

ID=58059474

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610565597.3A Active CN106154567B (en) 2016-07-18 2016-07-18 A kind of imaging method and device of 3 d light fields display system

Country Status (1)

Country Link
CN (1) CN106154567B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106507096B (en) * 2016-11-24 2018-12-04 北京邮电大学 A kind of tracing type ground light field 3D display method and system with super large visual angle
CN106878698B (en) * 2016-12-23 2019-05-24 中国科学院自动化研究所 The method and system of mobile naked eye three-dimensional virtual reality based on optical path acquisition
CN109283691B (en) * 2018-10-30 2021-03-19 安徽工程大学 A three-dimensional display method and system for light field reconstruction based on optical path transformation
CN113222868B (en) * 2021-04-25 2023-04-25 北京邮电大学 Image synthesis method and device
CN113516748B (en) * 2021-07-30 2024-05-28 中山大学 Real-time rendering method and device for integrated imaging light field display

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103019021A (en) * 2012-12-27 2013-04-03 Tcl集团股份有限公司 3D (three-dimensional) light field camera and method for processing images shot by same
CN103366356A (en) * 2012-04-06 2013-10-23 北京三星通信技术研究有限公司 General calibration system and method and integrated imaging reconstruction system and method thereof
CN103795998A (en) * 2012-10-31 2014-05-14 三星电子株式会社 Image processing method and image processing apparatus
CN104297930A (en) * 2014-10-09 2015-01-21 深圳市华星光电技术有限公司 Integrated imaging three-dimensional display device and system
WO2016045100A1 (en) * 2014-09-26 2016-03-31 深圳市泛彩溢实业有限公司 Holographic three-dimensional information collecting and restoring device and method

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101675961B1 (en) * 2010-12-29 2016-11-14 삼성전자주식회사 Apparatus and Method for Rendering Subpixel Adaptively
CN102647610B (en) * 2012-04-18 2014-05-07 四川大学 Integrated imaging directivity display method based on pixel extraction
KR102103983B1 (en) * 2013-07-31 2020-04-23 삼성전자주식회사 Light field image capturing apparatus including shifted microlens array
CN104427326A (en) * 2013-09-06 2015-03-18 北京三星通信技术研究有限公司 Three-dimensional display method and equipment in integral imaging display system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103366356A (en) * 2012-04-06 2013-10-23 北京三星通信技术研究有限公司 General calibration system and method and integrated imaging reconstruction system and method thereof
CN103795998A (en) * 2012-10-31 2014-05-14 三星电子株式会社 Image processing method and image processing apparatus
CN103019021A (en) * 2012-12-27 2013-04-03 Tcl集团股份有限公司 3D (three-dimensional) light field camera and method for processing images shot by same
WO2016045100A1 (en) * 2014-09-26 2016-03-31 深圳市泛彩溢实业有限公司 Holographic three-dimensional information collecting and restoring device and method
CN104297930A (en) * 2014-10-09 2015-01-21 深圳市华星光电技术有限公司 Integrated imaging three-dimensional display device and system

Also Published As

Publication number Publication date
CN106154567A (en) 2016-11-23

Similar Documents

Publication Publication Date Title
CN106154567B (en) A kind of imaging method and device of 3 d light fields display system
CN108074218B (en) Image super-resolution method and device based on light field acquisition device
Hong et al. Three-dimensional volumetric object reconstruction using computational integral imaging
CN101673395B (en) Image mosaic method and image mosaic device
US10397545B2 (en) 3-D light field camera and photography method
CN102209254B (en) One-dimensional integrated imaging method and device
US11825064B2 (en) Light field display method and system, storage medium and display panel
US20180338137A1 (en) LED-Based Integral Imaging Display System as Well as Its Control Method and Device
CN108513123B (en) Image array generation method for integrated imaging light field display
RU2453922C2 (en) Method of displaying original three-dimensional scene based on results of capturing images in two-dimensional projection
CN106507096B (en) A kind of tracing type ground light field 3D display method and system with super large visual angle
KR20170005009A (en) Generation and use of a 3d radon image
CN105262958A (en) Panoramic feature splicing system with virtual viewpoint and method thereof
CN102404598B (en) Image generation system and method for stereoscopic 3D display
CN110662014B (en) A method for 3D display of 4D data of light field camera with large depth of field
CN102300113A (en) Sparse-camera-array-based integrated-imaged micro image array generation method
CN103634588A (en) Image composition method and electronic apparatus
CN106154566A (en) A kind of 3 d light fields display system and display parameters determine method
CN116309854A (en) Method, device, equipment, system and storage medium for calibrating augmented reality equipment
JP2011234142A (en) Stereoscopic image generation device and its program
CN107659772B (en) 3D image generation method and device and electronic equipment
AU2013308155B2 (en) Method for description of object points of the object space and connection for its implementation
CN108833893A (en) A 3D Image Correction Method Based on Light Field Display
CN114879377B (en) Method, device and equipment for determining parameters of horizontal parallax three-dimensional light field display system
CN103873850B (en) Multi-view image method for reconstructing based on integration imaging and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant