CN105137599B - The head-mounted display and image and the transmittance / reflectance determination method and apparatus - Google Patents

The head-mounted display and image and the transmittance / reflectance determination method and apparatus Download PDF

Info

Publication number
CN105137599B
CN105137599B CN201510486523.6A CN201510486523A CN105137599B CN 105137599 B CN105137599 B CN 105137599B CN 201510486523 A CN201510486523 A CN 201510486523A CN 105137599 B CN105137599 B CN 105137599B
Authority
CN
China
Prior art keywords
image
point
display
corresponding
transmittance
Prior art date
Application number
CN201510486523.6A
Other languages
Chinese (zh)
Other versions
CN105137599A (en
Inventor
肖真
Original Assignee
北京国承万通信息科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京国承万通信息科技有限公司 filed Critical 北京国承万通信息科技有限公司
Priority to CN201510486523.6A priority Critical patent/CN105137599B/en
Publication of CN105137599A publication Critical patent/CN105137599A/en
Application granted granted Critical
Publication of CN105137599B publication Critical patent/CN105137599B/en

Links

Abstract

本发明公开了一种头戴式显示器及其图像和透射率/反射率确定方法和装置,其中,头戴式显示器包括显示装置和光学系统,显示装置通过其上的多个显示像素可以显示第一图像,光学系统包括空间光调制器,该空间光调制器包括多个调节像素,每个调节像素的透射率或反射率能够被调节,第一图像和透射率分布或反射率分布被设定为从所述光学系统出射的出射光的延长线或反向延长线相交于一个或多个像点,一个或多个像点构成三维虚拟图像。 The present invention discloses a head mounted display and image and the transmittance / reflectance determination method and apparatus, wherein the head-mounted display comprising a display device and an optical system, by the first display device may display a plurality of display pixels thereon an image optical system includes a spatial light modulator, the spatial light modulator comprises adjusting a plurality of pixels, each transmissivity or reflectivity adjustment pixel can be adjusted, a first image and a transmittance distribution or reflectance distribution is set to extend the lines intersect in one or more image points, the one or more image points constituting the three-dimensional virtual image optical system from an extension line of the outgoing light emitted or reverse. 本发明的头戴式显示器可以呈现带有人眼调节线索的立体图像,解决了使用现有立体显示设备观看立体图像容易造成视觉疲劳的问题。 The head-mounted display according to the present invention, a stereoscopic image may be presented with an eye accommodation cue solve the stereoscopic display device using the conventional view stereoscopic images likely to cause visual fatigue problems.

Description

头戴式显示器及其图像和透射率/反射率确定方法和装置 The head-mounted display and image and the transmittance / reflectance determination method and apparatus

技术领域 FIELD

[0001] 本发明涉及三维显示技术,具体地说,涉及一种头戴式显示器及其图像和透射率/ 反射率确定方法和装置。 [0001] The present invention relates to three-dimensional display technology, and more particularly, to a head-mounted display and image and the transmittance / reflectance determination method and apparatus.

背景技术 Background technique

[0002] 人眼之所以能看出物体的三维效果,是因为人的双眼之间存在一定距离,使得双眼看到的图像之间有一定的视差,这种带视差的图像经视网膜反馈至大脑皮层就使人产生立体视觉。 [0002] The human eye is able to see the effect of a three-dimensional object, because there is some distance between the human eyes, so that a certain binocular disparity between the images seen with this feedback parallax images to the brain via the retina cortex gives rise to three-dimensional vision.

[0003] 现有的三维显示装置大多是利用上述原理来产生立体感的,即分别为左眼和右眼提供稍有差别的图像,这些稍有差别的图像经视网膜反馈至大脑,从而欺骗大脑,令观察者产生3D的感觉。 [0003] Most of the conventional three-dimensional display apparatus is a stereoscopic be generated using the above principle, i.e. provide slightly different images to the left and right, these slightly different images to the brain via the retina feedback, the brain will fool , so that the viewer generated 3D feeling. 由于人为制造视差的方式所构造的3D景象并不是真正的立体图像,在观看这些3D景象时的人眼所感觉的图像所在位置和图像的实际位置(屏幕)不同,此时人眼会按照感觉的图像位置进行调焦,由于图像的实际位置在屏幕,因此调焦后会看不清图像,此时人眼需要再次调焦到屏幕,如此反复调节,造成视觉疲劳,降低用户的观看体验。 Because of the way the disparity artificially constructed 3D stereoscopic image scene not true, the actual location and position of the image while viewing these images a 3D scene perceived by human eyes (screens) different from the human eye will follow this case feel the image focus position, since the actual position of the image on the screen, so the focus will not see the image, this time the human eye needs to focus to the screen again, repeat the adjustment, resulting in visual fatigue, reduce the user's viewing experience.

[0004] 因此亟需一种可以产生带有人眼调节线索的三维立体图像的显示装置,以解决使用现有立体显示设备观看立体图像容易造成视觉疲劳的问题。 [0004] Thus a need for an apparatus can be produced with a three-dimensional stereoscopic image display eye accommodation cues to solve the problem using the conventional stereoscopic image display apparatus of the stereoscopic viewing likely to cause visual fatigue.

发明内容 SUMMARY

[0005] 本发明要解决的一个技术问题是提供一种能够产生提供人眼调节线索的三维立体图像头戴式显示器、三维图像优化方法及优化装置,以解决通过现有三维显示设备观看立体图像容易造成视觉疲劳的问题。 [0005] A technical problem to be solved by the present invention is to provide a head-mounted display to produce three-dimensional images adjusted to provide clues to the human eye, and a three-dimensional image optimization optimization means to solve the three-dimensional display device by the conventional stereoscopic image viewing likely to cause visual fatigue problems.

[0006] 根据本发明的一个方面,公开了一种头戴式显示器,包括: [0006] In accordance with one aspect of the present invention, discloses a head-mounted display, comprising:

[0007] 显示装置,该显示装置包括多个显示像素,每个显示像素的光强度能够被调节,从而在显示装置上显示第一图像; [0007] In the display device, the display device includes a plurality of display pixels, each display pixel light intensity can be adjusted, thereby displaying the first image on the display means;

[0008] 光学系统,光学系统包括空间光调制器,该空间光调制器(space light modulator,SLM)包括多个调节像素,每个调节像素的透射率或反射率能够被调节,从而在空间光调制器上形成预定的透射率分布或反射率分布; [0008] In the optical system, the optical system comprises a spatial light modulator, the spatial light modulator (space light modulator, SLM) comprising a plurality of adjustment pixels, the transmittance or reflectivity of each pixel is adjusted to be adjusted to the spatial light forming a predetermined transmittance distribution or reflectance distribution modulator;

[0009]第一图像和所述透射率分布或反射率分布被设定为从光学系统出射的出射光的延长线或反向延长线相交于一个或多个像点,一个或多个像点构成三维虚拟图像。 [0009] The first image and the transmittance distribution or reflectance distribution is set to be extended from an extension line of the optical system of the outgoing light emitted backward or to one or more lines intersecting dot, a plurality of image points or constitute a three-dimensional virtual image.

[001 0]优选地,空间光调制器处于光学系统的孔径光阑处。 [0010] Preferably, the spatial light modulator in the aperture stop of the optical system.

[0011]优选地,其中,光学系统还包括: [0011] Preferably, wherein the optical system further comprises:

[0012] 对光线具有折射或反射作用的光学元件或光学组件,其设置在光学系统的光路中。 [0012] or an optical element having a refractive or reflective optical components effect on the light, which is disposed in an optical path of the optical system.

[0013] 优选地,对光线具有折射或反射作用的光学元件或光学组件具有对光线的汇聚或发散作用。 [0013] Preferably, the optical elements or optical components having a refracting or reflecting the light having the effect of converging light or diverging effect.

[0014]优选地,光学元件或光学组件紧贴空间光调制器。 [0014] Preferably, the optical elements or optical components close to the spatial light modulator.

[0015] 优选地,还包括: [0015] Preferably, further comprising:

[0016] 处理器,用于根据光学系统的光学特性和期望呈现给用户的预期三维虚拟图像, 获得第一图像和所述透射率分布或反射率分布。 [0016] processor for rendering three-dimensional virtual image of the intended user and the desired optical characteristics of the optical system to obtain first image and the transmittance distribution or reflectance distribution.

[0017]优选地,对于每束出射光,以发出该出射光的显示像素的光强度与透射该出射光的调节像素的透射率的乘积作为其光线强度数据,或以发出该出射光的显示像素的光强度与反射该出射光的调节像素的反射率的乘积作为其光线强度数据; [0017] Preferably, the display each beam of outgoing light, to emit the product of the transmittance of the light intensity of the display pixels of the outgoing light and the transmittance of the emitted light adjustment pixels as its light intensity data, or to issue the outgoing light the reflected light intensity of the pixels in the adjustment pixels multiplied reflectance of light emitted as light intensity data;

[0018] 对于每个像点,以其所对应的所有出射光的光线强度数据之和作为其像点强度数据; [0018] For each image point, it corresponds to all the outgoing light beam intensity data as a sum of dot intensity data;

[0019] 处理器通过优化算法获得第一图像和透射率分布或反射率分布; [0019] and the image processor obtains a first transmittance distribution or reflectance distribution by the optimization algorithm;

[0020] 优化算法的目标是使三维虚拟图像的所有像点的像点强度数据和预期三维虚拟图像中对应的预期像点的预期像点强度数据整体上匹配。 [0020] Optimization Algorithm is to match the expected overall image intensity data points so that all the three-dimensional virtual image of the dot image data and the expected strength three-dimensional virtual image point in the image corresponding to the intended point.

[0021] 根据本发明的另一个方面,公开了一种根据预期三维虚拟图像确定用于上述头戴式显示器中所述第一图像和所述透射率分布或反射率分布的方法,包括: [0021] According to another aspect of the present invention, depending on the intended discloses a method of determining three-dimensional virtual image of the first image and the transmittance distribution or reflectance distribution of the head-mounted display, comprising:

[0022] 设置初始第一图像和初始透射率分布或初始反射率分布; [0022] The first sets an initial image and an initial transmittance distribution or reflectance distribution of the original;

[0023] 通过迭代优化算法,获得优化第一图像和优化透射率分布或优化反射率分布,使得头戴式显示器将呈现的所述三维虚拟图像的所有像点的像点强度数据和预期三维虚拟图像中对应的预期像点的预期像点强度数据整体上匹配。 Dot data and the expected strength of all three image points [0023] by an iterative optimization algorithm to obtain the three-dimensional virtual image of the first image and the optimized optimized optimized transmittance distribution or reflectance distribution, so that the head mounted virtual display to be presented matching the expected overall image point in the image corresponding to the intended image point intensity data.

[0024] 优选地,迭代优化算法的每一次迭代过程包括: [0024] Preferably, during each iteration of the iterative optimization algorithm comprises:

[0025] 根据所设置的第一图像和透射率分布或反射率分布,计算每个像点的像点强度数据; [0025] According to a first image set and transmittance distribution or reflectance distribution, intensity data calculated for each image point of the image points;

[0026] 计算目标函数值,目标函数值表示所有像点的像点强度数据和与其对应的预期像点的预期像点强度数据之间的整体差异; [0026] The calculated value of the objective function, the objective function value indicates that the overall difference between all of the intended dot dot image intensity data points expected intensity data corresponding to the image point thereto;

[0027]以使目标函数值减小为目标,优化设置第一图像和透射率分布或反射率分布。 [0027] In the objective function is reduced to the target value, and the image optimization settings first transmittance distribution or reflectance distribution. [0028]优选地,迭代优化算法需满足以下边界条件: [0028] Preferably, an iterative optimization algorithm must satisfy the following boundary conditions:

[0029]第一图像的每个显示像素的光强度大于或等于0; [0029] The light intensity of each display pixel of the first image is greater than or equal to 0;

[0030]透射率分布对每个调节像素的透射率大于或等于〇;或[0031]反射率分布对每个调节像素的反射率大于或等于0。 [0030] The transmittance distribution of the transmittance of each pixel is greater than or equal to the adjusted square; or [0031] the reflectance distribution of the reflectance of each pixel is greater than or equal to adjust 0.

[0032]优选地,对于每个像点,确定参与形成该像点的显示像素和对应的调节像素,其中, [0032] Preferably, for each image point is determined and the corresponding display pixels involved in the adjustment pixel forming the image point, wherein

[0033]由显示像素发出并且透过对应的调节像素的出射光的延长线或反向延长线相交于所述像点;或 [0033] emitted from the display pixels through and intersects an extension line extended line corresponding to the outgoing light adjustment pixels of the image point or reverse; or

[0034]由显示像素发出并且经对应的调节像素反射的反射光的延长线或反向延长线相交于所述像点。 [0034] emitted by the display pixels and adjustment pixels corresponding to the reflected light reflected by an extension line or an extension line intersects the reverse image point.

[0035]优选地,根据光学系统的光学特性来确定参与形成该像点的显示像素和对应的调节像素。 [0035] Preferably, optical characteristics of the optical system is determined to participate in the display pixels forming the image and the corresponding pixel point adjustment.

[0036]优选地,根据光学系统的光学特性和用户眼睛的像差来确定所述参与形成该像点的显示像素和对应的调节像素。 [0036] Preferably, the aberration of the optical characteristics of the optical system and the user's eye to determine the involvement of display pixels forming the image point and the corresponding adjustment pixel.

[0037]优选地,光学特性包括所述光学系统的像差。 [0037] Preferably, the optical characteristics including aberrations of the optical system.

[0038]优选地,光学系统还包括薄凸透镜,薄凸透镜设置在显示装置和空间光调制器之间,并紧贴空间光调制器, [0038] Preferably, the optical system further comprises a thin convex thin lens means disposed between the display and the spatial light modulator, and close to the spatial light modulator,

[0039]对于每个像点确定参与形成该像点的显示像素和对应的调节像素的步骤包括: [0040]根据凸透镜成像公式,计算像点对应的实像点的位置; Display pixels [0039] forming the image for each image point and the corresponding point determination involved in adjustment pixels comprises: [0040] The imaging lens formula to calculate the position of the image point corresponding to the real image point;

[0041 ]基于参与形成该像点的显示像素、实像点以及对应的调节像素三点共线的近似条件,确定参与形成该像点的显示像素和对应的调节像素。 [0041] involved in the formation of the pixels based on the display image points, adjusting the real image pixel approximation conditions are collinear and the corresponding points, and determining display pixels involved in forming the image corresponding to the pixel point adjustment.

[0042]优选地,计算每个像点的像点强度数据的步骤包括: [0042] Preferably, the step of calculating for each image point image intensity data points comprises:

[0043]计算每个参与形成该像点的显示像素的光强度与对应的调节像素的透射率或反射率的乘积; The product of the transmittance or reflectance of light intensity adjustment pixel display pixels [0043] involved in the formation of the image is calculated for each point with the corresponding;

[0044]对于所有参与形成该像点的显示像素,计算乘积之和,作为该像点的像点强度数据。 [0044] For all the display pixels involved in the formation of the image point, and calculating the sum of products, as the intensity data of the dot image point.

[0045] 优选地,目标函数值为: [0045] Preferably, the objective function is:

[0046]第一目标函数值,即所有像点的像点强度数据和与其对应的预期像点的预期像点强度数据的差值的绝对值之和;或者 [0046] The first objective function value, i.e., difference values ​​of all image points expected as expected dot image intensity data points and the corresponding points of absolute values ​​of intensity data; or

[0047]第二目标函数值,即所有像点的像点强度数据和与其对应的预期像点的预期像点强度数据的差值的平方之和;或者 [0047] The second objective function value, i.e., the difference between the sum of the squares of all contemplated as expected dot dot image intensity data points and the points corresponding thereto and intensity data; or

[0048]第三目标函数值,即所有像点的像点强度数据的梯度和与其对应的预期像点的预期像点强度数据的梯度之差的模平方之和;或者 [0048] The third objective function value, i.e., the difference between the sum of squares of all the mold as expected gradients and dot point corresponding image point intensity data expected dot intensity data and gradients; or

[0049]上述第一目标函数值、第二目标函数值、第三目标函数值的线性组合。 [0049] The first objective function value, a second objective function value, a linear combination of the third objective function value.

[0050] 优选地,迭代优化算法在迭代次数超过预设迭代次数时停止:或者[0051] 迭代优化算法在目标函数值小于预设目标函数阈值时停止。 [0050] Preferably, iterative optimization algorithm stops when the number of iterations exceeds a preset number of iterations: or [0051] an iterative optimization algorithm stops when the objective function value smaller than the preset threshold value objective function.

[0052]根据本发明的又一方面,公开了一种根据预期三维虚拟图像确定用于上述头戴式显示器中所述第一图像和所述透射率分布或反射率分布的装置,包括: [0052] According to another aspect of the present invention, discloses a three-dimensional virtual image depending on the intended means for determining the first image and the transmittance distribution in the above-described head-mounted display or reflectance distribution, comprising:

[0053]初始设置单元,用于设置初始第一图像和初始透射率分布或初始反射率分布; [0054]迭代优化单元,用于通过迭代优化算法,获得优化第一图像和优化透射率分布或优化反射率分布,使得头戴式显示器将呈现的所述三维虚拟图像的所有像点的像点强度数据和预期三维虚拟图像中对应的预期像点的预期像点强度数据整体上匹配。 [0053] The initial setting unit for setting a first initial image and an initial transmittance distribution or reflectance distribution of initial; [0054] The iterative optimization unit for optimizing the iterative algorithm to obtain a first image optimization and optimization transmittance distribution or matching the expected overall image intensity data for all image points the image intensity data points and the expected three-dimensional virtual image point in the image corresponding to the expected point of optimizing the reflectance distribution, so that the head-mounted display will show the three-dimensional virtual image.

[0055] 优选地,迭代优化单元包括: [0055] Preferably, iterative optimization unit comprises:

[0056]像点强度计算单元,用于根据所设置的第一图像和透射率分布或反射率分布,计算每个像点的像点强度数据; [0056] image point intensity calculation unit, and the transmittance for the first image according to the set or distribution of the reflectance distribution, intensity data calculated for each image point of the image points;

[0057]目标函数值计算单元,用于计算目标函数值,目标函数值表示所有像点的像点强度数据和与其对应的预期像点的预期像点强度数据之间的整体差异; [0057] The objective function value calculating means for calculating a value of the objective function, the objective function value indicates that the overall difference between all points as expected dot image intensity data points and the corresponding points of the image intensity data is expected;

[0058]优化设置单元,用于以使目标函数值减小为目标,优化设置第一图像和透射率分布或反射率分布。 [0058] optimization setting unit for the target value is decreased as the target function, and the image optimization settings first transmittance distribution or reflectance distribution.

[0059] 优选地,还包括: [0059] Preferably, further comprising:

[0060] 对应关系确定单元,用于对于每个像点,确定参与形成该像点的显示像素和对应的调节像素,其中, [0060] correspondence relationship determining unit configured to, for each image point is determined and the corresponding display pixels involved in the adjustment pixel forming the image point, wherein

[0061] 由显示像素发出并且透过对应的调节像素的出射光的延长线或反向延长线相交于像点,或 [0061] issued by the display pixel in the image and an extension line intersects the extension line through points corresponding to the adjustment pixels of the outgoing light or reverse, or

[0062] 由显示像素发出并且经过对应的调节像素反射的反射光的延长线或反向延长线相交于所述像点。 [0062] issued by the extended line of the display pixels and the reflected light passes through the pixel corresponding to reflection adjustment or inverse intersects an extension line of the image point.

[0063]优选地,光学系统还包括薄凸透镜,薄凸透镜设置在显示装置和空间光调制器之间,并紧贴空间光调制器, [0063] Preferably, the optical system further comprises a thin convex thin lens means disposed between the display and the spatial light modulator, and close to the spatial light modulator,

[0064] 对应关系确定单元包括: [0064] correspondence relationship determining unit comprises:

[0065]实像点位置计算单元,用于根据凸透镜成像公式,计算像点对应的实像点的位置; [0066]线性关系计算单元,用于基于参与形成该像点的显示像素、实像点以及对应的调节像素三点共线的近似条件,确定参与形成该像点的显示像素和对应的调节像素。 [0065] The real image point position calculation unit according to the imaging lens formula to calculate the image position of the real image point corresponding to the point; [0066] a linear relationship calculation unit for display pixels based participate in the formation of the image point, a real image point and the corresponding approximately collinear condition adjusting pixel is determined and the corresponding display pixels involved in the image formation point adjusting pixels.

[0067] 优选地,像点强度计算单元包括: [0067] Preferably, the image-point intensity calculating means comprises:

[0068] 乘法单元,用于计算每个参与形成该像点的显示像素的光强度与对应的调节像素的透射率或反射率的乘积; [0068] The multiplying unit for calculating a product of the transmittance or reflectance of light intensity adjustment pixels corresponding to each of the participating display pixels forming the image point;

[0069]求和单元,用于对于所有参与形成该像点的显示像素,计算乘积之和,作为该像点的像点强度数据。 [0069] The summation unit for participation for all the display pixels forming the image points, and calculating the sum of products, as the intensity data of the dot image point.

[0070] 本发明的头戴式显示器可以将需要显示的三维虚拟图像通过现有常规显示设备显示出来,且显示出的三维虚拟图像是带有人眼调节线索的立体图像,该三维虚拟图像的成像位置就在期望人眼感受的位置上,当用户佩戴该头戴式显示器进行观看时,就像该三维虚拟图像真实存在于空间中预定位置处一样,人眼只需要像观看空间中真实的物体一样观看该三维虚拟图像,因此,不会如现有技术中那样针对感受位置和实际显示位置来反复调节眼睛的焦距,从而解决了使用现有立体显示设备观看立体图像容易造成视觉疲劳的问题。 [0070] three-dimensional virtual image head-mounted display according to the present invention may be displayed by the display device prior conventional display it, and exhibits a three-dimensional virtual image is a stereoscopic image with the eye accommodation cue, the three-dimensional virtual image of the image in the desired position on the human eye perceives position, when the user wears the head-mounted display for viewing, as if the existence of the three-dimensional virtual image of the real at the same predetermined position in space, just like the human eye viewing space real objects as the three-dimensional virtual image is viewed, therefore, does not feel as for the display position and the actual position of repeatedly adjusting the focal length of the eye, such as the prior art, thereby solving the conventional stereoscopic display device using a stereoscopic viewing image likely to cause visual fatigue problems.

附图说明 BRIEF DESCRIPTION

[0071] 通过结合附图对本公开示例性实施方式进行更详细的描述,本公开的上述以及其它目的、特征和优势将变得更加明显,其中,在本公开示例性实施方式中,相同的参考标号通常代表相同部件。 [0071] By reference to the exemplary embodiments of the present disclosure will be described in more detail in conjunction with the present disclosure the above and other objects, features and advantages will become more apparent, wherein, in an exemplary embodiment of the present disclosure, the same reference numbers generally refer to the same parts.

[0072] 图1是根据本发明的一个实施例的头戴式显示器的结构示意图; [0072] FIG. 1 is a diagram showing the configuration of a head-mounted display according to an embodiment of the present invention;

[0073] 图放是基于本发明头戴式显示器的一个像点的形成示意图; [0073] FIG discharge is a schematic view of a formed image point based on the head-mounted display of the present invention;

[0074]图2B是基于本发明另一种头戴式显示器的一个像点的形成示意图; [0074] FIG. 2B is a schematic view of forming a dot based on the head-mounted display of the present invention, another;

[0075]图3A是本发明一实施例的头戴式显示器的空间光调制器处于光学系统的孔径光阑处的结构示意图; [0075] FIG 3A is a schematic view of an optical system at the aperture stop a spatial light modulator of the head mounted display according to an embodiment of the present invention is in;

[0076]图3B是本发明一实施例的头戴式显示器的空间光调制器未处于光学系统的孔径光阑处的结构不意图; [0076] FIG. 3B is a spatial light modulator to an embodiment of the head mounted display of the embodiment of the present invention is not in the structure of the aperture stop of the optical system is not intended;

[0077]图4是根据本发明的另一个实施例的头戴式显示器的结构示意图; [0077] FIG. 4 is a schematic view of the construction of another embodiment of the present invention is a head-mounted display of the embodiment;

[0078]图5是根据预期三维虚拟图像确定用于本发明的头戴式显示器中第一图像和透射率/反射率分布的方法流程示意图; [0078] FIG. 5 is a schematic process flow of the present invention, the head-mounted display of the first image and the transmittance / reflectance distribution depending on the intended three-dimensional virtual image determining;

[0079]图6是图5中所述迭代优化算法的每一次迭代过程的流程示意图; [0079] FIG. 6 is 5 each iteration of the iterative optimization algorithm is a schematic process flow;

[0080] 图7是根据预期三维虚拟图像确定用于本发明的头戴式显示器中第一图像和透射率分布或反射率分布的装置的结构示意图; [0080] FIG. 7 is a schematic view of a three-dimensional virtual image depending on the intended means for determining a first image and a transmittance distribution head-mounted display according to the present invention or reflectance distribution;

[0081] 图8是图7中迭代优化单元的一种结构示意图; [0081] FIG. 8 is a schematic view of a configuration of an iterative optimization unit in FIG 7;

[0082]图9是图8中像点强度计算单元的结构示意图LWOOJ ®川疋囹,屮达代1 尤化早兀的为一种结构示意图; [0082] FIG. 9 is a schematic view of FIG. 8 dot intensity calculation unit LWOOJ ® Chuan Cloth prison, Che behalf of a particular of early Wu is a schematic view of a configuration;

[0084]图n是本发明一实施例的对应关系确定单元的结构示意图。 [0084] FIG n is a schematic example of a correspondence relationship determining unit of an embodiment of the present invention.

具体实施方式 Detailed ways

[0085]、下面将参照附图更详细地描述本公开的优选实施方式。 [0085] The following preferred embodiments of the present disclosure will be described in more detail with reference to the drawings. 虽然附图中显示了本公开的优选实施方式,然而应该理解,可以以各种形式实现本公开而不应被这里阐述的实施方式所限制。 Although a preferred embodiment of the present disclosure in the drawings, however it should be understood that the present disclosure may be implemented and should not be limited to the embodiments set forth herein in various forms. 相反,提供这些实施方式是为了使本公开更加透彻和完整,并且能够将本公开的范围完整地传达给本领域的技术人员。 Rather, these embodiments are provided so that this disclosure will be thorough and complete, and the scope of the present disclosure will fully convey to those skilled in the art.

[0086] 一本发明公开^头戴式显示器,可以将需要显示的三维虚拟图像通过现有常规显示设备显示P来,且显示出的三维虚拟图像是带有人眼调节线索的立体图像,解决了使用现有立体显示设备观看立体图像容易造成视觉疲劳的问题。 [0086] ^ a head-mounted display is disclosed, you may need to be displayed three-dimensional virtual image P is displayed by existing conventional display apparatus, and exhibited three-dimensional virtual image is a stereoscopic image with the eye accommodation cue solve a stereoscopic display apparatus using the conventional view stereoscopic images likely to cause visual fatigue problems.

[00^7]具体地说,本发明的头戴式显示器包括显示装置和光学系统。 [00 ^ 7] Specifically, the present invention includes a head-mounted display device and a display optical system. 其中,显示装置用来显不图像,光学系统用于对显示装置显示的图像进行调制,其中,调制主要包括强度调制, 经过调制后,由显不装置显示的图像上发出的经光学系统出射后的多束光线的延长线或反向延长线相交于一个或多个像点,一个或多个像点就构成了三维虚拟图像。 Wherein the display device is not significant for the image, the optical system for the image displayed on the display means is modulated, wherein modulation includes the intensity modulation after modulated, emitted by the optical system on the image displayed by the emission means not significant a plurality of light beams extension line or an extension line intersect in reverse one or more image points, the one or more image points constitute a three-dimensional virtual image.

[0088]下面结合附图对本发明的头戴式显示器做进一步详细说明。 [0088] The following detailed description of the drawings further head-mounted display according to the present invention binds.

[0089]图1是本发明的头戴式显示器的结构示意图。 [0089] FIG. 1 is a schematic diagram of the head mounted display according to the present invention. _〇]如图1所示,本发明的头戴式显示器丨包括显示装置2和光学系统3。 _〇] 1, Shu head-mounted display device of the present invention comprises a display 2 and the optical system 3.

[0091] 显示装置2包括多个显示像素,每个显示像素上的光强度能够被调节,从而在显示装置2上显示第一图像。 [0091] The display device 2 includes a plurality of display pixels, the light intensity at each display pixel can be adjusted so that the display device 2 on the display the first image.

[0092] 第=图像可以通过改变显示装置2上的多个显示像素的光强度进行调节。 [0092] The first image = the light intensity by changing the display pixels on the plurality of display means 2 is adjusted. 另外, 本发明中显示装置2可以是手机屏、电脑屏、电视屏等各种显示设备。 Further, the display apparatus 2 according to the present invention may be a mobile phone screens, computer screens, television screens, and other display devices. [0093]光学系统3包括空间光调制器3-1(叩狀61;[§]11:111〇(111181:〇1',31^1),空间光调制器3-1包括多个调节像素,空间光调制器3-1可以是透射式光瞳也可以是反射式光瞳,每个调节像素的透射率或反射率能够被调节,从而在空间光调制器上形成预定的透射率分布或反射率分布。 [0093] The optical system 3 includes a spatial light modulator 3-1 (knock-shaped 61; [§] 11: 111〇 (111,181: 〇1 ', 31 ^ 1), a spatial light modulator comprises a plurality of adjustment pixels 3-1 , the spatial light modulator may be transmissive 3-1 pupil may be a reflective pupil transmittance or reflectance of each pixel is adjusted to be adjusted to a predetermined transmittance distribution on the spatial light modulator, or reflectance distribution.

[0094]第一图像和透射率分布或反射率分布被设定为从光学系统出射的出射光的延长线或反向延长线相交于一个或多个像点,一个或多个像点构成三维虚拟图像。 [0094] a first image and a transmittance distribution or reflectance distribution is set to be extended in one or more lines intersecting point of an extension line image from the optical system of the outgoing light emitted or reverse, or a plurality of points constituting the three-dimensional image virtual image.

[0095]本发明的光学系统3采用空间光调制器3-1对显示装置2上发出的光进行强度调制,其调制机理为,空间光调制器3-1可以通过改变其上各个位置的透射率或反射率对入射到其上的光线的强度进行调制,使得从光学系统出射的光的延长线或反向延长线交于空间中多个像点,像点足够多时就可以构成三维虚拟图像。 [0095] The optical system of the invention uses light emitted 3 on the spatial light modulator 2 on the display device 3-1 intensity modulation which is a modulation mechanism, a spatial light modulator which can be 3-1 on the transmission by changing the position of the respective or reflectivity of the intensity of the light incident thereon is modulated, such that the extension line from the optical system or the light emitted backward extension lines cross a plurality of image points in space, can be long enough to image points constituting the three-dimensional virtual image .

[0096]因此,空间光调制器3-1可以采用各种透射式液晶屏或反射式液晶屏,只要其上各个位置的透射率或反射率能够被调节即可。 [0096] Thus, the spatial light modulator 3-1 may take various transmission type liquid crystal panel or a reflective liquid crystal panel, as long as the transmittance or reflectance of each position can be adjusted. 例如,空间光调制器可以采用LCoS (Liquid crystal on silicon,即液晶附硅,也叫硅基液晶,是一种基于反射模式,尺寸非常小的矩阵液晶显不装置),还可以米用DMD(Digital Micro mirror Device,数字微镜元件,由美国德州一仪器公司开发的一种极小的反射镜)。 For example, the spatial light modulator may employ LCoS (Liquid crystal on silicon, i.e., silicon-on liquid crystal, also known as liquid crystal on silicon, based on a reflection mode, of very small size matrix liquid crystal display device is not), it may also be used m DMD ( digital Micro mirror device, DMD from Texas instruments has developed a minimum a mirror).

[0097]下面对本发明的头戴式显示器的三维虚拟图像的形成过程做进一步详细说明。 [0097] The following further detailed description of the formation of three-dimensional virtual image of the head-mounted display according to the present invention. [0098]图2A是基于本发明的头戴式显示器的一个像点的形成示意图。 [0098] FIG. 2A is a schematic view of a dot forming head mounted display of the present invention is based.

[0099] 如图所示,图中B代表显示装置,A代表空间光调制器,A上各个位置的透射率可调, B包括多个显示像素,通过调节B上多个显示像素的光强度可以在B上显示不同的图像。 [0099] As shown, B represents the display device in FIG, A represents the spatial light modulator, the transmittance of the respective adjustable position of the A, B comprises a plurality of display pixels, by adjusting the intensity of light on a plurality of display pixels B different images may be displayed on the B.

[0100] 在佩戴时,头戴式显示器和眼睛之间的距离较近,一般只有12mm,所以头戴式显示器如果成的是实像,实像离眼睛太近,不利于用户观看,因此在实际应用中,头戴式显示器优选显示虚像,而为了要产生空间一个虚像点,需要有多束入射到眼睛的光线的反向延长线交于该虚像点,这样眼睛看的时候,会顺着光线追过去,就会获取一个虚像点。 [0100] When worn, the distance between the eye and close the head-mounted display, generally only 12mm, so that the head-mounted display as if the real image, the real image from the eye too, is not conducive to a user viewing, and therefore in practice , the head mounted display is preferably a virtual image display, and in order to generate a virtual space image point, requires a plurality of light beams incident on the eye to reverse the extension lines intersect at the virtual image points, so when the eyes, the light will follow the chase In the past, it will obtain a virtual image point.

[0101] 基于上述虚像点成像原理,由图2A可知,虚像点P是由从A出射的反向延长线交于点P的那些光线形成的,而这些光线是由B上的Bx部分的像素点以一定出射角发出的,也就是说,点P是由B上的Bx部分的像素与A上所有位置的透射率参与形成的。 [0101] Based on the imaging principle of the virtual image point, 2A seen from FIG virtual image point P is extended from the A outgoing reverse lines intersect at those rays point P is formed, and these light rays by Bx portion on the B pixel points out a certain given angle, that is, the participation of the point P transmittance of all the pixel positions a Bx portion formed on the B.

[0102]因此,通过改变B上的显示图像和A上的透射率分布,可以调节点P的光强,使得点P 的光强接近预期三维显示图像在该处像点的光强。 [0102] Thus, the transmittance of the display image on the A and B on the distribution by changing the light intensity can be adjusted point P, the point P such that the light intensity near the expected three-dimensional display image light intensity where the image point.

[0103]上文结合图2A对根据本发明的头戴式显示器的一个像点的形成过程做了详细说明,基于上文所述的一个像点的形成过程,根据需要显示的立体图像,通过本发明的头戴式显示器就可以显示与立体图相对应的多个像点,这些像点就会构成与立体图相似的三维虚拟图像。 [0103] FIG 2A above in connection with the formation of a dot according to the head-mounted display according to the present invention, a detailed description, based on the formation of a dot described above, according to the stereoscopic image to be displayed, by the head-mounted display according to the present invention can display perspective view corresponding to a plurality of points relative to the image, which would constitute an image point and a perspective view similar to the three-dimensional virtual image.

[0104] 例如,需要在空间某一位置显示一幅立体图像,首先通过调节本发明的头戴式显示器中的显示装置上的显示图像和空间光调制器的透射率分布,在空间中显示多个特定的像点,即使这些像点与需要显示的位置处的立体图像相对应,这样,如果像点足够多时,这些像点就会形成虚拟的三维图像。 [0104] For example, the need to display a stereoscopic image in a spatial position by first transmittance of the display image and the spatial light modulator on a display device of the present invention, adjusting distribution head-mounted display, multiple displays in space a specific image point, even if the stereoscopic image at a position of the image point to be displayed corresponding to this, if the dot is large enough, these points will form a virtual image of three dimensional image.

[0105] 需要说明的是,图2A中实施例采用的是透射式空间光调制器,应该明白,对于本发明而言,还可以采用反射式空间光调制器,采用反射式空间光调制器的成像过程与上文类似,此处不再赘述。 [0105] Note that, in FIG. 2A embodiment uses a transmissive spatial light modulator, it should be understood that, for purposes of the present invention, may also employ a reflective spatial light modulator employing a reflective spatial light modulator Similarly to the above image forming process is omitted here.

[0106] 另外,还可以在光学系统的光路中增设光学元件或光学组件,如光学系统还可以包括对光线具有折射或反射作用的光学元件或光学组件,这些光学元件或光学组件可以是会聚类元件如凸透镜、凹面镜,还可以是发散类元件如凹透镜,这些光学元件或光学组件可以紧贴空间光调制器设置。 [0106] Further, also an additional optical elements or optical components in the optical path of the optical system, The optical system may further comprise an optical element or optical component having refraction or reflection of light rays, the optical elements or optical components may be converged the lens-like elements, a concave mirror may also be elements such as concave diverging type, the optical elements or optical components may be disposed close to the spatial light modulator.

[0107] 图2B是基于本发明的另一种头戴式显示器的像点形成过程示意图。 [0107] FIG. 2B is a process schematic of another dot image formed on the basis of the head-mounted display according to the present invention.

[0108]如图2B所示,本发明实施例中头戴式显示器与图2A的不同之处在于,本发明的在a 与B之间且紧贴着A放置一个薄凸透镜。 As shown in [0108] FIG. 2B, embodiments of the present invention with head-mounted display of FIG. 2A except that, in between a and B and A is placed close to the present invention a thin lens.

[0109]此时,像点P是由B上的部分的像素与A上所有位置的透射率参与形成的,与图2A中不包含光学元件相比,对于同一个像点P,设置凸透镜时,B上参与形成该像点的像素较少。 When [0109] In this case, the image point P is made with the transmittance of all the pixel positions on the B portion of the A participates in the formation, as compared with FIG. 2A is not included in the optical element, for the same image point P, a convex lens disposed , fewer pixels involved in the formation of the image point on the B.

[0110] 优选地可以让空间光调制器处于光学系统的孔径光阑处。 [0110] Preferably allows the spatial light modulator is an optical aperture stop of the system.

[0111]图3A是本发明一实施例的空间光调制器处于光学系统的孔径光阑处的结构示意图。 [0111] FIG 3A is a schematic view of a embodiment of the present invention, the aperture stop of the optical system of the spatial light modulator in the embodiment.

[0112]图邪本发明一实施例的空间光调制器未处于光学系统的孔径光阑处的结构示意图。 [0112] FIG evil schematic configuration of the present invention at the aperture stop a spatial light modulator in the embodiment is not an embodiment of the optical system.

[0113]图3A、图3B中A代表显示装置,B代表空间光调制器,C代表凸透镜。 [0113] Figures 3A, 3B, representative of the display device A, B represents the spatial light modulator, C for the convex lens.

[0114]如图3A、图3B所示,当空间光调制器处于光学系统时,对于显示装置A上一个像素点,空间光调制器上各个位置都可对其进行调制。 [0114] FIG. 3A, 3B, when the spatial light modulator is an optical system for a display device on a pixel A, the respective position of the spatial light modulator can be modulated. 当空间光调制器没有处于光学系统时,对于显示装置A上一个像素点,空间光调制器上只有部分对该像素进行调制。 When the spatial light modulator is not in the optical system, a pixel for displaying, on a spatial light modulator modulating only a portion of the pixel device A.

[0115]由图3A、图3B可知,两层显示器能够展示的光场是两层显示器像素的张量积决定的,所以,当空间光调制器不在孔径光阑上的时候,张量积中有大量的〇元素,当且仅当空间光调制器在孔径光阑上时,张量积中的非零元素最多,此时所能表现的光场最为丰富,所以,当空间光调制器处于光学系统的孔径光阑的位置时,可以得到最大限度的利用。 [0115] FIG. 3A, 3B can be seen, the light field display can show two tensor product is determined by the two display pixels, so that, when the spatial light modulator is not on the aperture stop, the tensor product of a large number of square element, if and only if the spatial light modulator on the aperture stop, the most non-zero elements of the tensor product of the most abundant light field can be expressed at this time, so that, when the spatial light modulator is when the position of the aperture stop of the optical system, maximum use can be obtained.

[0116]另j,空间光调制器处于孔径光阑的位置时,其自身不会成像,用户观察到的图像分辨率是显示器上的分辨率。 [0116] Another j, when the spatial light modulator in the position of the aperture stop, itself not forming, an image observed by the user on a display resolution is the resolution. 因此,显示装置和空间光调制器的分辨率可以不同,甚至可以有较大的差异。 Thus, the display apparatus and the resolution of the spatial light modulator may be different, there may be even greater difference. 例如,可以使用高分辨率和高刷新率和彩色的液晶或者〇LED (Organic Light-Emitting Diode,有机发光二极管又称为有机电激光显示)作为显示装置,使用较低分辨率、高或者低的刷新率、单色的液晶作为空间光调制器。 For example, a high resolution and high refresh rate and color liquid crystal or 〇LED (Organic Light-Emitting Diode, OLED yet organic laser display) as a display device using a lower resolution, high or low refresh rate, as a monochrome liquid crystal spatial light modulator.

[0117]另外需要说明的是,图3A、图3B是以光学系统采用凸透镜、空间光调制器为透射率可变的空间光调制器为例进行说明的,应该知道,对于光学系统采用其他光学元件或组件及空间光调制器采用反射式结构的情况同样适用于本发明的优选方案,只要将空间光调制器置于光学系统的孔径光阑处即可,都属于本发明的内容。 [0117] Further to be noted that, in FIG. 3A, 3B is an optical system uses a convex lens, a spatial light modulator is a transmittance of the variable spatial light modulator is described as an example, should know, another optical system using the optical where an element or component and a spatial light modulator employing a reflective structure is equally applicable to a preferred embodiment of the present invention, as long as the spatial light modulator is placed at the aperture stop of the optical system to fall within the present invention.

[0118]本发明的头戴式显示器在成像过程中,还需考虑成像的相似度的问题,即需要让本发明的头戴式显示器呈现的三维虚拟成像尽可能与需要呈现给用户的预期三维虚拟图像接近。 [01] The head-mounted display of the invention in the imaging process, the need to consider the issue of the similarity of imaging, the need to make three-dimensional virtual imaging head-mounted display of the invention presented as three-dimensional presentation and need to prospective users virtual image closer.

[0119]为此,本发明还提供了另一种头戴式显示器。 [0119] To this end, the present invention also provides another head-mounted display.

[0120]图4是本发明的另一种头戴式显示器的示意性结构框图,其中相同部分在上文图! [0120] FIG. 4 is a block diagram schematic of another head-mounted display of the present invention, wherein the same parts in FIG hereinabove! 部分已做了详细说明,此处不再赘述。 Section has a detailed description will not be repeated here.

[0121]与图1所示的头戴式显示器的不同之处在于,本发明实施例的头戴式显示器1还包括处理器4,处理器4用于根据光学系统的光学特性和期望呈现给用户的预期三维虚拟图像,获得第一图像和透射率分布或反射率分布。 [0121] with a head-mounted display shown in FIG. 1 except that the head mounted display according to a further embodiment of the present invention comprises a processor 4, for presentation to the processor 4 and the desired optical characteristics of the optical system three-dimensional virtual image of the user is expected to obtain a first image and a transmittance distribution or reflectance distribution.

[0122]即本发明实施例中处理器4用来确定显示装置2上需要显示的第一图像和空间光调制器3的透射率分布或反射率分布,以使本发明的头戴式显示器1所呈现的虚拟三维图像尽可能接近期望呈现给用户的预期三维虚拟图像。 [0122] That embodiment of the present invention in Example 4 processor for determining a first head-mounted display displaying spatial light modulator and the image to be displayed on the display device 2 3 transmittance distribution or reflectance distribution, so the present invention. virtual three-dimensional image rendered as close to the desired three-dimensional virtual image showing the expected to the user.

[0123]处理器4的上述功能可以通过优化算法来实现,即通过优化算法来确定第一图像和透射率分布或反射率分布,使三维虚拟图像的所有像点的像点强度数据和预期三维虚拟图像中对应的预期像点的预期像点强度数据整体上匹配。 [0123] The processor 4 functions described above can be achieved by optimization algorithm that determines a first image and a transmittance distribution or reflectance distribution by the optimization algorithm, the virtual three-dimensional image data of all the image points and the expected strength of the three-dimensional image point matching the expected overall image intensity data point in the virtual image corresponding to the intended image point.

[0124]其中整体上匹配是说,只要使本发明所显示的所有像点整体上接近预期三维虚拟图像的像点即可,对于其中某些像点来说,即使其像点强度数据与对应的预期像点强度数据相差较大也是可以接受的。 [0124] where the overall matching is to say, as long as the display of the present invention is expected to be close to all of the three-dimensional virtual image of the image as a whole point to point, for some of the image points, even if the image-point intensity data corresponding to the expected difference between the larger dot intensity data is also acceptable.

[0125]上文中所提到的像点强度数据等于形成该像点的所有从光学系统出射的出射光的光线强度数据之和。 [0125] Intensity data points as mentioned above is equal to the dot formed from the optical system all the emitted light intensity of the outgoing light and data.

[0126]具体地说,对于透射式空间光调制器,每束出射光的光线强度数据等于发出该出射光的显示装置上的显示像素的光强度与透射该出射光的调节像素的透射率的乘积。 [0126] Specifically, for the transmissive spatial light modulator, each beam of the light intensity data of the emitted light is equal to emit light transmittance intensity of display pixels on the display device of the outgoing light and the transmittance of the emitted light is adjusted pixel product. 对于反射式空间光调制器,每束出射光的光线强度数据等于发出该出射光的显示装置上的显示像素的光强度与反射该出射光的调节像素的反射率的乘积。 For the reflective spatial light modulator, the light intensity data of each outgoing light beam is equal to the product of the reflectivity of emitted light intensity adjustment pixels and the reflective display pixels on the display device of the outgoing light of the outgoing light.

[0127]下面就如何优化本发明的头戴式显不器显示的三维虚拟图像,使其尽可能接近预期三维虚拟图像做进一步详细说明。 [0127] Next, how to optimize the three-dimensional virtual image of the head-mounted device of the present invention does not substantially display, as close as possible the intended three-dimensional virtual image described in further detail.

[0128]图5是根据预期三维虚拟图像确定用于本发明的头戴式显示器中第一图像和透射率分布或反射率分布的方法流程示意图。 [0128] FIG. 5 is a schematic of a process flow of the first image and the transmittance distribution head-mounted display according to the present invention, the reflectance distribution or three-dimensional virtual image is determined depending on the intended used.

[0129]该方法根据预期三维虚拟图像来确定显示装置显示的第一图像和空间光调制器的透射率分布或反射率分布,以使得头戴式显示器所成的三维虚拟图像的所有像点的像点强度数据和预期二维虚拟图像中对应的预期像点的预期像点强度数据整体上匹配。 [0129] This method is expected to be determined according to the three-dimensional virtual image display and the transmittance of the first image of the spatial light modulator display device profile or reflectance distribution, so that all image points the head mounted display to the three-dimensional virtual image overall image intensity data matches the expected dot intensity data points and the expected two-dimensional image corresponding to the intended virtual image point.

[0130]在步骤sio,设置初始第一图像和初始透射率分布或初始反射率分布。 [0130] In step sio, first sets an initial image and an initial transmittance distribution or reflectance distribution of the initial.

[0131]初始第一图像可以通过调节显示装置的多个显示像素的光强度来设置,本步骤中可以随机设置一幅显示图像作为初始第一图像。 [0131] The first initial image display apparatus can display a plurality of light intensity of the pixel is set by adjusting, in this step may be randomly set a first image as an initial display image.

[0132]相应地,对于透射式空间光调制器或反射式空间光调制器,由于其上各处的透射率或反射率可调,因此其初始透射率分布或初始反射率分布也可以随机设置。 [0132] Accordingly, for the transmissive spatial light modulator or a reflective spatial light modulator, due to transmittance or reflectance throughout adjusted, the initial initial transmittance distribution or reflectance distribution may be randomly arranged .

[0133]在步骤S20,通过迭代优化算法,获得优化第一图像和优化透射率分布或优化反射率分布,使得头戴式显示器将呈现的三维虚拟图像的所有像点的像点强度数据和预期三维虚拟图像中对应的预期像点的预期像点强度数据整体上匹配。 All the intensity data and the expected image points [0133] In step S20, an iterative optimization algorithm to obtain a first image optimization and optimization transmittance distribution or reflectance distribution optimization, such that the three-dimensional virtual image of the head mounted display to be presented image point matching the expected overall image intensity data points in three-dimensional virtual image corresponding to the intended image point.

[0134]即通过迭代优化算法来改变初始设置的第一图像和透射率分布或反射率分布,以使得头戴式显示器所显示的三维虚拟图像尽可能接近预期三维虚拟图像。 [0134] i.e., by an iterative optimization algorithm to change the three-dimensional virtual image of the first image and the transmittance distribution or reflectance distribution, so that the head-mounted display illustrates the initial set as close to the expected three-dimensional virtual image. 其中,迭代优化算法可以通过现有优化理论和算法由计算机实现。 Among them, the iterative optimization algorithm can be implemented by a computer through existing optimization theory and algorithms.

[0135] 图6是图5中的迭代优化算法的每一次迭代过程的流程示意图。 [0135] FIG. 6 is a schematic flow diagram of each of the iterative process of FIG. 5 is an iterative optimization algorithm.

[0136] 在步骤S210,根据所设置的第一图像和透射率分布或反射率分布,计算每个像点的像点强度数据。 [0136] In step S210, each dot in accordance with a first image intensity data and transmittance distribution set or reflectance distribution, calculated as points.

[0137] 像点强度数据等于形成该像点的所有显示像素的光强度和与其对应的调节像素的透射率或反射率的乘积之和。 And the sum of the products of the transmittance or reflectance of light intensity adjustment pixels and all the display pixels corresponding to [0137] the dot data is equal to the intensity of the image forming point. 因此,可以先确定参与形成该像点的显示像素和对应的调节像素,也就是确定参与形成该像点的显示像素和调节像素间的对应关系,然后再计算像点强度数据。 Thus, it is possible to determine the involvement of display pixels and adjustment pixels forming the corresponding image point is involved in determining the display pixels forming the image point and the correspondence between the pixel adjuster, and then calculates the image intensity data points. _ _

[0138] 由于光学系统确定后,其光学特定可知,因此可以根据实际配置的光学系统的光学特性来确定参与形成该像点的显示像素和对应的调节像素,当然还可以通过现有的光路追迹技术或者软件模拟等方式确定。 [0138] Since the optical system is determined, the optical particular found that it is possible to define the corresponding display pixel and a corresponding adjustment pixels forming the image point of the optical properties of the optical system of the actual configuration, may of course also recover by conventional optical path determining trace software simulation technology or the like. _ _

[0139] 就通过光学特性来确定显示像素和调节像素间的对应关系的示例如下。 [0139] For example, and determines the display pixel corresponding relationship between pixels as by adjusting optical characteristics. _ _

[0140] 如图2B所示的头戴式显示器,其中,光学系统包括薄凸透镜,薄凸透镜位于显示装置B和空间光调制器A之间,并紧贴空间光调制器A设置。 [0140] The head-mounted display shown in FIG. 2B, wherein the optical lens system comprises a thin, thin lens means located between the B and A is displayed on the spatial light modulator, and close to the spatial light modulator A is provided. _ _

[0141] 此时通过凸透镜的光学特性来确定参与形成该像点的显示像素和调节像素的对应关系的方法如下。 [0141] At this time, involved in determining the dot display pixels is formed, and a method of adjusting the corresponding relationship between pixels by the following optical characteristics of lens. _ _

[0142] 根据凸透镜成像公式,计算像点P (虚像点)对应^物点P'(实像的位置,由于凸透镜是薄凸透镜,因此可以近似认为参与形成像点P的显示像素、实像点^以及对应的调节像素三点共线,根据三点共线、显示装置B和空间光调制器八之间的距离以及物点p/的位置就可以确定参与形成该像点的显示像素和调节像素间的对应关系,具体丨十算:过程不再赘述。 、、 [0142] According to the imaging lens formula, the image point P (virtual image point) corresponds ^ object point P '(real image position, the lens is a thin lens, it is possible to approximate that of the display pixels involved in forming an image of the point P, the real image points ^ and corresponding to the adjustment pixels are collinear the collinear, the display device and the spatial light modulator B, and the object point distance of p / between eight positions may be determined and adjusted participate in inter-pixel display pixels forming the image point correspondence between specific Shu ten count: the process will not go ,,

[0143] 由于实际的光学系统存在各种像差如色差、畸变、球差等等,因此在根据光学系统的光学特性进行确定时,为了保证结果的准确性,需要考虑系统像差带来的影响,此时,可以预先测量系统像差,然后将光学系统的像差包括在光学特性中作为新的光学特性来确定显示像素和调节像素的关系。 [0143] Due to the presence of various aberrations such as chromatic aberration, distortion, spherical aberration and so the actual optical system, at the time of determining the optical characteristics of the optical system, in order to ensure the accuracy of the results, it is necessary to consider the aberration caused by Effect in this case, the aberration can be measured in advance, and then the aberration of the optical system includes a novel optical characteristics to determine the relationship between the pixel and the display pixel is adjusted in the optical characteristics. ” ' " '

[0144]另外,考虑到用户人眼也有一定的像差,为了使用户看起来更加真实,还可以预先测量用户的人眼像差,然后根据光学系统的光学特性和用户的人眼像差来确定所述参与形成该像点的显示像素和对应的调节像素的关系。 [0144] Further, considering that the user has some human eye aberrations, in order to make the user appear more real, but also may be previously measured aberration of the human eye the user, then the user and optical characteristics of the optical system aberration of the human eye involved in determining the relationship of display pixels forming the image point and the corresponding adjustment pixels.

[0145]在步骤S22〇,计算目标函数值,目标函数值表示所有像占的像占强度数据和与宜对应的预期像点的预期像点强度数据之间的整体差异。 [0145] In step S22〇, the objective function value is calculated, the overall objective function value indicates that all the differences between the intensity data and intensity data and the expected dot appropriate image point corresponding to the intended image representing an image accounts. ..... '、 ..... '

[0146]通过目标函数值表示整体差异可以有多种表示形式。 [0146] represents an objective function value of the entire difference may have various representations. 例如,目标函数值可以是所有像点的像点强度数据和与其对应的预期像点的预期像点强度数据的差值的绝对值之和, 或者是所有像点的像点强度数据和与其对应的预期像点的预期像点强度数据的差值的平方之和,还可以是所有像点的像点强度数据的梯度和与其对应的预期像点的预期像点强度数据的梯度之差的模平方之和,还可以是上述三种表示方法的线性组合等等。 For example, the difference between the objective function values ​​may be expected dot intensity data for all dot image intensity data points and the expected image points corresponding thereto and the absolute values ​​of, or all of the image points of the image intensity data points corresponding thereto and difference expected dot dot expected sum of squares of the intensity data, the difference may also be molded as expected for all points expected dot dot image intensity data points and the corresponding gradient of the gradient of the intensity data and the sum of the squares, and may be a linear combination of the three methods, and the like.

[0147]在步骤S230,以使目标函数值减小为目标,优化设置第一图像和透射率分布或反射率分布。 [0147] In step S230, the value of the objective function is reduced to the target, and the image optimization settings first transmittance distribution or reflectance distribution.

[014 8 ]可以预先设置一个目标函数阈值,每次迭代完,将该次迭代得到的目标函数与目标函数阈值进行比较,如果该次迭代得到的目标函数小于目标函数阈值,说明已经达到期望优化值,可以停止迭代优化算法。 [0148] may be previously set a target function of the threshold, After each iteration, the iterations to obtain the objective function is compared with the target function of the threshold, if the iteration resulting objective function is smaller than the objective function of the threshold, description has reached the desired optimization value, you can stop the iterative optimization algorithm.

[0149]在每次迭代过程中,考虑到需要使目标函数有实际意义,因此可以增设如下迭代的边界条件: [0149] In each iteration, taking into account the need to make a meaningful objective function, it can be an additional iteration of boundary conditions are as follows:

[0150]第一图像的每个显示像素的光强度、每个调节像素的透射率或反射率大于或等于0〇 [0150] the light intensity of each display pixel of the first image, the reflectance or transmittance of each pixel is greater than or equal to the adjusted 0〇

[0151]假如迭代多次后仍旧无法达到优化目的,此时继续迭代有可能增加服务器的负荷,得不偿失,因此还可以预先设置迭代次数,在迭代超过预设的迭代次数时,停止迭代优化算法。 [0151] After multiple iterations if still unable to achieve optimization purposes, this time to continue the iteration may increase the load on the server, not worth the candle, it can also be pre-set number of iterations, when the number of iterations of iterations exceeds a preset stop iterative optimization algorithm.

[0152]上面参考图5、图6详细描述了根据本发明的头戴式显示器显示的三维图像的优化方法,下面参考图7至图11描述根据本发明的头戴式显示器显示的三维图像的优化装置。 [0152] above with reference to FIG. 5, FIG. 6 described in detail three-dimensional image of the optimization method according to the head mounted display according to the present invention shown below with reference to FIGS. 7 to 11 described three-dimensional image head-mounted display according to the present invention shown in optimization device. [0153]下面描述的装置的很多功能分别与上面参考图5、图6描述的步骤的功能相同。 [0153] Many features of the apparatus described below with reference to FIG. 5 above, respectively, the same functional steps depicted in Figure 6. 为了避免重复,这里重点描述该装置可以具有的结构,而对于一些细节,可以参考上文中的相应描述。 To avoid repetition, the apparatus described herein may have a key configuration, and for details, reference may be the corresponding description above.

[0154]图7是根据预期三维虚拟图像确定用于本发明的头戴式显示器中第一图像和透射率分布或反射率分布的装置的结构示意图。 [0154] FIG. 7 is a schematic view of a three-dimensional virtual image depending on the intended means for determining a first image and a transmittance distribution head-mounted display according to the present invention or reflectance distribution.

[0155]通过本发明实施例的装置可以确定显示装置第一图像和透射率分布或反射率分布,以使得头戴式显示器所成的三维虚拟图像的所有像点的像点强度数据和预期三维虚拟图像中对应的预期像点的预期像点强度数据整体上匹配。 Means [0155] Example embodiments of the present invention may be determined by the displaying means a first image and a transmittance distribution or reflectance distribution, so that the three-dimensional virtual image formed by the head mounted display of all the image data points and the expected strength of the three-dimensional image point matching the expected overall image intensity data point in the virtual image corresponding to the intended image point.

[0156]如图7所示,优化装置30包括初始设置单元40和迭代优化单元50。 [0156] As shown in FIG. 7, the optimizing means 30 includes an initial setting unit 40, and an iterative optimization unit 50.

[0157]初始设置单元40用于设置初始第一图像和初始透射率分布或初始反射率分布。 [0157] The initial setting unit 40 for setting a first initial image and an initial transmittance distribution or reflectance distribution of the initial. [0158]迭代优化单元50用于通过迭代优化算法,获得优化第一图像和优化透射率分布或反射率分布,使得头戴式显示器将呈现的三维虚拟图像的所有像点的像点强度数据和预期三维虚拟图像中对应的预期像点的预期像点强度数据整体上匹配。 [0158] iterative optimization unit 50 for an iterative optimization algorithm, get all dot image intensity data point in the first image optimization and optimization transmittance distribution or reflectance distribution, so that the three-dimensional virtual image of the head mounted display to be presented and matching the expected overall image intensity data point in the intended three-dimensional virtual image corresponding to the intended image point.

[0159] 其中,初始第一图像的和初始透射率分布或初始反射率分布的设置可参见图5中步骤S10中的相关描述。 Provided [0159] wherein the first initial image and an initial transmittance distribution or reflectance distribution initial see FIG Step S10 5 in the related description.

[0160]图8是图7中迭代优化单元50的一种结构示意图。 [0160] FIG. 8 is a schematic structural unit 50 in FIG. 7 iterative optimization.

[0161] 如图8所示,迭代优化单元50包括像点强度计算单元510、目标函数值计算单元520 以及优化设置单元530。 [0161] As shown in FIG 8 iterative optimization unit 50 includes an image point intensity calculation unit 510, the objective function value calculating unit 520 and a setting unit 530 optimization.

[0162]像点强度计算单元510用于根据所设置的第一图像和透射率分布,计算每个像点的像点强度数据。 [0162] image point intensity calculation unit 510 according to a first image set and transmittance distributions calculated for each image point image intensity data points.

[0163]目标函数值计算单元520用于计算目标函数值,所述目标函数值表示所有像点的像点强度数据和与其对应的预期像点的预期像点强度数据之间的整体差异。 [0163] The objective function value calculating unit 520 for calculating the value of the objective function, the objective function value represents the difference between the overall strength of all dot image data points and the expected image point corresponding thereto is expected dot intensity data.

[0164] 优化设置单元530用于以使所述目标函数值减小为目标,优化设置所述第一图像和透射率分布或反射率分布。 [0164] setting unit 530 is used to optimize the objective function is reduced to the target value, the first image and optimization settings transmittance distribution or reflectance distribution.

[0165] 图9是图8中像点强度计算单元510的结构示意图。 [0165] FIG. 9 is a schematic structural diagram of an image point intensity calculation unit 510 in FIG. 8.

[0166] 如图所示,像点强度计算单元510包括乘法单元511和求和单元520。 [0166] As shown, the image point intensity calculation unit 510 includes a multiplying unit 511 and summing unit 520.

[0167] 乘法单元511用于计算每个参与形成该像点的显示像素的光强度与对应的调节像素的透射率或反射率的乘积。 The product of the transmittance or reflectance of light intensity of the display pixel [0167] Multiplication unit 511 for calculating each participating in forming the image points corresponding to the adjustment pixels.

[0168] 求和单元512用于对于所有参与形成该像点的显示像素,计算乘积之和,作为该像点的像点强度数据。 [0168] summing unit 512 is used for all the display pixels involved in the formation of the image point, and calculating the sum of products, as the intensity data of the dot image point.

[0169] 其中,关于像点强度数据计算方法以及目标函数值表示方法可参见图5中步骤S210、S220的相关描述。 [0169] wherein, on the dot intensity data, and the objective function value calculation method represents Referring to FIG. 5, step S210, S220 of the relevant description.

[0170] 图10是图7中迭代优化单元50的另一种结构示意图。 [0170] FIG 10 is another schematic structural unit 50 in FIG. 7 iterative optimization.

[0171] 与图8中迭代优化单元相比,本实施例中迭代优化单元50还包括对应关系确定单元540。 [0171] in FIG. 8 units as compared to an iterative optimization, the iterative optimization unit embodiment according to the present embodiment 50 further comprising a correspondence relationship determining unit 540.

[0172] 对应关系确定单元540用于对于每个像点,确定参与形成该像点的显示像素和对应的调节像素,其中, [0172] unit 540 for determining a correspondence relationship for each image point is determined and the corresponding display pixels involved in the adjustment pixel forming the image point, wherein

[0173] 由显示像素发出并且透过对应的调节像素的出射光的延长线或反向延长线相交于像点,或由显示像素发出并且经过对应的调节像素反射的反射光的延长线或反向延长线相交于像点。 [0173] emitted from the display pixels through the extension line and an extension line of the adjustment pixels corresponding to the outgoing light or inverse image points intersect at or emitted from the display pixels and the extended line corresponding to the reflected light through a reflective or anti-adjustment pixels extension lines intersect at the image point.

[0174] 其中,像点的显示像素和对应的调节像素的关系确定方法可参见图5的步骤S210 的相关描述。 [0174] wherein, as the relationship between the display pixels and adjustment pixels corresponding point determination method see step S210 in FIG. 5 of the related description.

[0175] 图11是本发明一实施例的对应关系确定单元的结构示意图。 [0175] FIG. 11 is a schematic view of an example of a correspondence relationship determining unit according to an embodiment of the present invention.

[0176] 本发明实施例的对应关系确单元540适用于含有薄凸透镜的光学系统,其中薄凸透镜设置在所述显示装置和所述空间光调制器之间,并紧贴空间光调制器。 [0176] Example correspondence relationship determining unit 540 of the present invention is applicable to optical systems comprising a thin convex lenses, wherein the thin convex lens disposed between the display device and the spatial light modulator, and close to the spatial light modulator. 此时对应关系确定单元就可以根据凸透镜的相关光学特性来确定参与形成某一像点的显示像素和调节像素的对应关系。 At this time, correspondence relationship determination unit may determine to participate in the display pixels is formed and a dot image is adjusted according to the corresponding relationship between pixels associated optical characteristics of the lens. _ _

[0177] 具体地说,本发明实施例中对应关系确定单元54〇包括实像点位置计算单元541和线性关系计算单元542。 [0177] Specifically, this embodiment includes a correspondence relationship determining unit 54〇 real image position calculation unit 541 calculating unit 542 and linear embodiment of the present invention.

[0178] 实像点位置计算单元541用于根据凸透镜成像公式,计算像点对应的实像点的位置。 [0178] a real image position calculation unit 541 according to the position of the imaging lens formula, the real image corresponding to the image point of the point.

[0179] 线性关系计算单元542用于基于所述参与形成该像点的显示像素、所述实像点以及对应的调节像素三点共线的近似条件,确定上述参与形成该像点的显示像素和对应的调节像素。 [0179] linear calculation unit 542 based on display pixels forming the display pixels involved in the image point, the real image point and the corresponding approximation adjustment pixels are collinear, and participate in the formation of the above-determined image point and adjusting the corresponding pixel.

[0180] 具体可参见上文图6中S210的相关描述。 [0180] DETAILED related description can be found in S210 in FIG. 6 above.

[0181] 上文中已经参考附图详细描述了根据本发明的头戴式显示器及其图像和透射率/ 反射率确定方法和装置。 [0181] Hereinabove has been described with reference to the drawings in detail determination method and apparatus according to the head-mounted display and image and the transmittance / reflectance of the present invention.

[0182]此外,根据本发明的方法还可以实现为一种计算机程序产品,该计算机程序产品包括计算机可读介质,在该计算机可读介质上存储有用于执行本发明的方法中限定的上述功能的计算机程序。 [0182] Further, according to the method of the present invention also may be implemented as a computer program product, the computer program product comprising a computer-readable media above-described function, a method for performing a storage medium of the present invention is defined in the computer-readable computer programs. 本领域技术人员还将明白的是,结合这里的公开所描述的各种示例性逻辑块、模块、电路和算法步骤可以被实现为电子硬件、计算机软件或两者的组合。 Those skilled in the art will also be appreciated that, herein incorporated various illustrative logical blocks described in this disclosure, modules, circuits, and algorithm steps may be implemented as electronic hardware, computer software, or both.

[0183]附图中的流程图和框图显示了根据本发明的多个实施例的系统和方法的可能实现的体系架构、功能和操作。 [0183] The flowchart and block diagrams in the architecture shows possible implementations of systems and methods according to various embodiments of the present invention, functionality, and operation. 在这点上,流程图或框图中的每个方框可以代表一个模块、程序段或代码的一部分,所述模块、程序段或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。 In this regard, the flowchart or block diagrams may represent a portion of each block in a module, segment, or portion of code, a module, segment, or portion of code that comprises one or more devices for implementing the specified logical function executable instructions. 也应当注意,在有些作为替换的实现中,方框中所标记的功能也可以以不同于附图中所标记的顺序发生。 It should also be noted that, in some implementations, as an alternative, the block function can also be marked in a different order than as reference numerals occur. 例如,两个连续的方框实际上可以基本并行地执行, 它们有时也可以按相反的顺序执行,这依所涉及的功能而定。 For example, two consecutive blocks may in fact be executed substantially concurrently, they may sometimes be executed in the reverse order, depending upon the functionality involved may be. 也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或操作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。 Also be noted that each block of the flowchart in block diagram, as well as combinations and / or block diagrams and / or flowchart block may perform a predetermined function or operation of dedicated hardware-based system to achieve , or may be special purpose hardware and computer instructions to implement.

[0184]以上已经描述了本发明的各实施例,上述说明是示例性的,并非穷尽性的,并且也不限于所披露的各实施例。 [0184] The foregoing has described the embodiments of the present invention, the foregoing description is exemplary and not intended to be exhaustive or limited to the disclosed embodiments. 在不偏离所说明的各实施例的范围和精神的情况下,对于本技术领域的普通技术人员来说许多修改和变更都是显而易见的。 In the case of each of the embodiments from the scope and spirit of the embodiments described without departing from, those of ordinary skill in the art Many modifications and variations will be apparent. 本文中所用术语的选择,旨在最好地解释各实施例的原理、实际应用或对市场中的技术的改进,或者使本技术领域的其它普通技术人员能理解本文披露的各实施例。 Others of ordinary skill in the selected term herein used, is intended to best explain the principles of the embodiments, the practical application or improvement in the art in the market, or to the art to understand the embodiments herein disclosed embodiments.

Claims (22)

1. 一种头戴式显不器,包括: 显示装置,该显示装置包括多个显示像素,每个所述显示像素的光强度能够被调节,从而在所述显示装置上显示第一图像; 光学系统,所述显示装置发出的光经过所述光学系统出射,以进入人眼,所述光学系统包括空间光调制器,该空间光调制器包括多个调节像素,每个所述调节像素的透射率或反射率能够被调节,从而在所述空间光调制器上形成预定的透射率分布或反射率分布; 所述第一图像和所述透射率分布或反射率分布被设定为从所述光学系统出射的出射光的延长线或反向延长线相交于一个或多个像点,所述一个或多个像点构成三维虚拟图像,其中,在所述光学系统中,所述空间光调制器处于所述光学系统的孔径光阑处。 A head-mounted not significant, comprising: a display device, the display device includes a plurality of display pixels, each display pixel light intensity can be adjusted, thereby displaying a first image on a display device in the; optical system said display through said light emitting device emits an optical system to enter the human eye, the optical system comprises a spatial light modulator, the spatial light modulator comprises adjusting a plurality of pixels, each pixel of the transmittance adjusting or reflectivity can be adjusted, thereby forming the spatial light modulator on a predetermined transmittance distribution or reflectance distribution; the first image and the transmittance distribution or reflectance distribution is set from the optical an extension line system of the outgoing light emitted backward or extension line intersects the one or more image points, the image points constituting the one or more three-dimensional virtual image, wherein, in the optical system, the spatial light modulator at an aperture stop of said optical system.
2. 根据权利要求1所述的头戴式显示器,其中所述光学系统还包括: 对光线具有折射或反射作用的光学元件或光学组件,其设置在所述光学系统的光路中。 2. The head-mounted display according to claim 1, wherein said optical system further comprising: an optical element having a refractive or reflective optical components or effect on light, which is disposed in an optical path of the optical system.
3. 根据权利要求2所述的头戴式显示器,其中,所述对光线具有折射或反射作用的光学元件或光学组件具有对光线的汇聚或发散作用。 The head-mounted display according to claim 2, wherein said optical element has a light refraction or reflection or optical components having a converging or a diverging effect on the action of light.
4. 根据权利要求3所述的头戴式显示器,其中,所述光学元件或光学组件紧贴所述空间光调制器。 4. The head-mounted display according to claim 3, wherein the optical element against the optical component or the spatial light modulator.
5. 根据权利要求1至4中任何一项所述的头戴式显示器,还包括: 处理器,用于根据所述光学系统的光学特性和期望呈现给用户的预期三维虚拟图像, 获得所述第一图像和所述透射率分布或所述反射率分布。 The head-mounted display as claimed in any of claims 1 to 4, further comprising: a processor for rendering the desired optical characteristics of the optical system and the expected three-dimensional virtual image of the user to obtain the first image and the transmittance distribution or reflectance distribution.
6. 根据权利要求5所述的头戴式显示器,其中, 对于每束出射光,以发出该出射光的显示像素的光强度与透射该出射光的调节像素的透射率的乘积作为其光线强度数据,或以发出该出射光的显示像素的光强度与反射该出射光的调节像素的反射率的乘积作为其光线强度数据; 对于每个所述像点,以其所对应的所有所述出射光的光线强度数据之和作为其像点强度数据, 所述处理器通过优化算法获得所述第一图像和所述透射率分布或所述反射率分布, 所述优化算法的目标是使所述三维虚拟图像的所有像点的像点强度数据和预期三维虚拟图像中对应的预期像点的预期像点强度数据整体上匹配。 6. The head-mounted display as claimed in claim 5, wherein, for each light beam exit, to the product of the transmittance of emitted light intensity of the display pixel with the outgoing light transmittance of the emitted light is adjusted as a pixel light intensity data, or a product of reflectance to emit adjusted pixel intensity of the reflected light of the display pixel of the light emitted as outgoing light ray intensity data; for each point of the image, it corresponds to all the said light intensity of light emitted as a sum data image intensity data point, the processor obtains the first image by the optimization algorithm and the transmittance distribution or reflectance distribution, the optimization algorithm is the target matching the expected overall image intensity data for all image points the image intensity data points and the expected three-dimensional virtual image point in the image corresponding to the expected point in three-dimensional virtual image.
7. —种根据预期三维虚拟图像确定用于权利要求1所述的头戴式显示器的所述第一图像和所述透射率分布或反射率分布的方法,包括: 设置初始第一图像和初始透射率分布或初始反射率分布; 通过迭代优化算法,获得优化第一图像和优化透射率分布或优化反射率分布,使得所述头戴式显示器将呈现的所述三维虚拟图像的所有像点的像点强度数据和所述预期三维虚拟图像中对应的预期像点的预期像点强度数据整体上匹配。 7. - The method according to the intended kind of three-dimensional virtual image determining a head-mounted display according to claim 1 of the first image and the transmittance distribution or reflectance distribution, comprising: setting a first initial image and an initial All image points of the three-dimensional virtual image through an iterative optimization algorithm to obtain a first image optimization and optimization transmittance distribution or reflectance distribution optimization, such that the head-mounted display to be presented; initial transmittance distribution or reflectance distribution dot intensity data and the expected three-dimensional virtual image of the intended image point corresponding to a whole is expected to match the image intensity data points.
8. 根据权利要求7所述的方法,其中,所述迭代优化算法的每一次迭代过程包括: 根据所设置的第一图像和透射率分布或反射率分布,计算每个像点的像点强度数据; 计算目标函数值,所述目标函数值表示所有像点的像点强度数据和与其对应的预期像点的预期像点强度数据之间的整体差异; 以使所述目标函数值减小为目标,优化设置所述第一图像和透射率分布或反射率分布。 8. The method according to claim 7, wherein said iterative optimization process for each iteration of the algorithm comprises: distribution or reflectance distribution and the transmittance of the first image set, is calculated for each image point of a point image intensity transactions; objective function value is calculated, the objective function value represents the difference between the expected overall image point image intensity data for all image points and the points corresponding to its intended point image intensity data; so that the objective function value is reduced objective, the first image and optimization settings transmittance distribution or reflectance distribution.
9. 根据权利要求8所述的方法,所述迭代优化算法需满足以下边界条件: 所述第一图像的每个显示像素的光强度大于或等于0;并且、 所述透射率分布对每个调节像素的透射率大于或等于〇,或所述反射率分布对每个调节像素的反射率大于或等于〇。 9. The method according to claim 8, the iterative optimization algorithm must satisfy the following boundary conditions: the light intensity of each display pixel of the first image is greater than or equal to 0; and, each of the transmittance distribution adjusting the transmittance of the pixel is greater than or equal to the square, or the reflectance distribution of the reflectance of each pixel is greater than or equal to the adjusted square.
10. 根据权利要求8所述的方法,还包括: 对于每个像点,确定参与形成该像点的显不像素和对应的调节像素,其中, 由所述显示像素发出并且透过所述对应的调节像素的出射光的延长线或反向延长线相交于所述像点;或由所述显示像素发出并且经所述对应的调节像素反射的反射光的延长线或反向延长线相交于所述像点。 10. The method of claim 8, further comprising: for each image point, determined significantly involved in forming the image and the corresponding pixel point is not adjusted pixel, wherein, emitted by the display and transmitted through the pixel corresponding to adjusting an extended line of pixels emitted light or inverse intersects an extension line of the image points; or emitted by the display pixels and the extended line of the reflected light corresponding to the reflected or reverse adjustment pixels intersects an extension line the image point.
11. 根据权利要求10所述的方法,其中,根据所述光学系统的光学特性来确定所述参与形成该像点的显示像素和对应的调节像素。 11. The method according to claim 10, wherein the optical characteristics of the optical system is involved in determining the display pixels forming the image point and the corresponding adjustment pixel. ,
12. 根据权利要求10所述的方法,其中,根据所述光学系统的光学特性和用户眼睛的像差来确定所述参与形成该像点的显不像素和对应的调节像素。 12. The method according to claim 10, wherein the aberration of the optical system of the optical characteristics of the user's eyes and to determine the significant involvement of the formed image points are not pixel and the corresponding pixel adjustment.
13. 根据权利要求11所述的方法,其中,所述光学特性包括所述光学系统的像差。 13. The method according to claim 11, wherein the optical characteristic comprises aberration of the optical system.
14. 根据权利要求11所述的方法,其中, 所述光学系统还包括薄凸透镜,所述薄凸透镜设置在所述显示装置和所述空间光调制器之间,并紧贴所述空间光调制器, 所述对于每个像点确定参与形成该像点的显示像素和对应的调节像素的步骤包括: 根据凸透镜成像公式,计算所述像点对应的实像点的位置; 基于所述参与形成该像点的显示像素、所述实像点以及所述对应的调节像素三点近似共线,确定所述参与形成该像点的显示像素和所述对应的调节像素。 14. The method according to claim 11, wherein said optical system further comprises a thin convex lens disposed between the thin device and the display of the spatial light modulator, the spatial light modulator and against , said image point is determined for each participates in the formation of the image dot corresponding to the display pixels and adjustment pixels comprises: an imaging lens according to a formula, calculating the position of the real image of the image point corresponding to the point; forming the basis of the participation image display pixel, and the real image of the point corresponding to approximately three o'clock collinear adjustment pixels, involved in determining the display pixels forming the image and the point corresponding to the adjustment pixel.
15. 根据权利要求10至14中任何一项所述的方法,其中,所述计算每个像点的像点强度数据的步骤包括: 计算每个所述参与形成该像点的显示像素的光强度与所述对应的调节像素的透射率或反射率的乘积; 对于所有参与形成该像点的显示像素,计算所述乘积之和,作为该像点的像点强度数据。 10 15. A method according to any of claim 14, wherein said step of calculating for each image dot intensity data point comprising: a light display pixels of each of the participating forming the image point is calculated adjusting the product of the transmittance intensity of the corresponding pixel or reflectance; participation for all the display pixels forming the image point, calculating the sum thereof, as the intensity data of the dot image point.
16. 根据权利要求8所述的方法,其中,所述目标函数值为: 第一目标函数值,即所有像点的像点强度数据和与其对应的预期像点的预期像点强度数据的差值的绝对值之和;或者第二目标函数值,即所有像点的像点强度数据和与其对应的预期像点的预期像点强度数据的差值的平方之和;或者第三目标函数值,即所有像点的像点强度数据的梯度和与其对应的预期像点的预期像点强度数据的梯度之差的模平方之和;或者所述第一目标函数值、第二目标函数值、第三目标函数值的线性组合。 16. The method according to claim 8, wherein the objective function is: a first objective function value, i.e., the difference between the strength of all dot image data of the intended image point and the corresponding point of the expected dot intensity data and the sum of the absolute values; or the second objective function value, i.e., the difference between the sum of the squares of all dot image intensity data points and the expected image points corresponding to the expected dot and intensity data; objective function value or the third , i.e., modular square of the difference between the expected image all image points the gradient and the corresponding point image intensity data points expected dot intensity data and gradients; or the first objective function value, a second objective function value, linear combination of the third objective function value.
17. 根据权利要求8所述的方法,其中, 所述迭代优化算法在迭代次数超过预设迭代次数时停止:或者所述迭代优化算法在所述目标函数值小于预设目标函数阈值时停止。 17. The method according to claim 8, wherein said iterative optimization algorithm stops when the number of iterations exceeds a preset number of iterations: Iteration is stopped when the algorithm or the value of the objective function less than a preset threshold value in the objective function optimization.
18.—种根据预期三维虚拟图像确定用于权利要求i所述的头戴式显示器的所述第一图像和所述透射率分布或反射率分布的装置,包括: 初始设置单元,用于设置初始第一图像和初始透射率分布或初始反射率分布; 迭代优化单元,用于通过迭代优化算法,获得优化第一图像和优化透射率分布或优化反射率分布,使得所述头戴式显示器将呈现的所述三维虚拟图像的所有像点的像点强度数据和所述预期三维虚拟图像中对应的预期像点的预期像点强度数据整体上匹配。 18.- species distribution or reflectance distribution apparatus based on the head-mounted display intended for the three-dimensional virtual image determining Claim i and said image of said first transmittance, comprising: an initial setting unit for setting a first initial image and an initial transmittance distribution or reflectance distribution of initial; iterative optimization unit is configured by an iterative optimization algorithm to obtain a first image optimization and optimization transmittance distribution or reflectance distribution optimization, such that the head-mounted display will All the intensity data and the dot as a whole is expected to match the expected three-dimensional virtual image points in the image corresponding to the intended image point image intensity data points exhibit the three-dimensional virtual image.
19. 根据权利要求18所述的装置,其中,所述迭代优化单元包括: 像点强度计算单元,用于根据所设置的第一图像和透射率分布或反射率分布,计算每个像点的像点强度数据; 目标函数值计算单元,用于计算目标函数值,所述目标函数值表示所有像点的像点强度数据和与其对应的预期像点的预期像点强度数据之间的整体差异; 优化设置单元,用于以使所述目标函数值减小为目标,优化设置所述第一图像和透射率分布或反射率分布。 19. The apparatus according to claim 18, wherein said iterative optimization unit comprises: an image point intensity calculation unit, according to a first image set and transmittance distribution or reflectance distribution, calculated for each image point dot intensity data; objective function value calculating means for calculating a value of the objective function, the objective function value indicates that the overall difference between the strength of all dot image data points and the expected image points corresponding to the expected dot intensity data ; optimization setting unit configured such that the objective function is reduced to the target value, the first image and optimization settings transmittance distribution or reflectance distribution.
20. 根据权利要求19所述的装置,还包括: 对应关系确定单元,用于对于每个像点,确定参与形成该像点的显示像素和对应的调节像素,其中, 由所述显示像素发出并且透过所述对应的调节像素的出射光的延长线或反向延长线相交于所述像点,或由所述显示像素发出并且经过所述对应的调节像素反射的反射光的延长线或反向延长线相交于所述像点。 20. The apparatus according to claim 19, further comprising: a correspondence relationship determining unit configured to, for each image point is determined and the corresponding display pixels involved in the adjustment pixel forming the image points, wherein by the display pixel emits and extension lines extended line intersects the reflected light of the image points, or emitted by the display pixels and adjustment pixels through the corresponding reflected through an extension line of the adjustment pixels corresponding to the outgoing light or negative or reverse extension line intersects the image point.
21. 根据权利要求20所述的装置,其中, 所述光学系统还包括薄凸透镜,所述薄凸透镜设置在所述显示装置和所述空间光调制器之间,并紧贴所述空间光调制器, 所述对应关系确定单元包括: 实像点位置计算单元,用于根据凸透镜成像公式,计算所述像点对应的实像点的位置; 线性关系计算单元,用于基于所述参与形成该像点的显示像素、所述实像点以及所述对应的调节像素三点共线的近似条件,确定所述参与形成该像点的显示像素和所述对应的调节像素。 21. The apparatus according to claim 20, wherein said optical system further comprises a thin convex lens disposed between the thin device and the display of the spatial light modulator, the spatial light modulator and against device, the correspondence determining means comprises: a real image point position calculating unit, the imaging lens according to the formula for calculating the position of the real image of the image point corresponding to the point; linear relationship calculation unit for forming the image based on the dot participation the display pixels of the real image and the corresponding point approximation of adjustment pixels are collinear, involved in determining the display pixels forming the image and the point corresponding to the adjustment pixel.
22. 根据权利要求19至21中任何一项所述的装置,其中,所述像点强度计算单元包括: 乘法单元,用于计算每个所述参与形成该像点的显示像素的光强度与所述对应的调节像素的透射率或反射率的乘积; 求和单元,用于对于所有参与形成该像点的显示像素,计算所述乘积之和,作为该像点的像点强度数据。 22. The device according to any of claim 19 to claim 21, wherein the image point intensity calculation unit comprises: a multiplication unit for calculating a light intensity of each of the display pixels involved in the image formation point and adjusting the product of the transmittance or reflectance of the corresponding pixel; summing means for participation for all the display pixels forming the image point, calculating the sum thereof, as the intensity data of the dot image point.
CN201510486523.6A 2015-08-10 2015-08-10 The head-mounted display and image and the transmittance / reflectance determination method and apparatus CN105137599B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510486523.6A CN105137599B (en) 2015-08-10 2015-08-10 The head-mounted display and image and the transmittance / reflectance determination method and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510486523.6A CN105137599B (en) 2015-08-10 2015-08-10 The head-mounted display and image and the transmittance / reflectance determination method and apparatus

Publications (2)

Publication Number Publication Date
CN105137599A CN105137599A (en) 2015-12-09
CN105137599B true CN105137599B (en) 2018-03-13

Family

ID=54722997

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510486523.6A CN105137599B (en) 2015-08-10 2015-08-10 The head-mounted display and image and the transmittance / reflectance determination method and apparatus

Country Status (1)

Country Link
CN (1) CN105137599B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105652444B (en) * 2016-01-18 2019-02-15 北京国承万通信息科技有限公司 Display device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7446941B2 (en) * 2005-09-22 2008-11-04 Sony Corporation Display apparatus
TW201219829A (en) * 2010-11-08 2012-05-16 Seereal Technologies Sa Display device, in particular a head-mounted display
CN103885181A (en) * 2012-12-19 2014-06-25 辉达公司 Near-eye Parallax Barrier Display

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8890771B2 (en) * 2010-01-06 2014-11-18 Apple Inc. Transparent electronic device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7446941B2 (en) * 2005-09-22 2008-11-04 Sony Corporation Display apparatus
TW201219829A (en) * 2010-11-08 2012-05-16 Seereal Technologies Sa Display device, in particular a head-mounted display
CN103885181A (en) * 2012-12-19 2014-06-25 辉达公司 Near-eye Parallax Barrier Display

Also Published As

Publication number Publication date
CN105137599A (en) 2015-12-09

Similar Documents

Publication Publication Date Title
US9720228B2 (en) Collimating display with pixel lenses
Huang et al. The light field stereoscope.
US7667783B2 (en) Head mounted display with curved display screen, curved tunable focus liquid crystal micro-lens and first and second curved black masks corresponding independently to one of the right and the left eye
US20110075257A1 (en) 3-Dimensional electro-optical see-through displays
US8736963B2 (en) Two-dimensional exit-pupil expansion
US9841537B2 (en) Near-eye microlens array displays
CN103885181B (en) Near-eye parallax barrier display
Maimone et al. Holographic near-eye displays for virtual and augmented reality
US9557565B2 (en) Near-eye optical deconvolution displays
US20030063383A1 (en) Software out-of-focus 3D method, system, and apparatus
CN105934902B (en) Virtual and augmented reality system and method
US20100073376A1 (en) Electronic imaging device and method of electronically rendering a wavefront
JP6253117B2 (en) Virtual image projector with a wide field of view
JP5112326B2 (en) 3-dimensional display optical system for
US20050179868A1 (en) Three-dimensional display using variable focusing lens
CN103649816B (en) Full image scanning mirror display system
WO2012052981A2 (en) Head-mounted display apparatus employing one or more fresnel lenses
JP2005533291A (en) Auto stereoscopic projection apparatus
Kramida Resolving the vergence-accommodation conflict in head-mounted displays
US20020114078A1 (en) Resolution modulation in microlens image reproduction
KR20100076039A (en) Display device, display method and head-up display
CN102681663A (en) Immersive display experience
US20110032482A1 (en) 3d autostereoscopic display with true depth perception
CN1591175A (en) Stereoscopic display device
JP2008509438A (en) Optical display device which is scanned at a variable fixed viewing distance

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
GR01