WO2017121361A1 - 一种曲面二维屏幕的三维立体显示处理方法和装置 - Google Patents

一种曲面二维屏幕的三维立体显示处理方法和装置 Download PDF

Info

Publication number
WO2017121361A1
WO2017121361A1 PCT/CN2017/071014 CN2017071014W WO2017121361A1 WO 2017121361 A1 WO2017121361 A1 WO 2017121361A1 CN 2017071014 W CN2017071014 W CN 2017071014W WO 2017121361 A1 WO2017121361 A1 WO 2017121361A1
Authority
WO
WIPO (PCT)
Prior art keywords
angle
camera
curved
dimensional
screen
Prior art date
Application number
PCT/CN2017/071014
Other languages
English (en)
French (fr)
Inventor
骆磊
Original Assignee
深圳前海达闼云端智能科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳前海达闼云端智能科技有限公司 filed Critical 深圳前海达闼云端智能科技有限公司
Publication of WO2017121361A1 publication Critical patent/WO2017121361A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/363—Image reproducers using image projection screens
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers

Definitions

  • the present application relates to the field of three-dimensional stereoscopic display technology, and in particular, to a three-dimensional stereoscopic display processing method and apparatus for a curved two-dimensional screen, which can be applied to a cloud intelligent robot.
  • the display of existing three-dimensional images can only be achieved by holographic projection.
  • Theaters and TVs can achieve 3D (3D) display with special projection equipment and head-mounted devices, but the so-called 3D of theaters and TVs is just 3D in front, instead of 360-degree 3D images, images cannot be used by people.
  • the position is different and different perspectives are displayed, and the visual perception is relatively large.
  • the 3D display has only 3D information in one direction in front, and the content displayed after the rotation angle has no change in the angle of view, and is not a true stereoscopic image; while the holographic projection is a true three-dimensional display, the cost is high, and both For large equipment, in addition, the projection medium is also more difficult to handle.
  • special liquid mist or special gas method is adopted, the threshold is high, and the use environment is too high.
  • 3D image processing by cloud intelligent robot is a development direction of 3D image processing technology.
  • the embodiment of the present application provides a three-dimensional stereoscopic display processing method and apparatus for a curved two-dimensional screen for displaying a three-dimensional stereoscopic image on a curved two-dimensional screen.
  • the embodiment of the present application provides a three-dimensional display processing method for a curved two-dimensional screen, including:
  • an embodiment of the present application provides a three-dimensional display processing device for a curved two-dimensional screen, including:
  • a human eye determining unit for determining an angle of the user's eyes and the camera
  • An angle determining unit configured to determine a display angle of a three-dimensional stereoscopic image content source according to an angle between a front direction of the two-dimensional screen of the camera and the curved surface, and an angle between the user's eyes and the camera;
  • a display processing unit configured to display an image of a corresponding angle of the image content source on the curved two-dimensional screen according to the display angle.
  • determining an angle between the user's eyes and the camera determining a display angle of the three-dimensional stereoscopic content source according to the angle between the camera and the curved two-dimensional screen and the angle between the user's eyes and the camera; An image of the corresponding angle of the image content source is displayed on the curved two-dimensional screen.
  • FIG. 1 is a schematic diagram of a three-dimensional stereoscopic display processing method of a curved two-dimensional screen in the embodiment of the present application;
  • FIG. 2a is a schematic view showing an angle of a horizontal plane of a user and a camera in a top view of a two-dimensional curved surface screen according to Embodiment 1 of the present application;
  • 2b is a schematic view showing the angle between the user and the vertical plane of the camera in the side view of the two-dimensional curved screen in the first embodiment of the present application;
  • Figure 3a shows a top view of the three-dimensional modeled image in the first embodiment
  • Figure 3b shows a side view of the three-dimensional modeled image in the first embodiment
  • FIG. 4 is a perspective view showing a two-dimensional screen in which a horizontal plane is a curved surface in the first embodiment of the present application;
  • FIG. 5 is a schematic diagram showing the angle of a two-dimensional screen as a cylindrical surface in the second embodiment of the present application.
  • FIG. 6 is a schematic diagram of a multi-user scenario in Embodiment 2 of the present application.
  • FIG. 7 is a schematic structural diagram of a three-dimensional stereoscopic display processing apparatus for a curved two-dimensional screen in the embodiment of the present application.
  • FIG. 1 is a schematic diagram of a three-dimensional display processing method for a curved two-dimensional screen in an embodiment of the present application, including:
  • Step 101 Determine an angle between a user's eyes and a camera
  • Step 102 Determine a display angle of a three-dimensional stereoscopic image content source according to an angle between a front direction of the camera and the curved two-dimensional screen and an angle between the user's eyes and the camera;
  • Step 103 Display an image of a corresponding angle of the image content source on the curved two-dimensional screen according to the display angle.
  • the three-dimensional display processing method of the curved surface two-dimensional screen may be implemented by a device in which the curved two-dimensional screen is located, or may be implemented by a device (such as a server) separated from the curved two-dimensional screen.
  • the above-mentioned curved two-dimensional screen may be a cylindrical two-dimensional screen such as a cylinder surface, a spherical surface, or an aspheric surface.
  • the shape of the curved two-dimensional screen can be a small flexible flexible screen or a large circular screen for large display.
  • the angles in the three-dimensional display processing method of the above-described curved two-dimensional screen include horizontal angles and/or vertical angles.
  • the specific angle can be determined according to the actual situation. For example, when the curved two-dimensional screen is a horizontal direction vertical plane plane, that is, a vertical cylindrical surface two-dimensional screen, To handle only horizontal angles.
  • the curved two-dimensional screen is a horizontal direction horizontal plane, that is, a horizontal cylindrical two-dimensional screen, only the vertical angle can be processed.
  • the curved 2D screen is spherical or irregular, the horizontal and vertical angles can be processed simultaneously.
  • Embodiment 1 is a diagrammatic representation of Embodiment 1:
  • the user information collection and the three-dimensional stereoscopic display processing are performed by the same portable device as an example.
  • the camera's viewing angle of the curved 2D screen needs to cover all viewing positions of the user, so it may be necessary to capture multiple cameras at the same time, especially for the large column display, which requires 360 degree coverage. It is also necessary to use 6 or more wide-angle lenses (in a certain range, the more coverage, the wider the coverage, but beyond this range, there is no longer any improvement), which can give users a more consistent visual effect.
  • the solution of the embodiment of the present invention can also be implemented, but it is relatively lacking in the coverage of the user. Once the user leaves the area that the camera can capture, the user cannot continue to be served.
  • the image content source in the first embodiment of the present invention is the same as the holographic projection, and is a three-dimensional stereoscopic data model.
  • the content is three-dimensional 360 degrees, but still set a positive direction.
  • the screen whether it is a columnar screen or a ring screen, there will be a set positive direction, which is consistent with the positive direction of the stereo image.
  • one or more cameras start to detect the two-way angle between the human eye and the camera's line and the camera's central axis (the line is perpendicular to the camera's position), one is at the horizontal angle of the camera's central axis, and the other is the camera.
  • the straight line of the human eye to the camera and the central axis of the camera are at an angle of a in the horizontal plane and at an angle of b in the vertical plane.
  • the angle of the user and the horizontal plane of the camera is a.
  • the user The vertical plane angle to the camera is b. It is assumed that the three-dimensional modeling should take the horizontal angle a' and the vertical angle b' in this case to project the three-dimensional model onto the surface of the curved screen so that the user can see the image of the angle on the screen, with the front of the image as the car.
  • the front view is an example. As shown in Fig. 3a, in the top view of the three-dimensional modeled image, the horizontal angle a' should be taken. As shown in Fig. 3b, in the side view of the three-dimensional modeled image, the horizontal angle b' should be taken.
  • the tangential direction of the camera position curved screen is the Y-axis
  • the curvature radius of each point is known in the manufacturing process of the screen
  • the curved surface of the two-dimensional screen (0,0) of this surface has a radius of curvature r, wherein the curved surface of the two-dimensional screen (0,0) is a preset coordinate point, specifically, one of the three-dimensional content exists ( 0, 0) direction, to determine the direction of the content is displayed in the positive direction, and the surface 2D screen will also have a (0,0) direction to map the (0,0) direction of the 3D content to the surface 2D The (0,0) direction of the screen is displayed.
  • the camera detects that the distance between the human eye and the camera is l, and the angle between the camera and the human eye and the horizontal plane is ⁇ , then the linear distance between the human eye and the (0,0) point is l*cos ⁇ , and the human eye and the surface at the moment.
  • the angle between the vertical line of the screen and the central axis of the camera is a', as shown in Figure 4.
  • the distance between the user's eyes and the camera is l; the angle between the camera to the user's eyes and the horizontal plane is ⁇ ; the line of the user's eyes to the camera and the camera's central axis
  • the angle in the horizontal plane is a; the radius of curvature of the coordinate point of the curved two-dimensional screen (0, 0) is r.
  • the angle between the angle and the above a' is the three-dimensional content that the human eye should see at this position. Angle.
  • the vertical angles b and b' are also obtained in the same manner.
  • the angle of the vertical plane that is, the longitudinal angles b and b', the angle between the straight line of the user's eyes and the camera and the central axis of the camera is b, the vertical line of the human eye and the curved screen and the central axis of the camera
  • the angle is b', the angle between the camera and the human eye and the vertical plane is ⁇ , which is the same:
  • the longitudinal curvature radius of the coordinate point of the curved two-dimensional screen (0, 0) is r vertical .
  • the three-dimensional model is taken as a two-dimensional image according to this angle, and is displayed to the curved screen centering on the angle so that the user can see the image of the angle on the screen.
  • real-time calculation and real-time display of the corresponding projected image allows the user to have a new viewing experience.
  • the curved two-dimensional screen in the second embodiment is a cylindrical surface, assuming that the camera and the screen standard positive direction axis (the vertical height of the axis depends on the size of the device and the content type, and if it is a portable device, the vertical axis of the center point of the device in the vertical direction is taken. More suitable. If it is a large device, it depends more on the displayed content.
  • the height of the axis should be lowered, even close to the ground; And if you want the user to see the angle of the display content, such as watching the plane fly over, the height of the axis should be increased, even higher than the central axis of the camera.
  • the height difference is x, this value can be adjusted at any time. And known, as shown in Figure 5.
  • the actual angle between the user and the screen is ⁇
  • the actual angle between the screen obtained by the camera and the user is ⁇
  • the distance between the camera and the user is l (by the camera auto focus ranging or laser ranging, etc.)
  • the two lines to the user's folder The angle is ⁇
  • the actual distance from the user to the screen is k
  • 90°- ⁇ is the angle between the human eye and the positive direction of the content in the vertical direction.
  • Such a diagram means that the human eye will see an angle of 90°- ⁇ below the horizontal direction of the image, that is, the angle ⁇ ' of the user's eyes in the vertical direction can be determined according to the following formula:
  • the actual angle between the curved two-dimensional screen and the user is ⁇ ; the difference between the height of the image content source central axis and the camera central axis is x.
  • the b-angle is more rationally determined based on the set height for the large columnar screen.
  • the screen can be extinguished to save power. That is, when the camera does not detect the human eye, the screen block corresponding to the camera is turned off.
  • the corresponding relationship between the camera and the screen block may be established in advance. Once a camera does not detect the human eye, the corresponding screen block is closed. .
  • the three-dimensional display processing device of the curved two-dimensional screen in the embodiment of the present application includes:
  • a human eye determining unit 701 configured to determine an angle of the user's eyes and the camera
  • the angle determining unit 702 is configured to determine a display angle of the three-dimensional stereoscopic image content source according to an angle between the camera and the positive direction of the two-dimensional screen and the angle between the user's eyes and the camera;
  • the display processing unit 703 is configured to display an image of a corresponding angle of the image content source on the curved two-dimensional screen according to the display angle.
  • the human eye determining unit 701 may include a camera or may not include a camera. When the camera is not included, the human eye determining unit 701 may determine the angle of the user's eyes and the camera according to the image or information fed back by the camera.
  • the three-dimensional display processing device of the curved two-dimensional screen further includes a plurality of cameras for capturing an image of a human eye
  • the device also includes a screen control module for turning off its corresponding screen block when no camera detects the human eye.
  • the three-dimensional display processing device of the curved two-dimensional screen may not include a camera, but is a separate display processing device, such as a server. It is also possible to include only one camera to serve the users of the area covered by the camera.
  • the three-dimensional display processing device of the curved two-dimensional screen in the embodiment of the present invention further includes a plurality of cameras for capturing the human eye image
  • the display processing unit 703 displays the plurality of users separately on different screen blocks when it is determined that the plurality of users simultaneously view at different angles of the curved two-dimensional screen and the visible portion has no overlapping regions.
  • the three-dimensional stereoscopic display processing device of the curved two-dimensional screen in the embodiment of the present application may be a cloud intelligent robot.
  • the device is like a container, and the three-dimensional image is presented in a three-dimensional manner in the container, presenting a new experience to the user.
  • the hardware implementation point of view it is nothing more than the existing device, without any high requirements for equipment and environment like holographic projection.
  • the invention does not need to wear 3D glasses, and can display the projection of the three-dimensional image in the two-dimensional image, and different angles of the image can be seen at different angles, and can follow the change of the user angle. And real-time changes, the visual experience can reach the level of leap
  • the conventional fixed camera can accurately obtain the angle of the human eye relative to the midpoint (middle line) of the display screen.
  • the effect of the present invention is still different, but after all, the extremely low cost even the existing equipment It can be realized without any large equipment or any special projection medium, and the threshold is much lower.
  • embodiments of the present application can be provided as a method, apparatus, system, or computer program product.
  • the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment in combination of software and hardware.
  • the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Image Processing (AREA)

Abstract

本申请提供了一种曲面二维屏幕的三维立体显示处理方法和装置，用于在曲面二维屏幕上显示三维立体图像，可应用于云端智能机器人。该方法包括：确定用户眼睛与摄像头的角度；根据摄像头与曲面二维屏幕正方向的角度以及用户眼睛与摄像头的角度，确定三维立体图像内容源的显示角度；根据该显示角度在该曲面二维屏幕上显示该图像内容源相应角度的图像。通过上述方法，可以在普通的曲面二维屏幕上显示三维立体图像，不需要任何大型设备也不需要任何特殊投影介质,成本极低，形态与现有终端设备相符，对用户来说是一种全新的体验，也能为应用程序开发开拓新的想象空间。

Description

一种曲面二维屏幕的三维立体显示处理方法和装置 技术领域
本申请涉及三维立体显示技术领域，尤其涉及一种曲面二维屏幕的三维立体显示处理方法和装置，可应用于云端智能机器人。
背景技术
现有三维立体图像的显示只能通过全息投影来实现。影院和电视能够通过特殊的放映设备配合头戴设备实现3D(三维)显示，但影院和电视的所谓3D也不过是正前方的3D，而不是360度的三维立体图像，图像并不能因为人所处的位置不同而显示不同视角，视觉观感差距比较大。
现有技术中，3D显示只有正前方一个方向的3D信息，而转动角度后显示的内容没有视角变化，并非真正的立体图像；而全息投影虽然为真三维立体显示，但成本很高，且均为大型设备，另外，投影介质也是比较难处理的一块儿，目前多采用特殊液体薄雾或者特殊气体的方法，门槛很高，对使用环境要求过高。
随着产业的发展，云端智能机器人已经成为必然趋势。由云端智能机器人来进行3D图像处理，是3D图像处理技术的一个发展方向。
发明内容
本申请实施例提出了一种曲面二维屏幕的三维立体显示处理方法和装置，用于在曲面二维屏幕上显示三维立体图像。
在一个方面，本申请实施例提供了一种曲面二维屏幕的三维立体显示处理方法，包括：
确定用户眼睛与摄像头的角度；
根据所述摄像头与曲面二维屏幕正方向的角度以及所述用户眼睛与摄像头的角度，确定三维立体图像内容源的显示角度；
根据所述显示角度在所述曲面二维屏幕上显示所述图像内容源相应角度的图像。
在另一个方面，本申请实施例提供了一种曲面二维屏幕的三维立体显示处理装置，包括：
人眼确定单元，用于确定用户眼睛与摄像头的角度；
角度确定单元，用于根据所述摄像头与曲面二维屏幕正方向的角度以及所述用户眼睛与摄像头的角度，确定三维立体图像内容源的显示角度；
显示处理单元，用于根据所述显示角度在所述曲面二维屏幕上显示所述图像内容源相应角度的图像。
有益效果如下：
在本发明实施例中，确定用户眼睛与摄像头的角度；根据摄像头与曲面二维屏幕正方向的角度以及用户眼睛与摄像头的角度，确定三维立体图像内容源的显示角度；根据该显示角度在该曲面二维屏幕上显示该图像内容源相应角度的图像。通过上述方法，可以在普通的曲面二维屏幕上显示三维立体图像，不需要任何大型设备也不需要任何特殊投影介质,成本极低，形态与现有终端设备相符，对用户来说是一种全新的体验，也能为应用程序开发开拓新的想象空间。
附图说明
下面将参照附图描述本申请的具体实施例，其中：
图1示出了本申请实施例中曲面二维屏幕的三维立体显示处理方法示意图；
图2a示出了本申请实施例一中曲面二维屏幕的俯视图中用户与摄像头的水平面的角度示意图；
图2b示出了本申请实施例一中曲面二维屏幕的侧视图中用户与摄像头的垂直面的角度示意图；
图3a示出了实施例一中三维建模图像的俯视图；
图3b示出了实施例一中三维建模图像的侧视图；
图4示出了本申请实施例一中水平面为曲面的二维屏幕的角度示意图；
图5示出了本申请实施例二中二维屏幕为圆柱面的角度示意图；
图6示出了本申请实施例二中的多用户场景示意图；
图7示出了本申请实施例中的曲面二维屏幕的三维立体显示处理装置的结构示意图。
具体实施方式
为了使本申请的技术方案及优点更加清楚明白，以下结合附图对本申请的示例性实施例进行进一步详细的说明，显然，所描述的实施例仅是本申请的一部分实施例，而不是所有实施例的穷举。并且在不冲突的情况下，本说明书中的实施例及实施例中的特征可以互相结合。
图1示出了本申请实施例中曲面二维屏幕的三维立体显示处理方法，包括：
步骤101，确定用户眼睛与摄像头的角度；
步骤102，根据该摄像头与曲面二维屏幕正方向的角度以及该用户眼睛与摄像头的角度，确定三维立体图像内容源的显示角度；
步骤103，根据该显示角度在该曲面二维屏幕上显示该图像内容源相应角度的图像。
在实现时，上述曲面二维屏幕的三维立体显示处理方法可以由该曲面二维屏幕所在设备来实现，也可以由与该曲面二维屏幕分离的设备(例如服务器)来实现。上述曲面二维屏幕可以是柱面，球面，非球面等曲面二维屏幕。曲面二维屏幕的形态可以是较小的柔性可弯曲屏，也可以大型展示用的环形大屏幕。
上述曲面二维屏幕的三维立体显示处理方法中的角度包括水平角度和/或垂直角度。在具体实现时，可以根据实际情况确定具体的角度。例如，在曲面二维屏幕为水平方向曲面垂直方向平面，即垂直方向的圆柱面二维屏幕时，可 以仅处理水平角度。在曲面二维屏幕为垂直方向曲面水平方向平面，即水平方向的圆柱面二维屏幕时，可以仅处理垂直角度。在曲面二维屏幕为球面或者不规则曲面时，可以同时处理水平角度和垂直角度。
为了便于本申请的实施，下面以实施例进行说明。
实施例一：
实施例一以由同一个便携设备来进行用户信息采集、三维立体显示处理为例进行说明。
考虑到实际用户体验，曲面二维屏的摄像头可视角度需要能够覆盖用户的所有观看位置，因此有可能需要多颗摄像头同时进行捕获，尤其是大型展示用的环形柱状屏幕，需要360度覆盖，也就需要用到可能6颗甚至更多颗广角镜头(在一定范围内，越多则覆盖范围越广，但超过这个范围则基本不再有提升)，这样可以给用户一个更连贯的视觉效果。在只有一个摄像头时，也能够实现本发明实施例的方案，只是在对用户的覆盖范围上相对有所欠缺，一旦用户离开该摄像头能够捕捉的区域，则无法继续为该用户服务。
本发明实施例一中的图像内容源和全息投影相同，为一个三维立体数据建模。内容是三维立体360度的，但依然会设定一个正方向。屏幕也如此，不管是柱状屏幕还是环形屏幕，都会有一个设定好的正方向，此正方向与立体图像的正方向保持一致。显示的同时一个或多个摄像头开始侦测人眼到摄像头的直线与摄像头中心轴线(该线垂直于摄像头位置的屏幕)的双向角度，一个是与摄像头中心轴线在水平面的角度，一个是与摄像头中心轴线在垂直面的角度，以及人眼与摄像头的直线距离。因为摄像头在设备安装时即为固定的，因此每个摄像头与曲面二维屏幕正方向的角度都是固定的且已知的(0-360度范围内)。
在实施例一中，假设人眼到摄像头的直线与此摄像头中心轴线在水平面的角度为a，在垂直面角度为b。如图2a所示，曲面二维屏幕的俯视图中，用户与摄像头的水平面的角度为a。如图2b所示，曲面二维屏幕的侧视图中，用户 与摄像头的垂直面角度为b。假设三维建模在此情况下应取水平角a’，垂直角b’,进行三维立体模型到曲面屏表面的投影，以使用户能够在屏幕上看到此角度的图像，以图像正面为汽车的正前方视图为例。如图3a所示，该三维建模图像的俯视图中，应取水平角a’。如图3b所示，该三维建模图像的侧视图中，应取水平角b’。
以水平面的角度，即横向夹角a和a’为例，取该摄像头中心轴为X轴，摄像头位置曲面屏的切线方向为Y轴，屏幕在制造过程中可知其每一点的曲率半径，假设此曲面二维屏幕(0，0)坐标点横向的曲率半径为r，其中，曲面二维屏幕(0，0)坐标点是一个预设的坐标点，具体来说，三维内容会存在一个(0，0)方向，来决定内容显示的时候此方向为正方向，而曲面二维屏幕也会有一个(0，0)方向，来将三维内容的(0，0)方向对应到曲面二维屏幕的(0，0)方向显示。摄像头检测到人眼与摄像头的距离为l，摄像头到人眼的连线与水平面夹角为α，则可知人眼与(0，0)点的直线距离为l*cosα，此刻人眼与曲面屏的垂线与摄像头中心轴的夹角为a’，如图4所示。
假设人眼与直视点曲率圆心的直线距离为l’，则根据余弦定理可知：
cos(180°-a)＝(r2+(l*cosα)2–l’2)/2*r*l*cosα
进而可推导出：
Figure PCTCN2017071014-appb-000001
再根据正弦定理可知：
l’/sin(180°-a)＝l*cosα/sina’
推导并代入l’,可得到：
Figure PCTCN2017071014-appb-000002
由前面的描述可知，在公式(1)中，用户眼睛与摄像头的距离为l；摄像头到用户眼睛的连线与水平面夹角为α；用户眼睛到所述摄像头的直线与所述摄像头中心轴线在水平面的角度为a；曲面二维屏幕(0，0)坐标点的横向曲率半径为r。
在设备制造时已经有了每个摄像头对于曲面屏正方向(三维立体内容正方向)的夹角，因此，此夹角与如上a’的和即为人眼在此位置应该看到的三维立体内容的角度。
当垂直方向也为曲面时(即屏幕整体为球面或者近似于球面的形态时)，垂直角b和b’也可同理得到。
垂直面的角度，即纵向夹角b和b’，用户眼睛到所述摄像头的直线与所述摄像头中心轴线在垂直面的角度为b，人眼与曲面屏的垂线与摄像头中心轴的夹角为b’，摄像头到人眼的连线与垂直面夹角为β，同理可得：
Figure PCTCN2017071014-appb-000003
曲面二维屏幕(0，0)坐标点的纵向曲率半径为r纵。
将三维立体模型按照此角度取为二维图像，并以此角度为中心显示到曲面屏幕，以使用户能够在屏幕上看到此角度的图像。随着用户的走动，实时计算并实时显示对应投射图像，让用户能够有一个全新的观赏体验。
实施例二
实施例二中的曲面二维屏幕为圆柱面，假设摄像头与屏幕标准正方向轴(此轴纵向高度取决于设备的大小以及内容种类，如果为便携设备，则取设备垂直方向中心点的垂直轴线比较合适。如果为大型设备，则更取决于显示的内容，如果展示方更希望用户看到展示内容偏上的角度，比如看车的上表面，则此轴高度应该调低，甚至贴近地面；而如果希望用户看到展示内容偏下的角度，如看飞机飞过，则此轴高度应该调高，甚至高到超过摄像头的中心轴也可以)的高度差为x，这个值可以随时调整设置并已知，如图5所示。用户与屏幕纵向实际夹角为α，摄像头得到的屏幕与用户实际夹角为β，摄像头与用户距离为l(通过摄像头自动对焦测距或激光测距等方法)，两条线到用户的夹角为γ，用户到屏幕的实际距离为k
根据余弦定理可知：
cosβ＝x2+l2–k2/(2*x*l)
进而可推导出：
Figure PCTCN2017071014-appb-000004
再根据正弦定理可知：
k/sinβ＝l/sin(180°-α)
代入计算可得到：
Figure PCTCN2017071014-appb-000005
1.而90°-α即为人眼与内容正方向在垂直方向的夹角。如此图意味着人眼将看到比图像水平方向往下90°-α的角度，即，可以根据如下公式确定所述用户眼睛在垂直方向的夹角α’：
Figure PCTCN2017071014-appb-000006
由前面的描述可知，在公式(3)中，曲面二维屏幕与用户实际夹角为β；图像内容源中心轴与摄像头中心轴的高度差为x。
通过上述处理，针对大型柱状屏幕基于设定的高度更合理的确定b角。
如图6所示的情况，对于未检测到人眼的角度，也就是屏幕对人眼的不可见区域，则可以熄灭屏幕以达到省电的目的。即当摄像头未检测到人眼时，关闭该摄像头对应的屏幕块，在具体实现时，可以事先建立摄像头与屏幕块的对应关系，一旦某摄像头未检测到人眼，则关闭其对应的屏幕块。
如果多个用户在曲面屏的不同角度同时观看，如果没有可视部分的重合区域，则能够看到同一视频源或图像源的多个面而互不影响。即，在确定出多个用户在曲面二维屏幕的不同角度同时观看且可视部分无重合区域时，在不同屏幕块上为所述多个用户分别进行显示。
如图7所示，本申请实施例中曲面二维屏幕的三维立体显示处理装置包括：
人眼确定单元701，用于确定用户眼睛与摄像头的角度；
角度确定单元702，用于根据摄像头与曲面二维屏幕正方向的角度以及所述用户眼睛与摄像头的角度，确定三维立体图像内容源的显示角度；
显示处理单元703，用于根据所述显示角度在所述曲面二维屏幕上显示所述图像内容源相应角度的图像。
人眼确定单元701中可以包括摄像头，也可以不包括摄像头，在不包括摄像头时，人眼确定单元701可根据摄像头反馈的图像或者信息确定用户眼睛与摄像头的角度。
进一步地，该曲面二维屏幕的三维立体显示处理装置还包括多个摄像头，用于捕捉人眼图像；
该装置还包括屏幕控制模块，用于在任一摄像头未检测到人眼时，关闭其对应的屏幕块。
在具体实现时，该曲面二维屏幕的三维立体显示处理装置可以不包括摄像头，只是单独的显示处理装置，如服务器。也可以仅包括一个摄像头，对该摄像头所覆盖区域的用户进行服务。
在另一个具体实例中，本发明实施例中的曲面二维屏幕的三维立体显示处理装置还包括多个摄像头，用于捕捉人眼图像；
显示处理单元703，在确定出多个用户在曲面二维屏幕的不同角度同时观看且可视部分无重合区域时，在不同屏幕块上为所述多个用户分别进行显示。
本申请实施例中曲面二维屏幕的三维立体显示处理装置可以是云端智能机器人。
在本发明实施例中，设备犹如一个容器，三维图像在容器中立体的呈现出来，给用户呈现一种全新的体验。而且从硬件实现上看无非还是现有的装置，没有任何如全息投影般对设备和环境的高要求。
采用本发明的方案，和目前3D屏幕比，本发明不需要戴3D眼镜，可显示三维立体影像在二维图像的投影，不同的角度可看到图像的不同视角，且可跟随用户角度的变化而实时变化，视觉体验可以达到飞跃的水平
本发明中普通固定摄像头可精确获取人眼相对显示屏中点(中线)的角度。和全息投影比，本发明的效果还有差距，但毕竟极低的成本甚至现有的设备就 可实现，不需要任何大型设备也不需要任何特殊投影介质，实现门槛低很多。
本领域内的技术人员应明白，本申请的实施例可提供为方法、装置、系统、或计算机程序产品。因此，本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且，本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
尽管已描述了本申请的优选实施例，但本领域内的技术人员一旦得知了基本创造性概念，则可对这些实施例作出另外的变更和修改。所以，所附权利要求意欲解释为包括优选实施例以及落入本申请范围的所有变更和修改。

Claims (10)

  1. 一种曲面二维屏幕的三维立体显示处理方法，其特征在于，包括：
    确定用户眼睛与摄像头的角度；
    根据所述摄像头与曲面二维屏幕正方向的角度以及所述用户眼睛与摄像头的角度，确定三维立体图像内容源的显示角度；
    根据所述显示角度在所述曲面二维屏幕上显示所述图像内容源相应角度的图像。
  2. 如权利要求1所述的方法，其特征在于，所述角度包括水平角度和/或垂直角度。
  3. 如权利要求2所述的方法，其特征在于，所述角度包括水平角度，根据如下公式确定用户眼睛与摄像头的水平角度a’：
    Figure PCTCN2017071014-appb-100001
    其中，所述用户眼睛与所述摄像头的距离为l；所述摄像头到所述用户眼睛的连线与水平面夹角为α；所述用户眼睛到所述摄像头的直线与所述摄像头中心轴线在水平面的角度为a；所述曲面二维屏幕(0，0)坐标点的横向曲率半径为r。
  4. 如权利要求3所述的方法，其特征在于，所述曲面二维屏幕为圆柱面，所述角度还包括垂直角度，根据如下公式确定所述用户眼睛在垂直方向的夹角α’：
    Figure PCTCN2017071014-appb-100002
    其中，所述曲面二维屏幕与用户实际夹角为β；所述图像内容源中心轴与所述摄像头中心轴的高度差为x。
  5. 如权利要求3所述的方法，其特征在于，所述曲面二维屏幕垂直方向也 为曲面，所述角度还包括垂直角度，根据如下公式确定b’：
    Figure PCTCN2017071014-appb-100003
    其中，用户眼睛到所述摄像头的直线与所述摄像头中心轴线在垂直面的角度为b，用户眼睛与所述曲面二维屏幕的垂线与摄像头中心轴的夹角为b’，所述摄像头到用户眼睛的连线与垂直面夹角为β，曲面二维屏幕(0，0)坐标点的纵向曲率半径为r纵。
  6. 如权利要求1所述的方法，其特征在于，当所述摄像头未检测到人眼时，关闭所述摄像头对应的屏幕块。
  7. 如权利要求1所述的方法，其特征在于，在确定出多个用户在曲面二维屏幕的不同角度同时观看且可视部分无重合区域时，在不同屏幕块上为所述多个用户分别进行显示。
  8. 一种曲面二维屏幕的三维立体显示处理装置，其特征在于，包括：
    人眼确定单元，用于确定用户眼睛与摄像头的角度；
    角度确定单元，用于根据所述摄像头与曲面二维屏幕正方向的角度以及所述用户眼睛与摄像头的角度，确定三维立体图像内容源的显示角度；
    显示处理单元，用于根据所述显示角度在所述曲面二维屏幕上显示所述图像内容源相应角度的图像。
  9. 如权利要求7所述的装置，其特征在于，包括多个摄像头，用于捕捉人眼图像；
    所述装置还包括屏幕控制模块，用于在任一摄像头未检测到人眼时，关闭其对应的屏幕块。
  10. 如权利要求7所述的装置，其特征在于，包括多个摄像头，用于捕 捉人眼图像；
    所述显示处理单元，在确定出多个用户在曲面二维屏幕的不同角度同时观看且可视部分无重合区域时，在不同屏幕块上为所述多个用户分别进行显示。
PCT/CN2017/071014 2016-01-14 2017-01-12 一种曲面二维屏幕的三维立体显示处理方法和装置 WO2017121361A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610023567.X 2016-01-14
CN201610023567.XA CN105704475B (zh) 2016-01-14 2016-01-14 一种曲面二维屏幕的三维立体显示处理方法和装置

Publications (1)

Publication Number Publication Date
WO2017121361A1 true WO2017121361A1 (zh) 2017-07-20

Family

ID=56227326

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/071014 WO2017121361A1 (zh) 2016-01-14 2017-01-12 一种曲面二维屏幕的三维立体显示处理方法和装置

Country Status (2)

Country Link
CN (1) CN105704475B (zh)
WO (1) WO2017121361A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113168823A (zh) * 2018-12-18 2021-07-23 深圳市柔宇科技股份有限公司 显示控制方法、电子设备及计算机可读存储介质
CN113497930A (zh) * 2020-03-20 2021-10-12 华为技术有限公司 一种显示方法及控制显示的装置
CN114449246A (zh) * 2021-12-29 2022-05-06 邹虹 一种圆柱形显示器动态多视点立体图像方法
CN115546111A (zh) * 2022-09-13 2022-12-30 武汉海微科技有限公司 曲面屏检测方法、装置、设备及存储介质

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105704475B (zh) * 2016-01-14 2017-11-10 深圳前海达闼云端智能科技有限公司 一种曲面二维屏幕的三维立体显示处理方法和装置
CN107333121B (zh) * 2017-06-27 2019-02-26 山东大学 曲面屏幕上移动视点的沉浸式立体渲染投影系统及其方法
CN108859879A (zh) * 2018-05-31 2018-11-23 上海与德科技有限公司 一种座椅调节方法、装置、终端及存储介质
WO2020113568A1 (zh) * 2018-12-07 2020-06-11 深圳市柔宇科技有限公司 控制方法和显示设备
CN109933189A (zh) * 2018-12-28 2019-06-25 惠州Tcl移动通信有限公司 动态桌面布局方法、显示设备及计算机存储介质
CN111240407A (zh) * 2019-03-22 2020-06-05 卢丽君 一种柔性屏及柔性屏的立体显示方法
CN111856776A (zh) * 2019-04-30 2020-10-30 上海科技大学 全息投影设备
CN110488970A (zh) * 2019-07-03 2019-11-22 努比亚技术有限公司 弧形显示屏的图形显示方法、终端及计算机可读存储介质
CN114461057A (zh) * 2020-11-09 2022-05-10 华为技术有限公司 Vr显示控制方法、电子设备及计算机可读存储介质
CN113012574B (zh) * 2021-02-19 2023-05-09 深圳创维－Rgb电子有限公司 屏幕曲率调整方法、装置、曲面显示器以及存储介质
CN115243027A (zh) * 2022-07-21 2022-10-25 杭州吉沁文化创意有限公司 一种曲面二维屏幕的三维显示方法、存储介质和装置
CN115934020B (zh) * 2023-01-05 2023-05-30 南方科技大学 一种基于弧形屏幕的裸眼3d显示方法及终端

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000276613A (ja) * 1999-03-29 2000-10-06 Sony Corp 情報処理装置および情報処理方法
CN1512456A (zh) * 2002-12-26 2004-07-14 联想(北京)有限公司 一种显示三维图像的方法
EP2418862A2 (en) * 2010-08-09 2012-02-15 LG Electronics Inc. System, apparatus, and method for displaying 3-dimensional image and location tracking device
CN104603717A (zh) * 2012-09-05 2015-05-06 Nec卡西欧移动通信株式会社 显示装置、显示方法以及程序
CN105094304A (zh) * 2014-05-20 2015-11-25 联想(北京)有限公司 一种信息处理方法以及电子设备
CN105704475A (zh) * 2016-01-14 2016-06-22 深圳前海达闼云端智能科技有限公司 一种曲面二维屏幕的三维立体显示处理方法和装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0713105A (ja) * 1993-06-22 1995-01-17 Atr Tsushin Syst Kenkyusho:Kk 観察者追従型立体表示装置
CN101931823A (zh) * 2009-06-24 2010-12-29 夏普株式会社 显示3d图像的方法和设备
KR101832958B1 (ko) * 2011-06-01 2018-02-28 엘지전자 주식회사 이동 단말기 및 그의 3ｄ영상 표시방법
CN102447938B (zh) * 2011-12-05 2015-01-28 深圳市九洲电器有限公司 一种应用于裸眼3d的视频增效方法、装置及视频增效器
CN104349155B (zh) * 2014-11-25 2017-02-01 深圳超多维光电子有限公司 模拟立体图像显示方法及显示设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000276613A (ja) * 1999-03-29 2000-10-06 Sony Corp 情報処理装置および情報処理方法
CN1512456A (zh) * 2002-12-26 2004-07-14 联想(北京)有限公司 一种显示三维图像的方法
EP2418862A2 (en) * 2010-08-09 2012-02-15 LG Electronics Inc. System, apparatus, and method for displaying 3-dimensional image and location tracking device
CN104603717A (zh) * 2012-09-05 2015-05-06 Nec卡西欧移动通信株式会社 显示装置、显示方法以及程序
CN105094304A (zh) * 2014-05-20 2015-11-25 联想(北京)有限公司 一种信息处理方法以及电子设备
CN105704475A (zh) * 2016-01-14 2016-06-22 深圳前海达闼云端智能科技有限公司 一种曲面二维屏幕的三维立体显示处理方法和装置

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113168823A (zh) * 2018-12-18 2021-07-23 深圳市柔宇科技股份有限公司 显示控制方法、电子设备及计算机可读存储介质
CN113497930A (zh) * 2020-03-20 2021-10-12 华为技术有限公司 一种显示方法及控制显示的装置
CN114449246A (zh) * 2021-12-29 2022-05-06 邹虹 一种圆柱形显示器动态多视点立体图像方法
CN115546111A (zh) * 2022-09-13 2022-12-30 武汉海微科技有限公司 曲面屏检测方法、装置、设备及存储介质
CN115546111B (zh) * 2022-09-13 2023-12-05 武汉海微科技有限公司 曲面屏检测方法、装置、设备及存储介质

Also Published As

Publication number Publication date
CN105704475B (zh) 2017-11-10
CN105704475A (zh) 2016-06-22

Similar Documents

Publication Publication Date Title
WO2017121361A1 (zh) 一种曲面二维屏幕的三维立体显示处理方法和装置
US11533489B2 (en) Reprojecting holographic video to enhance streaming bandwidth/quality
US10037614B2 (en) Minimizing variations in camera height to estimate distance to objects
US10739936B2 (en) Zero parallax drawing within a three dimensional display
US10587868B2 (en) Virtual reality system using mixed reality and implementation method thereof
CN102959616B (zh) 自然交互的交互真实性增强
US8717360B2 (en) Presenting a view within a three dimensional scene
US11178385B2 (en) Synthetic stereoscopic content capture
US20170287218A1 (en) Virtual object manipulation within physical environment
CN109791442A (zh) 表面建模系统和方法
US20120162384A1 (en) Three-Dimensional Collaboration
WO2019062056A1 (zh) 一种智能投影方法、系统及智能终端
US20140306954A1 (en) Image display apparatus and method for displaying image
CN103443582A (zh) 图像处理设备、图像处理方法和程序
WO2017101780A1 (zh) 一种三维立体显示处理方法、装置、存储介质和电子设备
CN112154486A (zh) 用于多用户增强现实购物的系统和方法
JP2021527252A (ja) 自動化された表面選択設置およびコンテンツ配向設置を用いた拡張現実ビューア
JP6446465B2 (ja) 入出力装置、入出力プログラム、および入出力方法
CN113744411A (zh) 图像处理方法及装置、设备、存储介质
JP2022515608A (ja) 大面積透明タッチインターフェースにおける視差補正のためのシステム及び／又は方法
JP6140513B2 (ja) 立体映像表示装置
JP6563802B2 (ja) 運送点検用ヘッドマウントディスプレイおよび運送点検用ヘッドマウントディスプレイのプログラム
JP2014155635A (ja) 視線計測装置、注視領域の表示方法および注視点のガウス分布の表示方法
CN107147897A (zh) 图像显示方法及装置
WO2018232630A1 (zh) 三维影像预处理方法、装置及头戴显示设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17738174

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 05.12.2018)

122 Ep: pct application non-entry in european phase

Ref document number: 17738174

Country of ref document: EP

Kind code of ref document: A1