WO2017101780A1 - 一种三维立体显示处理方法、装置、存储介质和电子设备 - Google Patents

一种三维立体显示处理方法、装置、存储介质和电子设备 Download PDF

Info

Publication number
WO2017101780A1
WO2017101780A1 PCT/CN2016/109872 CN2016109872W WO2017101780A1 WO 2017101780 A1 WO2017101780 A1 WO 2017101780A1 CN 2016109872 W CN2016109872 W CN 2016109872W WO 2017101780 A1 WO2017101780 A1 WO 2017101780A1
Authority
WO
WIPO (PCT)
Prior art keywords
angle
user
screen
camera
dimensional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/109872
Other languages
English (en)
French (fr)
Inventor
骆磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cloudminds Shenzhen Robotics Systems Co Ltd
Original Assignee
Cloudminds Shenzhen Robotics Systems Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cloudminds Shenzhen Robotics Systems Co Ltd filed Critical Cloudminds Shenzhen Robotics Systems Co Ltd
Publication of WO2017101780A1 publication Critical patent/WO2017101780A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/302Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays

Definitions

  • the present application relates to the field of three-dimensional stereoscopic display technologies, and in particular, to a three-dimensional stereoscopic display processing method, apparatus, storage medium, and electronic device.
  • the display of existing three-dimensional images can only be achieved by holographic projection.
  • Theaters and televisions can achieve 3D (3D) display with special projection equipment and head-mounted equipment.
  • the image displayed by the plane is still flat after being viewed by the user, and the displayed content has no change of the viewing angle, and is not a stereoscopic image; while the holographic projection is a true three-dimensional display, the cost is high, and both are large.
  • Equipment there is no good solution on portable equipment.
  • the projection medium is also more difficult to handle.
  • special liquid mist or special gas method is adopted, and the threshold is very high. Without using these devices, users cannot see 3D images on a normal two-dimensional screen (such as a mobile phone screen) through the naked eye.
  • the embodiment of the present application proposes a three-dimensional stereoscopic display processing method, device, storage medium and electronic device for displaying a three-dimensional stereoscopic image on a common two-dimensional screen.
  • an embodiment of the present application provides a three-dimensional stereoscopic display processing method, including:
  • the adjusted image is displayed on the two-dimensional screen.
  • an embodiment of the present application provides a three-dimensional stereoscopic display processing apparatus, including:
  • An angle determining unit configured to determine an angle between a user's eye to a horizontal direction between a two-dimensional screen center point line and a horizontal axis of the screen, and an angle between a longitudinal direction between the center axis of the screen and the vertical axis of the screen;
  • a display processing unit configured to adjust an image display angle of the image content source according to the angle between the lateral direction angle and the longitudinal direction;
  • a display unit displays the adjusted image on the two-dimensional screen.
  • an embodiment of the present application provides a storage medium for storing a program to perform a three-dimensional stereoscopic display processing method as described above.
  • An electronic device comprising:
  • a storage medium for storing a program
  • a processor configured to execute a three-dimensional stereoscopic display processing method as described above according to a program stored in the storage medium
  • a two-dimensional screen for displaying according to instructions of the processor is a two-dimensional screen for displaying according to instructions of the processor.
  • the angle between the angle of the lateral direction and the angle of the longitudinal direction adjusts the image display angle of the image content source, and displays the adjusted image on the two-dimensional screen.
  • FIG. 1 is a schematic flow chart of a three-dimensional stereoscopic display processing method in an embodiment of the present application
  • FIG. 2 is a schematic flow chart of a three-dimensional stereoscopic display processing method in Embodiment 1 of the present application;
  • Figure 3a shows the user eye to the two-dimensional screen center point connection and the screen center horizontal axis in the first embodiment a top view of a portable device with an angle between the transverse directions a;
  • Figure 3b is a side elevational view of the portable device of the first embodiment in which the angle between the user's eyes and the center line of the two-dimensional screen and the longitudinal center of the screen is at an angle b;
  • FIG. 4 is a schematic view showing a holographic projection of a car in the first embodiment of the present application
  • FIG. 5 is a schematic diagram showing the angle error of the mobile phone in the third embodiment of the present application.
  • FIG. 6 is a schematic structural diagram of a three-dimensional stereoscopic display processing apparatus in an embodiment of the present application.
  • FIG. 7 is a schematic diagram showing another structure of a three-dimensional stereoscopic display processing apparatus in an embodiment of the present application.
  • FIG. 8 is a schematic diagram showing still another structure of a three-dimensional stereoscopic display processing apparatus in an embodiment of the present application.
  • FIG. 9 is a schematic diagram of an electronic device according to an embodiment of the present application.
  • FIG. 1 shows a three-dimensional stereoscopic display processing method in an embodiment of the present application, including:
  • Step 101 determining an angle between a horizontal direction between a user's eyes and a center line of the two-dimensional screen and a horizontal axis of the screen, and an angle between the longitudinal direction of the vertical axis of the screen;
  • Step 102 adjusting an image display angle of the image content source according to the angle between the angle of the lateral direction and the angle of the longitudinal direction;
  • step 103 the adjusted image is displayed on a two-dimensional screen.
  • the above three-dimensional stereoscopic display processing method may be implemented by a device where the two-dimensional screen is located, or may be implemented by a device (such as a server) separated from the two-dimensional screen.
  • Embodiment 1 is a diagrammatic representation of Embodiment 1:
  • the user information collection and the three-dimensional stereoscopic display processing are performed by the same portable device as an example.
  • the fixed forward camera of the portable device can cover images within a certain angle range directly in front of the device, and if the camera can be rotated in a small range, a larger range of images can be obtained.
  • the portable device camera can cover an angle of 120 degrees directly in front of the device, that is, a range in which the apex angle is 120 degrees perpendicular to the cone of the screen.
  • the image content source in the first embodiment is the same as the holographic projection, modeling a three-dimensional data (taking a holographic projection of a car as an example). While the portable device displays the holographic projection, the camera begins to detect the two-way angle between the human eye and the front surface of the screen, one is the lateral angle of the device, and the other is the longitudinal angle of the device.
  • the method for processing a three-dimensional stereoscopic display in the first embodiment, as shown in FIG. 2, includes:
  • Step 201 The forward camera of the portable device acquires an angle between a user's eye to a horizontal direction between a two-dimensional screen center point line and a horizontal axis of the screen, and an angle with a longitudinal direction between the center axis of the screen ;
  • Figure 3a shows a top view of the portable device, assuming that the angle between the user's eye to the two-dimensional screen center point line and the horizontal axis of the screen is a.
  • Figure 3b shows a side view of the portable device, assuming that the angle between the user's eye to the longitudinal direction of the two-dimensional screen center point line and the screen center longitudinal axis is b.
  • the maximum angle range that the current camera can recognize is 120 degrees
  • the maximum value of a and b is 60°, assuming that the front of the image is the front view of the car.
  • Step 202 Display an image of a corresponding angle of the image content source on the two-dimensional screen according to the angle between the angle of the lateral direction and the angle of the longitudinal direction.
  • the three-dimensional modeling should also take the angle a in the lateral direction and the angle b in the longitudinal direction to project the three-dimensional model onto the surface of the two-dimensional screen so that the user's eyes can be on the screen. See the image at this angle.
  • the hologram image is projected on the virtual plane at an angle a between the horizontal direction and the angle b in the longitudinal direction, and is used as a display screen of the portable device at this time.
  • the front camera can detect the orientation of the user's eyes and the screen and display the image image of the direction on the screen.
  • Embodiment 2 is a diagrammatic representation of Embodiment 1:
  • the portable device further receives an image rotation angle set by the user
  • the image rotation angle set by the user may be used as the basis for displaying the image of the corresponding angle of the image content source.
  • the user can manually set the horizontal and vertical rotation angles (p, q) of the image, where p represents the lateral rotation angle in the holographic image and q represents the longitudinal rotation angle in the holographic image.
  • p represents the lateral rotation angle in the holographic image
  • q represents the longitudinal rotation angle in the holographic image.
  • the front direction of the vehicle head is (0, 0). If the user sets the image rotation angle to (0, 0), that is, the user's setting is the basis of the image showing the corresponding angle of the image content source, that is, the user moves the eye position based on the front facing direction (0, 0). What you can see is the image of the front of the car head facing the direction (0,0) up and down and 60° angle.
  • the screen display is the direction in which the tail is facing.
  • the user can see the image in the range of 60° angles up, down, left, and right in the direction in which the tail is facing.
  • the screen When the user manually sets the image rotation angle to (0, 90), that is, after the car image is rotated 90 degrees vertically, the screen displays the direction directly opposite the vehicle.
  • the user's moving eye position can see the top image of the car within 60° of the front, rear, left and right of the vehicle.
  • the angle at which the holographic image should be projected is determined according to p and a and q and b at this time, and the image of the angle is displayed on the screen of the portable device. .
  • the forward direction camera of the portable device acquires the angle between the user's eyes to the horizontal direction between the center line of the two-dimensional screen and the horizontal axis of the screen, and the longitudinal direction between the center axis of the screen and the vertical axis of the screen. Angle, this is a case where there may be a forward camera located in the middle of the screen, in addition, Even if the forward camera is not located in the middle of the screen, the solution of the first embodiment can provide a three-dimensional image display on the two-dimensional screen, which improves the user experience compared with the prior art.
  • the forward camera of most devices is not in the middle of the horizontal direction of the mobile phone, and there is no vertical in the middle, the horizontal direction between the user's eyes detected by the camera and the center point of the two-dimensional screen and the horizontal axis of the screen.
  • the angle error of the mobile phone in the horizontal direction is taken as an example. As shown in FIG. 5, it is assumed that the side of the camera is taken as an angle of 180° (the forward camera will affect the direction on the left or right side of the front of the mobile phone):
  • the distance between the forward camera and the center axis of the screen is x, which is a known value when the phone is designed, and can be determined by reading the data stored by the device or receiving the user's input. It is determined that the angle between the eye of the household to the center line of the two-dimensional screen and the horizontal axis of the screen is ⁇ , and the angle between the line connecting the front camera and the user's eyes and the horizontal axis of the camera is ⁇ . The distance between the camera and the user's eyes is l. The distance between the camera and the user can be obtained by the camera auto focus ranging or laser focus ranging. The angle between the two lines to the user's eyes is ⁇ , and the distance from the user's eyes to the screen is k.
  • This ⁇ is the actual lateral direction between the user's eyes and the center point of the two-dimensional screen and the horizontal axis of the screen.
  • the angle between the forward camera and the user's eye and the longitudinal direction between the longitudinal axis of the camera is ⁇ ′, where y is the distance between the forward camera and the horizontal axis of the two-dimensional screen. , l is the distance between the forward camera and the user's eyes.
  • the distance y between the forward camera and the horizontal axis of the center of the two-dimensional screen can be determined by reading data stored by the device or receiving input from the user.
  • a three-dimensional stereoscopic display processing device is also provided in the embodiment of the present application. Since the principle of solving the problem of these devices is similar to that of a three-dimensional stereoscopic display processing method, the implementation of these devices can be referred to the implementation of the method. It will not be repeated here.
  • the three-dimensional stereoscopic display processing apparatus in the embodiment of the present application includes:
  • the angle determining unit 601 is configured to capture an angle between a horizontal direction between the user eye to the two-dimensional screen center point line and the horizontal axis of the screen, and an angle between the longitudinal direction of the screen center longitudinal axis;
  • the display processing unit 602 is configured to adjust an image display angle of the image content source according to the lateral direction angle and the longitudinal direction angle, and display the adjusted image on the two-dimensional screen.
  • the three-dimensional stereoscopic display processing device further includes a user setting unit 603, configured to receive an image rotation angle set by the user;
  • the display processing unit 602 further adjusts an image display angle of the image content source according to an angle between the angle of the lateral direction and the longitudinal direction and the image rotation angle.
  • the three-dimensional display processing device includes a forward camera 604;
  • the angle determining unit 601 determines the angle between the angle of the lateral direction and the longitudinal direction by the information acquired by the forward camera 604.
  • the information acquired by the forward camera 604 is the angle between the forward camera 604 and the horizontal line between the user's eye connection and the horizontal axis of the camera; the angle determining unit calculates the lateral direction angle ⁇ according to the following formula:
  • x is the distance between the forward camera 604 and the center axis of the two-dimensional screen
  • l is the distance between the forward camera 604 and the user's eyes
  • is the horizontal direction between the connection of the forward camera 604 and the user's eyes and the horizontal axis of the camera. The angle of the direction.
  • the information acquired by the forward camera 604 is the angle between the forward camera 604 and the longitudinal direction between the user's eye connection and the longitudinal axis of the camera; the angle determining unit 601 calculates the longitudinal direction angle ⁇ ' according to the following formula:
  • y is the distance between the forward camera 604 and the horizontal axis of the two-dimensional screen
  • l is the distance between the forward camera and the user's eyes
  • ⁇ ' is the longitudinal direction between the forward camera 604 and the user's eye connection and the longitudinal axis of the camera. Angle.
  • Embodiments of the present invention provide a storage medium for storing a program to perform a three-dimensional stereoscopic display processing method as described above.
  • an embodiment of the present invention further provides an electronic device, including:
  • the processor 902 is configured to execute a three-dimensional stereoscopic display processing method as described according to the program stored in the storage medium;
  • the camera 903 acquires image information
  • a two-dimensional screen 904 is configured to display according to instructions of the processor.
  • the embodiment of the present invention does not need to wear 3D glasses, and can display the projection of the three-dimensional image in the two-dimensional image, and different angles of the image can be seen from different angles, and the user's visual experience can reach a leap level;
  • the embodiments of the present invention can be realized at a very low cost even with existing equipment, without requiring any large equipment or any special projection medium, and achieving a much lower threshold.
  • the embodiment of the invention can correct the actual angle between the user's eyes and the screen, and the accuracy is improved.
  • embodiments of the present application can be provided as methods, apparatus, and systems. System, or computer program product.
  • the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment in combination of software and hardware.
  • the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Processing Or Creating Images (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

本申请提供了一种三维立体显示处理方法、装置、存储介质和电子设备,用于在普通的二维屏幕上显示三维立体图像。该方法包括:用户眼睛到二维屏幕中心点连线与所述屏幕中心横轴之间的横向方向夹角,和与所述屏幕中心纵轴之间的纵向方向夹角;根据所述横向方向夹角和纵向方向夹角调整图像内容源的图像显示角度,将调整后的图像显示在所述二维屏幕上。通过上述方法,可以在普通的二维屏幕上显示三维立体图像,不需要任何大型设备也不需要任何特殊投影介质,成本极低,形态与现有终端设备相符,对用户来说是一种全新的体验,也能为应用程序开发开拓新的想象空间。

Description

一种三维立体显示处理方法、装置、存储介质和电子设备 技术领域
本申请涉及三维立体显示技术领域,尤其涉及一种三维立体显示处理方法、装置、存储介质和电子设备。
背景技术
现有三维立体图像的显示只能通过全息投影来实现。影院和电视能够通过特殊的放映设备配合头戴设备实现3D(三维)显示。
现有技术中,平面显示的图像在用户转动角度观看后依然是平面的,显示的内容没有视角变化,不是立体图像;而全息投影虽然为真三维立体显示,但成本很高,且均为大型设备,在便携设备上还没有很好的解决方案,另外,投影介质也是比较难处理的,目前多采用特殊液体薄雾或者特殊气体的方法,门槛很高。在不利用这些设备的情况下,用户不能通过裸眼在普通的二维屏幕(如手机屏)上看到3D图像。
发明内容
本申请实施例提出了一种三维立体显示处理方法、装置、存储介质和电子设备,用于在普通的二维屏幕上显示三维立体图像。
在一个方面,本申请实施例提供了一种三维立体显示处理方法,包括:
确定用户眼睛到二维屏幕中心点连线与所述屏幕中心横轴之间的横向方向夹角,和与所述屏幕中心纵轴之间的纵向方向夹角;
根据所述横向方向夹角和纵向方向夹角调整图像内容源的图像显示角度;
将调整后的图像显示在所述二维屏幕上。
在另一个方面,本申请实施例提供了一种三维立体显示处理装置,包括:
角度确定单元,用于确定用户眼睛到二维屏幕中心点连线与所述屏幕中心横轴之间的横向方向夹角,和与所述屏幕中心纵轴之间的纵向方向夹角;
显示处理单元,用于根据所述横向方向夹角和纵向方向夹角调整图像内容源的图像显示角度;
显示单元,将调整后的图像显示在所述二维屏幕上。
在另一个方面,本申请实施例提供了存储介质,用于存储程序执行如上文所述的三维立体显示处理方法。
一种电子设备,包括:
存储介质,用于存储程序;
处理器,用于根据所述存储介质存储的程序执行如上文所述的三维立体显示处理方法;
摄像头,获取图像信息;
二维屏幕,用于根据所述处理器的指令进行显示。
有益效果如下:
在本发明实施例中,用户眼睛到二维屏幕中心点连线与所述屏幕中心横轴之间的横向方向夹角,和与所述屏幕中心纵轴之间的纵向方向夹角;根据所述横向方向夹角和纵向方向夹角调整图像内容源的图像显示角度,在二维屏幕上显示调整后的图像。通过上述方法,可以在普通的二维屏幕上显示三维立体图像,不需要任何大型设备也不需要任何特殊投影介质,成本极低,形态与现有终端设备相符,对用户来说是一种全新的体验,也能为应用程序开发开拓新的想象空间。
附图说明
下面将参照附图描述本申请的具体实施例,其中:
图1示出了本申请实施例中三维立体显示处理方法的流程示意图;
图2示出了本申请实施例一中三维立体显示处理方法的流程示意图;
图3a示出了实施例一中用户眼睛到二维屏幕中心点连线与屏幕中心横轴 之间的横向方向夹角为a的便携设备的俯视图;
图3b示出了实施例一中用户眼睛到二维屏幕中心点连线与屏幕中心纵轴之间的纵向方向夹角为b的便携设备的侧视图;
图4示出了本申请实施例一中汽车的全息投影示意图;
图5示出了本申请实施例三中手机横向的夹角误差的示意图;
图6示出了本申请实施例中的三维立体显示处理装置的结构示意图;
图7示出了本申请实施例中的三维立体显示处理装置的另一个结构示意图;
图8示出了本申请实施例中的三维立体显示处理装置的又一个结构示意图;
图9示出了本申请实施例电子设备的示意图。
具体实施方式
为了使本申请的技术方案及优点更加清楚明白,以下结合附图对本申请的示例性实施例进行进一步详细的说明,显然,所描述的实施例仅是本申请的一部分实施例,而不是所有实施例的穷举。并且在不冲突的情况下,本说明书中的实施例及实施例中的特征可以互相结合。
图1示出了本申请实施例中三维立体显示处理方法,包括:
步骤101,确定用户眼睛到二维屏幕中心点连线与屏幕中心横轴之间的横向方向夹角,和与屏幕中心纵轴之间的纵向方向夹角;
步骤102,根据该横向方向夹角和纵向方向夹角调整图像内容源的图像显示角度;
步骤103,将调整后的图像显示在二维屏幕上。
在实现时,上述三维立体显示处理方法可以由该二维屏幕所在设备来实现,也可以由与该二维屏幕分离的设备(例如服务器)来实现。
为了便于本申请的实施,下面以实施例进行说明。
实施例一:
实施例一以由同一个便携设备来进行用户信息采集、三维立体显示处理为例进行说明。
便携设备的固定前向摄像头能够覆盖设备正前方一定角度范围内的图像,若摄像头可小范围旋转,则可获得更大范围内的图像。实施例一中以便携设备摄像头能够覆盖设备正前方120度角进行举例,即一个顶角为120度垂直于屏幕的圆锥的范围。
实施例一中的图像内容源和全息投影相同,为一个三维立体数据建模(以一个汽车的全息投影为例)。便携设备显示该全息投影的同时摄像头开始侦测人眼与屏幕正表面的双向角度,一个是设备横向的角度,一个是设备纵向的角度。
实施例一中三维立体显示处理方法,如图2所示,包括:
步骤201,便携设备的前向摄像头获取用户眼睛到二维屏幕中心点连线与所述屏幕中心横轴之间的横向方向夹角,和与所述屏幕中心纵轴之间的纵向方向夹角;
图3a示出了便携设备的俯视图,假设用户眼睛到二维屏幕中心点连线与屏幕中心横轴之间的横向方向夹角为a。图3b示出了便携设备的侧视图,假设用户眼睛到二维屏幕中心点连线与屏幕中心纵轴之间的纵向方向夹角为b。当前置摄像头能够识别的最大角度范围是120度时,a和b的最大值为60°,假设图像正面为汽车的正前方视图。
步骤202,根据该横向方向夹角和纵向方向夹角在该二维屏幕上显示图像内容源相应角度的图像。
如图4所示,以汽车的全息投影为例,三维建模也应该取横向方向夹角a,纵向方向夹角b进行三维立体模型到二维屏幕表面的投影,以使用户眼睛能够在屏幕上看到此角度的图像。具体来说,取全息影像投影在与横向方向夹角a,纵向方向夹角b方向上虚拟平面上的投影,并将其作为此时便携设备的显示画面。
基于上述方法,当使用便携设备显示全息影像时,前置摄像头可检测用户眼睛与屏幕的方位进而将该方向的影像图像显示在屏幕上。
实施例二:
在实施例二中,便携设备还接收用户设置的图像旋转角度;
实施例一中根据横向方向夹角a和纵向方向夹角b在二维屏幕上显示图像内容源相应角度的图像时,可以以用户设置的图像旋转角度为显示图像内容源相应角度的图像的基础。
具体来说,用户可手动设置图像的横向和纵向旋转角度(p,q),其中p表示全息影像中的横向旋转角度,q表示全息影像中的纵向旋转角度。仍然以实施例一中的汽车为例,假设车头正对方向为(0,0)。若用户设置图像旋转角度为(0,0),即此时以用户的设置为显示图像内容源相应角度的图像的基础,即以车头正对方向(0,0)为基础,用户移动眼睛位置能够看到的是车头正对方向(0,0)上下左右60°角范围内的影像。
当用户手动设置图像旋转角度为(180,0)时,即此时汽车图像横向旋转180度之后,屏幕上显示则是车尾正对的方向。用户移动眼睛位置能够看到的是车尾正对的方向上下左右60°角范围内的影像。
当用户手动设置图像旋转角度为(0,90)时,即此时汽车图像纵向旋转90度之后,屏幕上显示的则是车辆正上方正对的方向。用户移动眼睛位置能够看到的是车辆正上方前后左右60°角范围内的汽车顶部影像。
也就是说在用户手动设置了图像旋转角度(p,q)后,将根据此时的p和a以及q和b判断全息影像应当投影的角度,并将该角度的影像显示在便携设备屏幕上。
实施例三
在实施例一中,由便携设备的前向摄像头获取了用户眼睛到二维屏幕中心点连线与屏幕中心横轴之间的横向方向夹角,和与屏幕中心纵轴之间的纵向方向夹角,这是考虑到可能存在前向摄像头位于屏幕中间的情况,此外, 即使前向摄像头并非位于屏幕中间,实施例一的方案也能够在二维屏幕上提供三维图像显示,与现有技术相比提升了用户体验。
考虑到目前大多数设备的前向摄像头都不在手机横向的正中间,更没有在竖向正中间的,摄像头检测到的用户眼睛到二维屏幕中心点连线与屏幕中心横轴之间的横向方向夹角,和与屏幕中心纵轴之间的纵向方向夹角与实际的夹角会存在误差,因此,若对相应的误差进行校正,则可以进一步提升三维图像显示与用户观看的准确度,提升用户体验。
实施例三中以手机横向的夹角误差为例,如图5所示,假设将摄像头一侧作为180°夹角(前向摄像头在手机正方向左侧还是右侧将影响此方向):
假设前向摄像头与屏幕中心纵轴的间距为x,这在手机设计时就是确定已知数值,可以通过读取所述设备存储的数据或接收用户的输入来确定。确定户眼睛到二维屏幕中心点连线与屏幕中心横轴之间的横向方向夹角为α,前向摄像头与用户眼睛的连线与摄像头所在横轴之间的横向方向夹角为β,摄像头与用户眼睛距离为l,可以通过摄像头自动对焦测距或激光对焦测距获得摄像头与用户距离为l,两条线到用户眼睛的夹角为γ,用户眼睛到屏幕距离为k。
根据余弦定理可知:
cosβ=x2+l2–k2/(2*x*l)
进而可推导出:k=√(x2+l2-2*x*l*cosβ)
再根据正弦定理可知:
k/sinβ=l/sin(180°-α)
代入计算可得到公式(1)
α=arcsin(l*sinβ/√(x2+l2-2*x*l*cosβ))
                                                  公式(1)
此α即为用户眼睛到二维屏幕中心点连线与屏幕中心横轴之间的实际横向方向夹角。
同理,也可以根据公式(2)得到用户眼睛到二维屏幕中心点连线与屏幕中心纵轴之间的实际纵向方向夹角α’:
α’=arcsin(l*sinβ’/√(y2+l2-2*x*l*cosβ’))
                                            公式(2)
其中,前向摄像头得到的前向摄像头与用户眼睛的连线与摄像头所在纵轴之间的纵向方向夹角为β’,y为所述前向摄像头与所述二维屏幕中心横轴的间距,l为所述前向摄像头与用户眼睛的距离。可以通过读取设备存储的数据或接收用户的输入确定前向摄像头与二维屏幕中心横轴的间距y。
基于同一发明构思,本申请实施例中还提供了一种三维立体显示处理装置,由于这些设备解决问题的原理与一种三维立体显示处理方法相似,因此这些设备的实施可以参见方法的实施,重复之处不再赘述。
如图6所示,本申请实施例中的三维立体显示处理装置包括:
角度确定单元601,用于用户眼睛到二维屏幕中心点连线与所述屏幕中心横轴之间的横向方向夹角,和与所述屏幕中心纵轴之间的纵向方向夹角;
显示处理单元602,用于用于根据所述横向方向夹角和纵向方向夹角调整图像内容源的图像显示角度,并将调整后的图像显示在二维屏幕上。
进一步地,如图7所示,该三维立体显示处理装置还包括用户设置单元603,用于接收用户设置的图像旋转角度;
显示处理单元602根据根据所述横向方向夹角和纵向方向夹角以及所述图像旋转角度进一步调整所述图像内容源的图像显示角度。
如图8所示,该三维立体显示处理装置包括前向摄像头604;
角度确定单元601,通过前向摄像头604获取的信息,确定横向方向夹角和纵向方向夹角。
前向摄像头604获取的信息为前向摄像头604到用户眼睛连线与摄像头所在横轴之间的横向方向夹角;角度确定单元根据如下公式计算得到横向方向夹角α:
α=arcsin(l*sinβ/√(x2+l2-2*x*l*cosβ))
其中x为前向摄像头604与二维屏幕中心纵轴的间距,l为前向摄像头604与用户眼睛的距离,β为前向摄像头604与用户眼睛的连线与摄像头所在横轴之间的横向方向夹角。
前向摄像头604获取的信息为前向摄像头604到用户眼睛连线与摄像头所在纵轴之间的纵向方向夹角;角度确定单元601根据如下公式计算得到纵向方向夹角α’:
α’=arcsin(l*sinβ’/√(y2+l2-2*x*l*cosβ’))
其中y为前向摄像头604与二维屏幕中心横轴的间距,l为前向摄像头与用户眼睛的距离;β’为前向摄像头604到用户眼睛连线与摄像头所在纵轴之间的纵向方向夹角。
本发明实施例提供一种存储介质,用于存储程序执行如上文所述的三维立体显示处理方法。
如图9所示,本发明实施例还提供一种电子设备,包括:
存储介质901,用于存储程序;
处理器902,用于根据所述存储介质存储的程序执行如所述的三维立体显示处理方法;
摄像头903,获取图像信息;
二维屏幕904,用于根据所述处理器的指令进行显示。
和目前3D屏幕比,本发明实施例不需要戴3D眼镜,可显示三维立体影像在二维图像的投影,不同的角度可看到图像的不同视角,用户的视觉体验可以达到飞跃的水平;
本发明实施例采用极低的成本甚至现有的设备就可实现,不需要任何大型设备也不需要任何特殊投影介质,实现门槛低很多。
本发明实施例可纠正得到用户眼睛与屏幕的实际夹角,精确度提升。
本领域内的技术人员应明白,本申请的实施例可提供为方法、装置、系 统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
尽管已描述了本申请的优选实施例,但本领域内的技术人员一旦得知了基本创造性概念,则可对这些实施例作出另外的变更和修改。所以,所附权利要求意欲解释为包括优选实施例以及落入本申请范围的所有变更和修改。

Claims (14)

  1. 一种三维立体显示处理方法,其特征在于,包括:
    确定用户眼睛到二维屏幕中心点连线与所述屏幕中心横轴之间的横向方向夹角,和与所述屏幕中心纵轴之间的纵向方向夹角;
    根据所述横向方向夹角和纵向方向夹角调整图像内容源的图像显示角度;
    将调整后的图像显示在所述二维屏幕上。
  2. 如权利要求1所述的方法,其特征在于,所述将调整后的图像显示在所述二维屏幕上的步骤之前,还包括:
    接收用户设置的图像旋转角度;
    根据所述横向方向夹角和纵向方向夹角以及所述图像旋转角度进一步调整所述图像内容源的图像显示角度。
  3. 如权利要求1所述的方法,其特征在于,所述确定用户眼睛到二维屏幕中心点连线与所述屏幕中心横轴之间的横向方向夹角,和与所述屏幕中心纵轴之间的纵向方向夹角的步骤,包括:通过所述二维屏幕所在设备的前向摄像头获取的信息,确定所述横向方向夹角和纵向方向夹角。
  4. 如权利要求3所述的方法,其特征在于,所述前向摄像头获取的信息为所述前向摄像头到用户眼睛连线与摄像头所在横轴之间的横向方向夹角,所述通过所述二维屏幕所在设备的前向摄像头获取的信息,确定所述横向方向夹角和纵向方向夹角,包括:
    根据如下公式计算得到所述用户眼睛到二维屏幕中心点连线与所述屏幕中心横轴之间的横向方向夹角α:
    α=arcsin(l*sinβ/√(x2+l2-2*x*l*cosβ))
    其中x为所述前向摄像头与所述二维屏幕中心纵轴的间距,l为所述前向摄像头与用户眼睛的距离,β为所述前向摄像头与用户眼睛的连线与摄像头 所在横轴之间的横向方向夹角。
  5. 如权利要求3所述的方法,其特征在于,所述前向摄像头获取的信息为所述前向摄像头到用户眼睛连线与摄像头所在纵轴之间的纵向方向夹角,所述通过所述二维屏幕所在设备的前向摄像头获取的信息,确定所述横向方向夹角和纵向方向夹角,包括:
    根据如下公式计算得到所述用户眼睛到二维屏幕中心点连线与所述屏幕中心纵轴之间的纵向方向夹角α’:
    α’=arcsin(l*sinβ’/√(y2+l2-2*x*l*cosβ’))
    其中y为所述前向摄像头与所述二维屏幕中心横轴的间距,l为所述前向摄像头与用户眼睛的距离;β’为所述前向摄像头与用户眼睛的连线与摄像头所在纵轴之间的纵向方向夹角。
  6. 如权利要求3、4或5任一项所述的方法,其特征在于,还包括:通过所述前向摄像头自动对焦测距或激光对焦测距获得所述前向摄像头与用户眼睛的距离l。
  7. 如权利要求4所述的方法,其特征在于,还包括:通过读取所述设备存储的数据或接收用户的输入确定所述前向摄像头与所述二维屏幕中心纵轴的间距x。
  8. 一种三维立体显示处理装置,其特征在于,包括:
    角度确定单元,用于确定用户眼睛到二维屏幕中心点连线与所述屏幕中心横轴之间的横向方向夹角,和与所述屏幕中心纵轴之间的纵向方向夹角;
    显示处理单元,用于根据所述横向方向夹角和纵向方向夹角调整图像内容源的图像显示角度,并将调整后的图像显示在所述二维屏幕上。
  9. 如权利要求8所述的装置,其特征在于,还包括用户设置单元,用于接收接收用户设置的图像旋转角度;
    所述显示处理单元根据根据所述横向方向夹角和纵向方向夹角以及所述图像旋转角度进一步调整所述图像内容源的图像显示角度。
  10. 如权利要求8所述的装置,其特征在于,包括:
    所述角度确定单元,通过二维屏幕所在设备的前向摄像头获取的信息,确定所述横向方向夹角和纵向方向夹角。
  11. 如权利要求10所述的装置,其特征在于,所述前向摄像头获取的信息为所述前向摄像头到用户眼睛连线与摄像头所在横轴之间的横向方向夹角;所述角度确定单元根据如下公式计算得到所述用户眼睛到二维屏幕中心点连线与所述屏幕中心横轴之间的横向方向夹角α:
    α=arcsin(l*sinβ/√(x2+l2-2*x*l*cosβ))
    其中x为所述前向摄像头与所述二维屏幕中心纵轴的间距,l为所述前向摄像头与用户眼睛的距离,β为所述前向摄像头与用户眼睛的连线与摄像头所在横轴之间的横向方向夹角。
  12. 如权利要求10所述的装置,其特征在于,所述前向摄像头获取的信息为所述前向摄像头到用户眼睛连线与摄像头所在纵轴之间的纵向方向夹角;所述角度确定单元根据如下公式计算得到所述用户眼睛到二维屏幕中心点连线与所述屏幕中心纵轴之间的纵向方向夹角α’:
    α’=arcsin(l*sinβ’/√(y2+l2-2*x*l*cosβ’))
    其中y为所述前向摄像头与所述二维屏幕中心横轴的间距,l为所述前向摄像头与用户眼睛的距离;β’为所述前向摄像头与用户眼睛的连线与摄像头所在纵轴之间的纵向方向夹角。
  13. 一种存储介质,其特征在于,存储程序执行如权力要求1至7任意一项所述的三维立体显示处理方法。
  14. 一种电子设备,其特征在于,包括:
    存储介质,用于存储程序;
    处理器,用于根据所述存储介质存储的程序执行如权力要求1至7任意一项所述的三维立体显示处理方法;
    摄像头,用于获取图像信息;
    二维屏幕,用于根据所述处理器的指令进行显示。
PCT/CN2016/109872 2015-12-18 2016-12-14 一种三维立体显示处理方法、装置、存储介质和电子设备 Ceased WO2017101780A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510958536.9A CN105592306A (zh) 2015-12-18 2015-12-18 一种三维立体显示处理方法和装置
CN201510958536.9 2015-12-18

Publications (1)

Publication Number Publication Date
WO2017101780A1 true WO2017101780A1 (zh) 2017-06-22

Family

ID=55931480

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/109872 Ceased WO2017101780A1 (zh) 2015-12-18 2016-12-14 一种三维立体显示处理方法、装置、存储介质和电子设备

Country Status (2)

Country Link
CN (1) CN105592306A (zh)
WO (1) WO2017101780A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116431095A (zh) * 2023-03-23 2023-07-14 北京凯视达科技股份有限公司 全景显示方法、装置、电子设备和存储介质

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105592306A (zh) * 2015-12-18 2016-05-18 深圳前海达闼云端智能科技有限公司 一种三维立体显示处理方法和装置
WO2018119676A1 (zh) * 2016-12-27 2018-07-05 深圳前海达闼云端智能科技有限公司 一种显示数据处理方法及装置
CN112817510B (zh) * 2019-11-15 2022-11-15 台达电子工业股份有限公司 图形程序语言的垂直线连续编辑方法
CN113012574B (zh) * 2021-02-19 2023-05-09 深圳创维-Rgb电子有限公司 屏幕曲率调整方法、装置、曲面显示器以及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102246202A (zh) * 2009-10-20 2011-11-16 索尼公司 图像显示装置、图像显示方法和程序
CN103019507A (zh) * 2012-11-16 2013-04-03 福州瑞芯微电子有限公司 一种基于人脸跟踪改变视点角度显示三维图形的方法
US20150206338A1 (en) * 2012-09-05 2015-07-23 Nec Casio Mobile Communications, Ltd. Display device, display method, and program
CN105138215A (zh) * 2014-05-26 2015-12-09 联想(北京)有限公司 一种信息处理方法及电子设备
CN105592306A (zh) * 2015-12-18 2016-05-18 深圳前海达闼云端智能科技有限公司 一种三维立体显示处理方法和装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101931823A (zh) * 2009-06-24 2010-12-29 夏普株式会社 显示3d图像的方法和设备
CN101901485B (zh) * 2010-08-11 2014-12-03 华中科技大学 3d自由头动式视线跟踪系统
CN103257707B (zh) * 2013-04-12 2016-01-20 中国科学院电子学研究所 利用视线跟踪技术和常规鼠标控制设备的三维漫游方法
JP2015041936A (ja) * 2013-08-23 2015-03-02 ソニー株式会社 画像表示装置、並びに画像処理装置及び画像処理方法
CN104618705B (zh) * 2014-11-28 2017-04-05 深圳市魔眼科技有限公司 基于眼球追踪的不同距离自适应全息显示方法及设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102246202A (zh) * 2009-10-20 2011-11-16 索尼公司 图像显示装置、图像显示方法和程序
US20150206338A1 (en) * 2012-09-05 2015-07-23 Nec Casio Mobile Communications, Ltd. Display device, display method, and program
CN103019507A (zh) * 2012-11-16 2013-04-03 福州瑞芯微电子有限公司 一种基于人脸跟踪改变视点角度显示三维图形的方法
CN105138215A (zh) * 2014-05-26 2015-12-09 联想(北京)有限公司 一种信息处理方法及电子设备
CN105592306A (zh) * 2015-12-18 2016-05-18 深圳前海达闼云端智能科技有限公司 一种三维立体显示处理方法和装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116431095A (zh) * 2023-03-23 2023-07-14 北京凯视达科技股份有限公司 全景显示方法、装置、电子设备和存储介质
CN116431095B (zh) * 2023-03-23 2024-04-30 北京凯视达科技股份有限公司 全景显示方法、装置、电子设备和存储介质

Also Published As

Publication number Publication date
CN105592306A (zh) 2016-05-18

Similar Documents

Publication Publication Date Title
US11838518B2 (en) Reprojecting holographic video to enhance streaming bandwidth/quality
CN107646126B (zh) 用于移动设备的相机姿态估计
JP6643357B2 (ja) 全球状取込方法
WO2017121361A1 (zh) 一种曲面二维屏幕的三维立体显示处理方法和装置
US20170295357A1 (en) Device and method for three-dimensional video communication
CN110276317A (zh) 一种物体尺寸检测方法、物体尺寸检测装置及移动终端
WO2017101780A1 (zh) 一种三维立体显示处理方法、装置、存储介质和电子设备
CN111696213A (zh) 图像生成装置、图像生成方法以及计算机可读介质
CN102246202A (zh) 图像显示装置、图像显示方法和程序
WO2020142328A1 (en) Image bounding shape using 3d environment representation
KR101701148B1 (ko) 3d 시각적 콘텐츠의 자동화된 평가를 위한 기술
CN120359547A (zh) 视频透视(vst)增强现实(ar)系统中扩展视图几何图形的生成和渲染
WO2017113733A1 (zh) 一种三维视频的自由观影方法及设备
KR102450236B1 (ko) 전자 장치, 그 제어 방법 및 컴퓨터 판독가능 기록 매체
CN115868158A (zh) 一种显示调节方法、装置、设备及介质
US11302023B2 (en) Planar surface detection
CN105809664A (zh) 生成三维图像的方法和装置
JP2017163528A5 (zh)
US20170300121A1 (en) Input/output device, input/output program, and input/output method
US12387422B2 (en) Methods and devices for video rendering for video see-through (VST) augmented reality (AR)
EP3599539B1 (en) Rendering objects in virtual views
CN105138215B (zh) 一种信息处理方法及电子设备
CN104519332A (zh) 产生视角平移影像的方法及其便携式电子设备
US20240078640A1 (en) Perspective Correction with Gravitational Smoothing
US20160373729A1 (en) Three-dimensional image display apparatus, methods and systems

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16874837

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 01.10.2018)

122 Ep: pct application non-entry in european phase

Ref document number: 16874837

Country of ref document: EP

Kind code of ref document: A1