WO2021169578A1 - 一种虚拟现实显示设备及显示方法 - Google Patents

一种虚拟现实显示设备及显示方法 Download PDF

Info

Publication number
WO2021169578A1
WO2021169578A1 PCT/CN2020/140974 CN2020140974W WO2021169578A1 WO 2021169578 A1 WO2021169578 A1 WO 2021169578A1 CN 2020140974 W CN2020140974 W CN 2020140974W WO 2021169578 A1 WO2021169578 A1 WO 2021169578A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
display area
image
virtual reality
area
Prior art date
Application number
PCT/CN2020/140974
Other languages
English (en)
French (fr)
Inventor
李文宇
苗京花
陈丽莉
张�浩
Original Assignee
京东方科技集团股份有限公司
北京京东方光电科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司, 北京京东方光电科技有限公司 filed Critical 京东方科技集团股份有限公司
Priority to US17/416,477 priority Critical patent/US11804194B2/en
Publication of WO2021169578A1 publication Critical patent/WO2021169578A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/003Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/36Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals
    • G09G3/3607Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals for displaying colours or for displaying grey scales with a specific pixel layout, e.g. using sub-pixels
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234Power saving characterised by the action undertaken
    • G06F1/325Power saving in peripheral device
    • G06F1/3265Power saving in display device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/39Control of the bit-mapped memory
    • G09G5/391Resolution modifying circuits, e.g. variable screen formats
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00Details relating to CAD techniques
    • G06F2111/18Details relating to CAD techniques using virtual or augmented reality
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00Control of display operating conditions
    • G09G2320/06Adjustment of display parameters
    • G09G2320/0686Adjustment of display parameters with two or more screen areas displaying information with different brightness or colours
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2330/00Aspects of power supply; Aspects of display protection and defect management
    • G09G2330/02Details of power systems and of start or stop of display operation
    • G09G2330/021Power management, e.g. power saving
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00Aspects of interface with display user

Definitions

  • the present invention relates to the field of display technology, in particular to a virtual reality display device and a display method.
  • VR Virtual Reality
  • the single-eye resolution of mainstream VR devices is 1080*1200.
  • a single-eye 4320*4320 or higher resolution VR device is a parameter that has not yet appeared on the market.
  • the introduction of smartview technology has solved the bottleneck in hardware transmission and software rendering of monocular high-resolution images to a certain extent. Combined with the eyetracking algorithm, it not only ensures the resolution requirement of the gaze area, but also reduces the rendering pressure and transmission bandwidth.
  • the prior art virtual reality display device has problems of high power consumption and waste of resources when performing smartview.
  • the present invention provides a virtual reality display device and a display method to improve the prior art virtual reality display device, which has the problems of high power consumption and waste of resources.
  • the embodiment of the present invention provides a display method of a virtual reality display device, including:
  • the screen of the virtual reality display device is controlled to be displayed with a first definition in a first display area where the human eye is watching, and a second display area other than the first display area is controlled to be displayed with a second definition, wherein the The first definition is higher than the second definition;
  • Part of the pixels in the second display area are controlled to perform black-filled display.
  • controlling part of the pixels in the second display area to perform black-filled display includes:
  • the black-filled pixels in the second display area are controlled to form a plurality of sequentially nested first closed patterns, and the unfilled pixels form a plurality of sequentially nested second closed patterns.
  • the first closed pattern and the second The closed patterns are arranged alternately.
  • the shape of the first closed pattern and the second closed pattern are similar to the shape of the first display area.
  • controlling part of the pixels in the second display area to perform black fill display includes:
  • the black-filled pixels controlling the second display area form a plurality of first pixel groups extending along the first direction, and the non-black-filled pixels form a plurality of second pixel groups extending along the first direction.
  • the first pixels The group and the second pixel group are arranged alternately.
  • the first direction is a pixel row direction or a pixel column direction.
  • control of the virtual reality display device to display in the first display area where the human eye is gazing at the first resolution, and the control of the second area outside the first display area to display in the second Definition display including:
  • the first image received for display in the first display area is overlaid on the first display area with the original resolution for display.
  • the display method further includes:
  • the received third image with the same screen resolution as the virtual reality display device is displayed in full screen at the original resolution.
  • the display method before the smart display mode is activated in response to the user's first operation, the display method further includes: real-time monitoring of user operations.
  • the display method further includes:
  • An embodiment of the present invention also provides a virtual reality display device, which includes a processing component configured to execute the display method provided in the embodiment of the present invention.
  • the virtual reality display method provided by the embodiments of the present invention includes: in response to a user's first operation, enabling an intelligent display mode;
  • the first display area is displayed with a first resolution
  • the second display area other than the first display area is controlled to be displayed with a second resolution, wherein the first resolution is higher than the second resolution
  • controlling Part of the pixels in the second display area are black-filled display, that is, because the second display area is an area that is not gaze by the human eye, it is not used for the main viewing display itself, and it is performed by performing partial pixels in the second display area.
  • the black fill display can reduce the low-resolution characteristics of the non-human eye's gaze area without affecting the human eye's viewing of the first display area, and greatly reduce the power consumption of the non-high-definition display area, thereby avoiding the non-human eye If all the pixels in the second display area of the gaze area are to be lit up, it will cause the problem of high power consumption of the virtual reality display device and waste of resources.
  • FIG. 1 is a flowchart of a display method of a virtual reality display device according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of the first black patching pattern provided by an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of a second black patching pattern provided by an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a third black patch provided by an embodiment of the present invention.
  • FIG. 5 is a flowchart of a specific display method of a virtual reality display device according to an embodiment of the present invention.
  • FIG. 6 is a schematic flowchart of another specific display method of a virtual reality display device according to an embodiment of the present invention.
  • an embodiment of the present invention provides a display method of a virtual reality display device, including:
  • Step S101 In response to the user's first operation, enable the smart display mode.
  • Step S102 controlling the screen of the virtual reality display device to display with the first definition in the first display area where human eyes are watching, and controlling the second display area outside the first display area to display with the second definition, where the first clear Degree is higher than the second clarity.
  • the first display area may be displayed in high definition
  • the second display area may be displayed in non-high definition.
  • Step S103 controlling part of the pixels in the second display area to perform black-filled display.
  • the gray scale of the pixel can be controlled to be 0 to realize the black-filled display of the pixel.
  • the virtual reality display method provided by the embodiment of the present invention includes: in response to a user's first operation, enabling the smart display mode; controlling the screen of the virtual reality display device to display in the first display area where the human eye is watching with the first definition, and Control the second display area other than the first display area to display at the second resolution, where the first resolution is higher than the second resolution; control part of the pixels in the second display area to perform black-filled display, that is, due to the second display
  • the area is the area that is not watched by the human eye, and is not used for the main viewing display.
  • the black display of some pixels in the second display area can reduce the view of the first display area by the human eye It is more in line with the low-resolution characteristics of the non-human eye viewing area, and at the same time, the power consumption of the non-high-definition display area is greatly reduced, thereby avoiding the second display area of the non-human eye viewing area to light up all pixels, which will cause a virtual reality display
  • controlling part of the pixels in the second display area S2 to perform black-filled display includes: controlling the black-filled pixels in the second display area S2 to form a plurality of sequentially nested pixels In the first closed pattern A1, the unfilled pixels form a plurality of sequentially nested second closed patterns A2, and the first closed pattern A1 and the second closed pattern A2 are arranged alternately.
  • the first closed pattern A1 and the second closed pattern A2 may be frame-shaped.
  • the first closed pattern A1 and the second closed pattern A2 may be rectangular frames, and each frame of the rectangular frame is composed of a single row or a single column of pixels.
  • the black-filled pixels in the second display area S2 are controlled to form a plurality of sequentially nested first closed patterns A1, and the non-black-filled pixels form a plurality of sequentially nested second closed patterns A2, and the first closed pattern A1 and the second closed pattern A2 are arranged alternately, which can make the brightness of different positions of the second display area basically the same, and avoid the problem of different brightness of different positions due to different pixel density distributions of black fill in different positions.
  • the shapes of the first closed pattern A1 and the second closed pattern A2 are similar to the shape of the first display area S1. That is, for example, if the shape of the first display area S1 is a square, the first closed pattern A1 and the second closed pattern A2 are also squares. For another example, if the shape of the first display area S1 is a circle, the first closed pattern A1 and the second closed pattern A2 are also circular.
  • controlling part of the pixels in the second display area to perform black-filling display includes: controlling the black-filling pixels in the second display area S2 to form a plurality of first pixel groups B1 extending in the first direction.
  • the black-filling pixels form a plurality of second pixel groups B2 extending along the first direction, and the first pixel group B1 and the second pixel group B2 are arranged alternately. It can be understood that if the first direction passes through the first display area S1, the pixels included in the first pixel group B1 should be pixels in this direction except the first display area S1.
  • the black-filled pixels forming the second display area S2 form a plurality of first pixel groups B1 extending in the first direction, and the non-black-filled pixels form a plurality of second pixel groups B2 extending in the first direction.
  • the first pixel group B1 and the second pixel group B2 are arranged alternately, so that minor improvements can be made to the display mode of pixels in the prior art, and the black-filling display mode is relatively simple and easy to implement.
  • the first direction is the pixel row direction, as shown in FIG. 3; the first direction may also be the pixel column direction, as shown in FIG. 4.
  • controlling the virtual reality display device to display with the first definition in the first display area where the human eye is watching, and controlling the second area outside the first display area to display with the second definition includes:
  • Step S1021 stretch the received second image for display in the second display area into an image with the same resolution as the screen of the virtual reality display device, and perform full-screen display. That is, the image displayed in the second display area is an image obtained by stretching the received image.
  • Step S1022 Cover the received first image for display in the first display area with the original resolution on the first display area for display.
  • the display method further includes:
  • Step S104 in response to the second operation of the user, enable the real display mode (real display mode).
  • Step S105 Display the received third image with the same resolution as the screen resolution of the virtual reality display device in full screen at the original resolution.
  • the display method further includes: in response to a second operation of the user, enabling the real display mode; displaying the received third image with the same resolution as the screen resolution of the virtual reality display device in full screen at the original resolution, Furthermore, the virtual display device can be switched between smartview mode and real mode intelligently according to the demand, which enriches the functions of the whole machine.
  • the display method before step S101, that is, before the smart display mode is activated in response to the user's first operation, the display method further includes: step S100, real-time monitoring of user operations.
  • step S101 and before step S102 that is, after the smart display mode is activated in response to the user's first operation, and after controlling the screen of the virtual reality display device to display the first display of the human eye Before displaying the area in the first resolution and controlling the second display area outside the first display area to be displayed in the second resolution, the display method further includes:
  • Step S201 Obtain the gaze area of the human eye.
  • Step S202 Render the original first image corresponding to the gaze area of the human eye, and render the original second image corresponding to the area other than the gaze area of the human eye;
  • Step S203 Perform image algorithm processing on the original first image to generate a first image, and perform image algorithm processing on the original second image to generate a second image.
  • the embodiment of the present invention also provides a virtual reality display device, including a processing component, and the processing component is used to execute the display method provided in the embodiment of the present invention.
  • the virtual reality display device in the embodiment of the present invention may specifically include: a virtual reality display component (for example, a virtual display helmet) and a computer device, and the processing component in the virtual reality display device may include: the first of the virtual reality display components Processing component, and the second processing component in computer equipment.
  • Two buttons can be set on the virtual reality display device (it can be the physical button set on the virtual reality display part, or the icon button displayed on the computer device, that is, replace with a software applet to select the display mode), respectively representing Intelligent display mode (smartview) and real display mode (real), users can choose the mode they want to experience according to their needs before use.
  • the software side will continuously monitor whether a button is pressed, which display mode is pressed, and pass the selected display mode information to the software and hardware;
  • the software outputs images according to the selected display mode, and the hardware switches the analysis scheme according to the selected display mode, as follows:
  • the steps performed on the software side can include: 1. Obtain the gaze area according to the eye tracking technology; 2. Render the non-high-definition image and the high-definition image of the eye gaze area. The original first image is rendered, and the original second image corresponding to the area other than the gaze area of the human eye is rendered; 3. Image algorithm processing is performed on high-definition images and non-high-definition images. Common algorithms include image enhancement and Local Dimming algorithm Etc., that is, perform image algorithm processing on the original first image to generate a first image, and perform image algorithm processing on the original second image to generate a second image; 4.
  • the processed high-definition image (ie, the first image) And the non-high-definition image (second image) is transmitted to the virtual reality display component on the hardware side through the transmission line; for the hardware side, the steps performed include: 5. Stretching the received second image for display in the second display area into and The virtual reality display device has images with the same screen resolution and displays them in full screen; 6. Part of the pixels of non-high-definition images are blackened, that is, part of the pixels in the second area is controlled to be blackened and displayed; 7. The first image displayed in a display area covers the first display area with the original resolution for display, that is, after receiving high-definition and non-high-definition images, a splicing is required to form an image; 8. Display displays the spliced image.
  • the real display mode on the software side, it can be the same as the traditional VR display solution. It can include: 1. Render real resolution images; 2. Image algorithm processing; 3. Transfer the processed images to the virtual hardware side through the transmission line. Realistic display parts are displayed on the hardware side.
  • the software side described above can specifically be the program code stored in the storage component of the computer device, and the corresponding implementation process can be executed by reading the program code of the storage component by the second processing component of the computer device. accomplish.
  • the hardware side it may specifically refer to the first processing component on the virtual reality display component, for example, an IC.
  • the virtual reality display method provided by the embodiments of the present invention includes: in response to a user's first operation, enabling an intelligent display mode; Display in the first resolution, and control the second display area outside the first display area to display in the second resolution, where the first resolution is higher than the second resolution; control part of the pixels in the second display area to fill black Display, that is, because the second display area is an area that is not gaze by human eyes, it is not used for the main viewing display itself, and it can fill in some pixels in the second display area to display the second display area without affecting the human eye’s While viewing in one display area, the reduction is more in line with the low-resolution characteristics of the non-human eye viewing area, and the power consumption of the non-high-definition display area is greatly reduced, thereby avoiding the second display area of the non-human eye viewing area to be fully lit All pixels will cause high power consumption and waste of resources for virtual reality display devices.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • Chemical & Material Sciences (AREA)
  • Crystallography & Structural Chemistry (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

一种虚拟现实显示设备及显示方法,以改善现有的虚拟现实显示设备存在的功耗较高和资源浪费的问题。所述虚拟现实显示设备的显示方法,包括:响应于用户的第一操作,启用智能显示模式 (S101);控制所述虚拟现实显示设备的屏幕在人眼注视的第一显示区以第一清晰度显示,以及控制所述第一显示区以外的第二显示区以第二清晰度显示 (S102),其中,所述第一清晰度高于所述第二清晰度;控制所述第二显示区的部分像素进行补黑显示 (S103)。

Description

一种虚拟现实显示设备及显示方法 技术领域
本发明涉及显示技术领域,尤其涉及一种虚拟现实显示设备及显示方法。
背景技术
虚拟现实(Virtual Reality,VR)技术是近年来出现的高新技术,其利用计算机硬件、软件和传感器等,建立虚拟现实环境,使用户能够通过VR设备体验虚拟世界并与虚拟世界交互。
现主流VR设备的单眼分辨率为1080*1200。单眼4320*4320或者更高分辨率VR设备,是目前市面上还未出现的参数。智能显示(smartview)技术的引入一定程度上解决了单眼高分辨率图像在硬件传输和软件渲染方面的瓶颈。结合人眼跟踪(eyetracking)算法,既保证了注视区域的分辨率需求,又降低了渲染压力和传输带宽。
但现有技术的虚拟现实显示设备在进行smartview时,存在功耗较高,资源浪费问题。
发明内容
本发明提供一种虚拟现实显示设备及显示方法,以改善现有技术的虚拟现实显示设备,存在功耗较高,资源浪费的问题。
本发明实施例提供一种虚拟现实显示设备的显示方法,包括:
响应于用户的第一操作,启用智能显示模式;
控制所述虚拟现实显示设备的屏幕在人眼注视的第一显示区以第一清晰度显示,以及控制所述第一显示区以外的第二显示区以第二清晰度显示,其中,所述第一清晰度高于所述第二清晰度;
控制所述第二显示区的部分像素进行补黑显示。
在一种可能的实施方式中,所述控制所述第二显示区的部分像素进行补 黑显示,包括:
控制所述第二显示区的补黑像素形成多个依次嵌套的第一闭合图案,未补黑像素形成多个依次嵌套的第二闭合图案,所述第一闭合图案和所述第二闭合图案相间排列。
在一种可能的实施方式中,所述第一闭合图案、所述第二闭合图案的形状与所述第一显示区的形状相似。
在一种可能的实施方式中,所述控制所述第二显示区的部分像素进行补黑显示,包括:
控制所述第二显示区的补黑像素形成多个沿第一方向延伸的第一像素组,未补黑像素形成多个沿所述第一方向延伸的第二像素组,所述第一像素组和所述第二像素组相间排列。
在一种可能的实施方式中,所述第一方向为像素行方向或像素列方向。
在一种可能的实施方式中,所述控制所述虚拟现实显示设备在人眼注视的第一显示区以第一清晰度显示,以及控制所述第一显示区以外的第二区域以第二清晰度显示,包括:
将接收的用于在所述第二显示区显示的第二图像拉伸成与所述虚拟现实显示设备的屏幕分辨率相同的图像,并进行全屏显示;
将接收的用于在所述第一显示区显示的第一图像以原分辨率覆盖于所述第一显示区进行显示。
在一种可能的实施方式中,所述显示方法还包括:
响应于用户的第二操作,启用真实显示模式;
将接收到的与所述虚拟现实显示设备的屏幕分辨率相同的第三图像以原分辨率进行全屏显示。
在一种可能的实施方式中,在响应于用户的第一操作,启用智能显示模式之前,所述显示方法还包括:实时监测用户操作。
在一种可能的实施方式中,在响应于用户的第一操作,启用智能显示模式之后,以及在控制所述虚拟现实显示设备的屏幕在人眼注视的第一显示区 以第一清晰度显示,以及控制所述第一显示区以外的第二显示区以第二清晰度显示之前,所述显示方法还包括:
获取人眼注视区域;
对与所述人眼注视区对应的原始第一图像进行渲染,以及与所述人眼注视区以外的其它区域对应的原始第二图像进行渲染;
对所述原始第一图像进行图像算法处理,生成第一图像,并对所述原始第二图像进行图像算法处理,生成第二图像。
本发明实施例还提供一种虚拟现实显示设备,包括处理部件,所述处理部件用于执行如本发明实施例提供的所述显示方法。
本发明实施例有益效果如下:本发明实施例提供的所述虚拟现实显示方法,包括:响应于用户的第一操作,启用智能显示模式;控制所述虚拟现实显示设备的屏幕在人眼注视的第一显示区以第一清晰度显示,以及控制所述第一显示区以外的第二显示区以第二清晰度显示,其中,所述第一清晰度高于所述第二清晰度;控制所述第二显示区的部分像素进行补黑显示,即,由于第二显示区为非人眼注视的区域,本身并不用于主要的观看显示,而其通过对第二显示区的部分像素进行补黑显示,可以在不影响人眼对第一显示区观看的同时,降低更加符合非人眼注视区低分辨率的特性,同时大大降低了非高清显示区域的功耗,进而避免非人眼注视区的第二显示区若要全部点亮所有像素,会造成虚拟现实显示设备功耗较高,资源浪费的问题。
附图说明
图1为本发明实施例提供的一种虚拟现实显示设备的显示方法的流程图;
图2为本发明实施例提供的第一种补黑图案示意图;
图3为本发明实施例提供的第二种补黑图案示意图;
图4为本发明实施例提供的第三种补黑图案示意图;
图5为本发明实施例提供的一种具体的虚拟现实显示设备的显示方法的流程图;
图6为本发明实施例提供的另一种具体的虚拟现实显示设备的显示方法的流程示意图。
具体实施方式
为了使得本公开实施例的目的、技术方案和优点更加清楚,下面将结合本公开实施例的附图,对本公开实施例的技术方案进行清楚、完整地描述。显然,所描述的实施例是本公开的一部分实施例,而不是全部的实施例。基于所描述的本公开的实施例,本领域普通技术人员在无需创造性劳动的前提下所获得的所有其他实施例,都属于本公开保护的范围。
除非另外定义,本公开使用的技术术语或者科学术语应当为本公开所属领域内具有一般技能的人士所理解的通常意义。本公开中使用的“第一”、“第二”以及类似的词语并不表示任何顺序、数量或者重要性,而只是用来区分不同的组成部分。“包括”或者“包含”等类似的词语意指出现该词前面的元件或者物件涵盖出现在该词后面列举的元件或者物件及其等同,而不排除其他元件或者物件。“连接”或者“相连”等类似的词语并非限定于物理的或者机械的连接,而是可以包括电性的连接,不管是直接的还是间接的。“上”、“下”、“左”、“右”等仅用于表示相对位置关系,当被描述对象的绝对位置改变后,则该相对位置关系也可能相应地改变。
为了保持本公开实施例的以下说明清楚且简明,本公开省略了已知功能和已知部件的详细说明。
参见图1,本发明实施例提供一种虚拟现实显示设备的显示方法,包括:
步骤S101、响应于用户的第一操作,启用智能显示模式。
步骤S102、控制虚拟现实显示设备的屏幕在人眼注视的第一显示区以第一清晰度显示,以及控制第一显示区以外的第二显示区以第二清晰度显示,其中,第一清晰度高于第二清晰度。具体的,可以使第一显示区以高清进行显示,使第二显示区以非高清进行显示。
步骤S103、控制第二显示区的部分像素进行补黑显示。具体的,可以通 过控制像素的灰阶为0,以实现使该像素进行补黑显示。
本发明实施例提供的虚拟现实显示方法,包括:响应于用户的第一操作,启用智能显示模式;控制虚拟现实显示设备的屏幕在人眼注视的第一显示区以第一清晰度显示,以及控制第一显示区以外的第二显示区以第二清晰度显示,其中,第一清晰度高于第二清晰度;控制第二显示区的部分像素进行补黑显示,即,由于第二显示区为非人眼注视的区域,本身并不用于主要的观看显示,而其通过对第二显示区的部分像素进行补黑显示,可以在不影响人眼对第一显示区观看的同时,降低更加符合非人眼注视区低分辨率的特性,同时大大降低了非高清显示区域的功耗,进而避免非人眼注视区的第二显示区若要全部点亮所有像素,会造成虚拟现实显示设备功耗较高,资源浪费的问题;同时,若虚拟现实显示的屏幕为液晶屏,本发明实施例中,由于第二显示区像素有时会补黑,液晶不需要时时翻转,可以增加液晶的显示寿命,提升液晶使用率。
具体的,关于第二显示区补黑像素和未补黑像素组成的图案,以下进行举例说明。
例如,结合图2所示,在具体实施时,关于步骤S103、控制第二显示区S2的部分像素进行补黑显示,包括:控制第二显示区S2的补黑像素形成多个依次嵌套的第一闭合图案A1,未补黑像素形成多个依次嵌套的第二闭合图案A2,第一闭合图案A1和第二闭合图案A2相间排列。具体的,第一闭合图案A1,第二闭合图案A2可以为框形,例如,第一闭合图案A1和第二闭合图案A2可以为矩形框,矩形框的每一边框由单行或单列像素组成。本发明实施例中,控制第二显示区S2的补黑像素形成多个依次嵌套的第一闭合图案A1,未补黑像素形成多个依次嵌套的第二闭合图案A2,第一闭合图案A1和第二闭合图案A2相间排列,可以使第二显示区不同位置的亮度基本一致,避免不同位置由于补黑的像素密度分布不同时,会造成不同位置亮度不一样的问题。
具体的,第一闭合图案A1、第二闭合图案A2的形状与第一显示区S1的形状相似。即,例如,第一显示区S1的形状为方形,则第一闭合图案A1和 第二闭合图案A2也为方形,又例如,若第一显示区S1的形状为圆形,则第一闭合图案A1和第二闭合图案A2也为圆形。
又例如,结合图3所示,控制第二显示区的部分像素进行补黑显示,包括:控制第二显示区S2的补黑像素形成多个沿第一方向延伸的第一像素组B1,未补黑像素形成多个沿第一方向延伸的第二像素组B2,第一像素组B1和第二像素组B2相间排列。可以理解的是,若第一方向经过第一显示区S1,则第一像素组B1包括的像素应为该方向上去除第一显示区S1以外的像素。本发明实施例中,制第二显示区S2的补黑像素形成多个沿第一方向延伸的第一像素组B1,未补黑像素形成多个沿第一方向延伸的第二像素组B2,第一像素组B1和第二像素组B2相间排列,可以在现有技术像素的显示方式上,进行较小的改进,补黑显示的方式较为简单,易于实现。
具体的,第一方向为像素行方向,参见图3所示;第一方向也可以为像素列方向,参见图4所示。
当然,在具体实施时,还可以是控制第二显示区的补黑像素和非补黑像素形成其它的图案,本发明不以此为限。
在具体实施时,关于步骤S102、控制虚拟现实显示设备在人眼注视的第一显示区以第一清晰度显示,以及控制第一显示区以外的第二区域以第二清晰度显示,包括:
步骤S1021、将接收的用于在第二显示区显示的第二图像拉伸成与虚拟现实显示设备的屏幕分辨率相同的图像,并进行全屏显示。即,第二显示区显示的图像为将接收到的图像进行拉伸后的图像。
步骤S1022、将接收的用于在第一显示区显示的第一图像以原分辨率覆盖于第一显示区进行显示。
在具体实施时,参见图5所示,显示方法还包括:
步骤S104、响应于用户的第二操作,启用真实显示模式(real显示模式)。
步骤S105、将接收到的与虚拟现实显示设备的屏幕分辨率相同的第三图像以原分辨率进行全屏显示。
本发明实施例中,显示方法还包括:响应于用户的第二操作,启用真实显示模式;将接收到的与虚拟现实显示设备的屏幕分辨率相同的第三图像以原分辨率进行全屏显示,进而可以使虚拟显示设备,同时可以根据需求智能的在smartview模式和real模式之间切换,丰富了整机的功能。
在具体实施时,结合图5所示,在步骤S101之前,即,在响应于用户的第一操作,启用智能显示模式之前,显示方法还包括:步骤S100、实时监测用户操作。
在具体实施时,在步骤S101之后,以及在步骤S102之前,即,在响应于用户的第一操作,启用智能显示模式之后,以及在控制虚拟现实显示设备的屏幕在人眼注视的第一显示区以第一清晰度显示,以及控制第一显示区以外的第二显示区以第二清晰度显示之前,显示方法还包括:
步骤S201、获取人眼注视区域。
步骤S202、对与人眼注视区对应的原始第一图像进行渲染,以及与人眼注视区以外的其它区域对应的原始第二图像进行渲染;
步骤S203、对原始第一图像进行图像算法处理,生成第一图像,并对原始第二图像进行图像算法处理,生成第二图像。
本发明实施例还提供一种虚拟现实显示设备,包括处理部件,处理部件用于执行如本发明实施例提供的显示方法。
为了更清楚地理解本发明实施例提供的虚拟现实显示设备的显示方法,以下结合图6进行具体说明:
本发明实施例中的虚拟现实显示设备具体可以包括:虚拟现实显示部件(例如,可以为虚拟显示头盔)和计算机设备,虚拟现实显示设备中的处理部件可以包括:虚拟现实显示部件中的第一处理部件,以及计算机设备中的第二处理部件。可以在虚拟现实显示设备设置两个按钮(可以是设置在虚拟现实显示部件的实体按钮,也可以是显示在计算机设备上的图标按钮,即,换成软件小程序来选择显示模式),分别表示智能显示模式(smartview)和真实显示模式(real),使用者使用前可根据需求选择想要体验的模式。
在进行显示时,可以执行如下几个步骤:
首先,软件端会持续监测是否有按钮按下,按下的是哪个显示模式,并且将选择的显示模式信息传递给软件和硬件;
其次,软件根据选择的显示模式输出图像,硬件根据选择的显示模式切换解析方案,具体如下:
对于smartview显示模式,对软件端,进行的步骤,可以包括:1、根据眼球追踪技术获得注视区域;2、渲染非高清图和眼睛注视区域的高清图,即,对与人眼注视区对应的原始第一图像进行渲染,以及与人眼注视区以外的其它区域对应的原始第二图像进行渲染;3、对高清图像和非高清图像做图像算法处理,常见的算法有图像增强、Local Dimming算法等,即,对原始第一图像进行图像算法处理,生成第一图像,并对原始第二图像进行图像算法处理,生成第二图像;4、将处理过的高清图(即,第一图像)和非高清图(第二图像)通过传输线传输给硬件端的虚拟现实显示部件;对于硬件端,执行的步骤包括:5、将接收的用于在第二显示区显示的第二图像拉伸成与虚拟现实显示设备的屏幕分辨率相同的图像,并进行全屏显示;6、非高清图像部分像素补黑,即,控制第二区域的部分像素进行补黑显示;7、将接收的用于在第一显示区显示的第一图像以原分辨率覆盖于第一显示区进行显示,即,将接收到高清和非高清图像后需要做一个拼接,拼接成一幅图像;8、Display显示拼接图像。
对于real显示模式,在软件端,具体可以与传统的VR显示方案一致,可以包括:1、渲染real分辨率图像;2、图像算法处理;3、将处理过的图通过传输线传输给硬件端的虚拟现实显示部件,在硬件端,进行相应显示。
需要说明的是,以上所描述的软件端,具体可以是存储在计算机设备存储部件的程序代码,对应的实现过程,可以是通过计算机设备的第二处理部件进行读取存储部件的程序代码进行执行实现。对于硬件端,具体可以是指虚拟现实显示部件上的第一处理部件,例如,IC。
本发明实施例有益效果如下:本发明实施例提供的虚拟现实显示方法, 包括:响应于用户的第一操作,启用智能显示模式;控制虚拟现实显示设备的屏幕在人眼注视的第一显示区以第一清晰度显示,以及控制第一显示区以外的第二显示区以第二清晰度显示,其中,第一清晰度高于第二清晰度;控制第二显示区的部分像素进行补黑显示,即,由于第二显示区为非人眼注视的区域,本身并不用于主要的观看显示,而其通过对第二显示区的部分像素进行补黑显示,可以在不影响人眼对第一显示区观看的同时,降低更加符合非人眼注视区低分辨率的特性,同时大大降低了非高清显示区域的功耗,进而避免非人眼注视区的第二显示区若要全部点亮所有像素,会造成虚拟现实显示设备功耗较高,资源浪费的问题。
显然,本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样,倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内,则本发明也意图包含这些改动和变型在内。

Claims (10)

  1. 一种虚拟现实显示设备的显示方法,其特征在于,包括:
    响应于用户的第一操作,启用智能显示模式;
    控制所述虚拟现实显示设备的屏幕在人眼注视的第一显示区以第一清晰度显示,以及控制所述第一显示区以外的第二显示区以第二清晰度显示,其中,所述第一清晰度高于所述第二清晰度;
    控制所述第二显示区的部分像素进行补黑显示。
  2. 如权利要求1所述的显示方法,其特征在于,所述控制所述第二显示区的部分像素进行补黑显示,包括:
    控制所述第二显示区的补黑像素形成多个依次嵌套的第一闭合图案,未补黑像素形成多个依次嵌套的第二闭合图案,所述第一闭合图案和所述第二闭合图案相间排列。
  3. 如权利要求2所述的显示方法,其特征在于,所述第一闭合图案、所述第二闭合图案的形状与所述第一显示区的形状相似。
  4. 如权利要求1所述的显示方法,其特征在于,所述控制所述第二显示区的部分像素进行补黑显示,包括:
    控制所述第二显示区的补黑像素形成多个沿第一方向延伸的第一像素组,未补黑像素形成多个沿所述第一方向延伸的第二像素组,所述第一像素组和所述第二像素组相间排列。
  5. 如权利要求4所述的显示方法,其特征在于,所述第一方向为像素行方向或像素列方向。
  6. 如权利要求1所述的显示方法,其特征在于,所述控制所述虚拟现实显示设备在人眼注视的第一显示区以第一清晰度显示,以及控制所述第一显示区以外的第二区域以第二清晰度显示,包括:
    将接收的用于在所述第二显示区显示的第二图像拉伸成与所述虚拟现实显示设备的屏幕分辨率相同的图像,并进行全屏显示;
    将接收的用于在所述第一显示区显示的第一图像以原分辨率覆盖于所述第一显示区进行显示。
  7. 如权利要求1-6任一项所述的显示方法,其特征在于,所述显示方法还包括:
    响应于用户的第二操作,启用真实显示模式;
    将接收到的与所述虚拟现实显示设备的屏幕分辨率相同的第三图像以原分辨率进行全屏显示。
  8. 如权利要求1所述的显示方法,其特征在于,在响应于用户的第一操作,启用智能显示模式之前,所述显示方法还包括:实时监测用户操作。
  9. 如权利要求1所述的显示方法,其特征在于,在响应于用户的第一操作,启用智能显示模式之后,以及在控制所述虚拟现实显示设备的屏幕在人眼注视的第一显示区以第一清晰度显示,以及控制所述第一显示区以外的第二显示区以第二清晰度显示之前,所述显示方法还包括:
    获取人眼注视区域;
    对与所述人眼注视区对应的原始第一图像进行渲染,以及与所述人眼注视区以外的其它区域对应的原始第二图像进行渲染;
    对所述原始第一图像进行图像算法处理,生成第一图像,并对所述原始第二图像进行图像算法处理,生成第二图像。
  10. 一种虚拟现实显示设备,其特征在于,包括处理部件,所述处理部件用于执行如权利要求1-9任一项所述的显示方法。
PCT/CN2020/140974 2020-02-25 2020-12-29 一种虚拟现实显示设备及显示方法 WO2021169578A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/416,477 US11804194B2 (en) 2020-02-25 2020-12-29 Virtual reality display device and display method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010115007.3A CN111338591B (zh) 2020-02-25 2020-02-25 一种虚拟现实显示设备及显示方法
CN202010115007.3 2020-02-25

Publications (1)

Publication Number Publication Date
WO2021169578A1 true WO2021169578A1 (zh) 2021-09-02

Family

ID=71179669

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/140974 WO2021169578A1 (zh) 2020-02-25 2020-12-29 一种虚拟现实显示设备及显示方法

Country Status (3)

Country Link
US (1) US11804194B2 (zh)
CN (1) CN111338591B (zh)
WO (1) WO2021169578A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111338591B (zh) 2020-02-25 2022-04-12 京东方科技集团股份有限公司 一种虚拟现实显示设备及显示方法
CN111785229B (zh) * 2020-07-16 2022-04-15 京东方科技集团股份有限公司 一种显示方法、装置及系统
CN115268073A (zh) * 2022-08-03 2022-11-01 展视网(北京)科技有限公司 一种虚拟现实显示设备及显示方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109388448A (zh) * 2017-08-09 2019-02-26 京东方科技集团股份有限公司 图像显示方法、显示系统以及计算机可读存储介质
CN109741289A (zh) * 2019-01-25 2019-05-10 京东方科技集团股份有限公司 一种图像融合方法和vr设备
CN110488977A (zh) * 2019-08-21 2019-11-22 京东方科技集团股份有限公司 虚拟现实显示方法、装置、系统及存储介质
CN111338591A (zh) * 2020-02-25 2020-06-26 京东方科技集团股份有限公司 一种虚拟现实显示设备及显示方法

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9484005B2 (en) * 2013-12-20 2016-11-01 Qualcomm Incorporated Trimming content for projection onto a target
KR102159151B1 (ko) * 2014-02-28 2020-09-24 삼성디스플레이 주식회사 전자 장치 및 표시 방법
US9965899B2 (en) * 2016-04-28 2018-05-08 Verizon Patent And Licensing Inc. Methods and systems for minimizing pixel data transmission in a network-based virtual reality media delivery configuration
US11644669B2 (en) * 2017-03-22 2023-05-09 Magic Leap, Inc. Depth based foveated rendering for display systems
CN107516335A (zh) * 2017-08-14 2017-12-26 歌尔股份有限公司 虚拟现实的图形渲染方法和装置
CN107526428A (zh) * 2017-08-24 2017-12-29 武汉华星光电技术有限公司 显示装置及其驱动方法
CN107742512B (zh) * 2017-11-07 2020-09-01 北京京东方光电科技有限公司 一种显示驱动电路、其驱动方法及显示装置
GB2569176B (en) * 2017-12-08 2022-04-13 Displaylink Uk Ltd Processing visual information for display on a screen
CN109725701B (zh) * 2019-01-02 2022-04-29 京东方科技集团股份有限公司 显示面板和装置、图像处理方法和装置、虚拟现实系统
CN109727316B (zh) * 2019-01-04 2024-02-02 京东方科技集团股份有限公司 虚拟现实图像的处理方法及其系统
CN110378914A (zh) * 2019-07-22 2019-10-25 北京七鑫易维信息技术有限公司 基于注视点信息的渲染方法及装置、系统、显示设备

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109388448A (zh) * 2017-08-09 2019-02-26 京东方科技集团股份有限公司 图像显示方法、显示系统以及计算机可读存储介质
CN109741289A (zh) * 2019-01-25 2019-05-10 京东方科技集团股份有限公司 一种图像融合方法和vr设备
CN110488977A (zh) * 2019-08-21 2019-11-22 京东方科技集团股份有限公司 虚拟现实显示方法、装置、系统及存储介质
CN111338591A (zh) * 2020-02-25 2020-06-26 京东方科技集团股份有限公司 一种虚拟现实显示设备及显示方法

Also Published As

Publication number Publication date
US11804194B2 (en) 2023-10-31
US20230178044A1 (en) 2023-06-08
CN111338591B (zh) 2022-04-12
CN111338591A (zh) 2020-06-26

Similar Documents

Publication Publication Date Title
WO2021169578A1 (zh) 一种虚拟现实显示设备及显示方法
CN108877694B (zh) 一种双层液晶屏、背光亮度控制方法、装置及电子设备
US11521564B2 (en) Image display processing method and device, display device and non-volatile storage medium
CN109658877B (zh) 一种显示装置及其驱动方法以及电子设备
JP3760903B2 (ja) 画像表示装置
CN105094433B (zh) 显示基板和显示装置
CN104616631B (zh) 一种应用于mva广视角液晶屏的显示方法及装置
WO2020259345A1 (zh) 终端、终端的控制方法及图像获取方法
CN107945766A (zh) 显示装置
WO2015117361A1 (zh) 数据的显示方法及装置、移动终端
US10649711B2 (en) Method of switching display of a terminal and a terminal
CN109741289A (zh) 一种图像融合方法和vr设备
US20120086710A1 (en) Display method
WO2020140794A1 (zh) 显示面板和装置、图像处理方法和装置、虚拟现实系统
CN108810648A (zh) 一种进行图像处理的方法及终端
CN104570430A (zh) 一种应用于mva广视角液晶屏的显示方法及装置
CN114974143A (zh) 一种显示设备、背光调节方法和存储介质
CN110211543B (zh) 局部背光调节方法和装置、虚拟现实系统
JP4069940B2 (ja) 画像表示装置、画像表示方法及び画像表示プログラム
TW201035948A (en) Method and related apparatus for improving image quality of liquid crystal display device
CN110416276A (zh) 一种电致发光显示面板、显示装置和图像采集方法
CN112882672B (zh) 近眼显示控制方法、装置及近眼显示设备
CN109712578B (zh) 显示方法和显示装置
US11348514B2 (en) LED-based display apparatus and method incorporating sub-pixel shifting
CN112201191B (zh) 显示屏控制方法、装置、电子设备和可读存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20920984

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20920984

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 05.04.2023)

122 Ep: pct application non-entry in european phase

Ref document number: 20920984

Country of ref document: EP

Kind code of ref document: A1