CN112433607A - Image display method and device, electronic equipment and storage medium - Google Patents
Image display method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN112433607A CN112433607A CN202011284680.6A CN202011284680A CN112433607A CN 112433607 A CN112433607 A CN 112433607A CN 202011284680 A CN202011284680 A CN 202011284680A CN 112433607 A CN112433607 A CN 112433607A
- Authority
- CN
- China
- Prior art keywords
- image
- resolution
- wearer
- display screen
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 59
- 238000003384 imaging method Methods 0.000 claims abstract description 76
- 241000226585 Antennaria plantaginifolia Species 0.000 claims abstract description 59
- 238000005516 engineering process Methods 0.000 claims abstract description 26
- 210000001508 eye Anatomy 0.000 claims description 76
- 210000005252 bulbus oculi Anatomy 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 8
- 238000006073 displacement reaction Methods 0.000 claims description 5
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 230000008569 process Effects 0.000 description 12
- 230000000694 effects Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 7
- 230000000007 visual effect Effects 0.000 description 7
- 208000003464 asthenopia Diseases 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 230000006872 improvement Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000004397 blinking Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 206010025421 Macule Diseases 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000001678 irradiating effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1407—General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/80—Geometric correction
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The application discloses an image display method, which is applied to VR equipment and comprises the following steps: determining a wearer's gaze area of the VR display screen using eye tracking technology; determining a target image corresponding to the wearer watching area in an image to be displayed, and performing pincushion distortion processing on the target image according to a preset distortion degree to obtain a current frame image; and displaying the current frame image through the VR display screen. The method and the device can display the image which accords with the human eye imaging characteristic on the premise of reducing the service life loss of the screen. The application also discloses an image display device, an electronic device and a storage medium, which have the beneficial effects.
Description
Technical Field
The present disclosure relates to the field of virtual reality technologies, and in particular, to an image display method and apparatus, an electronic device, and a storage medium.
Background
Virtual Reality (VR) integrates computer technology, display technology, simulation technology, and sensor technology, and provides a user with a sense of environmental immersion by simulating a Virtual environment. The human eye has the following foveal visual characteristics: a small portion of the center of the field of view is high definition imaging, while a large portion of the area is relatively low resolution imaging. Due to the imaging characteristics of the human eyes, in the using process of the virtual reality equipment, the display resolution ratio of the VR display screen is often required to be changed in real time according to the imaging characteristics of the human eyes, so that the improvement of the user experience is significant.
In the related art, there is a scheme for physically adjusting the display resolution of a local area of a VR display screen to make the imaging effect of VR equipment more consistent with the imaging characteristics of human eyes, but the above-mentioned way for physically adjusting the screen resolution may seriously reduce the service life of the screen.
Therefore, how to display an image according to the imaging characteristics of the human eye with the premise of reducing the service life loss of the screen is a technical problem which needs to be solved by the technical personnel in the field at present.
Disclosure of Invention
An object of the present application is to provide an image display method, an image display apparatus, an electronic device, and a storage medium, which can display an image that meets the imaging characteristics of human eyes while reducing the loss of the screen life.
In order to solve the above technical problem, the present application provides an image display method applied to a VR device, where the image display method includes:
determining a wearer's gaze area of the VR display screen using eye tracking technology;
determining a target image corresponding to the wearer watching area in an image to be displayed, and performing pincushion distortion processing on the target image according to a preset distortion degree to obtain a current frame image;
and displaying the current frame image through the VR display screen.
Optionally, after the current frame image is displayed on the VR display screen, the method further includes:
shooting an imaging picture of the VR display screen by using an imaging capturing unit;
judging whether the picture resolution of the imaging picture meets a resolution constraint condition or not;
and if not, increasing the numerical value of the preset distortion degree.
Optionally, the determining whether the picture resolution of the imaged picture meets a resolution constraint condition includes:
determining a target imaging picture corresponding to the wearer's gaze area in the imaging pictures;
judging whether the picture resolution of the target imaging picture is greater than a preset resolution or not;
if so, judging that the picture resolution of the imaging picture meets the resolution constraint condition;
if not, judging that the picture resolution of the imaging picture does not accord with the resolution constraint condition.
Optionally, after the current frame image is displayed on the VR display screen, the method further includes:
judging whether the maximum displacement value of display elements in the target image before and after pincushion distortion is larger than a preset distance or not;
and if so, reducing the numerical value of the preset distortion degree.
Optionally, after the current frame image is displayed on the VR display screen, the method further includes:
detecting a blink frequency of the wearer;
and if the blink frequency is greater than a preset frequency, reducing the numerical value of the preset distortion degree.
Optionally, the determining a wearer gaze area of the VR display screen using eye tracking technology includes:
determining a gaze direction of a wearer using eye tracking technology;
determining a gaze point of the wearer on the VR display screen according to the gaze direction;
and taking all areas on the VR display screen which are away from the fixation point by preset distances as the fixation areas of the wearer.
Optionally, in the process of displaying the current frame image through the VR display screen, the method further includes:
and keeping the display resolution of the VR display screen unchanged.
The present application also provides an image display device applied to a VR apparatus, the device including:
the gaze area determination module is used for determining a wearer gaze area of the VR display screen by utilizing an eyeball tracking technology;
the distortion processing module is used for determining a target image corresponding to the wearer watching area in an image to be displayed and performing pincushion distortion processing on the target image according to a preset distortion degree to obtain a current frame image;
and the display module is used for displaying the current frame image through the VR display screen.
The present application also provides a storage medium having stored thereon a computer program that, when executed, performs the steps performed by the above-described image display method.
The application also provides an electronic device, which comprises a memory and a processor, wherein the memory is stored with a computer program, and the processor realizes the steps executed by the image display method when calling the computer program in the memory.
The application provides an image display method applied to VR equipment, comprising the following steps: determining a wearer's gaze area of the VR display screen using eye tracking technology; determining a target image corresponding to the wearer watching area in an image to be displayed, and performing pincushion distortion processing on the target image according to a preset distortion degree to obtain a current frame image; and displaying the current frame image through the VR display screen.
According to the method and the device, firstly, a wearer watching region is determined by utilizing an eyeball pursuit technology, the watching region of the wearer is a region for high-definition imaging of human eyes, other regions are regions for low-resolution imaging of the human eyes, a target image corresponding to the wearer watching region is determined from an image to be displayed, the target image is a sub-region of the image to be displayed, namely the target image in the image to be displayed is an image for high-definition imaging of the human eyes. The method and the device execute pincushion distortion processing on the target image in the image to be displayed, and the pincushion distortion is characterized in that: the pixels corresponding to the central region are more concentrated and the pixels in the edge region are relatively dispersed, which is consistent with the foveal vision characteristic of the human eye. Under the condition that the screen display resolution is certain, the smaller the display image is, the clearer the imaging effect in human eyes is, so that the current frame image displayed can accord with the imaging characteristic of the human eyes on the premise of not adjusting the screen resolution or adjusting the screen resolution to a smaller degree by processing the target image through pincushion distortion. Therefore, the image which accords with the human eye imaging characteristics can be displayed on the premise of reducing the service life loss of the screen. The application also provides an image display device, an electronic device and a storage medium, which have the beneficial effects and are not repeated herein.
Drawings
In order to more clearly illustrate the embodiments of the present application, the drawings needed for the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained by those skilled in the art without inventive effort.
Fig. 1 is a flowchart of an image display method according to an embodiment of the present disclosure;
fig. 2 is a schematic diagram of a basic optical path structure of a VR device according to an embodiment of the present disclosure;
FIG. 3 is a schematic diagram illustrating pincushion distortion provided by an embodiment of the present application;
fig. 4 is a schematic diagram illustrating a current frame image implementation display provided in an embodiment of the present application;
fig. 5 is a flowchart illustrating an image display of a VR device with adjustable local resolution according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of an image display device according to an embodiment of the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a flowchart of an image display method according to an embodiment of the present disclosure.
The specific steps may include:
s101: determining a wearer's gaze area of the VR display screen using eye tracking technology;
fig. 2 is a schematic diagram of a basic optical path structure of a VR device provided in the embodiment of the present application, and the VR device may include a VR screen 100, a convex lens 200, a concave lens 300, an imaging capture unit 400, and an eyeball tracking unit 500. As shown in fig. 2, light emitted from the VR screen 100 is incident on human eyes through the convex lens 200 and the concave lens 300. The eyeball tracking unit 500 is located at the side of the light path emergent end close to the eyes of a person and is used for tracking the fixation point of the eyes of the person in real time, and the imaging capture unit 400 is also located at the side of the light path emergent end close to the eyes of the person and is used for capturing the imaging effect of the system in real time.
In this step, an image formed by irradiating the pupil with the LED light source may be captured by the camera of the eye tracking unit 500, and the gaze direction of the wearer may be determined based on the image. After the gaze direction is obtained, a specific area of the VR screen may be set as a wearer gaze area based on the gaze direction, the center of the wearer gaze area being an intersection of the gaze direction and the VR screen.
As a possible embodiment, this step can determine the wearer's gaze area by: determining a gaze direction of a wearer using eye tracking technology; determining a gaze point of the wearer on the VR display screen according to the gaze direction; and taking all areas on the VR display screen which are away from the fixation point by preset distances as the fixation areas of the wearer.
S102: determining a target image corresponding to a wearer watching area in an image to be displayed, and performing pincushion distortion processing on the target image according to a preset distortion degree to obtain a current frame image;
the step is established on the basis that the watching area of the wearer is determined, the watching area of the wearer is a sub-area of the VR screen, when the wearer watches the image displayed on the VR screen, the image corresponding to the watching area of the wearer is imaged in human eyes at high resolution, and other areas except the watching area of the wearer on the VR screen are imaged in the human eyes at low resolution. Based on human eye imaging characteristics, the VR device can display the sharpest image in the region of the wearer's gaze and less sharp images in other regions.
Before the step, an operation of acquiring an image to be displayed may also exist, where the image to be displayed is an image to be displayed in a next frame of the VR display screen, that is, the VR display screen is displaying an image of a frame before the image to be displayed in the process executed in the step. On the basis of obtaining the image to be displayed, the step can determine the target image displayed in the gazing area of the wearer after the image to be displayed is displayed on the VR display screen. Since the image corresponding to the wearer's gaze area is imaged in the human eye at high resolution, the target image will be imaged in the human eye at high resolution. In the embodiment, the image to be displayed is processed in a pincushion distortion mode, so that the image which accords with the imaging characteristics of human eyes is obtained. Specifically, the present embodiment may perform pincushion distortion processing on the target image, in which the center point of the target image is a distortion center.
Referring to fig. 3, fig. 3 is a schematic diagram illustrating pincushion distortion provided in an embodiment of the present application, and after the pincushion distortion processing shown in fig. 3, pixels corresponding to a central region of a target image are more concentrated, and pixels in an edge region are relatively dispersed and are consistent with foveal vision characteristics of human eyes, so that an image to be displayed after pincushion distortion is performed on the target image more conforms to human eye presentation characteristics. The current frame image mentioned in this step includes the target image after pincushion distortion processing, and also includes images corresponding to other areas except the target image in the image to be displayed.
There may also be an operation of determining a preset distortion degree before this step, the larger the value of the preset distortion degree is, the larger the reduction amount of the target image after the pincushion distortion processing is. The larger the preset distortion degree is, the higher the imaging definition of the target image in human eyes after pincushion distortion processing is carried out, but the situation that the distortion exceeds the bearable range of the human eyes can be caused by the overlarge preset distortion degree, so that the value of the preset distortion degree can be flexibly adjusted, and the imaging effect of the VR screen can be balanced between the definition and the bearable degree of the human eyes.
S103: and displaying the current frame image through the VR display screen.
The step is established on the basis that the current frame image is obtained, and the current frame image can be displayed through the VR display screen after the previous frame image is displayed. Referring to fig. 4, fig. 4 is a schematic view illustrating a current frame image implementation provided in an embodiment of the present application, where an area a in a dashed line frame in fig. 4 is a target image subjected to pincushion distortion processing, and an area B is an image other than the target image in an image to be displayed. As a possible implementation manner, in the process of executing this step, it may further determine a next frame of image to be displayed, and perform pincushion distortion processing on an image corresponding to the wearer's gaze area in the next frame of image to be displayed according to a preset distortion degree to obtain a next frame of image, so as to display the next frame of image after the current frame of image is displayed. As a possible implementation manner, in the process of displaying the current frame image, the operation of determining the wearer 'S gaze area in S101 may be performed in a loop, so as to perform local pincushion distortion processing on the image to be displayed according to the latest wearer' S gaze area, thereby improving the user experience.
As a possible implementation, during the process of displaying the current frame image through the VR display screen, the VR device may keep the display resolution of the VR display screen unchanged. Aiming at the problems of the existing display mode with fixed screen resolution and the technical difficulty of dynamically adjusting the resolution scheme of the display screen, the embodiment is based on the fovea imaging principle of human eyes, combines with an eyeball tracking technology, and realizes the local adjustment of the resolution of the display image through the distortion of a dynamically adjusted image, so that the high resolution of the attention area of the human eyes is displayed, and other areas are displayed with the common resolution, and the display effect of VR equipment is closer to the visual characteristic of the human eyes. Because the embodiment adjusts the specific image by carrying out pincushion distortion treatment on the image, the resolution of the central area relative to the edge area of pincushion distortion is more concentrated, and the central concave imaging visual characteristics of human eyes are met. Compared with the traditional scheme in which the resolution of the screen is adjusted in a physical mode, the pincushion distortion processing provided by the embodiment can be realized through an algorithm, and the service life of the screen can not be influenced. As another possible implementation manner, in the process of displaying the current frame image through the VR display screen, the display resolution of the wearer gaze area in the VR screen may also be improved, but since the image displayed in the wearer gaze area is subjected to pincushion distortion, compared with a scheme that only the screen display resolution is changed, the present embodiment can achieve the same display effect on the premise that the display resolution is changed to a smaller extent, and thus the present embodiment can reduce the loss of the service life of the screen.
The method includes the steps that firstly, an eyeball tracking technology is utilized to determine a watching area of a wearer, the watching area of the wearer is a high-definition imaging area of human eyes, and other areas are low-resolution imaging areas of the human eyes. In this embodiment, a target image in an image to be displayed performs pincushion distortion processing, and the pincushion distortion is characterized in that: the pixels corresponding to the central region are more concentrated and the pixels in the edge region are relatively dispersed, which is consistent with the foveal vision characteristic of the human eye. Under the condition that the screen display resolution is fixed, the smaller the display image is, the clearer the imaging effect in human eyes is, so that the current frame image displayed can accord with the imaging characteristic of human eyes on the premise of not adjusting the screen resolution or adjusting the screen resolution to a smaller degree by processing the target image through pincushion distortion. Therefore, the embodiment can display the image which is in accordance with the human eye imaging characteristic on the premise of reducing the service life loss of the screen.
As a further introduction to the corresponding embodiment of fig. 1, after the current frame image is displayed by the VR display screen, an imaging picture of the VR display screen may also be taken by an imaging capture unit; judging whether the picture resolution of the imaging picture meets a resolution constraint condition or not; if so, distortion is still carried out according to a preset distortion degree when pincushion distortion processing is carried out on the image to be displayed of the next frame; if not, increasing the numerical value of the preset distortion degree so as to perform distortion according to the new distortion degree after the numerical value is increased when performing pincushion distortion processing on the image to be displayed of the next frame. By means of the method, the resolution of VR screen imaging in human eyes can be improved, and the display effect is further improved.
Further, the embodiment may further determine whether the picture resolution of the imaged picture meets the resolution constraint condition by: determining a target imaging picture corresponding to the wearer's gaze area in the imaging pictures; judging whether the picture resolution of the target imaging picture is greater than a preset resolution or not; if so, judging that the picture resolution of the imaging picture meets the resolution constraint condition; if not, judging that the picture resolution of the imaging picture does not accord with the resolution constraint condition.
In addition, the embodiment may also compare the overall image resolution of the imaged image with a preset resolution critical value, and if the overall image resolution of the imaged image is greater than the resolution critical value, determine that the image resolution of the imaged image meets the resolution constraint condition; and if the resolution ratio is smaller than or equal to the resolution ratio critical value, judging that the image resolution ratio of the imaging image does not accord with the resolution ratio constraint condition.
By the method, whether the displayed image with the pincushion distortion introduced meets the high-resolution imaging requirement can be judged, and if the high-resolution imaging requirement is not met, the pincushion distortion needs to be continuously increased so as to improve the imaging resolution.
As a further introduction to the corresponding embodiment of fig. 1, after the current frame image is displayed on the VR display screen, it may also be determined whether a maximum value of displacement of display elements in the target image before and after pincushion distortion is greater than a preset distance; if so, reducing the numerical value of the preset distortion degree so as to carry out distortion according to the new distortion degree after the numerical value is reduced when carrying out pincushion distortion processing on the image to be displayed of the next frame; if not, the image to be displayed in the next frame is distorted according to the preset distortion degree when the pincushion distortion processing is carried out on the image to be displayed in the next frame.
The above method can judge whether the distortion degree is in the human eye bearable range after increasing the pincushion distortion of the image. For example, the limit resolution of the human eye (i.e., the above-mentioned preset distance) is about 0.1mm, and the degree of distortion may not be adjusted if it is less than 0.1mm, in comparison with the displacement amount of the display element of the image (i.e., the target image) corresponding to the foveal diameter; if it is larger than 0.1mm, the degree of distortion is reduced. By means of the method, the deformation degree of the target image after pincushion distortion is within the bearable range of human eyes, and user experience is improved. The display element is image content that can be observed by any human eye in the target image, and for example, the display element may be a pixel point, an object displayed in the image, or the like.
As a further introduction to the corresponding embodiment of fig. 1, after displaying the current frame image through the VR display screen, the VR device may also detect a blink frequency of the wearer; if the blink frequency is larger than the preset frequency, reducing the numerical value of the preset distortion degree so as to perform distortion according to the new distortion degree after the numerical value is reduced when performing pincushion distortion processing on the next frame of image to be displayed. And if the blink frequency is less than or equal to the preset frequency, the next frame of image to be displayed is distorted according to the preset distortion degree when the pincushion distortion processing is carried out on the next frame of image to be displayed.
Too much distortion of the pillow shape of the image may cause visual fatigue of the wearer, and the blinking frequency may be increased when the visual fatigue of the wearer occurs, so that the above embodiment determines whether the visual fatigue of the wearer occurs by detecting the blinking frequency, and reduces the value of the preset distortion degree when the visual fatigue of the wearer occurs, so as to reduce the distortion degree of the display picture and improve the viewing experience.
The flow described in the above embodiment is explained below by an embodiment in practical use. Referring to fig. 5, fig. 5 is a flowchart illustrating an image display of a VR device with adjustable local resolution according to an embodiment of the present application. In the embodiment, the eyeball tracking technology and the pillow-shaped distortion technology are combined, so that the image distortion of the gazing area of the wearer is dynamically adjusted, and an image which accords with the foveal vision characteristic of the human eye is displayed.
When a user wears VR equipment, eyeballs are in a dynamic change process, a fixation point of the user changes in real time, and the position of the fixation point can be judged through an eyeball tracking technology. Specifically, the camera of the eyeball tracking unit can feed the obtained eyeball fixation position information back to the main chip of the VR device, and the main chip analyzes the eyeball fixation position information to obtain the wearer fixation area. The main chip can feed back the gazing area of the wearer to a control unit of the system, and the control program can adjust the image distortion of the gazing direction, so that the resolution of the gazing direction of the human eyes can be adjusted.
In the present embodiment, the pincushion distortion algorithm may be written in advance in the main chip, and when the wearer's gaze area is determined, the pincushion distortion algorithm may be applied at the image area for local resolution adjustment. The pincushion distortion algorithm may be adapted to the visual characteristics of the human eye, the fovea macula of the human eye accounts for approximately 0.625% of the entire retina, and the resolution of the human eye decreases non-linearly as the viewing angle increases, with the resolution of the foveal region being the highest, 5 ° off the fovea, and the resolution decreasing almost by half. When the pincushion distortion algorithm performs pincushion distortion processing on the target image, the closer the position to the central point, the greater the distortion degree, the nonlinear change of the size of the region can be realized by combining the distortion algorithm, and further, the adjustment of the local resolution is realized. In the case of a constant display resolution, the smaller the display image, the sharper the display image, so that the image sharpness is improved by reducing the size of the center concave portion pattern to meet the resolution requirement of the human eye. The image after distortion adjustment is transmitted to the human eyes by the embodiment, and the visual characteristic of the fovea of the human eyes is met.
After the pincushion distortion processing is performed on the image, the present embodiment can determine whether the central region of the image with the pincushion distortion introduced therein meets the requirement of high resolution imaging. The present embodiment may preset a threshold for high resolution imaging, perform image acquisition through the imaging capture unit, and determine that high resolution imaging is achieved when the image resolution reaches the threshold, otherwise, it is necessary to continue to increase the pincushion distortion degree. In addition, after the pincushion distortion is added to the image, whether the distortion is in the human eye bearable range can be judged, if the pincushion distortion degree can not be adjusted in the human eye bearable range, and if the distortion is not in the human eye bearable range, the pincushion distortion degree can be reduced.
The method is based on the fovea imaging principle, the eyeball tracking technology is utilized to determine the watching area of a wearer, and pillow-shaped distortion is introduced into the local area of the image, so that local high-resolution display of the image in the watching area of the human eye is realized, and the visual characteristics of the human eye are met. The embodiment adjusts the local distortion of the display image to meet the resolution requirement of human eyes in different gazing directions. The image display mode provided by the embodiment is closer to the visual characteristics of human eyes, and the user experience effect is better. The adjustment of the image resolution provided by the embodiment is realized by introducing pincushion distortion by an algorithm, the change of a physical structure is not needed, and other errors introduced by the adjustment of the physical structure and the influence on the service life of a screen are effectively reduced.
Referring to fig. 6, fig. 6 is a schematic structural diagram of an image display device according to an embodiment of the present disclosure;
the apparatus may include:
a gaze region determination module 601, configured to determine a wearer gaze region of the VR display screen using eye tracking technology;
a distortion processing module 602, configured to determine a target image corresponding to the wearer gazing area in an image to be displayed, and perform pincushion distortion processing on the target image according to a preset distortion degree to obtain a current frame image;
a display module 603, configured to display the current frame image through the VR display screen.
The method includes the steps that firstly, an eyeball tracking technology is utilized to determine a watching area of a wearer, the watching area of the wearer is a high-definition imaging area of human eyes, and other areas are low-resolution imaging areas of the human eyes. In this embodiment, a target image in an image to be displayed performs pincushion distortion processing, and the pincushion distortion is characterized in that: the pixels corresponding to the central region are more concentrated and the pixels in the edge region are relatively dispersed, which is consistent with the foveal vision characteristic of the human eye. Under the condition that the screen display resolution is fixed, the smaller the display image is, the clearer the imaging effect in human eyes is, so that the current frame image displayed can accord with the imaging characteristic of human eyes on the premise of not adjusting the screen resolution or adjusting the screen resolution to a smaller degree by processing the target image through pincushion distortion. Therefore, the embodiment can display the image which is in accordance with the human eye imaging characteristic on the premise of reducing the service life loss of the screen.
Further, the method also comprises the following steps:
the picture shooting module is used for shooting an imaging picture of the VR display screen by using an imaging capturing unit after the current frame image is displayed by the VR display screen;
the image quality detection module is used for judging whether the image resolution of the imaging image meets a resolution constraint condition or not; and if not, increasing the numerical value of the preset distortion degree.
Further, the image quality detection module is used for determining a target imaging picture corresponding to the wearer gazing area in the imaging pictures; the system is also used for judging whether the image resolution of the target imaging image is greater than a preset resolution or not; if so, judging that the picture resolution of the imaging picture meets the resolution constraint condition; if not, judging that the picture resolution of the imaging picture does not accord with the resolution constraint condition.
Further, the method also comprises the following steps:
the distortion degree correcting module is used for judging whether the maximum displacement value of display elements in the target image before and after pincushion distortion is larger than a preset distance or not after the current frame image is displayed through the VR display screen; and if so, reducing the numerical value of the preset distortion degree.
Further, the method also comprises the following steps:
the image quality comfort level detection module is used for detecting the blink frequency of the wearer after the current frame image is displayed through the VR display screen; and the processing unit is also used for reducing the numerical value of the preset distortion degree if the blink frequency is greater than a preset frequency.
Further, the gaze region determination module 601 includes:
a gaze direction determination unit for determining a gaze direction of the wearer using eye tracking techniques;
the area determining unit is used for determining a gazing point of the wearer on the VR display screen according to the gazing direction; and all areas on the VR display screen which are away from the fixation point by preset distances are used as fixation areas of the wearer.
Further, the method also comprises the following steps:
and the resolution setting module is used for keeping the display resolution of the VR display screen unchanged in the process of displaying the current frame image through the VR display screen.
Since the embodiments of the apparatus portion and the method portion correspond to each other, please refer to the description of the embodiments of the method portion for the embodiments of the apparatus portion, which is not repeated here.
The present application also provides a storage medium having a computer program stored thereon, which when executed, may implement the steps provided by the above-described embodiments. The storage medium may include: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The application further provides an electronic device, which may include a memory and a processor, where the memory stores a computer program, and the processor may implement the steps provided by the foregoing embodiments when calling the computer program in the memory. Of course, the electronic device may also include various network interfaces, power supplies, and the like.
The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and such improvements and modifications also fall within the scope of the claims of the present application.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. An image display method applied to a VR device includes:
determining a wearer's gaze area of the VR display screen using eye tracking technology;
determining a target image corresponding to the wearer watching area in an image to be displayed, and performing pincushion distortion processing on the target image according to a preset distortion degree to obtain a current frame image;
and displaying the current frame image through the VR display screen.
2. The image display method of claim 1, further comprising, after displaying the current frame image via the VR display screen:
shooting an imaging picture of the VR display screen by using an imaging capturing unit;
judging whether the picture resolution of the imaging picture meets a resolution constraint condition or not;
and if not, increasing the numerical value of the preset distortion degree.
3. The image display method of claim 2, wherein determining whether the frame resolution of the imaged frame meets a resolution constraint comprises:
determining a target imaging picture corresponding to the wearer's gaze area in the imaging pictures;
judging whether the picture resolution of the target imaging picture is greater than a preset resolution or not;
if so, judging that the picture resolution of the imaging picture meets the resolution constraint condition;
if not, judging that the picture resolution of the imaging picture does not accord with the resolution constraint condition.
4. The image display method of claim 1, further comprising, after displaying the current frame image via the VR display screen:
judging whether the maximum displacement value of display elements in the target image before and after pincushion distortion is larger than a preset distance or not;
and if so, reducing the numerical value of the preset distortion degree.
5. The image display method of claim 1, further comprising, after displaying the current frame image via the VR display screen:
detecting a blink frequency of the wearer;
and if the blink frequency is greater than a preset frequency, reducing the numerical value of the preset distortion degree.
6. The image display method of claim 1, wherein the determining the wearer's gaze area of the VR display screen using eye tracking technology comprises:
determining a gaze direction of a wearer using eye tracking technology;
determining a gaze point of the wearer on the VR display screen according to the gaze direction;
and taking all areas on the VR display screen which are away from the fixation point by preset distances as the fixation areas of the wearer.
7. The image display method according to any one of claims 1 to 6, further comprising, during the displaying of the current frame image by the VR display screen:
and keeping the display resolution of the VR display screen unchanged.
8. An image display apparatus applied to a VR device, comprising:
the gaze area determination module is used for determining a wearer gaze area of the VR display screen by utilizing an eyeball tracking technology;
the distortion processing module is used for determining a target image corresponding to the wearer watching area in an image to be displayed and performing pincushion distortion processing on the target image according to a preset distortion degree to obtain a current frame image;
and the display module is used for displaying the current frame image through the VR display screen.
9. An electronic device comprising a memory in which a computer program is stored and a processor which, when called upon by the computer program in the memory, implements the steps of the image display method according to any one of claims 1 to 7.
10. A storage medium having stored thereon computer-executable instructions which, when loaded and executed by a processor, carry out the steps of the image display method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011284680.6A CN112433607B (en) | 2020-11-17 | 2020-11-17 | Image display method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011284680.6A CN112433607B (en) | 2020-11-17 | 2020-11-17 | Image display method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112433607A true CN112433607A (en) | 2021-03-02 |
| CN112433607B CN112433607B (en) | 2022-09-23 |
Family
ID=74700303
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011284680.6A Active CN112433607B (en) | 2020-11-17 | 2020-11-17 | Image display method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112433607B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160150154A1 (en) * | 2013-09-30 | 2016-05-26 | Beijing Zhigu Rui Tuo Tech Co., Ltd | Imaging to facilitate object gaze |
| CN107610044A (en) * | 2017-08-29 | 2018-01-19 | 歌尔科技有限公司 | Image processing method, computer-readable recording medium and virtual reality helmet |
| CN107742512A (en) * | 2017-11-07 | 2018-02-27 | 北京京东方光电科技有限公司 | A kind of display driver circuit, its driving method and display device |
| CN108665521A (en) * | 2018-05-16 | 2018-10-16 | 京东方科技集团股份有限公司 | Image rendering method, device, system, computer readable storage medium and equipment |
| CN108710206A (en) * | 2018-05-08 | 2018-10-26 | 苏州市启献智能科技有限公司 | A kind of method and apparatus of anti-dazzle and visual fatigue applied to VR displays |
| US20200301505A1 (en) * | 2019-11-28 | 2020-09-24 | Shanghai Tianma AM-OLED Co., Ltd. | Display device and display driving method for a display panel |
-
2020
- 2020-11-17 CN CN202011284680.6A patent/CN112433607B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160150154A1 (en) * | 2013-09-30 | 2016-05-26 | Beijing Zhigu Rui Tuo Tech Co., Ltd | Imaging to facilitate object gaze |
| CN107610044A (en) * | 2017-08-29 | 2018-01-19 | 歌尔科技有限公司 | Image processing method, computer-readable recording medium and virtual reality helmet |
| CN107742512A (en) * | 2017-11-07 | 2018-02-27 | 北京京东方光电科技有限公司 | A kind of display driver circuit, its driving method and display device |
| CN108710206A (en) * | 2018-05-08 | 2018-10-26 | 苏州市启献智能科技有限公司 | A kind of method and apparatus of anti-dazzle and visual fatigue applied to VR displays |
| CN108665521A (en) * | 2018-05-16 | 2018-10-16 | 京东方科技集团股份有限公司 | Image rendering method, device, system, computer readable storage medium and equipment |
| US20200301505A1 (en) * | 2019-11-28 | 2020-09-24 | Shanghai Tianma AM-OLED Co., Ltd. | Display device and display driving method for a display panel |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112433607B (en) | 2022-09-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20190004600A1 (en) | Method and electronic device for image display | |
| CN109633907B (en) | Method for automatically adjusting brightness of monocular AR (augmented reality) glasses and storage medium | |
| US9720238B2 (en) | Method and apparatus for a dynamic “region of interest” in a display system | |
| Hwang et al. | An augmented-reality edge enhancement application for Google Glass | |
| EP3158531B1 (en) | A method and a display device with pixel repartition optimization | |
| US20160165205A1 (en) | Holographic displaying method and device based on human eyes tracking | |
| KR20170104463A (en) | System and method for improved display | |
| CN112703464A (en) | Distributed point-of-regard rendering based on user gaze | |
| JP5607473B2 (en) | Diopter correction device | |
| CN112689470B (en) | Method for performing a test of the power of a scattered light using a computing device and corresponding computing device | |
| US20150304625A1 (en) | Image processing device, method, and recording medium | |
| KR20190110461A (en) | Devices having system for reducing the impact of near distance viewing on myopia onset and/or myopia progression | |
| WO2018219290A1 (en) | Information terminal | |
| US11749024B2 (en) | Graphics processing method and related eye-tracking system | |
| CN112433607B (en) | Image display method and device, electronic equipment and storage medium | |
| WO2019217262A1 (en) | Dynamic foveated rendering | |
| CN114816065A (en) | Screen backlight adjusting method, virtual reality device and readable storage medium | |
| US10440354B2 (en) | Light field display control method and apparatus, and light field display device | |
| WO2017026942A1 (en) | Apparatus for display adjustment and method thereof | |
| Hwang et al. | 23.4: Augmented Edge Enhancement for Vision Impairment using Google Glas | |
| CN112766022A (en) | Software design method with eyesight protection function | |
| CN110430469B (en) | Television display effect adjusting method, device, system and storage medium | |
| US11327313B2 (en) | Method and system for rendering an image with a pupil enhanced accommodation of the eye | |
| CN101828899A (en) | Visual test method and device | |
| EP4020057A1 (en) | Head-mounted display and method of optimisation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20221219 Address after: 266104 No. 500, Songling Road, Laoshan District, Qingdao, Shandong Patentee after: GOERTEK TECHNOLOGY Co.,Ltd. Address before: 261031 north of Yuqing street, east of Dongming Road, high tech Zone, Weifang City, Shandong Province (Room 502, Geer electronics office building) Patentee before: GoerTek Optical Technology Co.,Ltd. |
|
| TR01 | Transfer of patent right |