CN117334145A - Display brightness adjusting method, device and equipment of VR equipment and storage medium - Google Patents
Display brightness adjusting method, device and equipment of VR equipment and storage medium Download PDFInfo
- Publication number
- CN117334145A CN117334145A CN202311440131.7A CN202311440131A CN117334145A CN 117334145 A CN117334145 A CN 117334145A CN 202311440131 A CN202311440131 A CN 202311440131A CN 117334145 A CN117334145 A CN 117334145A
- Authority
- CN
- China
- Prior art keywords
- virtual
- brightness
- scene
- light level
- light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 70
- 238000004590 computer program Methods 0.000 claims abstract description 26
- 230000006870 function Effects 0.000 claims description 72
- 238000012546 transfer Methods 0.000 claims description 37
- 230000008859 change Effects 0.000 claims description 34
- 238000006243 chemical reaction Methods 0.000 claims description 19
- 230000009466 transformation Effects 0.000 claims description 19
- 230000003247 decreasing effect Effects 0.000 claims description 17
- 238000001514 detection method Methods 0.000 claims description 16
- 230000008569 process Effects 0.000 claims description 8
- 230000007423 decrease Effects 0.000 claims description 4
- 238000005516 engineering process Methods 0.000 description 24
- 230000000007 visual effect Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 6
- 230000004438 eyesight Effects 0.000 description 6
- 210000003128 head Anatomy 0.000 description 6
- 230000000694 effects Effects 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 238000011282 treatment Methods 0.000 description 4
- 230000016776 visual perception Effects 0.000 description 4
- 238000013461 design Methods 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000000638 stimulation Effects 0.000 description 3
- 206010015946 Eye irritation Diseases 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 238000010030 laminating Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000004310 photopic vision Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- OKTJSMMVPCPJKN-UHFFFAOYSA-N Carbon Chemical compound [C] OKTJSMMVPCPJKN-UHFFFAOYSA-N 0.000 description 1
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000033228 biological regulation Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000001747 exhibiting effect Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 231100000013 eye irritation Toxicity 0.000 description 1
- 230000004313 glare Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 229910021389 graphene Inorganic materials 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004298 light response Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000007170 pathology Effects 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 230000004296 scotopic vision Effects 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000001356 surgical procedure Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/10—Intensity circuits
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The application relates to a display brightness adjusting method, a device, a computer device, a storage medium and a computer program product of a VR device. The method comprises the following steps: when the VR equipment is in a wearing state, detecting the brightness of a real scene of the real scene where the VR equipment is located; grading the brightness of the real scene to obtain the light level of the real scene; detecting virtual scene brightness of a virtual scene displayed by VR equipment; grading the brightness of the virtual scene to obtain the virtual scene light level; and adaptively adjusting the virtual scene brightness of the virtual scene displayed by the VR device according to the real scene light level and the virtual scene light level. By adopting the method, the user experience when the user uses the VR equipment can be improved.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method, an apparatus, a computer device, a storage medium, and a computer program product for adjusting display brightness of a VR device.
Background
Virtual reality, VR (Virtual Reality), is a virtual environment created by computer-generated images and sounds, which allows a user to personally feel the scene and experience therein. Unlike traditional ways of viewing a screen or listening to sound, virtual reality allows a user to wear a VR device, completely immersed in a virtual world. Video-based virtual reality applications provide a wide variety of virtual world experience functions, for example, can provide a virtual screen playback environment that resembles a cinema, and when a user wears a VR device and uses the application, can provide a viewing experience that resembles a cinema.
Because wearing of VR equipment needs strict laminating head, so the user only can accept the light that comes from the screen in the VR equipment, when it wants to stop using, lift off the VR equipment, if the difference between the luminance of the light of the environment that the user is located and the display screen luminance of VR equipment is too big, brings the excitement for user's eyes easily, makes the user feel uncomfortable, leads to user experience relatively poor.
Disclosure of Invention
In view of the foregoing, it is desirable to provide a display brightness adjustment method, apparatus, computer device, computer-readable storage medium, and computer program product for a VR device that can enhance the user experience when the user uses the VR device.
In a first aspect, the present application provides a method for adjusting display brightness of a VR device. The method comprises the following steps:
when the VR equipment is in a wearing state, detecting the brightness of a real scene of the real scene where the VR equipment is located;
grading the brightness of the real scene to obtain the light level of the real scene;
detecting virtual scene brightness of a virtual scene displayed by the VR equipment;
grading the brightness of the virtual scene to obtain the virtual scene light level;
and according to the real scene light level and the virtual scene light level, adaptively adjusting the virtual scene brightness of the virtual scene displayed by the VR equipment.
In a second aspect, the present application further provides a display brightness adjustment device of a VR device. The device comprises:
the first detection module is used for detecting the brightness of the real scene where the VR equipment is located when the VR equipment is in a wearing state;
the brightness grading module is used for grading the brightness of the real scene to obtain the light level of the real scene;
the second detection module is used for detecting the brightness of the virtual scene displayed by the VR equipment;
the brightness grading module is further used for grading the brightness of the virtual scene to obtain the virtual scene light level;
and the adjusting module is used for adaptively adjusting the virtual scene brightness of the virtual scene displayed by the VR equipment according to the real scene light level and the virtual scene light level.
In one embodiment, the first detection module is further configured to send a control instruction for starting the ambient light sensor; acquiring readings detected by the ambient light sensor regarding ambient light; the reading for ambient light is converted to a real scene light level.
In one embodiment, the light brightness classification module is configured to determine that the light level of the real scene is a strong light level when the light brightness of the real scene is greater than a preset threshold; and when the brightness of the real scene is smaller than or equal to a preset threshold value, determining that the light level of the real scene is a weak light level.
In one embodiment, the virtual scene is a virtual screen play scene, and the virtual scene brightness includes a virtual environment brightness and a virtual screen brightness; the second detection module is further configured to obtain a current virtual environment light brightness of the virtual screen playing scene; converting a current screen input signal into virtual screen brightness based on an electric light transfer function, wherein the screen input signal is a nonlinear video signal value under a screen coordinate system; and calculating the virtual scene brightness of the virtual scene displayed by the VR equipment according to the virtual environment brightness and the virtual screen brightness.
In one embodiment, the brightness classification module is configured to determine that the virtual scene light level is a strong light level when the virtual scene brightness is greater than a preset threshold; and when the brightness of the virtual scene is smaller than or equal to a preset threshold value, determining that the light level of the virtual scene is a weak light level.
In one embodiment, the adjusting module is configured to adjust a virtual scene luminance of the virtual scene displayed by the VR device to a strong light level when the real scene light level is a strong light level and the virtual scene light level is a weak light level; when the real scene light level is a weak light level and the virtual scene light level is a strong light level, adjusting the virtual scene brightness of the virtual scene displayed by the VR equipment to the weak light level; and when the real scene light level is the same as the virtual scene light level, keeping the virtual scene brightness of the virtual scene displayed by the VR equipment unchanged.
In one embodiment, the virtual scene is a virtual screen play scene, and the virtual scene brightness includes a virtual environment brightness and a virtual screen brightness; the adjusting module is used for gradually increasing the virtual environment brightness of the virtual scene displayed by the VR equipment according to a nonlinear monotonically increasing virtual environment light conversion function; based on an electric light conversion transfer function, converting a current screen input signal into a current virtual screen brightness, wherein the screen input signal is a nonlinear video signal value under a screen coordinate system, and increasing the current virtual screen brightness to a virtual screen brightness corresponding to a strong light level according to a preset remapping value.
In one embodiment, the nonlinear monotonically increasing virtual ambient light transformation function is represented by the following formula:
L env ＝max(k,t b )；
wherein L is env B is the change rate of the virtual environment light brightness, the larger the change rate is, the faster the change of the virtual environment light brightness is, and k is the current virtual environment light brightness of the virtual scene displayed by the VR device; the nonlinear monotonically increasing virtual environment light transformation function is used for representing the virtual environment light brightness of the virtual scene displayed by the VR device, and gradually increases from k to T along with time T b Wherein t.epsilon.0, T]。
In one embodiment, the formula for converting the current screen input signal to the current virtual screen brightness based on the electric-to-light transfer function is as follows:
LinarInput x,y ＝EOTF(I x,y )；
LinarInput x,y for the current virtual screen brightness, EOTF () is the electrotransport light transfer function, I x,y The method comprises the steps of taking a current screen input signal as a nonlinear video signal value corresponding to a pixel point positioned at (x, y) under a screen coordinate system;
the formula for increasing the current virtual screen brightness to the virtual screen brightness corresponding to the strong light level according to the preset remapping value is as follows:
Output x,y ＝m+LinarInput x,y ；
m∈[0,5]m is a preset remap value, output x,y The brightness of the virtual screen corresponding to the strong light level.
In one embodiment, the virtual scene is a virtual screen play scene, and the virtual scene brightness includes a virtual environment brightness and a virtual screen brightness; the adjusting module is used for gradually reducing the virtual environment light brightness of the virtual scene displayed by the VR equipment according to a nonlinear monotonically decreasing virtual environment light conversion function until the virtual environment light brightness is the virtual environment light brightness corresponding to the weak light level; based on an electric light conversion transfer function, converting a current screen input signal into a current virtual screen brightness, wherein the screen input signal is a nonlinear video signal value under a screen coordinate system, and reducing the current virtual screen brightness to a virtual screen brightness corresponding to a dim light level according to a preset remapping coefficient.
In one embodiment, the nonlinear monotonically decreasing virtual ambient light transformation function is represented by the following formula:
L env ＝max(0,k-t b )；
wherein L is env B is the change rate of the virtual environment light brightness, the larger the change rate is, the faster the change of the virtual environment light brightness is, and k is the current virtual environment light brightness of the virtual scene displayed by the VR device; the nonlinear monotonically decreasing virtual environment light transformation function is used for representing the virtual environment brightness of the virtual scene displayed by the VR deviceThe degree, the time t, decreases gradually from k to 0.
In one embodiment, the formula for converting the current screen input signal to the current virtual screen brightness based on the electric-to-light transfer function is as follows:
LinarInput x,y ＝EOTF(I x,y )；
LinarInput x,y for the current virtual screen brightness, EOTF () is the electrotransport light transfer function, I x,y The method comprises the steps of taking a current screen input signal as a nonlinear video signal value corresponding to a pixel point positioned at (x, y) under a screen coordinate system;
the formula for reducing the current virtual screen brightness to the virtual screen brightness corresponding to the dim light level according to the preset remapping coefficient is as follows:
Output x,y ＝n*LinarInput x,y ；
n is a preset remapping coefficient, n is more than 0 and less than or equal to 1, and output x,y The virtual screen brightness corresponding to the dim light level.
In a third aspect, the present application also provides a computer device. The computer device comprises a memory storing a computer program and a processor which when executing the computer program performs the steps of:
when the VR equipment is in a wearing state, detecting the brightness of a real scene of the real scene where the VR equipment is located;
grading the brightness of the real scene to obtain the light level of the real scene;
detecting virtual scene brightness of a virtual scene displayed by the VR equipment;
grading the brightness of the virtual scene to obtain the virtual scene light level;
and according to the real scene light level and the virtual scene light level, adaptively adjusting the virtual scene brightness of the virtual scene displayed by the VR equipment.
In a fourth aspect, the present application also provides a computer-readable storage medium. The computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of:
when the VR equipment is in a wearing state, detecting the brightness of a real scene of the real scene where the VR equipment is located;
Grading the brightness of the real scene to obtain the light level of the real scene;
detecting virtual scene brightness of a virtual scene displayed by the VR equipment;
grading the brightness of the virtual scene to obtain the virtual scene light level;
and according to the real scene light level and the virtual scene light level, adaptively adjusting the virtual scene brightness of the virtual scene displayed by the VR equipment.
In a fifth aspect, the present application also provides a computer program product. The computer program product comprises a computer program which, when executed by a processor, implements the steps of:
when the VR equipment is in a wearing state, detecting the brightness of a real scene of the real scene where the VR equipment is located;
grading the brightness of the real scene to obtain the light level of the real scene;
detecting virtual scene brightness of a virtual scene displayed by the VR equipment;
grading the brightness of the virtual scene to obtain the virtual scene light level;
and according to the real scene light level and the virtual scene light level, adaptively adjusting the virtual scene brightness of the virtual scene displayed by the VR equipment.
According to the display brightness adjusting method, the device, the computer equipment, the storage medium and the computer program product of the VR equipment, when the VR equipment is in the wearing state, the real scene brightness of the real scene where the VR equipment is located is detected, the real scene brightness is graded to obtain the real scene light level, the virtual scene brightness of the virtual scene displayed by the VR equipment is detected, the virtual scene brightness is graded to obtain the virtual scene light level, the virtual scene brightness of the virtual scene displayed by the VR equipment is adaptively adjusted according to the real scene light level and the virtual scene light level, the virtual scene brightness of the virtual scene displayed by the VR equipment can be adaptively adjusted in real time according to the real scene brightness, no obvious brightness difference exists between the real scene brightness and the virtual scene brightness of the virtual scene, when the VR equipment is removed by a user, the visual perception of the user is consistent, discomfort and stimulation of eyes caused by severe brightness change are reduced, accordingly, the use experience of the user in the virtual reality is improved, and the VR equipment is convenient for the user to use.
Drawings
FIG. 1 is a schematic diagram of a VR system in one embodiment;
FIG. 2 is an application environment diagram of a display brightness adjustment method of a VR device in one embodiment;
FIG. 3 is a flow chart illustrating a method for adjusting display brightness of a VR device in one embodiment;
FIG. 4 is a flow chart of detecting brightness of a virtual scene according to an embodiment;
FIG. 5 is a schematic diagram of a virtual scene in one embodiment;
FIG. 6 is a flow chart of adaptively adjusting the luminance of a virtual scene according to an embodiment;
FIG. 7 is a block diagram of a method of adjusting display brightness of a VR device in one embodiment;
fig. 8 is a flowchart of a method for adjusting display brightness of a VR device in an embodiment;
fig. 9 is a block diagram of a display brightness adjustment device of the VR apparatus in one embodiment;
fig. 10 is an internal structural view of a computer device in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
In recent years, virtual reality technology has been widely used and developed in various fields of games, entertainment, education, medical treatment, real estate, and the like with its unique advantages. The virtual reality technology is to create a simulated reality environment through means of computer technology, sensors and the like, and a user can interact with the environment through various senses to realize immersive experience.
Virtual reality technology has found wide application in many fields. The main application scenarios are as follows:
through virtual reality technology, game player can feel the game world on the spot, promotes the immersive sense and the sense of reality of game, and the player can wear head-mounted display, puts oneself in the game world, feels environment, scene, role etc. in the game, and understanding the game world more deeply, VR game application can let the player more immersive in the game, experiences more true game experience.
Through virtual reality technology, various scenes such as historical events, scientific experiments and the like can be created, so that students can know knowledge more deeply. For example, students may visit museums, historic remains, etc. through virtual reality technology, thereby becoming more deeply aware of histories and cultures. The virtual reality technology can also be used for simulation experiments, so that students can know scientific knowledge more deeply. The application of virtual reality technology can make students learn knowledge more vividly.
The virtual reality technology can simulate the scenes of surgery, pathology, rehabilitation and the like, and helps doctors to better perform medical operation and treatment. For example, a doctor can simulate the operation process through a virtual reality technology, is familiar with the operation flow, and improves the operation efficiency. The virtual reality technology can also be used for rehabilitation, for example, a patient can be subjected to rehabilitation training through the virtual reality technology, and the rehabilitation effect is improved. The application of virtual reality technology may allow medical workers to perform medical procedures and treatments more effectively.
Through virtual reality technology, building designer can carry out building design in virtual environment, predicts the building effect. For example, a building designer may simulate a building effect through virtual reality technology, improving a building design. The virtual reality technology can also be used for exhibiting building effects, for example, by enabling a customer to visit a building in a virtual environment through the virtual reality technology, and improving the understanding and acceptance of the customer to the building. The application of virtual reality technology can improve the efficiency and quality of architectural design.
Video-based virtual reality applications provide a wide variety of virtual world experience functions, for example, can provide a virtual screen playback environment that resembles a cinema, and when a user wears a VR device and uses the application, can provide a viewing experience that resembles a cinema. Because wearing of VR equipment needs strict laminating head, so the user only can accept the light that comes from the screen in the VR equipment, when it wants to stop using, lift off the VR equipment, if the difference between the luminance of the light of the environment that the user is located and the display screen luminance of VR equipment is too big, brings the excitement for user's eyes easily, makes the user feel uncomfortable, leads to user experience relatively poor.
For example, when a virtual reality application presents a virtual cinema playing scene, the light of the virtual cinema playing scene is darker, the visual sense of the user is in a scotopic state, when the VR device is stopped to be used, the moment when the VR device is removed, if the light of the real environment where the user is located is brighter, the user will instantly change from the scotopic state to the photopic state, and the eyes of the user may feel uncomfortable. Similarly, a similar situation exists when a virtual reality application presents a virtual darkroom game scenario, a virtual cave adventure scenario.
Therefore, according to the display brightness adjusting method for the VR device, when the VR device is in the wearing state, the real scene brightness of the real scene where the VR device is located is detected, the real scene brightness is graded to obtain the real scene light level, the virtual scene brightness of the virtual scene displayed by the VR device is detected, the virtual scene brightness is graded to obtain the virtual scene light level, the virtual scene brightness of the virtual scene displayed by the VR device is adaptively adjusted according to the real scene light level and the virtual scene light level, the virtual scene brightness of the virtual scene displayed by the VR device can be adaptively adjusted in real time according to the real scene brightness, obvious brightness difference does not exist between the real scene brightness and the virtual scene brightness of the virtual scene, when the VR device is removed by a user, the visual perception of the user is consistent, discomfort and irritation of eyes caused by severe brightness change are reduced, accordingly, the use experience of the user in the virtual reality is improved, and the VR device is convenient for the user to use.
As shown in fig. 1, a typical VR system includes the following components: VR device, host system, capture system, controller. VR devices such as Head-Mounted displays (HMDs), 3D presentation systems, large projection systems (CAVE), and the like. The head display device is a hardware device for closing the vision and hearing of people to the outside, guiding the user to generate a feeling of the user in a virtual environment, the display principle is that left and right eye screens respectively display left and right eye images, and human eyes generate a stereoscopic impression in the brain after acquiring the information with the difference, and the head display device generally comprises a display screen, a lens, a camera, a processor, a sensor, wireless connection, storage, a battery and other components. The head display device may include VR helmets, VR glasses, and the like. The host system refers to a device that provides various functional guarantees for the VR device, and may be, for example, various terminals, where the host system determines the degree of intellectualization and automation of the VR device. The capturing system is generally used as a peripheral device of the VR device, and the capturing system may also be integrated into the VR device, where the capturing system generally includes a built-in sensor, a gyroscope, and a magnetometer, and creates an immersive experience by capturing the motion of the user, such as raising your head with the VR device, and the screen may convert the screen into sky by receiving the signal sent by the capturing system. The controller typically appears as a handheld device through which a user can capture his own actions and gestures.
As shown in fig. 2, the method for adjusting the display brightness of the VR device provided in the embodiments of the present application may be applied to a host system of a VR system, where the host system may be the terminal 102 shown in fig. 2, and the terminal 102 implements the method for adjusting the display brightness of the VR device while running a virtual reality application. That is, when the VR device 104 is in the wearing state, the terminal 102 detects the real scene brightness of the real scene where the VR device 104 is located, classifies the real scene brightness to obtain the real scene light level, and meanwhile, the terminal 102 detects the virtual scene brightness of the virtual scene displayed by the VR device 104, classifies the virtual scene brightness to obtain the virtual scene light level, and the terminal 102 adaptively adjusts the virtual scene brightness of the virtual scene displayed by the VR device 104 according to the real scene light level and the virtual scene light level. The terminal 102 may be, but not limited to, various desktop computers, notebook computers, smart phones, tablet computers, internet of things devices and portable wearable devices, where the internet of things devices may be smart speakers, smart televisions, smart air conditioners, smart car devices, and the portable wearable devices may be smart watches, smart bracelets, and the like.
In one embodiment, as shown in fig. 3, a method for adjusting display brightness of a VR device is provided, and the method is applied to the terminal 102 in fig. 1 for illustration, and includes the following steps:
step 302, detecting a real scene brightness of a real scene in which the VR device is located when the VR device is in a worn state.
Wherein when the VR device is in a worn state, it indicates that the VR device is ready to begin a start-up operation. Optionally, sensors, such as cameras, infrared sensors, gravity sensors, and the like, may be disposed on the VR device to detect relevant pose information of the VR device, so that the terminal may receive the detected pose information, and determine whether the VR device is in a wearing state according to the detected position information. After the terminal detects that the VR device is in a worn state, the terminal may enable the VR device to present a virtual scene to the user by running a virtual reality application.
The real scene that VR equipment was located is the real environment that VR equipment was located, and if the real environment that VR equipment was located was outdoor, the ambient light intensity of that its real scene that was located was higher, if the real environment that VR equipment was located was indoor or darkroom, the ambient light intensity of that its real scene that was located was lower.
Optionally, in one embodiment, detecting a real scene light level of a real scene in which the VR device is located includes: a control instruction for starting an ambient light sensor is sent out; acquiring readings of ambient light detected by an ambient light sensor; the reading for ambient light is converted to a real scene light level.
After detecting that VR equipment is in wearing the state, the terminal can send out the control command that starts ambient light sensor, detects the intensity of ambient light of the real scene that VR equipment is located through ambient light sensor, will detect the reading, converts into real scene luminance. The ambient light sensor may be any sensor capable of detecting the intensity of ambient light, such as a photosensitive sensor, which is not limited in the embodiments of the present application. The ambient light sensor can be arranged on the VR equipment, can also be arranged in the same real scene space as the peripheral equipment and the VR equipment, can be in wired or wireless communication with the terminal through a network, sends detected readings to the terminal, and can convert the readings about ambient light into real scene brightness.
Step 304, grading the brightness of the real scene to obtain the light level of the real scene.
Specifically, the terminal may classify the brightness of the real scene according to the brightness ranges corresponding to different light levels, to obtain the light level of the real scene. Optionally, when the brightness of the real scene is greater than a preset threshold, determining that the light level of the real scene is a strong light level; and when the brightness of the real scene is less than or equal to a preset threshold value, determining that the light level of the real scene is a weak light level. For example, when the light brightness is in the range of 0-10nit (nit), the corresponding light level is a weak light level, and when the light brightness is greater than 10nit, the corresponding light level is a strong light level. Of course, the value range can be set according to actual requirements, and the light level can be divided into more levels according to the actual requirements.
Step 306 detects a virtual scene light intensity of a virtual scene displayed by the VR device.
The virtual scene displayed by the VR device is a scene presented to the eyes of the user through the virtual reality technology, and the scene can be seen through the eyes of the user, namely the virtual scene. In order to provide a user with an immersive experience that is immersive, light control in the virtual scene is important. For example, in a virtual scene simulating a cinema, a virtual light source is included in addition to a virtual screen, and the virtual light source and the virtual screen together create a realistic sensation of the cinema for a user. Also for example, in virtual scenes that obscure outdoor environments, virtual light sources are required that create light changes for different periods of time, such as soft sunlight in dusk and kaliopsis in early morning, among others, in addition to outdoor scenes. Accordingly, the virtual scene luminance of the virtual scene may be determined based on the luminance of the virtual display screen and the luminance of the virtual ambient light.
Optionally, the virtual scene is a virtual screen playing scene, and the virtual scene brightness includes a virtual environment brightness and a virtual screen brightness; as shown in fig. 4, detecting virtual scene luminance of a virtual scene displayed by a VR device includes:
step 402, obtaining the current virtual environment brightness of the virtual screen playing scene.
The virtual screen playing scene is a virtual scene which is presented to the user through a virtual reality technology and is used for playing video through a screen, and the virtual scene comprises a virtual screen and virtual environment light, as shown in fig. 5. The virtual screen is responsible for displaying a playback picture, which receives input from the player and projects light into the virtual scene, which is a function of the input screen signal, and can be written as:
L screen(x,y) ＝φ(I x,y )；
wherein I is x,y The method comprises the steps that a current screen input signal is obtained, wherein the screen input signal is a nonlinear video signal value corresponding to a pixel point located at (x, y) in a screen coordinate system;
the virtual environment light is used to project light into the virtual scene, and can be described as: l (L) env The method comprises the steps of carrying out a first treatment on the surface of the The virtual environment light is simulated by the virtual reality application, so that the current virtual environment light brightness of the virtual screen playing scene can be obtained according to the current setting parameters of the virtual environment light, wherein the unit is Nib Is special.
Step 404, converting the current screen input signal into a virtual screen brightness based on the electric-to-optical transfer function, wherein the screen input signal is a nonlinear video signal value under a screen coordinate system.
Wherein an electroluminance transfer function (Electro-Optical Transfer Function, EOTF) is used to convert nonlinear video signal values into display luminance. For the display content of the current screen, the display content on the virtual screen can be controlled through a virtual reality technology, namely, in the currently presented virtual scene, the display content is known, the display content can be acquired by a terminal, namely, the terminal can acquire the current screen input signal, namely, the screen input signal is a nonlinear video signal value under a screen coordinate system, and the terminal can convert the screen input signal into virtual screen brightness through an electric light transfer function, wherein the unit is nit.
Step 406, calculating the virtual scene brightness of the virtual scene displayed by the VR device according to the virtual environment brightness and the virtual screen brightness.
It is understood that the virtual scene luminance is determined by both the virtual environment luminance and the virtual screen luminance. Optionally, the terminal may weight the virtual environment light brightness and the virtual screen light brightness to obtain the virtual scene light brightness of the virtual scene displayed by the VR device. Optionally, the terminal may obtain weighting coefficients of the virtual environment light brightness and the virtual screen light brightness, and weight the virtual environment light brightness and the virtual screen light brightness according to the respective weighting coefficients, so as to obtain the virtual scene light brightness of the virtual scene displayed by the VR device.
In this embodiment, the virtual scene is a virtual screen playing scene, and the light rays of the virtual scene include virtual screen light and virtual environment light, and by detecting the brightness of the virtual screen light and the virtual environment light, the brightness of the virtual scene can be accurately obtained.
Step 308, grading the brightness of the virtual scene to obtain the virtual scene light level.
Specifically, the terminal may classify the brightness of the virtual scene according to the brightness ranges corresponding to different light levels, to obtain the light level of the virtual scene. Optionally, when the virtual scene brightness is greater than a preset threshold, determining that the virtual scene brightness level is a strong light level; and when the brightness of the virtual scene is smaller than or equal to a preset threshold value, determining that the light level of the virtual scene is a weak light level. For example, when the light brightness is in the range of 0-10nit (nit), the corresponding light level is a weak light level, and when the light brightness is greater than 10nit, the corresponding light level is a strong light level. Of course, the value range can be set according to actual requirements, and the light level can be divided into more levels according to the actual requirements.
Step 310, adaptively adjusting a virtual scene luminance of a virtual scene displayed by the VR device according to the real scene light level and the virtual scene light level.
Specifically, based on the difference between the real scene light level and the virtual scene light level, it may be determined whether adjustment of the virtual scene light level of the virtual scene displayed by the VR device is required, and whether the adjustment direction, i.e., the direction adjustment to the dimming or the direction adjustment to the dimming, is determined. In addition, optionally, in order to reduce the difference between the brightness of the virtual scene and the brightness of the real scene, the visual perception of the user is kept consistent with the outside, the watching experience of the user can be prevented from being influenced by the adjusting process, and the terminal can also control the adjusting rate so as to ensure that the user is not perceived as much as possible in the adjusting process and ensure that the watched content of the user is not influenced.
It should be noted that, the method provided in the embodiment of the present application may be periodically executed in the process of running the virtual reality application, for example, the luminance detection and adjustment may be executed once every 20ms (milliseconds), so that it may be ensured that the luminance of the virtual scene displayed by the VR device may be adjusted in time before the user removes the VR device at any time, so that the eye irritation of the user is reduced to the greatest extent, and the user experience of using the VR device is prompted.
According to the display brightness adjusting method of the VR equipment, when the VR equipment is in the wearing state, the real scene brightness of the real scene where the VR equipment is located is detected, the real scene brightness is graded to obtain the real scene light level, the virtual scene brightness of the virtual scene displayed by the VR equipment is detected, the virtual scene brightness is graded to obtain the virtual scene light level, the virtual scene brightness of the virtual scene displayed by the VR equipment is adaptively adjusted according to the real scene light level and the virtual scene light level, the virtual scene brightness of the virtual scene displayed by the VR equipment can be adaptively adjusted in real time according to the real scene brightness, obvious brightness difference does not exist between the real scene brightness and the virtual scene brightness of the virtual scene, when the VR equipment is removed by a user, the visual feeling of the user is consistent, discomfort and stimulation of eyes caused by severe brightness change are reduced, the use experience of the user in the virtual reality world is improved, and the VR equipment is conveniently used by the user.
In one embodiment, as shown in fig. 6, step 310 of adaptively adjusting a virtual scene luminance of a virtual scene displayed by a VR device according to a real scene light level and a virtual scene light level includes:
step 602, when the real scene light level is a strong light level and the virtual scene light level is a weak light level, adjusting the virtual scene brightness of the virtual scene displayed by the VR device to the strong light level;
step 604, when the real scene light level is a weak light level and the virtual scene light level is a strong light level, adjusting the virtual scene brightness of the virtual scene displayed by the VR device to the weak light level;
step 606, when the real scene light level is the same as the virtual scene light level, maintaining the virtual scene brightness of the virtual scene displayed by the VR device unchanged.
Fig. 7 is a schematic diagram of a frame of a display brightness adjustment method of a VR device according to one embodiment. Referring to fig. 7, the real scene brightness detection, grading, virtual scene brightness detection, grading, adjustment and return to continue the real scene brightness detection after the adjustment is completed are included. Referring to fig. 7, it can be seen that when the brightness of the real scene is classified into a strong light level and the brightness of the virtual scene is classified into a weak light level, or when the brightness of the real scene is classified into a weak light level and the brightness of the virtual scene is classified into a strong light level, the brightness of the virtual scene needs to be adjusted to ensure the consistency of the visual perception of the user when the user removes the VR device.
The human eyes have different visual systems under different illumination intensities, for example, when working under a bright environment, the cone cells and the rod cells of the human eyes can work cooperatively, so that people can clearly see details and colors, and when working under a dark environment, people can only see the details clearly, but the colors are difficult to identify. When we enter a bright environment from a dark environment, the cone cells of the human eyes can adjust the light response, and the pupils can be reduced to reduce the light input amount, so that discomfort of eyes can be caused when the environment changes too severely.
In this embodiment of the present application, the virtual environment light of the virtual scene may adaptively change along with the illumination condition of the real scene, and when the user removes the VR device, the virtual environment light may rapidly adapt to the external real environment. Along with the adjustment of the virtual environment light, the brightness of the played content watched by the user needs to be adaptively adjusted, so that the user has comfortable watching experience under any condition. Namely, the method comprises the following steps:
in one embodiment, the virtual scene is a virtual screen play scene, and the virtual scene brightness includes a virtual environment brightness and a virtual screen brightness; adjusting a virtual scene light intensity of a virtual scene displayed by a VR device to a glare level, comprising: gradually increasing the virtual environment light brightness of a virtual scene displayed by the VR device according to a nonlinear monotonically increasing virtual environment light conversion function; based on the electric light transfer function, converting the current screen input signal into the current virtual screen brightness, wherein the screen input signal is a nonlinear video signal value under a screen coordinate system, and increasing the current virtual screen brightness to the virtual screen brightness corresponding to the strong light level according to the preset remapping value.
Specifically, when the real scene light level is a strong light level and the virtual scene light level is a weak light level, when the VR device is detached by the user, the eye vision of the user should adapt to external photopic vision as soon as possible, so that the scotopic vision state in the current virtual scene needs to be converted into the photopic vision state, that is, the virtual scene brightness of the virtual scene displayed by the VR device is adjusted to the strong light level.
Optionally, the nonlinear monotonically increasing virtual ambient light transformation function is expressed by the following formula:
L env ＝max(k,t b )；
wherein L is env In order to adjust the brightness of the virtual environment, b is the change rate of the brightness of the virtual environment, the larger the change rate is, the faster the brightness of the virtual environment changes, b is greater than 1, and k is the current brightness of the virtual environment of the virtual scene displayed by the VR equipment; a nonlinear monotonically increasing virtual ambient light transformation function for representing virtual ambient light levels of a virtual scene displayed by a VR device, gradually increasing from k to T over time T b Wherein t.epsilon.0, T]That is, the virtual environment light brightness is gradually increased, the recording start time T is 0, and the virtual environment light brightness gradually increases from k as the time T increases until the time T is increased to T b The value of T in this embodiment may be determined according to the difference between the current virtual environment light brightness k and the virtual environment light brightness corresponding to the strong light level, where the larger the difference is, the larger the value of T may be, the smaller the difference is, and the smaller the value of T may be, so as to ensure that the virtual environment light brightness performs nonlinear monotonically increasing through the nonlinear monotonically increasing virtual environment light transformation function, and keep consistent with the visual response characteristic of human eyes, and ensure user experience.
Optionally, the formula for converting the current screen input signal into the current virtual screen brightness based on the electric-to-light transfer function is as follows:
LinarInput x,y ＝EOTF(I x,y )；
LinarInput x,y for the current virtual screen brightness, EOTF () is the electrotransport light transfer function, I x,y The method comprises the steps that a current screen input signal is obtained, wherein the screen input signal is a nonlinear video signal value corresponding to a pixel point located at (x, y) in a screen coordinate system;
the formula for increasing the current virtual screen brightness to the virtual screen brightness corresponding to the strong light level according to the preset remapping value is as follows:
Output x,y ＝m+LinarInput x,y ；
m∈[0,5]m is a preset remap value, output x,y The brightness of the virtual screen corresponding to the strong light level.
Through the conversion formula related to the brightness of the virtual environment and the brightness of the virtual screen, the brightness of the current virtual scene can be adjusted to the brightness of the virtual screen corresponding to the strong light level by adjusting the brightness of the virtual environment and the brightness of the virtual screen simultaneously, and the adjusting process can be matched with the visual response characteristic of human eyes, so that the watching experience of a user before unloading of VR equipment is ensured.
In one embodiment, the virtual scene is a virtual screen play scene, and the virtual scene brightness includes a virtual environment brightness and a virtual screen brightness; adjusting a virtual scene light level of a virtual scene displayed by a VR device to a dim light level, comprising: gradually reducing the virtual environment light brightness of the virtual scene displayed by the VR equipment according to the nonlinear monotonically decreasing virtual environment light conversion function until the virtual environment light brightness is the virtual environment light brightness corresponding to the weak light level; based on the electric light transfer function, converting the current screen input signal into the current virtual screen brightness, wherein the screen input signal is a nonlinear video signal value under a screen coordinate system, and reducing the current virtual screen brightness to the virtual screen brightness corresponding to the dim light level according to the preset remapping coefficient.
Specifically, when the real scene light level is a weak light level and the virtual scene light level is a strong light level, when the VR device is detached by the user, the eye vision of the user should adapt to the external weak vision as soon as possible, so that the bright vision state in the current virtual scene needs to be converted into the dark vision state, that is, the virtual scene brightness of the virtual scene displayed by the VR device is adjusted to the weak light level.
Alternatively, the nonlinear monotonically decreasing virtual ambient light transformation function is expressed by the following formula:
L env ＝max(0,k-t b )；
wherein L is env To adjust the brightness of the virtual environment, b is the change rate of the brightness of the virtual environment, and the greater the change rate is, the brightness of the virtual environment becomesThe faster the change, the value of b is larger than 1, and k is the current virtual environment brightness of the virtual scene displayed by the VR equipment; a nonlinear monotonically decreasing virtual environment light conversion function for representing a change in virtual environment light brightness of a virtual scene displayed by a VR device from k to 0 gradually over time T, that is, the virtual environment light brightness is gradually decreased, a recording start time T is 0, and the virtual environment light brightness gradually decreases from k to 0 when time T increases, in this embodiment, according to k=t b The value of T can be obtained. By the nonlinear monotonically decreasing virtual environment light conversion function, the nonlinear monotonically decreasing virtual environment light brightness can be ensured, the visual response characteristic of human eyes can be kept consistent, and the user experience can be ensured.
Optionally, the formula for converting the current screen input signal into the current virtual screen brightness based on the electric-to-light transfer function is as follows:
LinarInput x,y ＝EOTF(I x,y )；
LinarInput x,y For the current virtual screen brightness, EOTF () is the electrotransport light transfer function, I x,y The screen input signal is a nonlinear video signal value corresponding to a pixel point located at (x, y) in a screen coordinate system.
Optionally, the formula for reducing the current virtual screen brightness to the virtual screen brightness corresponding to the dim light level according to the preset remapping coefficient is as follows:
Output x,y ＝n*LinarInput x,y ；
n is a preset remapping coefficient, n is more than 0 and less than or equal to 1, and output x,y The virtual screen brightness corresponding to the dim light level. For example, n may take on a value of 0.8.
Through the conversion formula related to the brightness of the virtual environment and the brightness of the virtual screen, the brightness of the current virtual scene can be adjusted to the brightness of the virtual screen corresponding to the dim light level by adjusting the brightness of the virtual environment and the brightness of the virtual screen simultaneously, and the adjusting process can be matched with the visual response characteristic of human eyes, so that the watching experience of a user before unloading of VR equipment is ensured.
The EOTF () is a function used by the electrical-to-optical transfer function, and is related to a standard used by the screen input signal, and is a gamma transfer function if it complies with BT709, and is a PQ transfer function if it is BT2020, and BT709 and BT2020 are different color gamut standards for color reconstruction of high definition television.
It can be appreciated that the nonlinear monotonically increasing virtual environment light conversion function, the nonlinear monotonically decreasing virtual environment light conversion function and the function for remapping the brightness of the virtual screen can be set according to actual requirements, so that the brightness can be adjusted, and the viewing experience of a user before the VR device is detached can be ensured.
In a specific embodiment, as shown in fig. 8, the method for adjusting display brightness of a VR device may be performed by a computer device, which may be a host system in the VR system shown in fig. 1, which may specifically be the terminal 102 shown in fig. 2, to provide various functional support for the VR device. The method may comprise the steps of:
step 802, when VR equipment is in a wearing state, a control instruction for starting an ambient light sensor is sent out;
step 804, obtaining readings detected by an ambient light sensor regarding ambient light;
step 806, converting the reading for ambient light to a real scene light level;
step 808, determining that the light level of the real scene is a strong light level when the light brightness of the real scene is greater than a preset threshold; when the brightness of the real scene is less than or equal to a preset threshold value, determining that the light level of the real scene is a weak light level;
Step 810, obtaining the current virtual environment brightness of a virtual screen playing scene;
step 812, converting the current screen input signal into a virtual screen brightness based on the electric-to-optical transfer function, wherein the screen input signal is a nonlinear video signal value under a screen coordinate system;
step 814, calculating the virtual scene brightness of the virtual scene displayed by the VR device according to the virtual environment brightness and the virtual screen brightness;
step 816, determining the virtual scene light level as the strong light level when the virtual scene light brightness is greater than the preset threshold; when the brightness of the virtual scene is smaller than or equal to a preset threshold value, determining that the light level of the virtual scene is a weak light level;
step 818, when the real scene light level is a strong light level and the virtual scene light level is a weak light level, gradually increasing the virtual environment light brightness of the virtual scene displayed by the VR device according to a nonlinear monotonically increasing virtual environment light conversion function, converting the current screen input signal into the current virtual screen light brightness based on the electric light conversion transfer function, wherein the screen input signal is a nonlinear video signal value under a screen coordinate system, and increasing the current virtual screen light brightness to the virtual screen light brightness corresponding to the strong light level according to a preset remapping value;
Step 820, when the real scene light level is the weak light level and the virtual scene light level is the strong light level, gradually reducing the virtual environment light brightness of the virtual scene displayed by the VR device according to the nonlinear monotonically decreasing virtual environment light conversion function until the virtual environment light brightness is the virtual environment light brightness corresponding to the weak light level, converting the current screen input signal into the current virtual screen light brightness based on the electric conversion light transfer function, wherein the screen input signal is a nonlinear video signal value under the screen coordinate system, and reducing the current virtual screen light brightness to the virtual screen light brightness corresponding to the weak light level according to the preset remapping coefficient;
step 822, when the real scene light level is the same as the virtual scene light level, maintaining the virtual scene brightness of the virtual scene displayed by the VR device unchanged.
According to the display brightness adjusting method of the VR equipment, when the VR equipment is in the wearing state, the real scene brightness of the real scene where the VR equipment is located is detected, the real scene brightness is graded to obtain the real scene light level, the virtual scene brightness of the virtual scene displayed by the VR equipment is detected, the virtual scene brightness is graded to obtain the virtual scene light level, the virtual scene brightness of the virtual scene displayed by the VR equipment is adaptively adjusted according to the real scene light level and the virtual scene light level, the virtual scene brightness of the virtual scene displayed by the VR equipment can be adaptively adjusted in real time according to the real scene brightness, obvious brightness difference does not exist between the real scene brightness and the virtual scene brightness of the virtual scene, when the VR equipment is removed by a user, the visual feeling of the user is consistent, discomfort and stimulation of eyes caused by severe brightness change are reduced, the use experience of the user in the virtual reality world is improved, and the VR equipment is conveniently used by the user. In addition, the virtual environment light of the virtual scene can be adaptively changed along with the illumination condition of the real scene, and when a user removes the VR device, the virtual environment light can be rapidly adapted to the external real environment. Along with the adjustment of the virtual environment light, the brightness of the played content watched by the user needs to be adaptively adjusted, so that the user has comfortable watching experience under any condition.
It should be understood that, although the steps in the flowcharts related to the above embodiments are sequentially shown as indicated by arrows, these steps are not necessarily sequentially performed in the order indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in the flowcharts described in the above embodiments may include a plurality of steps or a plurality of stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of the steps or stages is not necessarily performed sequentially, but may be performed alternately or alternately with at least some of the other steps or stages.
Based on the same inventive concept, the embodiment of the application also provides a display brightness adjusting device of the VR device for realizing the above-mentioned display brightness adjusting method of the VR device. The implementation of the solution provided by the apparatus is similar to the implementation described in the above method, so the specific limitation in the embodiments of the display brightness adjusting apparatus for one or more VR devices provided below may refer to the limitation of the display brightness adjusting method for the VR device hereinabove, and will not be described herein.
In one embodiment, as shown in fig. 9, there is provided a display brightness adjusting apparatus 900 of a VR device, including: a first detection module 902, a light intensity classification module 904, a second detection module 906, and an adjustment module 908, wherein:
the first detection module 902 is configured to detect, when the VR device is in a wearing state, a real scene light brightness of a real scene where the VR device is located;
the brightness grading module 904 is configured to grade brightness of the real scene to obtain a brightness level of the real scene;
a second detection module 906, configured to detect a virtual scene luminance of a virtual scene displayed by the VR device;
the brightness classification module 904 is further configured to classify brightness of the virtual scene to obtain a virtual scene light level;
an adjustment module 908 is configured to adaptively adjust a virtual scene luminance of a virtual scene displayed by the VR device according to the real scene light level and the virtual scene light level.
In one embodiment, the first detection module 902 is further configured to send a control instruction for starting the ambient light sensor; acquiring readings of ambient light detected by an ambient light sensor; the reading for ambient light is converted to a real scene light level.
In one embodiment, the light brightness classification module 904 is configured to determine that the light level of the real scene is a strong light level when the light brightness of the real scene is greater than a preset threshold; and when the brightness of the real scene is less than or equal to a preset threshold value, determining that the light level of the real scene is a weak light level.
In one embodiment, the virtual scene is a virtual screen play scene, and the virtual scene brightness includes a virtual environment brightness and a virtual screen brightness; the second detection module 906 is further configured to obtain a current virtual environment light brightness of the virtual screen playing scene; converting a current screen input signal into virtual screen brightness based on an electric light transfer function, wherein the screen input signal is a nonlinear video signal value under a screen coordinate system; and calculating the virtual scene brightness of the virtual scene displayed by the VR equipment according to the virtual environment brightness and the virtual screen brightness.
In one embodiment, the luminance grading module 904 is configured to determine that the virtual scene light level is a strong light level when the virtual scene luminance is greater than a preset threshold; and when the brightness of the virtual scene is smaller than or equal to a preset threshold value, determining that the light level of the virtual scene is a weak light level.
In one embodiment, the adjusting module 908 is configured to adjust a virtual scene light brightness of a virtual scene displayed by the VR device to a strong light level when the real scene light level is a strong light level and the virtual scene light level is a weak light level; when the real scene light level is a weak light level and the virtual scene light level is a strong light level, adjusting the virtual scene brightness of the virtual scene displayed by the VR equipment to the weak light level; when the real scene light level is the same as the virtual scene light level, the virtual scene brightness of the virtual scene displayed by the VR device is kept unchanged.
In one embodiment, the virtual scene is a virtual screen play scene, and the virtual scene brightness includes a virtual environment brightness and a virtual screen brightness; an adjusting module 908, configured to gradually increase the virtual environment light brightness of the virtual scene displayed by the VR device according to a nonlinear monotonically increasing virtual environment light transformation function; based on the electric light transfer function, converting the current screen input signal into the current virtual screen brightness, wherein the screen input signal is a nonlinear video signal value under a screen coordinate system, and increasing the current virtual screen brightness to the virtual screen brightness corresponding to the strong light level according to the preset remapping value.
In one embodiment, the nonlinear monotonically increasing virtual ambient light transformation function is represented by the following formula:
L env ＝max(k,t b )；
wherein L is env For the brightness of the virtual environment, b is the change rate of the brightness of the virtual environment, the larger the change rate is, the faster the brightness of the virtual environment changes, and k is the current virtual scene displayed by the VR deviceIs a virtual ambient light level; a nonlinear monotonically increasing virtual ambient light transformation function for representing virtual ambient light levels of a virtual scene displayed by a VR device, gradually increasing from k to T over time T b Wherein t.epsilon.0, T]。
In one embodiment, the formula for converting the current screen input signal to the current virtual screen light intensity based on the electrotransfer light transfer function is as follows:
LinarInput x,y ＝EOTF(I x,y )；
LinarInput x,y for the current virtual screen brightness, EOTF () is the electrotransport light transfer function, I x,y The method comprises the steps that a current screen input signal is obtained, wherein the screen input signal is a nonlinear video signal value corresponding to a pixel point located at (x, y) in a screen coordinate system;
the formula for increasing the current virtual screen brightness to the virtual screen brightness corresponding to the strong light level according to the preset remapping value is as follows:
Output x,y ＝m+LinarInput x,y ；
m∈[0,5]m is a preset remap value, output x,y The brightness of the virtual screen corresponding to the strong light level.
In one embodiment, the virtual scene is a virtual screen play scene, and the virtual scene brightness includes a virtual environment brightness and a virtual screen brightness; the adjusting module is used for gradually reducing the virtual environment light brightness of the virtual scene displayed by the VR equipment according to the nonlinear monotonically decreasing virtual environment light conversion function until the virtual environment light brightness is the virtual environment light brightness corresponding to the weak light level; based on the electric light transfer function, converting the current screen input signal into the current virtual screen brightness, wherein the screen input signal is a nonlinear video signal value under a screen coordinate system, and reducing the current virtual screen brightness to the virtual screen brightness corresponding to the dim light level according to the preset remapping coefficient.
In one embodiment, the nonlinear monotonically decreasing virtual ambient light transformation function is represented by the following formula:
L env ＝max(0,k-t b )；
wherein L is env The method comprises the steps that b is the change rate of the virtual environment light brightness, the larger the change rate is, the faster the change of the virtual environment light brightness is, and k is the current virtual environment light brightness of a virtual scene displayed by VR equipment; the nonlinear monotonically decreasing virtual environment light transformation function is used for representing the change process that the virtual environment light brightness of a virtual scene displayed by the VR device gradually decreases from k to 0 along with time t.
In one embodiment, the formula for converting the current screen input signal to the current virtual screen light intensity based on the electrotransfer light transfer function is as follows:
LinarInput x,y ＝EOTF(I x,y )；
LinarInput x,y for the current virtual screen brightness, EOTF () is the electrotransport light transfer function, I x,y The method comprises the steps that a current screen input signal is obtained, wherein the screen input signal is a nonlinear video signal value corresponding to a pixel point located at (x, y) in a screen coordinate system;
the formula for reducing the current virtual screen brightness to the virtual screen brightness corresponding to the weak light level according to the preset remapping coefficient is as follows:
Output x,y ＝n*LinarInput x,y ；
n is a preset remapping coefficient, n is more than 0 and less than or equal to 1, and output x,y The virtual screen brightness corresponding to the dim light level.
Above-mentioned VR equipment's display brightness adjusting device 900, when VR equipment is in wearing the state, detect the real scene luminance of the real scene that VR equipment is located, carry out the classification to real scene luminance and obtain real scene light level, detect the virtual scene luminance of virtual scene that VR equipment was shown, carry out the classification to virtual scene luminance and obtain virtual scene light level, according to real scene light level and virtual scene light level, the virtual scene luminance of the virtual scene that VR equipment was shown is adjusted in the adaptation, can be in real time according to the virtual scene luminance of real scene luminance adaptation virtual scene that VR equipment was shown, make can not have obvious luminance difference between real scene luminance and the virtual scene luminance of virtual scene, when the user unloads VR equipment, user's visual impression is unanimous, discomfort and the stimulus of eye are aroused because of luminance drastic change have been reduced, thereby promote user's in virtual reality's use experience, make things convenient for the better use VR equipment of user.
The modules in the display brightness adjustment device 900 of the VR device may be all or partially implemented by software, hardware, or a combination thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.
In one embodiment, a computer device is provided, which may be a terminal, and an internal structure diagram thereof may be as shown in fig. 10. The computer device includes a processor, a memory, an input/output interface, a communication interface, a display unit, and an input means. The processor, the memory and the input/output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input/output interface. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The input/output interface of the computer device is used to exchange information between the processor and the external device. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless mode can be realized through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. The computer program, when executed by a processor, implements a method for adjusting display brightness of a VR device. The display unit of the computer equipment is used for forming a visual picture, and can be a display screen, a projection device or a virtual reality imaging device, wherein the display screen can be a liquid crystal display screen or an electronic ink display screen, the input device of the computer equipment can be a touch layer covered on the display screen, can also be a key, a track ball or a touch pad arranged on a shell of the computer equipment, and can also be an external keyboard, a touch pad or a mouse and the like.
It will be appreciated by those skilled in the art that the structure shown in fig. 10 is merely a block diagram of some of the structures associated with the present application and is not limiting of the computer device to which the present application may be applied, and that a particular computer device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, including a memory and a processor, where the memory stores a computer program, and the processor implements the steps of the method for adjusting display brightness of the VR device provided in the embodiments of the present application when the computer program is executed.
In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, which when executed by a processor, implements the steps of the VR device display brightness adjustment method provided in the embodiments of the present application.
In one embodiment, a computer program product is provided that includes a computer program that, when executed by a processor, implements the steps of the VR device display brightness adjustment method provided by the embodiments of the present application.
It should be noted that, the user information (including, but not limited to, user equipment information, user personal information, etc.) and the data (including, but not limited to, data for analysis, stored data, presented data, etc.) referred to in the present application are information and data authorized by the user or sufficiently authorized by each party, and the collection, use and processing of the related data are required to comply with the related laws and regulations and standards of the related countries and regions.
Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, database, or other medium used in the various embodiments provided herein may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high density embedded nonvolatile Memory, resistive random access Memory (ReRAM), magnetic random access Memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric Memory (Ferroelectric Random Access Memory, FRAM), phase change Memory (Phase Change Memory, PCM), graphene Memory, and the like. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, and the like. By way of illustration, and not limitation, RAM can be in the form of a variety of forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), and the like. The databases referred to in the various embodiments provided herein may include at least one of relational databases and non-relational databases. The non-relational database may include, but is not limited to, a blockchain-based distributed database, and the like. The processors referred to in the embodiments provided herein may be general purpose processors, central processing units, graphics processors, digital signal processors, programmable logic units, quantum computing-based data processing logic units, etc., without being limited thereto.
The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The above examples only represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the present application. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application shall be subject to the appended claims.
Claims (16)
1. A method for adjusting display brightness of a VR device, the method comprising:
when the VR equipment is in a wearing state, detecting the brightness of a real scene of the real scene where the VR equipment is located;
grading the brightness of the real scene to obtain the light level of the real scene;
detecting virtual scene brightness of a virtual scene displayed by the VR equipment;
grading the brightness of the virtual scene to obtain the virtual scene light level;
And according to the real scene light level and the virtual scene light level, adaptively adjusting the virtual scene brightness of the virtual scene displayed by the VR equipment.
2. The method of claim 1, wherein detecting a real scene light level of a real scene in which the VR device is located comprises:
a control instruction for starting an ambient light sensor is sent out;
acquiring readings detected by the ambient light sensor regarding ambient light;
the reading for ambient light is converted to a real scene light level.
3. The method of claim 1, wherein said grading the real scene light intensity to obtain a real scene light level comprises:
when the brightness of the real scene is larger than a preset threshold value, determining that the light level of the real scene is a strong light level;
and when the brightness of the real scene is smaller than or equal to a preset threshold value, determining that the light level of the real scene is a weak light level.
4. The method of claim 1, wherein the virtual scene is a virtual screen play scene, and wherein the virtual scene light intensity comprises a virtual environment light intensity and a virtual screen light intensity;
the detecting the virtual scene brightness of the virtual scene displayed by the VR device includes:
Acquiring the current virtual environment brightness of the virtual screen playing scene;
converting a current screen input signal into virtual screen brightness based on an electric light transfer function, wherein the screen input signal is a nonlinear video signal value under a screen coordinate system;
and calculating the virtual scene brightness of the virtual scene displayed by the VR equipment according to the virtual environment brightness and the virtual screen brightness.
5. The method of claim 1, wherein said grading said virtual scene light level to obtain a virtual scene light level comprises:
when the brightness of the virtual scene is larger than a preset threshold value, determining that the light level of the virtual scene is a strong light level;
and when the brightness of the virtual scene is smaller than or equal to a preset threshold value, determining that the light level of the virtual scene is a weak light level.
6. The method of claim 1, wherein said adaptively adjusting virtual scene light intensity of a virtual scene displayed by the VR device based on the real scene light level and the virtual scene light level comprises:
when the real scene light level is a strong light level and the virtual scene light level is a weak light level, adjusting the virtual scene brightness of the virtual scene displayed by the VR equipment to the strong light level;
When the real scene light level is a weak light level and the virtual scene light level is a strong light level, adjusting the virtual scene brightness of the virtual scene displayed by the VR equipment to the weak light level;
and when the real scene light level is the same as the virtual scene light level, keeping the virtual scene brightness of the virtual scene displayed by the VR equipment unchanged.
7. The method of claim 6, wherein the virtual scene is a virtual screen play scene, and wherein the virtual scene light intensity comprises a virtual environment light intensity and a virtual screen light intensity; the adjusting the virtual scene brightness of the virtual scene displayed by the VR device to a strong light level includes:
gradually increasing the virtual environment brightness of the virtual scene displayed by the VR equipment according to a nonlinear monotonically increasing virtual environment light transformation function;
based on an electric light conversion transfer function, converting a current screen input signal into a current virtual screen brightness, wherein the screen input signal is a nonlinear video signal value under a screen coordinate system, and increasing the current virtual screen brightness to a virtual screen brightness corresponding to a strong light level according to a preset remapping value.
8. The method of claim 7, wherein the nonlinear monotonically increasing virtual ambient light transformation function is formulated by the formula:
L env ＝max(k,t b )；
wherein L is env B is the change rate of the virtual environment light brightness, the larger the change rate is, the faster the change of the virtual environment light brightness is, and k is the current virtual environment light brightness of the virtual scene displayed by the VR device; the nonlinear monotonically increasing virtual environment light transformation function is used for representing the virtual environment light brightness of the virtual scene displayed by the VR device, and gradually increases from k to T along with time T b Wherein t.epsilon.0, T]。
9. The method of claim 7, wherein the formula for converting the current screen input signal to the current virtual screen brightness based on the electrotransport light transfer function is as follows:
LinarInput x,y ＝EOTF(I x,y )；
LinarInput x,y for the current virtual screen brightness, EOTF () is the electrotransport light transfer function, I x,y The method comprises the steps of taking a current screen input signal as a nonlinear video signal value corresponding to a pixel point positioned at (x, y) under a screen coordinate system;
the formula for increasing the current virtual screen brightness to the virtual screen brightness corresponding to the strong light level according to the preset remapping value is as follows:
Output x,y ＝m+LinarInput x,y ；
m∈[0,5]M is a preset remap value, output x,y The brightness of the virtual screen corresponding to the strong light level.
10. The method of claim 6, wherein the virtual scene is a virtual screen play scene, and wherein the virtual scene light intensity comprises a virtual environment light intensity and a virtual screen light intensity; the adjusting the virtual scene brightness of the virtual scene displayed by the VR device to a dim light level includes:
gradually reducing the virtual environment light brightness of the virtual scene displayed by the VR equipment according to a nonlinear monotonically decreasing virtual environment light transformation function until the virtual environment light brightness is the virtual environment light brightness corresponding to the weak light level;
based on an electric light conversion transfer function, converting a current screen input signal into a current virtual screen brightness, wherein the screen input signal is a nonlinear video signal value under a screen coordinate system, and reducing the current virtual screen brightness to a virtual screen brightness corresponding to a dim light level according to a preset remapping coefficient.
11. The method of claim 10, wherein the nonlinear monotonically decreasing virtual ambient light transformation function is formulated by the formula:
L env ＝max(0,k-t b )；
Wherein,L env b is the change rate of the virtual environment light brightness, the larger the change rate is, the faster the change of the virtual environment light brightness is, and k is the current virtual environment light brightness of the virtual scene displayed by the VR device; the nonlinear monotonically decreasing virtual environment light transformation function is used for representing the change process that the virtual environment light brightness of the virtual scene displayed by the VR equipment gradually decreases from k to 0 along with time t.
12. The method of claim 10, wherein the formula for converting the current screen input signal to the current virtual screen brightness based on the electrotransport light transfer function is as follows:
LinarInput x,y ＝EOTF(I x,y )；
LinarInput x,y for the current virtual screen brightness, EOTF () is the electrotransport light transfer function, I x,y The method comprises the steps of taking a current screen input signal as a nonlinear video signal value corresponding to a pixel point positioned at (x, y) under a screen coordinate system;
the formula for reducing the current virtual screen brightness to the virtual screen brightness corresponding to the dim light level according to the preset remapping coefficient is as follows:
Output x,y ＝n*LinarInput x,y ；
n is a preset remapping coefficient, n is more than 0 and less than or equal to 1, and output x,y The virtual screen brightness corresponding to the dim light level.
13. A display brightness adjustment device for a VR device, the device comprising:
the first detection module is used for detecting the brightness of the real scene where the VR equipment is located when the VR equipment is in a wearing state;
the brightness grading module is used for grading the brightness of the real scene to obtain the light level of the real scene;
the second detection module is used for detecting the brightness of the virtual scene displayed by the VR equipment;
the brightness grading module is further used for grading the brightness of the virtual scene to obtain the virtual scene light level;
and the adjusting module is used for adaptively adjusting the virtual scene brightness of the virtual scene displayed by the VR equipment according to the real scene light level and the virtual scene light level.
14. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the computer program when executed by the processor implements the steps of the method of any of claims 1 to 12.
15. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 12.
16. A computer program product comprising a computer program, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any one of claims 1 to 12.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311440131.7A CN117334145A (en) | 2023-10-31 | 2023-10-31 | Display brightness adjusting method, device and equipment of VR equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311440131.7A CN117334145A (en) | 2023-10-31 | 2023-10-31 | Display brightness adjusting method, device and equipment of VR equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117334145A true CN117334145A (en) | 2024-01-02 |
Family
ID=89277364
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311440131.7A Pending CN117334145A (en) | 2023-10-31 | 2023-10-31 | Display brightness adjusting method, device and equipment of VR equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117334145A (en) |
-
2023
- 2023-10-31 CN CN202311440131.7A patent/CN117334145A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200160818A1 (en) | Systems and methods for head-mounted display adapted to human visual mechanism | |
| Scarfe et al. | Using high-fidelity virtual reality to study perception in freely moving observers | |
| CN107111131B (en) | Wearable electronic device | |
| US20210134245A1 (en) | Electronic Device with Adaptive Display | |
| CN114175045B (en) | Determining user characteristics using brightness variations | |
| CN105607263A (en) | Head mounted electronic equipment | |
| CN104167196A (en) | Backlight brightness adjusting method and device and electronic device | |
| US20230336865A1 (en) | Device, methods, and graphical user interfaces for capturing and displaying media | |
| US20240077937A1 (en) | Devices, methods, and graphical user interfaces for controlling avatars within three-dimensional environments | |
| US11366321B1 (en) | Predictive dimming of optical passthrough displays | |
| WO2022252924A1 (en) | Image transmission and display method and related device and system | |
| CN109124869A (en) | One kind overturning Conventional visual and is accustomed to and carries out brain eye coordinate motion image training system | |
| WO2021103990A1 (en) | Display method, electronic device, and system | |
| US20230290014A1 (en) | Attention-driven rendering for computer-generated objects | |
| Powell et al. | The accessibility of commercial off-the-shelf virtual reality for low vision users: a macular degeneration case study | |
| WO2018211103A1 (en) | Methods and systems for viewing and editing ar/vr computer-based designs allowing impaired vision simulation | |
| CN117334145A (en) | Display brightness adjusting method, device and equipment of VR equipment and storage medium | |
| US20220254115A1 (en) | Deteriorated video feed | |
| CN112584127B (en) | gaze-based exposure | |
| CN107665696A (en) | The display device that a kind of display brightness dynamic changes | |
| Vinnikov et al. | Real-time simulation of visual defects with gaze-contingent display | |
| US11823343B1 (en) | Method and device for modifying content according to various simulation characteristics | |
| US20240203306A1 (en) | Electronic Devices with Dynamic Brightness Ranges for Passthrough Display Content | |
| CN117472316B (en) | Display control method, electronic equipment, storage medium and chip system | |
| US20220027604A1 (en) | Assisted Expressions |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication |