CN112581435B - Anti-dizziness method and apparatus - Google Patents

Anti-dizziness method and apparatus Download PDF

Info

Publication number
CN112581435B
CN112581435B CN202011429679.8A CN202011429679A CN112581435B CN 112581435 B CN112581435 B CN 112581435B CN 202011429679 A CN202011429679 A CN 202011429679A CN 112581435 B CN112581435 B CN 112581435B
Authority
CN
China
Prior art keywords
determining
pupil
pupil size
size ratio
formula
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011429679.8A
Other languages
Chinese (zh)
Other versions
CN112581435A (en
Inventor
时准
莫畏
金雅庆
韩璘
张恒煦
杨嘉明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jilin Jianzhu University
Original Assignee
Jilin Jianzhu University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jilin Jianzhu University filed Critical Jilin Jianzhu University
Priority to CN202011429679.8A priority Critical patent/CN112581435B/en
Publication of CN112581435A publication Critical patent/CN112581435A/en
Application granted granted Critical
Publication of CN112581435B publication Critical patent/CN112581435B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/60Analysis of geometric attributes
    • G06T7/62Analysis of geometric attributes of area, perimeter, diameter or volume
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/90Determination of colour characteristics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10141Special mode during image acquisition
    • G06T2207/10144Varying exposure
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30041Eye; Retina; Ophthalmic

Abstract

The application discloses anti-dizziness method and equipment, which are applied to virtual reality equipment, wherein the virtual reality equipment comprises a display device and a photographing device, and the method comprises the following steps: controlling the photographing device to photograph the eyes of the user according to a preset time interval to obtain an eye image; determining the iris size and the pupil size of the user according to the eye image; determining a pupil size ratio based on the iris size and the pupil size; determining a vertigo evaluation function according to the pupil size ratio; when the vertigo evaluation function is larger than a preset threshold value, warning information is sent to a user to prompt the user to operate; when the specified operation of the user is not detected within the preset time, gradually reducing the display brightness of the display device until the display brightness of the display device is zero. By adopting the embodiment of the application, the situation that the user is dizzy when using the virtual reality equipment can be avoided.

Description

Anti-dizziness method and apparatus
Technical Field
The application relates to the technical field of virtual reality, in particular to an anti-dizziness method and equipment.
Background
Virtual reality equipment mainly is through the display device display image in the equipment, rethread optical system transmits the image to people's eye, virtual reality equipment builds three-dimensional virtual environment for the user, but the user when observing virtual environment, can be because the three-dimensional effect among the unable adaptation virtual environment, dizziness problem often can appear, and when dizziness appears in the use virtual reality equipment, the user can't observe real external environment, thereby cause the user to appear falling down to collide with easily, lead to user's safety problem.
Disclosure of Invention
The embodiment of the application provides an anti-dizziness method and device.
In a first aspect, an embodiment of the present application provides an anti-dizziness method, which is applied to a virtual reality device, where the virtual reality device includes a display device and a photographing device, and the anti-dizziness method includes:
controlling the photographing device to photograph the eyes of the user according to a preset time interval to obtain an eye image;
determining the iris size and the pupil size of the user according to the eye image;
determining a pupil size ratio according to a first formula, (z × D2)/(D1 × E), wherein K is the pupil size ratio, z is a first preset parameter, D1 is the iris size, D2 is the pupil size, and E is the display brightness of the display device;
determining a vertigo evaluation function according to the pupil size ratio;
when the dizziness evaluation function is larger than a preset threshold value, warning information is sent to a user to prompt the user to operate;
when the specified operation of the user is not detected within the preset time, gradually reducing the display brightness of the display device until the display brightness of the display device is zero.
In a second aspect, an embodiment of the present application provides an anti-glare device, which is applied to a virtual reality apparatus, where the virtual reality apparatus includes a display device and a photographing device, the anti-glare device includes:
the acquisition unit is used for controlling the photographing device to photograph the eyes of the user according to a preset time interval so as to acquire an eye image;
the determining unit is used for determining the iris size and the pupil size of the user according to the eye image;
the determining unit is further configured to determine a pupil size ratio according to a first formula, the iris size and the pupil size, where the first formula is K ═ z × D2/D1 × E, the K is the pupil size ratio, the z is a first preset parameter, the D1 is the iris size, the D2 is the pupil size, and the E is the display luminance of the display device;
the determining unit is further used for determining a dizziness evaluation function according to the pupil size ratio;
the warning unit is used for sending warning information to a user to prompt the user to operate when the vertigo evaluation function is larger than a preset threshold value;
and the display brightness adjusting unit is used for gradually reducing the display brightness of the display device until the display brightness of the display device is zero when the specified operation of the user is not detected within the preset time.
In a third aspect, an embodiment of the present application provides a virtual reality device, including a processor, a memory, a transceiver, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing steps in any method of the first aspect of the embodiment of the present application.
In a fourth aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program makes a computer perform part or all of the steps described in any one of the methods of the first aspect of the present application.
In a fifth aspect, the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to perform some or all of the steps as described in any one of the methods of the first aspect of the embodiments of the present application. The computer program product may be a software installation package.
It can be seen that, in the embodiment of the present application, the photographing device is controlled to photograph the eyes of the user at preset time intervals to obtain an eye image; determining the iris size and the pupil size of the user according to the eye image; then, determining a pupil size ratio according to a first formula, (z × D2)/(D1 × E), wherein K is the pupil size ratio, z is a first preset parameter, D1 is the iris size, D2 is the pupil size, and E is the display brightness of the display device; determining a dizziness evaluation function according to the pupil size ratio; when the vertigo evaluation function is larger than a preset threshold value, warning information is sent to a user to prompt the user to operate; when the specified operation of the user is not detected within the preset time, gradually reducing the display brightness of the display device until the display brightness of the display device is zero. Realized judging user's dizzy condition through virtual reality equipment to avoid the user when using virtual reality equipment, the dizzy condition appears, leads to the user to appear falling down to collide with, the problem of potential safety hazard appears.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic flow chart of an anti-glare method according to an embodiment of the present disclosure;
fig. 2 is a schematic structural diagram of a virtual reality device provided in an embodiment of the present application;
fig. 3 is a schematic structural diagram of an anti-glare device according to an embodiment of the present disclosure.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The following are detailed descriptions.
The terms "first," "second," "third," and "fourth," etc. in the description and claims of this application and in the accompanying drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements but may alternatively include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein may be combined with other embodiments.
Referring to fig. 1, fig. 1 is a schematic flow chart of an anti-glare method applied to a virtual reality device, where the virtual reality device includes a display device and a photographing device, and the anti-glare method includes the following steps.
Step 10, controlling the photographing device to photograph the eye region of the user according to a preset time interval, and acquiring an eye image.
Wherein, the preset time interval may be 0.5 second, 1 second or other time duration.
Optionally, the controlling the photographing device to photograph the eyes of the user according to the preset time interval to obtain the eye image includes:
determining the display brightness of the eye region of the user through the photographing device according to a preset time interval;
adjusting the diaphragm number of the photographing device according to the display brightness;
and photographing the eye region of the user according to the adjusted f-number to acquire an eye image.
For example, in order to ensure that the photographing device can acquire a clear image with high contrast, when the photographing device acquires the eye image, it needs to first determine the display brightness in the photographing environment, where the display brightness is determined according to the current display image of the display device, and when the brightness of the display image is higher, the display brightness is higher, and when the brightness of the display image is lower, the display brightness is lower. And after the display brightness of the photographing environment is determined, adjusting the f-number of the photographing device according to the display brightness, and controlling the photographing device to photograph the eye region of the user to acquire an eye image.
Therefore, the eye images acquired by the photographing device are ensured to have approximate image brightness by controlling the light incoming amount of the photographing device, so that the problem that the difficulty of subsequent eye image processing is increased due to inconsistent image brightness of the eye images at different moments when the eye images are acquired by the photographing device is solved.
And step 20, determining the iris size and the pupil size of the user according to the eye image.
Optionally, the determining the size of the iris and the size of the pupil of the user according to the eye image includes:
carrying out gray level processing on the eye image to obtain a gray level image;
determining an iris outline according to the gray image and a first preset gray value;
determining the iris size from the iris profile;
determining a pupil contour according to the iris contour and a second preset gray value;
and determining the pupil size according to the pupil contour.
Optionally, the performing gray scale processing on the eye image to obtain a gray scale image includes:
determining color information of pixel points of the eye image, wherein the color information comprises red brightness, green brightness and red brightness;
determining the gray value of the pixel point according to a sixth formula and the color information, wherein the sixth formula is that G1 ═ R a1+ G2 a2+ B a3, G1 represents the gray value of the pixel point, R represents the red brightness of the pixel point, G2 represents the green brightness of the pixel point, B represents the blue brightness of the pixel point, a1 represents a first reference coefficient, a2 represents a second reference coefficient, a3 represents a third reference coefficient, and a1+ a2+ a3 is 100%;
and acquiring gray values of all pixel points, and determining the gray image.
For example, when a pixel of the eye image is a color, it is determined that the red luminance of the pixel is 210, the blue luminance is 50, and the green luminance is 100, where a1 is 30%, a2 is 40%, and a3 is 30%, then the gray scale value of the pixel is 113.
The eyeball structure of the human eye comprises a sclera and an iris, the color of the sclera is different from that of the iris, after the eye image is subjected to gray level processing, the iris outline is determined according to the gray level image and a first preset gray level value, and the sclera surrounds the iris, so that the sclera and the iris can be distinguished according to the first preset gray level value, and the iris outline is determined.
After the iris outline is determined, the iris size is determined, and specifically, the iris size may be determined according to an average diameter of the iris outline in each direction.
After the size of the iris is determined, because the pupil is located in the iris and the color of the pupil is different from that of the iris, the iris and the pupil can be distinguished according to the second preset gray value, wherein the second preset gray value is smaller than the first preset gray value.
After the pupil contour is determined, the pupil size is determined, specifically, the way of determining the size of the through hole through the pupil contour is the same as the way of determining the size of the iris through the iris contour, and details are not repeated here.
Step 30, determining a pupil size ratio according to a first formula, (z × D2)/(D1 × E), the first formula being K ═ D2)/(D1 × E, the first formula being K, the first formula being the pupil size ratio, the second formula being D1, the second formula being the iris size, the first formula being D2, and the second formula being the display luminance of the display device.
For example, assuming that z is 50, D1 is 6 mm, D2 is 2 mm, and the display brightness of the current display device is 50 nits, the via dimension ratio can be calculated to be 33% according to the first formula.
And step 40, determining a dizziness evaluation function according to the pupil size ratio.
Optionally, the determining the vertigo evaluation function according to the pupil size ratio includes:
determining the pupil change rate of the pupil size ratio within a preset time range;
and determining a dizziness evaluation function according to the pupil change rate.
Optionally, the determining the pupil change rate of the pupil size ratio within the preset time range includes:
acquiring a pupil size ratio at a first time and acquiring a pupil size ratio at a second time, wherein the second time is different from the first time by at least one preset time interval;
determining the pupil change rate of the pupil size ratio within the preset time range according to a second formula, the pupil size ratio at the first time and the pupil size ratio at the second time;
the second formula is (K2-K1)/(T2-T1), where P is a pupil change rate, T2 is the second time, T1 is the first time, K2 is a pupil size ratio of the second time, and K1 is a pupil size ratio of the first time.
The preset time range comprises a first time and a second time.
When the display image of the display device is continuously changed, the display brightness of the display image is also changed, and the size of the pupil is usually changed by human eyes in order to adjust the light inlet quantity, so that the quantity of light entering the human eyes is controlled. When the user has dizziness, the pupil can be enlarged, so that the pupil size ratio is obviously increased, and whether the user has dizziness can be determined according to the pupil size ratio.
After the pupil size ratio of the first time and the pupil size ratio of the second time are obtained, wherein the difference between the second time and the first time is at least one preset time interval, so that the pupil change rate can be determined according to the time range from the first time to the second time.
For example, assuming that the second time is 1 second different from the first time, K1 is 0.4, and K2 is 0.33, the pupil change rate can be calculated to be 0.07 according to the second formula.
Optionally, the determining a vertigo evaluation function according to the pupil change rate includes:
determining the pupil change rate for a plurality of time intervals within the preset time range;
determining a standard deviation of the plurality of pupil change rates according to a third formula, wherein the third formula is
Figure RE-GDA0002939201210000061
Beta is the standard deviation, P i Is the ith pupil change rate, N is the number of the pupil change rates in the preset time range, and P' is the number of the pupils in the preset time rangeAverage of individual pupil change rates;
determining the vertigo rating function according to a fourth formula and the standard deviation, wherein the fourth formula is
Figure RE-GDA0002939201210000071
Q is a dizziness evaluation function, and s is a first constant.
The preset threshold value is used for judging the vertigo degree of the virtual reality device worn by the user, when the vertigo evaluation function is larger, the vertigo state of the current user is indicated, and when the vertigo evaluation function is smaller, the vertigo influence of the current user is not indicated.
In order to determine the vertigo evaluation function, a plurality of pupil change rates within the facility building range need to be determined, a standard deviation of the pupil change rates is calculated, and the vertigo evaluation function is determined according to the standard deviation.
In one embodiment, 5 pupil change rates are included in the preset time range, and the 5 pupil change rates are resolved into 0.02, 0.05, 0.07, 0.04, and 0.03, so that the average value P' of the pupil change rates is 0.042, and the standard deviation β of the 5 pupil change rates is 0.0384. After determining the standard deviation, the vertigo rating function is determined according to the fourth formula and the standard deviation, in the above embodiment, s is 0.05, and then the vertigo rating function Q is 0.05/0.0384 is 1.302.
Therefore, the current use condition of the user on the virtual display device can be determined through the pupil change rate of the user, and whether the user is in the vertigo state is judged.
And step 50, when the vertigo evaluation function is larger than a preset threshold value, sending warning information to a user to prompt the user to operate.
When the vertigo evaluation function is greater than the preset threshold value, the virtual reality device judges that the user is currently in the vertigo state according to the change of the pupil of the user, and therefore sends out warning information to the user.
In an embodiment, when a specific operation of the user is detected within a preset time, specifically, the specific operation may be a click operation or a sliding operation performed by the user through a controller associated with the virtual reality device, or may be an observation operation directing the user to observe a specific region of the display apparatus.
When the appointed operation of the user is detected, the user is determined not to be in the dizziness state at present, at the moment, the virtual reality equipment clears the pupil size and the pupil change rate information which are recorded at present, and starts to record again, so that the recorded data are prevented from influencing the subsequent anti-dizziness judgment.
And step 60, when the appointed operation of the user is not detected within the preset time, gradually reducing the display brightness of the display device until the display brightness of the display device is zero.
Optionally, the gradually decreasing the display brightness of the display device until the display brightness of the display device is zero includes:
determining a display brightness reduction rate of the display device according to a fifth formula and the vertigo evaluation function, wherein the fifth formula is V ═ E (1-1/Q), the E is the current display brightness of the display device, and the Q is the vertigo evaluation function;
and gradually reducing the display brightness of the display device according to the display brightness reduction rate until the display brightness of the display device is zero.
When the appointed operation of the user is not detected within the preset time, the virtual reality device judges that the user is in the dizziness state at present, and in order to avoid further enhancing the dizziness condition of the user, the display brightness of the display device is gradually reduced until the display device is closed, so that the user is gradually separated from the dizziness state, and the safety problem possibly caused by dizziness when the user uses the virtual reality device is avoided.
In one embodiment, when the user's designated operation is not detected within a preset time, the luminance decrease rate of the display device is determined according to a fifth formula and the vertigo evaluation function Q, the vertigo evaluation function Q is 1.302, the display luminance E is 50 nits, the luminance decrease rate V is E | (1-1/Q) | 50.232 is 11.6 nits/second, the display luminance of the display device is gradually decreased due to 50/11.6-4.31 seconds, and the display device is turned off after 4.31 seconds.
Therefore, the display brightness reduction rate is controlled according to the vertigo evaluation function, and compared with the situation that the display device is directly turned off, the stimulation of the display device to the user can be reduced, so that the influence of vertigo on the user is further reduced, and the safety of the user in using the virtual reality device is improved.
Referring to fig. 2, fig. 2 is a schematic structural diagram of a virtual reality device according to an embodiment of the present disclosure, and as shown in the drawing, the service device includes a processor, a memory, a transceiver, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for performing the following steps:
controlling the photographing device to photograph the eyes of the user according to a preset time interval to obtain an eye image;
determining the iris size and the pupil size of the user according to the eye image;
determining a pupil size ratio according to a first formula, (z × D2)/(D1 × E), wherein K is the pupil size ratio, z is a first preset parameter, D1 is the iris size, D2 is the pupil size, and E is the display brightness of the display device;
determining a dizziness evaluation function according to the pupil size ratio;
when the vertigo evaluation function is larger than a preset threshold value, warning information is sent to a user to prompt the user to operate;
when the appointed operation of the user is not detected within the preset time, the display brightness of the display device is gradually reduced until the display brightness of the display device is zero.
In one implementation of the present application, in determining the iris size and the pupil size of the user from the eye image, the program includes instructions specifically configured to perform the steps of:
carrying out gray processing on the eye image to obtain a gray image;
determining an iris outline according to the gray image and a first preset gray value;
determining the iris size from the iris outline;
determining a pupil contour according to the iris contour and a second preset gray value, wherein the second preset gray value is smaller than the first preset gray value;
and determining the pupil size according to the pupil contour.
In an implementation of the application, the program comprises instructions for carrying out the following steps in particular in determining a vertigo evaluation function from the pupil size ratio K:
determining the pupil change rate of the pupil size ratio within a preset time range;
and determining a dizziness evaluation function according to the pupil change rate.
In one implementation of the present application, in determining the pupil rate of change of the pupil size ratio within a preset time range, the program includes instructions specifically configured to:
acquiring a pupil size ratio at a first time and acquiring a pupil size ratio at a second time, wherein the second time is different from the first time by at least one preset time interval;
determining the pupil change rate of the pupil size ratio within the preset time range according to a second formula, the pupil size ratio at the first time and the pupil size ratio at the second time;
wherein the second formula is P ═ K2-K1)/(T2-T1), the T2 is the second time, the T1 is the first time, the K2 is a pupil size ratio at the second time, and the K1 is a pupil size ratio at the first time.
In an implementation of the application, the program comprises instructions for executing in particular the following steps in determining a vertigo evaluation function from the pupil rate of change P:
determining the pupil rate of change for a plurality of time intervals within the preset time range;
determining a standard deviation of the plurality of pupil change rates according to a third formula, wherein the third formula is
Figure RE-GDA0002939201210000101
Beta is the standard deviation, P i The number of the ith pupil change rate is N, the number of the pupil change rates in the preset time range is N, and the P' is the average value of the pupil change rates in the preset time range;
determining the vertigo rating function according to a fourth formula and the standard deviation, wherein the fourth formula is
Figure RE-GDA0002939201210000102
Q is a dizziness evaluation function, and s is a first constant.
In an implementation manner of the present application, in gradually reducing the display brightness of the display device until the display brightness of the display device is zero, the program includes instructions specifically for performing the following steps:
determining a display brightness reduction rate of the display device according to a fifth formula and the vertigo evaluation function, wherein the fifth formula is V ═ E | (1-1/Q) |, the E is the current display brightness of the display device, and the Q is the vertigo evaluation function;
and gradually reducing the display brightness of the display device according to the display brightness reduction rate until the display brightness of the display device is zero.
It should be noted that, for the specific implementation process of this embodiment, reference may be made to the specific implementation process described in the above method embodiment, and no description is given here.
Referring to fig. 3, fig. 3 is a schematic diagram of an anti-glare device applied to a virtual reality apparatus in an intelligent travel system according to an embodiment of the present disclosure, where the device includes:
an obtaining unit 310, configured to control the photographing device to photograph eyes of a user at preset time intervals, so as to obtain an eye image;
a determining unit 320, configured to determine an iris size and a pupil size of the user according to the eye image;
the determining unit 320 is further configured to determine a pupil size ratio according to a first formula, (z × D2)/(D1 × E), the first formula being K ═ pupil size ratio, z being a first preset parameter, the D1 being iris size, the D2 being pupil size, and the E being display luminance of the display device;
the determining unit 320 is further configured to determine a vertigo evaluation function according to the pupil size ratio;
the warning unit 330 is configured to send warning information to a user to prompt the user to perform an operation when the vertigo evaluation function is greater than a preset threshold;
the display brightness adjusting unit 340 is configured to gradually decrease the display brightness of the display device until the display brightness of the display device is zero when the user's designated operation is not detected within a preset time.
In an implementation manner of the present application, in determining the size of the iris and the size of the pupil of the user according to the eye image, the determining unit 320 is specifically configured to:
carrying out gray level processing on the eye image to obtain a gray level image;
determining an iris outline according to the gray image and a first preset gray value;
determining the iris size from the iris profile;
determining a pupil contour according to the iris contour and a second preset gray value, wherein the second preset gray value is smaller than the first preset gray value;
and determining the pupil size according to the pupil contour.
In an implementation manner of the present application, in determining the vertigo evaluation function according to the pupil size ratio K, the determining unit 320 is specifically configured to:
determining the pupil change rate of the pupil size ratio within a preset time range;
and determining a dizziness evaluation function according to the pupil change rate.
In an implementation manner of the present application, in determining the pupil change rate of the pupil size ratio within a preset time range, the determining unit 320 is specifically configured to:
acquiring a pupil size ratio at a first time and acquiring a pupil size ratio at a second time, wherein the second time is different from the first time by at least one preset time interval;
determining the pupil change rate of the pupil size ratio within the preset time range according to a second formula, the pupil size ratio at the first time and the pupil size ratio at the second time;
wherein the second formula is P ═ K2-K1)/(T2-T1), the T2 is the second time, the T1 is the first time, the K2 is the pupil size ratio of the second time, and the K1 is the pupil size ratio of the first time.
In an implementation manner of the present application, in determining the vertigo evaluation function according to the pupil change rate P, the determining unit 320 is specifically configured to:
determining the pupil rate of change for a plurality of time intervals within the preset time range;
determining a standard deviation of the plurality of pupil change rates according to a third formula, wherein the third formula is
Figure RE-GDA0002939201210000111
Beta is the standard deviation, P is i Is the ith pupil change rate, and N is the pupil change within the preset time rangeThe number of change rates, wherein P' is the average value of the plurality of pupil change rates within the preset time range;
determining the vertigo rating function according to a fourth formula and the standard deviation, wherein the fourth formula is
Figure RE-GDA0002939201210000112
Q is a dizziness evaluation function, and s is a first constant.
In an implementation manner of the present application, in gradually decreasing the display luminance of the display device until the display luminance of the display device is zero, the display luminance adjusting unit 340 is specifically configured to:
determining a display brightness decrease rate of the display device according to a fifth formula and the vertigo evaluation function, wherein the fifth formula is V ═ E | (1-1/Q) |, the E is the current display brightness of the display device, and the Q is the vertigo evaluation function;
and gradually reducing the display brightness of the display device according to the display brightness reduction rate until the display brightness of the display device is zero.
It should be noted that the obtaining unit 310, the determining unit 320, and the display brightness adjusting unit 340 may be implemented by a processor, and the warning unit 330 may be implemented by a transceiver.
The embodiment of the present application further provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program makes a computer perform some or all of the steps described in the virtual reality device in the above method embodiment.
Embodiments of the present application also provide a computer program product, where the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to perform some or all of the steps described in the virtual reality apparatus in the above method. The computer program product may be a software installation package.
The steps of a method or algorithm described in the embodiments of the present application may be implemented in hardware, or may be implemented by a processor executing software instructions. The software instructions may be comprised of corresponding software modules that may be stored in Random Access Memory (RAM), flash Memory, Read Only Memory (ROM), Erasable Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), registers, a hard disk, a removable disk, a compact disc Read Only Memory (CD-ROM), or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. Of course, the storage medium may also be integral to the processor. The processor and the storage medium may reside in an ASIC. Additionally, the ASIC may reside in an access network device, a target network device, or a core network device. Of course, the processor and the storage medium may reside as discrete components in an access network device, a target network device, or a core network device.
Those skilled in the art will appreciate that in one or more of the examples described above, the functionality described in the embodiments of the present application may be implemented, in whole or in part, by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website, computer, server, or data center to another website, computer, server, or data center via wire (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy DisK, hard DisK, magnetic tape), an optical medium (e.g., Digital Video Disc (DVD)), or a semiconductor medium (e.g., Solid State DisK (SSD)), among others.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the embodiments of the present application in further detail, and it should be understood that the above-mentioned embodiments are only specific embodiments of the present application, and are not intended to limit the scope of the embodiments of the present application, and any modifications, equivalent substitutions, improvements and the like made on the basis of the technical solutions of the embodiments of the present application should be included in the scope of the embodiments of the present application.

Claims (7)

1. An anti-dizziness method is applied to a virtual reality device, the virtual reality device comprises a display device and a photographing device, and the anti-dizziness method comprises the following steps:
controlling the photographing device to photograph the eyes of the user according to a preset time interval to obtain an eye image;
determining the iris size and the pupil size of the user according to the eye image;
determining a pupil size ratio according to a first formula, (z × D2)/(D1 × E), wherein K is the pupil size ratio, z is a first preset parameter, D1 is the iris size, D2 is the pupil size, and E is the display brightness of the display device;
determining a vertigo evaluation function according to the pupil size ratio;
when the vertigo evaluation function is larger than a preset threshold value, warning information is sent to a user to prompt the user to operate;
when the appointed operation of the user is not detected within the preset time, gradually reducing the display brightness of the display device until the display brightness of the display device is zero;
the determining of the vertigo evaluation function according to the pupil size ratio K comprises the following steps:
determining the pupil change rate of the pupil size ratio within a preset time range;
determining a vertigo evaluation function according to the pupil change rate;
the determining the pupil change rate of the pupil size ratio within the preset time range includes:
acquiring a pupil size ratio at a first time and acquiring a pupil size ratio at a second time, wherein the second time is different from the first time by at least one preset time interval;
determining the pupil change rate of the pupil size ratio within the preset time range according to a second formula, the pupil size ratio at the first time and the pupil size ratio at the second time;
wherein the second formula is P ═ K2-K1)/(T2-T1), the T2 is the second time, the T1 is the first time, the K2 is the pupil size ratio of the second time, and the K1 is the pupil size ratio of the first time;
the determining of the vertigo evaluation function according to the pupil change rate P comprises the following steps:
determining the pupil rate of change for a plurality of time intervals within the preset time range;
determining a standard deviation of a plurality of pupil change rates according to a third formula, wherein the third formula is
Figure FDA0003635133850000011
Beta is the standard deviation, P i The number of the ith pupil change rate is N, the number of the pupil change rates in the preset time range is N, and the P' is the average value of the pupil change rates in the preset time range;
according to a fourth formula anddetermining the vertigo rating function by using the standard deviation, wherein the fourth formula is
Figure FDA0003635133850000021
Q is a dizziness evaluation function, and s is a first constant.
2. The method of anti-glare according to claim 1, wherein the determining the iris size and the pupil size of the user from the eye image comprises:
carrying out gray processing on the eye image to obtain a gray image;
determining an iris outline according to the gray image and a first preset gray value;
determining the iris size from the iris profile;
determining a pupil contour according to the iris contour and a second preset gray value, wherein the second preset gray value is smaller than the first preset gray value;
and determining the pupil size according to the pupil contour.
3. The method of preventing glare according to any one of claims 1 to 2, wherein gradually decreasing the display luminance of the display device until the display luminance of the display device is zero comprises:
determining a display brightness reduction rate of the display device according to a fifth formula and the vertigo evaluation function, wherein the fifth formula is V ═ E | (1-1/Q) |, the E is the current display brightness of the display device, and the Q is the vertigo evaluation function;
and gradually reducing the display brightness of the display device according to the display brightness reduction rate until the display brightness of the display device is zero.
4. An anti-dizziness device, applied to a virtual reality apparatus, wherein the virtual reality apparatus comprises a display device and a photographing device, the anti-dizziness device comprising:
the acquisition unit is used for controlling the photographing device to photograph the eyes of the user according to a preset time interval so as to acquire an eye image;
the determining unit is used for determining the iris size and the pupil size of the user according to the eye image;
the determining unit is further configured to determine a pupil size ratio according to a first formula, (z × D2)/(D1 × E), the first formula being K ═ D2)/(D1 × E), the first formula being K, the first formula being the pupil size ratio, the z being a first preset parameter, the D1 being the iris size, the D2 being the pupil size, and the E being the display luminance of the display device;
the determining unit is further used for determining a dizziness evaluation function according to the pupil size ratio;
the warning unit is used for sending warning information to a user to prompt the user to operate when the vertigo evaluation function is larger than a preset threshold value;
the display brightness adjusting unit is used for gradually reducing the display brightness of the display device until the display brightness of the display device is zero when the specified operation of the user is not detected within the preset time;
the determination unit, in determining the vertigo evaluation function according to the pupil size ratio K, is further configured to:
determining the pupil change rate of the pupil size ratio within a preset time range;
determining a vertigo evaluation function according to the pupil change rate;
the determining unit, in determining the pupil change rate of the pupil size ratio within a preset time range, is further configured to:
acquiring a pupil size ratio at a first time and acquiring a pupil size ratio at a second time, wherein the second time is different from the first time by at least one preset time interval;
determining the pupil change rate of the pupil size ratio within the preset time range according to a second formula, the pupil size ratio at the first time and the pupil size ratio at the second time;
wherein the second formula is P ═ K2-K1)/(T2-T1), the T2 is the second time, the T1 is the first time, the K2 is the pupil size ratio of the second time, and the K1 is the pupil size ratio of the first time;
the determining unit, in determining the vertigo evaluation function according to the pupil change rate P, is further configured to:
determining the pupil rate of change for a plurality of time intervals within the preset time range;
determining a standard deviation of a plurality of pupil change rates according to a third formula, wherein the third formula is
Figure FDA0003635133850000031
Beta is the standard deviation, P i The number of the ith pupil change rate is N, the number of the pupil change rates in the preset time range is N, and the P' is the average value of the pupil change rates in the preset time range;
determining the vertigo rating function according to a fourth formula and the standard deviation, wherein the fourth formula is
Figure FDA0003635133850000032
Q is a dizziness evaluation function, and s is a first constant.
5. The apparatus according to claim 4, wherein in determining the iris size and pupil size of the user from the eye image, the determining unit is specifically configured to:
carrying out gray level processing on the eye image to obtain a gray level image;
determining an iris outline according to the gray image and a first preset gray value;
determining the iris size from the iris outline;
determining a pupil contour according to the iris contour and a second preset gray value, wherein the second preset gray value is smaller than the first preset gray value;
and determining the pupil size according to the pupil contour.
6. A virtual reality device comprising a processor, memory, a transceiver, and one or more programs stored in the memory and configured to be executed by the processor, the programs including instructions for performing the steps in the method of any of claims 1-3.
7. A computer-readable storage medium, characterized in that a computer program for electronic data exchange is stored, wherein the computer program causes a computer to perform the method according to any one of claims 1-3.
CN202011429679.8A 2020-12-09 2020-12-09 Anti-dizziness method and apparatus Active CN112581435B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011429679.8A CN112581435B (en) 2020-12-09 2020-12-09 Anti-dizziness method and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011429679.8A CN112581435B (en) 2020-12-09 2020-12-09 Anti-dizziness method and apparatus

Publications (2)

Publication Number Publication Date
CN112581435A CN112581435A (en) 2021-03-30
CN112581435B true CN112581435B (en) 2022-08-23

Family

ID=75130376

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011429679.8A Active CN112581435B (en) 2020-12-09 2020-12-09 Anti-dizziness method and apparatus

Country Status (1)

Country Link
CN (1) CN112581435B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114816065A (en) * 2022-04-28 2022-07-29 歌尔股份有限公司 Screen backlight adjusting method, virtual reality device and readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106295492A (en) * 2016-06-03 2017-01-04 北京奇虎科技有限公司 A kind of terminal processing method, device and mobile terminal
CN107221303A (en) * 2016-03-22 2017-09-29 中兴通讯股份有限公司 A kind of method, device and intelligent terminal for adjusting screen intensity
CN107224261A (en) * 2016-03-23 2017-10-03 香港中文大学 Utilize the dysopia detecting system of virtual reality
CN108490030A (en) * 2018-03-30 2018-09-04 吉林建筑大学 Thermal performance of building envelope detection method based on unmanned plane infrared thermal imaging
CN110208947A (en) * 2019-06-03 2019-09-06 歌尔股份有限公司 Display equipment and display methods based on human eye tracking

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3472828B1 (en) * 2016-06-20 2022-08-10 Magic Leap, Inc. Augmented reality display system for evaluation and modification of neurological conditions, including visual processing and perception conditions
KR101898414B1 (en) * 2018-04-24 2018-09-12 한림대학교 산학협력단 A 3-dimensional measurement method for eye movement and fully automated deep-learning based system for vertigo diagnosis

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107221303A (en) * 2016-03-22 2017-09-29 中兴通讯股份有限公司 A kind of method, device and intelligent terminal for adjusting screen intensity
CN107224261A (en) * 2016-03-23 2017-10-03 香港中文大学 Utilize the dysopia detecting system of virtual reality
CN106295492A (en) * 2016-06-03 2017-01-04 北京奇虎科技有限公司 A kind of terminal processing method, device and mobile terminal
CN108490030A (en) * 2018-03-30 2018-09-04 吉林建筑大学 Thermal performance of building envelope detection method based on unmanned plane infrared thermal imaging
CN110208947A (en) * 2019-06-03 2019-09-06 歌尔股份有限公司 Display equipment and display methods based on human eye tracking

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Near‐Eye Display and Tracking Technologies for Virtual and Augmented Reality;G.A.Koulieris等;《Computer Graphics Forum》;20190607;第38卷(第2期);第493-519页 *
自适应无眩晕虚拟现实眼镜的光学设计与仿真;耿雨晴;《中国优秀博硕士学位论文全文数据库(硕士)工程科技Ⅰ辑》;20200115(第01期);B024-1004 *
面向虚拟现实头盔的眼动跟踪系统研究;熊小峰;《中国优秀硕士学位论文全文数据库 信息科技辑》;20180215(第02期);I138-2605 *

Also Published As

Publication number Publication date
CN112581435A (en) 2021-03-30

Similar Documents

Publication Publication Date Title
CN106210523B (en) A kind of exposure adjustment method and device
JP6529195B2 (en) Thermal control device and method
TWI729983B (en) Electronic device, system and method for adjusting display device
US20120201453A1 (en) Image processing apparatus and method
US11678180B2 (en) Iris recognition workflow
CN112581435B (en) Anti-dizziness method and apparatus
CN108024027A (en) Image processing equipment, image processing method and storage medium
JP2016081249A (en) Information processing device and information processing method
CN113192468B (en) Display adjustment method, device, equipment and storage medium
CN110568930A (en) Method for calibrating fixation point and related equipment
CN111177679B (en) Game starting method and device, cloud game platform and readable storage medium
CN112070739A (en) Image processing method, image processing device, electronic equipment and storage medium
CN107495922A (en) Method for detecting eye fatigue
CN112130326B (en) Method and device for improving eye protection performance of VR glasses
CN114245071A (en) Intelligent monitoring early warning method and device and monitoring system
CN111695474B (en) Method for adaptively adjusting gamma curve of iris image of human eye
CN110519526B (en) Exposure time control method and device, storage medium and electronic equipment
KR102175481B1 (en) Biometric device and method
CN111190524A (en) Control method and system for automatically adjusting font size of screen and air conditioner
JP2021511606A (en) Systems and methods for blinking motion recognition based on facial features
CN113610723A (en) Image processing method and related device
CN114816065A (en) Screen backlight adjusting method, virtual reality device and readable storage medium
CN113032022B (en) Equipment control method and related equipment
CN113960788A (en) Image display method, image display device, AR glasses, and storage medium
CN112540674A (en) Virtual environment interaction method and equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant