CN111781656A - Wearing state detection method, device, equipment and medium for head-mounted display equipment - Google Patents

Wearing state detection method, device, equipment and medium for head-mounted display equipment Download PDF

Info

Publication number
CN111781656A
CN111781656A CN202010751660.9A CN202010751660A CN111781656A CN 111781656 A CN111781656 A CN 111781656A CN 202010751660 A CN202010751660 A CN 202010751660A CN 111781656 A CN111781656 A CN 111781656A
Authority
CN
China
Prior art keywords
head
mounted display
wearing
display device
light
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010751660.9A
Other languages
Chinese (zh)
Other versions
CN111781656B (en
Inventor
马赫
陈冬瑶
李占明
陈荣
彭建军
迟勇
吴敏
倪小明
邓仕平
董淑娟
洪潜凯
彭希
崔晓明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wangcai Technology Guangzhou Group Co ltd
Original Assignee
Guangzhou Nanfang Human Resources Evaluation Center Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Nanfang Human Resources Evaluation Center Co ltd filed Critical Guangzhou Nanfang Human Resources Evaluation Center Co ltd
Priority to CN202010751660.9A priority Critical patent/CN111781656B/en
Publication of CN111781656A publication Critical patent/CN111781656A/en
Application granted granted Critical
Publication of CN111781656B publication Critical patent/CN111781656B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01VGEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
    • G01V8/00Prospecting or detecting by optical means
    • G01V8/10Detecting, e.g. by using light barriers
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/197Matching; Classification

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Ophthalmology & Optometry (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Life Sciences & Earth Sciences (AREA)
  • Geophysics (AREA)
  • Optics & Photonics (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The application relates to a wearing state detection method and device of a head-mounted display device, the head-mounted display device and a storage medium. The method comprises the following steps: acquiring the brightness of light collected by a light sensor arranged in the head-mounted display device through a lens of the head-mounted display device; the light sensor is shielded by a lens frame of the lens, so that the light sensor shielded by the lens frame is invisible to a wearing object of the head-mounted display device; acquiring a preset light brightness threshold value; the preset light brightness threshold value is set correspondingly according to the light brightness acquired when the head-mounted display equipment is correctly worn according to the fact that the light sensor is in the test mode; and determining the wearing state of the wearing object on the head-mounted display equipment according to the comparison result of the light brightness and the light brightness threshold value. The light sensor arranged inside the head-mounted display equipment cannot be seen by a wearing object, so that the detection precision of the wearing state detection method of the head-mounted display equipment is improved.

Description

Wearing state detection method, device, equipment and medium for head-mounted display equipment
Technical Field
The present disclosure relates to the field of head-mounted display devices, and in particular, to a method and an apparatus for detecting a wearing state of a head-mounted display device, and a storage medium.
Background
With the development of VR (virtual reality) technology, VR technology has become a part of daily work and life, and among them, there are a plurality of methods for using a head-mounted display device as an important implementation carrier of VR technology. For example, the examination can be completed through the head-mounted display device, the examinee only needs to get the head-mounted display device for examination before the examination, in the examination process, the examinee only needs to wear the head-mounted display device, the examination questions uniformly issued by the server for managing the examination questions can be checked through the head-mounted display device, the examination questions can be answered through the corresponding device, and the answering information can be transmitted to the server through the head-mounted display device to be scored after the examinee finishes answering.
At present, the head-mounted display equipment for examination needs to sense information such as light brightness of the head-mounted display equipment through a light sensor, and when the light brightness meets certain requirements, the examinee is judged to wear glasses, and then the examination questions sent by an examination server are displayed. However, the light sensor is generally exposed on the surface of the head-mounted display device, for example, an opening is used for sensing the introduced light, but this is easy for the examinee to perceive the position of the light sensor and adopt a corresponding cheating means, for example, the opening is sealed by adhesive paper so that the light sensor cannot sense the light and the examinee can judge that the glasses are worn, which results in low detection precision of the wearing state of the head-mounted display device by this technology.
Disclosure of Invention
In view of the above, it is necessary to provide a method and an apparatus for detecting a wearing state of a head-mounted display device, and a storage medium, in order to solve the above technical problems.
A wearing state detection method of a head-mounted display device is applied to the head-mounted display device and comprises the following steps:
acquiring the brightness of light collected by a light sensor arranged in the head-mounted display device through a lens of the head-mounted display device; the light sensor is shielded by a lens frame of the lens, so that the light sensor shielded by the lens frame is invisible to a wearing object of the head-mounted display device;
acquiring a preset light brightness threshold value; the preset light brightness threshold value is set correspondingly according to the light brightness acquired when the head-mounted display equipment is correctly worn according to the fact that the light sensor is in the test mode;
and determining the wearing state of the wearing object on the head-mounted display equipment according to the comparison result of the light brightness and the light brightness threshold value.
In one embodiment, the light brightness threshold comprises: a first light brightness threshold and a second light brightness threshold; the first light brightness threshold is less than the second light brightness threshold; the determining the wearing state of the wearing object on the head-mounted display device according to the comparison result of the light brightness and the light brightness threshold value comprises: if the light brightness is smaller than the first light brightness threshold value, determining that the wearing state is correct wearing; if the light brightness is larger than the first light brightness threshold and smaller than the second light brightness threshold, determining that the wearing state is not correctly worn; if the light brightness is larger than the second light brightness threshold value, determining that the wearing state is not worn; the method further comprises the following steps: and if the wearing state is incorrect wearing, indicating the wearing object to adjust the wearing state of the head-mounted display equipment until the wearing object is determined to correctly wear the head-mounted display equipment.
In one embodiment, the number of the light sensors is multiple; the determining the wearing state of the wearing object on the head-mounted display device according to the comparison result of the light brightness and the light brightness threshold value comprises: respectively acquiring the light brightness collected by each light sensor; and determining the wearing state of the wearing object on the head-mounted display equipment according to the comparison result of the light brightness acquired by each light sensor and the light brightness threshold value.
In one embodiment, the determining the wearing state of the wearing object on the head-mounted display device according to the comparison result between the light brightness acquired by each light sensor and the light brightness threshold includes: and if the maximum value of the light brightness acquired by each light sensor is smaller than the light brightness threshold value, determining that the wearing state is correct wearing.
In one embodiment, the determining the wearing state of the wearing object on the head-mounted display device according to the comparison result between the light brightness acquired by each light sensor and the light brightness threshold includes: forming a light brightness sequence according to the light brightness collected by each light sensor; obtaining light brightness threshold values corresponding to the light sensors based on the brightness threshold values to form reference light brightness sequences corresponding to the light brightness threshold values; and determining the wearing state of the wearing object on the head-mounted display equipment according to the comparison result of the light brightness sequence and the reference light brightness sequence.
In one embodiment, the method further comprises: acquiring abnormal wearing times of the head-mounted display equipment in a preset time period; the abnormal wearing times are times that the wearing object does not correctly wear the head-mounted display equipment; and determining the working mode of the head-mounted display equipment according to the comparison result of the abnormal wearing times and a preset abnormal wearing time threshold.
In one embodiment, the abnormal wearing time threshold includes: a first abnormal wearing time threshold value, a second abnormal wearing time threshold value and a third abnormal wearing time threshold value; wherein the first abnormal wearing time threshold is smaller than the second abnormal wearing time threshold, and the second abnormal wearing time threshold is smaller than the third abnormal wearing time threshold; the determining the working mode of the head-mounted display device according to the comparison result of the abnormal wearing times and the preset abnormal wearing time threshold value includes: if the abnormal wearing times are smaller than the first abnormal wearing time threshold value, determining that the working mode of the head-mounted display equipment is a passive detection mode; the passive detection mode is a working mode in which the head-mounted display device passively detects a light leakage condition of the head-mounted display device; if the abnormal wearing times are larger than the first abnormal wearing time threshold and smaller than the second abnormal wearing time threshold, determining that the working mode of the head-mounted display equipment is the working mode of the active detection mode; the active detection mode is a working mode in which the head-mounted display device actively detects a light leakage condition of the head-mounted display device; if the abnormal wearing times are larger than the second abnormal wearing time threshold value, determining that the working mode of the head-mounted display equipment is a real-time detection mode; the real-time detection mode is that the head-mounted display equipment detects the light leakage condition of the head-mounted display equipment in real time; if the abnormal wearing times is larger than the third abnormal wearing time threshold value, uploading the abnormal wearing times and the wearing state to a server, so that the server feeds back an alarm instruction to the head-mounted display equipment according to the abnormal wearing times and the wearing state.
A wearing state detection apparatus of a head-mounted display device, the apparatus comprising:
the light brightness acquisition module is used for acquiring the light brightness acquired by a light sensor arranged in the head-mounted display device through a lens of the head-mounted display device; the light sensor is shielded by a lens frame of the lens, so that the light sensor shielded by the lens frame is invisible to a wearing object of the head-mounted display device;
the brightness threshold value acquisition module is used for acquiring a preset light brightness threshold value; the preset light brightness threshold value is set correspondingly according to the light brightness acquired when the head-mounted display equipment is correctly worn according to the fact that the light sensor is in the test mode;
and the wearing state determining module is used for determining the wearing state of the wearing object on the head-mounted display equipment according to the comparison result of the light brightness and the light brightness threshold.
A head-mounted display device comprising a memory having a computer program stored therein and a processor implementing the steps of the method when executing the computer program.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method.
The wearing state detection method and device for the head-mounted display equipment, the head-mounted display equipment and the storage medium acquire the brightness of light collected by a light sensor arranged in the head-mounted display equipment through a lens of the head-mounted display equipment; the light sensor is shielded by a lens frame of the lens, so that the light sensor shielded by the lens frame is invisible to a wearing object of the head-mounted display device; acquiring a preset light brightness threshold value; the preset light brightness threshold value is set correspondingly according to the light brightness acquired when the head-mounted display equipment is correctly worn according to the fact that the light sensor is in the test mode; and determining the wearing state of the wearing object on the head-mounted display equipment according to the comparison result of the light brightness and the light brightness threshold value. This application shelters from light sensor through head-mounted display device lens frame for wear the object and can't see and locate the inside light sensor of head-mounted display device, with the accurate detection of avoiding wearing the object and taking corresponding means to disturb head-mounted display device's wearing state, thereby improve head-mounted display device's wearing state detection method's detection precision.
Drawings
Fig. 1 is an application environment diagram of a method for detecting a wearing state of a head-mounted display device according to an embodiment;
FIG. 2 is a flowchart illustrating a method for detecting a wearing state of a head-mounted display device according to an embodiment;
FIG. 3 is a schematic diagram of a head mounted display device in one embodiment;
FIG. 4 is a schematic diagram illustrating a process of determining a wearing state of a head-mounted display device by a wearing object according to a comparison result between light brightness and a light brightness threshold in an embodiment;
FIG. 5 is a flow diagram illustrating the determination of an operating mode of a head mounted display device in one embodiment;
fig. 6 is a schematic flowchart of a wearing state detection method of a head-mounted display device in another embodiment;
FIG. 7 is a block diagram showing a structure of a wearing state detecting apparatus of a head-mounted display device according to an embodiment;
FIG. 8 is an internal block diagram of a head mounted display device in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The wearing state detection method of the head-mounted display equipment can be applied to the application environment shown in fig. 1. The head-mounted display device 101 may be VR glasses used by an examinee to perform an examination, and the server 102 may be an examination server storing examination information such as examination question information and examinee identity information. Head mounted display device 101 may communicate with server 102 over a network. Specifically, before the examination, the head-mounted display device 101 needs to detect the wearing state of the examinee on the head-mounted display device 101, and when the wearing state is that the examinee correctly wears the head-mounted display device 101, the head-mounted display device 101 may feed back the wearing state information to the server 102, so that the server 102 sends the examination question information to the head-mounted display device 101 for display. The server 102 may be implemented as a stand-alone server or a server cluster composed of a plurality of servers.
In an embodiment, as shown in fig. 2, a wearing state detection method for a head-mounted display device is provided, which is described by taking the method as an example applied to the head-mounted display device 101 in fig. 1, and the structure of the head-mounted display device 101 may be as shown in fig. 3, including the following steps:
step S201, the head-mounted display apparatus 101 obtains the brightness of light collected by a light sensor disposed inside the head-mounted display apparatus through a lens of the head-mounted display apparatus; the light sensor is blocked by the lens frame of the lens, so that the light sensor blocked by the lens frame is invisible to a wearing object of the head-mounted display device 101.
Specifically, the head-mounted display device 101 may include a light sensor 301, a lens 302 and a lens frame 303, wherein the lens frame 303 is used for supporting the lens 302 and shielding the light sensor 301 disposed inside the head-mounted display device 101, and the lens 302 may transmit light, so that the light sensor 301 may measure the brightness of the light according to the light transmitted by the lens 302. The head-mounted display device 101 may obtain the brightness of the light transmitted by the lens 302 through the light sensor 301, and the light sensor 301 may be shielded by the lens frame 303, so that the wearing object of the head-mounted display device 101 cannot view the specific installation position of the light sensor 301.
Step S202, the head-mounted display device 101 obtains a preset light brightness threshold value; the preset light brightness threshold value is set correspondingly according to the light brightness acquired when the head-mounted display device is correctly worn according to the fact that the light sensor 301 is in the test mode.
The light brightness threshold may be the light brightness measured by the light sensor 301 when the head-mounted display device 101 is worn correctly. Specifically, for example, a general examination organization for scheduling an examination may schedule a tester to wear the head-mounted display device 101, and when the tester wears the head-mounted display device 101 correctly, may record the brightness of the light collected by the light sensor 301 at that time, and set the brightness of the light as a light brightness threshold.
In step S203, the head-mounted display apparatus 101 determines the wearing state of the wearing object on the head-mounted display apparatus 101 according to the comparison result between the light brightness and the light brightness threshold.
After the current light brightness is obtained by the light sensor 301 in the head-mounted display device 101 in step S201, the current light brightness may be compared with the light brightness threshold preset in step S202, and a corresponding comparison result is obtained, so that the head-mounted display device 101 may determine the wearing state of the wearing object on the head-mounted display device 101 according to the comparison result.
In the method for detecting the wearing state of the head-mounted display device, the head-mounted display device 101 acquires the brightness of light collected by the light sensor 301 arranged inside the head-mounted display device 101 through the lens 302 of the head-mounted display device 101; the light sensor is shielded by the lens frame 303 of the lens 302, so that the light sensor 301 shielded by the lens frame 303 is invisible to a wearing object of the head-mounted display device 101; acquiring a preset light brightness threshold value; the preset light brightness threshold value is set correspondingly according to the light brightness acquired when the head-mounted display device 101 is correctly worn according to the fact that the light sensor 301 is in the test mode; the wearing state of the wearing object on the head-mounted display apparatus 101 is determined according to the comparison result of the light brightness and the light brightness threshold. The optical line sensor 301 is shielded by the lens frame 303 of the head-mounted display device 101, so that the optical line sensor 301 arranged inside the head-mounted display device 101 cannot be seen by a wearing object, accurate detection that the wearing state of the head-mounted display device 101 is interfered by the wearing object by adopting corresponding means is avoided, and the detection precision of the wearing state detection method of the head-mounted display device 101 is improved.
In one embodiment, the light brightness threshold may include: a first light brightness threshold and a second light brightness threshold; the first light brightness threshold value is smaller than the second light brightness threshold value; step S203 may further include: if the light brightness is smaller than the first light brightness threshold, the head-mounted display device 101 determines that the wearing state is correct wearing; if the light brightness is greater than the first light brightness threshold and less than the second light brightness threshold, the head-mounted display device 101 determines that the wearing state is incorrect wearing; if the light brightness is greater than the second light brightness threshold, the head-mounted display device 101 determines that the wearing state is not wearing.
Wherein the light brightness threshold may include: first light luminance threshold value and second light luminance threshold value are used for judging whether wearing personnel accurately wears head mounted display device 101 and whether judging wearing personnel wears head mounted display device 101 respectively, wherein, when wearing personnel accurately wears head mounted display device 101, the light luminance that light sensor 301 gathered can be less than the light luminance that wearing personnel did not accurately wear head mounted display device 101, consequently, can be through setting up the mode of first light luminance threshold value and the second light luminance threshold value that is greater than first light luminance threshold value, detect respectively whether wearing personnel accurately wears head mounted display device 101 and whether wearing personnel wears head mounted display device 101.
Specifically, if the light brightness measured by the light sensor 301 is smaller than the first light brightness threshold, the head-mounted display device 101 determines that the current wearing state is that the head-mounted display device 101 is worn correctly; if the light brightness measured by the light sensor 301 is greater than the first light brightness threshold and less than the second light brightness threshold, the head-mounted display device 101 determines that the current wearing state is that the head-mounted display device 101 is worn but not worn correctly; if the light brightness measured by the light sensor 301 is greater than the second light brightness threshold, the head-mounted display device 101 determines that the current wearing state is that the head-mounted display device 101 is not worn.
For example: the first light brightness threshold value may be set to be 0.05cd, the second light brightness threshold value may be set to be 0.1cd, if the light brightness obtained by the head-mounted display device 101 at this time is 0.04cd, and at this time, the light brightness is smaller than the first light brightness threshold value, so that the head-mounted display device 101 may determine that the wearing state of the current wearing object on the head-mounted display device 101 is correct wearing, and if the light brightness obtained by the head-mounted display device 101 at this time is 0.08cd and is between the first light brightness threshold value and the second light brightness threshold value, the head-mounted display device 101 at this time determines that the wearing state of the current wearing object on the head-mounted display device 101 is incorrect wearing.
Further, the method for detecting the wearing state of the head-mounted display device may further include: if the wearing state is not correctly worn, the head-mounted display device 101 instructs the wearing subject to adjust the wearing state of the head-mounted display device until it is determined that the wearing subject correctly wears the head-mounted display device.
Further, when the head-mounted display device 101 detects that the current wearing subject does not correctly wear the head-mounted display device 101, the wearing subject may be instructed to adjust the wearing state of the head-mounted display device 101 until it is determined that the wearing subject correctly wears the head-mounted display device. For example: when the light sensor 301 of the head-mounted display device 101 detects that the current light brightness is greater than the first light brightness threshold and less than the second light brightness threshold, the wearing mode of the head-mounted display device 101 can be correspondingly adjusted by reminding the wearing object through the preset voice message until the light brightness measured by the light sensor 301 is less than the first light brightness threshold, that is, the wearing object correctly wears the head-mounted display device 101.
In the above embodiment, by setting the first light brightness threshold and the second light brightness threshold, where the first light brightness threshold is smaller than the second light brightness threshold, the head-mounted display device 101 may detect that the wearing state is correct wearing, and may also detect that the wearing state is incorrect wearing and the wearing state is not wearing. In addition, when the head-mounted display device 101 is not worn correctly, the wearing object may also be instructed to adjust the wearing state to ensure that the wearing object can wear the head-mounted display device 101 correctly.
In order to further improve the accuracy of the detection of the wearing state of the head-mounted display device 101, in an embodiment, the number of the light sensors 301 may be multiple, as shown in fig. 4, and the step S203 may further include:
in step S401, the head-mounted display device 101 respectively obtains the brightness of the light collected by each light sensor 301.
The number of the light sensors 301 may be more than one, the installation positions of the light sensors are different, and each light sensor 301 collects the light brightness respectively, so that the head-mounted display device 101 can obtain multiple sets of light intensities.
In step S402, the head-mounted display apparatus 101 determines the wearing state of the head-mounted display apparatus by the wearing object according to the comparison result between the light brightness collected by each light sensor 301 and the light brightness threshold.
After obtaining a plurality of current light brightness values through each light sensor 301 in the head-mounted display device 101 in step S401, the current light brightness values may be compared with a preset light brightness threshold value, and a corresponding comparison result is obtained, so that the head-mounted display device 101 may determine the wearing state of the wearing object on the head-mounted display device 101 according to the comparison result.
Further, step S402 may include: if the maximum value of the light brightness collected by each light sensor 301 is smaller than the light brightness threshold, the head-mounted display device 101 determines that the wearing state is correct wearing.
Because the light brightness collected by the light sensors 301 is different, the head-mounted display device 101 may select a maximum value of the light brightness from the plurality of light brightnesses collected by the light sensors 301, and compare the maximum value of the light brightness with a light brightness threshold value, if the maximum value of the light brightness collected by the light sensors 301 is smaller than a preset light brightness threshold value, the head-mounted display device 101 may determine that the wearing state is correctly worn.
In addition, step S402 may further include: the head-mounted display device 101 forms a light brightness sequence according to the light brightness collected by each light sensor 301; obtaining light brightness thresholds corresponding to the light sensors based on the brightness thresholds to form a reference light brightness sequence corresponding to the light brightness thresholds; and determining the wearing state of the wearing object on the head-mounted display equipment according to the comparison result of the light brightness sequence and the reference light brightness sequence.
The light brightness sequence is a brightness sequence formed by a plurality of light brightnesses acquired by the plurality of light sensors 301, and the reference light brightness sequence is a brightness sequence formed by brightness thresholds preset by the different plurality of light sensors 301. For example: the light sensor 301 may include a sensor a, a sensor B, and a sensor C, and due to different installation positions of the sensor a, the sensor B, and the sensor C, under the condition that the head-mounted display device 101 is correctly worn, the light luminance thresholds corresponding to the sensor a, the sensor B, and the sensor C, for example, 0.05cd, 0.04cd, and 0.06cd, respectively, may be obtained through testing, that is, a reference light luminance sequence of 0.05cd, 0.04cd, and 0.06cd is formed. At this time, when the wearing subject wears the head-mounted display device 101, the current light luminance thresholds corresponding to the sensor a, the sensor B, and the sensor C may be 0.03cd, 0.07cd, and 0.1cd, respectively, due to inaccurate wearing manner, and the light luminance sequences formed at this time are 0.03cd, 0.07cd, and 0.1 cd. At this time, the head-mounted display device 101 may determine the wearing state of the current wearing object on the head-mounted display device 101 according to the comparison result of the current light brightness sequence and the reference light brightness sequence, for example, the wearing state at this time is not accurately worn, and may further determine a more specific wearing state according to a difference in the sequences, for example, the sensor a is installed above the head-mounted display device 101, the sensor B is installed in a middle position of the head-mounted display device 101, and the sensor C is installed below the head-mounted display device 101, so that the wearing state of the current wearing object on the head-mounted display device 101 may be generally determined as being a wearing position higher.
On this basis, the head-mounted display device 101 may further instruct the wearing subject to adjust the wearing state of the head-mounted display device 101 according to the comparison result between the current light brightness sequence and the reference light brightness sequence. Specifically, in the process of obtaining the reference light brightness sequence, the tester may wear the head-mounted display device 101 according to different modes, including the reference light brightness sequence a obtained when the tester is worn correctly, the reference light brightness sequence B generated when the tester is worn at an upper position, and the reference light brightness sequence C generated when the tester is worn at a lower position, and store the reference light brightness sequences in the head-mounted display device 101. In an actual use process, the head-mounted display device 101 may compare the currently acquired light brightness sequence with multiple reference light brightness sequences, determine which reference light brightness sequence is specifically close to, and obtain a wearing state of the current wearing object on the head-mounted display device 101. For example, if the light brightness sequence obtained at this time is similar to the reference light brightness sequence B, then the wearing state of the head-mounted display device 101 at this time is on the upper side of the wearing position, and therefore, for this situation, the head-mounted display device 101 may play preset voice information to remind the wearing subject to adjust the wearing position of the head-mounted display device 101 downward, and if the light brightness sequence obtained at this time is similar to the reference light brightness sequence C, then the wearing subject may be reminded to adjust the wearing position of the head-mounted display device 101 upward.
In this embodiment, through setting up a plurality of light sensors 301 to head mounted display device 101, and select the light luminance maximum value of gathering and compare with the light luminance threshold value, can improve the accuracy of detection, still through the mode that sets up the light luminance sequence, compare with reference light luminance sequence, can obtain the wearing state of wearing the object to head mounted display device 101 of more accuracy, in addition, still can be according to the contrast result with reference light luminance sequence, make head mounted display device 101 suggestion wear the object and adjust the wearing state, further guarantee to wear that the object can correctly wear head mounted display device 101.
In one embodiment, as shown in fig. 5, the method for detecting the wearing state of the head-mounted display device may further include the steps of:
step 501, the head-mounted display device 101 acquires abnormal wearing times of the head-mounted display device 101 in a preset time period; the number of abnormal wearing times is the number of times that the wearing object is not correctly worn on the head mounted display device 101;
step S502, determining the working mode of the head-mounted display device 101 according to the comparison result between the abnormal wearing times and the preset abnormal wearing times threshold.
Here, the number of abnormal wearing times refers to the number of times the wearing object is not correctly worn on the head mounted display apparatus 101, for example: during the process of taking an examination using the head-mounted display device 101, the examinee touches the head-mounted display device 101 with a hand or has a different wearing state of the head-mounted display device 101 due to the occurrence of some facial expressions compared with the previous wearing state, thereby causing light leakage of the head-mounted display device 101. Accordingly, the head mounted display device 101 may include an operational mode for detecting whether a light leakage situation exists. Specifically, the head-mounted display apparatus 101 acquires the number of abnormal wearing times of the head-mounted display apparatus 101 in a preset time period, and determines the operation mode of the head-mounted display apparatus 101 based on the comparison result of the number of abnormal wearing times and a preset threshold value of the number of abnormal wearing times.
Specifically, the abnormal wearing number threshold may include: a first abnormal wearing time threshold value, a second abnormal wearing time threshold value and a third abnormal wearing time threshold value; the first abnormal wearing time threshold is smaller than the second abnormal wearing time threshold, and the second abnormal wearing time threshold is smaller than the third abnormal wearing time threshold; step S502 may further include: if the abnormal wearing times are smaller than the first abnormal wearing time threshold value, determining that the working mode of the head-mounted display device 101 is a passive detection mode; the passive detection mode is a working mode in which the head-mounted display device 101 passively detects a light leakage situation of the head-mounted display device 101; if the abnormal wearing times are larger than the first abnormal wearing time threshold and smaller than the second abnormal wearing time threshold, determining that the working mode of the head-mounted display device 101 is an active detection mode; the active detection mode is a working mode in which the head-mounted display device 101 actively detects the light leakage condition of the head-mounted display device 101; if the abnormal wearing times is larger than the second abnormal wearing time threshold, determining that the working mode of the head-mounted display device 101 is a real-time detection mode; the real-time detection mode is a working mode in which the head-mounted display device 101 detects the light leakage condition of the head-mounted display device 101 in real time; if the abnormal wearing times is larger than the third abnormal wearing time threshold, the head-mounted display device 101 uploads the abnormal wearing times and the wearing state to the server 102, so that the server 102 feeds back an alarm instruction to the head-mounted display device 101 according to the abnormal wearing times and the wearing state.
The abnormal wearing time threshold may include a first abnormal wearing time threshold, a second abnormal wearing time threshold, and a third abnormal wearing time threshold, where the first abnormal wearing time threshold is smaller than the second abnormal wearing time threshold, and the second abnormal wearing time threshold is smaller than the third abnormal wearing time threshold. At this time, if the abnormal wearing times of the head mounted display apparatus 101 in the preset time period is less than the first abnormal wearing times threshold, the head mounted display apparatus 101 is in an operation mode for passively detecting the light leakage condition, and the light leakage condition is detected by the head mounted display apparatus 101 when the occurrence of the shake is detected in the passive detection mode. And with the increase of the abnormal wearing times within the preset time period, until the abnormal wearing times is greater than the first abnormal wearing time threshold, the head-mounted display device 101 may switch from the passive detection mode for passively detecting the light leakage condition to the active detection mode for actively detecting the light leakage condition, and in the active detection mode, the head-mounted display device 101 may actively detect the light leakage condition at random time or at set time intervals. And if the wearing object wears the head-mounted display device 101 abnormally frequently and is larger than the second abnormal wearing time threshold value, the head-mounted display device 101 is switched to the real-time detection mode, and in the process of the real-time detection mode, the head-mounted display device 101 prompts the wearing object to monitor whether the wearing object causes the light leakage of the head-mounted display device 101 or not continuously within a certain time period.
In addition, if in the real-time detection mode, abnormal wearing of the head-mounted display device 101 by the wearing object still occurs, and the abnormal wearing number is larger than the third abnormal wearing number threshold, the head-mounted display device 101 uploads the abnormal wearing number and the wearing state of the wearing object on the head-mounted display device 101 to the server 102, and the server 102 can decide the wearing state of the head-mounted display device 101 according to the abnormal wearing number and the wearing object, and generates a corresponding warning instruction to return to the head-mounted display device 101, for example: in the process of taking an examination by using the head-mounted display device 101, when the head-mounted display device 101 is in a real-time detection mode, the examinee is in an abnormal wearing state for many times, so that the light leakage of the head-mounted display device 101 is caused, the head-mounted display device 101 can upload the abnormal wearing times and the abnormal wearing state of the examinee to an examination server, the examination server can adjudicate the examinee, alarm information is generated and returned to the head-mounted display device 101, and the alarm information can be examination stopping information generated by the server 102 judging cheating of the examinee.
In the above embodiment, the head-mounted display device 101 may adjust the working mode of detecting the light leakage condition according to the abnormal wearing times of the wearing object on the head-mounted display device 101 within a certain time, and if the abnormal wearing times are too many, the abnormal wearing times and the abnormal wearing state may be uploaded to the server 102, and the server 102 decides to return the corresponding warning information, so as to further improve the accuracy of detecting the wearing state of the head-mounted display device 101.
In one embodiment, as shown in fig. 6, a wearing state detection method for a head-mounted display device is provided, which is described by taking the method as an example applied to the head-mounted display device 101 in fig. 1, and includes the following steps:
step S601, the head-mounted display apparatus 101 acquires brightness of light collected by a plurality of light sensors disposed inside the head-mounted display apparatus 101 through a lens of the head-mounted display apparatus; the light sensor is shielded by a lens frame of the lens, so that the light sensor shielded by the lens frame is invisible to a wearing object of the head-mounted display device;
step S602, the head-mounted display device 101 respectively obtains the light brightness collected by each light sensor to form a light brightness sequence;
step S603, the head-mounted display device 101 obtains a preset light brightness threshold; the preset light brightness threshold value is set correspondingly according to the light brightness acquired when the head-mounted display device 101 is correctly worn according to the fact that the light sensor is in the test mode;
step S604, based on the brightness threshold, the head-mounted display device 101 obtains the light brightness threshold corresponding to each light sensor, and forms a reference light brightness sequence corresponding to the light brightness threshold; the wearing state of the wearing subject on the head-mounted display device 101 is determined based on the comparison result of the light luminance sequence and the reference light luminance sequence.
In the above embodiment, the optical sensor is shielded by the lens frame of the head-mounted display device 101, so that the light sensor arranged inside the head-mounted display device 101 cannot be seen by the wearing object, and the wearing object is prevented from interfering with accurate detection of the wearing state of the head-mounted display device 101 by adopting a corresponding means, thereby improving the detection precision of the wearing state detection method of the head-mounted display device 101. In addition, the collected maximum light brightness value is selected to be compared with the light brightness threshold value, so that the detection accuracy can be improved, and the mode of setting the light brightness sequence is compared with the reference light brightness sequence, so that the wearing state of the wearing object on the head-mounted display device 101 can be obtained more accurately.
In an application example, a VR glasses-based examination method is provided, and the method specifically includes the following steps:
step s1, before the examination, the examinee may go to an official or official authority such as an evaluation center to obtain VR glasses, which are mainly used to display the examination questions in the virtual reality scene during the examination, and the examinee may answer the examination questions displayed in the virtual reality scene through the VR glasses. When the VR glasses are picked up, the relevant identity information of the examinee can be registered, for example, the biological characteristic information of the examinee, such as fingerprints, voiceprints, face images, irises and the like, is recorded, and the biological characteristic information can be used for identifying the identity of the examinee in the examination process. This kind of mode of adopting VR glasses to carry out unified examination need not to concentrate examinee to unified examination place in the middle of, and examinee utilizes VR glasses networking at home separately can carry out unified examination.
Step s 2: after the examinee receives the VR glasses and registers the relevant biological characteristics, the examinee can receive the VR glasses home according to the examination information, the examinee can test whether the VR glasses can normally display examination questions in advance, the VR glasses can enter a test mode before the examination and display an examination question template to enable the examinee to perform operation test, the examinee can test the operations of next questions, previous questions, change answering information, submit answering information and the like, after the test is finished, the examinee can confirm that the VR glasses can be normally used, and then the VR glasses can actively send the confirmation information passing the test to an examination server.
Step s 3: after the examination is finished, the VR glasses can further detect whether the VR glasses are in a normal working state, such as whether the electric quantity is sufficient or not, after the detection is finished, the VR glasses can automatically send confirmation information that the working state of the VR glasses is normal to the examination server, then the examination server sends relevant pre-examination information (including examination notes and examinee personal information) to the VR glasses, the VR glasses receive the pre-examination information and detect the wearing state of the VR glasses of the examinee, after the VR glasses are worn by the examinee, the VR glasses can confirm the identity of the examinee by collecting biological characteristic information such as the iris of the examinee, and after the identity is confirmed, the VR glasses can show the examination notes and the examinee personal information, after the examinee confirms that the examinee information is correct, the VR glasses wait for the examination server to send examination questions and display the examination questions when the examination begins.
Wherein, VR glasses detect examinee's wearing state, carry out the detection through locating the inside optical line sensors of VR glasses, the inside optical line sensors of VR glasses should be located can be sheltered from by the baffle of VR glasses, and do not expose on VR glasses with the mode of through-hole, optical line sensors can receive light through two lenses of VR glasses to judge whether examinee wears and whether worn VR glasses as required according to the leading-in light brightness of these two lenses. VR glasses can set up a plurality of light luminance threshold values, every threshold value corresponds different wearing state, this luminance threshold value can be set up to at least two, one of them can judge whether examinee has worn VR glasses, if worn VR glasses, then light luminance that light sensor received from two lenses of VR glasses can be less than certain luminance threshold value, and if this light luminance is further less than second light threshold value, then can judge that examinee has accurately worn VR glasses as required, VR glasses do not have the light leak this moment, examinee can't see the object outside VR glasses through modes such as strabismus promptly.
Further, can also set up a plurality of light sensor respectively around two lenses, judge whether the examinee wears and whether worn VR glasses as required according to the light luminance that a plurality of light sensor gathered, for example can get the light luminance maximum value that this a plurality of light sensor gathered and judge whether the examinee has worn VR glasses as required to improve the accuracy that detects. In addition, the plurality of light sensors can also form a plurality of detection result modes aiming at the light brightness value, the detection result modes are aiming at the current wearing state of the examinee, the light brightness detected by each light sensor can form a light brightness sequence, the light brightness sequence can be used as the current detection result mode, and according to the current detection result mode, the VR glasses can judge whether the VR glasses are worn accurately or not. Specifically, the VR glasses may be configured with a plurality of pre-made detection result patterns, where the detection result patterns are detection result patterns formed by each light sensor when a designated worker wears the VR glasses in a plurality of different manners, for example, the worker may wear the VR glasses accurately as required, each light sensor forms a detection result pattern a, forms a detection result pattern B in a manner of slightly leaking light, and so on, to obtain a plurality of detection result models, and use the detection result patterns as reference detection result patterns of the VR glasses for light. Based on this, before the examination begins, VR glasses can sense the present test result mode that corresponds when examinee wears this VR glasses through this a plurality of optical line sensors, then compare this present test result mode with the reference test result mode that presets, whether the examinee accurately wears according to the suggestion of comparison result, can also further according to the suggestion examinee of comparison result how correctly wears VR glasses, until the examinee accords with the requirement to wearing of VR glasses, the VR glasses just can show the examination question, further improve the accuracy of testing result and avoid leading to the examinee to have the possibility of cheating because of the light leak.
In addition, the college entrance examination mechanism can also guide the examinee how to correctly wear the VR glasses when the examinee gets the VR glasses. Therefore, when the wearing state of the VR glasses is tested by an examinee, the VR glasses can prompt the examinee how to adjust the wearing mode of the VR glasses based on the real-time wearing state and the reference detection result mode, and prompt information capable of guiding the examinee to correctly wear the VR glasses is recorded, so that the examinee can be guided to correctly wear the VR glasses in the examination process.
The VR glasses can also detect whether examinees accurately wear the VR glasses through the light sensor in the examination process, because the examinees can touch the VR glasses with hands in the examination process or the wearing states of the examinees to the VR glasses are different from the previous wearing states due to the occurrence of facial expressions, and VR glasses light leakage can exist under the circumstance. To this, VR glasses can detect whether the shake of certain degree takes place for VR glasses, detects the VR glasses passively when taking place the shake and whether there is the condition of light leak at the VR glasses. In addition, the VR glasses can actively detect whether the VR glasses have light leakage or not in the examination process according to a random time or a set time interval, and the detection mode is similar to the aforementioned mode. In some cases, for example, the VR glasses judge that the examinee often causes the VR glasses to leak light during the examination, the VR glasses can start the real-time detection mode and prompt the examinee to continuously monitor whether the examinee causes the VR glasses to leak light during the examination by using the VR glasses within a certain time period, if the examination continues for a plurality of times in the period of time to cause the VR glasses to leak light, the light leakage statistical information obtained by statistics in the examination period of time can be sent to the examination server, the examination server determines whether the examinee needs to decide to cheat, if the examination server judges that the examinee cheats, the examination can be terminated directly, if the examination server does not judge that the examinee cheats, the examination server sends a related instruction to the VR glasses to instruct the VR glasses to continuously monitor whether light leakage exists or not within a certain time period, and if yes, the examination server can judge whether cheating exists or not again; if not, the VR glasses may change the continuous monitoring mode to passive monitoring triggered by shaking or active monitoring randomly for a certain period of time until the examinee confirms that the answer is complete or the examination time is over.
Step s 4: and finally, when the examinee finishes answering within the limited examination time or finishes the examination, the VR glasses confirm the submitted answering information, and the VR glasses send the answering information and the light leakage statistical information obtained by statistics within the answering time of the examinee to the examination server.
In the above application example, the light sensor is hidden inside the VR glasses, so that the light sensor is not exposed at the surface position of the VR glasses, and thus, the examinee cannot find the installation position of the light sensor, further, different VR glasses can be used for the light sensor at different positions, and the VR glasses can be further limited to be judged to be cheated when the VR glasses have risks of being detached.
It should be understood that although the various steps in the flow charts of fig. 2-6 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2-6 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed in turn or alternately with other steps or at least some of the other steps.
In one embodiment, as shown in fig. 7, there is provided a wearing state detection apparatus of a head-mounted display device, including: a light brightness obtaining module 701, a brightness threshold obtaining module 702, and a wearing state determining module 703, wherein:
a light brightness obtaining module 701, configured to obtain light brightness collected by a light sensor disposed inside the head-mounted display device through a lens of the head-mounted display device; the light sensor is shielded by a lens frame of the lens, so that the light sensor shielded by the lens frame is invisible to a wearing object of the head-mounted display device;
a brightness threshold obtaining module 702, configured to obtain a preset light brightness threshold; the preset light brightness threshold value is set correspondingly according to the light brightness acquired when the head-mounted display equipment is correctly worn according to the fact that the light sensor is in the test mode;
the wearing state determining module 703 is configured to determine a wearing state of the head-mounted display device by the wearing object according to a comparison result between the light brightness and the light brightness threshold.
In one embodiment, the light brightness threshold comprises: a first light brightness threshold and a second light brightness threshold; the first light brightness threshold value is smaller than the second light brightness threshold value; the wearing state determining module 703 is further configured to determine that the wearing state is correct wearing if the light brightness is smaller than the first light brightness threshold; if the light brightness is larger than the first light brightness threshold and smaller than the second light brightness threshold, determining that the wearing state is incorrect wearing; and if the light brightness is larger than the second light brightness threshold value, determining that the wearing state is not wearing.
In one embodiment, the wearing state determining module 703 is further configured to instruct the wearing subject to adjust the wearing state of the head-mounted display device if the wearing state is that the head-mounted display device is not worn correctly, until it is determined that the head-mounted display device is worn correctly by the wearing subject.
In one embodiment, the number of the light sensors is plural; the wearing state determining module 703 is further configured to obtain the brightness of the light collected by each light sensor; and determining the wearing state of the wearing object on the head-mounted display equipment according to the comparison result of the light brightness acquired by each light sensor and the light brightness threshold.
In an embodiment, the wearing state determining module 703 is further configured to determine that the wearing state is correct wearing if a maximum value of the light intensities collected by the light sensors is smaller than a light intensity threshold.
In one embodiment, the wearing state determining module 703 is further configured to form a light brightness sequence according to the light brightness acquired by each light sensor; obtaining light brightness thresholds corresponding to the light sensors based on the brightness thresholds to form a reference light brightness sequence corresponding to the light brightness thresholds; and determining the wearing state of the wearing object on the head-mounted display equipment according to the comparison result of the light brightness sequence and the reference light brightness sequence.
In one embodiment, the wearing state detection apparatus of a head-mounted display device further includes: the working mode determining module is used for acquiring the abnormal wearing times of the head-mounted display equipment in a preset time period; the abnormal wearing times are times that the wearing object does not correctly wear the head-mounted display equipment; and determining the working mode of the head-mounted display equipment according to the comparison result of the abnormal wearing times and the preset abnormal wearing time threshold.
In one embodiment, the abnormal wear number threshold includes: a first abnormal wearing time threshold value, a second abnormal wearing time threshold value and a third abnormal wearing time threshold value; the first abnormal wearing time threshold is smaller than the second abnormal wearing time threshold, and the second abnormal wearing time threshold is smaller than the third abnormal wearing time threshold; the working mode determining module is further used for determining that the working mode of the head-mounted display equipment is a passive detection mode if the abnormal wearing times are smaller than the first abnormal wearing time threshold; the passive detection mode is a working mode in which the head-mounted display device passively detects the light leakage condition of the head-mounted display device; if the abnormal wearing times are larger than the first abnormal wearing time threshold and smaller than the second abnormal wearing time threshold, determining that the working mode of the head-mounted display equipment is an active detection mode; the active detection mode is a working mode in which the head-mounted display device actively detects the light leakage condition of the head-mounted display device; if the abnormal wearing times are larger than the second abnormal wearing time threshold value, determining that the working mode of the head-mounted display equipment is a real-time detection mode; the real-time detection mode is a working mode for detecting the light leakage condition of the head-mounted display equipment in real time by the head-mounted display equipment; and if the abnormal wearing times are larger than the third abnormal wearing time threshold value, uploading the abnormal wearing times and the wearing state to a server, so that the server feeds back an alarm instruction to the head-mounted display equipment according to the abnormal wearing times and the wearing state.
For specific limitations of the wearing state detection apparatus of the head-mounted display device, reference may be made to the above limitations on the wearing state detection method of the head-mounted display device, and details are not repeated here. All or part of the modules in the wearing state detection device of the head-mounted display equipment can be realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the head-mounted display device, and can also be stored in a memory in the head-mounted display device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a head-mounted display device is provided, which may be a terminal, and the internal structure thereof may be as shown in fig. 8. The head-mounted display device comprises a processor, a memory, a communication interface, a display screen and an input device which are connected through a system bus. Wherein the processor of the head mounted display device is configured to provide computing and control capabilities. The memory of the head-mounted display device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the head-mounted display device is used for carrying out wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, an operator network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a wearing state detection method of a head-mounted display device. The display screen of the head-mounted display device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the head-mounted display device can be a touch layer covered on the display screen, a button, a track ball or a touch pad arranged on the shell of the head-mounted display device, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the structure shown in fig. 8 is a block diagram of only a portion of the structure relevant to the present application, and does not constitute a limitation of the head mounted display device to which the present application is applied, and a particular head mounted display device may include more or less components than those shown in the drawings, or combine certain components, or have a different arrangement of components.
In one embodiment, there is also provided a head-mounted display device comprising a memory and a processor, the memory having stored therein a computer program, the processor implementing the steps of the above method embodiments when executing the computer program.
In an embodiment, a computer-readable storage medium is provided, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method embodiments.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), for example.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (10)

1. A wearing state detection method of a head-mounted display device is applied to the head-mounted display device, and comprises the following steps:
acquiring the brightness of light collected by a light sensor arranged in the head-mounted display device through a lens of the head-mounted display device; the light sensor is shielded by a lens frame of the lens, so that the light sensor shielded by the lens frame is invisible to a wearing object of the head-mounted display device;
acquiring a preset light brightness threshold value; the preset light brightness threshold value is set correspondingly according to the light brightness acquired when the head-mounted display equipment is correctly worn according to the fact that the light sensor is in the test mode;
and determining the wearing state of the wearing object on the head-mounted display equipment according to the comparison result of the light brightness and the light brightness threshold value.
2. The method of claim 1, wherein the light brightness threshold comprises: a first light brightness threshold and a second light brightness threshold; the first light brightness threshold is less than the second light brightness threshold;
the determining the wearing state of the wearing object on the head-mounted display device according to the comparison result of the light brightness and the light brightness threshold value comprises:
if the light brightness is smaller than the first light brightness threshold value, determining that the wearing state is correct wearing;
if the light brightness is larger than the first light brightness threshold and smaller than the second light brightness threshold, determining that the wearing state is not correctly worn;
if the light brightness is larger than the second light brightness threshold value, determining that the wearing state is not worn;
the method further comprises the following steps:
and if the wearing state is incorrect wearing, indicating the wearing object to adjust the wearing state of the head-mounted display equipment until the wearing object is determined to correctly wear the head-mounted display equipment.
3. The method of claim 1, wherein the number of the light sensors is plural; the determining the wearing state of the wearing object on the head-mounted display device according to the comparison result of the light brightness and the light brightness threshold value comprises:
respectively acquiring the light brightness collected by each light sensor;
and determining the wearing state of the wearing object on the head-mounted display equipment according to the comparison result of the light brightness acquired by each light sensor and the light brightness threshold value.
4. The method according to claim 3, wherein the determining the wearing state of the head-mounted display device by the wearing object according to the comparison result between the light brightness collected by each light sensor and the light brightness threshold value comprises:
and if the maximum value of the light brightness acquired by each light sensor is smaller than the light brightness threshold value, determining that the wearing state is correct wearing.
5. The method according to claim 3, wherein the determining the wearing state of the head-mounted display device by the wearing object according to the comparison result between the light brightness collected by each light sensor and the light brightness threshold value comprises:
forming a light brightness sequence according to the light brightness collected by each light sensor;
obtaining light brightness threshold values corresponding to the light sensors based on the brightness threshold values to form reference light brightness sequences corresponding to the light brightness threshold values;
and determining the wearing state of the wearing object on the head-mounted display equipment according to the comparison result of the light brightness sequence and the reference light brightness sequence.
6. The method of claim 1, further comprising:
acquiring abnormal wearing times of the head-mounted display equipment in a preset time period; the abnormal wearing times are times that the wearing object does not correctly wear the head-mounted display equipment;
and determining the working mode of the head-mounted display equipment according to the comparison result of the abnormal wearing times and a preset abnormal wearing time threshold.
7. The method of claim 6, wherein the threshold number of abnormal wear times comprises: a first abnormal wearing time threshold value, a second abnormal wearing time threshold value and a third abnormal wearing time threshold value; wherein the first abnormal wearing time threshold is smaller than the second abnormal wearing time threshold, and the second abnormal wearing time threshold is smaller than the third abnormal wearing time threshold;
the determining the working mode of the head-mounted display device according to the comparison result of the abnormal wearing times and the preset abnormal wearing time threshold value includes:
if the abnormal wearing times are smaller than the first abnormal wearing time threshold value, determining that the working mode of the head-mounted display equipment is a passive detection mode; the passive detection mode is a working mode in which the head-mounted display device passively detects a light leakage condition of the head-mounted display device;
if the abnormal wearing times are larger than the first abnormal wearing time threshold and smaller than the second abnormal wearing time threshold, determining that the working mode of the head-mounted display equipment is an active detection mode; the active detection mode is a working mode in which the head-mounted display device actively detects a light leakage condition of the head-mounted display device;
if the abnormal wearing times are larger than the second abnormal wearing time threshold value, determining that the working mode of the head-mounted display equipment is a real-time detection mode; the real-time detection mode is a working mode in which the head-mounted display device detects the light leakage condition of the head-mounted display device in real time;
if the abnormal wearing times is larger than the third abnormal wearing time threshold value, uploading the abnormal wearing times and the wearing state to a server, so that the server feeds back an alarm instruction to the head-mounted display equipment according to the abnormal wearing times and the wearing state.
8. A wearing state detection apparatus of a head-mounted display device, characterized in that the apparatus comprises:
the light brightness acquisition module is used for acquiring the light brightness acquired by a light sensor arranged in the head-mounted display device through a lens of the head-mounted display device; the light sensor is shielded by a lens frame of the lens, so that the light sensor shielded by the lens frame is invisible to a wearing object of the head-mounted display device;
the brightness threshold value acquisition module is used for acquiring a preset light brightness threshold value; the preset light brightness threshold value is set correspondingly according to the light brightness acquired when the head-mounted display equipment is correctly worn according to the fact that the light sensor is in the test mode;
and the wearing state determining module is used for determining the wearing state of the wearing object on the head-mounted display equipment according to the comparison result of the light brightness and the light brightness threshold.
9. A head-mounted display device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor realizes the steps of the method according to any of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 7.
CN202010751660.9A 2020-07-30 2020-07-30 Wearing state detection method, device, equipment and medium of head-mounted display equipment Active CN111781656B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010751660.9A CN111781656B (en) 2020-07-30 2020-07-30 Wearing state detection method, device, equipment and medium of head-mounted display equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010751660.9A CN111781656B (en) 2020-07-30 2020-07-30 Wearing state detection method, device, equipment and medium of head-mounted display equipment

Publications (2)

Publication Number Publication Date
CN111781656A true CN111781656A (en) 2020-10-16
CN111781656B CN111781656B (en) 2023-09-15

Family

ID=72766974

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010751660.9A Active CN111781656B (en) 2020-07-30 2020-07-30 Wearing state detection method, device, equipment and medium of head-mounted display equipment

Country Status (1)

Country Link
CN (1) CN111781656B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112164263A (en) * 2020-11-10 2021-01-01 龙岩烟草工业有限责任公司 Answering method and answering system for safety knowledge in tobacco industry
CN112998702A (en) * 2021-04-02 2021-06-22 深圳市齐胜达科技有限公司 Non-contact type human face recognition system and method for measuring heart rate, respiration and body temperature
CN116136611A (en) * 2023-04-17 2023-05-19 浙江口碑网络技术有限公司 Helmet wearing detection method and device, electronic equipment and storage medium

Citations (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11161190A (en) * 1997-11-25 1999-06-18 Seiko Epson Corp Head mounted display device
CN102668578A (en) * 2009-12-11 2012-09-12 夏普株式会社 Image display device, visual aid, and three-dimensional image display system using those
CN104298352A (en) * 2014-09-29 2015-01-21 广东欧珀移动通信有限公司 Wearable equipment working mode control method and system
CN105078437A (en) * 2014-11-14 2015-11-25 黎凯 Wearable human abnormity monitoring and alarming system and working method thereof
CN105654803A (en) * 2016-02-16 2016-06-08 北京励普教育科技有限公司 Head-mounted online examination machine
JP2016116066A (en) * 2014-12-15 2016-06-23 セイコーエプソン株式会社 Display device and control method of display device
US20170123744A1 (en) * 2015-11-02 2017-05-04 Lg Electronics Inc. Tethering type head mounted display and method for controlling the same
JP2017092628A (en) * 2015-11-06 2017-05-25 セイコーエプソン株式会社 Display device and display device control method
CN107370831A (en) * 2017-09-01 2017-11-21 广州励丰文化科技股份有限公司 Show the multiusers interaction realization method and system of equipment based on MR heads
EP3299871A1 (en) * 2016-09-22 2018-03-28 Essilor International A wearing detection module for spectacle frame
CN107907916A (en) * 2017-10-20 2018-04-13 歌尔科技有限公司 A kind of wearing state detection method and device of intelligent wearable device
CN108209864A (en) * 2017-01-22 2018-06-29 深圳市未来健身衣科技有限公司 Body-sensing detection device and body-sensing detection method
CN108337903A (en) * 2018-01-24 2018-07-27 深圳市汇顶科技股份有限公司 A kind of detection method and its detection module, wearable device of wearing state
CN108537704A (en) * 2018-04-17 2018-09-14 深圳市心流科技有限公司 Classroom evaluating method, device and computer readable storage medium
CN108897423A (en) * 2018-06-27 2018-11-27 武汉华工智云科技有限公司 A kind of VR glasses and its online testing anti-cheating method
CN109417593A (en) * 2016-03-30 2019-03-01 富士胶片株式会社 Photographic device, working method, image processing apparatus and image processing method
CN109558574A (en) * 2018-10-16 2019-04-02 广州市南方人力资源评价中心有限公司 A kind of generation online testing examination question processing method
JP2019058324A (en) * 2017-09-26 2019-04-18 株式会社コロプラ Program, information processing device, information processing system, and information processing method
CN109875863A (en) * 2019-03-14 2019-06-14 河海大学常州校区 Wear-type VR eyesight lifting system based on binocular vision Yu mental image training
CN110198665A (en) * 2016-11-16 2019-09-03 三星电子株式会社 Electronic equipment and its control method
CN110794587A (en) * 2019-11-29 2020-02-14 Oppo广东移动通信有限公司 Wearing equipment and wearing subassembly
CN111175979A (en) * 2020-02-17 2020-05-19 Oppo广东移动通信有限公司 Glasses and control circuit thereof

Patent Citations (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11161190A (en) * 1997-11-25 1999-06-18 Seiko Epson Corp Head mounted display device
CN102668578A (en) * 2009-12-11 2012-09-12 夏普株式会社 Image display device, visual aid, and three-dimensional image display system using those
CN104298352A (en) * 2014-09-29 2015-01-21 广东欧珀移动通信有限公司 Wearable equipment working mode control method and system
CN105078437A (en) * 2014-11-14 2015-11-25 黎凯 Wearable human abnormity monitoring and alarming system and working method thereof
JP2016116066A (en) * 2014-12-15 2016-06-23 セイコーエプソン株式会社 Display device and control method of display device
US20170123744A1 (en) * 2015-11-02 2017-05-04 Lg Electronics Inc. Tethering type head mounted display and method for controlling the same
JP2017092628A (en) * 2015-11-06 2017-05-25 セイコーエプソン株式会社 Display device and display device control method
CN105654803A (en) * 2016-02-16 2016-06-08 北京励普教育科技有限公司 Head-mounted online examination machine
CN109417593A (en) * 2016-03-30 2019-03-01 富士胶片株式会社 Photographic device, working method, image processing apparatus and image processing method
EP3299871A1 (en) * 2016-09-22 2018-03-28 Essilor International A wearing detection module for spectacle frame
CN110198665A (en) * 2016-11-16 2019-09-03 三星电子株式会社 Electronic equipment and its control method
CN108209864A (en) * 2017-01-22 2018-06-29 深圳市未来健身衣科技有限公司 Body-sensing detection device and body-sensing detection method
CN107370831A (en) * 2017-09-01 2017-11-21 广州励丰文化科技股份有限公司 Show the multiusers interaction realization method and system of equipment based on MR heads
JP2019058324A (en) * 2017-09-26 2019-04-18 株式会社コロプラ Program, information processing device, information processing system, and information processing method
CN107907916A (en) * 2017-10-20 2018-04-13 歌尔科技有限公司 A kind of wearing state detection method and device of intelligent wearable device
CN108337903A (en) * 2018-01-24 2018-07-27 深圳市汇顶科技股份有限公司 A kind of detection method and its detection module, wearable device of wearing state
CN108537704A (en) * 2018-04-17 2018-09-14 深圳市心流科技有限公司 Classroom evaluating method, device and computer readable storage medium
CN108897423A (en) * 2018-06-27 2018-11-27 武汉华工智云科技有限公司 A kind of VR glasses and its online testing anti-cheating method
CN109558574A (en) * 2018-10-16 2019-04-02 广州市南方人力资源评价中心有限公司 A kind of generation online testing examination question processing method
CN109875863A (en) * 2019-03-14 2019-06-14 河海大学常州校区 Wear-type VR eyesight lifting system based on binocular vision Yu mental image training
CN110794587A (en) * 2019-11-29 2020-02-14 Oppo广东移动通信有限公司 Wearing equipment and wearing subassembly
CN111175979A (en) * 2020-02-17 2020-05-19 Oppo广东移动通信有限公司 Glasses and control circuit thereof

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
叶青等: "增强现实技术在医学教育和临床实践中的应用及展望", 《医疗卫生装备》 *
叶青等: "增强现实技术在医学教育和临床实践中的应用及展望", 《医疗卫生装备》, vol. 39, no. 12, 15 December 2018 (2018-12-15) *
张睿鑫等: "《基于深度学习的墨镜佩戴检测系统》", 工业控制计算机, vol. 33, no. 6, pages 6 - 8 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112164263A (en) * 2020-11-10 2021-01-01 龙岩烟草工业有限责任公司 Answering method and answering system for safety knowledge in tobacco industry
CN112998702A (en) * 2021-04-02 2021-06-22 深圳市齐胜达科技有限公司 Non-contact type human face recognition system and method for measuring heart rate, respiration and body temperature
CN116136611A (en) * 2023-04-17 2023-05-19 浙江口碑网络技术有限公司 Helmet wearing detection method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN111781656B (en) 2023-09-15

Similar Documents

Publication Publication Date Title
CN111781656B (en) Wearing state detection method, device, equipment and medium of head-mounted display equipment
KR101785255B1 (en) Shape discrimination vision assessment and tracking system
US20200073476A1 (en) Systems and methods for determining defects in visual field of a user
KR20160044269A (en) Health management method and system using a wearable device
JP2009530071A (en) Visual attention and emotional reaction detection display system
TW201808214A (en) System and method for the rapid measurement of the visual contrast sensitivity function
US20190008441A1 (en) Diagnosing brain injury using a virtual reality system
US20210007599A1 (en) Visual testing using mobile devices
CA2948390C (en) Systems and methods for non-intrusive deception detection
CN110151120A (en) Vision testing method, device and electronic equipment
CN105919606A (en) Equipment and method for rapidly and conveniently detecting operation fatigue
US20220160223A1 (en) Methods and Systems for Evaluating Vision Acuity and/or Conducting Visual Field Tests in a Head-Mounted Vision Device
CN110569347A (en) Data processing method and device, storage medium and electronic equipment
CN114359135A (en) Medical tool detection method, system, computer device and storage medium
CN104840210A (en) Image display apparatus and control method therefor
CN103298527A (en) Consumer useable testing kit
CN114496261A (en) Novel coronavirus antigen detection method, system, equipment and readable storage medium
KR101984993B1 (en) Visual field examination device using personalized marker control
JP6451434B2 (en) Monitoring system
CN111583732B (en) Evaluation state monitoring method, device and equipment based on head-mounted display equipment
JP2007193447A (en) Health condition management system, health condition management method, insurance premium calculation system, and consumable member supply system
CN206453778U (en) A kind of equipment of rapid and convenient detection operation fatigue strength
WO2022115860A1 (en) Methods and systems for evaluating vision acuity and/or conducting visual field tests in a head-mounted vision device
WO2020225635A1 (en) Method and information system to evaluate an interaction between a user and a device
US10182715B2 (en) Apparatus and method for assessing and improving the reliability of a visual field test

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP03 Change of name, title or address

Address after: 511400 No.5, jinshangu creative 10th Street, Donghuan street, Panyu District, Guangzhou City, Guangdong Province

Patentee after: Wangcai Technology (Guangzhou) Group Co.,Ltd.

Country or region after: China

Address before: 511400 No.5, jinshangu creative 10th Street, Donghuan street, Panyu District, Guangzhou City, Guangdong Province

Patentee before: GUANGZHOU NANFANG HUMAN RESOURCES EVALUATION CENTER Co.,Ltd.

Country or region before: China

CP03 Change of name, title or address