CN112155509A - Physical examination method for VR of driver - Google Patents
Physical examination method for VR of driver Download PDFInfo
- Publication number
- CN112155509A CN112155509A CN202011057368.3A CN202011057368A CN112155509A CN 112155509 A CN112155509 A CN 112155509A CN 202011057368 A CN202011057368 A CN 202011057368A CN 112155509 A CN112155509 A CN 112155509A
- Authority
- CN
- China
- Prior art keywords
- user
- display module
- detection
- voice
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000001514 detection method Methods 0.000 claims abstract description 113
- 230000004438 eyesight Effects 0.000 claims abstract description 32
- 210000003141 lower extremity Anatomy 0.000 claims abstract description 14
- 210000001364 upper extremity Anatomy 0.000 claims abstract description 9
- 238000012790 confirmation Methods 0.000 claims abstract description 5
- 238000010586 diagram Methods 0.000 claims description 29
- 230000009471 action Effects 0.000 claims description 28
- 238000004891 communication Methods 0.000 claims description 14
- 238000012937 correction Methods 0.000 claims description 8
- 201000010099 disease Diseases 0.000 claims description 4
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 claims description 4
- 230000004044 response Effects 0.000 claims description 4
- 241001465754 Metazoa Species 0.000 claims description 3
- 230000008569 process Effects 0.000 abstract description 11
- 238000005516 engineering process Methods 0.000 abstract description 9
- 230000006870 function Effects 0.000 description 6
- 238000004088 simulation Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 4
- 230000006872 improvement Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 208000002173 dizziness Diseases 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/02—Subjective types, i.e. testing apparatus requiring the active assistance of the patient
- A61B3/028—Subjective types, i.e. testing apparatus requiring the active assistance of the patient for testing visual acuity; for determination of refraction, e.g. phoropters
- A61B3/032—Devices for presenting test symbols or characters, e.g. test chart projectors
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/02—Subjective types, i.e. testing apparatus requiring the active assistance of the patient
- A61B3/06—Subjective types, i.e. testing apparatus requiring the active assistance of the patient for testing light sensitivity, e.g. adaptation; for testing colour vision
- A61B3/066—Subjective types, i.e. testing apparatus requiring the active assistance of the patient for testing light sensitivity, e.g. adaptation; for testing colour vision for testing colour vision
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/107—Measuring physical dimensions, e.g. size of the entire body or parts thereof
- A61B5/1072—Measuring physical dimensions, e.g. size of the entire body or parts thereof measuring distances on the body, e.g. measuring length, height or thickness
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique
- A61B5/1128—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique using image analysis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/12—Audiometering
- A61B5/121—Audiometering evaluating hearing capacity
- A61B5/123—Audiometering evaluating hearing capacity subjective methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2503/00—Evaluating a particular growth phase or type of persons or animals
- A61B2503/20—Workers
- A61B2503/22—Motor vehicles operators, e.g. drivers, pilots, captains
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Pathology (AREA)
- Dentistry (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Theoretical Computer Science (AREA)
- Ophthalmology & Optometry (AREA)
- General Engineering & Computer Science (AREA)
- Physiology (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Otolaryngology (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The technical scheme of the invention discloses a VR physical examination method for a driver, which comprises the steps of identity recognition, information input, vision detection, hearing detection, color discrimination detection, trunk detection, upper limb detection, lower limb detection, height detection, confirmation and information submission; the invention carries out physical examination of the driver by VR technology, simplifies the physical examination process, is convenient to operate and has wide application range.
Description
Technical Field
The invention relates to the technical field of physical examination equipment and methods, in particular to a VR physical examination method for a driver.
Background
VR refers to virtual reality technology, and is a simulation system capable of creating and experiencing a virtual world. The intelligent simulation system utilizes intelligent equipment to generate a simulation environment, is a multi-source information fusion interactive three-dimensional dynamic scene and entity behavior system simulation, and enables a user to be immersed in the environment. The convenience, high simulation, interactivity, multi-perceptibility, autonomy and immersive experience of the VR technology are more and more accepted by people, the VR technology is applied to multiple fields, and the demands of various industries on the VR technology are increasingly vigorous.
When a driver transacts traffic management business, such as claiming a driving license, exchanging licenses at the end of the business, increasing driving, and the like, the driver needs to perform physical examination. The existing physical examination modes are complicated and mainly comprise two modes, one mode is physical examination by a plurality of doctors according to the traditional mode, and great inconvenience is brought to both time and physical examination efficiency; the other is that introduced novel intelligent physical examination machine equipment, it is very big to compare first mode improvement, but equipment specification is great relatively, can't remove, all has certain requirement to place, environment, like network communication, fixed power lamp, and the user must arrive the traffic control department and just can use, and this kind of intelligent physical examination machine equipment price is also higher relatively, and the consumption is great relatively, has the possibility of cheating to a certain extent, and the quantity that the traffic control department in a region held is limited. At present, a virtual reality technology is applied to vision examination, and a patent CN 205903239U discloses a vision examination and training device based on virtual reality, which realizes self-service vision examination anytime and anywhere, and has the presence and the sense of reality through a head-mounted device, an image processing device, an intelligent control device, an anti-dizziness device and a remote terminal device. However, the VR technology has not been applied to other physical examination contents, such as driving physical examination items such as color discrimination, hearing, trunk, lower limbs, height, etc., so a method for performing physical examination on a driver by using the VR technology needs to be developed, so that the physical examination process of the driver is more efficient.
Disclosure of Invention
In order to solve the technical problem in the prior art, the invention provides a VR physical examination method for a driver, which is used for carrying out physical examination on the driver by a VR technology, simplifies a physical examination process, is convenient to operate and has a wide application range.
The technical scheme of the invention is as follows: a physical examination method for a driver VR specifically comprises the following steps:
s1, identity recognition, wherein after the physical examination instrument is worn by a user, the user uses a camera to shoot and recognize the certificate information of the user, and the identity information of the user is read;
s2, inputting information, wherein the input information comprises a telephone number of a user and a certificate type of a driver license, after the step is carried out, voice prompt is carried out to inquire the telephone number of the user, the user receives voice information through a microphone after speaking the telephone number, and after the software system identifies the telephone number information in the voice information, a display module displays the telephone number information and simultaneously prompts the user to confirm through voice;
after the phone number information is confirmed, the display module displays the types of the selectable driver license certificates, and simultaneously prompts the user to select by voice; after the user selects the type of the driver license certificate through voice, the display module displays the type of the certificate selected by the user and prompts the user to confirm the type of the driver license certificate through voice;
s3, vision detection, wherein the vision detection comprises left-eye vision detection and right-eye vision detection; when the eyesight of the left eye is detected, the right part of the display module is shielded, so that the information on the display module cannot be seen by the right eye, the left part of the display module displays an 'E' character with a random opening direction, meanwhile, a user is prompted by voice to speak the opening direction of the 'E' character, the voice response information of the user is recognized within set time, the user is informed whether the response result is correct, and the preset times of detection are repeated; the right-eye vision detection method is the same as the left-eye vision detection method, and the method is distinguished in that the left part of the display module is shielded, so that the left eye cannot see the information on the display module, and the right part of the display module displays E characters with random opening directions;
s4, hearing detection, wherein one of the left loudspeaker and the right loudspeaker is randomly selected, a section of sound is played, and after the sound is played, the display module prompts a user to select the loudspeaker from which the sound comes; after the user answers the voice, recognizing the voice answer information of the user within a set time, informing the user whether the answer result is correct or not, and circularly detecting for a preset number of times;
s5, detecting the color discrimination, wherein after the detection is started, the display module randomly displays a picture for detecting the color discrimination and randomly displays a preset number of to-be-selected items, only one of the to-be-selected items is a correct answer, and each to-be-selected item has an identification number; the voice prompts the user to select a correct answer, the user speaks an identification number of the correct answer through voice, the voice answer information of the user is recognized within set time, the user is informed whether the answer result is correct, and the preset times are circularly detected;
s6, trunk detection, wherein the trunk detection comprises left-turn head detection, right-turn head detection and double-arm lifting detection; after the left turn detection is started, the display module displays a schematic diagram of the left turn and prompts a user to turn left, and after the user turns left, the physical examination instrument judges whether the action track of the user is correct or not by using data of a gyroscope and a distance meter and an algorithm in a software system and displays a result on the display module; the method for detecting the right turn head is the same as the method for detecting the left turn head, and the difference is that the display module displays a schematic diagram of the right turn head and prompts a user to turn the head right by voice;
when the two arms are lifted for detection, the display module displays a schematic diagram of the lifted two arms and prompts a user to lift the two arms by voice, after the user lifts the two arms, the physical examination instrument shoots the action of the user through the camera and transmits the shot image to the software system, and then the algorithm in the software system is used for judging whether the action track of the user is correct or not and displaying the result on the display module;
s7, detecting upper limbs, wherein the upper limbs comprise both hands and a fist; after the detection of the two hands is started, the display module displays an action schematic diagram of stretching out the two hands, and prompts a user to stretch out the two hands by voice; after the user stretches out the two hands, the camera shoots action pictures of the user, the pictures are transmitted to the software system, then whether the two hands of the user are normal or not is judged by utilizing an algorithm in the software system, the pictures are qualified if the two hands of the user are normal, and a result is displayed on the display module;
when the fist making detection starts, the display module displays a schematic diagram of actions of extending a hand and making a fist making, and prompts a user to extend the hand and make the fist making through voice;
s8, detecting lower limbs, wherein the lower limbs are used for detecting legs and feet of the user; after the lower limb detection is started, the display module displays a motion schematic diagram of a user walking for a set distance and carries out voice prompt, after the user walks for the set distance, the camera shoots the motion of the user and transmits a shot image to the software system, and then an algorithm in the software system is used for judging whether the motion track of the user is correct or not and displaying a result on the display module;
s9, detecting the height, displaying an action schematic diagram of the user keeping a vertical posture by a display module, carrying out voice prompt, carrying out horizontal position correction on the head position of the user by a gyroscope, detecting the distance from a distance meter to the ground by a physical examination instrument after the correction is finished, and adding the distances by combining the relative vertical distance from a contact sensor to the distance meter to obtain the height of the user; and displaying whether the height detection of the user is qualified or not on a display module;
s10, confirming and submitting information, displaying whether the user has related disease information or not on a display module, and performing voice confirmation; and then, uploading the detection result to a server through a communication module.
Further, in S3-S9, after each detection result is correct or qualified, the next detection is started, and if any detection result is incorrect or unqualified, the physical examination is directly quitted, and incorrect or unqualified detection items are displayed on the display module.
Further, the order of S3-S9 is not fixed.
Further, the time is set to be 1-2min in S3-S5, the preset times are 3-5 times, and the number of the preset number of to-be-selected items is 3-5; the set distance in S8 is 2-5 meters.
Further, after the user dresses the physical examination instrument in S1, turn on the equipment switch, adjust the display focal length through showing adjust knob, then use the camera to shoot and discern user' S certificate information.
Further, in S1-S10, when a living body such as a human body or an animal enters the range of 1-5 m of the user, the infrared sensor detects a living body signal, and reminds the driver of avoiding the living body by voice.
The invention discloses a physical examination instrument used in a VR physical examination method of a driver, which comprises a contact sensor, a distance meter, a camera, a microphone, a loudspeaker, a display module, a display adjusting knob, an equipment switch, a processor, a software system, a communication module, a gyroscope, a power supply module, a storage module and an infrared sensor, wherein the contact sensor is connected with the distance meter;
the processor is used for data processing operation of the operation function of the physical examination instrument;
the software system is used for identifying and analyzing voice information received by a microphone of the physical examination instrument and images shot by the camera and controlling the operation function of the physical examination instrument;
the communication module is used for communicating the physical examination instrument with the server, uploading the detection result of the physical examination instrument to the server, and receiving information transmitted by the server, wherein the communication mode includes but is not limited to WIFI, 4G and 5G;
the gyroscope is used for detecting the posture of the detector, such as; whether the physical examination instrument is kept in a horizontal state or not;
the contact sensor is used for detecting whether the user wears the physical examination instrument, and calculating the height of the user by combining the relative vertical distance between the contact sensor and the distance meter and the distance between the physical examination instrument and the ground, which is measured by the distance meter; after the user wears the physical examination instrument, the contact sensor is positioned at the top of the head of the user, and the relative vertical distance between the contact sensor and the distance meter is the relative vertical distance between the top of the head of the user and the distance meter;
the distance measuring instrument is used for measuring the distance from the physical examination instrument to the ground;
the camera is used for recording and taking pictures and shooting the using process of the physical examination of the user;
the microphone is used for receiving voice information of a user;
the loudspeaker is used for playing sound information;
the display module is used for displaying a scene interface to a user to realize screen-end display;
the display adjusting knob is used for adjusting the display focal length;
the equipment switch is used for controlling the on and off of the physical examination instrument;
the power module is used for providing electric energy for the physical examination instrument and storing electric quantity;
the storage module is used for storing control information of the physical examination instrument and temporary file information in the using process;
the infrared sensor is used for detecting living bodies appearing within a range of 1-5 meters from a driver.
By adopting the technical scheme, the invention has the following beneficial effects:
(1) when handling the management business, the health examination project of driver is fixed, judges easily, utilizes the VR technique for immersive experience during the driver's physical examination, and combines display module's screen end demonstration and voice prompt, makes whole physical examination process interactivity good, and the user operation of being convenient for makes the physical examination flow simplify, very big improvement physical examination efficiency.
(2) The physical examination instrument can only be operated by a user in the whole physical examination process, and the detection information can only be seen by the user wearing the physical examination instrument during the physical examination, so that the cheating resistance is high.
(3) The size of physical examination appearance is less relatively, portable, and applicable in more application scenes, the cost reduces relatively, more does benefit to a large amount of using widely, and is more convenient for the civilization.
Drawings
FIG. 1 is a flow chart of the operation of the present invention;
figure 2 is a schematic diagram of the physical examination apparatus of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and specific embodiments.
Example 1
Referring to fig. 1-2, a physical examination method for a driver VR specifically includes the following steps:
s1, identity recognition, wherein after the physical examination instrument is worn by a user, the user uses a camera to shoot and recognize the certificate information of the user, and the identity information of the user is read;
s2, inputting information, wherein the input information comprises a telephone number of a user and a certificate type of a driver license, after the step is carried out, voice prompt is carried out to inquire the telephone number of the user, the user receives voice information through a microphone after speaking the telephone number, and after the software system identifies the telephone number information in the voice information, a display module displays the telephone number information and simultaneously prompts the user to confirm through voice;
after the phone number information is confirmed, the display module displays the types of the selectable driver license certificates, and simultaneously prompts the user to select by voice; after the user selects the type of the driver license certificate through voice, the display module displays the type of the certificate selected by the user and prompts the user to confirm the type of the driver license certificate through voice;
s3, vision detection, wherein the vision detection comprises left-eye vision detection and right-eye vision detection; when the eyesight of the left eye is detected, the right part of the display module is shielded, so that the information on the display module cannot be seen by the right eye, the left part of the display module displays an 'E' character with a random opening direction, meanwhile, a user is prompted by voice to speak the opening direction of the 'E' character, the voice answer information of the user is recognized within 2min, and the user is informed whether the answer result is correct or not, and the detection is carried out for 4 times in a circulating manner; the right-eye vision detection method is the same as the left-eye vision detection method, and the method is distinguished in that the left part of the display module is shielded, so that the left eye cannot see the information on the display module, and the right part of the display module displays E characters with random opening directions;
s4, hearing detection, wherein one of the left loudspeaker and the right loudspeaker is randomly selected, a section of sound is played, and after the sound is played, the display module prompts a user to select the loudspeaker from which the sound comes; after the user answers the voice, recognizing the voice answer information of the user within 2min, informing the user whether the answer result is correct or not, and circularly detecting for 4 times;
s5, detecting the color discrimination, wherein after the detection is started, the display module randomly displays a picture for detecting the color discrimination and randomly displays 5 to-be-selected items, wherein only one of the to-be-selected items is a correct answer, and each to-be-selected item has an identification number; the voice prompts the user to select a correct answer, the user speaks an identification number of the correct answer through voice, the voice answer information of the user is recognized within 2min, the user is informed whether the answer result is correct, and the detection is carried out for 4 times in a circulating way;
s6, trunk detection, wherein the trunk detection comprises left-turn head detection, right-turn head detection and double-arm lifting detection; after the left turn detection is started, the display module displays a schematic diagram of the left turn and prompts a user to turn left, and after the user turns left, the physical examination instrument judges whether the action track of the user is correct or not by using data of a gyroscope and a distance meter and an algorithm in a software system and displays a result on the display module; the method for detecting the right turn head is the same as the method for detecting the left turn head, and the difference is that the display module displays a schematic diagram of the right turn head and prompts a user to turn the head right by voice;
when the two arms are lifted for detection, the display module displays a schematic diagram of the lifted two arms and prompts a user to lift the two arms by voice, after the user lifts the two arms, the physical examination instrument shoots the action of the user through the camera and transmits the shot image to the software system, and then the algorithm in the software system is used for judging whether the action track of the user is correct or not and displaying the result on the display module;
s7, detecting upper limbs, wherein the upper limbs comprise both hands and a fist; after the detection of the two hands is started, the display module displays an action schematic diagram of stretching out the two hands, and prompts a user to stretch out the two hands by voice; after the user stretches out the two hands, the camera shoots action pictures of the user, the pictures are transmitted to the software system, then whether the two hands of the user are normal or not is judged by utilizing an algorithm in the software system, the pictures are qualified if the two hands of the user are normal, and a result is displayed on the display module;
when the fist making detection starts, the display module displays a schematic diagram of actions of extending a hand and making a fist making, and prompts a user to extend the hand and make the fist making through voice;
s8, detecting lower limbs, wherein the lower limbs are used for detecting legs and feet of the user; after the lower limb detection is started, the display module displays a motion schematic diagram of a user walking for 3 meters, voice prompt is carried out, after the user walks for a set distance, the camera shoots the motion of the user and transmits a shot image to the software system, and then whether the motion track of the user is correct or not is judged by utilizing an algorithm in the software system, and a result is displayed on the display module;
s9, detecting the height, displaying an action schematic diagram of the user keeping a vertical posture by a display module, carrying out voice prompt, carrying out horizontal position correction on the head position of the user by a gyroscope, detecting the distance from a distance meter to the ground by a physical examination instrument after the correction is finished, and adding the distances by combining the relative vertical distance from a contact sensor to the distance meter to obtain the height of the user; and displaying whether the height detection of the user is qualified or not on a display module;
s10, confirming and submitting information, displaying whether the user has related disease information or not on a display module, and performing voice confirmation; and then uploading the detection result to a server through a communication module in a WIFI communication mode.
Further, in S3-S9, after each detection result is correct or qualified, the next detection is started, and if any detection result is incorrect or unqualified, the physical examination is directly quitted, and incorrect or unqualified detection items are displayed on the display module.
Further, in S1-S10, when a living body such as a human body or an animal enters a range of 3 meters from the user, the infrared sensor detects a living body signal, and reminds the driver of avoiding the living body by voice.
The physical examination instrument used in the driver VR physical examination method in this embodiment 1 includes a contact sensor, a distance meter, a camera, a microphone, a speaker, a display module, a display adjusting knob, an equipment switch, a processor, a software system, a communication module, a gyroscope, a power module, and a storage module;
the processor is used for data processing operation of the operation function of the physical examination instrument;
the software system is used for identifying and analyzing voice information received by a microphone of the physical examination instrument and images shot by the camera and controlling the operation function of the physical examination instrument;
the communication module is used for communicating the physical examination instrument with the server, uploading the detection result of the physical examination instrument to the server and receiving the information transmitted by the server;
the gyroscope is used for detecting the posture of the detector, such as; whether the physical examination instrument is kept in a horizontal state or not;
the contact sensor is used for detecting whether the user wears the physical examination instrument, and calculating the height of the user by combining the relative vertical distance between the contact sensor and the distance meter and the distance between the physical examination instrument and the ground, which is measured by the distance meter; after the user wears the physical examination instrument, the contact sensor is positioned at the top of the head of the user, and the relative vertical distance between the contact sensor and the distance meter is the relative vertical distance between the top of the head of the user and the distance meter;
the distance measuring instrument is used for measuring the distance from the physical examination instrument to the ground;
the camera is used for recording and taking pictures and shooting the using process of the physical examination of the user;
the microphone is used for receiving voice information of a user;
the loudspeaker is used for playing sound information;
the display module is used for displaying a scene interface to a user to realize screen-end display;
the display adjusting knob is used for adjusting the display focal length;
the equipment switch is used for controlling the on and off of the physical examination instrument;
the power module is used for providing electric energy for the physical examination instrument and storing electric quantity;
the storage module is used for storing control information of the physical examination instrument and temporary file information in the using process;
the infrared sensor is used for detecting living bodies appearing within a range of 2 meters from a driver.
Example 2
A physical examination method for a driver VR specifically comprises the following steps:
s1, identity recognition, wherein after the physical examination instrument is worn by a user, an equipment switch is turned on, a display focal length is adjusted through a display adjusting knob, the certificate information of the user is shot and recognized by a camera, and the identity information of the user is read;
s2, inputting information, wherein the input information comprises a telephone number of a user and a certificate type of a driver license, after the step is carried out, voice prompt is carried out to inquire the telephone number of the user, the user receives voice information through a microphone after speaking the telephone number, and after the software system identifies the telephone number information in the voice information, a display module displays the telephone number information and simultaneously prompts the user to confirm through voice;
after the phone number information is confirmed, the display module displays the types of the selectable driver license certificates, and simultaneously prompts the user to select by voice; after the user selects the type of the driver license certificate through voice, the display module displays the type of the certificate selected by the user and prompts the user to confirm the type of the driver license certificate through voice;
s3, vision detection, wherein the vision detection comprises left-eye vision detection and right-eye vision detection; when the eyesight of the left eye is detected, the right part of the display module is shielded, so that the information on the display module cannot be seen by the right eye, the left part of the display module displays an 'E' character with a random opening direction, meanwhile, a user is prompted by voice to speak the opening direction of the 'E' character, the voice answer information of the user is recognized within 1min, and the user is informed whether the answer result is correct or not, and the detection is carried out for 3 times in a circulating way; the right-eye vision detection method is the same as the left-eye vision detection method, and the method is distinguished in that the left part of the display module is shielded, so that the left eye cannot see the information on the display module, and the right part of the display module displays E characters with random opening directions;
s4, detecting the color discrimination, wherein after the detection is started, the display module randomly displays a picture for detecting the color discrimination and randomly displays 4 to-be-selected items, wherein only one of the to-be-selected items is a correct answer, and each to-be-selected item has an identification number; the voice prompts the user to select a correct answer, the user speaks an identification number of the correct answer through voice, the voice answer information of the user is recognized within 1min, the user is informed whether the answer result is correct, and the detection is carried out for 3 times in a circulating way;
s5, hearing detection, wherein one of the left loudspeaker and the right loudspeaker is randomly selected, a section of sound is played, and after the sound is played, the display module prompts a user to select the loudspeaker from which the sound comes; after the user answers the voice, recognizing the voice answer information of the user within 1min, informing the user whether the answer result is correct or not, and circularly detecting for 3 times;
s6, detecting upper limbs, wherein the upper limbs comprise both hands and a fist; after the detection of the two hands is started, the display module displays an action schematic diagram of stretching out the two hands, and prompts a user to stretch out the two hands by voice; after the user stretches out the two hands, the camera shoots action pictures of the user, the pictures are transmitted to the software system, then whether the two hands of the user are normal or not is judged by utilizing an algorithm in the software system, the pictures are qualified if the two hands of the user are normal, and a result is displayed on the display module;
when the fist making detection starts, the display module displays a schematic diagram of actions of extending a hand and making a fist making, and prompts a user to extend the hand and make the fist making through voice;
s7, trunk detection, wherein the trunk detection comprises left-turn head detection, right-turn head detection and double-arm lifting detection; after the left turn detection is started, the display module displays a schematic diagram of the left turn and prompts a user to turn left, and after the user turns left, the physical examination instrument judges whether the action track of the user is correct or not by using data of a gyroscope and a distance meter and an algorithm in a software system and displays a result on the display module; the method for detecting the right turn head is the same as the method for detecting the left turn head, and the difference is that the display module displays a schematic diagram of the right turn head and prompts a user to turn the head right by voice;
when the two arms are lifted for detection, the display module displays a schematic diagram of the lifted two arms and prompts a user to lift the two arms by voice, after the user lifts the two arms, the physical examination instrument shoots the action of the user through the camera and transmits the shot image to the software system, and then the algorithm in the software system is used for judging whether the action track of the user is correct or not and displaying the result on the display module;
s8, detecting lower limbs, wherein the lower limbs are used for detecting legs and feet of the user; after the lower limb detection is started, the display module displays a motion schematic diagram of a user walking for 2 meters, voice prompt is carried out, after the user walks for a set distance, the camera shoots the motion of the user and transmits a shot image to the software system, and then whether the motion track of the user is correct or not is judged by utilizing an algorithm in the software system, and a result is displayed on the display module;
s9, detecting the height, displaying an action schematic diagram of the user keeping a vertical posture by a display module, carrying out voice prompt, carrying out horizontal position correction on the head position of the user by a gyroscope, detecting the distance from a distance meter to the ground by a physical examination instrument after the correction is finished, and adding the distances by combining the relative vertical distance from a contact sensor to the distance meter to obtain the height of the user; and displaying whether the height detection of the user is qualified or not on a display module;
s10, confirming and submitting information, displaying whether the user has related disease information or not on a display module, and performing voice confirmation; and then, uploading the detection result to a server through a communication module in a 5G communication mode.
Further, in S3-S9, after each detection result is correct or qualified, the next detection is started, and if any detection result is incorrect or unqualified, the physical examination is directly quitted, and incorrect or unqualified detection items are displayed on the display module.
The invention discloses a physical examination instrument used in a VR physical examination method for a driver, which comprises a contact sensor, a distance meter, a camera, a microphone, a loudspeaker, a display module, a display adjusting knob, an equipment switch, a processor, a software system, a communication module, a gyroscope, a power supply module and a storage module, wherein the contact sensor is arranged on the contact sensor;
the processor is used for data processing operation of the operation function of the physical examination instrument;
the software system is used for identifying and analyzing voice information received by a microphone of the physical examination instrument and images shot by the camera and controlling the operation function of the physical examination instrument;
the communication module is used for communicating the physical examination instrument with the server, uploading the detection result of the physical examination instrument to the server and receiving the information transmitted by the server;
the gyroscope is used for detecting the posture of the detector, such as; whether the physical examination instrument is kept in a horizontal state or not;
the contact sensor is used for detecting whether the user wears the physical examination instrument, and calculating the height of the user by combining the relative vertical distance between the contact sensor and the distance meter and the distance between the physical examination instrument and the ground, which is measured by the distance meter; after the user wears the physical examination instrument, the contact sensor is positioned at the top of the head of the user, and the relative vertical distance between the contact sensor and the distance meter is the relative vertical distance between the top of the head of the user and the distance meter;
the distance measuring instrument is used for measuring the distance from the physical examination instrument to the ground;
the camera is used for recording and taking pictures and shooting the using process of the physical examination of the user;
the microphone is used for receiving voice information of a user;
the loudspeaker is used for playing sound information;
the display module is used for displaying a scene interface to a user to realize screen-end display;
the display adjusting knob is used for adjusting the display focal length;
the equipment switch is used for controlling the on and off of the physical examination instrument;
the power module is used for providing electric energy for the physical examination instrument and storing electric quantity;
the storage module is used for storing control information of the physical examination instrument and temporary file information in the using process.
Claims (6)
1. A physical examination method for a VR of a driver is characterized by comprising the following steps:
s1, identity recognition, wherein after the physical examination instrument is worn by a user, the user uses a camera to shoot and recognize the certificate information of the user, and the identity information of the user is read;
s2, inputting information, wherein the input information comprises a telephone number of a user and a certificate type of a driver license, after the step is carried out, voice prompt is carried out to inquire the telephone number of the user, the user receives voice information through a microphone after speaking the telephone number, and after the software system identifies the telephone number information in the voice information, a display module displays the telephone number information and simultaneously prompts the user to confirm through voice;
after the phone number information is confirmed, the display module displays the types of the selectable driver license certificates, and simultaneously prompts the user to select by voice; after the user selects the type of the driver license certificate through voice, the display module displays the type of the certificate selected by the user and prompts the user to confirm the type of the driver license certificate through voice;
s3, vision detection, wherein the vision detection comprises left-eye vision detection and right-eye vision detection; when the eyesight of the left eye is detected, the right part of the display module is shielded, so that the information on the display module cannot be seen by the right eye, the left part of the display module displays an 'E' character with a random opening direction, meanwhile, a user is prompted by voice to speak the opening direction of the 'E' character, the voice response information of the user is recognized within set time, the user is informed whether the response result is correct, and the preset times of detection are repeated; the right-eye vision detection method is the same as the left-eye vision detection method, and the method is distinguished in that the left part of the display module is shielded, so that the left eye cannot see the information on the display module, and the right part of the display module displays E characters with random opening directions;
s4, hearing detection, wherein one of the left loudspeaker and the right loudspeaker is randomly selected, a section of sound is played, and after the sound is played, the display module prompts a user to select the loudspeaker from which the sound comes; after the user answers the voice, recognizing the voice answer information of the user within a set time, informing the user whether the answer result is correct or not, and circularly detecting for a preset number of times;
s5, detecting the color discrimination, wherein after the detection is started, the display module randomly displays a picture for detecting the color discrimination and randomly displays a preset number of to-be-selected items, only one of the to-be-selected items is a correct answer, and each to-be-selected item has an identification number; the voice prompts the user to select a correct answer, the user speaks an identification number of the correct answer through voice, the voice answer information of the user is recognized within set time, the user is informed whether the answer result is correct, and the preset times are circularly detected;
s6, trunk detection, wherein the trunk detection comprises left-turn head detection, right-turn head detection and double-arm lifting detection; after the left turn detection is started, the display module displays a schematic diagram of the left turn and prompts a user to turn left, and after the user turns left, the physical examination instrument judges whether the action track of the user is correct or not by using data of a gyroscope and a distance meter and an algorithm in a software system and displays a result on the display module; the method for detecting the right turn head is the same as the method for detecting the left turn head, and the difference is that the display module displays a schematic diagram of the right turn head and prompts a user to turn the head right by voice;
when the two arms are lifted for detection, the display module displays a schematic diagram of the lifted two arms and prompts a user to lift the two arms by voice, after the user lifts the two arms, the physical examination instrument shoots the action of the user through the camera and transmits the shot image to the software system, and then the algorithm in the software system is used for judging whether the action track of the user is correct or not and displaying the result on the display module;
s7, detecting upper limbs, wherein the upper limbs comprise both hands and a fist; after the detection of the two hands is started, the display module displays an action schematic diagram of stretching out the two hands, and prompts a user to stretch out the two hands by voice; after the user stretches out the two hands, the camera shoots action pictures of the user, the pictures are transmitted to the software system, then whether the two hands of the user are normal or not is judged by utilizing an algorithm in the software system, the pictures are qualified if the two hands of the user are normal, and a result is displayed on the display module;
when the fist making detection starts, the display module displays a schematic diagram of actions of extending a hand and making a fist making, and prompts a user to extend the hand and make the fist making through voice;
s8, detecting lower limbs, wherein the lower limbs are used for detecting legs and feet of the user; after the lower limb detection is started, the display module displays a motion schematic diagram of a user walking for a set distance and carries out voice prompt, after the user walks for the set distance, the camera shoots the motion of the user and transmits a shot image to the software system, and then an algorithm in the software system is used for judging whether the motion track of the user is correct or not and displaying a result on the display module;
s9, detecting the height, displaying an action schematic diagram of the user keeping a vertical posture by a display module, carrying out voice prompt, carrying out horizontal position correction on the head position of the user by a gyroscope, detecting the distance from a distance meter to the ground by a physical examination instrument after the correction is finished, and adding the distances by combining the relative vertical distance from a contact sensor to the distance meter to obtain the height of the user; and displaying whether the height detection of the user is qualified or not on a display module;
s10, confirming and submitting information, displaying whether the user has related disease information or not on a display module, and performing voice confirmation; and then, uploading the detection result to a server through a communication module.
2. The method of claim 1, wherein the method comprises: after the user dressed the physical examination appearance in S1, the switch of the equipment was opened, the display focal distance was adjusted through the display adjust knob, and then user' S certificate information was shot and was discerned to the use camera.
3. The method of claim 1, wherein the method comprises: in the S3-S9, after each detection result is correct or qualified, the next detection is started, if any detection result is incorrect or unqualified, the physical examination is directly quitted, and incorrect or unqualified detection items are displayed on the display module.
4. The method of claim 1 or 3, wherein the method comprises: the order of S3-S9 is not fixed.
5. The method of any of claims 1 or 3, wherein the method comprises: setting the time in S3-S5 to be 1-2min, the preset times to be 3-5 times, and the number of the preset number of to-be-selected items to be 3-5; the set distance in S8 is 2-5 meters.
6. The method of claim 1, wherein the method comprises: in S1-S10, when living bodies such as human bodies or animals enter the range of 1-5 meters of the user, the infrared sensor detects living body signals, and reminds a driver through voice to avoid the driver.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011057368.3A CN112155509A (en) | 2020-09-30 | 2020-09-30 | Physical examination method for VR of driver |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011057368.3A CN112155509A (en) | 2020-09-30 | 2020-09-30 | Physical examination method for VR of driver |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112155509A true CN112155509A (en) | 2021-01-01 |
Family
ID=73860824
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011057368.3A Pending CN112155509A (en) | 2020-09-30 | 2020-09-30 | Physical examination method for VR of driver |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112155509A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113408354A (en) * | 2021-05-19 | 2021-09-17 | 珠海方图智能科技有限公司 | Method, system and terminal for detecting physical condition of driver |
| CN113889268A (en) * | 2021-12-06 | 2022-01-04 | 青岛通产智能科技股份有限公司 | Physical examination system and physical examination method for driver |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN204480251U (en) * | 2014-08-19 | 2015-07-15 | 青岛通产软件科技有限公司 | The self-service detection system of a kind of driver's physical qualification |
| CN107092314A (en) * | 2017-06-29 | 2017-08-25 | 南京多伦科技股份有限公司 | A kind of head-mounted display apparatus and detection method that driving behavior monitor detection is provided |
| CN107229338A (en) * | 2017-06-22 | 2017-10-03 | 四川数字工匠科技有限公司 | VR glasses play systems on Voice command |
| CN107300772A (en) * | 2017-06-22 | 2017-10-27 | 四川数字工匠科技有限公司 | A kind of multi-functional VR glasses of family expenses |
| CN107718000A (en) * | 2017-10-20 | 2018-02-23 | 深圳市前海安测信息技术有限公司 | Health supervision robot and method with emotional affection interaction function |
| CN107928620A (en) * | 2017-12-13 | 2018-04-20 | 深圳市酷开网络科技有限公司 | Vision testing method, storage medium and eyesight detection terminal based on VR technologies |
| CN108903957A (en) * | 2018-04-24 | 2018-11-30 | 浙江工业大学 | A kind of automobile driver Physical Examination System based on Kinect |
| CN109927053A (en) * | 2019-05-06 | 2019-06-25 | 广东工业大学 | A kind of smart etiquette robot |
| CN110825236A (en) * | 2019-11-21 | 2020-02-21 | 江西千盛影视文化传媒有限公司 | Display system based on intelligent VR speech control |
| CN211300992U (en) * | 2019-12-03 | 2020-08-21 | 中国矿业大学银川学院 | Auxiliary distance measuring and guiding device for blind person |
-
2020
- 2020-09-30 CN CN202011057368.3A patent/CN112155509A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN204480251U (en) * | 2014-08-19 | 2015-07-15 | 青岛通产软件科技有限公司 | The self-service detection system of a kind of driver's physical qualification |
| CN107229338A (en) * | 2017-06-22 | 2017-10-03 | 四川数字工匠科技有限公司 | VR glasses play systems on Voice command |
| CN107300772A (en) * | 2017-06-22 | 2017-10-27 | 四川数字工匠科技有限公司 | A kind of multi-functional VR glasses of family expenses |
| CN107092314A (en) * | 2017-06-29 | 2017-08-25 | 南京多伦科技股份有限公司 | A kind of head-mounted display apparatus and detection method that driving behavior monitor detection is provided |
| CN107718000A (en) * | 2017-10-20 | 2018-02-23 | 深圳市前海安测信息技术有限公司 | Health supervision robot and method with emotional affection interaction function |
| CN107928620A (en) * | 2017-12-13 | 2018-04-20 | 深圳市酷开网络科技有限公司 | Vision testing method, storage medium and eyesight detection terminal based on VR technologies |
| CN108903957A (en) * | 2018-04-24 | 2018-11-30 | 浙江工业大学 | A kind of automobile driver Physical Examination System based on Kinect |
| CN109927053A (en) * | 2019-05-06 | 2019-06-25 | 广东工业大学 | A kind of smart etiquette robot |
| CN110825236A (en) * | 2019-11-21 | 2020-02-21 | 江西千盛影视文化传媒有限公司 | Display system based on intelligent VR speech control |
| CN211300992U (en) * | 2019-12-03 | 2020-08-21 | 中国矿业大学银川学院 | Auxiliary distance measuring and guiding device for blind person |
Non-Patent Citations (2)
| Title |
|---|
| 万铭达: "《驾驶员自助体检机操作演示流程》", 《知乎》 * |
| 冀永强: "《基于 VR 技术的驾驶员视觉能力测试方法研究》", 《中国优秀博硕士学位论文全文数据库 工程科技Ⅱ辑》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113408354A (en) * | 2021-05-19 | 2021-09-17 | 珠海方图智能科技有限公司 | Method, system and terminal for detecting physical condition of driver |
| CN113889268A (en) * | 2021-12-06 | 2022-01-04 | 青岛通产智能科技股份有限公司 | Physical examination system and physical examination method for driver |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103181180B (en) | Prompting control device and prompting control method | |
| CN113994396A (en) | User guidance system based on augmented reality and/or gesture detection technology | |
| US11074737B2 (en) | Information processing apparatus and method | |
| EP2697792A1 (en) | Apparatus, systems and methods for providing motion tracking using a personal viewing device | |
| CN112155509A (en) | Physical examination method for VR of driver | |
| WO2017126433A1 (en) | Information processing device and user guide presentation method | |
| JP7157551B2 (en) | Program, Information Processing Apparatus, and Method | |
| JP7085578B2 (en) | Information processing device, user guide presentation method, and head-mounted display | |
| KR102134476B1 (en) | System for performing virtual fitting using artificial neural network, method thereof and computer recordable medium storing program to perform the method | |
| US20180373414A1 (en) | Method for communicating via virtual space, program for executing the method on computer, and information processing apparatus for executing the program | |
| CN112616048B (en) | AR glasses, display method and system thereof, image processing method and device | |
| KR20200077775A (en) | Electronic device and method for providing information thereof | |
| CN109171638A (en) | The method of eyesight detection, wears display equipment and vision inspection system at terminal | |
| CN113303791A (en) | Online self-service physical examination system for motor vehicle driver, mobile terminal and storage medium | |
| KR20190015332A (en) | Devices affecting virtual objects in Augmented Reality | |
| CN111801700A (en) | Method for preventing peeping in payment process and electronic equipment | |
| JP5103682B2 (en) | Interactive signage system | |
| CN115599219A (en) | Eye protection control method, system, equipment and storage medium for display screen | |
| KR20160133972A (en) | Wearable displat device displaying progress of payment process associated with billing information on the display unit and controll method thereof | |
| CN113197542B (en) | Online self-service vision detection system, mobile terminal and storage medium | |
| JP7258472B2 (en) | Program, Information Processing Apparatus, and Method | |
| JP6470387B1 (en) | Method executed by computer to provide information via head-mounted device, program causing computer to execute the method, and information processing apparatus | |
| CN111450480B (en) | Treadmill motion platform based on VR | |
| CN112530572A (en) | Physical examination system and physical examination method for driver | |
| CN214446447U (en) | Physical examination robot for driver |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210101 |