CN106448339A - Driving training system based on enhanced reality and biofeedback - Google Patents
Driving training system based on enhanced reality and biofeedback Download PDFInfo
- Publication number
- CN106448339A CN106448339A CN201610910634.XA CN201610910634A CN106448339A CN 106448339 A CN106448339 A CN 106448339A CN 201610910634 A CN201610910634 A CN 201610910634A CN 106448339 A CN106448339 A CN 106448339A
- Authority
- CN
- China
- Prior art keywords
- user
- training system
- driving training
- main frame
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
- G09B9/02—Simulators for teaching or training purposes for teaching control of vehicles or other craft
- G09B9/04—Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of land vehicles
- G09B9/05—Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of land vehicles the view from a vehicle being simulated
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/369—Electroencephalography [EEG]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/389—Electromyography [EMG]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
- A61B5/6802—Sensor mounted on worn items
- A61B5/6803—Head-worn items, e.g. helmets, masks, headphones or goggles
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
- A61B5/6802—Sensor mounted on worn items
- A61B5/681—Wristwatch-type devices
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
- G09B9/02—Simulators for teaching or training purposes for teaching control of vehicles or other craft
- G09B9/04—Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of land vehicles
- G09B9/052—Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of land vehicles characterised by provision for recording or measuring trainee's performance
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- Animal Behavior & Ethology (AREA)
- Theoretical Computer Science (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Surgery (AREA)
- Educational Administration (AREA)
- Business, Economics & Management (AREA)
- Aviation & Aerospace Engineering (AREA)
- General Physics & Mathematics (AREA)
- Educational Technology (AREA)
- Psychiatry (AREA)
- Psychology (AREA)
- Rehabilitation Tools (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a driving training system based on enhanced reality and biofeedback. A computer is used to simulate the environment such as an instrument, a steering wheel, a shift device and the like in a real vehicle and a road. The environment and the road are projected onto a translucent curved glass plate for display imaging through a curved 3D display. By adjusting the height and horizontal angle of the translucent curved glass plate, a virtual image and a built physical platform coincides. The steering wheel, a throttle clutch, brake composition and the shift device have force feedback, and can synchronize with the driving state of the simulated vehicle in real time, which allows a user to experience a real driving experience. In addition, the system has an automatic error correction function. The steering wheel with force feedback prompts the user to turn. The throttle force feedback prompts the user to slow down. A measurement bracelet which uses a wireless electromyographic signal and an easily worn brain electrical acquisition helmet are used to acquire the physiological information of the user. An electromyographic signal extracts the focus concentration degree, and the electromyographic signal extracts the muscle tension degree. Real-time projection display is carried out.
Description
Technical field
The present invention relates to human-computer interaction technique field, be specifically related to a kind of driving training based on augmented reality and biofeedback
Exercising system.
Background technology
With the growth of population, the increase of per capita income, more and more people have purchased automobile, but thing followed traffic accident thing
Part also increases all the more.So, correct driving technology is very necessary.Prediction industrial research institute issues《2013-2017 China
The investigation of the motor vehicle driving training industry degree of depth and the report of investment strategy planning application》Display, by the end of the year in 2012, the whole nation was total
Institute of driver training mechanism 10347,37.7 ten thousand, learner-driven vehicle, coach 43.9 ten thousand people, increased the 42.2%th, than 2006 respectively
75.3% and 106.6%.Meanwhile, the tuition fee of driving school day by day raises, but user cannot get comprehensively instructing.Within 2015, China issues
Cloth《With regard to the suggestion advancing the reform of vehicle driver training examination system》, it now is possible to driver's license can be learnt by oneself and directly examine,
Need not Fei Qu driving school, a virtual driving training system easily, driving school's pressure can be alleviated thus reduce driving school's cost.Virtual
Drive, be also called automobile driving simulation, or simulative automobile driving.Refer to utilize modern high technology technology such as：Real-time three-dimensional figure
As technology, vehicle dynamics simulation physical system, big visual field Display Technique (such as multichannel stereo projection system), six degree of freedom fortune
Moving platform (or Three-degree-of-freedom motion platform), user's input hardware system, stero set, central control system etc., allow experiencer exist
In one virtual driving environment, the car steering experiencing the vision close to true effect, the sense of hearing and body-sensing is experienced.Current
Virtual driving product, generally can not feed back physics and the physiologic information of comprehensive user's driving procedure and can not correct driving of user
Sailing bad habit, such virtual driving properties of product are perfect not.
Create many papers related to this and patent in recent years, as follows respectively：
China's publication number：CN105390042A, title：Simulation driving platform.This equipment copies car inner structure to build
Go out a platform.This equipment can simulate real environment inside car to a great extent, but this equipment does not has sense of touch to feed back, it is impossible to
Simulating the true driving situation of vehicle realistically, this patent of what is more important can not detect the physiology letter of user in real time
Breath, does not has automatic error correction function.
China's publication number：CN202171880U, title：A kind of three dimensional visual simulation control loop.This equipment uses
Drive simulating seat, coordinates projecting apparatus, and utilizes the stereoscopic three-dimensional virtual scene that computer real-time synchronization generates, cause a set of forcing
Very, solid, the simulation driving system immersing completely.But this equipment is also without the real-time driving condition monitoring user and driving appearance
Gesture, it is impossible in real time user's driving efficiency is corrected.Practicality has much room for improvement.
China's publication number：CN204856968U, title：A kind of driving stimulation system for driver's study
Device.This equipment equally can be outstanding simulate true driving environment, well combine audiovisual and sense of touch feedback.But
Equally exist the defect of existing drive simulating class patent, it is impossible to monitor the driving condition of user in real time, it is impossible to outstanding performance
Go out the due experience of man-machine interactive platform and performance.One ripe driving training system, in the basic training providing drive simulating
While energy, also should be with the function correcting user's driving habits.
Content of the invention
Present invention aim to address drawbacks described above of the prior art, such as poor user experience, virtual reality immersion sense is not
Enough strong, do not add sense of touch input and output, user's physiologic information could not be detected in real time, user's driving habits, feedback could not be corrected
The problems such as signal is single, provide a kind of driving training system based on augmented reality and biofeedback.
The purpose of the present invention can be reached by adopting the following technical scheme that：
A kind of driving training system based on augmented reality and biofeedback, described driving training system includes：Curved surface 3D
Display the 2nd, translucent bend glass plate the 4th, support platform the 7th, control main frame the 8th, steering wheel the 6th, throttle clutch and brake synthesis 9 and
Gearshift 12, wherein, described curved surface 3D display 2 is connected by holding wire with described control main frame 8, for by described control
The 3D image projecting that main frame 8 produces is on described translucent bend glass plate 4；Described curved surface 3D display 2 is translucent with described
Bend glass plate 4 is from top to bottom respectively arranged at the top of described support platform 7, is fixed on and is connected with described support platform 7
Display bracket fixes bar 3；Described steering wheel 6 and described gearshift 12 are arranged in described support platform 7, described throttle from
Clutch and brake synthesis 9 are arranged on the lower section of described support platform 7, described steering wheel the 6th, described throttle clutch and brake synthesis
9th, described gearshift 12 is connected by holding wire with described control main frame 8；
Described driving training system also includes：Brain wave acquisition equipment 10 and myoelectricity collecting device 14, wherein, described brain electricity is adopted
Collection equipment 10 wears the EEG signals of user for gathering, and is then transported to its signal and described brain wave acquisition equipment 10 signal
The described control main frame 8 connecting is processed；Described myoelectricity collecting device 14 is worn on large arm and the forearm of user, is used for adopting
Then its signal is transported to the described control being connected with described myoelectricity collecting device 14 signal by the surface electromyogram signal of collection user
Main frame 8 is processed.
Further, described curved surface 3D display 2 passes through 3D display bracket respectively with described translucent bend glass plate 4
1 is fixed on described display bracket with translucent bend glass board mount 5 fixes on bar 3.
Further, described translucent bend glass board mount 5 is by turning to corner fittings and screw and described display bracket
Fixing bar 3 is fixing to be connected, and height and the level angle of described translucent bend glass board mount 5 can be regulated as required.
Further, described steering wheel the 6th, described throttle clutch and brake synthesis the 9th, described gearshift 12 is anti-for band power
The equipment of feedback, the said equipment is while gathering user operation control information, by the user's spirit shape from described control main frame 8
State information, muscular states information, drive simulating information feed back to driving training user.
Further, described brain wave acquisition equipment 10 is the easy belt brain wave acquisition helmet, gathers and is used for extracting notice collection
The EEG signals of middle degree.
Further, described myoelectricity collecting device 14 measures bracelet for wireless electromyographic signal, and it is tight that collection is used for extracting muscle
The electromyographic signal of Zhang Chengdu.
Further, described driving training system also includes：Automotive seat 15, the height of described automotive seat 15 and front and back
Position-adjustable.
Further, described automotive seat 15 is provided with safety belt 13, with described control main frame 8 by holding wire even
Connecing, described control main frame 8 can detect the whether fastening safety belt 13 of the user on described automotive seat 15, and by safety belt setting fastening shape
State by described curved surface 3D display 2 Projection Display on described translucent bend glass plate 4.
Further, described driving training system also includes：Multimedia audio device 11, described multimedia audio device 11
Being connected by holding wire with described control main frame 8, described multimedia audio device 11 is used for playing described control main frame 8 and simulates car
Travel when engine sound, brake when brake sound.
The present invention has such advantages as relative to prior art and effect：
1) present invention provides a kind of driving training system based on augmented reality and biofeedback, and user can be allowed in indoor
Carry out driver training truly true to nature, correct the bad steering custom of driver.In terms of virtual reality technology, this system can will be used
The multi information such as the physiologic information at family, steering wheel feedback information, virtual surface conditions, virtual engine sound and brake sound merge
Process, improve accuracy and the efficiency of human-computer interaction.
2) native system can provide 3D virtual reality imagery true to nature, has vision, the sense of hearing and the touch feeling system of uniqueness
System, it is achieved that the synchronization of three renders and coordinates, and greatly strengthen the feeling of immersion of virtual reality technology.
3) native system has automatic error correction function and real-time detection user's physiologic information function, and EEG signals extract notice
Intensity, electromyographic signal is extracted muscular tone degree, on live fluoroscopic to pellicle screen, user can be trained to drive more comprehensively
Sail technical ability.
Brief description
Fig. 1 is the structural representation of the driving training system in the present invention based on augmented reality and biofeedback；
Fig. 2 is the left view of translucent bend glass board mount；
Fig. 3 is the perspective view of translucent bend glass board mount；
Fig. 4 is automobile instrument perspective view；
Fig. 5 is both arms muscular states interface schematic diagram；
Fig. 6 is Multi-information acquisition Processing Algorithm flow chart；
Wherein, 1---3D display bracket, 2---curved surface 3D display, 3---display bracket fixes bar, and 4---is semi-transparent
Bright bend glass plate, 5---translucent bend glass board mount, 6---steering wheel, 7---support platform, 8---controls main frame,
9---throttle clutch and brake, 10---brain wave acquisition equipment, 11---multimedia audio device, 12---gearshift,
13---safety belt, 14---myoelectricity collecting device, 15---automotive seat.
Detailed description of the invention
Purpose, technical scheme and advantage for making the embodiment of the present invention are clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
The a part of embodiment of the present invention, rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art
The every other embodiment being obtained under the premise of not making creative work, broadly falls into the scope of protection of the invention.
Embodiment
Present embodiment discloses a kind of driving training system based on augmented reality and biofeedback, by using computer
Environment in simulation real car, is shown by curved surface 3D display.Meanwhile, this system contains the direction with force feedback in car
Vehicle operation environment simulated by dish the 6th, throttle clutch and brake synthesis the 9th, gearshift 12, additionally contains much information collection
Equipment, builds a drive simulating environment true to nature by augmented reality and biofeedback technology to user.
As shown in Figure 1, Fig. 1 discloses a kind of driving training system based on augmented reality and biofeedback, this system
Including following composition component：3D display bracket the 1st, curved surface 3D display the 2nd, display bracket fixes bar the 3rd, translucent bend glass
Plate the 4th, translucent bend glass board mount the 5th, steering wheel the 6th, support platform the 7th, control main frame the 8th, throttle clutch and brake the 9th, brain electricity
Collecting device the 10th, multimedia audio device the 11st, gearshift the 12nd, safety belt the 13rd, myoelectricity collecting device the 14th, automotive seat 15.
Described curved surface 3D display 2 is connected by holding wire with described control main frame 8, for producing described control main frame 8
Raw 3D image projecting is on described translucent bend glass plate 4.
By use curved surface 3D display 2, thus strengthen the indication range of drive simulating environment, make user have wider
Wealthy drive simulating environment.The use of translucent bend glass plate 4 is to virtual analog be driven image whole projection to half
On transparency glass plate, meanwhile, the curved surface radian of bend glass plate needs specifically to customize according to 2 curved surface 3D make displays, to reach
To perfect drop shadow effect.
Control main frame 8 draws up environment inside car scene by computer mould, is passed through translucent curved surface glass by curved surface 3D display 2
The principle of reflection of glass plate 4, makes virtual image and the emulation driving platform built by material object overlap and real-time synchronization, thus permissible
Reach user directly in the effect of manipulation virtual image.Regulate song by regulating the height of 3D display bracket 1 and position
Face 3D display 2, can be regulated the position of translucent bend glass plate 4, have by the translucent bend glass board mount 5 of regulation
Also have in the case of necessary and add 3D glasses, to meet the various demands of different user.
Described curved surface 3D display 2 and described translucent bend glass plate 4 are from top to bottom respectively arranged at described support and put down
The top of platform 7, is fixed on the display bracket being connected with described support platform 7 and fixes bar 3.
In the present embodiment, described curved surface 3D display 2 is propped up by 3D display respectively with described translucent bend glass plate 4
Frame 1 and translucent bend glass board mount 5 are fixed on described display bracket and fix on bar 3.
Wherein, described translucent bend glass board mount 5 is fixed with described display bracket by turning to corner fittings and screw
Bar 3 is fixing to be connected, and height and the level angle of described translucent bend glass board mount 5 can be regulated as required.
With reference to the accompanying drawings 2 and accompanying drawing 3 in shown in the left view of translucent bend glass board mount and perspective view, half
Transparent bend glass board mount 5 is combined into a U-shaped support by two root type material a2 and a root type material a3 by corner fittings b1 and screw b2,
Equally, two root type material a1 and a root type material a4 are combined into another U-shaped support by corner fittings b1 and screw b2, are turned to by using
Corner fittings b3 has connected section bar a3 and section bar a4, is fixed on support platform 7 by corner fittings b1 and screw b2.The groove carrying due to section bar
Structure and the use of corner fittings, it is possible to achieve the height of translucent bend glass board mount 5 and the regulation of level angle.
Also should include based on the driving training system of augmented reality and biofeedback：Brain wave acquisition equipment 10, described brain electricity
The EEG signals of user worn by collecting device 10 for gathering, and are then transported to its signal believe with described brain wave acquisition equipment 10
Number connect described control main frame 8 process, finally, by the state of mind of user pass through curved surface 3D display 2 Projection Display
On translucent bend glass plate 4.
In the present embodiment, brain wave acquisition equipment 10 uses the easy belt brain wave acquisition helmet, the easy belt brain wave acquisition helmet and
EEG Processing software sharing brain wave acquisition in control main frame analyzes system, and this brain wave acquisition analyzes system energy Real-time Collection
User's EEG signals, EEG signals Real-time Feedback to control main frame is filtered, feature extraction, the associative operation such as classification,
It is mainly used to extract the eegαwave of driver.
Also should include based on the driving training system of augmented reality and biofeedback：Myoelectricity collecting device 14, described myoelectricity
Collecting device 14 is worn on large arm and the forearm of user, for gathering the surface electromyogram signal of user, then by defeated for its signal
The described control main frame 8 delivering to be connected with described myoelectricity collecting device 14 signal is processed, finally, by the muscular states of user
By curved surface 3D display 2 Projection Display on translucent bend glass plate 4.
In the present embodiment, myoelectricity collecting device 14 uses wireless electromyographic signal measurement bracelet, and wireless electromyographic signal measures hand
Electromyographic signal in ring and control main frame processes software sharing electromyographic signal collection and analyzes system, this electromyographic signal collection analysis system
System is measured the sEMG to user for the EMG sensor on bracelet by wireless electromyographic signal and is carried out Real-time Collection, and control main frame 8 receives
After the signal of wireless electromyographic signal measurement bracelet, automatic Wavelet Transformation Algorithm is used to be filtered signal, denoising, to denoising
After signal carry out the frequency spectrum that fast Fourier transform obtains sEMG signal.When the sEMG frequency spectrum of user occurs moving to left phenomenon, then
Show that muscular fatigue occurs in user.Electromyographic signal collection analysis system, mainly by the collection of electromyographic signal, monitors driver
The tensity of arm, control main frame 8 is made prompting driver and is adjusted state and posture.
Also should include based on the driving training system of augmented reality and biofeedback：Steering wheel the 6th, throttle clutch and brake
Synthesis the 9th, gearshift 12, described steering wheel 6 and described gearshift 12 be arranged in described support platform 7, described throttle from
Clutch and brake synthesis 9 are arranged on the lower section of described support platform 7, and the 9th, described steering wheel the 6th, throttle clutch and brake synthesis change
Blocking means 12 is connected by holding wire with described control main frame 8.User is sitting on automotive seat 15, can facilitate direction of operating dish
6th, throttle clutch and brake synthesis the 9th, gearshift 12.
Described steering wheel the 6th, described throttle clutch and brake synthesis the 9th, described gearshift 12 is the equipment with force feedback,
The said equipment is while gathering user operation control information, by the information from control main frame 8, comprises user's state of mind letter
Breath, muscular states information, drive simulating information feed back to user, carry to the real driving experience of user and suitable driving
Wake up.
Steering wheel the 6th, throttle clutch and brake synthesis the 9th, gearshift 12 and the relevant treatment software structure on control main frame 8
Become force feedback system, the steering wheel anglec of rotation and angular speed can be fed back to control main frame 8 in real time, and from control main frame 8 to
State in the 3D image of user's feedback steering wheel place.When car speed is too fast, the device for force feedback on throttle shakes, and reminds
User loosens throttle.
Should be adopted by brain electricity based on the driving training system of augmented reality and biofeedback while drive simulating environment
Collection equipment 10 and myoelectricity collecting device 14 detect the physiologic information of user in real time, such as muscular tone degree, the degree of fatigue of user
And notice intensity, by controlling the calculating of platform 8, it determines go out user's notice concentration degree and drive both arms muscular fatigue
Situation, and feed back to user.
It is shown on translucent bend glass plate 4 by the state display table of accompanying drawing 4.Its state is broadly divided into muscular states
And state of attention, state of attention is divided into, in, differ from three ranks, and muscular states is broadly divided into, nervous, tired three
Individual rank.Additionally, muscular states is also sub-divided into the major muscles group of two arms, such as accompanying drawing 5, when its muscle group is nervous, its
Send out a warning, give a green light when normal.
In a word, control main frame 8 according to the status information of user, drive input information and correct driving attitude information,
Calculate the operation guidance information of user, feed back to force feedback equipment, by force feedback equipment, Operating Guideline is carried out to user, repair
Use the bad steering custom at family instead.
Also should include based on the driving training system of augmented reality and biofeedback：Multimedia audio device 11 is described many
Media audio device 11 is connected by holding wire with described control main frame 8, constitutes audio feedback system, and described multimedia audio fills
Put 11 for play described control main frame 8 simulate vehicle travel when engine sound, brake sound during brake, improve this based on
The driving training system of augmented reality and biofeedback is in experience acoustically and the feeling of immersion substantially increasing virtual environment.
Described automotive seat 15 is provided with safety belt 13, is connected by holding wire with described control main frame 8, controls main frame 8
Can detect user's whether fastening safety belt 13, and by safety belt setting fastening state by curved surface 3D display 2 Projection Display semi-transparent
On bright bend glass plate 4.
Below, in conjunction with accompanying drawing 6 to disclosed by the invention based on many in the driving training system of augmented reality and biofeedback
Use processing algorithm illustrates.First, user to gather EEG signals when notice is concentrated, and this process needs many
Secondary training, through training, it can be deduced that the EEG signals model concentrated of user.Then, the differentiation stage is entered.Pass through
Gathering the real-time EEG signals data of user, period utilizes frequency domain filtering, airspace filter scheduling algorithm to carry out original EEG signals
Pretreatment, improves signal to noise ratio so that signal characteristic becomes apparent from, by the brain telecommunications before treated EEG signals and user
Number model contrasts, and main contrast's α ripple, when human fatigue is driven, α ripple can strengthen.Survey simultaneously also by wireless electromyographic signal
Electromyographic signal is acquired by amount bracelet, is entered by the sEMG to user for the EMG sensor on wireless electromyographic signal measurement bracelet
Row Real-time Collection, after computer receives the signal of wireless electromyographic signal measurement bracelet, uses automatic wavelet transformation to calculate signal
Method is filtered, denoising, carries out, to the signal after denoising, the frequency spectrum that fast Fourier transform obtains sEMG signal.When user's
SEMG frequency spectrum occurs moving to left phenomenon, then show that muscular fatigue occurs in user.Differentiate after drawing User Status, fed back by computer
To user.User is when direction of operating dish is in kind, and by the force feedback of steering wheel, computer can obtain user operation steering wheel
Information, such as the anglec of rotation, angular speed, virtual image also can make corresponding operation.In virtual driving environment true to nature,
Under the assistance of brain electricity and electromyographic signal, user can obtain good driving experience and correct driving directions.
In sum, the driving training system based on augmented reality and biofeedback disclosed by the invention is calculated by use
Environment such as instrument in machine simulation real car, steering wheel, gearshift etc. and surface conditions, by curved surface 3D display
Projection, is shown as picture through the catoptric imaging principle of translucent bend glass plate, by adjusting the height of translucent bend glass plate
And level angle, virtual image and the platform in kind built can be made to overlap, steering wheel, throttle clutch and brake synthesize, change
Blocking means band force feedback, can synchronize with the vehicle running state of simulation in real time, let user experiencing real driving experience.
Using translucent bend glass plate, can increasing user and watch the visual range of virtual image, user can be according to specifically simultaneously
The type selecting of display adds 3D glasses to strengthen feeling of immersion.Additionally, this system has automatic error correction function, with force feedback
Steering wheel prompting user turn to, and throttle force feedback prompting user slow down, simultaneously by use wireless electromyographic signal measurement bracelet and
The easy belt brain wave acquisition helmet gathers the physiologic information of user, and EEG signals extract notice intensity, and electromyographic signal is extracted
Muscular tone degree, on live fluoroscopic to translucent bend glass plate, reaches real-time prompting user's driving condition, anti-by biology
Feedback, helps user to understand and improves oneself's driving habits.This system represents console instrument by 3D virtual image to user is seamless
Information of road surface before dial plate and car, thus save hardware cost of manufacture.
Above-described embodiment is the present invention preferably embodiment, but embodiments of the present invention are not by above-described embodiment
Limit, the change made under other any Spirit Essence without departing from the present invention and principle, modifications, replacement, combination, simplification,
All should be the substitute mode of equivalence, be included within protection scope of the present invention.
Claims (9)
1. the driving training system based on augmented reality and biofeedback, described driving training system includes：Curved surface 3D shows
Show device (2), translucent bend glass plate (4), support platform (7), control main frame (8), steering wheel (6), throttle clutch and stop
Car synthesis 9 and gearshift (12), wherein, described curved surface 3D display (2) is with described control main frame (8) by holding wire even
Connecing, the 3D image projecting being used for producing described control main frame (8) is to described translucent bend glass plate (4)；Described curved surface
3D display (2) and described translucent bend glass plate (4) are from top to bottom respectively arranged at the top of described support platform (7),
It is fixed on the display bracket being connected with described support platform (7) and fix bar (3)；Described steering wheel (6) and described gearshift
(12) being arranged in described support platform (7), described throttle clutch and brake synthesis (9) are arranged on described support platform (7)
Lower section, described steering wheel (6), described throttle clutch and brake synthesis (9), described gearshift (12) are main with described control
Machine (8) is connected by holding wire；
It is characterized in that, described driving training system also includes：Brain wave acquisition equipment (10) and myoelectricity collecting device (14), its
In, described brain wave acquisition equipment (10) wears the EEG signals of user for gathering, and is then transported to and described brain its signal
Described control main frame (8) that electricity collecting device (10) signal connects is processed；Described myoelectricity collecting device (14) is worn on use
In the large arm at family and forearm, for gathering the surface electromyogram signal of user, then its signal is transported to and described myoelectricity collection
Described control main frame (8) that equipment (14) signal connects is processed.
2. the driving training system based on augmented reality and biofeedback according to claim 1, it is characterised in that
Described curved surface 3D display (2) and described translucent bend glass plate (4) respectively by 3D display bracket (1) with semi-transparent
Bright bend glass board mount (5) is fixed on described display bracket and fixes on bar (3).
3. the driving training system based on augmented reality and biofeedback according to claim 2, it is characterised in that
Described translucent bend glass board mount (5) is solid by turning to corner fittings and screw and described display bracket to fix bar (3)
Fixed connection, height and the level angle of described translucent bend glass board mount (5) can be regulated as required.
4. the driving training system based on augmented reality and biofeedback according to claim 1, it is characterised in that
Described steering wheel (6), described throttle clutch and brake synthesis (9), described gearshift (12) are setting with force feedback
Standby, the said equipment, will be from user's state of mind letter of described control main frame (8) while gathering user operation control information
Breath, muscular states information, drive simulating information feed back to driving training user.
5. the driving training system based on augmented reality and biofeedback according to claim 1, it is characterised in that
Described brain wave acquisition equipment (10) is the easy belt brain wave acquisition helmet, gathers the brain electricity for extracting notice intensity
Signal.
6. the driving training system based on augmented reality and biofeedback according to claim 1, it is characterised in that
Described myoelectricity collecting device (14) is wireless electromyographic signal measurement bracelet, gathers the myoelectricity for extracting muscular tone degree
Signal.
7. the driving training system based on augmented reality and biofeedback according to claim 1, it is characterised in that
Described driving training system also includes：Automotive seat (15), height and the front and back position of described automotive seat (15) are adjustable
Joint.
8. the driving training system based on augmented reality and biofeedback according to claim 7, it is characterised in that
It is provided with safety belt (13) on described automotive seat (15), be connected by holding wire with described control main frame (8), described control
Main frame processed (8) can detect the whether fastening safety belt (13) of the user on described automotive seat (15), and by safety belt setting fastening state
By described curved surface 3D display (2) Projection Display on described translucent bend glass plate (4).
9. the driving training system based on augmented reality and biofeedback according to claim 1, it is characterised in that
Described driving training system also includes：Multimedia audio device (11), described multimedia audio device (11) and described control
Main frame processed (8) is connected by holding wire, and described multimedia audio device (11) is used for playing described control main frame (8) simulating vehicle
Brake sound when engine sound during traveling, brake.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610910634.XA CN106448339A (en) | 2016-10-19 | 2016-10-19 | Driving training system based on enhanced reality and biofeedback |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610910634.XA CN106448339A (en) | 2016-10-19 | 2016-10-19 | Driving training system based on enhanced reality and biofeedback |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106448339A true CN106448339A (en) | 2017-02-22 |
Family
ID=58177134
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610910634.XA Pending CN106448339A (en) | 2016-10-19 | 2016-10-19 | Driving training system based on enhanced reality and biofeedback |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106448339A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106937869A (en) * | 2017-04-06 | 2017-07-11 | 吴涛 | Driver's biology electroanalysis experimental system under brake hard operating mode based on Virtual Driving Platform |
| CN107545809A (en) * | 2017-09-28 | 2018-01-05 | 北京理工大学 | Training method and support intervention operative training system |
| CN107773254A (en) * | 2017-12-05 | 2018-03-09 | 苏州创捷传媒展览股份有限公司 | A kind of method and device for testing Consumer's Experience |
| CN107825469A (en) * | 2017-12-04 | 2018-03-23 | 河北工业大学 | A kind of both arms, which move, multiplies robot simulation's experiment porch and its method of testing |
| CN109064829A (en) * | 2018-08-14 | 2018-12-21 | 山东省科学院自动化研究所 | A kind of automatic driving vehicle visual ability test method and system |
| CN109116977A (en) * | 2017-06-22 | 2019-01-01 | 韩国电子通信研究院 | Virtual experience content providing and device for it |
| CN110236574A (en) * | 2019-07-15 | 2019-09-17 | 万东百胜(苏州)医疗科技有限公司 | A kind of ultrasonic doctor mood quantization method and device |
| CN110349469A (en) * | 2019-07-21 | 2019-10-18 | 李力 | A kind of boss bolt pretightning force controlled training system of HWIL simulation |
| CN111316342A (en) * | 2017-11-10 | 2020-06-19 | 株式会社艾洛克 | Automatic brake simulation experience device of four-wheel automobile |
| CN111402670A (en) * | 2020-05-09 | 2020-07-10 | 中国人民解放军陆军装甲兵学院 | High-speed tracked vehicle driving training auxiliary command system |
| CN111450380A (en) * | 2020-03-30 | 2020-07-28 | 重庆大学 | Driving fatigue intelligent detection warning awakening system based on near-infrared brain function imaging |
| CN113190114A (en) * | 2021-04-14 | 2021-07-30 | 三峡大学 | Virtual scene experience system and method with haptic simulation and emotional perception |
| CN114387832A (en) * | 2022-01-12 | 2022-04-22 | 安徽云轩教育科技有限公司 | Utilize teaching interactive device of AR technique |
| US20230084753A1 (en) * | 2021-09-16 | 2023-03-16 | Sony Group Corporation | Hyper realistic drive simulation |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1220741A (en) * | 1996-06-04 | 1999-06-23 | 齐诺技术有限公司 | Multiple viewer system for displaying plurality of images |
| CN101002686A (en) * | 2007-01-23 | 2007-07-25 | 武汉理工大学 | Analysis testing system for fatigue state of driver's fatigue based on driving simulator |
| CN104865703A (en) * | 2014-02-25 | 2015-08-26 | 崔海龙 | High Brightness Head-up Display Device |
| CN105511600A (en) * | 2015-07-31 | 2016-04-20 | 华南理工大学 | Multi-media man-machine interaction platform based on mixed reality |
| CN206584583U (en) * | 2016-10-19 | 2017-10-24 | 华南理工大学 | Driving training system based on augmented reality and biofeedback |
-
2016
- 2016-10-19 CN CN201610910634.XA patent/CN106448339A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1220741A (en) * | 1996-06-04 | 1999-06-23 | 齐诺技术有限公司 | Multiple viewer system for displaying plurality of images |
| CN101002686A (en) * | 2007-01-23 | 2007-07-25 | 武汉理工大学 | Analysis testing system for fatigue state of driver's fatigue based on driving simulator |
| CN104865703A (en) * | 2014-02-25 | 2015-08-26 | 崔海龙 | High Brightness Head-up Display Device |
| CN105511600A (en) * | 2015-07-31 | 2016-04-20 | 华南理工大学 | Multi-media man-machine interaction platform based on mixed reality |
| CN206584583U (en) * | 2016-10-19 | 2017-10-24 | 华南理工大学 | Driving training system based on augmented reality and biofeedback |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106937869A (en) * | 2017-04-06 | 2017-07-11 | 吴涛 | Driver's biology electroanalysis experimental system under brake hard operating mode based on Virtual Driving Platform |
| CN109116977A (en) * | 2017-06-22 | 2019-01-01 | 韩国电子通信研究院 | Virtual experience content providing and device for it |
| CN107545809A (en) * | 2017-09-28 | 2018-01-05 | 北京理工大学 | Training method and support intervention operative training system |
| CN111316342A (en) * | 2017-11-10 | 2020-06-19 | 株式会社艾洛克 | Automatic brake simulation experience device of four-wheel automobile |
| CN107825469A (en) * | 2017-12-04 | 2018-03-23 | 河北工业大学 | A kind of both arms, which move, multiplies robot simulation's experiment porch and its method of testing |
| CN107825469B (en) * | 2017-12-04 | 2023-09-08 | 河北工业大学 | Double-arm moving and riding robot simulation experiment platform and test method thereof |
| CN107773254A (en) * | 2017-12-05 | 2018-03-09 | 苏州创捷传媒展览股份有限公司 | A kind of method and device for testing Consumer's Experience |
| CN109064829A (en) * | 2018-08-14 | 2018-12-21 | 山东省科学院自动化研究所 | A kind of automatic driving vehicle visual ability test method and system |
| CN110236574A (en) * | 2019-07-15 | 2019-09-17 | 万东百胜(苏州)医疗科技有限公司 | A kind of ultrasonic doctor mood quantization method and device |
| CN110349469A (en) * | 2019-07-21 | 2019-10-18 | 李力 | A kind of boss bolt pretightning force controlled training system of HWIL simulation |
| CN111450380A (en) * | 2020-03-30 | 2020-07-28 | 重庆大学 | Driving fatigue intelligent detection warning awakening system based on near-infrared brain function imaging |
| CN111402670A (en) * | 2020-05-09 | 2020-07-10 | 中国人民解放军陆军装甲兵学院 | High-speed tracked vehicle driving training auxiliary command system |
| CN113190114A (en) * | 2021-04-14 | 2021-07-30 | 三峡大学 | Virtual scene experience system and method with haptic simulation and emotional perception |
| US20230084753A1 (en) * | 2021-09-16 | 2023-03-16 | Sony Group Corporation | Hyper realistic drive simulation |
| CN114387832A (en) * | 2022-01-12 | 2022-04-22 | 安徽云轩教育科技有限公司 | Utilize teaching interactive device of AR technique |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106448339A (en) | Driving training system based on enhanced reality and biofeedback | |
| CN206584583U (en) | Driving training system based on augmented reality and biofeedback | |
| CN110070944B (en) | Social function assessment training system based on virtual environment and virtual roles | |
| CN102354349B (en) | Human-machine interaction multi-mode early intervention system for improving social interaction capacity of autistic children | |
| Dijksterhuis et al. | Classifying visuomotor workload in a driving simulator using subject specific spatial brain patterns | |
| CN205903239U (en) | Visual acuity test and trainer based on virtual reality | |
| CN108919950A (en) | Autism children based on Kinect interact device for image and method | |
| Li et al. | The Effects of Applying Game-Based Learning to Webcam Motion Sensor Games for Autistic Students' Sensory Integration Training. | |
| CN111063416A (en) | Alzheimer disease rehabilitation training and capability assessment system based on virtual reality | |
| NZ560457A (en) | Image generation system | |
| CN109658771A (en) | Neurodevelopmental disorder traffic safety training system and method based on VR technology | |
| CN105511600A (en) | Multi-media man-machine interaction platform based on mixed reality | |
| CN105853162A (en) | Multi-mode vision improvement training system and training method thereof | |
| US20170113095A1 (en) | Device and method for restoring and developing hand functions | |
| Lee et al. | ADHD assessment and testing system design based on virtual reality | |
| Deniaud et al. | An investigation into physiological responses in driving simulators: An objective measurement of presence | |
| CN111443799A (en) | Auxiliary learning method based on brain-computer interface, terminal and computer storage medium | |
| CN111863261A (en) | Method and system for relieving virtual reality disease through adaptive training | |
| CN106618610A (en) | Head-worn terminal system oriented to social skill training of shy children | |
| US11914773B2 (en) | Brain-machine interface based intention determination device and method using virtual environment | |
| RU2666517C1 (en) | Method of rehabilitation of patients with impaired motor function using an automated information system for the implementation of audiovisual biofeedback | |
| EP2834802B1 (en) | Apparatus and method for aiding learning | |
| CN112245756A (en) | Attention training method based on single-channel electroencephalogram | |
| WO2009022924A1 (en) | Image generation system | |
| CN114129850A (en) | Training device for improving special attention of children |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170222 |