CN215298537U - Motor vehicle driving intelligent training system based on MR technology - Google Patents

Motor vehicle driving intelligent training system based on MR technology Download PDF

Info

Publication number
CN215298537U
CN215298537U CN202121479351.7U CN202121479351U CN215298537U CN 215298537 U CN215298537 U CN 215298537U CN 202121479351 U CN202121479351 U CN 202121479351U CN 215298537 U CN215298537 U CN 215298537U
Authority
CN
China
Prior art keywords
motor vehicle
driving
platform
motion
driver
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202121479351.7U
Other languages
Chinese (zh)
Inventor
郭柏淇
闫勉
马向东
杨明昊
吴清见
贾梦婷
郑钿
陈柄赞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jinan University
University of Jinan
Original Assignee
Jinan University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jinan University filed Critical Jinan University
Priority to CN202121479351.7U priority Critical patent/CN215298537U/en
Application granted granted Critical
Publication of CN215298537U publication Critical patent/CN215298537U/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Processing Or Creating Images (AREA)

Abstract

The utility model discloses a motor vehicle driving intelligence training system based on MR technique, this system include motor vehicle emulation cockpit, motion platform, first data processor and CAVE immersive MR audio-visual system, first data processor is connected with motion platform, motor vehicle emulation cockpit, CAVE immersive MR audio-visual system respectively, motor vehicle emulation cockpit still is connected with motion platform, CAVE immersive MR audio-visual system; the motor vehicle simulation cockpit is fixedly arranged on the motion platform and used for providing a driving operation environment for a driver; the motion platform is used for simulating the vibration condition of the vehicle in the driving process and feeding back the simulated driving road condition and the vehicle driving in real time. The utility model discloses utilize the MR technique to effectively solve the problem that the driver can't accurately interact with motor vehicle simulation system in virtual environment.

Description

Motor vehicle driving intelligent training system based on MR technology
Technical Field
The utility model relates to a motor vehicle driving intelligence training technical field, concretely relates to motor vehicle driving intelligence training system based on MR technique.
Background
The motor vehicle has become one of the necessary tools for people to go out. According to statistics, the number of motor vehicle drivers in China reaches 3.96 hundred million people and is in a high-speed growth situation. Most of motor vehicle driving training need all carry out real car operation in real environment, need higher manpower and material resources cost input, easily receive real environment factor (like training place, weather) influence, and have certain risk, especially to some drivers who newly contact the motor vehicle, because it has fear psychology and operation action not skilled when carrying out real car operation, bring bigger potential safety hazard for real car driving training. How to achieve more effective, safe and cost-effective motor vehicle driving training has become a problem to be addressed in the field.
With the development of virtual reality technology, some driving training is carried out by using a head-mounted full-immersion virtual reality technology and matching with a motor vehicle simulation cockpit in the market at present. However, the utility model discloses people find that adopt one of showing of this technique is exactly when the simulation motor vehicle is driven, and driver's sight is shielded by wear-type virtual reality equipment completely, leads to it to carry out the interaction with motor vehicle emulation cockpit accurately, for example transform the gear, step on accelerator pedal device or service brake device, and this will reduce the effect of motor vehicle driving training certainly.
And the MR (mixed reality) technology has been developed for more than 20 years, and the related technology has made remarkable progress and shows strong development prospect. Human-computer interaction is an important support technology of MR, and is a research hotspot at home and abroad in recent years. A large number of innovative MR applications, physical interaction, 3D interaction, multi-channel and hybrid interaction show great vitality in the applications, and the development of interaction technology is greatly promoted.
Disclosure of Invention
In order to overcome the defect and not enough that prior art exists, the utility model provides a motor vehicle driving intelligence training system based on MR technique utilizes the MR technique to provide the virtual audio-visual environment of multi-sense organ for the driver in the training process, makes it can be accurate simultaneously and carry out effective interaction with motor vehicle emulation cockpit.
In order to achieve the above purpose, the utility model adopts the following technical scheme:
an MR technology-based intelligent training system for motor vehicle driving is provided with a motor vehicle simulation cockpit, a motion platform and a first data processor, wherein the motor vehicle simulation cockpit is fixedly arranged on the motion platform and used for providing a driving operation environment for a driver, the motion platform is used for simulating the vibration condition of the vehicle in the driving process, and the first data processor is used for receiving a driver operation instruction and driving data acquired by the motor vehicle simulation cockpit and simulating the motion and audio-visual scenes in the motor vehicle driving process;
the motor vehicle driving intelligent training system based on the MR technology further comprises a CAVE immersive MR audio-visual system, wherein the CAVE immersive MR audio-visual system is respectively connected with the first data processor and the motor vehicle simulation cockpit;
the CAVE immersive MR audio-visual system comprises a CAVE main body support, a projection screen, a second data processor, 3D glasses and a surround stereo system, wherein the first data processor is respectively connected with the projection screen and the second data processor;
the projection screen and the surrounding stereo system are respectively and fixedly arranged on the CAVE main body support, so that a surrounding CAVE type stereo audio-visual space is formed, the projection screen is used for displaying an interactive interface of a virtual driving scene, and the 3D glasses are used for converting 2D video pictures output by two channels at different frequencies into 3D images.
As a preferred technical scheme, the CAVE immersive MR audiovisual system further comprises a plurality of groups of motion tracking cameras and a motion tracking module, wherein the plurality of groups of motion tracking cameras are connected with the first data processor and the CAVE main body bracket, and the motion tracking module is respectively connected with the motor vehicle simulation cockpit and the 3D glasses;
the multi-group motion tracking camera is respectively and fixedly arranged on the CAVE main body support, the multi-group motion tracking camera is used for capturing the motion situation of a driver in the process of driving simulation, the motion tracking module is used for capturing the sight line position information of the driver and the position information of the motor vehicle simulation cockpit, and the 3D glasses are used for converting 2D video pictures output by two channels at different frequencies into 3D images.
As a preferred technical scheme, the motor vehicle simulation cockpit is provided with an adjustable seat, a steering wheel device, a driving light control device, a motor vehicle starting switch, an accelerator pedal device, a driving brake device, a parking brake device, a clutch device, a gear shifting device, a collecting and detecting device, a driving guidance processor and a display;
the driving guidance processor is respectively connected with the adjustable seat, the steering wheel device, the running light control device, the motor vehicle starting switch, the accelerator pedal device, the running brake device, the parking brake device, the clutch device, the gear shifting device, the acquisition and detection device and the display;
the driving guidance processor is embedded in the display, the driving guidance processor is used for providing real-time driving guidance information for a driver, and the display is used for displaying the real-time driving guidance information;
the acquisition and detection device comprises a steering angle sensor, a pressure sensor and a displacement sensor, wherein the steering angle sensor is used for detecting the rotation angle of a steering wheel, the pressure sensor is used for detecting the pressure born by a brake pedal and an accelerator in the trampling process, and the displacement sensor is used for detecting the displacement of the brake pedal and the accelerator in the trampling process.
As the preferred technical scheme, the projection screen is provided with at least 3 OLED high-definition display screens, and the OLED high-definition display screens are sequentially connected to form an annular structure.
As a preferred technical scheme, the projection screen adopts a flexible curved screen, and the flexible curved screen is connected end to form an annular structure and is arranged on the outer periphery of the motor vehicle simulation cockpit.
As an optimal technical scheme, the projection screen is provided with 3 OLED high-definition display screens, the 3 OLED high-definition display screens are sequentially connected to form a U-shaped structure, and the 3 OLED high-definition display screens are respectively arranged in the front, the left side and the right side of the motor vehicle simulation cockpit.
As an optimal technical scheme, the projection screen adopts a flexible curved screen, the flexible curved screen is bent to form a U shape, and the flexible curved screen surrounds the front, the left side and the right side of the motor vehicle simulation cockpit.
Preferably, the motion tracking module includes a first motion tracking component and a second motion tracking component, the first motion tracking component is fixedly disposed on the 3D glasses, and the second motion tracking component is disposed at a front end portion of the simulated cockpit of the vehicle.
As a preferred technical scheme, the motion platform is provided with a six-degree-of-freedom platform, a servo driver and a microcontroller, the servo driver is respectively connected with the six-degree-of-freedom platform and the microcontroller, the servo driver is used for driving the six-degree-of-freedom platform, and the microcontroller is used for providing driving parameters of the servo driver;
the six-degree-of-freedom platform comprises an upper platform, a lower platform fixedly arranged on the ground and 6 hydraulic electric cylinders, wherein the 6 hydraulic electric cylinders are respectively connected with the upper platform and the lower platform, the six-degree-of-freedom platform adopts a Stewart structure, and the motor vehicle simulation cockpit is fixedly arranged above the upper platform;
the 6 hydraulic electric cylinders are driven by a servo driver to realize the motion of the six-degree-of-freedom platform;
the motion platform is further provided with six-dimensional force sensors, the six-dimensional force sensors are respectively arranged at the connecting nodes of the upper platform and the hydraulic electric cylinders, and the six-dimensional force sensors are arranged on the six-degree-of-freedom platform.
As a preferred technical scheme, the motion platform is further provided with a handheld terminal, and the handheld terminal is in wireless connection with the microcontroller.
Compared with the prior art, the utility model, following advantage and beneficial effect have:
(1) the utility model discloses when carrying out motor vehicle driving training, the driver is in indoor fixed environment, does not receive factors influences such as driving training place, weather, vehicle, pedestrian, and this will effectively reduce the psychological fear when the driver just learns to drive, and the training process has higher security, avoids because of the influence that various real environment factors caused to the real vehicle operation, even if the circumstances such as vehicle is cut to pieces and rubbed, the collision appear in virtual environment, also can not cause actual personnel casualties, and then has improved the factor of safety of motor vehicle driving training; and simultaneously, the utility model discloses only adopt renewable energy such as electric energy when driving the training, no fuel consumption and real car wearing and tearing, drive the more green of training mode, consequently the utility model discloses it is safer, environmental protection more to drive the training process at the motor vehicle.
(2) Compare in traditional wear-type virtual reality technique, the utility model discloses see through 3D glasses and will throw the video content of screen on OLED high definition display screen and turn into the 3D picture, utilize the light transmissivity nature of 3D glasses simultaneously, for each subassembly in the driver can accurate positioning motor vehicle simulation system, for example steering wheel device, accelerator pedal device, service brake device, parking arresting gear, clutch etc to utilize the MR technique to effectively solve the problem that the driver can't accurately interact with motor vehicle simulation system in virtual environment.
Drawings
Fig. 1 is a schematic structural diagram of an intelligent training system for motor vehicle driving based on MR technology in embodiment 1 of the present invention;
fig. 2 is a schematic view of a projection screen in embodiment 1 of the present invention adopting a quadrilateral ring structure;
fig. 3 is a schematic view of a projection screen in embodiment 2 of the present invention, which adopts a triangular ring structure;
fig. 4 is a schematic view of a projection screen in embodiment 2 of the present invention, which has a circular ring structure;
fig. 5 is a schematic view of a projection screen in embodiment 2 of the present invention adopting a U-shaped structure.
The system comprises a motor vehicle simulation cockpit, a 2-motion platform and a 3-projection screen.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Examples
Example 1
As shown in fig. 1, the present embodiment provides an intelligent training system for motor vehicle driving based on MR technology, which includes a motor vehicle simulation cockpit 1, a motion platform 2, a first data processor, and a CAVE immersive MR audiovisual system, where CAVE is a CAVE Automatic Virtual Environment. The first data processor is respectively connected with the motion platform 2, the motor vehicle simulation cockpit 1 and the CAVE immersive MR audio-visual system, and the motor vehicle simulation cockpit 1 is also connected with the motion platform 2 and the CAVE immersive MR audio-visual system.
The motor vehicle simulation cockpit 1 is used for providing a driving operation environment for a driver, and the motion platform 2 is used for simulating vehicle vibration conditions in a driving process, such as turning, braking and the like, and feeding back the simulated driving road condition and vehicle driving in real time to improve the driving experience of the driver.
In the embodiment, a motor vehicle simulation cockpit 1 is fixedly arranged on a motion platform 2, and the motor vehicle simulation cockpit 1 is provided with an adjustable seat, a steering wheel device, a driving light control device, a motor vehicle starting switch, an accelerator pedal device, a driving brake device, a parking brake device, a clutch device, a gear shifting device, a collecting and detecting device, a driving guidance processor and a display.
The driving guidance processor is respectively connected with the adjustable seat, the steering wheel device, the running light control device, the motor vehicle starting switch, the accelerator pedal device, the running brake device, the parking brake device, the clutch device, the gear shifting device, the acquisition and detection device and the display. The acquisition and detection device is respectively connected with the steering wheel device, the accelerator pedal device, the service brake device, the parking brake device, the clutch device and the gear shifting device. The components are matched for use to simulate the real-vehicle operation process of a driver, the driver operates the components to generate a driver operation instruction, and the motor vehicle simulation cockpit 1 acquires the driver operation instruction and transmits the driver operation instruction to the first data processor for processing. The corresponding road condition information and the vehicle pose state are resolved by the first data processor and then fed back to the motion platform 2 and the CAVE immersive MR audio-visual system, so that the motor vehicle simulation cockpit 1 is driven to simulate the effects of vehicle vibration, acceleration, deceleration, turning, impact and the like, and the sensory effect of a driver in the MR environment is improved. Meanwhile, the driving guidance processor is embedded in the display and used as a tablet personal computer, provides real-time driving guidance information for a driver, such as the speed, the safety distance from a front vehicle, whether a steering lamp is turned during turning, the gear shifting time, the accelerator and the brake condition, and is used for displaying the real-time driving guidance information.
In practical application, after a driver completes a vehicle driving training, the related vehicle driving condition can be known through the tablet personal computer positioned on one side of the steering wheel device, so that the driver is helped to improve the driving skill of the motor vehicle.
After the motion and audio-visual simulation output of the motor vehicle is finished, the specific action information of the driver is collected through the collecting and detecting device, so that data support is provided for the driving performance analysis. During practical application, the acquisition and detection device comprises one or more of a steering angle sensor, a pressure sensor and a displacement sensor, the steering angle sensor is used for detecting the rotation angle of a steering wheel, the pressure sensor is used for detecting the pressure born by a brake pedal and an accelerator in the treading process, and the displacement sensor is used for detecting the displacement of the brake pedal and the accelerator in the treading process. In practice, the steering angle sensor employs a device for determining the angular position of the steering wheel shaft, such as a steering column, which comprises a coil assembly, a coil support and a coupler element having a coupler angular position related to the angular position of the steering wheel shaft. The coil assembly includes a transmitter coil and at least one receiver coil, the coupler element for altering the inductive coupling between the transmitter coil, the signal processing circuitry and the at least one receiver coil. The signal processing circuit receives a coil signal from the coil assembly and a reference signal, which is related to the axial displacement but otherwise substantially independent of the angular position, and determines the angular position using the receiver signal and the reference signal. The left or right turn of the steering wheel is detected by the steering angle sensor, and a correct steering command is issued. The rotation angle of the steering wheel provides basis for realizing the steering amplitude of the automobile, so that the automobile runs according to the steering intention of a driver. The steering angle sensor is composed of a photoelectric coupling element, a perforated slotted plate and the like. The photoelectric coupling element is a light emitting diode and a photosensitive transistor. The open-cell slot plate is arranged between the light-emitting diode and the photosensitive transistor. The perforated slotted plate has a plurality of small holes. When the steering wheel rotates, the perforated slotted plate rotates along with the steering wheel. The phototransistor operates according to light passing through the aperture plate and outputs a digital pulse signal. And the steering angle, the rotating direction and the rotating speed of the steering wheel are identified according to the signals. The pressure sensor adopts an oil pressure sensor, a semiconductor strain gauge is arranged in the oil pressure sensor, and the resistance of the strain gauge changes when the strain gauge deforms; in addition, the metal sheet is also arranged, and the change of the pressure is detected by the metal diaphragm strain gauge, converted into an electric signal and then output to the outside. The displacement sensor adopts a magnetostrictive displacement sensor, and the absolute position of the movable magnetic ring is accurately detected by an internal non-contact measurement and control technology to measure the actual displacement values of the brake pedal and the accelerator in the treading process.
The first data processor is used for receiving the driver operation instructions and driving data collected by all components in the motor vehicle simulation cockpit 1 and simulating the motion and audio-visual scenes in the motor vehicle driving process. Specifically, the first data processor feeds back driving motion process data to the motion platform 2 and the CAVE immersive MR audio-visual system in real time, and then simulates and outputs motion and audio-visual scenes in the driving process of the motor vehicle. In practical application, the driver operation instruction comprises steering wheel angle control, accelerator control, brake control, clutch control, gear control and the like, and the driving data comprises steering wheel angles, opening and closing amplitudes of various pedals and gear values.
In this embodiment, the motion platform 2 is provided with a six-degree-of-freedom platform, a servo driver and a microcontroller, and the servo driver is respectively connected with the six-degree-of-freedom platform and the microcontroller. The servo driver is used for driving the six-degree-of-freedom platform, and the microcontroller is used for providing driving parameters of the servo driver.
In this embodiment, the six-degree-of-freedom platform comprises an upper platform, a lower platform fixedly arranged on the ground and 6 hydraulic electric cylinders, wherein the 6 hydraulic electric cylinders are respectively connected with the upper platform and the lower platform, and the six-degree-of-freedom platform adopts a Stewart structure and then utilizes the hydraulic electric cylinders to support the upper platform. Specifically, each hydraulic electric cylinder is connected with the upper platform and the lower platform by a hook joint. In practical application, the 6 hydraulic electric cylinders are driven by a servo driver to realize the motion of the six-degree-of-freedom platform, specifically, the first data processor receives a driver operation instruction and driving data collected by a motor vehicle simulation cockpit 1, a hydraulic electric cylinder length adjusting value is obtained by resolving the pose and the hydraulic electric cylinder length of the motion platform 2, and then the hydraulic electric cylinder length adjusting value is sent to the microcontroller to adjust the hydraulic electric cylinder length, so that the motion of the upper platform in six degrees of freedom is realized; the motions of the upper platform in six degrees of freedom are three translation motions in a Cartesian coordinate system and rotation around three coordinate axes.
In this embodiment, the motion platform 2 is further provided with a six-dimensional force sensor and a handheld terminal, the six-dimensional force sensor is respectively arranged at a connection node of the upper platform and the hydraulic electric cylinder, and the six-dimensional force sensor is arranged on the six-degree-of-freedom platform. When the six-degree-of-freedom platform starts to work, the six-dimensional force sensor senses the pressure values at the six connecting nodes in real time and feeds the pressure values back to the first data processor. The handheld terminal is in wireless connection with the microcontroller, and the handheld terminal is used for emergently braking the servo driver to stop the six-degree-of-freedom platform, so that the braking effect of the motor vehicle simulation cockpit 1 is achieved, and accidents of a driver caused by incapability of braking under the condition of out-of-control equipment are avoided.
In the present exemplary embodiment, the motor vehicle simulation cockpit 1 is arranged in a particularly fixed manner above the upper platform.
In this embodiment, the CAVE immersive MR audiovisual system includes a CAVE body mount, a projection screen 3, a second data processor, a plurality of sets of motion tracking cameras, a motion tracking module, and 3D glasses and a surround stereo system. The first data processor is respectively connected with the plurality of groups of motion tracking cameras, the projection screen 3 and the second data processor, the CAVE main body support is respectively connected with the plurality of groups of motion tracking cameras and the surrounding stereo system, the second data processor is respectively connected with the projection screen 3 and the surrounding stereo system, and the motion tracking module is respectively connected with the motor vehicle simulation cockpit 1 and the 3D glasses.
As shown in fig. 2, the projection screen 3 adopts a plurality of OLED high-definition display screens, specifically, 4 OLED high-definition display screens are sequentially connected to form a quadrilateral ring structure, and the projection screen 3 and the surround stereo system are respectively and fixedly disposed on the CAVE main body support, so as to form a surround CAVE stereo audiovisual space. The motion tracking modules are used for capturing sight line position information of the driver and position information of a motor vehicle simulation cockpit 1; the multiple groups of motion tracking cameras are fixedly arranged in different dimensions of an audio-visual space respectively, are hung in corner regions around the CAVE main body support, or are hung on the side surfaces around the CAVE main body support, and are used for taking pictures to obtain more accurate driving action information; the plurality of motion tracking modules comprise a first motion tracking component and a second motion tracking component, the first motion tracking component is fixedly arranged on the 3D glasses, and the second motion tracking component is arranged at the front end part of the motor vehicle simulation cockpit 1; in practical application, the motion tracking module adopts a positioning instrument, in particular a Bluetooth positioner. The multiple groups of motion tracking cameras collect driving images of a driver.
When the driver carries out virtual driving activity, utilize 3D glasses to combine projection screen 3 to show, 2D video picture with the different frequency output of binary channels turns into the 3D image, combine motion tracking camera and motion tracking module to obtain the motion tracking condition, second data processor is with driver operating instruction and drive data transmission to first data processor and then adjust motion platform 2, second data processor still feeds back the video picture on 4 high definition OLED display screens, and then the output picture on the projection screen 3 can be adjusted in real time along with the motion condition of driver's head and vehicle, with bad effects such as dizzy sense that reduction driver produced under the virtual reality environment. Specifically, the second data processor analyzes the motion tracking situation and outputs the motion tracking video and the motion tracking audio signals to the OLED high-definition display screen and the surround stereo system in real time, and the video content projected on the OLED high-definition display screen is converted into a 3D picture through the 3D glasses so as to enhance the audio-visual effect of the driver in the MR environment, so that a motor vehicle simulation driving environment is provided for the driver, and the motor vehicle is further controlled, such as acceleration, braking, gear shifting, turning and the like.
In the present embodiment, the projection screen 3 is used to display an interactive interface of a virtual driving scene.
In the embodiment, the intelligent training system for motor vehicle driving based on the MR technology is also provided with a data storage, and the second data processor is connected with the data storage. In practical application, the second data processor specifically adopts a computer group configured with a high-performance display card, the data memory specifically adopts a database server, and the data memory stores and records data processed by the second data processor.
In this embodiment, the first data processor specifically employs a central control computer. In addition, a person skilled in the art may also implement a corresponding processing analysis function by using a server based on a cloud platform according to an actual situation, and the first data processor is not limited in this embodiment.
Example 2
The structure of the projection screen 3 is expanded in this embodiment 2 based on embodiment 1, and this embodiment provides an expanded ring structure and a U-shaped structure.
Specifically, in the ring structure, as shown in fig. 3, the projection screen 3 adopts 3 OLED high-definition display screens which are connected in sequence to form a triangular ring structure, the OLED high-definition display screens form corner regions at the joints, and the multiple sets of motion tracking cameras are respectively suspended in the corner regions. The plurality of groups of motion tracking cameras can be further respectively arranged on one side of the plane where each OLED high-definition display screen is located, and the specific hanging position of the plurality of groups of motion tracking cameras is not limited in the embodiment.
In addition, the OLED high-definition display screens with 5 or 6 or more numbers can be connected in sequence to form a ring structure by the person skilled in the art.
As shown in fig. 4, the projection screen 3 may also be a flexible curved screen which is connected end to form a circular ring structure and is disposed around the outer periphery of the simulated cockpit 1 of the vehicle.
As shown in fig. 5, in the U-shaped structure, the projection screen 3 adopts 3 OLED high-definition display screens, the 3 OLED high-definition display screens are sequentially connected to form the U-shaped structure, and the 3 OLED high-definition display screens are respectively arranged in front of, on the left of, and on the right of the motor vehicle simulation cockpit 1. In addition, the projection screen 3 can also adopt a flexible curved screen which is bent to form a U shape and surrounds the front, the left side and the right side of the motor vehicle simulation cockpit 1 so as to enable a driver to obtain the visual field in the front, the left and the right directions.
The above embodiments are preferred embodiments of the present invention, but the embodiments of the present invention are not limited to the above embodiments, and any other changes, modifications, substitutions, combinations, and simplifications which do not depart from the spirit and principle of the present invention should be equivalent replacement modes, and all are included in the scope of the present invention.

Claims (10)

1. An MR technology-based intelligent training system for motor vehicle driving is provided with a motor vehicle simulation cockpit, a motion platform and a first data processor, wherein the motor vehicle simulation cockpit is fixedly arranged on the motion platform and is used for providing a driving operation environment for a driver, the motion platform is used for simulating the vibration condition of the vehicle in the driving process, and the first data processor is used for receiving a driver operation instruction and driving data acquired by the motor vehicle simulation cockpit and simulating the motion and audio-visual scenes in the motor vehicle driving process;
the CAVE immersive MR audio-visual system comprises a CAVE main body support, a projection screen, a second data processor, 3D glasses and a surround stereo system, wherein the first data processor is respectively connected with the projection screen and the second data processor;
the projection screen and the surrounding stereo system are respectively and fixedly arranged on the CAVE main body support, so that a surrounding CAVE type stereo audio-visual space is formed, the projection screen is used for displaying an interactive interface of a virtual driving scene, and the 3D glasses are used for converting 2D video pictures output by two channels at different frequencies into 3D images.
2. The MR technology based intelligent training system for motor vehicle driving according to claim 1, wherein the CAVE immersive MR audiovisual system further comprises a plurality of sets of motion tracking cameras and a motion tracking module, the plurality of sets of motion tracking cameras are connected with the first data processor and the CAVE main body support, and the motion tracking module is respectively connected with the motor vehicle simulation cockpit and the 3D glasses;
the multi-group motion tracking cameras are respectively and fixedly arranged on the CAVE main body support, the multi-group motion tracking cameras are used for capturing the motion condition of a driver in the driving simulation process, and the motion tracking module is used for capturing the sight line position information of the driver and the position information of the motor vehicle simulation cockpit.
3. The intelligent training system for motor vehicle driving based on MR technology as claimed in claim 1, wherein the motor vehicle simulation cockpit is provided with an adjustable seat, a steering wheel device, a running light control device, a motor vehicle start switch, an accelerator pedal device, a running brake device, a parking brake device, a clutch device, a gear shifting device, a collecting and detecting device, a driving guidance processor and a display;
the driving guidance processor is respectively connected with the adjustable seat, the steering wheel device, the running light control device, the motor vehicle starting switch, the accelerator pedal device, the running brake device, the parking brake device, the clutch device, the gear shifting device, the acquisition and detection device and the display;
the driving guidance processor is embedded in the display, the driving guidance processor is used for providing real-time driving guidance information for a driver, and the display is used for displaying the real-time driving guidance information;
the acquisition and detection device comprises a steering angle sensor, a pressure sensor and a displacement sensor, wherein the steering angle sensor is used for detecting the rotation angle of a steering wheel, the pressure sensor is used for detecting the pressure born by a brake pedal and an accelerator in the trampling process, and the displacement sensor is used for detecting the displacement of the brake pedal and the accelerator in the trampling process.
4. The MR-technology-based intelligent training system for motor vehicle driving as claimed in claim 1, wherein the projection screen is provided with at least 3 OLED high-definition display screens, and the OLED high-definition display screens are connected in sequence to form a ring structure.
5. The MR technology based intelligent training system for motor vehicle driving as claimed in claim 1, wherein the projection screen is a flexible curved screen, and the flexible curved screen is connected end to form a ring structure and is arranged around the outer periphery of the simulated cockpit of the motor vehicle.
6. The MR-technology-based intelligent training system for motor vehicle driving according to claim 1, wherein the projection screen is provided with 3 OLED high-definition display screens, the 3 OLED high-definition display screens are sequentially connected to form a U-shaped structure, and the 3 OLED high-definition display screens are respectively arranged in front of, on the left side of and on the right side of the motor vehicle simulation cockpit.
7. The intelligent training system for motor vehicle driving based on MR technology as claimed in claim 1, wherein the projection screen is a flexible curved screen, the flexible curved screen is bent to form a U shape, and the flexible curved screen surrounds the front, the left side and the right side of the simulated cockpit of the motor vehicle.
8. The MR technology based intelligent training system for motor vehicle driving as claimed in claim 1, wherein the motion tracking module comprises a first motion tracking component and a second motion tracking component, the first motion tracking component is fixedly arranged on the 3D glasses, and the second motion tracking component is arranged on the front end portion of the simulated cockpit of the motor vehicle.
9. The MR technology based intelligent training system for motor vehicle driving according to claim 1, wherein the motion platform is provided with a six-degree-of-freedom platform, a servo driver and a microcontroller, the servo driver is respectively connected with the six-degree-of-freedom platform and the microcontroller, the servo driver is used for driving the six-degree-of-freedom platform, and the microcontroller is used for providing driving parameters of the servo driver;
the six-degree-of-freedom platform comprises an upper platform, a lower platform fixedly arranged on the ground and 6 hydraulic electric cylinders, wherein the 6 hydraulic electric cylinders are respectively connected with the upper platform and the lower platform, the six-degree-of-freedom platform adopts a Stewart structure, and the motor vehicle simulation cockpit is fixedly arranged above the upper platform;
the 6 hydraulic electric cylinders are driven by a servo driver to realize the motion of the six-degree-of-freedom platform;
the motion platform is further provided with six-dimensional force sensors, the six-dimensional force sensors are respectively arranged at the connecting nodes of the upper platform and the hydraulic electric cylinders, and the six-dimensional force sensors are arranged on the six-degree-of-freedom platform.
10. The MR technology based intelligent training system for motor vehicle driving as claimed in claim 9, wherein the motion platform is further provided with a handheld terminal, and the handheld terminal is wirelessly connected with the microcontroller.
CN202121479351.7U 2021-06-30 2021-06-30 Motor vehicle driving intelligent training system based on MR technology Active CN215298537U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202121479351.7U CN215298537U (en) 2021-06-30 2021-06-30 Motor vehicle driving intelligent training system based on MR technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202121479351.7U CN215298537U (en) 2021-06-30 2021-06-30 Motor vehicle driving intelligent training system based on MR technology

Publications (1)

Publication Number Publication Date
CN215298537U true CN215298537U (en) 2021-12-24

Family

ID=79519899

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202121479351.7U Active CN215298537U (en) 2021-06-30 2021-06-30 Motor vehicle driving intelligent training system based on MR technology

Country Status (1)

Country Link
CN (1) CN215298537U (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113327479A (en) * 2021-06-30 2021-08-31 暨南大学 Motor vehicle driving intelligent training system based on MR technology

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113327479A (en) * 2021-06-30 2021-08-31 暨南大学 Motor vehicle driving intelligent training system based on MR technology
CN113327479B (en) * 2021-06-30 2024-05-28 暨南大学 MR technology-based intelligent training system for driving motor vehicle

Similar Documents

Publication Publication Date Title
CN110262469B (en) Automatic driving control system and method applied to agricultural vehicle
CN112924185B (en) Human-computer co-driving test method based on digital twin virtual-real interaction technology
CN104036668A (en) Intelligent automobile simulating driving device
CN109636924B (en) Vehicle-mounted multi-mode augmented reality system based on real road condition information three-dimensional modeling
CN107323459B (en) Method for identifying driver intention identifying sensor device
CN113327479B (en) MR technology-based intelligent training system for driving motor vehicle
CN105551182A (en) Driving state monitoring system based on Kinect human body posture recognition
CN215298537U (en) Motor vehicle driving intelligent training system based on MR technology
CN106863307A (en) A kind of view-based access control model and the robot of speech-sound intelligent control
CN1904806A (en) System and method of contactless position input by hand and eye relation guiding
CN106774325A (en) Robot is followed based on ultrasonic wave, bluetooth and vision
CN108944919A (en) The method and system with the perception scene figure of focal zone is generated for motor vehicles
CN105045397A (en) Method for testing influence of illumination environment in tunnel on on-service tunnel operation safety
CN106846350A (en) One kind is based on RGB D cameras and stereosonic visually impaired people's barrier early warning system and method
CN109300357A (en) A kind of simulation system driving racing motorcycle
CN101770707B (en) Camera based virtual vehicle driving system and virtual driving method
CN2837955Y (en) Automobile steering emulator
CN202748964U (en) Computer-based virtual drive system
CN114063466A (en) Auxiliary driving system detection method based on virtual simulation scene
JP4163624B2 (en) Automatic work system
CN110539638A (en) method and device for assisting driving of traffic equipment
CN201576364U (en) Virtual automobile driving system based on camera
CN203858775U (en) Simulation drive device of intelligent car
CN204204236U (en) A kind of driving simulator
CN216356901U (en) Vehicle-mounted information acquisition device for motorcycle examination

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant