CN219266904U - Vehicle-mounted mixed reality experience expansion system - Google Patents
Vehicle-mounted mixed reality experience expansion system Download PDFInfo
- Publication number
- CN219266904U CN219266904U CN202320295378.3U CN202320295378U CN219266904U CN 219266904 U CN219266904 U CN 219266904U CN 202320295378 U CN202320295378 U CN 202320295378U CN 219266904 U CN219266904 U CN 219266904U
- Authority
- CN
- China
- Prior art keywords
- vehicle
- mixed reality
- head display
- interface
- cabin
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The utility model discloses a vehicle-mounted mixed reality experience expansion system, which comprises: the vehicle-mounted control mechanism is used for issuing control instructions and providing a power supply interface and a communication interface; the expansion processing mechanism is used for starting and closing the head display mechanism and the transmitted audio and video data according to the control instruction issued by the vehicle-mounted control mechanism; the head display mechanism is used for receiving and displaying the audio and video data; the in-cabin tracking mechanism is used for positioning the position and the posture of the head display mechanism; the head display mechanism comprises mixed reality glasses and an antenna enveloped on the mixed reality glasses; the in-cabin tracking mechanism is communicated with the expansion processing mechanism through the vehicle-mounted control mechanism, and the expansion processing mechanism is communicated with the head display mechanism. According to the vehicle-mounted mixed reality experience expansion system, the head display data are processed through the external processor, so that the burden of a vehicle-mounted control system is reduced.
Description
Technical Field
The utility model relates to a mixed reality technology, in particular to a vehicle-mounted mixed reality experience expansion system.
Background
In the current front intelligent cabin scene, the passengers are limited by seats and space in the cabin, and in the driving process, the personnel need to be fixed on the seats, even if a vehicle-mounted screen is arranged, the interaction is inconvenient, the fixed screen is observed in a moving space, the passengers are easy to feel dizziness, and a hybrid display technology is provided for solving the problems.
Mixed Reality (MR), which includes both augmented reality and augmented virtual, refers to a new visual environment created by merging the real and virtual worlds. Physical and digital objects coexist in the new visualization environment and interact in real time. The system combines the virtual and reality, projects the virtual in a real three-dimensional space, is more and more applied to intelligent driving, and as CN201810484966.5 discloses a mixed reality road display system, the system can receive real-time road conditions in the process of driving everywhere by designing a relay station, and can maintain the update of the road conditions at any time and improve the accuracy through a scanning module, so that the technical effect of receiving a virtual mixed model in real time in the driving process is achieved.
However, the mixed reality experience needs to perform the work of consuming computation such as dual-purpose 3D space rendering, space positioning, man-machine interaction and the like, so that the original vehicle-mounted computing platform is difficult to simultaneously bear. Meanwhile, the existing mixed reality head display integrated equipment is difficult to consider light, performance and endurance due to space limitation of head-mounted equipment.
Disclosure of Invention
In order to solve the problems, the utility model provides the vehicle-mounted mixed reality experience expansion system, which is characterized in that expansion processing is independently arranged, a central gateway is accessed through a vehicle-mounted data interface, the system is accessed with an original vehicle-mounted control mechanism, rendering calculation of 3D content is independently performed, and the rendered audio and video content is transmitted to a head display through wireless, so that the single of the vehicle-mounted control mechanism is lightened.
In order to achieve the above object, the present utility model provides a vehicle-mounted mixed reality experience expansion system, including:
the vehicle-mounted control mechanism is used for issuing control instructions and providing a power supply interface and a communication interface;
the expansion processing mechanism is used for starting and closing the head display mechanism and the transmitted audio and video data according to the control instruction issued by the vehicle-mounted control mechanism;
the head display mechanism is used for receiving and displaying the audio and video data;
the in-cabin tracking mechanism is used for positioning the position and the posture of the head display mechanism;
the head display mechanism comprises mixed reality glasses and an antenna enveloped on the mixed reality glasses;
the in-cabin tracking mechanism is communicated with the expansion processing mechanism through the vehicle-mounted control mechanism, and the expansion processing mechanism is communicated with the head display mechanism.
Preferably, the expansion processing mechanism comprises a single board computer and an MR signal generator;
the single board computer comprises a power interface, a vehicle data interface, a pose receiving module, a data receiving module, a software starter and a processor which are connected with the vehicle-mounted control mechanism;
the in-cabin tracking mechanism is respectively connected with the pose receiving module, the data receiving module and the software starter through a central gateway of the vehicle-mounted control mechanism, the pose receiving module, the data receiving module and the software starter are connected with the processor, the processor is sequentially connected with the MR signal generator through an MR head display interface and an encoding module, and the MR signal generator is communicated with a decoding module arranged on the mixed reality glasses through an antenna.
Preferably, the in-cabin tracking mechanism comprises an infrared camera group arranged in the vehicle corresponding to a user and a head display tag arranged on the outer wall of the mixed reality glasses, wherein the infrared camera is communicated with the central gateway through a vehicle-to-machine data interface and is used for transmitting video streams to the central gateway and then to the expansion processing mechanism through the central gateway;
the head display label is an infrared LED.
Preferably, the infrared camera group comprises four groups of corner infrared cameras positioned at four corners of the user and a top infrared camera positioned above the user.
Preferably, the corner infrared camera and the top infrared camera are both high-speed wide-angle infrared cameras.
Preferably, the utility model further comprises a storage charging box, wherein a charging interface electrically connected with the vehicle-mounted control mechanism is arranged in the storage charging box and used for charging the head display mechanism when the head display mechanism is stored.
Compared with the prior art, the utility model has the following beneficial effects:
1. the processing burden of the vehicle-mounted control mechanism is reduced by independently arranging the expansion processing mechanism;
2. through setting up the storage charging box, reduced the size of mixing display glasses, guaranteed simultaneously to mix the duration of display glasses.
The technical scheme of the utility model is further described in detail through the drawings and the embodiments.
Drawings
FIG. 1 is a block diagram of the structure of the present utility model;
FIG. 2 is a layout of the present utility model
FIG. 3 is an outline view of the development processing mechanism of the present utility model.
Wherein: 1. a user; 2. mixed reality glasses; 3. a top infrared camera; 4. corner infrared cameras; 5. an in-cabin tracking mechanism; 51. MR signal generator.
Detailed Description
The present utility model will be further described with reference to the accompanying drawings, and it should be noted that, while the present embodiment provides a detailed implementation and a specific operation process on the premise of the present technical solution, the protection scope of the present utility model is not limited to the present embodiment.
An in-vehicle mixed reality experience expansion system, comprising:
the vehicle-mounted control mechanism is used for issuing control instructions and providing a power supply interface and a communication interface; the control instructions of the present embodiment include highest authority instructions such as, for example, start, end, pause, etc.
The expansion processing mechanism is used for starting and closing the head display mechanism and the transmitted audio and video data according to a control instruction issued by the vehicle-mounted control mechanism, and the expansion processing mechanism in the embodiment is placed in the protection box and then fixed with the vehicle body;
the head display mechanism is used for receiving and displaying the audio and video data;
an in-cabin tracking mechanism 5 for positioning the position and posture of the head display mechanism;
the head display mechanism comprises a mixed reality glasses 2 and an antenna enveloped on the mixed reality glasses 2;
the in-cabin tracking mechanism 5 is communicated with the expansion processing mechanism through the vehicle-mounted control mechanism, and the expansion processing mechanism is communicated with the head display mechanism.
Preferably, the expansion processing mechanism comprises a single board computer and an MR signal generator 51;
the single board computer comprises a power interface and a vehicle data interface which are connected with the vehicle-mounted control mechanism, a pose receiving module, a data receiving module, a software starter and a processor;
the in-cabin tracking mechanism 5 is respectively connected with the pose receiving module, the data receiving module and the software starter through a central gateway of the vehicle-mounted control mechanism, the pose receiving module, the data receiving module and the software starter are connected with the processor, the processor is sequentially connected with the MR signal generator 51 through the MR head display interface and the encoding module, and the MR signal generator 51 is communicated with the decoding module arranged on the mixed reality glasses 2 through an antenna.
Preferably, the in-cabin tracking mechanism 5 comprises an infrared camera group arranged in the vehicle corresponding to the user 1 and a head display tag arranged on the outer wall of the mixed reality glasses 2, wherein the infrared camera is communicated with the central gateway through a vehicle-to-machine data interface and is used for transmitting video streams to the central gateway and then to the expansion processing mechanism through the central gateway;
the head display label is an infrared LED.
Preferably, the infrared camera set includes four sets of corner infrared cameras 4 located at four corners of the user 1 and a top infrared camera 3 located above the user 1.
Preferably, the corner infrared camera 4 and the top infrared camera 3 are both high-speed wide-angle infrared cameras.
Preferably, the utility model further comprises a storage charging box, wherein a charging interface electrically connected with the vehicle-mounted control mechanism is arranged in the storage charging box and used for charging the head display mechanism when the head display mechanism is stored.
A vehicle-mounted mixed reality experience expansion method comprises the following steps:
s1, disconnecting charging, and taking out the mixed reality glasses 2 from the storage charging box;
s2, clicking an interface of the vehicle-mounted control mechanism, and sending a starting instruction and data to the single board computer;
preferably, the data in step S2 includes multimode interaction data, navigation position data, and audio-video stream data.
S3, performing visual field fusion and space calibration through an intra-cabin tracking module;
preferably, the step S3 specifically includes the following steps:
s31, tracking the position of the head display label in each frame in the fusion view through a feature point extraction algorithm;
s32, identifying a target by using a corner detection or feature extraction algorithm;
s33, predicting the state of the target by using a Kalman filtering algorithm, and updating the target based on the actual position of the target in the current frame;
s34, acquiring the real-time space position of the head display in the cabin, so as to obtain the real-time orientation and coordinates of the user 1.
S4, pushing the fused video stream to a single board computer through a vehicle-computer data interface through a central gateway, and performing visual 6DOF gesture calculation based on an infrared tag to acquire using gesture data;
s5, the single board computer renders corresponding picture images and sounds for the user 1 according to the gesture of the user 1, namely, corresponding audios and videos are converted into digital signals through the coding module, and millimeter waves are emitted through the MR signal generator 51;
s6, the mixed reality glasses 2 receive millimeter wave signals through the antenna, and output the millimeter wave signals in real time before the eyes of a user 1 after decoding the millimeter wave signals through the decoding module;
s7, the user 1 changes the gesture, and the program outputs specific content according to different using gestures.
Therefore, the vehicle-mounted mixed reality experience expansion system is adopted, the head display data is processed through the external processor, the burden of a vehicle-mounted control system is reduced, the work of sensing and computing the original mixed reality head display and heavily burdening performance resources is separated, and the work is only used as display driving, so that the high-performance content experience can be still provided under the condition of light weight of the head display.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present utility model and not for limiting it, and although the present utility model has been described in detail with reference to the preferred embodiments, it will be understood by those skilled in the art that: the technical scheme of the utility model can be modified or replaced by the same, and the modified technical scheme cannot deviate from the spirit and scope of the technical scheme of the utility model.
Claims (6)
1. An on-vehicle mixed reality experience expansion system, its characterized in that: comprising the following steps:
the vehicle-mounted control mechanism is used for issuing control instructions and providing a power supply interface and a communication interface;
the expansion processing mechanism is used for starting and closing the head display mechanism and the transmitted audio and video data according to the control instruction issued by the vehicle-mounted control mechanism;
the head display mechanism is used for receiving and displaying the audio and video data;
the in-cabin tracking mechanism is used for positioning the position and the posture of the head display mechanism;
the head display mechanism comprises mixed reality glasses and an antenna enveloped on the mixed reality glasses;
the in-cabin tracking mechanism is communicated with the expansion processing mechanism through the vehicle-mounted control mechanism, and the expansion processing mechanism is communicated with the head display mechanism.
2. The vehicle-mounted mixed reality experience expansion system according to claim 1, wherein: the expansion processing mechanism comprises a single board computer and an MR signal generator;
the single board computer comprises a power interface, a vehicle data interface, a pose receiving module, a data receiving module, a software starter and a processor which are connected with the vehicle-mounted control mechanism;
the in-cabin tracking mechanism is respectively connected with the pose receiving module, the data receiving module and the software starter through a central gateway of the vehicle-mounted control mechanism, the pose receiving module, the data receiving module and the software starter are connected with the processor, the processor is sequentially connected with the MR signal generator through an MR head display interface and an encoding module, and the MR signal generator is communicated with a decoding module arranged on the mixed reality glasses through an antenna.
3. The vehicle-mounted mixed reality experience expansion system according to claim 2, wherein: the in-cabin tracking mechanism comprises an infrared camera group arranged in the vehicle corresponding to a user and a head display tag arranged on the outer wall of the mixed reality glasses, wherein the infrared camera is communicated with the central gateway through a vehicle-to-machine data interface and is used for transmitting video streams to the central gateway and then to the expansion processing mechanism through the central gateway;
the head display label is an infrared LED.
4. The vehicle-mounted mixed reality experience expansion system according to claim 3, wherein: the infrared camera group comprises four groups of corner infrared cameras positioned at four corners of a user and a top infrared camera positioned above the user.
5. The vehicle-mounted mixed reality experience expansion system according to claim 4, wherein: the corner infrared camera and the top infrared camera are both high-speed wide-angle infrared cameras.
6. The vehicle-mounted mixed reality experience expansion system according to claim 1, wherein: still including accomodating the receiver that charges, accomodate be provided with in the receiver with on-vehicle control mechanism electric connection's interface that charges is used for accomodating when the head shows the mechanism charge.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202320295378.3U CN219266904U (en) | 2023-02-23 | 2023-02-23 | Vehicle-mounted mixed reality experience expansion system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202320295378.3U CN219266904U (en) | 2023-02-23 | 2023-02-23 | Vehicle-mounted mixed reality experience expansion system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN219266904U true CN219266904U (en) | 2023-06-27 |
Family
ID=86869342
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202320295378.3U Active CN219266904U (en) | 2023-02-23 | 2023-02-23 | Vehicle-mounted mixed reality experience expansion system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN219266904U (en) |
-
2023
- 2023-02-23 CN CN202320295378.3U patent/CN219266904U/en active Active
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109891463B (en) | Image processing apparatus and image processing method | |
| US20230004218A1 (en) | Virtual reality system | |
| CN109949439A (en) | Driving outdoor scene information labeling method, apparatus, electronic equipment and medium | |
| CN113483774B (en) | Navigation method, navigation device, electronic equipment and readable storage medium | |
| CN114258319A (en) | Projection method and device, vehicle and AR-HUD | |
| CN110233998A (en) | A kind of method of transmitting video data, device, equipment and storage medium | |
| CN113467601A (en) | Information display method, system and device based on augmented reality and projection equipment | |
| CN113343457B (en) | Automatic driving simulation test method, device, equipment and storage medium | |
| CN114900625A (en) | Subtitle rendering method, device, equipment and medium for virtual reality space | |
| CN219266904U (en) | Vehicle-mounted mixed reality experience expansion system | |
| JP6930541B2 (en) | Image processing device and image processing method | |
| CN113378605B (en) | Multi-source information fusion method and device, electronic equipment and storage medium | |
| CN112874301A (en) | Information display method and device for automobile and computer storage medium | |
| CN116149480A (en) | Vehicle-mounted mixed reality experience expansion system and method | |
| CN114655240A (en) | Information display method and device, electronic equipment and storage medium | |
| AU2020404293B2 (en) | Image processing method and apparatus, electronic device and computer-readable storage medium | |
| EP4086102A2 (en) | Navigation method and apparatus, electronic device, readable storage medium and computer program product | |
| CN115604455A (en) | Panoramic display method, device, equipment and medium based on virtual reality | |
| CN113448322A (en) | Remote operation method and system for vehicle, storage medium, and electronic device | |
| CN111932687B (en) | In-vehicle mixed reality display method and device | |
| CN210781107U (en) | Vehicle-mounted data processing terminal and system | |
| CN117058504A (en) | Method and system for fusing vehicle-mounted sensor and MR technology | |
| CN113467616A (en) | Augmented reality processing method and related device, vehicle and storage medium | |
| CN116257131A (en) | Unmanned aerial vehicle control device and method based on image dynamic gestures in augmented reality environment | |
| CN117857761A (en) | Vehicle-mounted projection system, generation method and automobile |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |