CN110271417B - Full liquid crystal instrument system based on ADAS and AR technology - Google Patents
Full liquid crystal instrument system based on ADAS and AR technology Download PDFInfo
- Publication number
- CN110271417B CN110271417B CN201910540086.XA CN201910540086A CN110271417B CN 110271417 B CN110271417 B CN 110271417B CN 201910540086 A CN201910540086 A CN 201910540086A CN 110271417 B CN110271417 B CN 110271417B
- Authority
- CN
- China
- Prior art keywords
- liquid crystal
- vehicle
- full liquid
- module
- crystal instrument
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Arrangement of adaptations of instruments
Abstract
The invention relates to a full liquid crystal instrument system based on ADAS and AR technologies, which comprises a full liquid crystal instrument, an ADAS information acquisition system, a vehicle-mounted entertainment navigation system and a BCM vehicle body control system, wherein the ADAS information acquisition system and the BCM vehicle body control system are connected with the input end of the vehicle-mounted entertainment navigation system through a CAN bus, the output end of the vehicle-mounted entertainment navigation system is connected with the full liquid crystal instrument through a two-way LVDS signal line, the ADAS information acquisition system is connected with the full liquid crystal instrument through the CAN bus to realize information synchronization, and the BCM vehicle body control system is connected with the full liquid crystal instrument through the CAN bus to realize vehicle state information display. The system is low in implementation cost and easy to install, operate and use, can display the AR panoramic map integrating the running surrounding vehicles, road conditions, real-time traffic information, traffic marking indication, safe vehicle distance prompt and specific real-time road condition information prompt of the vehicles in the full liquid crystal instrument, provides danger early warning for a driver, and guides and assists the driver to drive the vehicles more accurately and safely.
Description
Technical Field
The invention relates to the technical field of automobile auxiliary driving equipment, in particular to an all-liquid-crystal instrument system based on ADAS and AR technologies.
Background
With the development of new energy vehicle technology, a navigation map, a road real scene and an ADAS (Advanced Driving assistance System) function are displayed on a full-size screen and are independent display modules at the automobile instrument end, and no related integrated display scheme exists. Especially, the needle-type instrument panel cannot meet the development requirement of the existing new energy automobile, and further the layout and display on the instrument interface can not get rid of the frame of the design mode of the traditional product, so that a driver can not better experience comprehensive vehicle state information and road condition information, and can not give a driver and a passenger a safe driving prompt, a road is dredged and the driving direction is clearly indicated. Therefore, the existing automobile instrument can not provide accurate and reliable information for a driver, and can avoid some driving dangers only by artificial identification and timely and flexible operation.
Disclosure of Invention
The invention aims to provide an all-liquid-crystal instrument system based on ADAS and AR technologies, which can be applied to large-scale new energy vehicles or vehicles with strong electromagnetic interference, can display an AR panoramic map integrating vehicles around the running vehicles, road conditions, real-time traffic information, traffic marking indication, safe vehicle distance prompt and specific real-time road condition information prompt in an automobile instrument, provides danger early warning for a driver, and guides and assists the driver to drive the vehicle more accurately and safely.
In order to achieve the purpose, the invention adopts the technical scheme that an all-liquid-crystal instrument system based on ADAS and AR technologies comprises an all-liquid-crystal instrument, an ADAS information acquisition system, a vehicle-mounted entertainment navigation system and a BCM vehicle body control system, wherein the ADAS information acquisition system and the BCM vehicle body control system are connected with the input end of the vehicle-mounted entertainment navigation system through a CAN bus, the output end of the vehicle-mounted entertainment navigation system is connected with the all-liquid-crystal instrument through a double-path LVDS signal line, the ADAS information acquisition system is connected with the all-liquid-crystal instrument through the CAN bus to achieve information synchronization, and the BCM vehicle body control system is connected with the all-liquid-crystal instrument through the CAN bus to achieve vehicle state information display; the ADAS information acquisition system comprises a sight distance imaging module and a first CAN (controller area network) transceiver, wherein the sight distance imaging module comprises a plurality of millimeter wave radars and an image collector, all the millimeter wave radars are connected with the vehicle-mounted entertainment navigation system and the full liquid crystal instrument through the first CAN transceiver, and the image collector is connected with the vehicle-mounted entertainment navigation system through a CVBS (composite video broadcast signal service) signal line.
As an improvement of the invention, the vehicle-mounted entertainment navigation system comprises an SOC module, an entertainment MCU, a GPS and Beidou satellite positioning module, an LVDS encoder, a video encoder and a second CAN transceiver, wherein the second CAN transceiver is connected with RX and TX ports of the entertainment MCU, the entertainment MCU is connected with the SOC module through an SPI bus, the SOC module is connected with the LVDS encoder and the video encoder through an FPD-Link transmission bus, the GPS and Beidou satellite positioning module is connected with the RX and TX ports of the SOC module, an image collector is connected with the video encoder through a CVBS signal wire, and the first CAN transceiver is connected with the second CAN transceiver through a CAN bus.
As an improvement of the invention, the full liquid crystal instrument comprises an instrument MCU, a third CAN transceiver, an LVDS decoder, an image display driver, a liquid crystal display screen and a control key, wherein the third CAN transceiver is connected with RX and TX ports of the instrument MCU, the instrument MCU is connected with the image display driver through an SPI bus, the LVDS decoder of the full liquid crystal instrument is connected with the image display driver through an FPD-Link transmission bus, the image display driver is connected with the liquid crystal display screen, the control key is connected with an I/O port of the instrument MCU, the first CAN transceiver is connected with the third CAN transceiver through a CAN bus, and an LVDS encoder of the vehicle-mounted entertainment navigation system is connected with the LVDS decoder of the full liquid crystal instrument through a double-way LVDS signal line.
As an improvement of the invention, the BCM vehicle body control system comprises a BCM module, a PEPS module, an ABS module and an ECU module, wherein the BCM module, the PEPS module, the ABS module and the ECU module are all connected with a second CAN transceiver and a third CAN transceiver through CAN buses.
As an improvement of the invention, the sight distance imaging module comprises four millimeter wave radars which are respectively arranged at the front, the back, the left and the right of the vehicle body, and the image collector comprises four high-definition image cameras which are respectively arranged at the front, the back, the left and the right of the vehicle body.
As an improvement of the invention, the entertainment MCU and the instrument MCU are both designed by adopting an RH850 microprocessor, the SOC module is designed by adopting a J6-DRA725 processor, the image display driver is designed by adopting an IMX6D industrial control board, and the first to third CAN transceivers adopt TJA1042 CAN transceivers.
The method for displaying the instrument AR panoramic map by the system comprises the steps of acquiring a real-time panoramic image and an image of the periphery of a vehicle body by using a sight distance imaging module of an ADAS information acquisition system, sending the real-time panoramic image and the image to a data analysis module consisting of an entertainment MCU and an SOC module in a vehicle-mounted entertainment navigation system, continuously tracking the real-time images in real time by combining a fusion algorithm of the data analysis module after the data analysis module receives the data and presetting a display mark on an acquired and captured image real object (an obstacle/a target), simultaneously combining displacement information of the image real object with vehicle state information for analysis, carrying out algorithm fusion on the analyzed data and GPS and Beidou navigation data/BCM data, and combining the current driving speed of the vehicle, the speed of the obstacle in the image and the speed of the target to carry out fusion calculation to obtain the relative distance between the vehicle and the obstacle/the target, and after all the data obtained by fusion calculation are sent to the full liquid crystal instrument, the full liquid crystal instrument fuses the real-time panoramic image and the data fused with the real vehicle, then the AR real-time panoramic image is fused, the full liquid crystal instrument fuses the vehicle state information with the AR real-time analysis module in the instrument MCU again, finally the AR image is displayed on the display screen of the full liquid crystal instrument, and meanwhile, the full liquid crystal instrument gives corresponding danger early warning and reminding.
Compared with the prior art, the all-liquid-crystal instrument system has the advantages that the whole structure design is ingenious, the structure is reasonable and stable, the installation, the operation and the use are easy, the ADAS information acquisition system in the automobile all-liquid-crystal instrument system acquires related data of obstacles/targets around a vehicle in the driving process, the data are provided for the vehicle-mounted entertainment navigation system through the CAN bus to be further fused with real-time state information of the vehicle detected by the BCM vehicle body control system for calculation, finally, a data generation image after the fused calculation processing is transmitted to the all-liquid-crystal instrument for AR panoramic map display, when the vehicle is in a danger warning line, a danger early warning prompt is jointly generated in the all-liquid-crystal instrument and the vehicle-mounted entertainment navigation system, and a driver is reminded to eliminate hidden dangers and risks to be generated, so that the driver is guided and assisted to more accurately, The vehicle is safely driven.
Drawings
Fig. 1 is a block diagram of a full liquid crystal instrument system according to a preferred embodiment of the present invention.
Fig. 2 is a schematic diagram of a hardware architecture of an all-liquid-crystal meter system according to a preferred embodiment of the present invention.
FIG. 3 is a flow chart of the working principle of the full liquid crystal instrument system according to the preferred embodiment of the invention.
Detailed Description
For a better understanding and appreciation of the invention, it is further described and illustrated below in connection with the accompanying drawings.
As shown in fig. 1, an ADAS and AR technology-based all-liquid-crystal instrument system provided in an embodiment of the present invention includes an all-liquid-crystal instrument, an ADAS information acquisition system, a vehicle-mounted entertainment navigation system, and a BCM vehicle body control system, where the ADAS information acquisition system and the BCM vehicle body control system are both connected to an input end of the vehicle-mounted entertainment navigation system through a CAN bus, an output end of the vehicle-mounted entertainment navigation system is connected to the all-liquid-crystal instrument through a dual LVDS signal line, the ADAS information acquisition system is connected to the all-liquid-crystal instrument through the CAN bus to achieve information synchronization, and the BCM vehicle body control system is connected to the all-liquid-crystal instrument through the CAN bus to achieve vehicle status information display. The all-liquid-crystal instrument system has an AR (Augmented Reality) function, an image collector in the ADAS information collection system collects related data of obstacles/targets around a vehicle in the driving process to form 360-degree stereoscopic image data, the data are provided for a vehicle-mounted entertainment navigation system through a CAN bus to be further fused with real-time state information of the vehicle detected by a BCM vehicle body control system for calculation, namely parameter calibration, point cloud splicing, redundancy elimination and the like, and the position information, the direction and the angle of the current vehicle with the enhanced visual effect are rendered by combining the synchronized image data at the same time and the vehicle data (comprising the current position information, the direction, the angle and the like of the vehicle) detected by a millimeter wave radar to be transmitted to the all-liquid-crystal instrument for AR panoramic map display according to the vehicle image, and when the vehicle is in a danger warning line, a danger early warning prompt is jointly generated by the full liquid crystal instrument and the vehicle-mounted entertainment navigation system, and a driver is reminded of eliminating hidden dangers and impending dangers.
As shown in fig. 2, the ADAS information acquisition system includes a line-of-sight imaging module, a first CAN transceiver, the line-of-sight imaging module includes a plurality of millimeter wave radars and an image collector, all the millimeter wave radars are connected to the vehicle-mounted entertainment navigation system and the full liquid crystal instrument through the first CAN transceiver, and the image collector is connected to the vehicle-mounted entertainment navigation system through a CVBS signal line. Specifically, stadia imaging module includes four millimeter wave radars, sets up respectively all around the automobile body, and image collector includes four high definition image cameras, sets up respectively all around the automobile body. The panoramic image and the radar image (including the night vision image) of the periphery of the vehicle body, including lane road conditions, lane markings, vehicles ahead, road signs, traffic identification signboards, pedestrians around the vehicle body, obstacles around the vehicle body and the like, are acquired in real time through the line-of-sight imaging module, and the acquired image data are transmitted through the first CAN transceiver.
The vehicle-mounted entertainment navigation system comprises an SOC module, an entertainment MCU, a GPS and Beidou satellite positioning module, an LVDS encoder, a video encoder and a second CAN transceiver, wherein the entertainment MCU is mainly responsible for the power on and off of the vehicle-mounted entertainment navigation system, and the start and off functions among the CAN chip, the LVDS chip and the SOC module are controlled and switched, the second CAN transceiver is connected with RX and TX ports of the entertainment MCU, the entertainment MCU is connected with the SOC module through an SPI bus, the SOC module is connected with the LVDS encoder and the video encoder through an FPD-Link transmission bus, the GPS and Beidou satellite positioning module is connected with the RX and TX ports of the SOC module, an image collector is connected with the video encoder through a CVBS signal wire, the first CAN transceiver is connected with the second CAN transceiver through a CAN bus, image data transmitted from the first CAN transceiver is received through the second CAN transceiver and is transmitted to the entertainment MCU for preprocessing and then sent to the SOC module, meanwhile, the SOC module receives virtual navigation map route map data transmitted by the GPS and Beidou satellite positioning module, vehicle body periphery live video data processed by the video encoder and real-time vehicle state information data transmitted by the BCM vehicle body control system, the SOC module performs data fusion processing on the received four parts of data to generate a virtual navigation map route guidance model to be overlaid on a real road so as to realize the function of ADAS, and LVDS signal data processed by the LVDS encoder is formed and transmitted to the all-liquid-crystal instrument through LVDS signal lines.
The full-liquid-crystal instrument comprises an instrument MCU, a third CAN transceiver, an LVDS decoder, an image display driver, a liquid crystal display screen and control keys, wherein the third CAN transceiver is connected with RX and TX ports of the instrument MCU, the instrument MCU is connected with the image display driver through an SPI bus, the LVDS decoder is connected with the image display driver through an FPD-Link transmission bus, the image display driver is connected with the liquid crystal display screen, the control keys are connected with an I/O port of the instrument MCU, the first CAN transceiver is connected with the third CAN transceiver through a CAN bus, and the LVDS encoder is connected with the LVDS decoder through a double-path LVDS signal line. After receiving the data, the LVDS decoder transmits the data to the image display driver to drive the display screen to display the AR panoramic map on one hand, and transmits the data to the instrument MCU to perform data clock synchronization processing on the other hand, and meanwhile, the instrument MCU also receives related information input by the control key, processes the information and transmits the processed information to the display screen through the image display driver to be displayed.
The BCM vehicle body control system comprises a BCM (vehicle body controller) module, a PEPS (keyless entry and keyless start system) module, an ABS (anti-lock brake system) module and an ECU (electronic control unit/driving computer) module, wherein the BCM module, the PEPS module, the ABS module and the ECU module are all connected with a second CAN transceiver and a third CAN transceiver through CAN buses. The BCM vehicle body control system transmits all state information (including a vehicle speed state, a vehicle lamp state, an engine state, a vehicle door state, a tire pressure state, a skylight state, a trunk state and the like) of the vehicle to a vehicle-mounted entertainment navigation system and a full liquid crystal instrument through a CAN bus for processing and displaying.
The entertainment MCU and the instrument MCU are designed by adopting an RH850 microprocessor, the RH850 microprocessor adopts a dual-core RH850G3 processor, the CPU main frequency is 120MHz at most, a memory protection unit is supported, a double-precision Floating Point Unit (FPU) is supported, a Memory Protection Unit (MPU) is supported, internal peripheral equipment protection (IPG) is supported, processor element Protection (PEG) is supported, and the entertainment MCU and the instrument MCU have the advantages of low power consumption, high processing capability, multiple peripheral functions and the like. The SOC module is designed by adopting a J6-DRA725 processor, the J6-DRA725 infotainment application processor can meet the intensive processing requirement of modern infotainment automobile experience, can be upwards expanded to a DRA74x device, has corresponding software frameworks and SDKs in infotainment, instruments, ADAS and other applications, supports 1920 x 7203D QNX graphic digital instruments and 1920 x 1080 full-size high-definition android infotainment systems, and realizes mutual noninterference through isolation at an operating system level. The system has ultrahigh integration level, can be used as a 3D (three-dimensional) look-around hardware accelerator through a DSP (digital signal processor), and can realize additional look-around display on the premise of not influencing information entertainment, instrument display and interactive application. The AR technology can also be realized, and the driving auxiliary information is superposed on the live-action application through the acquisition and the identification of the camera to the live-action. And an ISP is integrated, so that the traditional ISP chip can be saved, and the BOM of the whole system is reduced. The image display driver is designed by adopting an IMX6D industrial control board, the first CAN transceiver, the second CAN transceiver, the third CAN transceiver and the TJA1042 CAN transceiver are specially designed for high-speed CAN application in the automobile industry, CAN provide functions of sending and receiving differential signals for a CAN protocol controller (in a microcontroller), has low electromagnetic radiation (EME) and high electromagnetic interference tolerance (EMI), has an extremely low current standby mode, and has a host and bus wake-up function.
As shown in FIG. 3, the method for displaying the instrument AR panoramic map by the system comprises the steps of acquiring a real-time panoramic image and millimeter wave radar imaging around a vehicle body by using a sight distance imaging module of an ADAS information acquisition system, sending the real-time panoramic image and the millimeter wave radar imaging to a data analysis module consisting of an entertainment MCU and an SOC module in a vehicle-mounted entertainment navigation system, continuously tracking the real-time acquired and captured image real objects (obstacles/targets) by combining a fusion algorithm of the data analysis module after the data analysis module receives the data, simultaneously analyzing the displacement information of the image real objects and the vehicle state information by combining, carrying out algorithm fusion on the analyzed data and GPS and Beidou navigation data/BCM data, carrying out fusion calculation by combining the current driving speed of the vehicle, the speed of obstacles in the image and the speed of the targets to obtain the relative distance between the vehicle and the obstacles/targets, all data obtained through fusion calculation are sent to the full liquid crystal instrument, the full liquid crystal instrument fuses real-time panoramic images and real vehicles, then AR real-time panoramic image fusion is carried out on the data after the data are fused, the full liquid crystal instrument fuses vehicle state information with an AR real-time analysis module in the instrument MCU again, finally the AR images are displayed in a display screen of the full liquid crystal instrument, and meanwhile the full liquid crystal instrument gives corresponding danger early warning and reminding.
The system collects real-time road information through a line-of-sight imaging module of an ADAS information collection system, combines a live-action image into traditional map navigation, performs fusion calculation with real-time traffic information through a scene algorithm, generates a virtual navigation map route guidance model and superimposes the virtual navigation map route guidance model on a real road so as to guide a driver to drive a vehicle more accurately, more safely and more intuitively, and timely reminds the driver to eliminate hidden dangers and impending dangers when the vehicle is positioned on a danger warning line.
The system carries out data comprehensive operation processing on a lane departure system (LDW), an automatic emergency braking system (AEB), a front vehicle collision warning system (FCW), an Adaptive Cruise Control (ACC), Traffic Jam Assistance (TJA) and a full screen navigation function of a vehicle-mounted entertainment navigation system in ADAS through LVDS communication and CAN communication, thereby providing stable, visual, clear, comprehensive and safe AR display for a vehicle. The lane departure system collects lane marking images on a road path where a vehicle runs in real time through the sight distance imaging module, image processing and virtual navigation map road marking comparison are carried out through the SOC module, when the direction of a vehicle head or the direction of a vehicle body deviates due to pressure lines and the like or has a deviation trend, an image prompt combining AR and ADAS technologies is sent out through the full liquid crystal instrument, the images of the lane departure of the vehicle are displayed, when danger is possibly met, an early warning prompt signal is sent out on the full liquid crystal instrument, and meanwhile, a corresponding early warning prompt sound is sent out in the vehicle-mounted entertainment navigation system.
The automatic emergency braking system collects traffic state information of vehicles or pedestrians in front of a vehicle in driving through a sight distance imaging module, when an emergency situation occurs or a trend of the emergency situation is calculated through data fusion of an SOC module, an all-liquid crystal instrument sends an emergency signal to an emergency braking controller through rapid fusion calculation in combination with the SOC module to perform emergency braking on the vehicle, simultaneously, an image is displayed on the all-liquid crystal instrument, a highest safety measure signal is sent to a BCM vehicle body control system in combination with a live traffic state, and after the BCM vehicle body control system receives and confirms the signal, an emergency braking command is sent out to drive the braking system to perform emergency braking. When the full liquid crystal instrument receives the highest safety signal sent by the SOC module, dangerous objects which are possibly generated or already generated are displayed after data fusion calculation is carried out by combining the field-of-site live information collected by the image.
The front vehicle collision warning system collects real vehicle front vehicles, pedestrians and road conditions through a sight distance imaging module, carries out fusion calculation by combining data such as high-precision navigation information and real vehicle running speed during emergency turning, sends collision warning in the full liquid crystal instrument when the safety distance of the front vehicles or pedestrians does not meet requirements and there is a possible collision distance, displays real vehicle collision warning images by the full liquid crystal instrument after fusion calculation processing by combining real vehicle real-time state data (such as running speed, GPS and Beidou positioning longitude and latitude, road surface live condition, running speed and distance of other vehicles or pedestrians around, front-rear and left-right sides, and the like), and sends warning prompt tones.
The self-adaptive cruise function is that the sight distance imaging module is used for collecting the state road condition information of a vehicle running lane, the running state information of a front vehicle road and a secondary road, the real-time running speed of a real vehicle provided by the BCM vehicle body control system is combined to be fused, calculated and processed, the distance between the real vehicle and a target vehicle (specifically all vehicles right in front of the real vehicle) is displayed on the full liquid crystal instrument in real time, and the running speed is adjusted in real time so as to keep the running speed and the safe distance between the real vehicle and the target vehicle. The specific speed adjustment logic includes: 1) the full liquid crystal instrument displays the running speed of an actual vehicle and the distance image between the full liquid crystal instrument and a target vehicle in real time, simultaneously provides a danger early warning image in real time, and simultaneously gives out a warning sound for early warning by the vehicle-mounted entertainment navigation system; 2) when the SOC module gives an early warning that dangerous driving tends to occur or is in a dangerous driving state, a corresponding deceleration instruction is generated to the BCM body control system to perform forced deceleration.
The traffic jam assistance is to provide urban peak road conditions, emergency road dispersion information (such as congestion of a road ahead, emergency road repair of the road ahead, or road emergency accident handling and closing time periods) and urban hollow road live information in a full liquid crystal instrument through GPS and Beidou navigation data provided by a vehicle-mounted entertainment navigation system to perform early warning prompt so as to assist a driver to plan an optimal driving route in advance.
The automobile AR instrument system provided by the invention is fused through a smart algorithm by an all-liquid-crystal instrument and an AR technology and an embedded ADAS interconnection technology in a vehicle-mounted entertainment navigation system, and displays the fused AR panoramic image in the all-liquid-crystal instrument, so that more intuitive, clear, accurate and safe lane conditions, traffic marking indication, safe vehicle distance prompt and specific and accurate real-time road condition information prompt are provided for a driver, time and labor are saved, the driver is guided and assisted to drive the vehicle more accurately and safely, and the driver is timely reminded to eliminate hidden dangers and dangers to occur when the vehicle is on a dangerous warning line, and serious dangerous driving is avoided.
The technical means disclosed in the invention scheme are not limited to the technical means disclosed in the above embodiments, but also include the technical scheme formed by any combination of the above technical features. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principle of the present invention, and such improvements and modifications are also considered to be within the scope of the present invention.
Claims (6)
1. Full liquid crystal instrument system based on ADAS and AR technique, its characterized in that: the system comprises a full liquid crystal instrument, an ADAS information acquisition system, a vehicle-mounted entertainment navigation system and a BCM vehicle body control system, wherein the ADAS information acquisition system and the BCM vehicle body control system are connected with the input end of the vehicle-mounted entertainment navigation system through a CAN bus, the output end of the vehicle-mounted entertainment navigation system is connected with the full liquid crystal instrument through a double-channel LVDS signal line, the ADAS information acquisition system is connected with the full liquid crystal instrument through the CAN bus to realize information synchronization, the BCM vehicle body control system is connected with the full liquid crystal instrument through the CAN bus to realize vehicle state information display, the ADAS information acquisition system comprises a sight distance imaging module and a first CAN (controller area network) transceiver, wherein the sight distance imaging module comprises a plurality of millimeter wave radars and an image collector, all the millimeter wave radars are connected with the vehicle-mounted entertainment navigation system and the full liquid crystal instrument through the first CAN transceiver, and the image collector is connected with the vehicle-mounted entertainment navigation system through a CVBS (composite video broadcast signal service) signal line; the system for displaying the instrument AR panoramic map utilizes a sight distance imaging module of an ADAS information acquisition system to acquire real-time panoramic images and millimeter wave radar images around a vehicle body and send the images to a data analysis module consisting of an entertainment MCU and an SOC module in a vehicle-mounted entertainment navigation system, after the data analysis module receives the data and preset display marks are carried out on the acquired and captured image real objects, continuous real-time tracking is carried out by combining a fusion algorithm of the data analysis module, meanwhile, displacement information of the image real objects and vehicle state information are combined and analyzed, algorithm fusion is carried out on the analyzed data, GPS and Beidou navigation data/BCM data, fusion calculation is carried out by combining the current driving speed of the vehicle, the barrier speed and the target speed in the image to obtain the relative distance between the vehicle and the barrier/target, after all data are obtained by fusion calculation, and sending the data to a full liquid crystal instrument, fusing the real-time panoramic image and the real-vehicle fused data by the full liquid crystal instrument, fusing the AR real-time panoramic image, fusing the vehicle state information with an AR real-time analysis module in an instrument MCU (microprogrammed control Unit) by the full liquid crystal instrument, displaying the AR image in a display screen of the full liquid crystal instrument, and simultaneously giving corresponding danger early warning and reminding by the full liquid crystal instrument.
2. The ADAS and AR technology based full liquid crystal instrument system of claim 1, wherein the vehicle-mounted entertainment navigation system comprises an SOC module, an entertainment MCU, a GPS and Beidou satellite positioning module, an LVDS encoder, a video encoder, and a second CAN transceiver, the second CAN transceiver is connected with RX and TX ports of the entertainment MCU, the entertainment MCU is connected with the SOC module through an SPI bus, the SOC module is connected with the LVDS encoder and the video encoder through an FPD-Link transmission bus, the GPS and Beidou satellite positioning module is connected with the RX and TX ports of the SOC module, the image collector is connected with the video encoder through a CVBS signal wire, and the first CAN transceiver is connected with the second CAN transceiver through a CAN bus.
3. The ADAS and AR technology based full liquid crystal instrument system of claim 2, wherein the full liquid crystal instrument comprises an instrument MCU, a third CAN transceiver, an LVDS decoder, an image display driver, a liquid crystal display screen, and control keys, the third CAN transceiver is connected with the RX and TX ports of the instrument MCU, the instrument MCU is connected with the image display driver through an SPI bus, the LVDS decoder of the full liquid crystal instrument is connected with the image display driver through an FPD-Link transmission bus, the image display driver is connected with the liquid crystal display screen, the control keys are connected with the I/O port of the instrument MCU, the first CAN transceiver is connected with the third CAN transceiver through a CAN bus, and the LVDS encoder of the vehicle-mounted entertainment and navigation system is connected with the LVDS decoder of the full liquid crystal instrument through a dual LVDS signal line.
4. The ADAS and AR technology based full liquid crystal instrument system of claim 3, wherein the BCM body control system comprises a BCM module, a PEPS module, an ABS module, and an ECU module, and the BCM module, the PEPS module, the ABS module, and the ECU module are all connected to the second and third CAN transceivers via CAN buses.
5. The full liquid crystal instrument system based on ADAS and AR technology of claim 4, wherein said line-of-sight imaging module comprises four millimeter wave radars respectively arranged on the front, back, left and right of the vehicle body, and the image collector comprises four high definition image cameras respectively arranged on the front, back, left and right of the vehicle body.
6. The ADAS and AR technology based full liquid crystal instrument system of claim 5, wherein said entertainment MCU and instrument MCU are designed with RH850 microprocessor, SOC module is designed with J6-DRA725 processor, image display driver is designed with IMX6D industrial control board, first to third CAN transceivers are TJA1042 CAN transceivers.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910540086.XA CN110271417B (en) | 2019-06-21 | 2019-06-21 | Full liquid crystal instrument system based on ADAS and AR technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910540086.XA CN110271417B (en) | 2019-06-21 | 2019-06-21 | Full liquid crystal instrument system based on ADAS and AR technology |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110271417A CN110271417A (en) | 2019-09-24 |
| CN110271417B true CN110271417B (en) | 2021-08-20 |
Family
ID=67961340
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910540086.XA Active CN110271417B (en) | 2019-06-21 | 2019-06-21 | Full liquid crystal instrument system based on ADAS and AR technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110271417B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113147748A (en) * | 2021-03-26 | 2021-07-23 | 江铃汽车股份有限公司 | ADAS display method and system based on AR live-action navigation |
| CN113872838B (en) * | 2021-08-24 | 2024-04-05 | 爱驰汽车有限公司 | Vehicle-mounted control system and method, video data and audio data processing method |
| CN114312575A (en) * | 2021-12-30 | 2022-04-12 | 航天科技控股集团股份有限公司 | 3D display method for vehicle information |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010234959A (en) * | 2009-03-31 | 2010-10-21 | Equos Research Co Ltd | Information display device |
| CN103105174A (en) * | 2013-01-29 | 2013-05-15 | 四川长虹佳华信息产品有限责任公司 | AR (augmented reality)-based vehicle-mounted live-action safe navigation method |
| CN104512354A (en) * | 2013-09-26 | 2015-04-15 | 现代自动车株式会社 | Head-up display apparatus for vehicle using augmented reality |
| CN108204822A (en) * | 2017-12-19 | 2018-06-26 | 武汉极目智能技术有限公司 | A kind of vehicle AR navigation system and method based on ADAS |
| CN109353279A (en) * | 2018-12-06 | 2019-02-19 | 延锋伟世通电子科技（上海）有限公司 | A kind of vehicle-mounted head-up-display system of augmented reality |
-
2019
- 2019-06-21 CN CN201910540086.XA patent/CN110271417B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010234959A (en) * | 2009-03-31 | 2010-10-21 | Equos Research Co Ltd | Information display device |
| CN103105174A (en) * | 2013-01-29 | 2013-05-15 | 四川长虹佳华信息产品有限责任公司 | AR (augmented reality)-based vehicle-mounted live-action safe navigation method |
| CN104512354A (en) * | 2013-09-26 | 2015-04-15 | 现代自动车株式会社 | Head-up display apparatus for vehicle using augmented reality |
| CN108204822A (en) * | 2017-12-19 | 2018-06-26 | 武汉极目智能技术有限公司 | A kind of vehicle AR navigation system and method based on ADAS |
| CN109353279A (en) * | 2018-12-06 | 2019-02-19 | 延锋伟世通电子科技（上海）有限公司 | A kind of vehicle-mounted head-up-display system of augmented reality |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110271417A (en) | 2019-09-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102344171B1 (en) | Image generating apparatus, image generating method, and program | |
| CN110895417B (en) | Vehicle control device, vehicle control method, and storage medium | |
| CN111469838B (en) | Collaborative ACC/AEB decision management system based on Internet of vehicles and vehicle | |
| CN107914713B (en) | Display device for vehicle and vehicle including same | |
| CN109353279A (en) | A kind of vehicle-mounted head-up-display system of augmented reality | |
| CN110271417B (en) | Full liquid crystal instrument system based on ADAS and AR technology | |
| EP2723069B1 (en) | Vehicle periphery monitoring device | |
| CN110786004B (en) | Display control device, display control method, and storage medium | |
| CN108202669B (en) | Bad weather vision enhancement driving auxiliary system and method based on vehicle-to-vehicle communication | |
| CN111634290B (en) | Advanced driving assistance forward fusion system and method | |
| CN111279689B (en) | Display system, display method, and storage medium | |
| CN110126824A (en) | A kind of commercial vehicle AEBS system of integrated binocular camera and millimetre-wave radar | |
| JP2001344597A (en) | Fused visual field device | |
| JP5898539B2 (en) | Vehicle driving support system | |
| CN108791062A (en) | Dynamic information system and operating method | |
| CN111010532A (en) | Vehicle-mounted machine vision system based on multi-focal-length camera group and implementation method | |
| CN111824141B (en) | Display control device, display control method, and storage medium | |
| CN109050401B (en) | Augmented reality driving display method and device | |
| CN113147597A (en) | Vehicle electronic rearview mirror display system and method and vehicle | |
| JP2017182588A (en) | Display device | |
| CN207826169U (en) | A kind of advanced driving assistance system | |
| CN209257986U (en) | The vehicle-mounted head-up-display system of augmented reality | |
| JP2008046761A (en) | System, device, and method for processing image of movable object | |
| CN114822083B (en) | Intelligent vehicle formation auxiliary control system | |
| CN113377202B (en) | Head-up display method and system based on ARHUD |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |