CN210038487U - Intelligent vehicle-mounted terminal based on edge calculation and multi-sensor interface - Google Patents

Intelligent vehicle-mounted terminal based on edge calculation and multi-sensor interface Download PDF

Info

Publication number
CN210038487U
CN210038487U CN201920868240.1U CN201920868240U CN210038487U CN 210038487 U CN210038487 U CN 210038487U CN 201920868240 U CN201920868240 U CN 201920868240U CN 210038487 U CN210038487 U CN 210038487U
Authority
CN
China
Prior art keywords
interface
module
sensor
board card
embedded board
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201920868240.1U
Other languages
Chinese (zh)
Inventor
黄涛
张亮
范浩锋
乐高杨
凌东明
庞宇浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
JIAKE ELECTRONICS CO Ltd ZHEJIANG
CETC 36 Research Institute
Original Assignee
JIAKE ELECTRONICS CO Ltd ZHEJIANG
CETC 36 Research Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by JIAKE ELECTRONICS CO Ltd ZHEJIANG, CETC 36 Research Institute filed Critical JIAKE ELECTRONICS CO Ltd ZHEJIANG
Priority to CN201920868240.1U priority Critical patent/CN210038487U/en
Application granted granted Critical
Publication of CN210038487U publication Critical patent/CN210038487U/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Traffic Control Systems (AREA)
  • Navigation (AREA)

Abstract

The utility model relates to an intelligence vehicle mounted terminal technical field specifically is an intelligence vehicle mounted terminal based on edge calculation and multisensor interface, comprises embedded integrated circuit board, sensor module, wireless connection module, the mutual module of driver, peripheral hardware module and edge calculation module, sensor module, wireless connection module, the mutual module of driver, peripheral hardware module, edge calculation module all are connected with embedded integrated circuit board electricity, embedded integrated circuit board will receive the multisource data information that comes from sensor module, wireless connection module, the mutual module of driver and peripheral hardware module and fuse. The utility model discloses can effectual solution back dress multiple sensor or multiple module equipment interface not enough, can't carry out real-time edge calculation to the data that multiple sensor or multiple module were gathered, can't carry out data fusion and multisource sensor or multisource module data fusion result to multisource sensor or multiple module data and can't be to the problem of vehicle autonomous control.

Description

Intelligent vehicle-mounted terminal based on edge calculation and multi-sensor interface
Technical Field
The utility model relates to an intelligence vehicle mounted terminal technical field specifically is intelligent vehicle mounted terminal based on edge calculation and multisensor interface.
Background
At present, the known vehicle-mounted terminal equipment has various types, for example, the video monitoring vehicle-mounted terminal equipment for commercial vehicles, muck vehicles and sanitation vehicles can support multi-path video monitoring and has the functions of satellite positioning and remote wireless transmission of video data. However, in these in-vehicle terminal devices, it is also difficult to solve the problem of insufficient interfaces of the afterloading various sensor devices; the problem that real-time edge calculation cannot be carried out on data acquired by multiple sensors; the problem that data fusion cannot be carried out on multi-sensor data and the problem that autonomous control of a vehicle cannot be carried out on a multi-source data fusion result.
SUMMERY OF THE UTILITY MODEL
An object of the utility model is to provide an intelligence vehicle mounted terminal based on edge calculation and multisensor interface to it is not enough, can't carry out real-time edge calculation, can't carry out data fusion and multisource sensor or multisource module data fusion result to multisource sensor or multisource module data to the data that multiple sensor or multiple module gathered after the solution to the back dress multiple sensor or multiple module equipment interface can't be to the problem of vehicle autonomous control.
The to-be-solved technical problem of the utility model adopts the technical scheme that: the intelligent vehicle-mounted terminal is characterized by consisting of an embedded board card, a sensor module, a wireless connection module, a driver interaction module, an external module and an edge calculation module, wherein the sensor module, the wireless connection module, the driver interaction module, the external module and the edge calculation module are all electrically connected with the embedded board card; the embedded board card is composed of an stm32 series embedded processor chip with an ARM core and a chip peripheral circuit, a GPIO interface, a serial port and an ADC interface are led out from the IO port of the embedded processor chip in an expansion mode, and a plurality of peripheral circuit interfaces are arranged on the chip peripheral circuit and specifically comprise a USB interface, a LAN interface, a CAN interface, an SMA interface, an FFC interface, an RS485 interface, an RJ45 interface, an MIC interface, an Amplifer interface, an OBD interface, an SD interface, an SIM interface, a DC interface, an A/V interface, an IPC interface, a Panel interface and a GPIO/Sensor interface; the embedded processor chip is connected with a chip peripheral circuit through an IO port, and the GPIO port is extended and led out to be connected with an LAN port, an SMA port, an FFC port, an RJ45 port, an Amplifer port, an SD port, an SIM port, a DC port, an IPC port and a GPIO/Sensor port of the chip peripheral circuit; the serial port extension is led out to be connected with a USB interface, a CAN interface, an RS485 interface, an OBD interface, an IIC interface and a Panel interface of a chip peripheral circuit; the ADC interface extension lead-out is connected with an MIC interface and an A/V interface; and the DC interface of the embedded board card is externally connected with a direct-current power supply, and the voltage range is 8-36V.
Further, the wireless connection module comprises a Bluetooth module and a WiFi module which are electrically connected with the embedded board card through USB interfaces. And part of sensors in the sensor module are electrically connected with the embedded board card in a Bluetooth module mode. Due to the fact that the vehicles are different, the space for additionally installing the sensors is different, and the installation mode and the connection mode of the sensors are different, a part of the sensors are connected with the embedded board card in a wireless Bluetooth mode, and the Bluetooth module is used for connecting various sensor devices; the WiFi module is used for debugging and data checking of the mobile phone APP end of the intelligent vehicle-mounted terminal.
Further, the driver interaction module comprises a display screen and an alarm key, the display screen is electrically connected with the embedded board card through a Panel interface, and the alarm key is electrically connected with the embedded board card through a GPIO/Sensor interface.
Further, the display screen displays current vehicle state information collected by the intelligent vehicle-mounted terminal, the alarm key is used for emergency alarm of a driver in a dangerous rescue state, after the driver triggers the alarm key, alarm instruction information is wirelessly transmitted to the remote monitoring center through an SIM card in the peripheral module, the remote monitoring center watches picture information of the alarm vehicle in real time through a plurality of cameras in the peripheral module, and audio information of the alarm vehicle is monitored in real time through a microphone in the peripheral module.
Furthermore, the peripheral module comprises a plurality of cameras, a microphone, an information broadcasting screen, a GPS/Beidou dual-mode positioning module, a loudspeaker, an OBD resolver, an SIM card and a memory.
Further, the multi-path camera comprises an analog camera and an IP network camera, the analog camera is electrically connected with the embedded board card through an A/V interface, and the IP network camera is electrically connected with the embedded board card through an IPC interface; the image information monitored by the multiple paths of cameras can be displayed in real time through the display screen and stored in the memory in real time; meanwhile, the remote monitoring center monitors the multi-path camera pictures in real time by using the SIM card through a mobile wireless network, the mobile phone end APP establishes wireless connection with the intelligent vehicle-mounted terminal through the WiFi module, and the multi-path camera picture information is called in real time.
Further, the multichannel camera still includes camera, the front truck anticollision camera of control driver's action, passenger flow monitoring camera, the image camera of backing a car, the camera, the front truck anticollision camera of control driver's action, passenger flow monitoring camera, the image camera of backing a car are after the camera is opened, in transmitting the edge calculation module with surveillance video data in real time through embedded integrated circuit board, carry out real-time analysis.
Furthermore, the microphone is electrically connected with the embedded board card through an MIC interface, and the microphone and the multi-path cameras collect audio data in real time and store the audio data in the memory.
Further, the information broadcasting screen is electrically connected with an embedded board card through an FFC interface, and the embedded board card displays the vehicle position information, the arrival information and the advertising information in the memory which are all collected by the GPS/Beidou dual-mode positioning module on the information broadcasting screen in real time. The information broadcasting screen can adopt standard multi-size LED, LCD and OLED display screens.
Further, the GPS/Beidou dual-mode positioning module is electrically connected with the embedded board card through an SMA interface, adopts a GPS and Beidou dual-mode positioning chip and transmits the acquired vehicle position positioning information to the display screen, the information broadcasting screen and the embedded board card in real time.
Furthermore, the loudspeaker is electrically connected with the embedded board card through the amplifier interface, and a driver can broadcast voice information in real time through the microphone and simultaneously play the voice information outside through the loudspeaker.
Further, the OBD resolver is connected with embedded integrated circuit board electricity through the OBD interface, the OBD resolver reads the OBD data of vehicle through vehicle CAN bus to the OBD data that will read are stored to the memory through embedded integrated circuit board, transmit simultaneously to the edge calculation module in.
Further, the SIM card is electrically connected with the embedded board card through an SIM card slot interface, the SIM card is a 4GSIM card and is downward compatible, and data is transmitted through a mobile wireless cellular network.
Further, the memory is electrically connected with the embedded board card through a USB or SD interface, and the memory is one of a hard disk, an SD card or a U disk and is used for storing sensor module data, video and audio data, OBD data and position information.
Further, the sensor module at least comprises a temperature and humidity sensor, an angle sensor, a vibration sensor, a multi-axis gyroscope, an acceleration sensor, a hazardous chemical sensor, a tire pressure sensor, a rainfall sensor and a distance sensor;
further, a DHT11 temperature and humidity Sensor module of Risym is adopted by the temperature and humidity Sensor, and a data interface of the temperature and humidity Sensor is electrically connected with a GPIO/Sensor interface of the embedded board card; the temperature and humidity sensor is used for collecting internal working environment state data of the vehicle-mounted terminal, and when the ambient temperature exceeds 60 ℃ or/and the humidity exceeds 90%, the vehicle-mounted terminal sends out a danger alarm to remind a driver of paying attention to possible failure of the terminal equipment and needs to process in time.
Further, MPU6050 chips of InvenSense company are used as core chips for the multi-axis gyroscope and the acceleration sensor, and the MPU6050 chips and the embedded board card realize electric connection and data communication through IIC interfaces; the MPU6050 chip internally comprises a 3-axis gyroscope and a 3-axis acceleration sensor, the multi-axis gyroscope and the acceleration sensor can monitor the running state information of the vehicle in real time, transmit the information to the edge computing module through the embedded board card, perform information fusion analysis as part of multi-source sensor data, and judge the state and the fault state of the vehicle.
Furthermore, the vibration Sensor adopts a piezoelectric vibration Sensor SEN0209, is electrically connected with a GPIO/Sensor interface of an embedded board card, and is used for acquiring analog voltage output by the piezoelectric vibration Sensor SEN0209, acquiring the vibration state of the vehicle-mounted terminal and the large-amplitude vibration state of the vehicle in real time, transmitting information to the edge computing module through the embedded board card, performing information fusion analysis as part of multi-source Sensor data, and judging the state of the vehicle and the fault state.
Further, the hazardous chemical substance Sensor adopts an MQ-2-135-3-7-9 type hazardous chemical substance gas Sensor which is electrically connected with a GPIO/Sensor interface of the embedded board card, when the gas Sensor detects hazardous gas, the hazardous chemical substance Sensor outputs digital quantity signals, and the embedded board card receives the signals output by the transmitted hazardous chemical substance Sensor and transmits the signals to the display screen, and meanwhile, danger prompt is given to a driver through a loudspeaker.
Further, the tire pressure sensor adopts an SP40 tire pressure sensor chip of the England flying company, is connected with the embedded board card through a Bluetooth module, displays the acquired data on a display screen in real time, gives an alarm through a loudspeaker to prompt, and stores the tire pressure data in a memory in real time through the embedded board card. The tire pressure data are transmitted to the edge computing module through the embedded board card in a certain period for modeling analysis, so that maintenance data and maintenance states of the tire can be obtained, and an intelligent maintenance decision is provided.
Further, distance Sensor comprises ultrasonic distance Sensor, and is connected with embedded integrated circuit board electricity through GPIO/Sensor interface, distance Sensor installs the object distance around the vehicle in the front portion of vehicle, rear portion real-time supervision vehicle to in transmitting the monitoring data to the edge calculation module through embedded integrated circuit board, carry out multisensor data information fusion analysis. When the vehicle runs at a low speed of less than 30km/h, the distance sensor gives an alarm in real time for monitoring objects within 1 meter, and gives an alarm in real time for objects within 2 meters of the distance between the front vehicle with the vehicle speed of more than 30km/h, and the edge computing module is used for carrying out data fusion analysis on the multiple sensors, so that the emergency braking function CAN be adopted for the vehicle through a CAN bus of the embedded board card aiming at the imminent collision accident of the front vehicle.
Further, the rainfall sensor is connected with the RS485 interface on the embedded board card electricity, the rainfall sensor can adjust the running speed of windshield wiper action to the rainwater precipitation and with the analysis of water intensity data information, effectively reduces the vexation of driver's driving and improves the reliability of safe driving, the rainfall sensor can also monitor precipitation start-stop time, and here the rainfall sensor is prior art, no longer gives unnecessary details.
Further, the embedded board card receives data information output by the sensor module, the wireless connection module, the driver interaction module and the peripheral module, and the data information is fused.
Further, the edge calculation module adopts an NCS nerve calculation stick of Intel corporation, an OpenVINO SDK software development kit is arranged in the NCS nerve calculation stick, and the edge calculation module is electrically connected with the embedded board card through a USB or/and RS485 or/and FFC interface. The edge calculation module can configure one or more NCS nerve calculation rods according to the calculation force requirement of the system.
Furthermore, the edge calculation module analyzes the multi-source module data information received by the embedded board card, the analyzed result is stored in the memory by the embedded board card, and the edge calculation module can extract part of OBD data to perform data fusion calculation according to the data fusion requirement.
Further, edge calculation module is with the multisource module data information analysis back in the embedded integrated circuit board, according to the analysis result to specific application scene, accessible intelligent vehicle mounted terminal's display screen, loudspeaker and driver carry out information exchange, also CAN take emergency braking to the vehicle through the CAN bus of embedded integrated circuit board. The edge calculation module can carry out real-time edge calculation on data acquired by various sensors, and fuse multi-source sensor data according to application scene requirements, set data weight and clean invalid data.
Further, the multi-source sensor data is comprehensive data information obtained by each sensor in the sensor module.
Further, multisource module data is the comprehensive data information that sensor module, wireless connection module, driver interaction module and peripheral hardware module obtained.
Further, the calculation method of the NCS neural computation rod is the prior art, and redundant description is omitted here.
Intelligent vehicle mounted terminal's beneficial effect based on edge calculation and multisensor interface is:
(1) the arrangement of the peripheral circuit interface of the embedded board card can effectively solve the problem that the interfaces of a plurality of sensors or a plurality of modules are insufficient after installation;
(2) an stm32 series embedded processor chip with an ARM core is adopted in the embedded board card to carry out data collection and data fusion on multi-source sensor data or multi-source module data, so that the problem that data fusion cannot be carried out on the multi-source sensor data or the multi-source module data in the prior art is solved;
(3) the edge calculation module adopts the NCS neural calculation rod, can carry out real-time edge calculation to the fusion data that multisource sensor or multisource module gathered, and the edge calculation module can dispose one or more NCS neural calculation rods according to the needs of system computing power, has effectually solved among the prior art and can't carry out real-time edge calculation to the data that multisource sensor or multisource module gathered and solve the problem that multisource sensor or multisource module data fusion result can't be to vehicle autonomous control.
Drawings
The invention is described in further detail below with reference to the accompanying drawings:
FIG. 1 is a schematic diagram of an intelligent vehicle-mounted terminal based on edge computing and multi-sensor interface.
The reference numerals in figure 1 illustrate: 1-embedded board card, 2-sensor module, 3-wireless connection module, 4-driver interaction module, 5-peripheral module, 6-edge calculation module, 201-temperature and humidity sensor, 202-angle sensor, 203-vibration sensor, 204-multi-axis gyroscope, 205-acceleration sensor, 206-hazardous chemical substance sensor, 207-tire pressure sensor, 208-rainfall sensor, 209-distance sensor, 301-Bluetooth module, 302-WiFi module, 401-display screen, 402-alarm key, 501-multi-path camera, 502-microphone, 503-information broadcast screen, 504-GPS/Beidou dual-mode positioning module, 505-loudspeaker, 506-OBD resolver, 507-SIM card and 508-memory.
Detailed Description
The technical solution of the present invention will be described clearly and completely with reference to the accompanying drawings, and obviously, the described embodiments are some, but not all embodiments of the present invention. Based on the embodiments in the present invention, all other embodiments obtained by a person skilled in the art without creative work belong to the protection scope of the present invention.
Example 1
Shown in FIG. 1
The intelligent vehicle-mounted terminal based on the edge calculation and the multi-sensor interface is characterized by comprising an embedded board card 1, a sensor module 2, a wireless connection module 3, a driver interaction module 4, an external module 5 and an edge calculation module 6, wherein the sensor module 2, the wireless connection module 3, the driver interaction module 4, the external module 5 and the edge calculation module 6 are all electrically connected with the embedded board card 1; the embedded board card 1 is composed of an stm32 series embedded processor chip with an ARM core and a chip peripheral circuit, a GPIO interface, a serial port and an ADC interface are led out from an IO port of the embedded processor chip in an expansion mode, and a plurality of peripheral circuit interfaces are arranged on the chip peripheral circuit and specifically comprise a USB interface, a LAN interface, a CAN interface, an SMA interface, an FFC interface, an RS485 interface, an RJ45 interface, an MIC interface, an Amplifer interface, an OBD interface, an SD interface, an SIM interface, a DC interface, an IIC interface (not shown in the figure), an A/V interface, an IPC interface, a Panel interface and a GPIO/Sensor interface; the embedded processor chip is connected with a chip peripheral circuit through an IO port, and the GPIO port is extended and led out to be connected with an LAN port, an SMA port, an FFC port, an RJ45 port, an Amplifer port, an SD port, an SIM port, a DC port, an IPC port and a GPIO/Sensor port of the chip peripheral circuit; the serial port extension is led out to be connected with a USB interface, a CAN interface, an RS485 interface, an OBD interface, an IIC interface (not shown in the figure) and a Panel interface of a chip peripheral circuit; the ADC interface extension lead-out is connected with an MIC interface and an A/V interface; the DC interface of the embedded board card 1 is externally connected with a direct current power supply, and the voltage range is 8V-36V.
A plurality of backup interfaces can be arranged on the peripheral circuit of the embedded board card 1 in the implementation according to the requirement.
The embedded board card 1 in the implementation can realize the fusion of comprehensive data information obtained by each sensor in the sensor module 2; the embedded board card 1 can also realize the integration of the comprehensive data information obtained by the sensor module 2, the wireless connection module 3, the driver interaction module 4 and the peripheral module 5.
The sensor module 2 in this embodiment at least includes a temperature and humidity sensor 201, an angle sensor 202, a vibration sensor 203, a multi-axis gyroscope 204, an acceleration sensor 205, a hazardous chemical substance sensor 206, a tire pressure sensor 207, a rainfall sensor 208, and a distance sensor 209.
In the implementation, the temperature and humidity Sensor 201 adopts a DHT11 temperature and humidity Sensor module of Risym company, and a data interface of the temperature and humidity Sensor 201 is electrically connected with a GPIO/Sensor interface of the embedded board card 1; the temperature and humidity sensor 201 is used for collecting internal working environment state data of the vehicle-mounted terminal, and when the ambient temperature exceeds 60 ℃ or/and the humidity exceeds 90%, the vehicle-mounted terminal sends out a danger alarm to remind a driver of paying attention to possible failure of terminal equipment and needs to process the terminal equipment in time.
In the implementation, both the multi-axis gyroscope 204 and the acceleration sensor 205 adopt an MPU6050 chip of Invensense company as a core chip, and the MPU6050 chip and the embedded board card 1 realize electrical connection and data communication through an IIC interface (not shown in the figure); the MPU6050 chip internally comprises a 3-axis gyroscope and a 3-axis acceleration sensor, the multi-axis gyroscope 204 and the acceleration sensor 205 can monitor the running state information of the vehicle in real time, transmit the information to the edge computing module 6 through the embedded board card 1, perform information fusion analysis as part of multi-source sensor data, and judge the state and the fault state of the vehicle.
The vibration Sensor 203 in the implementation adopts the piezoelectric vibration Sensor SEN0209, is electrically connected with a GPIO/Sensor interface of the embedded board card 1, and is used for acquiring analog voltage output by the piezoelectric vibration Sensor SEN0209, acquiring the vibration state of the vehicle-mounted terminal and the large-amplitude vibration state of the vehicle in real time, transmitting information to the edge calculation module 6 through the embedded board card 1, performing information fusion analysis as part of multi-source Sensor data, and judging the state of the vehicle and the fault state.
The hazardous chemical substance Sensor 206 in the implementation adopts an MQ-2-135-3-7-9 type hazardous chemical substance gas Sensor which is electrically connected with a GPIO/Sensor interface of the embedded board card 1, when the gas Sensor detects hazardous gas, the hazardous chemical substance gas Sensor outputs digital quantity signals, the embedded board card 1 receives the signals output by the transmission hazardous chemical substance Sensor and transmits the signals to the display screen 401, and meanwhile, danger prompt is given to a driver through a loudspeaker 505.
The tire pressure sensor 207 in this embodiment is an SP40 tire pressure sensor chip of the company inflixing, and is connected with the embedded board card 1 through the bluetooth module 301 in the wireless connection module 3, the acquired data is displayed on the display 401 in real time, and the warning prompt is given through the speaker 205, and the tire pressure data is stored in the memory 508 through the embedded board card 1 in real time. The tire pressure data are transmitted to the edge calculation module 6 through the embedded board card 1 in a certain period for modeling analysis, so that maintenance data and maintenance states of tires can be obtained, and intelligent maintenance decisions are provided.
The rainfall sensor 208 in this implementation is connected with the RS485 interface electricity on the embedded integrated circuit board 1, the rainfall sensor 208 can adjust the functioning speed of windshield wiper action to the rainwater precipitation and with the analysis of water intensity data information, effectively reduces the vexation that the driver drove and improves the reliability of safe driving, the rainfall sensor 208 can also monitor precipitation start-stop time, and here rainfall sensor 208 is prior art, and unnecessary the repeated description no longer.
Distance Sensor 209 in this implementation comprises ultrasonic distance Sensor, and is connected with embedded integrated circuit board 1 electricity through GPIO/Sensor interface, distance Sensor 209 installs the object distance around the vehicle front portion, rear portion real-time supervision vehicle to in transmitting the monitoring data to edge calculation module 6 through embedded integrated circuit board 1, carry out the fusion analysis of multisensor data information. When the vehicle runs at a low speed of less than 30km/h, the distance sensor 209 alarms objects monitored within 1 meter in real time, alarms objects in a front vehicle with the vehicle speed of more than 30km/h within a distance of 2 meters, and performs data fusion analysis on multiple sensors based on the edge calculation module 6, so that an emergency braking function CAN be performed on the vehicle through a CAN bus of the embedded board card 1 aiming at the imminent collision accident of the front vehicle.
The wireless connection module 3 in this implementation includes a bluetooth module 301 and a WiFi module 302, and is electrically connected with the embedded board card 1 through a USB interface. And part of sensors in the sensor module 2 are electrically connected with the embedded board card 1 in a Bluetooth module 301 mode. Due to the fact that the different vehicles and the different spaces for installing the sensors are different, the different sensor installation modes and the different connection modes are adopted, so that part of the sensors are connected with the embedded board card 1 in a wireless Bluetooth mode, and the Bluetooth module 301 is used for being connected with various sensor devices. The WiFi module 302 is used for debugging and data checking of a mobile phone APP end of the intelligent vehicle-mounted terminal.
The driver interaction module 4 in the implementation comprises a display screen 401 and an alarm key 402, wherein the display screen 401 is electrically connected with the embedded board card 1 through a Panel interface, and the display screen 401 displays current vehicle state information acquired by the intelligent vehicle-mounted terminal; the alarm key 402 is electrically connected with the embedded board card 1 through a GPIO/Sensor interface. The alarm key 402 is used for emergency alarm of a driver in a dangerous rescue state, after the driver triggers the alarm key 402, the instruction information of the alarm 402 is wirelessly transmitted to a remote monitoring center through an SIM card 507 in the peripheral module 5, the remote monitoring center watches the picture information of the alarm vehicle in real time through a multi-path camera 502 in the peripheral module 5, and monitors the audio information of the alarm vehicle in real time through a microphone 502 in the peripheral module 5.
The peripheral module 5 in this embodiment includes a multi-channel camera 501, a microphone 502, an information broadcast screen 503, a GPS/beidou dual-mode positioning module 504, a speaker 505, an OBD resolver 506, a SIM card 507, and a memory 508.
The multi-path camera 501 in the implementation comprises an analog camera and an IP network camera, wherein the analog camera 501 is electrically connected with the embedded board card 1 through an A/V interface, and the IP network camera is electrically connected with the embedded board card 1 through an IPC interface; the picture information monitored by the multi-path camera 501 can be displayed in real time through the display screen 401 and stored in the memory 508 in real time; meanwhile, the remote monitoring center monitors the images of the multiple cameras 501 in real time through the SIM card 507 through a mobile wireless network, the mobile phone APP establishes wireless connection with the intelligent vehicle-mounted terminal through the WiFi module 302, and the image information of the multiple cameras 501 is called in real time. The multi-path camera 501 further comprises a camera for monitoring driver behaviors, a front vehicle anti-collision camera, a passenger flow monitoring camera and a back-up image camera, wherein the camera for monitoring the driver behaviors, the front vehicle anti-collision camera, the passenger flow monitoring camera and the back-up image camera transmit monitoring video data to the edge computing module 6 in real time through the embedded board card 1 after the camera is started, and real-time analysis is carried out.
The microphone 502 in this embodiment is electrically connected to the embedded board 1 through an MIC interface, and the microphone 502 and the multi-channel camera 501 collect audio data in real time and store the data in the memory 508.
The information broadcasting screen 503 in the implementation is electrically connected with the embedded board card 1 through an FFC interface, the embedded board card 1 displays vehicle position information, arrival information and advertising information in the memory 508, which are collected by the GPS/Beidou dual-mode positioning module 504, on the information broadcasting screen 503 in real time, and the information broadcasting screen 503 can adopt standard multi-size LED, LCD and OLED display screens.
The GPS/Beidou dual-mode positioning module 504 in the implementation is electrically connected with the embedded board card 1 through an SMA interface, and the GPS/Beidou dual-mode positioning module 504 adopts a GPS and Beidou dual-mode positioning chip and transmits the acquired vehicle position positioning information to the display screen 401, the information broadcasting screen 503 and the embedded board card 1 in real time.
Loudspeaker 505 in this implementation is connected with embedded integrated circuit board 1 electricity through the Amplifer interface, and the driver accessible microphone 502 reports voice information in real time, simultaneously puts outward through loudspeaker 505.
OBD resolver 506 in this implementation is connected through OBD interface and embedded integrated circuit board 1 electricity, OBD resolver 506 ware reads the OBD data of vehicle through car CAN bus to the OBD data that will read are stored to memory 508 through embedded integrated circuit board 1 in, transmit simultaneously to edge calculation module 6, edge calculation module 6 CAN be according to the data fusion needs, draws partial OBD data and carries out the data fusion calculation.
The SIM card 507 in this embodiment is electrically connected to the embedded board card 1 through a SIM card slot interface, and the SIM card is a 4g SIM card and is downward compatible, and transmits data through a mobile wireless cellular network.
The memory in this implementation is electrically connected with the embedded board card 1 through a USB or SD interface, the memory 508 is one of a hard disk, an SD card or a USB disk, and is used for storing sensor module 2 data, video audio data, OBD data, and position information.
Example 2
In this embodiment, the edge calculation module 6 is an NCS neural calculation stick of intel corporation, the NCS neural calculation stick is internally provided with an OpenVINO SDK software development kit, and the edge calculation module 6 is electrically connected with the embedded board card 1 through a USB or/and RS485 or/and FFC interface. The edge calculation module 6 can configure one or more NCS neural computation sticks according to the needs of the system computing power.
The edge calculation module 6 in this embodiment analyzes the multi-source module data information received by the embedded board card 1, and the analyzed result is stored in the memory 508 by the embedded board card 1.
Edge calculation module 6 in this implementation is with the multisource module data information analysis back in the embedded integrated circuit board 1, according to the analysis result to specific application scene, accessible intelligent vehicle mounted terminal's display screen 401, loudspeaker 505 and driver carry out information exchange, also CAN take emergency braking to the vehicle through the CAN bus of embedded integrated circuit board 1. The edge calculation module 6 can perform real-time edge calculation on data acquired by various sensors, fuse multi-source sensor data according to application scene requirements, set data weight and clean invalid data.
It should be understood that the above detailed description of the present invention is only for illustrating the present invention and is not limited by the technical solutions described in the embodiments of the present invention, and those skilled in the art should understand that the present invention can still be modified or replaced with other equivalents to achieve the same technical effects, and all are within the scope of the present invention as long as the requirements of use are satisfied.

Claims (7)

1. The intelligent vehicle-mounted terminal based on edge calculation and multi-sensor interfaces is characterized by comprising an embedded board card (1), a sensor module (2), a wireless connection module (3), a driver interaction module (4), a peripheral module (5) and an edge calculation module (6), wherein the sensor module (2), the wireless connection module (3), the driver interaction module (4), the peripheral module (5) and the edge calculation module (6) are electrically connected with the embedded board card (1);
the embedded board card (1) is composed of an stm32 series embedded processor chip with an ARM core and a chip peripheral circuit, a GPIO interface, a serial port and an ADC interface are led out from an IO port of the embedded processor chip in an expansion mode, and a plurality of peripheral circuit interfaces are arranged on the chip peripheral circuit and specifically are a USB interface, a LAN interface, a CAN interface, an SMA interface, an FFC interface, an RS485 interface, an RJ45 interface, an MIC interface, an Amplifer interface, an OBD interface, an SD interface, an SIM interface, a DC interface, an A/V interface, an IPC interface, a Panel interface and a GPIO/Sensor interface;
the embedded processor chip is connected with a chip peripheral circuit through an IO port, and the GPIO port is extended and led out to be connected with an LAN port, an SMA port, an FFC port, an RJ45 port, an Amplifer port, an SD port, an SIM port, a DC port, an IPC port and a GPIO/Sensor port of the chip peripheral circuit; the serial port extension is led out to be connected with a USB interface, a CAN interface, an RS485 interface, an OBD interface, an IIC interface and a Panel interface of a chip peripheral circuit; the ADC interface extension lead-out is connected with an MIC interface and an A/V interface;
the DC interface of the embedded board card (1) is externally connected with a direct current power supply, and the voltage range is 8-36V.
2. The intelligent vehicle-mounted terminal based on edge computing and multi-sensor interface of claim 1 is characterized in that the wireless connection module (3) comprises a Bluetooth module (301) and a WiFi module (302), and the Bluetooth module and the WiFi module are electrically connected with the embedded board card (1) through USB interfaces.
3. The intelligent vehicle-mounted terminal based on edge computing and multi-Sensor interface of claim 1 is characterized in that the driver interaction module (4) comprises a display screen (401) and an alarm key (402), wherein the display screen (401) is electrically connected with the embedded board card (1) through a Panel interface, and the alarm key (402) is electrically connected with the embedded board card (1) through a GPIO/Sensor interface;
the display screen (401) shows the current vehicle state information that intelligent vehicle terminal gathered, alarm key (402) are used for driver emergency alarm under the dangerous rescue state, after the driver triggered alarm key (402), alarm instruction information passes through SIM card (507) wireless transmission in peripheral module (5) to the remote monitoring center, the picture information of warning vehicle is watched in real time in remote monitoring center through multichannel camera (501) in peripheral module (5), and monitor the audio information of warning vehicle in real time through microphone (502) in peripheral module (5).
4. The intelligent vehicle-mounted terminal based on edge computing and multi-sensor interface of claim 1, wherein the peripheral modules comprise a multi-path camera (501), a microphone (502), an information broadcasting screen (503), a GPS/Beidou dual-mode positioning module (504), a loudspeaker (505), an OBD resolver (506), an SIM card (507) and a memory (508);
the multi-path camera (501) comprises an analog camera and an IP network camera, the analog camera is electrically connected with the embedded board card (1) through an A/V interface, and the IP network camera is electrically connected with the embedded board card (1) through an IPC interface; the picture information monitored by the multi-path camera (501) can be displayed in real time through the display screen (401) and stored in the memory (508) in real time; meanwhile, the remote monitoring center monitors the pictures of the multiple cameras (501) in real time through a mobile wireless network by using an SIM card (507), the APP at the mobile phone end establishes wireless connection with the intelligent vehicle-mounted terminal through a WiFi module (302), and the picture information of the multiple cameras (501) is called in real time;
the multi-path camera (501) further comprises a camera for monitoring driver behaviors, a front vehicle anti-collision camera, a passenger flow monitoring camera and a reversing image camera, and after the camera for monitoring the driver behaviors, the front vehicle anti-collision camera, the passenger flow monitoring camera and the reversing image camera are started, monitoring video data are transmitted to the edge computing module (6) in real time through the embedded board card (1) for real-time analysis;
the microphone (502) is electrically connected with the embedded board card (1) through an MIC interface, the microphone (502) and the multi-path camera (501) are connected together to collect audio data in real time, and the audio data are stored in the memory (508);
the information broadcasting screen (503) is electrically connected with the embedded board card (1) through an FFC interface, and the embedded board card (1) displays the vehicle position information, the arrival information and the advertising information in the memory (508) which are all acquired by the GPS/Beidou dual-mode positioning module (504) on the information broadcasting screen (503) in real time;
the GPS/Beidou dual-mode positioning module (504) is electrically connected with the embedded board card (1) through an SMA interface, and the GPS/Beidou dual-mode positioning module (504) adopts a GPS and Beidou dual-mode positioning chip and transmits the acquired vehicle position positioning information to the display screen (401), the information broadcasting screen (503) and the embedded board card (1) in real time;
the loudspeaker (505) is electrically connected with the embedded board card (1) through an amplifier interface, and a driver can broadcast voice information in real time through the microphone (502) and simultaneously play the voice information outside through the loudspeaker (505);
the OBD resolver (506) is electrically connected with the embedded board card (1) through an OBD interface, the OBD resolver (506) reads OBD data of a vehicle through a vehicle CAN bus, stores the read OBD data into the memory (508), and simultaneously transmits the OBD data to the edge computing module (6);
the SIM card (507) is electrically connected with the embedded board card (1) through an SIM card slot interface, the SIM card (507) is a 4GSIM card and is downward compatible, and data is transmitted through a mobile wireless cellular network;
the memory (508) is electrically connected with the embedded board card (1) through a USB or SD interface, and the memory (508) is one of a hard disk, an SD card or a U disk.
5. The intelligent vehicle-mounted terminal based on edge computing and multi-sensor interface according to claim 1, wherein the sensor module (2) at least comprises a temperature and humidity sensor (201), an angle sensor (202), a vibration sensor (203), a multi-axis gyroscope (204), an acceleration sensor (205), a hazardous chemical substance sensor (206), a tire pressure sensor (207), a rainfall sensor (208) and a distance sensor (209);
the temperature and humidity Sensor (201) adopts a DHT11 temperature and humidity Sensor module of Risym company, and a data interface of the temperature and humidity Sensor (201) is electrically connected with a GPIO/Sensor interface of the embedded board card (1);
the multi-axis gyroscope (204) and the acceleration sensor (205) both adopt MPU6050 chips of InvenSense company as core chips, and the MPU6050 chips and the embedded board card (1) realize electric connection and data communication through IIC interfaces;
the vibration Sensor (203) is a piezoelectric vibration Sensor SEN0209, is electrically connected with a GPIO/Sensor interface of the embedded board card (1), and is used for acquiring analog voltage output by the piezoelectric vibration Sensor SEN0209, acquiring the vibration state of the vehicle-mounted terminal and the vibration state of a vehicle in real time, and transmitting data to the edge calculation module (6) through the embedded board card (1);
the hazardous chemical substance Sensor (206) adopts an MQ-2-135-3-7-9 type hazardous chemical substance gas Sensor which is electrically connected with a GPIO/Sensor interface of the embedded board card (1), when the gas Sensor detects hazardous gas, the gas Sensor outputs digital quantity signals, the embedded board card (1) receives the signals output by the transmission hazardous chemical substance Sensor (206) and transmits the signals to the display screen (401), and meanwhile, a danger prompt is given to a driver through a loudspeaker (505);
the tire pressure sensor (207) adopts an SP40 tire pressure sensor chip of the English-flying company, is connected with the embedded board card (1) through a Bluetooth module (301), displays the acquired data on a display screen (401) in real time, gives an alarm through a loudspeaker (505) for prompting, and stores the tire pressure data in a memory (508) in real time through the embedded board card (1);
distance Sensor (209) comprise ultrasonic distance Sensor, and be connected with embedded integrated circuit board (1) electricity through GPIO/Sensor interface, distance Sensor (209) are installed at the anterior of vehicle, the rear portion object distance around the real-time supervision vehicle to transmit the monitoring data to edge calculation module (6) in through embedded integrated circuit board (1).
6. The intelligent vehicle-mounted terminal based on edge computing and multi-sensor interface of any one of claims 1-5, wherein the embedded board card (1) receives data information output by the sensor module (2), the wireless connection module (3), the driver interaction module (4) and the peripheral module (5), and fuses the data information.
7. The intelligent vehicle-mounted terminal based on edge computing and multi-sensor interface of claim 1 is characterized in that the edge computing module (6) adopts an NCS (neural network) of Intel corporation, the NCS is internally provided with an OpenVINO SDK software development kit, and the edge computing module (6) is electrically connected with the embedded board card (1) through a USB (universal serial bus) or/and RS485 or/and FFC (fan filter) interface.
CN201920868240.1U 2019-06-11 2019-06-11 Intelligent vehicle-mounted terminal based on edge calculation and multi-sensor interface Active CN210038487U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201920868240.1U CN210038487U (en) 2019-06-11 2019-06-11 Intelligent vehicle-mounted terminal based on edge calculation and multi-sensor interface

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201920868240.1U CN210038487U (en) 2019-06-11 2019-06-11 Intelligent vehicle-mounted terminal based on edge calculation and multi-sensor interface

Publications (1)

Publication Number Publication Date
CN210038487U true CN210038487U (en) 2020-02-07

Family

ID=69347325

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201920868240.1U Active CN210038487U (en) 2019-06-11 2019-06-11 Intelligent vehicle-mounted terminal based on edge calculation and multi-sensor interface

Country Status (1)

Country Link
CN (1) CN210038487U (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112180903A (en) * 2020-10-19 2021-01-05 江苏中讯通物联网技术有限公司 Vehicle state real-time detection system based on edge calculation
CN114063528A (en) * 2021-11-23 2022-02-18 安徽富煌科技股份有限公司 Intelligent connection vehicle-mounted terminal based on edge calculation
CN114838760A (en) * 2022-04-11 2022-08-02 湖南中融汇智信息科技股份有限公司 Edge calculation system of temperature and vibration intelligent monitoring module
US11753019B2 (en) 2020-11-30 2023-09-12 Sony Group Corporation Event determination for vehicles and occupants of mobility provider on MaaS platform

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112180903A (en) * 2020-10-19 2021-01-05 江苏中讯通物联网技术有限公司 Vehicle state real-time detection system based on edge calculation
US11753019B2 (en) 2020-11-30 2023-09-12 Sony Group Corporation Event determination for vehicles and occupants of mobility provider on MaaS platform
CN114063528A (en) * 2021-11-23 2022-02-18 安徽富煌科技股份有限公司 Intelligent connection vehicle-mounted terminal based on edge calculation
CN114838760A (en) * 2022-04-11 2022-08-02 湖南中融汇智信息科技股份有限公司 Edge calculation system of temperature and vibration intelligent monitoring module

Similar Documents

Publication Publication Date Title
CN210038487U (en) Intelligent vehicle-mounted terminal based on edge calculation and multi-sensor interface
CN204795418U (en) Equipment of unusual control of personnel in car
CN107861500A (en) A kind of pure electric automobile intelligent network connection IVCU control systems and control method
CN110161932A (en) A kind of intelligent vehicle mounted terminal based on edge calculations and multisensor interface
CN211718935U (en) Vehicle-mounted navigation monitoring device
US20220030408A1 (en) Emergency call based on vehicle-to-vehicle communication
CN104331947A (en) Vehicle monitoring method and related equipment and system
CN108881834A (en) Commercial vehicle remote shooting monitoring system and its method
CN107613009A (en) A kind of automotive safety monitoring system based on mobile Internet
CN210027332U (en) Early warning and rescue system for children staying in pure electric vehicle
CN103640533A (en) Device and method for detecting vehicle collision rolling over and automatically calling for help
CN104908683B (en) Vehicle collision wireless detection and alarm device and method based on data acquisition device of automobile instrument panel
CN105334764A (en) Automobile intelligent manager system
CN111532278A (en) Vehicle intelligent driving auxiliary monitoring device, mobile terminal and system
CN104992483A (en) ETC automobile data recorder based on wireless technology
CN204883870U (en) Driving safety reminds system
CN211058420U (en) Remote monitoring system for mechanical three-dimensional parking equipment
CN108242142A (en) A kind of Vehicular video monitoring system
CN203520470U (en) Image recording apparatus as well as supporting device and service system mounted on transportation tool
CN210573960U (en) Vehicle-mounted terminal based on driving record and safety precaution
CN115002411A (en) Vehicle front-mounted remote safety monitoring system and operation method
CN214311842U (en) Intelligent vehicle-mounted computer system
CN212605078U (en) Vehicle intelligent driving auxiliary monitoring device, mobile terminal and system
CN210222560U (en) Highway monitoring platform
CN209938352U (en) Charging rainproof cover and charging pile

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant