CN112288904B - Vehicle-mounted terminal, distributed vehicle-mounted terminal integrated management method and system - Google Patents

Vehicle-mounted terminal, distributed vehicle-mounted terminal integrated management method and system Download PDF

Info

Publication number
CN112288904B
CN112288904B CN202011319817.7A CN202011319817A CN112288904B CN 112288904 B CN112288904 B CN 112288904B CN 202011319817 A CN202011319817 A CN 202011319817A CN 112288904 B CN112288904 B CN 112288904B
Authority
CN
China
Prior art keywords
vehicle
data
mounted terminal
video
semi
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011319817.7A
Other languages
Chinese (zh)
Other versions
CN112288904A (en
Inventor
卜方玲
李珺
张文怡
徐雁菲
邹同元
李翔翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan University WHU
Original Assignee
Wuhan University WHU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan University WHU filed Critical Wuhan University WHU
Priority to CN202011319817.7A priority Critical patent/CN112288904B/en
Publication of CN112288904A publication Critical patent/CN112288904A/en
Application granted granted Critical
Publication of CN112288904B publication Critical patent/CN112288904B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00Registering or indicating the working of vehicles
    • G07C5/008Registering or indicating the working of vehicles communicating information to a remotely located station
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00Registering or indicating the working of vehicles
    • G07C5/08Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
    • G07C5/0841Registering performance data
    • G07C5/085Registering performance data using electronic data carriers
    • G07C5/0866Registering performance data using electronic data carriers the electronic data carrier being a digital video recorder in combination with video camera
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • H04N21/64322IP
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • H04N21/6437Real-time Transport Protocol [RTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30Services specially adapted for particular environments, situations or purposes
    • H04W4/38Services specially adapted for particular environments, situations or purposes for collecting sensor information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30Services specially adapted for particular environments, situations or purposes
    • H04W4/40Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
    • H04W4/44Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for communication between vehicles and infrastructures, e.g. vehicle-to-cloud [V2C] or vehicle-to-home [V2H]

Abstract

Disclosed are a vehicle-mounted terminal, a distributed vehicle-mounted terminal integrated management method and a distributed vehicle-mounted terminal integrated management system. The method comprises the following steps: the method comprises the steps that a vehicle-mounted terminal collects unstructured video data and semi-structured vehicle driving state data and/or vehicle internal environment data, and a vehicle-mounted terminal registration node ID and a time-space label are added into the collected data; the server is accessed to multi-source heterogeneous data acquired by the distributed vehicle-mounted terminal; when an instruction for playing a video collected by a vehicle-mounted terminal under a registered node ID is obtained, corresponding real-time video data is pushed to the front end of a server webpage for stream pulling, a space-time label is extracted in the stream pulling process, and vehicle environment data and/or vehicle running state data matched with the video stream in time and space are retrieved according to the registered node ID and the space-time label; and sending the retrieved data to the front end of the server webpage to be synchronously displayed on the video display page, and reproducing the scene in the vehicle. The invention realizes real-time monitoring and visual reproduction of the running state of the distributed vehicle and the environment in the vehicle.

Description

Vehicle-mounted terminal, distributed vehicle-mounted terminal integrated management method and system
Technical Field
The invention relates to a vehicle-mounted terminal, a distributed vehicle-mounted terminal integrated management method and a distributed vehicle-mounted terminal integrated management system, which can be applied to the field of logistics.
Background
In order to ensure the safety of transportation, the commonly adopted management and control modes are as follows: cameras and sensors are arranged in vehicles such as petroleum transport vehicles, buses and logistics vehicles to monitor the transportation process. With the continuous increase of monitored vehicles, a remote monitoring system faces the requirements of massive, high-concurrency, real-time data processing and intelligent analysis, and how to upload, summarize, store and utilize massive traffic flow data in real time and how to reproduce the data visually becomes a great problem.
Disclosure of Invention
The invention provides a vehicle-mounted terminal, and a distributed vehicle-mounted terminal integrated management method and system, which are used for realizing real-time monitoring and visual reproduction of the running state of a distributed vehicle and the environment in the vehicle.
According to a first aspect of the embodiments of the present invention, a distributed vehicle-mounted terminal integrated management method is provided, including:
performing node registration on the vehicle-mounted terminal, generating a registration node ID for verifying the vehicle-mounted terminal, and registering a sensor and a camera on the vehicle-mounted terminal to form registration information of the sensor and the camera;
acquiring semi-structured vehicle running state data and/or vehicle internal environment data through a sensor, and acquiring unstructured video data through a camera;
adding a registration node ID and a time-space label into the acquired semi-structured data and the acquired unstructured video data, packaging the semi-structured data, and encoding the unstructured video data;
and transmitting the packaged and coded semi-structured data and the unstructured video data to a server in a multi-path parallel transmission mode.
In some examples, semi-structured data is transmitted using the TCP/IP protocol and unstructured video data is transmitted using the RTMP streaming protocol.
According to a second aspect of the embodiments of the present invention, there is provided a distributed integrated management system for vehicle-mounted terminals, including:
the node registration module is used for performing node registration on the vehicle-mounted terminal, generating a registration node ID for verifying the vehicle-mounted terminal, and registering a sensor and a camera on the vehicle-mounted terminal to form sensor and camera registration information;
the data acquisition module is used for acquiring semi-structured vehicle driving state data and/or vehicle internal environment data through a sensor and acquiring unstructured video data through a camera;
the data processing module is used for adding a registration node ID and a space-time label into the acquired semi-structured data and the acquired unstructured video data, packaging the semi-structured data and encoding the unstructured video data;
and the data transmission module is used for transmitting the semi-structured data and the unstructured video data which are packaged and coded to the server in a multi-path parallel transmission mode.
According to a third aspect of the embodiments of the present invention, there is provided a vehicle-mounted terminal including: and the processor executes the steps of the distributed vehicle-mounted terminal integrated management method according to the first aspect when executing the program stored in the memory.
According to a fourth aspect of the embodiments of the present invention, there is provided a distributed vehicle-mounted terminal integrated management method, including:
the method comprises the steps that unstructured video data acquired by a vehicle-mounted terminal, semi-structured vehicle driving state data and/or vehicle internal environment data are accessed in a multi-path parallel mode through a master-slave multi-thread mode, wherein the semi-structured data and the unstructured video data are provided with vehicle-mounted terminal registration node IDs and space-time labels;
respectively storing the accessed unstructured video data and the semi-structured data of the vehicle driving state data and/or the vehicle internal environment data;
when an instruction for playing a video collected by a vehicle-mounted terminal under a registered node ID is acquired, pushing real-time video data corresponding to the registered node ID to the front end of a web server webpage for stream pulling;
extracting a space-time label in the video streaming process, and retrieving the in-vehicle environment data and/or vehicle driving state data matched with the video streaming in time and space according to the registered node ID and the space-time label;
and sending the retrieved in-vehicle environment data and/or vehicle driving state data to the front end of the web server webpage, and synchronously displaying the data on the video display page.
According to a fifth aspect of the embodiments of the present invention, there is provided a distributed integrated management system for vehicle-mounted terminals, including:
the data access module is used for accessing unstructured vehicle video data acquired by the vehicle-mounted terminal, semi-structured vehicle driving state data and/or vehicle internal environment data in a multi-path parallel mode through a master-slave multi-thread mode, wherein the semi-structured data and the unstructured data are provided with vehicle-mounted terminal registration node IDs and space-time labels;
the data management module is used for storing the accessed unstructured video data, and semi-structured vehicle driving state data and/or vehicle internal environment data;
and the in-vehicle environment reproduction module is used for pushing the real-time video data corresponding to the registered node ID to the front end of the web server webpage for streaming when an instruction for playing the video collected by the vehicle-mounted terminal under the registered node ID is acquired, extracting a space-time label in the video streaming process, retrieving in-vehicle environment data and/or vehicle running state data matched with the video stream in time and space according to the registered node ID and the space-time label, sending the retrieved in-vehicle environment data and/or vehicle running state data to the front end of the web server webpage, and synchronously displaying the in-vehicle environment data and/or vehicle running state data on the video display page.
According to a sixth aspect of the embodiments of the present invention, there is provided a server including: and the processor executes the steps of the distributed vehicle-mounted terminal integrated management method according to the fourth aspect when executing the program stored in the memory.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings of the embodiments will be briefly described below.
Fig. 1 is a block diagram of a vehicle-mounted terminal according to an embodiment of the present invention.
Fig. 2 is a block diagram of a functional module of a vehicle-mounted terminal according to an embodiment of the present invention.
Fig. 3 is a UML model associated with monitoring data of a vehicle-mounted terminal according to an embodiment of the present invention.
Fig. 4 is a server-side software architecture according to an embodiment of the present invention.
Fig. 5 is a high concurrency processing framework based on the Netty technology according to an embodiment of the present invention.
Fig. 6 is a schematic diagram illustrating a distributed in-vehicle environment visualization process according to an embodiment of the present invention.
Detailed Description
The term "in-vehicle terminal" in the present invention refers to an electronic device component mounted on a vehicle to acquire in-vehicle image or video data, vehicle driving state data, and/or in-vehicle environment data. The vehicle driving state data may include, but is not limited to, one or more of the following: the position coordinate, the angle, the speed, the angular speed, the steering angle of the front wheel relative to the vehicle body and the battery parameters of the new energy vehicle. In-vehicle environmental data may include, but is not limited to, one or more of the following: temperature and humidity, particulate matter concentration, carbon monoxide concentration, carbon dioxide concentration, and volatile organic matter (formaldehyde, toluene, etc.) concentration. The vehicle-mounted terminal can be used for monitoring petroleum and chemical transport vehicles, public transport vehicles and logistics vehicles.
Fig. 1 shows a block diagram of a vehicle-mounted terminal, which includes a processing device, a sensor, a camera, a communication module, and a display. And according to the actual monitoring requirement, configuring a sensor and acquiring vehicle running state data and/or vehicle internal environment data. The sensor refers to a non-image type sensor, and may include, but is not limited to, one or more of the following monitoring modules: a GNSS positioning module; the device comprises a temperature and humidity sensor, an infrared sensing module, a dust sensor, a formaldehyde, PM2.5, toluene, carbon monoxide or carbon dioxide gas sensor and the like; the monitoring module of the running state of hardware facilities such as air conditioners, engines and the like; vehicle motion information monitoring modules (speed, acceleration, angular acceleration, displacement); angle information monitoring modules (pitch angle, roll angle, azimuth angle); new energy automobile battery information monitoring module. The camera captures image or video data. The sensor establishes physical connection with the processing device through a serial port, and the selectable serial port may include: UART, RS232, RS485, I2C, SPI and USB. The camera can establish physical connection with the processing equipment through a USB interface, an MIPI interface or a DMI interface. The communication module is responsible for the wireless communication connection between the vehicle-mounted terminal and the server and can be connected with the processing equipment through a serial port. The vehicle-mounted terminal has strong mobility due to the fact that the vehicle-mounted terminal moves along with a vehicle, the data volume is small, the transmission frequency is high, and meanwhile long-distance transmission needs to be considered. The invention adopts the transmission mode of cellular communication (4G/5G) to realize remote transmission.
The camera collects video data, the sensor collects vehicle running state data and/or vehicle internal environment data, the vehicle running state and/or vehicle internal environment dynamic changes are displayed and reflected in real time through the displayer, and the displayer is connected with the processing equipment through a VGA (video graphics array), HDMI (high-definition multimedia interface) or USB (universal serial bus) interface.
Functional software of the vehicle-mounted terminal can be developed based on a Linux operating system. As shown in fig. 2, the in-vehicle terminal may include four functional modules: the system comprises a node registration module, a data acquisition module, a data processing module and a data transmission module.
The node registration module realizes the registration function of the vehicle-mounted terminal, mainly comprises an application demonstration theme, a node type, node related meta-information, the number of sensors and meta-data information of each sensor, and randomly generates 8-bit nodeID as the node ID for verifying the vehicle-mounted terminal after registration is finished.
The vehicle-mounted terminal has different requirements on observation perception of vehicle data according to different application demonstration scenes. Therefore, the terminal node registration module needs to include not only the node type and the related information, but also provide a corresponding application demonstration theme so as to facilitate data analysis and make an accurate judgment on the vehicle state. The application demonstration themes mainly comprise a logistics scene, a passenger carrying scene and the like. The logistics scene can be further divided according to the type attributes of goods, such as refrigeration, fragility, flammability and the like.
The sensors have different sampling frequencies, and each data can represent the running state information of the vehicle or the environmental element information in the vehicle in the sampling time. The data acquired by the vehicle-mounted terminal has heterogeneity, the acquired data has different formats and structural characteristics according to different standards, for example, the data acquired by the GNSS positioning module, the temperature and humidity sensor, the gas sensor and the like is semi-structured text information data, and the data acquired by the camera is a real-time video stream and is unstructured data. Therefore, the data acquisition module respectively realizes the acquisition of the semi-structured data and the unstructured data.
And the data processing module performs json format packaging on the acquired semi-structured data according to metadata information, wherein the json format is a lightweight packaging format, and the data processing module is concise and clear in hierarchy and easy to read. And the data processing module adopts H264 video coding for the unstructured video data.
The data transmission module is realized by adopting two process scripts and is divided into two channels for respectively transmitting video data and sensor data. Because the GNSS positioning data, the non-image sensor data and the clock data are semi-structured text data, the transmission of the automobile driving state information and the automobile internal environment data is realized by adopting socket communication programming based on a TCP/IP protocol; the video image data is structured file data, and the RTMP streaming protocol is adopted to carry out video streaming pushing.
The main characteristic of the data collected by the vehicle-mounted terminal is multisource heterogeneity. Considering that the subsequent storage is difficult due to different structural sources of various data, the unified description is carried out on the multi-source data by constructing the metadata dictionary, and the unit or format of the data is normalized. On the basis of the unified description, a data association model is established by using the registered vehicle-mounted terminal node ID, as shown in FIG. 3. And carrying out node registration on the vehicle-mounted terminal to form vehicle-mounted terminal registration information, and ensuring the specificity of the vehicle-mounted terminal deployed in each automobile. And simultaneously registering the vehicle-mounted terminal, registering the mounted sensor and the camera to form sensor and camera registration information. By inquiring the registered node ID of the vehicle-mounted terminal, all sensor and camera information related to the node ID can be inquired. The registered node ID is also added into the sensor data and the video data collected by the sensor and the camera as a label, and the corresponding non-image data and the video data collected by the camera can be inquired through the attribute of the registered node ID, so that the association among the automobile terminal, the sensor and the sensor data and the association among the sensor data and the sensor data are established through the node ID. On the basis, when multi-source heterogeneous data collected by the distributed vehicle-mounted terminals are accessed to a data center of the server side, the data of different vehicle-mounted terminals can be distinguished through the node IDs, and classified storage is carried out according to the data of the vehicle-mounted terminals and information of various sensors registered by the terminals, so that follow-up data query, the automobile driving state and the in-automobile environment can be conveniently and visually reproduced. The invention relates to a method for adding node ID and time labels into data generated by different data sources, which can associate multi-source heterogeneous data and fuse data while ensuring data integrity.
A large amount of semi-structured sensor data and unstructured video stream data acquired by a vehicle-mounted terminal are accessed to a data access management platform of a server side in a multi-path parallel transmission mode. As shown in fig. 4, the server-side system may include four functional modules: the system comprises a log monitoring module, a data access module, a data management module and an in-vehicle environment reproduction module.
The method comprises the steps that non-image sensor data and video data collected by a vehicle-mounted terminal are parallelly accessed to a data layer in an access layer in a unified mode, different data are decoded in the data layer according to coding rules of a client to obtain corresponding data, the data in different formats are classified and packaged, type registration and standardized description are carried out on the sensor data, the data and metadata information of the data are stored in corresponding sets of a database according to storage rules of the database, unified packaging of the data and persistent management of the data are achieved, and corresponding services are provided for users by controlling the persistent data. The invention aims at the characteristics of different heterogeneous data structures, classifies data according to types or application scenes, and combines a database and a file system according to data characteristics so as to overcome the defects of a single storage form and meet the requirements on multi-source heterogeneous data storage.
The whole operation process of the server side is that before a user accesses the server, an access request is sent to the server, after the server receives the access request of the user, whether the request is received or not is judged according to relevant information, if the request is received, the server establishes a service thread for each user, and a special socket port is distributed. Since the data collected by the vehicle-mounted terminal is heterogeneous, a large number of service threads need to be established when massive heterogeneous data is accessed into the system for operation, which causes a high concurrency problem. In order to solve the problem, as shown in fig. 5, a master-slave multithreading mode is adopted on the basis of a netty framework, the mode does not use only a single thread when receiving data acquired by a vehicle-mounted terminal, the single thread is changed into a thread pool, the main thread of the thread pool is only responsible for connection requests, and the auxiliary thread is responsible for allocation of request tasks, so that massive concurrent requests can be processed. The data transmission that will gather of many sensors of deployment in the car is main for receiving the request to main Reactor, and under the condition of only receiving the client request, main Reactor can receive million grades of connection requests, can satisfy the simultaneous access of multichannel sensor in the car, in addition, can also compensate the unstable problem of Reactor thread pool when connecting concurrent request. The main Reactor only receives a connection request of data access transmitted by a vehicle-mounted terminal sensor, the concrete operation of the corresponding request after connection is that tasks are dispatched through the sub Reactor, the sub Reactor dispatches data of the sensor in the vehicle to the thread pool, different types of sensor data are injected into a certain thread in the sub Reactor thread pool, the data transmitted into the thread pool are packaged and encoded through a data format, the thread pool calculates the encoded sensor data, the associated different data are decoded to obtain corresponding vehicle driving state data and vehicle internal environment monitoring data, the heterogeneous data parallel access of various sensors deployed in the vehicle is further realized through a netty frame, and the vehicle driving state data and the vehicle internal environment monitoring data are stored after being successfully accessed into the system.
As shown in fig. 6, for the real-time reproduction requirements of videos in the distributed vehicle, the driving state and the environment in the vehicle, the invention aggregates data collected by different sensors and real-time video stream data transmitted by the vehicle-mounted camera, and visually displays the driving state and the environment in the vehicle on the web page platform according to the query requirements of the user. A user can log in a web webpage platform through a mobile phone or a computer to watch the running state of the automobile and real-time data and videos of the environment in the automobile. The web page platform is built on a web server, the web server interacts with the data server through a local area network to realize the query and feedback of data, and the data is fed back to the intelligent terminal of the user through the Internet. Real-time video stream collected by the vehicle-mounted camera and data measured by the sensor are provided with time empty labels. When a user logs in a webpage to select to view in-vehicle videos, in-vehicle environment data and vehicle running state data, a registered node ID corresponding to a vehicle-mounted terminal of a vehicle is selected, the registered node ID is clicked to play, a camera carried by the vehicle-mounted terminal pushes collected real-time videos to a web server, and the front end of the webpage is pulled to display in-vehicle pictures in real time. The video stream extracts a space-time label from the video stream, and the database searches sensor data which are closest to the video stream in time and space, such as coordinate data, temperature and humidity, gas content and the like according to the node ID and the space-time label registered by the vehicle-mounted terminal of the automobile, so that space-time matching of the real-time video stream, the environment data and the driving state data is realized. And sending the retrieved data to the front end of the webpage, and synchronously displaying the data on a video display page, so that the user can simultaneously see the real-time video in the vehicle and various data measured by the sensor. When the user clicks to stop playing, the camera stops pushing the stream, the webpage stops pulling the stream, the database stops data retrieval, and therefore the webpage stops displaying all data. Therefore, the user clicks playing and stopping to control push streaming and pull streaming of the video, and the bearing pressure of the server can be relieved. According to the invention, the multi-source heterogeneous data are aggregated and the aggregated data are visualized by a multi-source heterogeneous data space-time matching method. The functions of the sensor data and the real-time video stream through the air-space tag matching and synchronous display can well meet the requirements of intelligent logistics on reproduction and real-time monitoring of the environment in the vehicle.

Claims (7)

1. A distributed vehicle-mounted terminal integrated management method is characterized by comprising the following steps:
performing node registration on the vehicle-mounted terminal, generating a registration node ID for verifying the vehicle-mounted terminal, and registering a sensor and a camera on the vehicle-mounted terminal to form registration information of the sensor and the camera;
acquiring semi-structured vehicle running state data and/or vehicle internal environment data through a sensor, and acquiring unstructured video data through a camera;
adding a registration node ID and a time-space label into the acquired semi-structured vehicle driving state data and/or the vehicle internal environment data and the unstructured video data, packaging the semi-structured vehicle driving state data and/or the vehicle internal environment data, and encoding the unstructured video data;
and transmitting the packaged semi-structured vehicle driving state data and/or the vehicle environment data and the encoded unstructured video data to a server in a multi-path parallel transmission mode.
2. The integrated management method for the distributed vehicle-mounted terminals according to claim 1, characterized in that a TCP/IP protocol is adopted to transmit semi-structured data, and an RTMP streaming protocol is adopted to transmit unstructured video data.
3. The utility model provides a distributed vehicle mounted terminal integrated management system which characterized in that includes:
the node registration module is used for performing node registration on the vehicle-mounted terminal, generating a registration node ID for verifying the vehicle-mounted terminal, and registering a sensor and a camera on the vehicle-mounted terminal to form sensor and camera registration information;
the data acquisition module is used for acquiring semi-structured vehicle driving state data and/or vehicle internal environment data through a sensor and acquiring unstructured video data through a camera;
the data processing module is used for adding a registration node ID and a time-space label into the acquired semi-structured vehicle driving state data and/or the vehicle internal environment data and the unstructured video data, packaging the semi-structured vehicle driving state data and/or the vehicle internal environment data and encoding the unstructured video data;
and the data transmission module is used for transmitting the packaged semi-structured vehicle driving state data and/or the vehicle internal environment data and the coded unstructured video data to the server in a multi-path parallel transmission mode.
4. A vehicle-mounted terminal characterized by comprising: a processor, when executing the program stored in the memory, executing the steps of the distributed vehicle terminal integrated management method according to any one of claims 1-2.
5. A distributed vehicle-mounted terminal integrated management method is characterized by comprising the following steps:
the method comprises the steps that unstructured video data acquired by a vehicle-mounted terminal and semi-structured vehicle driving state data and/or vehicle internal environment data are accessed in a multi-path parallel mode through a master-slave multi-thread mode, wherein the semi-structured vehicle driving state data and/or the vehicle internal environment data and the unstructured video data are provided with vehicle-mounted terminal registration node IDs and space-time labels;
respectively storing the accessed unstructured video data, and semi-structured vehicle driving state data and/or vehicle internal environment data;
when an instruction for playing a video collected by a vehicle-mounted terminal under a registered node ID is acquired, pushing real-time video data corresponding to the registered node ID to the front end of a web server webpage for stream pulling;
extracting a space-time label in the video streaming process, and retrieving the in-vehicle environment data and/or vehicle driving state data matched with the video streaming in time and space according to the registered node ID and the space-time label;
and sending the retrieved in-vehicle environment data and/or vehicle driving state data to the front end of the web server webpage, and synchronously displaying the data on the video display page.
6. The utility model provides a distributed vehicle mounted terminal integrated management system which characterized in that includes:
the data access module is used for accessing unstructured vehicle video data acquired by the vehicle-mounted terminal, and semi-structured vehicle driving state data and/or vehicle internal environment data in a multi-path parallel mode through a master-slave multi-thread mode, wherein the semi-structured vehicle driving state data and/or the vehicle internal environment data and the unstructured video data are provided with vehicle-mounted terminal registration node IDs and space-time labels;
the data management module is used for storing the accessed unstructured video data, and semi-structured vehicle driving state data and/or vehicle internal environment data;
and the in-vehicle environment reproduction module is used for pushing the real-time video data corresponding to the registered node ID to the front end of the web server webpage for streaming when an instruction for playing the video collected by the vehicle-mounted terminal under the registered node ID is acquired, extracting a space-time label in the video streaming process, retrieving in-vehicle environment data and/or vehicle running state data matched with the video stream in time and space according to the registered node ID and the space-time label, sending the retrieved in-vehicle environment data and/or vehicle running state data to the front end of the web server webpage, and synchronously displaying the in-vehicle environment data and/or vehicle running state data on the video display page.
7. A server, comprising: a processor, when executing the program stored in the memory, executing the steps of the distributed vehicle terminal integrated management method according to claim 5.
CN202011319817.7A 2020-11-23 2020-11-23 Vehicle-mounted terminal, distributed vehicle-mounted terminal integrated management method and system Active CN112288904B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011319817.7A CN112288904B (en) 2020-11-23 2020-11-23 Vehicle-mounted terminal, distributed vehicle-mounted terminal integrated management method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011319817.7A CN112288904B (en) 2020-11-23 2020-11-23 Vehicle-mounted terminal, distributed vehicle-mounted terminal integrated management method and system

Publications (2)

Publication Number Publication Date
CN112288904A CN112288904A (en) 2021-01-29
CN112288904B true CN112288904B (en) 2022-04-01

Family

ID=74425256

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011319817.7A Active CN112288904B (en) 2020-11-23 2020-11-23 Vehicle-mounted terminal, distributed vehicle-mounted terminal integrated management method and system

Country Status (1)

Country Link
CN (1) CN112288904B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114327838B (en) * 2022-03-07 2022-05-24 中电云数智科技有限公司 Video scheduling engine device and method based on distributed management
CN115118759B (en) * 2022-05-31 2024-03-22 在行(杭州)大数据科技有限公司 Data transmission method and system of vehicle-mounted equipment
CN115311852A (en) * 2022-07-12 2022-11-08 重庆长安汽车股份有限公司 Method, system, vehicle and storage medium for predicting traffic congestion

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103984737A (en) * 2014-05-22 2014-08-13 武汉大学 Optimization method for data layout of multi-data centres based on calculating relevancy
CN104111998A (en) * 2014-07-09 2014-10-22 江西理工大学 Method and device for sorting coding and integrated exchange and management of heterogeneous data of enterprise
US10178638B1 (en) * 2016-07-29 2019-01-08 Senseware, Inc. System, method and apparatus for sensor control applications
CN109766329A (en) * 2018-12-29 2019-05-17 湖南网数科技有限公司 A kind of clinical data unit generation method and device for supporting that exchange is shared

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10091904B2 (en) * 2016-07-22 2018-10-02 Intel Corporation Storage sled for data center

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103984737A (en) * 2014-05-22 2014-08-13 武汉大学 Optimization method for data layout of multi-data centres based on calculating relevancy
CN104111998A (en) * 2014-07-09 2014-10-22 江西理工大学 Method and device for sorting coding and integrated exchange and management of heterogeneous data of enterprise
US10178638B1 (en) * 2016-07-29 2019-01-08 Senseware, Inc. System, method and apparatus for sensor control applications
CN109766329A (en) * 2018-12-29 2019-05-17 湖南网数科技有限公司 A kind of clinical data unit generation method and device for supporting that exchange is shared

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
云计算为轨道交通插上隐形的翅膀;曾虹云;《中国安防》;20130901(第09期);全文 *
云计算对轨道交通的影响;杨迎卯;《中国高新技术企业》;20150120(第03期);全文 *
机车监控视频自动转储与分析系统的设计实现;吕峰;《机车监控视频自动转储与分析系统的设计实现》;20190915(第09期);全文 *

Also Published As

Publication number Publication date
CN112288904A (en) 2021-01-29

Similar Documents

Publication Publication Date Title
CN112288904B (en) Vehicle-mounted terminal, distributed vehicle-mounted terminal integrated management method and system
CN102982311B (en) Based on automobile video frequency Feature Extraction System and the method for video structural description
CN106790367A (en) The vehicle safety hidden danger early warning of big data treatment and accident reproduction system and method
US20210073265A1 (en) Method and system for providing a federated wide area motion imagery collection service
CN103312788A (en) Automotive network black box system with cooperative terminal, pipeline and cloud end
WO2010126557A1 (en) Correlated media for distributed sources
US20200162785A1 (en) Method and system of data polling for augmented/mixed reality applications
WO2004036926A2 (en) Video and telemetry apparatus and methods
CN109270565A (en) A kind of processing unit of vehicle GPS big data
CN103294829A (en) System and method of achieving light-weight video structuralization description based on Android operation system
CN103984710A (en) Video interaction inquiry method and system based on mass data
CN113033463B (en) Deceleration strip detection method and device, electronic equipment and storage medium
CN106056697A (en) Event monitoring method, device and system
CN112923242A (en) GIS (gas insulated switchgear) system and method for inspecting oil and gas pipelines
CN102665064A (en) A traffic video monitoring system based on standard labeling and quick search
CN112182286B (en) Intelligent video management and control method based on three-dimensional live-action map
CN103886773A (en) Method for monitoring taxi on GIS map in real time under B/S environment
CN202077133U (en) Vehicle-mounted information processing device based on EVDO (Evolution-Data Only)
US11034020B2 (en) Systems and methods for enhanced review of automated robotic systems
CN202353715U (en) System for monitoring locomotive video
CN215117778U (en) Two-dimensional visual traffic monitoring system
CN102572533B (en) Internet protocol television (IPTV) center and area service management system
CN101951497B (en) IPTV (Internet Protocol Television) business system, central business management system, regional business management systems and operation methods
CN207753802U (en) The vehicle-mounted equipment of intelligent bus
JP2022131099A (en) Electronic apparatus, server to animate still picture, program and the like

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant