CN109558450A - A kind of automobile remote monitoring method and apparatus based on distributed structure/architecture - Google Patents
A kind of automobile remote monitoring method and apparatus based on distributed structure/architecture Download PDFInfo
- Publication number
- CN109558450A CN109558450A CN201811276477.7A CN201811276477A CN109558450A CN 109558450 A CN109558450 A CN 109558450A CN 201811276477 A CN201811276477 A CN 201811276477A CN 109558450 A CN109558450 A CN 109558450A
- Authority
- CN
- China
- Prior art keywords
- data
- remote monitoring
- automobile remote
- vehicle
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0841—Registering performance data
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Traffic Control Systems (AREA)
Abstract
The present invention is directed to the deficiency of existing vehicle remote system architecture design aspect; by big data technology; it is tested and is tested by actual platform building; being formed with Hadoop, Hdfs, MongoDB is storage basis; Netty, RabbitMQ are the automobile remote monitoring system framework of the high concurrent on message sink basis, High Availabitity; storage management trap for automobile surveys big data, and a kind of automobile remote monitoring method and apparatus based on distributed structure/architecture are specifically claimed.Based on the reception of big data processing, design meets the automobile remote monitoring framework method of high concurrent, High Availabitity, mass data processing demand, solves the problems, such as the high concurrent data receiver existing for current vehicle monitoring system architecture design and mass data query analysis.And as supportive technology, this research can provide technical support in terms of mass data monitors and intelligent network joins automobile monitoring.
Description
Technical field
The invention belongs to modernize computer traffic transporting technology, and in particular, to a kind of vapour based on distributed structure/architecture
Vehicle long-distance monitoring method.
Background technique
Oneself becomes a part indispensable in public family daily life with automobile, in recent years domestic automobile ownership sharply on
It rises, but following traffic accident takes place frequently, urban road is crowded, tail gas and the problems such as noise pollution are increasingly severe.In this shape
Under gesture, intelligent transportation system becomes the preferred plan alleviated and improve the above path problem.More have, China is to accelerate manufacture by force
State, science and technology power, network power, the construction of traffic power, push vehicle intellectualized, net connectionization technology development and industry to answer energetically
With.Clear stipulaties test vehicle can return in real time in " intelligent network connection trap for automobile test and management specification (tentative) " that country promulgates
The motion states such as vehicle control scheme, vehicle location, car speed, acceleration are passed to test and management center, it is desirable that test and management
Center must have the platform for meeting test vehicle related parameters real time monitoring.
In this context, automobile remote monitoring system has very important in intelligent transportation field, intelligent network connection field
Status.Automobile remote monitoring system is using technologies such as the communication technology, sensor technology, Automatic Control Theories, road participant
The information such as real-time positioning information, historical track, monitoring and monitoring give control of traffic and road people by means of communication Real-time Feedback
Member, by the relevant information to vehicle and road carry out analysis and decision, thus science, accurately dispatch road vehicle, improve
Traffic management level [3].With being continuously increased for vehicle to be monitored, automobile remote monitoring system face against magnanimity, high concurrent,
The demand of real time data processing and intellectual analysis, to propose higher technical requirements to implementer.In system implementation process
It continues to bring out data structure and data storage capacity can not flexible expansion, distributed parallel excavation hardly possible, high fault-tolerant recovery energy
The problems such as power is poor.How the traffic flow data of magnanimity uploaded in real time, summarized and stored utilization, and how data is carried out
Statistics, which is excavated, becomes a biggish problem.
Studies in China mechanism is asked for cores general character such as the magnanimity of automobile remote monitoring system, high concurrent and real-time processing
Topic stores skill by the big datas such as Hadoop, Spark processing technique and Hdfs, Hbase, MongoDB distributed data
Art gradually achieves some practical experiences and research achievement, while there is also some the problem of requiring further improvement.In the U.S.
More states are implemented in combination with traffic intelligent management with big data technology and vehicle data, greatly improve traffic department to unexpected thing
Therefore treatment effeciency.Domestic internet giant Baidu, Alibaba, Tencent etc. are big in participation car networking technology and vehicle at present
The analysis and research of data, the public transport data processing system that Shenzhen establishes have acquisition data mining, magnanimity acquisition data
The functions such as storage, intelligent decision and multi-platform information sharing provide support for " wisdom traffic city ".Domestic scholars utilize
The big datas technology such as Hadoop is realized in high concurrents such as petroleum transportation vehicle monitoring, traffic monitor, logistics vehicles monitoring
The monitoring of vehicle.But architecture design is mostly used at present often in the automobile remote monitoring system based on big data both at home and abroad
See internet big data framework, there is no the vehicle high concurrent being directed in automobile remote monitoring, data are complicated, need long-term monitoring
Etc. characteristics formed canonical schema, cause system occur clogged with messages, expend server resource phenomena such as.
Summary of the invention
Pass through actual platform by big data technology for the deficiency of existing vehicle remote system architecture design aspect
Test and test are built, the present invention is formd with Hadoop, Hdfs, MongoDB as storage basis, and Netty, RabbitMQ are to disappear
Breath receives the automobile remote monitoring system framework of the high concurrent on basis, High Availabitity, and storage management trap for automobile surveys big data.
A kind of automobile remote monitoring method based on distributed structure/architecture is claimed in the present invention first, it is characterised in that:
Collected vehicle data is sent to remote monitoring server by A1, data collection terminal；
A2, data are sent to load-balanced server after being then passed through firewall；
A3 passes through message-oriented middleware by the data of load-balanced server, sufficiently holds to terminal data access and data
Longization is decoupled, and realizes message pipeline in magnanimity terminal concurrence peak time, guarantees that the stabilization of data transmission is consistent with message
Property；
A4, data are after message application server, and after being parsed, data are stored into distributed memory；
Preferably further, the automobile remote monitoring method based on distributed structure/architecture carries out same in A1-A4 step
When, user terminal also carries out corresponding policer operation, it is characterised in that:
B1, user terminal carry out the information such as vehicle, driver by the end pc or the mobile end app using service registration service device
Registration, registration information are stored in Mysql database；
B2, user send inquiry, analysis demand to system service center, service centre by the end pc or the mobile end app
The system service for utilizing service-Engine according to the demand of user is matched by the information data of Mysql, is looked into Redis database
Ask data；
B3, if data can not be inquired in Redis database, to Hbase data base querying data；
B4 completes retrieval and need of the analysis based on user of data by Spark or Solr platform after inquiring data
It asks and provides a user comprising vehicle warning information, trace playback information, data serch information, vehicle monitoring progress, report form statistics
Information, the different types of data information such as other.
A kind of automobile remote monitoring device based on distributed structure/architecture is also claimed in the present invention characterized by comprising
Web module, which is mainly responsible for the page presentation of the automobile remote monitoring device, service request is submitted etc.
WebUI work, contain html5, CSS, Jquery component that interactive performance is excellent, bandwagon effect is good, using easeyUI,
The icon of echart shows work；
Communication module, the module are responsible for receiving the data packet that data collection station is sent, and framework is carried out high using netty
The reception of concurrent data packet；
Scheduling of resource module, the module are responsible for completing to provide between each server cluster using zookeeper, flume
Source scheduling；
Institute's analysis module is examined, which provides the retrieval and analysis of mass data using solr and spark；
Memory module, the module use the form mutually arranged in pairs or groups with distributed data base of relational database, with hbase with
Redis layers of responsible system business data and test data storage.
For the present invention based on the reception of big data processing, design meets high concurrent, High Availabitity, mass data processing
The automobile remote monitoring framework method of demand solves the high concurrent data existing for current vehicle monitoring system architecture design and connects
The problem of receiving with mass data query analysis.And as supportive technology, this research can be monitored in mass data and intelligence
Technical support is provided in terms of net connection automobile monitoring.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention without any creative labor, may be used also for those of ordinary skill in the art
To obtain other drawings based on these drawings.
Attached drawing 1 is a kind of workflow of the automobile remote monitoring method based on distributed structure/architecture according to the present invention
Figure；
Attached drawing 2 is a kind of data flow diagram of the automobile remote monitoring device based on distributed structure/architecture according to the present invention；
Attached drawing 3 is a kind of organizational structure of the automobile remote monitoring device based on distributed structure/architecture according to the present invention
Figure.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
The present invention protects a kind of automobile remote monitoring method based on distributed structure/architecture first, it is characterised in that:
Collected vehicle data is sent to remote monitoring server by A1, data collection terminal；
A2, data are sent to load-balanced server after being then passed through firewall；
A3 passes through message-oriented middleware by the data of load-balanced server, sufficiently holds to terminal data access and data
Longization is decoupled, and realizes message pipeline in magnanimity terminal concurrence peak time, guarantees that the stabilization of data transmission is consistent with message
Property；
A4, data are after message application server, and after being parsed, data are stored into distributed memory；
Further preferential, the automobile remote monitoring method based on distributed structure/architecture carries out same in A1-A4 step
When, user terminal also carries out corresponding policer operation, it is characterised in that:
B1, user terminal carry out the information such as vehicle, driver by the end pc or the mobile end app using service registration service device
Registration, registration information are stored in Mysql database；
B2, user send inquiry, analysis demand to system service center, service centre by the end pc or the mobile end app
The system service for utilizing service-Engine according to the demand of user is matched by the information data of Mysql, is looked into Redis database
Ask data；
B3, if data can not be inquired in Redis database, to Hbase data base querying data；
B4 completes retrieval and need of the analysis based on user of data by Spark or Solr platform after inquiring data
It asks and provides a user comprising vehicle warning information, trace playback information, data serch information, vehicle monitoring progress, report form statistics
Information, the different types of data information such as other.
Preferably further, collected vehicle data is sent to remote monitoring server by the A1, data collection terminal；
Specifically:
The data collection terminal be installed on vehicle or former vehicle carry data collection station, after acquiring information of vehicles
According to the agreement layout of regulation at data packet, automobile remote monitoring server is sent to through wireless network.In automobile remote monitoring
In server, display is monitored in web page after carrying out dissection process to data packet and is stored to storage section.
Preferably further, the A3 passes through message-oriented middleware by the data of load-balanced server, sufficiently to terminal
Data access and data persistence are decoupled, and realize message pipeline in magnanimity terminal concurrence peak time, guarantee data transmission
Stabilization and message consistency, specifically:
Collected vehicle data is sent to remote monitoring server by the data collection terminal, remote monitoring server into
First have to solve in row receive process is exactly the intrinsic connection management of the communication server, is capable of handling flash, the visitor of network
The problems such as reconnection at family end, the encoding and decoding of safety certification and message, half packet processing.And since monitoring needs to face magnanimity terminal
The test of the high concurrent performance of access, system need to design good memory management mechanism, and the connection of car-mounted terminal is to be based on
The wireless connection of GPRS, in the high speed movement of field, signal plays pendulum vehicle, although based on long connection,
But this connection is constantly interrupted and access, server is accessed in processing terminal, and data parsing, alarm analysis is put in storage in batches
When, can Memory Allocation it is reasonable, not will cause memory overflow, not will cause in million calling memory it is accumulative on
It rises.
The automobile remote monitoring method based on distributed structure/architecture communicates frame by Netty and carries out data receiver,
The module is mainly responsible for the tcp link of maintenance access terminal, the decoding of uplink and downstream message, compiles independently of other application
Code, flow control, the security controls such as black and white lists.Netty is the NIO frame an of high-performance, asynchronous event driven, it is provided
To the support that TCP, UDP and file transmit, as an asynchronous NIO frame, all I/O operations of Netty are all asynchronous non-resistances
Plug, by Future-Listener mechanism, the active that user can be convenient obtains or obtains I/O operation by informing mechanism
As a result.In the data transmission, the robustness of Netty, function, performance, customizability and scalability are all in same class framework
It is premier, and its performance has obtained hundreds of commercial project verifying, and automobile remote monitoring can be solved perfectly
The problem of system magnanimity terminal access.
Automobile remote monitoring AM access module and memory module will carry out interacting message, because of magnanimity vehicle termination Data Concurrent
Peak not timing, also, can concurrently be reduced in night platform really relatively.Therefore it is disappeared using high-performance communication frame reception
After breath, there is message-oriented middleware to carry out the decoupling between component, message-oriented middleware is made to be mainly used for the decoupling between component, message
Sender be not necessarily to know the presence of message user, vice versa.AMQP's is mainly characterized by message-oriented, queue, routing
(including point-to-point and publish/subscribe), reliability, safety is concurrent, causes peak time, and this interaction is to message coherence request
Relatively high, between a system asynchronous interactive is to be carried out by MQ component, needs response affirmation mechanism.RabbitMQ is
It realizes one kind of the message-oriented middleware of AMQP (advanced message queue protocol), initially originates from financial system, in distribution
Storage forwarding message in system/, ease for use, scalability, in terms of performance it is original, there is reliability, flexible
The functions such as routing, cluster, affairs, the queue of High Availabitity, prioritisation of messages, track problems, visualized management tool, plug-in system are special
Point.Using RabbitMQ as the message-oriented middleware between system communication module and database, sufficiently to terminal data access and
Data persistence is decoupled.Message pipeline is realized in magnanimity terminal concurrence peak time, guarantees stablizing and disappearing for data transmission
Cease consistency.
Preferably, the A4, data are after message application server, and after being parsed, data are stored to distribution and deposited
In reservoir and the B1, user terminal take the information such as vehicle, driver by the end pc or the mobile end app using service registration
Business device is registered, and registration information is stored in Mysql database specifically:
In the case where the data of high concurrent upload background, the data for monitoring vehicle often have bigger reading and writing data concurrency and tire out
Volume data amount.According to statistics, under the vehicle of 3000 private cars, the scale of 1HZ upload frequencies, the data uploaded daily are reachable
30000000.Access for the high concurrent of data, traditional relevant database provides the scheme of read and write abruption, but brings
Be data consistency problem.For more and more mass datas, traditional database divides table using a point library, real
Now get up more complicated, the later period will constantly carry out migration maintenance.For High Availabitity and flexible aspect, traditional data using
Active and standby, principal and subordinate, mostly main scheme, but scalability itself is poor, increases node and delay machine needs to carry out the migration of data.Needle
To problem above, distributed data base HBase has a set of perfect solution, suitable for wanting for high concurrent mass data access
It asks.Hbase reduces IO based on the efficient storage of column, common to inquire the whole fields for not needing a line, most of only needs
Several fields；To with towards capable storage system, every time inquiry all can total data take out, then therefrom select the word of needs again
Section；Storage system towards column can individually inquire a certain column, to substantially reduce IO, improve compression efficiency；Have with column data
There is very high similitude, will increase compression efficiency.
Redis is for providing the inquiry of vehicle real-time status, and Redis is a key-value storage system, is existed now
In various systems using more and more, be to be taken as caching because of its high performance characteristic and use in most cases.
Redis read or write speed is fast, because data are deposited in memory, is similar to HashMap, the time that advantage is just to look for and operates is complicated
Degree is all (1) O；In addition, redis supports rich data types, support
String, list, set, sorted set, hash, and support affairs, operation is all atomicity, so-called original
Sub- property is exactly change to data or all executes or do not execute all.Redis has characteristic abundant: can be used for delaying
It deposits, message, expired time is set by key, will be automatically deleted after expired.Therefore, the looking into as whole system using redis
Asking read-write cache can solve the problem of real time data inquiry and no write de-lay, guarantee the speed and inquiry of mass data read-write
Speed.
It is further preferred that the B4 completes the retrieval of data by Spark or Solr platform after inquiring data
It provides a user with demand of the analysis based on user comprising vehicle warning information, trace playback information, data serch information, vehicle
Monitoring progress, report form statistics information, the different types of data information such as other specifically include:
The data retrieval of this method uses Solr search engine.Solr is the high performance full-text search clothes based on lucene
It is engaged in device, provides query language more more abundant than lucene, provide SolrCloud mode to support distributed index,
It is automatic to carry out the cutting of sharding data；It is mentioned by master-slave (leader, replica) mode of each sharding
The performance of height search.It is asynchronous for operating in system to the index of data and storage, can greatly improve availability and handling capacity；
It only indexes operation to certain attribute fields, the mark key of storing data reduces the size of index；Data are stored in distribution
Formula stores in HBase, and Solr function of search makes up the bad disadvantage that HBase supports secondary index search, can be realized
The retrieval statistics of various dimensions on Hbase.Using the confirm affirmation mechanism of Solr, by establishing number to be indexed before index
According to queue, after the completion of data store and index, data are deleted from data queue to be indexed.
In order to meet the calculating demand of mining analysis and interactive real-time query vehicle data, this method has used Spark
Platform come support mining analysis class to calculate, interactive real-time query calculates and the quick search of allowable error range calculates.
Spark is the big data Computational frame for more focusing on iteration efficiency than MapReduce, is generally compared in SQL query aspect of performance
MapReduce is higher by 2 times or more, calculates the characteristic with memory table using memory, performance is at least at 10 times or more.It is iterating to calculate
In terms of mining analysis, precisely recommend the training that the model training of hour and day rank are changed into the minute rank of Spark, together
When succinct programming interface that algorithm is realized is more high on time cost and size of code than MR.
Spark, which provides a comprehensive, unified frame, various has heterogeneity (text data, chart for managing
Data etc.) data set and data source (batch data or real-time flow data) big data processing demand.Spark SQL,
The core components such as Spark, Streaming, MLlib, GraphX, SparkR solve the problems, such as many big datas.Spark read-write
Process overflows write-in disk unlike hadoop, is all based on memory, therefore speed is quickly.In addition the width of DAG job scheduling system
Narrow dependence allows Spark speed to improve.
This method is laid particular emphasis on to magnanimity, high concurrent, real time data processing frame design method, and emphasis solves vehicle remote prison
Magnanimity that control system is faced in big data processing and analysis field, high concurrent, the in real time problem that handles, realize unified and standard performance
Excellent vehicle big data processing framework.
It is a kind of data of the automobile remote monitoring device based on distributed structure/architecture according to the present invention referring to attached drawing 2
Flow graph, for the flow direction and number of the data of the present invention automobile remote monitoring device based on distributed structure/architecture related first
It is described in detail according to the object of participation.
Firstly, the data collection terminal of the automobile remote monitoring device based on distributed structure/architecture, that is, automobile end, pass through end
End box sends data to system, then, after data flow through firewall, is further transmitted to load-balanced server.System benefit
With Netty module creation communication connection, completing data access allows data to flow into system.Due to monitor terminal concurrency compared with
Greatly, data flow into Rabbit message queue and wait data processing.Data are after message application server, after being parsed, number
It is inner server according to storing to Redis, Redis, is used for data quick-searching.The data little for not query demand are write
Enter distributed data base Hbase, Hbase is stored on the Hdfs of Hadoop using distributed document.
On the other hand, the lower half portion of attached drawing 2 describes the data flow of user terminal, and user terminal believes vehicle, driver etc.
Breath is registered by the end pc or the mobile end app using service registration service device, and registration information is stored in Mysql database.With
Family sends inquiry, analysis demand to system service center by the end pc or the mobile end app, and service centre is according to the demand of user
Using the system service of service-Engine, matched by the information data of Mysql, to Redis data base querying data, if
Redis database can not inquire data, then to Hbase data base querying data, after inquiring data, by Spark or
Solr platform completes the retrieval of data and demand of the analysis based on user is provided a user comprising vehicle warning information, trace playback
Information, data serch information, vehicle monitoring progress, report form statistics information, the different types of data information such as other.
It is a kind of tissue of the automobile remote monitoring device based on distributed structure/architecture according to the present invention referring to attached drawing 3
Architecture diagram.
Such automobile remote monitoring device based on distributed structure/architecture characterized by comprising
Web module, which is mainly responsible for the page presentation of the automobile remote monitoring device, service request is submitted etc.
WebUI work, contain html5, CSS, Jquery component that interactive performance is excellent, bandwagon effect is good, using easeyUI,
The icon of echart shows work；
Communication module, the module are responsible for receiving the data packet that data collection station is sent, and framework is carried out high using netty
The reception of concurrent data packet；
Scheduling of resource module, the module are responsible for completing to provide between each server cluster using zookeeper, flume
Source scheduling；
Institute's analysis module is examined, which provides the retrieval and analysis of mass data using solr and spark；
Memory module, the module use the form mutually arranged in pairs or groups with distributed data base of relational database, with hbase with
Redis layers of responsible system business data and test data storage.
For the above method and device, to analyze its validity, having been built using 20 servers is had data acquisition, deposited
Storage, the automobile remote monitoring system for calculating and dispatching, and carry out the property of data reception processing, data calculating, data storage read-write
It is able to verify that, is built using the server of 20 equal performances compared based on common acquisition memory module as a comparison.
1) data receiver processing test
Vehicle simulation packet data is sent using terminal simulation tool, at this time server load where observation, if branch
Simulation mass data is held, whether related data normally issues.Corresponding Communications service link address is written in server junction, really
Recognize it is errorless after start to give out a contract for a project, simulation terminal i.e. start simulate terminal to Tongxu system send data packet.It, can if communication is normal at this time
Average 40,000 packet per second of packet 41998.48/s is sent to see.
The data 1365.6M that simulation uploads is generated using local station server, has remote monitoring system and comparison with automobile
System establishes communication, carries out data transmission, observes data acquisition rate, and table shows four processing results of system.
Table 1 receives processing test result
By this test it is found that system can satisfy 40,000 trolleys under current framework concurrently uploads data, and data
Parsing receiving velocity be obviously improved.
2) storage test
The data to be written are generated with digital simulation terminal in experiment, are sent to data storage server, observe certain time
Data volume is written in (60 seconds), data rate is write in calculating.
The test of 2 storage performance of table
By verifying, the automobile remote monitoring system framework designed herein is than conventional storage system in reading and writing data rate
Aspect is promoted significantly, meets design requirement.
Presently preferred embodiments of the present invention is not intended to limit the invention, all within the spirits and principles of the present invention,
Any modification, equivalent substitution, improvement and etc. done, should be included within the scope of the present invention.
Claims (4)
1. a kind of automobile remote monitoring method based on distributed structure/architecture, it is characterised in that:
Collected vehicle data is sent to remote monitoring server by A1, data collection terminal；
A2, data are sent to load-balanced server after being then passed through firewall；
A3 passes through message-oriented middleware by the data of load-balanced server, sufficiently to terminal data access and data persistence
It is decoupled, realizes message pipeline in magnanimity terminal concurrence peak time, guarantee the stabilization and message consistency of data transmission；
A4, data are after message application server, and after being parsed, data are stored into distributed memory.
2. a kind of automobile remote monitoring method based on distributed structure/architecture as described in claim 1, described based on distributed frame
For the automobile remote monitoring method of structure while A1-A4 step carries out, user terminal also carries out corresponding policer operation, and feature exists
In:
B1, user terminal infuse the information such as vehicle, driver by the end pc or the mobile end app using service registration service device
Volume, registration information are stored in Mysql database；
B2, user send inquiry, analysis demand to system service center by the end pc or the mobile end app, service centre according to
The system service of the demand utilization service-Engine of user is matched by the information data of Mysql, to Redis data base querying number
According to；
B3, if data can not be inquired in Redis database, to Hbase data base querying data；
B4, after inquiring data, by Spark or Solr platform complete data retrieval with analysis the demand based on user to
User is provided comprising vehicle warning information, trace playback information, data serch information, vehicle monitoring progress, report form statistics information,
The different types of data information such as other.
3. a kind of automobile remote monitoring method based on distributed structure/architecture as described in claim 1, the A1, data collection terminal
Collected vehicle data is sent to remote monitoring server；Specifically:
The data collection terminal be installed on vehicle or former vehicle carry data collection station, acquire after information of vehicles according to
Defined agreement layout is sent to automobile remote monitoring server at data packet, through wireless network.In automobile remote monitoring service
In device, display is monitored in web page after carrying out dissection process to data packet and is stored to storage section.
4. a kind of automobile remote monitoring device based on distributed structure/architecture characterized by comprising
Web module, the webUI such as which is mainly responsible for the page presentation of the automobile remote monitoring device, service request is submitted
Work, contains html5, CSS, Jquery component that interactive performance is excellent, bandwagon effect is good, using easeyUI, echart
Icon shows work；
Communication module, the module are responsible for receiving the data packet that data collection station is sent, and framework carries out high concurrent using netty
The reception of data packet；
Scheduling of resource module, the module are responsible for completing resource tune between each server cluster using zookeeper, flume
Degree；
Institute's analysis module is examined, which provides the retrieval and analysis of mass data using solr and spark；Memory module, the mould
Block uses the form mutually arranged in pairs or groups with distributed data base of relational database, with hbase and redis layers of responsible system business data with
Test data storage.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811276477.7A CN109558450B (en) | 2018-10-30 | 2018-10-30 | Automobile remote monitoring method and device based on distributed architecture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811276477.7A CN109558450B (en) | 2018-10-30 | 2018-10-30 | Automobile remote monitoring method and device based on distributed architecture |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109558450A true CN109558450A (en) | 2019-04-02 |
| CN109558450B CN109558450B (en) | 2023-05-09 |
Family
ID=65865432
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811276477.7A Active CN109558450B (en) | 2018-10-30 | 2018-10-30 | Automobile remote monitoring method and device based on distributed architecture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109558450B (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110851544A (en) * | 2019-11-12 | 2020-02-28 | 芜湖盟博科技有限公司 | Method for controlling remote vehicle by using remote service |
| CN110930706A (en) * | 2019-11-30 | 2020-03-27 | 航天科技控股集团股份有限公司 | Rapid directional distribution system for vehicle real-time data |
| CN111241101A (en) * | 2020-01-09 | 2020-06-05 | 深圳市东深电子股份有限公司 | Distributed water conservancy RTU data acquisition system and method |
| CN111611746A (en) * | 2020-05-20 | 2020-09-01 | 中国公路工程咨询集团有限公司 | Intelligent network networking test oriented database management system |
| CN112003920A (en) * | 2020-08-18 | 2020-11-27 | 天津四立科技有限责任公司 | Information sharing system |
| CN112073963A (en) * | 2020-09-16 | 2020-12-11 | 武汉虹旭信息技术有限责任公司 | Communication interaction data transmission method and device |
| CN112621755A (en) * | 2020-12-18 | 2021-04-09 | 浙江工业大学 | Remote monitoring system for multi-model industrial robots |
| CN112698910A (en) * | 2020-08-20 | 2021-04-23 | 纬领(青岛)网络安全研究院有限公司 | Infrastructure and innovative data access research of big data security |
| CN112799891A (en) * | 2021-01-15 | 2021-05-14 | 网易（杭州）网络有限公司 | iOS device test method, device, system, storage medium and computer device |
| CN113282677A (en) * | 2020-12-09 | 2021-08-20 | 苏州律点信息科技有限公司 | Intelligent traffic data processing method, device and system based on big data |
| CN115118754A (en) * | 2022-08-29 | 2022-09-27 | 中国汽车技术研究中心有限公司 | Remote monitoring test system and monitoring test method for electric vehicle |
| CN115987929A (en) * | 2022-12-21 | 2023-04-18 | 浪潮通信信息系统有限公司 | Method for broadband maintenance real-time communication |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010034317A1 (en) * | 2008-09-26 | 2010-04-01 | As Sivex International | Method and system for checking and managing queue of vehicles at border-crossing |
| CN103595973A (en) * | 2013-11-28 | 2014-02-19 | 惠州华阳通用电子有限公司 | Real-time vehicle audio/video monitoring system and method |
| CN106330921A (en) * | 2016-08-26 | 2017-01-11 | 重庆蓝盾电子技术服务公司 | Working method of vehicle management inspection system |
| WO2017071134A1 (en) * | 2015-10-28 | 2017-05-04 | 北京汇商融通信息技术有限公司 | Distributed tracking system |
| CN107025486A (en) * | 2017-02-27 | 2017-08-08 | 中国科学院信息工程研究所 | A kind of event detection system and method |
| CN107092691A (en) * | 2017-04-24 | 2017-08-25 | 中科院微电子研究所昆山分所 | A kind of date storage method and system based on car networking |
| CN107729413A (en) * | 2017-09-25 | 2018-02-23 | 安徽畅通行交通信息服务有限公司 | Regional traffic intelligent management system based on big data |
| CN107846468A (en) * | 2017-11-16 | 2018-03-27 | 北京卫星信息工程研究所 | Car networking application system and its control method based on cloud computing technology |
| CN108053863A (en) * | 2017-12-22 | 2018-05-18 | 中国人民解放军第三军医大学第附属医院 | It is suitble to the magnanimity medical data storage system and date storage method of big small documents |
| US20180159693A1 (en) * | 2016-12-06 | 2018-06-07 | Veniam, Inc. | Systems and methods for self and automated management of certificates in a network of moving things, for example including a network of autonomous vehicles |
| CN108171971A (en) * | 2017-12-18 | 2018-06-15 | 武汉烽火众智数字技术有限责任公司 | Vehicular real time monitoring method and system based on Spark Streaming |
-
2018
- 2018-10-30 CN CN201811276477.7A patent/CN109558450B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010034317A1 (en) * | 2008-09-26 | 2010-04-01 | As Sivex International | Method and system for checking and managing queue of vehicles at border-crossing |
| CN103595973A (en) * | 2013-11-28 | 2014-02-19 | 惠州华阳通用电子有限公司 | Real-time vehicle audio/video monitoring system and method |
| WO2017071134A1 (en) * | 2015-10-28 | 2017-05-04 | 北京汇商融通信息技术有限公司 | Distributed tracking system |
| CN106330921A (en) * | 2016-08-26 | 2017-01-11 | 重庆蓝盾电子技术服务公司 | Working method of vehicle management inspection system |
| US20180159693A1 (en) * | 2016-12-06 | 2018-06-07 | Veniam, Inc. | Systems and methods for self and automated management of certificates in a network of moving things, for example including a network of autonomous vehicles |
| CN107025486A (en) * | 2017-02-27 | 2017-08-08 | 中国科学院信息工程研究所 | A kind of event detection system and method |
| CN107092691A (en) * | 2017-04-24 | 2017-08-25 | 中科院微电子研究所昆山分所 | A kind of date storage method and system based on car networking |
| CN107729413A (en) * | 2017-09-25 | 2018-02-23 | 安徽畅通行交通信息服务有限公司 | Regional traffic intelligent management system based on big data |
| CN107846468A (en) * | 2017-11-16 | 2018-03-27 | 北京卫星信息工程研究所 | Car networking application system and its control method based on cloud computing technology |
| CN108171971A (en) * | 2017-12-18 | 2018-06-15 | 武汉烽火众智数字技术有限责任公司 | Vehicular real time monitoring method and system based on Spark Streaming |
| CN108053863A (en) * | 2017-12-22 | 2018-05-18 | 中国人民解放军第三军医大学第附属医院 | It is suitble to the magnanimity medical data storage system and date storage method of big small documents |
Non-Patent Citations (6)
| Title |
|---|
| WU S 等: "Storage and retrieval of massive heterogeneous iot data based on hybrid storage" * |
| 张春风等: "基于Storm的车联网数据实时分析系统", 《计算机系统应用》 * |
| 李晓夏: "大数据环境下的车辆监控公共服务平台研究", 《中国优秀硕士学位论文全文数据库工程科技Ⅱ辑》 * |
| 牛慧斌;: "企业车载GPS系统设计和实现" * |
| 虞洋: "基于车联网的汽车远程信息系统服务器软件设计", 《中国优秀硕士学位论文全文数据库工程科技Ⅱ辑》 * |
| 项兴国: "基于车辆监控系统的数据分析及其优化" * |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110851544A (en) * | 2019-11-12 | 2020-02-28 | 芜湖盟博科技有限公司 | Method for controlling remote vehicle by using remote service |
| CN110930706A (en) * | 2019-11-30 | 2020-03-27 | 航天科技控股集团股份有限公司 | Rapid directional distribution system for vehicle real-time data |
| CN111241101A (en) * | 2020-01-09 | 2020-06-05 | 深圳市东深电子股份有限公司 | Distributed water conservancy RTU data acquisition system and method |
| CN111611746A (en) * | 2020-05-20 | 2020-09-01 | 中国公路工程咨询集团有限公司 | Intelligent network networking test oriented database management system |
| CN112003920A (en) * | 2020-08-18 | 2020-11-27 | 天津四立科技有限责任公司 | Information sharing system |
| CN112698910A (en) * | 2020-08-20 | 2021-04-23 | 纬领(青岛)网络安全研究院有限公司 | Infrastructure and innovative data access research of big data security |
| CN112073963A (en) * | 2020-09-16 | 2020-12-11 | 武汉虹旭信息技术有限责任公司 | Communication interaction data transmission method and device |
| CN113282677A (en) * | 2020-12-09 | 2021-08-20 | 苏州律点信息科技有限公司 | Intelligent traffic data processing method, device and system based on big data |
| CN112621755A (en) * | 2020-12-18 | 2021-04-09 | 浙江工业大学 | Remote monitoring system for multi-model industrial robots |
| CN112621755B (en) * | 2020-12-18 | 2022-04-19 | 浙江工业大学 | Remote monitoring system for multi-model industrial robots |
| CN112799891A (en) * | 2021-01-15 | 2021-05-14 | 网易（杭州）网络有限公司 | iOS device test method, device, system, storage medium and computer device |
| CN115118754A (en) * | 2022-08-29 | 2022-09-27 | 中国汽车技术研究中心有限公司 | Remote monitoring test system and monitoring test method for electric vehicle |
| CN115987929A (en) * | 2022-12-21 | 2023-04-18 | 浪潮通信信息系统有限公司 | Method for broadband maintenance real-time communication |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109558450B (en) | 2023-05-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109558450A (en) | A kind of automobile remote monitoring method and apparatus based on distributed structure/architecture | |
| CN112685385B (en) | Big data platform for smart city construction | |
| CN108536778B (en) | Data application sharing platform and method | |
| Khan et al. | Cloud based big data analytics for smart future cities | |
| US10484190B2 (en) | Managing channels in an open data ecosystem | |
| Du et al. | A distributed message delivery infrastructure for connected vehicle technology applications | |
| CN113254466B (en) | Data processing method and device, electronic equipment and storage medium | |
| CN109582717B (en) | Database unified platform for electric power big data and reading method thereof | |
| CN111432295A (en) | Power consumption information acquisition master station system based on distributed technology | |
| Zhang et al. | Building information modeling–based cyber-physical platform for building performance monitoring | |
| US10157476B1 (en) | Self-learning spatial recognition system | |
| CN103337191A (en) | Public transportation information real-time sharing and query system and method | |
| CN108170832B (en) | Monitoring system and monitoring method for heterogeneous database of industrial big data | |
| CN113596117B (en) | Real-time data processing method, system, equipment and medium | |
| CN111125228A (en) | Data sharing method and device based on forestry data sharing service platform | |
| Ma et al. | Design and implementation of smart city big data processing platform based on distributed architecture | |
| WO2018213199A1 (en) | System and method for testing message filters in publish-subscribe networks | |
| Diyan et al. | Intelligent Internet of Things gateway supporting heterogeneous energy data management and processing | |
| CN110019085A (en) | A kind of distributed time series database based on HBase | |
| CN117033504A (en) | Mass data distributed management system of homeland space basic information platform | |
| Peng et al. | Message oriented middleware data processing model in Internet of things | |
| Mytilinis et al. | Modissense: A distributed spatio-temporal and textual processing platform for social networking services | |
| CN115374101A (en) | Rail transit station level data management system | |
| CN113468259A (en) | Real-time data acquisition and storage method and system | |
| Mal et al. | Real-time push middleware and mobile application for electric vehicle smart charging and aggregation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |