CN103532975B - A kind of can dynamic smoothing extension data collecting system and method - Google Patents
A kind of can dynamic smoothing extension data collecting system and method Download PDFInfo
- Publication number
- CN103532975B CN103532975B CN201310516800.4A CN201310516800A CN103532975B CN 103532975 B CN103532975 B CN 103532975B CN 201310516800 A CN201310516800 A CN 201310516800A CN 103532975 B CN103532975 B CN 103532975B
- Authority
- CN
- China
- Prior art keywords
- node
- data
- data acquisition
- data collection
- collection station
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 64
- 238000009499 grossing Methods 0.000 title claims abstract description 10
- 238000013480 data collection Methods 0.000 claims abstract description 202
- 238000007726 management method Methods 0.000 claims abstract description 110
- 238000004891 communication Methods 0.000 claims abstract description 75
- 238000013481 data capture Methods 0.000 claims abstract description 59
- 230000005540 biological transmission Effects 0.000 claims abstract description 54
- 238000013500 data storage Methods 0.000 claims abstract description 26
- 230000001360 synchronised effect Effects 0.000 claims abstract description 7
- 230000008569 process Effects 0.000 claims description 44
- 238000003860 storage Methods 0.000 claims description 24
- 230000006870 function Effects 0.000 claims description 8
- 238000012423 maintenance Methods 0.000 claims description 8
- 238000012544 monitoring process Methods 0.000 claims description 8
- 230000015572 biosynthetic process Effects 0.000 claims description 5
- 230000002159 abnormal effect Effects 0.000 claims description 4
- 238000009432 framing Methods 0.000 claims description 4
- 238000004458 analytical method Methods 0.000 claims description 3
- 230000008878 coupling Effects 0.000 claims description 3
- 238000010168 coupling process Methods 0.000 claims description 3
- 238000005859 coupling reaction Methods 0.000 claims description 3
- 230000000704 physical effect Effects 0.000 claims description 3
- 238000012545 processing Methods 0.000 claims description 3
- 238000012546 transfer Methods 0.000 claims description 3
- 230000033228 biological regulation Effects 0.000 claims description 2
- 238000004364 calculation method Methods 0.000 claims description 2
- 238000013479 data entry Methods 0.000 claims description 2
- 230000002427 irreversible effect Effects 0.000 claims description 2
- 230000002688 persistence Effects 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 11
- 230000008859 change Effects 0.000 description 5
- 238000004519 manufacturing process Methods 0.000 description 5
- 238000009826 distribution Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 238000009776 industrial production Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 238000013024 troubleshooting Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- DMBHHRLKUKUOEG-UHFFFAOYSA-N diphenylamine Chemical compound C=1C=CC=CC=1NC1=CC=CC=C1 DMBHHRLKUKUOEG-UHFFFAOYSA-N 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a kind of can the data collecting system of dynamic smoothing extension and method, including data acquisition center system and data collection station；Data acquisition center system includes Gateway routing node, data capture management node, data acquisition node, safety certification node, acquired data storage node, monitor node, time synchronized service node, safety certificate memory node, log management node, daily record memory node, data acquisition center system is by communication network and data collection station communication, the data of collected equipment are transmitted to data acquisition node by described data collection station, and submit data acquisition application list to Gateway routing node, the data acquisition node routing iinformation list returned according to Gateway routing node, the transmission request of business report block is initiated respectively with each data acquisition node, carry out Data Encryption Transmission.The present invention solves available data acquisition system and extends under new opplication requirement that cost is high, extended capability is poor, the problem of security risk.
Description
Technical field
The present invention relates to data collecting field, particularly relate to a kind of can dynamic smoothing extension data collecting system and method.
Background technology
Perfect along with computer technology, the development of technology of Internet of things and data communication infrastructure, society is by computerized information
Epoch enter into the Internet of Things epoch, occur increasing on-site data gathering equipment in productive life, and these equipment both include passing
The specialized data collecting device being applied to the industrial monitoring such as intelligent grid, automatic production line field of system, also includes being applicable to
Smart Home, environmental monitoring, the Portable intelligent equipment possessing data acquisition function in individual Mobile solution field.Traditional
The data collecting system in computerized information epoch was developed from the eighties in 20th century, installation data gather the meter of Master Station Software
Calculating machine equipment, fieldbus and data acquisition equipment to constitute, the design object of such system is the specialized number by industry spot
Industrial monitoring data acquisition is realized according to collecting device.In the Internet of Things epoch, large number of faced by the data collecting system of traditional mode,
The data transfer demands of the Internet of Things collecting device of huge number, shows increasing limitation, is mainly reflected in:
1) in traditional data collecting system, extend by writing in data acquisition Master Station Software, by the way of configuration specification
Collecting device.Be only applicable to collection device type and number of devices is all fixed, the industrial automation that carries out operations specific.
When carrying out new equipment expansion access in traditional data collecting system, first it is the type in data acquisition Master Station Software
Equipment writes collection stipulations, and then in software system, each equipment for the type carries out communication configuration, including routing iinformation,
Stipulations information, data point table information.This configuration process have to be carried out, otherwise by the professional being well understood by system
The stability that may have influence on original system is changed in these configurations.The access of each new equipment in production scene, is required for this
Process repeats.Fortunately, in industrial production environment, kind and the quantity of data acquisition equipment all design through strict,
Although in the system debug stage, the configuration workload of this device extension can be very big, but puts into stable fortune when system completes debugging
After row, unless dilatation or maintenance, the demand of newly added equipment is less, and in this application scenario, traditional data collecting system is
Meet and use requirement.
In the application scenarios that kind and the quantity of collecting device can frequently change, the Smart Home of such as facing multiple users is public
Environmental dynamic monitor in data acquisition service, wide scope, electric automobile move data acquisition etc. altogether, due to monitoring object
Multiformity and the erratic behavior of operating condition, the type of data acquisition equipment and quantity can frequently change, if using traditional number
According to acquisition system, it is necessary to configure change in the system of stable operation frequently, this is both to data collecting system band
Carry out huge maintenance work, leave hidden danger to system stable operation again.
2), in traditional data acquisition system, the centring system road to all collected equipment in data acquisition Master Station Software system maintenance
By information, data acquisition occupies leading position, be responsible for setting up the transmission route with collected equipment, it is adaptable to by counting
The data acquisition scenarios of fixed route information is had to collected equipment according to gathering centring system.
When in industrial automation production process, emphasis equipment to production process carries out data acquisition, need for this collected equipment
Setting up proprietary data acquisition channel, data acquisition Master Station Software system is this collected equipment with its proprietary data passage in system
Inside setting up route record information, when data acquisition center system brings into operation, data acquisition Master Station Software system is deposited according to self
The route that the routing iinformation of storage is set up one by one with all data acquisition equipments is connected.This passage is proprietary and by data acquisition center system
It is big that the mode of the responsible Route establishment of system meets volume of transmitted data in commercial production, and real-time and the stability requirement of data transmission are high
Demand.
In internet of things data acquisition field, large number of Internet of Things data equipment presents discrete distribution character in geographical space
With the mobility of position, reality do not possesses the condition being equipped with proprietary, fixing data communication channel for each equipment, i.e. without
Fixed route information.In the case of not having fixed route, data acquisition center system the most just cannot be built for collected equipment in advance
Vertical route matching information table also initiates route connection, namely need to take new method for routing foundation；The most traditional data acquisition
Being specific to the attribute of collected equipment due to passage in system, acquisition system needs the maximum according to the collected equipment that may access
The data route of quantity equivalent arrangements equal number, in traditional data acquisition system, is the field that collected number of devices is few
Scape, this mode is feasible, but in Internet of Things field, needs in the face of millions of equipment, simultaneously collecting device
Wire condition can change frequently, and collecting device can frequently carry out online and off-line along with the actual requirement or restriction that gather place
Conversion, in traditional data acquisition system, static routing resources employment methods cannot meet the most changeable this demand, needs new
Route management method and available route Dynamic Reconfiguration.
3) traditional data acquisition system is applied to industrial production environment more, and its network environment is that privately owned industrial field data gathers net
Network, this with Common transport channel physical isolation, decrease data collecting system independent from the industrial on-site network becoming network and be subject to
The risk of extraneous security attack, for ensureing the real-time of commercial Application, typically takes data clear text to carry out message transmissions.With industry
It is different that on-the-spot specialty collecting device is in separate network environment, and Internet of Things intelligent acquisition device distribution, in the range of reason significantly, counts
Must be by means of common transmission network according to transmission network, system suffers the risk of security attack very greatly, traditional data collecting system
And method is not suitable for the scene that this security risk is higher.
No. 200410021983.3 patent of invention of China, relates generally in industrial field data acquisition system data by setting threshold value
Carry out a kind of method for designing stored, it is adaptable to realize valid data amount and data convert during the storage of dynamic environment data bottoms
Active balance, fail to solve that the newly-increased data acquisition equipment configuration that this programme proposes is loaded down with trivial details, route dynamically management and on-demand configuration,
The problems such as security fence.
No. 200810198817.9 patent of invention of China, proposes a kind of management system supporting different data collection service, and this is
System uses and uses different terminals for different business, can support uniformly, manage different data collection services, but this system
Substantially still fall within traditional data collecting system, simply by terminal carry out between concrete different business data collecting system every
From, solve the problem that stipulations expand.Gather in scene if applying at Internet of Things, the equipment that still suffers from expand loaded down with trivial details, routing management and
Security restriction, fails to solve newly-increased data acquisition equipment loaded down with trivial details, the routing management of configuration and dynamic configuration, the safety that this programme proposes
The problems such as property protection.
No. 200910111103.4 patent of invention of China, it is proposed that a kind of distributed data acquisition control platform system, this invention
Based on integrated by multiple communication modes of traditional data collecting system, it is achieved that the distributed capture of data, it is substantially
The traditional acquisition system mentioned in this programme is carried out the category of protocol extension, also fails to solve the newly-increased data acquisition that this programme proposes
The configuration of collection equipment is loaded down with trivial details, the route dynamically problem such as management and dynamic configuration, security fence.
Summary of the invention
For above-mentioned deficiency, the invention provides a kind of can the data collecting system of dynamic smoothing extension and method, it is achieved data
Collection centring system is not required to human configuration can realize the Weigh sensor of newly added equipment, access and data classification collection, data acquisition
Automatization's distribution according to need of collection route adjusts with dynamic, the safety certification that collecting device accesses and data are transmitted, solution available data
Under new opplication requires, extension cost is high, extended capability is poor, the problem of poor stability for acquisition system.
To achieve these goals, the present invention adopts the following technical scheme that
A kind of can the data collecting system of dynamic smoothing extension, including data acquisition center system and data collection station；
Described data acquisition center system passes through communication network and described data collection station communication,
Described data acquisition center system is the core of data collecting system, be responsible for data acquisition, management, safety certification,
Storage and log services；
The data of collected equipment are transmitted to data acquisition node by described data collection station, and by data acquisition application list
Submitting Gateway routing node to, the data acquisition node routing iinformation list returned according to Gateway routing node, respectively with each data acquisition
Collection node initiates the transmission request of business report block, carries out Data Encryption Transmission；
Described communication network is responsible for data collection station and provides the physical link of data acquisition center system, by Ethernet,
One or more in GPRS, 3G, 4G, industrial bus are constituted；And, it is also possible to can provide what data transmitted to have for other
Line or wireless physical links；For ensureing the versatility of routing iinformation customization, select ICP/IP protocol as transport layer protocol.
Described data acquisition center system includes:
Gateway routing node, with data collection station, some data capture management nodes, safety certification node, monitor node and
Log management node communication, is that data collection station passes through communication network entrance data acquisition center system the first entrance, gateway road
Fixed by the routing iinformation of node, generally one, open to all data collection stations, be responsible for processing data collection station to
The terminal data collection application list that data acquisition center system is initiated；And, by the identity in terminal data collection application list
Authentication information submits to safety certification node to carry out authentication, and the identity authentication result returned by safety certification node sends to data
Acquisition terminal；And, after safety certification is passed through, by business report block summary information in terminal data collection application list according to
The type of service of business report block reorganizes, and forms one or more classification business report block collection application list；By industry
Classification business report block collection application list is submitted to process the data capture management node of this type of service, by each by service type
The data acquisition node route information table single-shot that individual data capture management node returns delivers to data collection station.
Described data acquisition center system also includes:
Safety certification node, communicates with Gateway routing node, monitor node, safety certificate memory node, is used for carrying out data acquisition
The safety certification of collection terminal, receives the authentication information in the terminal data collection application list that Gateway routing node forwards, will
Certificate in authentication information and safety certificate memory node is compared certification, sends authentication result to Gateway routing node.
And, generating authentication information according to the uniqueness identity of data collection station, authentication information can fill storage down and arrive
In the cipher key module of data collection station.
Safety certificate memory node, with safety certification node communication, is used for storing the safety certificate of data collection station；
Monitor node, with Gateway routing node, safety certification node and log management node communication, is used for monitoring and controlling gateway
Routing node, safety certification node, the running status of log management node, it is ensured that each node works online.
Log management node, with Gateway routing node, safety certification node, data acquisition node, data capture management node,
Daily record memory node communicates, and produces the record of log information, maintenance and management work for each node of system；
Daily record memory node, with log management node communication, is responsible for the storage of daily record；
Data capture management node, with Gateway routing node, log management node, some data acquisition node communication, receives net
Close the classification business report block collection application list that routing node sends, gather for classification business report block according to routing strategy
Each business report block entry in application list chooses data acquisition node, forms data acquisition node routing iinformation list；
And, data acquisition node route information table single-shot is delivered to Gateway routing node, simultaneously according to data acquisition node routing iinformation
Communication information list is pushed to the data acquisition node of correspondence by the match information in list；
Data acquisition node, with data capture management node, acquired data storage node, data collection station, log management joint
Point communication, is responsible for the data acquisition of data collection station, and the transmission for data collection station asks to set up communication connection, is responsible for number
According to gathering resolving；
Acquired data storage node, with data acquisition node communication, for storing the data that each data acquisition node gathers, and carries
For data access function；
Time synchronization node, for providing time synchronized service for all nodes in system.
Described Gateway routing node, data capture management node and data acquisition node carry out logical relation tissue according to tree-like；Net
Closing routing node is the root node of this tree structure, and its lower connection has one or more data capture management node；Each data acquisition
One or more data acquisition node is had below collection management node.
Gateway routing node, data capture management node, data acquisition node, safety certification node, acquired data storage node,
Monitor node, time synchronized service node, safety certificate memory node, log management node, daily record memory node, all on
State application node to allow to operate on same computer server, allow also to multiple application node and operate in same computer clothes
On business device；And, above-mentioned node allows to operate on same or multiple different cloud computing service platform.
Described terminal data collection application list includes authentication information, transmission key information, business report block summary information.
Described data collection station includes master control borad, described master control borad respectively with power module, CPU module, memory module, communication
Module, display module, cipher key module, stipulations modular converter, input and output module, pair time module, Keysheet module two-way communication.
Allow between described data collection station and some collected equipment by RS232, RS485, CAN, Ethernet,
Wireless mode carries out communication connection.Described collected equipment include sensor, operation terminal, controller, device communication module,
The Internet of Things smart machine in the fields such as traditional industry field apparatus or Smart Home, intelligent building, Intelligent logistics such as PLC, especially
It it is Internet of Things smart machine in the intelligent grid such as intelligent meter meter and senior measurement, intelligent power, electric automobile and charging.
Allow by fiber optic Ethernet, wireless mode between described data collection station and Gateway routing node and data acquisition node
Communication connection is carried out as transport layer protocol using ICP/IP protocol.
Described data collection station has needed authentication, transmission key, business report block summary information before accessing said system
Configuration work.
The collecting method that above-mentioned data collecting system is used, including step:
Step (1): data collection station sends terminal data collection application list to Gateway routing node；
Step (2): Gateway routing node is that terminal data collection application list generates handling process, and each handling process is
One Erlang process, Gateway routing node sends terminal data collection application to safety certification node in this Erlang process
Authentication information in list, waits that safety certification node returns the security certification result of this data collection station；Gateway simultaneously
Routing node waits new collection application；
Step (3): safety certification node according to the authentication information in terminal data collection application list to data collection station
Carry out safety certification, authentication result is sent to Gateway routing node；
Step (4): if authentification failure, authentication result is returned to data collection station by Gateway routing node, terminates this and processes
Flow process, terminates to be responsible for this Erlang process processed simultaneously；
Step (5): if certification is passed through, Gateway routing node is by business report block summary information in terminal data collection application list
Reorganize according to the type of service of business report block, form the service order form list of classification business report block；Further,
The service order form list of classification business report block is submitted to process some data acquisitions of this type of service by Gateway routing node respectively
Management node；
Step (6): after some data capture management nodes receive service order form list, is business application according to preference policy
Each business report entries match data acquisition node in list, organizes the formation of data acquisition node routing iinformation list, and
Routing iinformation list is back to Gateway routing node；Data capture management node is simultaneously according to the data acquisition in routing iinformation list
Collection node generates communication information list with the match information of business report entry, and communication information list has pushed to coupling
Data acquisition node；
Step (7): Gateway routing node receives the routing iinformation list that data capture management node returns, now routing iinformation
List is made up of multiple concrete business report block entries and the combination entry with the routing iinformation of this business report block entries match,
Routing iinformation list is delivered to submit to the data collection station of this collection application by Gateway routing node；Gateway routing node is this collection
Application generate Erlang treatment progress wait always institute oriented data capture management node submit to application result return, if surpass
Time, send time-out information to data collection station；
Step (8): if data collection station receives the data acquisition in time-out information, or the routing iinformation list received
Node is empty data acquisition node, and data collection station terminates this application, and after postponing a period of time, to Gateway routing node
Initiate new collection application；
Step (9): data collection station is after receiving the routing iinformation list of all returns, to each routing iinformation list middle finger
Fixed data acquisition node initiates the transmission request of business report block, and data acquisition node is that transmission channel is set up in each transmission request,
Each transmission channel is an Erlang process, the data transmission key information corresponding according to business report block and data parsing
Mode, completes to transmit the deciphering of message, resolves, stores and framing, encrypt and transmit；
Step (10): collection data are stored data into acquired data storage node according to storage strategy by data acquisition node；
In described step (1)-step (10) log management node real-time storage Gateway routing node, safety in the process of implementation
The daily record of work that certification node, data capture management node, data acquisition node produce；Monitor node monitors in real time, safeguards net
Close routing node, safety certification node, the running status of data acquisition node, when Gateway routing node, safety certification node or
When data acquisition node occurs abnormal, monitor node attempts carrying out abnormal nodes reboot operation, and system for prompting attendant and
Shi Jinhang troubleshooting；Time synchronization node Timing Synchronization Gateway routing node, safety certification node, safety certificate memory node,
Monitor node, log management node, daily record memory node, data capture management node, data acquisition node, collection data are deposited
The time of storage node.
Terminal data collection application list in described step (1), including authentication information, transmission key information, business report
Accuse block summary information.
Described authentication information is this acquisition terminal equipment at initial phase, by safety certificate management node according to this data acquisition
The uniqueness identity of collection terminal generates, and lower dress storage is to the cipher key module of data collection station, and this lower process of assembling can not weigh
Carry out again, and irreversible.
Described transmission key information is produced by data collection station cipher key module, in each new data acquisition application list
Transmission key information can difference, data acquisition node by this key can resolve data collection station this transmission application thing
The data after cipher key module is encrypted sent in the business cycle, and allow the order by being sent to data collection station with this key
It is encrypted, it is ensured that this order can be by data collection station identification.
Described business report block summary information is the initialized collectable data entry information of this collection data collection station, including
Report blocks entry that the business report set of blocks divided according to type of service and attribute, report blocks set comprise, report blocks entry
Measuring point, the data store strategy of measuring point and other attributes comprised.
Safety certification in described step (3), is used for the guarantee data collection station only through legitimate authentication and just can automatically access
In system.Safety certification node is by the authentication information of data collection station and the safety certificate in safety certificate memory node
Carrying out checking coupling, if being verified, return authentication passes through result, otherwise authentification failure, and return authentication does not passes through information.
Described step (5) particular content is: Gateway routing node resolves terminal data collection application list, according to this terminal data
In collection application list, the type of service of report blocks set in business report block self-description information, is formed one or more according to business
Type carries out the service order form list classified, and each service order form list includes that data collection station mark, data collection station pass
Defeated key information, business gather applying type, the data acquisition node order of support and the collection report blocks set of this business, its
Middle collection report blocks set comprises one or more business report block entry, and each entry comprises the measuring point of this entry, data storage
Strategy and other information is described.Gateway routing node needs to gather applying type according to business and delivers to service order form single-shot process
The data capture management node of such business.
Preference policy in described step (6), in data capture management node data acquisition node under multiple node administrations
The preference policy carrying out selecting includes following factor: the I/O load of data acquisition node, cpu load, the physical property of core original paper
Can parameter, the Qos of data collection station to data acquisition node.
I/O load judges with the par of Erlang process in data acquisition node 30 minutes；
Cpu load judges with the average occupancy of CPU in 30 minutes；
The physical function parameter of core original paper includes cpu temperature, hard disk temperature, cpu fan rotating speed；
Appointment data collection station to the Qos calculation specifying data acquisition node is: from all and appointment data acquisition node
Keep in communication and the data collection station connected selects to be positioned at the data of identical and close communication topology location with this data collection station
Acquisition terminal, is that this data collection station is to being somebody's turn to do with the meansigma methods of these data collection stations to the Qos specifying data acquisition node
Specify node Qos, if there is not the data collection station of same or like network topological location, it is allowed to do not use this strategy because of
Element.
Data acquisition node selects the principle concrete in dominant strategy to be: I/O load is low, cpu load is low, the physical property of core original paper
Parameter is normal, Qos is low.
Routing iinformation list in described step (6), is according to being business application according to preference policy by data capture management node
Each business report entries match data acquisition node in list and organize the formation of, including data collection station mark and business
Communication protocol type that report blocks is corresponding, acquisition node IP address, acquisition node port numbers.Communication in described step (6)
Information list, is that data capture management node generates according to the data acquisition node match information in routing iinformation list, including number
According to acquisition terminal mark, data collection station transmission key information, business gathers applying type, the data acquisition node of support is ordered
Order and the business report block items for information of correspondence.
The step of described step (9) is: data capture management node is that each service order form list generates a routing iinformation list,
In service order form list each report blocks entry to should route information table Dan Zhongyi data acquisition node routing iinformation, route
Information includes communication protocol type, data acquisition node IP address and port numbers；Data collection station is to each data acquisition node
Initiating connection request, data acquisition node provides data acquisition channel in the mode of Erlang process for data collection station；Data
Acquisition terminal when setting up communication first and being connected with data acquisition node, and data acquisition node is detailed to data collection station request measuring point
Carefully describing information, data collection station uploads this data acquisition node correspondence report blocks bar measuring point information now；Hereafter data acquisition
The key that collection terminal and data acquisition node provide with data collection station carries out Data Encryption Transmission, and data acquisition node is according to number
Data parsing and data storage is completed according to the analysis mode of regulation in the measuring point self-description information that acquisition terminal provides.
Data storage in described step (10), data acquisition node transfers data to acquired data storage node, gathers number
Such as cache deviation according to memory node according to data store strategy set in advance, time interval completes data buffer storage, it is provided that count in real time
According to section access function and by data persistence to data base, data base provides perdurable data access function；Different business numbers
It was reported that the data store strategy of block allows also to be customized describing in report blocks.
Beneficial effects of the present invention:
1, data collection station by carrying out authentication information, transmission key information, data point and business report when initializing
Block summary information configures, and makes data collection station possess self portrait ability, it is achieved that the self-description data of various field equipment connects
Enter.Data acquisition center system, by accepting the collection application list of data collection station, inquires about the self-described of data collection station
Information, carries out resolving storage these three automatization step according to data collection station self-description information, it is possible to without to data
Gather the data acquisition realizing newly-increased data collection station in the case of centring system configuration is modified.
2, business is gathered application form single-shot by Gateway routing node and delivers to data capture management node by system, by data acquisition collector
Reason node dynamically distributes data acquisition node and forms routing iinformation list according to preference policy, and final by Gateway routing node by road
Acquisition terminal is returned by information.Under the cooperation of Gateway routing node, by by the data capture management node of work organization, number
According to acquisition node and the technical implementation way of the corresponding acquisition channel of one Erlang process of employing, it is achieved that data collecting system
Routing iinformation dynamic autoization configuration and access channel capacity smooth adjustment.
3, in the present invention, Gateway routing node is to enter data collecting system the first entrance, without safety certification or encryption
Service request can only enter Gateway routing node, Gateway routing node carry out the forwarding of business or abandon；Save to data acquisition
The business of point is the data through safety certification and encryption.Gateway route the mode being combined with safety certification, reduces data acquisition
The overall risk that system is attacked under various network environments of collecting system；Gateway routing node separates with data acquisition node, screen
Cover the technical scheme of acquisition node, improve the overall safety of data collecting system and availability, even Gateway routing node
Under attack, only affect the access of new data collection terminal, do not affect original normal data acquisition having accessed data collection station.
4, monitor node monitor Gateway routing node, safety certification node, log management node properly functioning, it is ensured that these joint
The stable operation of point；Monitor node itself runs in hot standby mode simultaneously, ensures the properly functioning of monitor node each other.Overall
Monitoring has ensured system run all right.
5, the data capture management node optimum option to data acquisition node, it is ensured that the load balancing of each data acquisition node.
Data acquisition node provides data acquisition channel in the mode of Erlang process for data collection station, it is achieved acquisition channel is smooth to be expanded
Hold；And data collection station exempts from configuration mode to what acquisition node provided data parsing mode and measuring point information, it is to avoid manually join
Put and cause possibility that is loaded down with trivial details and that make mistakes；Use key cipher mode number between data acquisition node and data collection station simultaneously
According to communication, enhance the safety of communication.
6, native system is in running, in addition to the data collection station of new access system is carried out initialization operation, in data
Other nodes feeling concerned about system are all not required to carry out the artificial participation of configuration change, i.e. decrease the work of operation maintenance personnel during system uses
Measure, more ensure that the operation that security of system is stable.
Accompanying drawing explanation
Fig. 1 is the structural representation of the present invention；
Fig. 2 is the data acquisition node management level aggregated(particle) structure schematic diagram of the present invention；
Fig. 3 is the monitor node work structuring schematic diagram of the present invention；
Fig. 4 is the data collection station structural representation of the present invention；
Fig. 5 is data collection station of the present invention and collected equipment connection diagram；
Fig. 6 is the data collection task interaction schematic diagram of the present invention；
Fig. 7 is the collection application process schematic diagram of the present invention；
Fig. 8 is the data collection station initial configuration information schematic diagram of the present invention；
Fig. 9 is the collection application list schematic diagram of the present invention；
Figure 10 is the service order form list schematic diagram of the present invention；
Figure 11 is the routing iinformation list schematic diagram of the present invention；
Figure 12 is the communication information list schematic diagram of the present invention；
Wherein, 1. data collection station, 2. Gateway routing node, 3. safety certification node, 4. safety certificate memory node, 5.
Monitor node, 6. log management node, 7. daily record memory node, 8. data capture management node, 9. data acquisition node, 10.
Acquired data storage node, 11. time synchronization nodes；21. power modules, 22.CPU module, 23. memory modules, 24. lead to
News module, 25. display modules, 26. cipher key module, 27. stipulations modular converters, 28. input and output modules, module when 29. pairs,
30. Keysheet modules, 31. collected equipment, 40. master control borads.
Detailed description of the invention
The invention will be further described with embodiment below in conjunction with the accompanying drawings:
As it is shown in figure 1, a kind of can dynamic smoothing extension data collecting system, including data collection station 1, gateway route joint
Point 2, safety certification node 3, data capture management node 8, data acquisition node 9, acquired data storage node 10, monitoring
Node 5, time synchronization node 11, log management node 6, safety certificate memory node 4, daily record memory node 7；Described number
According to acquisition terminal 1 respectively with described Gateway routing node 2 and data acquisition node 9 two-way communication；Described Gateway routing node 2
Respectively with log management node 6, monitor node 5, safety certification node 3, data capture management node 8 two-way communication；Described
Log management node 6 saves with daily record memory node 7, data acquisition node 9, data capture management node 8, safety certification respectively
Point 3 and monitor node 5 two-way communication；Described safety certification node 3 respectively with monitor node 5, safety certificate memory node 4
Two-way communication；Described data acquisition node 9 respectively with acquired data storage node 10 and data capture management node 8 two-way communication.
Gateway routing node, data capture management node, data acquisition node, safety certification node, acquired data storage node,
Monitor node, time synchronized service node, safety certificate memory node, log management node, daily record memory node, all on
State application node to operate on a computer server with each node, it is also possible to multiple nodes operate in same calculating
On machine server, connect with proprietary optical-fibre channel or proprietary radio channel between each computer server, can on geographical position
To be fixedly mounted on same room with them, may be mounted at multiple different city, it is also possible to be in mobile status at a high speed.Enter one
Step, above-mentioned each node may operate on same or multiple different Cloud Server.
Described Gateway routing node 2 is that data collection station 1 enters data collecting system the first entrance, Gateway routing node 2
Routing iinformation is fixed and to all data collection station 1 disclosures, is responsible for processing data collection station 1 and initiates to data collecting system
Terminal data collection application list, including authentication information, transmission key information, business report block summary information.
Further, described Gateway routing node 2, submit to safety to recognize the authentication information in terminal data collection application list
Card node 3 carries out authentication, waits that safety certification node 3 processes, the identity authentication result returned by safety certification node 3
Send to data collection station 1.
Further, described Gateway routing node 2, when safety certification is passed through, by business report in terminal data collection application list
Accuse block summary information to reorganize according to the type of service of business report block, form one or more classification business report block and adopt
Collection application list, submits to process the data acquisition collector of corresponding type of service by type by classification business report block collection application list
Reason node 8.Wait that data capture management node 8 processes, the data acquisition joint returned by each data capture management node 8
Point 9 route information table single-shots deliver to data collection station 1.
Described safety certification node 3 carries out the safety certification of data collection station 1, receives the terminal that Gateway routing node 2 forwards
Authentication information in data acquisition application list, is carried out authentication information with the certificate in safety certificate memory node 4
Safety certification, sends security certification result to Gateway routing node 2.Further, described safety certificate memory node 4 can
Generating authentication information with the uniqueness identity according to data collection station 1, authentication information can play dress storage to number
In cipher key module according to acquisition terminal 1.
Described data capture management node 8 manages the data acquisition node 9 of one or more process same line of business data, receives gateway
The classification business report block collection application list that routing node 2 sends, data capture management node 8 according to routing strategy is
Each business report block in classification business report block collection application list chooses data acquisition node 9, forms data acquisition joint
Point 9 routing iinformation lists.Further, data acquisition node 9 route information table single-shot is delivered to Gateway routing node 2, with
Time according to the match information in data acquisition node 9 routing iinformation list communication information list is pushed to the data acquisition joint of correspondence
Point 9.
Described data acquisition node 9 provides data acquisition channel for data collection station 1, when the industry receiving data collection station 1
During business report blocks transmission request, setting up transmission channel for each transmission request, each transmission channel is that an Erlang enters
Journey, according to the data transmission key information and data parsing mode that business report block is corresponding, complete to transmit the deciphering of message, parsing,
Storage and framing, encrypt and transmit.
Described time synchronized server node 11, with in gps signal, the Big Dipper, B code, CDMA, atomic clock standard clock source
One or more for clock source, for the data collection station 1 in system, Gateway routing node 2, safety certification node 3, data
Acquisition management node 8, data acquisition node 9, acquired data storage node 10, monitor node 5, log management node 6, peace
Full certificate management node 4, daily record memory node 7 carry out time synchronized, and the mode of time synchronizing signal can be: NTP/SNTP
Signal, pulse signal, IRIG-B signal, time message.
Described acquired data storage node 10 stores the data that each data acquisition node 9 gathers, and provides data access function.
Described log management node 6 is responsible for each node of system and is produced the record of log information, maintenance and management work, and daily record stores
Node 7 is responsible for the storage of daily record.
Described monitor node 8 monitors and controls the operation shape of Gateway routing node 2, safety certification node 3, log management node 6
State, it is ensured that each node works online, can use the hot standby mode of binode to run or trunking mode runs.
RS232, RS485, CAN, Ethernet, nothing can be passed through between described data collection station 1 and collected equipment
Line mode carries out communication connection.
Further, optical fiber can be passed through between described data collection station 1 and Gateway routing node 2 and data acquisition node 9
Ethernet, wireless mode carry out communication connection.
Further, described data collection station 1 is through completing authentication, transmission key, the configuration of business report block summary information
After, submit data acquisition application list to Gateway routing node 2, the data acquisition node 9 returned according to Gateway routing node 2
Routing iinformation list, sets up with each data acquisition node 9 respectively and is connected, carry out Data Encryption Transmission.
As in figure 2 it is shown, system can comprise one or more data capture management node 8, data capture management node 8 manages one
Or the data acquisition node 9 of multiple process same line of business data, receive the classification business report block that Gateway routing node 2 sends and adopt
Collection application list, data capture management node 8 according to routing strategy be classification business report block collection application list in every
One business report block chooses data acquisition node 9, forms data acquisition node 9 routing iinformation list.Further, by number
Gateway routing node 2 is delivered to, simultaneously according to data acquisition node 9 routing iinformation list according to acquisition node 9 route information table single-shot
In match information communication information list is pushed to correspondence data acquisition node 9.
As it is shown on figure 3, monitor node 5 is two-way with Gateway routing node 2, safety certification node 3, log management node 6 respectively
Communication, is also two-way communication between described monitor node 5 and other monitor node 5；Monitor node 5 is with the hot standby pattern of node
Or trunking mode runs, Gateway routing node 2, safety certification node 3, log management node 6 are registered to monitor node 5, and
Keep Entered state, if certain node runs occurs that monitor node 5 is attempted malfunctioning node is carried out reboot operation, and reminded extremely
System maintenance personnel carry out troubleshooting in time.
As shown in Figure 4, data collection station 1 includes master control borad 40, described master control borad respectively with power module 21, CPU module
22, memory module 23, communication module 24, display module 25, cipher key module 26, stipulations modular converter 27, input and output mould
Block 28, pair time module 29, Keysheet module 30 two-way communication.
As it is shown in figure 5, data collection station 1 allows to carry out data friendship from several collected equipment 31 with different communication modes
Mutually, adoptable communication modes includes RS232, RS485, CAN, Ethernet, wireless mode.
As shown in Figure 6, data collection task process schematic:
S1. data collection station sends terminal data collection application list to Gateway routing node, to obtain data acquisition node road
By information；
S2. data collection station safety certification request: Gateway routing node sends terminal data to safety certification node and gathers application form
Authentication information in list, carries out the safety certification of data collection station；
S3. safety certification node carries out the safety certification of data collection station, and authentication result is back to Gateway routing node.If
Authentification failure, then perform S6, and terminate this handling process, waits new collection application；If certification is passed through, then perform S4；
S4. Gateway routing node by business report block summary information in terminal data collection application list according to the industry of business report block
Service type reorganizes, and forms classification business report block collection application list, and classification business report block is gathered application form
List submits to process the data capture management node of this type of service, respectively to obtain data acquisition node routing iinformation；
S5. data capture management node is that each the business report entry in application list chooses data acquisition according to preference policy
Node, organizes the formation of data acquisition node routing iinformation list, and routing iinformation list is back to Gateway routing node, and according to
Communication information list is pushed to the data acquisition node of correspondence by the match information in data acquisition node routing iinformation list；
S6. Gateway routing node will receive data acquisition node routing iinformation list and deliver to data collection station；
S7. data collection station initiates the transmission request of business report block, number to the data acquisition node that each routing iinformation list middle finger is fixed
It is that transmission channel is set up in each transmission request, according to the data that business report block is corresponding according to acquisition node in Erlang process mode
Transmission key information and data parsing mode, is transmitted the deciphering of message, resolves, stores and framing, encrypt and transmit；
S8. data storage.Collection data are stored data into acquired data storage node according to storage strategy by data acquisition node.
As it is shown in fig. 7, gather application process schematic diagram:
S01. data collection station configuration, forms data collection station configuration documentation.
S02. data collection station sends to Security routing node and gathers application list.
S03. Gateway routing node carries out data collection station authentication to safety certification node.
S04. safety certification node is to Gateway routing node return authentication result.If authentification failure performs S05, successful execution S06.
S05. Gateway routing node returns application result to data collection station: authentification failure.
S06. Gateway routing node forms service order form list, is sent to data capture management node.
S07. Gateway routing node carries out applying for time-out judgement, and time-out then returns application result to data collection station: application is overtime.
S08. data capture management node returns data acquisition node routing iinformation list to Gateway routing node, and to data acquisition
Node pushes communication information list.
S09. Gateway routing node sends data acquisition node routing iinformation list to data collection station.
S10., after data collection station receives all routing iinformation lists, gather and apply for successfully.
As shown in Figure 8, the configuration documentation of data collection station, including file header, business report block message, measuring point information.Literary composition
Part head is the essential information of data collection station, comprises data collection station title, data collection station unique identification, data
Acquisition terminal model, manufacturer, founder and the time of establishment, safety certification node is according to data collection station unique identification
Generate the authentication information of data collection station；Business report block message is data capture management node selection data acquisition node
There is provided foundation, each equipment can according to type of service configure multiple report blocks set, report blocks aggregate attribute include type of service,
The data acquisition node order supported and data parsing mode, each report blocks set can configure according to measuring point quantity or other factors
One or more report blocks entries, report blocks bar configures data storage attribute such as memory gap, storage deviation and this entry now
Comprise the ID of measuring point；The ID of each measuring point of measuring point information configuration and specifying information, such as measuring point title, measuring point type, measuring point
Control Cooling and other information needed.
As it is shown in figure 9, data acquisition application list, collect including authentication information, transmission key information, business report block
Information.Authentication information is at equipment configuration phase, safety certificate manage the node uniqueness according to this data collection station
Identity generates, and lower dress storage is to the cipher key module of data collection station；Transmission key information is by data collection station key
Module produces；Business report block summary information is business report block message in data collection station configuration documentation, including according to business
Measuring point that report blocks entry that the business report block collection of Type division and attribute thereof, report blocks set comprise, report blocks entry comprise,
Data store strategy and other attributes.
As shown in Figure 10, service order form list, is according to gathering application list business report block summary information by Gateway routing node
The type of service of middle report blocks set generates, and each service order form list includes that data collection station mark, data collection station pass
Defeated key information, business gather applying type, the data acquisition node order of support and business collection report collection, and wherein business is adopted
Collection report collection comprise one or more business report block entry, each entry comprise the measuring point of this entry, data store strategy and
He describes information.
As shown in figure 11, routing iinformation list, data capture management node is that each service order form list generates a routing iinformation
List, in service order form list each report blocks entry to should route information table Dan Zhongyi data acquisition node routing iinformation,
Routing iinformation includes communication protocol type, data acquisition node IP address and port numbers.
As shown in figure 12, communication information list, data capture management node is according to the data acquisition node in routing iinformation list
Join information to generate, gather applying type including data collection station mark, data collection station transmission key information, business, prop up
The data acquisition node order held and the business report block items for information of correspondence.
Although the detailed description of the invention of the present invention is described by the above-mentioned accompanying drawing that combines, but not limit to scope
System, one of ordinary skill in the art should be understood that on the basis of technical scheme, and those skilled in the art need not pay
Go out various amendments or deformation that creative work can make still within protection scope of the present invention.
Claims (10)
1. can the data collecting system of dynamic smoothing extension, it is characterized in that, including data acquisition center system and data acquisition
Collection terminal；
Described data acquisition center system passes through communication network and described data collection station communication,
Described data acquisition center system is the core of data collecting system, be responsible for data acquisition, management, safety certification,
Storage and log services；
The data of collected equipment are transmitted to data acquisition node by described data collection station, and by data acquisition application list
Submitting Gateway routing node to, the data acquisition node routing iinformation list returned according to Gateway routing node, respectively with each data acquisition
Collection node initiates the transmission request of business report block, carries out Data Encryption Transmission；
Described communication network is responsible for data collection station and provides the physical link of data acquisition center system；
Described data acquisition center system includes:
Gateway routing node, with data collection station, some data capture management nodes, safety certification node, monitor node and
Log management node communication, is that data collection station passes through communication network entrance data acquisition center system the first entrance, gateway road
Fixed by the routing iinformation of node, open to all data collection stations, it is responsible for processing data collection station to data acquisition center
The terminal data collection application list that system is initiated；And, the authentication information in terminal data collection application list is submitted to
Safety certification node carries out authentication, and the identity authentication result returned by safety certification node sends to data collection station；With
And, after safety certification is passed through, by business report block summary information in terminal data collection application list according to business report block
Type of service reorganizes, and forms one or more classification business report block collection application list；Will classification by type of service
Business report block collection application list submits to process the data capture management node of this type of service, by each data acquisition collector
The data acquisition node route information table single-shot that reason node returns delivers to data collection station.
A kind of can dynamic smoothing extension data collecting system, it is characterized in that,
Described data acquisition center system also includes:
Safety certification node, communicates with Gateway routing node, monitor node, safety certificate memory node, is used for carrying out data acquisition
The safety certification of collection terminal, receives the authentication information in the terminal data collection application list that Gateway routing node forwards, will
Certificate in authentication information and safety certificate memory node is compared certification, sends authentication result to Gateway routing node；
And, generating authentication information according to the uniqueness identity of data collection station, authentication information fills storage under allowing
In the cipher key module of data collection station；
Safety certificate memory node, with safety certification node communication, is used for storing the safety certificate of data collection station；
Monitor node, with Gateway routing node, safety certification node and log management node communication, is used for monitoring and controlling gateway
Routing node, safety certification node, the running status of log management node, it is ensured that each node works online；
Log management node, with Gateway routing node, safety certification node, data acquisition node, data capture management node,
Daily record memory node communicates, and produces the record of log information, maintenance and management work for each node of system；
Daily record memory node, with log management node communication, is responsible for the storage of daily record；
Data capture management node, with Gateway routing node, log management node, some data acquisition node communication, receives net
Close the classification business report block collection application list that routing node sends, gather for classification business report block according to routing strategy
Each business report block entry in application list chooses data acquisition node, forms data acquisition node routing iinformation list；
And, data acquisition node route information table single-shot is delivered to Gateway routing node, simultaneously according to data acquisition node routing iinformation
Communication information list is pushed to the data acquisition node of correspondence by the match information in list；
Data acquisition node, with data capture management node, acquired data storage node, data collection station, log management joint
Point communication, is responsible for the data acquisition of data collection station, and the transmission for data collection station asks to set up communication connection, is responsible for number
According to gathering resolving；
Acquired data storage node, with data acquisition node communication, for storing the data that each data acquisition node gathers, and carries
For data access function；
Time synchronization node, for providing time synchronized service for all nodes in system.
A kind of can the collecting method that used of data collecting system of dynamic smoothing extension, its
Feature is, including step:
Step (1): data collection station sends terminal data collection application list to Gateway routing node；
Step (2): Gateway routing node is that terminal data collection application list generates handling process, and each handling process is
One Erlang process, Gateway routing node sends terminal data collection application to safety certification node in this Erlang process
Authentication information in list, waits that safety certification node returns the security certification result of this data collection station；Gateway simultaneously
Routing node waits new collection application；
Step (3): safety certification node according to the authentication information in terminal data collection application list to data collection station
Carry out safety certification, authentication result is sent to Gateway routing node；
Step (4): if authentification failure, authentication result is returned to data collection station by Gateway routing node, terminates this and processes
Flow process, terminates to be responsible for this Erlang process processed simultaneously；
Step (5): if certification is passed through, Gateway routing node is by business report block summary information in terminal data collection application list
Reorganize according to the type of service of business report block, form the service order form list of classification business report block；Further,
The service order form list of classification business report block is submitted to process some data acquisitions of this type of service by Gateway routing node respectively
Management node；
Step (6): after some data capture management nodes receive service order form list, is business application according to preference policy
Each business report entries match data acquisition node in list, organizes the formation of data acquisition node routing iinformation list, and
Routing iinformation list is back to Gateway routing node；Data capture management node is simultaneously according to the data acquisition in routing iinformation list
Collection node generates communication information list with the match information of business report entry, and communication information list has pushed to coupling
Data acquisition node；
Step (7): Gateway routing node receives the routing iinformation list that data capture management node returns, now routing iinformation
List is made up of multiple concrete business report block entries and the combination entry with the routing iinformation of this business report block entries match,
Routing iinformation list is delivered to submit to the data collection station of this collection application by Gateway routing node；Gateway routing node is this collection
Application generate Erlang treatment progress wait always institute oriented data capture management node submit to application result return, if surpass
Time, send time-out information to data collection station；
Step (8): if data collection station receives the data acquisition in time-out information, or the routing iinformation list received
Node is empty data acquisition node, and data collection station terminates this application, and after postponing a period of time, to Gateway routing node
Initiate new collection application；
Step (9): data collection station is after receiving the routing iinformation list of all returns, to each routing iinformation list middle finger
Fixed data acquisition node initiates the transmission request of business report block, and data acquisition node is that transmission channel is set up in each transmission request,
Each transmission channel is an Erlang process, the data transmission key information corresponding according to business report block and data parsing
Mode, completes to transmit the deciphering of message, resolves, stores and framing, encrypt and transmit；
Step (10): collection data are stored data into acquired data storage node according to storage strategy by data acquisition node；?
Described step (1)-step (10) perform during log management node real-time storage Gateway routing node, safety certification node,
The daily record of work that data capture management node, data acquisition node produce；Monitor node monitors in real time, safeguard Gateway routing node,
Safety certification node, the running status of data acquisition node, when Gateway routing node, safety certification node or data acquisition node
When occurring abnormal, monitor node attempts carrying out abnormal nodes reboot operation, and system for prompting attendant is carried out at fault in time
Reason；Time synchronization node Timing Synchronization Gateway routing node, safety certification node, safety certificate memory node, monitor node,
Log management node, daily record memory node, data capture management node, data acquisition node, acquired data storage node time
Between.
4. method as claimed in claim 3, is characterized in that, the terminal data collection application list in described step (1),
Including authentication information, transmission key information, business report block summary information；
Described authentication information is this acquisition terminal equipment at initial phase, by safety certificate management node according to this data acquisition
The uniqueness identity of collection terminal generates, and lower dress storage is to the cipher key module of data collection station, and this lower process of assembling does not allows
Repeat, and irreversible；
Described transmission key information is produced by data collection station cipher key module, in each new data acquisition application list
Transmission key information can difference, data acquisition node by this key can resolve data collection station this transmission application thing
The data after cipher key module is encrypted sent in the business cycle, and allow the order by being sent to data collection station with this key
It is encrypted, it is ensured that this order can be by data collection station identification；
Described business report block summary information is the initialized data entry information allowing to gather of this collection data collection station, bag
Include the business report set of blocks divided according to type of service and report blocks entry that attribute, report blocks set comprise, report blocks bar
Measuring point, the data store strategy of measuring point and other attributes that mesh comprises.
5. method as claimed in claim 3, is characterized in that, the safety certification in described step (3), for only ensureing
Data collection station through legitimate authentication just can automatically access in system；Safety certification node is by the identity of data collection station
Authentication information carries out checking and mates with the safety certificate in safety certificate memory node, if being verified, return authentication passes through result,
Otherwise authentification failure, return authentication does not passes through information.
6. method as claimed in claim 3, is characterized in that, described step (5) particular content is: Gateway routing node solution
Analysis terminal data collection application list, according to report blocks in business report block self-description information in this terminal data collection application list
The type of service of set, forms one or more service order form list carrying out according to type of service and classifying, each service order form
Singly include that data collection station mark, data collection station transmission key information, business gather applying type, the data acquisition of support
Collection node orders and the collection report blocks set of this business, wherein gather report blocks set and comprise one or more business report block bar
Mesh, each entry comprises measuring point and the data store strategy of this entry；Gateway routing node needs to gather applying type according to business
Service order form single-shot is delivered to process the data capture management node of such business.
7. method as claimed in claim 3, is characterized in that, the preference policy in described step (6), data capture management
The preference policy that node carries out selecting in the data acquisition node under multiple node administrations includes following factor: data acquisition saves
The I/O load of point, cpu load, the physical function parameter of core original paper, the Qos of data collection station to data acquisition node；
I/O load judges with the par of Erlang process in data acquisition node 30 minutes；
Cpu load judges with the average occupancy of CPU in 30 minutes；
The physical function parameter of core original paper includes cpu temperature, hard disk temperature, cpu fan rotating speed；
Appointment data collection station to the Qos calculation specifying data acquisition node is: from all and appointment data acquisition node
Keep in communication and the data collection station connected selects to be positioned at the data of identical and close communication topology location with this data collection station
Acquisition terminal, is this data collection data collection with the meansigma methods of these data collection stations to the Qos specifying data acquisition node
Terminal is to the Qos of this appointment node, if there is not the data collection station of same or like network topological location, it is allowed to do not use
This strategic factor；
Data acquisition node selects the principle concrete in dominant strategy to be: I/O load is low, cpu load is low, the physical property of core original paper
Parameter is normal, Qos is low.
8. method as claimed in claim 3, is characterized in that, the routing iinformation list in described step (6), is by data
Acquisition management node is according to being each the business report entries match data acquisition node in service order form list according to preference policy
And organize the formation of, including data collection station mark and communication protocol type corresponding to business report block, acquisition node IP address,
Acquisition node port numbers；
Communication information list in described step (6), is that data capture management node is according to the data acquisition in routing iinformation list
Node matching information generates, including data collection station mark, data collection station transmission key information, business collection application class
The business report block items for information of type, the data acquisition node order of support and correspondence.
9. method as claimed in claim 3, is characterized in that, the step of described step (9) is: data capture management node
Generating a routing iinformation list for each service order form list, in service order form list, each report blocks entry is to routeing
A data acquisition node routing iinformation in information list, routing iinformation includes communication protocol type, data acquisition node IP address
And port numbers；Data collection station initiates connection request to each data acquisition node, and data acquisition node is with Erlang process
Mode provides data acquisition channel for data collection station；Data collection station is connected setting up communication first with data acquisition node
Time, data acquisition node describes information in detail to data collection station request measuring point, and data collection station uploads this data acquisition joint
The corresponding report blocks bar measuring point information now of point；Hereafter data collection station and data acquisition node provide with data collection station
Key carries out Data Encryption Transmission, the solution of regulation in the measuring point self-description information that data acquisition node provides according to data collection station
Analysis mode completes data parsing and data storage.
10. method as claimed in claim 3, is characterized in that, the data storage in described step (10), data acquisition saves
Point transfers data to acquired data storage node, and acquired data storage node is according to data store strategy set in advance such as caching
Deviation, time interval complete data buffer storage, it is provided that real time data section access function by data persistence to data base, data
Storehouse provides perdurable data access function；The data store strategy of different business datum report blocks allows also to carry out in report blocks
Customization describes.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310516800.4A CN103532975B (en) | 2013-10-28 | 2013-10-28 | A kind of can dynamic smoothing extension data collecting system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310516800.4A CN103532975B (en) | 2013-10-28 | 2013-10-28 | A kind of can dynamic smoothing extension data collecting system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103532975A CN103532975A (en) | 2014-01-22 |
| CN103532975B true CN103532975B (en) | 2016-08-17 |
Family
ID=49934654
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310516800.4A Active CN103532975B (en) | 2013-10-28 | 2013-10-28 | A kind of can dynamic smoothing extension data collecting system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103532975B (en) |
Families Citing this family (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104869567B (en) * | 2015-04-01 | 2018-04-27 | 青岛中物云传智能科技有限公司 | A kind of information processing method based on Intelligent terminal for Internet of things |
| JP6727292B2 (en) * | 2015-08-24 | 2020-07-22 | 華為技術有限公司Ｈｕａｗｅｉ Ｔｅｃｈｎｏｌｏｇｉｅｓ Ｃｏ．，Ｌｔｄ． | Security authentication methods, configuration methods, and related devices |
| JP6577412B2 (en) * | 2016-05-13 | 2019-09-18 | 株式会社日立製作所 | Operation management apparatus, operation management method, and operation management system |
| CN106125678A (en) * | 2016-06-14 | 2016-11-16 | 国电南瑞科技股份有限公司 | A kind of method in the self adaptation many control source for centralized intelligence gateway |
| WO2018137202A1 (en) * | 2017-01-25 | 2018-08-02 | 华为技术有限公司 | Method, apparatus, and system for transmitting data |
| CN107094155B (en) * | 2017-06-14 | 2020-03-10 | 广东工业大学 | Data security storage method and device based on alliance block chain |
| US10906425B2 (en) * | 2018-04-05 | 2021-02-02 | Ford Global Technologies, Llc | Systems and methods to generate charging warnings |
| CN109067932B (en) * | 2018-07-24 | 2022-01-25 | 广州贯行电能技术有限公司 | Data transmission method for data acquisition terminal without fixed IP and data server |
| CN109587138A (en) * | 2018-12-06 | 2019-04-05 | 中电工业互联网有限公司 | A kind of fault-tolerant dynamic dispatching method of Internet of things system service node and server |
| CN109587142B (en) * | 2018-12-10 | 2022-08-16 | 北京华虹集成电路设计有限责任公司 | Data security access module and equipment for service flow |
| CN109714334B (en) * | 2018-12-26 | 2020-11-24 | 珠海格力电器股份有限公司 | Method, device, processor, circuit and storage medium for transmitting air conditioner data |
| CN110809025A (en) * | 2019-09-29 | 2020-02-18 | 四川中曼电气工程技术有限公司 | Data acquisition and monitoring method based on data routing gateway |
| CN112583781B (en) * | 2019-09-30 | 2024-04-12 | 中兴通讯股份有限公司 | Media code stream acquisition method, device, media gateway and storage medium |
| CN110716986B (en) * | 2019-10-17 | 2021-05-04 | 深圳市蓝思网络技术有限公司 | Big data analysis system and application method thereof |
| CN111935090B (en) * | 2020-07-07 | 2021-04-06 | 上海微亿智造科技有限公司 | Big data transmission and persistence method and system for industrial intelligent Internet of things |
| CN111787286B (en) * | 2020-07-22 | 2022-04-15 | 杭州当虹科技股份有限公司 | Method for realizing multichannel synchronous recording system |
| CN111885164B (en) * | 2020-07-23 | 2023-08-25 | 广东电网有限责任公司 | Data management system |
| CN111817935B (en) * | 2020-07-24 | 2021-12-24 | 浙江超人科技股份有限公司 | Internet intelligent home data processing method and system |
| CN112968908B (en) * | 2021-03-26 | 2022-02-08 | 中国电子科技集团公司第三十研究所 | Internet of things security gateway with data aggregation and one-way transmission and implementation method |
| CN115988038B (en) * | 2023-03-20 | 2023-08-01 | 睿至科技集团有限公司 | Data management method and system based on Internet of things platform |
| CN116319088B (en) * | 2023-05-17 | 2023-08-29 | 深圳前海翼联科技有限公司 | Method for monitoring route node state and collecting information of Internet of things |
| CN116367157B (en) * | 2023-06-01 | 2023-08-01 | 深圳市北测检测技术有限公司 | Security authentication method and device based on 5G communication network |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101032427A (en) * | 2007-04-27 | 2007-09-12 | 周钷 | Digital-signal intelligent monitoring method and application system thereof |
| CN101399780A (en) * | 2008-11-12 | 2009-04-01 | 清华大学 | Quasi minimum state flow control method for Internet |
| US8510830B2 (en) * | 2011-06-03 | 2013-08-13 | Fluke Corporation | Method and apparatus for efficient netflow data analysis |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7861281B2 (en) * | 2005-12-30 | 2010-12-28 | Reflexis Systems, Inc. | System and method for facilitating the transfer of information relating to quality of an organization |
| US7890616B2 (en) * | 2007-03-02 | 2011-02-15 | Informed Control Inc. | System and method for validation of middleware failover behavior |
| US8045776B2 (en) * | 2007-03-06 | 2011-10-25 | General Electric Company | Geometry-dependent filtering in CT method and apparatus |
| CN101488206A (en) * | 2008-01-16 | 2009-07-22 | 张道光 | Electronic transaction method and electronic transaction platform system |
| CN101360011B (en) * | 2008-09-26 | 2011-04-20 | 广州市聚晖电子科技有限公司 | Management system supporting different data collection service |
-
2013
- 2013-10-28 CN CN201310516800.4A patent/CN103532975B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101032427A (en) * | 2007-04-27 | 2007-09-12 | 周钷 | Digital-signal intelligent monitoring method and application system thereof |
| CN101399780A (en) * | 2008-11-12 | 2009-04-01 | 清华大学 | Quasi minimum state flow control method for Internet |
| US8510830B2 (en) * | 2011-06-03 | 2013-08-13 | Fluke Corporation | Method and apparatus for efficient netflow data analysis |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103532975A (en) | 2014-01-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103532975B (en) | A kind of can dynamic smoothing extension data collecting system and method | |
| CN106850611B (en) | Cross-system Internet of things secure communication technology service platform method | |
| CN103152393B (en) | A kind of charging method of cloud computing and charge system | |
| CN106790112B (en) | Node operating system integrating lightweight block chains and data updating method | |
| CN103597707B (en) | There is the distributed intelligence framework of the most reversely/forward cloud | |
| US10992494B2 (en) | Gateway round-robin system | |
| CN108092884A (en) | A kind of wireless access gateway system and application process | |
| CN102902536B (en) | A kind of Internet of Things computer system | |
| CN106162639B (en) | SDN wireless network management platform and authentication method based on Floodlight | |
| CN104701984B (en) | Intelligent electricity terminal plug and play method based on self recognition | |
| CN108011370A (en) | A kind of distributed energy scheduling method of commerce based on global energy block chain | |
| US20110314163A1 (en) | Wireless communication network for smart appliances | |
| CN100524125C (en) | Solution method for remote monitoring and maintenance of automatization system | |
| CN104601665A (en) | System and method for real-time cloud simulation on Internet of things sensing device | |
| CN104881748A (en) | Power dispatching automation method and power dispatching automation system based on 'cloud computing' dispatching application | |
| CN105306557A (en) | Bridge health monitoring system based on cloud platform | |
| CN103973815A (en) | Method for unified monitoring of storage environment across data centers | |
| CN104238466A (en) | Smart power and energy using system platform based on Cloud of Things | |
| CN109639483B (en) | Wind driven generator group data intercommunication sharing platform and fault ride-through method thereof | |
| CN105450654A (en) | Smart home development platform based on middleware technology and business development method thereof | |
| CN107330580A (en) | Power marketing Base data platform construction method | |
| CN102932431A (en) | Message-routing-based state monitoring data interface configuration method | |
| CN108650111A (en) | Information security electric power semi-physical emulation platform building method and system | |
| Ferrari et al. | Evaluation of communication delay in IoT applications based on OPC UA | |
| CN116485136A (en) | Cloud edge cooperation-based lithium battery production line data platform construction method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: 100031 Xicheng District West Chang'an Avenue, No. 86, Beijing Co-patentee after: Electric Power Research Institute of State Grid Shandong Electric Power Company Patentee after: State Grid Corporation of China Co-patentee after: National Network Intelligent Technology Co., Ltd. Address before: 250002, No. 1, South Second Ring Road, Shizhong District, Shandong, Ji'nan Co-patentee before: Electric Power Research Institute of State Grid Shandong Electric Power Company Patentee before: State Grid Corporation of China Co-patentee before: Shandong Luneng Intelligent Technology Co., Ltd. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20201029 Address after: 250101 Electric Power Intelligent Robot Production Project 101 in Jinan City, Shandong Province, South of Feiyue Avenue and East of No. 26 Road (ICT Industrial Park) Patentee after: National Network Intelligent Technology Co.,Ltd. Address before: 100031 Xicheng District West Chang'an Avenue, No. 86, Beijing Patentee before: STATE GRID CORPORATION OF CHINA Patentee before: ELECTRIC POWER RESEARCH INSTITUTE OF STATE GRID SHANDONG ELECTRIC POWER Co. Patentee before: National Network Intelligent Technology Co.,Ltd. |