CN106484591A - A kind of collecting method based on distributed system and acquisition system - Google Patents
A kind of collecting method based on distributed system and acquisition system Download PDFInfo
- Publication number
- CN106484591A CN106484591A CN201610846324.6A CN201610846324A CN106484591A CN 106484591 A CN106484591 A CN 106484591A CN 201610846324 A CN201610846324 A CN 201610846324A CN 106484591 A CN106484591 A CN 106484591A
- Authority
- CN
- China
- Prior art keywords
- data
- collection
- subitem
- acquisition
- acquisition node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3006—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3055—Monitoring arrangements for monitoring the status of the computing system or of the computing system component, e.g. monitoring if the computing system is on, off, available, not available
Abstract
The present invention provides a kind of collecting method based on distributed system and acquisition system, including will need to carry out the node of data acquisition as acquisition node in distributed system, the object for carrying out data acquisition will be needed in acquisition node to be set as gathering subitem；Acquisition node monitors each collection subitem of itself, and stores the data item changed in collection subitem and changing value mark；In each poll time piece, each acquisition node of poll, obtains the data and changing value mark changed in collection subitem successively；According to the data changed in the collection subitem of acquisition node and changing value mark, distributed system database on the basis of original gathered data, is updated in distributed system database.The collecting method based on distributed system of the present invention and acquisition system reduce the expense of nodal information monitoring, improve the efficiency of data acquisition.
Description
Technical field
The present invention relates to the technical field of data acquisition, more particularly to a kind of data acquisition side based on distributed system
Method and acquisition system.
Background technology
With developing rapidly for distributed system (distributed system), network structure increasingly complicated and isomery
Change, the monitoring of each node state and business datum and analysis under system becomes more and more important, also become increasingly complex.Centralized
Monitoring system can be the state of all nodes under keeper's offer system and business information.The mould of this ONE TO ALL
Formula, usually collects data by monitoring system from each node, and locally completes the sorting to information and processing operation.The mould
Formula can avoid checking each node one by one that the regular maintenance for significantly reducing keeper is born.
In the state for carrying out node and service data acquisition, when can pass through the response for judging transmission-reception packet
Between whether normal to determine node state, and business datum then can only be by updating to the collection-sorting of business information, and not
Same its data form of business differs greatly.
One complete information monitoring system realizes information monitoring essentially by following steps：
1) initial data is gathered；
2) storage is updated the data；
3) analysis statisticaling data；
4) data are visualized.
Wherein, raw data acquisition is the basis of all follow-up works.Once there are the imperfect or even data of Monitoring Data
Situation about losing completely, it will make follow-up statistic analysis produce serious error, cause serious consequence, therefore, one
Individual rational data collecting system is had very important significance to monitoring node performance and business.
Collecting method of the prior art is basically divided into following two big class：
(1) constant duration acquisition method
When the poll time piece of acquisition system reaches node, all information belonged in collection item are obtained, by network
Acquisition system is transferred to, acquisition system reads data and the newest number that all last collection period are obtained from database afterwards
According to being contrasted, so as to realize insertion and the renewal of data.This is the method adopted by most of data collecting system, generally exists
Use in the case of not high to real-time data acquisition performance requirement.The advantage of the method is that to realize relatively easy, extensibility good,
Easily add when there is new collection item；Have the disadvantage that poll is all by supervisory node information under constant duration, does not account for institute
The change of sampled data, waste network bandwidth etc..Ought particularly need the information of poll especially many, and data variation frequency is relatively low
When, constant duration acquisition method will produce repeatedly invalid poll.
(2) self adaptation acquisition method
The method adjusts acquisition time interval according to data variation.Generally, combined content triggering mode, is preserved in systems
Business Stream information data, in the case of nodal information change burst severity is less, can be obtained using less cost in theory
Take newest nodal test information.However, the shortcoming of the method is：When nodal information change is very frequent, once information occurs
Change immediately by network transmission in acquisition system, and when environment, the inconsistency of business, will be increased
The process expense of Prediction and Acquisition time, it is also possible to more random errors can be introduced；While the realization of acquisition system and maintenance
More complicated, cost is higher.
Therefore, real-time performance is being required it is not especially harsh, and is gathering in the case that item generally needs flexibly to change,
Existing collecting method can not all effectively improve the efficiency of data acquisition.
Content of the invention
The shortcoming of prior art in view of the above, it is an object of the invention to provide a kind of number based on distributed system
According to acquisition method and acquisition system, there is the collection subitem that data are changed thereon in each node real-time monitoring, when acquisition system pair
When node is polled, the collection subitem that data change occurs only is obtained, to avoid total data by network transmission to adopting
Collecting system, then delta data is judged from all data, so as to reduce the expense of nodal information monitoring, improve data acquisition
Efficiency.
For achieving the above object and other related purposes, the present invention provides a kind of data acquisition side based on distributed system
Method, comprises the following steps：To need to carry out the node of data acquisition as acquisition node in distributed system, by acquisition node
The object for carrying out data acquisition is needed to be set as gathering subitem；Acquisition node monitors each collection subitem of itself, and stores and adopt
The data item changed in collection subitem and changing value mark；In each poll time piece, each acquisition node of poll, obtains successively
Take the data and changing value mark changed in collection subitem；According to the data changed in the collection subitem of acquisition node
And changing value mark, distributed system database is updated in distributed system database on the basis of original gathered data.
According to the above-mentioned collecting method based on distributed system, wherein：The acquisition node adopts tree data
Structure gathers the data item changed in subitem and changing value mark to store；The tree form data structure includes collection successively
Node, collection subitem, change item and four layers of changing value, the acquisition node is root node, including several collection subitems；Each
Collection subitem includes several change items, and the change item represents the data item changed in collection subitem；Each change item
Including a corresponding changing value；The changing value is used for storing the data item after corresponding change item changes and changing value mark.
Further, according to the above-mentioned collecting method based on distributed system, wherein：Each acquisition node itself
Maintenance has a tables of data, and monitors the operation in the tables of data by trigger；When the tables of data occurs data to become
During change, during the trigger stores the data for changing and corresponding changing value mark to the tree form data structure.
Further, according to the above-mentioned collecting method based on distributed system, wherein：Each acquisition node of poll
When, the data changed in acquired collection subitem include：Acquisition node ID, the collection subitem for changing, collection
The change item of item and the changing value of change item.
According to the above-mentioned collecting method based on distributed system, wherein：Before being polled to acquisition node, also
The mandate of acquisition node need to be obtained, to obtain the data changed in collection subitem and changing value mark；If cannot obtain adopting
The mandate of collection node, then can not be polled to the acquisition node.
Meanwhile, the present invention also provides a kind of data collecting system based on distributed system, deposits including setting module, monitoring
Storage module, poller module and update module；
The setting module is used for using the node for needing to carry out data acquisition in distributed system as acquisition node, will adopt
The object for carrying out data acquisition is needed to be set as gathering subitem in collection node；
The monitoring memory module is used for monitoring each collection subitem of itself by acquisition node, and stores collection subitem
In the data item that changes and changing value mark；
The poller module is used in each poll time piece, successively each acquisition node of poll, obtains in collection subitem
The data for changing and changing value mark；
The update module is used for data and the changing value mark that change in the collection subitem according to acquisition node,
Distributed system database is updated in distributed system database on the basis of original gathered data.
According to the above-mentioned data collecting system based on distributed system, wherein：In the monitoring memory module, described adopt
Collection node stores the data item and changing value mark changed in collection subitem using tree form data structure；The tree-like number
Include acquisition node, collection subitem, change item and four layers of changing value successively according to structure, the acquisition node is root node, including
Several collection subitems；Each collection subitem include several change item, the change item represent collection subitem in change
Data item；Each change item includes a corresponding changing value；After the changing value is used for storing corresponding change item change
Data item and changing value mark.
Further, according to the above-mentioned data collecting system based on distributed system, wherein：Each acquisition node itself
Maintenance has a tables of data, and monitors the operation in the tables of data by trigger；When the tables of data occurs data to become
During change, during the trigger stores the data for changing and corresponding changing value mark to the tree form data structure.
Further, according to the above-mentioned data collecting system based on distributed system, wherein：In the poller module,
During each acquisition node of poll, the data changed in acquired collection subitem include：Acquisition node ID, change
The changing value of collection subitem, the change item of collection subitem and change item.
According to the above-mentioned data collecting system based on distributed system, wherein：The poller module is additionally operable to adopting
Before collection node is polled, the mandate of acquisition node is obtained, to obtain the data changed in collection subitem and changing value mark
Note；If the mandate of acquisition node cannot be obtained, the acquisition node can not be polled.
As described above, the collecting method based on distributed system of the present invention and acquisition system, with following beneficial
Effect：
(1) there is the collection subitem of data change in each node real-time monitoring thereon, when acquisition system is carried out to node
During poll, the collection subitem that data change occurs only is obtained；
(2) using the collection subitem changed in trigger (trigger) record acquisition node, tied by tree data
Structure storage change data, simplify data acquisition flow；
(3) data item for changing only is transmitted, and acquisition node data do not change then return sky, alleviate network burden；
(4) changing value mark according to entrained by return information, directly updates the data storehouse, reduces data base querying, data
Contrast operation, improves the efficiency of data acquisition.
Description of the drawings
The flow chart that Fig. 1 is shown as the collecting method based on distributed system of the present invention；
Fig. 2 is shown as the structural representation of the tree form data structure of the present invention；
Fig. 3 is shown as the structural representation of the data collecting system based on distributed system of the present invention.
Component label instructions
1 setting module
2 monitoring memory modules
3 poller module
4 update modules
Specific embodiment
Embodiments of the present invention are described below by way of specific instantiation, those skilled in the art can be by this specification
Disclosed content understands other advantages of the present invention and effect easily.The present invention can also pass through in addition different concrete realities
The mode of applying is carried out or applies, the every details in this specification can also based on different viewpoints and application, without departing from
Various modifications and changes are carried out under the spirit of the present invention.It should be noted that, in the case of not conflicting, following examples and enforcement
Feature in example can be mutually combined.
It should be noted that the diagram provided in following examples only illustrates the basic structure of the present invention in a schematic way
Think, only show then the component relevant with the present invention in schema rather than according to component count during actual enforcement, shape and size
Draw, during its actual enforcement, the kenel of each component, quantity and ratio can be a kind of random change, and its assembly layout kenel
It is likely more complexity.
In the collecting method based on distributed system of the present invention and acquisition system, the state of itself is monitored by node
And data variation, and by change information storage to caching, when system poll time piece is reached, change to System Reports
Data item；System only gathers or updates the data that change, so as to the efficiency for improving data acquisition and update.
Specifically, present invention is generally directed to be this system monitoring pattern of ONE TO ALL, acquisition node is according to equipment
State or service condition update the tree form data structure of a data storage change, the section of poll collection at a certain time interval
Point, obtains the data of change updating the data storehouse, to reach the purpose of rapid data collection.
With reference to Fig. 1, the present invention is comprised the following steps based on the collecting method of distributed system：
Step S1, will need to carry out the node of data acquisition as acquisition node in distributed system, by acquisition node
The object for carrying out data acquisition is needed to be set as gathering subitem.
Distributed system includes multiple nodes.For example, in distributed system computer, router, printer etc. are all
Can be considered an independent node.Acquisition node is in distributed system the node for needing to carry out data acquisition.Each collection
Subitem is corresponding to an object for needing to carry out data acquisition of acquisition node.For an acquisition node, which may include one
Or multiple collection subitems.For example, for an acquisition node, gathering subitem can include internal memory, the magnetic of equipment 2 of equipment 1
Disk, mission bit stream of business 1 etc..Wherein, business refers to the operation with complete function performed by node, as run
Software.
Step S2, acquisition node monitor each collection subitem of itself, and store the data changed in collection subitem
Item and changing value mark.
Wherein, changing value mark includes insertion, deletes and update, and is respectively used to show that the data item for changing is inserted for new
After entering, having deleted or updated.
Preferably, the data item and changing value mark changed in collection subitem is stored using tree form data structure.
As shown in Fig. 2 the tree form data structure includes acquisition node, collection subitem, change item and four layers of changing value successively.Wherein, adopt
Integrate node as root node, including several collection subitem nodes, such as equipment 1, equipment 2, business 1, business 2 etc..Each collection
Subitem node includes several change item nodes, such as change item 1, change item 2 etc..Change item represent collection subitem in become
The data item of change.Each change item node includes a corresponding change value node.Change value node is used for storing corresponding change
Data item after item change and changing value mark.Changing value mark includes insertion, deletes and update, and is respectively used to show to become
After the data of change are for newly inserting, having deleted or updated.
Specifically, each acquisition node self maintained has a tables of data.Acquisition node by trigger (trigger) come
Operation in monitored data table.When there is belonging in tables of data the insertion of collection subitem, renewal or delete the data variation such as data
When, trigger can store insertion, the data for updating or deleting and corresponding changing value mark in tables of data to tree data
In structure.
Step S3, in each poll time piece, each acquisition node of poll successively, obtain and change in collection subitem
Data and changing value mark.
Preferably, also include in step S3：Before being polled, the mandate of acquisition node is obtained to acquisition node, to obtain
Take the data and changing value mark changed in collection subitem.If the mandate of acquisition node cannot be obtained, this can not be adopted
Collection node is polled, and also cannot just gather the corresponding data of the acquisition node.Wherein, acquisition system can be verified by sending
The modes such as instruction obtain the mandate of acquisition node.In the art, the prior art authorized as maturation is obtained, is adopted in the present invention
Acquisition authorization is not limited to said method, and other can obtain the additive method of mandate also in the protection model of the present invention
Within enclosing, will not be described here.
During each acquisition node of poll, the data changed in acquired collection subitem include：Acquisition node ID, send out
The changing value of the collection subitem, the change item of collection subitem and change item of changing.Specifically, acquisition node returns tree data
The information in change value node in structure is to acquisition system.Wherein, the information that acquisition node is returned includes：Acquisition node ID,
The equipment of generating state change or the changing value of business, specific equipment item or traffic item, specific equipment item or traffic item, with
And changing value mark.If without information in change value node, being returned as sky.
After poll time piece terminates, the changing value of the tree form data structure of itself is reset by acquisition node, is deposited again
The data item changed in storage collection subitem and changing value mark.
Step S4, according to the data that change and changing value mark in the collection subitem of acquisition node, in distributed system
Distributed system database is updated on the basis of original gathered data in system database.
Distributed system database on the basis of original gathered data, according to becoming in the collection subitem of acquisition node
The data of change and changing value mark, you can obtain newest gathered data, so as to without the need for reading out from own database again
The data that secondary collection is obtained are compared one by one, but directly the data for changing recorded distribution according to changing value mark
Formula system database, so as to greatly reduce data base querying, Data Comparison operation, improves data acquisition efficiency.
It should be noted that when data acquisition is carried out first, need to carry out each acquisition node data acquisition, and will
The data storage for collecting to distributed system database, using the basis as subsequent data acquisition.Subsequently carry out data to adopt
During collection, data that only need to be in a distributed system to changing are recorded, it is achieved thereby that the Quick Acquisition of data.
With reference to Fig. 3, the present invention includes setting module 1, monitoring storage mould based on the data collecting system of distributed system
Block 2, poller module 3 and update module 4.
Setting module 1 is used for using the node for needing to carry out data acquisition in distributed system as acquisition node, will collection
The object for carrying out data acquisition is needed to be set as gathering subitem in node.
Distributed system includes multiple nodes.For example, in distributed system computer, router, printer etc. are all
Can be considered an independent node.Acquisition node is in distributed system the node for needing to carry out data acquisition.Each collection
Subitem is corresponding to an object for needing to carry out data acquisition of acquisition node.For an acquisition node, which may include one
Or multiple collection subitems.For example, for an acquisition node, gathering subitem can include internal memory, the magnetic of equipment 2 of equipment 1
Disk, mission bit stream of business 1 etc..Wherein, business refers to the operation with complete function performed by node, as run
Software.
Monitoring memory module 2 is connected with setting module 1, for monitoring each collection subitem of itself by acquisition node,
And store the data item changed in collection subitem and changing value mark.
Wherein, changing value mark includes insertion, deletes and update, and is respectively used to show that the data item for changing is inserted for new
After entering, having deleted or updated.
Preferably, the data item and changing value mark changed in collection subitem is stored using tree form data structure.
As shown in Fig. 2 the tree form data structure includes acquisition node, collection subitem, change item and four layers of changing value successively.Wherein, adopt
Integrate node as root node, including several collection subitem nodes, such as equipment 1, equipment 2, business 1, business 2 etc..Each collection
Subitem node includes several change item nodes, such as change item 1, change item 2 etc..Change item represent collection subitem in become
The data item of change.Each change item node includes a corresponding change value node.Change value node is used for storing corresponding change
Data item after item change and changing value mark.Changing value mark includes insertion, deletes and update, and is respectively used to show to become
After the data of change are for newly inserting, having deleted or updated.
Specifically, each acquisition node self maintained has a tables of data.Acquisition node by trigger (trigger) come
Operation in monitored data table.When there is belonging in tables of data the insertion of collection subitem, renewal or delete the data variation such as data
When, trigger can store insertion, the data for updating or deleting and corresponding changing value mark in tables of data to tree data
In structure.
Poller module 3 is connected with monitoring memory module 2, in each poll time piece, each collection of poll successively is saved
Point, obtains the data and changing value mark changed in collection subitem.
Preferably, poller module 3 is additionally operable to before being polled to acquisition node, obtains the mandate of acquisition node, to obtain
Take the data and changing value mark changed in collection subitem.If the mandate of acquisition node cannot be obtained, this can not be adopted
Collection node is polled, and also cannot just gather the corresponding data of the acquisition node.Wherein, acquisition system can be verified by sending
The modes such as instruction obtain the mandate of acquisition node.In the art, the prior art authorized as maturation is obtained, is adopted in the present invention
Acquisition authorization is not limited to said method, and other can obtain the additive method of mandate also in the protection model of the present invention
Within enclosing, will not be described here.
During each acquisition node of poll, the data changed in acquired collection subitem include：Acquisition node ID, send out
The changing value of the collection subitem, the change item of collection subitem and change item of changing.Specifically, acquisition node returns tree data
The information in change value node in structure is to acquisition system.Wherein, the information that acquisition node is returned includes：Acquisition node ID,
The equipment of generating state change or the changing value of business, specific equipment item or traffic item, specific equipment item or traffic item, with
And changing value mark.If without information in change value node, being returned as sky.
After poll time piece terminates, the changing value of the tree form data structure of itself is reset by acquisition node, is deposited again
The data item changed in storage collection subitem and changing value mark.
Update module 4 is connected with poller module 3, for the data that change in the collection subitem according to acquisition node and
Changing value is marked, and updates distributed system database in distributed system database on the basis of original gathered data.
Distributed system database on the basis of original gathered data, according to becoming in the collection subitem of acquisition node
The data of change and changing value mark, you can obtain newest gathered data, so as to without the need for reading out from own database again
The data that secondary collection is obtained are compared one by one, but directly the data for changing recorded distribution according to changing value mark
Formula system database, so as to greatly reduce data base querying, Data Comparison operation, improves data acquisition efficiency.
It should be noted that when data acquisition is carried out first, need to carry out each acquisition node data acquisition, and will
The data storage for collecting to distributed system database, using the basis as subsequent data acquisition.Subsequently carry out data to adopt
During collection, data that only need to be in a distributed system to changing are recorded, it is achieved thereby that the Quick Acquisition of data.
In sum, the collecting method based on distributed system of the present invention and acquisition system real-time in each node
There is the collection subitem of data change thereon in monitoring, when acquisition system is polled to node, only obtains and data change occurs
Collection subitem；Using the collection subitem changed in recording trigger acquisition node, become by tree form data structure storage
Change data, simplify data acquisition flow；The data item that change only is transmitted, and acquisition node data do not change then return sky,
Alleviate network burden；According to entrained by return information changing value mark, directly update the data storehouse, reduce data base querying,
Data Comparison is operated, and improves the efficiency of data acquisition.So, the present invention effectively overcome various shortcoming of the prior art and
Tool high industrial utilization.
Above-described embodiment only principle of the illustrative present invention and its effect, not for the restriction present invention.Any ripe
The personage for knowing this technology all can carry out modifications and changes without prejudice under the spirit and the scope of the present invention to above-described embodiment.Cause
This, those of ordinary skill in the art is complete with institute under technological thought without departing from disclosed spirit such as
All equivalent modifications for becoming or change, must be covered by the claim of the present invention.
Claims (10)
1. a kind of collecting method based on distributed system, it is characterised in that：Comprise the following steps：
To need the node of data acquisition to be carried out as acquisition node in distributed system, will need to carry out data in acquisition node
The object of collection is set as gathering subitem；
Acquisition node monitors each collection subitem of itself, and stores the data item and changing value mark changed in collection subitem
Note；
In each poll time piece, each acquisition node of poll, obtains the data and change changed in collection subitem successively
Value mark；
According to the data changed in the collection subitem of acquisition node and changing value mark, in distributed system database Central Plains
Distributed system database is updated on the basis of having gathered data.
2. the collecting method based on distributed system according to claim 1, it is characterised in that：The acquisition node
The data item and changing value mark changed in collection subitem is stored using tree form data structure；The tree form data structure
Include acquisition node, collection subitem, change item and four layers of changing value successively, the acquisition node is root node, including several
Collection subitem；Each collection subitem includes several change items, and the change item represents the data changed in collection subitem
?；Each change item includes a corresponding changing value；The changing value is used for the data item after storing corresponding change item change
Mark with changing value.
3. the collecting method based on distributed system according to claim 2, it is characterised in that：Each acquisition node
Self maintained has a tables of data, and monitors the operation in the tables of data by trigger；When the tables of data occurs number
According to during change, the trigger stores the data for changing and corresponding changing value mark to the tree form data structure
In.
4. the collecting method based on distributed system according to claim 2, it is characterised in that：Each collection of poll
During node, the data changed in acquired collection subitem include：Acquisition node ID, the collection subitem for changing, adopt
The change item of collection subitem and the changing value of change item.
5. the collecting method based on distributed system according to claim 1, it is characterised in that：To acquisition node
Before being polled, also need to obtain the mandate of acquisition node, to obtain the data changed in collection subitem and changing value mark；
If the mandate of acquisition node cannot be obtained, the acquisition node can not be polled.
6. a kind of data collecting system based on distributed system, it is characterised in that：Including setting module, monitoring memory module,
Poller module and update module；
The setting module is used for the node for needing to carry out in distributed system data acquisition as acquisition node, by collection section
The object for carrying out data acquisition is needed to be set as gathering subitem in point；
Described monitoring memory module be used for by acquisition node monitor itself each collection subitem, and store collection subitem in send out
The data item of changing and changing value mark；
The poller module is used in each poll time piece, successively each acquisition node of poll, obtains and occurs in collection subitem
The data of change and changing value mark；
The update module is used for data and the changing value mark that change in the collection subitem according to acquisition node, in distribution
Distributed system database is updated in formula system database on the basis of original gathered data.
7. the data collecting system based on distributed system according to claim 6, it is characterised in that：The monitoring storage
In module, the acquisition node stores the data item and changing value mark changed in collection subitem using tree form data structure
Note；The tree form data structure includes acquisition node, collection subitem, change item and four layers of changing value, the acquisition node successively
For root node, subitem is gathered including several；Each collection subitem includes several change items, and the change item represents collection
The data item changed in；Each change item includes a corresponding changing value；The changing value is used for storage to strain
Change the data item after item change and changing value mark.
8. the data collecting system based on distributed system according to claim 7, it is characterised in that：Each acquisition node
Self maintained has a tables of data, and monitors the operation in the tables of data by trigger；When the tables of data occurs number
According to during change, the trigger stores the data for changing and corresponding changing value mark to the tree form data structure
In.
9. the data collecting system based on distributed system according to claim 7, it is characterised in that：The poller module
In, during each acquisition node of poll, the data changed in acquired collection subitem include：Acquisition node ID, become
The changing value of the collection subitem, the change item of collection subitem and change item of change.
10. the data collecting system based on distributed system according to claim 6, it is characterised in that：The poll mould
Block is additionally operable to before being polled to acquisition node, obtains the mandate of acquisition node, is changed in collection subitem with obtaining
Data and changing value mark；If the mandate of acquisition node cannot be obtained, the acquisition node can not be polled.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610846324.6A CN106484591A (en) | 2016-09-23 | 2016-09-23 | A kind of collecting method based on distributed system and acquisition system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610846324.6A CN106484591A (en) | 2016-09-23 | 2016-09-23 | A kind of collecting method based on distributed system and acquisition system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106484591A true CN106484591A (en) | 2017-03-08 |
Family
ID=58268792
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610846324.6A Pending CN106484591A (en) | 2016-09-23 | 2016-09-23 | A kind of collecting method based on distributed system and acquisition system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106484591A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108287923A (en) * | 2018-02-28 | 2018-07-17 | 山东汇贸电子口岸有限公司 | A kind of visualization interface data intelligence extraction system and its design method |
| CN108664625A (en) * | 2018-05-14 | 2018-10-16 | 链家网（北京）科技有限公司 | A kind of cross-system method of data synchronization and device |
| CN108958960A (en) * | 2018-07-26 | 2018-12-07 | 郑州云海信息技术有限公司 | Low-quality disk localization method, device, equipment and storage medium in distributed storage cluster |
| CN109933624A (en) * | 2018-12-28 | 2019-06-25 | 曙光信息产业(北京)有限公司 | Aviation emergency management and rescue data collection system and method |
| CN112732710A (en) * | 2020-12-25 | 2021-04-30 | 北京知因智慧科技有限公司 | Data processing method and device and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090204833A1 (en) * | 2008-02-11 | 2009-08-13 | International Business Machines Corporation | Minimization of power consumption in server environment |
| CN102096711A (en) * | 2011-01-24 | 2011-06-15 | 四川长虹电器股份有限公司 | Method for constructing tree structural directory in database |
| CN103605797A (en) * | 2013-12-05 | 2014-02-26 | 用友软件股份有限公司 | Data storage and inquiry devices and data storage and inquiry methods |
| CN103778265A (en) * | 2014-01-02 | 2014-05-07 | 中国人民解放军装甲兵工程学院 | Data acquisition method based on trigger |
| CN105701094A (en) * | 2014-11-24 | 2016-06-22 | 北京航管科技有限公司 | ETL data acquisition method and device |
-
2016
- 2016-09-23 CN CN201610846324.6A patent/CN106484591A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090204833A1 (en) * | 2008-02-11 | 2009-08-13 | International Business Machines Corporation | Minimization of power consumption in server environment |
| CN102096711A (en) * | 2011-01-24 | 2011-06-15 | 四川长虹电器股份有限公司 | Method for constructing tree structural directory in database |
| CN103605797A (en) * | 2013-12-05 | 2014-02-26 | 用友软件股份有限公司 | Data storage and inquiry devices and data storage and inquiry methods |
| CN103778265A (en) * | 2014-01-02 | 2014-05-07 | 中国人民解放军装甲兵工程学院 | Data acquisition method based on trigger |
| CN105701094A (en) * | 2014-11-24 | 2016-06-22 | 北京航管科技有限公司 | ETL data acquisition method and device |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108287923A (en) * | 2018-02-28 | 2018-07-17 | 山东汇贸电子口岸有限公司 | A kind of visualization interface data intelligence extraction system and its design method |
| CN108287923B (en) * | 2018-02-28 | 2020-12-29 | 浪潮云信息技术股份公司 | Intelligent visual interface data extraction system and design method thereof |
| CN108664625A (en) * | 2018-05-14 | 2018-10-16 | 链家网（北京）科技有限公司 | A kind of cross-system method of data synchronization and device |
| CN108664625B (en) * | 2018-05-14 | 2020-06-02 | 贝壳找房(北京)科技有限公司 | Cross-system data synchronization method and device |
| CN108958960A (en) * | 2018-07-26 | 2018-12-07 | 郑州云海信息技术有限公司 | Low-quality disk localization method, device, equipment and storage medium in distributed storage cluster |
| CN109933624A (en) * | 2018-12-28 | 2019-06-25 | 曙光信息产业(北京)有限公司 | Aviation emergency management and rescue data collection system and method |
| CN112732710A (en) * | 2020-12-25 | 2021-04-30 | 北京知因智慧科技有限公司 | Data processing method and device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106484591A (en) | A kind of collecting method based on distributed system and acquisition system | |
| CN105005274B (en) | Big data in management process control system | |
| CN104731690B (en) | Adaptive metrology collection, storage and warning threshold | |
| CN104601696B (en) | Service processing method, service calling system, device and system | |
| CN106533527B (en) | Reconfigurable satellite telemetering on-orbit monitoring and quantitative management system and implementation method thereof | |
| CN103176974B (en) | The method and apparatus of access path in optimization data storehouse | |
| US9679021B2 (en) | Parallel transactional-statistics collection for improving operation of a DBMS optimizer module | |
| CN103795596A (en) | Programmable control SDN measuring system and method | |
| CN112711612B (en) | Data processing method, device, storage medium and electronic device | |
| CN106357442A (en) | Server cluster monitoring method and system | |
| US8136012B2 (en) | Method and system for updating topology changes of a computer network | |
| CN102082701A (en) | Method for storing network element positional information and apparatus for same | |
| CN100413257C (en) | Network element warning data obtaining method | |
| US8886764B2 (en) | Quick upload | |
| WO2021147319A1 (en) | Data processing method, apparatus, device, and medium | |
| CN106792825A (en) | A kind of management method of distributed network equipment | |
| JP6724796B2 (en) | Packet analysis program, packet analysis method, and packet analysis device | |
| Wang et al. | Research and design of RFID data processing model based on complex event processing | |
| CN101145971A (en) | A statistical method and device for network topology change | |
| KR101968575B1 (en) | Method for automatic real-time analysis for bottleneck and apparatus for using the same | |
| CN103001813A (en) | Method for configuration management in network management device | |
| CN112134738A (en) | Network multidimensional data flow simulation device based on composite two-dimensional Sketch | |
| CN105119741A (en) | Cloud network reliability measuring method | |
| CN102710455B (en) | Method, Apparatus and system that data are monitored in real time | |
| CN103944777A (en) | Distributed monitoring system information processing method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170308 |
|
| RJ01 | Rejection of invention patent application after publication |