CN102739775A - Method for monitoring and managing Internet of Things data acquisition server cluster - Google Patents
Method for monitoring and managing Internet of Things data acquisition server cluster Download PDFInfo
- Publication number
- CN102739775A CN102739775A CN2012101708494A CN201210170849A CN102739775A CN 102739775 A CN102739775 A CN 102739775A CN 2012101708494 A CN2012101708494 A CN 2012101708494A CN 201210170849 A CN201210170849 A CN 201210170849A CN 102739775 A CN102739775 A CN 102739775A
- Authority
- CN
- China
- Prior art keywords
- acquisition
- server
- management server
- zookeeper
- acquisition server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Computer And Data Communications (AREA)
Abstract
The invention discloses a method for monitoring and managing an Internet of Things data acquisition server cluster aiming at the problem of automatic acquisition of mass data in the Internet of Things. The data acquisition center server cluster is monitored and managed in real time, therefore automatic distribution, cluster load balance distribution and failure task automatic receiving of data acquisition tasks are realized.
Description
Technical field
The present invention relates to Internet of Things field and distributed server cluster management domain, particularly a kind of monitoring and management method of Internet of Things data acquisition server cluster.
Background technology
Technology of Internet of things is the important component part of generation information technology; Its core and basis remain the Internet; Be extension and the network of expansion on the basis, the Internet, the Internet of Things acquisition terminal is connected with data acquisition center monitoring management server through cable network or wireless network.In large-scale Internet of things system is used; One station server far can not satisfy the demand of system applies; Cluster for multiple servers; The operating load of monitoring management cluster server and balance server how relates to that distributed synchronization, load balancing, task are distributed automatically and variety of issue such as adapter.
There has been the distributed acquisition system of some data at present; But these acquisition systems mainly are responsible for Data Receiving work; The auto-mechanism that lacks distributed management; Not enough below existing: as 1, when new Internet of Things acquisition terminal increases, can only artificially to specify acquisition server, be difficult to guarantee that the overall load of cluster server is balanced for it; 2, present distributed capture system is not owing to realize real-time monitoring and load-balancing mechanism, thereby can't be automatically the task in the acquisition server of high capacity be assigned in the acquisition server of other low loads with pressure that reduces the separate unit server and the even running that keeps system; 3, when acquisition server breaks down, at present mainly adopt artificial method to start new machine, and artificial new acquisition tasks is set, and real-time monitoring and the automatic switching function to acquisition server in the cluster is not provided; 4, the connected mode with acquisition server is solidificated in the acquisition terminal; Acquisition server can't obtain task list automatically and carry out collecting work; Especially when acquisition server breaks down; Need to adopt artificial mode again acquisition terminal to be set the connected mode of new acquisition server, not only strengthen the workload of safeguarding, and can occur manual work inevitably mistake is set.
Summary of the invention
Technical problem to be solved by this invention is: to the automatic acquisition problems of mass data in the Internet of Things; A kind of monitoring and management method of Internet of Things data acquisition server cluster are provided; Monitor in real time and manage so that data are gathered the central server cluster, thereby realize that the data acquisition task is distributed automatically, the cluster load balancing is distributed, the inefficacy task is taken over.
The present invention addresses the above problem the technical scheme that is adopted: a kind of monitoring and management method of Internet of Things data acquisition server cluster may further comprise the steps:
(1), in advance the ID of all Internet of Things acquisition terminals that are connected with acquisition server is stored in the relational database;
(2), utilize distributed collaboration service Zookeeper to set up tree-like storage organization; This tree-like storage organization is set up acquisition server, management server, acquisition tasks tabulation and configuration file four node under root node, be respectively applied for and deposit relevant acquisition server information, management server information, acquisition tasks list information and system configuration information;
(3), start the Zookeeper cooperation with service;
(4), start management server and the be connected task of acquisition server in the cluster, and foundation and be connected the interim node of corresponding son in Zookeeper with the Zookeeper cooperation with service;
(5), the acquisition terminal ID that prestores in the main management server reading database also gives every acquisition server that the service of collection can be provided with acquisition terminal ID mean allocation;
(6), the main management server is monitored the connection from acquisition terminal; When acquisition terminal was connected to the main management server through network, the main management server returned IP and the port of the acquisition server that this acquisition terminal belongs to and is transmitted to acquisition terminal by routing device;
(7), acquisition terminal is connected communication with the acquisition server of main management server appointment;
(8), every acquisition server all regularly writes corresponding nodes among the Zookeeper with the state information of this machine;
(9), the main management server is monitored acquisition server through Zookeeper; When finding the acquisition server overload is arranged; The main management server is in time adjusted the operating load of every acquisition server according to the load state of other acquisition servers in the current cluster; When finding to have acquisition server that service can't be provided, the main management server judges whether subsequent use acquisition server is arranged in the current cluster, if subsequent use acquisition server is arranged, launches subsequent use acquisition server; If there is not subsequent use acquisition server, the acquisition terminal task mean allocation that the main management server is responsible for this acquisition server can provide the acquisition server of the service of collection for interior other of cluster;
(10), after step (9) acquisition terminal task is redistributed; Acquisition terminal possibly failed with being connected of former acquisition server; If acquisition terminal and former acquisition server are attempted connection failure; Acquisition terminal can connect to the main management server requests once more, and the main management server returns the IP and the port of new acquisition server.
Further comprising the steps of:
(11), through Zookeeper the main management server is monitored, if the main management server loses with Zookeeper and is connected, be upgraded to the main management server from management server, management server is upgraded to from management server fully from management server;
(12), be equipped with management server through Zookeeper to monitoring from management server, be connected if be upgraded to the main management server or lose with Zookeeper from management server, be equipped with management server and be upgraded to from management server;
(13), after recovering, the management server that loses connection becomes management server fully.
In Zookeeper, set up described in the step (4) and be connected the interim node of corresponding son and be meant; Every management server with all under the management server node, set up the interim node of a son after Zookeeper is connected, every acquisition server with all the acquisition server node is tabulated node with acquisition tasks under, set up a sub node temporarily after Zookeeper is connected.
Step (5) concrete operations step is:
1., the main management server reads the tabulation of all acquisition terminal ID and acquisition server respectively from database and configuration file;
2., the main management server is given every acquisition server that the service of collection can be provided with the acquisition terminal mean allocation;
3., the acquisition tasks list information after the main management server will be distributed writes in the interim node of corresponding down each acquisition server of acquisition tasks tabulation node;
4., the data that listen in the interim node of the corresponding down son of acquisition tasks tabulation node of each acquisition server change, and from the interim node of each self-corresponding son, read the acquisition tasks list information.
Step (9) concrete operations step is:
(1), the main management server monitors acquisition server through Zookeeper, finds to have the acquisition server overload, management server is in time adjusted the operating load of every acquisition server according to the load state of other acquisition servers in the current cluster;
(2), the main management server monitors acquisition server through Zookeeper, finds that having acquisition server to lose with Zookeeper is connected:
(a), Zookeeper deletes with this acquisition server corresponding nodes automatically and notifies the main management server;
(b), the main management server starts a timer after receiving the notice of Zookeeper, judges whether the acquisition server that loses connection at the appointed time recovers automatically;
(c), if step (b) is judged the acquisition server lose connection to be recovered at the appointed time automatically, the main management server is not taked any operation; Do not recover automatically at the appointed time if step (b) is judged the acquisition server lose connection, the main management server is judged this acquisition server machine of delaying, and the main management server judges whether subsequent use acquisition server is arranged in the current cluster;
(d), if step (c) is judged in the current cluster subsequent use acquisition server is arranged; The main management server is launched subsequent use acquisition server, and the acquisition terminal tabulation that original acquisition server is responsible for is written in the Zookeeper node of the acquisition server correspondence of newly launching; If judging in the current cluster, step (c) do not have standby server; The main management server acquisition terminal task mean allocation that original acquisition server is responsible is given other acquisition server that can provide collection to serve in the cluster, and the new acquisition terminal tabulation that every acquisition server is responsible for is write in the interior node corresponding of Zookeeper;
(e), the acquisition server of the machine of delaying recovers and restart after be included into subsequent use acquisition server tabulation, when subsequent use acquisition server surpassed some, main management server selected part from subsequent use acquisition server tabulation was arranged work.
Compared with prior art, the invention has the advantages that: the first, when increasing new Internet of Things acquisition terminal, can carry out the automatic distribution of acquisition tasks, guarantee that the overall load of cluster server is balanced according to the running status of acquisition server in the cluster; The second, can be complicated through real-time monitoring and adjustment work to the operation state of acquisition server; Three, through setting up mutual back mechanism, when acquisition server can't provide service, automatically with the acquisition server of its task immigration to backup server or other low loads; Four, need not to connect IP and port into Internet of Things acquisition terminal manual allocation; Acquisition terminal can obtain the acquisition server that it need connect automatically through management server; After the instantaneous acquiring server can't connect, acquisition terminal can automatically obtain new connected mode from management server once more.
Description of drawings
Fig. 1 is the monitoring related among the present invention and the physical structure figure of management system.
Fig. 2 is an implementation step flow chart of the present invention.
Fig. 3 is the cluster server nodal information structure chart of Zookeeper among the present invention.
Fig. 4 is the flow chart that acquisition terminal sends data to acquisition server among the present invention.
Embodiment
For ease of control method of the present invention is described,, the monitoring and the management method of Internet of Things data acquisition server cluster of the present invention elaborated below in conjunction with accompanying drawing:
The present invention based on the monitoring and the management system of Internet of Things data acquisition server cluster as shown in Figure 1; Acquisition server links to each other with the Zookeeper server cluster as client with management server; ZooKeeper be one distributed; The distributed application program coordination service of open source code, Zookeeper cluster provide services such as the global monitoring of management server and acquisition server, configuration and management guest machines.The Zookeeper cluster can detect the information such as state, resource utilization and operating load of acquisition server in real time through the heartbeat agreement.When acquisition server is reached the standard grade, from the Zookeeper cluster, download global configuration information, and therefrom read the own acquisition terminal of being responsible for and tabulate, then with this tabulation in acquisition terminal carry out data communication and gather related data.Management server is connected with the Zookeeper cluster, and is responsible for dynamically updating the state of global configuration information and monitoring acquisition server through Zookeeper.That management server comprises is master and slave, be equipped with three, wherein, has only the main management server that service is provided.When finding to have acquisition server to delay machine, management server uses the acquisition server of the current machine of delaying of standby server replacement, and new server is distributed in the acquisition terminal tabulation that the acquisition server of the former machine of delaying is responsible for.Management server is the acquisition terminal information in the Query Database server regularly, and with up-to-date data sync in the Zookeeper cluster.Acquisition server, management server and Zookeeper cluster are in same Intranet; Transmit packet through router between this Intranet and the outer net; Acquisition terminal links to each other with management server through router; Acquisition terminal carries out data communication with acquisition server then to the IP and the port of management server request acquisition server.
The monitoring and the management method of Internet of Things data acquisition server cluster of the present invention may further comprise the steps:
(1), in advance the ID of all Internet of Things acquisition terminals that are connected with acquisition server is stored in the relational database; When new Internet of Things acquisition terminal increases, also ID is stored into relational database, regularly inquire about for management server;
(2), utilize distributed collaboration service Zookeeper to set up tree-like storage organization; As shown in Figure 3, this tree-like storage organization is set up acquisition server (Cserver), management server (Cmaster), acquisition tasks tabulation (ConcentratorList) and configuration file (Configure) four node under root node (Root).Root ZNode is high node.The CServer node is stored all acquisition server relevant informations with interim node mode, comprises all current spare machines that the machine of the service of collection are provided and the service of collection is not provided.CMaster with interim node mode store master and slave, be equipped with three management server information.ConcentratorList stores the acquisition tasks information of all acquisition servers with interim node mode.Configure with permanent node mode store the present invention based on monitoring and all configuration informations of management system of Internet of Things data acquisition server cluster.Deposit three category informations under the Configure node, the first kind is the unified configuration information of acquisition server, leaves under the node of Same by name; Second type is directed against the different different configuration informations of acquisition server setting, leaves in the provisional child node of Distinct by name; The 3rd type of configuration information leaves in the Extension node, is used for later configuration expansion;
(3), start the Zookeeper cooperation with service;
(4), start management server and the be connected task of acquisition server in the cluster, and foundation and be connected the interim node of corresponding son in Zookeeper with the Zookeeper cooperation with service;
(5), the acquisition terminal ID that prestores in the main management server reading database also gives every acquisition server that the service of collection can be provided with acquisition terminal ID mean allocation;
(6), the main management server is monitored the connection from acquisition terminal; When acquisition terminal was connected to the main management server through network, the main management server returned IP and the port of the acquisition server that this acquisition terminal belongs to and is transmitted to acquisition terminal by routing device;
(7), acquisition terminal is connected communication with the acquisition server of main management server appointment; Only if afterwards with this acquisition server connection failure otherwise need not to be connected with the main management server again;
(8), the every son that all Cserver in the Zookeeper structure is corresponding down at a distance from two minutes of every acquisition server temporarily node write load information, state information, CPU usage, memory usage and the IO information etc. of this machine;
(9), the main management server is monitored acquisition server through Zookeeper; When finding the acquisition server overload is arranged; The main management server is in time adjusted the operating load of every acquisition server according to the load state of other acquisition servers in the current cluster; When finding to have acquisition server that service can't be provided, the main management server judges whether subsequent use acquisition server is arranged in the current cluster, if subsequent use acquisition server is arranged, launches subsequent use acquisition server; If there is not subsequent use acquisition server, the acquisition terminal task mean allocation that the main management server is responsible for this acquisition server can provide the acquisition server of the service of collection for interior other of cluster;
(10), after step (9) acquisition terminal task is redistributed; Acquisition terminal possibly failed with being connected of former acquisition server; If acquisition terminal and former acquisition server are attempted connection failure; Acquisition terminal can connect to the main management server requests once more, and the main management server returns the IP and the port of new acquisition server.
Further comprising the steps of:
(11), through Zookeeper the main management server is monitored, if the main management server loses with Zookeeper and is connected, be upgraded to the main management server from management server, management server is upgraded to from management server fully from management server;
(12), be equipped with management server through Zookeeper to monitoring from management server, be connected if be upgraded to the main management server or lose with Zookeeper from management server, be equipped with management server and be upgraded to from management server;
(13), after recovering, the management server that loses connection becomes management server fully.
In Zookeeper, set up described in the step (4) and be connected the interim node of corresponding son and be meant; Every management server with all under management server node (Cmaster), set up the interim node of a son (comprise main M, from M, be equipped with M) after Zookeeper is connected, every acquisition server with all acquisition server node (Cserver) is tabulated node (ConcentratorList) with acquisition tasks under, set up a sub node temporarily after Zookeeper is connected and (comprise the S1 that is based upon under the Cserver node ... Sn be based upon the L1 under the ConcentratorList node ... Ln).
Step (5) concrete operations step is:
1., the main management server reads the tabulation of all acquisition terminal ID and acquisition server respectively from database and configuration file; Main management server acquisition terminal information in the Query Database server regularly still behind all acquisition terminal ID in first time reading database, and with up-to-date data sync in Zookeeper so that the acquisition terminal that increases newly is distributed automatically;
2., the main management server is given every acquisition server that the service of collection can be provided with the acquisition terminal mean allocation; And in internal memory, set up (acquisition server main frame; The acquisition terminal tabulation) the acquisition server Hash table and the acquisition terminal Hash table of (acquisition terminal ID, acquisition server IP:Port);
3., the main management server writes the acquisition server Hash table in the interim node of corresponding down each acquisition server of acquisition tasks tabulation node (ConcentratorList);
4., the data that listen in the interim node of the corresponding down son of acquisition tasks tabulation node (ConcentratorList) of each acquisition server change, and from the interim node of each self-corresponding son, read the acquisition tasks list information.
Step (9) concrete operations step is:
(1), the main management server monitors acquisition server through Zookeeper, finds to have the acquisition server overload, management server is in time adjusted the operating load of every acquisition server according to the load state of other acquisition servers in the current cluster;
(2), the main management server monitors acquisition server through Zookeeper, finds that having acquisition server to lose with Zookeeper is connected:
(a), Zookeeper deletes with this acquisition server corresponding nodes automatically and notifies the main management server;
(b), the main management server starts a timer after receiving the notice of Zookeeper, judges whether the acquisition server that loses connection at the appointed time recovers automatically;
(c), if step (b) is judged the acquisition server lose connection to be recovered at the appointed time automatically, the main management server is not taked any operation; Do not recover automatically at the appointed time if step (b) is judged the acquisition server lose connection, the main management server is judged this acquisition server machine of delaying, and the main management server judges whether subsequent use acquisition server is arranged in the current cluster;
(d), if step (c) is judged in the current cluster subsequent use acquisition server is arranged; The main management server is launched subsequent use acquisition server; And the acquisition terminal that original acquisition server is responsible for tabulation is written in the corresponding Zookeeper node of the acquisition server newly launched, and the acquisition server of promptly newly launching is based upon the son node temporarily ConcentratorList under; If judging in the current cluster, step (c) do not have standby server; The acquisition terminal task mean allocation that the main management server is responsible for original acquisition server is given other acquisition server that can provide collection to serve in the cluster; And the new acquisition terminal tabulation that every acquisition server is responsible for write in the Zookeeper in the node corresponding, promptly every acquisition server is based upon the interim node of each height under the ConcentratorList;
(e), the acquisition server of the machine of delaying recovers and restart after be included into subsequent use acquisition server tabulation, when subsequent use acquisition server surpassed some, main management server selected part from subsequent use acquisition server tabulation was arranged work.
Monitoring described in the above-mentioned steps, monitoring all are the event notification mechanisms that utilized Zookeeper; When after respective nodes is injected watcher (Zookeeper monitor), Zookeeper promptly can give corresponding server with the change notification that this node data takes place.Dotted line among Fig. 3 is represented the distribution of watcher.
Fig. 4 has acquisition terminal, router, management server and four kinds of participants of acquisition server for acquisition terminal sends data to the flow process of acquisition server in this flow process.
Step 1: when acquisition terminal is reached the standard grade, connect to the management server request of sending through router;
Step 2: router is mapped to management server with this connection request;
Step 3: management server is according to the operating duty of current acquisition server cluster and the allocation strategy of acquisition server, for this concentrator distributes an acquisition server;
Step 4: router is transmitted to acquisition terminal with the information in the step 3;
Step 5: after acquisition terminal is received the acquisition server IP and port numbers of connection, be connected with the management server disconnection;
Step 6: management server listens to connect and breaks off, and closes socket;
Step 7: acquisition terminal sends connection request to the acquisition server that receives;
Step 8: router is transmitted the connection request of acquisition terminal;
Step 9: after acquisition server receives the connection request of acquisition terminal, monitor this acquisition terminal ID whether in the acquisition terminal tabulation that it is responsible for, if, then accept the connection request of this acquisition terminal, otherwise refusal;
Step 10: router is transmitted the response frame of step 9;
Step 11: after acquisition terminal is received response frame, send acknowledgement frame;
Step 12: the routing forwarding acknowledgement frame, after acquisition server receives acknowledgement frame, successful connection;
Step 13: be connected if acquisition terminal loses with acquisition server, maximum repeating step 7 twice then is not if still connect then change step 14 over to;
Step 14: if repeat twice all not success of step 7, then repeating step 1.
Claims (5)
1. the monitoring and the management method of an Internet of Things data acquisition server cluster is characterized in that: may further comprise the steps:
(1), in advance the ID of all Internet of Things acquisition terminals that are connected with acquisition server is stored in the relational database;
(2), utilize distributed collaboration service Zookeeper to set up tree-like storage organization; This tree-like storage organization is set up acquisition server, management server, acquisition tasks tabulation and configuration file four node under root node, be respectively applied for and deposit relevant acquisition server information, management server information, acquisition tasks list information and system configuration information;
(3), start the Zookeeper cooperation with service;
(4), start management server and the be connected task of acquisition server in the cluster, and foundation and be connected the interim node of corresponding son in Zookeeper with the Zookeeper cooperation with service;
(5), the acquisition terminal ID that prestores in the main management server reading database also gives every acquisition server that the service of collection can be provided with acquisition terminal ID mean allocation;
(6), the main management server is monitored the connection from acquisition terminal; When acquisition terminal was connected to the main management server through network, the main management server returned IP and the port of the acquisition server that this acquisition terminal belongs to and is transmitted to acquisition terminal by routing device;
(7), acquisition terminal is connected communication with the acquisition server of main management server appointment;
(8), every acquisition server all regularly writes corresponding nodes among the Zookeeper with the state information of this machine;
(9), the main management server is monitored acquisition server through Zookeeper; When finding the acquisition server overload is arranged; The main management server is in time adjusted the operating load of every acquisition server according to the load state of other acquisition servers in the current cluster; When finding to have acquisition server that service can't be provided, the main management server judges whether subsequent use acquisition server is arranged in the current cluster, if subsequent use acquisition server is arranged, launches subsequent use acquisition server; If there is not subsequent use acquisition server, the acquisition terminal task mean allocation that the main management server is responsible for this acquisition server can provide the acquisition server of the service of collection for interior other of cluster;
(10), after step (9) acquisition terminal task is redistributed; Acquisition terminal possibly failed with being connected of former acquisition server; If acquisition terminal and former acquisition server are attempted connection failure; Acquisition terminal can connect to the main management server requests once more, and the main management server returns the IP and the port of new acquisition server.
2. the monitoring and the management method of a kind of Internet of Things data acquisition server cluster according to claim 1 is characterized in that:
Further comprising the steps of:
(11), through Zookeeper the main management server is monitored, if the main management server loses with Zookeeper and is connected, be upgraded to the main management server from management server from management server;
(12), be equipped with management server through Zookeeper to monitoring from management server, be connected if be upgraded to the main management server or lose with Zookeeper from management server, be equipped with management server and be upgraded to from management server;
(13), after recovering, the management server that loses connection becomes management server fully.
3. the monitoring and the management method of a kind of Internet of Things data acquisition server cluster according to claim 1; It is characterized in that: in Zookeeper, set up described in the step (4) and be connected the interim node of corresponding son and be meant; Every management server with all under the management server node, set up the interim node of a son after Zookeeper is connected, every acquisition server with all the acquisition server node is tabulated node with acquisition tasks under, set up a sub node temporarily after Zookeeper is connected.
4. the monitoring and the management method of a kind of Internet of Things data acquisition server cluster according to claim 1 is characterized in that: step (5) concrete operations step is:
1., the main management server reads the tabulation of all acquisition terminal ID and acquisition server respectively from database and configuration file;
2., the main management server is given every acquisition server that the service of collection can be provided with the acquisition terminal mean allocation;
3., the acquisition tasks list information after the main management server will be distributed writes in the interim node of corresponding down each acquisition server of acquisition tasks tabulation node;
4., the data that listen in the interim node of the corresponding down son of acquisition tasks tabulation node of each acquisition server change, and from the interim node of each self-corresponding son, read the acquisition tasks list information.
5. the monitoring and the management method of a kind of Internet of Things data acquisition server cluster according to claim 1 is characterized in that: step (9) concrete operations step is:
(1), the main management server monitors acquisition server through Zookeeper, finds to have the acquisition server overload, management server is in time adjusted the operating load of every acquisition server according to the load state of other acquisition servers in the current cluster;
(2), the main management server monitors acquisition server through Zookeeper, finds that having acquisition server to lose with Zookeeper is connected:
(a), Zookeeper deletes with this acquisition server corresponding nodes automatically and notifies the main management server;
(b), the main management server starts a timer after receiving the notice of Zookeeper, judges whether the acquisition server that loses connection at the appointed time recovers automatically;
(c), if step (b) is judged the acquisition server lose connection to be recovered at the appointed time automatically, the main management server is not taked any operation; Do not recover automatically at the appointed time if step (b) is judged the acquisition server lose connection, the main management server is judged this acquisition server machine of delaying, and the main management server judges whether subsequent use acquisition server is arranged in the current cluster;
(d), if step (c) is judged in the current cluster subsequent use acquisition server is arranged; The main management server is launched subsequent use acquisition server, and the acquisition terminal tabulation that original acquisition server is responsible for is written in the Zookeeper node of the acquisition server correspondence of newly launching; If judging in the current cluster, step (c) do not have standby server; The main management server acquisition terminal task mean allocation that original acquisition server is responsible is given other acquisition server that can provide collection to serve in the cluster, and the new acquisition terminal tabulation that every acquisition server is responsible for is write in the interior node corresponding of Zookeeper;
(e), the acquisition server of the machine of delaying recovers and restart after be included into subsequent use acquisition server tabulation, when subsequent use acquisition server surpassed some, main management server selected part from subsequent use acquisition server tabulation was arranged work.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210170849.4A CN102739775B (en) | 2012-05-29 | 2012-05-29 | The monitoring of internet of things data acquisition server cluster and management method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210170849.4A CN102739775B (en) | 2012-05-29 | 2012-05-29 | The monitoring of internet of things data acquisition server cluster and management method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102739775A true CN102739775A (en) | 2012-10-17 |
| CN102739775B CN102739775B (en) | 2017-11-07 |
Family
ID=46994546
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210170849.4A Active CN102739775B (en) | 2012-05-29 | 2012-05-29 | The monitoring of internet of things data acquisition server cluster and management method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102739775B (en) |
Cited By (45)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103152428A (en) * | 2013-03-19 | 2013-06-12 | 汉柏科技有限公司 | Method for carrying out service communication among nodes on cloud platform |
| CN103227840A (en) * | 2013-05-24 | 2013-07-31 | 上海和伍新材料科技有限公司 | IOT (Internet of things)-oriented high-concurrency high-availability data acquisition system |
| CN103577255A (en) * | 2013-10-29 | 2014-02-12 | 汉柏科技有限公司 | Method and system for controlling asynchronous progresses among plurality of services based on Zookeeper |
| CN103731312A (en) * | 2014-01-26 | 2014-04-16 | 飞狐信息技术（天津）有限公司 | Method and apparatus for performing failure checking on service of remote method invocation |
| CN103793493A (en) * | 2014-01-21 | 2014-05-14 | 深圳市元征科技股份有限公司 | Method and system for processing car-mounted terminal mass data |
| CN103905537A (en) * | 2014-03-20 | 2014-07-02 | 冶金自动化研究设计院 | System for managing industry real-time data storage in distributed environment |
| CN103915892A (en) * | 2013-01-06 | 2014-07-09 | 上海电力通信有限公司 | Transmission method for transformer substation comprehensive information |
| CN104536814A (en) * | 2015-01-16 | 2015-04-22 | 北京京东尚科信息技术有限公司 | Method and system for processing workflow |
| CN104735097A (en) * | 2013-12-18 | 2015-06-24 | 青岛海尔空调器有限总公司 | Information collecting method and system |
| CN103078805B (en) * | 2012-12-31 | 2015-08-05 | 北京京东世纪贸易有限公司 | Make the system and method reading the expansion of performance support level of Zookeeper |
| CN104915259A (en) * | 2015-06-15 | 2015-09-16 | 浪潮软件集团有限公司 | Task scheduling method applied to distributed acquisition system |
| CN105306514A (en) * | 2014-07-30 | 2016-02-03 | 北京信威通信技术股份有限公司 | Audio recording file distributed storage method and audio recording file distributed storage system based on Zookeeper |
| CN105306583A (en) * | 2015-11-11 | 2016-02-03 | 广州新科佳都科技有限公司 | Distributed permission management method and system based on atomic broadcast technology |
| CN105338086A (en) * | 2015-11-04 | 2016-02-17 | 浪潮软件股份有限公司 | Distributed message forwarding method |
| CN105357549A (en) * | 2015-11-09 | 2016-02-24 | 天津网络广播电视台有限公司 | Data collection system and data collection method for set-top box |
| CN105554099A (en) * | 2015-12-10 | 2016-05-04 | 浪潮通信信息系统有限公司 | Method and device for balancing load of acquisition servers |
| CN105553774A (en) * | 2015-12-23 | 2016-05-04 | 厦门市美亚柏科信息股份有限公司 | Internet data collection method and system |
| CN106487599A (en) * | 2016-11-30 | 2017-03-08 | 上海斐讯数据通信技术有限公司 | The method and system of cloud access controller running status distributed monitoring |
| CN103220165B (en) * | 2013-03-20 | 2017-04-19 | 杭州华三通信技术有限公司 | Processing method and device for server active downtime |
| CN106817408A (en) * | 2016-12-27 | 2017-06-09 | 中国银联股份有限公司 | A kind of distributed server cluster dispatching method and device |
| CN107086940A (en) * | 2017-03-31 | 2017-08-22 | 北京奇艺世纪科技有限公司 | A kind of single service operation method and device |
| CN107135156A (en) * | 2017-06-07 | 2017-09-05 | 努比亚技术有限公司 | Call chain collecting method, mobile terminal and computer-readable recording medium |
| CN107229525A (en) * | 2017-04-27 | 2017-10-03 | 国电南瑞科技股份有限公司 | A kind of power system device model keyword generation method based on Zookeeper |
| CN107547622A (en) * | 2017-06-28 | 2018-01-05 | 新华三技术有限公司 | A kind of resource adjusting method and device |
| CN108134702A (en) * | 2017-12-26 | 2018-06-08 | 北京科来数据分析有限公司 | A kind of data collector failure solution |
| CN108234623A (en) * | 2017-12-29 | 2018-06-29 | 长园深瑞继保自动化有限公司 | Distribution main website data acquisition link automatic equalization management method |
| CN108234637A (en) * | 2017-12-29 | 2018-06-29 | 广州品唯软件有限公司 | A kind of method and system that load balancing is realized based on zookeeper |
| US10069941B2 (en) | 2015-04-28 | 2018-09-04 | Microsoft Technology Licensing, Llc | Scalable event-based notifications |
| CN108712467A (en) * | 2018-04-19 | 2018-10-26 | 宁波三掌柜新商业有限公司 | A kind of exchange method realized Internet of Things real time high-speed and stablize high concurrent |
| CN108833408A (en) * | 2018-06-15 | 2018-11-16 | 杭州数途信息科技有限公司 | Centralized machine tool data acquires framework |
| CN109194757A (en) * | 2018-09-13 | 2019-01-11 | 林东权 | The control method and system of Intelligent internet of things lathe based on statistical analysis |
| CN109246219A (en) * | 2018-09-18 | 2019-01-18 | 食品安全与营养（贵州）信息科技有限公司 | A kind of working method and system of IoT data collection system |
| CN109391489A (en) * | 2017-08-08 | 2019-02-26 | 大唐移动通信设备有限公司 | A kind of storage processing method and device of element configuration data |
| CN109660428A (en) * | 2018-12-24 | 2019-04-19 | 航天信息股份有限公司 | High availability cluster system |
| CN110034925A (en) * | 2019-01-07 | 2019-07-19 | 阿里巴巴集团控股有限公司 | Across computer room trust computing cluster formation and communication means and device |
| CN110083504A (en) * | 2019-03-29 | 2019-08-02 | 北京奇安信科技有限公司 | The running state monitoring method and device of distributed task scheduling |
| WO2019222904A1 (en) * | 2018-05-22 | 2019-11-28 | 杭州全视软件有限公司 | Method for generating and allocating task and obtaining task completion evaluation through internet of things |
| CN110858168A (en) * | 2018-08-24 | 2020-03-03 | 浙江宇视科技有限公司 | Cluster node fault processing method and device and cluster node |
| CN111104209A (en) * | 2019-11-25 | 2020-05-05 | 华为技术有限公司 | Method for processing task and related equipment |
| CN111130900A (en) * | 2019-12-30 | 2020-05-08 | 智慧神州(北京)科技有限公司 | Data acquisition method and device based on distributed interconnection of coordination services |
| CN111641716A (en) * | 2020-06-01 | 2020-09-08 | 第四范式（北京）技术有限公司 | Self-healing method of parameter server, parameter server and parameter service system |
| CN112073265A (en) * | 2020-08-31 | 2020-12-11 | 帷幄匠心科技（杭州）有限公司 | Internet of things monitoring method and system based on distributed edge computing |
| CN112202895A (en) * | 2020-09-30 | 2021-01-08 | 北京达佳互联信息技术有限公司 | Method and system for collecting monitoring index data, electronic equipment and storage medium |
| CN112671909A (en) * | 2020-12-25 | 2021-04-16 | 中标慧安信息技术股份有限公司 | Application method and system of Internet of things rule chain |
| CN116720645A (en) * | 2022-10-21 | 2023-09-08 | 荣耀终端有限公司 | Task distribution method, distribution equipment and task distribution system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101977124A (en) * | 2010-11-05 | 2011-02-16 | 山东中创软件工程股份有限公司 | Service clustering method and system based on ZooKeeper technology |
| CN102158346A (en) * | 2010-11-23 | 2011-08-17 | 北京神州泰岳软件股份有限公司 | Information acquisition system and method based on cloud computing |
| US20110313973A1 (en) * | 2010-06-19 | 2011-12-22 | Srivas Mandayam C | Map-Reduce Ready Distributed File System |
| US20120120964A1 (en) * | 2010-07-06 | 2012-05-17 | Teemu Koponen | Network control apparatus and method for populating logical datapath sets |
-
2012
- 2012-05-29 CN CN201210170849.4A patent/CN102739775B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110313973A1 (en) * | 2010-06-19 | 2011-12-22 | Srivas Mandayam C | Map-Reduce Ready Distributed File System |
| US20120120964A1 (en) * | 2010-07-06 | 2012-05-17 | Teemu Koponen | Network control apparatus and method for populating logical datapath sets |
| CN101977124A (en) * | 2010-11-05 | 2011-02-16 | 山东中创软件工程股份有限公司 | Service clustering method and system based on ZooKeeper technology |
| CN102158346A (en) * | 2010-11-23 | 2011-08-17 | 北京神州泰岳软件股份有限公司 | Information acquisition system and method based on cloud computing |
Non-Patent Citations (2)
| Title |
|---|
| 张新瑞等: "《用电信息采集系统的设计与建设》", 《工业计量》 * |
| 王洁等: "《基于分布式协调系统的并行频繁模式增长算法的优化》", 《计算机科学》 * |
Cited By (58)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103078805B (en) * | 2012-12-31 | 2015-08-05 | 北京京东世纪贸易有限公司 | Make the system and method reading the expansion of performance support level of Zookeeper |
| CN103915892A (en) * | 2013-01-06 | 2014-07-09 | 上海电力通信有限公司 | Transmission method for transformer substation comprehensive information |
| CN103152428A (en) * | 2013-03-19 | 2013-06-12 | 汉柏科技有限公司 | Method for carrying out service communication among nodes on cloud platform |
| CN103220165B (en) * | 2013-03-20 | 2017-04-19 | 杭州华三通信技术有限公司 | Processing method and device for server active downtime |
| CN103227840A (en) * | 2013-05-24 | 2013-07-31 | 上海和伍新材料科技有限公司 | IOT (Internet of things)-oriented high-concurrency high-availability data acquisition system |
| CN103577255A (en) * | 2013-10-29 | 2014-02-12 | 汉柏科技有限公司 | Method and system for controlling asynchronous progresses among plurality of services based on Zookeeper |
| CN104735097A (en) * | 2013-12-18 | 2015-06-24 | 青岛海尔空调器有限总公司 | Information collecting method and system |
| CN103793493A (en) * | 2014-01-21 | 2014-05-14 | 深圳市元征科技股份有限公司 | Method and system for processing car-mounted terminal mass data |
| CN103731312A (en) * | 2014-01-26 | 2014-04-16 | 飞狐信息技术（天津）有限公司 | Method and apparatus for performing failure checking on service of remote method invocation |
| CN103905537A (en) * | 2014-03-20 | 2014-07-02 | 冶金自动化研究设计院 | System for managing industry real-time data storage in distributed environment |
| CN105306514A (en) * | 2014-07-30 | 2016-02-03 | 北京信威通信技术股份有限公司 | Audio recording file distributed storage method and audio recording file distributed storage system based on Zookeeper |
| CN104536814B (en) * | 2015-01-16 | 2019-01-22 | 北京京东尚科信息技术有限公司 | A kind of method and system handling workflow |
| CN104536814A (en) * | 2015-01-16 | 2015-04-22 | 北京京东尚科信息技术有限公司 | Method and system for processing workflow |
| US10069941B2 (en) | 2015-04-28 | 2018-09-04 | Microsoft Technology Licensing, Llc | Scalable event-based notifications |
| CN104915259A (en) * | 2015-06-15 | 2015-09-16 | 浪潮软件集团有限公司 | Task scheduling method applied to distributed acquisition system |
| CN105338086A (en) * | 2015-11-04 | 2016-02-17 | 浪潮软件股份有限公司 | Distributed message forwarding method |
| CN105338086B (en) * | 2015-11-04 | 2019-06-25 | 浪潮软件股份有限公司 | A kind of distributed message forwarding method |
| CN105357549A (en) * | 2015-11-09 | 2016-02-24 | 天津网络广播电视台有限公司 | Data collection system and data collection method for set-top box |
| CN105306583A (en) * | 2015-11-11 | 2016-02-03 | 广州新科佳都科技有限公司 | Distributed permission management method and system based on atomic broadcast technology |
| CN105554099A (en) * | 2015-12-10 | 2016-05-04 | 浪潮通信信息系统有限公司 | Method and device for balancing load of acquisition servers |
| CN105553774A (en) * | 2015-12-23 | 2016-05-04 | 厦门市美亚柏科信息股份有限公司 | Internet data collection method and system |
| CN106487599A (en) * | 2016-11-30 | 2017-03-08 | 上海斐讯数据通信技术有限公司 | The method and system of cloud access controller running status distributed monitoring |
| CN106487599B (en) * | 2016-11-30 | 2020-02-04 | 上海斐讯数据通信技术有限公司 | Method and system for distributed monitoring of running state of cloud access controller |
| CN106817408A (en) * | 2016-12-27 | 2017-06-09 | 中国银联股份有限公司 | A kind of distributed server cluster dispatching method and device |
| CN106817408B (en) * | 2016-12-27 | 2020-09-29 | 中国银联股份有限公司 | Distributed server cluster scheduling method and device |
| CN107086940A (en) * | 2017-03-31 | 2017-08-22 | 北京奇艺世纪科技有限公司 | A kind of single service operation method and device |
| CN107086940B (en) * | 2017-03-31 | 2019-11-15 | 北京奇艺世纪科技有限公司 | A kind of list service operation method and device |
| CN107229525A (en) * | 2017-04-27 | 2017-10-03 | 国电南瑞科技股份有限公司 | A kind of power system device model keyword generation method based on Zookeeper |
| CN107135156A (en) * | 2017-06-07 | 2017-09-05 | 努比亚技术有限公司 | Call chain collecting method, mobile terminal and computer-readable recording medium |
| CN107547622A (en) * | 2017-06-28 | 2018-01-05 | 新华三技术有限公司 | A kind of resource adjusting method and device |
| CN109391489B (en) * | 2017-08-08 | 2020-10-30 | 大唐移动通信设备有限公司 | Network element configuration data storage processing method and device |
| CN109391489A (en) * | 2017-08-08 | 2019-02-26 | 大唐移动通信设备有限公司 | A kind of storage processing method and device of element configuration data |
| CN108134702B (en) * | 2017-12-26 | 2021-01-01 | 北京科来数据分析有限公司 | Data acquisition unit fault solving method |
| CN108134702A (en) * | 2017-12-26 | 2018-06-08 | 北京科来数据分析有限公司 | A kind of data collector failure solution |
| CN108234637A (en) * | 2017-12-29 | 2018-06-29 | 广州品唯软件有限公司 | A kind of method and system that load balancing is realized based on zookeeper |
| CN108234623A (en) * | 2017-12-29 | 2018-06-29 | 长园深瑞继保自动化有限公司 | Distribution main website data acquisition link automatic equalization management method |
| CN108712467A (en) * | 2018-04-19 | 2018-10-26 | 宁波三掌柜新商业有限公司 | A kind of exchange method realized Internet of Things real time high-speed and stablize high concurrent |
| WO2019222904A1 (en) * | 2018-05-22 | 2019-11-28 | 杭州全视软件有限公司 | Method for generating and allocating task and obtaining task completion evaluation through internet of things |
| CN108833408A (en) * | 2018-06-15 | 2018-11-16 | 杭州数途信息科技有限公司 | Centralized machine tool data acquires framework |
| CN110858168A (en) * | 2018-08-24 | 2020-03-03 | 浙江宇视科技有限公司 | Cluster node fault processing method and device and cluster node |
| CN110858168B (en) * | 2018-08-24 | 2023-08-18 | 浙江宇视科技有限公司 | Cluster node fault processing method and device and cluster node |
| CN109194757A (en) * | 2018-09-13 | 2019-01-11 | 林东权 | The control method and system of Intelligent internet of things lathe based on statistical analysis |
| CN109194757B (en) * | 2018-09-13 | 2021-05-04 | 江苏汉峰数控科技有限公司 | Control method and system of intelligent Internet of things machine tool based on statistical analysis |
| CN109246219A (en) * | 2018-09-18 | 2019-01-18 | 食品安全与营养（贵州）信息科技有限公司 | A kind of working method and system of IoT data collection system |
| CN109660428A (en) * | 2018-12-24 | 2019-04-19 | 航天信息股份有限公司 | High availability cluster system |
| CN110034925A (en) * | 2019-01-07 | 2019-07-19 | 阿里巴巴集团控股有限公司 | Across computer room trust computing cluster formation and communication means and device |
| CN110034925B (en) * | 2019-01-07 | 2022-03-01 | 创新先进技术有限公司 | Cross-machine-room trusted computing cluster forming and communication method and device |
| CN110083504A (en) * | 2019-03-29 | 2019-08-02 | 北京奇安信科技有限公司 | The running state monitoring method and device of distributed task scheduling |
| CN111104209A (en) * | 2019-11-25 | 2020-05-05 | 华为技术有限公司 | Method for processing task and related equipment |
| CN111104209B (en) * | 2019-11-25 | 2023-07-11 | 华为技术有限公司 | Task processing method and related equipment |
| CN111130900A (en) * | 2019-12-30 | 2020-05-08 | 智慧神州(北京)科技有限公司 | Data acquisition method and device based on distributed interconnection of coordination services |
| CN111641716A (en) * | 2020-06-01 | 2020-09-08 | 第四范式（北京）技术有限公司 | Self-healing method of parameter server, parameter server and parameter service system |
| CN111641716B (en) * | 2020-06-01 | 2023-05-02 | 第四范式（北京）技术有限公司 | Self-healing method of parameter server, parameter server and parameter service system |
| CN112073265A (en) * | 2020-08-31 | 2020-12-11 | 帷幄匠心科技（杭州）有限公司 | Internet of things monitoring method and system based on distributed edge computing |
| CN112202895A (en) * | 2020-09-30 | 2021-01-08 | 北京达佳互联信息技术有限公司 | Method and system for collecting monitoring index data, electronic equipment and storage medium |
| CN112671909A (en) * | 2020-12-25 | 2021-04-16 | 中标慧安信息技术股份有限公司 | Application method and system of Internet of things rule chain |
| CN112671909B (en) * | 2020-12-25 | 2022-10-21 | 中标慧安信息技术股份有限公司 | Application method and system of Internet of things rule chain |
| CN116720645A (en) * | 2022-10-21 | 2023-09-08 | 荣耀终端有限公司 | Task distribution method, distribution equipment and task distribution system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102739775B (en) | 2017-11-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102739775A (en) | Method for monitoring and managing Internet of Things data acquisition server cluster | |
| CN108199897B (en) | OPC UA multi-server aggregation method supporting cache management | |
| US11314539B2 (en) | Cloud storage based data processing method and system | |
| CN103532741B (en) | A kind of access level network topology management method and system | |
| CN101729412B (en) | Distributed level cluster method and system of geographic information service | |
| CN103581276B (en) | Cluster management device, system, service customer end and correlation method | |
| CN105357296A (en) | Elastic caching system based on Docker cloud platform | |
| CN104618255B (en) | A kind of front-collection service system and data processing method | |
| CN103236949A (en) | Monitoring method, device and system for server cluster | |
| CN103974140B (en) | Management method and management system of TR069 protocol based large-scale interactive TV terminal | |
| CN108259215B (en) | Equipment management method and device | |
| CN102984012B (en) | Management method and system for service resources | |
| CN104935672A (en) | High available realizing method and equipment of load balancing service | |
| CN102984501A (en) | Network video-recording cluster system | |
| CN103888277A (en) | Gateway disaster recovery backup method, apparatus and system | |
| CN108055157A (en) | The acquisition methods and device of a kind of service node | |
| CN106407011A (en) | A routing table-based search system cluster service management method and system | |
| CN108600322B (en) | Comprehensive video monitoring cloud service system and method based on railway video technical specification | |
| CN100452741C (en) | Expandable P2P flow media system | |
| CN111464612A (en) | Method for providing stable computing service in severe environment | |
| CN114036236A (en) | Multi-gateway cluster system | |
| CN101702673A (en) | Load balancing method based on BS framework | |
| CN111460030A (en) | ZooKeeper-based distributed data exchange system | |
| WO2017124834A1 (en) | Resource management method, apparatus, and system | |
| CN102571383B (en) | Access control method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180528 Address after: 315181 Lin village, Haishu District, Ningbo, Zhejiang Patentee after: Ningbo Donghai Group Corp., Ltd. Address before: 315105 Zhejiang, Ningbo, Ningbo, Yinzhou District, Zhonghe street, Yinzhou District, Macun Patentee before: Ningbo Dongguan Technology Co., Ltd. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180705 Address after: 315181 Lin village, Haishu District, Ningbo, Zhejiang Co-patentee after: Ningbo Dongguan Technology Co., Ltd. Patentee after: Ningbo Donghai Group Corp., Ltd. Address before: 315181 Lin village, Haishu District, Ningbo, Zhejiang Patentee before: Ningbo Donghai Group Corp., Ltd. |