CN103795647A - Data acquisition method, data collector and data acquisition system - Google Patents
Data acquisition method, data collector and data acquisition system Download PDFInfo
- Publication number
- CN103795647A CN103795647A CN201210431036.6A CN201210431036A CN103795647A CN 103795647 A CN103795647 A CN 103795647A CN 201210431036 A CN201210431036 A CN 201210431036A CN 103795647 A CN103795647 A CN 103795647A
- Authority
- CN
- China
- Prior art keywords
- collector
- data
- server
- thread
- collecting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data acquisition method, a data collector and a data acquisition system. The data acquisition method comprises: a collector receiving an acquisition starting command from a server; the collector performing data acquisition on a target device after receiving the acquisition starting command, and obtaining target data; the collector performing pretreatment on the target data, and obtaining feedback data; and the collector feeding the feedback data back to the server for storage. By using the method, the collector and the system provided by the invention, the problem in the prior art is solved that a conventional data acquisition method tends to cause decreased stability of a network server, and the effect of improving stability of the server is achieved.
Description
Technical field
The present invention relates to data processing field, in particular to a kind of collecting method, data acquisition unit and system.
Background technology
In prior art, server S erver is to generally adopting the mode of polling system to process and store from the image data of each collector Collector, as shown in Figure 1, server carries out after caching process, data being deposited in DB database to image data under polling system mode, this collection model is realized simple, the in the situation that of a small amount of image data, this model is available, but server has carried collection scheduling in this model, the simple cache of the memory scheduling of DB database and not congested data, so this kind of collection model is very high to the requirement of server, in existing network environment, be to have serious performance bottleneck, can cause the performance of following several aspects congested:
1, the resource of Server is limited, polling system can use thread CPU and the memory source of Server, the performance bottleneck that this there will be Server to process when can causing the resources such as Server thread, CPU, internal memory relatively nervous, increase the data processing pressure of server, reduce server stability.
2, because Server and Collector in existing data collecting model are the relations of one-to-many, if Collector is left intact and directly returns to Server after obtaining data, be responsible for the conversion of initial data to object data by Server, the not reciprocity data collecting model of this framework does not make full use of multiple processing cores of Collector, and this processing core burden of Server is large especially, in the time that Collector is abundant, this 1 of Server processing core cannot be born, cause equally data collecting model to have potential performance bottleneck, increase the data processing pressure of server, reduce server stability.
3, the storage of DB database is a slow procedure, if it is bad that process the opportunity of Collector return data, for example Server does not handle the time point of initiating collection well, cause Collector return data too concentrated, and Server can not be by a large amount of deposit data among DB database, will cause these return datas to occur in the buffer queue of Server so congested, under extreme case, can, with the limited memory source of light Server, cause the collapse of Server.
4, in existing data collecting model, other data processing modules in server can be fought for the system resource of Server equally, and this situation can increase the processing pressure of server more.
Easily cause the problem of webserver stability decreases for collecting method in correlation technique, not yet propose at present effective solution.
Summary of the invention
Main purpose of the present invention is to provide a kind of collecting method, data acquisition unit and system, easily causes the problem of webserver stability decreases to solve collecting method in prior art.
To achieve these goals, according to an aspect of the present invention, provide a kind of collecting method, having comprised: collector has received the collection starting command from server; Collector carries out data acquisition to target device receiving to gather after starting command, obtains target data; Collector carries out preliminary treatment to target data, obtains feedback data; And collector feeds back to server by feedback data and stores.
Further, collector comprises multiple collectors, collector feeds back to server by feedback data and stores and comprise: the first collector send-thread request instruction is to server, wherein, server receives the feedback data from multiple collectors by different transfer of data threads, server is also for feeding back idle data transmission thread to the first collector receiving after thread request instruction, the first collector is the arbitrary collector in multiple collectors; And first collector by first data transmission thread, the first feedback data is sent to server and stores, wherein, the first feedback data is that the first collector carries out the feedback data obtaining after preliminary treatment to the target data collecting, the idle data transmission thread that first data transmission thread is server feedback.
Further, after the first collector is sent to server by first data transmission thread by the first feedback data, collecting method also comprises: server receives the first feedback data by first data transmission thread; And server is stored to database by a DB passage by the first feedback data, wherein, server is also stored to database for the DB passage by different by the first feedback data, and a DB passage is the DB passage corresponding with first data transmission thread.
Further, at the first collector send-thread request instruction, to before server, collecting method also comprises: the relatively priority of the feedback data of each collector; And the order of determining each collector send-thread request instruction is corresponding with the priority orders comparing.
Further, carry out the priority of comparison feedback data by the COS mark of the target data of each collector relatively.
Further, collector comprises multiple collectors, after collector receives the collection starting command from server, and before collector carries out data acquisition to target device, collecting method also comprises: the first collector starts the first scheduling thread, wherein, the first collector is the arbitrary collector in multiple collectors; And in the time that the first scheduling thread carries out data acquisition, from collecting thread pond, obtain collecting thread resource, wherein, the SNMP collecting thread resource that collecting thread pond is Chi Huahou wherein, is carried out data acquisition to target device after getting collecting thread resource.
Further, preliminary treatment comprise in following processing mode any one or multiple: residual quantity computing, percentage computing and total amount computing.
Further, collecting method also comprises: collector receives the parameter modification order from server; And collector upgrades acquisition parameter according to parameter modification order after current data collection finishes.
To achieve these goals, according to a further aspect in the invention, provide a kind of data acquisition unit, having comprised: receiving element, for receiving the collection starting command from server; Collecting unit, for target device being carried out to data acquisition receiving to gather after starting command, obtains target data; Processing unit, for target data is carried out to preliminary treatment, obtains feedback data; And feedback unit, for being fed back to server, feedback data stores.
To achieve these goals, according to a further aspect in the invention, provide a kind of data acquisition system, having comprised: server; And the data acquisition unit that provides of foregoing of the present invention.
By the present invention, adopt collector to receive the collection starting command from server; Collector carries out data acquisition to target device receiving to gather after starting command, obtains target data; Collector carries out preliminary treatment to target data, obtains feedback data; And collector feeds back to server by feedback data and stores.By receiving after the collection starting command of server initiation, by collector, target device is carried out to data acquisition, and the target data collecting is carried out feeding back to server after preliminary treatment again, this kind carries out pretreated mode by collector to target data, directly use the processing core of collector, avoid taking thread CPU and the memory source of server S erver, reduce the data processing pressure of server, solve the problem that collecting method in prior art easily causes webserver stability decreases, and then reach the effect that improves server stability.
Accompanying drawing explanation
The accompanying drawing that forms the application's a part is used to provide a further understanding of the present invention, and schematic description and description of the present invention is used for explaining the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings:
Fig. 1 is according to the schematic diagram of the data acquisition system of correlation technique;
Fig. 2 is according to the flow chart of the collecting method of the embodiment of the present invention;
Fig. 3 is the schematic diagram that adopts the collecting method of the embodiment of the present invention to carry out data preservation;
Fig. 4 is according to the schematic diagram of the data acquisition unit of the embodiment of the present invention; And
Fig. 5 is according to the schematic diagram of the data acquisition system of the embodiment of the present invention.
Embodiment
It should be noted that, in the situation that not conflicting, the feature in embodiment and embodiment in the application can combine mutually.Describe below with reference to the accompanying drawings and in conjunction with the embodiments the present invention in detail.
The embodiment of the present invention provides a kind of collecting method, below collecting method that the embodiment of the present invention is provided be specifically introduced:
Fig. 2 is according to the flow chart of the collecting method of the embodiment of the present invention, and as shown in Figure 2, the method comprises that following step S202 is to step S208:
S202: collector receives the collection starting command from server, in the time that collection scheduling work starts, sends collection scheduling starting command by server S erver to collector Collector that is.
S204: collector carries out data acquisition to target device receiving to gather after starting command, obtains target data; Particularly, collector, receiving after collection starting command, starts a scheduling thread not exiting, and by this scheduling thread charge of overseeing acquisition state, and initiates concrete collecting work according to the acquisition parameter gathering in starting command.
S206: collector carries out preliminary treatment to target data, obtains feedback data, wherein, the concrete preprocess method adopting for the target data of heterogeneity attribute can be not identical.
S208: collector feeds back to server by feedback data and stores.
After the collection starting command that the collecting method of the embodiment of the present invention passes through to initiate at server, by collector, target device is carried out to data acquisition, and the target data collecting is carried out feeding back to server after preliminary treatment again, this kind carries out pretreated mode by collector to target data, directly use the processing core of collector, avoid taking thread CPU and the memory source of server S erver, reduce the data processing pressure of server, solve the problem that collecting method in prior art easily causes webserver stability decreases, and then reach the effect that improves server stability.
Further, in the data acquisition system being formed by server and collector, next station server correspondence of ordinary circumstance many collectors, and wherein, the acquisition method that each collector all provides with the above embodiment of the present invention the acquisition method of its monitoring objective equipment is identical.Further introduce in detail below the collecting method of the embodiment of the present invention as an example of two collectors (the first collector and the second collector) example:
Particularly, when server issues after collection scheduling starting command to the first collector and the second collector, the first collector and the second collector all can start a scheduling thread not exiting, the so-called scheduling thread not exiting is the acquisition state in order to monitor collector, and included acquisition parameter reaches while gathering the moment in collection scheduling starting command, scheduling thread can be initiated gatherer process, take the first collector as example, the first collector starts the first scheduling thread after receiving and gathering starting command, in the time that the first scheduling thread need to carry out data acquisition, from collecting thread pond, obtain collecting thread resource, so-called collecting thread resource refers to Simple Network Management Protocol (the Simple NetworkManagement Protocol of Chi Huahou, be called for short SNMP) collecting thread resource, limited just because of Internet resources, so in the time that the scheduling thread of multiple collectors is initiated data acquisition simultaneously, or cause the SNMP request of simultaneously initiating too much, cause network congestion, so need to limit the access to netwoks resource of collector Collector end, the mode of taking is that collecting thread resource is carried out to pond, each collecting thread is controlled to the access of network, basic guarantee the network access quantity of Collector.In the time that the first scheduling thread need to be initiated once new collection, first go to apply in collecting thread pond collecting thread resource, if in pond, do not had surplus resources time, scheduling thread and the collector corresponding to this thread of initiating data acquisition just need to wait for, if there is resource in thread pool, the first collector carries out data acquisition to target device after getting collecting thread resource.Certainly, in the time that the first scheduling thread completes its data acquisition, need the collecting thread resource getting to put back in collecting thread pond, this time second, scheduling thread (was supposed to start after the second scheduling thread after the second collector receives collection starting command, in the time that the second scheduling thread carries out data acquisition request, need to wait until) just can obtain the collecting thread resource of returning in pond, thus initiate a new gatherer process.
Each collector complete the collection to target device separately and to the preliminary treatment of data after, in the process that feedback data is fed back to server, also comprise to the process of server request transfer of data thread, particularly, still take the first collector as example, when completing data preliminary treatment, the first collector obtains after the first feedback data, the first collector first can send-thread request instruction to server, server is sent to the first collector by the pid information of idle transfer of data thread receiving after thread request instruction, the first collector obtains obtaining transfer of data thread after the feedback information of coming, finally by this transfer of data thread, the first feedback data is sent in server and is stored, and for this side of server, owing to being that to avoid DB database connection violations to cause to the ready-made generation of DB database transmissions data congested in the time carrying out data storage, server S erver holds the memory channel thread pool of DB database, in the time carrying out data storage, reasonably adjust passage number and DB connection pool number, accomplish DB connection pool of a passage, the message that each delivery is come can have a set of thread to be connected to come independent process with DB.So, when server receives after feedback data by certain transfer of data thread, can feedback data be stored to DB database by the DB passage corresponding with this transfer of data thread, wherein, the communication schematic diagram that carries out data storage between collector and server is shown in Figure 3.
Further, when each collector is during all to server feedback feedback data, now between each collector, can carry out the comparison of a data priority, then determine that according to the priority orders comparing collector corresponding to data that priority is high is first to server send-thread request instruction, finally taking turns to collector corresponding to data that priority is low to server send-thread request instruction.Wherein, can carry out by the Cos mark of the target data of each collector of comparison the priority of comparison feedback data, what Cos mark mainly solved is real-time performance collection and historical performance collection, the regulatory requirement that each performance index are brought gathering requirement of real time difference.For example real-time performance collection requires to need to process in real time, has higher delivery priority, can not have influence on the smooth degree of the page of user's real time inspection when generation is congested.And historical performance only can do background process, representing to user's page effect is not real-time change, occurring in congested not bring a little etc. bad user to experience, so can stamp lower priority to historical performance yet.The acquisition index of for example cpu busy percentage and concurrent number type, change very fast, must have processing speed faster, can stamp higher priority tag, and network transmission speed some values like this, the long point of timing statistics or short point, do not affect last analysis result, when checking historical performance, the few some relation of many points is little, and post-processed still can be filled, such data just can be stamped lower priority tag.Collector can conclude initial data in different processing queue according to priority tag, the state returning at Server be available free in, preferentially deliver the initial data of piling up in the queue that priority is high.
Further, in the time that target data is carried out to preliminary treatment, because different performance numbers has different features, need to carry out different operation rules to every kind of data type, in the collecting method providing in the embodiment of the present invention, the pretreatment mode of target data is comprised:
1, residual quantity computing: equipment side typically uses a counter and adds up a cumulant when processing example is as data such as speed, bag numbers, in performance collection process, this cumulative amount itself is nonsensical, and its needs and the last Counter Value collecting carries out a difference computing and just can calculate and between this twice collection, have how many flows or bag number.Such calculating process need to carry out data buffer storage.Collector supports the buffer memory of last round of image data, only need to specify the type of acquisition index is residual quantity, just can become by the own preliminary treatment of Collector the data of twice residual quantity, avoid just calculating by DB operation frequently the value needing at Server end.
2, percentage computing: in the time that processing CPU, memory usage etc. finally need to form the performance data of percent value, need to carry out repeatedly arithmetical operation to the multiple values that collect could be meaningful.Collector is supported in same multiple collection values of taking turns in collection and carries out combinatorial operation, thereby calculates a percent value.Avoid Server end to operate and just can calculate the value needing by DB.
3, total amount computing: some performance index need to be carried out webmaster side and added and add up, for example concurrent number statistics.This just need to sum up computing by the data in a period of time before, such calculating process is also to carry out data buffer storage, Collector supports to keep a counter, only need to specify acquisition index type is total amount computing, just can use this counter to carry out accumulating operation, avoid just calculating by DB operation frequently the value needing at Server end.
While depositing in DB database due to data, the throughput of disk storage is relevant with the hardware configuration of building whole system, and the cost that this disk storage throughput is provided is very high, under the exigent prerequisite of cost control, it is directly related that the throughput of disk storage is actually the relatively more fixing hardware bus type with selecting, and is the processing speed that is difficult to CPU and the internal memory of catching up with server and collector certainly.This just caused one unbalanced, CPU processes very fast, processing a lot of initial data that are over, but waiting for the IO of disk always, cause the initial data of handling to deposit to enter DB, cause the accumulation of internal memory, longer when this process duration, pile up the destabilizing factor of just having brought system when overabundance of data.The collecting method of the embodiment of the present invention is by the data that collect are carried out to preliminary treatment, and is uploaded to successively server by prioritization, realized the speed of the disk storage of neither can slowing down, and can avoid again mass data all to block up on upper DB memory channel.Wherein, while not adopting the collecting method of the embodiment of the present invention, in data acquisition system, the order of the processing speed of each component units is as shown in table 1, and while adopting the collecting method of the embodiment of the present invention, the order of the processing speed of each unit is as shown in table 2:
Table 1
Table 2
Find through contrast, due to the controlled distribution of resource from Server end, hold the message stores of powerful file-type to Collector, arriving the delivery thread of Collector based on Cos, be all with how solving data rate memory control peak efficiency, and the resources occupation rate of Server is minimum again, while adopting the collecting method of the embodiment of the present invention, the treatable thing of Collector is more, the utilization of resources is also more reasonable, and Server side is controlled because of resource, and stability is also improved.
Further, in the collecting method of the embodiment of the present invention, if if collector Collector runs into the situation generation that server S erver end thread resources uses in delivery process, can cause delivering unsuccessfully, at this moment collector can be put message in preferential delivery queue, preferentially delivers these message in application in Server end thread resources.Because data acquisition amount in existing network environment is a curve of cyclical fluctuations, data peak period mechanism evening 6 between 1:00 AM, and data volume sharply declines after 1:00 AM, touch the bottom in 3:00 AM left and right, then data volume can progressively be gone up, the fluctuation of such data volume is regular, and surfing the Net to user, to concentrate on this time period be relevant to custom.And such trend analysis data do not need to reflect in real time, often such data are to use as a week month annual data excavation, so such data guarantee that can preserve into database within the cycle of one day is all acceptable.Collecting method based on this principle embodiment of the present invention also comprises time delay preservation step, in the time data being carried out to time delay preservation, require the data-message self collecting must carry acquisition time label, and guarantee that this data-message deposits the correctness that does not affect data time attribute at any time in, carry out the data buffer storage of Collector end in data peak period, guarantee that each collection point can both collect data, but immediately do not deposit database in, guarantee the reasonable use in data peak period Server end resource, and process these heap volume data in the data low ebb phase.Guarantee the integrality of image data, can promote again in existing network environment the stability of whole server when Server is in the face of big data quantity.
The embodiment of the present invention also provides a kind of data acquisition unit, the collecting method that this data acquisition unit can provide for carrying out embodiment of the present invention foregoing, below data acquisition unit that the embodiment of the present invention is provided be specifically introduced:
Fig. 4 is according to the schematic diagram of the data acquisition unit of the embodiment of the present invention, and as shown in Figure 4, the data acquisition unit of this embodiment comprises: receiving element 10, collecting unit 20, processing unit 30 and feedback unit 40.
Particularly, receiving element 10 for receiving the collection starting command from server in the time that collection scheduling work starts.
Collecting unit 20, for target device being carried out to data acquisition receiving to gather after starting command, obtains target data; Particularly, collecting unit, receiving after collection starting command, starts a scheduling thread not exiting, and by this scheduling thread charge of overseeing acquisition state, and initiates concrete collecting work according to the acquisition parameter gathering in starting command.
After the collection starting command that the data acquisition unit of the embodiment of the present invention passes through to initiate at server, by collector, target device is carried out to data acquisition, and the target data collecting is carried out feeding back to server after preliminary treatment again, this kind carries out pretreated mode by collector to target data, directly use the processing core of collector, avoid taking thread CPU and the memory source of server S erver, reduce the data processing pressure of server, solve the problem that collecting method in prior art easily causes webserver stability decreases, and then reach the effect that improves server stability.
In addition, the embodiment of the present invention also provides a kind of data acquisition system, particularly, as shown in Figure 5, this data acquisition system can be the system of the collecting method that provides of any employing embodiment of the present invention foregoing, also can be any system with the data acquisition that embodiment of the present invention foregoing provides, meanwhile, the data acquisition system of this embodiment also comprises server.
From above description, can find out, the present invention has realized the processing core that makes full use of collector, avoid the thread CPU and the memory source that take server S erver that when mass data is processed, cause, reduce the data processing pressure of server, solve collecting method in prior art and easily caused the problem of webserver stability decreases, and then reached the effect that improves server stability.
It should be noted that, can in the computer system such as one group of computer executable instructions, carry out in the step shown in the flow chart of accompanying drawing, and, although there is shown logical order in flow process, but in some cases, can carry out shown or described step with the order being different from herein.
Obviously, those skilled in the art should be understood that, above-mentioned of the present invention each module or each step can realize with general calculation element, they can concentrate on single calculation element, or be distributed on the network that multiple calculation elements form, alternatively, they can be realized with the executable program code of calculation element, thereby, they can be stored in storage device and be carried out by calculation element, or they are made into respectively to each integrated circuit modules, or the multiple modules in them or step are made into single integrated circuit module to be realized.Like this, the present invention is not restricted to any specific hardware and software combination.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any modification of doing, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.
Claims (10)
1. a collecting method, is characterized in that, comprising:
Collector receives the collection starting command from server;
Described collector carries out data acquisition to target device receiving after described collection starting command, obtains target data;
Described collector carries out preliminary treatment to described target data, obtains feedback data; And
Described collector feeds back to described server by described feedback data and stores.
2. collecting method according to claim 1, is characterized in that, described collector comprises multiple collectors, and described collector feeds back to described server by described feedback data and stores and comprise:
The first collector send-thread request instruction is to described server, wherein, described server receives the feedback data from described multiple collectors by different transfer of data threads, described server is also for feeding back idle data transmission thread to described the first collector receiving after described thread request instruction, described the first collector is the arbitrary collector in described multiple collector; And
Described the first collector is sent to described server by first data transmission thread by the first feedback data and stores, wherein, described the first feedback data is that described the first collector carries out the feedback data obtaining after preliminary treatment to the target data collecting, the idle data transmission thread that described first data transmission thread is described server feedback.
3. collecting method according to claim 2, is characterized in that, after described the first collector is sent to described server by first data transmission thread by the first feedback data, described collecting method also comprises:
Described server receives described the first feedback data by described first data transmission thread; And
Described server is stored to described database by a DB passage by described the first feedback data, wherein, described server is also stored to described database for the DB passage by different by described the first feedback data, and a described DB passage is the DB passage corresponding with described first data transmission thread.
4. collecting method according to claim 2, is characterized in that, at described the first collector send-thread request instruction, to before described server, described collecting method also comprises:
The relatively priority of the feedback data of each collector; And
The order that definite described each collector sends described thread request instruction is corresponding with the priority orders comparing.
5. collecting method according to claim 4, is characterized in that, the COS mark of the target data by relatively described each collector carrys out the priority of more described feedback data.
6. collecting method according to claim 1, it is characterized in that, described collector comprises multiple collectors, after described collector receives the collection starting command from described server, and before described collector carries out data acquisition to target device, described collecting method also comprises:
The first collector starts the first scheduling thread, and wherein, described the first collector is the arbitrary collector in described multiple collector; And
In the time that described the first scheduling thread carries out data acquisition, from collecting thread pond, obtain collecting thread resource, wherein, the SNMP collecting thread resource that described collecting thread pond is Chi Huahou,
Wherein, after getting described collecting thread resource, described target device is carried out to data acquisition.
7. collecting method according to claim 1, is characterized in that, described preliminary treatment comprise in following processing mode any one or multiple:
Residual quantity computing, percentage computing and total amount computing.
8. collecting method according to claim 1, is characterized in that, described collecting method also comprises:
Described collector receives the parameter modification order from described server; And
Described collector upgrades acquisition parameter according to described parameter modification order after current data collection finishes.
9. a data acquisition unit, is characterized in that, comprising:
Receiving element, for receiving the collection starting command from described server;
Collecting unit, for target device being carried out to data acquisition receiving after described collection starting command, obtains target data;
Processing unit, for described target data is carried out to preliminary treatment, obtains feedback data; And
Feedback unit, stores for described feedback data is fed back to described server.
10. a data acquisition system, is characterized in that, comprising:
Server; And
Data acquisition unit, wherein, described data acquisition unit is the data acquisition unit described in claim 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210431036.6A CN103795647A (en) | 2012-11-01 | 2012-11-01 | Data acquisition method, data collector and data acquisition system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210431036.6A CN103795647A (en) | 2012-11-01 | 2012-11-01 | Data acquisition method, data collector and data acquisition system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103795647A true CN103795647A (en) | 2014-05-14 |
Family
ID=50670952
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210431036.6A Pending CN103795647A (en) | 2012-11-01 | 2012-11-01 | Data acquisition method, data collector and data acquisition system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103795647A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105488983A (en) * | 2015-12-11 | 2016-04-13 | 芜湖乐锐思信息咨询有限公司 | Industrial product information data feedback system |
| CN105721564A (en) * | 2016-01-29 | 2016-06-29 | 广州能迪能源科技股份有限公司 | Data acquisition method and system based on industrial Internet of things |
| CN105978710A (en) * | 2016-04-27 | 2016-09-28 | 上海斐讯数据通信技术有限公司 | Data storage method and system thereof |
| CN106444579A (en) * | 2016-10-09 | 2017-02-22 | 鼎点视讯科技有限公司 | Spectrum data multiplexing system and method |
| CN109215327A (en) * | 2018-08-17 | 2019-01-15 | 宁波三星医疗电气股份有限公司 | A kind of metering method of electric power acquisition terminal |
| CN109639667A (en) * | 2018-12-07 | 2019-04-16 | 上海明牛云科技有限公司 | Data acquisition and transmission method, device and equipment based on local data parsing |
| CN110769403A (en) * | 2019-09-16 | 2020-02-07 | 惠州高盛达科技有限公司 | Intelligent Bluetooth pen control method, system and storage medium |
| CN114338481A (en) * | 2022-02-24 | 2022-04-12 | 重庆伏特猫科技有限公司 | Terminal equipment data acquisition system based on Netty framework |
| CN114815707A (en) * | 2022-05-17 | 2022-07-29 | 重庆伏特猫科技有限公司 | Intelligent device control method and system based on Netty network framework |
Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1326162A (en) * | 2000-05-30 | 2001-12-12 | 松下电器产业株式会社 | Data collecting apparatus and method |
| CN101001290A (en) * | 2006-01-09 | 2007-07-18 | 杭州世导科技有限公司 | System for multi-media integrated accessing |
| CN101090340A (en) * | 2007-06-29 | 2007-12-19 | 华为技术有限公司 | System, method and device for alarm information buffer |
| CN101118655A (en) * | 2007-07-31 | 2008-02-06 | 惠州市新天健服装有限公司 | Data acquisition based on radio frequency card and processing equipment, and method thereof |
| CN101145945A (en) * | 2007-08-29 | 2008-03-19 | 中兴通讯股份有限公司 | A message bus system and control method in telecommunication network management |
| CN101345652A (en) * | 2008-08-15 | 2009-01-14 | 北京立通无限科技有限公司 | Data acquisition method and data acquisition equipment |
| CN101350834A (en) * | 2008-07-21 | 2009-01-21 | 深圳市高正软件有限公司 | Information acquisition system capable of asynchronously implementing information acquisition and information transmission |
| CN101873005A (en) * | 2010-06-17 | 2010-10-27 | 深圳市科陆电子科技股份有限公司 | Method for realizing balanced acquisition of electric energy |
| CN101916507A (en) * | 2010-08-10 | 2010-12-15 | 广东省建筑科学研究院 | Bridge health monitoring system |
| CN101981955A (en) * | 2008-04-04 | 2011-02-23 | 三星电子株式会社 | Method and apparatus for managing tokens for digital rights management |
| CN102063083A (en) * | 2010-11-29 | 2011-05-18 | 浙江大学 | Multi-ECU (Electronic Control Unit) time-shared downloading method |
| CN202058147U (en) * | 2011-05-23 | 2011-11-30 | 北京六所和瑞科技发展有限公司 | Distribution type real-time database management system |
| CN102435922A (en) * | 2011-10-26 | 2012-05-02 | 上海交通大学 | Acoustic-electric combined detection system and positioning method for GIS (Gas Insulated Switchgear) local discharge |
| CN102480749A (en) * | 2010-11-25 | 2012-05-30 | 中国移动通信集团浙江有限公司 | Method, device and system for remotely collecting host process information |
| CN202385116U (en) * | 2011-12-31 | 2012-08-15 | 成都勤智数码科技股份有限公司 | Distributed operation and maintenance data acquisition device |
| CN102752131A (en) * | 2012-06-04 | 2012-10-24 | 国网电力科学研究院 | Task-driven based power telecommunication network data acquisition method |
-
2012
- 2012-11-01 CN CN201210431036.6A patent/CN103795647A/en active Pending
Patent Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1326162A (en) * | 2000-05-30 | 2001-12-12 | 松下电器产业株式会社 | Data collecting apparatus and method |
| CN101001290A (en) * | 2006-01-09 | 2007-07-18 | 杭州世导科技有限公司 | System for multi-media integrated accessing |
| CN101090340A (en) * | 2007-06-29 | 2007-12-19 | 华为技术有限公司 | System, method and device for alarm information buffer |
| CN101118655A (en) * | 2007-07-31 | 2008-02-06 | 惠州市新天健服装有限公司 | Data acquisition based on radio frequency card and processing equipment, and method thereof |
| CN101145945A (en) * | 2007-08-29 | 2008-03-19 | 中兴通讯股份有限公司 | A message bus system and control method in telecommunication network management |
| CN101981955A (en) * | 2008-04-04 | 2011-02-23 | 三星电子株式会社 | Method and apparatus for managing tokens for digital rights management |
| CN101350834A (en) * | 2008-07-21 | 2009-01-21 | 深圳市高正软件有限公司 | Information acquisition system capable of asynchronously implementing information acquisition and information transmission |
| CN101345652A (en) * | 2008-08-15 | 2009-01-14 | 北京立通无限科技有限公司 | Data acquisition method and data acquisition equipment |
| CN101873005A (en) * | 2010-06-17 | 2010-10-27 | 深圳市科陆电子科技股份有限公司 | Method for realizing balanced acquisition of electric energy |
| CN101916507A (en) * | 2010-08-10 | 2010-12-15 | 广东省建筑科学研究院 | Bridge health monitoring system |
| CN102480749A (en) * | 2010-11-25 | 2012-05-30 | 中国移动通信集团浙江有限公司 | Method, device and system for remotely collecting host process information |
| CN102063083A (en) * | 2010-11-29 | 2011-05-18 | 浙江大学 | Multi-ECU (Electronic Control Unit) time-shared downloading method |
| CN202058147U (en) * | 2011-05-23 | 2011-11-30 | 北京六所和瑞科技发展有限公司 | Distribution type real-time database management system |
| CN102435922A (en) * | 2011-10-26 | 2012-05-02 | 上海交通大学 | Acoustic-electric combined detection system and positioning method for GIS (Gas Insulated Switchgear) local discharge |
| CN202385116U (en) * | 2011-12-31 | 2012-08-15 | 成都勤智数码科技股份有限公司 | Distributed operation and maintenance data acquisition device |
| CN102752131A (en) * | 2012-06-04 | 2012-10-24 | 国网电力科学研究院 | Task-driven based power telecommunication network data acquisition method |
Non-Patent Citations (2)
| Title |
|---|
| 张兴国等: ""地震前兆数据多线程采集与多目标入库应用研究"", 《大地测量与地球动力学》 * |
| 王金伟: ""分布式数据采集与监测系统的设计_实现及应用"", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105488983A (en) * | 2015-12-11 | 2016-04-13 | 芜湖乐锐思信息咨询有限公司 | Industrial product information data feedback system |
| CN105721564A (en) * | 2016-01-29 | 2016-06-29 | 广州能迪能源科技股份有限公司 | Data acquisition method and system based on industrial Internet of things |
| CN105978710A (en) * | 2016-04-27 | 2016-09-28 | 上海斐讯数据通信技术有限公司 | Data storage method and system thereof |
| CN106444579A (en) * | 2016-10-09 | 2017-02-22 | 鼎点视讯科技有限公司 | Spectrum data multiplexing system and method |
| CN106444579B (en) * | 2016-10-09 | 2019-01-25 | 鼎点视讯科技有限公司 | A kind of frequency spectrum data multiplex system and method |
| CN109215327A (en) * | 2018-08-17 | 2019-01-15 | 宁波三星医疗电气股份有限公司 | A kind of metering method of electric power acquisition terminal |
| CN109215327B (en) * | 2018-08-17 | 2021-02-02 | 宁波三星医疗电气股份有限公司 | Metering method of power acquisition terminal |
| CN109639667A (en) * | 2018-12-07 | 2019-04-16 | 上海明牛云科技有限公司 | Data acquisition and transmission method, device and equipment based on local data parsing |
| CN110769403A (en) * | 2019-09-16 | 2020-02-07 | 惠州高盛达科技有限公司 | Intelligent Bluetooth pen control method, system and storage medium |
| CN114338481A (en) * | 2022-02-24 | 2022-04-12 | 重庆伏特猫科技有限公司 | Terminal equipment data acquisition system based on Netty framework |
| CN114338481B (en) * | 2022-02-24 | 2022-11-15 | 重庆伏特猫科技有限公司 | Terminal equipment data acquisition system based on Netty framework |
| CN114815707A (en) * | 2022-05-17 | 2022-07-29 | 重庆伏特猫科技有限公司 | Intelligent device control method and system based on Netty network framework |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103795647A (en) | Data acquisition method, data collector and data acquisition system | |
| CN112162865B (en) | Scheduling method and device of server and server | |
| US8898172B2 (en) | Parallel generation of topics from documents | |
| CN110908788B (en) | Spark Streaming based data processing method and device, computer equipment and storage medium | |
| CN103152393B (en) | A kind of charging method of cloud computing and charge system | |
| CN103561354B (en) | Method and device for calculating and processing video smoothness | |
| CN108845878A (en) | The big data processing method and processing device calculated based on serverless backup | |
| TW201539326A (en) | Method and device for augmenting and releasing computing resources used in real-time stream computing | |
| CN104092756A (en) | Cloud storage system resource dynamic allocation method based on DHT mechanism | |
| CN104158699B (en) | A kind of collecting method based on priority and segmentation | |
| US8868855B2 (en) | Request management system and method for dynamically managing prioritized requests | |
| CN103561055B (en) | Web application automatic elastic extended method under conversation-based cloud computing environment | |
| WO2017107456A1 (en) | Method and apparatus for determining resources consumed by task | |
| CN104021040A (en) | Cloud computing associated task scheduling method and device based on time constraint | |
| CN103685309A (en) | Asynchronous request queue model oriented to map visualization tile service | |
| CN106130960B (en) | Judgement system, load dispatching method and the device of steal-number behavior | |
| CN109684078A (en) | Resource dynamic distributing method and system for spark streaming | |
| Choi et al. | pHPA: A proactive autoscaling framework for microservice chain | |
| CN107180050A (en) | A kind of data grabber system and method | |
| CN112130966A (en) | Task scheduling method and system | |
| CN110020046A (en) | A kind of data grab method and device | |
| CN107493485B (en) | Resource control method and device and IPTV server | |
| CN113568759B (en) | Cloud computing-based big data processing method and system | |
| CN103856558B (en) | A kind of data processing method and device for terminal applies | |
| CN108228323B (en) | Hadoop task scheduling method and device based on data locality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140514 |