CN105847446A - Network data obtaining method, device and system - Google Patents
Network data obtaining method, device and system Download PDFInfo
- Publication number
- CN105847446A CN105847446A CN201610380227.2A CN201610380227A CN105847446A CN 105847446 A CN105847446 A CN 105847446A CN 201610380227 A CN201610380227 A CN 201610380227A CN 105847446 A CN105847446 A CN 105847446A
- Authority
- CN
- China
- Prior art keywords
- plug
- network data
- unit
- configuration file
- parameter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/2866—Architectures; Arrangements
- H04L67/30—Profiles
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention discloses a network data obtaining method, device and system. A configuration file is obtained regularly; according to the configuration file, a corresponding dynamic library file is loaded, and a corresponding plug-in function is called; parameters related to the plug-in function is obtained from the configuration file; and the plug-in parameter is executed according to the parameters to obtain network data. According to the invention, realization and update are easy, functions are easy to expand, and resource consumption can be reduced.
Description
Technical field
The present invention relates to communication technical field, be specifically related to a kind of browser page data filtering method, device
And system.
Background technology
Along with the development of Internet technology, it is required each that increasing people selects to obtain oneself by network
The information of kind, including some electron readings, such as e-book, electronic journal or electronics report, etc..So-called electricity
Sub-reading matter, refer to by the digitized publications of message contents such as word, picture, sound and image or non-go out
Version thing.Meanwhile, user obtains electron reading for convenience, and prior art has the most correspondingly been gushed out a collection of
The terminal applies relevant to reading, is called for short and reads application.
User by read application obtain data, can be generally divided into user related data and user without
Closing data, so-called user related data, refer to the individuation data of user, such as, the VIP of user is (expensive
Guest, very important people) grade, service content ordered by user, the bookmark of user and
The collection etc. of user, and user's extraneous data, refer to the data that all users can be public, such as certain
Illustration on a little configuration information of read interface, the pages and the particular content etc. of electron reading.Existing
In technology, general, read the service end belonging to application and all can use the finger daemon (daemon) of timing
The mode pulled obtains user's extraneous data in batches, and is processed this user's extraneous data, then deposits
Storage is in this locality, and so, when each user accesses, service end has only to call user-dependent interface, to obtain
Take corresponding user related data, and for user's extraneous data, just can obtain from this locality, thus
Avoid in real-time request, call too much external interface, decrease the time-consuming of request and to outside
The dependence of interface.
To in the research of prior art and practice process, it was found by the inventors of the present invention that due to modules
Diversity, in existing scheme, need independently to write corresponding finger daemon for each module, if
New module is had to add or function is updated, in addition it is also necessary to re-start programming and integrate, the most existing scheme
Use the mode of hard coded, it is achieved and update the most complex, it is difficult to carry out functions expanding, Er Qielang
Take resource.
Summary of the invention
The embodiment of the present invention provides the acquisition methods of a kind of network data, device and system, not only realizes and more
The most relatively simple, it is easy to carry out Function Extension, and the consumption of resource can be reduced.
The embodiment of the present invention provides the acquisition methods of a kind of network data, including:
Timing acquisition configuration file；
Load corresponding dynamic library file according to described configuration file, and call corresponding plug-in unit function；
The parameter with described plug-in unit functional dependence is obtained from described configuration file；
Described plug-in unit function is performed, to obtain network data according to described parameter.
Accordingly, the embodiment of the present invention also provides for the acquisition device of a kind of network data, including:
File obtaining unit, for timing acquisition configuration file；
Call unit, for loading corresponding dynamic library file according to described configuration file, and calls corresponding
Plug-in unit function；
Parameter acquiring unit, for obtaining the parameter with described plug-in unit functional dependence from described configuration file；
Performance element, for performing described plug-in unit function according to described parameter, to obtain network data.
Additionally, the embodiment of the present invention also provides for the acquisition system of a kind of network data, including the embodiment of the present invention
The acquisition device of any one network data provided.
The embodiment of the present invention uses timing acquisition configuration file, loads corresponding dynamic base according to this configuration file
File, and call corresponding plug-in unit function, and obtain from this configuration file and this plug-in unit functional dependence
Parameter, then, performs this plug-in unit function according to these parameters, to obtain network data；Owing to the program can
So that some logic processing operations during network data will be being obtained with dynamic library file and plug-in unit function
Mode embodies, therefore, for some basic logic functions that disparate modules is total, such as user's extraneous data
Acquisition etc., only need to share same dynamic library file and plug-in unit function, and without the most single for each module
Solely write a set of corresponding complete code, not only realize the simplest, and also allow for being updated and function
Extension, such as, when carrying out functions expanding, only need to be absorbed in the logic development of this expanding function, and without
Pay close attention to its basic logic function, etc., substantially increase its motility；Further, due to can be by reality
The code of existing identical function is shared, so, it is possible to reduce a large amount of codes repeated, reduce disappearing of resource
Consumption.
Accompanying drawing explanation
For the technical scheme being illustrated more clearly that in the embodiment of the present invention, institute in embodiment being described below
The accompanying drawing used is needed to be briefly described, it should be apparent that, the accompanying drawing in describing below is only the present invention
Some embodiments, for those skilled in the art, on the premise of not paying creative work, also
Other accompanying drawing can be obtained according to these accompanying drawings.
Fig. 1 a is the scene schematic diagram of the acquisition methods of the network data that the embodiment of the present invention provides；
Fig. 1 b is the flow chart of the acquisition methods of the network data that the embodiment of the present invention provides；
Fig. 2 is another flow chart of the acquisition methods of the network data that the embodiment of the present invention provides；
Fig. 3 a is the structural representation of the acquisition device of the network data that the embodiment of the present invention provides；
Fig. 3 b is another structural representation of the acquisition device of the network data that the embodiment of the present invention provides；
Fig. 4 is the structural representation of the server that the embodiment of the present invention provides.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clearly
Chu, be fully described by, it is clear that described embodiment be only a part of embodiment of the present invention rather than
Whole embodiments.Based on the embodiment in the present invention, those skilled in the art are not making creative labor
The every other embodiment obtained under dynamic premise, broadly falls into the scope of protection of the invention.
The embodiment of the present invention provides the acquisition methods of a kind of network data, device and system.
Wherein, the acquisition system of this network data can include any one network that the embodiment of the present invention is provided
The acquisition device of data, the acquisition device of this network data specifically can integrated in the server, additionally, should
The acquisition system of network data can also include other equipment, such as terminal, and this terminal is mainly used in receiving
The network data that server sends.
For example, with reference to Fig. 1 a, this server can load according to this configuration file with timing acquisition configuration file
Corresponding dynamic library file, such as so file, and call corresponding plug-in unit function, and from this configuration file
Middle acquisition and the parameter of this plug-in unit functional dependence, then, perform this plug-in unit function according to these parameters, to obtain
Take network data；Such as, these parameters can be added in order to parameter list, then, should
Parameter in parameter list sequentially inputs to described plug-in unit function, performs have input the plug-in unit function of parameter,
To call corresponding external interface, and by this external interface from server pull raw network data, to former
Beginning network data carries out data mart modeling, obtains network data, etc.；Hereafter, need to obtain this net when terminal
Network data, such as, when server receives the data acquisition request that terminal sends, it is possible to by obtain
Network data is supplied to terminal.
It is described in detail individually below.It should be noted that, the sequence number of following example is not as to embodiment
The restriction of preferred sequence.
Embodiment one,
The present embodiment will be described from the angle of the acquisition device of network data, the acquisition dress of this network data
Put and specifically can be integrated in server, such as application server.
A kind of acquisition methods of network data, including: timing acquisition configuration file；Add according to this configuration file
Carry corresponding dynamic library file, and call corresponding plug-in unit function；Obtain from this configuration file and insert with this
The parameter of part functional dependence；This plug-in unit function is performed, to obtain network data according to this parameter.
As shown in Figure 1 b, the idiographic flow of the acquisition methods of this network data can be such that
101, timing acquisition configuration file.
Such as, an acquisition cycle specifically can be set, then according to this cycle timing acquisition configuration file.Its
In, this cycle can be configured according to the demand of reality application, such as, can arrange every 30 seconds and obtain one
Secondary, or obtained once every 20 seconds, etc..
Wherein, depending on the form of this configuration file can be according to the demand of reality application, such as, can be html
Or the form such as xml, etc..For convenience, in embodiments of the present invention, all have with this configuration file
Body is to illustrate as a example by xml form.
Wherein, when obtaining configuration file, can be from other equipment, such as management server or storage service
Obtaining this configuration file in device, it is also possible in advance this configuration file is carried in this locality, obtaining from this locality should
Configuration file, i.e. before step " timing acquisition configuration file ", the acquisition methods of this network data also may be used
To include:
Determine when current operating environment meets pre-conditioned, loading configuration file.
Wherein, current operating environment can include running temporal information and/or the status information of each software and hardware
Deng, this is pre-conditioned, can according to reality application demand be configured, such as, can arrange every
In certain cycle, just load once this configuration file；The most such as, it is also possible to arrange when certain process is in certain
During state, then load this configuration file, etc., do not repeat them here.
Optionally, in order to save signaling process, it is provided that treatment effeciency, when loading configuration file, it is also possible to
Judging whether this configuration file there occurs change, if there occurs change, just re-starting loading, and if do not had
There is transmission change, then can continue to use the configuration file of last loading.
Wherein, it is judged that whether this configuration file there occurs that the mode of change can have multiple, except can be direct
Outside current configuration file is compared with the last configuration file loaded, it is also possible to pass through configuration file
Modification time judge, i.e. after step " loading configuration file ", the acquisition of this network data
Method can also include:
When modification time when determining the last modification time of configuration file and last loading is inconsistent, again
Load this configuration file.
Otherwise, however, it is determined that the last modification time of configuration file is consistent with modification time during last loading,
Then showing that the configuration file loaded does not changes, this configuration file loaded is the most up-to-date
Version, can be continuing with.
Such as, specifically can be by reading the file status information of configuration file, such as stat (file status)
Information, determines whether are the current last modification time of this configuration file and last modification time when loading
Unanimously, etc..
102, load corresponding dynamic library file according to this configuration file, and call corresponding plug-in unit function；
Such as, specifically can be such that
Read finger daemon (such as daemon) task in this configuration file, be currently needed for holding to determine
The finger daemon task of row, loads corresponding dynamically library text according to this finger daemon task being currently needed for performing
Part, and call corresponding plug-in unit function.
Such as, can be currently needed for the finger daemon task performed obtaining corresponding dynamic library file from this
Mark and the mark of plug-in unit function, call corresponding dynamic library file according to the mark of this dynamic library file, and
Loading this dynamic library file, such as so file, then, according to the mark of this plug-in unit function from this dynamic library text
Part calls corresponding plug-in unit function, etc..
Wherein, finger daemon is a kind of to operate in the special process on backstage, and it is independent of controlling terminal also
And periodically perform certain task or etc. some event pending.
Wherein, the mark of dynamic library file can include that title or the numbering etc. of dynamic library file can identify
The information of this dynamic library file；The mark of plug-in unit function then can include title or the numbering etc. of plug-in unit function
The information of this plug-in unit function can be identified.
Such as, it is specially the title of dynamic library file with the mark of dynamic library file, the mark tool of plug-in unit function
As a example by body is the title of plug-in unit function, if the content of configuration file is as follows:
Wherein, what handler node represented is a plug-in unit function, concrete in the example of above-mentioned configuration file
Refer to the GetColumnBook function (i.e. that libdaemon.so storehouse (i.e. one dynamic library file) is inner
Individual plug-in unit function).And task node represents is finger daemon (daemon) tasks that perform of needs.
Then, after the acquisition device of this network data reads this task record, will find entitled
The handler of " getcolumnbook ", then, loads corresponding dynamic library file according to information therein,
I.e. load " libdaemon.so ", and call corresponding plug-in unit function, i.e. call " GetColumnBook.
It should be noted that, owing to finger daemon execution number of times is less, it is impossible to adjusted by mould and offer monitoring execution feelings
Condition, therefore, once process dies or access external interface failure, then easily because cannot process in time and
Cause the ageing problem of outer network data, so, in order to avoid due to cannot find in time process dies or
The ageing problem of the outer network data accessing external interface failure and cause, optionally, can trigger every time
During the logical process entrance of finger daemon (such as before obtaining configuration file), all carry out primary characteristic letter
The detection of breath, wherein, the detection of this characteristic information is similar to a heartbeat mechanism, is used for checking finger daemon
Such as the survival condition of daemon process, may determine that whether this finger daemon occurs based on this characteristic information different
Often, if abnormal, then alarm can be sent, in order to notify that related personnel processes in time.I.e., optionally,
The acquisition methods of this network data can also include:
Obtain the characteristic information of logical process entrance of finger daemon, according to this characteristic information determine described in guard
When process occurs abnormal, generate warning information.
Wherein, depending on the form of this characteristic information specifically can be according to the demand of reality application, such as, permissible
The characteristic using numeric type represents (i.e. representing this characteristic information by the height of numerical value), meanwhile,
The warning strategies fallen on a year-on-year basis can be set, if there is under numerical value server (such as network management system) is inner
Fall, then it represents that the ruuning situation of finger daemon occurs abnormal, such as process dies or access external interface loses
Lose, etc., need to send warning information, then at this point it is possible to send warning information to default terminal.
Wherein, warning information transmission channel can include mail, note and/or social platform or IMU
The message etc. of letter platform.
103, from this configuration file, the parameter with this plug-in unit functional dependence is obtained.
Wherein, the data relevant parameter of storage can be included to the parameter of this plug-in unit functional dependence, for distinguishing
Whether this task is parameter and the parameter etc. of instruction type of message of mission critical.Such as, insert with following
As a example by part function:
Then the parameter with this plug-in unit functional dependence can include appid, netid, critical, errmsg and
Va_list etc., wherein, appid with netid is the parameter that data storage is relevant；Critical parameter is used for distinguishing
Whether this task is mission critical；Errmsg is to return message, if function return value is non-zero, then this returns
Letter in reply breath can report with character string type characteristic information；And join grand mode with the change of C language and be indicated
Parameter va_list, then be to process under different business scene, plug-in unit function need parameter type and ginseng
Problem that several numbers are different and be configured.
104, this plug-in unit function is performed according to this parameter, to obtain network data.
Such as, specifically this parameter can be added in order to parameter list, then, according to this parameter
List performs this plug-in unit function, to obtain network data.
Wherein, perform this plug-in unit function according to this parameter list, can have many in the way of obtaining network data
Kind, such as, can be such that
Parameter in this parameter list is sequentially input to this plug-in unit function, perform have input the plug-in unit of parameter
Function, to obtain network data.
Such as, in step 102 as a example by the configuration file of example, then except " type " parameter (" type "
It is to obtain from the attribute of task node), other parameters can the most incoming plug-in unit letter
In number, i.e. can the most incoming " 1 ", " 2477 " and " 20 ".Wherein, the type of parameter can be pre-
Advanced professional etiquette is fixed, such as, can unify as char* type, etc..
Wherein, the parameter in this parameter list is sequentially input to this plug-in unit function, i.e. function parameter stack pop down
The key code (32 machines) of operation specifically can be such that
After parameter is inputted plug-in unit function, the plug-in unit function call that have input parameter just can be utilized corresponding
External interface, then, pull raw network data by this external interface, and to this raw network data
Carry out data mart modeling, obtain network data.
Optionally, ageing in order to avoid the outer network data that causes owing to process exception cannot be found in time
Problem, when data mart modeling failure, it is also possible to alert, i.e. " enters this raw network data in step
Row data mart modeling, obtains network data " after, the acquisition methods of this network data can also include:
If data mart modeling failure, then generate the first failure information, such as generate the first mistake of character string type
Lose information, and alert according to this first failure information.
Such as, if data mart modeling failure, then plug-in unit function can return the numerical value of an instruction mistake, such as
Return a non-zero value (representing correct, as a example by non-zero expression mistake with 0), then now, just can basis
This numerical value judges data mart modeling failure, then generates the first failure information, and according to this first failure
Information alerts, etc..
Optionally, after getting network data, it is also possible to memory space is preset in the write of this network data,
To store, i.e. step " this raw network data is carried out data mart modeling, obtain network data " it
After, the acquisition methods of this network data can also include:
Memory space is preset in the write of this network data.
In like manner, the ageing of outer network data in order to avoid causing owing to cannot find process exception in time is asked
Topic, when writing unsuccessfully, can alert too, the most specifically can be such that
If writing unsuccessfully, then generate the second failure information, such as generate the second of character string type and unsuccessfully carry
Show information, and alert according to this second failure information.
Such as, if writing unsuccessfully, then plug-in unit function can return the numerical value of an instruction mistake, such as returns
One non-zero value (representing correct, as a example by non-zero expression mistake with 0), then now, just can be according to this number
Value is judged to write unsuccessfully, in being by alarm, etc..
Wherein, the mode of alarm can have multiple, such as can be to carry out the forms such as word, sound or picture
Remind, etc..
It should be noted that, when generating the first failure information or the second failure information, it is also possible to
First failure information or the second failure information carry corresponding plugin name and/or function name
Claim, in order to can quickly position and send abnormal position.
From the foregoing, it will be observed that the present embodiment uses timing acquisition configuration file, load corresponding according to this configuration file
Dynamic library file, and call corresponding plug-in unit function, and obtain and this plug-in unit function from this configuration file
Relevant parameter, then, performs this plug-in unit function according to these parameters, to obtain network data；Due to this
Scheme can be by some logic processing operations during obtaining network data with dynamic library file and plug-in unit
The mode of function embodies, therefore, for some basic logic functions that disparate modules is total, as user without
Close the acquisition etc. of data, only need to share same dynamic library file and plug-in unit function, and without for each mould
Block the most individually writes a set of corresponding complete code, not only realizes the simplest, and also allows for being updated
And Function Extension, such as, when carrying out functions expanding, only need to be absorbed in the logic development of this expanding function,
And without paying close attention to its basic logic function, (the new daemon of existing exploitation is required for again developing daemon
Basic logic function, workload repeat), etc., substantially increase its motility；Further, by
In the code realizing identical function being shared, so, it is possible to reduce a large amount of codes repeated, subtract
The consumption of few resource.
Embodiment two,
According to the method described by embodiment one, below citing is described in further detail.
In the present embodiment, electron reading information will be specially with this network data, and the obtaining of this network data
Fetching put the most integrated in the server as a example by illustrate.
As in figure 2 it is shown, the acquisition methods of a kind of network data, idiographic flow can be such that
201, server determines when current operating environment meets pre-conditioned, loading configuration file.
Wherein, current operating environment can include running temporal information and/or the status information of each software and hardware
Deng, this is pre-conditioned, can be configured according to the demand of reality application.
Optionally, in order to save signaling process, it is provided that treatment effeciency, when loading configuration file, it is also possible to
Judging whether this configuration file there occurs change, if there occurs change, just re-starting loading, and if do not had
There is transmission change, then can continue to use the configuration file of last loading, for example, it is possible to as follows:
The file status information of server reading configuration file, such as stat (file status) information, according to
This document status information determines that the last modification time of configuration file with modification time during last loading is
No unanimously if unanimously, then can be continuing with the configuration file of last loading, otherwise, if inconsistent,
Then reload this configuration file.
Optionally, in order to avoid leading owing to process dies cannot be found in time or accesses external interface failure
The ageing problem of the outer network data caused, can trigger the logical process entrance of finger daemon (such as every time
Before obtaining configuration file) time, all carry out the detection of primary characteristic information, such as, specifically can obtain
The characteristic information of the logical process entrance of finger daemon, then in this server, corresponding detection module reports
This characteristic information.
Wherein, this characteristic information reports and is similar to a heartbeat mechanism, be used for checking finger daemon (as
Daemon) based on this characteristic information, survival condition, then, is judged that this finger daemon is by server
No generation is abnormal, if abnormal, then can send alarm, in order to notify that related personnel processes in time.
It should be noted that, this characteristic information report the loading not affecting configuration file, i.e. no matter this guard into
Whether journey there is exception, all can perform step 201.
202, the configuration file that server timing acquisition loads.
Such as, include free books module and ranking list module with this server, and now need to obtain freely
As a example by the associated electrical reading matter information of books module and ranking list module, then corresponding configuration file can be arranged
For:
Wherein, what handler node represented is plug-in unit function, refers specifically in the example of above-mentioned configuration file
It is the GetFreeBook function in libfree.so storehouse, and the GetRankBook letter in librank.so storehouse
Number.And task node represents is finger daemon (daemon) tasks that perform of needs, i.e. need to find
Entitled " getfreebook " and the handler of " getrankbook ", and load corresponding according to information therein
Dynamic library file and plug-in unit function, i.e. load " libfree.so " storehouse and " librank.so " storehouse, and adjust
With " GetRankBook " in " GetFreeBook " function in " libfree.so " storehouse and " librank.so " storehouse
Function.
Wherein, " libfree.so " is used for free books module, and " librank.so " processes for ranking list data.
203, finger daemon (such as daemon) task during server reads this configuration file, to determine
It is currently needed for the finger daemon task performed.
Such as, as a example by the configuration file shown in step 202, then at this point it is possible to determine and be currently needed for
The finger daemon task performed is:
From above-mentioned code, this finger daemon task instruction being currently needed for performing needs to find entitled
The handler of " getfreebook ", and load corresponding dynamic library file and plug-in unit letter according to information therein
Number, i.e. needs to perform " libfree.so " inner function " GetFreeBook ", wherein, this function be for
Pull the electron reading information processed required for free module.
The most such as, if the finger daemon task being currently needed for performing is:
Then from above-mentioned code, this finger daemon task instruction being currently needed for performing needs to find entitled
The handler of " getrankbook ", and load corresponding dynamic library file and plug-in unit letter according to information therein
Number, i.e. needs to perform the function " GetRankBook " that " librank.so " is inner, and wherein, this function is to use
In pulling the electron reading information specifying ranking list and preserving.
204, server loads corresponding dynamic library file according to this finger daemon task being currently needed for performing,
And call corresponding plug-in unit function.
Such as, if in step 203, these finger daemon task instruction needs being currently needed for performing find name
It is referred to as the handler of " getfreebook ", then at this point it is possible to load corresponding according to the information in this handler
Dynamic library file " libfree.so ", find entitled " GetFreeBook " from dynamic library file " libfree.so "
Plug-in unit function.
The most such as, if in step 203, these finger daemon task instruction needs being currently needed for performing find
The handler of entitled " getrankbook ", then at this point it is possible to load phase according to the information in this handler
The dynamic library file " librank.so " answered, finds entitled from dynamic library file " librank.so "
The plug-in unit function of " GetRankBook ".
205, server obtains the parameter with this plug-in unit functional dependence from this configuration file, and by this parameter
Add in order to parameter list.
Such as, if in step 204, the plug-in unit function called is GetFreeBook, then performing plug-in unit letter
Number " GetFreeBook " time, can by this be currently needed for perform finger daemon task " < task
Type=" getfreebook " critical=" true " plat=" 1 " columnid=" 2477 " booknum=" 20 "/> "
In parameters, such as " critical ", " plat ", " columned " and " booknum " etc. this
Several values are added to the parameter list corresponding to plug-in unit function " GetFreeBook " in order as parameter
In.
Wherein, parameter " columned " is the numbering of free books (the most free electron reading) column,
Parameter " booknum " then represents the electron reading quantity needing to pull, such as, booknum=" 20 ",
Represent that the electron reading quantity needing to pull is 20, etc..
The most such as, if in step 204, the plug-in unit function called is " GetRankBook ", then performing
During plug-in unit function " GetRankBook ", can by this be currently needed for perform finger daemon task " < task
Type=" getrankbook " critical=" true " plat=" 1 " rankid=" 2478 " booknum=" 100 "/> " in
Parameters, such as these values such as " critical ", " plat ", " rankid " and " booknum "
Add in order to the parameter list corresponding to function " getrankbook " as parameter.
Wherein, the numbering of the ranking list that parameter " rankid " represents, " booknum " then represents needs
Pull the electron reading of first how many, such as, booknum=" 100 ", represent that needs pull seniority among brothers and sisters for front 100
The electron reading information of name, etc..
206, the parameter in this parameter list is sequentially input to this plug-in unit function and performs by server, with
Obtain electron reading information, be then back to perform step 203.
Such as, be currently needed for perform finger daemon task for " < task type=" getfreebook "
Critical=" true " plat=" 1 " columnid=" 2477 " booknum=" 20 "/> " as a example by, the most now, can
With in the most incoming " 1 ", " 2477 " and " 20 " to plug-in unit function " GetFreeBook " and perform,
Such as, it is possible to use have input the corresponding external interface of plug-in unit function call of parameter, then, outer by this
Portion's interface pulls original electron reading matter information, and this original electron reading matter information is carried out data mart modeling, obtains
Electron reading information.
The most such as, be currently needed for perform finger daemon task for " < task type=" getrankbook "
Critical=" true " plat=" 1 " rankid=" 2478 " booknum=" 100 "/> " as a example by, then at this point it is possible to
The most incoming " 1 ", " 2478 " and " 100 " in plug-in unit function " getrankbook " and perform,
Such as, it is possible to use have input the corresponding external interface of plug-in unit function call of parameter, then, outer by this
Portion's interface pulls original electron reading matter information, and this original electron reading matter information is carried out data mart modeling, obtains
Electron reading information, etc..
Optionally, ageing in order to avoid the outer network data that causes owing to process exception cannot be found in time
Problem, when data mart modeling failure, it is also possible to alert, i.e. " believes this original electron reading matter in step
Breath carries out data mart modeling, obtains electron reading information " after, the acquisition methods of this network data can also wrap
Include:
If data mart modeling failure, then generate the first failure information of character string type, according to this first failure
Information alerts.
Such as, if data mart modeling failure, then plug-in unit function can return the numerical value of an instruction mistake, such as
Return a non-zero value (representing correct, as a example by non-zero expression mistake with 0), then, now, server is just
Data mart modeling failure can be judged according to this numerical value, in being by alarm, etc..
Optionally, after getting electron reading information, it is also possible to the write of this electron reading information is preset
Memory space, to store；In like manner, when writing unsuccessfully, can alert too, i.e. in step
Suddenly after " this original electron reading matter information being carried out data mart modeling, obtain electron reading information ", this network
The acquisition methods of data can also include:
Memory space being preset in the write of this electron reading information, if writing unsuccessfully, then generating the of character string type
Two failure informations, and alert according to this second failure information.
Such as, if writing unsuccessfully, then plug-in unit function can return the numerical value of an instruction mistake, such as returns
One non-zero value (representing correct, as a example by non-zero expression mistake with 0), then, now, server is the most permissible
Judge to write unsuccessfully according to this numerical value, in being by alarm, etc..
It should be noted that, when returning the first failure information or the second failure information, it is also possible to the
One failure information or the second failure information carry corresponding plugin name and/or function name,
Abnormal position is sent can quickly to position.
Additionally, it should be noted that, no matter the implementation status of the plug-in unit function of first finger daemon task is such as
I.e. no matter what, be required for continuing executing with next finger daemon task, the plug-in unit function of first " task "
Whether return represents successful return value, all can continue the execution of the next one " task ", i.e. need return to hold
Row step 203.
Such as, if first finger daemon task is " < task type=" getfreebook " critical=" true "
Plat=" 1 " columnid=" 2477 " booknum=" 20 "/> ", then at this point it is possible to continue executing with second and guard
Process task, will " < task type=" getrankbook " critical=" true " plat=" 1 " rankid=" 2478 "
Booknum=" 100 "/> " as be currently needed for perform finger daemon task, refer to step 203.
It should be noted that, after having performed all of finger daemon task (i.e. task), this server can be stopped
Dormancy awaiting a specified time, then re-executes step 201, and so circulation is repeatedly, such as, in this enforcement
Being 2 task in example, therefore, after having performed the two task, this server can be to be specified with dormancy etc.
Time, re-execute step 201 the most again, in order to perform other task, the like.
It should be noted that, in order to improve treatment effeciency, optionally, it is also possible to open multiple threads pattern,
To improve the ability of parallel processing, multiple thread i.e. can be used, parallel processing multiple finger daemon task,
Wherein, the execution of each finger daemon task is similar with above-mentioned flow process, does not repeats them here.
From the foregoing, it will be observed that the present embodiment uses timing acquisition configuration file, load corresponding according to this configuration file
Dynamic library file, and call corresponding plug-in unit function, and obtain and this plug-in unit function from this configuration file
Relevant parameter, then, by this plug-in unit function the most incoming for these parameters and perform, to obtain electricity
Sub-reading matter information；Owing to the program can be by some logical process behaviour in obtaining electron reading information process
Make to embody in the way of dynamic library file and plug-in unit function, therefore, for some bases that disparate modules is total
Plinth logic function, such as the acquisition etc. of user's extraneous data, only need to share same dynamic library file and plug-in unit function
, and without the most individually writing a set of corresponding complete code for each module, not only realize the simplest,
And also allow for being updated and Function Extension, such as, when carrying out functions expanding, only need to be absorbed in this and open up
The logic development of exhibition function, and without paying close attention to its basic logic function, etc., substantially increase its motility；
Further, owing to the code realizing identical function can be shared, so, it is possible to reduce great Liang Chong
Multiple code, reduces the consumption of resource.
Further, due to can with the characteristic information of the logical process entrance of timing acquisition finger daemon, and on
Offer server, and abnormal finding that other process, when such as data mart modeling failure or write data failure,
Alert, it can thus be avoided owing to process dies cannot be found in time or accesses external interface failure
And the ageing problem of the outer network data caused, it is substantially improved the effect that data process.
Embodiment three,
In order to preferably implement above method, the embodiment of the present invention also provides for the acquisition dress of a kind of network data
Put, as shown in Figure 3 a, the acquisition device of this network data include file obtaining unit 301, call unit,
Parameter acquiring unit 303 and performance element 304, as follows:
(1) file obtaining unit 301；
File obtaining unit 301, for timing acquisition configuration file.
Such as, an acquisition cycle specifically can be set, then according to this cycle timing acquisition configuration file.Its
In, this cycle can be configured according to the demand of reality application.
Wherein, depending on the form of this configuration file can be according to the demand of reality application, such as, can use
Xml form.
Wherein, when obtaining configuration file, this configuration file can be obtained from other equipment, it is also possible to
In advance this configuration file is carried in this locality, obtains this configuration file, the most as shown in Figure 3 b, this net from this locality
The acquisition device of network data can also include loading unit 305, as follows:
This loading unit 305, is determined for current operating environment when meeting pre-conditioned, loads configuration
File.
Wherein, current operating environment can include running temporal information and/or the status information of each software and hardware
Deng, this is pre-conditioned, can according to reality application demand be configured, such as, can arrange every
In certain cycle, just load once this configuration file；The most such as, it is also possible to arrange when certain process is in certain
During state, then load this configuration file, etc., do not repeat them here.
Optionally, in order to save signaling process, it is provided that treatment effeciency, when loading configuration file, it is also possible to
Judging whether this configuration file there occurs change, if there occurs change, just re-starting loading, and if do not had
There is transmission change, then can continue to use the configuration file of last loading.
Wherein, it is judged that whether this configuration file there occurs that the mode of change can have multiple, except can be direct
Outside current configuration file is compared with the last configuration file loaded, it is also possible to pass through configuration file
Modification time judge, it may be assumed that
This loading unit 305, it is also possible to for after being loaded with configuration file, however, it is determined that configuration file
When modification time when last modification time and last loading is inconsistent, then reload this configuration file.
Otherwise, however, it is determined that the last modification time of configuration file is consistent with modification time during last loading,
Then showing that the configuration file loaded does not changes, this configuration file loaded is the most up-to-date
Version, can be continuing with.
(2) call unit 302；
Call unit 302, for loading corresponding dynamic library file according to this configuration file, and calls phase
The plug-in unit function answered；
Such as, this call unit 302 can include determining that subelement and calls subelement, as follows:
Determine subelement, for reading the finger daemon task in this configuration file, be currently needed for holding to determine
The finger daemon task of row.
Call subelement, for loading corresponding dynamic base according to this finger daemon task being currently needed for performing
File, and call corresponding plug-in unit function.
Such as, this calls subelement, specifically may be used for being currently needed for the finger daemon task performed from this
Obtain mark and the mark of plug-in unit function of corresponding dynamic library file, adjust according to the mark of this dynamic library file
Using corresponding dynamic library file, and load this dynamic library file, such as so file, then, according to this plug-in unit
The mark of function calls corresponding plug-in unit function from this dynamic library file, etc..
Wherein, the mark of dynamic library file can include that title or the numbering etc. of dynamic library file can identify
The information of this dynamic library file；The mark of plug-in unit function then can include title or the numbering etc. of plug-in unit function
The information of this plug-in unit function can be identified.
(3) parameter acquiring unit 303；
Parameter acquiring unit 303, for obtaining the parameter with this plug-in unit functional dependence from this configuration file.
Wherein, the data relevant parameter of storage can be included to the parameter of this plug-in unit functional dependence, for distinguishing
Whether this task is parameter and the parameter etc. of instruction type of message of mission critical.
(4) performance element 304；
Performance element 304, for performing this plug-in unit function according to this parameter, to obtain network data.
Such as, this performance element 304 can include adding subelement and performing subelement, as follows:
Add subelement, for this parameter being added in order to parameter list；
Perform subelement, for performing this plug-in unit function according to this parameter list, to obtain network data.
Such as, perform subelement, specifically may be used for sequentially inputting the parameter in this parameter list inserting to this
In part function, perform have input the plug-in unit function of parameter, to obtain network data.
After parameter is inputted plug-in unit function, this execution subelement just can utilize the plug-in unit that have input parameter
The corresponding external interface of function call, then, pulls raw network data by this external interface, and to this
Raw network data carries out data mart modeling, obtains network data.
Optionally, ageing in order to avoid the outer network data that causes owing to process exception cannot be found in time
Problem, when data mart modeling failure, it is also possible to alert, it may be assumed that
Perform subelement, it is also possible to for when data mart modeling failure, generate the first failure information, root
Alert according to this first failure information.
Optionally, after getting network data, it is also possible to memory space is preset in the write of this network data,
To store, i.e. performance element 304 can also include storing sub-units, as follows:
This storing sub-units, for the write of this network data is preset memory space, if writing unsuccessfully, then gives birth to
Become the second failure information, alert according to this second failure information.
It should be noted that, when generating the first failure information or the second failure information, it is also possible to
First failure information or the second failure information carry corresponding plugin name and/or function name
Claim, in order to can quickly position and send abnormal position.
Optionally, in order to avoid leading owing to process dies cannot be found in time or accesses external interface failure
The ageing problem of the outer network data caused, can trigger the logical process entrance of finger daemon (such as every time
Before obtaining configuration file) time, all carry out the detection of primary characteristic information, the most as shown in Figure 3 b, this net
The acquisition device of network data can also include Alarm Unit 306, as follows:
This Alarm Unit 306, may be used for obtaining the characteristic information of the logical process entrance of finger daemon, root
When determining that this finger daemon occurs abnormal according to this characteristic information, generate warning information.
This Alarm Unit 306, it is also possible to for this warning information being sent to the terminal preset, the most relevant
Terminal belonging to attendant, etc..
Wherein, warning information transmission channel can include mail, note and/or social platform or IMU
The message etc. of letter platform.
When being embodied as, above unit can realize as independent entity, it is also possible to carries out arbitrarily
Combination, realizes as same or several entities, before being embodied as of above unit may refer to
Embodiment of the method, do not repeat them here.
The acquisition device of this network data specifically can be integrated in server, such as application server.
From the foregoing, it will be observed that the file obtaining unit 301, Ke Yiding of the acquisition device of the network data of the present embodiment
Time obtain configuration file, then by call unit 302 according to this configuration file load corresponding dynamic library file,
And call corresponding plug-in unit function, and obtained from this configuration file by parameter acquiring unit 303 and insert with this
The parameter of part functional dependence, subsequently, is performed this plug-in unit function by performance element 304 according to these parameters,
To obtain network data；Owing to the program can be by some logical process behaviour during obtaining network data
Make to embody in the way of dynamic library file and plug-in unit function, therefore, for some bases that disparate modules is total
Plinth logic function, such as the acquisition etc. of user's extraneous data, only need to share same dynamic library file and plug-in unit function
, and without the most individually writing a set of corresponding complete code for each module, not only realize the simplest,
And also allow for being updated and Function Extension, such as, when carrying out functions expanding, only need to be absorbed in this and open up
The logic development of exhibition function, and without paying close attention to its basic logic function, etc., substantially increase its motility；
Further, owing to the code realizing identical function can be shared, so, it is possible to reduce great Liang Chong
Multiple code, reduces the consumption of resource.
Embodiment four,
Accordingly, the embodiment of the present invention also provides for the acquisition system of a kind of network data, implements including the present invention
The acquisition device of any one network data that example provides, specifically can be found in embodiment three, for example, it is possible to as follows:
The acquisition device of network data, for loading corresponding dynamic library file according to this configuration file, and
Call corresponding plug-in unit function；The parameter with this plug-in unit functional dependence is obtained from this configuration file；According to this
Parameter performs this plug-in unit function, to obtain network data.
The acquisition device of this network data, it is also possible to for obtaining the characteristic of the logical process entrance of finger daemon
According to this characteristic information, information, determines whether finger daemon occurs exception, the most then generate warning information；
If it is not, then generate the response message representing normal operation, or, it is also possible to do not generate response message.
Additionally, the acquisition system of this network data can also include other equipment, such as terminal, as follows:
Terminal, for sending data acquisition request, and receiving network data to the acquisition device of network data
The network data that acquisition device returns according to this data acquisition request.
The embodiment being embodied as can be found in above of each equipment, does not repeats them here above.
Owing to the acquisition system of this network data can include any one network number that the embodiment of the present invention provides
According to acquisition device, it is thereby achieved that the acquisition of any one network data that the embodiment of the present invention is provided
Beneficial effect achieved by device.
Embodiment five,
The embodiment of the present invention also provides for a kind of server, as shown in Figure 4, it illustrates embodiment of the present invention institute
The structural representation of the server related to, specifically:
This server can include one or the processor 401, or of more than one process core
The memorizer 402 of above computer-readable recording medium, radio frequency (Radio Frequency, RF) circuit 403,
The parts such as power supply 404, input block 405 and display unit 406.Those skilled in the art can manage
Solving, the server architecture shown in Fig. 4 is not intended that the restriction to server, can include more more than diagram
Or less parts, or combine some parts, or different parts are arranged.Wherein:
Processor 401 is the control centre of this server, utilizes various interface and the whole server of connection
Various piece, by run or perform be stored in the software program in memorizer 402 and/or module, with
And call the data being stored in memorizer 402, perform the various functions of server and process data, thus
Server is carried out integral monitoring.Optionally, processor 401 can include one or more process core；Excellent
Choosing, processor 401 can integrated application processor and modem processor, wherein, application processor master
Operating system to be processed, user interface and application program etc., modem processor mainly processes radio communication.
It is understood that above-mentioned modem processor can not also be integrated in processor 401.
Memorizer 402 can be used for storing software program and module, and processor 401 is stored in by operation
The software program of reservoir 402 and module, thus perform the application of various function and data process.Memorizer
402 can mainly include store program area and storage data field, wherein, storage program area can store operating system,
Application program (such as sound-playing function, image player function etc.) etc. needed at least one function；Deposit
Storage data field can store the data etc. that the use according to server is created.Additionally, memorizer 402 can wrap
Include high-speed random access memory, it is also possible to include nonvolatile memory, for example, at least one disk storage
Device, flush memory device or other volatile solid-state parts.Correspondingly, memorizer 402 can also wrap
Include Memory Controller, to provide the processor 401 access to memorizer 402.
During RF circuit 403 can be used for receiving and sending messages, the reception of signal and transmission, especially, by base
After the downlink information stood receives, transfer to one or more than one processor 401 processes；It addition, will relate to
Up data are sent to base station.Generally, RF circuit 403 includes but not limited to antenna, at least one puts
Big device, tuner, one or more agitator, subscriber identity module (SIM) card, transceiver, coupling
Clutch, low-noise amplifier (LNA, Low Noise Amplifier), duplexer etc..Additionally, RF is electric
Road 403 can also be communicated with network and other equipment by radio communication.Described radio communication can use appoints
One communication standard or agreement, include but not limited to global system for mobile communications (GSM, Global System of
Mobile communication), general packet radio service (GPRS, General Packet Radio
Service), CDMA (CDMA, Code Division Multiple Access), WCDMA
(WCDMA, Wideband Code Division Multiple Access), Long Term Evolution (LTE, Long
Term Evolution), Email, Short Message Service (SMS, Short Messaging Service)
Deng.
Server also includes the power supply 404 (such as battery) powered to all parts, it is preferred that power supply 404
Can be logically contiguous with processor 401 by power-supply management system, thus realize pipe by power-supply management system
The functions such as reason charging, electric discharge and power managed.Power supply 404 can also include one or more
Direct current or alternating current power supply, recharging system, power failure detection circuit, power supply changeover device or inverter,
The random component such as power supply status indicator.
This server may also include input block 405, and this input block 405 can be used for receiving the numeral of input
Or character information, and produce the keyboard relevant with user setup and function control, mouse, action bars,
Optics or the input of trace ball signal.Specifically, in a specific embodiment, input block 405
Touch sensitive surface and other input equipments can be included.Touch sensitive surface, also referred to as touches display screen or Trackpad,
Can collect user thereon or neighbouring touch operation (such as user uses finger, stylus etc. any applicable
The operation on Touch sensitive surface or near Touch sensitive surface of object or adnexa), and according to formula set in advance
Drive corresponding attachment means.Optionally, Touch sensitive surface can include touch detecting apparatus and touch controller two
Individual part.Wherein, the touch orientation of touch detecting apparatus detection user, and detect the letter that touch operation brings
Number, transmit a signal to touch controller；Touch controller receives touch information from touch detecting apparatus,
And it is converted into contact coordinate, then give processor 401, and the order that processor 401 is sent can be received
And performed.Furthermore, it is possible to use the multiple types such as resistance-type, condenser type, infrared ray and surface acoustic wave
Type realizes Touch sensitive surface.Except Touch sensitive surface, input block 405 can also include other input equipments.Tool
Body ground, other input equipments can include but not limited to physical keyboard, function key (such as volume control button,
Switch key etc.), trace ball, mouse, one or more in action bars etc..
This server may also include display unit 406, and this display unit 406 can be used for display and inputted by user
Information or be supplied to the information of user and the various graphical user interface of server, these graphical users connect
Mouth can be made up of figure, text, icon, video and its combination in any.Display unit 406 can include
Display floater, optionally, can use liquid crystal display (LCD, Liquid Crystal Display),
The forms such as Organic Light Emitting Diode (OLED, Organic Light-Emitting Diode) configure display surface
Plate.Further, Touch sensitive surface can cover display floater, when Touch sensitive surface detects thereon or neighbouring
After touch operation, send processor 401 to determine the type of touch event, with preprocessor 401 basis
The type of touch event provides corresponding visual output on a display panel.Although in the diagram, Touch sensitive surface
It is to realize input and input function as two independent parts with display floater, but in some embodiment
In, can be by integrated to Touch sensitive surface and display floater and realize input and output function.
Although not shown, server can also include photographic head, bluetooth module etc., does not repeats them here.Tool
Body in the present embodiment, processor 401 in server can according to following instruction, by one or one with
On executable file corresponding to the process of application program be loaded in memorizer 402, and by processor 401
Run the application program being stored in memorizer 402, thus realize various function, as follows:
Timing acquisition configuration file；Load corresponding dynamic library file according to this configuration file, and call phase
The plug-in unit function answered；The parameter with this plug-in unit functional dependence is obtained from this configuration file；Hold according to this parameter
This plug-in unit function of row, to obtain network data.
Such as, this processor 401 may be used for performing to operate as follows:
This parameter is added in order to parameter list, then, performs this plug-in unit according to this parameter list
Function, to obtain network data；Such as, the parameter in this parameter list can be sequentially input to this plug-in unit
In function, utilize the corresponding external interface of plug-in unit function call that have input parameter, then, by outside this
Interface pulls raw network data, and this raw network data is carried out data mart modeling, obtains network data,
Etc..
Optionally, ageing in order to avoid the outer network data that causes owing to process exception cannot be found in time
Problem, when data mart modeling failure, it is also possible to alert, i.e. this processor 401 can be also used for performing
Following operation:
If data mart modeling failure, then generate the first failure information, and according to this first failure information
Alert.
Optionally, after getting network data, it is also possible to memory space is preset in the write of this network data,
To store, and when writing unsuccessfully, alert, i.e. this processor 401 can be also used for performing such as
Lower operation:
If writing unsuccessfully, then generate the second failure information, such as generate the second of character string type and unsuccessfully carry
Show information, and alert according to this second failure information.
Optionally, for the ease of knowing process situation in time, this processor 401 can be also used for performing
Following operation:
Obtain the characteristic information of logical process entrance of finger daemon, according to this characteristic information determine described in guard
When process occurs abnormal, generate warning information.
The embodiment being embodied as can be found in above of each operation, does not repeats them here above.
From the foregoing, it will be observed that the server of the present embodiment can obtain configuration file, load phase according to this configuration file
The dynamic library file answered, and call corresponding plug-in unit function, and obtain and this plug-in unit from this configuration file
The parameter of functional dependence, then, performs this plug-in unit function according to these parameters, to obtain network data；By
In the program can by obtain some logic processing operations during network data with dynamic library file and
The mode of plug-in unit function embodies, therefore, for some basic logic functions that disparate modules is total, as with
The acquisition etc. of family extraneous data, only need to share same dynamic library file and plug-in unit function, and without for every
Individual module the most individually writes a set of corresponding complete code, not only realizes the simplest, and also allows for carrying out
Updating and Function Extension, such as, when carrying out functions expanding, the logic that only need to be absorbed in this expanding function is opened
Send out, and without paying close attention to its basic logic function, etc., substantially increase its motility；Further, by
In the code realizing identical function being shared, so, it is possible to reduce a large amount of codes repeated, subtract
The consumption of few resource.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment
Suddenly the program that can be by completes to instruct relevant hardware, and this program can be stored in a computer-readable
In storage medium, storage medium may include that read only memory (ROM, Read Only Memory),
Random access memory (RAM, Random Access Memory), disk or CD etc..
The acquisition methods of a kind of network data, device and the system that are thered is provided the embodiment of the present invention above are carried out
Being discussed in detail, principle and the embodiment of the present invention are set forth by specific case used herein,
The explanation of above example is only intended to help to understand method and the core concept thereof of the present invention；Simultaneously for
Those skilled in the art, according to the thought of the present invention, the most all has
In place of change, in sum, this specification content should not be construed as limitation of the present invention.
Claims (23)
1. the acquisition methods of a network data, it is characterised in that including:
Timing acquisition configuration file；
Load corresponding dynamic library file according to described configuration file, and call corresponding plug-in unit function；
The parameter with described plug-in unit functional dependence is obtained from described configuration file；
Described plug-in unit function is performed, to obtain network data according to described parameter.
Method the most according to claim 1, it is characterised in that described load according to described configuration file
Corresponding dynamic library file, and call corresponding plug-in unit function and include:
Read the finger daemon task in described configuration file, to determine that the finger daemon being currently needed for performing is appointed
Business；
Load corresponding dynamic library file according to the described finger daemon task being currently needed for performing, and call
Corresponding plug-in unit function.
Method the most according to claim 2, it is characterised in that be currently needed for described in described basis performing
Finger daemon task load corresponding dynamic library file, and call corresponding plug-in unit function, including:
From described be currently needed for perform finger daemon task obtain corresponding dynamic library file mark and
The mark of plug-in unit function；
Mark according to described dynamic library file calls corresponding dynamic library file, and loads described dynamic library text
Part；
Mark according to described plug-in unit function calls corresponding plug-in unit function from described dynamic library file.
4. according to the method described in any one of claims 1 to 3, it is characterised in that described according to described ginseng
Number performs described plug-in unit function, to obtain network data, including:
Described parameter is added in order to parameter list；
Described plug-in unit function is performed, to obtain network data according to described parameter list.
Method the most according to claim 4, it is characterised in that described perform according to described parameter list
Described plug-in unit function, to obtain network data, including:
Parameter in described parameter list is sequentially input to described plug-in unit function；
Perform have input the plug-in unit function of parameter, to obtain network data.
Method the most according to claim 5, it is characterised in that described execution have input the plug-in unit of parameter
Function, to obtain network data, including:
Utilize the corresponding external interface of plug-in unit function call that have input parameter, and drawn by described external interface
Take raw network data；
Described raw network data is carried out data mart modeling, obtains network data.
Method the most according to claim 6, it is characterised in that described described raw network data is entered
Row data mart modeling, after obtaining network data, also includes:
If data mart modeling failure, then generate the first failure information, according to described first failure information
Alert.
Method the most according to claim 6, it is characterised in that described described raw network data is entered
Row data mart modeling, after obtaining network data, also includes:
Memory space is preset in the write of described network data；
If writing unsuccessfully, then generating the second failure information, carrying out according to described second failure information
Alarm.
9. according to the method described in any one of claims 1 to 3, it is characterised in that described timing acquisition is joined
Before putting file, also include:
Determine when current operating environment meets pre-conditioned, loading configuration file.
Method the most according to claim 9, it is characterised in that after described loading configuration file,
Also include:
When modification time when determining the last modification time of configuration file and last loading is inconsistent, again
Load described configuration file.
11. methods according to claim 2, it is characterised in that also include:
Obtain the characteristic information of the logical process entrance of finger daemon；
When determining that described finger daemon sends abnormal according to described characteristic information, generate warning information.
The acquisition device of 12. 1 kinds of network datas, it is characterised in that including:
File obtaining unit, for timing acquisition configuration file；
Call unit, for loading corresponding dynamic library file according to described configuration file, and calls corresponding
Plug-in unit function；
Parameter acquiring unit, for obtaining the parameter with described plug-in unit functional dependence from described configuration file；
Performance element, for performing described plug-in unit function according to described parameter, to obtain network data.
13. devices according to claim 12, it is characterised in that described call unit includes determining son
Unit and call subelement；
Described determine subelement, for reading the finger daemon task in described configuration file, current to determine
Need the finger daemon task performed；
Described call subelement, for according to described in be currently needed for performing finger daemon task load corresponding
Dynamic library file, and call corresponding plug-in unit function.
14. devices according to claim 13, it is characterised in that
Described call subelement, specifically for obtaining phase from the described finger daemon task being currently needed for and performing
The mark of the dynamic library file answered and the mark of plug-in unit function；Mark according to described dynamic library file calls phase
The dynamic library file answered, and load described dynamic library file；Mark according to described plug-in unit function is from described dynamic
State library file calls corresponding plug-in unit function.
15. according to the device described in any one of claim 12 to 14, it is characterised in that described performance element
Including adding subelement and performing subelement；
Described interpolation subelement, for adding described parameter in order to parameter list；
Described execution subelement, for performing described plug-in unit function according to described parameter list, to obtain network
Data.
16. devices according to claim 15, it is characterised in that
Described execution subelement, specifically for sequentially inputting the parameter in described parameter list to described plug-in unit
In function；Perform have input the plug-in unit function of parameter, to obtain network data.
17. devices according to claim 16, it is characterised in that
Described execution subelement, specifically for utilizing, the plug-in unit function call that have input parameter is outside accordingly to be connect
Mouthful, and pull raw network data by described external interface；Described raw network data is carried out data add
Work, obtains network data.
18. devices according to claim 17, it is characterised in that
Described execution subelement, is additionally operable to when data mart modeling failure, generates the first failure information, root
Alert according to described first failure information.
19. devices according to claim 17, it is characterised in that described performance element also includes storage
Subelement；
Described storing sub-units, for memory space is preset in the write of described network data, if writing unsuccessfully,
Then generate the second failure information, alert according to described second failure information.
20. according to the device described in any one of claim 12 to 14, it is characterised in that also include loading list
Unit；
Described loading unit, is used for determining when current operating environment meets pre-conditioned, loading configuration file.
21. devices according to claim 20, it is characterised in that
Described loading unit, is additionally operable to after being loaded with configuration file, however, it is determined that finally repairing of configuration file
When the time that changes is inconsistent with modification time during last loading, then reload described configuration file.
22. devices according to claim 13, it is characterised in that also include Alarm Unit；
Described Alarm Unit, for obtaining the characteristic information of the logical process entrance of finger daemon, according to described
Characteristic information determines when described finger daemon occurs abnormal, generates warning information.
The acquisition system of 23. 1 kinds of network datas, it is characterised in that include described in claim 12 to 22
The acquisition device of any one network data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610380227.2A CN105847446B (en) | 2016-05-31 | 2016-05-31 | Method, device and system for acquiring network data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610380227.2A CN105847446B (en) | 2016-05-31 | 2016-05-31 | Method, device and system for acquiring network data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105847446A true CN105847446A (en) | 2016-08-10 |
| CN105847446B CN105847446B (en) | 2020-08-04 |
Family
ID=56595381
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610380227.2A Active CN105847446B (en) | 2016-05-31 | 2016-05-31 | Method, device and system for acquiring network data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105847446B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107729197A (en) * | 2017-10-12 | 2018-02-23 | 郑州云海信息技术有限公司 | A kind of abnormality detection method and device |
| CN110045998A (en) * | 2019-04-22 | 2019-07-23 | 腾讯科技（深圳）有限公司 | Load the method and device of dynamic base |
| CN110457345A (en) * | 2019-07-05 | 2019-11-15 | 平安证券股份有限公司 | Database read method, device and computer readable storage medium |
| CN111427548A (en) * | 2020-03-18 | 2020-07-17 | 成都中科合迅科技有限公司 | Plug-in development method and system based on process |
| CN113468023A (en) * | 2021-07-09 | 2021-10-01 | 中国电信股份有限公司 | Monitoring method, monitoring device, monitoring medium and electronic equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1524216A (en) * | 2001-05-30 | 2004-08-25 | Bea系统公司 | System and method for software component plug-in framework |
| CN1968154A (en) * | 2006-09-15 | 2007-05-23 | 华为技术有限公司 | System and method for service expansion using plug |
| US20080064383A1 (en) * | 2006-09-13 | 2008-03-13 | Mformation Technologies, Inc. | System and method to provide application management on wireless data terminals by means of device management agent and dynamic link libraries |
| CN101409643A (en) * | 2008-11-24 | 2009-04-15 | 北京中创信测科技股份有限公司 | Method, apparatus and corresponding system for analyzing telecom network modeling |
| CN102073520A (en) * | 2010-12-30 | 2011-05-25 | 中国民航信息网络股份有限公司 | Dynamic management system and method for C++ application program version |
| CN103166787A (en) * | 2011-12-15 | 2013-06-19 | 中国移动通信集团浙江有限公司 | Information analysis method and information analysis device |
-
2016
- 2016-05-31 CN CN201610380227.2A patent/CN105847446B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1524216A (en) * | 2001-05-30 | 2004-08-25 | Bea系统公司 | System and method for software component plug-in framework |
| US20080064383A1 (en) * | 2006-09-13 | 2008-03-13 | Mformation Technologies, Inc. | System and method to provide application management on wireless data terminals by means of device management agent and dynamic link libraries |
| CN1968154A (en) * | 2006-09-15 | 2007-05-23 | 华为技术有限公司 | System and method for service expansion using plug |
| CN101409643A (en) * | 2008-11-24 | 2009-04-15 | 北京中创信测科技股份有限公司 | Method, apparatus and corresponding system for analyzing telecom network modeling |
| CN102073520A (en) * | 2010-12-30 | 2011-05-25 | 中国民航信息网络股份有限公司 | Dynamic management system and method for C++ application program version |
| CN103166787A (en) * | 2011-12-15 | 2013-06-19 | 中国移动通信集团浙江有限公司 | Information analysis method and information analysis device |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107729197A (en) * | 2017-10-12 | 2018-02-23 | 郑州云海信息技术有限公司 | A kind of abnormality detection method and device |
| CN110045998A (en) * | 2019-04-22 | 2019-07-23 | 腾讯科技（深圳）有限公司 | Load the method and device of dynamic base |
| CN110457345A (en) * | 2019-07-05 | 2019-11-15 | 平安证券股份有限公司 | Database read method, device and computer readable storage medium |
| CN110457345B (en) * | 2019-07-05 | 2023-11-03 | 平安证券股份有限公司 | Database reading method, device and computer readable storage medium |
| CN111427548A (en) * | 2020-03-18 | 2020-07-17 | 成都中科合迅科技有限公司 | Plug-in development method and system based on process |
| CN111427548B (en) * | 2020-03-18 | 2023-03-31 | 成都中科合迅科技有限公司 | Plug-in development method and system based on process |
| CN113468023A (en) * | 2021-07-09 | 2021-10-01 | 中国电信股份有限公司 | Monitoring method, monitoring device, monitoring medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105847446B (en) | 2020-08-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108512695B (en) | Method and device for monitoring application blockage | |
| CN105119806B (en) | message updating method and device | |
| CN106453053B (en) | Group message display methods and device | |
| CN105847446A (en) | Network data obtaining method, device and system | |
| CN104484031B (en) | The optimization method and device of terminal device power consumption state | |
| CN106202441A (en) | Data processing method based on relevant database, device and system | |
| EP3504619B1 (en) | Apparatus and method for managing notification | |
| CN106557407A (en) | A kind of monitoring method and device of apparatus of load | |
| CN104104711B (en) | Reading histories treating method and apparatus | |
| CN108541310A (en) | A kind of method, apparatus and graphic user interface of display candidate word | |
| CN108702421A (en) | For controlling using the electronic equipment and method with component | |
| CN104598513A (en) | Data flow control method and system based on webpage frame | |
| CN104063400B (en) | Data search method and data search device | |
| CN106528156B (en) | A kind of page data processing method and device | |
| CN106296135A (en) | Event-prompting method, device and terminal | |
| CN107436948A (en) | File search method, device and terminal | |
| CN106371964A (en) | Message prompting method and apparatus | |
| CN109246233A (en) | Data processing method, device, equipment and storage medium based on on-line monitoring | |
| CN105955597A (en) | Method and device for displaying information | |
| CN106919458A (en) | The method and device of Hook target kernel functions | |
| CN109992399A (en) | Method for managing resource, device, mobile terminal and computer readable storage medium | |
| CN113434075A (en) | Information display method and device and electronic equipment | |
| CN106371326A (en) | Storage method and apparatus of equipment work scenes | |
| CN108268232A (en) | A kind of image display method, device, system and storage medium | |
| CN109885729A (en) | A kind of method, apparatus and system showing data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |