CN107317722A - A kind of expansible system and method for data source - Google Patents

A kind of expansible system and method for data source Download PDF

Info

Publication number
CN107317722A
CN107317722A CN201710392604.9A CN201710392604A CN107317722A CN 107317722 A CN107317722 A CN 107317722A CN 201710392604 A CN201710392604 A CN 201710392604A CN 107317722 A CN107317722 A CN 107317722A
Authority
CN
China
Prior art keywords
data
mentioned
unit
data source
management module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710392604.9A
Other languages
Chinese (zh)
Other versions
CN107317722B (en
Inventor
冯盼盼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN201710392604.9A priority Critical patent/CN107317722B/en
Publication of CN107317722A publication Critical patent/CN107317722A/en
Application granted granted Critical
Publication of CN107317722B publication Critical patent/CN107317722B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/04Processing captured monitoring data, e.g. for logfile generation
    • H04L43/045Processing captured monitoring data, e.g. for logfile generation for graphical visualisation of monitoring data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/22Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks comprising specially adapted graphical user interfaces [GUI]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/10Active monitoring, e.g. heartbeat, ping or trace-route
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/565Conversion or adaptation of application format or content

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Data Mining & Analysis (AREA)
  • Health & Medical Sciences (AREA)
  • Cardiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention provides a kind of expansible system and method for data source, it is related to internet arena.The system includes:Visualization model, data task management module, data processing centre and data acquisition adaptation module;Above-mentioned data task management module includes the first judging unit, task creation unit and Dispatching Unit;Above-mentioned visualization model includes request creating unit;Above-mentioned data acquisition adaptation module includes data capture unit and data adaptation unit.The embodiment of the present invention can realize the expanded compatibility of different data source types index tests by data task management module in said system, save exploitation manpower of the different team to protocol detection, reduce time cost.

Description

A kind of expansible system and method for data source
Technical field
The present invention relates to internet arena, more particularly to a kind of expansible system and method for data source.
Background technology
With flourishing for Internet technology, more and more various network service and platform has provided the user abundant many Color function;Each company or Dou You Web Service Deployments intra-company of group would generally safeguard multiple online services, different Service completes different functions, and situation about interdepending generally also is had between each service and is occurred, any one network service Service quality can all influence the quality of the overall networking products of company and service, therefore how can guarantee that the service of network service Quality just seems most important.
Oneself a set of Dashboard (business intelligence are developed because most of team can all use dashboard:Business intelligence instrument board) system, data during service operation, Ran Hou are gathered by an agent agency Shown in Dashboard systems, so that service operation state be visualized, the service more intuitively seen potentially is asked Topic, while when servicing failure, failure cause can be analyzed by checking historical data trend.
Usual monitoring data is not homogeneous, and the data for having plenty of database have plenty of machine resources data, had plenty of Daily record data, it is not a simple thing, usual way that a variety of data, which need to show in same Dashboard, It is to separate displaying, a set of database monitoring system of data mining of such as database, daily record data develops a set of daily record monitoring System, a set of machine resources monitoring system of machine resources data mining.So there are two harms to be, first, if new number Need to support according to source, then developer needs to write a set of monitoring system again to show, and expends substantial amounts of manpower and materials;The Two, identical demand is might have between different team, but each exploitation can put into the time cost of repetition, waste company Overall human resources.
The content of the invention
In view of the above problems, it is proposed that the present invention so as to provide one kind overcome above mentioned problem or at least in part solve on State a kind of expansible system of data source and a kind of corresponding data source expandable method of problem.
According to one aspect of the present invention there is provided a kind of expansible system of data source, including:Visualization model, data Task management module, data processing centre and data acquisition adaptation module;
The visualization model includes request creating unit;
The request creating unit is used to create probe requests thereby according to the type of data source, and the probe requests thereby is sent to First judging unit of the data task management module;
The data task management module includes the first judging unit, task creation unit and Dispatching Unit;
First judging unit is used to receive after the probe requests thereby that the request creating unit is sent, according to institute State probe requests thereby and judge whether the type of the data source is supported to be tested;
The task creation unit is used for first judging unit and judges that the type of the data source is supported after being tested, Then create detection mission;
The Dispatching Unit is used for the task creation unit and created after detection mission, and the detection mission is distributed into institute State the data capture unit of data acquisition adaptation module;
The data acquisition adaptation module includes data capture unit and data adaptation unit;
The data capture unit is used to receive after the detection mission that the Dispatching Unit is sent, according to the detection Task obtains the data source;
The data adaptation unit is used for the data capture unit and obtained after the data source, and the data source is converted To be sent after general format to the data processing centre;
The data processing centre is used for after the data source that the data adaptation unit sends general format, will be described general The data source of form is calculated according to the requirement of the detection mission;And the result of calculation is sent to the visualization mould Block.
Alternatively, based on the expansible system of the data source, the task creation unit includes:
Index receiving subelement, the test index for receiving the data source that the visualization model is sent;
Task creation subelement, for creating the detection mission according to the test index of the data source.
Alternatively, based on the expansible system of the data source,
The data task management module also includes:
Feedback unit is not supported, if judging the data according to the probe requests thereby for the data task management module The type in source is not supported to be tested, then is returned to the visualization model and do not support test post;
Bound cell is obtained, for not supported described in visualization model reception after test post, by the data source The corresponding plug-in unit of type be uploaded to the data task management module;
Plug-in unit loading unit, is loaded onto the data acquisition by the plug-in unit for the task management module and is adapted to mould Block;
The data acquisition adaptation module also includes:
Date Conversion Unit, for the data acquisition adaptation module according to the plug-in unit by the corresponding data of the plug-in unit Source Type is converted to general format, the data processing centre is handled the data source.
Alternatively, based on the expansible system of the data source, the data task management module also includes:
Second judging unit, for judging the detection mission;
Cycle start unit, if being timed task for the detection mission, in the setting time cycle, starts the detection Task.
According to one aspect of the present invention there is provided a kind of data source expandable method, including:
Visualization model creates probe requests thereby according to the type of data source, and the probe requests thereby is sent into data task pipe Manage module;
Data task management module judges whether the type of the data source is supported to be tested according to the probe requests thereby;
If the type of the data source supports tested, the data task management module creates detection mission;
The detection mission is distributed to data acquisition adaptation module by the data task management module;
The data acquisition adaptation module obtains the data source according to the detection mission;
The data source is converted into after general format by the data acquisition adaptation module to be sent to the Data processing The heart;
The data processing centre is calculated the data source of the general format according to the requirement of the detection mission; And the result of calculation is sent to the visualization model.
Alternatively, if the type of the data source supports tested, the step of creating detection mission, including:
The data task management module returns to the message for supporting test to the visualization model;
The test index of the data source is sent to the data task management module by the visualization model;
The detection mission is created according to the test index of the data source.
Alternatively, in addition to:
If the data task management module judges that the type of the data source is not supported to be tested according to the probe requests thereby Examination, then return to the visualization model and do not support test post;
The visualization model is not supported after test post described in receiving, by the corresponding plug-in unit of the type of the data source Reach the data task management module;
The plug-in unit is loaded onto the data acquisition adaptation module by the task management module;
The data acquisition adaptation module is converted to the corresponding data source types of the plug-in unit according to the plug-in unit general Form, makes the data processing centre handle the data source.
Alternatively, the step of detection mission is distributed to data acquisition adaptation module by the data task management module Afterwards, in addition to:
The data task management module is judged the detection mission;
If the detection mission is timed task, in the setting time cycle, start the detection mission.
The embodiment of the present invention includes advantages below:
When detecting different types of data source, check whether the above-mentioned data task management module of the system supports above-mentioned number According to the type in source, the data task management module of the system can be used to create detection mission if supporting, make the system to not Same data source types have expanded compatibility;Therefore, solving different data source types is needing what is detected into row index When time cost and the problem of high human cost, save exploitation manpower of the different team to protocol detection, reduce the time Cost.
Brief description of the drawings
By reading the detailed description of hereafter optional embodiment, various other advantages and benefit is common for this area Technical staff will be clear understanding.Accompanying drawing is only used for showing the purpose of optional embodiment, and is not considered as to the present invention Limitation.And in whole accompanying drawing, identical part is denoted by the same reference numerals.In the accompanying drawings:
Fig. 1 shows a kind of structure of the device embodiment of the expansible system of data source according to an embodiment of the invention Block diagram;
Fig. 2 shows a kind of knot of the device embodiment of the expansible system of data source in accordance with another embodiment of the present invention Structure block diagram;
Fig. 3 shows a kind of method and step flow chart of data source expandable method according to an embodiment of the invention;
Fig. 4 shows a kind of method and step flow of data source expandable method in accordance with another embodiment of the present invention Figure.
Embodiment
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although showing the disclosure in accompanying drawing Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here Limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure Complete conveys to those skilled in the art.
Embodiment one
Reference picture 1, shows a kind of structure of the expansible system embodiment of data source according to an embodiment of the invention, Said system includes visualization model 110, data task management module 120, data processing centre 140 and data acquisition adaptation mould Block 130;
Above-mentioned visualization model 110 includes request creating unit 111;
Above-mentioned request creating unit 111 is used to create probe requests thereby according to the type of data source, and above-mentioned probe requests thereby is sent out Give the first judging unit 121 of above-mentioned data task management module 120;
User confirms to need after detected data source types, the basis in the human-computer interaction interface of visualization model 110 Above-mentioned data source types create probe requests thereby;After above-mentioned probe requests thereby is created successfully, above-mentioned probe requests thereby is sent to above-mentioned number According to the first judging unit 121 of task management module 120;
Alternatively, above-mentioned visualization model 110 provides a user a personal-machine interactive interface, for example, web interface, is used for User creates above-mentioned probe requests thereby according to above-mentioned detected data source.
Above-mentioned data task management module 120 includes the first judging unit 121, task creation unit 122 and Dispatching Unit 123;
Above-mentioned first judging unit 121 is used to receive after the above-mentioned probe requests thereby that above-mentioned request creating unit 111 is sent, Judge whether the type of above-mentioned data source is supported to be tested according to above-mentioned probe requests thereby;
Above-mentioned first judging unit 121 is received after the above-mentioned probe requests thereby that above-mentioned request creating unit 111 is sent, and is extracted The corresponding data source types of above-mentioned probe requests thereby;Above-mentioned data task management module 120 is searched according to above-mentioned data source types Whether above-mentioned data source types corresponding plug-in unit is stored in memory cell;If being stored in memory cell, above-mentioned data source is corresponding to insert Part, then above-mentioned first judging unit 121 to above-mentioned visualization model 110 send plug-in unit confirm order;Above-mentioned visualization model 110 Receive above-mentioned plug-in unit to confirm after order, user confirms that execution is above-mentioned by above-mentioned visualization model 110 according to the type of data source The index and data source of data source detection obtain address;Above-mentioned visualization model is by the type of above-mentioned data source and above-mentioned data source The index and data source of detection obtain the above-mentioned task creation unit 122 that address is sent to above-mentioned data task management module 120.
Above-mentioned task creation unit 122 is used for above-mentioned first judging unit 121 and judges that the type of above-mentioned data source supports quilt After test, then detection mission is created;
Above-mentioned task creation unit 122 judges that the type of above-mentioned data source supports tested in above-mentioned first judging unit 121 After examination, the type and the index and number of above-mentioned data source detection for the above-mentioned data source that above-mentioned visualization model 110 is sent are received Address is obtained according to source;Address creation is obtained according to the index and data source of the type of above-mentioned data source and above-mentioned data source detection to visit Survey task.
Above-mentioned Dispatching Unit 123 is used for above-mentioned task creation unit 122 and created after detection mission, by above-mentioned detection mission point Issue the data capture unit 131 of above-mentioned data acquisition adaptation module 130;
Above-mentioned task creation unit 122 is created after detection mission, and above-mentioned detection mission is sent into above-mentioned Dispatching Unit 123;The data source that above-mentioned Dispatching Unit 123 is obtained in above-mentioned detection mission obtains address, and above-mentioned detection mission is distributed to State the data capture unit 131 that data source obtains the corresponding data acquisition adaptation module 130 in address.
Above-mentioned data acquisition adaptation module 130 includes data capture unit 131 and data adaptation unit 132;
Above-mentioned data capture unit 131 is used to receive after the above-mentioned detection mission that above-mentioned Dispatching Unit 123 is sent, according to upper State detection mission and obtain above-mentioned data source;
Above-mentioned data capture unit 131 is received after above-mentioned detection mission, obtains above-mentioned data source;If above-mentioned data source is day Will data, then the above-mentioned inquiry log of data capture unit 131, obtains data source from daily record;If above-mentioned data source is database Data, then above-mentioned data capture unit 131 above-mentioned data source is obtained from database;The form of above-mentioned data source is each comfortable former Form in memory.Above-mentioned data source is sent to above-mentioned adaptation unit 132 by above-mentioned data capture unit 131.
Above-mentioned data adaptation unit 132 is obtained after above-mentioned data source for above-mentioned data capture unit 131, by above-mentioned data Source, which is converted into after general format, to be sent to above-mentioned data processing centre 140;
Above-mentioned data adaptation unit 140 is received after above-mentioned data source, and above-mentioned data source is converted into the general number of the system According to form, so as to so that the unobstructed circulation and calculating in the present system of above-mentioned data source so that other modules or unit are to upper The form for stating data source being capable of quick response.
Such as data source A comes from the data of database, and the data format that data source getter is got is usually many Data of row, such as lane database has user name and the row of age of user two, then the data format that getter is taken is exactly Two column datas, first row is user name, and secondary series is the age, due to being multirow data, so can be a line a line during storage, It is an array per a line, this is the form that data source getter is taken.The universal data format of the system is json data lattice Formula, form such as { " name ":" Zhang San ", " age ":25 } it is such, but the data that data source getter is got are [[' name ', ' age '], [' Zhang San ', 25]], it is therefore desirable to which data source adapter makes corresponding adaptation modification, by form modifying For the general format of the system.Wherein, json data formats (JavaScript Object Notation) refer to a kind of light weight The data interchange format of level.
The data source of universal data format is transmitted to above-mentioned data processing centre 140 by above-mentioned data adaptation unit 132.
Above-mentioned data processing centre 140 is used for after the data source that above-mentioned data adaptation unit 132 sends general format, will be upper The data source for stating general format is calculated according to the requirement of above-mentioned detection mission;And by above-mentioned result of calculation be sent to it is above-mentioned can Depending on changing module 110.
Above-mentioned data processing centre 140 carries out judging above-mentioned to the data source of above-mentioned general format according to above-mentioned detection mission Whether data source closes rule, will determine that the data for not conforming to rule are deleted, and entering row index to the remaining data for closing rule calculates;By index Result of calculation is preserved and is sent to above-mentioned visualization model;The man-machine interface of above-mentioned visualization model calculates These parameters As a result user is showed.
The embodiment of the present invention includes advantages below:
When detecting different types of data source, check whether the above-mentioned data task management module of the system supports above-mentioned number According to the type in source, the data task management module of the system can be used to create detection mission if supporting, make the system to not Same data source types have expanded compatibility;Therefore, solving different data source types is needing what is detected into row index When time cost and the problem of high human cost, save exploitation manpower of the different team to protocol detection, reduce the time Cost.
Embodiment two
Reference picture 2, shows that a kind of expansible visual telephone system of data source in accordance with another embodiment of the present invention is real The structure of example is applied, said system includes visualization model 210, data task management module 220, the sum of data processing centre 240 According to acquisition adaptation module 230;
Above-mentioned visualization model 210 includes request creating unit 211;
Above-mentioned request creating unit 211 is used to create probe requests thereby according to the type of data source, and above-mentioned probe requests thereby is sent out Give the first judging unit 221 of above-mentioned data task management module 220;
User confirms to need after detected data source types, the basis in the human-computer interaction interface of visualization model 210 Above-mentioned data source types create probe requests thereby;After above-mentioned probe requests thereby is created successfully, above-mentioned probe requests thereby is sent to above-mentioned number According to the first judging unit 221 of task management module 220;
Alternatively, above-mentioned visualization model 210 provides a user a personal-machine interactive interface, for example, web interface, is used for User creates above-mentioned probe requests thereby according to above-mentioned detected data source.
Above-mentioned data task management module 220 includes the first judging unit 221, task creation unit 222 and Dispatching Unit 223;
Above-mentioned first judging unit 221 is used to receive after the above-mentioned probe requests thereby that above-mentioned request creating unit 211 is sent, Judge whether the type of above-mentioned data source is supported to be tested according to above-mentioned probe requests thereby;
Above-mentioned first judging unit 221 is received after the above-mentioned probe requests thereby that above-mentioned request creating unit 211 is sent, and is extracted The corresponding data source types of above-mentioned probe requests thereby;Above-mentioned data task management module 220 is searched according to above-mentioned data source types Whether above-mentioned data source types corresponding plug-in unit is stored in memory cell;If being stored in memory cell, above-mentioned data source is corresponding to insert Part, then above-mentioned first judging unit 221 to above-mentioned visualization model 210 send plug-in unit confirm order;Above-mentioned visualization model 210 Receive above-mentioned plug-in unit to confirm after order, user confirms that execution is above-mentioned by above-mentioned visualization model 210 according to the type of data source The index and data source of data source detection obtain address;Above-mentioned visualization model is by the type of above-mentioned data source and above-mentioned data source The index and data source of detection obtain the above-mentioned task creation unit 222 that address is sent to above-mentioned data task management module 220.
Above-mentioned task creation unit 222 is used for above-mentioned first judging unit 221 and judges that the type of above-mentioned data source supports quilt After test, then detection mission is created;
Alternatively, above-mentioned task creation unit 222 includes:
Index receiving subelement 2221, the test index for receiving the above-mentioned data source that above-mentioned visualization model is sent;
Task creation subelement 2222, for creating above-mentioned detection mission according to the test index of above-mentioned data source.
Above-mentioned task creation unit 222 judges that the type of above-mentioned data source supports tested in above-mentioned first judging unit 221 After examination, the type for sending above-mentioned data source to above-mentioned visualization model 210 supports tested signal;Above-mentioned visualization model 210 receive after above-mentioned signal, according to the type of above-mentioned data source, obtain above-mentioned data source detection index, while obtaining user The data field selected in human-computer interaction interface obtains address;Above-mentioned data source detection index and above-mentioned data field are obtained into address It is sent to the index receiving subelement 2221 of above-mentioned task creation unit 222;These parameters receiving subelement 2221 receives above-mentioned The test index and data source for the above-mentioned data source that visualization model 210 is sent obtain address;These parameters receiving subelement The test index of above-mentioned data source and data source are obtained address by 2221 is sent to task creation subelement 2222, above-mentioned task wound Build subelement 2222 and above-mentioned detection mission is built according to the test index of above-mentioned data source.
Above-mentioned Dispatching Unit 223 is used for above-mentioned task creation unit 222 and created after detection mission, by above-mentioned detection mission point Issue the data capture unit 231 of above-mentioned data acquisition adaptation module 230;
Above-mentioned task creation subelement 2222 is created after detection mission, and above-mentioned detection mission is sent into above-mentioned Dispatching Unit 223;The data source that above-mentioned Dispatching Unit 223 is obtained in above-mentioned detection mission obtains address, and above-mentioned detection mission is distributed to State the data capture unit 231 that data source obtains the corresponding data acquisition adaptation module 230 in address.
Alternatively, above-mentioned data task management module 220 also includes:
Second judging unit 224, for judging above-mentioned detection mission;
Cycle start unit 225, if being timed task for above-mentioned detection mission, in the setting time cycle, starts above-mentioned Detection mission.
For example, the task creation unit 222 of above-mentioned data task management module 220 is set up after above-mentioned detection mission, will be upper State detection mission and be sent to above-mentioned second judging unit 224, whether judge above-mentioned detection mission is periodic cells, if it is, Then cycles per instruction is sent to above-mentioned cycle start unit 225;In the above-mentioned setting time cycle of cycle start unit 225, start above-mentioned Detection mission.
For example, above-mentioned detection mission is the type data task on demand of single, then above-mentioned second judging unit 224 sends single The instruction of task, makes above-mentioned file distributing unit 223 that above-mentioned detection mission is distributed into above-mentioned data acquisition adaptation module 230 Data capture unit 231;If above-mentioned second judging unit 224 judges above-mentioned detection mission for periodic task, above-mentioned second Judging unit 224 sends the instruction of cycle startup to above-mentioned cycle start unit 225, such as, starts within each 5 minutes once above-mentioned Detection mission, makes above-mentioned file distributing unit obtain above-mentioned data source according to above-mentioned data capture unit 231 in 223 each 5 minutes.
Above-mentioned data acquisition adaptation module 230 includes data capture unit 231 and data adaptation unit 232;
Above-mentioned data capture unit 231 is used to receive after the above-mentioned detection mission that above-mentioned Dispatching Unit 223 is sent, according to upper State detection mission and obtain above-mentioned data source;
Above-mentioned data capture unit 231 is received after above-mentioned detection mission, obtains above-mentioned data source;If above-mentioned data source is day Will data, then the above-mentioned inquiry log of data capture unit 231, obtains data source from daily record;If above-mentioned data source is database Data, then above-mentioned data capture unit 231 above-mentioned data source is obtained from database;The form of above-mentioned data source is each comfortable former Form in memory.Above-mentioned data source is sent to above-mentioned adaptation unit 232 by above-mentioned data capture unit 231.
Above-mentioned data adaptation unit 232 is obtained after above-mentioned data source for above-mentioned data capture unit 231, by above-mentioned data Source, which is converted into after general format, to be sent to above-mentioned data processing centre 240;
Above-mentioned data adaptation unit 240 is received after above-mentioned data source, and above-mentioned data source is converted into the general number of the system According to form, so as to so that the unobstructed circulation and calculating in the present system of above-mentioned data source so that other modules or unit are to upper The form for stating data source being capable of quick response.
Such as data source A comes from the data of database, and the data format that data source getter is got is usually many Data of row, such as lane database has user name and the row of age of user two, then the data format that getter is taken is exactly Two column datas, first row is user name, and secondary series is the age, due to being multirow data, so can be a line a line during storage, It is an array per a line, this is the form that data source getter is taken.The universal data format of the system is json data lattice Formula, form such as { " name ":" Zhang San ", " age ":25 } it is such, but the data that data source getter is got are [[' name ', ' age '], [' Zhang San ', 25]], it is therefore desirable to which data source adapter makes corresponding adaptation modification, by form modifying For the general format of the system.Wherein, json data formats (JavaScript Object Notation) refer to a kind of light weight The data interchange format of level.
The data source of universal data format is transmitted to above-mentioned data processing centre 240 by above-mentioned data adaptation unit 232.
Above-mentioned data processing centre 240 is used for after the data source that above-mentioned data adaptation unit 232 sends general format, will be upper The data source for stating general format is calculated according to the requirement of above-mentioned detection mission;And by above-mentioned result of calculation be sent to it is above-mentioned can Depending on changing module 210.
Above-mentioned data processing centre 240 carries out judging above-mentioned to the data source of above-mentioned general format according to above-mentioned detection mission Whether data source closes rule, will determine that the data for not conforming to rule are deleted, and entering row index to the remaining data for closing rule calculates;By index Result of calculation is preserved and is sent to above-mentioned visualization model;The man-machine interface of above-mentioned visualization model calculates These parameters As a result user is showed.
Alternatively,
Above-mentioned data task management module 220 also includes:
Feedback unit 226 is not supported, if judging above-mentioned according to above-mentioned probe requests thereby for above-mentioned data task management module The type of data source is not supported to be tested, then is returned to above-mentioned visualization model and do not support test post;
Obtain bound cell 227, for above-mentioned visualization model receive it is above-mentioned do not support after test post, by above-mentioned data The corresponding plug-in unit of type in source is uploaded to above-mentioned data task management module;
Plug-in unit loading unit 228, is loaded onto above-mentioned data acquisition by above-mentioned plug-in unit for above-mentioned task management module and is adapted to Module;
Above-mentioned data acquisition adaptation module 230 also includes:
Date Conversion Unit 233, it is according to above-mentioned plug-in unit that above-mentioned plug-in unit is corresponding for above-mentioned data acquisition adaptation module Data source types are converted to general format, above-mentioned data processing centre is handled above-mentioned data source.
If the first judging unit 211 of above-mentioned data task management module 220 is received after above-mentioned probe requests thereby, above-mentioned One judging unit 211 inquires about the corresponding plug-in unit of above-mentioned data source types not according to the corresponding data source types of above-mentioned probe requests thereby Stored in above-mentioned data task management module 220;Feedback unit 226 is not supported then to be returned not to above-mentioned visualization model 210 Support test post.
Above-mentioned visualization model 210 obtain it is above-mentioned do not support after test post, those skilled in the art are by above-mentioned data source The type support of above-mentioned data source, task parsing, tasks carrying, result are delivered each step and use generation by type package into plug-in unit The mode of code develops into plug-in code, wherein, each plug-in unit has corresponding interface:Plug-in unit, unloading plug-in unit are loaded, reads and visits The configuration of survey task, execution task, return task action result data;Above-mentioned plug-in code is packaged into a jar file, i.e., on The corresponding plug-in unit of detection agreement is stated, the acquisition bound cell 227 of above-mentioned data task management module 220 is uploaded to.Wherein, it is above-mentioned Jar file (jar file form is based on popular ZIP file form), for script, source code file is inherently Can exist with add-on file, it is not necessary to extra packing process.
Above-mentioned acquisition bound cell 227 is received after above-mentioned plug-in unit, will by above-mentioned plug-in unit loading unit 228 by above-mentioned plug-in unit Above-mentioned plug-in unit is stored and sent to above-mentioned data acquisition video module 230.
The general format of above-mentioned the system refers to that the system artificially provides or used mechano-linguistics according to test index The general format of habit.
For example, the index in above-mentioned detection mission is extracted the name of minimus 10 people in data source A, then Above-mentioned data capture unit 231 gets data source A from database, and above-mentioned data adaptation unit 232 turns above-mentioned data source A The general format [[' name ', ' age '], [' Zhang San ', 25]] for changing the system into sends above-mentioned data processing centre 240 afterwards.On State data processing centre 240 to judge the data source A under above-mentioned general format, the data for not conforming to rule are deleted, as described above [' Zhang San ', 25] part in form, any part is sky, then judges that above-mentioned data do not conform to rule.Wherein, if above-mentioned data without Method calculates and obtains These parameters, then above-mentioned data are the data for not conforming to rule.
Above-mentioned data processing centre 240 carries out getting the conjunction rule for meeting the system after judgement cleaning to above-mentioned data source A Data source B, then the index of above-mentioned detection mission is calculated according to above-mentioned data source B.Above-mentioned data processing centre 240 is to above-mentioned number Required achievement data can be produced by having gone out during being calculated according to source A, while a kind of raw data can be produced.Above-mentioned raw data Referring to system acquisition time has an intervals, the index of the viewing number of times of such as one web video, if we Each minute of system when can count once, obtain the viewing number of times in this minute, then the leader of company may The viewing number of times of one day of the video is wished to, then what we to be done is exactly data aggregate, by the viewing of each minute time Number does cumulative, becomes the viewing number of times of one day, as raw data are with metric data in such cases, is all one The numerical value of individual viewing number of times;By way of further example, it is now desired to be user watch a video average latency, we are still The data of inquiry in right one minute, have obtained that [user 1:10 seconds, user 2:20 seconds] etc. data, then by the way that calculate can be with It is 15 seconds to obtain average delay, if company leader need to see one day average latency what ifWe can not be by Average latency per minute is added again divided by one day the number of minutes, because the viewing number of times of each minute is different, Correct way should be that average latency per minute and viewing number of times per minute are all saved, and be used as raw Data, during the average latency for then calculating one day, is multiplied by viewing number of times by the average latency per minute, then adds up Come, divided by viewing number of times total in one day, it is exactly average latency of one day so to calculate.For example 10 o'clock had 100 Secondary viewing, average delay is 10 seconds, there is 200 viewings 11 o'clock, and average delay is 20 seconds, then the two hours it is flat Delay is (100 times+200 times * 20 seconds * 10 seconds)/(100 times+200 times)=16.67 seconds, without that should be (10 seconds Clock+20 seconds)/2=15 seconds.
The embodiment of the present invention includes advantages below:
When detecting different types of data source, check whether the above-mentioned data task management module of the system supports above-mentioned number According to the type in source, the data task management module of the system can be used to create detection mission if supporting, make the system to not Same data source types have expanded compatibility;Therefore, solving different data source types is needing what is detected into row index When time cost and the problem of high human cost, save exploitation manpower of the different team to protocol detection, reduce the time Cost;Meanwhile, when needing to detect into row index, the system can be based on, in above-mentioned data task management module Plug-in unit is updated, then the system is supported the detection demand of new data source types;Further, above-mentioned data task management module In plug-in unit support different departments of team agreement demand for services, all departments is carried out protocol service based on the system Detection, saves overall human resources.
Embodiment three
Reference picture 3, shows a kind of method and step stream of data source expandable method according to an embodiment of the invention Cheng Tu, can specifically include S301-S307:
S301, visualization model creates probe requests thereby according to the type of data source, and above-mentioned probe requests thereby is sent into data Task management module.
User confirms to need after detected data source types, according to above-mentioned number in visualization model human-computer interaction interface Probe requests thereby is created according to Source Type;After above-mentioned probe requests thereby is created successfully, above-mentioned probe requests thereby is sent to above-mentioned data task Management module.
Alternatively, above-mentioned visualization model provides a user a personal-machine interactive interface, for example, web interface, for user Above-mentioned probe requests thereby is created according to above-mentioned detected data source.
S302, data task management module judges whether the type of above-mentioned data source is supported to be tested according to above-mentioned probe requests thereby Examination.
In the embodiment of the present invention, above-mentioned data task management module searches above-mentioned data task according to above-mentioned data source types Whether above-mentioned data source types corresponding plug-in unit is stored in the memory cell of management module;If the type of above-mentioned data source supports quilt Test, then perform S303.
S303, if the type of above-mentioned data source supports tested, above-mentioned data task management module creates detection mission.
If storing the corresponding plug-in unit of above-mentioned data source in memory cell, send plug-in unit to above-mentioned visualization model and confirm to order Order;Above-mentioned visualization model receives above-mentioned plug-in unit and confirms after order that user passes through class of the above-mentioned visualization model according to data source Type confirms that the index and data source that perform above-mentioned data source detection obtain address;Above-mentioned visualization model is by the class of above-mentioned data source The index and data source of type and above-mentioned data source detection obtain address and are sent to above-mentioned data task management module.
Above-mentioned data task management module is according to the type of above-mentioned data source and the index and data of above-mentioned data source detection Source obtains address creation detection mission.
Above-mentioned detection mission is distributed to data acquisition adaptation module by S304, above-mentioned data task management module.
Above-mentioned detection mission is distributed to corresponding data acquisition adaptation module by above-mentioned data task management module.
S305, above-mentioned data acquisition adaptation module obtains above-mentioned data source according to above-mentioned detection mission.
Above-mentioned data acquisition adaptation module is received after above-mentioned detection mission, obtains above-mentioned data source;If above-mentioned data source is Daily record data, then above-mentioned data acquisition adaptation module inquiry log, obtains data source from daily record;If above-mentioned data source is data Storehouse data, then above-mentioned data acquisition adaptation module above-mentioned data source is obtained from database;The form of above-mentioned data source is respective Form in former memory.
S306, above-mentioned data source is converted into after general format by above-mentioned data acquisition adaptation module to be sent to above-mentioned data Reason center.
Above-mentioned data acquisition adaptation module is obtained after above-mentioned data source, and above-mentioned data source is converted into after general format and sent To above-mentioned data processing centre.
S307, above-mentioned data processing centre carries out the data source of above-mentioned general format according to the requirement of above-mentioned detection mission Calculate;And above-mentioned result of calculation is sent to above-mentioned visualization model.
Above-mentioned data processing centre carries out judging above-mentioned number to the data source of above-mentioned general format according to above-mentioned detection mission Rule whether are closed according to source, will determine that the data for not conforming to rule are deleted, entering row index to the remaining data for closing rule calculates;By index meter Result is calculated to be preserved and be sent to above-mentioned visualization model;These parameters are calculated and tied by the man-machine interface of above-mentioned visualization model Fruit shows user.
The embodiment of the present invention includes advantages below:
When detecting different types of data source, check whether the above-mentioned data task management module of the system supports above-mentioned number According to the type in source, the data task management module of the system can be used to create detection mission if supporting, make the system to not Same data source types have expanded compatibility;Therefore, solving different data source types is needing what is detected into row index When time cost and the problem of high human cost, save exploitation manpower of the different team to protocol detection, reduce the time Cost.
Example IV
Reference picture 4, shows a kind of method and step stream of data source expandable method according to an embodiment of the invention Cheng Tu, can specifically include S401-S411:
S401, visualization model creates probe requests thereby according to the type of data source, and above-mentioned probe requests thereby is sent into data Task management module.
S402, data task management module judges whether the type of above-mentioned data source is supported to be tested according to above-mentioned probe requests thereby Examination.
If the type of above-mentioned data source supports tested, S403 is performed;If the type of above-mentioned data source is not supported to be tested Examination, then perform S408.
S403, if the type of above-mentioned data source supports tested, above-mentioned data task management module creates detection mission.
Alternatively, the process of above-mentioned data task management module establishment detection mission includes:Above-mentioned data task manages mould Block returns to the message for supporting test to above-mentioned visualization model;Above-mentioned visualization model sends the test index of above-mentioned data source To above-mentioned data task management module;Above-mentioned detection mission is created according to the test index of above-mentioned data source.
Above-mentioned data task management module searches the storage of above-mentioned data task management module according to above-mentioned data source types Whether above-mentioned data source types corresponding plug-in unit is stored in unit;If storing the corresponding plug-in unit of above-mentioned data source in memory cell, Then plug-in unit is sent to above-mentioned visualization model to confirm to order;Above-mentioned visualization model receives above-mentioned plug-in unit and confirmed after order, user Confirm that the index and data source that perform above-mentioned data source detection obtain ground according to the type of data source by above-mentioned visualization model Location;The index and data source of the type of above-mentioned data source and above-mentioned data source detection are obtained address and sent by above-mentioned visualization model To above-mentioned data task management module.
Above-mentioned data task management module is according to the type of above-mentioned data source and the index and data of above-mentioned data source detection Source obtains address creation detection mission.
Above-mentioned detection mission is distributed to data acquisition adaptation module by S404, above-mentioned data task management module.
Above-mentioned detection mission is distributed to corresponding data acquisition adaptation module by above-mentioned data task management module.
Alternatively, above-mentioned data task management module is judged above-mentioned detection mission;
If above-mentioned detection mission is timed task, in the setting time cycle, start above-mentioned detection mission.
For example, above-mentioned detection mission is the type data task on demand of single, then above-mentioned data task management module sends single The instruction of subtask, above-mentioned data acquisition adaptation module is distributed to by above-mentioned detection mission;If data task management module judges Above-mentioned detection mission is periodic task, then sets the cycle to start the instruction of above-mentioned detection mission, such as, starts every 5 minutes Once above-mentioned detection mission, the instruction that above-mentioned data source was obtained every 5 minutes is sent to above-mentioned data acquisition video module.
S405, above-mentioned data acquisition adaptation module obtains above-mentioned data source according to above-mentioned detection mission.
Above-mentioned data acquisition adaptation module is received after above-mentioned detection mission, obtains above-mentioned data source;If above-mentioned data source is Daily record data, then above-mentioned data acquisition adaptation module inquiry log, obtains data source from daily record;If above-mentioned data source is data Storehouse data, then above-mentioned data acquisition adaptation module above-mentioned data source is obtained from database;The form of above-mentioned data source is respective Form in former memory.
S406, above-mentioned data source is converted into after general format by above-mentioned data acquisition adaptation module to be sent to above-mentioned data Reason center.
Above-mentioned data acquisition adaptation module is obtained after above-mentioned data source, and above-mentioned data source is converted into after general format and sent To above-mentioned data processing centre.
S407, above-mentioned data processing centre carries out the data source of above-mentioned general format according to the requirement of above-mentioned detection mission Calculate;And above-mentioned result of calculation is sent to above-mentioned visualization model.
Above-mentioned data processing centre carries out judging above-mentioned number to the data source of above-mentioned general format according to above-mentioned detection mission Rule whether are closed according to source, will determine that the data for not conforming to rule are deleted, entering row index to the remaining data for closing rule calculates;By index meter Result is calculated to be preserved and be sent to above-mentioned visualization model;These parameters are calculated and tied by the man-machine interface of above-mentioned visualization model Fruit shows user.
S408, if above-mentioned data task management module judges that the type of above-mentioned data source is not supported according to above-mentioned probe requests thereby It is tested, then returned to above-mentioned visualization model and do not support test post.
If above-mentioned data task management module is received after above-mentioned probe requests thereby, according to the corresponding data of above-mentioned probe requests thereby Source Type, inquires about the corresponding plug-in unit of above-mentioned data source types and is stored not in above-mentioned data task management module, then judge above-mentioned The type of data source is not supported to be tested, and does not support test post to the return of above-mentioned visualization model.
S409:Above-mentioned visualization model reception is above-mentioned not to be supported after test post, and the type of above-mentioned data source is corresponding Plug-in unit is uploaded to above-mentioned data task management module.
Above-mentioned visualization model obtain it is above-mentioned does not support after test post, those skilled in the art are by above-mentioned data source types Plug-in unit is packaged into, the type support of above-mentioned data source, task parsing, tasks carrying, result are delivered into each step code Mode develops into plug-in code, wherein, each plug-in unit has corresponding interface:Load plug-in unit, unloading plug-in unit, read detection times Business configuration, execution task, return task action result data;Above-mentioned plug-in code is packaged into a jar file, i.e., above-mentioned spy The corresponding plug-in unit of agreement is surveyed, the acquisition bound cell of above-mentioned data task management module is uploaded to.Wherein, above-mentioned jar file (jar file form is based on popular ZIP file form), for script, source code file inherently can be with What add-on file was present, it is not necessary to extra packing process.
S410:Above-mentioned plug-in unit is loaded onto above-mentioned data acquisition adaptation module by above-mentioned task management module;
In the embodiment of the present invention, the acquisition bound cell of above-mentioned data task management module is received after above-mentioned plug-in unit, will be upper Plug-in unit is stated above-mentioned plug-in unit is stored and sent to above-mentioned data acquisition adaptation module by above-mentioned plug-in unit loading unit.
S411:Above-mentioned data acquisition adaptation module is converted to the corresponding data source types of above-mentioned plug-in unit according to above-mentioned plug-in unit General format, makes above-mentioned data processing centre handle above-mentioned data source.
The general format of above-mentioned the system refers to that the system artificially provides or used mechano-linguistics according to test index The general format of habit.
The embodiment of the present invention includes advantages below:
When detecting different types of data source, check whether the above-mentioned data task management module of the system supports above-mentioned number According to the type in source, the data task management module of the system can be used to create detection mission if supporting, make the system to not Same data source types have expanded compatibility;Therefore, solving different data source types is needing what is detected into row index When time cost and the problem of high human cost, save exploitation manpower of the different team to protocol detection, reduce the time Cost;Meanwhile, when needing to detect into row index, the system can be based on, in above-mentioned data task management module Plug-in unit is updated, then the system is supported the detection demand of new data source types;Further, above-mentioned data task management module In plug-in unit support different departments of team agreement demand for services, all departments is carried out protocol service based on the system Detection, saves overall human resources.
For embodiment of the method, because it is substantially similar to device embodiment, so description is fairly simple, it is related Part illustrates referring to the part of embodiment of the method.
Algorithm and display be not inherently related to any certain computer, virtual system or miscellaneous equipment provided herein. Various general-purpose systems can also be used together with based on teaching in this.As described above, construct required by this kind of system Structure be obvious.In addition, the present invention is not also directed to any certain programmed language.It is understood that, it is possible to use it is various Programming language realizes the content of invention described herein, and the description done above to language-specific is to disclose this hair Bright preferred forms.
In the specification that this place is provided, numerous specific details are set forth.It is to be appreciated, however, that the implementation of the present invention Example can be put into practice in the case of these no details.In some instances, known method, structure is not been shown in detail And technology, so as not to obscure the understanding of this description.
Similarly, it will be appreciated that in order to simplify the disclosure and help to understand one or more of each inventive aspect, exist Above in the description of the exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes In example, figure or descriptions thereof.However, the method for the disclosure should be construed to reflect following intention:It is i.e. required to protect The application claims of shield features more more than the feature being expressly recited in each claim.More precisely, such as following Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore, Thus the claims for following embodiment are expressly incorporated in the embodiment, wherein each claim is in itself All as the separate embodiments of the present invention.
Those skilled in the art, which are appreciated that, to be carried out adaptively to the module in the equipment in embodiment Change and they are arranged in one or more equipment different from the embodiment.Can be the module or list in embodiment Member or component be combined into a module or unit or component, and can be divided into addition multiple submodule or subelement or Sub-component.In addition at least some in such feature and/or process or unit exclude each other, it can use any Combination is disclosed to all features disclosed in this specification (including adjoint claim, summary and accompanying drawing) and so to appoint Where all processes or unit of method or equipment are combined.Unless expressly stated otherwise, this specification (including adjoint power Profit is required, summary and accompanying drawing) disclosed in each feature can or similar purpose identical, equivalent by offer alternative features come generation Replace.
Although in addition, it will be appreciated by those of skill in the art that some embodiments described herein include other embodiments In included some features rather than further feature, but the combination of the feature of be the same as Example does not mean in of the invention Within the scope of and form different embodiments.For example, in the following claims, times of embodiment claimed One of meaning mode can be used in any combination.
The present invention all parts embodiment can be realized with hardware, or with one or more processor run Software module realize, or realized with combinations thereof.It will be understood by those of skill in the art that can use in practice Microprocessor or digital signal processor (DSP) come realize the expansible system of a kind of data source according to embodiments of the present invention and The some or all functions of some or all parts in method.The present invention is also implemented as being used to perform being retouched here The some or all equipment or program of device (for example, computer program and computer program product) for the method stated. Such program for realizing the present invention can be stored on a computer-readable medium, or can have one or more signal Form.Such signal can be downloaded from internet website and obtained, either on carrier signal provide or with it is any its He provides form.
It should be noted that the present invention will be described rather than limits the invention for above-described embodiment, and ability Field technique personnel can design alternative embodiment without departing from the scope of the appended claims.In the claims, Any reference symbol between bracket should not be configured to limitations on claims.Word "comprising" is not excluded the presence of not Element or step listed in the claims.Word "a" or "an" before element does not exclude the presence of multiple such Element.The present invention can be by means of including the hardware of some different elements and coming real by means of properly programmed computer It is existing.In if the unit claim of equipment for drying is listed, several in these devices can be by same hardware branch To embody.The use of word first, second, and third does not indicate that any order.These words can be explained and run after fame Claim.

Claims (8)

1. a kind of expansible system of data source, it is characterised in that the system includes visualization model, data task management mould Block, data processing centre and data acquisition adaptation module;
The visualization model includes request creating unit;
The request creating unit is used to create probe requests thereby according to the type of data source, the probe requests thereby is sent to described First judging unit of data task management module;
The data task management module includes the first judging unit, task creation unit and Dispatching Unit;
First judging unit is used to receive after the probe requests thereby that the request creating unit is sent, and is visited according to described Survey request and judge whether the type of the data source is supported to be tested;
The task creation unit is used for first judging unit and judges that the type of the data source is supported after being tested, then creates Build detection mission;
The Dispatching Unit is used for the task creation unit and created after detection mission, and the detection mission is distributed into the number According to the data capture unit for obtaining adaptation module;
The data acquisition adaptation module includes data capture unit and data adaptation unit;
The data capture unit is used to receive after the detection mission that the Dispatching Unit is sent, according to the detection mission Obtain the data source;
The data adaptation unit is used for the data capture unit and obtained after the data source, the data source is converted into logical With being sent after form to the data processing centre;
The data processing centre is used for after the data source that the data adaptation unit sends general format, by the general format Data source calculated according to the requirement of the detection mission;And the result of calculation is sent to the visualization model.
2. system according to claim 1, it is characterised in that the task creation unit includes:
Index receiving subelement, the test index for receiving the data source that the visualization model is sent;
Task creation subelement, for creating the detection mission according to the test index of the data source.
3. system according to claim 1, it is characterised in that
The data task management module also includes:
Feedback unit is not supported, if judging the data source according to the probe requests thereby for the data task management module Type is not supported to be tested, then is returned to the visualization model and do not support test post;
Bound cell is obtained, for not supported described in visualization model reception after test post, by the class of the data source The corresponding plug-in unit of type is uploaded to the data task management module;
Plug-in unit loading unit, is loaded onto the data acquisition by the plug-in unit for the data task management module and is adapted to mould Block;
The data acquisition adaptation module also includes:
Date Conversion Unit, for the data acquisition adaptation module according to the plug-in unit by the corresponding data source class of the plug-in unit Type is converted to general format, the data processing centre is handled the data source.
4. system according to claim 1, it is characterised in that the data task management module also includes:
Second judging unit, for judging the detection mission;
Cycle start unit, if being timed task for the detection mission, in the setting time cycle, starts the detection and appoints Business.
5. a kind of data source expandable method, it is characterised in that including:
Visualization model creates probe requests thereby according to the type of data source, and the probe requests thereby is sent into data task management mould Block;
Data task management module judges whether the type of the data source is supported to be tested according to the probe requests thereby;
If the type of the data source supports tested, the data task management module creates detection mission;
The detection mission is distributed to data acquisition adaptation module by the data task management module;
The data acquisition adaptation module obtains the data source according to the detection mission;
The data source is converted into after general format by the data acquisition adaptation module to be sent to the data processing centre;
The data processing centre is calculated the data source of the general format according to the requirement of the detection mission;And will The result of calculation is sent to the visualization model.
6. method according to claim 5, it is characterised in that if the type of the data source supports tested, The step of creating detection mission, including:
The data task management module returns to the message for supporting test to the visualization model;
The test index of the data source is sent to the data task management module by the visualization model;
The detection mission is created according to the test index of the data source.
7. method according to claim 5, it is characterised in that also include:
If the data task management module judges that the type of the data source is not supported to be tested according to the probe requests thereby, Returned to the visualization model and do not support test post;
The visualization model is not supported after test post described in receiving, and the corresponding plug-in unit of the type of the data source is uploaded to The data task management module;
The plug-in unit is loaded onto the data acquisition adaptation module by the data task management module;
The corresponding data source types of the plug-in unit are converted to general format by the data acquisition adaptation module according to the plug-in unit, The data processing centre is set to handle the data source.
8. method according to claim 5, it is characterised in that the data task management module divides the detection mission After the step of issuing data acquisition adaptation module, in addition to:
The data task management module is judged the detection mission;
If the detection mission is timed task, in the setting time cycle, start the detection mission.
CN201710392604.9A 2017-05-27 2017-05-27 data source extensible system and method Active CN107317722B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710392604.9A CN107317722B (en) 2017-05-27 2017-05-27 data source extensible system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710392604.9A CN107317722B (en) 2017-05-27 2017-05-27 data source extensible system and method

Publications (2)

Publication Number Publication Date
CN107317722A true CN107317722A (en) 2017-11-03
CN107317722B CN107317722B (en) 2020-01-31

Family

ID=60181527

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710392604.9A Active CN107317722B (en) 2017-05-27 2017-05-27 data source extensible system and method

Country Status (1)

Country Link
CN (1) CN107317722B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107332730A (en) * 2017-06-19 2017-11-07 北京奇艺世纪科技有限公司 A kind of agreement expansible service availability detection system and method
CN109995703A (en) * 2017-12-29 2019-07-09 中国移动通信集团云南有限公司 A kind of data source safety detection method and Edge Server
CN111600771A (en) * 2020-04-14 2020-08-28 新浪网技术(中国)有限公司 Network resource detection system and method

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102231686A (en) * 2011-06-24 2011-11-02 北京天融信科技有限公司 System and method for implementing automated test of network security equipment
CN103036736A (en) * 2012-11-30 2013-04-10 航天恒星科技有限公司 Configuration equipment monitoring system and monitoring method based on data sources
CN103279336A (en) * 2013-01-06 2013-09-04 北京慧正通软科技有限公司 Workflow engine multi-data source processing method
CN103902286A (en) * 2014-03-12 2014-07-02 郑州轻工业学院 Hierarchy type multi-source data fusion method based on SOA
CN105243333A (en) * 2015-08-28 2016-01-13 苏州国云数据科技有限公司 Multi-data-source remote access method
CN105260177A (en) * 2015-09-21 2016-01-20 广东大工数值仿真研究院有限公司 SiPESC platform based Python extension module development method
CN105487867A (en) * 2015-11-26 2016-04-13 中国空间技术研究院 Lightweight visual satellite testing program design system and method
CN105512168A (en) * 2015-11-16 2016-04-20 天津南大通用数据技术股份有限公司 Cluster database composite data loading method and apparatus

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102231686A (en) * 2011-06-24 2011-11-02 北京天融信科技有限公司 System and method for implementing automated test of network security equipment
CN103036736A (en) * 2012-11-30 2013-04-10 航天恒星科技有限公司 Configuration equipment monitoring system and monitoring method based on data sources
CN103036736B (en) * 2012-11-30 2015-09-23 航天恒星科技有限公司 A kind of configuration equipment monitoring system based on data source and method
CN103279336A (en) * 2013-01-06 2013-09-04 北京慧正通软科技有限公司 Workflow engine multi-data source processing method
CN103902286A (en) * 2014-03-12 2014-07-02 郑州轻工业学院 Hierarchy type multi-source data fusion method based on SOA
CN105243333A (en) * 2015-08-28 2016-01-13 苏州国云数据科技有限公司 Multi-data-source remote access method
CN105260177A (en) * 2015-09-21 2016-01-20 广东大工数值仿真研究院有限公司 SiPESC platform based Python extension module development method
CN105512168A (en) * 2015-11-16 2016-04-20 天津南大通用数据技术股份有限公司 Cluster database composite data loading method and apparatus
CN105487867A (en) * 2015-11-26 2016-04-13 中国空间技术研究院 Lightweight visual satellite testing program design system and method

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107332730A (en) * 2017-06-19 2017-11-07 北京奇艺世纪科技有限公司 A kind of agreement expansible service availability detection system and method
CN107332730B (en) * 2017-06-19 2020-04-21 北京奇艺世纪科技有限公司 Protocol extensible service availability detection system and method
CN109995703A (en) * 2017-12-29 2019-07-09 中国移动通信集团云南有限公司 A kind of data source safety detection method and Edge Server
CN111600771A (en) * 2020-04-14 2020-08-28 新浪网技术(中国)有限公司 Network resource detection system and method

Also Published As

Publication number Publication date
CN107317722B (en) 2020-01-31

Similar Documents

Publication Publication Date Title
EP3447642B1 (en) System and method for predicting application performance for large data size on big data cluster
CN107450941B (en) Automatic packaging method, device, storage medium and computer equipment
CN108647141A (en) Automatic test approach, device, computer-readable medium and electronic equipment
US8832658B2 (en) Verification framework for business objects
US11200157B1 (en) Automated execution reporting for container builds
US8732838B2 (en) Evaluating the effectiveness of a threat model
CN106294094A (en) The method of testing of game server, client, server and system
CN107239271A (en) Develop document structure tree method and device
CN107317722A (en) A kind of expansible system and method for data source
CN103870591B (en) Method and system for carrying out parallel spatial analysis service based on spatial data
CN107145438A (en) Code test method, code tester device and code tester system
EP2492806A1 (en) Unified interface for meta model checking, modifying, and reporting
CN109685089A (en) The system and method for assessment models performance
CN109753432A (en) A kind of interface performance test method, apparatus, server and system
US9778955B2 (en) Task processing utilizing queues
CN105262835A (en) Data storage method and device of multiple machine rooms
CN107944000A (en) Flight freight rate update method, device, electronic equipment, storage medium
CN110196809A (en) Interface test method and device
CN110147327A (en) A kind of web automatic test management method based on more granularities
CN107065663A (en) A kind of unit malfunction test method and its mobile terminal, unit malfunction test system
CN103544271B (en) Load Image in a kind of browser the method and apparatus for processing window
EP2954445A1 (en) Methods and apparatus for data-driven monitoring
CN107436846A (en) Method of testing, device, calculate readable storage medium storing program for executing and computing device
CN107403112A (en) Data verification method and its equipment
CN108023905A (en) Internet of things application system and method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant