CN102929899A - Distributed reporting system based on intermediate table - Google Patents
Distributed reporting system based on intermediate table Download PDFInfo
- Publication number
- CN102929899A CN102929899A CN 201110461917 CN201110461917A CN102929899A CN 102929899 A CN102929899 A CN 102929899A CN 201110461917 CN201110461917 CN 201110461917 CN 201110461917 A CN201110461917 A CN 201110461917A CN 102929899 A CN102929899 A CN 102929899A
- Authority
- CN
- China
- Prior art keywords
- middle table
- module
- statistics
- reporting system
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a distributed reporting system based on an intermediate table. According to the invention, the problem on a poor performance of generating a statistical report for an original event under a large-scale event processing environment is solved by introducing the intermediate table to get phase-in statistics of an original large-scale event in real time. The classification and real-time statistics of the original event are realized through predefining some universal intermediate tables; statistical data in the intermediate tables is directly used to generate a statistical report; and report generating time and system resource occupation are greatly decreased by reducing scale of input data.
Description
Technical field
The present invention is a kind of distributed reporting system based on middle table, belongs to the integrated and applied technical field of computer system, is used for network security centralized management platform software major issue amount report form processing technology.
Background technology
Along with the development of network environment, the expansion of scale, the application of network security centralized management platform software system is also more and more extensive.These class software systems all can comprise various routers, switch, fire wall, VPN, memory device etc. by operation, access or the alarm log of collecting various device in the network environment usually, analyze, predict and represent safe coefficient in the network environment.And because the continuous increase of network environment various device, the enriching constantly of device type, the log recording quantity of the required collection of network security centralized management platform software system is rapid growth also.
Because log recording quantity is big, can not require the keeper one by one analysis all to be checked in each bar daily record, thereby how can grasp so state and the security level of the basic condition awareness network environment of daily record as the keeper? check that statistical forms is exactly an inevitable demand.So-called statistical forms, that is to say not to be the detailed form of simply enumerating to log recording, but according to some conditions (classified statistics, ordering, filtercondition etc.) of keeper's appointment, original log recording is analyzed, and the form that presents afterwards statistics is only significant.
The statistical study of pairing approximation mass data is a task easily never, and is like this equally to the analysis of log recording.Because the enormous amount of log recording always had many restrictions to the statistical study of raw readings in the past, often between the speed of adding up and real-time, can not take into account.If require to obtain as early as possible statistics, the raw data time range of analyzing so just can not be too large, often can only be the data in several hours; If ask real-time as far as possible high, may add up with regard to needing the long time so, if more this time of field of analyzing often may be above one day.In addition, because log recording often all has more field, when statistical study, also tend to limit the field of use, usually field that can event is not all is as selecting static fields, and only be with some general and generally believe that important field includes the scope that can add up in, thereby guarantee certain statistical efficiency and time.
Summary of the invention
The present invention designs for above-mentioned prior art situation just a kind of distributed reporting system based on middle table is provided, and its objective is the treatment effeciency that improves reporting system under the environment that mass incident is processed.
The present invention solves under the mass incident processing environment the not good problem of primitive event generation statistical report form performance by adopting the introducing middle table that original mass incident is carried out the real-time stage by stage mode of statistics.By some general middle table of predefine, primitive event is classified and real-time statistics, when generating statistical report form, directly use the statistics in the middle table, by the scale of minimizing input data, thereby greatly reduce the time of generating report forms and taking system resource.
The objective of the invention is to be achieved through the following technical solutions:
This kind comprises server and the network equipment as the host based on the distributed reporting system of middle table, it is characterized in that: this system comprises middle table administrative unit A, form operational management unit B and management platform service unit C, wherein:
Middle table administrative unit A comprises:
Middle table document management module, this module are responsible for the middle table description document that is stored in the file system is read, and are stored in the internal memory, use for other modules;
The middle table initialization module, this module is by form operational management unit triggers, the content of being responsible for all middle table description document that the middle table document management module is loaded is converted into the object form that computing machine can be understood, one by one initialization, this module can be kept at all middle table objects after the initialization in the internal memory, calls at any time system is in service;
Be defined as follows content in the middle table object:
Attribute specification
Table name: middle table is built the title that table uses in database;
Title: the title of identification middle table in administrative center's system platform;
The operation interval: middle table is once added up and time between the statistics next time, and unit is minute that minimum value is 1 minute;
The field that comprises: when the whole fields that comprise in the middle table, administrative center's system platform are made form according to middle table, the field scope that can use;
All select all can be used as grouping field when SQL statement is added up in assembling as the field of middle table, and create index;
Each middle table can comprise automatically that volume of event, transmitted traffic, reception flow and total flow are kept in the middle table as the statistical value of each statistics, and offers when making form and use;
Condition: the event scope of selecting when middle table is added up;
Middle table is built the table module, and what this module was responsible for assembling the middle table definition builds the table SQL statement, and carries out the table process of building, and also namely carries out creating the table SQL statement, creates corresponding tables of data in database;
Middle table statistical module, this module are responsible for assembling the statistics SQL statement of middle table, in the scheduling process of reporting system, by form operational management cell call, carry out statistical work, and statistics is write in the tables of data in database corresponding to middle table, also namely carry out the statistics SQL statement;
Management platform service unit B exists as the support unit of reporting system, does not directly finish the function of reporting system, and provides the needed part basic function of reporting system, and it comprises:
File system access module, this module provide unified interface and the method for access computer file system, and the method that provides has: file reading, storage file and deleted file;
This module is used for the middle table statement file that the middle table document management module calls file system, with the use of standard reporting system to file system;
Database access module, this module provides unified interface and the method for accessing database, the information (user name, password, address etc.) of avoiding obtaining the database connection is scattered in reporting system everywhere, cause leakage and the inconvenience of change during database information of security information, the method that provides has: creation database table and data inserting in the database table;
Form operational management unit C is the core component of reporting system, build the database access module of table module, middle table statistical module and management platform service unit B by middle table initialization administration module, middle table among the scheduling middle table administrative unit A, the middle table statistical module that complete call middle table administrative unit carries out initialization, periodically call the middle table administrative unit is carried out the action of middle table statistics, is provided report data by database table corresponding to management platform service unit access middle table.
Form operational management unit C comprises a distributed deployment administration module, and this module is used for the local reporting system of registration and management distribution deployment.The distributed report form processing mechanism of this kind, namely can distribute to be deployed on the different servers by the middle table that each is different and process and add up, thereby load is shared on each different server, thereby under the prerequisite that does not reduce the reporting system processing power, can effectively reduce reporting system taking the system resource of the server at the system platform place of administrative center.
Reporting system of the present invention occurs mainly as a service module of safety management platform system, also can be independent of the management platform system isolated operation, is used for providing statistics, operation, the stores service of form.No matter management platform or independent Report Forms Service platform finally all is installed in the high-performance hardware main frame runs in the network with server mode.
In addition, system of the present invention can also carry out spreading of data by distributed deployment administration module and local reporting system, this part reporting system is the subsystem of system of the present invention when distributed deployment, a local reporting system can be regarded as a complete reporting system based on middle table, structure is identical with system of the present invention.
The main design concept of the reporting system based on middle table of the present invention is by periodically using constantly representative middle table that primitive event is added up, when the needs generating report forms, directly in middle table, calculate and obtain final data, obtain balance best between the required real-time of generating report forms and the performance with this.
The good effect of technical solution of the present invention is:
The realization of system of the present invention can solve the contradiction of mass incident form between real-time and Statistical Speed to a certain extent preferably.Owing to adopting the statistical of middle table, every one shorter period, system namely can be on the backstage automatically the design according to middle table carry out the Intermediate Statistics computing, thereby effectively guaranteed the real-time of data; On the other hand, owing to having carried out the Intermediate Statistics computing, large-scale source event data are carried out effective statistics merged, reduced the data scale when form moves, thereby can effectively improve the timing statistics of form.In addition, because the design of middle table is subjected to too many restriction hardly, so the user can design different middle table according to the actual needs, thereby so that participate in the event attribute of statistical study and greatly increase, and be not subjected to artificial restriction.
Description of drawings
Fig. 1 is the composition schematic diagram of system of the present invention
Fig. 2 is the software flow pattern of the initialization flow process of system of the present invention
Fig. 3 is the software flow pattern of the statistics scheduling flow of system of the present invention
Fig. 4 is the software flow pattern of the report generation flow process of system of the present invention
Fig. 5 is the software flow pattern of the distributed deployment flow process of system of the present invention
Fig. 6 is the software flow pattern of the local reporting system register flow path of system of the present invention
Embodiment
Below with reference to drawings and Examples system of the present invention is further described:
Shown in accompanying drawing 1, this kind comprises server and the network equipment as the host based on the distributed reporting system of middle table, it is characterized in that: this system comprises middle table administrative unit A, form operational management unit B and management platform service unit C, wherein:
Middle table administrative unit A comprises:
Middle table document management module 1, this module are responsible for the middle table description document that is stored in the file system is read, and are stored in the internal memory, use for other modules;
Middle table initialization module 2, this module is by form operational management unit triggers, the content of being responsible for all middle table description document that middle table document management module 1 is loaded is converted into the object form that computing machine can be understood, one by one initialization, this module can be kept at all middle table objects after the initialization in the internal memory, calls at any time system is in service;
Be defined as follows content in the middle table object:
Attribute specification
Table name: middle table is built the title that table uses in database;
Title: the title of identification middle table in administrative center's system platform;
The operation interval: middle table is once added up and time between the statistics next time, and unit is minute that minimum value is 1 minute;
The field that comprises: when the whole fields that comprise in the middle table, administrative center's system platform are made form according to middle table, the field scope that can use;
All select all can be used as grouping field when SQL statement is added up in assembling as the field of middle table, and create index;
Each middle table can comprise automatically that volume of event, transmitted traffic, reception flow and total flow are kept in the middle table as the statistical value of each statistics, and offers when making form and use;
Condition: the event scope of selecting when middle table is added up;
Middle table is built table module 3, and what this module was responsible for assembling the middle table definition builds the table SQL statement, and carries out the table process of building, and also namely carries out creating the table SQL statement, creates corresponding tables of data in database;
Middle table statistical module 4, this module are responsible for assembling the statistics SQL statement of middle table, in the scheduling process of reporting system, by form operational management cell call, carry out statistical work, and statistics is write in the tables of data in database corresponding to middle table, also namely carry out the statistics SQL statement;
Management platform service unit B comprises:
File system access module 5, this module provide unified interface and the method for access computer file system, and the method that provides has: file reading, storage file and deleted file;
This module is used for the middle table statement file 8 that middle table document management module 1 calls file system, with the use of standard reporting system to file system;
Database access module 6, this module provide unified interface and the method for accessing database 9, and the method that provides has: creation database table and data inserting in the database table;
Form operational management unit C builds the database access module 6 of table module 3, middle table statistical module 4 and management platform service unit B by middle table initialization administration module 2, middle table among the scheduling middle table administrative unit A, the middle table statistical module that complete call middle table administrative unit carries out initialization, periodically call the middle table administrative unit is carried out the action of middle table statistics, provided report data by database table corresponding to management platform service unit access middle table.
Form operational management unit C comprises a distributed deployment administration module 7, and this module 7 is used for the local reporting system of registration and management distribution deployment.
Distributed reporting system based on middle table uses the Java programming language to realize, occurs with the form of a software service module as the safety management platform system, also can be independent of the management platform system isolated operation simultaneously.No matter management platform or independent Report Forms Service platform, final management platform and reporting system all are installed in the high performance bare machine main frame, run in the network with server mode.
Reporting system need to be aided with the safety management platform system provide the transmissions such as fire wall, IDS, main frame, application system, the network equipment, carry out computing and statistics through the event after the safety management platform engine normalized as source data.
Shown in Fig. 2～6, the course of work of the reporting system based on middle table of the present invention is comprised of initialization flow process, statistics scheduling flow, report generation flow process and distributed deployment flow process.
The initialization flow process:
The initialization flow process is when reporting system starts, or reporting system carries out when together starting with management platform.
1. read the middle table description document
2 resolve the middle table description document, and are stored in the internal memory
3. according to the middle table definition, create True Data table corresponding to middle table
Process flow diagram as shown in Figure 2.
The statistics scheduling flow:
The statistics scheduling flow also is the core process of reporting system, and namely field and the polling interval according to the middle table definition loops statistics, and the every interval of statistics scheduling flow one minute checks each middle table definition in the internal memory, carries out following process:
1. from internal memory, read the middle table definition;
2. whether the polling interval that checks the middle table definition arrives, if also not then ignore this middle table;
3. if arrived the polling interval, then obtain the statistical method definition in the intermediate list definition;
4. for the primitive event table, carry out statistical method, statistics is write in True Data table corresponding to middle table;
5. this statistics scheduling of this middle table is finished, and carries out the statistics scheduling of next middle table
As above-mentioned, statistics scheduling flow every interval checked in one minute carries out the scheduling of a middle table statistics, therefore also be that the minimum-poll of middle table is spaced apart one minute.Process flow diagram is seen shown in the accompanying drawing 3.
The purpose of reporting system is the statistical report form that generates relevant for event, also be that form should be added up and show according to some or volume of event, transmitted traffic that certain several field condition is calculated, accept flow or these several important data targets of total flow, therefore each middle table can comprise automatically that volume of event, transmitted traffic, reception flow and total flow are kept in the middle table as the statistical value of each statistics, and automatically calculates the value of these 4 fields when each statistics scheduling.
Illustrate the statistics scheduling flow of a middle table, in order to statistics design concrete in the interpretation procedure 4.
Suppose that this middle table comprises field: source address, grade, action, volume of event, transmitted traffic, accept flow, total flow
In time period between this is added up and added up last time, system receives also and preserved several primitive events, and is as follows:
Annotate: for clarity, omitted irrelevant event attribute in the above-mentioned primitive event.
According to the definition of middle table, underway when statistics table, will be according to source address, grade, three fields groupings of action, then statistical phenomeon amount, transmitted traffic, reception flow and total flow, the data that namely write after the statistics are:
The report generation flow process:
The report generation flow process is intended to as required, sends with calculating in the form desired data intermediate list and after obtaining.
1. according to initial conditions, construct the form computing method
2. in True Data table corresponding to middle table, carry out the form computing method
3. the result of calculation of statistical method being carried out is returned
Process flow diagram as shown in Figure 4.
The distributed deployment flow process:
Reporting system of the present invention not only can be integrated into unit operation in the management platform, also can move in the distributed deployment mode simultaneously.In the distributed deployment, be divided into master control reporting system and some local reporting systems 10 in the whole environment, in fact each local reporting system 10 can be regarded as a complete independent reporting system, and structure is identical.
Master control reporting system: be integrated into reporting system in the management platform as the master control reporting system;
Local reporting system: different middle table or several middle table be deployed to respectively on the different servers move, become local reporting system.
Under the distributed deployment pattern, the master control reporting system is no longer carried out initialization flow process, statistics scheduling flow and report generation flow process, and only is responsible for registering, managing each local reporting system, namely carries out following distributed deployment flow process:
1. the registration of the local reporting system of wait reception is asked clearly;
2. when receiving registration request, the information (such as address, port etc.) of the local reporting system in the request is kept in the internal memory for future use;
3. according to the information of local reporting system, check whether local reporting system survives
Can be as shown in Figure 5.
Local reporting system can be carried out following register flow path when starting:
1. seek the master control reporting system according to the master control reporting system information (such as address, port etc.) of configuration, if do not find then report an error and stop operation;
2. if find the master control reporting system, then send registration request to the master control reporting system, and wait for and replying;
3. receive the master control reporting system message that succeeds in registration, register flow path finishes;
4. queued for log-on is replied overtimely, reports an error and stops operation, and register flow path finishes;
As shown in Figure 6.
The middle table description document
Middle table described in the system of the present invention is used current standard x ML language definition, and is stored in the file system with document form, and each file is corresponding one by one with a middle table.All middle table description document 8 unified leaving in the position (catalogue) of management platform system appointment in the initialization flow process, are called file system access module 5 by middle table document management module 1 and are read.
8 of all middle table description document are read once when middle table document management module 1 starts, and effective all the time in the reporting system life cycle.No matter the additions and deletions to middle table description document 8 change operation, all only have when by the time starting middle table document management module 1 next time and just can come into force.
The tables of data that middle table is corresponding
The actual vector of middle table adopts the MySQL relevant database to realize, the result who namely adds up with the record form storage middle table of the tables of data in the database.The field that defines in each field in the database table and the middle table is corresponding one by one, and the type corresponding relation of field is as follows:
| Middle table define field type | The data sheet field type |
| int，long | Bigint |
| float，double | Double |
| String | Varchar |
Tables of data is accessed in initialization flow process, statistics scheduling flow and report generation flow process by database access module 6.
When management platform system started, middle table administrative unit A was triggered by form operational management unit C, with all one by one initialization of middle table description document 8 of middle table document management module 1 loading.The initialization of middle table mainly comprises: the field, the assembling middle table that obtain the Data Source (being the primitive event table) of middle table are built table SQL statement, assembling middle table statistics SQL statement.After finishing the middle table initialization, middle table administrative unit A can be kept at all middle table objects in the internal memory, calls at any time system is in service.
Middle table build the surface low journey
The table of building of middle table creates according to the field that middle table defines, create index (remove volume of event, transmitted traffic, accept flow and total flow field) according to the order that defines in the middle table file for each field simultaneously, in order to improve the speed of report generation flow process.
When building table, field according to definition, be assembled into establishment table (CREATE TABLE) SQL statement that meets the sql like language standard, and built the interface of table module 3 calling data storehouse access modules 6 by middle table, JDBC interface by standard is carried out the SQL statement of building table in the MySQL database, can finish the table of building of middle table.
The statistics scheduling flow of middle table
During statistics, according to the field of definition, be assembled into meet the sql like language standard choose (SELECT) SQL statement.The assembling of SQL statement will be followed following rule:
With all fields in the middle table description document as the SELECT field in the SQL statement;
Volume of event, transmitted traffic, accept flow and the total flow field obtains by COUNT (*), SUM (send), SUM (receive) and SUM (send+receive) function calculation respectively;
3. the condition that defines in the middle table description document uses the WHERE condition of sql like language to realize being assembled in the SQL statement;
4. all fields in the middle table description document (remove time of reception, volume of event, transmitted traffic, accept flow and total flow field) are assembled in the SQL statement in order as GROUP BY field.
After having assembled SQL statement, by the interface of middle table statistical module 4 calling data storehouse access modules 6, in the MySQL database, carry out the SQL statement of statistics by the JDBC interface of standard, can finish the statistics of middle table.
After the statistics, middle table statistical module 4 can continue the interface of calling data storehouse access modules 6, JDBC interface by standard is carried out INSERT INTO statement in the MySQL database, the result who adds up is write in tables of data corresponding to middle table, namely finishes the statistics scheduling flow of middle table.
Distributed deployment
The master control reporting system uses Web Service interface mode to provide registration, the local reporting system of access to local reporting system to obtain the functions such as report data.
At server registration request first-class to be received (Process-D-1), Web Service uses the character string of XML file layout to communicate based on http protocol to Web Service by listening mode.When receiving the request of local reporting system, the local reporting system information in the request is saved as Java language object (Process-D-2) in the internal memory, respond (Process-D-3) in the WebService mode simultaneously.Can support the heat registration based on the logon mode of Web Service, namely in the process of master control reporting system operation, can constantly add new local reporting system, and need not stop or restarting the master control reporting system, thereby form the reporting system cloud of similar cloud structure, further sharing system pressure.
In local reporting system, specify the information (such as IP address, port etc.) of master control reporting system by the XML document form.When local reporting system starts, by the file reading content and after resolving (Process-D-Sub-1), use Web Service order to initiate registration request (Process-D-Sub-2) to the master control reporting system, the master control reporting system feeds back local reporting system with Web Service order equally, and keeps heartbeat communication (Process-D-Sub-3).
Following rule is followed in the operation of local reporting system:
Local reporting system moves independently according to the middle table of this server deploy, and is identical when operational mode and independent Deployment Report system;
The minimum run unit of local reporting system is a middle table, and namely a middle table can only be moved in a local reporting system, and can not be distributed in the more than one local reporting system;
In the local reporting system, the Intermediate Statistics data storage that the middle table operation produces can be according to flexible configuration ground Selective storage in the database at master control reporting system place, or in the database at local reporting system place, no matter select which kind of mode, should not affect the master control reporting system and obtain these data, the configuration when the master control reporting system should be registered according to local reporting system selects to obtain these Intermediate Statistics data automatically from which database.
This form system has advantages of following:
The thread computing is avoided blocking
Owing to adding up each time thread all as the separate threads operation, also namely when time operation of statistics, no matter whether finish, can not affect the start-up and operation result of statistics next time, so reporting system can bear the pressure than the major issue amount.
Independent operating, the interval is adjustable
The statistical interval of each middle table can arrange separately, therefore after the statistics of finding some middle table is very consuming time, the statistical interval of middle table can be suitably dwindled, with the event data between twice statistics of corresponding minimizing, thereby the time that middle table is added up can be reduced.
Merge statistics, efficient is superior
Because in fact middle table merges the primitive event data and adds up, middle table has good index simultaneously, when therefore generating actual form on the basis of middle table, the rise time of form and operational efficiency all can be better than directly the primitive event data directly being carried out the statistics of actual form greatly.
Be easy to expansion, need not compiling
Because middle table adopts the XML document definition of standard, therefore be beneficial to very much expansion and customization.In deployment, as meet new demand, need to add new middle table or revise existing middle table and satisfy, can finish by direct editing XML file easily so.And expansion only need to be changed the XML file, and other arrange and do not need additionally to change code or database again, also do not need extra instrument.Simultaneously, because each XML file namely represents a middle table, when therefore increasing middle table again, can existing middle table not impacted yet, and only be that new XML file is put in the catalogue of appointment, can finish initialization from registration.Increased so to a great extent the stability of reporting system.Certainly, talk about as " realization of middle table description document " one joint, the additions and deletions of middle table description document are changed operation, need to wait until when starting the middle table document management module next time and just can come into force.
If move this reporting system in distributed mode, except bringing above good effect, the effectively load of balancing safety management platform system, computing, storage and the output of each middle table all are assigned on the server at local reporting system place, so that the CPU of the server at master control reporting system place, internal memory, disk pressure can be alleviated, for the happy operation of other critical functions of safety management platform system also provides guarantee to a certain degree.
Claims (2)
1. the distributed reporting system of the table based on the centre comprises server and the network equipment as the host, it is characterized in that: this system comprises middle table administrative unit A, form operational management unit B and management platform service unit C, wherein:
Middle table administrative unit A comprises:
Middle table document management module (1), this module are responsible for the middle table description document that is stored in the file system is read, and are stored in the internal memory, use for other modules;
Middle table initialization module (2), this module is by form operational management unit triggers, the content of being responsible for all middle table description document that middle table document management module (1) is loaded is converted into the object form that computing machine can be understood, one by one initialization, this module can be kept at all middle table objects after the initialization in the internal memory, calls at any time system is in service;
Be defined as follows content in the middle table object:
Attribute specification
Table name: middle table is built the title that table uses in database;
Title: the title of identification middle table in administrative center's system platform;
The operation interval: middle table is once added up and time between the statistics next time, and unit is minute that minimum value is 1 minute;
The field that comprises: when the whole fields that comprise in the middle table, administrative center's system platform are made form according to middle table, the field scope that can use;
All select all can be used as grouping field when SQL statement is added up in assembling as the field of middle table, and create index;
Each middle table can comprise automatically that volume of event, transmitted traffic, reception flow and total flow are kept in the middle table as the statistical value of each statistics, and offers when making form and use;
Condition: the event scope of selecting when middle table is added up;
Middle table is built table module (3), and what this module was responsible for assembling the middle table definition builds the table SQL statement, and carries out the table process of building, and also namely carries out creating the table SQL statement, creates corresponding tables of data in database;
Middle table statistical module (4), this module is responsible for assembling the statistics SQL statement of middle table, in the scheduling process of reporting system, by form operational management cell call, carry out statistical work, and statistics write in the tables of data in database corresponding to middle table, also namely carry out the statistics SQL statement;
Management platform service unit B comprises:
File system access module (5), this module provide unified interface and the method for access computer file system, and the method that provides has: file reading, storage file and deleted file;
This module is used for the middle table statement file (8) that middle table document management module (1) calls file system, with the use of standard reporting system to file system;
Database access module (6), this module provide unified interface and the method for accessing database (9), and the method that provides has: creation database table and data inserting in the database table;
Form operational management unit C builds the database access module (6) of table module (3), middle table statistical module (4) and management platform service unit B by middle table initialization administration module (2), middle table among the scheduling middle table administrative unit A, the middle table statistical module that complete call middle table administrative unit carries out initialization, periodically call the middle table administrative unit carries out the action of middle table statistics, access database table corresponding to middle table by the management platform service unit provides report data.
2. the distributed reporting system based on middle table according to claim 1, it is characterized in that: form operational management unit C comprises a distributed deployment administration module (7), and this module (7) is used for the local reporting system (10) of registration and management distribution deployment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110461917 CN102929899A (en) | 2011-12-31 | 2011-12-31 | Distributed reporting system based on intermediate table |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110461917 CN102929899A (en) | 2011-12-31 | 2011-12-31 | Distributed reporting system based on intermediate table |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102929899A true CN102929899A (en) | 2013-02-13 |
Family
ID=47644698
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201110461917 Pending CN102929899A (en) | 2011-12-31 | 2011-12-31 | Distributed reporting system based on intermediate table |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102929899A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103500185A (en) * | 2013-09-13 | 2014-01-08 | 北京奇虎科技有限公司 | Data table generation method and system based on multi-platform data |
| CN104281672A (en) * | 2014-09-28 | 2015-01-14 | 网神信息技术（北京）股份有限公司 | Log data processing method and device |
| CN104317820A (en) * | 2014-09-28 | 2015-01-28 | 网神信息技术（北京）股份有限公司 | Statistical method and device of report |
| CN105279143A (en) * | 2015-10-17 | 2016-01-27 | 浙江宇视科技有限公司 | Periodic report system |
| CN106469226A (en) * | 2016-09-30 | 2017-03-01 | 安徽马钢自动化信息技术有限公司 | Data communication method based on data base's middle table |
| CN107122364A (en) * | 2016-02-25 | 2017-09-01 | 华为技术有限公司 | Data manipulation method and data management server |
| CN108255855A (en) * | 2016-12-29 | 2018-07-06 | 北京国双科技有限公司 | Date storage method and device |
| CN108900568A (en) * | 2018-05-25 | 2018-11-27 | 山东中创软件商用中间件股份有限公司 | A kind of method, system and the server of table transmission |
| CN109542902A (en) * | 2018-11-12 | 2019-03-29 | 珠海格力电器股份有限公司 | Data processing system and method |
| CN110888774A (en) * | 2019-11-07 | 2020-03-17 | 中盈优创资讯科技有限公司 | Big data report processing method and device based on HBASE |
-
2011
- 2011-12-31 CN CN 201110461917 patent/CN102929899A/en active Pending
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103500185A (en) * | 2013-09-13 | 2014-01-08 | 北京奇虎科技有限公司 | Data table generation method and system based on multi-platform data |
| CN103500185B (en) * | 2013-09-13 | 2018-07-06 | 北京奇虎科技有限公司 | A kind of method and system based on multi-platform data generation tables of data |
| CN104281672B (en) * | 2014-09-28 | 2021-02-12 | 网神信息技术（北京）股份有限公司 | Method and device for processing log data |
| CN104281672A (en) * | 2014-09-28 | 2015-01-14 | 网神信息技术（北京）股份有限公司 | Log data processing method and device |
| CN104317820A (en) * | 2014-09-28 | 2015-01-28 | 网神信息技术（北京）股份有限公司 | Statistical method and device of report |
| CN105279143A (en) * | 2015-10-17 | 2016-01-27 | 浙江宇视科技有限公司 | Periodic report system |
| CN107122364A (en) * | 2016-02-25 | 2017-09-01 | 华为技术有限公司 | Data manipulation method and data management server |
| US11100101B2 (en) | 2016-02-25 | 2021-08-24 | Huawei Technologies Co., Ltd. | Data operation method and data management server |
| CN107122364B (en) * | 2016-02-25 | 2021-05-18 | 华为技术有限公司 | Data operation method and data management server |
| CN106469226A (en) * | 2016-09-30 | 2017-03-01 | 安徽马钢自动化信息技术有限公司 | Data communication method based on data base's middle table |
| CN108255855A (en) * | 2016-12-29 | 2018-07-06 | 北京国双科技有限公司 | Date storage method and device |
| CN108255855B (en) * | 2016-12-29 | 2021-10-08 | 北京国双科技有限公司 | Data storage method and device |
| CN108900568B (en) * | 2018-05-25 | 2020-09-18 | 山东中创软件商用中间件股份有限公司 | Form transmission method, system and server |
| CN108900568A (en) * | 2018-05-25 | 2018-11-27 | 山东中创软件商用中间件股份有限公司 | A kind of method, system and the server of table transmission |
| CN109542902A (en) * | 2018-11-12 | 2019-03-29 | 珠海格力电器股份有限公司 | Data processing system and method |
| CN110888774A (en) * | 2019-11-07 | 2020-03-17 | 中盈优创资讯科技有限公司 | Big data report processing method and device based on HBASE |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102929899A (en) | Distributed reporting system based on intermediate table | |
| CN112685385B (en) | Big data platform for smart city construction | |
| CN107357856B (en) | Method for realizing data integration and data service based on power grid panoramic service model | |
| CN104050042B (en) | The resource allocation methods and device of ETL operations | |
| CN102262680B (en) | Distributed database proxy system based on massive data access requirement | |
| CN101645032B (en) | Performance analysis method of application server and application server | |
| CN101996271B (en) | Software interface for automatically generating simulation calculation model of PSCAD power system | |
| CN107103064B (en) | Data statistical method and device | |
| CN102917006B (en) | A kind of unified control and management method and device realizing computational resource and object permission | |
| CN103631596A (en) | Configuration device and configuration method of business object data entry and updating rule | |
| TW201636888A (en) | Multi-cluster management method and device | |
| CN103207920A (en) | Parallel metadata acquisition system | |
| CN103338135A (en) | Real-time monitoring method of cluster storage capacity | |
| CN110147470B (en) | Cross-machine-room data comparison system and method | |
| CN106294757A (en) | A kind of distributed data base divided based on hypergraph and clustered partition method thereof | |
| CN111061732A (en) | Report generation method based on big data processing | |
| CN111143391A (en) | Data sharing exchange method and system | |
| CN105550351B (en) | The extemporaneous inquiry system of passenger's run-length data and method | |
| CN105912621A (en) | Area building energy consumption platform data storing and query method | |
| CN109522292B (en) | Data processing device and method based on power grid standard unified information model | |
| CN115618825A (en) | Financial statement merging method and device, computer readable medium and terminal equipment | |
| CN115509693A (en) | Data optimization method based on cluster Pod scheduling combined with data lake | |
| Pan et al. | An open sharing pattern design of massive power big data | |
| CN113177084A (en) | Database storage method based on Internet of things | |
| CN102542103A (en) | Simulation comprehensive integration system capable of supporting multiple tasks on basis of WEB |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C05 | Deemed withdrawal (patent law before 1993) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20130213 |