WO2014183723A1

WO2014183723A1 - Method and device for processing large volume of data based on table

Info

Publication number: WO2014183723A1
Application number: PCT/CN2014/079793
Authority: WO
Inventors: 陈波
Original assignee: 中兴通讯股份有限公司
Priority date: 2013-11-11
Filing date: 2014-06-12
Publication date: 2014-11-20
Also published as: KR20160058928A; JP2016539415A; CN104636372B; KR101777073B1; JP6530390B2; CN104636372A

Abstract

A method and device for processing a large volume of data based on a table, the method comprising: deploying a table having gone through a customized development and being capable of realizing complex typesetting functions; establishing an association between the table and an in-memory database; identifying at least one large-volume-data operating command for the table, acquiring the large volume of data from the in-memory database according to the large-volume-data operating command, and displaying the large volume of data via the table.

Description

Method and device for realizing large data volume processing based on table

The present invention relates to the field of computer data processing technologies, and in particular, to a method and apparatus for implementing large data volume processing based on a table. Background technique

It is known that a telecommunication network management system usually needs to implement processing of a large amount of data. The so-called large amount of data, that is, the amount of data displayed far exceeds the capacity that can be supported by the memory, and the report management in the network management system is taken as an example to illustrate that the report management is The system administrator provides a unified report output function for important information of the network management system. With the report management function, the system administrator can customize the report task and output the report data, which is convenient for monitoring the operation of the network management system. In order to make better use of the report data analysis system, it is often necessary to quickly collect a large number of performance, alarm, configuration and other data, so that maintenance personnel can quickly evaluate the system operation. Currently, the report management system is generally used to output the corresponding form. Process such data.

However, the functions provided by the prior art are relatively simple. If complex typographic functions are to be implemented on the basis of such a form, complex secondary development is required, but the secondary development of the form can realize complex typographic functions. However, on the other hand, it is difficult to support the presentation of large amounts of data. Among them, the so-called complex typesetting refers to the typesetting functions such as global real-time sorting, line number display, column freezing, column heading automatic line-feeding display, blank column filtering, and the like. In addition, for tables that support large data volume presentations, it is difficult to meet the requirements of complex typographic functions such as real-time sorting.

Therefore, how to provide a method based on table implementation that can support complex typesetting while supporting large data volume presentation has become a technical problem that those skilled in the art need to solve. Summary of the invention

To overcome existing forms, you can't support complex typography at the same time, global real-time sorting, big data The problem of the present invention is to provide a method and apparatus for implementing large data volume processing based on a table.

In order to achieve the object of the present invention, the embodiments of the present invention are implemented by the following technical solutions:

A method for implementing large data volume processing based on a table, comprising:

Deploy a second-developed form that implements complex typographic features;

Establishing an association relationship between the form and the in-memory database;

At least one large data volume operation command to the table is identified, and a large amount of data is obtained from the in-memory database and presented through the table in accordance with the large data volume operation command.

Preferably, after the establishing the association relationship between the table and the in-memory database, the method further includes: indexing the data in the in-memory database according to the row number of the table, and when the data needs to be displayed, according to the row number of the table to the memory The corresponding data is read in the database.

Preferably, the redeveloped table has a column header sorting function; the column header sorting function is configured to bind the redeveloped table to an in-memory database for sorting a result set .

Preferably, after the large data volume is obtained from the in-memory database according to the large data volume operation command, the method further includes: first buffering the large data volume to an intermediate file, and then presenting the file according to the intermediate file. Large amount of data.

Preferably, the method further comprises: identifying at least one function customization command, and performing corresponding adding or deleting operations on the complex typesetting function supported by the table according to the function customization command.

An apparatus for implementing large data volume processing based on a table, comprising:

a deployment module configured to deploy a secondary developed form that implements complex typographic functions; an association module configured to establish an association relationship between the form and the in-memory database;

An identification module configured to identify at least one large data volume operation command for the form;

The obtaining module is configured to obtain a large amount of data from the in-memory database according to the large data volume operation command;

A rendering module configured to present a large amount of data retrieved from the in-memory database through the table. Preferably, the association module is configured to index data in the in-memory database according to the row number of the table, so that when the data needs to be displayed, the obtaining module reads the corresponding data into the in-memory database according to the row number of the table.

Preferably, the redeveloped table has a column header sorting function; the column header sorting function is configured to bind the redeveloped table to an in-memory database for sorting the result set.

Preferably, the obtaining module is configured to cache the large amount of data to an intermediate file after acquiring a large amount of data from the in-memory database according to a large data operation command, and the rendering module is configured on the form according to the intermediate file. Present a large amount of data.

Preferably, the device for implementing large data volume processing based on a table further includes:

The customization module is configured to identify at least one function customization command, and according to the function customization command, perform corresponding addition or deletion operations on the complex layout function supported by the table.

It can be seen from the above technical solution of the present invention that the method and device for realizing large data volume processing based on a table provided by the present invention can realize secondary development of a complex typesetting function by using a table, and the secondary developed form It is bound to the in-memory database. When users need to view and analyze large data volumes through tables, the table can support complex layout, global real-time sorting, and large data volume presentation. DRAWINGS

1 is a schematic flowchart of a method for implementing large data volume processing based on a table according to an embodiment of the present invention; FIG. 2 is a flow chart of a method for implementing large data volume processing based on a table according to another embodiment of the present invention;

FIG. 3 is a schematic structural diagram of an apparatus for implementing large data volume processing based on a table according to an embodiment of the present invention; FIG. 4 is a schematic structural diagram of an apparatus for implementing large data volume processing based on a table according to another embodiment of the present invention.

The realization, functional features and excellent effects of the object of the present invention will be further described below in conjunction with the specific embodiments and the accompanying drawings. detailed description

The technical solutions of the present invention are further described in detail below with reference to the accompanying drawings and specific embodiments to enable those skilled in the art to understand the invention. .

As shown in FIG. 1 , a method for implementing large data volume processing based on a table according to an embodiment of the present invention includes the following steps:

S10, deploying a secondary developed form that can implement complex typesetting functions;

S20. Establish an association relationship between the table and the in-memory database.

S30. Identify at least one large data volume operation command for the table, and obtain a large amount of data from the in-memory database according to the large data volume operation command and present through the table.

Specifically, in the embodiment of the present invention, the complex typesetting function includes, but is not limited to, a global real-time sorting, a line number display, a column freeze, a column header automatic line feed display, and a blank column filter.

In the step S10, the pre-developed secondary development of the table may be performed according to the prior art that is known to those skilled in the art, and will not be described in detail herein.

In this embodiment, the redeveloped table has a column head sorting function, and the column head sorting function is used to bind the redeveloped table and the in-memory database for sorting the result set. The ordering operation instruction may be an Order by operation. This allows you to click on the header to perform global sorting.

In this embodiment, for the step S20, the association relationship between the establishment table and the in-memory database may be an association relationship between the display logic of the table and the in-memory database.

After the association between the table and the in-memory database is established, the method may further include: indexing the data in the in-memory database according to the row number of the table, and reading the corresponding data according to the row number of the table to the in-memory database when the data needs to be displayed. .

In this embodiment, for the step S30, the large data volume operation command is a variety of complex typesetting operation commands for the table input by the user.

After obtaining a large amount of data from the in-memory database according to a large data operation command, the large The amount of data is cached to the intermediate file, and then the large amount of data is presented on the form according to the intermediate file, so that when the large amount of data is presented through the table and the complex typesetting function is performed on the large amount of data, the memory usage can be reduced, and the large size can be realized. Data volume presentation and operation.

In another embodiment of the present invention, referring to FIG. 2, the method for implementing large data volume processing based on a table further includes:

S40. Identify at least one function customization command, and perform corresponding adding or deleting operations on the complex typesetting function supported by the table according to the function customization command.

By identifying at least one user-entered function customization command, for example, the function customization command can add or delete column freeze, column width, header order, column hiding, etc. by the user clicking the right mouse button and selecting the corresponding custom menu input. Typesetting function. In other embodiments, the typesetting of the functions such as column freeze, column width, and header order can also be performed by the user directly dragging the header of the table, which is not described in detail herein.

The method for realizing large data volume processing based on the table provided by the embodiment of the present invention realizes column freezing by secondary development of the table; secondary development of the header, supporting column headings and sorting arrow display; and displaying the logic of the table The in-memory database is bound, and when the specific data needs to be displayed, the records are read according to the line number to the in-memory database; the function of sorting the table column header is bound with the Order by operation of the in-memory database, so as to implement the click header globally. Sorting function; Cache in-memory database data into files, reduce memory usage, and realize large data volume rendering and operation. Therefore, the table provided by the embodiment of the present invention can simultaneously support functions of complex typesetting, global real-time sorting, and large data volume presentation.

As shown in FIG. 3, an apparatus for implementing large data volume processing based on a table according to an embodiment of the present invention includes:

The deployment module 10 is configured to deploy a re-developed table that implements complex typographic functions; the association module 20 is configured to establish an association relationship between the display logic of the table and the in-memory database 40; and the identification module 30 is configured to identify the pair of tables At least one large data volume operation command 300;

The obtaining module 50 is configured to obtain a large amount of data from the in-memory database 40 according to the large data volume operation command 300;

a presentation module 60, configured to use the table to obtain a large amount of data obtained from the in-memory database 40 Presented.

Correspondingly, in the embodiment of the present invention, the complex typesetting function includes, but is not limited to, a global real-time sorting, a line number display, a column freeze, a column header automatic line feed display, and a blank column filter. The pre-developed secondary development of the form can be performed in accordance with the prior art already known to those skilled in the art.

In the embodiment of the present invention, the association module 20 is further configured to index the data in the in-memory database 40 according to the row number of the table, so that when the data needs to be displayed, the obtaining module 50 goes to the in-memory database according to the row number of the table. The corresponding data is read in 40.

The large data volume operation command 300 recognized by the identification module 30 is a user-entered various complex typesetting operation commands for the table.

In the embodiment of the present invention, the column header sorting function of the redeveloped table is configured to be bound to the Order by operation of the in-memory database 40 for sorting the result set, thereby implementing the click header For global sorting.

In the embodiment of the present invention, after acquiring the large data amount from the in-memory database 40 according to the large data volume operation command, the obtaining module 50 caches the large data amount to an intermediate file (not shown), The presentation module 60 presents a large amount of data on the form in accordance with the intermediate file. In this way, when a large amount of data is presented through a table and a complex typesetting function is performed on a large amount of data, the memory usage can be reduced, and a large amount of data can be presented and operated.

As shown in FIG. 4, in another embodiment of the present invention, the apparatus for implementing large data volume processing based on a table further includes:

The customization module 70 is configured to identify at least one function customization command 700, and according to the function customization command 700, perform corresponding addition or deletion operations on the complex typesetting function supported by the table.

The customization module 70 can add or delete a column freeze, a column width, and a table by identifying at least one user-entered function customization command 700, for example, the function customization command 700 can be added or deleted by the user clicking the right mouse button and selecting a corresponding custom menu input. Complex typographic features such as head order, column hiding, etc. In other embodiments, the typesetting of the column freeze, the column width, the header order, and the like may also be performed by the user directly dragging the header of the table, which is not described in detail herein. The above description is only the preferred embodiment of the present invention, and is not intended to limit the scope of the invention, and the equivalent structure or equivalent flow transformation made by the specification and the drawings of the present invention may be directly or indirectly applied to other related The technical field is equally included in the scope of patent protection of the present invention.

Claims

claims

1. A table-based method for processing large amounts of data, including:

Deploy secondary developed tables that can implement complex typesetting functions;

Establish an association between the table and the memory database;

Identify at least one large data volume operation command for the table, and according to the large data volume operation command, obtain the large data volume from the memory database and present it through the table.

2. The method for processing large amounts of data based on tables as claimed in claim 1, wherein after establishing the association between the table and the memory database, the method further includes: The data is indexed, and when the data needs to be displayed, the corresponding data is read from the memory database according to the row number of the table.

3. The method for processing large amounts of data based on tables as claimed in claim 1, wherein the secondary developed table has a column header sorting function; the column header sorting function is used to sort the secondary developed tables into The table is bound to the in-memory database for sorting the result set.

4. The method for processing large amounts of data based on tables as claimed in claim 1, wherein, after obtaining the large amount of data from the memory database according to the large amount of data operation command, the method further includes: first, converting the large amount of data into The data volume is cached into an intermediate file, and then the large data volume is presented on the table based on the intermediate file.

5. The method for processing large amounts of data based on tables as claimed in claim 1, wherein the method further includes:

Identify at least one function customization command, and perform corresponding addition or deletion operations on the complex typesetting functions supported by the table according to the function customization command.

6. A device for processing large amounts of data based on tables, including:

The deployment module is configured to deploy a secondary developed table that can realize complex typesetting functions; the association module is configured to establish an association between the table and the memory database;

An identification module configured to identify at least one large data volume operation command on the table;

Acquisition module, configured to obtain big data from the memory database according to the large data volume operation command quantity;

A presentation module configured to present a large amount of data obtained from the in-memory database through the table.

7. The device for processing large amounts of data based on tables as claimed in claim 6, wherein the association module is configured to index the data in the memory database according to the row number of the table, so that when the data needs to be displayed, the The above acquisition module reads the corresponding data from the memory database according to the row number of the table.

8. The device for processing large amounts of data based on tables as claimed in claim 6, wherein the secondary developed table has a column header sorting function; the column header sorting function is used to sort the secondary developed tables into The table is bound to the in-memory database for sorting the result set.

9. The device for processing large amounts of data based on tables as claimed in claim 6, wherein the acquisition module is configured to obtain the large amount of data from the memory database according to the large data amount operation command, and then convert the big data into The amount of data is cached into an intermediate file, and the presentation module presents the large amount of data on the table based on the intermediate file.

10. The device for processing large amounts of data based on tables as claimed in claim 6, further comprising: a customization module configured to identify at least one function customization command and configure the complex typesetting functions supported by the table according to the function customization command. Perform the corresponding addition or deletion operations.