CN112015423A

CN112015423A - Data processing system and method

Info

Publication number: CN112015423A
Application number: CN201910465154.0A
Authority: CN
Inventors: 徐皓; 张正武; 秦海峰; 刘镇东; 李永光; 鲁冰洁; 薛琪
Original assignee: Beijing Qihoo Technology Co Ltd
Current assignee: Beijing Qihoo Technology Co Ltd
Priority date: 2019-05-30
Filing date: 2019-05-30
Publication date: 2020-12-01

Abstract

The invention discloses a data processing system and a data processing method. Wherein, the system includes: the data processing component library is provided with a plurality of data processing components; the graphic primitive operation interface is suitable for presenting graphic primitives of the data processing assembly and receiving selection operation and attribute configuration operation aiming at the graphic primitives of the data processing assembly; the data processing logic engine is used for generating corresponding data processing logic according to the selection operation and the attribute configuration operation; calling an analysis engine and a corresponding storage engine to obtain data required by data processing, processing the data to obtain a data processing result, and feeding back the data processing result to the primitive operation interface; the analysis engine is suitable for analyzing the data processing logic and routing an analysis result to the corresponding storage engine; and the storage engines are suitable for storing mass data. By adopting the scheme, a user can complete data processing only by selecting and configuring the component primitives in the primitive operation interface, so that the data processing efficiency is improved.

Description

Data processing system and method

Technical Field

The invention relates to the technical field of computers, in particular to a data processing system and a data processing method.

Background

With the continuous development of science and society, various data show the growth of well-jet type. At present, when people process mass data, corresponding developers are usually required to compile a data report generation code or a data model building code of a trocar for each data processing requirement (such as a data report requirement).

However, in the implementation process, the inventor finds that the prior art has the following defects: the existing data processing mode has higher requirements on the compiling level of developers, and has complex and fussy process and low processing efficiency.

Disclosure of Invention

In view of the above, the present invention has been developed to provide a data processing system and method that overcome, or at least partially solve, the above-discussed problems.

According to an aspect of the present invention, there is provided a data processing system comprising:

a data processing component library adapted to provide a plurality of data processing components; the data processing component comprises a report component and/or a data table component;

the graphical element operating interface is suitable for presenting graphical elements of the data processing components corresponding to at least one data processing component in the data processing component library; receiving selection operation and attribute configuration operation aiming at the presented data processing component graphic primitive;

the data processing logic engine is suitable for generating corresponding data processing logic according to the selection operation and the attribute configuration operation aiming at the presented data processing assembly graphic primitive; calling an analysis engine and a corresponding storage engine to obtain data required by data processing, processing the data to obtain a data processing result, and feeding back the data processing result to the graphical operation interface;

the analysis engine is suitable for analyzing the data processing logic and routing an analysis result to the corresponding storage engine;

and the storage engines are suitable for storing mass data.

According to another aspect of the present invention, there is provided a data processing method using the data processing system described above, including:

presenting a data processing component primitive corresponding to at least one data processing component;

receiving selection operation and attribute configuration operation aiming at the presented data processing component primitive;

generating corresponding data processing logic according to the selection operation and the attribute configuration operation aiming at the presented data processing assembly graphic primitive;

and obtaining data required by data processing according to the data processing logic, and processing the data to obtain a data processing result.

According to yet another aspect of the present invention, there is provided a computing device comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;

the memory is used for storing at least one executable instruction, and the executable instruction enables the processor to execute the operation corresponding to the data processing method.

According to still another aspect of the present invention, there is provided a computer storage medium having at least one executable instruction stored therein, the executable instruction causing a processor to perform operations corresponding to the data processing method.

According to the data processing system and method provided by the invention, a plurality of data processing components are provided by a data processing component library; presenting a data processing assembly graphic primitive through a graphic primitive operation interface and receiving selection operation and attribute configuration operation aiming at the data processing assembly graphic primitive; the data processing logic engine generates corresponding data processing logic according to the selection operation and the attribute configuration operation; calling an analysis engine and a corresponding storage engine to obtain data required by data processing, processing the data to obtain a data processing result, and reflecting the data processing result to a graphical element operation interface; the analysis engine analyzes the data processing logic and routes the analysis result to the corresponding storage engine; the plurality of storage engines are used to store mass data. By adopting the scheme, a user can complete data processing only by selecting and configuring the component primitives in the primitive operation interface, so that the data processing efficiency is improved.

The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.

Drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:

FIG. 1 is a functional block diagram of a data processing system according to an embodiment of the present invention;

FIG. 2 is a functional block diagram of a data processing system according to another embodiment of the present invention;

FIG. 3 is a schematic diagram illustrating a graphical primitive operation interface according to another embodiment of the present invention;

FIG. 4 is a functional block diagram of a data processing system according to yet another embodiment of the present invention;

FIG. 5 is a diagram illustrating a graphical primitive operation interface according to another embodiment of the present invention;

FIG. 6a is a schematic diagram illustrating a graphical primitive operation interface according to another embodiment of the present invention;

FIG. 6b is a schematic diagram illustrating a graphical primitive operation interface according to another embodiment of the present invention;

FIG. 7 is a flow chart illustrating a data processing method according to an embodiment of the present invention;

fig. 8 is a schematic structural diagram of a computing device according to an embodiment of the present invention.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

FIG. 1 is a functional block diagram of a data processing system according to an embodiment of the present invention. As shown in fig. 1, the system includes: a data processing component library 11, a graphical element operation interface 12, a data processing logic engine 13, a parsing engine 14, and a plurality of storage engines 15.

A data processing component library 11 adapted to provide a plurality of data processing components; wherein, the data processing component comprises a report component and/or a data table component.

Different from the prior art that corresponding data processing codes need to be compiled aiming at each data processing requirement, the system abstracts data processing processes such as data reports, data models and data analysis through a large amount of analysis and research so as to obtain a plurality of data processing components. Each data processing component has corresponding data processing logic. Wherein, the data processing component comprises a report component and/or a data table component.

A graphical element operating interface 12, adapted to present a graphical element of a data processing component corresponding to at least one data processing component in the data processing component library 11; and receiving selection operations and attribute configuration operations for rendered data processing component primitives.

In particular, the present system provides a user with a graphical primitive operational interface in which data processing component primitives corresponding to at least one data processing component in the data processing component library 11 are presented. That is, each data processing element primitive presented by the metalized operation interface 12 corresponds to a real data processing element, and the data processing element primitive is an interface display element of the data processing element corresponding to the data processing element primitive.

And further, receiving a selection operation performed by a user through the metaplastic operation interface for the rendered data processing component primitive. The specific type of the selection operation is not limited in this embodiment, and the selection operation may be, for example, a click operation and/or a move operation.

Also, attribute configuration operations may further be received for the rendered data processing component primitives. In a specific implementation, a corresponding attribute configuration entry is provided for the user, so that the user can configure the attribute information for the data processing component through the attribute configuration entry.

A data processing logic engine 13 adapted to generate corresponding data processing logic according to the selection operation and the attribute configuration operation for the rendered data processing component primitive; and calling the analysis engine and the corresponding storage engine to obtain data required by data processing, processing the data to obtain a data processing result, and feeding back the data processing result to the graphical operation interface 12.

First, the data processing logic engine 13 may determine a target data processing component according to a selection operation performed by a user in the graphical element operation interface 12 for a graphical element of a presented data processing component; and then receiving the attribute configuration operation, which is executed by the user through the graphical operation interface 12 and is directed to the target data processing component, so as to obtain the attribute configuration information directed to the target data processing component, and further generating a corresponding data processing logic according to the determined target data component and the attribute configuration information of the target data component. Since each data processing component provided in the present system corresponds to a respective data processing logic, after a target data processing component is determined, a complete component execution logic for the target data processing component can be generated using the attribute information of the target processing component; when the target attribute components are multiple and the multiple target data processing components have corresponding association relations, the total data processing logic can be generated according to the component execution logic corresponding to each target attribute component and the association relations among the multiple target attribute components.

Further, according to the data processing logic, the parsing engine 14 and the corresponding storage engine 15 are called to obtain data required for data processing, the obtained data are processed to obtain a final data processing result, and the obtained data processing result is finally fed back to the graphical operating interface 12, so that the graphical operating interface presents the data processing result.

And the analysis engine 14 is suitable for analyzing the data processing logic and routing the analysis result to the corresponding storage engine.

Specifically, when the corresponding source data needs to be acquired from the data processing logic for processing, the parsing engine 14 may parse the query statement and the like in the data processing logic to determine the storage engine corresponding to the data query statement, and route the query statement to the corresponding storage engine.

Optionally, the parsing engine 14 may also manage log or error information, file or mail information, and perform data caching, etc. during data processing.

And the storage engines are suitable for storing mass data.

The system comprises a plurality of storage engines, such as MySQL, Oracle, HDFS, MongoDB, Redis and/or SQL-Server.

Therefore, the system abstracts the data processing process into a plurality of data processing components, provides a plurality of data processing component primitives for a user through a primitive operation interface, and receives selection operation and attribute configuration operation aiming at the presented data processing component primitives by utilizing the primitive operation interface; and generating a corresponding data processing logic by the data processing logic engine according to the selection operation and the attribute configuration operation, calling the analysis engine and the storage engine by using the data processing logic to obtain source data required by data processing, processing the source data to obtain a data processing result, and feeding the data processing result back to the graphical operation interface. By adopting the system, a user can complete data processing only by selecting and configuring the component primitives in the primitive operation interface, so that the data processing efficiency is improved; moreover, when the data processing requirement is changed, the change of the data processing requirement can be realized only by adjusting the selected data processing component or configuration information, so that the flexibility of the data processing process is further improved, and the labor cost is reduced; moreover, the compiling capability threshold of the user in the data processing process is reduced, and the user experience is improved.

Fig. 2 is a functional block diagram of a data processing system according to another embodiment of the present invention. In this embodiment, further optimization is performed on the basis of the system shown in fig. 1, so that the data processing system can meet the automatic generation requirement of the data report of the user.

In the system provided in this embodiment, an automatic data report generation entry 21 is provided, and a user enters an automatic data report generation process through operations such as clicking, voice control, and the like of the automatic data report generation entry 21. In an optional implementation manner, in order to ensure the security of system data, corresponding function use permissions can be configured for different users, and when receiving operations such as clicking, voice control and the like of a user for the data report automatic generation entry 21, whether the user has the use permission of the data report automatic generation function is judged, and if yes, a subsequent module executes the data report automatic generation function; if not, feeding back corresponding authority limit information.

In the system, the data processing component provided by the data processing component library 11 is a report component. The report component is obtained by abstracting after analyzing the generation process of the data report. Each reporting component corresponds to a respective data processing logic.

Specifically, the report component comprises: a data display class component, a data filtering class component, and an auxiliary class component. Wherein, the data display class component can display the final data result, for example, the data display class component can include a chart component, a table component, and/or a card diagram component, etc.; the data filtering class component is used to filter data to obtain a final data result, for example, the data filtering class component includes: a temporal screening component, a fuzzy query component, and/or a precision query component, etc.; the auxiliary class component is used for assisting a user in completing a data report by using the data display class component and/or the data filtering class component, for example, the auxiliary class component may include: a text box component, a toggle component, an input box component, and/or a button component, among others.

The graphical element operation interface 12 is suitable for presenting a plurality of different types of report component graphical elements; the report component primitives of different categories comprise data display component primitives, data filtering component primitives and auxiliary component primitives. Specifically, the data display class component primitives include: a chart component primitive, a table component primitive, and/or a card component primitive; and/or, the data filtering class component primitives comprise: time screening component primitives, fuzzy query component primitives, and/or accurate query component primitives; and/or, the auxiliary class components include: a text box component primitive, a switch component primitive, an input box component primitive, and/or a button component primitive.

As shown in fig. 3, a chart component primitive, a table component primitive, a text component primitive, a time filtering component primitive, a fuzzy query component primitive, a pull-down filtering component primitive (relative to one of the accurate query component primitives), a card component, and a Tab component (the switching component primitive described above) are present in the report component menu area 31, thereby facilitating the selection by the user.

The graphical operating interface 12 is further adapted to receive a selection operation for the rendered report component graphical element. Specifically, the user may perform a corresponding selection operation on the report component primitive presented in the metaplastic operation interface 12, where the selection operation may be a click operation or a move operation, and the like.

The data processing logic engine 13 is further adapted to: and determining a target report component according to the selection operation aiming at the presented report component primitive. Still taking fig. 3 as an example, when it is monitored that a user moves a certain report component primitive in the report component menu area 31 to the layout area 32 in fig. 3, it is determined that the report component corresponding to the moved report component primitive is a target report component, and by adopting the moving selection operation mode, the user can conveniently select the target report component and determine the position of the target report component.

After the target report component is determined, the graphical element operation interface 12 further presents an attribute configuration entry corresponding to the target report component. Wherein the attribute configuration portal comprises: a data source configuration entry, a data field configuration entry, a style configuration entry, and/or a linkage configuration entry, among others. The graphical operation interface shown in FIG. 3 is provided with a data source configuration entry (e.g. 34 in FIG. 3), a data field configuration entry, and a style configuration entry (e.g. 33 in FIG. 3).

The data processing logic engine 13 is further adapted to: and acquiring attribute configuration information configured by the attribute configuration entrance and aiming at the target report component. Wherein the attribute configuration information includes: data source configuration information, data field configuration information, style configuration information, and/or linkage relationship configuration information, among others.

The data source configuration information includes names (such as data table names) of data sources configured by a user, and the like; the data fields in the data field configuration information include dimension fields and/or metric fields. When the target report component is a chart component or a table component, the data field configuration information corresponding to the target report component is dimension field configuration information and measurement field configuration information; if the target report component is a card graph component, a time screening component, a fuzzy query component and an accurate query component, the data field configuration information corresponding to the target report component can be only one of dimension field configuration information and measurement field configuration information; the style configuration information specifically comprises display style information such as background color, title size, lines and the like of the target report component; and the linkage relation configuration information is specifically the linkage relation between the data display type component and the data filtering type component, so that the data display content in the data display type component corresponding to the filtering type component can be updated subsequently according to the linkage relation when the data result corresponding to the filtering type component changes. For example, the association relationship between the graph component and the fuzzy query component may be configured, and when the query condition of the fuzzy query component changes, the data result corresponding to the fuzzy query will also change, and according to the changed data result, the content in the data result area presented in the graph component is updated.

The data processing logic engine 13 is further adapted to: and generating a data report according to the target report component and the attribute configuration information of the target report component. In a specific implementation process, firstly, corresponding report data is acquired according to a data source and data field configuration information corresponding to a target report component; and further displaying data in a corresponding display style at a corresponding position of the report according to the display style and the position information of each target report component.

Therefore, by adopting the system, a user can complete the automatic generation of the data report only by performing selection and configuration operation on the report component primitive in the primitive operation interface, thereby improving the generation efficiency of the data report; moreover, when the data report requirement changes, the data report requirement can be changed only by adjusting the selected data processing assembly or configuration information, so that the flexibility of the data report generation process is further improved, and the labor cost is reduced; moreover, the compiling capability threshold of the user in the data report generating process is reduced, and the user experience is improved.

FIG. 4 is a functional block diagram of a data processing system according to yet another embodiment of the present invention. In this embodiment, further optimization is performed on the basis of the system shown in fig. 1, so that the data processing system can meet the automatic generation requirement of the data model of the user. Wherein the data model is an abstraction of real world data features that underlie the database system. The data model generally includes a hierarchical model, a mesh model, and a relational model. The data processing system provided by the embodiment is mainly used for automatically generating the relational model.

In the system provided in this embodiment, the data model automatic generation entry 41 is provided, and the user enters the data model automatic generation flow by operations such as clicking, voice control, and the like for the data model automatic generation entry 41. In an optional implementation manner, in order to ensure the security of system data, corresponding function use permissions may be configured for different users, and when receiving operations such as clicking, voice control and the like of a user for the data model automatic generation entry 41, it is determined whether the user has the use permission of the data model automatic generation function, and if so, the subsequent module executes the data model automatic generation function; if not, feeding back corresponding authority limit information.

In the present system, the data processing component library 11 is provided with a plurality of data table components.

The metaplastic operator interface 12 is further adapted to render a plurality of data table component primitives. After the user selects the desired database, a plurality of data table component primitives corresponding to the user-selected database are further rendered. As shown in FIG. 5, a number of data table component primitives are presented to the left of FIG. 5 for selection by the user.

And, the metaplastic operation interface 12 is further adapted to receive a selection operation for the rendered data table component primitive. The selection operation for the data table component primitive may be a click operation or a move operation, and the like.

The data processing logic engine 13 is further adapted to determine a plurality of target data tables based on the selection operations for the rendered data table component primitives. For example, by moving the data table component primitive on the left side of fig. 5 to the canvas area in the middle, the data table corresponding to the moved data table component primitive is determined to be the target data table.

After the target data table is determined, the graphical element operation interface 12 is further adapted to: a field configuration entry is presented with a plurality of target data tables. Wherein the field includes a dimension field and/or a metric field. As shown in fig. 5, for the target data table "dm _ u _ tableinfo", its corresponding metric fields include "life cycle", "virtual pricing", "human cost", and "complexity"; the dimension field corresponding to the target data table "dm _ u _ field" includes "incremental ID (dm _ u _ field)" and "table _ ID", etc.

The data processing logic engine 13 is further adapted to: and acquiring field configuration information which is configured by the field configuration entry and aims at the target data table. Wherein the field configuration information includes dimension field information and/or metric field information selected by the user.

The graphical element-based operation interface 12 is further adapted to: join operations are received for a plurality of target data table component primitives. The connection operation for the primitives of the target data table components is specifically a selection and configuration operation for the connection lines. The user can move the connecting line to determine the graphic elements of the data table components connected with the connecting line; the types of the connecting lines include inner connection, outer connection, left connection, right connection, etc.

The data processing logic engine 13 is further adapted to: and determining the connection relation of the target data tables according to the connection operation aiming at the target data table component primitives. Specifically, the connection relation of the target data tables is determined according to the target data tables corresponding to the two ends of the connecting line and the type of the connecting line. Wherein, the connection relation of the target data tables comprises at least one of the following connection relations: inner connection, outer connection, left connection, and right connection.

Finally, the data processing logic engine 13 is further adapted to: and generating a data width table according to the field configuration information of the target data table and the connection relation of the plurality of target data tables. Specifically, according to the field configuration information of the target data table and the connection relationship of the plurality of target data tables, a data width table is generated in a manner corresponding to the connection relationship: aiming at the internal connection mode, the same part in a plurality of (such as 2) target data tables is taken to generate a data width table; aiming at an external connection mode, acquiring all deduplicated data in a plurality of (such as 2) target data tables to generate a data wide table; for the left connection mode, adding part of data which is lacked by the left target data table relative to the right target data table into the left target data table so as to generate a data width table; for the right connection mode, partial data which is missing from the right target data table relative to the left target data table is added to the right table, and a data width table is generated. Optionally, in the process of generating the data width table according to the field configuration information of the target data table and the connection relationships of the multiple target data tables, in order to improve the accuracy of the generated data width table, in this embodiment, corresponding front-end statements (such as json statements and the like) may be generated based on the field configuration information of the target data table and the connection relationships of the multiple target data tables, and further, the corresponding data width table may be generated based on the generated front-end statements.

The graphical element-ized operation interface 12 is further adapted to: and displaying the generated data width table.

Optionally, the data processing logic engine 13 is further adapted to call the parsing engine and the corresponding storage engine to obtain the query data by using the data wide table.

Therefore, by adopting the system, a user only needs to perform selection, field configuration and connection relation configuration operations on the data table component graphics primitives in the graphics primitive operation interface, and the automatic generation of the data model can be completed, so that the generation efficiency of the data model is improved; moreover, when the data model requirements change, the data model requirements can be changed only by adjusting the selected data table components, the field configuration information and the connection relation, so that the flexibility of the data model generation process is further improved, and the labor cost is reduced; moreover, the compiling capability threshold of the user for constructing the data model is reduced, and the user experience is improved.

In yet another embodiment of the present invention, further optimization may be performed with respect to the data processing system shown in FIG. 1 to meet the user's sentence model automation build requirements. That is, the corresponding sentence model building entry can be presented in the graphical operation interface 12. Through which automatic construction of the sentence model can be performed. Specifically, a corresponding database configuration entry, name configuration entry, and corresponding statement configuration entry are presented. As shown in fig. 6a, when a user wants to construct an add-SQL statement model, a database configuration entry, a name configuration entry, and a corresponding statement configuration entry are further presented, and the data processing logic engine 13 receives database configuration information, name configuration information, and statement configuration information input by the user through the database configuration entry, the name configuration entry, and the corresponding statement configuration entry.

Further, as shown in fig. 6b, a field configuration entry of the statement model is presented in the graphical operating interface 12; the field configuration entry includes: the physical name configuration item, the logical name configuration item, the field type configuration item, the dimension/measurement configuration item, the primary key setting configuration item, the unique key configuration item and the like of the field can be used for generating a corresponding statement model and a data table, and the generated data table can be applied to the embodiment of fig. 2 or fig. 4. Therefore, a user can construct the statement model only through the graphical element interface, user operation is simplified, and the construction efficiency of the statement model is improved.

In yet another embodiment of the present invention, further optimization may be performed with respect to the data processing system shown in FIG. 1 to meet the data analysis needs of the user. That is, the corresponding data analysis entry can be presented in the graphical operation interface 12. Through which automatic analysis of the data can be performed. In a specific implementation process, a corresponding data processing rule can be configured through the graphical element operation interface 12; the data processing logic engine 13 is further adapted to: monitoring a preset index according to a preset data processing rule, and calling a corresponding processing method to perform exception processing when the index is determined to be abnormal; and/or acquiring user behavior data, and performing user loss prediction by analyzing the user behavior data. Therefore, the abnormal data processing requirement and the user loss prediction requirement of the user are met.

Fig. 7 is a flowchart illustrating a data processing method according to an embodiment of the present invention. As shown in fig. 7, the method includes:

step S710, presenting a data processing element primitive corresponding to at least one data processing element.

Step S720, receiving selection operation and attribute configuration operation aiming at the rendered data processing component primitive.

Step S730, generating a corresponding data processing logic according to the selection operation and the attribute configuration operation for the rendered primitive of the data processing component.

Step S740, obtaining data required for data processing according to the data processing logic, and processing the data to obtain a data processing result.

Optionally, the presenting the data processing component primitive corresponding to the at least one data processing component further includes: presenting a plurality of report component primitives of different categories; the report component primitives of different types comprise data display component primitives, data filtering component primitives and auxiliary component primitives;

generating corresponding data processing logic according to the selection operation and the attribute configuration operation for the rendered data processing component primitive further comprises: and determining a target report component according to the selection operation aiming at the presented report component primitive.

Optionally, the method further includes: presenting an attribute configuration entry corresponding to the target report component;

the receiving a selection operation and an attribute configuration operation for a rendered data processing component primitive further comprises: acquiring attribute configuration information configured by the attribute configuration entrance and aiming at the target report component;

generating, according to the selection operation and the attribute configuration operation for the rendered data processing component primitive, a corresponding data processing logic further comprises: and generating a data report according to the target report component and the attribute configuration information of the target report component.

Optionally, the attribute configuration entry includes: a data source configuration entry, a data field configuration entry, a style configuration entry, and/or a linkage configuration entry;

the attribute configuration information includes: data source configuration information, data field configuration information, style configuration information, and/or linkage relationship configuration information.

Optionally, the data display class component primitive includes: a chart component primitive, a table component primitive, and/or a card component primitive;

and/or, the data filtering class component primitive comprises: time screening component primitives, fuzzy query component primitives, and/or accurate query component primitives;

and/or, the auxiliary class component comprises: a text box component primitive, a switch component primitive, an input box component primitive, and/or a button component primitive.

Optionally, the rendering a data processing component primitive corresponding to at least one data processing component, and the receiving a selection operation and an attribute configuration operation for the rendered data processing component primitive further includes: presenting a plurality of data table component primitives and receiving selection operations directed to the presented data table component primitives;

generating, according to the selection operation and the attribute configuration operation for the rendered data processing component primitive, a corresponding data processing logic further comprises: a plurality of target data tables is determined based on a selection operation for a rendered data table component primitive.

Optionally, after the determining the plurality of target data tables, the method further includes: presenting a field configuration entry with the plurality of target data tables; and receiving join operations for the plurality of target data table component primitives;

generating corresponding data processing logic according to the selection operation and the attribute configuration operation for the rendered data processing component primitive further comprises: acquiring field configuration information which is configured through the field configuration entry and aims at the target data table; determining the connection relation of a plurality of target data tables according to the connection operation aiming at the graphic primitives of the plurality of target data table components; and generating a data width table according to the field configuration information of the target data table and the connection relation of the plurality of target data tables.

Optionally, the connection relationships of the multiple target data tables include at least one of the following connection relationships:

inner connection, outer connection, left connection, and right connection.

Optionally, after the generating the data wide table, the method further includes: and displaying the data width table.

Optionally, the method further includes: monitoring a preset index, and calling a corresponding processing method to perform exception handling when the index is determined to be abnormal;

and/or acquiring user behavior data, and performing user loss prediction by analyzing the user behavior data.

The specific implementation process of each step in this embodiment may refer to descriptions of corresponding parts in the method embodiments such as fig. 1, fig. 2, and/or fig. 4, which are not described herein again.

By adopting the system, a user can complete data processing only by selecting and configuring the component primitives in the primitive operation interface, so that the data processing efficiency is improved; moreover, when the data processing requirement is changed, the change of the data processing requirement can be realized only by adjusting the selected data processing component or configuration information, so that the flexibility of the data processing process is further improved, and the labor cost is reduced; moreover, the compiling capability threshold of the user in the data processing process is reduced, and the user experience is improved.

According to an embodiment of the present invention, a non-volatile computer storage medium is provided, which stores at least one executable instruction, which can execute the data processing method in any of the above method embodiments.

Fig. 8 is a schematic structural diagram of a computing device according to an embodiment of the present invention, and the specific embodiment of the present invention does not limit the specific implementation of the computing device.

As shown in fig. 8, the computing device may include: a processor (processor)802, a Communications Interface 804, a memory 806, and a communication bus 808.

Wherein:

the processor 802, communication interface 804, and memory 806 communicate with one another via a communication bus 808.

A communication interface 804 for communicating with network elements of other devices, such as clients or other servers.

The processor 802 is configured to execute the program 810, and may specifically perform relevant steps in the above-described data processing method embodiments.

In particular, the program 810 may include program code comprising computer operating instructions.

The processor 802 may be a central processing unit CPU, or an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits configured to implement embodiments of the present invention. The computing device includes one or more processors, which may be the same type of processor, such as one or more CPUs; or may be different types of processors such as one or more CPUs and one or more ASICs.

The memory 806 stores a program 810. The memory 806 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.

The program 810 may be specifically configured to cause the processor 802 to perform the following operations:

In an alternative embodiment, the program 810 may be specifically configured to cause the processor 802 to perform the following operations:

presenting a plurality of report component primitives of different categories; the report component primitives of different types comprise data display component primitives, data filtering component primitives and auxiliary component primitives;

and determining a target report component according to the selection operation aiming at the presented report component primitive.

presenting an attribute configuration entry corresponding to the target report component;

acquiring attribute configuration information configured by the attribute configuration entrance and aiming at the target report component;

and generating a data report according to the target report component and the attribute configuration information of the target report component.

In an alternative embodiment, the attribute configuration portal includes: a data source configuration entry, a data field configuration entry, a style configuration entry, and/or a linkage configuration entry;

In an alternative embodiment, the data display class component primitives include: a chart component primitive, a table component primitive, and/or a card component primitive;

presenting a plurality of data table component primitives and receiving selection operations directed to the presented data table component primitives;

a plurality of target data tables is determined based on a selection operation for a rendered data table component primitive.

presenting a field configuration entry with the plurality of target data tables; and receiving join operations for the plurality of target data table component primitives;

acquiring field configuration information which is configured through the field configuration entry and aims at the target data table; determining the connection relation of a plurality of target data tables according to the connection operation aiming at the graphic primitives of the plurality of target data table components; and generating a data width table according to the field configuration information of the target data table and the connection relation of the plurality of target data tables.

In an optional embodiment, the connection relationship of the plurality of target data tables includes at least one of the following connection relationships:

inner connection, outer connection, left connection, and right connection.

displaying the data width table after the generating the data width table.

monitoring a preset index, and calling a corresponding processing method to perform exception handling when the index is determined to be abnormal;

The algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus. Various general purpose systems may also be used with the teachings herein. The required structure for constructing such a system will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.

In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.

The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components in a data processing system according to embodiments of the present invention. The present invention may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.

The invention discloses: A1. a data processing system comprising:

and the storage engines are suitable for storing mass data.

A2. The system according to a1, wherein the graphical element-based operation interface is further adapted to:

presenting a plurality of report component primitives of different types, wherein the report component primitives of different types comprise data display component primitives, data filtering component primitives and auxiliary component primitives; receiving selection operation aiming at the presented report component primitive;

the data processing logic engine is further adapted to: and determining a target report component according to the selection operation aiming at the presented report component primitive.

A3. The system according to a2, wherein the graphical element-based operation interface is further adapted to:

the data processing logic engine is further adapted to: acquiring attribute configuration information configured by the attribute configuration entrance and aiming at the target report component;

A4. The system of a3, wherein the attribute configuration portal includes: a data source configuration entry, a data field configuration entry, a style configuration entry, and/or a linkage configuration entry;

A5. The system of any of A2-A4, wherein the data display class component primitives comprise: a chart component primitive, a table component primitive, and/or a card component primitive;

A6. The system according to a1, wherein the graphical element-based operation interface is further adapted to: presenting a plurality of data table component primitives and receiving selection operations directed to the presented data table component primitives;

the data processing logic engine is further adapted to: a plurality of target data tables is determined based on a selection operation for a rendered data table component primitive.

A7. The system according to a6, wherein the graphical element-based operation interface is further adapted to:

the data processing logic engine is further adapted to: acquiring field configuration information which is configured through the field configuration entry and aims at the target data table; determining the connection relation of a plurality of target data tables according to the connection operation aiming at the graphic primitives of the plurality of target data table components; and generating a data width table according to the field configuration information of the target data table and the connection relation of the plurality of target data tables.

A8. The system of a7, wherein the linkage of the plurality of target data tables includes at least one of:

inner connection, outer connection, left connection, and right connection.

A9. The system of A7 or A8, wherein the metaplasia operation interface is further adapted to: and displaying the data width table.

A10. The system of a1, wherein the data processing logic engine is further adapted to: monitoring a preset index, and calling a corresponding processing method to perform exception handling when the index is determined to be abnormal;

The invention also discloses: B11. a data processing method using the data processing system of any one of a1-a10, comprising:

B12. The method of B11, wherein rendering data processing component primitives corresponding to at least one data processing component further comprises: presenting a plurality of report component primitives of different categories; the report component primitives of different types comprise data display component primitives, data filtering component primitives and auxiliary component primitives;

B13. The method of B12, wherein the method further comprises: presenting an attribute configuration entry corresponding to the target report component;

B14. The method of B13, wherein the attribute configuration portal includes: a data source configuration entry, a data field configuration entry, a style configuration entry, and/or a linkage configuration entry;

B15. The method of any of B12-B14, wherein the data display class component primitives comprise: a chart component primitive, a table component primitive, and/or a card component primitive;

B16. The method of B11, wherein the rendering data processing component primitives corresponding to at least one data processing component, the receiving selection operations and attribute configuration operations for the rendered data processing component primitives further comprises: presenting a plurality of data table component primitives and receiving selection operations directed to the presented data table component primitives;

B17. The method of B16, wherein after the determining a plurality of target data tables, the method further comprises: presenting a field configuration entry with the plurality of target data tables; and receiving join operations for the plurality of target data table component primitives;

B18. The method of B17, wherein the join relationships of the plurality of target data tables include at least one of:

inner connection, outer connection, left connection, and right connection.

B19. The method of B17 or B18, wherein, after the generating a data wide table, the method further comprises: and displaying the data width table.

B20. The method of B11, wherein the method further comprises: monitoring a preset index, and calling a corresponding processing method to perform exception handling when the index is determined to be abnormal;

The invention also discloses: C21. a computing device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;

the memory is used for storing at least one executable instruction, and the executable instruction causes the processor to execute the corresponding operation of the data processing method according to any one of B11-B20.

The invention also discloses: D22. a computer storage medium having stored therein at least one executable instruction for causing a processor to perform operations corresponding to the data processing method as described in any one of B11-B20.

Claims

1. A data processing system comprising:

and the storage engines are suitable for storing mass data.

2. The system of claim 1, wherein the graphical element-based operation interface is further adapted to:

3. The system of claim 2, wherein the graphical user interface is further adapted to:

4. The system of claim 3, wherein the attribute configuration portal comprises: a data source configuration entry, a data field configuration entry, a style configuration entry, and/or a linkage configuration entry;

5. The system of any of claims 2-4, wherein the data display class component primitives comprise: a chart component primitive, a table component primitive, and/or a card component primitive;

6. The system of claim 1, wherein the graphical element-based operation interface is further adapted to: presenting a plurality of data table component primitives and receiving selection operations directed to the presented data table component primitives;

7. The system of claim 6, wherein the graphical user interface is further adapted to:

8. A data processing method using the data processing system of any one of claims 1-7, comprising:

9. A computing device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;

the memory is used for storing at least one executable instruction, and the executable instruction causes the processor to execute the corresponding operation of the data processing method according to claim 8.

10. A computer storage medium having at least one executable instruction stored therein, the executable instruction causing a processor to perform operations corresponding to the data processing method of claim 8.