CN112905627B

CN112905627B - Data processing method, data processing device, computer equipment and storage medium

Info

Publication number: CN112905627B
Application number: CN202110308147.7A
Authority: CN
Inventors: 李勤成
Original assignee: Jinling Education Technology Beijing Co ltd
Current assignee: Jinling Education Technology Beijing Co ltd
Priority date: 2021-03-23
Filing date: 2021-03-23
Publication date: 2022-04-29
Anticipated expiration: 2041-03-23
Also published as: CN112905627A

Abstract

The application is applicable to the technical field of data storage, and particularly relates to a data processing method, a device, computer equipment and a storage medium. Compared with other data processing modes, the method has the advantages that the data processing is easier, no complex database statement exists, the establishment of a plurality of data table association management is avoided, the complexity of the database can be reduced, the disordered expansion of the database table is reduced, and the maintenance is easier.

Description

Data processing method, data processing device, computer equipment and storage medium

Technical Field

The present application belongs to the technical field of data storage, and in particular, to a data processing method, apparatus, computer device, and storage medium.

Background

In the information construction, the data flow is based on tables in the database, and as shown in fig. 1, each data constructs a corresponding database table. For a large project, the data association relationship in the Database internal table is very complex, and a sophisticated DBA (Database Administrator) consumes a lot of manpower to develop Database functions to maintain the operation of the Database. The database function is used when the values in the data list need to be analyzed to meet specific conditions. The data management mode of the database has strong DBA dependency, and is not easy to maintain if DBA personnel change and the association logic is different.

Disclosure of Invention

The embodiment of the application provides a data processing method, a data processing device, computer equipment and a storage medium, and aims to solve the problems that association relations among data in a database are complex and are not beneficial to maintenance.

In order to achieve the purpose, the technical scheme adopted by the application is as follows: a data processing method, characterized by: it includes:

storing physical tables formed by creating modules in a logic table, wherein each module corresponds to at least one page at the front end and a physical table for storing module data at the back end, and each module comprises at least one preset function on the page;

setting the information of the physical table data in the logic table to be consistent with the information of the data in the page;

and associating the preset function with the corresponding data in the physical table by adopting preset database statements, so that the data modification of the preset function and the data modification in the physical table are synchronous, and the data circulation is realized, and vice versa.

Optionally, the preset database statement is implemented by a dragging method, including:

splitting each sentence forming the preset database sentence to form each split sentence;

correspondingly associating each split statement with each subfunction forming the preset function;

and dragging and selecting all sub-functions of the preset function according to a preset sequence, and generating the preset database statement when the preset function is formed.

Optionally, the preset database statement is an SQL statement.

Optionally, the information comprises attributes and fields.

Optionally, the attributes include a custom table, a scene table, a metadata table, and a remote table, and are used to improve matching efficiency of the physical table and the page.

Optionally, the field includes a name and a type.

Optionally, the types include a text type, a number type, and a time type.

The present application also provides a data processing apparatus, characterized in that the apparatus comprises:

the storage module is used for storing the physical table formed by the creation module in a logic table, each module corresponds to at least one page at the front end and a physical table for storing the module data at the rear end, and each module comprises at least one preset function on the page;

the processing module is used for setting the information of the physical table data in the logic table to be consistent with the information of the data in the page;

and the association module is used for associating the preset function with the corresponding data in the physical table by adopting preset database statements, so that the modification of the preset function on the data is synchronous with the modification on the data in the physical table, and the data flow is realized, and vice versa.

The present application further provides a computer device comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to perform the steps of:

The present application also provides a computer readable storage medium storing a computer program which, when executed by a processor, causes the processor to perform the steps of:

The data processing method provided by the application has the beneficial effects that: the physical tables formed by all the setting modules are stored in one logic table, modification of all data is only needed to be conducted on the physical tables in the logic table, information of the physical table data in the logic table is set to be consistent with information of data in a page, a preset function is associated with corresponding data in the physical tables through preset database statements, modification of the preset function on the data and modification on the data in the physical tables are synchronous, data circulation is achieved, and the reverse is achieved. Compared with other data processing modes, the method has the advantages that the data processing is easier, no complex database statement exists, the establishment of a plurality of data table association management is avoided, the complexity of the database can be reduced, the disordered expansion of the database table is reduced, and the maintenance is easier.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

FIG. 1 is a schematic diagram of a prior art data storage system;

fig. 2 is a schematic diagram of a data processing method according to an embodiment of the present application;

FIG. 3 is a diagram illustrating a logical table storing physical tables corresponding to modules according to the present application;

FIG. 4 is a schematic illustration of step 13 of FIG. 1 provided herein;

FIG. 5 is a diagram of a data processing apparatus according to an embodiment of the present application;

fig. 6 is an internal structural diagram of a computer device according to an embodiment of the present application.

Detailed Description

In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

As used in this specification and the appended claims, the term "if" may be interpreted contextually as "when", "upon" or "in response to" determining "or" in response to detecting ". Similarly, the phrase "if it is determined" or "if a [ described condition or event ] is detected" may be interpreted contextually to mean "upon determining" or "in response to determining" or "upon detecting [ described condition or event ]" or "in response to detecting [ described condition or event ]".

Furthermore, in the description of the present application and the appended claims, the terms "first," "second," "third," and the like are used for distinguishing between descriptions and not necessarily for describing or implying relative importance.

Reference throughout this specification to "one embodiment" or "some embodiments," or the like, means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," or the like, in various places throughout this specification are not necessarily all referring to the same embodiment, but rather "one or more but not all embodiments" unless specifically stated otherwise. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless expressly specified otherwise.

As shown in fig. 2, an embodiment of the present application provides a data processing method 10, which includes:

step 11, as shown in fig. 3, storing the physical table formed by the creating modules in a logical table, where each module corresponds to at least one page at the front end and a physical table storing module data at the back end, and each module includes at least one preset function on the page;

the system for forming a project is composed of a plurality of modules, all physical tables generated by the creation module are stored in one logic table, the association relationship of at least one data table established relative to one module through the setting is complex, and only physical data on one logic table needs to be processed.

The preset function on the page simulates one or more functions of adding, deleting, changing and searching the database.

Illustratively, a login creating module is taken as an example for explanation, and specifically includes:

and storing a physical table formed by creating a login module in a logic table, wherein the login module corresponds to a page displayed at the front end and a physical table for storing login module data at the rear end, and the login module comprises a registration function and a login function.

Inputting a login account password aiming at the login function, and inquiring whether the information is correct or not, namely, the preset function is a check;

for the registration function, a new user is registered, i.e. the preset function is increased.

Step 12, setting the information of the physical table data in the logic table to be consistent with the information of the data in the page;

wherein the information comprises attributes and fields.

The attributes comprise a custom table, a scene table, a metadata table and a remote table, and the classification of the tables according to the attributes is beneficial to improving the matching efficiency of the physical tables and the pages, namely, when data is processed, the tables with the same attributes are screened firstly, so that the matching efficiency of the physical tables and the pages is improved, and the processing time is shortened.

The user-defined table is a data table created by a user for managing data, and fields are newly created in the user-defined table and comprise field names, field types, data types, whether to be filled and other related information.

The scene table is used for setting the scene table according to different scenes and matching with the existing scene modules in the system so as to process the data in the scenes;

the metadata table is used for establishing association relations among different data tables, and standard metadata can be established for some service nouns or matters. Metadata (Metadata), also called intermediary data and relay data, is data (data about data) describing data, and is mainly information describing data attribute (property) for supporting functions such as indicating storage location, history data, resource search, and file record.

There are many categories of metadata, and more specialized categories are generally classified into business metadata, technical metadata, and operational metadata.

The business metadata describes non-technical characteristics of the data and its use. Examples are domain definitions, report names, titles of reports and web pages, application display names, data quality statistics, and teams responsible for interpreting data quality in a particular domain.

Technical metadata is metadata used to describe techniques and data structures. Examples of technical metadata include field name, length, type, lineage, and database table design.

Operation metadata is a record used to describe operations on data. Such as modifying a record of data, accessing a record of data, etc.

Remote tables, data fields for outside the system may be invoked to retrieve. Therefore, the business requirement that some forms cannot realize is solved.

The fields include a name and a type.

Wherein the types include a text type, a number type, a time (or date) type, and a logic type.

The setting that the information of the physical table data in the logical table is consistent with the information of the data in the page specifically includes:

setting the attribute, the field name and the field type of the data in the physical table to be consistent with the attribute, the field name and the field type of the data in the page.

The name and age in the page data are taken as examples for explanation:

in the page data, a name field is a text field, and an age field is a number field;

the corresponding name field stored in the physical table in the logical table is a text type and the age field is a number field.

And step 13, associating the preset function with the corresponding data in the physical table by adopting preset database statements, so that the preset function modifies the data synchronously with the physical table, and the data circulation is realized, and vice versa.

The modification of data in the preset function displayed on the front-end page directly corresponds to the modification of data in the corresponding physical table in the back-end logical table, and the data circulation is directly formed; otherwise, the data modification corresponding to the physical table in the back-end logical table corresponds to the data modification in the preset function displayed on the front-end page, and the data modification are synchronously carried out to form the data circulation.

The preset database statement may be, but is not limited to, a Structured Query Language (SQL) statement.

Take personnel information as an example (tuser)

Newly-added personnel:

the numbers of the newly added Zhang Sanli Queen five King staff information table are 140178134 respectively

INSERT INTO tuser (id, name, score) VALUES (NULL, 'Zhang three', 140), (NULL, 'Zhang four', 178), (NULL, 'Zhang five', 134);

and (4) deleting personnel:

deleting person-in-person information table with name Zhang III

DELETE FROM tuesrwere name ═ zhangsan';

inquiring personnel:

query all information named Zhang III

SELECT FROM tuser where name is zhang san;

the modifier:

changing class of Zhang three to 189 by modifying personnel information

UPDATE tuser SET score 189WHERE name;

in summary, in the present application, the physical tables formed by all the setting modules are stored in one logical table, and modification of all data only needs to be performed on the physical tables in the logical table, information of the physical table data in the logical table is set to be consistent with information of data in a page, and a preset database statement is used to associate a preset function with corresponding data in the physical table, so that the data modification in the physical table is synchronized with the data modification in the preset function, and data flow is realized, and vice versa. Compared with other data processing modes, the method has the advantages that the data processing is easier, no complex database statement exists, the establishment of a plurality of data table association management is avoided, the complexity of the database can be reduced, the disordered expansion of the database table is reduced, and the maintenance is easier.

Optionally, in order to facilitate the user to edit the preset function, as shown in fig. 4, step 13 is to associate the preset function with the corresponding data in the physical table by using a preset database statement, where the preset database statement is implemented by a dragging method, and the method includes:

step 131, splitting each statement forming a preset database statement to form each split statement;

the preset database statement is divided into a plurality of statements, each statement forms an independent function, an interface is arranged between the statements, and each statement is named as query A, query B, query C, query D and the like;

step 132, associating each split statement with each subfunction forming the preset function;

for example, the preset functions of the lookup may be taken as examples, including:

the sub-functions comprise a data table query function A ', a content query function B ', a target query table C ', a condition limiting function D ', a sorting function E ', and the like;

and correspondingly associating preset database statements A, B, C, D and the like with each subfunction, namely querying A corresponding to a data table query function, querying B corresponding to a query content function, and so on in a one-to-one correspondence manner.

And step 133, dragging and selecting all sub-functions of the preset function according to a preset sequence, and generating a preset database statement when the preset function is formed.

And sequentially dragging and selecting all the searched subfunctions according to the rules of the data table query function A ', the query content function B ', the query target table C ', the condition limiting function D ' and the sequencing function E ', so that interfaces of the query A, the query B, the query C, the query D and the query E are connected with one another to form a complete preset database statement.

The preset database statement may be Structured Query Language (SQL), but is not limited thereto.

The function of presetting database sentences can be realized by a dragging method, the database operation can be simulated only by dragging and splicing the sentences of the database, no complex database sentences exist, and the convenient operability is improved.

As shown in fig. 5, an embodiment of the present application provides a data processing apparatus 20, which includes:

the storage module 21 is configured to store the physical table formed by the creating module in a logical table, where each module corresponds to at least one page at the front end and a physical table storing module data at the back end, and each module includes at least one preset function on the page;

the processing module 22 is used for setting the information of the physical table data in the logical table to be consistent with the information of the data in the page;

the association module 23 is configured to associate the preset function with the corresponding data in the physical table by using a preset database statement, so that the preset function modifies the data synchronously with the physical table, and data flow is achieved, and vice versa.

Optionally, in order to facilitate the user to edit the preset function, the association module 23 includes:

a splitting unit 231, configured to split each statement forming a preset database statement to form each split statement;

an association unit 232, configured to associate each split statement with each subfunction forming a preset function;

The processing unit 233 is configured to drag and select all sub-functions of the preset function according to a preset sequence, and generate a preset database statement when the preset function is formed.

It should be noted that, for the information interaction, execution process, and other contents between the above-mentioned devices/units, the specific functions and technical effects thereof are based on the same concept as those of the embodiment of the method of the present application, and specific reference may be made to the part of the embodiment of the method, which is not described herein again.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules, so as to perform all or part of the functions described above. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described in detail herein.

The present application further provides a computer device comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to perform the steps of the data processing method as in any of the embodiments.

FIG. 6 is a diagram illustrating an internal structure of a computer device in one embodiment. As shown in fig. 5, the computer device includes a processor, a memory, and a network interface connected by a system bus. Wherein the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium of the computer device stores an operating system and may also store a computer program which, when executed by the processor, causes the processor to implement the data processing method. The internal memory may also have stored therein a computer program that, when executed by the processor, causes the processor to perform a data processing method. Those skilled in the art will appreciate that the architecture shown in FIG. 5 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices in which the disclosed aspects may be used, and that a particular computing device may include more or less components than those shown, or may have some components combined, or may have a different arrangement of components

The embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the method steps of the data processing method in the foregoing embodiments may be implemented.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, all or part of the processes in the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer readable storage medium and used by a processor to implement the steps of the embodiments of the methods described above. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer readable medium may include at least: any entity or device capable of carrying computer program code to a photographing apparatus/terminal apparatus, a recording medium, computer Memory, Read-Only Memory (ROM), random-access Memory (RAM), an electrical carrier signal, a telecommunications signal, and a software distribution medium. Such as a usb-disk, a removable hard disk, a magnetic or optical disk, etc. In certain jurisdictions, computer-readable media may not be an electrical carrier signal or a telecommunications signal in accordance with legislative and patent practice.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus/network device and method may be implemented in other ways. For example, the above-described apparatus/network device embodiments are merely illustrative, and for example, a module or a unit may be divided into only one logical function, and may be implemented in other ways, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

The above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; the modifications or substitutions do not make the essence of the corresponding technical solutions depart from the spirit and scope of the technical solutions of the embodiments of the present application, and all are included in the scope of the present application.

Claims

1. A data processing method, characterized by: it includes:

2. The data processing method of claim 1, wherein:

the preset database statement is realized by a dragging method, and the method comprises the following steps:

3. The data processing method of claim 2, wherein:

the preset database statement is an SQL statement.

4. A data processing method according to any one of claims 1 to 3, characterized by:

the information includes attributes and fields.

5. The data processing method of claim 4, wherein:

the attributes comprise a user-defined table, a scene table, a metadata table and a remote table, and are used for improving the matching efficiency of the physical table and the page.

6. The data processing method of claim 4, wherein:

the fields include a name and a type.

7. The data processing method of claim 6, wherein:

the types include a text type, a number type, and a time type.

8. A data processing apparatus, characterized in that the apparatus comprises:

9. A computer device comprising a memory and a processor, the memory storing a computer program that, when executed by the processor, causes the processor to perform the steps of the data processing method of any one of claims 1 to 7.

10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, causes the processor to carry out the steps of the data processing method according to any one of claims 1 to 7.