CN116204554A - Data processing method, system, electronic device and storage medium - Google Patents
Data processing method, system, electronic device and storage medium Download PDFInfo
- Publication number
- CN116204554A CN116204554A CN202310486070.1A CN202310486070A CN116204554A CN 116204554 A CN116204554 A CN 116204554A CN 202310486070 A CN202310486070 A CN 202310486070A CN 116204554 A CN116204554 A CN 116204554A
- Authority
- CN
- China
- Prior art keywords
- model
- data
- data model
- modeling
- rule
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003860 storage Methods 0.000 title claims abstract description 28
- 238000003672 processing method Methods 0.000 title abstract description 17
- 238000013499 data model Methods 0.000 claims abstract description 154
- 238000000034 method Methods 0.000 claims abstract description 36
- 230000004931 aggregating effect Effects 0.000 claims abstract description 14
- 238000004590 computer program Methods 0.000 claims description 13
- 238000012545 processing Methods 0.000 claims description 10
- 230000008569 process Effects 0.000 claims description 7
- 230000004044 response Effects 0.000 claims description 6
- 238000004458 analytical method Methods 0.000 claims description 4
- 238000005516 engineering process Methods 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 10
- 238000011161 development Methods 0.000 description 5
- 230000008901 benefit Effects 0.000 description 3
- 238000007405 data analysis Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000008520 organization Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 241001320851 Aaaba Species 0.000 description 1
- 101100190462 Caenorhabditis elegans pid-1 gene Proteins 0.000 description 1
- 101100190464 Caenorhabditis elegans pid-2 gene Proteins 0.000 description 1
- 101100190466 Caenorhabditis elegans pid-3 gene Proteins 0.000 description 1
- 108010001267 Protein Subunits Proteins 0.000 description 1
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2462—Approximate or statistical queries
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Computational Linguistics (AREA)
- Probability & Statistics with Applications (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application relates to a data processing method, which comprises the following steps: obtaining a data modeling rule, wherein the data modeling rule comprises: according to the type of a preset format, representing the hierarchy of the data model, aggregating a storage table of the data model with a father-son relationship according to a preset attribute identifier, and storing attribute information of the model in a database table of the data model; receiving a modeling operation instruction input by a user according to a data modeling rule, and performing data modeling according to the modeling operation instruction to obtain a tree structure model; and inquiring corresponding instance data in the tree structure model according to an inquiry instruction input by a user. According to the method and the device, the problem that the data processing method in the related technology is poor in efficiency and stability is solved, and a standard modeling rule is provided, so that the data modeling efficiency is improved, meanwhile, the query step can be optimized, the usability of the system is improved, and efficient multidimensional authority control is realized in an enterprise-level complex scene.
Description
Technical Field
The present application relates to the field of software development, and in particular, to a data processing method, system, electronic device, and storage medium.
Background
Data modeling is a technical means for defining and analyzing information systems for data requirements and their corresponding support required. The data modeling work directly relates to the quality and development efficiency of the software product in the software development process.
In the software development process, the modeling quality of the underlying data is related to the stability, efficiency and expansibility of the system. Because of the differences between the technical level and the business level of different developers, the efficiency of data modeling and the stability of data analysis are difficult to ensure by adopting a modeling mode in the prior art.
At present, no effective solution is proposed for the problem of poor efficiency of a data modeling method in the related technology.
Disclosure of Invention
The embodiment of the application provides a data processing method, a system, electronic equipment and a storage medium, which are used for at least solving the problem of poor efficiency and stability of the data processing method in the related technology.
In a first aspect, an embodiment of the present application provides a data processing method, where the method includes:
obtaining a data modeling rule, wherein the data modeling rule comprises: according to the type of a preset format, representing the hierarchy of a data model, and according to a preset attribute identifier, aggregating a storage table of the data model with a father-son relationship, wherein attribute information of the data model is stored in a database table of the data model;
receiving a modeling operation instruction input by a user according to the data modeling rule, and performing data modeling according to the modeling operation instruction to obtain a tree structure model;
and inquiring corresponding instance data in the tree structure model according to an inquiry instruction input by a user.
In some of these embodiments, representing the hierarchy of the data model according to a type of a preset format includes:
setting the type of the first layer data model of the tree structure model as any character of a first preset bit number;
setting types of different data models in the same hierarchy in the tree structure model as characters with the same character bit number and different contents;
the types of the data models of different levels except the root model in the tree structure model are set to be determined according to the types of the parent data model.
In some of these embodiments, the determining the type of the child data model from the type of the parent data model comprises:
acquiring the type of any one of the father data models, and determining the character content of the type of the father data model;
and writing N-bit character content after the character content of the type of the parent data model to obtain the type of the child data model.
In some embodiments, according to a query instruction input by a user, querying corresponding instance data in the tree structure model includes:
in the tree structure model, determining a target data model corresponding to the query instruction;
obtaining the type of the target data model by searching the description information of the target data model, and sequentially determining all father data models of the target data model according to the type of the target data model;
and aggregating the data table of the target data model and the storage tables of all father data models of the target data model through the attribute identification to obtain the full attribute information of the instance data corresponding to the query instruction input by the user.
In some embodiments, the aggregating the data table of the target data model and the stored tables of all parent data models of the target data model by the attribute identification includes:
acquiring corresponding first attribute information from the target data model according to the attribute identification;
acquiring corresponding second attribute information from all father data models of the target data model according to the attribute identification;
and collecting the first attribute information and the second attribute information corresponding to all the attribute identifiers to obtain the full attribute information of the instance data corresponding to the query instruction input by the user.
In some of these embodiments, the method further comprises:
configuring authority information for any one data model in the tree structure model in the process of data processing according to the modeling operation instruction, wherein the child data model inherits the authority information of the father data model;
after generating the tree structure model, performing authority identification on the user based on the authority information, including:
obtaining the type of any target data model by searching the description information of the target data model, and sequentially determining all father data models of the target data model according to the type of the target data model;
generating an access control list based on rule information configured in the target data model and rule information configured in all parent data models of the target data model;
and carrying out authority identification on the access flow according to the access control list.
In some of these embodiments, the rights information configured within the target data model has a higher priority than the rights information configured in its parent model.
In a second aspect, embodiments of the present application provide a data processing system, including: the system comprises a rule acquisition module, a modeling execution module and a response analysis module, wherein the rule acquisition module is used for acquiring a rule;
the rule obtaining module is configured to obtain a data modeling rule, where the data modeling rule includes: according to the type of a preset format, representing the hierarchy of a data model, and according to a preset attribute identifier, aggregating a storage table of the data model with a father-son relationship, wherein attribute information of the data model is stored in a database table of the data model;
the modeling execution module is used for receiving a modeling operation instruction input by a user according to the data modeling rule, and performing data modeling according to the modeling operation instruction to obtain a tree structure model;
the response analysis module is used for inquiring corresponding instance data in the tree structure model according to an inquiry instruction input by a user.
In a third aspect, embodiments of the present application provide a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the method according to the first aspect described above when executing the computer program.
In a fourth aspect, embodiments of the present application provide a computer readable storage medium having stored thereon a computer program which when executed by a processor implements a method as described in the first aspect above.
Compared with the related art, the data processing method provided by the embodiment of the application obtains the data modeling rule through the operation development platform, wherein the data modeling rule comprises the following steps: according to the type of the preset format, representing the hierarchy of the data model, aggregating the storage table of the data model with the father-son relationship according to the preset attribute identification, storing attribute information of the data model in the database table of the data model, receiving a modeling operation instruction input by a user according to a data modeling rule, carrying out data processing according to the modeling operation instruction, generating a tree structure model, and inquiring corresponding instance data in the tree structure model according to an inquiry instruction input by the user. The modeling method solves the problems of low efficiency and poor stability of the data modeling method in the related technology, provides a standard modeling rule, improves the data modeling efficiency, can optimize the query step, improves the usability of the system, and realizes high-efficiency multidimensional authority control in an enterprise-level complex scene.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute an undue limitation to the application. In the drawings:
FIG. 1 is a schematic view of an application environment of a data processing method according to an embodiment of the present application;
FIG. 2 is a flow chart of a data processing method according to an embodiment of the present application;
FIG. 3 is a schematic diagram of a data model association according to an embodiment of the present application;
FIG. 4 is a schematic diagram of aggregating storage tables of data models having parent-child relationships based on attribute identification, according to an embodiment of the present application;
FIG. 5 is a schematic diagram of data model rights inheritance in accordance with embodiments of the present application;
FIG. 6 is a schematic diagram of implementing rights configuration according to an organization structure, according to an embodiment of the present application;
FIG. 7 is a block diagram of a data processing system according to an embodiment of the present application;
fig. 8 is a schematic diagram of an internal structure of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described and illustrated below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden on the person of ordinary skill in the art based on the embodiments provided herein, are intended to be within the scope of the present application.
It is apparent that the drawings in the following description are only some examples or embodiments of the present application, and it is possible for those of ordinary skill in the art to apply the present application to other similar situations according to these drawings without inventive effort. Moreover, it should be appreciated that while such a development effort might be complex and lengthy, it would nevertheless be a routine undertaking of design, fabrication, or manufacture for those of ordinary skill having the benefit of this disclosure, and thus should not be construed as having the benefit of this disclosure.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the application. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is to be expressly and implicitly understood by those of ordinary skill in the art that the embodiments described herein can be combined with other embodiments without conflict.
Unless defined otherwise, technical or scientific terms used herein should be given the ordinary meaning as understood by one of ordinary skill in the art to which this application belongs. Reference to "a," "an," "the," and similar terms herein do not denote a limitation of quantity, but rather denote the singular or plural. The terms "comprising," "including," "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, article, or apparatus that comprises a list of steps or modules (elements) is not limited to only those steps or elements but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. The terms "connected," "coupled," and the like in this application are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The term "plurality" as used herein refers to two or more. "and/or" describes an association relationship of an association object, meaning that there may be three relationships, e.g., "a and/or B" may mean: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship. The terms "first," "second," "third," and the like, as used herein, are merely distinguishing between similar objects and not representing a particular ordering of objects.
The data processing method provided by the embodiment of the application can be applied to an environment shown in fig. 1. Fig. 1 is a schematic view of an application environment of a data processing method according to an embodiment of the present application, as shown in fig. 1, a terminal 10 communicates with a server 11 through a network, and a user performs information interaction with the terminal 10 through an external device on the terminal 10. The terminal 10 receives an operation instruction of a user, and can acquire data from the server 11 according to the operation instruction, and model, inquire, configure control authority, and the like for the data. It should be noted that the terminal 10 may be, but not limited to, various computers, notebook computers, smartphones, tablet computers, and the server 11 may be a stand-alone server or a server cluster composed of a plurality of servers.
An embodiment of the present application provides a data processing method, and fig. 2 is a flowchart of the data processing method according to an embodiment of the present application, as shown in fig. 2, where the flowchart includes the following steps:
step S201, a data modeling rule is obtained, a modeling operation instruction input by a user according to the data modeling rule is received, and data processing is carried out according to the modeling operation instruction, so that a tree structure model is obtained; wherein the data modeling rule includes: and aggregating the storage tables of the data models with the parent-child relationship according to the preset attribute identification according to the hierarchy of the data models represented by the types in the preset format, and storing the attribute information of the data models in the database tables of the data models.
It should be noted that, the scheme provided by the embodiment can be implemented in a development platform, and the development platform receives the user's instructions uniformly and executes corresponding data modeling operations according to the instructions; the software development platform can be any common software development management platform, and can also be a customized industrial software development management platform.
Further, the data modeling rule is a preset unified modeling rule, which is formulated by a developer before modeling. According to the method and the device, through unified modeling specifications, the indicator is modeled according to a given strategy, so that the research and development efficiency of developers can be greatly improved; specifically, the data modeling rule is set to represent the hierarchy of the data model according to the type of the preset format, the storage tables of the data model with father-son relationship are aggregated according to the preset attribute identification, and the attribute information of the data model is stored in the database tables of the data model;
modeling is performed based on the data modeling rule provided by the embodiment, a tree-shaped data structure model can be obtained, and the service model is expanded in a high-efficiency and flexible manner;
specifically, the hierarchy of any one data model can be represented by a type in a preset format, and the attribute of any one model is obtained; specifically, as shown in fig. 3, the type of the model a may be set as AAA, for the model B obtained by further expanding the model a, the type thereof is configured as AAAA, the model B further expands the model B1 obtained by further expanding the model B, and the type thereof is configured as AAAAA; on the other hand, the type of the model C from which the model a extends is configured as AAAB, and the type of the model C1 from which the model C extends is configured as AAABA.
Further, as shown in fig. 3, the modeling rule provided by the embodiment of the application is utilized to perform modeling, so that inheritance of the model attribute can be realized. Specific: for example, model a has the property: PUID, P1, P2, P3, model B and model C are two models extended by model a, corresponding to each other, model B and model C are set to inherit all attributes of model a, and model B and model C may further define their own attributes in addition to inheriting attributes of model a, for example, model B extends attribute P4, and model C extends attribute P6.
At this time, if the model B and the model C need to be further expanded due to the service requirement, specifically, the model B expands a sub-model B1, and the model B1 inherits all the attributes of the model B, including: PUID, P1, P2, P3, P4, of course, model B1 may extend attribute P5 again.
It should be noted that the type and attribute information of each data model are only specific examples, and in practical application, the type and attribute information of the model may be more flexible and complex, however, it should be understood that under the modeling rule of the present application, what character is selected as type and what attribute is configured should all belong to the reasonable implementation scope of the present embodiment.
Step S202, according to a query instruction input by a user, corresponding instance data is queried in the tree structure model.
The tree structure model obtained by the scheme is built through standard and unified bottom modeling rules. Because the attribute has inheritance relationship between the models of the attribute structure, the database table corresponding to the model can be only used for storing the attribute of the model without storing all attribute information; therefore, the storage amount of the data can be reduced as a whole while the original data is not influenced. When the full attribute of the model is required to be acquired, only the storage tables corresponding to all the father models associated with the model are required to be acquired in a combined mode.
Through the steps S201 to S202, compared with the data modeling manner in the prior art, the data modeling method provided by the application provides a set of standard and unified data modeling standards, and the user operates and performs data analysis based on the data modeling standards, so that the efficiency in the software development process and the usability of the system can be improved.
In some of these embodiments, the data modeling specification is set to: the method specifically comprises the steps of representing the hierarchy of the data model according to the type of a preset format:
setting the type of a first layer data model (i.e. a root node of a tree structure) of the tree structure model as any character content with a first preset bit number, wherein the first preset bit number can be any number of 1, 2, 5, 10 and the like, and considering the light weight of the structure of the data model, in the embodiment, the first preset bit number is preferably a smaller number of 1, 2 and the like; further, the type character may be specifically any english letter, such as AA, BB, AAA and BBB.
Setting types of different data models in the same hierarchy in the tree structure model to be the same in character bit number and different in character content; for example, the type of the model A at the top layer is AAA, and the number of character bits of the type of all data models in the second layer is set to 4 bits, such as model B-AAAA, model C-AAAB; the number of character bits of all the cell model types in the third layer is set to 5 bits, for example: model B1-AAAA, model B2-AAAB;
in addition, the types of the data models of different levels in the tree structure model are set to determine the types of the child data models according to the types of the parent data model, wherein the data models of different levels in the tree structure model do not comprise the first layer data model.
In this embodiment, determining the type of the child data model according to the type of the parent data model specifically includes: the number of character bits of the child model type is obtained by adding a fixed N-bit character on the basis of the character of the parent model type, and optionally, the child model type is fixedly added with one bit or two bits after the parent model type.
For example, model a type is set to AAA, then the second layer model extended by model a: the types of the model B and the model C can be AAAA and AAAB respectively; by analogy, model B extends the third layer model: the types of the model B1 and the model B2 may be AAAAA, aaaaab, and AAAAC, respectively.
Through the above type setting mode, the level where any one data model is located and what kind of association exists between the data model and other data models can be conveniently and quickly determined, namely which data model the model is expanded from, and which of the cell model and the sub-model of the model are.
It should be noted that the above case is only a specific example of the data modeling method according to the present application, and in practical application, the number of character bits and the content of the characters of the model may be flexibly selected under the condition that the above rule is satisfied.
In some embodiments, after the data model is obtained through the modeling rule of the present application, convenient and fast data parsing may be implemented through the corresponding parsing specification, as shown in fig. 4, which specifically includes:
in the tree structure model, determining a target data model corresponding to the query instruction; for example, the instance data and the full attribute information corresponding to the query model B1 specifically include:
obtaining the type of the target data model by searching the description information of the target data model, and sequentially determining all father data models of the target data model according to the type of the target data model;
and aggregating the data table of the target data model and the storage tables of all the father data models of the target data model through the attribute identification to obtain the attribute information of the instance data corresponding to the query instruction input by the user.
For example: the attributes of model B1 are: PUID, P1, P2, P3, P4, P5, where P1, P2, P3 are stored in the memory table of model a, P4 is stored in the memory table of model B, and P5 is stored in the memory table of model B1.
The Type-AAAAAA of model B1 is known: the father model Type of the model B1 is AAAA, and the father model of the model B1 can be known to be the model B through the Type; the parent model of model B is model A, which can be determined to be model A, type of the parent model is AA. It should be noted that, the PUID in the model storage table is a unique identifier of an attribute, for example, pid1, pid2, pid3, etc., and by using the attribute identifier, the model storage table with the parent-child relationship can be aggregated from the tree structure model, so as to find and obtain the full attribute of any one model instance.
For example: when the instance data corresponding to the model B1 is queried, the Type of the instance data is AAAAAA by acquiring the description information of the model B1, and the attribute information of the instance of the model B1 can be known to be composed of the models corresponding to the AAAA and the AA, and at the moment, the full attribute information of the instance of the model B1 is acquired through the association attribute PUID aggregation model B1, the model B1 and the model A.
In some of these embodiments, since the data model constructed by the present embodiment is a tree structure model, each child model inherits various attribute features of its parent model, so that the mechanism can be utilized to implement complex rights control of system data, and in particular:
as shown in fig. 5, after the modeling is completed, authority configuration is performed for any one model, where the authority of each model is composed of different rules (Rule), and all the rules together form a data access control list.
For example, authority configuration is performed on the model A, two authority rules Rule1 and Rule2 are defined, the model B is a sub-model of the model A, and the model B inherits the authority Rule of the model A;
further, the authority configuration is performed on the model B, two rules Rule3 and Rule4 are added, and at this time, the authority Rule of the model B has own Rule3 and Rule4 and two rules of the model A which are inherited, and four rules are added in total: rule1, rule2, rule3, rule4.
When judging the authority, the priority of the rule of the data model is highest, then the rule of the father model is the rule of the father model, and further the rule of the father model is analogized until all preset authority rules are traversed.
Specific implementation scenarios are exemplified as follows: when resolving based on the data modeling result provided by the application, rules configured by any one model and rules configured in all parent models thereof are sequentially acquired, for example, a rule list of a model B1 is as follows: rule1, rule2, rule3, rule4, rule5 and Rule6, wherein Rule3 and Rule4 are rules of the model B inherited, rule1 and Rule2 are rules inherited from the model A, and when authority judgment is carried out on the model B1, rule5 and Rule6 of the model B are judged firstly, rule3 and Rule4 are judged, and Rule1 and Rule2 are judged finally.
The specific flow comprises the following steps: after the tree structure model is generated and before an operation instruction of a user is responded, determining a target data model corresponding to the operation instruction;
obtaining the type of the target data model by searching the description information of the target data model, and sequentially determining all father data models of the target data model according to the type of the target data model;
generating an access control list based on rule information configured in the target data model and rule information configured in all parent data models of the target data model;
and carrying out authority identification on the access flow according to the access control list.
As shown in fig. 6, by adopting the modeling method provided by the application, different data access control authorities can be customized in a manner to different service type data, objects of different organization structures are regarded as data models of different levels in a tree structure model, authority rule configuration is performed to different data models, and based on the modeling method in the application, the authority configuration of different levels of an enterprise can be conveniently performed through a unique setting mode of an inheritance mechanism and a type, so that the requirement of the enterprise on multidimensional authority control of different data, different departments, roles, personnel, projects, states and the like is met.
In some embodiments, the present embodiment further provides a data processing system, which is used to implement the foregoing embodiments and preferred implementations, and the description is omitted herein. As used below, the terms "module," "unit," "sub-unit," and the like may be a combination of software and/or hardware that implements a predetermined function. While the means described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.
FIG. 7 is a block diagram of a data processing system, according to an embodiment of the present application, including, as shown in FIG. 7: the system comprises: a rule acquisition module 70, a modeling execution module 71, and a response resolution module 73, wherein;
the rule obtaining module 70 is configured to obtain a data modeling rule, where the data modeling rule includes: according to the type of a preset format, representing the hierarchy of the data model, aggregating a storage table of the data model with a father-son relationship according to a preset attribute identifier, and storing attribute information of the model in a database table of the data model;
the modeling execution module 71 is configured to receive a modeling operation instruction input by a user according to a data modeling rule, and perform data modeling according to the modeling operation instruction to obtain a tree structure model;
the response parsing module 72 is configured to query the corresponding instance data in the tree structure model according to a query instruction input by a user.
In one embodiment, a computer device is provided, which may be a terminal. The computer device includes a processor, a memory, a network interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a data processing method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, can also be keys, a track ball or a touch pad arranged on the shell of the computer equipment, and can also be an external keyboard, a touch pad or a mouse and the like.
In one embodiment, fig. 8 is a schematic diagram of an internal structure of an electronic device according to an embodiment of the present application, and as shown in fig. 8, an electronic device is provided, which may be a server, and an internal structure diagram thereof may be as shown in fig. 8. The electronic device includes a processor, a network interface, an internal memory, and a non-volatile memory connected by an internal bus, where the non-volatile memory stores an operating system, computer programs, and a database. The processor is used for providing computing and control capabilities, the network interface is used for communicating with an external terminal through a network connection, the internal memory is used for providing an environment for the operation of an operating system and a computer program, the computer program is executed by the processor to realize a data processing method, and the database is used for storing data.
It will be appreciated by those skilled in the art that the structure shown in fig. 8 is merely a block diagram of a portion of the structure associated with the present application and is not limiting of the electronic device to which the present application is applied, and that a particular electronic device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.
Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the various embodiments provided herein may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Syncline) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others. The foregoing examples represent only a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the invention. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application is to be determined by the claims appended hereto.
Claims (10)
1. A method of data processing, the method comprising:
obtaining a data modeling rule, wherein the data modeling rule comprises: according to the type of a preset format, representing the hierarchy of a data model, and according to a preset attribute identifier, aggregating a storage table of the data model with a father-son relationship, wherein attribute information of the data model is stored in a database table of the data model;
receiving a modeling operation instruction input by a user according to the data modeling rule, and performing data modeling according to the modeling operation instruction to obtain a tree structure model;
and inquiring corresponding instance data in the tree structure model according to an inquiry instruction input by a user.
2. The method of claim 1, wherein representing the hierarchy of the data model according to a type of a preset format comprises:
setting the type of the first layer data model of the tree structure model as any character of a first preset bit number;
setting types of different data models in the same hierarchy in the tree structure model as characters with the same character bit number and different contents;
the types of the data models of different levels except the root model in the tree structure model are set to be determined according to the types of the parent data model.
3. The method of claim 2, wherein the determining the type of the child data model from the type of the parent data model comprises:
acquiring the type of any one of the father data models, and determining the character content of the type of the father data model;
and writing N-bit character content after the character content of the type of the parent data model to obtain the type of the child data model.
4. The method of claim 1, wherein querying the tree-structure model for corresponding instance data according to a query entered by a user comprises:
in the tree structure model, determining a target data model corresponding to the query instruction;
obtaining the type of the target data model by searching the description information of the target data model, and sequentially determining all father data models of the target data model according to the type of the target data model;
and aggregating the data table of the target data model and the storage tables of all father data models of the target data model through the attribute identification to obtain the full attribute information of the instance data corresponding to the query instruction input by the user.
5. The method of claim 4, wherein aggregating the data table of the target data model and the stored tables of all parent data models of the target data model by the attribute identification comprises:
acquiring corresponding first attribute information from the target data model according to the attribute identification;
acquiring corresponding second attribute information from all father data models of the target data model according to the attribute identification;
and collecting the first attribute information and the second attribute information corresponding to all the attribute identifiers to obtain the full attribute information of the instance data corresponding to the query instruction input by the user.
6. The method according to claim 1, wherein the method further comprises:
configuring authority information for any one data model in the tree structure model in the process of data processing according to the modeling operation instruction, wherein the child data model inherits the authority information of the father data model;
after generating the tree structure model, performing authority identification on the user based on the authority information, including:
obtaining the type of any target data model by searching the description information of the target data model, and sequentially determining all father data models of the target data model according to the type of the target data model;
generating an access control list based on rule information configured in the target data model and rule information configured in all parent data models of the target data model;
and carrying out authority identification on the access flow according to the access control list.
7. The method according to claim 6, wherein: and the priority of the authority information configured in the target data model is higher than that of the authority information configured in the father model.
8. A data processing system, comprising: the system comprises a rule acquisition module, a modeling execution module and a response analysis module, wherein the rule acquisition module is used for acquiring a rule;
the rule obtaining module is configured to obtain a data modeling rule, where the data modeling rule includes: according to the type of a preset format, representing the hierarchy of a data model, and according to a preset attribute identifier, aggregating a storage table of the data model with a father-son relationship, wherein attribute information of the data model is stored in a database table of the data model;
the modeling execution module is used for receiving a modeling operation instruction input by a user according to the data modeling rule, and performing data modeling according to the modeling operation instruction to obtain a tree structure model;
the response analysis module is used for inquiring corresponding instance data in the tree structure model according to an inquiry instruction input by a user.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of any of claims 1 to 7 when executing the computer program.
10. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310486070.1A CN116204554B (en) | 2023-05-04 | 2023-05-04 | Data processing method, system, electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310486070.1A CN116204554B (en) | 2023-05-04 | 2023-05-04 | Data processing method, system, electronic device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116204554A true CN116204554A (en) | 2023-06-02 |
| CN116204554B CN116204554B (en) | 2023-08-08 |
Family
ID=86508041
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310486070.1A Active CN116204554B (en) | 2023-05-04 | 2023-05-04 | Data processing method, system, electronic device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116204554B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030028551A1 (en) * | 2001-08-01 | 2003-02-06 | Sutherland James Bryce | System and method for retrieval of objects from object to relational mappings |
| CN102385629A (en) * | 2011-11-21 | 2012-03-21 | 山东浪潮金融信息系统有限公司 | Application method of extending father and son model to network model in data warehouse |
| CN109033208A (en) * | 2018-06-29 | 2018-12-18 | 杭州海康威视数字技术股份有限公司 | Body constructing method and device |
| US10311051B1 (en) * | 2014-01-29 | 2019-06-04 | Bentley Systems, Incorporated | Storing modeling alternatives with unitized data |
| CN114647650A (en) * | 2022-05-18 | 2022-06-21 | 苏州琞能能源科技有限公司 | Data storage method and device, electronic equipment and storage medium |
| CN115017158A (en) * | 2022-05-31 | 2022-09-06 | 武汉联影医疗科技有限公司 | Node information query method |
| CN115687386A (en) * | 2022-10-28 | 2023-02-03 | 北京字跳网络技术有限公司 | Data query method and device, electronic equipment and storage medium |
| CN115774707A (en) * | 2023-02-15 | 2023-03-10 | 广州汇通国信科技有限公司 | Object attribute based data processing method and device, electronic equipment and storage medium |
| CN115935944A (en) * | 2022-08-19 | 2023-04-07 | 山东省计算中心（国家超级计算济南中心） | Cross-platform standard file tree structure generation method and display control |
| CN115994141A (en) * | 2022-12-06 | 2023-04-21 | 山东浪潮新基建科技有限公司 | Tree-shaped coding method and system |
-
2023
- 2023-05-04 CN CN202310486070.1A patent/CN116204554B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030028551A1 (en) * | 2001-08-01 | 2003-02-06 | Sutherland James Bryce | System and method for retrieval of objects from object to relational mappings |
| CN102385629A (en) * | 2011-11-21 | 2012-03-21 | 山东浪潮金融信息系统有限公司 | Application method of extending father and son model to network model in data warehouse |
| US10311051B1 (en) * | 2014-01-29 | 2019-06-04 | Bentley Systems, Incorporated | Storing modeling alternatives with unitized data |
| CN109033208A (en) * | 2018-06-29 | 2018-12-18 | 杭州海康威视数字技术股份有限公司 | Body constructing method and device |
| CN114647650A (en) * | 2022-05-18 | 2022-06-21 | 苏州琞能能源科技有限公司 | Data storage method and device, electronic equipment and storage medium |
| CN115017158A (en) * | 2022-05-31 | 2022-09-06 | 武汉联影医疗科技有限公司 | Node information query method |
| CN115935944A (en) * | 2022-08-19 | 2023-04-07 | 山东省计算中心（国家超级计算济南中心） | Cross-platform standard file tree structure generation method and display control |
| CN115687386A (en) * | 2022-10-28 | 2023-02-03 | 北京字跳网络技术有限公司 | Data query method and device, electronic equipment and storage medium |
| CN115994141A (en) * | 2022-12-06 | 2023-04-21 | 山东浪潮新基建科技有限公司 | Tree-shaped coding method and system |
| CN115774707A (en) * | 2023-02-15 | 2023-03-10 | 广州汇通国信科技有限公司 | Object attribute based data processing method and device, electronic equipment and storage medium |
Non-Patent Citations (3)
| Title |
|---|
| YONG ZHANG ETC.: "An Efficient Framework for Exact Set Similarity Search Using Tree Structure Indexes", 《2017 IEEE 33RD INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE)》, pages 759 - 770 * |
| 周红伟: "数据仓库技术在实现优惠信息汇聚中的应用", 《中国优秀硕士学位论文全文数据库（信息科技辑）》, pages 138 - 707 * |
| 董亚东 等: "基于模型空间的树形数据处理方法", 《计算机工程》, pages 194 - 199 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116204554B (en) | 2023-08-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AU2005202285B2 (en) | Method, system, and apparatus for providing access to workbook models through remote function calls | |
| US10467250B2 (en) | Data model design collaboration using semantically correct collaborative objects | |
| US7743071B2 (en) | Efficient data handling representations | |
| US20080097802A1 (en) | Time-Series Forecasting | |
| KR101355273B1 (en) | A computing system, a method for controlling thereof, and a computer-readable recording medium having a computer program for controlling thereof | |
| CN112860777B (en) | Data processing method, device and equipment | |
| US20120023071A1 (en) | Converting two-tier resource mapping to one-tier resource mapping | |
| CN113434482A (en) | Data migration method and device, computer equipment and storage medium | |
| CN106557307B (en) | Service data processing method and system | |
| US20100318964A1 (en) | Software extension analysis | |
| CN109800147A (en) | A kind of test cases generation method and terminal device | |
| CN116204554B (en) | Data processing method, system, electronic device and storage medium | |
| CN115629763A (en) | Target code generation method and NPU instruction display method and device | |
| CN116167882A (en) | Conditional expression dynamic configuration method, accounting condition calculation method and accounting condition calculation device | |
| CN115543428A (en) | Simulated data generation method and device based on strategy template | |
| CN111857662B (en) | Programming method for describing specific constitution of object based on MAP and interface | |
| CN112181796B (en) | Information acquisition method, device, server and storage medium | |
| JP7381290B2 (en) | Computer system and data management method | |
| CN112579705B (en) | Metadata acquisition method, device, computer equipment and storage medium | |
| CN113849482A (en) | Data migration method and device and electronic equipment | |
| CN114327611A (en) | Interface description document generation method and device, computer equipment and storage medium | |
| CN108363614B (en) | Application service module management method and device and server | |
| Awiti | Algorithms and architecture for managing evolving ETL workflows | |
| CN112347160B (en) | Work order management method, system and storage medium based on call center system | |
| Angelopoulos et al. | Advances in big data bio analytics |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Data processing methods, systems, electronic devices, and storage media Granted publication date: 20230808 Pledgee: Bank of Jiangsu Limited by Share Ltd. Hangzhou branch Pledgor: Zhejiang Kangle Industrial Software Co.,Ltd. Registration number: Y2024980001786 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right |