CN115408401B - Data storage method and device, computer equipment and storage medium - Google Patents
Data storage method and device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN115408401B CN115408401B CN202211343215.4A CN202211343215A CN115408401B CN 115408401 B CN115408401 B CN 115408401B CN 202211343215 A CN202211343215 A CN 202211343215A CN 115408401 B CN115408401 B CN 115408401B
- Authority
- CN
- China
- Prior art keywords
- data
- information
- row
- field
- result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application relates to a data storage method, a data storage device, computer equipment and a storage medium, and relates to the technical field of data storage. The method comprises the following steps: reading table data in the data table; converting table data in the data table into a row set by using a data row unit; the row set comprises target data information of each data row in the data table, and the target data information comprises field names and field values; traversing the row set, and carrying out isomorphism processing on target data information of each data row in the row set to obtain a first isomorphism result of each data row; the first structuralization result comprises field information and field value information; and performing data storage based on the first structuralization result of each data line. By the method, a uniform data storage structure is provided, so that the complexity of the data table structure in the data table storage process is reduced, the storage pressure is reduced, and the data storage effect is improved.
Description
Technical Field
The embodiment of the application relates to the technical field of data storage, in particular to a data storage method, a data storage device, computer equipment and a storage medium.
Background
The global data often contains a large amount of data, the data organization is complex, a plurality of databases respectively contain a plurality of data tables, and the data tables have various structures.
In the related art, when storing the global data, the data table is usually stored in accordance with the table structure of the data table.
However, as the number of data tables with different structures increases, the diversity of the data storage structure gradually increases and the storage pressure also increases based on the data storage method in the related art, so that the data storage effect is poor.
Disclosure of Invention
The embodiment of the application provides a data storage method, a data storage device, computer equipment and a storage medium, and provides a unified data storage structure, so that data tables stored based on the data storage structure have the same storage structure, the complexity of the data table structure in the data table storage process can be reduced, the storage pressure is reduced, and the data storage effect is improved. The technical scheme comprises the following aspects.
In one aspect, a data storage method is provided, and the method includes:
reading table data in the data table;
converting table data in the data table into a row set by using a data row unit; the row set comprises target data information of each data row in the data table, and the target data information comprises field names and field values;
traversing the row set, and carrying out isomorphism processing on the target data information of each data row in the row set to obtain a first isomorphism result of each data row; the first structuralization result comprises field information and field value information; the field information refers to information composed of field names of the same data line, and the field value information refers to information composed of field values of the same data line;
and performing data storage based on the first structuralization result of each data line.
In another aspect, there is provided a data storage apparatus, the apparatus comprising:
the data reading module is used for reading table data in the data table;
the data conversion module is used for converting the table data in the data table into a row set by using a data row unit; the row set comprises target data information of each data row in the data table, and the target data information comprises field names and field values;
the processing module is used for traversing the line set, carrying out isomorphism processing on the target data information of each data line in the line set and obtaining a first isomorphism result of each data line; the first structuralization result comprises field information and field value information; the field information comprises field names of the same data line, and the field value information comprises field values of the same data line;
and the storage module is used for storing data based on the first structuralization result of each data line.
In one possible implementation manner, the processing module includes:
the numerical value obtaining submodule is used for obtaining each field name and each field value corresponding to the first data line; the first data line is any one of the data lines;
the first connecting submodule is used for connecting the field names of the first data line through a target segmentation character to obtain the field information of the first data line;
and the second connection submodule is used for connecting all field values of the first data line through the target separators to obtain the field value information of the first data line.
In one possible implementation, the connection order of the field names coincides with the connection order of the field values.
In one possible implementation manner, the storage module includes:
the information supplementing submodule is used for supplementing other data information on the basis of the first isomorphic result of each data line to obtain a second isomorphic result of each data line; the other data information is determined based on data information preset in a preset data storage structure;
the storage submodule is used for storing data based on the second isomorphic result of each data line;
the other data information comprises at least one of subject information, title information, grading information, classification information, table name information, library name information and reserved fields.
In one possible implementation manner, the storage submodule includes:
a field determining unit, configured to determine a row-level permission field of the target data row when the other data information includes the reserved field; the target data line is a data line with line-level authority setting in each data line;
a first adding unit, configured to add a field value corresponding to the row-level permission field to the reserved field of the second isomorphic result of the target data row, so as to obtain a third isomorphic result of the target data row;
a second adding unit, configured to add the third isomorphic result of the target data line to an isomorphic set; the isomorphic set comprises final isomorphic results of all data rows;
and the storage unit is used for storing the final isomorphic result of each data row in the isomorphic set.
In a possible implementation manner, the data reading module is configured to, in a case that a data write request is received, access a data source based on the data write request; the data source comprises at least two data tables;
and reading table data in each data table contained in the data source.
In one possible implementation, the table structures of at least two data tables are different.
In another aspect, a computer device is provided, which comprises a processor and a memory, wherein the memory stores at least one computer program, and the at least one computer program is loaded and executed by the processor to realize the data storage method.
In another aspect, a computer-readable storage medium is provided, in which at least one computer program is stored, the computer program being loaded and executed by a processor to implement the above-mentioned data storage method.
In another aspect, a computer program product is provided, which comprises at least one computer program that is loaded and executed by a processor to implement the data storage method provided in the various alternative implementations described above.
The technical scheme provided by the application can comprise the following beneficial effects:
according to the data storage method provided by the embodiment of the application, table data in a data table is converted into a row set, then the row set is traversed, target data information of each data row in the row set is isomorphic processed, a first isomorphic result of each data row is obtained, the first isomorphic result comprises field information consisting of field names of the same data row and field value information consisting of field values of the same data row, and data storage is performed on the data table based on the first isomorphic result of each data row of the data table, so that a uniform data storage structure is provided, the data tables stored based on the data storage structure have the same storage structure, complexity of the data table structure in the data table storage process is reduced, storage pressure is reduced, and the data storage effect is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and, together with the description, serve to explain the principles of the application.
FIG. 1 is a flow chart illustrating a data storage method provided by an exemplary embodiment of the present application;
FIG. 2 illustrates a flow chart of another method of data storage provided by an exemplary embodiment of the present application;
FIG. 3 illustrates a block diagram of a data storage device provided by an exemplary embodiment of the present application;
FIG. 4 is a block diagram illustrating the structure of a computer device in accordance with an exemplary embodiment;
FIG. 5 is a block diagram illustrating the structure of a computer device according to an example embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
Fig. 1 shows a flowchart of a data storage method provided by an exemplary embodiment of the present application, which may be executed by a data storage device, which may be implemented as a server or a terminal having a data storage function, as shown in fig. 1, and the data storage method may include the following steps.
Taking table 1 as an example, table 1 includes 2 data lines, namely data line 1 and data line 2, each data line has a corresponding field name "id", "name" and "age", each data line has a corresponding field value under the corresponding field name, for example, the field value of data line 1 under the field name "id" is "1", the field value under the field name "is" name a ", and the field value under the field name" age "is" 18".
TABLE 1
| id | name | age |
| 1 | Name A | 18 |
| 2 | Name B | 26 |
In the embodiment of the application, the data storage device may sequentially perform isomorphic processing on the target data information of each data line according to the sequence of the data line in the data table; when the target data information of each data line is isomorphic processed, the field name and the field value can be processed respectively to obtain the field information and the field value information of each data line.
And 140, storing data based on the first structuralization result of each data line.
The data storage of the data table can be completed by the data storage of the first structuralization results of the data rows of the same data table.
In the case that there are a plurality of data tables, the data storage device may perform the isomorphic processing operations of steps 110 to 140 on the plurality of data tables, respectively, so as to complete isomorphic storage of the plurality of data tables, that is, unify the storage structures of the plurality of data tables.
In summary, in the data storage method provided in the embodiment of the present application, table data in a data table is converted into a row set, and then the row set is traversed to perform isomorphism processing on target data information of each data row in the row set, so as to obtain a first isomorphism result of each data row, where the first isomorphism result includes field information composed of field names of the same data row and field information composed of field values of the same data row, and data storage is performed on the data table based on the first isomorphism result of each data row of the data table, so that a unified data storage structure is provided, so that the data tables stored based on the data storage structure have the same storage structure, thereby reducing complexity of the data table structure in the data table storage process, reducing storage pressure, and improving the data storage effect.
Fig. 2 shows a flowchart of another data storage method provided by an exemplary embodiment of the present application, which may be executed by a data storage device implemented as a server or a terminal having a data storage function, and as shown in fig. 2, the data storage method may include the following steps.
In one possible implementation, the data storage device connects to the data source upon receiving a data write request; the data source comprises at least two data tables; table data in each data table contained in the data source is read.
Or, the data storage device is connected to different data sources respectively and reads the table data of each data table contained in each data source when receiving different write requests.
That is, the data tables read by the data storage device may originate from the same data source or from different data sources.
Optionally, the table structures of at least two data tables are different; or the table structures of at least two data tables are the same. That is, the table structures of different data tables from the same data source may be the same or different; the table structures of different data tables from different data sources may be the same or different, and this application does not limit this.
Taking table 1 as an example, the row set obtained by converting the table data in table 1 can be represented as:
[
{
"id":1,
"name": name A ",
"age":18
},
{
"id":2,
"name": name B ",
"age":26
}
]
that is, the set structure of the row set corresponding to one data table may be:
[
{
"field name 1" means "field value 1 corresponding to data line 1",
"field name 2" means "field value 2 corresponding to data line 1",
"field name 3" field value 3 corresponding to data line 1"
……
},
{
"field name 1" means "field value 1 corresponding to data line 2",
"field name 2" means "field value 2 corresponding to data line 2",
"field name 3" the field value 3 corresponding to the data line 2"
……
}
]
It should be noted that the above listed data tables and corresponding row sets are only illustrative, and the application does not limit the number of field names in the data tables, the number of data rows in the data tables, and the number of field values corresponding to the field names.
The process of performing isomorphism processing on the target data information of the data line by using a data line example to obtain the first isomorphism result of the data line can be realized as follows:
acquiring each field name and each field value corresponding to the first data line; the first data line is any one of the data lines;
connecting each field name of the first data line through a target segmentation character to obtain field information of the first data line;
and connecting the field values of the first data line through the object separators to obtain the field value information of the first data line.
The target separator may be set based on actual requirements, and the target separator may be "space", or may be "/", or slash, which is not limited in this application.
When the field names are connected and the field values are connected, the connection sequence of the field names is consistent with that of the field values.
Taking the target separator as a blank, schematically, after performing isomorphism processing on the data line 1 in table 1, the obtained first isomorphism result of the data line 1 can be represented as:
{
"field information": id name age ",
"field value information": 1 name A18 "
}
After isomorphism processing is performed on the data line 2 in table 1, the obtained first isomorphism result of the data line 2 can be represented as:
{
"field information": id name age ",
field value information 2 name B26 "
}
After the isomorphism processing is performed on each data line in each data table, a first isomorphism result corresponding to each data line is obtained.
Wherein, the other data information comprises at least one of subject information, title information, grading information, classification information, table name information, library name information and reserved fields.
The data storage structure may be preset based on actual requirements, the reserved field may be a row-level permission reserved field, and the preset data storage structure may include a plurality of reserved fields.
Illustratively, if the other data information includes subject information, title information, hierarchical information, classification information, table name information, library name information, and reserved fields, the data storage structure may be represented as:
{
subject matter: subject classification to which data sheet belongs
Title: title name to which data table belongs
Grading: class to which the data sheet belongs
And (4) classification: category to which data table belongs
Table name: data table names
Library name: database name
Field information (target delimiter separation):
field value information (target separator):
reservation 1: line level permission reservation field
And (4) reserving:
and (3) reserving:
and 4, reservation:
}
taking table 1 as an example, after the first isomorphic result of the data row 1 is obtained, the second isomorphic result of the data row 1 obtained by supplementing other data information on the basis of the first isomorphic result can be represented as:
{
subject matter: subject _1
Title: title _1
Grading: 2
And (4) classification: 3
Table name: table _1
Library name: database _1
Field information (target delimiter separation): id name age
Field value information (target separator): 1. name A18
Reservation 1:
and (4) reserving:
and (3) reservation:
and 4, reservation:
}
after obtaining the first isomorphic result of the data line 2, the second isomorphic result of the data line 2 obtained by supplementing other data information on the basis of the first isomorphic result can be expressed as:
{
subject matter: subject _1
Title: title _1
Grading: 2
And (4) classification: 3
Table name: table _1
Library name: database _1
Field information (target delimiter separation): id name age
Field value information (target delimiter separation): 2. name B26
Reservation 1:
and (4) reserving:
and (3) reservation:
and (4) reservation:
}
the field value in the other data information can be obtained from the related information of the corresponding data table and the related information of the data source corresponding to the data table.
And step 250, storing data based on the second isomorphic result of each data line.
After the second isomorphic result of each data line is obtained, judging whether each data line has line-level authority setting; determining the data line with the line-level authority setting as a target data line, further performing information supplementation on the basis of a second isomorphic result of the target data line, acquiring a third isomorphic result of the target data line, and storing the third isomorphic result of the target data line; this process may be implemented as:
when other data information comprises a reserved field, determining a row-level authority field of a target data row; the target data line is a data line with line-level authority setting in each data line;
adding a field value corresponding to the row-level authority field into a reserved field of a second isomorphic result of the target data row to obtain a third isomorphic result of the target data row;
adding the third isomorphic result of the target data row into the isomorphic set; the isomorphic set comprises final isomorphic results of each data line;
and storing the final isomorphic result of each data line in the isomorphic set.
Wherein, whether the target data row has the row-level authority setting or not and the row-level authority field of the target data row can be determined from the related information of the data table; illustratively, if the related information in table 1 indicates that the "age" field has been set as the row-level permission field, the field value corresponding to the "age" in the target data row is added to the reserved field, and the third isomorphic result of data row 1 in table 1 may be represented as:
{
subject matter: subject _1
Title: title _1
Grading: 2
And (4) classification: 3
Table name: table _1
Library name: database _1
Field information (target delimiter separation): id name age
Field value information (target separator): 1. name A18
Reservation 1:18
And (4) reserving:
and (3) reserving:
and (4) reservation:
}
that is, after the second isomorphic result of each data row is obtained, if a target data row with row-level authority setting exists, adding a field value corresponding to a row-level authority field on the basis of the second isomorphic result of the target data row to obtain a third isomorphic result of the target data row; adding the final isomorphic result of each data line into the isomorphic set so as to write and store the data in the final isomorphic result of each data line in the isomorphic set; and the final isomorphic result of the target data line is a third isomorphic result, and the final isomorphic result of other data lines except the target data line in each data line is a second isomorphic result.
To sum up, in the data storage method provided in the embodiment of the present application, table data in a data table is converted into a row set, and then the row set is traversed to perform isomorphism processing on target data information of each data row in the row set, so as to obtain a first isomorphism result of each data row, where the first isomorphism result includes field information composed of field names of the same data row and field information composed of field values of the same data row, and data storage is performed on the data table based on the first isomorphism result of each data row of the data table, so as to provide a uniform data storage structure, so that the data tables stored based on the data storage structure have the same storage structure, thereby reducing complexity of the data table structure in the data table storage process, reducing storage pressure, and improving the data storage effect;
meanwhile, each data line supports the line-level authority setting of the respective data line, and a foundation is laid for subsequent operations of searching, inquiring, authenticating and the like based on the data in the isomorphic set, so that the subsequent searching and inquiring efficiency is improved, and the authentication effect is improved.
Fig. 3 shows a block diagram of a data storage device provided in an exemplary embodiment of the present application, which may perform all or part of the steps shown in any of fig. 1 or fig. 2, and as shown in fig. 3, the data storage device may include the following modules.
A data reading module 310, configured to read table data in a data table;
the data conversion module 320 is configured to convert the table data in the data table into a row set in units of data rows; the row set comprises target data information of each data row in the data table, and the target data information comprises field names and field values;
the processing module 330 is configured to traverse the row set, perform isomorphism processing on the target data information of each data row in the row set, and obtain a first isomorphism result of each data row; the first structuralization result comprises field information and field value information; the field information comprises field names of the same data line, and the field value information comprises field values of the same data line;
a storage module 340, configured to perform data storage based on the first structuralization result of each data row.
In a possible implementation manner, the processing module 330 includes:
the numerical value obtaining submodule is used for obtaining each field name and each field value corresponding to the first data line; the first data line is any one of the data lines;
the first connecting sub-module is used for connecting the field names of the first data line through a target segmentation character to obtain the field information of the first data line;
and the second connection submodule is used for connecting all field values of the first data line through the target separators to obtain the field value information of the first data line.
In one possible implementation, the connection order of the field names coincides with the connection order of the field values.
In a possible implementation manner, the storage module 340 includes:
the information supplementing submodule is used for supplementing other data information on the basis of the first isomorphic result of each data line to obtain a second isomorphic result of each data line; the other data information is determined based on data information preset in a preset data storage structure;
the storage submodule is used for storing data based on the second isomorphic result of each data line;
the other data information comprises at least one of subject information, title information, grading information, classification information, table name information, library name information and reserved fields.
In one possible implementation manner, the storage submodule includes:
a field determining unit, configured to determine a row-level permission field of the target data row when the other data information includes the reserved field; the target data line is a data line with line-level authority setting in each data line;
a first adding unit, configured to add a field value corresponding to the row-level permission field to the reserved field of the second isomorphic result of the target data row, so as to obtain a third isomorphic result of the target data row;
a second adding unit, configured to add the third isomorphic result of the target data line to an isomorphic set; the isomorphic set comprises final isomorphic results of all data rows;
and the storage unit is used for storing the final isomorphic result of each data row in the isomorphic set.
In a possible implementation manner, the data reading module 310 is configured to, in a case that a data write request is received, access a data source based on the data write request; the data source comprises at least two data tables;
and reading table data in each data table contained in the data source.
In one possible implementation, the table structures of at least two data tables are different.
In summary, the data storage device provided in the embodiment of the present application converts table data in a data table into a row set, performs isomorphism processing on target data information of each data row in the row set by traversing the row set to obtain a first isomorphism result of each data row, where the first isomorphism result includes field information composed of field names of the same data row and field information composed of field values of the same data row, and performs data storage on the data table based on the first isomorphism result of each data row of the data table, thereby providing a unified data storage structure, so that the data tables stored based on the data storage structure have the same storage structure, thereby reducing complexity of the data table structure in the data table storage process, reducing storage pressure, and improving the data storage effect.
FIG. 4 is a block diagram illustrating the structure of a computer device 400 according to an example embodiment. The computer device may be implemented as a data storage device in the above-described aspects of the present application. The computer apparatus 400 includes a Central Processing Unit (CPU) 401, a system Memory 404 including a Random Access Memory (RAM) 402 and a Read-Only Memory (ROM) 403, and a system bus 405 connecting the system Memory 404 and the CPU 401. The computer device 400 also includes a mass storage device 406 for storing an operating system 409, client 410, and other program modules 411.
Without loss of generality, the computer readable media may comprise computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes RAM, ROM, erasable Programmable Read-Only Memory (EPROM), electrically Erasable Programmable Read-Only Memory (EEPROM) flash Memory or other solid state Memory technology, CD-ROM, digital Versatile Disks (DVD), or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage, or other magnetic storage devices. Of course, those skilled in the art will appreciate that the computer storage media is not limited to the foregoing. The system memory 404 and mass storage 406 described above may be collectively referred to as memory.
According to various embodiments of the present application, the computer device 400 may also operate as a remote computer connected to a network via a network, such as the Internet. That is, the computer device 400 may be connected to the network 408 through the network interface unit 407 coupled to the system bus 405, or may be connected to another type of network or remote computer system (not shown) using the network interface unit 407.
The memory further includes at least one instruction, at least one program, a code set, or a set of instructions, which is stored in the memory, and the central processing unit 401 implements all or part of the steps of the data storage method shown in the above embodiments by executing the at least one instruction, the at least one program, the code set, or the set of instructions.
FIG. 5 is a block diagram illustrating the structure of a computer device 500, according to an example embodiment. The computer device 500 may be implemented as the data storage device described above, such as: smart phones, tablet computers, notebook computers, desktop computers, smart watches, televisions, and the like. Computer device 500 may also be referred to by other names such as user equipment, portable terminals, laptop terminals, desktop terminals, and the like.
Generally, the computer device 500 includes: a processor 501 and a memory 502.
In some embodiments, the computer device 500 may further optionally include: a peripheral interface 503 and at least one peripheral. The processor 501, memory 502 and peripheral interface 503 may be connected by a bus or signal lines. Each peripheral may be connected to the peripheral interface 503 by a bus, signal line, or circuit board. Specifically, the peripheral device includes: at least one of radio frequency circuitry 504, display screen 505, camera assembly 506, audio circuitry 507, and power supply 508.
In some embodiments, the computer device 500 also includes one or more sensors 509. The one or more sensors 505 include, but are not limited to: acceleration sensor 510, gyro sensor 511, pressure sensor 512, optical sensor 513, and proximity sensor 514.
Those skilled in the art will appreciate that the configuration shown in FIG. 5 does not constitute a limitation of the computer device 500, and may include more or fewer components than those shown, or combine certain components, or employ a different arrangement of components.
In an exemplary embodiment, a computer readable storage medium is further provided, in which at least one computer program is stored, the computer program being loaded and executed by a processor to implement all or part of the steps of the above data storage method. For example, the computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a Compact Disc Read-Only Memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, and the like.
In an exemplary embodiment, a computer program product is also provided, which comprises at least one computer program that is loaded by a processor and executes all or part of the steps of the data storage method shown in any of the embodiments of fig. 1 or 2.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.
Claims (7)
1. A method of storing data, the method comprising:
reading table data in the data table;
converting table data in the data table into a row set by using a data row unit; the row set comprises target data information of each data row in the data table, and the target data information comprises field names and field values;
traversing the row set, and carrying out isomorphism processing on the target data information of each data row in the row set to obtain a first isomorphism result of each data row; the first structuralization result comprises field information and field value information; the field information refers to information composed of field names of the same data line, and the field value information refers to information composed of field values of the same data line; the connection sequence of each field name contained in the field information is consistent with the connection sequence of each field value in the field information;
performing data storage based on the first structuralization result of each data line;
wherein the performing data storage based on the first structuralization result of each data line comprises:
supplementing other data information on the basis of the first isomorphic result of each data line to obtain a second isomorphic result of each data line; the other data information is determined based on data information preset in a preset data storage structure; the other data information comprises at least one of subject information, title information, grading information, classification information, table name information, library name information and reserved fields;
performing data storage based on the second isomorphic result of each data row;
the storing data based on the second isomorphic result of each data row includes:
when the other data information comprises the reserved field, determining a row-level authority field of the target data row; the target data line is a data line with line-level authority setting in each data line;
adding a field value corresponding to the row-level authority field to the reserved field of the second isomorphic result of the target data row to obtain a third isomorphic result of the target data row;
adding the third isomorphic result for the target data row to an isomorphic set; the isomorphic set comprises final isomorphic results of all data rows;
and storing the final isomorphic result of each data row in the isomorphic set.
2. The method of claim 1, wherein traversing the row set, isomorphizing the target data information of each data row in the row set, and obtaining a first isomorphizing result for each data row comprises:
acquiring each field name and each field value corresponding to the first data line; the first data line is any one of the data lines;
connecting each field name of the first data line through a target segmentation character to obtain the field information of the first data line;
and connecting the field values of the first data line through the target separators to obtain the field value information of the first data line.
3. The method of claim 1, wherein reading the table data in the data table comprises:
under the condition that a data writing request is received, accessing a data source based on the data writing request; the data source comprises at least two data tables;
and reading table data in each data table contained in the data source.
4. The method of claim 3, wherein the table structure of at least two data tables is different.
5. A data storage device, the device comprising:
the data reading module is used for reading table data in the data table;
the data conversion module is used for converting the table data in the data table into a row set by using a data row unit; the row set comprises target data information of each data row in the data table, and the target data information comprises field names and field values;
the processing module is used for traversing the row set, carrying out isomorphism processing on the target data information of each data row in the row set and obtaining a first isomorphism result of each data row; the first structuralization result comprises field information and field value information; the field information comprises field names of the same data line, and the field value information comprises field values of the same data line; the connection sequence of each field name contained in the field information is consistent with the connection sequence of each field value in the field information;
the storage module is used for storing data based on the first structuralization result of each data line;
wherein the storage module comprises:
the information supplementing submodule is used for supplementing other data information on the basis of the first isomorphic result of each data line to obtain a second isomorphic result of each data line; the other data information is determined based on data information preset in a preset data storage structure; the other data information comprises at least one of subject information, title information, grading information, classification information, table name information, library name information and reserved fields;
the storage submodule is used for storing data based on the second isomorphic result of each data line;
the storage submodule includes:
a field determining unit, configured to determine a row-level permission field of the target data row when the other data information includes the reserved field; the target data line is a data line with line-level authority setting in each data line;
a first adding unit, configured to add a field value corresponding to the row-level permission field to the reserved field of the second isomorphic result of the target data row, so as to obtain a third isomorphic result of the target data row;
a second adding unit, configured to add the third isomorphic result of the target data line to an isomorphic set; the isomorphic set comprises final isomorphic results of all data rows;
and the storage unit is used for storing the final isomorphic result of each data row in the isomorphic set.
6. A computer device comprising a processor and a memory, the memory storing at least one computer program that is loaded and executed by the processor to implement a data storage method as claimed in any one of claims 1 to 4.
7. A computer-readable storage medium, in which at least one computer program is stored, which is loaded and executed by a processor to implement a data storage method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211343215.4A CN115408401B (en) | 2022-10-31 | 2022-10-31 | Data storage method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211343215.4A CN115408401B (en) | 2022-10-31 | 2022-10-31 | Data storage method and device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115408401A CN115408401A (en) | 2022-11-29 |
| CN115408401B true CN115408401B (en) | 2023-03-24 |
Family
ID=84167172
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211343215.4A Active CN115408401B (en) | 2022-10-31 | 2022-10-31 | Data storage method and device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115408401B (en) |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106547786A (en) * | 2015-09-22 | 2017-03-29 | 阿里巴巴集团控股有限公司 | A kind of date storage method and device |
| CN105224663A (en) * | 2015-09-30 | 2016-01-06 | 广州精点计算机科技有限公司 | A kind of data-accessing tasks management method based on multiple data source and device |
| US20180349467A1 (en) * | 2017-06-02 | 2018-12-06 | Apple Inc. | Systems and methods for grouping search results into dynamic categories based on query and result set |
| CN108255984A (en) * | 2017-12-28 | 2018-07-06 | 浪潮通用软件有限公司 | A kind of data analysis method and device |
| CN112579592A (en) * | 2019-09-30 | 2021-03-30 | 北京国双科技有限公司 | Isomorphic data storage method and device |
-
2022
- 2022-10-31 CN CN202211343215.4A patent/CN115408401B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN115408401A (en) | 2022-11-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2017198070A1 (en) | Multi-channel data memory and access method and apparatus therefor, and storage medium | |
| CN102782642A (en) | System and method for aggregation and association of professional affiliation data with commercial data content | |
| CN115827436A (en) | Data processing method, device, equipment and storage medium | |
| CN109815241B (en) | Data query method, device, equipment and storage medium | |
| CN109582906B (en) | Method, device, equipment and storage medium for determining data reliability | |
| CN115408401B (en) | Data storage method and device, computer equipment and storage medium | |
| CN113254673A (en) | Data management method, system, equipment and medium based on knowledge graph | |
| CN105653674A (en) | File management method and system of intelligent terminal | |
| CN109542912B (en) | Interval data storage method, device, server and storage medium | |
| CN111897828A (en) | Data batch processing implementation method, device, equipment and storage medium | |
| CN110909266A (en) | Deep paging method and device and server | |
| CN111414422A (en) | Data distribution method, device, equipment and storage medium | |
| CN103164532A (en) | Classification and partitioning extract method of power grid model data and system | |
| CN113408724A (en) | Model compression method and device | |
| CN109740027B (en) | Data exchange method, device, server and storage medium | |
| CN115794806A (en) | Gridding processing system, method and device for financial data and computing equipment | |
| CN111291230A (en) | Feature processing method and device, electronic equipment and computer-readable storage medium | |
| CN111782886A (en) | Method and device for managing metadata | |
| CN111581490A (en) | Information searching method and device, storage medium and electronic equipment | |
| WO2022156365A1 (en) | Wireless network data matching method, device, and storage medium | |
| CN111581228A (en) | Search method and device for correcting search condition, storage medium and electronic equipment | |
| CN113449196B (en) | Information generation method and device, electronic equipment and readable storage medium | |
| CN116089996A (en) | Data searching method, device, computer equipment and storage medium | |
| US8898177B2 (en) | E-mail thread hierarchy detection | |
| CN117272257A (en) | Professional identity authentication method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |