CN116414820A - Data table preprocessing method and device, electronic equipment and storage medium - Google Patents
Data table preprocessing method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN116414820A CN116414820A CN202111643066.9A CN202111643066A CN116414820A CN 116414820 A CN116414820 A CN 116414820A CN 202111643066 A CN202111643066 A CN 202111643066A CN 116414820 A CN116414820 A CN 116414820A
- Authority
- CN
- China
- Prior art keywords
- data
- preprocessing
- parameter
- data table
- packet
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007781 pre-processing Methods 0.000 title claims abstract description 99
- 238000000034 method Methods 0.000 title claims abstract description 47
- 238000012545 processing Methods 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 6
- 238000003780 insertion Methods 0.000 abstract description 9
- 230000037431 insertion Effects 0.000 abstract description 9
- 230000006870 function Effects 0.000 description 4
- 238000012217 deletion Methods 0.000 description 2
- 230000037430 deletion Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 238000002203 pretreatment Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/50—Reducing energy consumption in communication networks in wire-line communication networks, e.g. low power modes or reduced link rate
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application provides a preprocessing method and device for a data table, electronic equipment and a storage medium, and relates to the field of databases. The preprocessing method of the data table comprises the following steps: creating a preprocessing statement according to the received creation command, wherein the preprocessing statement carries a parameter packet, and the parameter packet at least comprises a placeholder for representing data to be inserted; receiving an execution command for executing the preprocessing statement, wherein the execution command carries a data packet comprising a plurality of groups of data; splicing the parameter packets carried in the preprocessing statement and the data packets carried in the execution command, and inserting each group of data in the data packets into a data table in batches; and deleting the created preprocessing statement. The method is applied to the preprocessing process of the data table in the database, realizes batch insertion of a large amount of data into the data table, and improves preprocessing efficiency.
Description
Technical Field
The embodiment of the application relates to the field of databases, in particular to a preprocessing method and device for a data table, electronic equipment and a storage medium.
Background
The pretreatment flow of the data table in the database is mainly divided into three steps, namely creation, execution and deletion. The creation stage mainly creates a preprocessing statement, the execution stage mainly sets a specific value of the inserted data, and the deletion stage deletes the preprocessing statement defined before. However, in the current preprocessing procedure for data tables, the execution stage can only insert the data table for each group of data independently, and for the insertion of a large amount of data, a large amount of time is consumed, so that the efficiency of the whole preprocessing procedure is reduced.
Disclosure of Invention
The main purpose of the embodiments of the present application is to provide a data table preprocessing method, apparatus, electronic device, and storage medium, so as to implement batch insertion of a large amount of data into a data table, and improve preprocessing efficiency.
In order to achieve the above object, an embodiment of the present application provides a method for preprocessing a data table, including: creating a preprocessing statement according to the received creation command, wherein the preprocessing statement carries a parameter packet, and the parameter packet at least comprises a placeholder for representing data to be inserted; receiving an execution command for executing the preprocessing statement; wherein the execution command carries a data packet comprising a plurality of groups of data; splicing the parameter packets carried in the preprocessing statement and the data packets carried in the execution command, and inserting each group of data in the data packets into a data table in batches; and deleting the created preprocessing statement.
In order to achieve the above object, an embodiment of the present application further provides a preprocessing device for a data table, including:
the system comprises a creation module, a data processing module and a data processing module, wherein the creation module is used for creating a preprocessing statement according to a received creation command, wherein the preprocessing statement carries a parameter packet, and the parameter packet at least comprises a placeholder for representing data to be inserted;
the execution module is used for receiving an execution command for executing the preprocessing statement, wherein the execution command carries a data packet comprising a plurality of groups of data; the parameter packets carried in the preprocessing statement and the data packets carried in the execution command are spliced, and all groups of data in the data packets are inserted into a data table in batches;
and the deleting module is used for deleting the created preprocessing statement.
To achieve the above object, an embodiment of the present application further provides an electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the data table preprocessing method described above.
To achieve the above object, an embodiment of the present application further provides a computer readable storage medium storing a computer program, where the computer program is executed by a processor to implement the above-mentioned preprocessing method for a data table.
According to the preprocessing method, the device, the electronic equipment and the storage medium for the data table, preprocessing sentences containing parameter packets are created according to the creation command, the parameter packets contain placeholders for representing data to be inserted, the parameter packets and the data packets are spliced according to the execution command of the received data packets containing multiple groups of data, the multiple groups of data in the data packets are inserted into the data table in batches, so that the multiple groups of data can be processed in batches without splicing and inserting one group of data, then splicing and inserting the next group of data, preprocessing of the data table can be completed through multiple operations, the splicing time and the inserting time are greatly reduced, and the preprocessing efficiency of the data table is improved.
Drawings
One or more embodiments are illustrated by way of example and not limitation in the figures of the accompanying drawings.
FIG. 1 is a flow chart of a method of preprocessing a data table provided by an embodiment of the present application;
FIG. 2 is a schematic structural diagram of a preprocessing device for a data table according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the embodiments of the present application will be described in detail below with reference to the accompanying drawings. However, as will be appreciated by those of ordinary skill in the art, in the various embodiments of the present application, numerous technical details have been set forth in order to provide a better understanding of the present application. However, the technical solutions claimed in the present application can be implemented without these technical details and with various changes and modifications based on the following embodiments. The following embodiments are divided for convenience of description, and should not be construed as limiting the specific implementation of the present application, and the embodiments may be mutually combined and referred to without contradiction.
The data table preprocessing method of the present application is applicable to any network,
the embodiment of the application relates to a preprocessing method of a data table, as shown in fig. 1, comprising the following steps:
In this embodiment, the parameter packet includes placeholders, where the placeholders represent data to be inserted, and the number of the placeholders is consistent with the number of the data to be inserted. Specifically, for example: the database receives a creation command sent by the client, and creates a preprocessing statement according to the creation command.
And 103, splicing the parameter packets carried in the preprocessing statement and the data packets carried in the execution command, and inserting all groups of data in the data packets into the data table in batches.
In an embodiment, the executing the command includes: a statement identification field for indicating a current to-be-executed preprocessing statement, a batch size field for indicating the number of groups of the plurality of groups of data, and a plurality of unit fields, each of which is used for carrying a group of data; wherein the number of the unit fields is the same as the number of the groups.
Further, step 103 specifically includes: determining a current to-be-executed preprocessing statement according to the statement identification field; acquiring a parameter packet of the current to-be-executed pretreatment sentence, and determining the execution times of the current to-be-executed pretreatment sentence according to the batch size field; and respectively inserting each group of data carried by the unit fields into the data table according to the position of the placeholder in the parameter packet and the execution times.
That is, the execution command includes: a data packet of multiple groups of data, a statement identification field, a batch size field and a unit field. For a database, a creation command and an execution command sent by a plurality of different clients may be received, so that a current to-be-executed preprocessing statement is determined according to a statement identification field in the execution command, that is, a to-be-processed statement created by the creation command corresponds to a to-be-processed statement to be executed by the execution command. And then determining the execution times of the preprocessing statement to be executed according to the batch size field in the execution command, namely the number of groups of data groups which need to be inserted into the data table is the execution times, and then respectively inserting each group of data into the data table according to the position of the placeholder in the parameter package and the execution times in the preprocessing statement. The data table pretreatment method and device can be used for carrying out batch package and batch insertion of multiple groups of data which are required to be inserted into the data table, pretreatment of the data table can be carried out once without carrying out package and insertion of one group of data, and then pretreatment of the data table can be carried out after the next group of data package and insertion. The preprocessing time of the data table is greatly saved.
In addition, in the process of inserting data into the data table, in order to ensure the atomicity of the data in the database, the data table needs to be locked, and the data table is unlocked after the insertion is completed. If the processing time of the data table is too long, the locking time of the data table is too long, and other processing of the data table is affected. Therefore, the preprocessing time of the data table is greatly saved through batch operation, the locking time of the data table is further reduced, and the processing efficiency of the data table is ensured.
In an embodiment, the executing the command further comprises: a command field for indicating a current protocol type; before the parameter packet carried in the preprocessing statement and the data packet carried in the execution command are spliced, the method further comprises the following steps: and determining that the protocol type of the execution command is a batch type according to the command field.
Specifically, after receiving the execution command, obtaining a command field from the execution command, and determining that the protocol type of the execution command is a batch type according to the command field, then performing batch operation on multiple groups of data to be inserted.
In an embodiment, the executing the command further comprises: a flag bit for indicating whether the current execution command is to be transmitted and used with a new data type; in the case where the flag bit indicates that a new data type is to be transmitted and used, the execute command further includes: a parameter type field; the parameter type field is used for indicating the parameter type of each data carried in the unit field; before each group of data carried by the unit fields is respectively inserted into the data table according to the position of the placeholder in the parameter packet and the execution times, the method further comprises the following steps: and analyzing and obtaining the data carried by the unit field according to the parameter type of each data indicated by the parameter type field.
That is, when it is determined that a new data type is used by the flag bit in the execution command, it is necessary to further acquire a parameter type field from the execution command, determine the parameter type of each data from the parameter type field, and parse the data from the parameter type of each data. And then inserting the parsed data into a data table. If the flag bit in the execution command indicates that a new data type is not used at this time, the parameter type of each data is the parameter type of the placeholder in the preprocessing statement, that is, the parameter type of each data is consistent with the parameter type of the placeholder in the preprocessing statement.
In an embodiment, the unit field includes: an indication field for marking whether the data in the unit field is empty and a parameter field for carrying a set of data. Specifically, the parameter field is used for carrying specific content of parameters of each data, and the length of each parameter is determined by a corresponding parameter type, i.e. the parameter type is determined by the parameter type field. The indication field is a bitmap that marks whether the data in the current cell field is empty, one bit for each data. Such as: the unit field has 8 data, that is, 8 bits, and information on whether the 8 data are empty can be stored. Whereas if there are 9 data, one byte is not present, two bytes are required to be present.
In an embodiment, the parameter package further comprises: data to be inserted expressed in a constant; the step of splicing the parameter packet carried in the preprocessing statement and the data packet carried in the execution command, and inserting each group of data in the data packet into a data table in batches comprises the following steps: and matching each group of data in the data packet carried in the execution command with the position of the placeholder in the parameter packet, and inserting the matched data into the data table. Specifically, the parameter packet further includes data to be inserted represented by a constant, the data to be inserted represented by the constant indicates that the content of the data to be inserted is already determined, and no matching determination is needed, and only the data of each group are respectively matched with the position of the placeholder, and the matched data are inserted into the data table, namely, the data to be inserted represented by the constant are not subjected to replacement processing. Compared with the prior art that the data to be inserted in the constant expression is replaced by the placeholder, the method further reduces the packaging time and improves the data insertion efficiency.
In one embodiment, the data band has a self-increasing sequence; before the parameter packets carried in the preprocessing statement and the data packets carried in the execution command are spliced, each group of data in the data packets is inserted into a data table in batches, the method further comprises the steps of: applying for a self-increment sequence to the global transaction controller; the step of splicing the parameter packet carried in the preprocessing statement and the data packet carried in the execution command, and inserting each group of data in the data packet into a data table in batches comprises the following steps: under the condition that the parameter packet comprises the placeholder in the self-increasing sequence, according to the position of the placeholder in the non-self-increasing sequence in the parameter packet, inserting data in the non-self-increasing sequence in each group of data into the data table in batches, and automatically generating the data of the self-increasing sequence inserted into the data table; and under the condition that the parameter packet does not comprise the placeholder in the self-increasing sequence, inserting the groups of data into the data table in batches according to the position of the placeholder in the parameter packet, and automatically generating the data of the self-increasing sequence inserted into the data table.
When the placeholder in the parameter packet is the self-increasing sequence, the data in the non-self-increasing sequence in each group of data is inserted into the data table in batches according to the position of the placeholder in the non-self-increasing sequence, and meanwhile, the data with the self-increasing sequence in the data table is processed according to the placeholder in the self-increasing sequence and the self-increasing sequence applied to the global transaction controller while the data is inserted. And when the parameter packet does not contain the placeholder of the self-increasing sequence, the data of each group of data are directly inserted into the data table in batches according to the position of the placeholder, and after the data insertion is finished, the data of the self-increasing sequence in the data table are independently processed according to the self-increasing sequence applied to the global transaction controller, and the data of the self-increasing sequence inserted into the data table is automatically generated.
That is, when the self-increasing sequence is contained in the data table, the self-increasing sequence in the data table can be processed by the placeholder containing the self-increasing sequence and the self-increasing sequence applied to the global transaction controller while the data is inserted.
And step 104, deleting the created preprocessing statement.
According to the preprocessing method for the data table, preprocessing sentences containing parameter packets are created according to the creation command, the parameter packets contain placeholders for representing data to be inserted, the parameter packets and the data packets are spliced according to the execution command of the data packets containing multiple groups of data, and multiple groups of data in the data packets are inserted into the data table in batches, so that multiple groups of data can be processed in batches without splicing and inserting one group of data, then splicing and inserting the next group of data can be completed through multiple operations, splicing time and inserting time are greatly reduced, and preprocessing efficiency of the data table is improved.
Moreover, it should be understood that the above steps of the various methods are divided, for clarity of description, and may be combined into one step or split into multiple steps when implemented, so long as they include the same logic relationship, and all the steps are within the scope of protection of the present patent; it is within the scope of this patent to add insignificant modifications to the process or introduce insignificant designs, but not to alter the core design of the process.
An embodiment of the present application relates to a preprocessing device for a data table, as shown in fig. 2, including:
a creating module 201, configured to create a preprocessing statement according to a received creating command, where the preprocessing statement carries a parameter packet, and the parameter packet includes at least one placeholder for representing data to be inserted;
an execution module 202, configured to receive an execution command for executing the preprocessing statement, where the execution command carries a data packet including multiple sets of data; the parameter packets carried in the preprocessing statement and the data packets carried in the execution command are spliced, and all groups of data in the data packets are inserted into a data table in batches;
and the deleting module 203 is configured to delete the created preprocessing statement.
It should be noted that the embodiment of the present apparatus is mainly described in terms of a preprocessing method of a data table provided by a method embodiment on a software implementation level, where implementation needs to be supported by hardware, for example, functions of related modules may be deployed on a processor, so that the processor performs corresponding functions, and in particular, data generated by the operation may be stored in a memory for later checking and use.
It should be noted that, each module involved in this embodiment is a logic module, and one logic unit may be one physical unit, or may be a part of one physical unit, or may be implemented by a combination of multiple physical units. In addition, in order to highlight the innovative part of the present invention, units less closely related to solving the technical problem presented by the present invention are not introduced in the present embodiment, but it does not indicate that other units are not present in the present embodiment.
It is to be noted that this embodiment is an embodiment of the apparatus corresponding to an embodiment of the preprocessing method of the data table, and this embodiment may be implemented in cooperation with the above-described embodiment. The related technical details mentioned in the above embodiments are still valid in this embodiment, and are not repeated here for reducing repetition. Accordingly, the related technical details mentioned in the present embodiment can also be applied in the above-described method embodiments.
An embodiment of the present invention relates to an electronic device, as shown in fig. 3, including: at least one processor 301; and a memory 302 communicatively coupled to the at least one processor 301; wherein the memory 302 stores instructions executable by the at least one processor 301, the instructions being executable by the at least one processor 301 to enable the at least one processor 301 to perform the method for preprocessing a data table according to the above embodiments.
Where the memory and the processor are connected by a bus, the bus may comprise any number of interconnected buses and bridges, the buses connecting the various circuits of the one or more processors and the memory together. The bus may also connect various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art, and therefore, will not be described any further herein. The bus interface provides an interface between the bus and the transceiver. The transceiver may be one element or may be a plurality of elements, such as a plurality of receivers and transmitters, providing a means for communicating with various other apparatus over a transmission medium. The data processed by the processor is transmitted over the wireless medium via the antenna, which further receives the data and transmits the data to the processor.
The processor is responsible for managing the bus and general processing and may also provide various functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. And memory may be used to store data used by the processor in performing operations.
Embodiments of the present invention relate to a computer-readable storage medium storing a computer program. The computer program, when executed by the processor, implements the data table preprocessing method described above.
That is, it will be understood by those skilled in the art that all or part of the steps in implementing the methods of the embodiments described above may be implemented by a program stored in a storage medium, where the program includes several instructions for causing a device (which may be a single-chip microcomputer, a chip or the like) or a processor (processor) to perform all or part of the steps in the methods of the embodiments described herein. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
It will be understood by those of ordinary skill in the art that the foregoing embodiments are specific embodiments in which the present application is implemented and that various changes in form and details may be made therein without departing from the spirit and scope of the present application.
Claims (10)
1. A method for preprocessing a data table, comprising:
creating a preprocessing statement according to the received creation command, wherein the preprocessing statement carries a parameter packet, and the parameter packet at least comprises a placeholder for representing data to be inserted;
receiving an execution command for executing the preprocessing statement, wherein the execution command carries a data packet comprising a plurality of groups of data;
splicing the parameter packets carried in the preprocessing statement and the data packets carried in the execution command, and inserting each group of data in the data packets into a data table in batches;
and deleting the created preprocessing statement.
2. The method of preprocessing a data table according to claim 1, wherein said executing a command comprises: a statement identification field for indicating a current to-be-executed preprocessing statement, a batch size field for indicating the number of groups of the plurality of groups of data, and a plurality of unit fields, each of which is used for carrying a group of data; wherein the number of the unit fields is the same as the number of the groups;
the step of splicing the parameter packet carried in the preprocessing statement and the data packet carried in the execution command, and inserting each group of data in the data packet into a data table in batches comprises the following steps:
determining a current to-be-executed preprocessing statement according to the statement identification field;
acquiring a parameter packet of the current to-be-executed pretreatment sentence, and determining the execution times of the current to-be-executed pretreatment sentence according to the batch size field;
and respectively inserting each group of data carried by the unit fields into the data table according to the position of the placeholder in the parameter packet and the execution times.
3. The method of preprocessing a data table according to claim 2, wherein said executing command further comprises: a flag bit for indicating whether the current execution command is to be transmitted and used with a new data type;
in the case where the flag bit indicates that a new data type is to be transmitted and used, the execute command further includes: a parameter type field; the parameter type field is used for indicating the parameter type of each data carried in the unit field; before each group of data carried by the unit fields is respectively inserted into the data table according to the position of the placeholder in the parameter packet and the execution times, the method further comprises the following steps:
and analyzing and obtaining the data carried by the unit field according to the parameter type of each data indicated by the parameter type field.
4. The method of preprocessing a data table according to claim 2, wherein said executing command further comprises: a command field for indicating a current protocol type;
before the parameter packet carried in the preprocessing statement and the data packet carried in the execution command are spliced, the method further comprises the following steps:
and determining that the protocol type of the execution command is a batch type according to the command field.
5. The method for preprocessing a data table according to claim 2, wherein said unit field comprises: an indication field for marking whether the data in the unit field is empty and a parameter field for carrying a set of data.
6. The method of preprocessing a data table according to any one of claims 1 to 5, wherein said parameter packet further comprises: data to be inserted expressed in a constant;
the step of splicing the parameter packet carried in the preprocessing statement and the data packet carried in the execution command, and inserting each group of data in the data packet into a data table in batches comprises the following steps:
and matching each group of data in the data packet carried in the execution command with the position of the placeholder in the parameter packet, and inserting the matched data into the data table.
7. The method for preprocessing a data sheet according to any one of claims 1 to 5, wherein the data sheet has a self-increasing sequence;
before the parameter packets carried in the preprocessing statement and the data packets carried in the execution command are spliced, each group of data in the data packets is inserted into a data table in batches, the method further comprises the steps of: applying for a self-increment sequence to the global transaction controller;
the step of splicing the parameter packet carried in the preprocessing statement and the data packet carried in the execution command, and inserting each group of data in the data packet into a data table in batches comprises the following steps:
under the condition that the parameter packet comprises the placeholder in the self-increasing sequence, according to the position of the placeholder in the non-self-increasing sequence in the parameter packet, inserting data in the non-self-increasing sequence in each group of data into the data table in batches, and automatically generating the data of the self-increasing sequence inserted into the data table;
and under the condition that the parameter packet does not comprise the placeholder in the self-increasing sequence, inserting the groups of data into the data table in batches according to the position of the placeholder in the parameter packet, and automatically generating the data of the self-increasing sequence inserted into the data table.
8. A data table preprocessing apparatus, comprising:
the system comprises a creation module, a data processing module and a data processing module, wherein the creation module is used for creating a preprocessing statement according to a received creation command, wherein the preprocessing statement carries a parameter packet, and the parameter packet at least comprises a placeholder for representing data to be inserted;
the execution module is used for receiving an execution command for executing the preprocessing statement, wherein the execution command carries a data packet comprising a plurality of groups of data; the parameter packets carried in the preprocessing statement and the data packets carried in the execution command are spliced, and all groups of data in the data packets are inserted into a data table in batches;
and the deleting module is used for deleting the created preprocessing statement.
9. An electronic device, comprising:
at least one processor; the method comprises the steps of,
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of preprocessing the data table of any one of claims 1 to 7.
10. A computer readable storage medium storing a computer program, characterized in that the computer program, when executed by a processor, implements the method of preprocessing a data table according to any one of claims 1 to 7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111643066.9A CN116414820A (en) | 2021-12-29 | 2021-12-29 | Data table preprocessing method and device, electronic equipment and storage medium |
| PCT/CN2022/139269 WO2023125038A1 (en) | 2021-12-29 | 2022-12-15 | Data table preprocessing method and apparatus, and electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111643066.9A CN116414820A (en) | 2021-12-29 | 2021-12-29 | Data table preprocessing method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116414820A true CN116414820A (en) | 2023-07-11 |
Family
ID=86997657
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111643066.9A Pending CN116414820A (en) | 2021-12-29 | 2021-12-29 | Data table preprocessing method and device, electronic equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN116414820A (en) |
| WO (1) | WO2023125038A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116975032A (en) * | 2023-07-14 | 2023-10-31 | 南京领行科技股份有限公司 | Data alignment method, system, electronic device and storage medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8090700B2 (en) * | 2008-02-26 | 2012-01-03 | International Business Machines Corporation | Method for updating databases |
| CN102271057B (en) * | 2011-08-02 | 2015-08-05 | 大唐移动通信设备有限公司 | Parameter updating method and equipment |
| CN102521408B (en) * | 2011-12-27 | 2015-04-08 | 北京人大金仓信息技术股份有限公司 | Method for accessing flat file by using java database connectivity (JDBC) interface |
| CN102521409B (en) * | 2011-12-28 | 2015-04-08 | 北京人大金仓信息技术股份有限公司 | Method for updating data of database in batch mode based on communication protocol |
| CN109829327A (en) * | 2018-12-15 | 2019-05-31 | 中国平安人寿保险股份有限公司 | Sensitive information processing method, device, electronic equipment and storage medium |
-
2021
- 2021-12-29 CN CN202111643066.9A patent/CN116414820A/en active Pending
-
2022
- 2022-12-15 WO PCT/CN2022/139269 patent/WO2023125038A1/en unknown
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116975032A (en) * | 2023-07-14 | 2023-10-31 | 南京领行科技股份有限公司 | Data alignment method, system, electronic device and storage medium |
| CN116975032B (en) * | 2023-07-14 | 2024-04-12 | 南京领行科技股份有限公司 | Data alignment method, system, electronic device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023125038A1 (en) | 2023-07-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111209004B (en) | Code conversion method and device | |
| CN108829647A (en) | A kind of data transfer device and device | |
| CN108984177A (en) | A kind of data processing method and system | |
| CN111552838A (en) | Data processing method and device, computer equipment and storage medium | |
| CN109241095B (en) | Rapid query method, terminal and storage medium | |
| CN109165266A (en) | List generation method, device, computer equipment and storage medium | |
| CN110308944B (en) | Configuration file processing method, system, computer device and storage medium | |
| CN112346775B (en) | Index data general processing method, electronic device and storage medium | |
| CN107193917A (en) | Whole station CONFIG.SYS lossless data update method based on IID | |
| CN111541521B (en) | Data packet length identification method and system | |
| CN116414820A (en) | Data table preprocessing method and device, electronic equipment and storage medium | |
| EP2563061B1 (en) | Data cut-over method and apparatus | |
| CN112507729A (en) | Method and device for translating text in page, computer equipment and storage medium | |
| CN116346961B (en) | Financial message processing method and device, electronic equipment and storage medium | |
| CN110990381B (en) | Processing method and device of server, storage medium and electronic device | |
| CN116644035B (en) | File batch warehousing method, device, equipment and storage medium | |
| CN113239039B (en) | Dynamic data storage method, query method, management method and management system | |
| CN112306466A (en) | AAR packet generation method, electronic device, and storage medium | |
| CN111221787A (en) | File processing method and device | |
| CN112039729B (en) | Device identification method, server, electronic device, and storage medium | |
| CN114138829B (en) | Method, system and network equipment for sharing Prepare State | |
| CN110309133B (en) | Batch data processing method and device | |
| CN111882419B (en) | Method and device for quality inspection of files and server | |
| CN117539788A (en) | Method, device, equipment and medium for managing demand documents and test cases | |
| CN115238010A (en) | Data processing method and device based on Gaussian database |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication |