CN115617811A

CN115617811A - Data processing method and device, electronic equipment and storage medium

Info

Publication number: CN115617811A
Application number: CN202211393725.2A
Authority: CN
Inventors: 吕鸣; 李昌; 李鹏宇; 单国夫; 郭俊峰; 周凡利; 陈立平
Original assignee: Suzhou Tongyuan Software & Control Technology Co ltd
Current assignee: Suzhou Tongyuan Software & Control Technology Co ltd
Priority date: 2022-11-08
Filing date: 2022-11-08
Publication date: 2023-01-17

Abstract

The invention discloses a data processing method, a data processing device, electronic equipment and a storage medium. The method comprises the following steps: acquiring simulation data and determining the generation time of the simulation data; inserting the simulation data and the generation time of the simulation data into a data table, wherein the position of the simulation data in the data table is determined according to the generation time of the simulation data; and when the data table meets the preset condition, storing the data table into the database. According to the technical scheme, after the simulation data are generated, the simulation data are written into the data table, and when the simulation data written into the data table meet the preset conditions, the simulation data in the data table are stored into the database, so that the number of times of inserting the simulation data can be reduced, the storage time of the simulation data is shortened, and the data storage efficiency is improved.

Description

Data processing method and device, electronic equipment and storage medium

Technical Field

The present invention relates to the field of software engineering technologies, and in particular, to a data processing method and apparatus, an electronic device, and a storage medium.

Background

With the development and application of simulation technology, the requirements of technicians on simulation performance of industrial software are gradually increased, especially the storage efficiency of simulation data.

At present, a storage method of simulation data is to directly store each piece of simulation data after being generated, but when a large amount of simulation data needs to be stored in a plurality of servers, data storage needs to be across networks and is affected by the number of the simulation data, the efficiency of network transmission and other factors, and the storage speed and the storage efficiency of the simulation data are low.

Disclosure of Invention

The invention provides a data processing method, a data processing device, electronic equipment and a storage medium, which are used for reducing the times of inserting simulation data and the time of storing the simulation data and improving the data storage efficiency.

According to an aspect of the present invention, there is provided a data processing method, the method including:

acquiring simulation data and determining the generation time of the simulation data;

inserting the simulation data and the generation time of the simulation data into a data table, wherein the position of the simulation data in the data table is determined according to the generation time of the simulation data;

and when the data table meets the preset condition, storing the data table into the database.

Optionally, when the data table meets the preset condition, storing the data table to the database, including: determining whether the quantity of the simulation data inserted into the data table is equal to a first preset threshold value; and if the quantity of the simulation data inserted into the data table is equal to a first preset threshold value, storing the data table into a database.

Optionally, when the data table meets the preset condition, storing the data table to the database, including: determining whether the remaining space of the data table is less than or equal to a second preset threshold; and if the residual space of the data table is less than or equal to a second preset threshold value, storing the data table to the database.

Optionally, when the data table meets the preset condition, storing the data table to the database, including: determining whether the last simulation data inserted into the data table is the last simulation data generated in the simulation process; and if the last simulation data inserted into the data table is the last simulation data generated in the simulation process, storing the data table into a database.

Optionally, storing the data table to a database includes: inserting the data table into a queue; storing the data table to a local database based on the queue; alternatively, the data tables are sent to the distributed database based on the queues, such that the distributed database stores the data tables.

Optionally, the data table includes attribute time, and the data tables are arranged in the local database or the distributed database according to the sequence of the attribute time.

Optionally, the attribute time is at least one of the following times: the simulation data generating method comprises the steps of generating time of a data table, sending time of the data table and generating time of simulation data corresponding to a preset position in the data table.

According to another aspect of the present invention, there is provided a data processing apparatus comprising:

the receiving module is used for acquiring the simulation data and determining the generation time of the simulation data;

the processing module is used for inserting the simulation data and the generation time of the simulation data into the data table, and the position of the simulation data in the data table is determined according to the generation time of the simulation data;

and the storage module is used for storing the data table to the database when the data table meets the preset condition.

According to another aspect of the present invention, there is provided an electronic apparatus including:

at least one processor; and a memory communicatively coupled to the at least one processor;

wherein the memory stores a computer program executable by the at least one processor, the computer program being executable by the at least one processor to enable the at least one processor to perform the data processing method according to any of the embodiments of the present invention.

According to another aspect of the present invention, there is provided a computer-readable storage medium storing computer instructions for causing a processor to implement a data processing method according to any one of the embodiments of the present invention when the computer instructions are executed.

According to the technical scheme of the embodiment of the invention, the simulation data are obtained, and the generation time of the simulation data is determined; inserting the simulation data and the generation time of the simulation data into a data table, wherein the position of the simulation data in the data table is determined according to the generation time of the simulation data; and when the data table meets the preset condition, storing the data table into the database. After the simulation data are generated, the simulation data are written into the data table, and when the simulation data written into the data table meet preset conditions, the simulation data in the data table are stored in the database, so that the insertion times of the simulation data can be reduced, the storage time of the simulation data is shortened, and the data storage efficiency is improved. The problem of low storage efficiency caused by low data storage speed when a large amount of simulation data are stored is solved.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present invention, nor do they necessarily limit the scope of the invention. Other features of the present invention will become apparent from the following description.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the description below are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic flow chart of a data processing method according to an embodiment of the present invention;

fig. 2 is a schematic structural diagram of a data processing apparatus according to a second embodiment of the present invention;

fig. 3 is a schematic structural diagram of an electronic device according to a third embodiment of the present invention.

Detailed Description

In order to make those skilled in the art better understand the technical solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Example one

Fig. 1 is a flowchart of a data processing method according to an embodiment of the present invention, where the data processing method is applicable to data storage and the like, and the data processing method may be executed by a data processing apparatus according to an embodiment of the present invention, where the apparatus may be implemented in a form of hardware and/or software, and in a specific embodiment, the apparatus may be integrated in an electronic device. The following embodiments will be described by taking as an example that the apparatus is integrated in an electronic device, and referring to fig. 1, the method specifically includes the following steps:

s101, acquiring simulation data and determining the generation time of the simulation data.

The simulation data may be understood as one frame of data generated in the simulation process, and the generation time of the simulation data may be understood as an identification time of the frame of data, for example, a time for starting to form the frame of data, a time for determining the frame of data, a time for receiving the frame of data, and the like, which is not limited in this embodiment of the present invention.

Specifically, the server includes a solver and a controller, where the controller may be used to set simulation parameters, and after the server receives a simulation control instruction sent by a user, the solver starts to operate according to the simulation parameters set by the controller to generate simulation data, and sends the simulation data to the controller, and the controller inserts the simulation data into the database.

For example, the controller may receive the simulation data generated by the solver and determine the generation time of the simulation data, and the generation time of the simulation data may be the time when the solver prepares to form the simulation data, the time when the solver determines the simulation data, the time when the solver sends the simulation data, the time when the controller receives the simulation data, and the like.

The time when the solver prepares to form the simulation data can be understood as the time when the solver starts to form the simulation data, and the time when the solver determines the simulation data can be understood as the time when the simulation data is completely generated.

The simulation data can be sorted according to time, so that the simulation data are orderly arranged, and the data insertion efficiency is improved.

S102, inserting the simulation data and the generation time of the simulation data into a data table, wherein the position of the simulation data in the data table is determined according to the generation time of the simulation data.

The data table may be understood as a cache table of the simulation data. The plurality of pieces of simulation data may be formed in the simulation process, and inserting the simulation data and the generation time of the simulation data into the data table may be understood as inserting the plurality of pieces of simulation data generated in the simulation process and the generation time of the simulation data corresponding to the plurality of pieces of simulation data into the data table.

Specifically, the data table is provided with a plurality of rows, each row can be inserted with one simulation data, the position of the simulation data inserted into the data table is determined by the generation time of the simulation data, for example, the simulation data is inserted in a mode that the generation time is from early to late, the simulation data with the early generation time is arranged above the data table, and the simulation data with the late generation time is arranged below the data table.

Illustratively, there are three pieces of simulation data, and the data generation times of the three pieces of simulation data are time 1, time 2, and time 3, respectively. If the time 2 is earlier than the time 1 and the time 3 is earlier than the time 1, the simulation data 2 in the simulation data is inserted into the data table, the simulation data 3 is inserted into the data table, and finally the simulation data 1 is inserted into the data table. The simulation data are inserted one by one, and the data table is written with the simulation data in line order.

The advantage of this arrangement is that the simulation data can be sorted by taking the generation time of the simulation data as a reference standard, so that the simulation data in the data table are regularly distributed.

And S103, storing the data table to a database when the data table meets a preset condition.

The simulation data is continuously inserted into the data table until the data table meets the preset condition. The Database may be understood as a time-series Database, including an online Internet of Things time-series Database (IoTDB), which is not limited in the embodiment of the present invention.

Specifically, the data table has a memory upper limit, that is, the data table can write limited simulation data. The preset conditions are set to enable the data table to insert more simulation data on the basis that the storage upper limit is not exceeded, and include whether the quantity of the simulation data inserted in the data table is equal to a first preset threshold, whether the remaining space of the data table is less than or equal to a second preset threshold, whether the last simulation data inserted in the data table is the last simulation data generated in the simulation process, and the like.

According to the characteristics of the simulation data, a data structure of a data table as shown below is set.

The Table represents a data Table, the schema is used for recording the name of the data Table, the two-dimensional array values are used for storing simulation data, and the maxRowNumber is used for representing the threshold of the two-dimensional array.

Further, the server includes four interfaces as shown below.

bool checkSorted_Ty(const Table_Ty&tablet)；

void sortTablet_Ty(Table_Ty&tablet)；

void insertTablet_Ty(Table_Ty&tablet)；

void insertTablet_Ty(Table_Ty&tablet,bool sorted)；

Wherein, the checkSorted _ Ty (const Table _ Ty & Table) indicates whether the internal cache of the Table is checked to be sorted according to the time sequence; the sortTable _ Ty (Table _ Ty & Table) represents that the internal caches of the tables are sorted according to time sequence; insert Table _ Ty (Table _ Ty & Table) indicates that Table is inserted into the time series database; the insertTable _ Ty (Table _ Ty & Table, cool cached) indicates that the Table is inserted into the time sequence database, and the cached is the current internal cache of the Table and is sorted according to the time sequence.

For example, before the data table is inserted into the database, it is determined whether the data in the data table is sorted according to a time sequence, and if the data in the data table is not sorted according to a time sequence, the simulation data in the data table is inserted into the database after being sorted according to a time sequence.

The advantage of setting up like this lies in can be the media of data insertion with the data table, when the data table satisfies preset condition, with the data table storage to the database (be about to the emulation data storage in the data table to the database), can reduce the number of times of data storage to the database, and then reduce data storage time, promote data storage efficiency.

Optionally, when the data table meets the preset condition, storing the data table into the database includes: determining whether the quantity of the simulation data inserted into the data table is equal to a first preset threshold value; and if the quantity of the simulation data inserted into the data table is equal to a first preset threshold value, storing the data table into a database.

The first preset threshold may be understood as the maximum value of the simulation data that can be inserted into the data table, and includes 500, 800, 1000, and the like. Specifically, the first preset threshold is related to the upper storage limit of the data table and the size of the simulation data, and the first preset threshold of the data table may be calculated according to the upper storage limit of the data table and the size of the simulation data.

Specifically, if the sizes of the simulation data are the same, the first preset threshold may be determined according to a quotient of the upper storage limit of the data table and the size of the simulation data, for example, the first preset threshold = upper storage limit of the data table/size-1 of the simulation data. Since the header is required in the data table, the first preset threshold is less than 1 in the number of rows of the data table, and the header of the data table includes the simulation data and the generation time of the simulation data, which is not limited in the embodiment of the present invention.

For example, assuming that the first preset threshold of the data table is 500, the number of pieces of simulation data inserted into the data table may be recorded, and when the number of pieces of simulation data inserted into the data table is 500, the data table is stored into the database.

Optionally, when the data table meets the preset condition, storing the data table into the database includes: determining whether the remaining space of the data table is less than or equal to a second preset threshold; and if the residual space of the data table is less than or equal to a second preset threshold value, storing the data table to the database.

The second preset threshold may be understood as simulation data with the minimum storage space requirement. Specifically, when the sizes of the simulation data are different, it may be determined when to store the data table to the database according to the remaining storage amount of the data table.

For example, after the simulation data is inserted into the data table, the current remaining storage amount of the data table may be determined according to the remaining storage amount (i.e., the remaining space) of the data table before the simulation data is inserted and the size of the simulation data, and the relationship between the current remaining storage amount and the second preset threshold value may be determined, and when the remaining space (i.e., the current remaining storage amount) of the data table is less than or equal to the second preset threshold value, it is considered that the remaining space of the current data table cannot be inserted with the simulation data, and the data table may be stored in the database. Further, when the simulation data are equal in size, the remaining space of the data table may also be used to determine when to store the data table to the database.

Specifically, the number of pieces of simulation data generated in the simulation process may be pre-calculated, the number of pieces of inserted simulation data may be recorded in the process of inserting the simulation data into the data table, and after the last simulation data is inserted into the data table, the data table may be stored in the database no matter how many pieces of simulation data are inserted into the data table.

Optionally, storing the data table to a database includes: inserting the data table into the queue; storing the data table to a local database based on the queue; alternatively, the data tables are sent to the distributed database based on the queue, such that the distributed database stores the data tables.

The queue can be understood as a buffer area of the data table, and after the data table meets a preset condition, the data table is sent to the queue first, and the data table is inserted into the database based on the queue.

Specifically, the database may be a local database or a distributed database. When the database is a local database, storing the data table to the database may be understood as storing the data table to the local database based on the queue; when the database is a distributed database, storing the data tables to the database may be understood as sending the data tables to the distributed database based on the queue, such that the distributed database stores the data tables.

Optionally, the data table includes attribute time, and the attribute time may be understood as a time identifier of the data table, and the ordering of each data table may be determined according to the attribute time. The attribute time comprises the generation time of the data table, the sending time of the data table and the generation time of the simulation data corresponding to the preset position in the data table.

The generation time of the data table may be understood as the time when the data table stores the simulation data, the sending time of the data table may be understood as the time when the data table is sent to the database, and the preset position may be set and adjusted according to the simulation requirement, for example, the preset position is an X-th row of the data table, and the generation time of the data table is the generation time of the simulation data corresponding to the X-th row of the data table, which is not limited in the embodiment of the present invention.

Specifically, in order to ensure the integrity and time sequence of the simulation result, the data tables are stored sequentially, and the data tables are arranged in the local database or the distributed database according to the sequence of the attribute time.

Furthermore, the speed of generating the simulation data by the server is extremely high, and in order to improve the storage efficiency of the simulation data, the data tables can be stored in a multithreading mode, namely, the data tables in the queue are stored in a database in a multithreading mode, and then the data tables are rearranged in the database according to the sequence of the attribute time of each data table. Because the distributed database needs to cross the network and is greatly influenced by the network, the data storage efficiency can be improved by adopting a multithreading mode, and the phenomenon of low data storage and transmission efficiency caused by network delay is reduced.

According to the technical scheme of the embodiment, the simulation data are obtained, and the generation time of the simulation data is determined; inserting the simulation data and the generation time of the simulation data into a data table, wherein the position of the simulation data in the data table is determined according to the generation time of the simulation data; and when the data table meets the preset conditions, storing the data table into a database. After the simulation data are generated, the simulation data are written into the data table, and when the simulation data written into the data table meet preset conditions, the simulation data in the data table are stored in the database, so that the insertion times of the simulation data can be reduced, the storage time of the simulation data is reduced, and the data storage efficiency is improved. The problem of low storage efficiency caused by low data storage speed when a large amount of simulation data are stored is solved.

Example two

Fig. 2 is a schematic structural diagram of a data processing apparatus according to a second embodiment of the present invention. As shown in fig. 2, the apparatus includes: a receiving module 201, a processing module 202 and a storage module 203.

The receiving module 201 is configured to obtain simulation data and determine a generation time of the simulation data.

And the processing module 202 is used for inserting the simulation data and the generation time of the simulation data into the data table, wherein the position of the simulation data in the data table is determined according to the generation time of the simulation data.

The storage module 203 is configured to store the data table in the database when the data table meets a preset condition.

Optionally, the storage module 203 is specifically configured to determine whether the number of the simulation data inserted in the data table is equal to a first preset threshold; and if the quantity of the simulation data inserted into the data table is equal to a first preset threshold value, storing the data table into a database.

Optionally, the storage module 203 is specifically configured to determine whether the remaining space of the data table is less than or equal to a second preset threshold; and if the residual space of the data table is less than or equal to a second preset threshold value, storing the data table to the database.

Optionally, the storage module 203 is specifically configured to determine whether the last simulation data inserted into the data table is the last simulation data generated in the simulation process; and if the last simulation data inserted into the data table is the last simulation data generated in the simulation process, storing the data table into the database.

Optionally, the storage module 203 is specifically configured to insert the data table into the queue; storing the data table to a local database based on the queue; alternatively, the data tables are sent to the distributed database based on the queues, such that the distributed database stores the data tables.

The data processing device provided by the embodiment can execute the data processing method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method.

EXAMPLE III

Fig. 3 is a schematic structural diagram of an electronic device according to a third embodiment of the present invention. The electronic device 10 is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.

As shown in fig. 3, the electronic device 10 includes at least one processor 11, and a memory communicatively connected to the at least one processor 11, such as a Read Only Memory (ROM) 12, a Random Access Memory (RAM) 13, and the like, wherein the memory stores a computer program executable by the at least one processor, and the processor 11 can perform various suitable actions and processes according to the computer program stored in the Read Only Memory (ROM) 12 or the computer program loaded from a storage unit 18 into the Random Access Memory (RAM) 13. In the RAM 13, various programs and data necessary for the operation of the electronic apparatus 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other via a bus 14. An input/output (I/O) interface 15 is also connected to bus 14.

A number of components in the electronic device 10 are connected to the I/O interface 15, including: an input unit 16 such as a keyboard, a mouse, or the like; an output unit 17 such as various types of displays, speakers, and the like; a storage unit 18 such as a magnetic disk, optical disk, or the like; and a communication unit 19 such as a network card, modem, wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.

Processor 11 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, or the like. The processor 11 performs the various methods and processes described above, such as a data processing method.

In some embodiments, the data processing method may be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 10 via the ROM 12 and/or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the data processing method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the data processing method by any other suitable means (e.g. by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

Computer programs for implementing the methods of the present invention can be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be performed. A computer program can execute entirely on a machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. A computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user may provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.

The computing system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service are overcome.

It should be understood that various forms of the flows shown above, reordering, adding or deleting steps, may be used. For example, the steps described in the present invention may be executed in parallel, sequentially, or in different orders, and are not limited herein as long as the desired result of the technical solution of the present invention can be achieved.

The above-described embodiments should not be construed as limiting the scope of the invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A method of data processing, comprising:

and when the data table meets a preset condition, storing the data table to a database.

2. The method according to claim 1, wherein storing the data table to a database when the data table meets a preset condition comprises:

determining whether the quantity of the simulation data inserted into the data table is equal to a first preset threshold value;

and if the quantity of the simulation data inserted into the data table is equal to a first preset threshold value, storing the data table into a database.

3. The method according to claim 1, wherein storing the data table to a database when the data table meets a preset condition comprises:

determining whether the remaining space of the data table is less than or equal to a second preset threshold;

and if the residual space of the data table is less than or equal to a second preset threshold value, storing the data table to a database.

4. The method according to claim 1, wherein storing the data table to a database when the data table meets a preset condition comprises:

determining whether the last simulation data inserted into the data table is the last simulation data generated in the simulation process;

and if the last simulation data inserted into the data table is the last simulation data generated in the simulation process, storing the data table into a database.

5. The method of any of claims 1-4, wherein storing the data table to a database comprises:

inserting the data table into a queue;

storing the data table to a local database based on the queue; or sending the data table to a distributed database based on the queue, so that the distributed database stores the data table.

6. The method of claim 5, wherein the data tables include attribute times, and wherein a plurality of the data tables are arranged in the local database or the distributed database according to the sequence of the attribute times.

7. The method of claim 6, wherein the attribute time is at least one of: the method comprises the steps of generating time of a data table, sending time of the data table and generating time of simulation data corresponding to a preset position in the data table.

8. A data processing apparatus, comprising:

the processing module is used for inserting the simulation data and the generation time of the simulation data into a data table, and the position of the simulation data in the data table is determined according to the generation time of the simulation data;

and the storage module is used for storing the data table to a database when the data table meets a preset condition.

9. An electronic device, characterized in that the electronic device comprises:

wherein the memory stores a computer program executable by the at least one processor, the computer program being executable by the at least one processor to enable the at least one processor to perform the data processing method of any one of claims 1-7.

10. A computer-readable storage medium, characterized in that it stores computer instructions for causing a processor to implement the data processing method of any of claims 1-7 when executed.