CN116150249B

CN116150249B - Table data export method, apparatus, electronic device and computer readable medium

Info

Publication number: CN116150249B
Application number: CN202310390809.9A
Authority: CN
Inventors: 姜在国
Original assignee: Xinxing Jihua Group Finance Co ltd
Current assignee: Xinxing Jihua Group Finance Co ltd
Priority date: 2023-04-13
Filing date: 2023-04-13
Publication date: 2023-06-16
Anticipated expiration: 2043-04-13
Also published as: CN116150249A

Abstract

Embodiments of the present disclosure disclose a table data export method, apparatus, electronic device, and computer readable medium. One embodiment of the method comprises the following steps: determining table data export information; generating initial information of a data export log in response to determining that the export quantity of the table data meets a preset quantity condition; the method comprises the steps of sending preset export information and data export log initial information to a client; querying each target table data set; performing verification processing on the target table data set to obtain data verification information; transmitting each target table data group to a preset server in response to determining that each data verification information meets a preset verification condition; updating the initial information of the data export log to obtain updated information of the data export log; and sending the preset download prompt information and the data export log update information to the client. The embodiment can shorten the waiting time of the user, improve the experience of the user and reduce the waste of computer resources.

Description

Table data export method, apparatus, electronic device and computer readable medium

Technical Field

Embodiments of the present disclosure relate to the field of computer technology, and in particular, to a method, an apparatus, an electronic device, and a computer readable medium for table data export.

Background

With the rapid development of the internet age, more and more data is stored in a database in the form of electronic forms for users to query and download. Currently, when exporting spreadsheet data in a database, the following methods are generally used: and waiting for the server to return the spreadsheet data to export data by a synchronous interface mode, or returning the information exported by the client to the server by an asynchronous interface mode, and executing an export task by the server.

However, the inventors have found that when the above manner is used to derive the spreadsheet data in the database, there are often the following technical problems:

firstly, the server side waits for returning the electronic form data to derive data in a synchronous interface mode, when the data volume of the electronic form data to be derived is large (for example, millions of data volumes), the loaded file is too large, the response time of the client side waiting for the server side is long, the user experience is poor, and when the data volume of the electronic form data to be derived is small in an asynchronous interface mode, the computer resource waste is caused.

Second, when the electronic form data to be exported is encrypted, the same encryption mode is adopted for different users, no hierarchy division is made for the security of the electronic form data, when the higher-level encryption mode is adopted to encrypt the exported electronic form data required by a common user (for example, a common staff member), the decryption process consumes relatively long time, and when the lower-level encryption mode is adopted to encrypt the exported electronic form data required by a higher-level user (for example, a manager), the security of the electronic form data is lower.

Thirdly, when determining the number of the exported electronic form data, directly exporting all the data meeting export conditions together, and not considering whether the processing capacity of the client can support the number of the electronic form data needing to be exported, thereby causing memory overflow and failing the task of exporting the electronic form data.

The above information disclosed in this background section is only for enhancement of understanding of the background of the inventive concept and, therefore, may contain information that does not form the prior art that is already known to those of ordinary skill in the art in this country.

Disclosure of Invention

The disclosure is in part intended to introduce concepts in a simplified form that are further described below in the detailed description. The disclosure is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.

Some embodiments of the present disclosure propose a form data derivation method, apparatus, electronic device, and computer-readable medium to solve one or more of the technical problems mentioned in the background section above.

In a first aspect, some embodiments of the present disclosure provide a table data export method, the method comprising: in response to receiving the table data export request information sent by the client, determining table data export information corresponding to the table data export request information, wherein the table data export information comprises a table data export quantity; generating data export log initial information according to the table data export request information in response to determining that the number of the table data exports meets a preset number condition; the preset export information and the initial information of the data export log are sent to a client for display; inquiring each target table data group corresponding to the table data export request information according to the table data export request information; for each target table data group included in each target table data group, performing verification processing on the target table data group to obtain data verification information; responding to the fact that all obtained data verification information meets preset verification conditions, and sending all target table data sets to a preset server to obtain data path information; updating the initial information of the data export log according to the data path information and the preset query success information to obtain updated information of the data export log; and sending preset download prompt information and the data export log update information to the client so as to prompt a user to export each target form data set.

In a second aspect, some embodiments of the present disclosure provide a tabular data deriving apparatus, the apparatus comprising: a determining unit configured to determine, in response to receiving table data export request information sent by a client, table data export information corresponding to the table data export request information, wherein the table data export information includes a table data export number; a generation unit configured to generate data export log initial information from the table data export request information in response to determining that the number of table data exports satisfies a preset number condition; the first sending unit is configured to send preset export information and the initial information of the data export log to the client for display; a query unit configured to query each target table data group corresponding to the table data export request information, based on the table data export request information; a verification unit configured to perform verification processing on each target table data set included in each target table data set to obtain data verification information; the second sending unit is configured to send each target table data group to a preset server to obtain data path information in response to the fact that each obtained data verification information meets preset verification conditions; the updating unit is configured to update the initial information of the data export log according to the data path information and the preset query success information to obtain update information of the data export log; and a third sending unit configured to send preset download prompt information and the data export log update information to the client so as to prompt the user to export each target table data set.

In a third aspect, some embodiments of the present disclosure provide an electronic device comprising: one or more processors; a storage device having one or more programs stored thereon, which when executed by one or more processors causes the one or more processors to implement the method described in any of the implementations of the first aspect above.

In a fourth aspect, some embodiments of the present disclosure provide a computer readable medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method described in any of the implementations of the first aspect above.

The above embodiments of the present disclosure have the following advantageous effects: according to the table data export method, the waiting time of the user can be shortened, the experience of the user is improved, and the waste of computer resources is reduced. Specifically, the reason why the user experience is poor or the computer resources are wasted is that: the method comprises the steps that a server side waits for returning electronic form data in a synchronous interface mode to derive data, when the data volume of the electronic form data to be derived is large (for example, millions of data volumes), a loaded file is too large, the response time of the client side waiting for the server side is long, the user experience is poor, and when the data volume of the electronic form data to be derived is small, computer resource waste is caused in an asynchronous interface mode. Based on this, the table data export method of some embodiments of the present disclosure first determines the table data export information corresponding to the above-described table data export request information in response to receiving the table data export request information transmitted by the client. Wherein the table data export information includes a table data export quantity. Thus, the number of table data to be exported can be obtained and thus can be used to determine the manner in which the table data is exported. And secondly, generating data export log initial information according to the table data export request information in response to determining that the export quantity of the table data meets a preset quantity condition. Thus, when the amount of table data to be exported is large, the initial information of the data export log is obtained, and the table data can be exported in an asynchronous export mode. And then, the preset export information and the initial information of the data export log are sent to the client for display. Therefore, the relevant information of the export form data of the server side can be displayed on the client side, so that a user can obtain the relevant information of the export data in time, and the user experience is improved. And then, according to the table data export request information, inquiring each target table data group corresponding to the table data export request information. Thus, each target table data set can be obtained, and thus can be used to generate data path information. And then, for each target table data group included in each target table data group, performing verification processing on the target table data group to obtain data verification information. Thus, it is possible to know whether or not each target table data group meets the criterion of the export table data, and thus it is possible to determine whether or not each target table data group is stored. And then, in response to the fact that all obtained data verification information meets the preset verification conditions, storing all target table data sets to a preset server to obtain data path information. Thus, when each target table data group meets the standard of the export table data, the data path information storing the export data file can be obtained, thereby being convenient for the user to export the required table data. And then, according to the data path information and the preset query success information, updating the initial information of the data export log to obtain updated information of the data export log. Thus, data export log update information is available for transmission to the client. And finally, sending preset download prompt information and the data export log update information to the client so as to prompt a user to export each target form data set. Thus, the user can be prompted to export each target table data set required, and the table data export task can be completed. Also, when the form data required by the user is exported, the form data export quantity of the form data to be queried is determined first, and then the form data can be exported in an asynchronous interface export mode when the data quantity is large, so that the user experience is improved, and the waste of computer resources is reduced.

Drawings

The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. The same or similar reference numbers will be used throughout the drawings to refer to the same or like elements. It should be understood that the figures are schematic and that elements and components are not necessarily drawn to scale.

FIG. 1 is a flow chart of some embodiments of a tabular data derivation method according to the present disclosure;

FIG. 2 is a schematic diagram of the structure of some embodiments of a tabular data derivation device according to the present disclosure;

fig. 3 is a schematic structural diagram of an electronic device suitable for use in implementing some embodiments of the present disclosure.

Detailed Description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.

It should be noted that, for convenience of description, only the portions related to the present invention are shown in the drawings. Embodiments of the present disclosure and features of embodiments may be combined with each other without conflict.

It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.

It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.

The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

Fig. 1 illustrates a flow 100 of some embodiments of a table data export method according to the present disclosure. The table data export method comprises the following steps:

step 101, in response to receiving the table data export request information sent by the client, determining table data export information corresponding to the table data export request information.

In some embodiments, an execution body (e.g., a server) of the table data export method may determine the table data export information corresponding to the above-described table data export request information in response to receiving the table data export request information transmitted by the client. The table data export request information may be an instruction for exporting table data. The tabular data export request information described above may include, but is not limited to, a query data source identification. The query data source identification may be a unique identification of the data source storing the tabular data that the user needs to export. The above-mentioned table data export information may be information of table data that needs to be exported. The table data export information may include, but is not limited to, a table data export quantity. The above-described table data export number may be the number of table data that need to be exported. In practice, the execution body may determine the table data export information corresponding to the table data export request information in various ways in response to receiving the table data export request information sent by the client.

In some optional implementations of some embodiments, the executing entity may determine the table data export information corresponding to the table data export request information by:

The first step, the configuration information of the client is obtained. The configuration information may be configuration information of the client. The terminal may be, but is not limited to, one of the following: a mobile phone and a computer. The configuration information may include, but is not limited to, CPU (Central Processing Unit ) usage, memory occupancy, disk usage, network usage, CPU operation speed, and total memory capacity. The total memory capacity may be a total memory capacity of the client.

And secondly, inputting the configuration information into a preset export quantity information generation model to obtain export quantity information. The preset derived quantity information generating model takes configuration information as input and derived quantity information corresponding to the configuration information as output. For example, the generative model may be a classification model. The derived number information may be a maximum value of the number of table data that the client can derive. The predetermined derived quantity information generation model may include an input layer, a first generation model, a second generation model, a third generation model, and an output layer. The input layer may be used to perform feature extraction on configuration information. The first, second, third generation models may be different types of generation models for generating the derived number. The output layer may be configured to select, as the derived quantity information, a derived quantity satisfying a preset condition from the respective derived quantities generated by the first, second, and third generation models. The preset condition may be that the export quantity is a minimum value among the respective export quantities. The input layer is connected to the first generation model, the second generation model, and the third generation model, respectively. The first generation model, the second generation model, and the third generation model are connected to the output layer.

Alternatively, the preset derived quantity information generating model may be obtained through training by the following steps:

first, a sample set is obtained. Wherein, the samples in the sample set may include sample configuration information and sample derived quantity information corresponding to the sample configuration information.

Second, the following training steps are performed based on the sample set:

and a first training step of inputting at least one sample in the sample set to an input layer of an initial derived quantity information generation model respectively to obtain a feature vector corresponding to each sample in the at least one sample.

And a second training step of respectively inputting the feature vector corresponding to each sample in the at least one sample into a first generation model, a second generation model and a third generation model of the initial derived quantity information generation model to obtain a first derived quantity, a second derived quantity and a third derived quantity corresponding to each sample in the at least one sample.

And a third training step of inputting the first export quantity, the second export quantity and the third export quantity corresponding to each sample in the at least one sample to an output layer of the initial export quantity information generation model to obtain export quantity information corresponding to each sample in the at least one sample.

And a fourth training step of comparing the derived number information corresponding to each of the at least one sample with the sample derived number information corresponding to the sample. Here, the comparison may be performed by determining whether or not the difference between the derived quantity information and the sample derived quantity information is within the target range. The setting of the target range is not limited.

And a fifth training step, determining whether the initial derived quantity information generation model reaches a preset optimization target according to the comparison result. The optimization objective may be that the difference between the derived quantity information and the sample derived quantity information is within a target range.

And a sixth training step, in response to determining that the initial derived quantity information generating model reaches the optimization target, using the initial derived quantity information generating model as a preset derived quantity information generating model after training.

Optionally, the step of training to obtain the preset derived quantity information generating model may further include:

and a seventh training step of, in response to determining that the initial lead-out quantity information generation model does not reach the above-described optimization target, adjusting network parameters of the initial lead-out quantity information generation model, and forming a sample set using unused samples, using the adjusted initial lead-out quantity information generation model as the initial lead-out quantity information generation model, and executing the above-described training step again. As an example, the network parameters of the initial derived quantity information generation model described above may be adjusted using a back propagation algorithm (Back Propagation Algorithm, BP algorithm) and a gradient descent method (e.g., a random small batch gradient descent algorithm).

And thirdly, determining the target export quantity corresponding to the table data export request information. The target export quantity may be the total quantity of table data that is stored in the query data source and needs to be exported by the user.

And step four, determining whether the derived quantity information meets preset derived conditions. The preset export condition may be that the export quantity information is greater than or equal to the target export quantity.

And fifthly, determining the target export quantity as the table data export information in response to determining that the export quantity information meets the preset export condition.

And sixthly, in response to determining that the derived quantity information does not meet the preset derived condition, sending preset batch derived prompt information to the client to prompt a user to derive data in batches. The preset batch export prompting information may be information for prompting the user that the number of export table data exceeds the operation capability of the client, and the number of export table data needs to be reduced. For example, the preset batch export cue information may be "the data volume is too large, the system may be jammed, and the amount of export table data is suggested to be reduced.

The technical scheme and the related content are taken as an invention point of the embodiment of the disclosure, so that the technical problem three mentioned in the background art, namely memory overflow and task failure of exporting the electronic form data, is solved. Factors that cause memory overflow and failure of the task of exporting spreadsheet data are often as follows: when the number of the exported electronic form data is determined, all the data meeting the export conditions are exported together directly, and whether the processing capacity of the client can support the number of the electronic form data needing to be exported or not is not considered, so that memory overflows, and the task of exporting the electronic form data fails. If the above factors are solved, the effect of reducing memory overflow and the number of task failures to export spreadsheet data can be achieved. To achieve this effect, the table data export method of some embodiments of the present disclosure first obtains the configuration information of the client described above. Therefore, the operation processing capacity of the terminal where the client is located can be obtained, and the operation processing capacity can be used for judging whether the task of exporting the table data can be processed. And secondly, inputting the configuration information into a preset derived quantity information generation model to obtain derived quantity information. The preset derived quantity information generating model takes configuration information as input and derived quantity information corresponding to the configuration information as output. The preset derived quantity information generating model comprises an input layer, a first generating model, a second generating model, a third generating model and an output layer. Therefore, the corresponding relation between the configuration information and the export quantity information can be established, and the export quantity information is comprehensively determined through different models, so that the method can be used for predicting whether the client can process the quantity of the export form data at this time in advance. Then, a target export amount corresponding to the above-described table data export request information is determined. Therefore, the number of the table data which is actually required to be exported by the task can be obtained, and the method can be used for predicting whether the client can process the number of the exported table data in advance. And then determining whether the derived quantity information meets a preset derived condition. Thus, it can be determined whether the number of table data actually required to be exported by the user is smaller than the maximum value of the number of exported table data that can be processed by the client, and thus can be used for determining the number of exported table data. Then, in response to determining that the derived quantity information satisfies the preset derived condition, the target derived quantity is determined as table data derived information. Therefore, when the number of the table data which is actually required to be exported by the user is smaller than the maximum value of the number of the exported table data which can be processed by the client, the task of exporting the table data at this time can be directly processed, so that the memory overflow and the failure times of the task of exporting the table data can be reduced. And finally, in response to determining that the derived quantity information does not meet the preset derived condition, sending preset batch derived prompt information to the client to prompt a user to derive data in batches. Therefore, when the number of the table data which is actually required to be exported by the user is larger than the maximum value of the number of the exported table data which can be processed by the client, the user is prompted that the risk of memory overflow exists in the task of exporting the table data, and the user is recommended to adjust the number of the exported table data, so that the memory overflow and the failure times of the task of exporting the table data can be reduced. Also, before the table data is exported, the corresponding relation between the processing capacity of the client and the number of the exported table data is established in advance, so that the possibility of memory overflow can be judged in advance, and when the possibility of memory overflow exists, the user is recommended to adjust the number of the exported table data, so that the number of memory overflow and the failure times of the tasks of exporting the table data are reduced.

Step 102, generating initial information of the data export log according to the export request information of the table data in response to determining that the export quantity of the table data meets the preset quantity condition.

In some embodiments, the execution body may generate the data export log initial information according to the table data export request information in response to determining that the table data export quantity satisfies a preset quantity condition. The preset number condition may be that the derived number of the table data is greater than or equal to a preset threshold. The preset threshold may be a preset maximum value of the number of table data derived by means of synchronous derivation. The data export log initial information may be log information initialized for export table data records. In practice, the execution body may generate the data export log initial information according to the table data export request information in various manners in response to determining that the number of table data exports satisfies the preset number condition.

Alternatively, the table data export request information described above may include an export data identification. The derived data identifier may be an identifier of a file of each table data to be derived.

In some optional implementations of some embodiments, the executing entity may generate the data export log initial information according to the table data export request information by:

and a first step of determining the export data identifier included in the table data export request information as a data file identifier.

And secondly, determining the preset duration as the effective duration of the data file. The preset duration may be a preset duration. For example, the preset time period may be 24 hours.

Third, the current time is determined as the derived start time.

And step four, determining the data file identification, the effective duration of the data file and the export start time as initial information of a data export log.

And step 103, the preset export information and the data export log initial information are sent to the client for display.

In some embodiments, the executing entity may send the preset export information and the data export log initial information to the client for display. The preset export information may be preset information indicating that table data is being exported. For example, the preset export information may be "export table data".

Step 104, according to the table data export request information, each target table data group corresponding to the table data export request information is queried.

In some embodiments, the executing body may export the request information according to the table data, and query each target table data set corresponding to the table data export request information. The target table data sets included in the target table data sets may be target table data obtained by querying the corresponding sub-threads. The target table data included in each target table data may be table data required by a user. In practice, the executing body may export the request information according to the table data in various manners, and inquire each target table data set corresponding to the table data export request information.

Optionally, the table data export request information includes a query data time sequence and a query data information set. The query data time included in the query data time sequence may be a time corresponding to the table data that needs to be derived by the user. For example, if the data that the user needs to derive is employee attendance information of 2022 month 3, the above-mentioned query data time sequence may be a sequence in which the dates of 2022 month 31 to 2022 month 3 31 are sequentially arranged in order from front to back. The query data information included in the query data information set may be a condition that the user needs to screen the derived form data. For example, the query data information is "xx department". The above "xx" may be any character. The query data time included in the query data time sequence corresponds to the query data information included in the query data information set. The correspondence between the query data time included in the query data time sequence and the query data information included in the query data information set may be one-to-one correspondence.

In some optional implementations of some embodiments, the executing entity may query each target table data group corresponding to the table data export request information according to the table data export request information by:

first, the number of each query data time included in the query data time sequence is determined as a target number.

And secondly, determining the number of each sub-thread included in the sub-thread set as the number of the sub-threads.

And thirdly, determining the ratio of the target number to the number of the sub-threads as a first ratio.

And step four, determining a target ratio according to the first ratio. The target ratio may be the number of query data times included in the query data time sequence corresponding to the sub-thread included in the sub-thread set. In practice, first, the execution body may determine whether the first ratio satisfies a preset numerical condition. The preset numerical condition may be that the first ratio is an integer. Then, in response to determining that the first ratio satisfies the preset numerical condition, the first ratio is determined as a target ratio. And in response to determining that the first ratio does not meet the preset numerical condition, rounding the first ratio to obtain a second ratio. Finally, the sum of the second ratio and 1 is determined as a target ratio.

And fifthly, determining any sub-thread included in the sub-thread set as the rest sub-threads.

And sixthly, determining each sub-thread which is included in the sub-thread set and meets the preset thread condition as a target sub-thread set. The preset thread condition may be that the sub-thread is not a remaining sub-thread.

Seventh, for each target sub-thread included in the target sub-thread set, executing the following sub-steps:

and a first sub-step of sequentially selecting the target ratio of the query data time from the query data time sequence as a sub-thread query time set.

And a second sub-step of querying a target table data group corresponding to the sub-thread querying time according to the target sub-thread and the querying data information corresponding to the sub-thread querying time for each sub-thread querying time included in the sub-thread querying time set. In practice, the execution subject may query each target table data satisfying the query data information through the target sub-thread as a target table data group.

And eighth, determining each non-sub-thread query time in the query data time sequence as a remaining sub-thread query time set corresponding to the remaining sub-threads.

And a ninth step of inquiring a target table data group corresponding to the remaining sub-thread inquiry time according to the remaining sub-threads and inquiry data information corresponding to the remaining sub-thread inquiry time for each remaining sub-thread inquiry time included in the remaining sub-thread inquiry time set. In practice, the execution subject may query each target table data satisfying the query data information through the remaining sub-threads as a target table data group.

Step 105, for each target table data set included in each target table data set, performing verification processing on the target table data set to obtain data verification information.

In some embodiments, the execution body may perform a verification process on each target table data set included in each target table data set to obtain data verification information. The data verification information may represent whether each target table data included in the target table data set meets the user requirement. In practice, the execution body may perform verification processing on each target table data set included in each target table data set through various manners, so as to obtain data verification information.

In some optional implementations of some embodiments, for each target table data included in the target table data set, the executing body may perform a verification process on the target table data set to obtain data verification information by:

first, for each target table data included in the target table data group, the following verification steps are performed:

and a first checking step, determining whether the target table data meets a preset uploading condition. The predetermined uploading condition may be that the format of the target table data is a predetermined format. The preset format may be a preset format. For example, the predetermined format may be. Xsl.

And a second checking step of determining preset check success information as check result information in response to determining that the target table data satisfies the preset uploading condition. The preset verification success information may be preset information indicating that the target table data meets a preset uploading condition. For example, the preset verification success information may be "data verification pass".

And secondly, determining the preset uploading information as data verification information in response to determining that each piece of determined verification result information meets the preset verification condition. The preset verification condition may be that verification result information is preset verification success information. The preset uploading information may be preset information for uploading the data of each target table. For example, the preset upload information may be "can upload each target table data".

And thirdly, determining the preset failure information as data verification information in response to determining that any verification result information in the verification result information does not meet the preset verification condition. The preset failure information may be information indicating that the verification of the target table data set fails. For example, the preset failure information may be "check failed".

And step 106, transmitting each target table data group to a preset server to obtain data path information in response to the fact that each obtained data verification information meets the preset verification condition.

In some embodiments, the executing body may send the target table data sets to a preset server to obtain the data path information in response to determining that the obtained data verification information meets the preset verification condition. The preset verification condition can characterize the verification passing of the target table data set for the data verification information. The preset server may be a preset server for storing each target table data set. The data path information may characterize the path in which each target table data set is stored. In practice, the executing body may send the target table data sets to a preset server in various manners in response to determining that each obtained data verification information meets a preset verification condition, so as to obtain data path information.

In some optional implementations of some embodiments, the executing body may send the target table data sets to a preset server to obtain the data path information through the following steps:

first, a table is created as a target table.

And a second step of determining the derived data identifier as the data table identifier of the target table.

And thirdly, sequentially adding the target table data sets to the target table according to the time sequence to obtain the target data table. In practice, the execution body may sequentially add the target table data sets to the target table according to the time sequence of the corresponding each sub-thread query time and the corresponding each remaining sub-thread query time, so as to obtain a target data table.

And step four, the target data table and the data table identification are sent to a preset server to receive the storage path information.

And fifthly, determining the received storage path information as data path information.

Optionally, before the adding of the respective target table data sets to the target table sequentially in time sequence, the execution body may further execute the following steps:

First, user login information is obtained. The user login information may be information for a user to log in to the client. The user login information may include, but is not limited to, a user identification. The user identification may be a unique identification for the user. In practice, the executing body may acquire the user login information from the terminal on which the user logs in by means of a wired connection or a wireless connection. It should be noted that the wireless connection may include, but is not limited to, 3G/4G connections, wiFi connections, bluetooth connections, wiMAX connections, zigbee connections, UWB (ultra wideband) connections, and other now known or later developed wireless connection means.

And step two, determining user authority information according to the user login information. The user rights information may include, but is not limited to, rights types. Wherein, the authority type can be one of the following, but not limited to: primary authority and secondary authority. The primary authority can represent that the job level of the user is a common job. The secondary rights may characterize the user's role as middle or high level management. In practice, the executing body determines the authority type corresponding to the user login information as user authority information.

And thirdly, determining the encryption type information of the user according to the user authority information. Wherein the execution body may determine an encryption type corresponding to the user authority information as user encryption type information. The encryption type may be, but is not limited to, at least one of the following: advanced encryption, intermediate encryption. The encryption algorithm corresponding to the intermediate encryption may be, but is not limited to, at least one of the following: MD5 encryption algorithm, DES encryption algorithm. The encryption algorithm corresponding to the advanced encryption may be, but is not limited to, at least one of the following: 3DES encryption algorithm, AES encryption algorithm.

Fourth, for each target table data included in the respective target table data group, the following sub-steps are performed:

and a first sub-step, classifying each field included in the target table data to obtain a classified information set. In practice, the execution body may sequentially input each field included in the target table data into a pre-trained classification information generation model, to obtain a classification information set. The classification information generation model may be a classification model that takes a field as an input and takes classification information as an output. The classification model may be a convolutional neural network. The classification information may characterize whether the field needs encryption. The classification information may be, but is not limited to, one of the following: encryption type, non-encryption type. The encryption type described above may characterize that a field needs encryption. The above non-encryption type may characterize the field without encryption.

And a second sub-step of, for each piece of classification information included in the classification information set, performing encryption processing on a field corresponding to the classification information included in the target table data according to the user encryption type information in response to determining that the classification information satisfies a preset encryption condition, thereby obtaining encrypted target table data as target table data. The preset encryption condition may be that the classification information characterization field needs to be encrypted. In practice, for each piece of classification information included in the set of classification information, the executing body may perform encryption processing on a field corresponding to the classification information included in the target table data by an encryption algorithm corresponding to the user encryption type information in response to determining that the piece of classification information satisfies a preset encryption condition, to obtain encrypted target table data as target table data.

The above technical solution and the related content serve as an invention point of the embodiments of the present disclosure, and solve the second technical problem mentioned in the background art, that "the decryption process consumes relatively long time or the security of the electronic form data is low". Factors that result in relatively long time spent decrypting or low security of the spreadsheet data tend to be as follows: when the electronic form data to be exported is encrypted, the same encryption mode is adopted for different users, the security of the electronic form data is not hierarchically divided, when the electronic form data to be exported required by a common user (such as a common staff member) is encrypted by adopting a higher-level encryption mode, the time consumed by the decryption process is relatively long, and when the electronic form data to be exported required by a higher-level user (such as a manager) is encrypted by adopting a lower-level encryption mode, the security of the electronic form data is low. If the above factors are solved, the effects of shortening the time taken for decryption and improving the security of the electronic form data can be achieved. To achieve this effect, the form data derivation method of some embodiments of the present disclosure first acquires user login information. Thus, the login information of the user can be obtained, and thus the login information can be used for determining the authority of the user. And secondly, determining user authority information according to the user login information. Thus, the authority information of the user can be obtained, so that the encryption level adopted for the everywhere table data of the corresponding user can be determined through the identity of the user. Then, the user encryption type information is determined according to the user authority information. Thus, the encryption level of the corresponding user can be obtained, and thus can be used for encrypting the form data that needs everywhere. Finally, for each target table data included in the respective target table data sets, the following steps are performed: classifying each field included in the target table data to obtain a classified information set; and for each piece of classification information included in the classification information set, in response to determining that the classification information meets a preset encryption condition, performing encryption processing on a field corresponding to the classification information included in the target table data according to the user encryption type information to obtain encrypted target table data as target table data. Therefore, the table data to be exported can be encrypted by adopting an encryption method corresponding to the user identity, so that corresponding encryption modes can be adopted for different users. And when the electronic form data is encrypted, an encryption mode corresponding to the user authority is adopted for different users, so that the time consumed by decryption is shortened, and the security of the electronic form data is improved.

And step 107, updating the initial information of the data export log according to the data path information and the preset query success information to obtain updated information of the data export log.

In some embodiments, the execution body may update the initial information of the data export log according to the data path information and the preset query success information to obtain updated information of the data export log. The preset query success information may be preset table data representing that the user needs to export, which is already queried successfully and stored in a preset server. For example, the preset query success information may be "data has been successfully exported". In practice, the execution body may add the data path information and the preset query success information to the initial information of the data export log, so as to obtain update information of the data export log.

And step 108, transmitting preset download prompt information and data export log update information to the client so as to prompt the user to export each target table data set.

In some embodiments, the executing entity may send a preset download prompt message and the data export log update message to the client to prompt the user to export the respective target table data set. The preset download prompt information may be preset information for prompting the user to download each target table data set. For example, the preset download prompt message may be "please download data".

Optionally, the above execution body may further execute the following steps:

and a first step of inquiring and obtaining each target table data set according to the table data export request information in response to determining that the export quantity of the table data does not meet the preset quantity condition. In practice, the executing body may query each target table data set from a query data source included in the table data export request information through the main thread in response to determining that the table data export quantity does not satisfy the preset quantity condition.

And a second step of adding the target table data sets to a preset table file to obtain an updated table file. The preset table file may be a preset table file.

And thirdly, the updated table file is sent to the client side for export by a user.

Optionally, the above execution body may further execute the following steps:

in the first step, in response to determining that any data verification information in the obtained data verification information does not meet the preset verification condition, updating the initial information of the data export log according to the preset query failure information to obtain data export failure log information. The preset query failure information may be preset information indicating a data query failure of the table. For example, the preset query failure information may be "data query failure". In practice, the executing body may add the preset query failure information to the initial information of the data export log to obtain data export failure log information.

And a second step of sending the data export failure log information to the client for display.

With further reference to fig. 2, as an implementation of the method shown in the above figures, the present disclosure provides some embodiments of a table data deriving apparatus, which correspond to those method embodiments shown in fig. 1, and which are particularly applicable in various electronic devices.

As shown in fig. 2, the table data deriving device 200 of some embodiments includes: a determining unit 201, a generating unit 202, a first transmitting unit 203, a querying unit 204, a checking unit 205, a second transmitting unit 206, an updating unit 207, and a third transmitting unit 208. Wherein the determining unit 201 is configured to determine, in response to receiving the table data export request information sent by the client, table data export information corresponding to the table data export request information, wherein the table data export information includes a table data export number; the generating unit 202 is configured to generate data export log initial information according to the table data export request information in response to determining that the number of table data exports satisfies a preset number condition; the first sending unit 203 is configured to send preset export information and the initial information of the data export log to the client for display; the query unit 204 is configured to query each target table data group corresponding to the table data export request information according to the table data export request information; the verification unit 205 is configured to perform verification processing on each target table data set included in each target table data set to obtain data verification information; the second sending unit 206 is configured to send the target table data sets to a preset server to obtain data path information in response to determining that the obtained data verification information meets a preset verification condition; the updating unit 207 is configured to update the initial information of the data export log according to the data path information and the preset query success information, so as to obtain update information of the data export log; the third sending unit 208 is configured to send preset download prompt information and the data export log update information to the client, so as to prompt the user to export each target table data set.

It will be appreciated that the elements described in the table data deriving means 200 correspond to the respective steps of the method described with reference to fig. 1. Thus, the operations, features and resulting benefits described above for the method are equally applicable to the apparatus 200 and the units contained therein, and are not described in detail herein.

Referring now to fig. 3, a schematic diagram of an electronic device 300 suitable for use in implementing some embodiments of the present disclosure is shown. The electronic device shown in fig. 3 is merely an example and should not impose any limitations on the functionality and scope of use of embodiments of the present disclosure.

As shown in fig. 3, the electronic device 300 may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 301 that may perform various suitable actions and processes in accordance with a program stored in a Read Only Memory (ROM) 302 or a program loaded from a storage means 308 into a Random Access Memory (RAM) 303. In the RAM 303, various programs and table data necessary for the operation of the electronic apparatus 300 are also stored. The processing device 301, the ROM 302, and the RAM 303 are connected to each other via a bus 304. An input/output (I/O) interface 305 is also connected to bus 304.

In general, the following devices may be connected to the I/O interface 305: input devices 306 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 307 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 608 including, for example, magnetic tape, hard disk, etc.; and communication means 309. The communication means 309 may allow the electronic device 300 to communicate with other devices wirelessly or by wire to exchange form data. While fig. 3 shows an electronic device 300 having various means, it is to be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead. Each block shown in fig. 3 may represent one device or a plurality of devices as needed.

In particular, according to some embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, some embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such embodiments, the computer program may be downloaded and installed from a network via communications device 309, or from storage device 308, or from ROM 302. The above-described functions defined in the methods of some embodiments of the present disclosure are performed when the computer program is executed by the processing means 301.

It should be noted that, the computer readable medium described in some embodiments of the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In some embodiments of the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In some embodiments of the present disclosure, however, the computer readable signal medium may comprise a tabular data signal propagated in baseband or as part of a carrier wave, with the computer readable program code embodied therein. Such a propagated tabular data signal may take a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.

In some implementations, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (Hyper Text Transfer Protocol ), and may be interconnected with any form or medium of digital form data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.

The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device. The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: in response to receiving the table data export request information sent by the client, determining table data export information corresponding to the table data export request information, wherein the table data export information comprises a table data export quantity; generating data export log initial information according to the table data export request information in response to determining that the number of the table data exports meets a preset number condition; the preset export information and the initial information of the data export log are sent to a client for display; inquiring each target table data group corresponding to the table data export request information according to the table data export request information; for each target table data group included in each target table data group, performing verification processing on the target table data group to obtain data verification information; responding to the fact that all obtained data verification information meets preset verification conditions, and sending all target table data sets to a preset server to obtain data path information; updating the initial information of the data export log according to the data path information and the preset query success information to obtain updated information of the data export log; and sending preset download prompt information and the data export log update information to the client so as to prompt a user to export each target form data set.

Computer program code for carrying out operations for some embodiments of the present disclosure may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units described in some embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. The described units may also be provided in a processor, for example, described as: a processor includes a determination unit, a generation unit, a first transmission unit, a query unit, a verification unit, a second transmission unit, an update unit, and a third transmission unit. Wherein the names of the units do not constitute a limitation of the unit itself in some cases, for example, the determining unit may also be described as "in response to receiving the form data export request information transmitted by the client, determining form data export information corresponding to the form data export request information, wherein the form data export information includes units of the form data export number".

The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.

The foregoing description is only of the preferred embodiments of the present disclosure and description of the principles of the technology being employed. It will be appreciated by those skilled in the art that the scope of the invention in the embodiments of the present disclosure is not limited to the specific combination of the above technical features, but encompasses other technical features formed by any combination of the above technical features or their equivalents without departing from the spirit of the invention. Such as the above-described features, are mutually substituted with (but not limited to) the features having similar functions disclosed in the embodiments of the present disclosure.

Claims

1. A method of table data export, comprising:

in response to receiving form data export request information sent by a client, determining form data export information corresponding to the form data export request information, wherein the form data export information comprises a form data export quantity;

generating data export log initial information according to the table data export request information in response to determining that the table data export quantity meets a preset quantity condition;

the preset export information and the initial information of the data export log are sent to a client for display;

Inquiring each target table data group corresponding to the table data export request information according to the table data export request information;

for each target table data group included in each target table data group, checking the target table data group to obtain data checking information;

responding to the fact that all obtained data verification information meets preset verification conditions, and sending all target table data sets to a preset server to obtain data path information;

updating the initial information of the data export log according to the data path information and the preset query success information to obtain updated information of the data export log;

and sending preset downloading prompt information and the data export log update information to the client so as to prompt a user to export each target form data set.

2. The method of claim 1, wherein the tabular data derivation request information comprises a derivation data identification; and

the generating data export log initial information according to the form data export request information includes:

determining a derived data identifier included in the table data derived request information as a data file identifier;

Determining the preset time length as the effective time length of the data file;

determining the current time as a derived start time;

and determining the data file identification, the effective duration of the data file and the export start time as data export log initial information.

3. The method of claim 2, wherein the tabular data derivation request information includes a query data time sequence and a query data information set, the query data time sequence including query data time corresponding to query data information included in the query data information set; and

the step of inquiring each target table data group corresponding to the table data export request information according to the table data export request information comprises the following steps:

determining the number of each query data time included in the query data time sequence as a target number;

determining the number of each sub-thread included in the sub-thread set as the number of the sub-threads;

determining a ratio of the target number to the number of sub-threads as a first ratio;

determining a target ratio according to the first ratio;

determining any sub-thread included in the sub-thread set as a remaining sub-thread;

determining each sub-thread which is included in the sub-thread set and meets the preset thread condition as a target sub-thread set;

For each target sub-thread included in the target sub-thread set, performing the steps of:

selecting the target ratio of the query data time from the query data time sequence as a sub-thread query time set;

for each sub-thread inquiry time included in the sub-thread inquiry time set, inquiring a target table data set corresponding to the sub-thread inquiry time according to the target sub-thread and inquiry data information corresponding to the sub-thread inquiry time;

determining the query time of each non-sub-thread in the query data time sequence as a set of remaining sub-thread query times corresponding to the remaining sub-threads;

and inquiring a target table data group corresponding to the residual sub-thread inquiry time according to the residual sub-thread and inquiry data information corresponding to the residual sub-thread inquiry time for each residual sub-thread inquiry time included in the residual sub-thread inquiry time set.

4. The method of claim 1, wherein the performing a verification process on the target table data set to obtain data verification information includes:

for each target table data included in the target table data set, performing the following checking steps:

Determining whether the target form data meets a preset uploading condition;

in response to determining that the target form data meets the preset uploading condition, determining preset verification success information as verification result information;

determining the preset uploading information as data verification information in response to determining that each piece of determined verification result information meets the preset verification condition;

and determining preset failure information as data verification information in response to determining that any verification result information in the verification result information does not meet the preset verification condition.

5. The method of claim 3, wherein the sending the target table data sets to a preset server to obtain the data path information includes:

creating a table as a target table;

determining the derived data identification as a data table identification of the target table;

sequentially adding the target table data sets to the target table according to the time sequence to obtain a target data table;

the target data table and the data table identification are sent to a preset server to receive storage path information;

the received storage path information is determined as data path information.

6. The method of claim 1, wherein the method further comprises:

responding to the fact that the table data export quantity does not meet the preset quantity condition, and inquiring to obtain each target table data group according to the table data export request information;

adding each target table data group to a preset table file to obtain an updated table file;

and sending the updated table file to the client for export by a user.

7. The method of claim 1, wherein the method further comprises:

in response to determining that any data verification information in the obtained data verification information does not meet the preset verification condition, updating the initial information of the data export log according to preset query failure information to obtain data export failure log information;

and sending the data export failure log information to the client for display.

8. A form data derivation apparatus comprising:

a determining unit configured to determine, in response to receiving table data export request information transmitted by a client, table data export information corresponding to the table data export request information, wherein the table data export information includes a table data export number;

A generation unit configured to generate data export log initial information from the table data export request information in response to determining that the table data export quantity satisfies a preset quantity condition;

the first sending unit is configured to send preset export information and initial information of the data export log to the client for display;

a query unit configured to derive request information from the table data, and query each target table data group corresponding to the table data derivation request information;

the verification unit is configured to perform verification processing on each target table data group included in each target table data group to obtain data verification information;

the second sending unit is configured to send each target table data group to a preset server to obtain data path information in response to the fact that each obtained data verification information meets preset verification conditions;

the updating unit is configured to update the initial information of the data export log according to the data path information and the preset query success information to obtain update information of the data export log;

And the third sending unit is configured to send preset download prompt information and the data export log update information to the client so as to prompt a user to export each target table data set.

9. An electronic device, comprising:

one or more processors;

a storage device having one or more programs stored thereon,

when executed by the one or more processors, causes the one or more processors to implement the method of any of claims 1-7.

10. A computer readable medium having stored thereon a computer program, wherein the computer program, when executed by a processor, implements the method of any of claims 1-7.