CN113504957A - Table data processing method and device, computer equipment and storage medium - Google Patents

Table data processing method and device, computer equipment and storage medium Download PDF

Info

Publication number
CN113504957A
CN113504957A CN202110848015.3A CN202110848015A CN113504957A CN 113504957 A CN113504957 A CN 113504957A CN 202110848015 A CN202110848015 A CN 202110848015A CN 113504957 A CN113504957 A CN 113504957A
Authority
CN
China
Prior art keywords
data
processing
processed
verification
configuration file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110848015.3A
Other languages
Chinese (zh)
Inventor
林继丰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ping An Puhui Enterprise Management Co Ltd
Original Assignee
Ping An Puhui Enterprise Management Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ping An Puhui Enterprise Management Co Ltd filed Critical Ping An Puhui Enterprise Management Co Ltd
Priority to CN202110848015.3A priority Critical patent/CN113504957A/en
Publication of CN113504957A publication Critical patent/CN113504957A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/448Execution paradigms, e.g. implementations of programming paradigms
    • G06F9/4482Procedural

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the application belongs to the field of big data, and relates to a table data processing method, a table data processing device, a computer device and a storage medium, wherein the method comprises the following steps: acquiring a table identifier of a table to be processed according to the table data processing instruction; obtaining a form processing configuration file associated with the form identification; determining key value pairs to be processed according to the table processing configuration file; reading table data corresponding to the key value pairs to be processed from the table to be processed; performing data verification on the form data according to the form processing configuration file; and when the table data passes the data verification, performing data processing on the table data according to the table data processing instruction to obtain a target table. In addition, the present application also relates to blockchain techniques, where table processing profiles may be stored. The method and the device improve the operation efficiency of the table data processing program.

Description

Table data processing method and device, computer equipment and storage medium
Technical Field
The present application relates to the field of big data technologies, and in particular, to a method and an apparatus for processing table data, a computer device, and a storage medium.
Background
In the field of computers, the processing of tables is often involved. The processing of the table includes reading and outputting of table data, calculation of the table data, and the like. The processing of the table data requires that the code be written in advance to determine the processing logic for the table data.
The traditional table data processing technology generally adopts a hard coding mode, codes are written according to a specific table, specific field information is embedded into the codes, and then a processing process is written. However, the existing tables are generally complex, many fields are involved in the tables, and this coding method causes code redundancy and is prone to errors, which affects program operation and reduces program operation efficiency.
Disclosure of Invention
An embodiment of the present application provides a method and an apparatus for processing table data, a computer device, and a storage medium, so as to solve the problem of low running efficiency of a table data processing program.
In order to solve the above technical problem, an embodiment of the present application provides a table data processing method, which adopts the following technical solutions:
acquiring a table identifier of a table to be processed according to the table data processing instruction;
obtaining a form processing configuration file associated with the form identification;
determining key value pairs to be processed according to the table processing configuration file;
reading table data corresponding to the key value pairs to be processed from the table to be processed;
performing data verification on the table data according to the table processing configuration file;
and when the table data passes the data verification, performing data processing on the table data according to the table data processing instruction to obtain a target table.
In order to solve the above technical problem, an embodiment of the present application further provides a table data processing apparatus, which adopts the following technical solutions:
the identification acquisition module is used for acquiring the table identification of the table to be processed according to the table data processing instruction;
the configuration acquisition module is used for acquiring a form processing configuration file associated with the form identifier;
the key value pair determining module is used for determining the key value pair to be processed according to the table processing configuration file;
the data reading module is used for reading table data corresponding to the key value pairs to be processed from the table to be processed;
the data verification module is used for performing data verification on the table data according to the table processing configuration file;
and the data processing module is used for carrying out data processing on the table data according to the table data processing instruction to obtain a target table when the table data passes data verification.
In order to solve the above technical problem, an embodiment of the present application further provides a computer device, which adopts the following technical solutions:
acquiring a table identifier of a table to be processed according to the table data processing instruction;
obtaining a form processing configuration file associated with the form identification;
determining key value pairs to be processed according to the table processing configuration file;
reading table data corresponding to the key value pairs to be processed from the table to be processed;
performing data verification on the table data according to the table processing configuration file;
and when the table data passes the data verification, performing data processing on the table data according to the table data processing instruction to obtain a target table.
In order to solve the above technical problem, an embodiment of the present application further provides a computer-readable storage medium, which adopts the following technical solutions:
acquiring a table identifier of a table to be processed according to the table data processing instruction;
obtaining a form processing configuration file associated with the form identification;
determining key value pairs to be processed according to the table processing configuration file;
reading table data corresponding to the key value pairs to be processed from the table to be processed;
performing data verification on the table data according to the table processing configuration file;
and when the table data passes the data verification, performing data processing on the table data according to the table data processing instruction to obtain a target table.
Compared with the prior art, the embodiment of the application mainly has the following beneficial effects: when processing the table, the key value pair in the program is not directly read, but the table processing configuration file of the table to be processed is obtained according to the table identification; the table processing configuration file predefines key value pairs to be processed, and reads table data corresponding to the key value pairs to be processed from the table to be processed; then, checking the form data according to the form processing configuration file to detect whether the form data has errors, and processing the data to obtain a target form when the form data passes the data checking; the method and the device redefine the table data reading process, through the table processing configuration file, specific table data needing to be read does not need to be complexly defined in the program, the program has universality, code redundancy is reduced, data verification is conducted through the table processing configuration file, the phenomenon that error accumulation delays program operation is avoided, and therefore the operation efficiency of the table data processing program is improved.
Drawings
In order to more clearly illustrate the solution of the present application, the drawings needed for describing the embodiments of the present application will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and that other drawings can be obtained by those skilled in the art without inventive effort.
FIG. 1 is an exemplary system architecture diagram in which the present application may be applied;
FIG. 2 is a flow diagram for one embodiment of a tabular data processing method according to the present application;
FIG. 3 is a schematic block diagram of one embodiment of a tabular data processing apparatus according to the present application;
FIG. 4 is a schematic block diagram of one embodiment of a computer device according to the present application.
Detailed Description
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs; the terminology used in the description of the application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application; the terms "including" and "having," and any variations thereof, in the description and claims of this application and the description of the above figures are intended to cover non-exclusive inclusions. The terms "first," "second," and the like in the description and claims of this application or in the above-described drawings are used for distinguishing between different objects and not for describing a particular order.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.
As shown in fig. 1, the system architecture 100 may include terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 serves as a medium for providing communication links between the terminal devices 101, 102, 103 and the server 105. Network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.
The user may use the terminal devices 101, 102, 103 to interact with the server 105 via the network 104 to receive or send messages or the like. The terminal devices 101, 102, 103 may have various communication client applications installed thereon, such as a web browser application, a shopping application, a search application, an instant messaging tool, a mailbox client, social platform software, and the like.
The terminal devices 101, 102, 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, e-book readers, MP3 players (Moving Picture experts Group Audio Layer III, mpeg compression standard Audio Layer 3), MP4 players (Moving Picture experts Group Audio Layer IV, mpeg compression standard Audio Layer 4), laptop portable computers, desktop computers, and the like.
The server 105 may be a server providing various services, such as a background server providing support for pages displayed on the terminal devices 101, 102, 103.
It should be noted that the form data processing method provided in the embodiment of the present application is generally executed by a server, and accordingly, the form data processing apparatus is generally disposed in the server.
It should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
With continued reference to FIG. 2, a flow diagram of one embodiment of a tabular data processing method in accordance with the present application is shown. The table data processing method comprises the following steps:
step S201, according to the table data processing instruction, obtaining the table identification of the table to be processed.
In the present embodiment, the electronic device (for example, the server shown in fig. 1) on which the form data processing method operates may communicate with the terminal by a wired connection manner or a wireless connection manner. It should be noted that the wireless connection means may include, but is not limited to, a 3G/4G connection, a WiFi connection, a bluetooth connection, a WiMAX connection, a Zigbee connection, a uwb (ultra wideband) connection, and other wireless connection means now known or developed in the future.
Specifically, the server may perform processing of the tabular data according to the received tabular data processing instruction. The server may parse the table data processing instruction to extract the table identification of the table to be processed therefrom. The table to be processed may be an excel table, and the table identifier is an identifier of the table to be processed, and may be a table name or a table number of the table to be processed, and has a one-to-one correspondence relationship with the table to be processed.
In step S202, a form processing configuration file associated with the form identifier is acquired.
Wherein the form processing configuration file is used to indicate the processing of the form data.
Specifically, the processing of the form data in the form to be processed may be performed according to the form processing configuration file. The server can access the configuration center, various form processing configuration files are prestored in the configuration center, the server inquires the form processing configuration files corresponding to the form identifications, and the inquired form processing configuration files are extracted.
It is emphasized that to further ensure privacy and security of the form handling profile, the form handling profile may also be stored in a node of a blockchain.
The block chain referred by the application is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, a consensus mechanism, an encryption algorithm and the like. A block chain (Blockchain), which is essentially a decentralized database, is a series of data blocks associated by using a cryptographic method, and each data block contains information of a batch of network transactions, so as to verify the validity (anti-counterfeiting) of the information and generate a next block. The blockchain may include a blockchain underlying platform, a platform product service layer, an application service layer, and the like.
Step S203, determining the key value pair to be processed according to the table processing configuration file.
In particular, the form processing profile may define which form data needs to be processed. In a table, key-value pairs are associated with specific table data. The table processing configuration file can set the key value pairs to be processed, and the table data corresponding to the key value pairs to be processed is the table data to be processed.
The table processing configuration file can directly define specific key value pairs to be processed; the range of key-value pairs to be processed can also be defined, for example, a sheet number, a start line and an end line in a table are defined; and the server takes the key value pairs covered by the starting row and the ending row in the sheet column corresponding to the sheet number as the key value pairs to be processed.
And step S204, reading table data corresponding to the key value pairs to be processed from the table to be processed.
Specifically, in the table to be processed, the table data corresponding to the key value pair to be processed is the table data that needs to be processed. And for each key value pair, the server acquires the table data corresponding to the key value pair from the table to be processed.
Further, the step S204 may include: acquiring a preset access template; updating the access template according to the key value pair to be processed to obtain an access code; and executing the access code to read the table data from the table to be processed.
The access template may be a program for extracting form data from a form to be processed.
Specifically, the server obtains a preset access template, where there are alternative variables in the access template, and the alternative variables are accompanied by variable descriptions to declare the variables here, for example, the alternative variables may be specific key value pairs that need to be filled in, or table identifiers, etc. And the server identifies the replaceable variables in the access template and enables the key value pairs to be processed to replace the replaceable variables to obtain the access codes. And the server runs the access code, accesses the table to be processed according to the access code and extracts the table data from the table to be processed. The server may load the table data in the table to be processed into the memory in the ArrayList data structure, so as to further process the table data.
In one embodiment, the fetch template may be an SQL (Structured Query Language) statement, which is a database Query and programming Language for accessing data and querying, updating, and managing a relational database system.
Based on the form processing configuration file and the access template, when a form data processing program is compiled, a specific key value pair does not need to be filled, the program can realize modularization, one section of program realizes reading the form processing configuration file, and one section of program realizes filling the access template for access, so that the program has universality on various forms to be processed, and the development efficiency is improved.
In the embodiment, the access template is prepared, the form data can be quickly acquired by filling the access template according to the key value pairs to be processed, the access code does not need to be repeatedly written, and the development efficiency is improved.
And S205, performing data verification on the table data according to the table processing configuration file.
In particular, the table processing configuration file also performs normalized definition on table data, such as a value range and a data type of the table data. The server may check the form data according to the form processing configuration file to detect whether the form data is erroneous. If the data processing is directly carried out without data verification, and the error accumulation causes the program to run in error, the completed data processing process is invalidated to influence the running efficiency of the program, so the table data can be verified firstly.
Further, the step S205 may include: acquiring verification configuration information from the form processing configuration file; and performing data verification on the table data according to the verification configuration information, wherein the data verification comprises integrity verification, validity verification and relevance verification.
Specifically, the verification configuration information in the form processing configuration file records in which aspect the form data is verified. The data check includes an integrity check, a validity check and an association check. The integrity check is to check whether the missing table data exists; the validity check is to check whether the value range of the form data is within a preset range and whether the data type is correct; the relevance check is to check whether the reference relationship between the table data is correct. The relevance check can be realized by a data relevance tree, and the relevance between table data is recorded by the data relevance tree and can be in a tree structure.
Reference relations may exist between table data, and the reference relations are recorded in the data association tree. For example, when the table data B is applied, the table data a needs to be referenced, and if an error occurs in the table data a (for example, the table data a is missing or the value of the table data a is abnormal), the table data B is abnormal. Therefore, it is necessary to acquire a data association tree in the verification configuration information, and verify whether the reference association between the table data is correct through the data association tree.
The verification configuration information also records a verification standard, wherein the verification standard specifically defines what the tabular data should be, and when the tabular data meets the verification standard, the tabular data is indicated to pass the verification.
In the embodiment, various data checks are performed on the tabular data according to the check configuration information, so that the correctness of the tabular data is ensured.
Further, after step S205, the method may further include: when the table data do not pass the data verification, the table data containing the data error information are sent to a preset terminal so as to indicate the preset terminal to display the table data containing the data error information; and when receiving the modified form data returned by the preset terminal, performing data verification on the form data according to the form processing configuration file.
Specifically, when the table data fails to pass the data verification, the table data and the data error information may be transmitted together to the preset terminal. The data error information records details of the table data error, and may record, for example, an abnormal value range of the table data.
And the preset terminal displays the table data containing the data error information so that a user can check and modify the table data. And the user sends the modified form data to the server through the preset terminal, and the server performs data verification on the form data again according to the form processing configuration file until all the form data pass the data verification.
In this embodiment, the table data and the data error information corresponding to the table data are sent to the preset terminal to correct the error in the table data, so as to ensure the correctness of the table data.
And step S206, when the table data passes the data verification, performing data processing on the table data according to the table data processing instruction to obtain a target table.
Specifically, when the tabular data passes the data check, indicating that the tabular data has no error, the data processing may be started. The server processes the table data according to the table data processing instruction, for example, the table data processing instruction may instruct operations such as copying, calculating, and the like on the table data. And after finishing the processing of the table data according to the table data processing instruction, obtaining a new table, namely the target table.
In the embodiment, when the form is processed, the key value pair in the program is not directly read, but the form processing configuration file of the form to be processed is obtained according to the form identifier; the table processing configuration file predefines key value pairs to be processed, and reads table data corresponding to the key value pairs to be processed from the table to be processed; then, checking the form data according to the form processing configuration file to detect whether the form data has errors, and processing the data to obtain a target form when the form data passes the data checking; the method and the device redefine the table data reading process, through the table processing configuration file, specific table data needing to be read does not need to be complexly defined in the program, the program has universality, code redundancy is reduced, data verification is conducted through the table processing configuration file, the phenomenon that error accumulation delays program operation is avoided, and therefore the operation efficiency of the table data processing program is improved.
Further, before step S201, the method may further include: when a configuration instruction sent by a terminal is received, displaying a configuration page through the terminal; acquiring form processing configuration information input in a configuration page through a terminal; and generating a form processing configuration file according to the form processing configuration information.
The configuration instruction may be an instruction for configuring a table processing configuration file.
Specifically, a configuration platform is built in the server, and the configuration platform provides a visual configuration mode. And the user accesses the configuration platform at the terminal to trigger the configuration instruction. And after receiving the configuration instruction sent by the terminal, the server displays the configuration page through the terminal.
The configuration page can realize what you see is what you get configuration, and a user does not need to write a complex script, so that the generation efficiency of the form processing configuration file is improved. The user can input form processing configuration information in the configuration page, wherein the form processing configuration information comprises form identification, key value pairs to be processed, value range of form data, data types, data association trees and the like. When the form is entered to process the configuration information, the following functions are supported: radio box input, multiple box input, drop-down search box input, input box input, and the like. The terminal obtains form processing configuration information recorded in the configuration page, the form processing configuration information is sent to the server, and the server generates a form processing configuration file according to the recorded form processing configuration information.
In the embodiment, the form processing configuration file can be automatically generated by inputting the form processing configuration information according to the requirements in the configuration page, the operation is simple and convenient, the adjustment is flexible, and the generation efficiency of the form processing configuration file is improved.
Further, the step S206 may include: extracting a calculation instruction and a form template identifier in a form data processing instruction; calculating the form data according to the calculation instruction to obtain a data calculation result; and importing the data calculation result into a form template corresponding to the form template identification to obtain the target form.
Wherein, the calculation instruction can be an instruction for instructing the server to calculate the form data; the form template identifier may be an identifier of a form template, and the form template may be a preset formatted form.
Specifically, the server extracts the calculation instruction and the form template identification from the form data processing instruction. According to the calculation instruction, the acquired table data is calculated, for example, mathematical statistics or duplicate removal is performed, so as to obtain a data calculation result.
The server acquires the form template from the template library according to the form template identification, imports the data calculation result into the form template, exports the data in a normalized mode, improves the readability of the generated target form, and reduces errors in the target form.
In this embodiment, the table data is calculated according to the calculation instruction, and the calculation result is imported into the table template to obtain the target table, so that the processing of the table data is realized.
Further, the step of calculating the table data according to the calculation instruction to obtain the data calculation result may include: acquiring a data association tree from a table processing configuration file; dividing the table data into a plurality of groups of associated table subdata according to the data association tree; and running a plurality of threads to perform parallel calculation on the associated table subdata to obtain a data calculation result, wherein the number of the running threads is the same as the group number of the associated table subdata.
Specifically, the server acquires a data association tree from the table processing configuration file, and the data association tree records association and reference relations among table data. The table data can be classified according to the data association tree to obtain a plurality of groups of association table subdata. The table data in each set of associated table subdata can be associated through a data association tree, and the associated table subdata of different sets does not have association and reference relations.
And the server counts the group number of the associated table subdata, runs threads with the same group number in parallel, and calculates a group of associated table subdata by each thread to realize parallel processing of the table data.
In the embodiment, the reference relation between the table data is determined according to the data association tree, the table data generating the reference relation is divided into a group of association table subdata, one thread is started for calculation for each group of association table subdata, parallel processing of the table data is achieved, and processing efficiency of the table data is improved.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the computer program is executed. The storage medium may be a non-volatile storage medium such as a magnetic disk, an optical disk, a Read-only Memory (ROM), or a Random Access Memory (RAM).
It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least a portion of the steps in the flow chart of the figure may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
With further reference to fig. 3, as an implementation of the method shown in fig. 2, the present application provides an embodiment of a table data processing apparatus, which corresponds to the embodiment of the method shown in fig. 2, and which can be applied to various electronic devices.
As shown in fig. 3, the table data processing apparatus 300 according to the present embodiment includes: an identity acquisition module 301, a configuration acquisition module 302, a key-value pair determination module 303, a data reading module 304, a data verification module 305, and a data processing module 306, wherein:
the identifier obtaining module 301 is configured to obtain a table identifier of a table to be processed according to a table data processing instruction.
A configuration obtaining module 302, configured to obtain a table processing configuration file associated with the table identifier.
And a key-value pair determining module 303, configured to determine a key-value pair to be processed according to the table processing configuration file.
And the data reading module 304 is configured to read table data corresponding to the key-value pair to be processed from the table to be processed.
And the data checking module 305 is configured to perform data checking on the table data according to the table processing configuration file.
And the data processing module 306 is configured to, when the table data passes the data verification, perform data processing on the table data according to the table data processing instruction to obtain a target table.
In the embodiment, when the form is processed, the key value pair in the program is not directly read, but the form processing configuration file of the form to be processed is obtained according to the form identifier; the table processing configuration file predefines key value pairs to be processed, and reads table data corresponding to the key value pairs to be processed from the table to be processed; then, checking the form data according to the form processing configuration file to detect whether the form data has errors, and processing the data to obtain a target form when the form data passes the data checking; the method and the device redefine the table data reading process, through the table processing configuration file, specific table data needing to be read does not need to be complexly defined in the program, the program has universality, code redundancy is reduced, data verification is conducted through the table processing configuration file, the phenomenon that error accumulation delays program operation is avoided, and therefore the operation efficiency of the table data processing program is improved.
In some optional implementations of this embodiment, the table data processing apparatus 300 may further include: the system comprises a page display module, an information acquisition module and a file generation module, wherein:
and the page display module is used for displaying the configuration page through the terminal when receiving the configuration instruction sent by the terminal.
And the information acquisition module is used for acquiring form processing configuration information input in the configuration page through the terminal.
And the file generating module is used for generating a form processing configuration file according to the form processing configuration information.
In the embodiment, the form processing configuration file can be automatically generated by inputting the form processing configuration information according to the requirements in the configuration page, the operation is simple and convenient, the adjustment is flexible, and the generation efficiency of the form processing configuration file is improved.
In some optional implementations of this embodiment, the data reading module 304 may include: the template acquisition submodule, the template updating submodule and the data reading submodule, wherein:
and the template obtaining submodule is used for obtaining a preset access template.
And the template updating submodule is used for updating the access template according to the key value pair to be processed to obtain the access code.
And the data reading submodule is used for operating the access code to read the table data from the table to be processed.
In the embodiment, the access template is prepared, the form data can be quickly acquired by filling the access template according to the key value pairs to be processed, the access code does not need to be repeatedly written, and the development efficiency is improved.
In some optional implementations of this embodiment, the data checking module 305 may include: information acquisition submodule and data check submodule, wherein:
and the information acquisition submodule is used for acquiring the verification configuration information from the form processing configuration file.
And the data verification submodule is used for performing data verification on the table data according to the verification configuration information, and the data verification comprises integrity verification, validity verification and relevance verification.
In the embodiment, various data checks are performed on the tabular data according to the check configuration information, so that the correctness of the tabular data is ensured.
In some optional implementations of this embodiment, the table data processing apparatus 300 may further include: a sending module, wherein:
and the sending module is used for sending the table data containing the data error information to the preset terminal when the table data does not pass the data verification so as to indicate the preset terminal to display the table data containing the data error information.
The data verification module 305 is further configured to: and when receiving the modified form data returned by the preset terminal, performing data verification on the form data according to the form processing configuration file.
In this embodiment, the table data and the data error information corresponding to the table data are sent to the preset terminal to correct the error in the table data, so as to ensure the correctness of the table data.
In some optional implementations of this embodiment, the data processing module 306 may include: an extraction submodule, a calculation submodule and an import submodule, wherein:
and the extraction submodule is used for extracting the calculation instruction and the form template identification in the form data processing instruction.
And the calculation submodule is used for calculating the form data according to the calculation instruction to obtain a data calculation result.
And the importing submodule is used for importing the data calculation result into the form template corresponding to the form template identification to obtain the target form.
In this embodiment, the table data is calculated according to the calculation instruction, and the calculation result is imported into the table template to obtain the target table, so that the processing of the table data is realized.
In some optional implementations of this embodiment, the calculation sub-module may include: the device comprises a correlation tree acquisition unit, a data dividing unit and a parallel computing unit, wherein:
and the association tree acquisition unit is used for acquiring the data association tree from the table processing configuration file.
And the data dividing unit is used for dividing the table data into a plurality of groups of associated table subdata according to the data associated tree.
And the parallel computing unit is used for running a plurality of threads to perform parallel computing on the associated table subdata to obtain a data computing result, wherein the number of the running threads is the same as the number of groups of the associated table subdata.
In the embodiment, the reference relation between the table data is determined according to the data association tree, the table data generating the reference relation is divided into a group of association table subdata, one thread is started for calculation for each group of association table subdata, parallel processing of the table data is achieved, and processing efficiency of the table data is improved.
In order to solve the technical problem, an embodiment of the present application further provides a computer device. Referring to fig. 4, fig. 4 is a block diagram of a basic structure of a computer device according to the present embodiment.
The computer device 4 comprises a memory 41, a processor 42, a network interface 43 communicatively connected to each other via a system bus. It is noted that only computer device 4 having components 41-43 is shown, but it is understood that not all of the shown components are required to be implemented, and that more or fewer components may be implemented instead. As will be understood by those skilled in the art, the computer device is a device capable of automatically performing numerical calculation and/or information processing according to a preset or stored instruction, and the hardware includes, but is not limited to, a microprocessor, an Application Specific Integrated Circuit (ASIC), a Programmable Gate Array (FPGA), a Digital Signal Processor (DSP), an embedded device, and the like.
The computer device can be a desktop computer, a notebook, a palm computer, a cloud server and other computing devices. The computer equipment can carry out man-machine interaction with a user through a keyboard, a mouse, a remote controller, a touch panel or voice control equipment and the like.
The memory 41 includes at least one type of readable storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Read Only Memory (ROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a Programmable Read Only Memory (PROM), a magnetic memory, a magnetic disk, an optical disk, etc. In some embodiments, the memory 41 may be an internal storage unit of the computer device 4, such as a hard disk or a memory of the computer device 4. In other embodiments, the memory 41 may also be an external storage device of the computer device 4, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are provided on the computer device 4. Of course, the memory 41 may also include both internal and external storage devices of the computer device 4. In this embodiment, the memory 41 is generally used for storing an operating system installed in the computer device 4 and various types of application software, such as computer readable instructions of a table data processing method. Further, the memory 41 may also be used to temporarily store various types of data that have been output or are to be output.
The processor 42 may be a Central Processing Unit (CPU), controller, microcontroller, microprocessor, or other data Processing chip in some embodiments. The processor 42 is typically used to control the overall operation of the computer device 4. In this embodiment, the processor 42 is configured to execute computer readable instructions stored in the memory 41 or process data, for example, execute computer readable instructions of the table data processing method.
The network interface 43 may comprise a wireless network interface or a wired network interface, and the network interface 43 is generally used for establishing communication connection between the computer device 4 and other electronic devices.
The computer device provided in this embodiment may execute the above table data processing method. The table data processing method here may be the table data processing method of the above-described respective embodiments.
In the embodiment, when the form is processed, the key value pair in the program is not directly read, but the form processing configuration file of the form to be processed is obtained according to the form identifier; the table processing configuration file predefines key value pairs to be processed, and reads table data corresponding to the key value pairs to be processed from the table to be processed; then, checking the form data according to the form processing configuration file to detect whether the form data has errors, and processing the data to obtain a target form when the form data passes the data checking; the method and the device redefine the table data reading process, through the table processing configuration file, specific table data needing to be read does not need to be complexly defined in the program, the program has universality, code redundancy is reduced, data verification is conducted through the table processing configuration file, the phenomenon that error accumulation delays program operation is avoided, and therefore the operation efficiency of the table data processing program is improved.
The present application further provides another embodiment, which is to provide a computer-readable storage medium storing computer-readable instructions executable by at least one processor to cause the at least one processor to perform the steps of the table data processing method as described above.
In the embodiment, when the form is processed, the key value pair in the program is not directly read, but the form processing configuration file of the form to be processed is obtained according to the form identifier; the table processing configuration file predefines key value pairs to be processed, and reads table data corresponding to the key value pairs to be processed from the table to be processed; then, checking the form data according to the form processing configuration file to detect whether the form data has errors, and processing the data to obtain a target form when the form data passes the data checking; the method and the device redefine the table data reading process, through the table processing configuration file, specific table data needing to be read does not need to be complexly defined in the program, the program has universality, code redundancy is reduced, data verification is conducted through the table processing configuration file, the phenomenon that error accumulation delays program operation is avoided, and therefore the operation efficiency of the table data processing program is improved.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.
It is to be understood that the above-described embodiments are merely illustrative of some, but not restrictive, of the broad invention, and that the appended drawings illustrate preferred embodiments of the invention and do not limit the scope of the invention. This application is capable of embodiments in many different forms and is provided for the purpose of enabling a thorough understanding of the disclosure of the application. Although the present application has been described in detail with reference to the foregoing embodiments, it will be apparent to one skilled in the art that the present application may be practiced without modification or with equivalents of some of the features described in the foregoing embodiments. All equivalent structures made by using the contents of the specification and the drawings of the present application are directly or indirectly applied to other related technical fields and are within the protection scope of the present application.

Claims (10)

1. A method for processing tabular data, comprising the steps of:
acquiring a table identifier of a table to be processed according to the table data processing instruction;
obtaining a form processing configuration file associated with the form identification;
determining key value pairs to be processed according to the table processing configuration file;
reading table data corresponding to the key value pairs to be processed from the table to be processed;
performing data verification on the table data according to the table processing configuration file;
and when the table data passes the data verification, performing data processing on the table data according to the table data processing instruction to obtain a target table.
2. The form data processing method of claim 1, further comprising, before the step of obtaining the form identifier of the form to be processed according to the form data processing instruction:
when a configuration instruction sent by a terminal is received, displaying a configuration page through the terminal;
acquiring form processing configuration information input in the configuration page through the terminal;
and generating a form processing configuration file according to the form processing configuration information.
3. A tabular data processing method according to claim 1, wherein said step of reading tabular data corresponding to said key-value pairs to be processed from said table to be processed comprises:
acquiring a preset access template;
updating the access template according to the key value pair to be processed to obtain an access code;
and running the access code to read table data from the table to be processed.
4. The tabular data processing method of claim 1, wherein said step of data checking the tabular data according to the tabular processing profile comprises:
acquiring verification configuration information from the form processing configuration file;
and performing data verification on the table data according to the verification configuration information, wherein the data verification comprises integrity verification, validity verification and relevance verification.
5. The tabular data processing method of claim 1, further comprising, after the step of performing data verification on the tabular data according to the tabular processing profile:
when the table data do not pass the data verification, the table data containing the data error information are sent to a preset terminal so as to indicate the preset terminal to display the table data containing the data error information;
and when receiving the modified form data returned by the preset terminal, executing the step of carrying out data verification on the form data according to the form processing configuration file.
6. The tabular data processing method according to claim 1, wherein the step of performing data processing on the tabular data according to the tabular data processing instruction to obtain the target table when the tabular data passes data verification comprises:
extracting a calculation instruction and a form template identifier in the form data processing instruction;
calculating the table data according to the calculation instruction to obtain a data calculation result;
and importing the data calculation result into a form template corresponding to the form template identification to obtain a target form.
7. The tabular data processing method of claim 6, wherein said step of calculating the tabular data according to the calculation instruction to obtain a data calculation result comprises:
acquiring a data association tree from the table processing configuration file;
dividing the table data into a plurality of groups of associated table subdata according to the data associated tree;
and running a plurality of threads to perform parallel calculation on the associated table subdata to obtain a data calculation result, wherein the number of the running threads is the same as the group number of the associated table subdata.
8. A form data processing apparatus, comprising:
the identification acquisition module is used for acquiring the table identification of the table to be processed according to the table data processing instruction;
the configuration acquisition module is used for acquiring a form processing configuration file associated with the form identifier;
the key value pair determining module is used for determining the key value pair to be processed according to the table processing configuration file;
the data reading module is used for reading table data corresponding to the key value pairs to be processed from the table to be processed;
the data verification module is used for performing data verification on the table data according to the table processing configuration file;
and the data processing module is used for carrying out data processing on the table data according to the table data processing instruction to obtain a target table when the table data passes data verification.
9. A computer device comprising a memory having computer readable instructions stored therein and a processor which when executed implements the steps of a table data processing method as claimed in any one of claims 1 to 7.
10. A computer-readable storage medium, having computer-readable instructions stored thereon, which, when executed by a processor, implement the steps of the table data processing method of any one of claims 1 to 7.
CN202110848015.3A 2021-07-27 2021-07-27 Table data processing method and device, computer equipment and storage medium Pending CN113504957A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110848015.3A CN113504957A (en) 2021-07-27 2021-07-27 Table data processing method and device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110848015.3A CN113504957A (en) 2021-07-27 2021-07-27 Table data processing method and device, computer equipment and storage medium

Publications (1)

Publication Number Publication Date
CN113504957A true CN113504957A (en) 2021-10-15

Family

ID=78014631

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110848015.3A Pending CN113504957A (en) 2021-07-27 2021-07-27 Table data processing method and device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN113504957A (en)

Similar Documents

Publication Publication Date Title
CN108427705B (en) Electronic device, distributed system log query method and storage medium
CN112765271B (en) Block chain transaction index storage method and device, computer equipment and medium
CN115757495A (en) Cache data processing method and device, computer equipment and storage medium
CN112671734A (en) Message processing method facing multiple data sources and related equipment thereof
CN112181835A (en) Automatic testing method and device, computer equipment and storage medium
CN108427700B (en) Electronic device, user grouping method and computer readable storage medium
CN112860662A (en) Data blood relationship establishing method and device, computer equipment and storage medium
CN114493255A (en) Enterprise abnormity monitoring method based on knowledge graph and related equipment thereof
CN112328486A (en) Interface automation test method and device, computer equipment and storage medium
CN113282591B (en) Authority filtering method, authority filtering device, computer equipment and storage medium
CN114265835A (en) Data analysis method and device based on graph mining and related equipment
CN113010542B (en) Service data processing method, device, computer equipment and storage medium
CN110647577A (en) Data cube partitioning method and device, computer equipment and storage medium
CN112363814A (en) Task scheduling method and device, computer equipment and storage medium
CN111475468A (en) Log access method, device, equipment and storage medium of newly added system
CN116842012A (en) Method, device, equipment and storage medium for storing Redis cluster in fragments
CN114968822A (en) Interface testing method and device, computer equipment and storage medium
CN113504957A (en) Table data processing method and device, computer equipment and storage medium
CN114626352A (en) Report automatic generation method and device, computer equipment and storage medium
CN114637672A (en) Automatic data testing method and device, computer equipment and storage medium
CN114912003A (en) Document searching method and device, computer equipment and storage medium
CN114625372A (en) Automatic component compiling method and device, computer equipment and storage medium
CN114143308A (en) File uploading information processing method and device, computer equipment and storage medium
CN111782208A (en) Index early warning method and device, computer equipment and storage medium
CN112416875A (en) Log management method and device, computer equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination