CN115080509A

CN115080509A - Data processing method and device, electronic equipment and storage medium

Info

Publication number: CN115080509A
Application number: CN202210656409.3A
Authority: CN
Inventors: 王炳洋; 俞致吉
Original assignee: Beijing Dajia Internet Information Technology Co Ltd
Current assignee: Beijing Dajia Internet Information Technology Co Ltd
Priority date: 2022-06-10
Filing date: 2022-06-10
Publication date: 2022-09-20

Abstract

The present disclosure relates to a data processing method, an apparatus, an electronic device, and a storage medium, including: the method comprises the steps of obtaining a file to be processed and execution information, determining the execution sequence and execution correlation of the at least one piece of data processing information and the at least one piece of data application information under the condition that the execution information comprises the at least one piece of data processing information and the at least one piece of data application information, conducting parallel or serial processing on the file to be processed by utilizing the at least one piece of data processing information based on the execution sequence and the execution correlation to obtain application data corresponding to the at least one piece of data processing information, and sending the application data corresponding to the at least one piece of data processing information to an application object in the data application information. The method and the device have the advantages that the tasks on each execution chain are independent through the execution sequence and the execution correlation, the processing can be carried out in parallel, the processing and application time of the device is shortened, and the execution efficiency of the device is improved.

Description

Data processing method and device, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of internet technologies, and in particular, to a data processing method and apparatus, an electronic device, and a storage medium.

Background

With the rapid development of the current mobile internet, massive data and files are waiting to be processed, and with the increase of data processing scenes and the increase of requirements for personalized processing, a platform needs to develop various data processing application programs according to various scenes so as to meet daily requirements of people.

However, the processing steps in the existing data processing applications are often coupled together and difficult to multiplex, and the devices also have difficulty scheduling the processing of data, which results in a waste of a lot of time and resources.

Disclosure of Invention

The present disclosure provides a data processing method, an apparatus, an electronic device and a storage medium, and the technical scheme of the present disclosure is as follows:

according to a first aspect of an embodiment of the present disclosure, there is provided a data processing method, including:

acquiring a file to be processed and execution information;

in the case that the execution information includes at least one data processing information and at least one data application information, determining an execution order and an execution correlation of the at least one data processing information and the at least one data application information;

based on the execution sequence and the execution correlation, performing parallel or serial processing on the file to be processed by utilizing the at least one piece of data processing information to obtain application data corresponding to the at least one piece of data processing information;

and sending the application data corresponding to the at least one piece of data processing information to the application object in the data application information.

In some possible embodiments, the parallel or serial processing of the file to be processed by using the at least one piece of data processing information to obtain the application data corresponding to the at least one piece of data processing information includes:

analyzing the file to be processed by utilizing the analysis object corresponding to the file to be processed to obtain data to be processed;

and performing parallel or serial processing on the data to be processed by utilizing the at least one piece of data processing information to obtain application data corresponding to the at least one piece of data processing information.

In some possible embodiments, analyzing the file to be processed by using the analysis object corresponding to the file to be processed to obtain the data to be processed includes:

determining a file analysis object based on the file type of the file to be processed;

analyzing the file to be processed by using the file analysis object to obtain data to be analyzed;

determining a data analysis object based on the data type of the data to be analyzed;

and analyzing the data to be analyzed by using the data analysis object to obtain the data to be processed.

In some possible embodiments, analyzing the file to be processed by using the file analysis object to obtain the data to be analyzed includes:

determining a file analysis mode of a file to be processed;

and analyzing the file to be processed by utilizing the file analysis object according to a file analysis mode to obtain data to be analyzed.

In some possible embodiments, determining a file parsing manner of the file to be processed includes:

determining the file capacity of the currently acquired file; the currently acquired files comprise files to be processed;

determining a current operable memory;

and determining a file analysis mode of the file to be processed based on the file capacity of the currently acquired file and the currently operable memory.

In some possible embodiments, the executing information includes file processing information, and analyzing the file to be processed by using the file analysis object to obtain the data to be analyzed includes:

and when the file processing information comprises a file analysis range aiming at the file, analyzing the file to be processed according to the file analysis range by using the file analysis object to obtain data to be analyzed.

In some possible embodiments, the performing parallel or serial processing on the data to be processed by using the at least one piece of data processing information to obtain the application data corresponding to the at least one piece of data processing information includes:

when the data processing information comprises data cleaning information, cleaning the data to be processed according to the data cleaning information to obtain application data;

and/or;

when the data processing information comprises data conversion information, converting the data to be processed according to the data conversion information to obtain application data;

and/or;

and when the data processing information comprises data integration information, integrating the data to be processed according to the data integration information to obtain the application data.

In some possible embodiments, based on the execution sequence and the execution correlation, parallel or serial processing is performed on the file to be processed by using at least one piece of data processing information, so as to obtain application data corresponding to the at least one piece of data processing information; sending the application data corresponding to the at least one piece of data processing information to the application object in the data application information includes:

determining data processing information and data application information belonging to an execution chain according to the identification of the execution correlation of the at least one data processing information and the identification of the execution correlation of the at least one data application information;

when a plurality of execution chains exist, determining an execution position on each execution chain based on the identification of the execution sequence of the data processing information and the identification of the execution sequence of the data application information in each execution chain;

if the execution position of the data processing information is in front of the execution position of the data application information in each execution chain, processing the file to be processed by using the data processing information in each execution chain respectively in the same time period to obtain application data corresponding to each execution chain;

and sending the application data corresponding to each execution chain to the application object in the data application information in the corresponding execution chain.

when there is one execution chain, determining an execution position on the execution chain based on the identification of the execution sequence of the data processing information and the identification of the execution sequence of the data application information in the execution chain;

if the execution position of the data processing information is in front of the execution position of the data application information, processing the file to be processed by using the data processing information to obtain application data;

and sending the application data to an application object in the data application information in the execution chain.

According to a second aspect of an embodiment of the present disclosure, there is provided a data processing apparatus including:

the file information acquisition module is configured to execute acquisition of a file to be processed and execution information;

an execution information determination module configured to determine an execution order and an execution correlation of the at least one data processing information and the at least one data application information in a case where the execution information includes the at least one data processing information and the at least one data application information;

the data processing application module is configured to execute parallel or serial processing on the file to be processed by utilizing the at least one piece of data processing information based on the execution sequence and the execution correlation to obtain application data corresponding to the at least one piece of data processing information; and sending the application data corresponding to the at least one piece of data processing information to the application object in the data application information.

In some possible embodiments, the data processing application module is configured to perform:

determining a file analysis mode of a file to be processed;

determining a current operable memory;

In some possible embodiments, the execution information comprises file processing information, the data processing application module configured to perform:

and/or;

According to a third aspect of the embodiments of the present disclosure, there is provided an electronic apparatus including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement the method of any one of the first aspect as described above.

According to a fourth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium, wherein instructions, when executed by a processor of an electronic device, enable the electronic device to perform the method of any one of the first aspects of the embodiments of the present disclosure.

According to a fifth aspect of embodiments of the present disclosure, there is provided a computer program product comprising a computer program, the computer program being stored in a readable storage medium, from which at least one processor of a computer device reads and executes the computer program, causing the computer device to perform the method of any one of the first aspect of embodiments of the present disclosure.

The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:

the method comprises the steps of obtaining a file to be processed and execution information, determining the execution sequence and execution correlation of the at least one piece of data processing information and the at least one piece of data application information under the condition that the execution information comprises the at least one piece of data processing information and the at least one piece of data application information, conducting parallel or serial processing on the file to be processed by utilizing the at least one piece of data processing information based on the execution sequence and the execution correlation to obtain application data corresponding to the at least one piece of data processing information, and sending the application data corresponding to the at least one piece of data processing information to an application object in the data application information. According to the method and the device, the file processing flow is decomposed, the flow processing unitization is realized, so that decoupling is carried out among all processing processes, the aim of multiplexing the capacity is realized, tasks on each execution chain are independent through the execution sequence and the execution correlation, processing can be carried out in parallel, the equipment processing and application time is shortened, and the equipment execution efficiency is improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.

FIG. 1 is a schematic diagram illustrating an application environment in accordance with an illustrative embodiment;

FIG. 2 is a flow diagram illustrating a method of data processing in accordance with an exemplary embodiment;

FIG. 3 is a flow diagram illustrating the acquisition of data to be processed in accordance with an exemplary embodiment;

FIG. 4 is a flow diagram illustrating a file parsing method in accordance with an exemplary embodiment;

FIG. 5 is a flow diagram illustrating a determination of a manner in which a file is parsed in accordance with an illustrative embodiment;

FIG. 6 is a block diagram illustrating a data processing apparatus in accordance with an exemplary embodiment;

FIG. 7 is a block diagram illustrating an electronic device for data processing in accordance with an exemplary embodiment.

Detailed Description

In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

It should be noted that, the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for presentation, analyzed data, etc.) referred to in the present disclosure are information and data authorized by the user or sufficiently authorized by each party.

Referring to fig. 1, fig. 1 is a schematic diagram illustrating an application environment of a data processing method according to an exemplary embodiment, and as shown in fig. 1, the application environment may include a server 01 and a client 02.

In this embodiment of the application, the server 01 may obtain the file to be processed and the execution information, determine an execution order and execution correlation between the at least one piece of data processing information and the at least one piece of data application information when the execution information includes the at least one piece of data processing information and the at least one piece of data application information, perform parallel or serial processing on the file to be processed by using the at least one piece of data processing information based on the execution order and the execution correlation, obtain application data corresponding to the at least one piece of data processing information, and send the application data corresponding to the at least one piece of data processing information to the application object in the data application information.

The server 01 may include an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, and a cloud server providing basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a Network service, cloud communication, a middleware service, a domain name service, a security service, a CDN (Content Delivery Network), a big data and artificial intelligence platform. The operating system running on the server may include, but is not limited to, an android system, an IOS system, linux, windows, Unix, and the like.

In some possible embodiments, the client 02 described above sends the characteristic information of the object to the server 01. Client 02 may include, but is not limited to, smart phones, desktop computers, tablet computers, laptop computers, smart speakers, digital assistants, Augmented Reality (AR)/Virtual Reality (VR) devices, smart wearable devices, and the like. The software running on the client may also be an application program, an applet, or the like. Alternatively, the operating system running on the client may include, but is not limited to, an android system, an IOS system, linux, windows, Unix, and the like.

In addition, it should be noted that fig. 1 shows only one application environment of the data processing method provided by the present disclosure, and in practical applications, other application environments may also be included.

Fig. 2 is a flowchart illustrating a data processing method according to an exemplary embodiment, where as shown in fig. 2, the data processing method may be applied to a server or a client, and includes the following steps:

in step S201, a file to be processed and execution information are acquired.

In the embodiment of the application, when a user to which a client belongs wants to process and execute a file to be processed, the file to be processed may be uploaded to the client, and then the file to be processed is sent to the server through the client.

In an alternative embodiment, the connection between the client and the server is through an application hosted on the client. Therefore, the client can read the file to be processed from the local storage to the application on the client. Alternatively, the client may obtain the pending file from another client and upload the pending file to an application on the client. For example, assuming that the client is a desktop computer and the other clients are smart phones, the desktop computer may obtain the file to be processed from the smart phones and upload the file to be processed to an application on the desktop computer in response to an upload instruction.

In an alternative embodiment, the connection between the client and the server is through a web site hosted on the client. Therefore, the client can read the file to be processed from the local storage to the website on the client. Alternatively, the client may obtain the pending file from another client and upload the pending file to a website on the client. For example, assuming that the client is a desktop computer and the other clients are smart phones, the desktop computer may obtain the file to be processed from the smart phones and upload the file to be processed to a website on the desktop computer in response to an upload instruction.

In the embodiment of the application, when a user to which the client belongs wants to process and execute a file to be processed, an application can be directly downloaded from a provider providing services or a website can be logged in. Therefore, the client loaded with the application or logging in the website can obtain the file to be processed.

The server or the client in the embodiment of the application can meet the requirements of personalized, multi-scene processing, execution and application of various complicated and fussy files, and the purpose of improving the efficiency is achieved.

In step S203, in the case where the execution information includes at least one data processing information and at least one data application information, an execution order and an execution correlation of the at least one data processing information and the at least one data application information are determined.

In the embodiment of the present application, the execution information may include data processing information and data application information. The data processing information is used for indicating how the server or the client processes the file to be processed. The data application information is used for instructing the server or the client how to apply the processed data.

In an alternative embodiment, the execution information may include a data processing information and a data application information. That is, the client or the server may process the file to be processed according to the data processing information, and apply the processed data according to the data application information.

In another alternative embodiment, the execution information may include one data processing information and a plurality of data application information. That is, the client or the server may process the file to be processed according to the data processing information, and perform multiple applications on the processed data according to the multiple data application information, respectively.

In another alternative embodiment, the execution includes a plurality of data processing information and one data application information. That is, the client or the server may perform various kinds of processing on the file to be processed according to the plurality of data processing information, and apply various kinds of data obtained after the processing according to the data application information.

In another alternative embodiment, the execution includes a plurality of data processing information and a plurality of data application information. That is, the client or the server may perform various kinds of processing on the file to be processed according to the plurality of data processing information, and perform various kinds of application on the various kinds of data obtained after the processing according to the various kinds of data application information.

However, the above four ways do not indicate whether data processing precedes or data application precedes, i.e., the order and correlation of data processing and data application are not indicated. Therefore, in the embodiment of the present application, in the case that the execution information includes at least one piece of data processing information and at least one piece of data application information, the client or the server may determine the execution order and the execution correlation of the at least one piece of data processing information and the at least one piece of data application information.

In an optional embodiment, the data processing information and the data application information may carry an identifier of an execution sequence, or may also carry an identifier of execution correlation. When the client or the server acquires the at least one piece of data processing information and the at least one piece of data application information, the execution sequence and the execution correlation corresponding to the at least one piece of data processing information can be read, and the execution sequence and the execution correlation of the at least one piece of data application information can be read.

In step S205, based on the execution sequence and the execution correlation, the file to be processed is processed in parallel or in series by using the at least one data processing information, so as to obtain application data corresponding to the at least one data processing information.

In an alternative embodiment, the file to be processed includes the parsed data to be processed. The client or the server may perform parallel or serial processing on the file to be processed by using the at least one piece of data processing information based on the execution sequence and the execution correlation, so as to obtain application data corresponding to the at least one piece of data processing information.

In another alternative embodiment, the pending file includes the unresolved pending data. The client or the server may analyze the file to be processed by using the analysis object corresponding to the file to be processed to obtain data to be processed, and perform parallel or serial processing on the data to be processed by using the at least one piece of data processing information to obtain application data corresponding to the at least one piece of data processing information.

The embodiment of the application provides an implementation method for analyzing a file to be processed by using an analysis object corresponding to the file to be processed to obtain data to be processed. Fig. 3 is a flowchart illustrating an exemplary embodiment of obtaining data to be processed, and as shown in fig. 3, the data processing method may be applied to a server or a client, and includes the following steps:

in step S2051, a file analysis object is determined based on the file type of the file to be processed.

In the embodiment of the present application, since the server can process various files, there may be many types of acquired files to be processed.

In an alternative embodiment, the server or the client may determine the file type from the extension of the file to be processed.

In another optional embodiment, the execution information may further include file processing information, where the file processing information is used to instruct the server how to parse the file to be processed. Optionally, the file processing information may include a file type of the file to be processed. Therefore, after the server or the client acquires the file to be processed, if the file to be processed does not have the extension, the server or the client can acquire the file type from the file processing information in the execution information.

In the embodiment of the application, after the server or the client acquires the file type of the file to be processed, the file analysis object can be determined according to the file type. Optionally, the server or the client may determine, from the file template configuration module, that the file parsing object of the file to be processed is a word parsing processor. Optionally, the server or the client may determine, from the file template configuration module, that the file parsing object of the file to be processed is the table parsing processor. Optionally, the server or the client may determine, from the file template configuration module, that the file parsing object of the file to be processed is the picture parsing processor.

Therefore, the file template configuration module in the embodiment of the application can comprise various analysis processors to prepare for analyzing files of various file types, so that personalized requirements of different users can be met, and meanwhile, time and equipment resources for loading different file analysis processors in the prior art are saved.

In step S2052, the file to be processed is analyzed by using the file analysis object, so as to obtain data to be analyzed.

In an optional embodiment, the server or the client may analyze the file to be processed by using the determined file analysis object to obtain data to be analyzed.

Different analysis modes can exist for different files, even different analysis modes can exist for the same file, and different analysis modes can have different influences on the processing speed of the server or the client at different moments. Therefore, in another optional embodiment, the server or the client may determine a file parsing manner of the file to be processed, and parse the file to be processed according to the file parsing manner by using the file parsing object to obtain the data to be parsed.

In another optional embodiment, the server or the client may determine a file analysis range, and analyze the file to be processed according to the file analysis range by using the file analysis object to obtain the data to be analyzed. Therefore, the analysis resources of the server or the client are saved, the analysis time can be saved, and the analysis, execution and application speeds are integrally improved.

In another optional embodiment, the server or the client may determine a file parsing manner and a file parsing range, and parse the to-be-processed file according to the file parsing manner and the file parsing range by using the file parsing object to obtain the to-be-parsed data. FIG. 4 is a flowchart illustrating a file parsing method according to an example embodiment, as shown in FIG. 4, including:

in step S401, a file parsing method of the file to be processed is determined.

In an alternative embodiment, as mentioned above, the execution information may further include file processing information for instructing the server or the client how to parse the file to be processed. If the file processing information includes a file parsing method for the file, the server or the client may determine the parsing method as the file parsing method.

For example, when the file to be processed is a file in a table format, the server or the client may determine, from the file processing information, that the file parsing manner is a one-row one-line parsing manner, a multiple-row multiple-line parsing manner, a one-column parsing manner, or a multiple-column parsing manner. When the file to be processed is a file in a text form, the server or the client can determine the file analysis mode from the file processing information as a one-line analysis mode, a multi-line analysis mode, a one-page analysis mode or a multi-page analysis mode.

If the file processing information does not include an analysis mode for the file, in an optional embodiment, the server or the client may randomly select an analysis mode, for example, when the file to be processed is a file in a table format, the file analysis mode is a one-row one-line analysis mode, a multiple-row analysis mode, a one-column analysis mode, or a multiple-column analysis mode. When the document to be processed is a text document, the document analysis mode is a one-line analysis mode, a multi-line and multi-line analysis mode, a one-page analysis mode or a multi-page and multi-page analysis mode.

In another alternative embodiment, the server or the client may determine the file parsing manner of the file to be processed based on the file to be processed and the attribute information of the server or the client itself.

Fig. 5 is a flowchart illustrating a method for determining a file parsing method according to an exemplary embodiment, where as shown in fig. 5, the method includes:

in step S501, the file capacity of the currently acquired file is determined; the currently acquired files include files to be processed.

In this embodiment, the server may alternatively determine the file capacity of the currently acquired file. The currently acquired files can include files uploaded by other clients besides the files to be processed. That is, when the server determines the file parsing manner of the file to be processed, it needs to determine the total file capacity of the file to be processed uploaded by all the different clients currently.

In this embodiment of the application, when the client determines the file capacity of the currently acquired file, optionally, the currently acquired file may only include the file to be processed. Optionally, the currently acquired file may include other files uploaded by the client, in addition to the file to be processed.

In step S503, the currently executable memory is determined.

In addition, the server may also determine the current operational memory of the server. Similarly, the client determines the current executable memory of the client.

In step S505, a file parsing manner of the file to be processed is determined based on the file capacity of the currently acquired file and the currently operable memory.

Thus, the server or the client can determine the file analysis mode of the file to be processed based on the file capacity of the currently acquired file and the currently operable memory. For example, when the file to be processed is a file in a table format, the file parsing manner is a one-row one-line parsing manner, a multiple-row parsing manner, a one-column parsing manner, or a multiple-column parsing manner. For example, if the file capacity of the currently acquired file is larger than the preset copper beam and the currently operable memory is smaller than the preset memory, a line-by-line parsing manner may be used.

When the document to be processed is a text document, the document analysis mode is a one-line analysis mode, a multi-line and multi-line analysis mode, a one-page analysis mode or a multi-page and multi-page analysis mode.

Optionally, the attribute information may include information about the central processing unit, such as whether the central processing unit is single-core or dual-core, in addition to the currently executable memory.

In step S403, when the file processing information includes a file parsing range for the file, the file to be processed is parsed by using the file parsing object according to the file parsing manner and the file parsing range, so as to obtain data to be parsed.

The server or the client can determine the file parsing range because data which is not needed to be used subsequently may exist in the file to be processed. If the file processing information includes a file analysis range for the file, the server or the client may analyze the file to be processed according to the file analysis mode and the file analysis range by using the file analysis object, so as to obtain data to be analyzed. The file analysis range may be some rows or some columns in the file in the form of a table, and the file analysis range may be some pages or some rows in the file in the form of a character.

In step S2053, a data analysis object is determined based on the data type of the data to be analyzed.

In the embodiment of the application, the server or the client may determine the data parsing object based on the data type of the data to be parsed.

Optionally, the data type of the data to be analyzed may include numeric data, character data (including chinese characters, english letters, and spaces), character string data, url link data, mailbox data, date data, time data, and the like.

In the embodiment of the application, after the server or the client acquires the data type of the data to be analyzed, the data analysis object can be determined according to the data type. For example, assuming that the data type is character type data, the data analysis object may be determined to be a character analysis processor, assuming that the data type is digital type data, the data analysis object may be determined to be a digital analysis processor, assuming that the data type is mailbox type data, the data analysis object may be determined to be a mailbox analysis processor, and so on.

In step S2054, the data to be analyzed is analyzed by using the data analysis object, so as to obtain the data to be processed.

After the server or the client determines the required data analysis object, the data analysis object can be called from the file template configuration module to analyze the data to be analyzed, so as to obtain the data to be processed. At this point, the server or the client completes the preparation work before data processing.

In the embodiment of the present application, the data processing information may correspond to information of a plurality of processing manners, such as data cleaning, data conversion, data integration, data grouping, and the like.

In an optional embodiment, when the data processing information includes data cleansing information, the server or the client may perform cleansing processing on the data to be processed according to the data cleansing information to obtain application data. For example, the data to be processed is a plurality of operation information, and each operation information is provided with time stamp information. If the data cleansing information is "before XXX time", the server may cleanse the plurality of operation information, and cleanse the operation information having the timestamp information before "XXX time".

In an optional embodiment, when the data processing information includes data conversion information, the server or the client may perform conversion processing on the data to be processed according to the data conversion information to obtain application data. For example, the data to be processed is time data in a first form, if the data conversion information is time data in a second form, the server or the client may convert the time data in the first form into the time data in the second form according to the data conversion information, and the obtained time data in the second form is application data.

In an optional embodiment, when the data processing information includes data integration information, the server or the client may perform integration processing on the data to be processed according to the data integration information to obtain the application data. For example, the data to be processed is a plurality of resource allocation information, where each resource allocation information carries an allocation object identifier. If the data integration information is data for representing the allocation object identifier, the server or the client may integrate a plurality of resource allocation information according to the allocation object identifier, and integrate different resource allocation information belonging to the same allocation object identifier, so that one allocation object identifier corresponds to only one piece of resource allocation information.

In an optional embodiment, when the data processing information includes data grouping information, the server or the client may perform grouping processing on the data to be processed according to the data grouping information to obtain the application data. For example, the data to be processed is a document containing a plurality of words. If the data grouping information is a "period", the server or the client may split the document according to the "period" to obtain a document containing a plurality of texts. Wherein each text comprises a complete sentence.

As can be seen from the above description, the data processing information may include a data processing information, such as data cleansing information, data conversion information, data integration information, or data grouping information. The data processing information may further include a plurality of data processing information, such as data cleansing information and data integration information, and in order to avoid disorder, when the data processing information includes a plurality of data processing information, the included plurality of data processing information may be referred to as sub-data processing information, that is, the data processing information includes a plurality of data processing information, such as two sub-data processing information including data cleansing information and data integration information.

In step S207, the application data corresponding to the at least one piece of data processing information is sent to the application object in the data application information.

Optionally, the server or the client may analyze the data application information to obtain the data application instruction and the data application object, and then may perform downlink application on the application object based on the data application instruction.

Optionally, the server or the client may analyze the data application information to obtain a data storage instruction and a data storage object. In this way, the client or the server may transmit the application data to the data storage object (local storage, cloud storage) for storage based on the data storage instruction.

Optionally, the server or the client may analyze the data application information to obtain a data distribution instruction and a data distribution object. In this manner, the client or the server can distribute the application data to consumers subscribing to the application data, i.e., data distribution objects, based on the data distribution instructions. Optionally, the data distribution time may be analyzed, and thus, the client or the server may distribute the application data to the consumers subscribing to the application data at the data distribution time based on the data distribution instruction.

In this embodiment of the application, based on the execution sequence and the execution correlation, the server or the client performs parallel or serial processing on the file to be processed by using the at least one piece of data processing information to obtain application data corresponding to the at least one piece of data processing information, and sends the application data corresponding to the at least one piece of data processing information to an application object in the data application information, which may be expressed as:

in a first alternative embodiment it is possible that the client or the server may determine the data processing information and the data application information belonging to one execution chain based on an identification of an execution dependency of the at least one data processing information and an identification of an execution dependency of the at least one data application information. If a plurality of execution chains exist, the data to be processed in the plurality of execution chains can be processed in parallel.

Specifically, in the embodiment that the data to be processed in the multiple execution chains are processed in parallel, the execution position on each execution chain may be determined according to the identifier of the execution sequence of the data processing information and the identifier of the execution sequence of the data application information in each execution chain, which is actually the execution sequence of the data processing information and the data application information on the corresponding execution chain. Subsequently, the server or the client may process the data to be processed by using the data processing information according to the execution sequence to obtain the application data, and send the application data to the application object in the data application information. For example, in each execution chain, when the execution position of the data processing information is in front of the execution position of the data application information, in the same time period, the data processing information in each execution chain is used to process the file to be processed, so as to obtain the application data corresponding to each execution chain, and the application data corresponding to each execution chain is sent to the application object in the corresponding execution chain and the data application information.

For example, the execution information may include two data processing information and two data application information, where the execution order of the first data processing information is denoted by 1, and the execution correlation is denoted by a; the execution sequence of the second data processing information is marked as 1, and the execution correlation is marked as B; the identification of the execution sequence of the first data application information is 2, and the identification of the execution correlation is A; the execution order of the second data application information is denoted by 2 and the execution correlation is denoted by B. The client or the server may determine that the first data processing information and the first data application information are related based on the identity a of the same execution correlation, and the first data processing information and the first data application information belong to the first execution chain. Similarly, the client or the server may determine that the second data processing information and the second data application information are related based on the identification B of the same execution correlation, and then the second data processing information and the second data application information belong to the second execution chain.

Then, the server or the client may perform data processing corresponding to the first data processing information on the data to be processed in the file to be processed first to obtain first application data based on the determination of the execution sequence identifier of the first data processing information being 1, the execution sequence identifier of the first data application information being 2, and the front-back sequence represented by the identifiers, and then send the first application data to the first application object corresponding to the first data application information. In the same time period, the server or the client may perform data processing corresponding to the second data processing information on the data to be processed in the file to be processed to obtain second application data, and then send the second application data to a second application object corresponding to the second data application information.

For example, the data to be processed is a plurality of operation information, and each operation information is provided with time stamp information and an operation object identifier. When the first data processing information includes data cleansing information and the data cleansing information is "before XXX", the first data application information includes data storage instructions and data storage objects. The server or the client can wash a plurality of pieces of operation information, and wash away operation information with timestamp information before "XXX time" to obtain the first application data. Subsequently, the server or the client may transmit the first application data to a data storage object (local storage, cloud storage) for storage based on the data storage instruction.

Meanwhile, when the second data processing information includes data integration information for data indicating an operation object identification, and the second data application information includes a data distribution instruction and a data distribution object. The server or the client can integrate a plurality of operation information according to the distribution object identifier, and integrate different operation information belonging to the same operation object identifier, so that one operation object identifier only has one operation information, and thus, second application data is obtained. Subsequently, the server or the client may distribute the second application data to consumers subscribing to the second application data, i.e. data distribution objects, based on the data distribution instructions.

In this way, it is achieved that the processing is performed in series on each execution chain, but in parallel on different execution chains. The method comprises the steps of processing data to be processed by a first data processing information processor, processing data to be processed by a second data processing information processor, sending data to be processed by a first data application information processor, sending data to be processed by a second data application information processor, and sending data to be processed by the second data application information processor.

In a second alternative embodiment, the client or the server may determine the data processing information and the data application information belonging to one execution chain based on an identification of an execution dependency of the at least one data processing information and an identification of an execution dependency of the at least one data application information. If there is one execution chain, the data to be processed in one execution chain can be processed serially.

Specifically, when there is one execution chain, the server or the client determines the execution position on the execution chain based on the identification of the execution sequence of the data processing information and the identification of the execution sequence of the data application information in the execution chain, which is actually the execution sequence of the data processing information and the data application information on the execution chain. Subsequently, the server or the client may process the data to be processed by using the data processing information according to the execution sequence to obtain the application data, and send the application data to the application object in the data application information. For example, if the execution position of the data processing information is in front of the execution position of the data application information, the file to be processed may be processed by using the data processing information to obtain application data; and sending the application data to an application object in the data application information in the execution chain.

For example, the execution information may include a data processing information and a data application information, where the execution order of the data processing information is denoted by 1 and the execution correlation is denoted by a. The execution order of the data application information is denoted by 2 and the execution correlation is denoted by a. The client or the server may determine that the data processing information and the data application information are related and belong to the same execution chain based on the identity a of the same execution correlation.

Subsequently, the server or the client may determine, based on the identifier 1 of the execution sequence of the data processing information, the identifier 2 of the execution sequence of the data application information, and the front-back sequence of the identifier representation, to perform data processing corresponding to the data processing information on the to-be-processed data in the to-be-processed file first, so as to obtain application data, and then send the application data to the application object in the data application information.

For example, the execution information may include two data processing information and two data application information, where the execution order of the first data processing information is denoted by 1, and the execution correlation is denoted by a; the execution sequence of the second data processing information is marked as 3, and the execution correlation is marked as A; the identification of the execution sequence of the first data application information is 2, and the identification of the execution correlation is A; the execution order of the second data application information is denoted 4 and the execution dependency is denoted a. The client or the server may determine that the two data processing information and the two data application information are related and belong to the same execution chain based on the same execution correlation identifier a.

Then, the server or the client may perform data processing corresponding to the first data processing information on the to-be-processed data in the to-be-processed file to obtain first application data, and then send the first application data to a first application object corresponding to the first data application information, based on that the identifier of the execution sequence of the first data processing information is 1, the identifier of the execution sequence of the second data processing information is 3, the identifier of the execution sequence of the first data application information is 2, the identifier of the execution sequence of the second data application information is 4, and the front-back sequence represented by the identifiers is determined. Subsequently, feedback data fed back by the first application object may be received. And performing data processing corresponding to second data processing information on the feedback data to obtain second application data, and then sending the second application data to a second application object corresponding to the second data application information.

For example, the data to be processed is a plurality of resource allocation information, where each resource allocation information includes a resource quantity, an allocation object identifier (resource allocation account), and a mailbox corresponding to the allocation object identifier. When the first data processing information includes data integration information and the data integration information is data used for representing the distribution object identifier, the server or the client may integrate multiple resource distribution information according to the distribution object identifier and integrate different resource distribution information belonging to the same distribution object identifier, so that one distribution object identifier corresponds to only one piece of resource distribution information to obtain the first application data. Each allocation object identifier in the first application data corresponds to one resource.

Then, the server or the client acquires first data application information, wherein the first data application information comprises a data distribution instruction and a distribution object identifier, the data distribution instruction comprises an identifier of a distribution module, and the distribution object identifier is used for indicating a data distribution object.

In the actual implementation process, the server or the client may invoke the allocation module, and control the allocation module to allocate resources to the data allocation object corresponding to the allocation object identifier according to the resource quantity corresponding to each allocation object identifier. In addition, the server or the client may further instruct the allocation module to send feedback data of successful allocation to the client or the server after the allocation corresponding to each data allocation object is completed.

On this basis, the server or the client may allocate the feedback data returned by each data allocation object.

Optionally, the second data processing information may generate the feedback data and/or the data to be processed to obtain second application data. Optionally, the feedback data may include allocation time of successful allocation, and the server or the client may generate the body content of the email including the allocation time based on the allocation time, and add the body content of the email to the integrated resource allocation information corresponding to each allocation object identifier.

Optionally, the server or the client may generate the body content of the email based on the number of resources, and add the body content of the email to the integrated resource allocation information corresponding to each allocation object identifier. Optionally, the server or the client may generate the body content of the email based on the allocation time and the resource amount, and add the body content to the integrated resource allocation information corresponding to each allocation object identifier. Thus, the second application data, namely the mail text content, is obtained.

Then, the server or the client acquires the second data application information. The second data application information comprises a mail sending instruction and a mail sending object, and the mail sending object is used for indicating a mailbox corresponding to the distribution object identifier. Subsequently, the server or the client may call the mail module, and control the mail module to send the mail body content corresponding to each allocation object identifier to the mailbox corresponding to each allocation object identifier.

Of course, the above example indicates an alternative embodiment, in an actual process, one execution chain may include multiple pieces of data processing information and multiple pieces of data application information, where the execution positions of the data processing information and the data application information on the execution chain may be arbitrary and logical, for example, the execution positions may be: first data processing information-second data processing information-first data application information-second data application information; or first data application information-first data processing information-second data application information.

In summary, the embodiment of the application can decompose the file processing flow and realize the unitization of flow processing, so that the decoupling is performed among all processing processes, the aim of reusability is realized, and the iteration performance and the maintainability of the application are improved.

Meanwhile, the tasks on each execution chain are separated through the execution sequence and the execution correlation, the processing can be carried out in parallel, the processing and application time of the equipment is shortened, and the execution efficiency of the equipment is improved.

FIG. 6 is a block diagram illustrating a data processing apparatus according to an example embodiment. Referring to fig. 6, the apparatus includes:

a file information obtaining module 601 configured to perform obtaining of a file to be processed and execution information;

an execution information determination module 602 configured to determine an execution order and execution correlation of the at least one data processing information and the at least one data application information in case that the execution information includes the at least one data processing information and the at least one data application information;

the data processing application module 603 is configured to execute parallel or serial processing on the file to be processed by using the at least one piece of data processing information based on the execution sequence and the execution correlation, so as to obtain application data corresponding to the at least one piece of data processing information; and sending the application data corresponding to the at least one piece of data processing information to the application object in the data application information.

determining a file analysis mode of a file to be processed;

determining a current operable memory;

and when the file processing information comprises a file analysis range aiming at the file, analyzing the file to be processed by utilizing the file analysis object according to the file analysis range to obtain data to be analyzed.

and/or;

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

Fig. 7 is a block diagram illustrating an apparatus 2000 for data processing in accordance with an example embodiment. For example, the apparatus 2000 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.

Referring to fig. 7, the apparatus 2000 may include one or more of the following components: a processing component 2002, a memory 2004, a power component 2006, a multimedia component 2008, an audio component 2010, an input/output (I/O) interface 2012, a sensor component 2014, and a communications component 2016.

The processing component 2002 generally controls the overall operation of the device 2000, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 2002 may include one or more processors 2020 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 2002 can include one or more modules that facilitate interaction between the processing component 2002 and other components. For example, the processing component 2002 may include a multimedia module to facilitate interaction between the multimedia component 2008 and the processing component 2002.

The memory 2004 is configured to store various types of data to support operation at the device 2000. Examples of such data include instructions for any application or method operating on device 2000, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 2004 may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The power supply component 2006 provides power to the various components of the device 2000. The power supply components 2006 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 2000.

The multimedia component 2008 includes a screen providing an output interface between the device 2000 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 2008 includes a front camera and/or a rear camera. The front-facing camera and/or the rear-facing camera may receive external multimedia data when the device 2000 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

Audio component 2010 is configured to output and/or input audio signals. For example, audio component 2010 includes a Microphone (MIC) configured to receive external audio signals when apparatus 2000 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 2004 or transmitted via the communication component 2016. In some embodiments, audio assembly 2010 also includes a speaker for outputting audio signals.

The I/O interface 2012 provides an interface between the processing component 2002 and peripheral interface modules, which can be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 2014 includes one or more sensors for providing various aspects of state assessment for the device 2000. For example, sensor assembly 2014 may detect an open/closed state of device 2000, a relative positioning of components, such as a display and keypad of apparatus 2000, a change in position of apparatus 2000 or a component of apparatus 2000, the presence or absence of user contact with apparatus 2000, an orientation or acceleration/deceleration of apparatus 2000, and a change in temperature of apparatus 2000. The sensor assembly 2014 may include a proximity sensor configured to detect the presence of a nearby object in the absence of any physical contact. The sensor assembly 2014 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 2014 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 2016 is configured to facilitate wired or wireless communication between the apparatus 2000 and other devices. The apparatus 2000 may access a wireless network based on a communication standard, such as WiFi, an operator network (such as 2G, 3G, 4G, or 5G), or a combination thereof. In an exemplary embodiment, the communication component 2016 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 2016 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 2000 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a storage medium comprising instructions, such as the memory 2004 comprising instructions, executable by the processor 2020 of the apparatus 2000 to perform the above-described method is also provided. Alternatively, the storage medium may be a non-transitory computer readable storage medium, which may be, for example, a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

Claims

1. A data processing method, comprising:

acquiring a file to be processed and execution information;

based on the execution sequence and the execution correlation, performing parallel or serial processing on the file to be processed by using the at least one piece of data processing information to obtain application data corresponding to the at least one piece of data processing information;

2. The data processing method according to claim 1, wherein the performing parallel or serial processing on the file to be processed by using the at least one piece of data processing information to obtain the application data corresponding to the at least one piece of data processing information comprises:

and performing parallel or serial processing on the data to be processed by using the at least one piece of data processing information to obtain application data corresponding to the at least one piece of data processing information.

3. The data processing method according to claim 2, wherein the parsing the file to be processed by using the parsing object corresponding to the file to be processed to obtain the data to be processed comprises:

4. The data processing method according to claim 3, wherein the parsing the file to be processed by using the file parsing object to obtain data to be parsed comprises:

determining a file analysis mode of the file to be processed;

and analyzing the file to be processed by using the file analysis object according to the file analysis mode to obtain data to be analyzed.

5. The data processing method of claim 4, wherein the determining a file parsing manner of the file to be processed comprises:

determining the file capacity of the currently acquired file; the currently acquired file comprises the file to be processed;

determining a current operable memory;

6. The data processing method according to claim 3, wherein the execution information includes file processing information, and the parsing the file to be processed by using the file parsing object to obtain the data to be parsed includes:

and when the file processing information comprises a file analysis range aiming at the file, analyzing the file to be processed by using the file analysis object according to the file analysis range to obtain data to be analyzed.

7. A data processing apparatus, comprising:

an execution information determination module configured to perform determining an execution order and an execution correlation of at least one data processing information and at least one data application information in a case where the execution information includes the at least one data processing information and the at least one data application information;

the data processing application module is configured to execute parallel or serial processing on the file to be processed by using the at least one piece of data processing information based on the execution sequence and the execution correlation to obtain application data corresponding to the at least one piece of data processing information; and sending the application data corresponding to the at least one piece of data processing information to the application object in the data application information.

8. An electronic device, comprising:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the data processing method of any one of claims 1 to 6.

9. A computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the data processing method of any of claims 1 to 6.

10. A computer program product, characterized in that the computer program product comprises a computer program, which is stored in a readable storage medium, from which at least one processor of a computer device reads and executes the computer program, causing the computer device to perform the data processing method according to any one of claims 1 to 6.