WO2023065937A1

WO2023065937A1 - Data processing method and apparatus, and readable medium and electronic device

Info

Publication number: WO2023065937A1
Application number: PCT/CN2022/120087
Authority: WO
Inventors: 龙跃; 高官涛; 郭俊
Original assignee: 北京火山引擎科技有限公司
Priority date: 2021-10-22
Filing date: 2022-09-21
Publication date: 2023-04-27
Also published as: CN113971192A

Abstract

The present disclosure relates to a data processing method and apparatus, and a readable medium and an electronic device, wherein the method is applied to a first application program. The method comprises: in response to receiving a data processing instruction, acquiring first target data to be processed; determining whether the first application program can execute a target processing policy on the first target data; when it is determined that the first application program cannot execute the target processing policy on the first target data, determining a second application program, which can execute the target processing policy, wherein the encoding mode of the second application program is different from that of the first application program; converting the first target data into second target data according to a first data format in which the second application program can perform processing; and executing the target processing policy on the second target data by means of the second application program. In this way, a first application program and a second application program can be used interchangeably without re-defining a framework, such that the difficulty in implementation is reduced.

Description

Data processing method, device, readable medium and electronic device

Cross References to Related Applications

This application is based on the Chinese patent application with the application number 202111234197.1, the filing date is October 22, 2021, and the title is "data processing method, device, readable medium and electronic equipment", and claims the priority of the Chinese patent application, The entire content of this Chinese patent application is hereby incorporated by reference into this application.

technical field

The present disclosure relates to the field of computer technology, and in particular, to a data processing method, device, readable medium, and electronic equipment.

Background technique

With the development of big data technology, a variety of query engines based on big data have emerged. For example, query engine Hive, query engine Presto, query engine Spark, query engine Impala. These query engines have powerful query functions and provide rich UDF (User Defined function, user-defined function). However, different query engines support UDFs differently, and it is difficult to use them universally.

In related technologies, by defining a new UDF framework, a user rewrites a set of UDFs in the new framework to meet the grammatical requirements of different query engines. However, this method requires a large amount of work, which makes it difficult to implement.

Contents of the invention

This Summary is provided to introduce a simplified form of concepts that are described in detail later in the Detailed Description. This summary of the invention is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to be used to limit the scope of the claimed technical solution.

In a first aspect, the present disclosure provides a data processing method applied to a first application program, the method comprising:

acquiring first target data to be processed in response to receiving a data processing instruction, the data processing instruction being used to instruct execution of a target processing policy on the first target data;

determining whether the first application is capable of executing the target processing policy on the first target data;

In a case where it is determined that the first application program cannot execute the target processing policy on the first target data, determining a second application program capable of executing the target processing policy, the second application program being identical to the first application program An application is coded differently;

converting the first target data into second target data according to a first data format capable of being processed by the second application;

The target processing policy is executed on the second target data by the second application.

In a second aspect, the present disclosure provides a data processing device applied to a first application program, the device comprising:

A data acquisition module, configured to acquire first target data to be processed in response to receiving a data processing instruction, where the data processing instruction is used to instruct execution of a target processing policy on the first target data;

an execution determining module, configured to determine whether the first application program can execute the target processing policy on the first target data;

An application program determining module, configured to determine a second application program capable of executing the target processing policy when it is determined that the first application program cannot execute the target processing policy on the first target data, the first application program The encoding method of the second application program is different from that of the first application program;

a first format conversion module, configured to convert the first target data into second target data according to a first data format that can be processed by the second application program;

A policy execution module, configured to execute the target processing policy on the second target data through the second application program.

In a third aspect, the present disclosure provides a computer-readable medium on which a computer program is stored, and when the program is executed by a processing device, the steps of the method described in the first aspect of the present disclosure are implemented.

In a fourth aspect, the present disclosure provides an electronic device, including:

a storage device on which a computer program is stored;

A processing device configured to execute the computer program in the storage device to implement the steps of the method described in the first aspect of the present disclosure.

Through the above technical solution, in response to receiving a data processing instruction, the first target data to be processed is obtained, and the data processing instruction is used to instruct to execute a target processing policy on the first target data; determine whether the first application program capable of executing the target processing policy on the first target data; in a case where it is determined that the first application cannot execute the target processing policy on the first target data, determine that the target processing policy can be executed A second application program, the encoding method of the second application program is different from that of the first application program; according to the first data format that the second application program can process, the first target data is converted into a second target data; executing the target processing policy on the second target data by the second application program. That is to say, in the case that the first application program cannot execute the target processing policy on the first target data, according to the first data format that the second application program can process, the format conversion is performed on the first target data to obtain the second target data, The target processing strategy is executed on the second target data through the second application program, so that the mutual commonality between the first application program and the second application program can be realized without redefining the framework, and the implementation difficulty is reduced.

Other features and advantages of the present disclosure will be described in detail in the detailed description that follows.

Description of drawings

The above and other features, advantages and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic and that elements and elements are not necessarily drawn to scale. In the attached picture:

Fig. 1 is a flowchart of a data processing method shown according to an exemplary embodiment;

Fig. 2 is a flow chart showing another data processing method according to an exemplary embodiment;

Fig. 3 is a block diagram of a data processing device according to an exemplary embodiment;

Fig. 4 is a block diagram of a second data processing device according to an exemplary embodiment;

Fig. 5 is a block diagram of a third data processing device according to an exemplary embodiment;

Fig. 6 is a block diagram of a fourth data processing device according to an exemplary embodiment;

Fig. 7 is a block diagram of an electronic device according to an exemplary embodiment.

Detailed ways

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the drawings, it should be understood that the disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein; A more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for exemplary purposes only, and are not intended to limit the protection scope of the present disclosure.

It should be understood that the various steps described in the method implementations of the present disclosure may be executed in different orders, and/or executed in parallel. Additionally, method embodiments may include additional steps and/or omit performing illustrated steps. The scope of the present disclosure is not limited in this respect.

As used herein, the term "comprise" and its variations are open-ended, ie "including but not limited to". The term "based on" is "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one further embodiment"; the term "some embodiments" means "at least some embodiments." Relevant definitions of other terms will be given in the description below.

It should be noted that concepts such as "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the sequence of functions performed by these devices, modules or units or interdependence.

It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative and not restrictive, and those skilled in the art should understand that unless the context clearly indicates otherwise, it should be understood as "one or more" multiple".

The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are used for illustrative purposes only, and are not used to limit the scope of these messages or information.

First, the application scenarios of the present disclosure are described. The UDF function allows users to define their own functions in the query, instead of just using the system preset functions, which greatly improves the user query experience and expands the query function of the query engine. However, different query engines support UDFs differently, and it is difficult to use them universally. This non-universality makes it difficult for users to reuse their queries between multiple query engines, and even needs to maintain multiple versions of UDF. Although some query engines support the ability to run other query engine UDFs (for example, Spark supports running Hive UDF), this is due to their similar syntax. Presto's UDF is an annotation type definition, which is quite different from Hive UDF.

Due to historical reasons, Hive was born earlier and widely used. Most companies in the industry have used Hive extensively, and a large number of Hive UDFs play an important role in the production environment. Therefore, how to support Hive UDF in Presto is a technical problem, which also greatly affects the scalability and versatility of the Presto query engine.

In related technologies, by defining a new UDF framework, a user rewrites a set of UDFs in the new framework to meet the grammatical requirements of different query engines. However, this method requires a large amount of work, and users need to be familiar with the new framework syntax and rewrite existing UDFs into UDFs under the new framework, which makes implementation more difficult and less feasible.

In order to solve the above-mentioned technical problems, the present disclosure provides a data processing method, device, readable medium, and electronic device. When the first application program cannot execute the target processing policy on the first target data, the second application program can process of the first data format, convert the first target data to obtain the second target data, and execute the target processing strategy on the second target data through the second application program. In this way, the first application program and the The second application programs are common to each other, which reduces the difficulty of implementation.

The present disclosure will be described below in combination with specific embodiments.

Fig. 1 is a flow chart of a data processing method shown according to an exemplary embodiment, the method is applied to a first application program, and the first application program may be a data query tool, such as a Presto query engine, or may be a data processing tool, which is not limited in the present disclosure. In the embodiment of the present disclosure, the first application program is used as an example for illustration; the method may include:

S101. Acquire first target data to be processed in response to receiving a data processing instruction.

Wherein, the data processing instruction may be used to instruct to execute the target processing policy on the first target data, for example, the data processing instruction may be a SQL (Structured Query Language, Structured Query Language) statement.

In this step, after receiving the data processing instruction triggered by the user, the first target data to be processed may be acquired according to the data processing instruction. Exemplarily, if the data processing instruction is an SQL statement, the first target data can be obtained from a preset database according to the SQL statement, for example, in the case where the SQL statement is "select avg(col) from table" , the first target data may be each row of data in the table.

S102. Determine whether the first application program can execute the target processing policy on the first target data.

In this step, after the first target data is acquired, the target processing strategy to be executed on the first target data can be determined according to the data processing instruction. For example, continue to use the data processing instruction as "select avg(col) from table” for description, then the target processing strategy is averaging. Further, after the target processing policy is determined, it may be determined whether the first application program can execute the target processing policy on the first target data.

In a possible implementation manner, it may be determined whether the first application program includes a first objective function, and the first objective function is used to execute the target processing strategy. After determining that the first application program includes the first objective function, In this case, it is determined that the first application program can execute the target processing policy; when it is determined that the first application program does not include the first target function, it is determined that the first application program cannot execute the target processing policy. As an example, continue to use the data processing instruction as "select avg (col) from table" for description, the first objective function may be a function of obtaining the average value, and the first application program includes the function of obtaining the average value In some cases, it may be determined that the first application program can execute the target processing strategy, and in a case where it is determined that the first application program does not include a function for obtaining an average value, it may be determined that the first application program cannot execute the target processing strategy.

S103. In a case where it is determined that the first application program cannot execute the target processing policy on the first target data, determine a second application program capable of executing the target processing policy.

Wherein, the encoding method of the second application program may be different from that of the first application program. For example, if the first application program is a Presto query engine, then the second application program may be a Hive query engine.

In this step, when it is determined that the first application program cannot execute the target processing strategy for the first target data, a second application program capable of executing the target processing strategy may be determined from a plurality of preset application programs, Wherein, the plurality of preset applications may be applications with the same functions as the first application but with different coding methods. For example, if the first application is the Presto query engine, the preset applications may be existing Other query engines are available. It should be noted that, in a case where the preset application program includes one application program, the preset application program may be used as the second application program.

S104. Convert the first target data into second target data according to the first data format that can be processed by the second application program.

In this step, the coding method of the second application program is different from that of the first application program, and the second application program cannot directly execute the target processing strategy on the first target data. After determining that the target processing strategy can be executed After the second application program, the first data format that the second application program can process can be obtained. For example, continue to use the data processing instruction as "select avg(col) from table" for illustration, the second application program can The type corresponding to the parameter of the function used to obtain the average value is used as the first data format, and then the first target data can be converted into the second target data according to the first data format.

S105. Execute the target processing policy on the second target data through the second application program.

In this step, after converting the first target data into the second target data, the corresponding function in the second application program can be called to execute the target processing strategy on the second target data.

Further, after executing the target processing policy on the second target data through the second application program, the first processing result may be converted into a second processing result according to the second data format that the first application program can process, And outputting the second processing result, the first processing result is the result of executing the target processing strategy on the second target data through the second application program.

Using the above method, in the case that the first application program cannot execute the target processing policy on the first target data, according to the first data format that the second application program can process, the format conversion of the first target data is performed to obtain the second target data, The target processing strategy is executed on the second target data through the second application program, so that the mutual commonality between the first application program and the second application program can be realized without redefining the framework, and the implementation difficulty is reduced.

Fig. 2 is a flowchart of another data processing method shown according to an exemplary embodiment, the method may include:

S201. Acquire first target data to be processed in response to receiving a data processing instruction.

S202. Determine whether the first application program includes the first objective function. If it is determined that the first application program includes the first objective function, perform step S203. After determining that the first application program does not include the first objective function In the case of , execute steps S204 to S208.

Wherein, the first objective function may be used to implement the objective processing strategy.

In this step, after the first target data is acquired, the target processing strategy for the first target data can be determined according to the data processing instruction. For example, if the first application program is a Presto query engine, the data processing If the instruction is an SQL statement, the SQL statement can be parsed to determine the first objective function corresponding to the SQL statement. The first objective function can include multiple. Afterwards, the first objective function can be searched in the built-in functions of the Presto query engine. an objective function. For example, if the SQL statement is "select avg(col) from table", it can be determined that the first objective function is the function for obtaining the average value, and then the function for obtaining the average value can be found in the built-in functions of the Presto query engine .

If the first target function is found in the built-in functions of the Presto query engine, it means that the Presto query engine can execute the target processing strategy for the first target data; if it is not found in the built-in functions of the Presto query engine The first objective function means that the Presto query engine cannot execute the objective processing strategy on the first objective data.

S203. Determine that the first application program can execute the target processing policy on the first target data, and execute the target processing policy on the first target data through the first application program.

S204. Determine that the first application program cannot execute the target processing policy on the first target data.

S205. Using a preset application program including the second objective function among the plurality of preset application programs as the second application program.

Wherein, the plurality of preset applications may be applications with the same functions as the first application but with different coding methods. For example, if the first application is the Presto query engine, the preset applications may be existing Other query engines of the art; the second objective function is used to implement the objective processing strategy.

In this step, if it is determined that the first application program cannot execute the target processing strategy for the first target data, it may be searched from a plurality of preset application programs that can execute the target processing strategy for the first target data. of the second application. In a possible implementation manner, the second objective function may be searched in sequence among multiple preset application programs, and the first preset application program including the second objective function is used as the second application program.

It should be noted that, since different preset application programs have different encoding methods, the second objective functions corresponding to different preset application programs may also be different.

S206. Convert the first target data into the second target data according to the first data format that can be processed by the second target function of the second application program.

Wherein, the first data format may be a parameter type of the second objective function.

In this step, after the second application program is determined, the parameter type of the second objective function of the second application program may be determined, and the first objective function is converted into the second objective function according to the parameter type.

In a possible implementation manner, before converting the first target data into the second target data according to the first data format that can be processed by the second target function of the second application program, the first Whether the application program caches the target resource package corresponding to the second target function of the second application program, if it is determined that the first application program caches the target resource package corresponding to the second target function of the second application program, according to the first The second target function of the application program can process the first data format, and convert the first target data into the second target data.

For example, according to the preset resource information corresponding to the second objective function, it may be determined whether the second objective function is cached in the local server corresponding to the first application program, and the local server corresponding to the first application program is cached in the local server corresponding to the first application program. In the case of the second target function, the first target data may be directly converted into the second target data according to the first data format that can be processed by the second target function of the second application program. Wherein, the resource information may include resource address, class name, parameter type, return type, creation time, modification time and so on.

It should be noted that, it may also be determined whether the process of the first application program has loaded the target resource package corresponding to the second target function, when the process of the first application program has loaded the target resource package corresponding to the second target function In this case, it means that the first application caches the target resource bundle corresponding to the second target function.

When it is determined that the first application program does not cache the target resource package corresponding to the second target function of the second application program, the target resource package may be obtained from a server corresponding to the second application program, and the target resource package may be loaded, And after the target resource package is loaded, convert the first target data into the second target data according to the first data format that can be processed by the second target function of the second application program.

For example, according to the preset resource address corresponding to the second target function, the target resource package can be obtained from the server corresponding to the second application program, and the target resource package can be downloaded to the local server corresponding to the first application program, Afterwards, the target resource pack can be loaded through the process of the first application program, and after the target resource pack is loaded, the first target data can be converted into the second target according to the parameter type corresponding to the second target function data.

It should be noted that after the target resource package is loaded, the resource information and version information of the target resource package can be stored. In this way, when it is subsequently determined that the first application program caches the second target function, it can be further processed according to The resource information and version information of the target resource package corresponding to the second target function determine whether a new target resource package needs to be acquired and loaded.

In addition, before converting the first target data into the second target data according to the first data format that can be processed by the second target function of the second application program, the second target function in the second application program can be executed The corresponding initialization method obtains all data types supported by the second target function, and then determines whether the first application program can perform format conversion on the first target data according to the first data format. If the first application program can perform format conversion on the first target data according to the first data format, convert the first target data according to the first data format that can be processed by the second target function of the second application program is the second target data; if the first application program cannot perform format conversion on the first target data according to the first data format, then output abnormal prompt information.

S207. Execute the target processing policy on the second target data by using the second target function.

Wherein, the second target data may include multiple data. For example, if the data processing instruction is "select avg(col) from table", the first target data may be each row of data in the table, and the second target data The data includes data obtained by converting the format of each row of data in the table according to the first data format. The second objective function may include a first function, a second function, and a third function. For example, the second objective function may be a UDAF (User Defined Aggregate Function, user-defined aggregate function).

In this step, after converting the first target data into the second target data, the first function can be called through the first preset function of the first application program, so as to process multiple The second target data is to obtain a plurality of first data; the second function is called through the second preset function of the first application program, so that the plurality of first data is aggregated through the second function to obtain a plurality of first data second data; calling the third function through a third preset function of the first application program, so as to process a plurality of second data through the third function.

For example, the first function may be an iterate function, the second function may be a merge function, and the third function may be a terminate function, and a call to the first function may be added to the first preset function in advance, and the A call to the second function is added to the second preset function, and a call to the third function is added to the third preset function. Wherein, the iterate function may include multiple ones, different iterate functions may run on different servers, and the obtained multiple first data are also located on different servers. When the first application program calls the iterate function, the second target data is used as an input parameter of the iterate function, and the second target data is respectively processed by a plurality of iterate functions to obtain a plurality of first data.

Further, after obtaining a plurality of first data, the merge function may be called through a second preset function, the first data may be used as an input parameter of the merge function, and the plurality of first data may be aggregated through the merge function, That is, sending the first data to the same server to obtain multiple second data. Wherein, the merge function may include multiple, and different merge functions may run on different servers.

Finally, the terminate function is called through the third preset function, the plurality of second data are used as input parameters of the terminate function, and the final processing flow is executed on the plurality of second data through the terminate function.

It should be noted that the above-mentioned first function, second function, and third function are just examples, and the first function, the second function, and the third function may also be functions that execute other strategies, which are not limited in this disclosure . Moreover, the first preset function, the second preset function, and the third preset function may be existing functions in the first application program, or newly added functions in the first application program, This disclosure does not limit it.

S208. Convert the first processing result into a second processing result according to the second data format that can be processed by the first application program, and output the second processing result.

Wherein, the first processing result may be a result of executing the target processing policy on the second target data through the second target function of the second application program.

In this step, after obtaining the first processing result, the type of the return value of the first preset function can be used as the second data format, the first processing result can be converted into the second processing result, and output The second processing result. It should be noted that, after converting the first processing result into the second processing result, subsequent processing procedures may also be executed according to the second processing result, which is not limited in the present disclosure.

Using the above method, in the case that the first application program cannot execute the target processing policy on the first target data, according to the first data format that the second application program can process, the format conversion of the first target data is performed to obtain the second target data, Through the second application program to implement the target processing strategy for the second target data, in this way, without redefining the framework, the mutual commonality between the first application program and the second application program can be realized, which reduces the difficulty of implementation; further, in the first application program In the case that the second target data includes multiple cases, the second target data can be aggregated through multiple functions, so that the mutual use of the UDAF functions in the first application program and the second application program can be realized, expanding the scope of the first application program. The usage scenarios of the first application program and the second application program improve the user experience.

Fig. 3 is a block diagram of a data processing device according to an exemplary embodiment, the device is applied to a first application program, as shown in Fig. 3 , including:

A data acquisition module 301, configured to acquire first target data to be processed in response to receiving a data processing instruction, where the data processing instruction is used to instruct execution of a target processing policy on the first target data;

an execution determining module 302, configured to determine whether the first application program can execute the target processing policy on the first target data;

An application program determining module 303, configured to determine a second application program capable of executing the target processing policy when it is determined that the first application program cannot execute the target processing policy for the first target data, and the second application program is related to the the first application is coded differently;

The first format conversion module 304 is configured to convert the first target data into second target data according to the first data format that the second application program can process;

A policy execution module 305, configured to execute the target processing policy on the second target data through the second application program.

Optionally, the execution determining module 302 is also used to:

determining whether the first application program includes a first objective function for implementing the objective processing policy;

In a case where it is determined that the first application program includes the first target function, determining that the first application program is capable of executing the target processing policy on the first target data;

In a case where it is determined that the first application program does not include the first target function, it is determined that the first application program cannot execute the target processing policy on the first target data.

Optionally, the application program determination module 303 is also used to:

A preset application program including a second objective function among the plurality of preset application programs is used as the second application program, and the second objective function is used to execute the target processing strategy.

Optionally, the first format conversion module 304 is also used for:

converting the first target data into the second target data according to the first data format that can be processed by the second target function of the second application program;

Executing the target processing policy on the second target data through the second application program includes:

The target processing strategy is executed on the second target data by the second target function.

Optionally, FIG. 4 is a block diagram of a second data processing device according to an exemplary embodiment. As shown in FIG. 4 , the device further includes:

A cache determination module 306, configured to determine whether the first application program caches the target resource bundle corresponding to the second target function of the second application program;

The first format conversion module 304 is also used for:

When it is determined that the first application program caches the target resource bundle corresponding to the second target function of the second application program, according to the first data format that the second target function of the second application program can handle, the first The target data is converted into the second target data.

Optionally, FIG. 5 is a block diagram of a third data processing device according to an exemplary embodiment. As shown in FIG. 5 , the device further includes:

A resource package acquiring module 307, configured to acquire the target resource package from the server corresponding to the second application program when it is determined that the first application program has not cached the target resource package corresponding to the second target function of the second application program ;

A resource pack loading module 308, configured to load the target resource pack;

The first format converting module 304 is further configured to convert the first target data into the second target data.

Optionally, the second target data includes multiple, the second target function includes a first function, a second function, and a third function; the policy execution module 305 is also used for:

calling the first function through a first preset function of the first application program, so as to process a plurality of second target data respectively through the first function to obtain a plurality of first data;

calling the second function through the second preset function of the first application program, so as to aggregate the plurality of first data through the second function to obtain a plurality of second data;

calling the third function through a third preset function of the first application program, so as to process a plurality of the second data through the third function.

Optionally, FIG. 6 is a block diagram of a fourth data processing device according to an exemplary embodiment. As shown in FIG. 6, the device further includes:

The second format conversion module 309 is configured to convert the first processing result into a second processing result according to the second data format that the first application program can process, and output the second processing result, and the first processing result is passed A result of the second application executing the target processing policy on the second target data.

With the above device, in the case that the first application program cannot execute the target processing policy on the first target data, the first target data is format-converted according to the first data format that the second application program can process to obtain the second target data, The target processing strategy is executed on the second target data through the second application program, so that the mutual commonality between the first application program and the second application program can be realized without redefining the framework, and the implementation difficulty is reduced.

Referring now to FIG. 7 , it shows a schematic structural diagram of an electronic device 700 suitable for implementing the embodiments of the present disclosure. The terminal equipment in the embodiment of the present disclosure may include but not limited to such as mobile phone, notebook computer, digital broadcast receiver, PDA (personal digital assistant), PAD (tablet computer), PMP (portable multimedia player), vehicle terminal (such as mobile terminals such as car navigation terminals) and fixed terminals such as digital TVs, desktop computers and the like. The electronic device shown in FIG. 7 is only an example, and should not limit the functions and application scope of the embodiments of the present disclosure.

As shown in FIG. 7 , an electronic device 700 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) Various appropriate actions and processes are executed by programs in the memory (RAM) 703 . In the RAM 703, various programs and data necessary for the operation of the electronic device 700 are also stored. The processing device 701, ROM 702, and RAM 703 are connected to each other through a bus 704. An input/output (I/O) interface 705 is also connected to the bus 704 .

Typically, the following devices can be connected to the I/O interface 705: input devices 706 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speaker, vibration an output device 707 such as a computer; a storage device 708 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 709. The communication means 709 may allow the electronic device 700 to communicate with other devices wirelessly or by wire to exchange data. While FIG. 7 shows electronic device 700 having various means, it should be understood that implementing or having all of the means shown is not a requirement. More or fewer means may alternatively be implemented or provided.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product, which includes a computer program carried on a non-transitory computer readable medium, where the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network via communication means 709, or from storage means 708, or from ROM 702. When the computer program is executed by the processing device 701, the above-mentioned functions defined in the methods of the embodiments of the present disclosure are executed.

It should be noted that the above-mentioned computer-readable medium in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. A computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present disclosure, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can transmit, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device . Program code embodied on a computer readable medium may be transmitted by any appropriate medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

In some embodiments, the client and the server can communicate using any currently known or future network protocols such as HTTP (HyperText Transfer Protocol, Hypertext Transfer Protocol), and can communicate with digital data in any form or medium The communication (eg, communication network) interconnections. Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), internetworks (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network of.

The above-mentioned computer-readable medium may be included in the above-mentioned electronic device, or may exist independently without being incorporated into the electronic device.

The above-mentioned computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device: responds to receiving a data processing instruction, acquires the first target data to be processed, so The data processing instruction is used to instruct to execute the target processing policy on the first target data; determine whether the first application program can execute the target processing policy on the first target data; If the target processing policy cannot be executed on the first target data, determine a second application program capable of executing the target processing policy, where the second application program is coded differently from the first application program; Converting the first target data into second target data according to the first data format that the second application program can process; executing the target processing policy on the second target data through the second application program.

Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, or combinations thereof, including but not limited to object-oriented programming languages—such as Java, Smalltalk, C++, and Includes conventional procedural programming languages - such as "C" or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (for example, using an Internet service provider to connected via the Internet).

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, program segment, or portion of code that contains one or more logical functions for implementing specified executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified functions or operations , or may be implemented by a combination of dedicated hardware and computer instructions.

The modules involved in the embodiments described in the present disclosure may be implemented by software or by hardware. Wherein, the name of the module does not constitute a limitation of the module itself under certain circumstances, for example, the data acquisition module may also be described as "a module for acquiring the first target data to be processed".

The functions described herein above may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), System on Chips (SOCs), Complex Programmable Logical device (CPLD) and so on.

In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer discs, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.

According to one or more embodiments of the present disclosure, Example 1 provides a data processing method applied to a first application program, the method comprising: acquiring first target data to be processed in response to receiving a data processing instruction, The data processing instruction is used to instruct to execute the target processing policy on the first target data; determine whether the first application program can execute the target processing policy on the first target data; When the program cannot execute the target processing policy on the first target data, determine a second application program capable of executing the target processing policy, where the second application program is coded differently from the first application program ; convert the first target data into second target data according to the first data format that the second application program can process; execute the target processing policy on the second target data through the second application program .

According to one or more embodiments of the present disclosure, Example 2 provides the method of Example 1, the determining whether the first application program can execute the target processing policy on the first target data includes: determining the first target data Whether an application program includes a first objective function, and the first objective function is used to execute the target processing strategy; when it is determined that the first application program includes the first objective function, determining that the first application program a program capable of executing the target processing policy on the first target data; in a case where it is determined that the first application program does not include the first target function, it is determined that the first application program cannot process the first target data Data enforces the target processing policy.

According to one or more embodiments of the present disclosure, Example 3 provides the method of Example 1, the determining the second application that can execute the target processing strategy includes: including the second target function in a plurality of preset application programs The preset application program is the second application program, and the second objective function is used to execute the target processing policy.

According to one or more embodiments of the present disclosure, Example 4 provides the method of Example 3, converting the first target data into second target data according to the first data format that the second application program can handle including: converting the first target data into the second target data according to the first data format that can be processed by the second target function of the second application program; Executing the target processing policy on the second target data includes: executing the target processing policy on the second target data through the second target function.

According to one or more embodiments of the present disclosure, Example 5 provides the method of Example 4. In the first data format that can be processed by the second objective function of the second application program, the first target data is Before converting to the second target data, the method further includes: determining whether the first application program caches the target resource package corresponding to the second target function of the second application program; A first data format that can be processed by the second object function of the program, converting the first object data into the second object data includes: determining that the first application program caches the second object of the second application program In the case of the target resource package corresponding to the function, the first target data is converted into the second target data according to the first data format that can be processed by the second target function of the second application program.

According to one or more embodiments of the present disclosure, Example 6 provides the method of Example 5, the method further comprising: after determining that the first application program does not cache the target corresponding to the second target function of the second application program In the case of a resource pack, the target resource pack is obtained from the server corresponding to the second application; the target resource pack is loaded; after the target resource pack is loaded, according to the second A first data format that can be processed by the objective function, converting the first objective data into the second objective data.

According to one or more embodiments of the present disclosure, Example 7 provides the method of Example 4, the second target data includes a plurality, and the second target function includes a first function, a second function, and a third function; Executing the target processing strategy on the second target data through the second target function includes: calling the first function through a first preset function of the first application program, so as to use the first function Process a plurality of the second target data respectively to obtain a plurality of first data; call the second function through the second preset function of the first application program, so as to use the second function for the plurality of the Aggregating the first data to obtain a plurality of second data; calling the third function through a third preset function of the first application program, so as to process the plurality of second data through the third function.

According to one or more embodiments of the present disclosure, Example 8 provides the method of any one of Examples 1 to 7, the method further comprising: according to the second data format that the first application program can handle, converting the first A processing result is converted into a second processing result, and the second processing result is output, and the first processing result is a result of executing the target processing policy on the second target data through the second application program.

According to one or more embodiments of the present disclosure, Example 9 provides a data processing device, which is applied to a first application program, and the device includes: a data acquisition module, configured to acquire a data processing instruction to be processed in response to receiving a data processing instruction the first target data, the data processing instruction is used to instruct to execute the target processing policy on the first target data; the execution determining module is used to determine whether the first application program can execute the target processing policy on the first target data The target processing strategy; an application program determination module, configured to determine a second application capable of executing the target processing strategy when it is determined that the first application program cannot execute the target processing strategy for the first target data program, the encoding method of the second application program is different from that of the first application program; the first format conversion module is configured to convert the first target data into the first data format that can be processed by the second application program converted into second target data; a policy execution module, configured to execute the target processing policy on the second target data through the second application program.

According to one or more embodiments of the present disclosure, Example 10 provides a computer-readable medium on which a computer program is stored, and when the program is executed by a processing device, the steps of the method described in any one of Examples 1-8 are implemented. .

According to one or more embodiments of the present disclosure, Example 11 provides an electronic device, including: a storage device on which a computer program is stored; a processing device configured to execute the computer program in the storage device to Implement the steps of the method described in any one of Examples 1-8.

The above description is only a preferred embodiment of the present disclosure and an illustration of the applied technical principles. Those skilled in the art should understand that the disclosure scope involved in this disclosure is not limited to the technical solution formed by the specific combination of the above-mentioned technical features, but also covers the technical solutions formed by the above-mentioned technical features or Other technical solutions formed by any combination of equivalent features. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

In addition, while operations are depicted in a particular order, this should not be understood as requiring that the operations be performed in the particular order shown or performed in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while the above discussion contains several specific implementation details, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims. Regarding the apparatus in the foregoing embodiments, the specific manner in which each module executes operations has been described in detail in the embodiments related to the method, and will not be described in detail here.

Claims

A data processing method, characterized in that it is applied to a first application program, the method comprising:

acquiring first target data to be processed in response to receiving a data processing instruction, the data processing instruction being used to instruct execution of a target processing policy on the first target data;

determining whether the first application is capable of executing the target processing policy on the first target data;

In a case where it is determined that the first application program cannot execute the target processing policy on the first target data, determining a second application program capable of executing the target processing policy, the second application program being identical to the first application program An application is coded differently;

converting the first target data into second target data according to a first data format capable of being processed by the second application;

The target processing policy is executed on the second target data by the second application.
The method according to claim 1, wherein the determining whether the first application program can execute the target processing policy on the first target data comprises:

determining whether the first application program includes a first objective function for implementing the objective processing policy;

determining that the first application is capable of executing the target processing policy on the first target data, if the first application is determined to include the first target function;

In a case where it is determined that the first application program does not include the first target function, it is determined that the first application program cannot execute the target processing policy on the first target data.
The method according to claim 1, wherein the determining the second application program capable of executing the target processing policy comprises:

A preset application program including a second objective function among the plurality of preset application programs is used as the second application program, and the second objective function is used to execute the target processing strategy.
The method according to claim 3, wherein converting the first target data into the second target data according to the first data format that can be processed by the second application program comprises:

converting the first target data into the second target data according to a first data format that can be processed by a second target function of the second application;

The executing the target processing policy on the second target data through the second application program includes:

The target processing strategy is executed on the second target data by the second target function.
The method according to claim 4, characterized in that converting the first object data into the second object in the first data format that can be processed by the second object function of the second application program Before the data, the method also includes:

Determine whether the first application program caches the target resource bundle corresponding to the second target function of the second application program;

The converting the first target data into the second target data according to the first data format that can be processed by the second target function of the second application program includes:

When it is determined that the first application program caches the target resource bundle corresponding to the second target function of the second application program, according to the first data format that the second target function of the second application program can handle, the The first target data is converted into the second target data.
The method according to claim 5, wherein the method further comprises:

When it is determined that the first application program does not cache the target resource package corresponding to the second target function of the second application program, acquiring the target resource package from a server corresponding to the second application program;

Load the target resource bundle;

After the target resource package is loaded, convert the first target data into the second target data according to the first data format that can be processed by the second target function of the second application program.
The method according to claim 4, wherein the second target data includes a plurality, the second target function includes a first function, a second function and a third function; The function executing the target processing policy on the second target data includes:

calling the first function through a first preset function of the first application, so as to process a plurality of second target data respectively through the first function to obtain a plurality of first data;

calling the second function through a second preset function of the first application, so as to aggregate a plurality of first data through the second function to obtain a plurality of second data;

calling the third function through a third preset function of the first application program, so as to process a plurality of the second data through the third function.
The method according to any one of claims 1-7, wherein the method further comprises:

convert the first processing result into a second processing result according to the second data format that the first application program can process, and output the second processing result, the first processing result is passed through the second application program A result of executing the target processing policy on the second target data.
A data processing device, characterized in that it is applied to a first application program, said device comprising:

A data acquisition module, configured to acquire first target data to be processed in response to receiving a data processing instruction, where the data processing instruction is used to instruct execution of a target processing policy on the first target data;

an execution determining module, configured to determine whether the first application program can execute the target processing policy on the first target data;

An application program determining module, configured to determine a second application program capable of executing the target processing policy when it is determined that the first application program cannot execute the target processing policy on the first target data, the first application program The encoding method of the second application program is different from that of the first application program;

a first format conversion module, configured to convert the first target data into second target data according to a first data format that can be processed by the second application program;

A policy execution module, configured to execute the target processing policy on the second target data through the second application program.
A computer-readable medium, on which a computer program is stored, wherein, when the program is executed by a processing device, the steps of the method according to any one of claims 1-8 are realized.
An electronic device, characterized in that it comprises:

a storage device on which a computer program is stored;

A processing device configured to execute the computer program in the storage device to implement the steps of the method according to any one of claims 1-8.