CN116243931A - Data processing method, device, equipment and medium - Google Patents

Data processing method, device, equipment and medium Download PDF

Info

Publication number
CN116243931A
CN116243931A CN202111484616.7A CN202111484616A CN116243931A CN 116243931 A CN116243931 A CN 116243931A CN 202111484616 A CN202111484616 A CN 202111484616A CN 116243931 A CN116243931 A CN 116243931A
Authority
CN
China
Prior art keywords
function
function service
service
script
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111484616.7A
Other languages
Chinese (zh)
Inventor
张莹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jingdong Technology Information Technology Co Ltd
Original Assignee
Jingdong Technology Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jingdong Technology Information Technology Co Ltd filed Critical Jingdong Technology Information Technology Co Ltd
Priority to CN202111484616.7A priority Critical patent/CN116243931A/en
Publication of CN116243931A publication Critical patent/CN116243931A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/60—Software deployment
    • G06F8/61—Installation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/70—Software maintenance or management
    • G06F8/71—Version control; Configuration management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogram communication
    • G06F9/547—Remote procedure calls [RPC]; Web services

Abstract

The disclosure provides a data processing method, a device, equipment and a medium, wherein the method comprises the following steps: when the parameter formats of the upstream and downstream services are converted through the function component, firstly, a function service script, a function service dependency list and a function service configuration in the function component are loaded, the function service script and the function service dependency list are configured based on the parameter formats of the upstream and downstream services, a mirror image interface is called based on the configured function service script and function service dependency list to construct a first mirror image file corresponding to the function service, and the upstream and downstream services are arranged according to the first mirror image file and the function service configuration. Therefore, a mode of connecting upstream and downstream services in series in a function component loading mode can be realized, and a service arrangement flow is started, so that the service arrangement flow is simplified, and the flexibility and applicability of service arrangement are improved.

Description

Data processing method, device, equipment and medium
Technical Field
The disclosure relates to the technical field of artificial intelligence, and in particular relates to a data processing method, device, equipment and medium.
Background
With the development of the field of artificial intelligence (AI, artificial Intelligence), the use of AI capabilities is also rapidly increasing, and the demand for combined use of AI capabilities is gradually increasing. When the AI capability combination is used, different services corresponding to the AI capability combination can be connected in series through the service arrangement engine so as to enrich the using functions.
However, in general, the interface parameter requirements of different AI capabilities are inconsistent, so that parameter conversion needs to be performed between services in order to connect the services in series, and currently, a common method is to manually construct engineering, i.e. code writing is required to process upstream and downstream service data, in this way, repeated work of service arrangement is excessive, and more time is consumed by manual mode.
Disclosure of Invention
The present disclosure aims to solve, at least to some extent, one of the technical problems in the related art.
The present disclosure provides a data processing method, apparatus, device, and medium, in which upstream and downstream services are connected in series in a function component loading manner, and a service scheduling process is started without a hard coding manner, so that the service scheduling process is simplified, and flexibility and applicability of service scheduling are improved.
An embodiment of a first aspect of the present disclosure provides a method for processing data, including:
loading a function component, wherein the function component comprises a function service script, a function service dependency list and a function service configuration;
configuring the function service script and the function service dependency list based on the parameter formats of the upstream and downstream services;
and calling a mirror interface based on the configured function service script and function service dependency list to construct a first mirror file corresponding to the function service, and arranging the upstream and downstream services according to the first mirror file and the function service configuration.
An embodiment of a second aspect of the present disclosure provides a data processing apparatus, including:
the loading module is used for loading the function component, and the function component comprises a function service script, a function service dependency list and a function service configuration;
the configuration module is used for configuring the function service script and the function service dependency list based on the parameter formats of the upstream and downstream services;
the calling module is used for calling the mirror interface based on the configured function service script and the function service dependency list so as to construct a first mirror file corresponding to the function service;
and the arrangement module is used for arranging the upstream and downstream services according to the first image file and the function service configuration.
Embodiments of a third aspect of the present disclosure provide a computer device comprising: the system comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor realizes the data processing method as proposed by the embodiment of the first aspect of the present disclosure when the processor executes the program.
An embodiment of a fourth aspect of the present disclosure proposes a non-transitory computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements a method of processing data as proposed by an embodiment of the first aspect of the present disclosure.
An embodiment of a fifth aspect of the present disclosure proposes a computer program product which, when executed by a processor, performs a method of processing data as proposed by an embodiment of the first aspect of the present disclosure.
One embodiment of the present disclosure described above has at least the following advantages or benefits:
when the parameter formats of the upstream and downstream services are converted through the function component, firstly, a function service script, a function service dependency list and a function service configuration in the function component are loaded, the function service script and the function service dependency list are configured based on the parameter formats of the upstream and downstream services, a mirror image interface is called based on the configured function service script and function service dependency list to construct a first mirror image file corresponding to the function service, and the upstream and downstream services are arranged according to the first mirror image file and the function service configuration. Therefore, a mode of connecting upstream and downstream services in series in a function component loading mode can be realized, and a service arrangement flow is started, so that the service arrangement flow is simplified, and the flexibility and applicability of service arrangement are improved.
Drawings
The foregoing and/or additional aspects and advantages of the present disclosure will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:
FIG. 1 is a flow chart of a method for processing data according to an embodiment of the disclosure;
FIG. 2 is a schematic illustration of service orchestration provided by embodiments of the present disclosure;
fig. 3 is a flow chart of a method for processing data according to a second embodiment of the disclosure;
FIG. 4 is an interface schematic of a function component provided in an embodiment of the present disclosure;
fig. 5 is a flow chart of a method for processing data according to a third embodiment of the disclosure;
fig. 6 is a flow chart of a method for processing data according to a fourth embodiment of the disclosure;
fig. 7 is a schematic structural diagram of a data processing apparatus according to a fifth embodiment of the present disclosure;
FIG. 8 illustrates a block diagram of an exemplary computer device suitable for use in implementing embodiments of the present disclosure.
Detailed Description
Embodiments of the present disclosure are described in detail below, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to like or similar elements or elements having like or similar functions throughout. The embodiments described below by referring to the drawings are exemplary and intended for the purpose of explaining the present disclosure and are not to be construed as limiting the present disclosure.
Data processing methods, devices, apparatuses and media according to embodiments of the present disclosure are described below with reference to the accompanying drawings.
Fig. 1 is a flowchart illustrating a method for processing data according to an embodiment of the disclosure.
The processing method of the data in the embodiment of the disclosure can be applied to a server.
As shown in fig. 1, the data processing method may include the following steps:
step 101, loading a function component, wherein the function component comprises a function service script, a function service dependency list and a function service configuration.
In the disclosed embodiment, the function component supports editing of multiple function languages, such as: python, java, go, and when there is a need for service orchestration, selecting the required functional language to load the functional components. The function component includes a function service script, and a script template of a function language is generally defaulted in a specific application process, and the specific default function language is not limited in this embodiment of the present application.
The function component comprises a function service script, a function service dependency list and a function service configuration, wherein the function service dependency list is a data packet capable of supporting normal operation of the function service script, and provides a better operation environment for the function service script. The function service configuration comprises a target gateway for issuing services, wherein the target gateway is information such as HTTP request address, resource configuration, memory, script path, request mode, port and the like of the target gateway.
In the embodiment of the disclosure, the function service script is written for the template provided based on the OpenFaaS framework, but in practical application, the function service script is not limited to the dependency framework of the function service script, and the function service script can be used as the protection scope of the disclosure.
And 102, configuring the function service script and the function service dependency list based on the parameter formats of the upstream and downstream services.
Since the parameter formats of the respective services in the orchestration service are different, the parameters of the upstream service cannot be directly transferred to the downstream service for use. In the function service script configuration and function service dependency list configuration, the reference object is mainly the parameter format of the downstream service, and the processing result of the upstream service is converted into the parameter format of the downstream service. The function service script plays a role of converting parameters, so that parameter interaction between all services is more flexible and simple.
For example, as an example, the parameter format of the downstream service (in-parameter format) is the average avg, and the parameter format of the upstream service (out-parameter format) is the sum and the sum num, and in this scenario, only the script provided by default needs to be configured as follows:
Figure BDA0003397014760000051
/>
parameter conversion between services can be completed through simple function service script configuration, and similarly, after the function language selected in step 101 is based, when the function component is loaded, the function service dependency list is synchronously loaded.
Step 103, calling a mirror interface based on the configured function service script and function service dependency list to construct a first mirror file corresponding to the function service, and arranging the upstream and downstream services according to the first mirror file and the function service configuration.
In the embodiment of the present disclosure, since the function service script provided by the OpenFaaS framework is a script command, the command line tool is converted into a RESTful API, that is, the mirror interface is called to create the first mirror file based on the function service script, so as to construct the mirror image. After the mirror image construction is completed, the function service corresponding to the function service script is released based on the mirror image, the release process depends on information configured in the function service configuration, and service arrangement and service call among release systems are facilitated after the function service is released.
In order to better understand the application scenario of the embodiments of the present disclosure, it is assumed that, as shown in fig. 2, 5 services are total, where the parameters of service 1, service 2, service 3, service 4 and service 5 are different, and in order to implement flexible conversion of parameters, a function component is added between each service, where the function component can convert the format of an output parameter of an upstream service into the format of an input parameter of a downstream service, and service 1 is illustrated as an example of service 1, the corresponding format of an output parameter of the service 1 is format 1, service 2 is a downstream service, and the corresponding format of an input parameter of the service 2 is format 2.
When the parameter formats of the upstream and downstream services are converted through the function component, firstly, loading a function service script, a function service dependency list and a function service configuration in the function component, configuring the function service script and the function service dependency list based on the parameter formats of the upstream and downstream services, calling a mirror interface based on the configured function service script and function service dependency list to construct a first mirror file corresponding to the function service, and arranging the upstream and downstream services according to the first mirror file and the function service configuration. Therefore, a mode of connecting upstream and downstream services in series in a function component loading mode can be realized, and a service arrangement flow is started, so that the service arrangement flow is simplified, and the flexibility and applicability of service arrangement are improved.
To clearly illustrate how the function components are loaded in the present disclosure, this embodiment provides another method for processing data.
Fig. 3 is a flowchart illustrating a method for processing data according to a second embodiment of the disclosure.
As shown in fig. 3, the data processing method may include the steps of:
step 201, receiving a confirmation instruction of an objective function language used when configuring the function service script.
Referring to fig. 4, fig. 4 is an interface schematic diagram of a function component provided in an embodiment of the present disclosure, when the function component is loaded, first, a relevant person inputs or selects a locally provided target function language for a function service script by a configuration manner, where the target function language is Python in fig. 4, and it should be clear that the manner is not intended to be limiting, and the target function language can only be Python.
Step 202, in response to the confirmation instruction, loading, by the function component, the function service script and the function service dependency list according to the target function language.
After the objective function language is configured, a function service script corresponding to the objective function language and the function service dependency list can be loaded in the background, namely, the objective function language of the script information in fig. 4 is also Python.
In order to clearly illustrate how the upstream and downstream services are arranged according to the first image file and the function service configuration in the present disclosure, another data processing method is provided in this embodiment.
Fig. 5 is a flow chart of a method for processing data according to the third embodiment of the disclosure.
As shown in fig. 5, the processing method of the data may include the steps of:
step 301, pushing a first image file corresponding to the function service to an image warehouse, wherein the image warehouse records the association relation between the first image file and a target gateway in the function service configuration.
Since the script command provided by the Java package OpenFaaS framework is used, the script command needs to be converted into a RESTful API, and please refer to fig. 4, the interface information described in fig. 4 is the RESTful API, and the user needs to provide API configuration (HTTP, header, query, body, etc.), where the HTTP request address of the target gateway is recorded in the function service configuration.
After the configuration of the API interface is completed, a first mirror image file is constructed according to the configuration information of HTTP, header, query, body, the first mirror image file is pushed to a mirror image warehouse, and the association relation between the first mirror image file and the HTTP request address of the target gateway in the function service configuration is recorded in the mirror image warehouse.
Step 302, the function service is issued to the corresponding target gateway so as to arrange the service for completing the upstream and downstream services.
Based on the HTTP request address of the target gateway determined in step 301, the function service is published, so that flexible call with the orchestration service and the service between the publishing systems is facilitated.
In the embodiment of the present disclosure, in order to further improve flexibility and applicability of the method, fig. 3 is a schematic flow chart of a data processing method provided in the fourth embodiment of the present disclosure.
As shown in fig. 6, the processing method of the data may include the steps of:
step 401, generating the function service script, the function service dependency list and the custom templates of the function service configuration of the function service by using a preset number of function languages, wherein the custom templates are in a command line form.
Templates provided based on an OpenFaaS framework in the embodiment of the disclosure are respectively customized aiming at Python, java, go and other common languages, and comprise a function service default script, a function service dependency list, a function service configuration yml and the like, so that flexible HTTP request processing is supported;
for example, the function service custom templates are as follows:
Figure BDA0003397014760000081
Figure BDA0003397014760000091
the above examples are merely exemplary examples, and the embodiments of the present disclosure do not limit the template content and style of the custom template.
And step 402, packaging the custom templates corresponding to the function services as the function components.
In order to better integrate with the orchestration service, the embodiment of the disclosure encapsulates the function service into a function component, and only related personnel are required to provide the API interface information (Header, query, body and other information) shown in fig. 4, select the objective function language, and provide script information (i.e. scripts for processing the upstream and downstream services) in the specific operation process.
The related personnel do not need to build engineering and only need to provide script information of parameter conversion, and function components are applied to arrangement services to play a role in converting parameters, so that parameter interaction between the services is more flexible and simpler.
Step 403, loading a function component, wherein the function component comprises a function service script, a function service dependency list and a function service configuration.
Step 404, configuring the function service script and the function service dependency list based on the parameter formats of the upstream and downstream services.
The execution of steps 403 to 404 may refer to the execution of any embodiment of the present disclosure, and will not be described herein.
Step 405, creating a function service file based on the custom template of the function service.
Because the custom templates are created based on the OpenFaaS framework, for convenience and flexibility of use, script commands of the OpenFaaS framework are required to be converted into RESTful API interfaces by the command line tool.
Step 406, constructing a second image file based on the function service file, and pushing the second image file to an image warehouse.
In the embodiment of the disclosure, the purpose of constructing the second image file is different from the purpose of constructing the first image file, and the purpose of constructing the first image file is to search the association relationship between the first image file and the function service configuration from the image warehouse so as to release the function service. The second image file is constructed to push the second image file to the repository file so as to establish an association relationship between the second image file and the target gateway in the function service configuration, so that the association relationship can be referred to.
In the embodiment of the disclosure, the first and second are only used for facilitating distinguishing different image files, and have other roles, such as priority and the like.
Step 407, establishing an association relationship between the second image file and the target gateway in the function service configuration in the image repository.
The aim of establishing the association is to issue a function service and provide a RESTful API interface for the function service.
Step 408, publishing the function service based on the function service configuration to generate the mirror interface.
Step 409, calling a mirror interface to construct a first mirror file corresponding to a function service based on the configured function service script and function service dependency list, and arranging the upstream and downstream services according to the first mirror file and the function service configuration.
The execution of steps 408 to 409 may refer to the execution of any embodiment of the present disclosure, and will not be described herein.
According to the data processing method, through the use of the function component, the parameter entering formats of the upstream and downstream services are converted, the upstream and downstream services are connected in series, a hard coding mode is not needed, the service arrangement flow is started, the service arrangement flow is simplified, and the flexibility and the applicability of service arrangement are improved.
Corresponding to the data processing method provided by the embodiments of fig. 1 to 6, the present disclosure also provides a data processing apparatus, and since the data processing apparatus provided by the embodiments of the present disclosure corresponds to the data processing method provided by the embodiments of fig. 1 to 6, implementation of the data processing method is also applicable to the data processing apparatus provided by the embodiments of the present disclosure, and will not be described in detail in the embodiments of the present disclosure.
Fig. 7 is a schematic structural diagram of a data processing apparatus according to a fifth embodiment of the present disclosure.
As shown in fig. 7, the processing apparatus 500 of the data may be applied to a server, including: a loading module 510, a configuration module 520, a calling module 530, and an orchestration module 540.
The loading module 510 is configured to load a function component, where the function component includes a function service script, a function service dependency list, and a function service configuration;
a configuration module 520, configured to configure the function service script and the function service dependency list based on the parameter formats of the upstream and downstream services;
a calling module 530, configured to call a mirror interface based on the configured function service script and function service dependency list, so as to construct a first mirror file corresponding to the function service;
and an orchestration module 540, configured to orchestrate the upstream and downstream services according to the first image file and the function service configuration.
In one possible implementation manner of the embodiment of the present disclosure, the loading module 510 is specifically configured to:
receiving a confirmation instruction of an objective function language used when the function service script is configured;
and in response to the confirmation instruction, loading, by the function component, the function service script and the function service dependency list according to the target function language.
In one possible implementation of the embodiment of the disclosure, the arranging module 540 is specifically configured to:
pushing a first image file corresponding to the function service to an image warehouse, wherein the image warehouse records the association relation between the first image file and a target gateway in the function service configuration;
and releasing the function service to a corresponding target gateway so as to arrange the service for completing the upstream and downstream services.
In a possible implementation manner of the embodiment of the disclosure, the apparatus further includes:
the generating module 550 is configured to generate, before the loading module loads the function component, the function service script, the function service dependency list, and the custom templates of the function service configuration of the function service by using a preset number of function languages, where the custom templates are in a command line form;
and the packaging module 560 is configured to package the custom template corresponding to the function service into the function component.
In a possible implementation manner of the embodiment of the disclosure, the apparatus further includes:
a creating module 570, configured to create a function service file based on a custom template of the function service before the calling mirror interface;
a building module 580, configured to build a second image file based on the function service file, and push the second image file to an image repository;
the establishing module 590 is configured to establish an association relationship between the second image file and the target gateway in the function service configuration in the image repository;
the publishing module 5100 is configured to publish the function service based on the function service configuration to generate the mirror interface.
When the parameter formats of the upstream and downstream services are converted through the function component, the function service script, the function service dependency list and the function service configuration in the function component are loaded, the function service script and the function service dependency list are configured based on the parameter formats of the upstream and downstream services, the mirror interface is called based on the configured function service script and function service dependency list to construct a first mirror file corresponding to the function service, and the upstream and downstream services are arranged according to the first mirror file and the function service configuration. Therefore, a mode of connecting upstream and downstream services in series in a function component loading mode can be realized, and a service arrangement flow is started, so that the service arrangement flow is simplified, and the flexibility and applicability of service arrangement are improved.
To achieve the above embodiments, the present disclosure further proposes a computer device including: the system comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the data processing method according to any one of the previous embodiments of the disclosure.
In order to implement the above-described embodiments, the present disclosure also proposes a non-transitory computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method of processing data as proposed in any of the foregoing embodiments of the present disclosure.
To achieve the above embodiments, the present disclosure also proposes a computer program product which, when executed by a processor, performs a method of processing data as proposed in any of the previous embodiments of the present disclosure.
FIG. 8 illustrates a block diagram of an exemplary computer device suitable for use in implementing embodiments of the present disclosure. The computer device 12 shown in fig. 8 is merely an example and should not be construed as limiting the functionality and scope of use of the disclosed embodiments.
As shown in FIG. 8, the computer device 12 is in the form of a general purpose computing device. Components of computer device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, a bus 18 that connects the various system components, including the system memory 28 and the processing units 16.
Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, and a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include industry Standard architecture (Industry Standard Architecture; hereinafter ISA) bus, micro channel architecture (Micro Channel Architecture; hereinafter MAC) bus, enhanced ISA bus, video electronics standards Association (Video Electronics Standards Association; hereinafter VESA) local bus, and peripheral component interconnect (Peripheral Component Interconnection; hereinafter PCI) bus.
Computer device 12 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by computer device 12 and includes both volatile and nonvolatile media, removable and non-removable media.
Memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (Random Access Memory; hereinafter: RAM) 30 and/or cache memory 32. The computer device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from or write to non-removable, nonvolatile magnetic media (not shown in FIG. 7, commonly referred to as a "hard disk drive"). Although not shown in fig. 7, a magnetic disk drive for reading from and writing to a removable non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable non-volatile optical disk (e.g., a compact disk read only memory (Compact Disc Read Only Memory; hereinafter CD-ROM), digital versatile read only optical disk (Digital Video Disc Read Only Memory; hereinafter DVD-ROM), or other optical media) may be provided. In such cases, each drive may be coupled to bus 18 through one or more data medium interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to carry out the functions of the various embodiments of the disclosure.
A program/utility 40 having a set (at least one) of program modules 42 may be stored in, for example, memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 42 generally perform the functions and/or methods in the embodiments described in this disclosure.
The computer device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), one or more devices that enable a user to interact with the computer device 12, and/or any devices (e.g., network card, modem, etc.) that enable the computer device 12 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 22. Moreover, the computer device 12 may also communicate with one or more networks such as a local area network (Local Area Network; hereinafter LAN), a wide area network (Wide Area Network; hereinafter WAN) and/or a public network such as the Internet via the network adapter 20. As shown, network adapter 20 communicates with other modules of computer device 12 via bus 18. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with computer device 12, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, for example, implementing the methods mentioned in the foregoing embodiments.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present disclosure. In this specification, schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, the different embodiments or examples described in this specification and the features of the different embodiments or examples may be combined and combined by those skilled in the art without contradiction.
Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In the description of the present disclosure, the meaning of "a plurality" is at least two, such as two, three, etc., unless explicitly specified otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and additional implementations are included within the scope of the preferred embodiment of the present disclosure in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present disclosure.
Logic and/or steps represented in the flowcharts or otherwise described herein, e.g., a ordered listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). In addition, the computer readable medium may even be paper or other suitable medium on which the program is printed, as the program may be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.
It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. As with the other embodiments, if implemented in hardware, may be implemented using any one or combination of the following techniques, as is well known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.
Those of ordinary skill in the art will appreciate that all or a portion of the steps carried out in the method of the above-described embodiments may be implemented by a program to instruct related hardware, where the program may be stored in a computer readable storage medium, and where the program, when executed, includes one or a combination of the steps of the method embodiments.
Furthermore, each functional unit in the embodiments of the present disclosure may be integrated in one processing module, or each unit may exist alone physically, or two or more units may be integrated in one module. The integrated modules may be implemented in hardware or in software functional modules. The integrated modules may also be stored in a computer readable storage medium if implemented in the form of software functional modules and sold or used as a stand-alone product.
The above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, or the like. Although embodiments of the present disclosure have been shown and described above, it will be understood that the above embodiments are illustrative and not to be construed as limiting the present disclosure, and that variations, modifications, alternatives, and variations may be made to the above embodiments by one of ordinary skill in the art within the scope of the present disclosure.

Claims (13)

1. A method of processing data, the method comprising:
loading a function component, wherein the function component comprises a function service script, a function service dependency list and a function service configuration;
configuring the function service script and the function service dependency list based on the parameter formats of the upstream and downstream services;
and calling a mirror interface based on the configured function service script and function service dependency list to construct a first mirror file corresponding to the function service, and arranging the upstream and downstream services according to the first mirror file and the function service configuration.
2. The method of claim 1, wherein loading the function component comprises:
receiving a confirmation instruction of an objective function language used when the function service script is configured;
and in response to the confirmation instruction, loading, by the function component, the function service script and the function service dependency list according to the target function language.
3. The method of claim 1, wherein orchestrating the upstream and downstream services according to the first image file and the functional service configuration comprises:
pushing a first image file corresponding to the function service to an image warehouse, wherein the image warehouse records the association relation between the first image file and a target gateway in the function service configuration;
and releasing the function service to a corresponding target gateway so as to arrange the service for completing the upstream and downstream services.
4. The method of claim 1, wherein prior to loading the function component, the method further comprises:
generating the function service script, the function service dependency list and the custom templates of the function service configuration of the function service respectively by adopting a preset number of function languages, wherein the custom templates are in a command line form;
and packaging the custom templates corresponding to the function services as the function components.
5. The method of claim 1, wherein prior to the invoking the mirror interface, the method further comprises:
creating a function service file based on the custom template of the function service;
constructing a second image file based on the function service file, and pushing the second image file to an image warehouse;
establishing an association relation between the second image file and a target gateway in the function service configuration in the image warehouse;
and publishing the function service based on the function service configuration to generate the mirror interface.
6. A data processing apparatus, the apparatus comprising:
the loading module is used for loading the function component, and the function component comprises a function service script, a function service dependency list and a function service configuration;
the configuration module is used for configuring the function service script and the function service dependency list based on the parameter formats of the upstream and downstream services;
the calling module is used for calling the mirror interface based on the configured function service script and the function service dependency list so as to construct a first mirror file corresponding to the function service;
and the arrangement module is used for arranging the upstream and downstream services according to the first image file and the function service configuration.
7. The device according to claim 6, wherein the loading module is specifically configured to:
receiving a confirmation instruction of an objective function language used when the function service script is configured;
and in response to the confirmation instruction, loading, by the function component, the function service script and the function service dependency list according to the target function language.
8. The apparatus according to claim 7, wherein the orchestration module is specifically configured to:
pushing a first image file corresponding to the function service to an image warehouse, wherein the image warehouse records the association relation between the first image file and a target gateway in the function service configuration;
and releasing the function service to a corresponding target gateway so as to arrange the service for completing the upstream and downstream services.
9. The apparatus of claim 6, wherein the apparatus further comprises:
the generating module is used for respectively generating the function service script, the function service dependency list and the custom templates of the function service configuration of the function service by adopting a preset number of function languages before the loading module loads the function components, wherein the custom templates are in a command line form;
and the packaging module is used for packaging the custom templates corresponding to the function services into the function components.
10. The apparatus of claim 6, wherein the apparatus further comprises:
the creation module is used for creating a function service file based on the user-defined template of the function service before the mirror image interface is called;
the construction module is used for constructing a second mirror image file based on the function service file and pushing the second mirror image file to a mirror image warehouse;
the establishing module is used for establishing the association relation between the second image file and the target gateway in the function service configuration in the image warehouse;
and the issuing module is used for issuing the function service based on the function service configuration so as to generate the mirror image interface.
11. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing a method of processing data according to any one of claims 1 to 5 when the program is executed.
12. A non-transitory computer readable storage medium, on which a computer program is stored, characterized in that the program, when executed by a processor, implements a method of processing data according to any one of claims 1-5.
13. A computer program product, characterized in that the instructions in the computer program product, when executed by a processor, perform the method of processing data according to any of claims 1-5.
CN202111484616.7A 2021-12-07 2021-12-07 Data processing method, device, equipment and medium Pending CN116243931A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111484616.7A CN116243931A (en) 2021-12-07 2021-12-07 Data processing method, device, equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111484616.7A CN116243931A (en) 2021-12-07 2021-12-07 Data processing method, device, equipment and medium

Publications (1)

Publication Number Publication Date
CN116243931A true CN116243931A (en) 2023-06-09

Family

ID=86629980

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111484616.7A Pending CN116243931A (en) 2021-12-07 2021-12-07 Data processing method, device, equipment and medium

Country Status (1)

Country Link
CN (1) CN116243931A (en)

Similar Documents

Publication Publication Date Title
US7698628B2 (en) Method and system to persist state
CN111858727B (en) Multi-data source data export system and method based on template configuration
CN110764752B (en) System and method for realizing graphic service arrangement of Restful service
CN111143446A (en) Data structure conversion processing method and device of data object and electronic equipment
CN113971037A (en) Application processing method and device, electronic equipment and storage medium
CN114115838A (en) Data interaction method and system based on distributed components and cloud platform
CN109445841A (en) Interface document management method, device, server and storage medium
CN112667228A (en) Application program construction method and device and computer equipment
CN114048415A (en) Form generation method and device, electronic equipment and computer readable storage medium
CN115795211A (en) Page display method, device, system, equipment and storage medium
CN113094125B (en) Business process processing method, device, server and storage medium
CN101136780A (en) Method, system to obtain user command information, and user command registered device
CN114358742A (en) Workflow execution method, device, equipment and storage medium
CN112558968A (en) Resource tree view generation method, device, equipment and storage medium
CN116243931A (en) Data processing method, device, equipment and medium
CN114449063B (en) Message processing method, device and equipment
CN113485686B (en) Information system program generation method and device, electronic equipment and storage medium
CN112764802A (en) Business logic customization method and device, electronic equipment and storage medium
CN114979125A (en) Method, device, terminal and storage medium for rapidly uploading files to network disk
CN111930690B (en) File generation method and device
CN111290701B (en) Data read-write control method, device, medium and electronic equipment
US20100011376A1 (en) Invocation channel
CN111782212A (en) View assembly creating method and device and storage medium
CN112418796A (en) Sub-process node activation method and device, electronic equipment and storage medium
CN110457110A (en) System theme management method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination