CN117271000A - Data processing method, device, system and equipment based on cloud platform - Google Patents

Data processing method, device, system and equipment based on cloud platform Download PDF

Info

Publication number
CN117271000A
CN117271000A CN202311234938.5A CN202311234938A CN117271000A CN 117271000 A CN117271000 A CN 117271000A CN 202311234938 A CN202311234938 A CN 202311234938A CN 117271000 A CN117271000 A CN 117271000A
Authority
CN
China
Prior art keywords
event
sub
target
executed
processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311234938.5A
Other languages
Chinese (zh)
Inventor
马浩钦
唐震宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN202311234938.5A priority Critical patent/CN117271000A/en
Publication of CN117271000A publication Critical patent/CN117271000A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/445Program loading or initiating
    • G06F9/44505Configuring for program initiating, e.g. using registry, configuration files
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/546Message passing systems or structures, e.g. queues

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer And Data Communications (AREA)

Abstract

The present disclosure relates to the field of virtual cloud platforms, and in particular, to a data processing method, device, system, and apparatus based on a cloud platform. The cloud platform-based data processing method comprises the steps of generating an event to be executed according to a received data processing request; processing the event to be executed based on a first target service corresponding to the event to be executed in the plurality of services, and determining a plurality of sub-events corresponding to the event to be executed; the first target service calls a first target network interface, and processes the first sub-event to obtain a first processing result; and calling a second target network interface based on a second target service corresponding to the second sub-event in the plurality of services, and processing the second sub-event and the first processing result to obtain a target processing result. According to the embodiment of the specification, based on the event and the plurality of services, the coupling degree between the systems is reduced under the background of the virtual cloud platform, so that the dependence degree between the systems is reduced, and the expandability of the systems is improved.

Description

Data processing method, device, system and equipment based on cloud platform
Technical Field
The present disclosure relates to the field of virtual cloud platforms, and in particular, to a data processing method, device, system, and apparatus based on a cloud platform.
Background
Currently, administrators often need a strong theoretical basis for practical operations in operating an open source system (Kubernetes) for automatically deploying, scaling and managing containerized applications. For inexperienced administrators, the operation of the open source system is also time consuming, and thus requires high demands on the administrator. In addition, when the open source system comprises a plurality of subsystems, an administrator directly faces the plurality of subsystems when in operation and the plurality of subsystems directly interact with each other, so that the coupling degree among the plurality of subsystems is higher, and the expandability of the open source system is lower.
How to reduce the requirements on administrators and the coupling degree between systems in the context of a virtual cloud platform is a problem that needs to be solved in the prior art.
Disclosure of Invention
In order to solve the problems in the prior art, the embodiment of the specification provides a data processing method, a device, a system and equipment based on a cloud platform, which are based on events and a plurality of services, and realize the requirements of management staff and the reduction of the coupling degree between the systems under the background of a virtual cloud platform, thereby reducing the dependence degree between the systems and improving the expandability of the systems.
In order to solve the technical problems, the specific technical scheme in the specification is as follows:
in one aspect, embodiments of the present disclosure provide a data processing method based on a cloud platform, including,
generating an event to be executed according to the received data processing request;
processing the event to be executed based on a first target service corresponding to the event to be executed in a plurality of services, and determining a plurality of sub-events corresponding to the event to be executed, wherein the plurality of sub-events comprise a first sub-event and a second sub-event;
the first target service calls a first target network interface, processes the first sub-event to obtain a first processing result, and the first sub-event corresponds to the first target network interface; and
and calling a second target network interface based on a second target service corresponding to the second sub-event in the plurality of services, and processing the second sub-event and the first processing result to obtain a target processing result.
Further, the method also comprises the steps of,
based on the visual service in the plurality of services, invoking a visual network interface to process the target processing result to obtain data to be sent;
Packaging the data to be sent to obtain target data to be sent; and
and sending the target data to be sent to a terminal sending the data processing request.
Further, after the event to be executed is generated according to the received data processing request, and the event to be executed is processed based on a first target service corresponding to the event to be executed in the plurality of services, it is determined that the event to be executed includes a plurality of sub-events before the event to be executed includes,
sending the event to be executed to a message queue; and
and determining that the service subscribed to the event to be executed, which is included in the message queue, is the first target service.
Further, the method processes the event to be executed based on a first target service corresponding to the event to be executed in a plurality of services, determines a plurality of sub-events corresponding to the event to be executed to include,
analyzing the event to be executed based on the first target service to obtain step data for executing the event to be executed; and
and determining sub-events corresponding to each step data, and obtaining the plurality of sub-events.
Further, after the first target service calls a first target network interface to process the first sub-event to obtain a first processing result, and the second target service based on a second sub-event corresponding to the second sub-event in the plurality of services calls a second target network interface to process the second sub-event and the first processing result, before obtaining a target processing result, the method further comprises,
Sending the second sub-event and the first processing result to a message queue; and
determining that the service subscribed to the second sub-event included in the message queue is the second target service.
Further, in the case that the second sub-event is plural, the second target service includes a first sub-target service and a second sub-target service, the processing is performed on the second sub-event and the first processing result by calling a second target network interface based on a second target service corresponding to the second sub-event in the plural services, and the obtaining a target processing result includes,
calling a first sub-target network interface based on a first sub-target service corresponding to a first sub-event in the second sub-events in the plurality of services, and processing the first second sub-event and the first processing result to obtain a first sub-target result, wherein the first second sub-event is a second sub-event which is located in a first position after a plurality of second sub-events are sequenced according to an execution step; and
and calling a second sub-target network interface based on a second sub-target service corresponding to a second sub-event in the second sub-events in the plurality of services, processing the second sub-event, the first sub-target processing result and the first processing result to obtain a second sub-target result, and continuing to execute the steps until each second sub-event is processed to obtain the target result.
Further, the plurality of services includes: a login check service, a filtering service, a user creation service, a user deletion service, a user modification service, a user lookup service, a role setting service, an operation authority check service, a resource query service, and a resource modification service.
Further, in the case that the second target service is an operation authority verification service, the processing the second sub-event and the first processing result based on the second target service corresponding to the second sub-event in the plurality of services, to obtain a target processing result includes,
invoking a second target network interface, and determining a first priority identifier represented by the first processing result and a second priority identifier corresponding to the second sub-event;
judging whether the first priority identifier is higher than the second priority identifier; and
and determining that the target processing result is verified under the condition that the first priority identification is higher than or equal to the second priority identification.
On the other hand, the embodiment of the specification also provides a data processing system based on a cloud platform, which comprises an interactive terminal, a message queue, a plurality of services and a virtual cloud platform which are sequentially in communication connection, wherein the plurality of services are in communication connection with the interactive terminal,
The data processing request received by the interactive terminal generates an event to be executed and sends the event to a message queue;
the message queue receives the event to be executed and stores the event to be executed into the message queue;
a first target service corresponding to the event to be executed in the plurality of services acquires the event to be executed from the message queue, processes the event to be executed, and determines a plurality of sub-events corresponding to the event to be executed, wherein the plurality of sub-events comprise a first sub-event and a second sub-event; the first target service calls a first target network interface to be connected with the virtual cloud platform, the virtual cloud platform is utilized to process the first sub-event to obtain a first processing result, and the first sub-event corresponds to the first target network interface; and sending the first processing result and the second sub-event to the message queue;
the message queue receives the first processing result and the second sub-event and stores the first processing result and the second sub-event into the message queue;
and a second target service corresponding to the second sub-event in the plurality of services is used for acquiring the first processing result and the second sub-event from the message queue, calling a second target network interface to connect with the virtual cloud platform, and processing the second sub-event and the first processing result by using the virtual cloud platform to obtain a target processing result.
On the other hand, the embodiment of the specification also provides a data processing device based on a cloud platform, which comprises,
the generating unit is used for generating an event to be executed according to the received data processing request;
the first processing unit is used for processing the event to be executed based on a first target service corresponding to the event to be executed in a plurality of services, and determining a plurality of sub-events corresponding to the event to be executed, wherein the plurality of sub-events comprise a first sub-event and a second sub-event;
the second processing unit is used for calling a first target network interface by the first target service, processing the first sub-event to obtain a first processing result, wherein the first sub-event corresponds to the first target network interface; and
and the third processing unit is used for calling a second target network interface based on a second target service corresponding to the second sub-event in the plurality of services, and processing the second sub-event and the first processing result to obtain a target processing result.
Further, the device also comprises a control unit,
the fourth processing unit is used for calling a visual network interface based on visual service in the plurality of services, and processing the target processing result to obtain data to be sent;
The packaging unit is used for packaging the data to be sent to obtain target data to be sent; and
and the sending unit is used for sending the target data to be sent to the terminal sending the data processing request.
In another aspect, embodiments of the present disclosure further provide a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor implements the method described above when executing the computer program.
In another aspect, embodiments of the present disclosure also provide a computer-readable storage medium having stored thereon computer instructions that, when executed by a processor, perform the above-described method.
In another aspect, the present description embodiments also provide a computer program product comprising a computer program/instruction which, when executed by a processor, implements a method.
By utilizing the embodiment of the specification, when a received data processing request is received, generating an event to be executed according to the data processing request; processing the event to be executed based on a first target service corresponding to the event to be executed in the plurality of services, and determining a plurality of sub-events corresponding to the event to be executed; the first target service calls a first target network interface and processes the first sub-event to obtain a first processing result; and finally, based on a second target service corresponding to the second sub-event in the plurality of services, calling a second target network interface, and processing the second sub-event and the first processing result to obtain a target processing result. The operator only needs to input the easy-to-learn data processing request, and then the difficult-to-learn event to be executed (the operation instruction required to learn and use the original operation open source system) corresponding to the easy-to-learn data processing request is determined, so that the requirement on the operator is reduced. In addition, the events to be executed are disassembled by utilizing the first target service, so that a plurality of sub-events are obtained, and then each sub-event is processed by utilizing a system managed by the virtual cloud platform, so that the coupling degree between the systems is reduced under the background of the virtual cloud platform, the dependence degree between the systems is reduced, and the expandability of the system is improved.
Drawings
In order to more clearly illustrate the embodiments of the present description or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present description, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic diagram of an implementation system of a data processing method based on a cloud platform according to an embodiment of the present disclosure;
fig. 2 is a flowchart of a data processing method based on a cloud platform according to an embodiment of the present disclosure;
FIG. 3 is a flowchart of a data processing method based on a cloud platform according to another embodiment of the present disclosure;
FIG. 4A is a flowchart of a data processing method based on a cloud platform according to another embodiment of the present disclosure;
FIG. 4B is a flow chart illustrating a sub-event determination method according to an embodiment of the present disclosure;
FIG. 5A is a flowchart of a data processing method based on a cloud platform according to another embodiment of the present disclosure;
FIG. 5B is a flowchart showing a target processing result determining method according to an embodiment of the present disclosure;
FIG. 6 is a flowchart showing a target processing result determining method according to another embodiment of the present disclosure;
fig. 7A is a schematic structural diagram of a data processing device based on a cloud platform according to an embodiment of the present disclosure;
fig. 7B is a schematic structural diagram of a data processing device based on a cloud platform according to another embodiment of the present disclosure;
fig. 8 is a schematic structural diagram of a computer device according to an embodiment of the present disclosure.
[ reference numerals description ]
101. An interactive terminal;
102. a message queue;
103. a service;
104. a virtual cloud platform;
710. a generating unit;
720. a first processing unit;
730. a second processing unit;
740. a third processing unit;
750. a fourth processing unit;
760. a packaging unit;
770. a transmitting unit;
802. a computer device;
804. a processing device;
806. storing the resource;
808. a driving mechanism;
810. an input/output module;
812. an input device;
814. an output device;
816. a presentation device;
818. a graphical user interface;
820. a network interface;
822. a communication link;
824. a communication bus.
Detailed Description
The technical solutions of the embodiments of the present specification will be clearly and completely described below with reference to the drawings in the embodiments of the present specification, and it is apparent that the described embodiments are only some embodiments of the present specification, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are intended to be within the scope of the present disclosure.
It should be noted that the terms "first," "second," and the like in the description and the claims of the specification and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the present description described herein may be capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, apparatus, article, or device that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or device.
It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer executable instructions, and that although a logical order is illustrated in the flowcharts, in some cases the steps illustrated or described may be performed in an order other than that illustrated herein.
Fig. 1 is a schematic diagram of an implementation system of a data processing method based on a cloud platform according to an embodiment of the present disclosure, which may include: an interactive terminal 101, a message queue 102, a service 103, and a virtual cloud platform 104, and the service 103 includes a plurality of services; the interactive terminal 101, the message queue 102, the service 103, and the virtual cloud platform 104 sequentially communicate with each other via a network, and the interactive terminal 101 and the service 103 also communicate with each other via a network, where the network may include a local area network (Local Area Network, abbreviated as LAN), a wide area network (Wide Area Network, abbreviated as WAN), the internet, or a combination thereof. When an operator operates the virtual cloud platform, a data processing request is sent through the interactive terminal 101. The data processing request received by the interactive terminal 101 generates an event to be executed, and sends the event to the message queue 102. The message queue 102 receives events to be executed and stores the events in the message queue 102. A first target service corresponding to an event to be executed in the service 103 acquires the event to be executed from the message queue 102, processes the event to be executed, and determines a plurality of sub-events corresponding to the event to be executed, wherein the plurality of sub-events comprise a first sub-event and a second sub-event; the first target service calls a first target network interface to connect with the virtual cloud platform 104, and processes a first sub-event by using the virtual cloud platform to obtain a first processing result, wherein the first sub-event corresponds to the first target network interface; and sending the first processing result and the second sub-event to the message queue 102. The message queue 102 receives the first processing result and the second sub-event and stores them in the message queue 102. And a second target service corresponding to the second sub-event in the service 103 acquires the first processing result and the second sub-event from the message queue, calls a second target network interface to connect with the virtual cloud platform 104, and processes the second sub-event and the first processing result by using the virtual cloud platform 104 to acquire a target processing result. Further, the target processing result may also be transmitted to the interactive terminal 101. In addition, before sending the target processing result to the interaction terminal 101, a visual network interface may be called based on a visual service in a plurality of services, and the visual operation module connected to the virtual cloud platform 104 may process the target processing result to obtain data to be sent; packaging data to be transmitted to obtain target data to be transmitted; and transmitting the target data to be transmitted to the interactive terminal 101 which transmits the data processing request. Included within the virtual cloud platform are modules that can be used to process individual events for processing each event. It should be noted that, the virtual cloud platform may be a platform that uses a container (Docker) and an open source system (Kubernetes) as container orchestration tools to manage resources for the bottom layer, and further connects the open source system to an application (Spring Boot) based on an external resource package (java-client), so that an operator can process the open source system through an interaction terminal, a message queue and each service.
In an alternative embodiment, the interactive terminal 101 may include electronic devices not limited to smart phones, acquisition devices, desktop computers, tablet computers, notebook computers, smart speakers, digital assistants, augmented Reality (AR, augmented Reality)/Virtual Reality (VR) devices, smart wearable devices, and the like. Alternatively, the operating system running on the electronic device may include, but is not limited to, an android system, an IOS system, linux, windows, and the like.
In addition, it should be noted that, fig. 1 is only an application environment provided in the present specification, and in practical application, for example, a plurality of interaction terminals 101 may also be included, which is not limited in the present specification.
Fig. 2 is a flowchart of a data processing method based on a cloud platform according to an embodiment of the present disclosure. In this figure, a cloud platform based data processing process is described, but conventional or non-inventive labor based may include more or fewer operational steps. The order of steps recited in the embodiments is merely one way of performing the order of steps and does not represent a unique order of execution. When a system or apparatus product in practice is executed, it may be executed sequentially or in parallel according to the method shown in the embodiments or the drawings. As shown in fig. 2, the method may include:
S210, generating an event to be executed according to the received data processing request;
s220, processing the event to be executed based on a first target service corresponding to the event to be executed in the plurality of services, and determining a plurality of sub-events corresponding to the event to be executed;
s230, the first target service calls a first target network interface, and processes the first sub-event to obtain a first processing result;
s240, based on a second target service corresponding to the second sub-event in the plurality of services, calling a second target network interface, and processing the second sub-event and the first processing result to obtain a target processing result.
By utilizing the embodiment of the specification, when a received data processing request is received, generating an event to be executed according to the data processing request; processing the event to be executed based on a first target service corresponding to the event to be executed in the plurality of services, and determining a plurality of sub-events corresponding to the event to be executed; the first target service calls a first target network interface and processes the first sub-event to obtain a first processing result; and finally, based on a second target service corresponding to the second sub-event in the plurality of services, calling a second target network interface, and processing the second sub-event and the first processing result to obtain a target processing result. The operator only needs to input the easy-to-learn data processing request, and then the difficult-to-learn event to be executed (the operation instruction required to learn and use the original operation open source system) corresponding to the easy-to-learn data processing request is determined, so that the requirement on the operator is reduced. In addition, the events to be executed are disassembled by utilizing the first target service, so that a plurality of sub-events are obtained, and then each sub-event is processed by utilizing a system managed by the virtual cloud platform, so that the coupling degree between the systems is reduced under the background of the virtual cloud platform, the dependence degree between the systems is reduced, and the expandability of the system is improved.
According to one embodiment of the present disclosure, when an administrator wants to process a bottom resource managed by a virtual cloud platform, the administrator inputs a processing instruction, that is, a data processing request, through an interactive terminal. The data processing request may be, for example, user registration, data query and data processing, etc. And when the data processing request is received, generating an event to be executed which can be identified and processed by the virtual cloud platform according to the data processing request.
The virtual cloud platform has a plurality of network interfaces, and the underlying resource to which each network interface is connected may be used to execute a corresponding instruction (process a corresponding event) to obtain a corresponding result. Each network interface of the virtual cloud platform is connected with a service corresponding to processing the event. In particular, a service may be connected to multiple network interfaces and, in turn, to multiple underlying resources.
Since a plurality of steps are required to be performed in processing an event to be executed corresponding to a data processing request, each step is processed by a different system (or resource). To avoid interaction between multiple systems or multiple resources when processing an event to be executed, in this embodiment, the service corresponding to the first step for executing each event to be executed may be used for event parsing to determine the steps that need to be included to execute the event to be executed.
Specifically, for example, a mapping relationship between each service and the pre-event, specifically, an association relationship between the pre-event and the service for executing the first step of the pre-event may be maintained in advance. And determining the similarity between the event to be executed and each pre-event, and determining the target pre-event corresponding to the similarity with the maximum similarity. And determining the service corresponding to the target pre-event as a first target service.
After determining the first target service, analyzing the event to be executed by using the first target service, determining a plurality of steps needed to be executed for processing the event to be executed, and determining sub-events corresponding to each step, thereby obtaining sub-events corresponding to the event to be executed. It should be noted that the sub-event includes a first sub-event and a second sub-event, where the first sub-event is an event processed by the current service, and the second sub-event is an event processed by other services. The first sub-event corresponds to a first target network interface.
The first target service calls a first target network interface corresponding to the resource for processing the first sub-event, so as to process the first sub-event through the resource corresponding to the first target network interface, obtain a processing result, and take the processing result as a first processing result.
After obtaining the first processing result, the first target service may, for example, also send the second sub-event and the first processing result to a second target service that processes the second sub-event. Specifically, the manner of determining the second target service may be similar to the method of determining the first target service, for example, and will not be described herein.
The second target service calls a second network interface corresponding to the resource for processing the second sub-event, so as to process the second sub-event and the first processing result through the resource corresponding to the second target network interface, obtain a processing result, and take the processing result as a target processing result.
Specifically, the number of the second sub-events may be plural, and in the case where the number of the second sub-events is plural, according to the executing step, the first second sub-event is first executed, and then the executing result, the first processing result, and all remaining second sub-events are sent to the service corresponding to executing the first second sub-event in all remaining second sub-events. The service processes the first second sub event, the execution result of the last step and the first processing result in all the remaining second sub events to obtain a corresponding execution result and a second sub event which remains again, and then forwards the second sub event by the previous method until the last second sub event is processed, so that a target processing result is obtained. It should be noted that, in each forwarding, the execution result of the current step, the execution result of all the previous steps, and all the remaining second sub-events need to be sent to the corresponding service.
According to another embodiment of the present description, the plurality of services includes: a login check service, a filtering service, a user creation service, a user deletion service, a user modification service, a user lookup service, a role setting service, an operation authority check service, a resource query service, and a resource modification service.
Specifically, the login verification service may perform login verification on a user name and a password input by an operator by using the system, where the verification content mainly includes whether the user name exists and whether the password is correct. In addition, the page at the interactive terminal can be a main page of the platform if verification is passed, and the login failure reason is displayed if the login fails.
The filtering service may be performed by processing an operator's access to resources within the system. Specifically, if the operator does not log in, the user skips to the login page, otherwise, the corresponding resource page of the request is returned, for example, if the user does not log in, the user directly wants to directly access the container monitoring page through a uniform resource locator (url), the user skips to the login page to prompt the user to log in, and if the user logs in, the user skips to the target page directly.
The content executed by the user creation service may be for enabling an operator having a certain authority to create the user on the user management page. Such as a project manager, can create a general user, but the general user cannot perform an operation of creating the user.
The content executed by the user deletion service may be for enabling an operator having a certain authority to delete the user on the user management page. Such as a project manager, can delete the general user, but the general user cannot perform the operation of deleting the user.
The content executed by the user modification service may be for enabling a user having a certain authority to modify user information on the user management page. Such as project administrators, can modify the information of the general users, but the general users cannot perform the operation of modifying the user information.
The content executed by the user searching service can be used for enabling the project manager and the users with the authority above to browse all users under the current system on the user management interface, and inquiring the users according to the three modes of fields, time ordering and paging.
The content executed by the role setting service may be that each user is configured with a role attribute in advance, so that specific roles of the users are identified through a role name field and a priority field, each role has corresponding authority, and operation authority verification is performed on the users.
The content executed by the operation authority verification service may be used to verify the authority of the current user when performing part of the function operation, and by comparing the required priority with the priority of the role, if the priority of the role of the user is lower than the required priority, a prompt of insufficient authority is returned. Meanwhile, for the functions of the larger module, such as the functions of user management only operable by project administrators, filtering processing can be performed according to the role name field, namely, the common user cannot display the page and select the entry of the user management function.
The resource query service may be executed to enable an operator to query the resource condition on the resource management page, and the resource may be screened through key fields, such as container identifier, node name, modification time, and the like, to perform fuzzy screening.
The resource modification service may be executed to enable an operator having a certain authority to process the resource on the resource management page. The operations of starting and stopping the container, adding, deleting, modifying and the like of the variable can be performed by clicking to enter the resource management page.
It should be noted that, the above processing steps are stored for quickly and accurately determining the failure cause after the execution failure, or for daily monitoring by an administrator.
Therefore, the operation of directly using commands or even more aggregation at the interactive terminal is realized by packaging specific functions of a network interface provided by a system (Kubernetes), so that resources can be monitored and managed at a visual interface, and a user does not need to care about the underlying technical principle, commands (Linux) and the like, and only needs to care about the operation mode on a page and returned data. Finally, related usage manual of the platform needs to be written to further facilitate understanding and use by the user.
Fig. 3 is a flowchart of a data processing method based on a cloud platform according to another embodiment of the present disclosure. Another cloud platform based data processing process is depicted in fig. 3, but may include more or fewer operational steps based on conventional or non-inventive labor. As shown in fig. 3, the method may include:
s350, calling a visual network interface based on visual service in a plurality of services, and processing a target processing result to obtain data to be transmitted;
s360, packaging data to be sent to obtain target data to be sent;
s370, sending the target data to be sent to the terminal sending the data processing request.
According to another embodiment of the present specification, after determining that the target processing result is obtained, a visualization service connected to a system of the visualization processing is determined from among a plurality of services. And calling a visual network interface for connecting with a system for visual processing by using the visual service, and sending the target processing result to a corresponding system or resource. And carrying out visual processing on the target processing result by using the system or the resource to obtain data to be transmitted, which can be displayed on a user management page.
And packaging the obtained pre-sent data to obtain target data to be sent, which can be transmitted on a transmission path. And further, the target data to be sent is sent to the terminal through a path communicated with the terminal sending the data processing request, so that the visualization processing of the target processing result is completed. It should be noted that, in this operation, the server does not need to be connected through a visualization tool (Xshell, etc.), and the operation instruction is used to view the resource, so that the threshold of the visualization operation is reduced to a certain extent, and the waste of the resource is reduced.
Fig. 4A is a flowchart of a data processing method based on a cloud platform according to another embodiment of the present disclosure. Another cloud platform based data processing process is depicted in fig. 4A, but may include more or fewer operational steps based on conventional or non-inventive labor. As shown in fig. 4A, the method may include:
s4121, sending an event to be executed to a message queue;
s4122, determining that the service subscribing to the event to be executed included in the message queue is the first target service.
According to another embodiment of the present disclosure, in order to further reduce the coupling degree between systems and reduce the coupling degree between services, the execution result and the event are forwarded by using the message queue, so that the waste of resources (without maintaining the mapping relationship between the event and the service) is reduced.
Specifically, the determined event to be executed is sent to a message queue. And when the message queue receives the event to be executed, storing the event to be executed into the message queue. Each service subscribes to a different event in the message queue. For example, service a may be used to execute event S, service a subscribes to event S in the message queue. Thus, when event S is stored in the message queue, service a is automatically triggered for processing. Therefore, the event to be executed is stored in the message queue, and the first target service subscribed to the event to be executed is triggered to process the event to be executed. Specifically, the first target service is a service that processes a first step of a plurality of steps included in the event to be executed.
Fig. 4B is a flowchart illustrating a sub-event determination method according to an embodiment of the present disclosure. The sub-event determination process is depicted in FIG. 4B, but may include more or fewer operational steps based on conventional or non-inventive labor. As shown in fig. 4B, the method may include:
s421, analyzing the event to be executed based on the first target service to obtain step data of the event to be executed;
S422, determining sub-events corresponding to the data of each step to obtain a plurality of sub-events.
According to another embodiment of the present disclosure, the first target service is utilized to parse the event to be executed to determine step data. It should be noted that the determining step data may be that, for each event, a corresponding preset step is configured in advance. And determining a target event matched with the consistency of the event to be executed from a plurality of events, and taking a preset step corresponding to the target event as the step data. For example, step data corresponding to the event to be executed may also be determined by using a trained neural network model, and the training process of the trained neural network model may refer to the prior art, which is not described in detail in this specification.
Based on similar operations as determining the event to be executed, determining the sub-event corresponding to each step data, and obtaining a plurality of sub-events, which will not be described in detail in this specification.
Fig. 5A is a flowchart of a data processing method based on a cloud platform according to another embodiment of the present disclosure. Another cloud platform based data processing procedure is depicted in this figure, but may include more or fewer operational steps based on conventional or non-inventive labor. As shown in fig. 5A, the method may include:
S5321, sending the second sub-event and the first processing result to a message queue;
s5322, determining that the service subscribed to the second sub-event included in the message queue is a second target service.
According to another embodiment of the present disclosure, in order to further reduce the coupling degree between systems and reduce the coupling degree between services, the execution result and the event are forwarded by using the message queue, so that the waste of resources (without maintaining the mapping relationship between the event and the service) is reduced.
And after the first target service finishes processing the first sub-event, sending the second sub-event and the first processing result to the message queue. The message queue performs a similar process to the process of the first sub-event on the second sub-event and the first processing result, and stores the second sub-event and the first processing result in the message queue. Therefore, the second sub-event and the first processing result are stored in the message queue, and the second target service subscribed to the second sub-event is triggered to process the second sub-event and the first processing result.
It should be noted that, in the case that the second sub-event is plural, the second target service is a service subscribed to a first second sub-event of the plural second sub-events.
Fig. 5B is a flowchart illustrating a target processing result determining method according to an embodiment of the present disclosure. The target process result determination process is described in this figure, but may include more or fewer operational steps based on conventional or non-inventive labor. As shown in fig. 5B, the method may include:
s541, calling a first sub-target network interface based on a first sub-target service corresponding to a first sub-event in the second sub-events in the plurality of services, and processing the first sub-event and the first processing result to obtain a first sub-target result;
s542, calling a second sub-target network interface based on a second sub-target service corresponding to a second sub-event in the second sub-events in the plurality of services, and processing the second sub-event, the first sub-target processing result and the first processing result to obtain a second sub-target result;
s543, judging whether a second sub-event which is not executed exists;
s544, determining a second sub-target result as a target result under the condition that no unexecuted second sub-event is determined;
s545, when it is determined that there is a second sub-event that is not executed, the first sub-event, the first sub-target result, the second sub-target result and the first processing result that are not executed are used as the first sub-event, the second sub-event and the first processing result, and S541 is input.
According to another embodiment of the present description, the second target service includes a first sub-target service and a second sub-target service.
It should be noted that, there is a sequence between the generated first sub-event and the second sub-event. The sequence is the sequence of executing dimensions, for example, the first, second and third steps are needed when executing the event to be executed, and the events corresponding to the first, second and third steps are the first sub-event, the first second sub-event and the second sub-event.
Based on the first sub-target service corresponding to the first sub-event and the second sub-event, the first sub-target network interface is called, and the first sub-event and the first processing result are processed to obtain a first sub-target result, and the specific execution operation can be referred to S230, which is not described in detail in this specification.
The first sub-target service transmits the unexecuted second sub-event, the first sub-target processing result, and the first processing result to a second sub-target service corresponding to a second sub-event (a first one of the unexecuted second sub-events). The second sub-target service invokes a second sub-target network interface to process a second sub-event, the first sub-target processing result and the first processing result to obtain a second sub-target result, and the specific execution operation may refer to S230, which is not described in detail in this specification.
Judging whether the second sub-event is not executed, if so, continuing to refer to the execution of all the second sub-events in the above manner, for example, the first sub-event, the first sub-target result, the second sub-target result and the first processing result which are not executed are used as the first second sub-event and the first processing result, and processing the first sub-event and the first processing result by using S541. It should be noted that, when the second sub-event that is not executed is processed later, the execution result of the current service and each service before and the second sub-event that is not executed need to be transmitted.
It should be noted that, when processing the plurality of second sub-events, a transmission manner of the message queue may also be introduced. Specifically, the first sub-target service and the second sub-target service send the second sub-event, the first sub-target processing result and the first processing result which are not executed or send the second sub-event, the first sub-target processing result, the second sub-target result and the first processing result which are not executed to the message queue, and the corresponding sub-target service subscribed to the sub-event acquires the corresponding message and invokes the corresponding network interface to execute so as to obtain the target result.
In case it is determined that there are no second sub-events that are not executed, i.e. all second sub-events have been executed, the second sub-target result is determined to be the target result.
Fig. 6 is a flowchart of a target processing result determining method according to another embodiment of the present disclosure. Another target process result determination process is depicted in this figure, but may include more or fewer operational steps based on conventional or non-inventive labor. As shown in fig. 6, the method may include:
s641, calling a second target network interface, and determining a first priority identifier represented by the first processing result and a second priority identifier corresponding to a second sub-event;
s642, judging whether the first priority identifier is higher than the second priority identifier;
s643, determining that the verification is a target processing result under the condition that the first priority identification is higher than or equal to the second priority identification;
s644, in the case where it is determined that the first priority identification is not higher than the second priority identification, it is determined that the verification is not passed as the target processing result.
According to another embodiment of the present specification, the second target service is an operation authority verification service, and the manner of determining the target processing result may employ the above S641 to S644.
Specifically, the second target service invokes the second target network interface to communicate with the corresponding system or resource. And processing the first processing result and the second sub-event by using the system or the resource, and determining a first priority identifier characterized by the first processing result and a second priority identifier corresponding to the second sub-event. The second priority identifier corresponding to the second sub-event is a priority identifier required to execute the second sub-event.
The system or resource, after determining the first priority identification and the second priority identification, determines whether the first priority identification is higher than the second priority identification. And under the condition that the first priority identification is higher than the second priority identification, the current manager has higher authority, and the target processing result is determined to pass verification. And under the condition that the first priority identification is higher than the second priority identification, the current manager has lower authority, and the target processing result is determined not to pass verification.
For example, the first processing result may be a role corresponding to the operator, the first priority identification is a priority identification corresponding to the role, and the second priority identification characterizes a priority identification that may perform the second sub-event.
Fig. 7A is a schematic structural diagram of a data processing device based on a cloud platform according to an embodiment of the present disclosure. As shown in fig. 7A, including,
a generating unit 710, configured to generate an event to be executed according to the received data processing request;
the first processing unit 720 is configured to process the event to be executed based on a first target service corresponding to the event to be executed in the multiple services, and determine multiple sub-events corresponding to the event to be executed, where the multiple sub-events include a first sub-event and a second sub-event;
The second processing unit 730 is configured to invoke a first target network interface by using a first target service, process a first sub-event to obtain a first processing result, where the first sub-event corresponds to the first target network interface;
and the third processing unit 740 is configured to invoke a second target network interface based on a second target service corresponding to the second sub-event in the multiple services, and process the second sub-event and the first processing result to obtain a target processing result.
Since the principle of the device for solving the problem is similar to that of the method, the implementation of the device can be referred to the implementation of the method, and the repetition is omitted.
Fig. 7B is a schematic structural diagram of a data processing device based on a cloud platform according to another embodiment of the present disclosure. As shown in fig. 7B, including,
a fourth processing unit 750, configured to invoke a visual network interface based on a visual service among the plurality of services, and process the target processing result to obtain data to be sent;
the encapsulation unit 760 is configured to encapsulate the data to be sent to obtain target data to be sent;
a transmitting unit 770 for transmitting the target data to be transmitted to the terminal transmitting the data processing request.
Since the principle of the device for solving the problem is similar to that of the method, the implementation of the device can be referred to the implementation of the method, and the repetition is omitted.
Fig. 8 is a schematic structural diagram of a computer device according to an embodiment of the present disclosure, where an apparatus in the present disclosure may be the computer device in the present embodiment, and perform the method of the present disclosure. The computer device 802 may include one or more processing devices 804, such as one or more Central Processing Units (CPUs), each of which may implement one or more hardware threads. The computer device 802 may also include any storage resources 806 for storing any kind of information, such as code, settings, data, etc. For example, and without limitation, storage resources 806 may include any one or more of the following combinations: any type of RAM, any type of ROM, flash memory devices, hard disks, optical disks, etc. More generally, any storage resource may store information using any technology. Further, any storage resource may provide volatile or non-volatile retention of information. Further, any storage resources may represent fixed or removable components of computer device 702. In one case, the computer device 802 may perform any of the operations of the associated instructions when the processing device 804 executes the associated instructions stored in any storage resource or combination of storage resources. The computer device 802 also includes one or more drive mechanisms 808, such as a hard disk drive mechanism, an optical disk drive mechanism, and the like, for interacting with any storage resources.
The computer device 802 may also include an input/output module 810 (I/O) for receiving various inputs (via an input device 812) and for providing various outputs (via an output device 814). One particular output mechanism may include a presentation device 816 and an associated Graphical User Interface (GUI) 818. In other embodiments, input/output module 810 (I/O), input device 812, and output device 814 may not be included, but merely as a computer device in a network. The computer device 802 may also include one or more network interfaces 820 for exchanging data with other devices via one or more communication links 822. One or more communications buses 824 couple the above-described components together.
The communication link 822 may be implemented in any manner, such as, for example, through a local area network, a wide area network (e.g., the internet), a point-to-point connection, etc., or any combination thereof. Communication link 822 may include any combination of hardwired links, wireless links, routers, gateway functions, name servers, etc., governed by any protocol or combination of protocols.
The embodiments of the present specification also provide a computer readable storage medium storing a computer program which, when executed by a processor, implements the above method.
The present description also provides a computer program product comprising a computer program which, when executed by a processor, implements the above method.
It will be appreciated by those skilled in the art that embodiments of the present description may be provided as a method, system, or computer program product. Accordingly, the present specification may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present description can take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
The present description is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the specification. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing detailed description of the embodiments has been presented for purposes of illustration and description, and it should be understood that the foregoing is by way of example only, and is not intended to limit the scope of the invention.

Claims (14)

1. The data processing method based on the cloud platform is characterized by comprising the following steps of:
generating an event to be executed according to the received data processing request;
processing the event to be executed based on a first target service corresponding to the event to be executed in a plurality of services, and determining a plurality of sub-events corresponding to the event to be executed, wherein the plurality of sub-events comprise a first sub-event and a second sub-event;
the first target service calls a first target network interface, processes the first sub-event to obtain a first processing result, and the first sub-event corresponds to the first target network interface; and
and calling a second target network interface based on a second target service corresponding to the second sub-event in the plurality of services, and processing the second sub-event and the first processing result to obtain a target processing result.
2. The method according to claim 1, wherein the method further comprises:
based on the visual service in the plurality of services, invoking a visual network interface to process the target processing result to obtain data to be sent;
packaging the data to be sent to obtain target data to be sent; and
And sending the target data to be sent to a terminal sending the data processing request.
3. The method according to claim 1, wherein after the generating the to-be-executed event according to the received data processing request, and the processing the to-be-executed event based on the first target service corresponding to the to-be-executed event among the plurality of services, before determining that the to-be-executed event includes a plurality of sub-events, further includes:
sending the event to be executed to a message queue; and
and determining that the service subscribed to the event to be executed, which is included in the message queue, is the first target service.
4. The method of claim 1, wherein the processing the to-be-executed event based on a first target service corresponding to the to-be-executed event among the plurality of services, determining a plurality of sub-events corresponding to the to-be-executed event comprises:
analyzing the event to be executed based on the first target service to obtain step data for executing the event to be executed; and
and determining sub-events corresponding to each step data, and obtaining the plurality of sub-events.
5. The method of claim 1, wherein after the first target service invokes a first target network interface to process the first sub-event to obtain a first processing result, and the invoking a second target network interface based on a second target service corresponding to the second sub-event in the plurality of services, to process the second sub-event and the first processing result to obtain a target processing result, further comprising:
Sending the second sub-event and the first processing result to a message queue; and
determining that the service subscribed to the second sub-event included in the message queue is the second target service.
6. The method according to claim 1, wherein, in the case that the second sub-event is plural, the second target service includes a first sub-target service and a second sub-target service, the calling a second target network interface based on a second target service corresponding to the second sub-event in the plural services, and processing the second sub-event and the first processing result to obtain a target processing result includes:
calling a first sub-target network interface based on a first sub-target service corresponding to a first sub-event in the second sub-events in the plurality of services, and processing the first second sub-event and the first processing result to obtain a first sub-target result, wherein the first second sub-event is a second sub-event which is located in a first position after a plurality of second sub-events are sequenced according to an execution step; and
and calling a second sub-target network interface based on a second sub-target service corresponding to a second sub-event in the second sub-events in the plurality of services, processing the second sub-event, the first sub-target processing result and the first processing result to obtain a second sub-target result, and continuing to execute the steps until each second sub-event is processed to obtain the target result.
7. The method of claim 1, wherein the plurality of services comprises: a login check service, a filtering service, a user creation service, a user deletion service, a user modification service, a user lookup service, a role setting service, an operation authority check service, a resource query service, and a resource modification service.
8. The method of claim 7, wherein, in the case where the second target service is an operation authority check service, the calling a second target network interface based on a second target service corresponding to the second sub-event in the plurality of services, and processing the second sub-event and the first processing result to obtain a target processing result includes:
invoking a second target network interface, and determining a first priority identifier represented by the first processing result and a second priority identifier corresponding to the second sub-event;
judging whether the first priority identifier is higher than the second priority identifier; and
and determining that the target processing result is verified under the condition that the first priority identification is higher than or equal to the second priority identification.
9. A data processing system based on a cloud platform is characterized by comprising an interactive terminal, a message queue, a plurality of services and a virtual cloud platform which are sequentially in communication connection, wherein the plurality of services are in communication connection with the interactive terminal,
the data processing request received by the interactive terminal generates an event to be executed and sends the event to a message queue;
the message queue receives the event to be executed and stores the event to be executed into the message queue;
a first target service corresponding to the event to be executed in the plurality of services acquires the event to be executed from the message queue, processes the event to be executed, and determines a plurality of sub-events corresponding to the event to be executed, wherein the plurality of sub-events comprise a first sub-event and a second sub-event; the first target service calls a first target network interface to be connected with the virtual cloud platform, the virtual cloud platform is utilized to process the first sub-event to obtain a first processing result, and the first sub-event corresponds to the first target network interface; and sending the first processing result and the second sub-event to the message queue;
the message queue receives the first processing result and the second sub-event and stores the first processing result and the second sub-event into the message queue;
And a second target service corresponding to the second sub-event in the plurality of services is used for acquiring the first processing result and the second sub-event from the message queue, calling a second target network interface to connect with the virtual cloud platform, and processing the second sub-event and the first processing result by using the virtual cloud platform to obtain a target processing result.
10. A cloud platform-based data processing apparatus, comprising:
the generating unit is used for generating an event to be executed according to the received data processing request;
the first processing unit is used for processing the event to be executed based on a first target service corresponding to the event to be executed in a plurality of services, and determining a plurality of sub-events corresponding to the event to be executed, wherein the plurality of sub-events comprise a first sub-event and a second sub-event;
the second processing unit is used for calling a first target network interface by the first target service, processing the first sub-event to obtain a first processing result, wherein the first sub-event corresponds to the first target network interface; and
and the third processing unit is used for calling a second target network interface based on a second target service corresponding to the second sub-event in the plurality of services, and processing the second sub-event and the first processing result to obtain a target processing result.
11. The apparatus as recited in claim 10, further comprising:
the fourth processing unit is used for calling a visual network interface based on visual service in the plurality of services, and processing the target processing result to obtain data to be sent;
the packaging unit is used for packaging the data to be sent to obtain target data to be sent; and
and the sending unit is used for sending the target data to be sent to the terminal sending the data processing request.
12. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method of any of the preceding claims 1-8 when executing the computer program.
13. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when executed by a processor, performs the method of any of the preceding claims 1-8.
14. A computer program product comprising computer programs/instructions which, when executed by a processor, implement the method according to any of claims 1-8.
CN202311234938.5A 2023-09-22 2023-09-22 Data processing method, device, system and equipment based on cloud platform Pending CN117271000A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311234938.5A CN117271000A (en) 2023-09-22 2023-09-22 Data processing method, device, system and equipment based on cloud platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311234938.5A CN117271000A (en) 2023-09-22 2023-09-22 Data processing method, device, system and equipment based on cloud platform

Publications (1)

Publication Number Publication Date
CN117271000A true CN117271000A (en) 2023-12-22

Family

ID=89205703

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311234938.5A Pending CN117271000A (en) 2023-09-22 2023-09-22 Data processing method, device, system and equipment based on cloud platform

Country Status (1)

Country Link
CN (1) CN117271000A (en)

Similar Documents

Publication Publication Date Title
US20210042144A1 (en) Virtual machine morphing for heterogeneous migration environments
CN109120678B (en) Method and apparatus for service hosting of distributed storage system
US9369521B2 (en) Naming of distributed business transactions
CN111026635B (en) Software project testing system, method, device and storage medium
US9003356B2 (en) Business process change controller
KR100998515B1 (en) Methods for distributed program execution with file-type association in a client-server network
CN112035228A (en) Resource scheduling method and device
WO2021203979A1 (en) Operation and maintenance processing method and apparatus, and computer device
US20120016999A1 (en) Context for Sharing Data Objects
CN111277432A (en) Configuration information updating method and device, electronic equipment and storage medium
JP2002182909A (en) Method to share application definition
CN113835911B (en) Intranet penetration agent method, system, host and computer readable storage medium
US20170026448A1 (en) Sending a command with client information to allow any remote server to communicate directly with client
WO2019075845A1 (en) Construction method and device for link call relationship, computer device and storage medium
US20210334185A1 (en) Task based service management platform
CN113821254A (en) Interface data processing method, device, storage medium and equipment
CN112882863A (en) Method, device and system for recovering data and electronic equipment
CN114726789A (en) Method, device, equipment and medium for traffic management and traffic management policy configuration
US9542171B2 (en) Managing an application modification process
CN111897843A (en) Configuration method and device of data transfer strategy of Internet of things and computer equipment
CN117271000A (en) Data processing method, device, system and equipment based on cloud platform
US10951738B1 (en) Automatic API integration
CN114090242A (en) Model training method, device, equipment, storage medium and program product
CN110768855B (en) Method and device for testing linkmzation performance
CN111176782A (en) Online experimental method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination