CN112416980A - Data service processing method, device and equipment - Google Patents
Data service processing method, device and equipment Download PDFInfo
- Publication number
- CN112416980A CN112416980A CN202011397730.1A CN202011397730A CN112416980A CN 112416980 A CN112416980 A CN 112416980A CN 202011397730 A CN202011397730 A CN 202011397730A CN 112416980 A CN112416980 A CN 112416980A
- Authority
- CN
- China
- Prior art keywords
- service
- components
- processing
- component
- service processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 20
- 238000012545 processing Methods 0.000 claims abstract description 346
- 238000000034 method Methods 0.000 claims abstract description 90
- 230000008569 process Effects 0.000 claims description 70
- 238000003860 storage Methods 0.000 claims description 20
- 239000000126 substance Substances 0.000 claims description 4
- 238000007726 management method Methods 0.000 description 24
- 238000010586 diagram Methods 0.000 description 18
- 230000008859 change Effects 0.000 description 14
- 238000004590 computer program Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 10
- 230000000712 assembly Effects 0.000 description 4
- 238000000429 assembly Methods 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000015556 catabolic process Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24552—Database cache management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/103—Workflow collaboration or project management
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Entrepreneurship & Innovation (AREA)
- Computational Linguistics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Computing Systems (AREA)
- Stored Programmes (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The embodiment of the application provides a data service processing method, a device and equipment, which are applied to a service processing system, wherein the service processing system comprises a plurality of service components and a plurality of basic components, the service components are used for providing services of at least one service type, the basic components are used for providing basic services, and the method comprises the following steps: acquiring a service processing request; determining a target component in a plurality of service components and a plurality of basic components according to the business processing request, wherein the target component comprises M service components and N basic components, M is an integer greater than or equal to 1, and N is an integer greater than or equal to 0; and processing the service processing request through the target component to obtain a service processing result. The reliability of service processing is improved.
Description
Technical Field
The embodiment of the application relates to the technical field of computers, in particular to a data service processing method, device and equipment.
Background
For many services (e.g., data analysis services, asset management services, etc.), a service system may be designed and service processing may be performed by the service system.
Service components are generally included in a business system, and the processing logic of the business is designed in the service components in a centralized manner. When the business system is used for business processing, the business system can obtain the business processing instruction, and the business processing instruction is processed by the service assembly to obtain a business processing result. However, when the amount of service data is large, the processing pressure of the service component is large, and the service component is likely to be crashed, so that the service system is crashed, and the reliability of service processing is poor.
Disclosure of Invention
The embodiment of the application provides a data service processing method, a data service processing device and data service processing equipment, and the reliability of service processing is improved.
In a first aspect, an embodiment of the present application provides a data service processing method applied to a service processing system, where the service processing system includes multiple service components and multiple basic components, the service components are used to provide services of at least one service type, and the basic components are used to provide basic services, where the method includes:
acquiring a service processing request;
determining a target component among the plurality of service components and the plurality of base components according to the business processing request; the target component comprises M service components and N basic components, wherein M is an integer greater than or equal to 1, and N is an integer greater than or equal to 0;
and processing the service processing request through the target component to obtain a service processing result.
In one possible embodiment, determining a target component among the plurality of service components and the plurality of base components according to the business process request includes:
determining the type of a first service according to the service processing request; the service processing request is used for requesting to process the first service;
determining a first service component among the plurality of service components according to the type of the first service; the first service component is included in the M service components;
determining, by the first service component, a service processing logic corresponding to the first service;
and determining the target component according to the service processing logic.
In one possible embodiment, determining the target component according to the business processing logic includes:
and determining N target basic components and M-1 second service components called by the business processing request according to the business processing logic, and determining that the target components comprise the first service component, the N target basic components and the M-1 second service components.
In a possible implementation manner, the service processing system further includes at least one of the following: a data component, a message event bus, or at least one database; wherein the content of the first and second substances,
the data component is used for providing various data;
the message event bus is used for transmitting events, calls among the service components and calls of the service components to the basic components;
the at least one database is used for providing data reading and writing services.
In one possible embodiment, M is 1, N is 0; processing the service processing request through the target component to obtain a service processing result, wherein the service processing result comprises:
and processing the service processing request through the first service assembly to obtain the service processing result.
In a possible implementation manner, processing, by the first service component, the service processing request to obtain the service processing result includes:
calling the data component and/or operating the at least one database through the first service component to obtain the service processing result; the operations include read operations and/or write operations, wherein the data component is to provide a variety of data.
In one possible embodiment, M is 1, N is greater than or equal to 1; processing the service processing request through the target component to obtain a service processing result, wherein the service processing result comprises:
processing the service processing request according to the first service component to obtain a first intermediate result;
and calling the N basic components according to the service processing logic to process the first intermediate result to obtain the service processing result.
In a possible implementation manner, invoking the N basic components according to the service processing logic to process the first intermediate result, so as to obtain the service processing result, includes:
and calling the N basic components through the message event bus to process the first intermediate result to obtain the service processing result.
In one possible embodiment, said M is greater than 1, said N is greater than or equal to 1; processing the service processing request through the target component to obtain a service processing result, wherein the service processing result comprises:
processing the service processing request according to the first service component to obtain a first intermediate result;
and calling the N basic components and the M-1 second service components according to the service processing logic to process the first intermediate result to obtain the service processing result.
In a possible implementation manner, invoking the N basic components and M-1 second service components according to the service processing logic to process the first intermediate result, so as to obtain the service processing result, includes:
determining a calling sequence of the N basic components and the M-1 second service components according to the business processing logic;
and calling the N basic components and the M-1 second service components to process the first intermediate result according to the calling sequence through the message event bus to obtain the service processing result.
In a second aspect, an embodiment of the present application provides a data service processing apparatus applied to a service processing system, where the service processing system includes a plurality of service components and a plurality of basic components, the service components are configured to provide services of at least one service type, the basic components are configured to provide basic services, the apparatus includes an obtaining module, a determining module, and a processing module, where,
the acquisition module is used for acquiring a service processing request;
the determining module is used for determining a target component in the service components and the basic components according to the service processing request; the target component comprises M service components and N basic components, wherein M is an integer greater than or equal to 1, and N is an integer greater than or equal to 0;
and the processing module is used for processing the service processing request through the target assembly to obtain a service processing result.
In a possible implementation, the determining module is specifically configured to:
determining the type of a first service according to the service processing request; the service processing request is used for requesting to process the first service;
determining a first service component among the plurality of service components according to the type of the first service; the first service component is included in the M service components;
determining, by the first service component, a service processing logic corresponding to the first service;
and determining the target component according to the service processing logic.
In a possible implementation, the determining module is specifically configured to:
and determining N target basic components and M-1 second service components called by the business processing request according to the business processing logic, and determining that the target components comprise the first service component, the N target basic components and the M-1 second service components.
In a possible implementation manner, the service processing system further includes at least one of the following: a data component, a message event bus, or at least one database; wherein the content of the first and second substances,
the data component is used for providing various data;
the message event bus is used for transmitting events, calls among the service components and calls of the service components to the basic components;
the at least one database is used for providing data reading and writing services.
In one possible embodiment, M is 1, N is 0; the processing module is specifically configured to:
and processing the service processing request through the first service assembly to obtain the service processing result.
In a possible implementation, the processing module is specifically configured to:
calling the data component and/or operating the at least one database through the first service component to obtain the service processing result; the operations include read operations and/or write operations, wherein the data component is to provide a variety of data.
In one possible embodiment, M is 1, N is greater than or equal to 1; the processing module is specifically configured to:
processing the service processing request according to the first service component to obtain a first intermediate result;
and calling the N basic components according to the service processing logic to process the first intermediate result to obtain the service processing result.
In a possible implementation, the processing module is specifically configured to:
and calling the N basic components through the message event bus to process the first intermediate result to obtain the service processing result.
In one possible embodiment, said M is greater than 1, said N is greater than or equal to 1; the processing module is specifically configured to:
processing the service processing request according to the first service component to obtain a first intermediate result;
and calling the N basic components and the M-1 second service components according to the service processing logic to process the first intermediate result to obtain the service processing result.
In a possible implementation, the processing module is specifically configured to:
determining a calling sequence of the N basic components and the M-1 second service components according to the business processing logic;
and calling the N basic components and the M-1 second service components to process the first intermediate result according to the calling sequence through the message event bus to obtain the service processing result.
In a third aspect, an embodiment of the present application provides a data service processing device, including: a transceiver, a processor, a memory;
the memory stores computer-executable instructions;
the processor executes computer-executable instructions stored by the memory, causing the processor to perform the data traffic processing method of any of the first aspects.
In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where computer-executable instructions are stored in the computer-readable storage medium, and when the computer-executable instructions are executed by a processor, the computer-readable storage medium is configured to implement the data service processing method according to any one of the first aspect.
In a fifth aspect, an embodiment of the present application provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the computer program implements the data service processing method shown in any one of the first aspect.
The data service processing method, the data service processing device and the data service processing equipment provided by the embodiment of the application can be used for processing services through a service processing system, wherein the service processing system comprises a plurality of service components and a plurality of basic components, the service components are used for providing services of at least one service type, and the basic components are used for providing basic services. After the service processing request is obtained, a target component may be determined in the plurality of service components and the plurality of basic components, and the service processing request is processed by the target component to obtain a service processing result. Aiming at the service corresponding to one service processing request, the service is processed by a plurality of service components and a plurality of basic component middle sub-components (target components), so that the service volume processed by a single component is reduced, the problem of service processing system breakdown caused by overlarge service volume processed by the single component is solved, and the reliability of service processing is further improved.
Drawings
Fig. 1 is a schematic diagram of a service processing system according to an embodiment of the present application;
fig. 2 is a schematic flowchart of a data service processing method according to an embodiment of the present application;
FIG. 3 is a schematic diagram of a resource management system according to an embodiment of the present application;
fig. 4 is a schematic diagram of a module relationship provided in the present embodiment;
fig. 5 is a schematic structural diagram of a data service processing apparatus according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a data service processing device according to an embodiment of the present application.
Detailed Description
For ease of understanding, first, a description is given of the service processing system shown in the embodiment of the present application with reference to fig. 1.
Fig. 1 is a schematic diagram of a service processing system according to an embodiment of the present application. The business processing system may be deployed in a server. Referring to fig. 1, the service system includes: a client interface, a plurality of service components, a plurality of base components, a message event bus, a data component, a plurality of databases, and a system support component.
The client interface may obtain a service processing request, which may be from a client or generated by a service processing system. For example, when a user needs to query product information, the user may send a business process request to the business process system at the client, in which case the business process request comes from the client. When product information in the business system needs to be updated, a business process request may be entered in the business process system, in which case the business process request is generated by the business process system.
The services which can be processed by the service processing system can be subdivided to obtain various types of services, and the different types of services correspond to different service components, that is, the different service components can process the different types of services. For example, the plurality of service components may include an account service component, a product service component, a rights service component, and the like, and the account service component may process account-related services, such as an account creation service, an account inquiry service, and the like; the product service component can process product-related services, such as a product information query service, a product information update service, and the like; the permission service component can process permission related services, such as a function permission setting service, a data permission authentication service and the like.
The common codes required by processing various types of services can be extracted to serve as the basic components, namely, the basic components can assist a plurality of service components to perform service processing, so that the code amount of the service components can be simplified, a plurality of different service components are prevented from including a large number of repeated codes, and the redundancy of the codes is reduced. For example, when a plurality of service components perform service processing, all of the service components need to perform dynamic storage, the dynamic storage related code may be extracted as a dynamic storage basic component, and when the plurality of service components perform service processing, the dynamic storage basic component may be called to implement dynamic storage. According to the functions which can be realized by the basic components, a plurality of basic components can be arranged, and different functions can be realized by different basic components. For example, the plurality of base components may include a mission plan base component, a JSF (jeff) service base component, an Application Programming Interface (API) gateway base component, and the like; the scheduled task base component can execute a predetermined task at a predetermined time; the JSF service infrastructure component can provide event services such as event registration, event discovery, event invocation, and the like. The API gateway infrastructure component may provide data security authentication services, flow control, billing services, and the like.
The message event bus may be used to transmit events, calls between service components, and calls to the underlying components by the service components. For example, after a service component generates an event, the event may be sent to a message event bus, from which the service component that subscribes to the message may retrieve the event. Multiple service components and base components may be connected to the message event bus, one service component may invoke other service components through the message event bus, or one service component may invoke the base component through the message event bus.
The data component is used to provide a variety of data. The service assembly and the basic assembly can acquire data from the data assembly, so that the service assembly and the basic assembly can acquire data directly from the data assembly without inquiring data in a database, and the data acquisition efficiency is high. The data provided by the data component can be integrated data, for example, the data component can process the data in the database to obtain the integrated data, so that the service component and the basic component do not need to perform data integration independently, and the data processing efficiency is improved.
The multiple databases are used for providing data reading and writing services, and different databases can store different types of data. For example, the plurality of databases may include a business library/bus database, a big database, a search database, a cache database, and the like. The service library/bus database may be used to store service data, and the cache database may be used to store cache data during service processing.
The system support components may provide a system architecture such that service components, infrastructure components, etc. may function properly. For example, the system support components may include a Linux system, a Java Development Kit (JDK), Tomcat (a web server), and the like.
In the application, the service processing system shown in fig. 1 may be used to perform service processing, in the service processing system, a plurality of service components are divided according to the types of services, and one service component only needs to process the service of the corresponding type, so that the traffic volume processed by a single service component is reduced, and part of the contents in the service are processed by the basic component, thereby further reducing the traffic volume processed by a single service component, solving the problem of crash of the service processing system caused by too large traffic volume processed by the service component, and further improving the reliability of service processing.
Next, a process of performing the business process by the business process system will be described in detail. It should be noted that the following embodiments may exist alone or in combination with each other, and description of the same or similar contents is not repeated in different embodiments.
Fig. 2 is a schematic flow chart of a data service processing method according to an embodiment of the present application. Referring to fig. 2, the method may include:
s201, acquiring a service processing request.
The execution subject of the embodiment of the present application may be a server, and may also be a data service processing apparatus disposed in the server. The data service processing means may be implemented by software, or by a combination of software and hardware. The data traffic processing means may be a processor in a server. For ease of understanding, the following description will take the execution subject as an example of a server.
The service processing request is used for requesting the server to process the service through the service processing system. For example, the services may include an account inquiry service, an account maintenance service, a product information inquiry service, a product update service, and the like.
When the business processing system is as shown in fig. 1, the service may obtain the business processing request through a client interface in the business processing system.
S202, determining a target component in the plurality of service components and the plurality of basic components according to the type of the business processing request.
The target component comprises M service components and N basic components, wherein M is an integer greater than or equal to 1, and N is an integer greater than or equal to 0.
The target component may be determined by: determining the type of the first service according to the service processing request; determining a first service component among the plurality of service components according to the type of the first service; determining a business processing logic corresponding to a first business through a first service assembly; and determining the target component according to the business processing logic. The service processing request is used for requesting to process a first service; the M service components include a first service component.
The service processing request may include a type of the first service, and accordingly, the type of the first service may be obtained in the service processing request.
A service component may handle one or more types of traffic, one type of traffic being handled by one service component, i.e. one service component may correspond to one or more types of traffic, one type of traffic corresponding to one service component. The service component and the service type have a corresponding relationship, and the first service component can be determined according to the corresponding relationship and the type of the first service. The first service component is a main service component for processing the first service.
The first service assembly comprises a service processing logic corresponding to the first service, and the service processing logic comprises a step of processing the first service and a call to other assemblies (service assemblies or basic assemblies) in the first service processing process.
Determining the obtained target component according to the business logic comprises the following three conditions:
case 1, calls to other components are not included in the business processing logic.
In this case, the target component is determined to comprise the first service component.
Case 2, the business process logic includes calls to the underlying components.
In this case, the determining the called N base components among the plurality of base components according to the business processing logic, and the determining the target component may include: a first service component and N base components. Wherein N is an integer greater than or equal to 1.
Case 3, the business processing logic includes calls to the base component and the second service component.
In this case, determining the N basic components to invoke among the plurality of basic components and the M-1 second service components to invoke among the plurality of service components according to the business processing logic, and determining the target component may include: a first service component, M-1 second service components, and N base components. Wherein N is an integer greater than or equal to 1, and M is an integer greater than 1.
S203, the service processing request is processed through the target component, and a service processing result is obtained.
When the target component includes different components, the process of processing the service processing request is different, and the following three cases may be included:
in case 1, M is 1 and N is 0. That is, the first service component is included in the target component.
In this case, the service processing result can be obtained by processing the service processing request through the first service component. For example, a service processing logic may be obtained, and the first service component processes the service processing request according to the service processing logic to obtain a service processing result.
Optionally, the first service component may call the data component and/or perform an operation on at least one database to obtain a service processing result, where the operation includes a read operation and/or a write operation.
And if the service processing logic indicates to call the data component, calling the data component through the first service component to obtain a service processing result.
And if the business processing logic indicates to operate the at least one database, operating the at least one database through the first service assembly to obtain a business processing result.
If the business processing logic indicates to call the data component and operate the at least one database, the data component is called through the first service component, and the at least one database is operated through the first service component, so that a business processing result is obtained.
In case 2, M is 1 and N is 1 or more. That is, the target component includes the first service component and the N base components.
In this case, the service processing request may be processed according to the first service component to obtain a first intermediate result, and the N basic components may be called according to the service processing logic to process the first intermediate result to obtain a service processing result.
The first intermediate result may be obtained by the first service component invoking the data component and/or performing an operation on the at least one database, the operation comprising a read operation and/or a write operation.
And if the business processing logic indicates to call the data component, calling the data component through the first service component to obtain a first intermediate result.
And if the business processing logic indicates to operate the at least one database, operating the at least one database through the first service component to obtain a first intermediate result.
If the business processing logic indicates to call the data component and operate the at least one database, the data component is called through the first service component, and the at least one database is operated through the first service component, so that a first intermediate result is obtained.
Optionally, the N basic components may be called through the message event bus to process the first intermediate result, so as to obtain a service processing result. And when the N is 1, calling the basic component to process the first intermediate result, and obtaining a service processing result. When N is greater than 1, the N basic components may be called in parallel, so that the N basic components respectively process the first intermediate result, and correspondingly, the service processing result includes a result obtained by processing the first intermediate result by the N basic components.
For example, assuming that the business processing request is a transaction request, the first service component is a transaction service component, and the business processing logic corresponding to the transaction request includes: the method comprises the steps of charging the transaction through the API gateway basic component and storing the transaction information of the transaction through the dynamic storage basic component. After receiving the transaction request, the transaction request may be processed by the transaction service component to obtain a first intermediate result, where the first intermediate result may include a processing result of the transaction, and may also call the API gateway basic component according to the service processing logic to perform charging according to the processing result to obtain a charging result, and call the dynamic storage basic component to perform dynamic storage on the processing record to obtain a dynamic storage result, and accordingly, the service processing result includes: charging results and dynamic storage results.
Case 3, M is greater than 1 and N is greater than or equal to 1. That is, the target component includes a first service component, M-1 second service components, and N base components.
In this case, the service processing request may be processed according to the first service component to obtain a first intermediate result, and the N basic components and the M-1 second service components may be called according to the service processing logic to process the first intermediate result to obtain a service processing result.
In the actual application process, the first service component generally needs to call the second service component through the base component, and therefore, when the target component includes the second service component, the target component generally includes the base component. For example, a first service component can invoke a second service component through a JSF service base component.
The calling sequence of the N basic components and the M-1 second service components can be determined according to the business processing logic, and the N basic components and the M-1 second service components are called to process the first intermediate result according to the calling sequence through the message event bus to obtain a business processing result.
Optionally, if N is 1, the first service component invokes the second service component through the one base component, so as to invoke the second service component to process the first intermediate result, and obtain a service processing result.
Optionally, if N is greater than 1, the N basic components include a basic component (hereinafter referred to as a first basic component) for implementing call between the service components and N-1 basic components (hereinafter referred to as second basic components) for performing service processing, the first basic component calls the second service component to process the first intermediate result to obtain a first processing result, the N-1 second basic components process the first intermediate result to obtain a second processing result, and it is determined that the service processing result includes the first processing result and the second processing result.
In the embodiment shown in fig. 2, the business process may be performed by a business processing system, where the business processing system includes a plurality of service components and a plurality of basic components, the service components are used for providing services of at least one business type, and the basic components are used for providing basic services. After the service processing request is obtained, a target component may be determined in the plurality of service components and the plurality of basic components, and the service processing request is processed by the target component to obtain a service processing result. Aiming at the service corresponding to one service processing request, the service is processed by a plurality of service components and a plurality of basic component middle sub-components (target components), so that the service volume processed by a single component is reduced, the problem of service processing system breakdown caused by overlarge service volume processed by the single component is solved, and the reliability of service processing is further improved.
In the service processing system shown in the embodiment of the application, by adopting a cluster mode, deployment of multiple components (multi-point deployment) is performed, different components can process different services, the service processing capability is improved, and horizontal expansion is facilitated. Under the condition of flow peak, a plurality of assemblies can be used for parallel service processing, and the service processing efficiency is high. High cohesion and low coupling among all the components (service components and basic components) are convenient for later maintenance of all the components, and pluggable interfaces can be reserved on all the components so as to add or delete the components in the service processing system. The network and/or power may be separately configured to each component such that the ability of the business processing system to withstand contingencies, which may include, for example, network outages, power outages, hardware damage, etc., may be enhanced.
On the basis of any of the above embodiments, the following describes the data service processing method in detail by using a specific example.
For example, assuming that the service processing system is an asset management service system (hereinafter referred to as a resource management system), for ease of understanding, first, the architecture of the resource management system will be described with reference to fig. 3.
Fig. 3 is a schematic structural diagram of a resource management system according to an embodiment of the present application. The resource management system may be provided in a server. Referring to FIG. 3, there are included a client interface, a plurality of service components, a data component, a message event bus, a plurality of base components, a plurality of databases, and a system support component.
The client interface may be implemented by Java-Web technology, Vue/React framework, Nginx technology, or the like. The server may receive the service processing request from the client through the client interface, or the service processing request may be input in the resource management system through a visual interface at the server.
The resource management system comprises 8 service components which are respectively marked as an account service component, a product service component, a position taking service component, an authority service component, a transaction service component, a flow service component, a wind control service component and an analysis calculation service component. The service component may receive input information (business process requests) and process the input information to determine output information (business process results). It should be noted that, for convenience of description, description of "component" is omitted in the reference numerals of each service component in fig. 3.
The input information and output information of the 8 service components are described below by table 1:
TABLE 1
The data component may provide various data, for example, the data component may be implemented by a time sequence database (infixdb), a Content Distribution Service (CDS), an AgensGraph multimodal database.
The message event bus may enable transmission of events, calls between service components, and calls of service components to underlying components. For example, events generated by service components may be transmitted to a message event bus, one service component may invoke other service components through the message event bus, and a service component may also invoke the base component through the message event bus.
The basic components comprise a planning task basic component, a JSF service basic component, an API gateway basic component, a dynamic storage basic component, an MQ basic component, a Zookeeper basic component and a service monitoring/log management basic component. It should be noted that, for convenience of description, the description of "base component" is omitted from the reference numerals of the respective base components in fig. 3. The scheduled task base component can perform timed tasks, e.g., perform fixed tasks at fixed times. The JSF service infrastructure component can enable registration, discovery, calls between service components, and the like of service components. The API gateway can realize the functions of data security authentication, current limiting, charging and the like. Dynamic storage may enable dynamic storage of data. The MQ can realize the subpackaging of data and provide a friendly service interface. The Zookeeper basic component may implement cluster consistency, for example, if the cluster includes three service nodes, after one of the service nodes goes down, the other two service nodes may know that the service node goes down and perform corresponding service policy adjustment, and after the service node returns to normal, the other two service nodes may know that the service node returns to normal and perform corresponding service policy adjustment. The service monitoring/log management basic component can monitor and log each service component.
The plurality of databases may include a business library/bus database, a big database, a search database, and a cache database. Different types of data may be stored in different databases. The service library/bus database may be a Mysql database, the big database may be a Hbase/MongoDB database, the search database may be an Elasticsearch database, and the cache database may be a Redis database.
The system support components may include Linux systems, JDK1.8, Tomcat, and the like.
Next, the relationship between the modules (components, buses, etc.) in the resource management system shown in the embodiment of fig. 3 will be described with reference to fig. 4.
Fig. 4 is a schematic diagram of a module relationship provided in the embodiment of the present application. Referring to fig. 4, a plurality of service components and auxiliary modules are included. Wherein, the service assembly includes: the system comprises an authority service component, a product service component, an account service component, a transaction service component, a wind control service component, a position taking service component and an analysis calculation component. The auxiliary module comprises a strategy center, a report center, an execution management system and the like. The supplementary module may be provided in the service component or in the base component, or the supplementary module may be provided separately in the resource management system (the supplementary module is not shown in the resource management system shown in fig. 3).
Multiple service components may generate an event and publish the event to the message event bus, and other service components may subscribe to the event to fetch the event from the message event bus.
The product service component can generate a product change event and publish the product change event to the message event bus, and the account service component can acquire the product change event from the message event bus as the account service component subscribes to the product change event.
The account service component can generate an account change event and publish the account change event to the message event bus, and the execution management system, the wind control service component and the position taking service component can acquire the account change event from the message event bus because the execution management system, the wind control service component and the position taking service component subscribe to the account change event.
The execution management system may generate a transaction change event and issue the transaction change event to the message event bus.
The wind control service assembly can generate a wind control result event and publish the wind control result event to the message event bus, and the report center subscribes the wind control result event, so that the report center can acquire the wind control result event from the message event bus.
The position taking service component can generate a position taking change event and publish the position taking change event to the message event bus, and the wind control service component subscribes the position taking change event, so that the wind control service component can acquire the position taking change event from the message event bus.
After some market events, or market/scheduled task events are generated by some components, the part of events can be sent to a message event bus, and the position holding service component and the wind control service component subscribe to the part of events, so that the part of events can be acquired from the message event bus.
A number of components or modules have dependencies between them, which are indicated in fig. 4 by solid lines without arrows. The dependency may be unidirectional or bidirectional. For example, referring to fig. 4, the product service component depends on the rights service component in the running process, for example, the product service component needs to call the rights service component or use part of data generated by the rights service component.
Next, a data service processing method shown in the embodiment of the present application will be described by taking the resource management system shown in fig. 3 as an example.
For example, the server receives a service processing request, where the service processing request is used to request to process a first service, and assuming that the server determines that the first service corresponds to a product service component, a processing logic corresponding to the first service may be stored in the product service component, and according to different processing logics, processing the first service may include the following three cases:
and in case 1, the product service component processes the first service to determine a service processing result. For example, assuming that the first service is used to request to query product information, the product service component may obtain the product information from the database and return the product information to the client.
And 2, processing the first service by the product service component, and calling the basic component to process the first service so as to determine to obtain a service processing result. For example, assuming that a first business is used to request update of product information, the product service component may update the product information through the product service component and invoke the scheduled task service component to aggregate the product information at a predetermined time.
And 3, processing the first business by the product service component, and calling the basic component and other service components to process the first business so as to determine to obtain a business processing result. For example, assuming that the first service is used for updating the product information recommended to each account, the product service component may call the account service through the JSF service to update the product information recommended to each account.
In the resource management system, services of the whole resource management life cycle are disassembled, scenes, users, functions and input and output of each service of the resource management system are summarized and summarized, and for each characteristic, input and output, the service data volume, the service frequency, the flow peak, the consistency requirement, the availability requirement, the expansibility requirement and the like of each service link are considered, and proper choices are made in the consistency, the availability and the partition fault tolerance so as to design a service architecture adapting to the resource management service system and split the service. The problems of high availability, high throughput, consistency, expandability, easy access and the like of the whole system are solved, the service management difficulty is reduced, and the whole iterative development efficiency of the resource system is improved.
Fig. 5 is a schematic structural diagram of a data service processing apparatus according to an embodiment of the present application. The data business processing device 10 comprises an acquisition module 11, a determination module 12 and a processing module 13, wherein,
the obtaining module 11 is configured to obtain a service processing request;
the determining module 12 is configured to determine a target component among the plurality of service components and the plurality of base components according to the service processing request; the target component comprises M service components and N basic components, wherein M is an integer greater than or equal to 1, and N is an integer greater than or equal to 0;
the processing module 13 is configured to process the service processing request through the target component to obtain a service processing result.
The data service processing apparatus provided in the embodiment of the present application may execute the technical solution shown in the foregoing method embodiment, and the implementation principle and the beneficial effect thereof are similar, which are not described herein again.
In a possible implementation, the determining module 12 is specifically configured to:
determining the type of a first service according to the service processing request; the service processing request is used for requesting to process the first service;
determining a first service component among the plurality of service components according to the type of the first service; the first service component is included in the M service components;
determining, by the first service component, a service processing logic corresponding to the first service;
and determining the target component according to the service processing logic.
In a possible implementation, the determining module 12 is specifically configured to:
and determining N target basic components and M-1 second service components called by the business processing request according to the business processing logic, and determining that the target components comprise the first service component, the N target basic components and the M-1 second service components.
In a possible implementation manner, the service processing system further includes at least one of the following: a data component, a message event bus, or at least one database; wherein the content of the first and second substances,
the data component is used for providing various data;
the message event bus is used for transmitting events, calls among the service components and calls of the service components to the basic components;
the at least one database is used for providing data reading and writing services.
In one possible embodiment, M is 1, N is 0; the processing module 13 is specifically configured to:
and processing the service processing request through the first service assembly to obtain the service processing result.
In a possible implementation, the processing module 13 is specifically configured to:
and calling the data assembly and/or operating the at least one database through the first service assembly to obtain the service processing result, wherein the operation comprises reading operation and/or writing operation, the service processing result is obtained, and the data assembly is used for providing various data.
In one possible embodiment, M is 1, N is greater than or equal to 1; the processing module 13 is specifically configured to:
processing the service processing request according to the first service component to obtain a first intermediate result;
and calling the N basic components according to the service processing logic to process the first intermediate result to obtain the service processing result.
In a possible implementation, the processing module 13 is specifically configured to:
and calling the N basic components through the message event bus to process the first intermediate result to obtain the service processing result.
In one possible embodiment, said M is greater than 1, said N is greater than or equal to 1; the processing module 13 is specifically configured to:
processing the service processing request according to the first service component to obtain a first intermediate result;
and calling the N basic components and the M-1 second service components according to the service processing logic to process the first intermediate result to obtain the service processing result.
In a possible implementation, the processing module 13 is specifically configured to:
determining a calling sequence of the N basic components and the M-1 second service components according to the business processing logic;
and calling the N basic components and the M-1 second service components to process the first intermediate result according to the calling sequence through the message event bus to obtain the service processing result.
The data service processing apparatus provided in the embodiment of the present application may execute the technical solution shown in the foregoing method embodiment, and the implementation principle and the beneficial effect thereof are similar, which are not described herein again.
Fig. 6 is a schematic structural diagram of a data service processing device according to an embodiment of the present application. Referring to fig. 6, the service processing device 20 may include: a transceiver 21, a memory 22, a processor 23. The transceiver 21 may include: a transmitter and/or a receiver. The transmitter may also be referred to as a sender, a transmitter, a sending port or a sending interface, and the like, and the receiver may also be referred to as a receiver, a receiving port or a receiving interface, and the like. Illustratively, the transceiver 21, the memory 22, and the processor 23 are connected to each other by a bus 24.
The memory 22 is used for storing program instructions;
the processor 23 is configured to execute program instructions stored in the memory to cause the service processing device 20 to perform any of the data service processing methods shown above.
The service processing device shown in the embodiment of fig. 6 may execute the technical solution shown in the above method embodiment, and the implementation principle and the beneficial effect are similar, which are not described herein again.
An embodiment of the present application provides a computer-readable storage medium, in which computer-executable instructions are stored, and when the computer-executable instructions are executed by a processor, the computer-readable storage medium is configured to implement the data service processing method.
An embodiment of the present application may further provide a computer program product, which includes a computer program, and when the computer program is executed by a processor, the data service processing method may be implemented.
All or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The aforementioned program may be stored in a readable memory. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned memory (storage medium) includes: read-only memory (ROM), RAM, flash memory, hard disk, solid state disk, magnetic tape (magnetic tape), floppy disk (flexible disk), optical disk (optical disk), and any combination thereof.
Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processing unit of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the embodiments of the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the embodiments of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to encompass such modifications and variations.
In the present application, the terms "include" and variations thereof may refer to non-limiting inclusions; the term "or" and variations thereof may mean "and/or". The terms "first," "second," and the like in this application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. In the present application, "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
Claims (13)
1. A data service processing method is applied to a service processing system, the service processing system comprises a plurality of service components and a plurality of basic components, the service components are used for providing services of at least one service type, the basic components are used for providing basic services, and the method comprises the following steps:
acquiring a service processing request;
determining a target component among the plurality of service components and the plurality of base components according to the business processing request; the target component comprises M service components and N basic components, wherein M is an integer greater than or equal to 1, and N is an integer greater than or equal to 0;
and processing the service processing request through the target component to obtain a service processing result.
2. The method of claim 1, wherein determining a target component among the plurality of service components and the plurality of base components based on the business process request comprises:
determining the type of a first service according to the service processing request; the service processing request is used for requesting to process the first service;
determining a first service component among the plurality of service components according to the type of the first service; the first service component is included in the M service components;
determining, by the first service component, a service processing logic corresponding to the first service;
and determining the target component according to the service processing logic.
3. The method of claim 2, wherein determining the target component according to the business processing logic comprises:
and determining N target basic components and M-1 second service components called by the business processing request according to the business processing logic, and determining that the target components comprise the first service component, the N target basic components and the M-1 second service components.
4. The method according to claim 2 or 3, wherein the service processing system further comprises at least one of: a data component, a message event bus, or at least one database; wherein the content of the first and second substances,
the data component is used for providing various data;
the message event bus is used for transmitting events, calls among the service components and calls of the service components to the basic components;
the at least one database is used for providing data reading and writing services.
5. The method of claim 4, wherein M is 1, and N is 0; processing the service processing request through the target component to obtain a service processing result, wherein the service processing result comprises:
and processing the service processing request through the first service assembly to obtain the service processing result.
6. The method of claim 5, wherein processing the service processing request by the first service component to obtain the service processing result comprises:
calling the data component and/or operating the at least one database through the first service component to obtain the service processing result; the operations include read operations and/or write operations, and the data component is used to provide a variety of data.
7. The method of claim 4, wherein M is 1, and N is greater than or equal to 1; processing the service processing request through the target component to obtain a service processing result, wherein the service processing result comprises:
processing the service processing request according to the first service component to obtain a first intermediate result;
and calling the N basic components according to the service processing logic to process the first intermediate result to obtain the service processing result.
8. The method of claim 7, wherein invoking the N base components according to the business processing logic to process the first intermediate result to obtain the business processing result comprises:
and calling the N basic components through the message event bus to process the first intermediate result to obtain the service processing result.
9. The method of claim 4, wherein M is greater than 1, and N is greater than or equal to 1; processing the service processing request through the target component to obtain a service processing result, wherein the service processing result comprises:
processing the service processing request according to the first service component to obtain a first intermediate result;
and calling the N basic components and the M-1 second service components according to the service processing logic to process the first intermediate result to obtain the service processing result.
10. The method of claim 9, wherein invoking the N basic components and M-1 second service components according to the business processing logic to process the first intermediate result to obtain the business processing result comprises:
determining a calling sequence of the N basic components and the M-1 second service components according to the business processing logic;
and calling the N basic components and the M-1 second service components to process the first intermediate result according to the calling sequence through the message event bus to obtain the service processing result.
11. A data business processing device is applied to a business processing system, the business processing system comprises a plurality of service components and a plurality of basic components, the service components are used for providing services of at least one business type, the basic components are used for providing basic services, the device comprises an acquisition module, a determination module and a processing module, wherein,
the acquisition module is used for acquiring a service processing request;
the determining module is configured to determine a target component from the plurality of service components and the plurality of basic components according to the service processing request, where the target component includes M service components and N basic components, M is an integer greater than or equal to 1, and N is an integer greater than or equal to 0;
and the processing module is used for processing the service processing request through the target assembly to obtain a service processing result.
12. A data traffic processing device, comprising: a transceiver, a processor, a memory;
the memory stores computer-executable instructions;
the processor executing the computer-executable instructions stored by the memory causes the processor to perform the data traffic processing method of any of claims 1 to 10.
13. A computer-readable storage medium having computer-executable instructions stored thereon, which when executed by a processor, are configured to implement the data traffic processing method of any one of claims 1 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011397730.1A CN112416980B (en) | 2020-12-03 | 2020-12-03 | Data service processing method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011397730.1A CN112416980B (en) | 2020-12-03 | 2020-12-03 | Data service processing method, device and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112416980A true CN112416980A (en) | 2021-02-26 |
| CN112416980B CN112416980B (en) | 2024-04-09 |
Family
ID=74829785
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011397730.1A Active CN112416980B (en) | 2020-12-03 | 2020-12-03 | Data service processing method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112416980B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112991064A (en) * | 2021-04-20 | 2021-06-18 | 深圳华锐金融技术股份有限公司 | Service processing method, device, computer equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107645508A (en) * | 2017-10-16 | 2018-01-30 | 深圳市买买提乐购金融服务有限公司 | A kind of data handling system, method, client and server |
| CN110825539A (en) * | 2019-11-07 | 2020-02-21 | 中国联合网络通信集团有限公司 | Service processing method and device |
| CN110851114A (en) * | 2019-10-24 | 2020-02-28 | 山东中创软件工程股份有限公司 | Business system development method and device, electronic equipment and storage medium |
-
2020
- 2020-12-03 CN CN202011397730.1A patent/CN112416980B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107645508A (en) * | 2017-10-16 | 2018-01-30 | 深圳市买买提乐购金融服务有限公司 | A kind of data handling system, method, client and server |
| CN110851114A (en) * | 2019-10-24 | 2020-02-28 | 山东中创软件工程股份有限公司 | Business system development method and device, electronic equipment and storage medium |
| CN110825539A (en) * | 2019-11-07 | 2020-02-21 | 中国联合网络通信集团有限公司 | Service processing method and device |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112991064A (en) * | 2021-04-20 | 2021-06-18 | 深圳华锐金融技术股份有限公司 | Service processing method, device, computer equipment and storage medium |
| CN112991064B (en) * | 2021-04-20 | 2021-11-19 | 深圳华锐金融技术股份有限公司 | Service processing method, device, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112416980B (en) | 2024-04-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9887889B1 (en) | State reconciliation using event tracking and polling | |
| CN111258565B (en) | Method, system, server and storage medium for generating applet | |
| CN103649915A (en) | Associated plugin management method, device and system | |
| CN111371898B (en) | Message monitoring method, device, equipment and storage medium | |
| CN110062041B (en) | Method and device for changing IOT (input/output) equipment based on block chain | |
| CN110769018A (en) | Message pushing method and device | |
| CN109104368B (en) | Connection request method, device, server and computer readable storage medium | |
| CN102033741A (en) | North interface system and realization method thereof | |
| CN115562757A (en) | Data processing method, configuration center system, electronic device, and storage medium | |
| CN112416980A (en) | Data service processing method, device and equipment | |
| US8566279B1 (en) | Enhanced data collection techniques | |
| CN116755799A (en) | Service arrangement system and method | |
| CN110807058B (en) | Method and system for exporting data | |
| KR20140037605A (en) | Method for active processing ami using cim schema and system topology information | |
| US20190109886A1 (en) | Selected data exchange | |
| CN112910835B (en) | Block chain-based configuration management method, apparatus, system, device, and medium | |
| CN112671877B (en) | Data processing method and device | |
| CN114756227A (en) | Resource release processing method and device | |
| CN112860292A (en) | Configuration management method and device based on application | |
| CN112347191A (en) | Method and device for sharing and exchanging data, computer equipment and storage medium | |
| CN113741912A (en) | Model management system, method, device and equipment | |
| CN112637288A (en) | Streaming data distribution method and system | |
| CN117170941B (en) | Data backup method, device, electronic equipment and storage medium | |
| CN114268540B (en) | Rule engine optimization method, device and equipment | |
| CN116541133B (en) | Nanotube method for container application, device and electronic equipment thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Room 221, 2 / F, block C, 18 Kechuang 11th Street, Daxing District, Beijing, 100176 Applicant after: Jingdong Technology Holding Co.,Ltd. Address before: Room 221, 2 / F, block C, 18 Kechuang 11th Street, Beijing Economic and Technological Development Zone, 100176 Applicant before: Jingdong Digital Technology Holding Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |