CN109213770B - Data processing method, system, computer device and storage medium - Google Patents

Data processing method, system, computer device and storage medium Download PDF

Info

Publication number
CN109213770B
CN109213770B CN201810584611.3A CN201810584611A CN109213770B CN 109213770 B CN109213770 B CN 109213770B CN 201810584611 A CN201810584611 A CN 201810584611A CN 109213770 B CN109213770 B CN 109213770B
Authority
CN
China
Prior art keywords
service
micro
scheduling center
order
data processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810584611.3A
Other languages
Chinese (zh)
Other versions
CN109213770A (en
Inventor
陈培镇
陈泽晖
李琦
刘琼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ping An Technology Shenzhen Co Ltd
Original Assignee
Ping An Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ping An Technology Shenzhen Co Ltd filed Critical Ping An Technology Shenzhen Co Ltd
Priority to CN201810584611.3A priority Critical patent/CN109213770B/en
Priority to PCT/CN2018/104727 priority patent/WO2019232962A1/en
Publication of CN109213770A publication Critical patent/CN109213770A/en
Application granted granted Critical
Publication of CN109213770B publication Critical patent/CN109213770B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present invention relates to a data processing method, system, computer device and storage medium, the method comprising: the API Gateway receives a service request sent by a client and sends the service request to an order field micro-service, and the order field micro-service generates an order event by sequencing the selected micro-services; the transaction scheduling center receives the order event and then interfaces with the micro service to execute the order event and output a full service result; and the micro-service sends the data exchange result to the order field micro-service through the transaction scheduling center so as to complete the data exchange of each micro-service. And the transaction scheduling center is added to coordinate all the micro services, so that the consistency of data is ensured when all the micro services call a plurality of databases.

Description

Data processing method, system, computer device and storage medium
Technical Field
The present invention relates to the field of information technology, and in particular, to a data processing method, system, computer device, and storage medium.
Background
A database is a repository that organizes, stores, and manages data according to a data structure. In the informationized society, various information resources are fully and effectively managed and utilized, and the informationized society is a precondition for scientific research and decision management. The database technology is a core part of various information systems such as a management information system, an office automation system, a decision support system and the like, and is an important technical means for scientific research and decision management. The existing relational databases have the ability to address complex transaction scenarios, and the relational databases satisfy ACID characteristics, namely atomicity, consistency, isolation, and permanence. The database with the ACID characteristic supports strong consistency of data, and can ensure that the data cannot be inconsistent.
However, under the micro-service architecture, each micro-service has its own database, and once the system under the micro-service architecture cannot simply meet the ACID characteristics, the situation that the data under the micro-service architecture is inconsistent occurs, including when one micro-service spans multiple databases simultaneously, multiple data are required to be operated simultaneously, so that partial data update failure and partial data update success of the data in the databases may occur, and the consistency of the data cannot be ensured; the micro-service has strong dependence on the database, and is easy to invade the micro-service system, so that data loss is caused; the existing service under the micro service item cannot distinguish service abnormality and technical abnormality, and can not process the abnormal situation in time.
Disclosure of Invention
In view of this, it is necessary to provide a data processing method, system, computer device, and storage medium for solving the problems of data loss and the like caused by the fact that data update is not uniform and a database is vulnerable to damage when data processing is performed.
The data processing method specifically comprises the following specific steps:
an interface Gateway API Gateway receives a service request sent by a client and sends the service request to an order field micro-service, the order field micro-service selects micro-services to be accessed according to the service request and sorts the selected micro-services according to the sequence of meeting the service request so as to generate order events for accessing the micro-services one by one, and the API Gateway and the order field micro-service are arranged in an application system;
the transaction scheduling center receives the order event and then connects each micro service, accesses the micro service one by one to execute the order event, and outputs a service result meeting the service request, wherein the transaction scheduling center is arranged in the application system;
the micro-service sends the data exchange result generated when executing the order event to the transaction scheduling center, and the transaction scheduling center gathers the data exchange result and sends the data exchange result to the order field micro-service so as to complete the data updating of each micro-service.
In one embodiment, the generating order events that access the microservices one by one includes:
the method comprises the steps that a client obtains a service request through an input interface, a sending interface is called to send the service request to an API Gateway, the API Gateway is used for abutting an order field micro-service through a data interface, the service request is sent to the order field micro-service, the order field micro-service selects micro-services needing to be accessed according to the service request, the selected micro-services are ordered according to the sequence of meeting the service request, order events of accessing the micro-services one by one are generated, and the input interface and the sending interface are arranged on the client.
In one embodiment, the outputting the service result satisfying the service request includes:
the transaction scheduling center comprises a data processing interface, the transaction scheduling center receives order events sent by the order field micro-service after the transaction scheduling center is used for abutting the order field micro-service through the data processing interface, the transaction scheduling center is used for abutting other micro-service through the data processing interface, accessing the micro-service one by one to execute the order events, outputting a service result meeting the service request, and the transaction scheduling center is arranged in the application system.
In one embodiment, the summarizing the data alternating results, updating the microservice data includes:
after the micro-service provides the required service for the micro-service according to the requirement of the service request, the micro-service calls a database corresponding to the micro-service to record the data updating result generated by the service request, the micro-service sends the data updating result to a transaction scheduling center, the transaction scheduling center comprises a data processing core, the transaction scheduling center gathers the data updating result by calling the data processing core and sends the data updating result to the micro-service in the order field so as to finish the data updating of each micro-service, and the database is arranged on an operation interface of the micro-service.
In one embodiment, the database comprises Oracle, mySQL, DB2 or Sybase.
In one embodiment, the clients include a mobile phone client, a computer client, and a third party client;
the application system comprises an Nginx application system and a WEB application system.
In one embodiment, when the transaction scheduling center performs the docking micro service, an abnormal condition that the docking micro service is overtime or the micro service cannot provide service occurs, the transaction scheduling center feeds back the abnormal condition to the order field micro service, and the order field micro service performs a retry mechanism on the order event until the micro service can re-execute the order event.
Based on the same technical conception, the invention also provides a data processing system, which comprises an order event generating unit, an output service result unit and a data updating unit;
the order event generating unit is used for receiving a service request sent by a client by an interface Gateway API Gateway, sending the service request to the order field micro-service, selecting micro-services to be accessed by the order field micro-service according to the service request, and sequencing the selected micro-services according to the sequence of meeting the service request so as to generate order events for accessing the micro-services one by one, wherein the API Gateway and the order field micro-service are arranged in an application system;
the business result outputting unit is used for docking each micro service after the business scheduling center receives the order event, accessing the micro services one by one to execute the order event, outputting a business result meeting the business request, and the business scheduling center is arranged in the application system;
the data updating unit is configured to send a data updating result generated when the order event is executed to the transaction scheduling center by using the micro service, and the transaction scheduling center gathers the data updating result and sends the data updating result to the order field micro service to complete data updating of each micro service.
Based on the same technical concept, the invention also provides a computer device, which comprises a memory and a processor, wherein the memory stores computer readable instructions, and the computer readable instructions, when executed by the processor, cause the processor to execute the steps of the data processing method.
Based on the same technical idea, the present invention also provides a storage medium storing computer readable instructions, which when executed by one or more processors, cause the one or more processors to perform the steps of the data processing method as described above.
The data processing method, the system, the computer equipment and the storage medium receive the service request sent by the client through the API Gateway, and send the service request to the order field micro-service, wherein the order field micro-service selects the micro-service which is required to be accessed by the service request according to the service request, and sorts the selected micro-service according to the sequence which meets the service request so as to generate order events which access the micro-service one by one; the transaction scheduling center receives the order event and then connects each micro service, accesses the micro service one by one to execute the order event, and outputs a service result meeting the service request; and the micro-service transmits the data exchange result generated when the order event is executed to the transaction scheduling center, and the transaction scheduling center gathers the data exchange result and transmits the data exchange result to the order field micro-service so as to complete the data updating of each micro-service. Therefore, the transaction scheduling center is added to coordinate the micro services, so that when the micro services call a plurality of databases, the consistency of the data is ensured, meanwhile, the processing of abnormal conditions is increased through a retry mechanism, the instantaneity of data call is improved, the consistency of the data is ensured, the dependence degree of the micro services on the databases is reduced, and the intrusion into a micro service system is avoided.
Drawings
FIG. 1 is a flow chart of a data processing method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram illustrating an environment for a data processing method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a data processing system in accordance with one embodiment of the present invention;
1-a mobile phone client; 2-API Gateway; 3-order field microservice; 4-an account domain microservice; 5-customer domain microservices; 6-product domain microservices; 7-a transaction scheduling center; 8-Nginx application system.
Detailed Description
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise, as will be understood by those skilled in the art. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, procedures, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, procedures, steps, operations, elements, components, and/or groups thereof.
FIG. 1 is a flowchart of a data processing method according to an embodiment of the present invention, as shown in FIG. 1, the data processing method may include the following steps:
step S1: the method comprises the steps that an interface Gateway API Gateway receives a service request sent by a client and sends the service request to the order field micro-service, the order field micro-service selects micro-service to be accessed according to the service request, the selected micro-service is ordered according to the sequence of meeting the service request, order events for accessing the micro-service one by one are generated, and the API Gateway and the order field micro-service are arranged in an application system.
In this embodiment, the generating order events for accessing the micro-services one by one includes:
the client acquires a service request through the input interface, calls a sending interface to send the service request to the API Gateway, the API Gateway is used for abutting an order field micro-service through a data interface, the service request is sent to the order field micro-service, the order field micro-service selects micro-services to be accessed according to the service request, the selected micro-services are ordered according to the sequence of meeting the service request, order events for accessing the micro-services one by one are generated, and the input interface and the sending interface are arranged on the client.
The client side is a program corresponding to the server and providing local service for the client, and comprises a mobile phone client side, a computer client side and a third party client side. The client in the embodiment can be selected as a mobile phone client, and the mobile phone client refers to software running on a mobile phone terminal, which can provide perfect, convenient, various and efficient mobile marketing for enterprises. The user can input the service request through the input interface of the mobile phone client at any time and any place, and send the service request through calling the sending interface.
In this embodiment, the application system may be selected as an nginnx application system, where the nginnx application system is a high-performance HTTP and reverse proxy server, and is used for load balancing, and may directly support the services of the Rails and the PHP programs in the application system, or support the services of the HTTP server. Meanwhile, the Nginx application system has the advantages of less occupied memory, strong concurrency capacity and the like.
In this embodiment, the API Gateway refers to an API Gateway, that is, the service request sent by the client needs to pass through the API Gateway and then reach the order field micro-service. The API Gateway is used as the same interface of the system to the outside, so that the perception of a calling party on service realization can be reduced.
The mobile phone client acquires a service request through an input interface, and invokes a sending interface to send the service request; setting an API Gateway and an order field micro-service on the Nginx application system, after the API Gateway receives the service request sent by the mobile phone client, calling a data interface to access the order field micro-service, sending the service request to the order field micro-service, selecting micro-services to be accessed according to the service request, and sequencing the selected micro-services according to the sequence of meeting the service request so as to generate order events for accessing the micro-services one by one, wherein the input interface and the sending interface are arranged on the mobile phone client.
Step S2: and the transaction scheduling center receives the order event and then connects each micro service, accesses the micro services one by one to execute the order event, and outputs a service result meeting the service request, wherein the transaction scheduling center is arranged in the application system.
In this embodiment, the outputting the service result that satisfies the service request includes:
the transaction scheduling center comprises a data processing interface, the transaction scheduling center receives order events sent by the order field micro-service after the transaction scheduling center is used for abutting the order field micro-service through the data processing interface, the transaction scheduling center is used for abutting other micro-service through the data processing interface, accessing the micro-service one by one to execute the order events, outputting a service result meeting the service request, and the transaction scheduling center is arranged in the application system.
In this embodiment, the application system may be selected as an nginnx application system, where the nginnx application system is a high-performance HTTP and reverse proxy server, and is used for load balancing, and may directly support the services of the Rails and the PHP programs in the application system, or support the services of the HTTP server. Meanwhile, the Nginx application system has the advantages of less occupied memory, strong concurrency capacity and the like.
The transaction scheduling center aims at ensuring the real-time validity of data in a database so as to ensure that each micro-service can reliably run, and comprises a data processing interface, and the transaction scheduling center interfaces each micro-service through the data processing interface so as to execute the order event.
And setting a transaction scheduling center on the Nginx application system, wherein the service scheduling center is used for abutting the micro-service in the order field through the data processing interface, receiving the order event sent by the service scheduling center, abutting other micro-services through the data processing interface, accessing the micro-services one by one to execute the order event, and outputting a service result meeting the service request.
Step S3: the micro-service sends the data exchange result generated when executing the order event to the transaction scheduling center, and the transaction scheduling center gathers the data exchange result and sends the data exchange result to the order field micro-service so as to complete the data updating of each micro-service.
In this embodiment, the updating the microservice data includes:
after the micro service provides the required service for the micro service according to the requirement of the service request, the micro service records the data exchange result generated by the service request by calling a database corresponding to the micro service and sends the data exchange result to a transaction scheduling center, the transaction scheduling center comprises a data processing core, the transaction scheduling center gathers the data exchange result by calling the data processing core and sends the data exchange result to the order field micro service so as to complete the data exchange of each micro service, and the database is arranged on an operation interface of the micro service.
The database is a data set which is stored together in a certain mode, can be shared by a plurality of users, has the smallest redundancy, is independent of application programs, has integrity and sharing, is a core part for managing various information such as an information system, an office automation system, a decision support system and the like, and is an important technical means for scientific research and decision management. The database includes Oracle, mySQL, DB2 or Sybase. In this embodiment, the database may be selected as an Oracle database, which is a relational database management system of Oracle corporation, and is always in the leading position in the database field, and the system has good portability, convenient use, strong functions, and can be suitable for various large, medium, small and microcomputer environments.
When the transaction scheduling center performs the docking micro-service, abnormal conditions that the docking micro-service is overtime or the micro-service cannot provide service occur, the transaction scheduling center feeds back the abnormal conditions to the order field micro-service, and the order field micro-service performs a retry mechanism on the order event until the micro-service can re-execute the order event. For example, when the transaction scheduling center interfaces with the micro service through the data processing interface, a situation of docking timeout occurs, the transaction scheduling center feeds back the abnormal situation to the order field micro service, and the order field micro service resends a service request, so that the transaction scheduling center rechecks with the micro service.
According to the embodiment, the transaction scheduling center is added to coordinate all the micro services, so that the consistency of data is guaranteed when all the micro services call a plurality of databases. Meanwhile, the retry mechanism increases the processing of abnormal conditions, improves the real-time property of data call and ensures the consistency of data.
Fig. 2 is an environmental schematic diagram of a data processing method according to an embodiment of the present invention, as shown in fig. 2, a selected client is a mobile phone client 1, a selected application is an nmginx application 8, and an API Gateway2 is set on the nmginx application, an order field micro-service 3, an account field micro-service 4, a customer field micro-service 5, a product field micro-service 6 and a transaction scheduling center 7.
An input interface and a sending interface are arranged on the mobile phone client 1, the mobile phone client 1 obtains a business request of a buying foundation at the input interface, the sending interface is called to send the business request of the buying foundation to the API Gateway2 through the Internet, a data interface is arranged on the API Gateway2, the business request of the buying foundation is sent to the order field micro-service 3 through the data interface in a butt joint mode with the order field micro-service 3, after receiving the business request, the order field micro-service 3 selects micro-services which are required to be accessed by buying the foundation, the selected micro-services are ordered according to the sequence of completing the buying foundation, the order events of the buying foundation are sent to the transaction scheduling center 7 after being generated, the transaction scheduling center 7 comprises a data processing core and a data processing interface, the transaction scheduling center 7 receives the order events of the buying foundation through the data processing interface, and the micro-service 3 is in butt joint mode according to the micro-service sequence displayed on the order of the foundation, so that the buying of the foundation is completed.
Invoking the product domain micro-service 6, and judging whether the fund can be purchased or not by the product domain micro-service 6 according to the buying amount of the fund product under the flag of the fund company. When the product field micro service 6 judges that the fund can not be purchased, the judging result is fed back to the transaction scheduling center 7, and the transaction scheduling center 7 feeds back to the mobile phone client 1 through the API Gateway2 so as to inform the user that the fund can not be purchased. The product field micro service 6 feeds back the judging result to the transaction scheduling center 7 after judging that the fund can be purchased, the transaction scheduling center 7 is connected with the customer field micro service 5 in a butt joint mode, the customer field micro service 5 judges whether the user meets the buying condition of the fund according to the conditions of user account deposit, the buying amount of the fund, buying time and the like, when judging that the user does not meet the buying condition of the fund, the customer field micro service 5 feeds back the judging result to the transaction scheduling center 7, and the transaction scheduling center 7 feeds back the transaction scheduling center to the mobile phone client 1 through the API Gateway2 so as to inform the user that the buying condition of the fund is not met. When the customer domain micro service 5 judges that the customer meets the buying condition of the fund, the judgment result is fed back to the transaction scheduling center 7, the transaction scheduling center 7 is in butt joint with the account domain micro service 4, the account domain micro service 4 deducts the money of the fund buying from the account deposit of the user according to the buying amount of the fund, records the buying transaction of the fund, feeds back the money of the fund deducted from the account deposit of the user to the transaction scheduling center 7, and the transaction scheduling center 7 feeds back to the mobile phone client 1 through the API Gateway2 to inform the user of the success of the buying of the fund and the deduction of the buying fund.
After the transaction of the purchased funds is completed, the product domain micro-service 6 feeds back the purchased amount of the funds to the transaction scheduling center 7, the customer domain micro-service 6 feeds back account deposit information of the user to the transaction scheduling center 7, and the account domain micro-service 4 feeds back the money information deducted from the account deposit of the user due to the purchased funds to the transaction scheduling center 7. The transaction scheduling center 7 gathers the data exchange results in each micro service by calling the data processing core therein, and sends the data exchange results to the order field micro service 3.
In the above embodiment, by inputting a service request of buying a fund at the mobile phone client 1, using the API Gateway2 to select a required micro-service for buying the fund, and generating order events according to the sequence, the transaction scheduling center 7 accesses the micro-service one by one after receiving the order events, so as to execute the order events, and complete the buying of the fund. The transaction scheduling center 7 saves the time of accessing all the micro services one by one, and improves the fund buying efficiency.
Based on the same technical conception, the embodiment of the invention also provides a data processing system, as shown in fig. 3, which comprises an order event generating unit, an output service result unit and a data updating unit;
the order generation event unit is used for receiving a service request sent by a client by using an API Gateway, sending the service request to the order field micro-service, selecting micro-services to be accessed according to the service request by using the order field micro-service, and sequencing the selected micro-services according to the sequence of meeting the service request so as to generate order events for accessing the micro-services one by one, wherein the API Gateway and the order field micro-service are arranged in an application system;
the business result outputting unit is used for docking each micro service after the business scheduling center receives the order event, accessing the micro services one by one to execute the order event, outputting a business result meeting the business request, and the business scheduling center is arranged in the application system;
the data updating unit is used for sending the data updating result generated when the order event is executed to the transaction scheduling center by the micro service, and the transaction scheduling center gathers the data updating result and sends the data updating result to the order field micro service so as to complete the data updating of each micro service.
In the above embodiment, the order event generating unit receives the service request sent by the client through the API Gateway, and sends the service request to the order field micro-service, where the order field micro-service selects the micro-service to be accessed according to the service request, and sorts the selected micro-service according to the order of satisfying the service request, so as to generate the order event of accessing the micro-service one by one; receiving the order event by the transaction scheduling center and then docking each micro service by utilizing the output service result unit, accessing the micro services one by one to execute the order event, and outputting a service result meeting the service request; the data updating unit utilizes the micro-service to send the data updating result generated when the order event is executed to the transaction scheduling center, and the transaction scheduling center gathers the data updating result and sends the data updating result to the order field micro-service so as to complete the data updating of each micro-service. And the transaction scheduling center is added to coordinate all the micro services, so that the consistency of data is ensured when all the micro services call a plurality of databases.
Based on the same technical concept, the invention also provides a computer device, which comprises a memory, a processor and computer readable instructions stored on the memory and capable of running on the processor, wherein the processor executes the computer readable instructions to realize the following steps: the method comprises the steps that an interface Gateway API Gateway receives a service request sent by a client and sends the service request to the order field micro-service, the order field micro-service selects micro-services to be accessed according to the service request, and the selected micro-services are ordered according to the sequence of meeting the service request so as to generate order events for accessing the micro-services one by one; the transaction scheduling center receives the order event and then connects each micro service, accesses the micro service one by one to execute the order event, and outputs a service result meeting the service request; and the micro-service transmits the data exchange result generated when the order event is executed to the transaction scheduling center, and the transaction scheduling center gathers the data exchange result and transmits the data exchange result to the order field micro-service so as to complete the data updating of each micro-service.
Based on the same technical idea, the present invention also provides a storage medium storing computer readable instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of: the method comprises the steps that an interface Gateway API Gateway receives a service request sent by a client and sends the service request to the order field micro-service, the order field micro-service selects micro-services to be accessed according to the service request, and the selected micro-services are ordered according to the sequence of meeting the service request so as to generate order events for accessing the micro-services one by one; the transaction scheduling center receives the order event and then connects each micro service, accesses the micro service one by one to execute the order event, and outputs a service result meeting the service request; and the micro-service transmits the data exchange result generated when the order event is executed to the transaction scheduling center, and the transaction scheduling center gathers the data exchange result and transmits the data exchange result to the order field micro-service so as to complete the data updating of each micro-service.
Those skilled in the art will appreciate that implementing all or part of the above-described methods in accordance with the embodiments may be accomplished by way of a computer program stored in a computer-readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. The storage medium may be a nonvolatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a random access Memory (Random Access Memory, RAM).
The technical features of the above-described embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above-described embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The foregoing examples illustrate only a few embodiments of the invention and are described in detail herein without thereby limiting the scope of the invention. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the invention, which are all within the scope of the invention. Accordingly, the scope of protection of the present invention is to be determined by the appended claims.

Claims (7)

1. A data processing method, characterized in that the data processing method comprises:
the method comprises the steps that a client obtains a service request through an input interface, a sending interface is called to send the service request to an API Gateway, the API Gateway is used for abutting an order field micro-service through a data interface and sending the service request to the order field micro-service, the order field micro-service selects micro-services needing to be accessed according to the service request, the selected micro-services are ordered according to the sequence of meeting the service request so as to generate order events for accessing the micro-services one by one, the input interface and the sending interface are arranged on the client, and the API Gateway and the order field micro-service are arranged in an application system;
the transaction scheduling center comprises a data processing interface, the transaction scheduling center receives order events sent by the order field micro-service after the transaction scheduling center is used for abutting the order field micro-service through the data processing interface, the transaction scheduling center is used for abutting other micro-services through the data processing interface, accessing the micro-services one by one to execute the order events, outputting a service result meeting the service request, and the transaction scheduling center is arranged in the application system;
and after the micro-service provides the required service according to the requirement of the service request, calling a database corresponding to the micro-service to record a data updating result generated by the service request, wherein the micro-service sends the data updating result to a transaction scheduling center, the transaction scheduling center comprises a data processing core, the transaction scheduling center gathers the data updating result by calling the data processing core and sends the data updating result to the micro-service in the order field so as to finish the data updating of each micro-service, and the database is arranged on an operation interface of the micro-service.
2. A data processing method according to claim 1, wherein the database comprises Oracle, mySQL, DB2 or Sybase.
3. A data processing method according to claim 1 or 2, wherein the clients comprise a mobile phone client, a computer client and a third party client;
the application system comprises an Nginx application system and a WEB application system.
4. A data processing method according to claim 1 or 2, wherein when the transaction scheduling center performs the docking micro service, an abnormal condition occurs that the docking micro service is overtime or the micro service cannot provide service, the transaction scheduling center feeds back the abnormal condition to the order field micro service, and the order field micro service will perform a retry mechanism on the order event until the micro service can re-execute the order event.
5. A data processing system, wherein the system comprises an order event generating unit, an output business result unit and a data updating unit;
the order generation event unit is used for acquiring a service request by a client through an input interface, calling a sending interface to send the service request to an API Gateway, wherein the API Gateway is used for abutting an order field micro-service through a data interface and sending the service request to the order field micro-service, the order field micro-service selects micro-services needing to be accessed according to the service request and sorts the selected micro-services according to the sequence of meeting the service request so as to generate order events for accessing the micro-services one by one, the input interface and the sending interface are arranged on the client, and the API Gateway and the order field micro-service are arranged in an application system;
the business scheduling center receives order events sent by the order field micro-service after the business scheduling center receives the order field micro-service through the data processing interface, the business scheduling center receives other micro-services through the data processing interface to access the micro-service one by one to execute the order events, and outputs business results meeting the business request, and the business scheduling center is arranged in the application system;
the data updating unit is used for calling a data updating result generated by the service request when the micro service provides the required service according to the requirement of the service request, the micro service sends the data updating result to the transaction scheduling center, the transaction scheduling center comprises a data processing core, the transaction scheduling center gathers the data updating result by calling the data processing core and sends the data updating result to the micro service in the order field so as to complete data updating of each micro service, and the database is arranged on an operation interface of the micro service.
6. A computer device comprising a database and a processor, the database having stored therein computer readable instructions which, when executed by the processor, cause the processor to perform the steps of the data processing method of any of claims 1 to 4.
7. A storage medium storing computer readable instructions which, when executed by one or more processors, cause the one or more processors to perform the steps of the data processing method of any of claims 1 to 4.
CN201810584611.3A 2018-06-06 2018-06-06 Data processing method, system, computer device and storage medium Active CN109213770B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201810584611.3A CN109213770B (en) 2018-06-06 2018-06-06 Data processing method, system, computer device and storage medium
PCT/CN2018/104727 WO2019232962A1 (en) 2018-06-06 2018-09-08 Data processing method, system, computer device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810584611.3A CN109213770B (en) 2018-06-06 2018-06-06 Data processing method, system, computer device and storage medium

Publications (2)

Publication Number Publication Date
CN109213770A CN109213770A (en) 2019-01-15
CN109213770B true CN109213770B (en) 2023-05-30

Family

ID=64991118

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810584611.3A Active CN109213770B (en) 2018-06-06 2018-06-06 Data processing method, system, computer device and storage medium

Country Status (2)

Country Link
CN (1) CN109213770B (en)
WO (1) WO2019232962A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110489139A (en) * 2019-07-03 2019-11-22 平安科技(深圳)有限公司 A kind of real-time data processing method and its relevant device based on micro services
CN110545328A (en) * 2019-09-25 2019-12-06 杭州安恒信息技术股份有限公司 Non-invasive service function expansion enhancing method and device and server
CN111586092A (en) * 2020-03-25 2020-08-25 深圳壹账通智能科技有限公司 Full link monitoring method, system and CAT client
CN113037812A (en) * 2021-02-25 2021-06-25 中国工商银行股份有限公司 Data packet scheduling method and device, electronic equipment, medium and intelligent network card
CN114037496A (en) * 2021-11-17 2022-02-11 广域铭岛数字科技有限公司 State machine-based order state management method, device, equipment and medium
CN115118769B (en) * 2022-06-28 2024-02-02 深圳前海微众银行股份有限公司 Method and device for configuring parameters of service system and executing micro-service

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105959138A (en) * 2016-04-29 2016-09-21 深圳前海大数点科技有限公司 Micro-service dynamic disposition system and method based on cloud calculation
CN106878393A (en) * 2017-01-16 2017-06-20 深圳市商沃科技发展有限公司 A kind of system based on fusion micro services framework
CN107370786A (en) * 2017-06-02 2017-11-21 广州杰赛科技股份有限公司 A kind of general information management system based on micro services framework

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10348838B2 (en) * 2016-07-22 2019-07-09 Cisco Technology, Inc. Scaling service discovery in a micro-service environment
CN106993023A (en) * 2017-03-01 2017-07-28 北京交通大学 Distributed transaction solution under micro services framework
CN107979635A (en) * 2017-10-24 2018-05-01 广东康美通信息服务有限公司 System, method and storage medium based on micro services
CN108038141A (en) * 2017-11-27 2018-05-15 国云科技股份有限公司 Ensure the method for data consistency under micro services framework HTTP interactive modes
CN108055296B (en) * 2017-11-30 2020-11-27 北京中电普华信息技术有限公司 Transaction processing method and device based on micro-service architecture

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105959138A (en) * 2016-04-29 2016-09-21 深圳前海大数点科技有限公司 Micro-service dynamic disposition system and method based on cloud calculation
CN106878393A (en) * 2017-01-16 2017-06-20 深圳市商沃科技发展有限公司 A kind of system based on fusion micro services framework
CN107370786A (en) * 2017-06-02 2017-11-21 广州杰赛科技股份有限公司 A kind of general information management system based on micro services framework

Also Published As

Publication number Publication date
WO2019232962A1 (en) 2019-12-12
CN109213770A (en) 2019-01-15

Similar Documents

Publication Publication Date Title
CN109213770B (en) Data processing method, system, computer device and storage medium
CN111198751B (en) Service processing method and device
US8548442B2 (en) Syndication of multiple service instances
CN108874567B (en) Service processing method and system
US8756254B2 (en) Integration of CRM applications to ECS application user interface
CN109587356B (en) Virtual number calling method, device, system, electronic equipment and storage medium
WO2023207146A1 (en) Service simulation method and apparatus for esop system, and device and storage medium
US11972465B2 (en) Social network-based inventory management
US20240103750A1 (en) Systems and methods for providing customer service functionality during portfolio migration downtime
CN109614271A (en) Control method, device, equipment and the storage medium of multiple company-data consistency
CN102135895A (en) System upgrading method and system
CN115098469A (en) Database migration method and device, electronic equipment and readable storage medium
CN116503005A (en) Method, device, system and storage medium for dynamically modifying flow
CN111506340A (en) Business rule information processing method, device and system
CN111126937B (en) House selection transaction processing method and device
US20240232968A1 (en) Social network-based inventory management
CN114968982A (en) Method and device for processing services of database-based and table-based scenes
CN116433422A (en) Service processing method, device and computer equipment
CN114756329A (en) Business process simulation method and device, electronic equipment and readable storage medium
CN117035855A (en) Resource management method, apparatus, device, storage medium, and program product
CN115187337A (en) Order compensation method, device and equipment and storage medium
CN111833029A (en) Claims data auditing method and system and computer readable storage medium
CN117708177A (en) Data processing system, method, device, electronic equipment and storage medium
CN116303620A (en) Accounting method, system, equipment, medium and product based on light database
CN113835796A (en) Method and apparatus for processing information

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant