WO2024002232A1 - Data processing method, apparatus and system, edge server, electronic device, and storage medium - Google Patents
Data processing method, apparatus and system, edge server, electronic device, and storage medium Download PDFInfo
- Publication number
- WO2024002232A1 WO2024002232A1 PCT/CN2023/103799 CN2023103799W WO2024002232A1 WO 2024002232 A1 WO2024002232 A1 WO 2024002232A1 CN 2023103799 W CN2023103799 W CN 2023103799W WO 2024002232 A1 WO2024002232 A1 WO 2024002232A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- call chain
- chain data
- server
- cross
- Prior art date
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 39
- 238000012545 processing Methods 0.000 claims abstract description 112
- 238000000034 method Methods 0.000 claims description 54
- 238000009877 rendering Methods 0.000 claims description 25
- 230000004044 response Effects 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 16
- 238000004891 communication Methods 0.000 claims description 15
- 230000001360 synchronised effect Effects 0.000 claims description 9
- 238000010586 diagram Methods 0.000 description 19
- 230000005540 biological transmission Effects 0.000 description 16
- 230000008569 process Effects 0.000 description 16
- 238000012423 maintenance Methods 0.000 description 7
- 230000003993 interaction Effects 0.000 description 6
- 238000007405 data analysis Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 238000007726 management method Methods 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 3
- 238000013500 data storage Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000004931 aggregating effect Effects 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000013439 planning Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2471—Distributed queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
- G06F16/1824—Distributed file systems implemented using Network-attached Storage [NAS] architecture
- G06F16/183—Provision of network file services by network file servers, e.g. by using NFS, CIFS
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2246—Trees, e.g. B+trees
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Definitions
- This application relates to the field of data processing technology, specifically to data processing methods, data processing devices, edge servers, data processing systems, electronic equipment and computer-readable storage media.
- an enterprise can establish branches in multiple places and build communication connections between multiple branches through the distributed network within the enterprise.
- a distributed call chain is used to realize data transmission.
- embodiments of the present application provide a data processing method, including: when it is determined that the first call chain data is based on data corresponding to cross-data center services, marking the first call link data and generating a cross-data center data processing method. Domain identification; and saving the cross-domain identification and the first call chain data to the edge server, so that the edge server can synchronize the first call chain data to the central server.
- embodiments of the present application provide a data processing method, which includes: obtaining a cross-domain identifier and first call chain data sent by a data processing device, where the first call chain data is data corresponding to services based on cross-data centers; generating a storage identifier corresponding to the first call chain data; saving the cross-domain identifier and the first call chain data according to the storage identifier; and synchronizing the first call chain data to the central server.
- embodiments of the present application provide a data processing device, including: a marking module configured to, when it is determined that the first call chain data is based on data corresponding to cross-data center services, marking and generating a cross-domain identification; and a storage module configured to save the cross-domain identification and the first call chain data to the edge server, so that the edge server can synchronize the first call chain data to the central server.
- an edge server including: an acquisition module configured to acquire the cross-domain identification and first call chain data sent by the data processing device.
- the first call chain data is based on business correspondence across data centers. data; a generation module configured to generate a storage identifier corresponding to the first call chain data; a save module configured to save the cross-domain identifier and the first call chain data based on the storage identifier; and a synchronization module configured to save the first call chain data Data is synchronized to the central server.
- embodiments of the present application provide a data processing system, including: a communication-connected data processing device, an edge server, and a central server; a data processing device configured to execute the first step of the present application.
- the data processing method in the second aspect is configured to execute the data processing method in the second aspect of this application
- the central server is configured to obtain the first call chain data synchronized by the edge server; in response to the query request sent by the user terminal, based on The query identifier in the query request obtains the first call chain data, and feeds the first call chain data back to the user terminal; the first call chain data is based on business correspondence across data centers.
- embodiments of the present application provide an electronic device, including: at least one processor; and a memory on which at least one computer program is stored.
- the at least one computer program is executed by at least one processor, at least one process
- the device implements the data processing method in the embodiment of this application.
- embodiments of the present application provide a computer-readable storage medium.
- the computer-readable storage medium stores a computer program.
- the computer program is executed by a processor, the data processing method in the embodiment of the present application is implemented.
- Figure 1 shows a schematic flowchart of a method for processing call chain data between different data centers provided by an embodiment of the present application.
- Figure 2 shows a schematic diagram of a processing system for call chain data reported across clouds provided by an embodiment of the present application.
- Figure 3 shows a schematic diagram of the processing system for cross-cloud query call chain data provided by the embodiment of the present application.
- FIG. 4 shows a schematic flowchart of the data processing method provided by the embodiment of the present application.
- Figure 5 shows a schematic diagram of the query front-end interface provided by the embodiment of the present application.
- Figure 6 shows a schematic diagram of the statistics front-end interface provided by the embodiment of the present application.
- FIG. 7 shows a schematic flowchart of the data processing method provided by the embodiment of the present application.
- FIG. 8 shows a block diagram of the data processing system provided by the embodiment of the present application.
- FIG. 9 shows a block diagram of the data processing system provided by the embodiment of the present application.
- FIG 10 shows a schematic flowchart of the working method of the data processing system provided by the embodiment of the present application.
- Figure 11 shows a schematic flowchart of a method for collecting first call chain data provided by an embodiment of the present application.
- Figure 12 shows a schematic flowchart of a method for processing first call chain data by an edge call chain server provided by an embodiment of the present application.
- Figure 13 shows a schematic flowchart of the first call chain data query method provided by the embodiment of the present application.
- Figure 14 shows a schematic flowchart of a method for processing call chain data corresponding to financial microservices in the financial system provided by the embodiment of the present application.
- Figure 15 shows a schematic flowchart of a method for processing call chain data corresponding to a charging microservice in a communication operator's charging system provided by an embodiment of the present application.
- Figure 16 shows a schematic flowchart of a method for processing call chain data corresponding to a cloud-based game scene microservice provided by an embodiment of the present application.
- Figure 17 shows a block diagram of a data processing device provided by an embodiment of the present application.
- FIG. 18 shows a block diagram of the edge server provided by the embodiment of the present application.
- Figure 19 shows a structural diagram of an exemplary hardware architecture of a computing device capable of implementing the data processing method and apparatus according to embodiments of the present application.
- FIG. 1 shows a schematic flowchart of a method for processing call chain data between different data centers provided by an embodiment of the present application.
- the main center server 110 is communicatively connected with the local disaster recovery center server 120 and the remote disaster recovery center server 130 .
- the main center server 110 needs to perform data synchronization with the local disaster recovery center server 120, and the local disaster recovery center server 120 also needs to perform asynchronous log replay and other services with the remote disaster recovery center server 130.
- the first application may call data across multiple data centers (for example, the first application on the local disaster recovery center server 120 calls the main center server 110 The data on the data nodes corresponding to the first group 111, or the data on the data nodes corresponding to the second group 112, or the data on the data nodes corresponding to the third group 113, etc.), and the first application may also Interact with second applications deployed on other data centers (for example, interact between the first application on the local disaster recovery center server 120 and the second application on the remote disaster recovery center server 130, etc.).
- the call chain data is based on the data corresponding to the business across data centers, which is prone to incomplete collection of the call chain and reduces the operation and maintenance efficiency of the entire system.
- since data are all centrally stored on the main central server 110, it is easy for the main central server 110 to occupy a large amount of private network bandwidth and reduce data transmission efficiency when interacting with other servers.
- Figure 2 shows a schematic diagram of a processing system for call chain data reported across clouds provided by an embodiment of the present application.
- application D in the self-built computer room transmits data to the public network access point on the public cloud, it will occupy the public network bandwidth and private network bandwidth.
- the cost of public network traffic, and the public network There are many limitations on network stability, which reduces the user experience of Application D.
- Cross-cloud query means that the original link data is stored in the current cloud network, and a user's query request is sent to multiple cloud servers respectively, so that multiple cloud servers can aggregate the query results and then perform unified processing, which can reduce Transmission costs in the public network.
- Figure 3 shows a schematic diagram of the processing system for cross-cloud query call chain data provided by the embodiment of the present application.
- application C in the self-built computer room interacts with an application in the public cloud (for example, application A or application B) through the intranet access point, multiple data processing terminals need to be deployed in the public cloud.
- the public cloud does not support functions such as statistical analysis of quantile and global call chain data, which reduces the management efficiency of call chain data in the network.
- Embodiments of the present application provide a data processing method, a data processing device, an edge server, a data processing system, an electronic device, and a computer-readable storage medium.
- FIG 4 shows a schematic flowchart of the data processing method provided by the embodiment of the present application.
- the data processing method can be applied to data processing devices.
- the data processing method in the embodiment of the present application includes but is not limited to the following steps S401 and S402.
- Step S401 When it is determined that the first call chain data is based on data corresponding to cross-data center services, mark the first call link data and generate a cross-domain identification.
- Step S402 Save the cross-domain identification and the first call chain data to the edge server, so that the edge server can synchronize the first call chain data to the central server.
- the first call link data is marked to generate a cross-domain identifier to distinguish Other call chain data that do not operate cross-domain, reduce the proportion of incomplete call chain collection failures, and ensure the integrity of data corresponding to cross-data center business analysis; save cross-domain identification and first call chain data to the edge server, for the edge server to transfer the first call chain number
- Data synchronization to the central server can reduce the storage space wasted due to centralized storage of call chain data, reduce the frequency of reporting call chain data, improve data transmission efficiency, and reduce the consumption of private network bandwidth.
- the data processing method further includes :
- the destination address is the network address of the central server.
- the edge server can synchronize the first call chain data to the central server based on the target address in the synchronization request, so that the central server can obtain cross-data center call chain data to facilitate subsequent data analysis. , and ensure that when analyzing call chain data, the proportion of incomplete call chain collection failures is reduced and the accuracy of data analysis is improved.
- the data processing method further includes : Obtain the query request; and query the edge server and/or central server according to the query identifier to obtain the first call chain data.
- the query request includes a query identifier, and the query identifier corresponds to the storage identifier of the first call chain data.
- a query request can be sent to the edge server and/or the central server.
- the edge server and/or the central server When a server stores the first call chain data corresponding to the query identifier, the first call chain data can be obtained.
- the call chain data based on cross-data centers is not only stored on the central server, but also on the edge server, sending query requests to the edge server and/or the central server can facilitate different devices to access this cross-data center call chain. Query and use data to reduce the proportion of faults caused by incomplete call chain collection.
- the data processing method further includes: based on the tree structure, displaying the corresponding data of the first call chain The category of the data center to which the microservice belongs; and/or, based on the graph structure, display the processing time information of the microservice corresponding to the first call chain data.
- FIG. 5 shows a schematic diagram of the query front-end interface provided by the embodiment of the present application.
- the left half of Figure 5 uses a tree structure to respectively display microservice 1, microservice 2 and public services included in data center 1; and microservice 3 and microservice 4 included in data center 2.
- microservice 1 corresponds to the first call chain data
- the right half of Figure 5 will display the calling process of the first call chain data based on the graph structure (for example, the "Call Chain Display" in Figure 5). This allows users to clearly view the calling process of the call chain data corresponding to different microservices.
- traceId represents the query identifier (such as 12445, etc.) for the user to input the query identifier they want to query, and click the "Query" button to obtain relevant information about the call chain data corresponding to the query identifier, and intuitively display the call chain data to users to improve the user experience.
- the data processing method further includes: when it is determined that the second call chain data is based on data corresponding to services occurring in the same data center, saving the second call chain data to the edge server.
- the call chain data corresponding to the business occurring in the same data center does not need to be aggregated to the central server, thus saving the storage space of the central server. At the same time, it also reduces the consumption of private network bandwidth during data interaction. consumption, reducing the cost of network communication.
- the above data processing methods when it is determined that the first call chain data is based on data corresponding to cross-data center services in step S401, before marking the first call link data and generating a cross-domain identification, the The above data processing methods also include:
- the registration information includes the registration address of the microservice; the target data is the data that the microservice expects to obtain.
- the registration address of the microservice is different from the storage address of the target data corresponding to the first call chain data
- it is determined that the first call chain data corresponding to the microservice is data corresponding to the business based on the cross-data center
- the registration address of the microservice is the same as the storage address of the target data corresponding to the first call chain data
- it is determined that the first call chain data corresponding to the microservice is not based on data corresponding to cross-data center business, that is, the first call Chain data is the call chain data corresponding to the business occurring in the data center.
- the central server Based on the determination of the type of the first call chain data, it can be clarified whether the first call chain data needs to be synchronized to the central server, thereby reducing the consumption of transmission bandwidth during data transmission and saving transmission costs.
- the first call chain data is data corresponding to financial microservices in the financial system. Saving the cross-domain identification and the first call chain data to the edge server in step S402, so that the edge server can synchronize the first call chain data to the central server, can be implemented in the following manner:
- the storage address corresponding to the first call chain data is obtained from the edge server; based on the storage address corresponding to the first call chain data and the network address of the central server, a generated a synchronization request; and sending a synchronization request to the edge server for the edge server to synchronize the first call chain data to the central server based on the storage address corresponding to the first call chain data and the network address of the central server.
- the storage address corresponding to the first call chain data is an address determined by the edge server based on the data offset information of the last time it obtained the call chain data.
- the data offset information of the last time the call chain data was obtained includes the storage address offset length and the storage first address. Then the storage address offset length and the storage first address can be added together to obtain the first call chain data correspondence. storage address, thereby speeding up the acquisition of the first call chain data.
- the first call chain data can be quickly and accurately obtained. Then, based on the network address of the central server, a synchronization request is sent to the edge server, so that the edge server can send the first call chain data to the central server based on the network address of the central server, speeding up the synchronization efficiency of the first call chain data, Ensure safe storage of data.
- the first call chain data is data corresponding to the charging microservice in the charging system of the communication operator (for example, data generated by querying bills, etc., or charging standards, etc.).
- Saving the cross-domain identification and the first call chain data to the edge server in step S402, so that the edge server can synchronize the first call chain data to the central server, can be implemented in the following manner:
- the data is saved to the edge server corresponding to the billing area level.
- the charging area information includes the charging area level corresponding to the charging microservice.
- the charging area level may include at least one of a provincial charging area, a municipal charging area, and a county charging area.
- the specific billing standard can be clarified, and the cross-domain identification and first call chain data can be quickly and accurately saved to the edge server corresponding to the billing area level to facilitate the edge.
- the server performs billing to ensure the normal communication of terminals and protect the interests of operators.
- the first call chain data is data corresponding to the cloud-based game scene microservice.
- the game scene microservice includes the game scene rendering microservice and its corresponding billing microservice.
- the game scene rendering microservice is deployed at the edge.
- the target data of the billing microservice corresponding to the game scene rendering microservice is stored on the public cloud server.
- a terminal when a terminal needs to render a game scene, it needs to be served through the game scene rendering microservice deployed on the nearest edge server. However, correspondingly, the cost information generated by the game scene rendering needs to be provided through the game scene rendering microservice deployed on the public cloud.
- the billing microservice is implemented on the server, thus generating the first call chain data across data centers.
- the game scene rendering microservice By deploying the game scene rendering microservice on the edge server, it is convenient for the terminal to obtain the data it needs from the edge server, improving the service efficiency with the terminal; and the goal of the billing microservice corresponding to the game scene rendering microservice is Data is stored on the public cloud server, which enables the public cloud server to accurately bill services performed on multiple different edge servers, improving billing accuracy.
- the data processing further includes: sending the data to the public cloud server. Send a data statistics request; respond to the statistical response fed back by the public cloud server, obtain statistical results; and display the statistical results.
- the data statistics request is used to count information on the use of a preset amount of call chain data within a preset period of time.
- the statistical results may include: at least one of: statistical start time, statistical end time, statistical type, and usage information corresponding to the call chain data.
- FIG. 6 shows a schematic diagram of the statistics front-end interface provided by the embodiment of the present application.
- the user enters the start time and end time to be counted in the "Statistical Time Period” input window, and enters the statistical type corresponding to the call chain data expected to be obtained in the "Statistical Type” and clicks " "Statistics Button” will display in the "Statistical Result Display” the information used by the preset number of call chain data determined based on the statistical type during the period from the start time to the end time.
- the call status of the call chain data corresponding to a certain statistical type on the public cloud server can be clarified, which facilitates the query of users or operation and maintenance personnel, so that based on the display of statistical results, it is possible to quickly and easily locate possible Improve the efficiency of management and maintenance of call chain data by handling failures.
- Figure 7 shows a schematic flowchart of the data processing method provided by the embodiment of the present application. This method can be applied to edge servers. As shown in Figure 7, the data processing method in the embodiment of the present application includes but is not limited to the following steps S701 to S704.
- Step S701 Obtain the cross-domain identifier and first call chain data sent by the data processing device.
- the first call chain data is based on business correspondence across data centers.
- Step S702 Generate a storage identifier corresponding to the first call chain data.
- Step S703 Save the cross-domain identifier and the first call chain data according to the storage identifier.
- Step S704 Synchronize the first call chain data to the central server.
- synchronizing the first call chain data to the central server in step S704 includes: responding to the synchronization request sent by the data processing device, obtaining the target address in the synchronization request; and synchronizing the first call chain data according to the target address. Synchronize to central server.
- the destination address is the network address of the central server.
- the data processing method by obtaining the cross-domain identification and the first call chain data sent by the data processing device, it can be determined based on the cross-domain identification that the first call chain data is data corresponding to the business across data centers, and it can Distinguish cross-data center call chain data from other call chain data that does not cross-domain operations to reduce the proportion of incomplete call chain collection failures; generate a storage identifier corresponding to the first call chain data, and save the cross-domain call chain data based on the storage identifier.
- Domain identification and first call chain data can reduce the frequency of call chain data reported to the central server and improve data transmission efficiency; synchronize the first call chain data to the central server so that the central server can handle cross-data center business
- the corresponding data is analyzed to meet the needs of data analysis and reduce the storage space of the central server wasted due to centralized storage of call chain data.
- Figure 8 shows a block diagram of the data processing system provided by the embodiment of the present application.
- the data processing system includes but is not limited to the following equipment: a communication-connected data processing device 801, an edge server 802, a central server 803, and a user terminal 804.
- the data processing device 801 is configured to determine that the first call chain data is based on cross-data center services. In the case of corresponding data, the first call link data is marked to generate a cross-domain identification; the cross-domain identification and the first call chain data are saved to the edge server 802 for the edge server 802 to synchronize the first call chain data. To the central server 803.
- the edge server 802 is configured to obtain the cross-domain identification and the first call chain data sent by the data processing device 801.
- the first call chain data is data corresponding to the business based on the cross-data center; generate a storage identification corresponding to the first call chain data; Save the cross-domain identification and the first call chain data according to the storage identification; synchronize the first call chain data to the central server 803.
- the central server 803 is configured to obtain the first call chain data synchronized by the edge server 802; in response to the query request sent by the user terminal 804, obtain the first call chain data based on the query identifier in the query request, and feed the first call chain data back to User terminal 804; the first call chain data is data corresponding to services based on cross-data centers.
- the data processing device 801 sends the cross-domain identification and the first call chain data to the edge server 802. Based on the cross-domain identification, it can be clear that the first call chain data is based on cross-data center business correspondence.
- the data can distinguish cross-data center call chain data from other call chain data that does not cross-domain operations, reducing the proportion of incomplete call chain collection failures; the edge server 802 generates a storage identifier corresponding to the first call chain data.
- saving the cross-domain identifier and the first call chain data according to the storage identifier can reduce the frequency of the call chain data reported to the central server 803 and improve the data transmission efficiency; the edge server 802 synchronizes the first call chain data to the central server 803, This allows the central server 803 to analyze data corresponding to cross-data center services, meet the needs of data analysis, and reduce the storage space of the central server wasted due to centralized storage of call chain data.
- Figure 9 shows a block diagram of the data processing system provided by the embodiment of the present application.
- the data processing system includes but is not limited to the following equipment: the first center call chain server 901, the second center call chain server 902, the first edge call chain server 903, the second edge call chain server 904, registration Server 905, user terminal 906 and multiple call chain data processing devices (eg, call chain data processing device A, call chain data processing device B, call chain data processing device C, call chain data processing device D, etc.).
- the data processing system includes but is not limited to the following equipment: the first center call chain server 901, the second center call chain server 902, the first edge call chain server 903, the second edge call chain server 904, registration Server 905, user terminal 906 and multiple call chain data processing devices (eg, call chain data processing device A, call chain data processing device B, call chain data processing device C, call chain data processing device D, etc.).
- call chain data processing device A e.g, call chain data processing device A, call chain data processing device B, call chain data processing device C, call chain data
- the first edge call chain server 903 includes a first call chain synchronizer 9031; the second edge call chain server 904 includes a second call chain synchronizer 9041.
- the call chain data processing device is configured to collect distributed call chain data.
- the call chain data processing device may be in the same processing process as its corresponding microservice, or may be in a different processing process as its corresponding microservice.
- the first central call chain server 901 or the second central call chain server 902 is configured to store distributed call chain data and analyze the stored call chain data to obtain statistical results.
- the second central call chain server 902 may be deployed in a specific data center.
- the first central call server 902 may also be configured to display the queried call chain data to the user terminal 906 .
- the call chain data processing device may also be used to display the usage information and/or statistical information of the queried call chain data to the user terminal 906 .
- the first edge call chain server 903 or the second edge call chain server 904 is configured to store distributed call chain data inside each data center.
- the first call chain synchronizer 9031 is configured to synchronize call chain data corresponding to cross-data center services stored in the first edge call chain server 903 to the first central call chain server 901; and corresponding to the services implemented within this data center The corresponding call chain data does not need to be synchronized to the first central call chain server 901.
- the second call chain synchronizer 9041 is configured to synchronize call chain data corresponding to cross-data center services stored in the second edge call chain server 904 to the first central call chain server 901; and corresponding to the services implemented within the data center The corresponding call chain data does not need to be synchronized to the first central call chain server 901.
- the registration server 905 is configured to provide multiple call chain data processing devices with the registration information of the microservice corresponding to the call chain data that they need.
- the registration information may include: the registration address of the microservice and other information.
- FIG 10 shows a schematic flowchart of the working method of the data processing system provided by the embodiment of the present application. As shown in Figure 10, the working method of the data processing system includes but is not limited to the following steps S1010 to S1030.
- Step S1010 The call chain data processing device A marks the first call chain data, generates a cross-domain identifier corresponding to the first call chain data, and reports the first call chain data and its corresponding cross-domain identifier to the first call chain data.
- the edge calls the chain server 903.
- the first call chain data is data generated based on cross-data center services. Moreover, the first edge call chain server 903 and the call chain data processing device A belong to the same data center.
- Step S1020 After receiving the first call chain data and its corresponding cross-domain identification, the first edge call chain server 903 saves the first call chain data to the local storage space based on the cross-domain identification, and at the same time, saves the first call chain data to the local storage space.
- the first call chain data is synchronized to the first central call chain server 901.
- Step S1030 when the user terminal 906 inputs the query identifier in the query front-end interface, the second center call chain server 902 in the background interacts with the first center call chain server 901, and/or, with the first edge call chain server 903 interaction, obtain the first call chain data corresponding to the query identifier, and display the first call chain data through the query front-end interface.
- the cross-data center call chain data can be specially marked to facilitate subsequent processing, and the first edge call chain
- the server 903 only synchronizes the call chain data with the cross-domain identifier to the first central call chain server 902, which can reduce the consumption of private network bandwidth between data centers when aggregating the call chain and reduce the transmission cost of network bandwidth. Since the first central call chain server 902 only aggregates call chain data with cross-domain identification (that is, call chain data generated based on cross-data center calls), a large amount of call chain data within the data center is stored at the edge. On the call chain server, the data storage pressure and computing pressure of the first central call chain server 902 can be reduced.
- the user terminal When the user terminal requests to display the call chain data, it can reduce the proportion of incomplete call chain collection failures, ensure the display integrity of the call chain data, and enable the first central call chain server 902 to handle cross-data center business correspondence. Complete analysis of call chain data improves query efficiency and meets the needs of user terminals.
- the call chain data processing device A in step S1010 marks the first call chain data and generates a cross-domain identifier corresponding to the first call chain data; and combines the first call chain data and its corresponding Reporting the cross-domain identity to the first edge call chain server 903 can also be implemented in the following manner.
- Figure 11 shows a schematic flowchart of a method for collecting first call chain data provided by an embodiment of the present application. As shown in Figure 11, the method of collecting first call chain data includes but is not limited to the following steps S1011 to S1015.
- Step S1011 The microservice in the call chain data processing device A obtains the registration information of the microservice corresponding to the first call chain data from the registration server 905; and obtains the storage address of the target data corresponding to the first call chain data.
- the registration information includes the registration address of the microservice, and the target data is the data that the microservice expects to obtain.
- Step S1012 The microservice in the call chain data processing device A compares the registration address of the microservice with the storage address of the target data corresponding to the first call chain data to determine whether the first call chain data is based on cross-data center Business corresponding data.
- step S1013 is executed; if it is determined that the first call chain data is not based on data corresponding to cross-data center services, step S1014 is executed.
- Step S1013 The call chain data processing device A marks the first call chain data and generates a cross-domain identifier corresponding to the first call chain data.
- step S1013 After step S1013 is executed, jump to step S1015.
- Step S1014 the call chain data processing device A does not mark the first call chain data specially, but only sends the first call chain data to the first edge call chain server 903.
- Step S1015 The first edge call chain server 903 stores the obtained first call chain data.
- the first edge call chain server 903 in step S1020 saves the first call chain data to the local server based on the cross-domain identification. storage space.
- synchronizing the first call chain data to the first central call chain server 901 can also be implemented in the following manner.
- FIG 12 shows a schematic flowchart of a method for processing first call chain data by an edge call chain server provided by an embodiment of the present application.
- the edge call chain server's method for processing the first call chain data includes but is not limited to the following steps S1021 to S1025.
- the first call chain data corresponding to the cross-domain identification needs to be stored in a specific storage area (for example, a cross-domain data storage area); when it is determined that the first call chain data does not have a corresponding cross-domain identifier, the first call chain data only needs to be stored in a common storage area (such as a local storage area, etc.).
- Step S1021 the first call chain synchronizer 9031 obtains the first call chain data through a scheduled task.
- the first call chain synchronizer 9031 and the first edge call chain server 903 may also be two different devices.
- the first call chain synchronizer 9031 determines the first edge call chain server through active listening. Whether the first call chain data in 903 needs to be synchronized; and if it is determined that data synchronization is required, obtain the first call chain data from the first edge call chain server 903.
- Step S1022 The first call chain synchronizer 9031 determines whether the first call chain data contains a cross-domain identifier.
- step S1023 is executed; if it is determined that the first call chain data does not have a cross-domain identifier, the process ends.
- Step S1023 Obtain the TraceId corresponding to the first call chain data.
- Step S1024 The first call chain synchronizer 9031 obtains the first call chain data from the first edge call chain server 903 of the data center based on the TraceId.
- Step S1025 The first call chain synchronizer 9031 reports the obtained first call chain data to the first central call chain server 901.
- the call chain data corresponding to the business based on cross-data centers is collected into the first central call chain server 901, and the call chain data corresponding to the business based on one data center is collected to each data center.
- the edge call chain server for example, the first edge call chain server 903
- the second center call chain server 902 in the background interacts with the first center call chain server 901, and/or, with The interaction of the first edge call chain server 903 to obtain the first call chain data corresponding to the query identifier and display the first call chain data through the query front-end interface can also be implemented in the following manner.
- Figure 13 shows a schematic flowchart of the first call chain data query method provided by the embodiment of the present application.
- the query method of the first call chain data includes but is not limited to the following steps S1031 to S1036.
- Step S1031 The user terminal 906 generates a query request based on the query front-end interface.
- the query request may include: Query ID.
- Query ID For example, you can generate a query request by entering the query ID (TraceId) on the query front-end interface.
- Step S1032 the user terminal 906 sends the query request to the first central call chain server 901 to complete the query operation.
- Step S1033 Determine whether the call chain data corresponding to TraceId is queried in the first central call chain server 901. If it is determined that the call chain data corresponding to TraceId is queried, step S1036 is executed; if the call chain data corresponding to TraceId is not queried, step S1034 is executed.
- Step S1034 the user terminal 906 sends the query request to each edge call chain server, and waits for the query results fed back by each edge call chain server.
- Each edge call chain server may include a first call chain edge server 903, and/or a second call chain edge server 904.
- Step S1035 Determine whether the call chain data corresponding to the query identifier is queried in the query response fed back by at least one edge call chain server. If it is determined that no call chain data corresponding to the query identifier is found in the query responses fed back by each edge call chain server, the process ends; if at least one edge call chain server returns query responses corresponding to the query identifier. Call the chain data and execute step S1036.
- Step S1036 Display the obtained query results on the query front-end interface.
- the above data processing methods can be used to improve the management efficiency of call chain data.
- a large enterprise distributes its own data centers in different cities and deploys different applications in these data centers, and some specific applications are only deployed in some specific data centers. Applications in other data centers call these For specific applications, cross-data center data calls will occur, resulting in cross-data center call chain data.
- the financial microservices in the financial system are only deployed in the data center in location A, while applications in the Human Resources (HR) system or applications in the Enterprise Resource Planning (ERP) system can be deployed In data centers across the country.
- HR Human Resources
- ERP Enterprise Resource Planning
- applications in the HR system or applications in the ERP system may call the financial microservices of the financial system deployed in the data center at location A, thus generating cross-data center call chain data.
- Figure 14 shows a schematic flowchart of a method for processing call chain data corresponding to financial microservices in the financial system provided by the embodiment of the present application.
- the method for processing call chain data corresponding to the financial microservices in the financial system includes but is not limited to the following steps S1401 to S1408.
- Step S1401 The microservice in the HR system queries the address information of the financial microservice in the financial system through the registration server 905.
- Step S1402 The microservice in the HR system determines whether the financial microservice is in the same data center as the microservice in the HR system through the address information of the financial microservice in the financial system returned by the registration server 905.
- Step S1403 when it is determined that the financial microservice and the microservice in the HR system are not in the same data center, the call chain data processing device corresponding to the microservice in the HR system performs cross-domain marking on the first call chain data, and generates The cross-domain identifier corresponding to the first call chain data.
- the first call chain data is used to represent the call relationship data between the financial microservices and the microservices in the HR system.
- Step S1404 The call chain data processing device corresponding to the microservice in the HR system sends the first call chain data and its corresponding cross-domain identifier to the edge call chain server of the data center to which the HR system belongs, so that the edge call chain service Store the first call chain data and its corresponding cross-domain identifier.
- step S1405 While executing step S1404, step S1405 also needs to be executed.
- Step S1405 The call chain data processing device corresponding to the microservice in the HR system sends the first call chain data and its corresponding cross-domain identification to the central call chain server of the data center to which the HR system belongs.
- Step S1406 The call chain synchronizer in the data center to which the HR system belongs periodically triggers the acquisition of call chain data corresponding to cross-data center services through a timer.
- the call chain synchronizer can obtain the offset information of the last call chain data obtained from its own memory, and use this offset information as the starting address to obtain the offset information from the data center to which the HR system belongs. Pull the call chain data including the cross-domain identifier from the edge call chain server.
- the call chain synchronizer When the call chain synchronizer obtains the query identification (TraceId) corresponding to the call chain data including the cross-domain identification, it can obtain the TraceId corresponding to the TraceId from the edge call chain server in the data center to which the HR system belongs. Complete call chain data, and send the complete call chain data corresponding to the TraceId to the central call chain server in the data center to which the HR system belongs.
- TraceId query identification
- Step S1407 when the user inputs a TraceId into the call chain query interface and expects to query the call chain data corresponding to the TraceId, the user terminal used by the user will generate a query request based on the TraceId and send the query request to the central call chain. Query on the server and/or edge call chain server.
- Step S1408 When the query result fed back by the central call chain server and/or the edge call chain server is obtained, the query result is displayed on the call chain query interface.
- a multi-level data center architecture will also be used to deploy virtual network function (Virtual Network Feature, VNF) applications in different telecom systems in different data centers and deploy them in multiple VNF applications in the multi-level data center will also complete corresponding communication services through mutual calls.
- VNF Virtual Network Feature
- operators deploy billing microservices in provincial data centers, and terminal access microservices and identity authentication microservices are deployed in county-level data centers.
- the accounting microservice, terminal access microservice and identity authentication microservice need to cooperate with each other to achieve network access of the terminal device.
- Figure 15 shows a schematic flowchart of a method for processing call chain data corresponding to a charging microservice in a communication operator's charging system provided by an embodiment of the present application.
- the method for processing the call chain data corresponding to the charging microservice in the charging system of the communication operator includes but is not limited to the following steps S1501 to S1509.
- Step S1501 The call chain data processing device corresponding to the terminal access microservice sends an information acquisition request to the registration server 905 to obtain the target service address information corresponding to the charging microservice.
- Step S1502 in response to the information acquisition response returned by the registration server 905, the terminal accesses the call chain data processing device corresponding to the microservice to determine that the charging microservice is deployed in a provincial data center.
- Step S1503 The call chain data processing device corresponding to the terminal access microservice performs cross-domain marking on the call chain data between the terminal access microservice and the billing microservice, and generates a cross-domain identification corresponding to the call chain data; And the call chain data between the terminal access microservice and the billing microservice and its corresponding cross-domain identification are sent to the edge call chain server in the county-level data center.
- the edge call chain server in the county-level data center and the call chain data processing device corresponding to the terminal access microservice are in the same data center.
- Step S1504 After receiving the call chain data between the terminal access microservice and the billing microservice, the edge call chain server in the county-level data center stores the call chain data and the corresponding cross-domain identification.
- Step S1505 The call chain synchronizer in the county-level data center determines whether there is new call chain data with a cross-domain identification on the edge call chain server by monitoring the edge call chain server.
- Step S1506 When the call chain synchronizer determines that there is new call chain data with a cross-domain identifier on the edge call chain server, it obtains the TraceId corresponding to the call chain data, and based on the TraceId, from the same county level Get complete information about the call chain data from the edge call chain server in the data center.
- Step S1507 The call chain synchronizer sends the obtained call chain data between the terminal access microservice and the billing microservice and its corresponding cross-domain identification to the central call chain server of the provincial data center.
- Step S1508 when the operation and maintenance personnel enter the TraceId on the distributed call chain query interface in the provincial data center and click the query button, the central call chain server in the provincial data center will generate a query request based on the TraceId. And send the query request to the edge call chain server for query, or query the local memory of the central call chain server to obtain the call chain data corresponding to the TraceId.
- Step S1509 If it is determined that the call chain data corresponding to the TraceId is obtained, the call chain data is displayed on the distributed call chain query interface.
- edge clouds in order to improve the user experience of mobile terminals, major public cloud vendors are actively deploying edge clouds and deploying different types of applications directly in edge clouds to reduce the interaction between mobile terminals and backend servers. time delay.
- part of the data in the background server that interacts closely with the mobile terminal is usually isolated and deployed separately in the edge cloud.
- other parts of the data in the backend server are still deployed in the public cloud. This allows the data in the edge cloud to interact with other parts of the data still deployed in the public cloud through preset interfaces.
- a game development server will deploy the game scene rendering microservice on the edge cloud.
- the game scene rendering microservice is mainly used for business interaction with mobile terminals; and the game's authentication microservices and billing microservices are for of components are still deployed in the public cloud.
- the game scene microservice deployed in the edge cloud needs to interact with the authentication microservice and charging microservice deployed in the public cloud, thus generating cross-data center call chain data.
- Figure 16 shows a schematic flowchart of a method for processing call chain data corresponding to a cloud-based game scene microservice provided by an embodiment of the present application.
- the method for processing the call chain data corresponding to the cloud-based game scene microservice includes but is not limited to the following steps S1601 to S1612.
- Step S1601 The mobile terminal starts to create a game scene and sends a creation request to the game scene rendering microservice deployed in the edge cloud.
- Step S1602 The call chain data processing device corresponding to the game scene rendering microservice sends an information acquisition request to the registration server 905 to obtain the target service address information corresponding to the charging microservice corresponding to the game scene rendering microservice.
- Step S1603 In response to the information acquisition response returned by the registration server 905, the call chain data processing device corresponding to the game scene rendering microservice determines that the charging microservice is deployed in the public cloud.
- Step S1604 The call chain data processing device corresponding to the game scene rendering microservice performs cross-domain marking on the call chain data between the game scene rendering microservice and the charging microservice, and generates a cross-domain identification corresponding to the call chain data; and The call chain data between the game scene rendering microservice and the charging microservice and its corresponding cross-domain identification are sent to the edge call chain server deployed in the edge cloud.
- Step S1605 After receiving the call chain data and its corresponding cross-domain identification between the game scene rendering microservice and the charging microservice, the edge call chain server deployed in the edge cloud sends the call chain data and its corresponding cross-domain identification. Identity is stored.
- Step S1606 The edge call chain server corresponding to the game scene rendering microservice periodically triggers the start of the call chain synchronizer through a timer.
- the edge call chain server and the call chain synchronizer are both located in the same data center (such as edge cloud).
- Step S1607 The call chain synchronizer obtains the offset information of the last call chain data obtained from its own storage.
- Step S1608 Using the offset of the call chain data as a starting point, the call chain synchronizer pulls the call chain data including the cross-domain identifier from the edge call chain server of the edge cloud.
- Step S1609 The call chain synchronizer analyzes the call chain data including the cross-domain identifier and obtains TraceId corresponding to the call chain data; and based on the TraceId, complete information of the call chain data between the game scene rendering microservice and the charging microservice is obtained from the edge call chain server of the edge cloud.
- Step S1610 The call chain synchronizer sends the obtained complete information of the call chain data between the game scene rendering microservice and the charging microservice to the central call chain server of the public cloud.
- Step S1611 when the operation and maintenance personnel of the public cloud input the time period information and statistics type that need to be counted on the distributed call chain query interface in the public cloud, the central call chain server on the public cloud will based on the obtained time period information and statistics type, to perform statistics on call chain data and obtain statistical results.
- Step S1612 Display statistical results on the distributed call chain query interface.
- Figure 17 shows a block diagram of a data processing device provided by an embodiment of the present application.
- the data processing device 1700 includes but is not limited to the following modules: a marking module 1701 and a storage module 1702.
- the marking module 1701 is configured to mark the first calling link data and generate a cross-domain identification when it is determined that the first calling link data is based on data corresponding to cross-data center services.
- the storage module 1702 is configured to save the cross-domain identification and the first call chain data to the edge server, so that the edge server can synchronize the first call chain data to the central server.
- the data processing device 1700 in this embodiment can implement the data processing method applied to the data processing device in the embodiment of this application.
- the first call link data is marked and a cross-domain identifier is generated, using In order to distinguish other call chain data that do not operate across domains, reduce the proportion of incomplete call chain collection failures, and ensure the integrity of data corresponding to cross-data center business analysis; the storage module 1702 combines the cross-domain identifier with the first The first call chain data is saved to the edge server for the edge server to synchronize the first call chain data to the central server, which can reduce the storage space wasted due to centralized storage of call chain data, reduce the frequency of reporting call chain data, and improve data transmission efficiency while reducing the consumption of private network bandwidth.
- FIG 18 shows a block diagram of the edge server provided by the embodiment of the present application.
- the edge server 1800 includes but is not limited to the following modules: an acquisition module 1801, a generation module 1802, a saving module 1803, and a synchronization module 1804.
- the acquisition module 1801 is configured to acquire the cross-domain identification and first call chain data sent by the data processing device.
- the first call chain data is data corresponding to services based on cross-data centers.
- the generating module 1802 is configured to generate a storage identification corresponding to the first call chain data.
- the saving module 1803 is configured to save the cross-domain identification and the first call chain data according to the storage identification.
- the synchronization module 1804 is configured to synchronize the first call chain data to the central server.
- edge server 1800 in this embodiment can implement the data processing method applied to the edge server in the embodiment of this application.
- the cross-domain identification and the first call chain data sent by the data processing device are obtained through the acquisition module 1801. Based on the cross-domain identification, it can be determined that the first call chain data is based on data corresponding to the cross-data center business.
- the generation module 1802 can distinguish cross-data center call chain data from other call chain data that does not cross-domain operations, and reduce the proportion of failures in incomplete call chain collection;
- the generation module 1802 generates a storage identifier corresponding to the first call chain data,
- the saving module 1803 saves the cross-domain identifier and the first call chain data according to the storage identifier, which can reduce the frequency of reporting the call chain data to the central server and improve the data transmission efficiency;
- the synchronization module 1804 synchronizes the first call chain data to the central server to This enables the central server to analyze data corresponding to cross-data center businesses to meet the needs of data analysis and reduce the storage space of the central server wasted due to centralized storage of call chain data.
- Figure 19 shows a structural diagram of an exemplary hardware architecture of a computing device capable of implementing the data processing method and apparatus according to embodiments of the present application.
- computing device 1900 includes an input device 1901, an input interface 1902, a central processing unit 1903, a memory 1904, an output interface 1905, and an output device 1906.
- the input interface 1902, the central processing unit 1903, the memory 1904, and the output interface 1905 are connected to each other through the bus 1907.
- the input device 1901 and the output device 1906 are connected to the bus 1907 through the input interface 1902 and the output interface 1905 respectively, and then to other parts of the computing device 1900. Component connections.
- the input device 1901 receives input information from the outside and transmits the input information to the central processor 1903 through the input interface 1902; the central processor 1903 processes the input information based on computer-executable instructions stored in the memory 1904 to generate output information.
- the output information is temporarily or permanently stored in the memory 1904 and then transmitted to the output device 1906 through the output interface 1905; the output device 1906 outputs the output information to the outside of the computing device 1900 for use by the user.
- the computing device shown in FIG. 19 may be implemented as an electronic device, and the electronic device may include: a memory configured to store a computer program; and a processor configured to execute the computer program stored in the memory. , to perform the above data processing method.
- the computing device shown in Figure 19 may be implemented as a data processing system, which may include: a memory configured to store a computer program; a processor configured to execute the computer program stored in the memory , to perform the above data processing method.
- Embodiments of the present application also provide a computer-readable storage medium, which stores a computer program.
- the computer program is executed by a processor, the above-mentioned data processing method is implemented.
- Embodiments of the present application may be implemented by a data processor of the mobile device executing computer program instructions, for example in a processor entity, or by hardware, or by a combination of software and hardware.
- Computer program instructions may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code written in any combination of one or more programming languages or object code.
- ISA instruction set architecture
- Any block diagram of a logic flow in the figures of this application may represent program steps, or may represent interconnected logic circuits, modules, and functions, or may represent a combination of program steps and logic circuits, modules, and functions.
- Computer programs can be stored on memory.
- the memory may be of any type suitable to the local technical environment and may be implemented using any suitable data storage technology, such as, but not limited to, read only memory (ROM), random access memory (RAM), optical storage devices and systems (digital versatile disc DVD or CD), etc.
- Computer-readable media may include non-transitory storage media.
- the data processor may be of any type suitable for the local technical environment, such as, but not limited to, general purpose computers, special purpose computers, microprocessors, digital signal processors (DSP), application specific integrated circuits (ASIC), programmable logic devices (FGPA) and processors based on multi-core processor architecture.
- DSP digital signal processors
- ASIC application specific integrated circuits
- FGPA programmable logic devices
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Probability & Statistics with Applications (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Hardware Redundancy (AREA)
- Telephonic Communication Services (AREA)
Abstract
The present application relates to the technical field of data processing, and provides a data processing method, a data processing apparatus, an edge server, a data processing system, an electronic device, and a computer readable storage medium. The data processing method comprises: when it is determined that first call chain data is data corresponding to a service based on a cross-data center, marking the first call chain data to generate a cross-domain identifier; and storing the cross-domain identifier and the first call chain data in the edge server, so that the edge server synchronizes the first call chain data to a central server.
Description
相关申请的交叉引用Cross-references to related applications
本申请要求于2022年7月1日提交的中国专利申请NO.202210767296.4的优先权,该中国专利申请的内容通过引用的方式整体合并于此。This application claims priority from Chinese patent application No. 202210767296.4 filed on July 1, 2022. The contents of this Chinese patent application are incorporated herein by reference in their entirety.
本申请涉及数据处理技术领域,具体涉及数据处理方法、数据处理装置、边缘服务器、数据处理系统、电子设备和计算机可读存储介质。This application relates to the field of data processing technology, specifically to data processing methods, data processing devices, edge servers, data processing systems, electronic equipment and computer-readable storage media.
目前,一个企业可以在多个地方建立分部,并通过企业内部的分布式网络构建多个分部之间的通信连接,而在多个分部之间进行数据运维的过程中,通常会采用分布式调用链的方式来实现数据的传输。At present, an enterprise can establish branches in multiple places and build communication connections between multiple branches through the distributed network within the enterprise. In the process of data operation and maintenance between multiple branches, it is usually necessary to A distributed call chain is used to realize data transmission.
但是,在进行跨数据中心的调用数据的过程中,易发生调用链收集不完整的故障,降低整个系统的运维效率;并且,相关的对于跨数据中心的调用链信息的集中存储方式,也易导致数据在进行传输时占用大量的专网带宽,降低数据的传输效率。However, in the process of calling data across data centers, incomplete call chain collection failures are prone to occur, which reduces the operation and maintenance efficiency of the entire system; and the related centralized storage method of call chain information across data centers is also It is easy to cause data to occupy a large amount of private network bandwidth during transmission and reduce data transmission efficiency.
公开内容public content
第一方面,本申请实施例提供一种数据处理方法,包括:在确定第一调用链数据是基于跨数据中心的业务对应的数据的情况下,对第一调用链路数据进行标记,生成跨域标识;以及将跨域标识和第一调用链数据保存至边缘服务器,以供边缘服务器将第一调用链数据同步到中心服务器。In a first aspect, embodiments of the present application provide a data processing method, including: when it is determined that the first call chain data is based on data corresponding to cross-data center services, marking the first call link data and generating a cross-data center data processing method. Domain identification; and saving the cross-domain identification and the first call chain data to the edge server, so that the edge server can synchronize the first call chain data to the central server.
第二方面,本申请实施例提供一种数据处理方法,包括:获取数据处理装置发送的跨域标识和第一调用链数据,第一调用链数据是基于跨数据中心的业务对应的数据;生成与第一调用链数据对应的存储标识;依据存储标识保存跨域标识和第一调用链数据;以及将第一调用链数据同步至中心服务器。In a second aspect, embodiments of the present application provide a data processing method, which includes: obtaining a cross-domain identifier and first call chain data sent by a data processing device, where the first call chain data is data corresponding to services based on cross-data centers; generating a storage identifier corresponding to the first call chain data; saving the cross-domain identifier and the first call chain data according to the storage identifier; and synchronizing the first call chain data to the central server.
第三方面,本申请实施例提供一种数据处理装置,包括:标记模块,配置为在确定第一调用链数据是基于跨数据中心的业务对应的数据的情况下,对第一调用链路数据进行标记,生成跨域标识;以及存储模块,配置为将跨域标识和第一调用链数据保存至边缘服务器,以供边缘服务器将第一调用链数据同步到中心服务器。In a third aspect, embodiments of the present application provide a data processing device, including: a marking module configured to, when it is determined that the first call chain data is based on data corresponding to cross-data center services, marking and generating a cross-domain identification; and a storage module configured to save the cross-domain identification and the first call chain data to the edge server, so that the edge server can synchronize the first call chain data to the central server.
第四方面,本申请实施例提供一种边缘服务器,包括:获取模块,配置为获取数据处理装置发送的跨域标识和第一调用链数据,第一调用链数据是基于跨数据中心的业务对应的数据;生成模块,配置为生成与第一调用链数据对应的存储标识;保存模块,配置为依据存储标识保存跨域标识和第一调用链数据;以及同步模块,配置为将第一调用链数据同步至中心服务器。In the fourth aspect, embodiments of the present application provide an edge server, including: an acquisition module configured to acquire the cross-domain identification and first call chain data sent by the data processing device. The first call chain data is based on business correspondence across data centers. data; a generation module configured to generate a storage identifier corresponding to the first call chain data; a save module configured to save the cross-domain identifier and the first call chain data based on the storage identifier; and a synchronization module configured to save the first call chain data Data is synchronized to the central server.
第五方面,本申请实施例提供一种数据处理系统,包括:通信连接的数据处理装置、边缘服务器和中心服务器;数据处理装置,配置为执行本申请第一
方面中的数据处理方法;边缘服务器,配置为执行本申请第二方面中的数据处理方法;中心服务器,配置为获取边缘服务器同步的第一调用链数据;响应于用户终端发送的查询请求,基于查询请求中的查询标识获取第一调用链数据,并将第一调用链数据反馈给用户终端;第一调用链数据是基于跨数据中心的业务对应的数据。In a fifth aspect, embodiments of the present application provide a data processing system, including: a communication-connected data processing device, an edge server, and a central server; a data processing device configured to execute the first step of the present application. The data processing method in the second aspect; the edge server is configured to execute the data processing method in the second aspect of this application; the central server is configured to obtain the first call chain data synchronized by the edge server; in response to the query request sent by the user terminal, based on The query identifier in the query request obtains the first call chain data, and feeds the first call chain data back to the user terminal; the first call chain data is based on business correspondence across data centers.
第六方面,本申请实施例提供一种电子设备,包括:至少一个处理器;以及存储器,其上存储有至少一个计算机程序,当至少一个计算机程序被至少一个处理器执行时,使得至少一个处理器实现本申请实施例中的数据处理方法。In a sixth aspect, embodiments of the present application provide an electronic device, including: at least one processor; and a memory on which at least one computer program is stored. When the at least one computer program is executed by at least one processor, at least one process The device implements the data processing method in the embodiment of this application.
第七方面,本申请实施例提供了一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序,计算机程序被处理器执行时实现本申请实施例中的数据处理方法。In a seventh aspect, embodiments of the present application provide a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the data processing method in the embodiment of the present application is implemented.
关于本申请的以上实施例和其他方面以及其实现方式,在附图说明、具体实施方式和权利要求中提供更多说明。Regarding the above embodiments and other aspects of the application and the manner in which they may be implemented, further description is provided in the description of the drawings, the detailed description and the claims.
图1示出本申请实施例提供的不同数据中心之间的调用链数据的处理方法的流程示意图。Figure 1 shows a schematic flowchart of a method for processing call chain data between different data centers provided by an embodiment of the present application.
图2示出本申请实施例提供的跨云上报的调用链数据的处理系统示意图。Figure 2 shows a schematic diagram of a processing system for call chain data reported across clouds provided by an embodiment of the present application.
图3示出本申请实施例提供的跨云查询的调用链数据的处理系统示意图。Figure 3 shows a schematic diagram of the processing system for cross-cloud query call chain data provided by the embodiment of the present application.
图4示出本申请实施例提供的数据处理方法的流程示意图。Figure 4 shows a schematic flowchart of the data processing method provided by the embodiment of the present application.
图5示出本申请实施例提供的查询前端界面的示意图。Figure 5 shows a schematic diagram of the query front-end interface provided by the embodiment of the present application.
图6示出本申请实施例提供的统计前端界面的示意图。Figure 6 shows a schematic diagram of the statistics front-end interface provided by the embodiment of the present application.
图7示出本申请实施例提供的数据处理方法的流程示意图。Figure 7 shows a schematic flowchart of the data processing method provided by the embodiment of the present application.
图8示出本申请实施例提供的数据处理系统的组成方框图。Figure 8 shows a block diagram of the data processing system provided by the embodiment of the present application.
图9示出本申请实施例提供的数据处理系统的组成方框图。Figure 9 shows a block diagram of the data processing system provided by the embodiment of the present application.
图10示出本申请实施例提供的数据处理系统的工作方法的流程示意图。Figure 10 shows a schematic flowchart of the working method of the data processing system provided by the embodiment of the present application.
图11示出本申请实施例提供的第一调用链数据的采集方法的流程示意图。Figure 11 shows a schematic flowchart of a method for collecting first call chain data provided by an embodiment of the present application.
图12示出本申请实施例提供的边缘调用链服务器对第一调用链数据的处理方法的流程示意图。Figure 12 shows a schematic flowchart of a method for processing first call chain data by an edge call chain server provided by an embodiment of the present application.
图13示出本申请实施例提供的第一调用链数据的查询方法的流程示意图。Figure 13 shows a schematic flowchart of the first call chain data query method provided by the embodiment of the present application.
图14示出本申请实施例提供的财务系统中的财务微服务对应的调用链数据的处理方法的流程示意图。Figure 14 shows a schematic flowchart of a method for processing call chain data corresponding to financial microservices in the financial system provided by the embodiment of the present application.
图15示出本申请实施例提供的通信运营商的计费系统中的计费微服务对应的调用链数据的处理方法的流程示意图。Figure 15 shows a schematic flowchart of a method for processing call chain data corresponding to a charging microservice in a communication operator's charging system provided by an embodiment of the present application.
图16示出本申请实施例提供的基于云端的游戏场景微服务对应的调用链数据的处理方法的流程示意图。Figure 16 shows a schematic flowchart of a method for processing call chain data corresponding to a cloud-based game scene microservice provided by an embodiment of the present application.
图17示出本申请实施例提供的数据处理装置的组成方框图。Figure 17 shows a block diagram of a data processing device provided by an embodiment of the present application.
图18示出本申请实施例提供的边缘服务器的组成方框图。Figure 18 shows a block diagram of the edge server provided by the embodiment of the present application.
图19示出能够实现根据本申请实施例的数据处理方法和装置的计算设备的示例性硬件架构的结构图。Figure 19 shows a structural diagram of an exemplary hardware architecture of a computing device capable of implementing the data processing method and apparatus according to embodiments of the present application.
为使本申请的目的、技术方案和优点更加清楚明白,下文中将结合附图对本申请的实施例进行详细说明。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的各特征可以相互任意组合。
In order to make the purpose, technical solutions and advantages of the present application more clear, the embodiments of the present application will be described in detail below with reference to the accompanying drawings. It should be noted that, as long as there is no conflict, the embodiments in this application and the features in the embodiments can be arbitrarily combined with each other.
随着互联网业务的快速扩展,软件架构也日益变得复杂,为了适应海量用户的高并发请求,系统中越来越多的组件开始采用分布式架构。例如,将单体架构拆分为多个微服务架构、将服务内缓存变为分布式缓存;服务组件之间的通信采用分布式通信消息的交互等等,不同的组件使分布式网络变得更加繁杂,不易管理。With the rapid expansion of Internet business, software architecture has become increasingly complex. In order to adapt to the high concurrent requests of massive users, more and more components in the system have begun to adopt distributed architecture. For example, the monolithic architecture is split into multiple microservice architectures, the in-service cache is turned into a distributed cache; the communication between service components adopts the interaction of distributed communication messages, etc. Different components make the distributed network become More complex and difficult to manage.
随着通信系统复杂度的提升,以及用户对容灾等方面的需求,在政企分布式应用场景中,越来越多的企业会采用“两地三中心”的模式来搭建自己的通信网络。例如,图1示出本申请实施例提供的不同数据中心之间的调用链数据的处理方法的流程示意图。如图1所示,主中心服务器110分别与同城灾备中心服务器120和异地灾备中心服务器130通信连接。With the increase in the complexity of communication systems and users' needs for disaster recovery and other aspects, in government and enterprise distributed application scenarios, more and more enterprises will adopt the "two places and three centers" model to build their own communication networks . For example, FIG. 1 shows a schematic flowchart of a method for processing call chain data between different data centers provided by an embodiment of the present application. As shown in FIG. 1 , the main center server 110 is communicatively connected with the local disaster recovery center server 120 and the remote disaster recovery center server 130 .
主中心服务器110需要与同城灾备中心服务器120进行数据同步,并且,同城灾备中心服务器120还需要与异地灾备中心服务器130之间进行异步的日志重放等业务。The main center server 110 needs to perform data synchronization with the local disaster recovery center server 120, and the local disaster recovery center server 120 also needs to perform asynchronous log replay and other services with the remote disaster recovery center server 130.
而在进行不同的业务数据的处理过程中,第一应用在调用数据的过程中,可能存在跨多个数据中心的情况(如,同城灾备中心服务器120上的第一应用调用主中心服务器110的第一组111对应的数据节点上的数据、或第二组112对应的数据节点上的数据、或第三组113对应的数据节点上的数据等),并且,该第一应用也可能会与部署在其它数据中心上的第二应用进行交互(如,同城灾备中心服务器120上的第一应用与异地灾备中心服务器130的第二应用之间进行交互等)。在上述过程中,存在调用链数据是基于跨数据中心的业务对应的数据,易发生调用链收集不完整的故障,降低整个系统的运维效率。并且,由于数据都集中存储在主中心服务器110上,易导致主中心服务器110在与其他服务器进行数据交互时,占用大量的专网带宽,降低数据的传输效率。In the process of processing different business data, the first application may call data across multiple data centers (for example, the first application on the local disaster recovery center server 120 calls the main center server 110 The data on the data nodes corresponding to the first group 111, or the data on the data nodes corresponding to the second group 112, or the data on the data nodes corresponding to the third group 113, etc.), and the first application may also Interact with second applications deployed on other data centers (for example, interact between the first application on the local disaster recovery center server 120 and the second application on the remote disaster recovery center server 130, etc.). In the above process, the call chain data is based on the data corresponding to the business across data centers, which is prone to incomplete collection of the call chain and reduces the operation and maintenance efficiency of the entire system. Moreover, since data are all centrally stored on the main central server 110, it is easy for the main central server 110 to occupy a large amount of private network bandwidth and reduce data transmission efficiency when interacting with other servers.
图2示出本申请实施例提供的跨云上报的调用链数据的处理系统示意图。如图2所示,自建机房中的应用D在向公有云上的公网接入点上传输数据时,会占用公网带宽和专网带宽,但是,公网流量的费用、以及公网的网络稳定性都存在很多的限制,降低了应用D的使用感受。Figure 2 shows a schematic diagram of a processing system for call chain data reported across clouds provided by an embodiment of the present application. As shown in Figure 2, when application D in the self-built computer room transmits data to the public network access point on the public cloud, it will occupy the public network bandwidth and private network bandwidth. However, the cost of public network traffic, and the public network There are many limitations on network stability, which reduces the user experience of Application D.
跨云查询是指原始链路数据保存在当前云网络内,将用户的一次查询请求分别下发至多个云服务器,以使多个云服务器将查询结果聚合后,再进行统一的处理,能够减少在公网中的传输成本。Cross-cloud query means that the original link data is stored in the current cloud network, and a user's query request is sent to multiple cloud servers respectively, so that multiple cloud servers can aggregate the query results and then perform unified processing, which can reduce Transmission costs in the public network.
图3示出本申请实施例提供的跨云查询的调用链数据的处理系统示意图。如3所示,当自建机房中的应用C通过内网接入点与公有云中的某个应用(如,应用A或应用B)进行交互时,公有云中需要部署多个数据处理终端,以供多个应用进行访问使用,但该公有云中不支持分位数和全局的调用链数据的统计分析等功能,降低了对网络中的调用链数据的管理效率。Figure 3 shows a schematic diagram of the processing system for cross-cloud query call chain data provided by the embodiment of the present application. As shown in 3, when application C in the self-built computer room interacts with an application in the public cloud (for example, application A or application B) through the intranet access point, multiple data processing terminals need to be deployed in the public cloud. , for access by multiple applications, but the public cloud does not support functions such as statistical analysis of quantile and global call chain data, which reduces the management efficiency of call chain data in the network.
本申请实施例提供一种数据处理方法、一种数据处理装置、一种边缘服务器、一种数据处理系统、一种电子设备和一种计算机可读存储介质。Embodiments of the present application provide a data processing method, a data processing device, an edge server, a data processing system, an electronic device, and a computer-readable storage medium.
图4示出本申请实施例提供的数据处理方法的流程示意图。该数据处理方法可应用于数据处理装置。如图4所示,本申请实施例中的数据处理方法包括但不限于以下步骤S401和S402。Figure 4 shows a schematic flowchart of the data processing method provided by the embodiment of the present application. The data processing method can be applied to data processing devices. As shown in Figure 4, the data processing method in the embodiment of the present application includes but is not limited to the following steps S401 and S402.
步骤S401,在确定第一调用链数据是基于跨数据中心的业务对应的数据的情况下,对第一调用链路数据进行标记,生成跨域标识。Step S401: When it is determined that the first call chain data is based on data corresponding to cross-data center services, mark the first call link data and generate a cross-domain identification.
步骤S402,将跨域标识和第一调用链数据保存至边缘服务器,以供边缘服务器将第一调用链数据同步到中心服务器。Step S402: Save the cross-domain identification and the first call chain data to the edge server, so that the edge server can synchronize the first call chain data to the central server.
在本申请提供的数据处理方法中,通过在确定第一调用链数据是基于跨数据中心的业务对应的数据的情况下,对第一调用链路数据进行标记,生成跨域标识,用以区分其他不跨域操作的调用链数据,降低调用链收集不完整的故障发生的比例,保证对跨数据中心的业务对应的数据进行分析时的完整性;将跨域标识和第一调用链数据保存至边缘服务器,以供边缘服务器将第一调用链数
据同步到中心服务器,能够减少因集中式存储调用链数据而浪费的存储空间,并减少上报调用链数据的频次,提升数据的传输效率,同时减少对专网带宽的消耗。In the data processing method provided by this application, when it is determined that the first call chain data is based on data corresponding to cross-data center services, the first call link data is marked to generate a cross-domain identifier to distinguish Other call chain data that do not operate cross-domain, reduce the proportion of incomplete call chain collection failures, and ensure the integrity of data corresponding to cross-data center business analysis; save cross-domain identification and first call chain data to the edge server, for the edge server to transfer the first call chain number Data synchronization to the central server can reduce the storage space wasted due to centralized storage of call chain data, reduce the frequency of reporting call chain data, improve data transmission efficiency, and reduce the consumption of private network bandwidth.
在一些实施方式中,在执行步骤S402中的将跨域标识和第一调用链数据保存至边缘服务器,以供边缘服务器将第一调用链数据同步到中心服务器之后,所述数据处理方法还包括:In some embodiments, after performing step S402 of saving the cross-domain identification and the first call chain data to the edge server for the edge server to synchronize the first call chain data to the central server, the data processing method further includes :
向边缘服务器发送同步请求,以供边缘服务器依据同步请求中的目标地址,将第一调用链数据同步至中心服务器;以及响应于中心服务器反馈的同步响应,确定边缘服务器完成对第一调用链数据的同步。Send a synchronization request to the edge server for the edge server to synchronize the first call chain data to the central server according to the target address in the synchronization request; and respond to the synchronization response fed back by the central server to determine that the edge server has completed the first call chain data synchronization.
目标地址为中心服务器的网络地址。The destination address is the network address of the central server.
通过向边缘服务器发送同步请求,能够使边缘服务器依据同步请求中的目标地址,将第一调用链数据同步至中心服务器,以使中心服务器可以获取跨数据中心的调用链数据,方便后续的数据分析,并保证在对调用链数据进行分析时,减少发生调用链收集不完整的故障的比例,提升数据分析的准确性。By sending a synchronization request to the edge server, the edge server can synchronize the first call chain data to the central server based on the target address in the synchronization request, so that the central server can obtain cross-data center call chain data to facilitate subsequent data analysis. , and ensure that when analyzing call chain data, the proportion of incomplete call chain collection failures is reduced and the accuracy of data analysis is improved.
在一些实施方式中,在执行步骤S402中的将跨域标识和第一调用链数据保存至边缘服务器,以供边缘服务器将第一调用链数据同步到中心服务器之后,所述数据处理方法还包括:获取查询请求;以及依据查询标识对边缘服务器和/或中心服务器进行查询,获取第一调用链数据。In some embodiments, after performing step S402 of saving the cross-domain identification and the first call chain data to the edge server for the edge server to synchronize the first call chain data to the central server, the data processing method further includes : Obtain the query request; and query the edge server and/or central server according to the query identifier to obtain the first call chain data.
查询请求包括查询标识,查询标识与第一调用链数据的存储标识相对应。The query request includes a query identifier, and the query identifier corresponds to the storage identifier of the first call chain data.
例如,可向边缘服务器和/或中心服务器发送查询请求,当某个服务器中存储有与该查询标识对应的第一调用链数据时,即可获取到该第一调用链数据。For example, a query request can be sent to the edge server and/or the central server. When a server stores the first call chain data corresponding to the query identifier, the first call chain data can be obtained.
因基于跨数据中心的调用链数据不仅存储在中心服务器上,还可以存储在边缘服务器上,所以向边缘服务器和/或中心服务器发送查询请求能够方便不同的设备对这种跨数据中心的调用链数据的查询和使用,减少调用链收集不完整的故障的发生比例。Because the call chain data based on cross-data centers is not only stored on the central server, but also on the edge server, sending query requests to the edge server and/or the central server can facilitate different devices to access this cross-data center call chain. Query and use data to reduce the proportion of faults caused by incomplete call chain collection.
在一些实施方式中,所述依据查询标识对边缘服务器和/或中心服务器进行查询,获取第一调用链数据之后,所述数据处理方法还包括:基于树型结构,展示第一调用链数据对应的微服务所属的数据中心的类别;和/或,基于图型结构,展示第一调用链数据对应的微服务的处理时长信息。In some embodiments, after querying the edge server and/or the central server according to the query identifier and obtaining the first call chain data, the data processing method further includes: based on the tree structure, displaying the corresponding data of the first call chain The category of the data center to which the microservice belongs; and/or, based on the graph structure, display the processing time information of the microservice corresponding to the first call chain data.
例如,图5示出本申请实施例提供的查询前端界面的示意图。如图5所示,图5的左半部分采用树型结构分别展示数据中心1下包括的微服务1、以及微服务2和公共服务;以及数据中心2包括的微服务3和微服务4。例如,微服务1对应第一调用链数据,则在图5的右半部分会基于图型结构,展示该第一调用链数据的调用过程(如,图5中的“调用链展示”),以使用户可以清晰地查看到不同的微服务对应的调用链数据的调用过程。For example, FIG. 5 shows a schematic diagram of the query front-end interface provided by the embodiment of the present application. As shown in Figure 5, the left half of Figure 5 uses a tree structure to respectively display microservice 1, microservice 2 and public services included in data center 1; and microservice 3 and microservice 4 included in data center 2. For example, if microservice 1 corresponds to the first call chain data, the right half of Figure 5 will display the calling process of the first call chain data based on the graph structure (for example, the "Call Chain Display" in Figure 5). This allows users to clearly view the calling process of the call chain data corresponding to different microservices.
traceId表示查询标识(如,12445等),以供用户输入期望查询的查询标识,并点击“查询”按钮后,获取与该查询标识对应的调用链数据的相关信息,直观地展示调用链数据给用户,以提升用户的使用感受。traceId represents the query identifier (such as 12445, etc.) for the user to input the query identifier they want to query, and click the "Query" button to obtain relevant information about the call chain data corresponding to the query identifier, and intuitively display the call chain data to users to improve the user experience.
在一些实施方式中,所述数据处理方法还包括:在确定第二调用链数据是基于同一个数据中心内发生的业务对应的数据的情况下,保存第二调用链数据至边缘服务器。In some embodiments, the data processing method further includes: when it is determined that the second call chain data is based on data corresponding to services occurring in the same data center, saving the second call chain data to the edge server.
需要说明的是,对于同一个数据中心内发生的业务对应的调用链数据,不需要汇聚到中心服务器上,从而节省了中心服务器的存储空间,同时,还减少了数据交互时对专网带宽的消耗,降低了网络通信的成本。It should be noted that the call chain data corresponding to the business occurring in the same data center does not need to be aggregated to the central server, thus saving the storage space of the central server. At the same time, it also reduces the consumption of private network bandwidth during data interaction. consumption, reducing the cost of network communication.
在一些实施方式中,在执行步骤S401中的在确定第一调用链数据是基于跨数据中心的业务对应的数据的情况下,对第一调用链路数据进行标记,生成跨域标识之前,所述数据处理方法还包括:In some embodiments, when it is determined that the first call chain data is based on data corresponding to cross-data center services in step S401, before marking the first call link data and generating a cross-domain identification, the The above data processing methods also include:
从注册服务器获取与第一调用链数据对应的微服务的注册信息;获取第一调用链数据对应的目标数据的存储地址;以及依据微服务的注册地址和第一调
用链数据对应的目标数据的存储地址,确定第一调用链数据是否是基于跨数据中心的业务对应的数据。Obtain the registration information of the microservice corresponding to the first call chain data from the registration server; obtain the storage address of the target data corresponding to the first call chain data; and based on the registration address of the microservice and the first call chain data Use the storage address of the target data corresponding to the chain data to determine whether the first call chain data is based on data corresponding to cross-data center services.
注册信息包括微服务的注册地址;目标数据为微服务期望获取的数据。The registration information includes the registration address of the microservice; the target data is the data that the microservice expects to obtain.
通过对微服务的注册地址和第一调用链数据对应的目标数据的存储地址的对比,能够明确微服务在进行业务数据处理时,是否需要使用其他数据中心的数据。By comparing the registration address of the microservice and the storage address of the target data corresponding to the first call chain data, it can be clarified whether the microservice needs to use data from other data centers when processing business data.
在确定微服务的注册地址和第一调用链数据对应的目标数据的存储地址不同的情况下,确定与该微服务对应的第一调用链数据是基于跨数据中心的业务对应的数据;在确定微服务的注册地址和第一调用链数据对应的目标数据的存储地址相同的情况下,确定与该微服务对应的第一调用链数据不是基于跨数据中心的业务对应的数据,即第一调用链数据是数据中心内发生的业务对应的调用链数据。When it is determined that the registration address of the microservice is different from the storage address of the target data corresponding to the first call chain data, it is determined that the first call chain data corresponding to the microservice is data corresponding to the business based on the cross-data center; after determining When the registration address of the microservice is the same as the storage address of the target data corresponding to the first call chain data, it is determined that the first call chain data corresponding to the microservice is not based on data corresponding to cross-data center business, that is, the first call Chain data is the call chain data corresponding to the business occurring in the data center.
基于对第一调用链数据的类型的确定,能够明确是否需要将该第一调用链数据同步至中心服务器,从而减少数据传输过程中的传输带宽的消耗,节约传输成本。Based on the determination of the type of the first call chain data, it can be clarified whether the first call chain data needs to be synchronized to the central server, thereby reducing the consumption of transmission bandwidth during data transmission and saving transmission costs.
在一些实施方式中,第一调用链数据为财务系统中的财务微服务对应的数据。步骤S402中的将跨域标识和第一调用链数据保存至边缘服务器,以供边缘服务器将第一调用链数据同步到中心服务器,可以采用如下方式实现:In some implementations, the first call chain data is data corresponding to financial microservices in the financial system. Saving the cross-domain identification and the first call chain data to the edge server in step S402, so that the edge server can synchronize the first call chain data to the central server, can be implemented in the following manner:
每间隔预设时长(如,3小时、或5小时等),从边缘服务器中获取第一调用链数据对应的存储地址;依据第一调用链数据对应的存储地址和中心服务器的网络地址,生成同步请求;以及向边缘服务器发送同步请求,以供边缘服务器依据第一调用链数据对应的存储地址和中心服务器的网络地址,将第一调用链数据同步至中心服务器。At each preset interval (for example, 3 hours, or 5 hours, etc.), the storage address corresponding to the first call chain data is obtained from the edge server; based on the storage address corresponding to the first call chain data and the network address of the central server, a generated a synchronization request; and sending a synchronization request to the edge server for the edge server to synchronize the first call chain data to the central server based on the storage address corresponding to the first call chain data and the network address of the central server.
第一调用链数据对应的存储地址为边缘服务器基于其上一次获取调用链数据的数据偏移量信息确定的地址。The storage address corresponding to the first call chain data is an address determined by the edge server based on the data offset information of the last time it obtained the call chain data.
例如,上一次获取调用链数据的数据偏移量信息包括存储地址偏移长度和存储首地址,则可根据该存储地址偏移长度与存储首地址进行加和处理,获得第一调用链数据对应的存储地址,进而加快对第一调用链数据的获取速度。For example, the data offset information of the last time the call chain data was obtained includes the storage address offset length and the storage first address. Then the storage address offset length and the storage first address can be added together to obtain the first call chain data correspondence. storage address, thereby speeding up the acquisition of the first call chain data.
通过获得第一调用链数据对应的存储地址,可快速准确地获取到第一调用链数据。进而基于中心服务器的网络地址,向边缘服务器发送同步请求,以使该边缘服务器能够根据该中心服务器的网络地址,向该中心服务器发送第一调用链数据,加快第一调用链数据的同步效率,保证数据的安全存储。By obtaining the storage address corresponding to the first call chain data, the first call chain data can be quickly and accurately obtained. Then, based on the network address of the central server, a synchronization request is sent to the edge server, so that the edge server can send the first call chain data to the central server based on the network address of the central server, speeding up the synchronization efficiency of the first call chain data, Ensure safe storage of data.
在一些实施方式中,第一调用链数据为通信运营商的计费系统中的计费微服务对应的数据(例如,查询账单等产生的数据、或计费标准等)。步骤S402中的将跨域标识和第一调用链数据保存至边缘服务器,以供边缘服务器将第一调用链数据同步到中心服务器,可以采用如下方式实现:In some embodiments, the first call chain data is data corresponding to the charging microservice in the charging system of the communication operator (for example, data generated by querying bills, etc., or charging standards, etc.). Saving the cross-domain identification and the first call chain data to the edge server in step S402, so that the edge server can synchronize the first call chain data to the central server, can be implemented in the following manner:
对第一调用链数据进行分析,确定第一调用链数据对应的计费微服务所属的计费区域信息;以及依据计费微服务对应的计费区域等级,将跨域标识和第一调用链数据保存至与计费区域等级对应的边缘服务器。Analyze the first call chain data to determine the billing area information to which the billing microservice corresponding to the first call chain data belongs; and according to the billing area level corresponding to the billing microservice, combine the cross-domain identification and the first call chain The data is saved to the edge server corresponding to the billing area level.
计费区域信息包括计费微服务对应的计费区域等级。例如,计费区域等级可以包括省级计费区域、市级计费区域和县级计费区域中的至少一种。The charging area information includes the charging area level corresponding to the charging microservice. For example, the charging area level may include at least one of a provincial charging area, a municipal charging area, and a county charging area.
通过获取计费微服务对应的计费区域等级,能够明确具体的计费标准,快速准确地将跨域标识和第一调用链数据保存至与计费区域等级对应的边缘服务器,以方便该边缘服务器进行计费,保证终端通信的正常进行,并维护运营商的利益。By obtaining the billing area level corresponding to the billing microservice, the specific billing standard can be clarified, and the cross-domain identification and first call chain data can be quickly and accurately saved to the edge server corresponding to the billing area level to facilitate the edge. The server performs billing to ensure the normal communication of terminals and protect the interests of operators.
在一些实施方式中,第一调用链数据为基于云端的游戏场景微服务对应的数据,游戏场景微服务包括游戏场景渲染微服务及其对应的计费微服务,游戏场景渲染微服务部署在边缘服务器上,游戏场景渲染微服务对应的计费微服务的目标数据存储在公有云服务器上。
In some implementations, the first call chain data is data corresponding to the cloud-based game scene microservice. The game scene microservice includes the game scene rendering microservice and its corresponding billing microservice. The game scene rendering microservice is deployed at the edge. On the server, the target data of the billing microservice corresponding to the game scene rendering microservice is stored on the public cloud server.
例如,当终端需要进行游戏场景渲染时,需要通过就近的边缘服务器上部署的游戏场景渲染微服务为其提供服务,但对应的,该游戏场景渲染所产生的费用信息,需要通过部署在公有云服务器上的计费微服务来实现,从而产生了跨数据中心的第一调用链数据。For example, when a terminal needs to render a game scene, it needs to be served through the game scene rendering microservice deployed on the nearest edge server. However, correspondingly, the cost information generated by the game scene rendering needs to be provided through the game scene rendering microservice deployed on the public cloud. The billing microservice is implemented on the server, thus generating the first call chain data across data centers.
通过将游戏场景渲染微服务部署在边缘服务器上,能够方便终端到边缘服务器上获取其需要的数据,提升与终端之间的服务效率;而将游戏场景渲染微服务对应的计费微服务的目标数据存储在公有云服务器上,能够使公有云服务器对多个不同的边缘服务器上进行的业务进行准确计费,提升计费的准确性。By deploying the game scene rendering microservice on the edge server, it is convenient for the terminal to obtain the data it needs from the edge server, improving the service efficiency with the terminal; and the goal of the billing microservice corresponding to the game scene rendering microservice is Data is stored on the public cloud server, which enables the public cloud server to accurately bill services performed on multiple different edge servers, improving billing accuracy.
在一些实施方式中,所述将跨域标识和第一调用链数据保存至边缘服务器,以供边缘服务器将第一调用链数据同步到中心服务器之后,所述数据处理还包括:向公有云服务器发送数据统计请求;响应于公有云服务器反馈的统计响应,获取统计结果;以及展示统计结果。In some embodiments, after the cross-domain identification and the first call chain data are saved to the edge server so that the edge server can synchronize the first call chain data to the central server, the data processing further includes: sending the data to the public cloud server. Send a data statistics request; respond to the statistical response fed back by the public cloud server, obtain statistical results; and display the statistical results.
数据统计请求用于统计在预设时长内,预设数量的调用链数据被使用的信息。统计结果可以包括:统计开始时间、统计截止时间、统计类型和调用链数据对应的使用信息中的至少一种。The data statistics request is used to count information on the use of a preset amount of call chain data within a preset period of time. The statistical results may include: at least one of: statistical start time, statistical end time, statistical type, and usage information corresponding to the call chain data.
例如,图6示出本申请实施例提供的统计前端界面的示意图。如图6所示,用户通过在“统计时间段”的输入窗口内输入需要进行统计的开始时间和截止时间,以及在“统计类型”中输入期望获取的调用链数据对应的统计类型,点击“统计按钮”,即可在“统计结果展示”中显示从开始时间到截止时间这段时间内,基于统计类型确定的预设数量的调用链数据被使用的信息。For example, FIG. 6 shows a schematic diagram of the statistics front-end interface provided by the embodiment of the present application. As shown in Figure 6, the user enters the start time and end time to be counted in the "Statistical Time Period" input window, and enters the statistical type corresponding to the call chain data expected to be obtained in the "Statistical Type" and clicks " "Statistics Button" will display in the "Statistical Result Display" the information used by the preset number of call chain data determined based on the statistical type during the period from the start time to the end time.
通过上述对调用链数据的统计,能够明确公有云服务器上对某种统计类型对应的调用链数据的调用情况,便于用户或运维人员的查询,从而基于统计结果的展示,方便快捷地定位可能发生故障的处理环节,提升对调用链数据的管理和维护效率。Through the above statistics of call chain data, the call status of the call chain data corresponding to a certain statistical type on the public cloud server can be clarified, which facilitates the query of users or operation and maintenance personnel, so that based on the display of statistical results, it is possible to quickly and easily locate possible Improve the efficiency of management and maintenance of call chain data by handling failures.
图7示出本申请实施例提供的数据处理方法的流程示意图。该方法可应用于边缘服务器。如图7所示,本申请实施例中的数据处理方法包括但不限于以下步骤S701至S704。Figure 7 shows a schematic flowchart of the data processing method provided by the embodiment of the present application. This method can be applied to edge servers. As shown in Figure 7, the data processing method in the embodiment of the present application includes but is not limited to the following steps S701 to S704.
步骤S701,获取数据处理装置发送的跨域标识和第一调用链数据。Step S701: Obtain the cross-domain identifier and first call chain data sent by the data processing device.
第一调用链数据是基于跨数据中心的业务对应的数据。The first call chain data is based on business correspondence across data centers.
步骤S702,生成与第一调用链数据对应的存储标识。Step S702: Generate a storage identifier corresponding to the first call chain data.
步骤S703,依据存储标识保存跨域标识和第一调用链数据。Step S703: Save the cross-domain identifier and the first call chain data according to the storage identifier.
步骤S704,将第一调用链数据同步至中心服务器。Step S704: Synchronize the first call chain data to the central server.
在一些实施方式中,步骤S704中的将第一调用链数据同步至中心服务器包括:响应于数据处理装置发送的同步请求,获取同步请求中的目标地址;以及依据目标地址将第一调用链数据同步至中心服务器。In some implementations, synchronizing the first call chain data to the central server in step S704 includes: responding to the synchronization request sent by the data processing device, obtaining the target address in the synchronization request; and synchronizing the first call chain data according to the target address. Synchronize to central server.
目标地址为中心服务器的网络地址。The destination address is the network address of the central server.
在本申请提供的数据处理方法中,通过获取数据处理装置发送的跨域标识和第一调用链数据,基于跨域标识能够明确第一调用链数据是基于跨数据中心的业务对应的数据,能够将跨数据中心的调用链数据与其他不跨域操作的调用链数据进行区分,降低调用链收集不完整的故障发生的比例;生成与第一调用链数据对应的存储标识,依据存储标识保存跨域标识和第一调用链数据,能够减少上报至中心服务器的调用链数据的频次,提升数据的传输效率;将第一调用链数据同步至中心服务器,以使中心服务器可以对跨数据中心的业务对应的数据进行分析,满足数据分析的需求,并减少因集中式存储调用链数据而浪费的中心服务器的存储空间。In the data processing method provided by this application, by obtaining the cross-domain identification and the first call chain data sent by the data processing device, it can be determined based on the cross-domain identification that the first call chain data is data corresponding to the business across data centers, and it can Distinguish cross-data center call chain data from other call chain data that does not cross-domain operations to reduce the proportion of incomplete call chain collection failures; generate a storage identifier corresponding to the first call chain data, and save the cross-domain call chain data based on the storage identifier. Domain identification and first call chain data can reduce the frequency of call chain data reported to the central server and improve data transmission efficiency; synchronize the first call chain data to the central server so that the central server can handle cross-data center business The corresponding data is analyzed to meet the needs of data analysis and reduce the storage space of the central server wasted due to centralized storage of call chain data.
图8示出本申请实施例提供的数据处理系统的组成方框图。如图8所示,该数据处理系统包括但不限于如下设备:通信连接的数据处理装置801、边缘服务器802、中心服务器803和用户终端804。Figure 8 shows a block diagram of the data processing system provided by the embodiment of the present application. As shown in Figure 8, the data processing system includes but is not limited to the following equipment: a communication-connected data processing device 801, an edge server 802, a central server 803, and a user terminal 804.
数据处理装置801配置为在确定第一调用链数据是基于跨数据中心的业务
对应的数据的情况下,对第一调用链路数据进行标记,生成跨域标识;将跨域标识和第一调用链数据保存至边缘服务器802,以供边缘服务器802将第一调用链数据同步到中心服务器803。The data processing device 801 is configured to determine that the first call chain data is based on cross-data center services. In the case of corresponding data, the first call link data is marked to generate a cross-domain identification; the cross-domain identification and the first call chain data are saved to the edge server 802 for the edge server 802 to synchronize the first call chain data. To the central server 803.
边缘服务器802配置为获取数据处理装置801发送的跨域标识和第一调用链数据,第一调用链数据是基于跨数据中心的业务对应的数据;生成与第一调用链数据对应的存储标识;依据存储标识保存跨域标识和第一调用链数据;将第一调用链数据同步至中心服务器803。The edge server 802 is configured to obtain the cross-domain identification and the first call chain data sent by the data processing device 801. The first call chain data is data corresponding to the business based on the cross-data center; generate a storage identification corresponding to the first call chain data; Save the cross-domain identification and the first call chain data according to the storage identification; synchronize the first call chain data to the central server 803.
中心服务器803配置为获取边缘服务器802同步的第一调用链数据;响应于用户终端804发送的查询请求,基于查询请求中的查询标识获取第一调用链数据,并将第一调用链数据反馈给用户终端804;第一调用链数据是基于跨数据中心的业务对应的数据。The central server 803 is configured to obtain the first call chain data synchronized by the edge server 802; in response to the query request sent by the user terminal 804, obtain the first call chain data based on the query identifier in the query request, and feed the first call chain data back to User terminal 804; the first call chain data is data corresponding to services based on cross-data centers.
在本申请提供的数据处理系统中,通过数据处理装置801向边缘服务器802发送跨域标识和第一调用链数据,基于跨域标识能够明确第一调用链数据是基于跨数据中心的业务对应的数据,能够将跨数据中心的调用链数据与其他不跨域操作的调用链数据进行区分,降低调用链收集不完整的故障发生的比例;边缘服务器802生成与第一调用链数据对应的存储标识,依据存储标识保存跨域标识和第一调用链数据,能够减少上报至中心服务器803的调用链数据的频次,提升数据的传输效率;边缘服务器802将第一调用链数据同步至中心服务器803,以使中心服务器803可以对跨数据中心的业务对应的数据进行分析,满足数据分析的需求,并减少因集中式存储调用链数据而浪费的中心服务器的存储空间。In the data processing system provided by this application, the data processing device 801 sends the cross-domain identification and the first call chain data to the edge server 802. Based on the cross-domain identification, it can be clear that the first call chain data is based on cross-data center business correspondence. The data can distinguish cross-data center call chain data from other call chain data that does not cross-domain operations, reducing the proportion of incomplete call chain collection failures; the edge server 802 generates a storage identifier corresponding to the first call chain data. , saving the cross-domain identifier and the first call chain data according to the storage identifier can reduce the frequency of the call chain data reported to the central server 803 and improve the data transmission efficiency; the edge server 802 synchronizes the first call chain data to the central server 803, This allows the central server 803 to analyze data corresponding to cross-data center services, meet the needs of data analysis, and reduce the storage space of the central server wasted due to centralized storage of call chain data.
图9示出本申请实施例提供的数据处理系统的组成方框图。如图9所示,该数据处理系统包括但不限于如下设备:第一中心调用链服务器901、第二中心调用链服务器902、第一边缘调用链服务器903、第二边缘调用链服务器904、注册服务器905、用户终端906和多个调用链数据处理装置(如,调用链数据处理装置A、调用链数据处理装置B、调用链数据处理装置C和调用链数据处理装置D等)。Figure 9 shows a block diagram of the data processing system provided by the embodiment of the present application. As shown in Figure 9, the data processing system includes but is not limited to the following equipment: the first center call chain server 901, the second center call chain server 902, the first edge call chain server 903, the second edge call chain server 904, registration Server 905, user terminal 906 and multiple call chain data processing devices (eg, call chain data processing device A, call chain data processing device B, call chain data processing device C, call chain data processing device D, etc.).
第一边缘调用链服务器903包括第一调用链同步器9031;第二边缘调用链服务器904包括第二调用链同步器9041。The first edge call chain server 903 includes a first call chain synchronizer 9031; the second edge call chain server 904 includes a second call chain synchronizer 9041.
调用链数据处理装置配置为采集分布式调用链数据,该调用链数据处理装置可以与其对应的微服务处于同一个处理进程中,也可以与其对应的微服务处于不同的处理进程中。The call chain data processing device is configured to collect distributed call chain data. The call chain data processing device may be in the same processing process as its corresponding microservice, or may be in a different processing process as its corresponding microservice.
第一中心调用链服务器901或第二中心调用链服务器902配置为储存分布式调用链数据,并对其存储的调用链数据进行分析,以获得统计结果。在一些实施方式中,该第二中心调用链服务器902可以部署在一个特定的数据中心中。The first central call chain server 901 or the second central call chain server 902 is configured to store distributed call chain data and analyze the stored call chain data to obtain statistical results. In some embodiments, the second central call chain server 902 may be deployed in a specific data center.
在一些实施方式中,第一中心调用服务器902还可以配置为向用户终端906展示其查询到的调用链数据。或者,也可以采用调用链数据处理装置向用户终端906展示其查询到的调用链数据的使用信息、和/或统计信息。In some implementations, the first central call server 902 may also be configured to display the queried call chain data to the user terminal 906 . Alternatively, the call chain data processing device may also be used to display the usage information and/or statistical information of the queried call chain data to the user terminal 906 .
第一边缘调用链服务器903或第二边缘调用链服务器904配置为在每个数据中心内部,存储分布式调用链数据。The first edge call chain server 903 or the second edge call chain server 904 is configured to store distributed call chain data inside each data center.
第一调用链同步器9031配置为将第一边缘调用链服务器903中存储的跨数据中心的业务对应的调用链数据,同步至第一中心调用链服务器901;而对应本数据中心内部实现的业务对应的调用链数据则不需要同步至第一中心调用链服务器901。The first call chain synchronizer 9031 is configured to synchronize call chain data corresponding to cross-data center services stored in the first edge call chain server 903 to the first central call chain server 901; and corresponding to the services implemented within this data center The corresponding call chain data does not need to be synchronized to the first central call chain server 901.
第二调用链同步器9041配置为将第二边缘调用链服务器904中存储的跨数据中心的业务对应的调用链数据,同步至第一中心调用链服务器901;而对应本数据中心内部实现的业务对应的调用链数据则不需要同步至第一中心调用链服务器901。The second call chain synchronizer 9041 is configured to synchronize call chain data corresponding to cross-data center services stored in the second edge call chain server 904 to the first central call chain server 901; and corresponding to the services implemented within the data center The corresponding call chain data does not need to be synchronized to the first central call chain server 901.
注册服务器905配置为向多个调用链数据处理装置提供其需要的调用链数据对应的微服务的注册信息,该注册信息可以包括:微服务的注册地址等信息。
The registration server 905 is configured to provide multiple call chain data processing devices with the registration information of the microservice corresponding to the call chain data that they need. The registration information may include: the registration address of the microservice and other information.
需要说明的是,上述组件设备仅是通过逻辑关系进行的划分,在不同的应用场景中,还可以对不同的组件设备进行合并部署,以增加设备的功能的灵活性。It should be noted that the above component devices are only divided through logical relationships. In different application scenarios, different component devices can also be combined and deployed to increase the flexibility of the device's functions.
图10示出本申请实施例提供的数据处理系统的工作方法的流程示意图。如图10所示,该数据处理系统的工作方法包括但不限于如下步骤S1010至S1030。Figure 10 shows a schematic flowchart of the working method of the data processing system provided by the embodiment of the present application. As shown in Figure 10, the working method of the data processing system includes but is not limited to the following steps S1010 to S1030.
步骤S1010,调用链数据处理装置A对第一调用链数据进行标记,生成与该第一调用链数据对应的跨域标识;并将第一调用链数据及其对应的跨域标识上报给第一边缘调用链服务器903。Step S1010: The call chain data processing device A marks the first call chain data, generates a cross-domain identifier corresponding to the first call chain data, and reports the first call chain data and its corresponding cross-domain identifier to the first call chain data. The edge calls the chain server 903.
第一调用链数据是基于跨数据中心的业务生成的数据。并且,第一边缘调用链服务器903与调用链数据处理装置A同属于一个数据中心。The first call chain data is data generated based on cross-data center services. Moreover, the first edge call chain server 903 and the call chain data processing device A belong to the same data center.
步骤S1020,第一边缘调用链服务器903在接收到第一调用链数据及其对应的跨域标识后,基于该跨域标识,将第一调用链数据保存至本地的存储空间,同时,将该第一调用链数据同步到第一中心调用链服务器901。Step S1020: After receiving the first call chain data and its corresponding cross-domain identification, the first edge call chain server 903 saves the first call chain data to the local storage space based on the cross-domain identification, and at the same time, saves the first call chain data to the local storage space. The first call chain data is synchronized to the first central call chain server 901.
步骤S1030,当用户终端906在查询前端界面中输入查询标识时,后台的第二中心调用链服务器902通过与第一中心调用链服务器901的交互,和/或,与第一边缘调用链服务器903的交互,获取与该查询标识对应的第一调用链数据,并通过查询前端界面显示该第一调用链数据。Step S1030, when the user terminal 906 inputs the query identifier in the query front-end interface, the second center call chain server 902 in the background interacts with the first center call chain server 901, and/or, with the first edge call chain server 903 interaction, obtain the first call chain data corresponding to the query identifier, and display the first call chain data through the query front-end interface.
在本实施方式中,通过判断第一调用链数据是否是基于跨数据中心的业务生成的数据,能够对跨数据中心的调用链数据进行特殊的标记,方便后续处理,并且,第一边缘调用链服务器903仅将具有跨域标识的调用链数据同步至第一中心调用链服务器902中,能够降低汇聚调用链时对数据中心间的专网带宽的消耗,降低网络带宽的传输成本。由于在第一中心调用链服务器902中只汇聚具有跨域标识的调用链数据(即,基于跨数据中心调用产生的调用链数据),而将大量的本数据中心内部的调用链数据存储在边缘调用链服务器上,能够减少第一中心调用链服务器902的数据存储压力和计算压力。当用户终端请求展示调用链数据时,能够降低调用链收集不完整的故障发生的比例,保证调用链数据的展示完整性,并使第一中心调用链服务器902可以对跨数据中心的业务对应的调用链数据进行完整的分析,提升了查询效率,满足了用户终端的使用需求。In this embodiment, by determining whether the first call chain data is data generated based on cross-data center services, the cross-data center call chain data can be specially marked to facilitate subsequent processing, and the first edge call chain The server 903 only synchronizes the call chain data with the cross-domain identifier to the first central call chain server 902, which can reduce the consumption of private network bandwidth between data centers when aggregating the call chain and reduce the transmission cost of network bandwidth. Since the first central call chain server 902 only aggregates call chain data with cross-domain identification (that is, call chain data generated based on cross-data center calls), a large amount of call chain data within the data center is stored at the edge. On the call chain server, the data storage pressure and computing pressure of the first central call chain server 902 can be reduced. When the user terminal requests to display the call chain data, it can reduce the proportion of incomplete call chain collection failures, ensure the display integrity of the call chain data, and enable the first central call chain server 902 to handle cross-data center business correspondence. Complete analysis of call chain data improves query efficiency and meets the needs of user terminals.
在一些实施方式中,步骤S1010中的调用链数据处理装置A对第一调用链数据进行标记,生成与该第一调用链数据对应的跨域标识;并将第一调用链数据及其对应的跨域标识上报给第一边缘调用链服务器903还可以采用如下方式实现。In some embodiments, the call chain data processing device A in step S1010 marks the first call chain data and generates a cross-domain identifier corresponding to the first call chain data; and combines the first call chain data and its corresponding Reporting the cross-domain identity to the first edge call chain server 903 can also be implemented in the following manner.
图11示出本申请实施例提供的第一调用链数据的采集方法的流程示意图。如图11所示,该第一调用链数据的采集方法包括但不限于如下步骤S1011至S1015。Figure 11 shows a schematic flowchart of a method for collecting first call chain data provided by an embodiment of the present application. As shown in Figure 11, the method of collecting first call chain data includes but is not limited to the following steps S1011 to S1015.
步骤S1011,调用链数据处理装置A中的微服务从注册服务器905获取与第一调用链数据对应的微服务的注册信息;并获取第一调用链数据对应的目标数据的存储地址。Step S1011: The microservice in the call chain data processing device A obtains the registration information of the microservice corresponding to the first call chain data from the registration server 905; and obtains the storage address of the target data corresponding to the first call chain data.
注册信息包括微服务的注册地址,目标数据为微服务期望获取的数据。The registration information includes the registration address of the microservice, and the target data is the data that the microservice expects to obtain.
步骤S1012,调用链数据处理装置A中的微服务对微服务的注册地址和第一调用链数据对应的目标数据的存储地址进行对比,以判断该第一调用链数据是否是基于跨数据中心的业务对应的数据。Step S1012: The microservice in the call chain data processing device A compares the registration address of the microservice with the storage address of the target data corresponding to the first call chain data to determine whether the first call chain data is based on cross-data center Business corresponding data.
在确定第一调用链数据是基于跨数据中心的业务对应的数据的情况下,执行步骤S1013;在确定第一调用链数据不是基于跨数据中心的业务对应的数据的情况下,执行步骤S1014。If it is determined that the first call chain data is based on data corresponding to cross-data center services, step S1013 is executed; if it is determined that the first call chain data is not based on data corresponding to cross-data center services, step S1014 is executed.
步骤S1013,调用链数据处理装置A对第一调用链数据进行标记,生成与第一调用链数据对应的跨域标识。Step S1013: The call chain data processing device A marks the first call chain data and generates a cross-domain identifier corresponding to the first call chain data.
在执行完步骤S1013后,跳转至步骤S1015。
After step S1013 is executed, jump to step S1015.
步骤S1014,调用链数据处理装置A不对第一调用链数据进行特殊标记,仅将该第一调用链数据发送至第一边缘调用链服务器903。Step S1014, the call chain data processing device A does not mark the first call chain data specially, but only sends the first call chain data to the first edge call chain server 903.
步骤S1015,第一边缘调用链服务器903对获取到的第一调用链数据进行存储。Step S1015: The first edge call chain server 903 stores the obtained first call chain data.
在一些实施方式中,步骤S1020中的第一边缘调用链服务器903在接收到第一调用链数据及其对应的跨域标识后,基于该跨域标识,将第一调用链数据保存至本地的存储空间,同时,将该第一调用链数据同步到第一中心调用链服务器901还可以采用如下方式实现。In some embodiments, after receiving the first call chain data and its corresponding cross-domain identification, the first edge call chain server 903 in step S1020 saves the first call chain data to the local server based on the cross-domain identification. storage space. At the same time, synchronizing the first call chain data to the first central call chain server 901 can also be implemented in the following manner.
图12示出本申请实施例提供的边缘调用链服务器对第一调用链数据的处理方法的流程示意图。如图12所示,边缘调用链服务器对第一调用链数据的处理方法包括但不限于如下步骤S1021至S1025。Figure 12 shows a schematic flowchart of a method for processing first call chain data by an edge call chain server provided by an embodiment of the present application. As shown in Figure 12, the edge call chain server's method for processing the first call chain data includes but is not limited to the following steps S1021 to S1025.
当确定第一调用链数据存在与其对应的跨域标识的情况下,需要根据该跨域标识将与其对应的第一调用链数据存储至特定的存储区域(如,跨域数据存储区域);当确定第一调用链数据不存在与其对应的跨域标识的情况下,只需将该第一调用链数据存储至普通的存储区域(如,本地的存储区域等)。When it is determined that the first call chain data has a cross-domain identification corresponding to it, the first call chain data corresponding to the cross-domain identification needs to be stored in a specific storage area (for example, a cross-domain data storage area); when When it is determined that the first call chain data does not have a corresponding cross-domain identifier, the first call chain data only needs to be stored in a common storage area (such as a local storage area, etc.).
步骤S1021,第一调用链同步器9031通过定时任务,获取第一调用链数据。Step S1021, the first call chain synchronizer 9031 obtains the first call chain data through a scheduled task.
在一些实施方式中,第一调用链同步器9031和第一边缘调用链服务器903也可以是两种不同的设备,第一调用链同步器9031通过主动监听的方式,确定第一边缘调用链服务器903中的第一调用链数据是否需要进行同步;并在确定需要进行数据同步的情况下,从第一边缘调用链服务器903中获取第一调用链数据。In some implementations, the first call chain synchronizer 9031 and the first edge call chain server 903 may also be two different devices. The first call chain synchronizer 9031 determines the first edge call chain server through active listening. Whether the first call chain data in 903 needs to be synchronized; and if it is determined that data synchronization is required, obtain the first call chain data from the first edge call chain server 903.
步骤S1022,第一调用链同步器9031判断第一调用链数据是否存在跨域标识。Step S1022: The first call chain synchronizer 9031 determines whether the first call chain data contains a cross-domain identifier.
在确定第一调用链数据存在跨域标识的情况下,执行步骤S1023;在确定第一调用链数据不存在跨域标识的情况下,结束流程。If it is determined that the first call chain data has a cross-domain identifier, step S1023 is executed; if it is determined that the first call chain data does not have a cross-domain identifier, the process ends.
步骤S1023,获取与第一调用链数据对应的TraceId。Step S1023: Obtain the TraceId corresponding to the first call chain data.
步骤S1024,第一调用链同步器9031基于该TraceId,从本数据中心的第一边缘调用链服务器903上获取第一调用链数据。Step S1024: The first call chain synchronizer 9031 obtains the first call chain data from the first edge call chain server 903 of the data center based on the TraceId.
步骤S1025,第一调用链同步器9031将获取到第一调用链数据上报到第一中心调用链服务器901。Step S1025: The first call chain synchronizer 9031 reports the obtained first call chain data to the first central call chain server 901.
在经过上面的处理步骤后,基于跨数据中心的业务对应的调用链数据被收集到了第一中心调用链服务器901中,而基于一个数据中心内部的业务对应的调用链数据被收集到了各个数据中心的边缘调用链服务器(如,第一边缘调用链服务器903)中,方便对不同的调用链数据进行区别管理,提升数据的管理效率。After the above processing steps, the call chain data corresponding to the business based on cross-data centers is collected into the first central call chain server 901, and the call chain data corresponding to the business based on one data center is collected to each data center. In the edge call chain server (for example, the first edge call chain server 903), it is convenient to carry out differentiated management of different call chain data and improve the data management efficiency.
在一些实施方式中,步骤S1030中的当用户终端906在查询前端界面中输入查询标识时,后台的第二中心调用链服务器902通过与第一中心调用链服务器901的交互,和/或,与第一边缘调用链服务器903的交互,获取与该查询标识对应的第一调用链数据,并通过查询前端界面显示该第一调用链数据还可以采用如下方式实现。In some embodiments, when the user terminal 906 inputs the query identifier in the query front-end interface in step S1030, the second center call chain server 902 in the background interacts with the first center call chain server 901, and/or, with The interaction of the first edge call chain server 903 to obtain the first call chain data corresponding to the query identifier and display the first call chain data through the query front-end interface can also be implemented in the following manner.
图13示出本申请实施例提供的第一调用链数据的查询方法的流程示意图。如图13所示,该第一调用链数据的查询方法包括但不限于如下步骤S1031至S1036。Figure 13 shows a schematic flowchart of the first call chain data query method provided by the embodiment of the present application. As shown in Figure 13, the query method of the first call chain data includes but is not limited to the following steps S1031 to S1036.
步骤S1031,用户终端906基于查询前端界面,生成查询请求。Step S1031: The user terminal 906 generates a query request based on the query front-end interface.
查询请求可以包括:查询标识。例如,可以通过在查询前端界面上输入查询标识(TraceId)的方式,生成查询请求。The query request may include: Query ID. For example, you can generate a query request by entering the query ID (TraceId) on the query front-end interface.
步骤S1032,用户终端906将查询请求发送到第一中心调用链服务器901,以完成查询操作。Step S1032, the user terminal 906 sends the query request to the first central call chain server 901 to complete the query operation.
例如,可以通过在查询前端界面上点击“查询”按钮的方式,实现对查询
请求的发送。For example, you can query by clicking the "Query" button on the query front-end interface. The request is sent.
步骤S1033,确定是否在第一中心调用链服务器901查询到与TraceId对应的调用链数据。在确定查询到与TraceId对应的调用链数据的情况下,执行步骤S1036;在未查询到与TraceId对应的调用链数据的情况下,执行步骤S 1034。Step S1033: Determine whether the call chain data corresponding to TraceId is queried in the first central call chain server 901. If it is determined that the call chain data corresponding to TraceId is queried, step S1036 is executed; if the call chain data corresponding to TraceId is not queried, step S1034 is executed.
步骤S1034,用户终端906将查询请求发送到各个边缘调用链服务器中,等待各个边缘调用链服务器反馈的查询结果。Step S1034, the user terminal 906 sends the query request to each edge call chain server, and waits for the query results fed back by each edge call chain server.
各个边缘调用链服务器可以包括第一调用链边缘服务器903,和/或,第二调用链边缘服务器904。Each edge call chain server may include a first call chain edge server 903, and/or a second call chain edge server 904.
步骤S1035,确定是否有至少一个边缘调用链服务器反馈的查询响应中查询到与该查询标识对应的调用链数据。若确定各个边缘调用链服务器反馈的查询响应中都没有查询到与该查询标识对应的调用链数据,则结束流程;若至少一个边缘调用链服务器反馈的查询响应中查询到与该查询标识对应的调用链数据,执行步骤S1036。Step S1035: Determine whether the call chain data corresponding to the query identifier is queried in the query response fed back by at least one edge call chain server. If it is determined that no call chain data corresponding to the query identifier is found in the query responses fed back by each edge call chain server, the process ends; if at least one edge call chain server returns query responses corresponding to the query identifier. Call the chain data and execute step S1036.
步骤S1036,在查询前端界面上显示获得的查询结果。Step S1036: Display the obtained query results on the query front-end interface.
通过上述对不同类型的调用链数据的处理,能够增强分布式调用在复杂的应用环境中的适应性。Through the above processing of different types of call chain data, the adaptability of distributed calls in complex application environments can be enhanced.
在不同的应用场景中,都可以使用上述数据处理方法,以提升对调用链数据的管理效率。例如,某大型企业在不同的地市分布自己搭建的数据中心,在这些数据中心部署了不同的应用,并且有些特定应用只部署在部分特定的数据中心中,其他数据中心中的应用在调用这些特定应用时,就会发生跨数据中心的数据调用,从而产生跨数据中心的调用链数据。In different application scenarios, the above data processing methods can be used to improve the management efficiency of call chain data. For example, a large enterprise distributes its own data centers in different cities and deploys different applications in these data centers, and some specific applications are only deployed in some specific data centers. Applications in other data centers call these For specific applications, cross-data center data calls will occur, resulting in cross-data center call chain data.
例如,财务系统中的财务微服务只部署在A地的数据中心中,而人力资源(Human Resources,HR)系统中的应用、或企业资源计划(Enterprise Resource Planning,ERP)系统中的应用可以部署在全国多地的数据中心中。在进行业务处理的过程中,HR系统中的应用或ERP系统中的应用都可能会调用部署在A地的数据中心中的财务系统的财务微服务,从而产生跨数据中心的调用链数据。For example, the financial microservices in the financial system are only deployed in the data center in location A, while applications in the Human Resources (HR) system or applications in the Enterprise Resource Planning (ERP) system can be deployed In data centers across the country. During the process of business processing, applications in the HR system or applications in the ERP system may call the financial microservices of the financial system deployed in the data center at location A, thus generating cross-data center call chain data.
图14示出本申请实施例提供的财务系统中的财务微服务对应的调用链数据的处理方法的流程示意图。如图14所示,该财务系统中的财务微服务对应的调用链数据的处理方法包括但不限于如下步骤S1401至S1408。Figure 14 shows a schematic flowchart of a method for processing call chain data corresponding to financial microservices in the financial system provided by the embodiment of the present application. As shown in Figure 14, the method for processing call chain data corresponding to the financial microservices in the financial system includes but is not limited to the following steps S1401 to S1408.
步骤S1401,HR系统中的微服务通过注册服务器905,查询财务系统中的财务微服务的地址信息。Step S1401: The microservice in the HR system queries the address information of the financial microservice in the financial system through the registration server 905.
步骤S1402,HR系统中的微服务通过注册服务器905返回的财务系统中的财务微服务的地址信息,确定该财务微服务是否与HR系统中的微服务在同一个数据中心。Step S1402: The microservice in the HR system determines whether the financial microservice is in the same data center as the microservice in the HR system through the address information of the financial microservice in the financial system returned by the registration server 905.
步骤S1403,在确定财务微服务与HR系统中的微服务不在同一个数据中心的情况下,HR系统中的微服务对应的调用链数据处理装置对第一调用链数据进行跨域标记,生成与第一调用链数据对应的跨域标识。Step S1403, when it is determined that the financial microservice and the microservice in the HR system are not in the same data center, the call chain data processing device corresponding to the microservice in the HR system performs cross-domain marking on the first call chain data, and generates The cross-domain identifier corresponding to the first call chain data.
第一调用链数据用于表征财务微服务与HR系统中的微服务之间的调用关系数据。The first call chain data is used to represent the call relationship data between the financial microservices and the microservices in the HR system.
步骤S1404,HR系统中的微服务对应的调用链数据处理装置将第一调用链数据及其对应的跨域标识发送至HR系统所属的数据中心的边缘调用链服务器,以使该边缘调用链服务对第一调用链数据及其对应的跨域标识进行存储。Step S1404: The call chain data processing device corresponding to the microservice in the HR system sends the first call chain data and its corresponding cross-domain identifier to the edge call chain server of the data center to which the HR system belongs, so that the edge call chain service Store the first call chain data and its corresponding cross-domain identifier.
在执行步骤S1404的同时,还需要执行步骤S1405。While executing step S1404, step S1405 also needs to be executed.
步骤S1405,HR系统中的微服务对应的调用链数据处理装置将第一调用链数据及其对应的跨域标识发送至HR系统所属的数据中心的中心调用链服务器。Step S1405: The call chain data processing device corresponding to the microservice in the HR system sends the first call chain data and its corresponding cross-domain identification to the central call chain server of the data center to which the HR system belongs.
步骤S1406,HR系统所属的数据中心中的调用链同步器通过定时器周期性的触发对跨数据中心的业务对应的调用链数据的获取。Step S1406: The call chain synchronizer in the data center to which the HR system belongs periodically triggers the acquisition of call chain data corresponding to cross-data center services through a timer.
例如,调用链同步器可用通过从自身的存储器中获取上次获取调用链数据的偏移量信息,并以该偏移量信息为起始地址,从HR系统所属的数据中心中的
边缘调用链服务器中拉取包括跨域标识的调用链数据。For example, the call chain synchronizer can obtain the offset information of the last call chain data obtained from its own memory, and use this offset information as the starting address to obtain the offset information from the data center to which the HR system belongs. Pull the call chain data including the cross-domain identifier from the edge call chain server.
当调用链同步器获取到包括跨域标识的调用链数据对应的查询标识(TraceId)时,可根据该TraceId,从HR系统所属的数据中心中的边缘调用链服务器上获取到与该TraceId对应的完整的调用链数据,并发送与该TraceId对应的完整的调用链数据至HR系统所属的数据中心中的中心调用链服务器。When the call chain synchronizer obtains the query identification (TraceId) corresponding to the call chain data including the cross-domain identification, it can obtain the TraceId corresponding to the TraceId from the edge call chain server in the data center to which the HR system belongs. Complete call chain data, and send the complete call chain data corresponding to the TraceId to the central call chain server in the data center to which the HR system belongs.
步骤S1407,当用户通过在调用链查询界面中输入TraceId,期望查询与该TraceId对应的调用链数据时,用户所使用的用户终端会基于该TraceId生成查询请求,并发送该查询请求至中心调用链服务器和/或边缘调用链服务器上进行查询。Step S1407, when the user inputs a TraceId into the call chain query interface and expects to query the call chain data corresponding to the TraceId, the user terminal used by the user will generate a query request based on the TraceId and send the query request to the central call chain. Query on the server and/or edge call chain server.
步骤S1408,当获得中心调用链服务器和/或边缘调用链服务器反馈的查询结果时,将该查询结果显示到调用链查询界面中。Step S1408: When the query result fed back by the central call chain server and/or the edge call chain server is obtained, the query result is displayed on the call chain query interface.
通过上述对HR系统中的应用与部署在A地的数据中心中的财务系统的财务微服务之间的跨数据中心的调用链数据的处理,能够降低调用链收集不完整的故障发生的比例,减少因集中式存储调用链数据而浪费的存储空间,并减少上报调用链数据的频次,提升数据的传输效率,同时减少对专网带宽的消耗。Through the above-mentioned processing of cross-data center call chain data between applications in the HR system and financial microservices of the financial system deployed in the data center at location A, the proportion of incomplete call chain collection failures can be reduced. Reduce the storage space wasted due to centralized storage of call chain data, reduce the frequency of reporting call chain data, improve data transmission efficiency, and reduce the consumption of private network bandwidth.
在电信运营商服务器的数据处理过程中,也会采用多级数据中心的架构,在不同的数据中心中部署不同的电信系统中的虚拟的网络功能(Virtual Network Feature,VNF)应用,部署在多级数据中心中的VNF应用之间,也会通过相互调用来完成对应的通信业务。In the data processing process of telecom operators' servers, a multi-level data center architecture will also be used to deploy virtual network function (Virtual Network Feature, VNF) applications in different telecom systems in different data centers and deploy them in multiple VNF applications in the multi-level data center will also complete corresponding communication services through mutual calls.
例如,运营商在省级的数据中心中部署了计费微服务,而在各个县级的数据中心中会部署终端接入微服务和身份认证微服务。在终端接入到电信网络时,需要计费微服务、终端接入微服务和身份认证微服务之间相互配合,才能实现终端设备的网络接入。For example, operators deploy billing microservices in provincial data centers, and terminal access microservices and identity authentication microservices are deployed in county-level data centers. When a terminal accesses the telecommunications network, the accounting microservice, terminal access microservice and identity authentication microservice need to cooperate with each other to achieve network access of the terminal device.
图15示出本申请实施例提供的通信运营商的计费系统中的计费微服务对应的调用链数据的处理方法的流程示意图。如图15所示,该通信运营商的计费系统中的计费微服务对应的调用链数据的处理方法包括但不限于如下步骤S1501至S1509。Figure 15 shows a schematic flowchart of a method for processing call chain data corresponding to a charging microservice in a communication operator's charging system provided by an embodiment of the present application. As shown in Figure 15, the method for processing the call chain data corresponding to the charging microservice in the charging system of the communication operator includes but is not limited to the following steps S1501 to S1509.
步骤S1501,终端接入微服务对应的调用链数据处理装置向注册服务器905发送信息获取请求,以获取计费微服务对应的目标服务地址信息。Step S1501: The call chain data processing device corresponding to the terminal access microservice sends an information acquisition request to the registration server 905 to obtain the target service address information corresponding to the charging microservice.
步骤S1502,响应于注册服务器905返回的信息获取响应,终端接入微服务对应的调用链数据处理装置确定计费微服务是部署在省级的数据中心中。Step S1502, in response to the information acquisition response returned by the registration server 905, the terminal accesses the call chain data processing device corresponding to the microservice to determine that the charging microservice is deployed in a provincial data center.
步骤S1503,终端接入微服务对应的调用链数据处理装置,对终端接入微服务与计费微服务之间的调用链数据进行跨域标记,生成与该调用链数据对应的跨域标识;并将终端接入微服务与计费微服务之间的调用链数据及其对应的跨域标识发送至县级的数据中心中的边缘调用链服务器中。Step S1503: The call chain data processing device corresponding to the terminal access microservice performs cross-domain marking on the call chain data between the terminal access microservice and the billing microservice, and generates a cross-domain identification corresponding to the call chain data; And the call chain data between the terminal access microservice and the billing microservice and its corresponding cross-domain identification are sent to the edge call chain server in the county-level data center.
县级的数据中心中的边缘调用链服务器与终端接入微服务对应的调用链数据处理装置在同一个数据中心中。The edge call chain server in the county-level data center and the call chain data processing device corresponding to the terminal access microservice are in the same data center.
步骤S1504,县级的数据中心中的边缘调用链服务器在接收到终端接入微服务与计费微服务之间的调用链数据后,对该调用链数据和对应的跨域标识进行存储。Step S1504: After receiving the call chain data between the terminal access microservice and the billing microservice, the edge call chain server in the county-level data center stores the call chain data and the corresponding cross-domain identification.
步骤S1505,县级的数据中心中的调用链同步器通过监听边缘调用链服务器,确定该边缘调用链服务器上是否有新的具有跨域标识的调用链数据。Step S1505: The call chain synchronizer in the county-level data center determines whether there is new call chain data with a cross-domain identification on the edge call chain server by monitoring the edge call chain server.
步骤S1506,调用链同步器在确定边缘调用链服务器上有新的具有跨域标识的调用链数据的情况下,获取与该调用链数据对应的TraceId,并基于该TraceId,从同一个县级的数据中心中的边缘调用链服务器上获取该调用链数据的完整信息。Step S1506: When the call chain synchronizer determines that there is new call chain data with a cross-domain identifier on the edge call chain server, it obtains the TraceId corresponding to the call chain data, and based on the TraceId, from the same county level Get complete information about the call chain data from the edge call chain server in the data center.
步骤S1507,调用链同步器将获取到的终端接入微服务与计费微服务之间的调用链数据及其对应的跨域标识,发送至省级的数据中心的中心调用链服务器中。
Step S1507: The call chain synchronizer sends the obtained call chain data between the terminal access microservice and the billing microservice and its corresponding cross-domain identification to the central call chain server of the provincial data center.
步骤S1508,当运维人员在省级的数据中心中的分布式调用链查询界面上输入TraceId,并点击查询按钮时,省级的数据中心中的中心调用链服务器会基于该TraceId生成查询请求,并发送该查询请求至边缘调用链服务器上进行查询,或查询该中心调用链服务器本地的存储器,以获取与TraceId对应的调用链数据。Step S1508, when the operation and maintenance personnel enter the TraceId on the distributed call chain query interface in the provincial data center and click the query button, the central call chain server in the provincial data center will generate a query request based on the TraceId. And send the query request to the edge call chain server for query, or query the local memory of the central call chain server to obtain the call chain data corresponding to the TraceId.
步骤S1509,在确定获得与TraceId对应的调用链数据的情况下,在分布式调用链查询界面显示该调用链数据。Step S1509: If it is determined that the call chain data corresponding to the TraceId is obtained, the call chain data is displayed on the distributed call chain query interface.
通过上述对省级的数据中心中部署的计费微服务与部署在各个县级的数据中心中的终端接入微服务之间的跨数据中心的调用链数据的处理,能够降低调用链收集不完整的故障发生的比例,使终端能够快速准确地接入到通信网络中,提升通信的传输效率。Through the above processing of cross-data center call chain data between the accounting microservice deployed in the provincial data center and the terminal access microservice deployed in each county-level data center, it is possible to reduce the inefficiency of call chain collection. The complete proportion of fault occurrences enables terminals to quickly and accurately access the communication network and improve communication transmission efficiency.
在一些实施方式中,为了提升移动终端的使用体验,各大公有云厂商都在积极部署边缘云,并将不同类型的应用直接部署在边缘云中,以降低移动终端与后台服务器之间的交互时延。但是由于边缘云的资源有限,通常会将后台服务器中与移动终端交互密切的部分数据独立出来,并将这部分数据单独部署在边缘云中。但对于后台服务器中的其它部分数据仍旧部署在公有云中。从而使边缘云中的数据通过预设的接口,与仍旧部署在公有云中的其他部分数据进行业务交互。In some implementations, in order to improve the user experience of mobile terminals, major public cloud vendors are actively deploying edge clouds and deploying different types of applications directly in edge clouds to reduce the interaction between mobile terminals and backend servers. time delay. However, due to the limited resources of the edge cloud, part of the data in the background server that interacts closely with the mobile terminal is usually isolated and deployed separately in the edge cloud. But other parts of the data in the backend server are still deployed in the public cloud. This allows the data in the edge cloud to interact with other parts of the data still deployed in the public cloud through preset interfaces.
例如,某游戏开发服务器,会将游戏场景渲染微服务部署在边缘云上,该游戏场景渲染微服务主要用于与移动终端进行业务的交互;而游戏的认证微服务和计费微服务等对于的组件仍然部署在公有云中。当移动终端在创建游戏场景时,部署在边缘云中的游戏场景微服务需要与部署在公有云中的认证微服务和收费微服务进行交互,从而产生了跨数据中心的调用链数据。For example, a game development server will deploy the game scene rendering microservice on the edge cloud. The game scene rendering microservice is mainly used for business interaction with mobile terminals; and the game's authentication microservices and billing microservices are for of components are still deployed in the public cloud. When a mobile terminal creates a game scene, the game scene microservice deployed in the edge cloud needs to interact with the authentication microservice and charging microservice deployed in the public cloud, thus generating cross-data center call chain data.
图16示出本申请实施例提供的基于云端的游戏场景微服务对应的调用链数据的处理方法的流程示意图。如图16所示,该基于云端的游戏场景微服务对应的调用链数据的处理方法包括但不限于如下步骤S1601至S1612。Figure 16 shows a schematic flowchart of a method for processing call chain data corresponding to a cloud-based game scene microservice provided by an embodiment of the present application. As shown in Figure 16, the method for processing the call chain data corresponding to the cloud-based game scene microservice includes but is not limited to the following steps S1601 to S1612.
步骤S1601,移动终端开始创建游戏场景,发送创建请求至边缘云中部署的游戏场景渲染微服务。Step S1601: The mobile terminal starts to create a game scene and sends a creation request to the game scene rendering microservice deployed in the edge cloud.
步骤S1602,游戏场景渲染微服务对应的调用链数据处理装置通过向注册服务器905发送信息获取请求,以获取与该游戏场景渲染微服务对应的收费微服务对应的目标服务地址信息。Step S1602: The call chain data processing device corresponding to the game scene rendering microservice sends an information acquisition request to the registration server 905 to obtain the target service address information corresponding to the charging microservice corresponding to the game scene rendering microservice.
步骤S1603,响应于注册服务器905返回的信息获取响应,游戏场景渲染微服务对应的调用链数据处理装置确定收费微服务部署在公有云中。Step S1603: In response to the information acquisition response returned by the registration server 905, the call chain data processing device corresponding to the game scene rendering microservice determines that the charging microservice is deployed in the public cloud.
步骤S1604,游戏场景渲染微服务对应的调用链数据处理装置对游戏场景渲染微服务与收费微服务之间的调用链数据进行跨域标记,生成与该调用链数据对应的跨域标识;并将游戏场景渲染微服务与收费微服务之间的调用链数据及其对应的跨域标识发送至边缘云中部署的边缘调用链服务器中。Step S1604: The call chain data processing device corresponding to the game scene rendering microservice performs cross-domain marking on the call chain data between the game scene rendering microservice and the charging microservice, and generates a cross-domain identification corresponding to the call chain data; and The call chain data between the game scene rendering microservice and the charging microservice and its corresponding cross-domain identification are sent to the edge call chain server deployed in the edge cloud.
步骤S1605,边缘云中部署的边缘调用链服务器在接收到游戏场景渲染微服务与收费微服务之间的调用链数据及其对应的跨域标识后,对该调用链数据及其对应的跨域标识进行存储。Step S1605: After receiving the call chain data and its corresponding cross-domain identification between the game scene rendering microservice and the charging microservice, the edge call chain server deployed in the edge cloud sends the call chain data and its corresponding cross-domain identification. Identity is stored.
步骤S1606,游戏场景渲染微服务对应的边缘调用链服务器,通过定时器周期性地触发调用链同步器的启动。Step S1606: The edge call chain server corresponding to the game scene rendering microservice periodically triggers the start of the call chain synchronizer through a timer.
边缘调用链服务器与调用链同步器都处于同一个数据中心(如,边缘云)中。The edge call chain server and the call chain synchronizer are both located in the same data center (such as edge cloud).
步骤S1607,调用链同步器从自身存储中获取上次获取调用链数据的偏移量信息。Step S1607: The call chain synchronizer obtains the offset information of the last call chain data obtained from its own storage.
步骤S1608,调用链同步器以调用链数据的偏移量为起点,从边缘云的边缘调用链服务器中拉取包括跨域标识的调用链数据。Step S1608: Using the offset of the call chain data as a starting point, the call chain synchronizer pulls the call chain data including the cross-domain identifier from the edge call chain server of the edge cloud.
步骤S1609,调用链同步器对包括跨域标识的调用链数据进行分析,获得
与该调用链数据对应的TraceId;并基于该TraceId,从边缘云的边缘调用链服务器中获取到游戏场景渲染微服务与收费微服务之间的调用链数据的完整信息。Step S1609: The call chain synchronizer analyzes the call chain data including the cross-domain identifier and obtains TraceId corresponding to the call chain data; and based on the TraceId, complete information of the call chain data between the game scene rendering microservice and the charging microservice is obtained from the edge call chain server of the edge cloud.
步骤S1610,调用链同步器将获取到的游戏场景渲染微服务与收费微服务之间的调用链数据的完整信息发送至公有云的中心调用链服务器。Step S1610: The call chain synchronizer sends the obtained complete information of the call chain data between the game scene rendering microservice and the charging microservice to the central call chain server of the public cloud.
步骤S1611,当公有云的运维人员在公有云中的分布式调用链查询界面上输入需要进行统计的时间段信息和统计类型时,公有云上的中心调用链服务器会基于获得的时间段信息和统计类型,对调用链数据进行统计,获得统计结果。Step S1611, when the operation and maintenance personnel of the public cloud input the time period information and statistics type that need to be counted on the distributed call chain query interface in the public cloud, the central call chain server on the public cloud will based on the obtained time period information and statistics type, to perform statistics on call chain data and obtain statistical results.
步骤S1612,在分布式调用链查询界面上显示统计结果。Step S1612: Display statistical results on the distributed call chain query interface.
通过上述对游戏场景渲染微服务与收费微服务之间的调用链数据的处理,能够降低调用链收集不完整的故障发生的比例,使终端能够快速准确进行游戏中的场景渲染,提升用户的使用体验。Through the above processing of the call chain data between the game scene rendering microservice and the charging microservice, it is possible to reduce the proportion of incomplete call chain collection failures, enable the terminal to quickly and accurately render the scene in the game, and improve user usage. experience.
下面结合附图,详细介绍根据本申请实施例的设备。图17示出本申请实施例提供的数据处理装置的组成方框图。如图17所示,该数据处理装置1700包括但不限于如下模块:标记模块1701和存储模块1702。The equipment according to the embodiments of the present application will be introduced in detail below with reference to the accompanying drawings. Figure 17 shows a block diagram of a data processing device provided by an embodiment of the present application. As shown in Figure 17, the data processing device 1700 includes but is not limited to the following modules: a marking module 1701 and a storage module 1702.
标记模块1701配置为在确定第一调用链数据是基于跨数据中心的业务对应的数据的情况下,对第一调用链路数据进行标记,生成跨域标识。The marking module 1701 is configured to mark the first calling link data and generate a cross-domain identification when it is determined that the first calling link data is based on data corresponding to cross-data center services.
存储模块1702配置为将跨域标识和第一调用链数据保存至边缘服务器,以供边缘服务器将第一调用链数据同步到中心服务器。The storage module 1702 is configured to save the cross-domain identification and the first call chain data to the edge server, so that the edge server can synchronize the first call chain data to the central server.
需要说明的是,本实施例中的数据处理装置1700能够实现本申请实施例中应用于数据处理装置的数据处理方法。It should be noted that the data processing device 1700 in this embodiment can implement the data processing method applied to the data processing device in the embodiment of this application.
根据本申请提供的数据处理装置,通过标记模块1701在确定第一调用链数据是基于跨数据中心的业务对应的数据的情况下,对第一调用链路数据进行标记,生成跨域标识,用以区分其他不跨域操作的调用链数据,降低调用链收集不完整的故障发生的比例,保证对跨数据中心的业务对应的数据进行分析时的完整性;存储模块1702将跨域标识和第一调用链数据保存至边缘服务器,以供边缘服务器将第一调用链数据同步到中心服务器,能够减少因集中式存储调用链数据而浪费的存储空间,并减少上报调用链数据的频次,提升数据的传输效率,同时减少对专网带宽的消耗。According to the data processing device provided by this application, when it is determined that the first call chain data is data corresponding to cross-data center services through the marking module 1701, the first call link data is marked and a cross-domain identifier is generated, using In order to distinguish other call chain data that do not operate across domains, reduce the proportion of incomplete call chain collection failures, and ensure the integrity of data corresponding to cross-data center business analysis; the storage module 1702 combines the cross-domain identifier with the first The first call chain data is saved to the edge server for the edge server to synchronize the first call chain data to the central server, which can reduce the storage space wasted due to centralized storage of call chain data, reduce the frequency of reporting call chain data, and improve data transmission efficiency while reducing the consumption of private network bandwidth.
图18示出本申请实施例提供的边缘服务器的组成方框图。如图18所示,该边缘服务器1800包括但不限于如下模块:获取模块1801、生成模块1802、保存模块1803和同步模块1804。Figure 18 shows a block diagram of the edge server provided by the embodiment of the present application. As shown in Figure 18, the edge server 1800 includes but is not limited to the following modules: an acquisition module 1801, a generation module 1802, a saving module 1803, and a synchronization module 1804.
获取模块1801配置为获取数据处理装置发送的跨域标识和第一调用链数据,第一调用链数据是基于跨数据中心的业务对应的数据。The acquisition module 1801 is configured to acquire the cross-domain identification and first call chain data sent by the data processing device. The first call chain data is data corresponding to services based on cross-data centers.
生成模块1802配置为生成与第一调用链数据对应的存储标识。The generating module 1802 is configured to generate a storage identification corresponding to the first call chain data.
保存模块1803配置为依据存储标识保存跨域标识和第一调用链数据。The saving module 1803 is configured to save the cross-domain identification and the first call chain data according to the storage identification.
同步模块1804配置为将第一调用链数据同步至中心服务器。The synchronization module 1804 is configured to synchronize the first call chain data to the central server.
需要说明的是,本实施例中的边缘服务器1800能够实现本申请实施例中应用于边缘服务器的数据处理方法。It should be noted that the edge server 1800 in this embodiment can implement the data processing method applied to the edge server in the embodiment of this application.
根据本申请实施例的边缘服务器,通过获取模块1801获取数据处理装置发送的跨域标识和第一调用链数据,基于跨域标识能够明确第一调用链数据是基于跨数据中心的业务对应的数据,能够将跨数据中心的调用链数据与其他不跨域操作的调用链数据进行区分,降低调用链收集不完整的故障发生的比例;生成模块1802生成与第一调用链数据对应的存储标识,保存模块1803依据存储标识保存跨域标识和第一调用链数据能够减少上报至中心服务器的调用链数据的频次,提升数据的传输效率;同步模块1804将第一调用链数据同步至中心服务器,以使中心服务器可以对跨数据中心的业务对应的数据进行分析,满足数据分析的需求,并减少因集中式存储调用链数据而浪费的中心服务器的存储空间。According to the edge server in the embodiment of the present application, the cross-domain identification and the first call chain data sent by the data processing device are obtained through the acquisition module 1801. Based on the cross-domain identification, it can be determined that the first call chain data is based on data corresponding to the cross-data center business. , can distinguish cross-data center call chain data from other call chain data that does not cross-domain operations, and reduce the proportion of failures in incomplete call chain collection; the generation module 1802 generates a storage identifier corresponding to the first call chain data, The saving module 1803 saves the cross-domain identifier and the first call chain data according to the storage identifier, which can reduce the frequency of reporting the call chain data to the central server and improve the data transmission efficiency; the synchronization module 1804 synchronizes the first call chain data to the central server to This enables the central server to analyze data corresponding to cross-data center businesses to meet the needs of data analysis and reduce the storage space of the central server wasted due to centralized storage of call chain data.
需要明确的是,本申请并不局限于上文中所描述并在图中示出的特定配置
和处理。为了描述的方便和简洁,这里省略了对已知方法的详细描述,并且上述描述的系统、模块和单元的具体工作过程,可以参考前述方法中的对应过程,在此不再赘述。It is to be understood that this application is not limited to the specific configurations described above and illustrated in the drawings. and processing. For the convenience and simplicity of description, detailed descriptions of known methods are omitted here, and for the specific working processes of the systems, modules and units described above, reference can be made to the corresponding processes in the foregoing methods, which will not be described again here.
图19示出能够实现根据本申请实施例的数据处理方法和装置的计算设备的示例性硬件架构的结构图。Figure 19 shows a structural diagram of an exemplary hardware architecture of a computing device capable of implementing the data processing method and apparatus according to embodiments of the present application.
如图19所示,计算设备1900包括输入设备1901、输入接口1902、中央处理器1903、存储器1904、输出接口1905、以及输出设备1906。输入接口1902、中央处理器1903、存储器1904、以及输出接口1905通过总线1907相互连接,输入设备1901和输出设备1906分别通过输入接口1902和输出接口1905与总线1907连接,进而与计算设备1900的其他组件连接。As shown in Figure 19, computing device 1900 includes an input device 1901, an input interface 1902, a central processing unit 1903, a memory 1904, an output interface 1905, and an output device 1906. The input interface 1902, the central processing unit 1903, the memory 1904, and the output interface 1905 are connected to each other through the bus 1907. The input device 1901 and the output device 1906 are connected to the bus 1907 through the input interface 1902 and the output interface 1905 respectively, and then to other parts of the computing device 1900. Component connections.
输入设备1901接收来自外部的输入信息,并通过输入接口1902将输入信息传送到中央处理器1903;中央处理器1903基于存储器1904中存储的计算机可执行指令对输入信息进行处理以生成输出信息,将输出信息临时或者永久地存储在存储器1904中,然后通过输出接口1905将输出信息传送到输出设备1906;输出设备1906将输出信息输出到计算设备1900的外部供用户使用。The input device 1901 receives input information from the outside and transmits the input information to the central processor 1903 through the input interface 1902; the central processor 1903 processes the input information based on computer-executable instructions stored in the memory 1904 to generate output information. The output information is temporarily or permanently stored in the memory 1904 and then transmitted to the output device 1906 through the output interface 1905; the output device 1906 outputs the output information to the outside of the computing device 1900 for use by the user.
在一些实施方式中,图19所示的计算设备可以被实现为一种电子设备,该电子设备可以包括:存储器,被配置为存储计算机程序;处理器,被配置为运行存储器中存储的计算机程序,以执行上述的数据处理方法。In some embodiments, the computing device shown in FIG. 19 may be implemented as an electronic device, and the electronic device may include: a memory configured to store a computer program; and a processor configured to execute the computer program stored in the memory. , to perform the above data processing method.
在一些实施方式中,图19所示的计算设备可以被实现为一种数据处理系统,该系统可以包括:存储器,被配置为存储计算机程序;处理器,被配置为运行存储器中存储的计算机程序,以执行上述的数据处理方法。In some embodiments, the computing device shown in Figure 19 may be implemented as a data processing system, which may include: a memory configured to store a computer program; a processor configured to execute the computer program stored in the memory , to perform the above data processing method.
本申请实施例还提供了一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时实现上述的数据处理方法。Embodiments of the present application also provide a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the above-mentioned data processing method is implemented.
以上所述,仅为本申请的示例性实施例而已,并非用于限定本申请的保护范围。一般来说,本申请的多种实施例可以在硬件或专用电路、软件、逻辑或其任何组合中实现。例如,一些方面可以被实现在硬件中,而其它方面可以被实现在可以被控制器、微处理器或其它计算装置执行的固件或软件中,尽管本申请不限于此。The above descriptions are only exemplary embodiments of the present application and are not used to limit the protection scope of the present application. Generally speaking, the various embodiments of the present application may be implemented in hardware or special purpose circuitry, software, logic, or any combination thereof. For example, some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software that may be executed by a controller, microprocessor, or other computing device, although the application is not limited thereto.
本申请的实施例可以通过移动装置的数据处理器执行计算机程序指令来实现,例如在处理器实体中、或者通过硬件、或者通过软件和硬件的组合实现。计算机程序指令可以是汇编指令、指令集架构(ISA)指令、机器指令、机器相关指令、微代码、固件指令、状态设置数据、或者是以一种或多种编程语言的任意组合编写的源代码或目标代码。Embodiments of the present application may be implemented by a data processor of the mobile device executing computer program instructions, for example in a processor entity, or by hardware, or by a combination of software and hardware. Computer program instructions may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code written in any combination of one or more programming languages or object code.
本申请附图中的任何逻辑流程的框图可以表示程序步骤,或者可以表示相互连接的逻辑电路、模块和功能,或者可以表示程序步骤与逻辑电路、模块和功能的组合。计算机程序可以存储在存储器上。存储器可以具有任何适合于本地技术环境的类型并且可以使用任何适合的数据存储技术实现,例如但不限于只读存储器(ROM)、随机访问存储器(RAM)、光存储器装置和系统(数码多功能光碟DVD或CD光盘)等。计算机可读介质可以包括非瞬时性存储介质。数据处理器可以是任何适合于本地技术环境的类型,例如但不限于通用计算机、专用计算机、微处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、可编程逻辑器件(FGPA)以及基于多核处理器架构的处理器。Any block diagram of a logic flow in the figures of this application may represent program steps, or may represent interconnected logic circuits, modules, and functions, or may represent a combination of program steps and logic circuits, modules, and functions. Computer programs can be stored on memory. The memory may be of any type suitable to the local technical environment and may be implemented using any suitable data storage technology, such as, but not limited to, read only memory (ROM), random access memory (RAM), optical storage devices and systems (digital versatile disc DVD or CD), etc. Computer-readable media may include non-transitory storage media. The data processor may be of any type suitable for the local technical environment, such as, but not limited to, general purpose computers, special purpose computers, microprocessors, digital signal processors (DSP), application specific integrated circuits (ASIC), programmable logic devices (FGPA) and processors based on multi-core processor architecture.
通过示范性和非限制性的示例,上文已提供了对本申请的示范实施例的详细描述。但结合附图和权利要求来考虑,对以上实施例的多种修改和调整对本领域技术人员来说是显而易见的,但不偏离本申请的范围。因此,本申请的恰当范围将根据权利要求确定。
A detailed description of exemplary embodiments of the present application has been provided above, by way of illustrative and non-limiting examples. However, considering the accompanying drawings and claims, various modifications and adjustments to the above embodiments will be apparent to those skilled in the art without departing from the scope of the present application. Accordingly, the proper scope of the application will be determined from the claims.
Claims (17)
- 一种数据处理方法,包括:A data processing method including:在确定第一调用链数据是基于跨数据中心的业务对应的数据的情况下,对所述第一调用链路数据进行标记,生成跨域标识;以及When it is determined that the first call link data is based on data corresponding to cross-data center services, mark the first call link data to generate a cross-domain identification; and将所述跨域标识和所述第一调用链数据保存至边缘服务器,以供所述边缘服务器将所述第一调用链数据同步到中心服务器。The cross-domain identification and the first call chain data are saved to an edge server, so that the edge server can synchronize the first call chain data to the central server.
- 根据权利要求1所述的方法,中,还包括:The method according to claim 1, further comprising:所述将所述跨域标识和所述第一调用链数据保存至边缘服务器,以供所述边缘服务器将所述第一调用链数据同步到中心服务器之后,向所述边缘服务器发送同步请求,以供所述边缘服务器依据所述同步请求中的目标地址,将所述第一调用链数据同步至所述中心服务器,其中,所述目标地址为所述中心服务器的网络地址;以及Saving the cross-domain identification and the first call chain data to the edge server, so that after the edge server synchronizes the first call chain data to the central server, it sends a synchronization request to the edge server, For the edge server to synchronize the first call chain data to the central server according to the target address in the synchronization request, where the target address is the network address of the central server; and响应于所述中心服务器反馈的同步响应,确定所述边缘服务器完成对所述第一调用链数据的同步。In response to the synchronization response fed back by the central server, it is determined that the edge server has completed synchronization of the first call chain data.
- 根据权利要求1所述的方法,还包括:The method of claim 1, further comprising:所述将所述跨域标识和所述第一调用链数据保存至边缘服务器,以供所述边缘服务器将所述第一调用链数据同步到中心服务器之后,获取查询请求,其中,所述查询请求包括查询标识,所述查询标识与所述第一调用链数据的存储标识相对应;以及The cross-domain identification and the first call chain data are saved to the edge server so that the edge server can obtain a query request after synchronizing the first call chain data to the central server, wherein the query The request includes a query identifier corresponding to the storage identifier of the first call chain data; and依据所述查询标识对所述边缘服务器或所述中心服务器中至少一者进行查询,获取所述第一调用链数据。Query at least one of the edge server or the central server according to the query identifier to obtain the first call chain data.
- 根据权利要求3所述的方法,还包括:The method of claim 3, further comprising:所述依据所述查询标识对所述边缘服务器或所述中心服务器中至少一者进行查询,获取所述第一调用链数据之后,进行以下至少一种操作:Query at least one of the edge server or the central server based on the query identifier, and after obtaining the first call chain data, perform at least one of the following operations:基于树型结构,展示所述第一调用链数据对应的微服务所属的数据中心的类别;或,Based on the tree structure, display the category of the data center to which the microservice corresponding to the first call chain data belongs; or,基于图型结构,展示所述第一调用链数据对应的微服务的处理时长信息。Based on the graph structure, the processing time information of the microservice corresponding to the first call chain data is displayed.
- 根据权利要求1所述的方法,还包括:The method of claim 1, further comprising:在确定第二调用链数据是基于同一个数据中心内发生的业务对应的数据的情况下,保存所述第二调用链数据至所述边缘服务器。When it is determined that the second call chain data is based on data corresponding to services occurring in the same data center, the second call chain data is saved to the edge server.
- 根据权利要求1所述的方法,还包括:The method of claim 1, further comprising:所述在确定第一调用链数据是基于跨数据中心的业务对应的数据的情况下,对所述第一调用链路数据进行标记,生成跨域标识之前,从注册服务器获取与所述第一调用链数据对应的微服务的注册信息,其中,所述注册信息包括所述微服务的注册地址;When it is determined that the first call chain data is data corresponding to cross-data center services, the first call link data is marked and the cross-domain identifier is obtained from the registration server before the cross-domain identification is generated. Call the registration information of the microservice corresponding to the chain data, where the registration information includes the registration address of the microservice;获取所述第一调用链数据对应的目标数据的存储地址,其中,所述目标数据为所述微服务期望获取的数据;以及Obtain the storage address of the target data corresponding to the first call chain data, where the target data is the data that the microservice expects to obtain; and依据所述微服务的注册地址和所述第一调用链数据对应的目标数据的存储地址,确定所述第一调用链数据是否是基于跨数据中心的业务对应的数据。Based on the registration address of the microservice and the storage address of the target data corresponding to the first call chain data, it is determined whether the first call chain data is based on data corresponding to cross-data center services.
- 根据权利要求1至6中任一项所述的方法,其中,所述第一调用链数 据为财务系统中的财务微服务对应的数据;The method according to any one of claims 1 to 6, wherein the first call chain number The data is the data corresponding to the financial microservices in the financial system;所述将所述跨域标识和所述第一调用链数据保存至边缘服务器,以供所述边缘服务器将所述第一调用链数据同步到中心服务器包括:Saving the cross-domain identification and the first call chain data to the edge server so that the edge server can synchronize the first call chain data to the central server includes:每间隔预设时长,从所述边缘服务器中获取所述第一调用链数据对应的存储地址,其中,所述第一调用链数据对应的存储地址为所述边缘服务器基于其上一次获取调用链数据的数据偏移量信息确定的地址;At every preset time interval, obtain the storage address corresponding to the first call chain data from the edge server, where the storage address corresponding to the first call chain data is based on the last time the edge server obtained the call chain. The address determined by the data offset information of the data;依据所述第一调用链数据对应的存储地址和所述中心服务器的网络地址,生成同步请求;以及Generate a synchronization request based on the storage address corresponding to the first call chain data and the network address of the central server; and向所述边缘服务器发送所述同步请求,以供所述边缘服务器依据所述第一调用链数据对应的存储地址和所述中心服务器的网络地址,将所述第一调用链数据同步至所述中心服务器。Send the synchronization request to the edge server, so that the edge server synchronizes the first call chain data to the first call chain data based on the storage address corresponding to the first call chain data and the network address of the central server. central server.
- 根据权利要求1至6中任一项所述的方法,其中,所述第一调用链数据为通信运营商的计费系统中的计费微服务对应的数据;The method according to any one of claims 1 to 6, wherein the first call chain data is data corresponding to the charging microservice in the charging system of the communication operator;所述将所述跨域标识和所述第一调用链数据保存至边缘服务器,以供所述边缘服务器将所述第一调用链数据同步到中心服务器包括:Saving the cross-domain identification and the first call chain data to the edge server so that the edge server can synchronize the first call chain data to the central server includes:对所述第一调用链数据进行分析,确定所述第一调用链数据对应的计费微服务所属的计费区域信息,其中,所述计费区域信息包括所述计费微服务对应的计费区域等级;以及Analyze the first call chain data to determine the billing area information to which the charging microservice corresponding to the first call chain data belongs, wherein the charging area information includes the charging area information corresponding to the charging microservice. fee area level; and依据所述计费微服务对应的计费区域等级,将所述跨域标识和所述第一调用链数据保存至与所述计费区域等级对应的边缘服务器。According to the charging area level corresponding to the charging microservice, the cross-domain identification and the first call chain data are saved to the edge server corresponding to the charging area level.
- 根据权利要求1至6中任一项所述的方法,其中,所述第一调用链数据为基于云端的游戏场景微服务对应的数据,其中,所述游戏场景微服务包括游戏场景渲染微服务及其对应的计费微服务,所述游戏场景渲染微服务部署在所述边缘服务器上,所述游戏场景渲染微服务对应的计费微服务的目标数据存储在公有云服务器上。The method according to any one of claims 1 to 6, wherein the first call chain data is data corresponding to a cloud-based game scene microservice, wherein the game scene microservice includes a game scene rendering microservice. and its corresponding billing microservice. The game scene rendering microservice is deployed on the edge server, and the target data of the billing microservice corresponding to the game scene rendering microservice is stored on the public cloud server.
- 根据权利要求9所述的方法,还包括:The method of claim 9, further comprising:所述将所述跨域标识和所述第一调用链数据保存至边缘服务器,以供所述边缘服务器将所述第一调用链数据同步到中心服务器之后,向所述公有云服务器发送数据统计请求,其中,所述数据统计请求用于统计在预设时长内,预设数量的调用链数据被使用的信息;The cross-domain identification and the first call chain data are saved to the edge server, so that after the edge server synchronizes the first call chain data to the central server, the data statistics are sent to the public cloud server. Request, wherein the data statistics request is used to count the information that a preset amount of call chain data is used within a preset time period;响应于所述公有云服务器反馈的统计响应,获取统计结果;以及Obtain statistical results in response to the statistical response fed back by the public cloud server; and展示所述统计结果。Display the statistical results.
- 一种数据处理方法,包括:A data processing method including:获取数据处理装置发送的跨域标识和第一调用链数据,其中,所述第一调用链数据是基于跨数据中心的业务对应的数据;Obtain the cross-domain identification and first call chain data sent by the data processing device, wherein the first call chain data is data corresponding to services based on cross-data centers;生成与所述第一调用链数据对应的存储标识;Generate a storage identification corresponding to the first call chain data;依据所述存储标识保存所述跨域标识和所述第一调用链数据;以及Save the cross-domain identification and the first call chain data according to the storage identification; and将所述第一调用链数据同步至中心服务器。Synchronize the first call chain data to the central server.
- 根据权利要求11所述的方法,其特征在于,所述将所述第一调用链数据同步至中心服务器包括:The method according to claim 11, characterized in that, synchronizing the first call chain data to the central server includes:响应于所述数据处理装置发送的同步请求,获取所述同步请求中的目标地址,其中,所述目标地址为所述中心服务器的网络地址;以及In response to the synchronization request sent by the data processing device, obtain the target address in the synchronization request, wherein the target address is the network address of the central server; and依据所述目标地址将所述第一调用链数据同步至所述中心服务器。Synchronize the first call chain data to the central server according to the target address.
- 一种数据处理装置,包括: A data processing device including:标记模块,配置为在确定第一调用链数据是基于跨数据中心的业务对应的数据的情况下,对所述第一调用链路数据进行标记,生成跨域标识;以及A marking module configured to mark the first calling link data and generate a cross-domain identification when it is determined that the first calling link data is based on data corresponding to cross-data center services; and存储模块,配置为将所述跨域标识和所述第一调用链数据保存至边缘服务器,以供所述边缘服务器将所述第一调用链数据同步到中心服务器。A storage module configured to save the cross-domain identification and the first call chain data to an edge server, so that the edge server can synchronize the first call chain data to the central server.
- 一种边缘服务器,包括:An edge server that includes:获取模块,配置为获取数据处理装置发送的跨域标识和第一调用链数据,其中,所述第一调用链数据是基于跨数据中心的业务对应的数据;The acquisition module is configured to acquire the cross-domain identification and the first call chain data sent by the data processing device, wherein the first call chain data is data corresponding to the business based on the cross-data center;生成模块,配置为生成与所述第一调用链数据对应的存储标识;A generation module configured to generate a storage identification corresponding to the first call chain data;保存模块,配置为依据所述存储标识保存所述跨域标识和所述第一调用链数据;以及a saving module configured to save the cross-domain identification and the first call chain data according to the storage identification; and同步模块,配置为将所述第一调用链数据同步至中心服务器。A synchronization module configured to synchronize the first call chain data to the central server.
- 一种数据处理系统,包括:通信连接的数据处理装置、边缘服务器和中心服务器;A data processing system, including: a communication-connected data processing device, an edge server and a central server;所述数据处理装置,被配置为执行如权利要求1至10中任一项所述的数据处理方法;The data processing device is configured to perform the data processing method according to any one of claims 1 to 10;所述边缘服务器,被配置为执行如权利要求11至12中任一项所述的数据处理方法;The edge server is configured to perform the data processing method according to any one of claims 11 to 12;所述中心服务器,被配置为获取所述边缘服务器同步的第一调用链数据;响应于用户终端发送的查询请求,基于所述查询请求中的查询标识获取所述第一调用链数据,并将所述第一调用链数据反馈给所述用户终端;其中,所述第一调用链数据是基于跨数据中心的业务对应的数据。The central server is configured to obtain the first call chain data synchronized by the edge server; in response to the query request sent by the user terminal, obtain the first call chain data based on the query identifier in the query request, and The first call chain data is fed back to the user terminal; wherein the first call chain data is data corresponding to services across data centers.
- 一种电子设备,包括:An electronic device including:至少一个处理器;以及at least one processor; and存储器,其上存储有至少一个计算机程序,当所述至少一个计算机程序被所述至少一个处理器执行时,使得所述至少一个处理器实现如权利要求1至12中任一项所述的数据处理方法。A memory having at least one computer program stored thereon, which when executed by the at least one processor causes the at least one processor to implement the data as claimed in any one of claims 1 to 12 Approach.
- 一种计算机可读存储介质,所述可读存储介质存储有计算机程序,所述计算机程序被处理器执行时实现如权利要求1至12中任一项所述的数据处理方法。 A computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the data processing method according to any one of claims 1 to 12 is implemented.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210767296.4A CN117370297A (en) | 2022-07-01 | 2022-07-01 | Data processing method, device, server and system |
CN202210767296.4 | 2022-07-01 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2024002232A1 true WO2024002232A1 (en) | 2024-01-04 |
Family
ID=89383141
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2023/103799 WO2024002232A1 (en) | 2022-07-01 | 2023-06-29 | Data processing method, apparatus and system, edge server, electronic device, and storage medium |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN117370297A (en) |
WO (1) | WO2024002232A1 (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109873717A (en) * | 2019-01-18 | 2019-06-11 | 深圳壹账通智能科技有限公司 | Monitoring method, device, computer equipment and storage medium |
CN111625414A (en) * | 2020-04-29 | 2020-09-04 | 江苏瑞中数据股份有限公司 | Method for realizing automatic scheduling monitoring system of data conversion integration software |
CN112887279A (en) * | 2021-01-13 | 2021-06-01 | 太平金融科技服务(上海)有限公司 | Micro-service calling method and device, computer equipment and storage medium |
CN114301988A (en) * | 2021-12-22 | 2022-04-08 | 中国电信股份有限公司 | Distributed calling method and device, storage medium and electronic equipment |
US11321217B1 (en) * | 2020-10-06 | 2022-05-03 | Splunk Inc. | Generating metrics values at component levels of a monolithic application and of a microservice of a microservices-based architecture |
CN114490268A (en) * | 2022-02-09 | 2022-05-13 | 中国工商银行股份有限公司 | Full link monitoring method, device, equipment, storage medium and program product |
-
2022
- 2022-07-01 CN CN202210767296.4A patent/CN117370297A/en active Pending
-
2023
- 2023-06-29 WO PCT/CN2023/103799 patent/WO2024002232A1/en unknown
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109873717A (en) * | 2019-01-18 | 2019-06-11 | 深圳壹账通智能科技有限公司 | Monitoring method, device, computer equipment and storage medium |
CN111625414A (en) * | 2020-04-29 | 2020-09-04 | 江苏瑞中数据股份有限公司 | Method for realizing automatic scheduling monitoring system of data conversion integration software |
US11321217B1 (en) * | 2020-10-06 | 2022-05-03 | Splunk Inc. | Generating metrics values at component levels of a monolithic application and of a microservice of a microservices-based architecture |
CN112887279A (en) * | 2021-01-13 | 2021-06-01 | 太平金融科技服务(上海)有限公司 | Micro-service calling method and device, computer equipment and storage medium |
CN114301988A (en) * | 2021-12-22 | 2022-04-08 | 中国电信股份有限公司 | Distributed calling method and device, storage medium and electronic equipment |
CN114490268A (en) * | 2022-02-09 | 2022-05-13 | 中国工商银行股份有限公司 | Full link monitoring method, device, equipment, storage medium and program product |
Also Published As
Publication number | Publication date |
---|---|
CN117370297A (en) | 2024-01-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10924419B1 (en) | Underlay-overlay correlation | |
WO2021017301A1 (en) | Management method and apparatus based on kubernetes cluster, and computer-readable storage medium | |
US8606897B2 (en) | Systems and methods for exporting usage history data as input to a management platform of a target cloud-based network | |
WO2021169268A1 (en) | Data processing method, apparatus and device, and storage medium | |
CN110457178A (en) | A kind of full link monitoring alarm method based on log collection analysis | |
CN103516802A (en) | Method and device for achieving seamless transference of across heterogeneous virtual switch | |
CN107133231B (en) | Data acquisition method and device | |
CN108965003A (en) | A kind of dispositions method of distributed type assemblies, device, system and storage medium | |
WO2017181430A1 (en) | Method and device for duplicating database in distributed system | |
CN104216963A (en) | Mass network management data collection and storage method based on HBase | |
CN112685499A (en) | Method, device and equipment for synchronizing process data of work service flow | |
CN207968542U (en) | A kind of police service information acquisition system | |
WO2024002232A1 (en) | Data processing method, apparatus and system, edge server, electronic device, and storage medium | |
CN104731660A (en) | Data distribution method, device and system | |
CN105205735A (en) | Power dispatching data cloud service system and implementation method | |
US11895192B1 (en) | Managing subscriptions to resource updates made via a target interface | |
CN109274763B (en) | Information synchronization method and dual-computer hot standby equipment | |
CN115269719A (en) | Data synchronization method and device | |
CN113515425A (en) | Method and device for dynamically reporting data | |
TWI762969B (en) | Service arrangement and provisioning system for the mobile-fixed convergence network and method thereof | |
CN114756301A (en) | Log processing method, device and system | |
CN108664503A (en) | A kind of data archiving method and device | |
CN112667465A (en) | Multi-cluster operation monitoring method, device and system and readable storage medium | |
CN107330089B (en) | Cross-network structured data collection system | |
CN112491596A (en) | Cloud-based fault processing method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23830400 Country of ref document: EP Kind code of ref document: A1 |