CN117201516A

CN117201516A - Data processing method, device, electronic equipment and storage medium

Info

Publication number: CN117201516A
Application number: CN202311219099.XA
Authority: CN
Inventors: 胡建男; 徐永明; 刘艳飞; 王影轩; 崔尚; 袁奥; 冯俊钦; 王海亮; 胡丰; 王文涛; 刘塽; 王超
Original assignee: China United Network Communications Group Co Ltd; Unicom Digital Technology Co Ltd
Current assignee: China United Network Communications Group Co Ltd; Unicom Digital Technology Co Ltd
Priority date: 2023-09-20
Filing date: 2023-09-20
Publication date: 2023-12-08

Abstract

The application provides a data processing method, a data processing device, electronic equipment and a storage medium. The method comprises the following steps: acquiring a first data synchronization instruction sent by a first client; determining a first virtual network node in the target network system according to the first client address information; according to the modified data information, synchronously updating the data information recorded in the first virtual network node, so that after the synchronous updating of the first virtual network node is completed, the first virtual network node sends the modified data information to the second virtual network node, and the second virtual network node synchronously updates the data information according to the modified data information; after the second virtual network node completes the synchronous update, the second virtual network node feeds back the synchronous update result to the first virtual network node so that the first virtual network node feeds back the synchronous update result to the first client. The method of the application improves the data synchronization efficiency and the network resource utilization rate, and meets the requirements of users on low delay and high reliability of data response.

Description

Data processing method, device, electronic equipment and storage medium

Technical Field

The present application relates to the field of communications technologies, and in particular, to a data processing method, a data processing device, an electronic device, and a storage medium.

Background

With large-scale application of the distributed file system, application scenes of data sharing are more and more complex, and data needs to be shared not only among different users, but also among different applications, different devices, different application systems and other access subjects.

In the existing distributed deployment mode, each remote sensing data provider is utilized to deploy a node server, wherein the node server comprises a alliance chain node and a distributed storage node, and each alliance chain node and each distributed storage node form an alliance chain system and a distributed storage system to form a remote sensing data sharing exchange platform together; then constructing a alliance chain encryption and decryption environment which comprises a transaction data generating end, a client and a transaction data using end; the transaction data generating end sends the transaction data to the client, then the client selects to upload the data, the data is packaged into shared data by adopting an intelligent contract uploading method and is broadcasted to all network nodes of the whole network, and therefore data sharing is achieved.

However, the transmission efficiency in the data sharing in the existing method is not ideal, and for network nodes deployed in the whole network, the request routing time of the traffic between each node is long, and the data sharing system has to delay processing the sharing task, so that the processing efficiency of the data sharing is adversely affected.

Disclosure of Invention

The application provides a data processing method, a data processing device, electronic equipment and a storage medium, which are used for solving the problems of network bandwidth bottleneck and lower data sharing efficiency in data transmission of each node in the existing data processing method.

In a first aspect, the present application provides a data processing method, including:

acquiring a first data synchronization instruction sent by a first client, wherein the first data synchronization instruction comprises address information and modified data information of the first client;

determining a first virtual network node in a target network system according to address information of a first client, wherein the first virtual network node is a virtual node constructed according to the first network node, and the address of the first network node and the address of the client meet preset address requirements;

according to the modified data information, synchronously updating the data information recorded in the first virtual network node, so that after the synchronous updating of the first virtual network node is completed, the first virtual network node sends the modified data information to the second virtual network node, and enables the second virtual network node to synchronously update according to the modified data information, wherein the second virtual network node is a virtual node constructed according to the second network node, and the second network node and the first network node are nodes in a target network environment;

After the second virtual network node completes the synchronous update, the second virtual network node feeds back the synchronous update result to the first virtual network node so that the first virtual network node feeds back the synchronous update result to the first client.

In the embodiment of the present application, before determining the first virtual network node in the target network system according to the address information of the first client, the method further includes:

determining network node information of a target network environment in a target network system, wherein the network node information comprises network nodes and configuration information of the network nodes;

constructing a virtual network node corresponding to the network node according to the network node information;

and constructing a virtual network environment according to the virtual network nodes to execute the step of determining a first virtual network node in the target network system according to the address information of the client.

In the embodiment of the application, a virtual network environment is constructed according to a virtual network node, and the method comprises the following steps:

configuring DOTS network protocol according to the virtual network node;

configuring DOTS servers of each virtual network node according to DOTS network protocol;

and (3) arranging a page management platform and a map database in the DOTS server of each virtual network node to obtain a virtual network environment.

In the embodiment of the present application, determining a first virtual network node in a target network system according to address information of a first client includes:

acquiring configuration information of a network node of a target network environment in a target network system;

determining a node address of the network node according to the configuration information of the network node;

comparing the address information of the first client with the node address of the network node to determine a first network node in the network node, wherein the address information of the first network node and the first client meet the preset address requirement;

and determining a first virtual network node according to the first network node.

In the embodiment of the present application, according to the modified data information, the data information recorded in the first virtual network node is synchronously updated, so that after the synchronization update of the first virtual network node is completed, the first virtual network node sends the modified data information to the second virtual network node, and the second virtual network node synchronously updates according to the modified data information, including:

determining a DOTS server in the first virtual network node;

determining data information recorded in the first virtual network node according to the DOTS server in the first virtual network node;

And according to the modified data information, synchronously updating the data information recorded in the first virtual network node, so that after the synchronous updating of the first virtual network node is completed, the first virtual network node sends the modified data information to the second virtual network node, and the second virtual network node synchronously updates the data information according to the modified data information.

In an embodiment of the present application, the method further includes:

receiving query data information sent by a second client, wherein the query data information comprises a second client address and a query data instruction;

determining a third virtual network node according to the second client address;

obtaining a data query result from the map database information in the third virtual network node according to the query data instruction;

and sending the data query result to the second client.

In the embodiment of the application, determining a third virtual network node according to the address of the second client, including;

comparing the address information of the second client with the node address of the network node to determine a third network node in the network node, wherein the address information of the third network node and the second client meet the preset address requirement;

And determining a third virtual network node according to the third network node.

In a second aspect, the present application provides a data processing apparatus comprising:

the acquisition module is used for acquiring a first data synchronization instruction sent by the first client, wherein the first data synchronization instruction comprises address information and modified data information of the first client;

the determining module is used for determining a first virtual network node in the target network system according to the address information of the first client, wherein the first virtual network node is a virtual node constructed according to the first network node, and the address of the first network node and the address of the client meet preset address requirements;

the response module is used for synchronously updating the data information recorded in the first virtual network node according to the modified data information, so that after the synchronous updating of the first virtual network node is completed, the first virtual network node sends the modified data information to the second virtual network node and enables the second virtual network node to synchronously update according to the modified data information, wherein the second virtual network node is a virtual node constructed according to the second network node, and the second network node and the first network node are nodes in a target network environment;

And the sending module is used for feeding back the synchronous updating result to the first virtual network node by the second virtual network node after the synchronous updating of the second virtual network node is completed, so that the first virtual network node feeds back the synchronous updating result to the first client.

In a third aspect, the present application provides an electronic device, comprising: a processor, a memory communicatively coupled to the processor;

the memory stores computer-executable instructions;

the processor executes computer-executable instructions stored in the memory to implement the data processing method of the embodiments of the present application.

In a fourth aspect, a computer readable storage medium stores computer executable instructions that, when executed by a processor, are configured to implement a data processing method according to an embodiment of the present application.

According to the data processing method, the data processing device, the electronic equipment and the storage medium, a first data synchronization instruction sent by a first client is obtained, and the first data synchronization instruction comprises address information and modified data information of the first client; determining a first virtual network node in a target network system according to address information of a first client, wherein the first virtual network node is a virtual node constructed according to the first network node, and the address of the first network node and the address of the client meet preset address requirements; according to the modified data information, synchronously updating the data information recorded in the first virtual network node, so that after the synchronous updating of the first virtual network node is completed, the first virtual network node sends the modified data information to the second virtual network node, and enables the second virtual network node to synchronously update according to the modified data information, wherein the second virtual network node is a virtual node constructed according to the second network node, and the second network node and the first network node are nodes in a target network environment; after the second virtual network node is updated synchronously, the second virtual network node feeds back the synchronous updating result to the first virtual network node, so that the first virtual network node feeds back the synchronous updating result to the first client, the data can realize cross-region and ultra-long distance synchronous transmission in the virtual network environment constructed according to the target network environment node, the target network environment can provide the target network bandwidth of data transmission of each node, the access efficiency of each node is improved, meanwhile, in order to realize the data consistency of each node of the whole network, the request response time of the client is shortened, the virtual network node is constructed by utilizing the target network system, the virtual network node is used for sharing data synchronization, the path from the target network to the server in the traditional sharing scheme can be omitted, the time delay of database data synchronization is reduced, and the data transmission efficiency is improved.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.

Fig. 1 is a schematic structural diagram of a data processing method according to an embodiment of the present application;

FIG. 2 is a schematic flow chart of a data processing method according to an embodiment of the present application;

FIG. 3 is a flowchart illustrating another data processing method according to an embodiment of the present application;

FIG. 4 is a schematic diagram of a data query timing sequence of a data processing method according to an embodiment of the present application;

FIG. 5 is a schematic diagram of a data modification timing diagram of a data processing method according to an embodiment of the present application;

FIG. 6 is a schematic diagram of a data processing apparatus according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Specific embodiments of the present application have been shown by way of the above drawings and will be described in more detail below. The drawings and the written description are not intended to limit the scope of the inventive concepts in any way, but rather to illustrate the inventive concepts to those skilled in the art by reference to the specific embodiments.

Detailed Description

Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the application. Rather, they are merely examples of apparatus and methods consistent with aspects of the application as detailed in the accompanying claims.

In the prior art, a data sharing method based on a alliance chain is adopted, alliance chain nodes and distributed storage nodes are deployed on all data providers to form a remote sensing data sharing exchange platform together, shared data are stored in a distributed storage system, remote sensing metadata are cataloged to the alliance chain system, a client performs data retrieval through the remote sensing data sharing exchange platform, a data access request is performed on required data, and data sharing service is automatically executed through an intelligent contract after the sharing platform verifies client information. Although the method improves the safety reliability and the sharing exchange efficiency of the sharing exchange environment, distributed storage nodes are arranged in the whole network range, and the service is deployed in a machine room where a data provider is located, so that the request route of the flow among the storage nodes is longer, and the data synchronization time is greatly limited. And the method for setting the third party data sharing platform on the data provider and the data demander is not applicable to a large number of service requests with low security requirements, and the phenomena of insufficient network bandwidth and delay of data transmission time are faced.

In order to solve the above problems, a virtual network node can be constructed in a target network environment by utilizing the advantages of the network environment, such as high network transmission speed, high bandwidth upper limit and network security and stability, of the target network system. Specifically, after a first data synchronization instruction sent by a first client is obtained, according to address information of the first client, a first virtual network node in a target network system which is closest to the address information of the first client in position is found; the data information recorded in the first virtual network node is modified and updated, and then the data is synchronized to other virtual network nodes through the first virtual network node; after the first virtual network node receives the synchronization messages fed back by other virtual network nodes, the synchronization completion result is fed back to the first client.

The following describes the technical scheme of the present application and how the technical scheme of the present application solves the above technical problems in detail with specific embodiments. The following embodiments may be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments. Embodiments of the present application will be described below with reference to the accompanying drawings.

Fig. 1 is a schematic view of a scenario of a data processing method according to an embodiment of the present application. As shown in fig. 1, the application body of the data processing method may be a target network system. The a-province, B-province, C-province, D-province, and other province nodes of the target network system may refer to network nodes that need to construct virtual network nodes, where each network node is connected by a router IP address of the network node, so as to implement data routing between each network node. A virtual switch is deployed for each network node, the virtual switch is connected with the corresponding network node through an MAC address, a DOTS server is deployed in the virtual switch, and therefore a virtual network node corresponding to the network node is constructed, wherein the target network system can be a data network system provided by an operator and having a rapid and flat intercommunication function among a data center, a cloud resource pool and an office place; the MAC address is also called a hardware address, and is used to identify the identity of a network node, in a stable network system, the IP address and the MAC address are in pairs, and the IP address is focused on the network layer, and forwards a data packet from one network to another network; the MAC address is focused on the data link layer, and one data frame is transmitted from one node to another node of the same link, so that the data of the virtual network node can be shared to the virtual network nodes corresponding to other network nodes through the network nodes; the DOTS server comprises a web management platform server and a database server, wherein the web management platform server is a page management platform and is used for responding to a request of a client; the database server, i.e. the graph database, is used for storing shared data in the virtual network nodes and responding to requests for data queries or data modifications.

The selection type of the target network system is not particularly limited in this embodiment, as long as the first data synchronization instruction sent by the first client can be obtained, the first data synchronization instruction includes address information and modified data information of the first client; determining a first virtual network node in a target network system according to address information of a first client, wherein the first virtual network node is a virtual node constructed according to the first network node, and the address of the first network node and the address of the client meet preset address requirements; according to the modified data information, synchronously updating the data information recorded in the first virtual network node, so that after the synchronous updating of the first virtual network node is completed, the first virtual network node sends the modified data information to the second virtual network node, and enables the second virtual network node to synchronously update according to the modified data information, wherein the second virtual network node is a virtual node constructed according to the second network node, and the second network node and the first network node are nodes in a target network environment; after the second virtual network node completes the synchronous updating, the second virtual network node feeds back the synchronous updating result to the first virtual network node, so that the first virtual network node feeds back the synchronous updating result to the first client.

The client may refer to an end of a user sending a data query or data modification instruction, the client may submit the data query or data modification instruction through an operation page provided by a page management platform in the virtual network node, where the operation page configuration includes a client network node name of a location where the client is located and an IP address of the client network node, and the client network node may be a network node at any location in the target network system.

The virtual network node may refer to a virtual service node constructed according to a network node in the target network system, a page management platform deployed on the virtual network node may add a plurality of operation pages, a client network node name is formulated on each operation page, and when the page management platform receives a client access request, different virtual network nodes are accessed according to different client network node names, so that rapid transmission of data between network nodes in the target network system is realized.

Fig. 2 is a flow chart of a data processing method according to an embodiment of the present application, where an execution body of the data processing method may be a server, as shown in fig. 2, and the data processing method includes the following steps:

S201, a first data synchronization instruction sent by a first client is obtained, wherein the first data synchronization instruction comprises address information and modified data information of the first client.

The first client may refer to a client that sends out an operation instruction at a client network node in the target network system.

The first data synchronization instruction may refer to modification data sent by the client and an instruction that needs to perform synchronization modification on data in the virtual network node.

The address information may refer to client network node IP address information configured by an operating page used by the first client.

The modified data information may refer to modified content submitted by the client on the corresponding operation page and data content that needs to synchronously modify the storage history data of the database corresponding to the virtual network node.

S202, determining a first virtual network node in a target network system according to address information of a first client, wherein the first virtual network node is a virtual node constructed according to the first network node, and the address of the first network node and the address of the client meet preset address requirements.

The target network system can be a data network system provided by an operator, and the data network system meets the requirements of quick and flat intercommunication among a data center, a cloud resource pool and an office place.

A network node may refer to a computer or other device that is connected to a network having a separate address and having the capability to transmit or receive data. The nodes may be workstations, clients, network users or personal computers, but also servers, printers and other network-connected devices. Each workstation, server, terminal equipment and network equipment, namely equipment with own unique network address, are network nodes. In the embodiment of the application, a plurality of network nodes which need to construct virtual network nodes in the target network system can be represented by the main network node so as to distinguish client network nodes.

The first virtual network node may refer to a virtual network node corresponding to a main network node with a shortest path of a client network node where the first client is located, and data modification is performed on the first virtual network node by adopting a priority modification principle, and then the first virtual network node synchronizes the modified data to other virtual network nodes.

The first network node may refer to a primary network node having a shortest path to a client network node where the first client is located.

The preset address requirement may refer to an address requirement of forming a shortest path between the client network node and the main network node, and the preset address requirement may be used to automatically compare address information of the client network node and the main network node through an algorithm, so as to find a first network node forming a shortest path with the client network node.

In the embodiment of the application, according to the address information of the first client, the method for determining the first virtual network node from the target network system can perform data modification operation on the operation page of the a-client network node for the client, the page management platform receives the data modification operation instruction, acquires the IP address of the a-client network node, searches the network node closest to the IP address path of the a-client network node as the B-network node through the shortest path algorithm, and the virtual network node corresponding to the B-network node is the first virtual network node. Wherein, the lower case letters of a, b and the like are adopted to distinguish different client network nodes, the upper case letters of A, B and the like are adopted to distinguish different master network nodes which construct virtual network nodes and have a shared data storage function.

In this embodiment of the present application, before determining the first virtual network node in the target network system according to the address information of the first client, the data processing method may further include:

The target network environment may be formed by a plurality of network nodes connected by a network, and the network nodes in the network node information may be a plurality of master network nodes required to construct a virtual network node. The configuration information of the network node may include a domain name, an IP address, memory information, gateway information of the master network node. When the virtual network node is constructed, the mapping address of the IP address of the main network node is required to be written, so that the IP address of the virtual network node and the IP address of the corresponding main network node are in the same section of network IP, and if the IP of the virtual network node can be ping-passed through by the main network node in the test, the network connection function of the virtual network node and the main network node can be realized.

In an embodiment of the present application, a method for constructing a virtual network environment according to a virtual network node may include:

configuring DOTS network protocol according to the virtual network node;

The virtual network node is internally configured by utilizing DOTS, the DOTS refers to a multi-thread data oriented technical stack (Data oriented Tech Stack), the DOTS comprises ECS (Entity Component System), a Job System and a Burst compiler, wherein ECS refers to writing high-performance codes, data and behaviors can be separated, job System refers to writing multi-thread codes, multi-thread can be used for developing functions such as data and networks, a multi-core processor is utilized to avoid the problems of thread safety and the like, the Burst compiler refers to compiling and generating the high-performance codes, C# jobs can be compiled into highly-optimized machine codes, and the specific capability of a target platform is fully utilized.

The page management platform can directly update the content of the website on the web page, and synchronous update display of client inquiry or modification is realized, wherein the operation realization of the page management platform requires network connection and database cooperation to provide data support.

The map database refers to data storage and inquiry in a map structure, is an online database management system, has the operations of creating, reading, updating and deleting graphic data models, is simple in data model, is a map composed of nodes and relations, and can quickly search data information by using a map structure related algorithm, wherein the map structure related algorithm can comprise shortest path and node relation searching.

In an embodiment of the present application, the method for determining the first virtual network node in the target network system according to the address information of the first client may include:

Wherein, determining the node address of the network node may refer to searching the IP address information of the master network node having the virtual network node built therein according to the configuration information of the network node.

The first client address information may be client network node IP address information configured by an operation page used by the current client, and the client network node may be a network node of the same or different IP address as the main network node.

After the modification operation is carried out on the client a, the path distance between the IP address of the network node a and the IP address of each main network node is compared by adopting a priority distance modification principle, and the comparison result is that the path distance between the IP address of the network node B and the IP address of the network node a is shortest, so that the network node B can be determined to be a first network node.

S203, according to the modified data information, the data information recorded in the first virtual network node is synchronously updated, so that after the first virtual network node is synchronously updated, the first virtual network node sends the modified data information to the second virtual network node, and the second virtual network node synchronously updates according to the modified data information, wherein the second virtual network node is a virtual node constructed according to the second network node, and the second network node and the first network node are nodes in a target network environment.

The second virtual network node may be a virtual network node that has not been subjected to data modification, and is a virtual network node that needs to transmit synchronization modification data through the first virtual network node, and in the process of performing data modification synchronization, there may be multiple second virtual networks, that is, the first virtual network may synchronize modification data to other multiple virtual network nodes at the same time.

In an embodiment of the present application, according to the modified data information, the method for synchronously updating the data information recorded in the first virtual network node, so that after the synchronous updating of the first virtual network node is completed, the first virtual network node sends the modified data information to the second virtual network node, and the second virtual network node synchronously updates the data information according to the modified data information may include:

Determining a DOTS server in the first virtual network node;

S204, after the second virtual network node completes the synchronous updating, the second virtual network node feeds back the synchronous updating result to the first virtual network node so that the first virtual network node feeds back the synchronous updating result to the first client.

In an embodiment of the present application, the data processing method may further include:

And sending the data query result to the second client.

The second client may be a client different from the first client, and the second client may be a client corresponding to a location of any network node in the target network system.

The third virtual network node may be any one of the constructed multiple virtual network nodes, for example, the determining method of the third virtual network node may be that after the b-client performs the query operation, a priority distance query principle is adopted to compare the path distance between the IP address of the b-client network node and the IP address of each main network node, and the comparison result is that the path distance between the IP address of the C-network node and the IP address of the b-client network node is shortest, so that the C-network node may be determined to be the third network node, and the third virtual network node corresponding to the third network node provides the query data result for the b-client.

In the embodiment of the present application, the method for determining the third virtual network node according to the address of the second client may include;

According to the data processing method provided by the embodiment of the application, cross-region and ultra-long distance synchronous transmission can be realized in the virtual network environment constructed according to the target network environment nodes, the target network environment can provide the target network bandwidth for data transmission of each node, the access efficiency of each node is rapidly improved, meanwhile, a DOTS server is arranged in the virtual network environment, the deployed server comprises a page management platform and a database storage platform, the data request of the client can be responded, the data of each node in the virtual network environment can be queried or synchronously updated and stored when the data query or modification is carried out on the client, the response time of the request of the client is shortened, the time delay of the data synchronization of the database is reduced, the data consistency of each node in the whole network is realized, and the data transmission efficiency is improved.

Fig. 3 is a flow chart of another data processing method according to an embodiment of the present application, as shown in fig. 3, the method includes the following steps:

s301, constructing a distributed map library based on a target network, wherein the method mainly comprises the steps of constructing DOTS servers in a plurality of network nodes, and deploying map databases and page web services in the servers.

The target network may refer to a core network in a target network system provided by an operator.

In the embodiment of the application, the method for constructing the distributed map library based on the target network can comprise the following steps of;

simulating a target network to construct a multi-node large network environment;

based on the constructed large network environment, constructing DOTS servers under each network node and deploying databases and page web services;

after the environment is built, modifying data at the nodes, and simulating data synchronization.

Specifically, the simulation target network building of the multi-node large network environment may refer to creating virtual machine simulation large network nodes, distributing routes to the nodes, and connecting the large network environments in series.

Based on the constructed large network environment, constructing the DOTS server under each network node and deploying the database and the page web service can refer to creating virtual machines and installing DOTS network protocols, and deploying the web management platform and the map database on the formed DOTS server.

The analog data synchronization may be that the data synchronization operation is performed by the DOTS server under the large network node after the network environment and the server are all deployed.

The virtual machine refers to a virtual host (shared web hosting), which is a method for implementing multi-domain service on a single host or host group, and can operate multiple websites or services, and the virtual machine is built by bridging, nat and host-only, where the bridging mode not only enables a current server (a machine for building the virtual machine) to communicate with the virtual machine, but also enables other servers in the same network segment to communicate with the virtual machine; in the nat mode, only the current server can communicate with the virtual machine, and when the current server can access the network, the virtual machine can also access the network; in host-only mode, only the current server can communicate with the virtual machine, and when the current server can access the network, the virtual machine cannot access the network, and the virtual host is created according to the above steps of building the virtual network node.

Routing refers to the act of transmitting data packets from a source station to a destination station over an interconnected network, where the data packets typically pass through one or more transit nodes, i.e., routers; the router is used to connect different networks, and is a hub for interconnecting networks, and the main task is to find a corresponding transmission path for each packet passing through the router, and to efficiently transmit the data to a destination.

S302, based on the constructed virtual network environment, realizing data processing operation, wherein the data processing comprises data query and data modification, namely, when the data is queried, a query request sent by a client is received, and the data is queried from the nearest node initiated by the request and fed back to the client; when the data is changed, the change node broadcasts a data change command to other nodes, and the other nodes synchronously complete the data change operation, so that the data consistency is ensured.

Specifically, when data is queried, a client submits a data query instruction through a page web management platform, a server determines a node closest to a position node initiated by a client request, data information is read from a node database, and the data information is fed back to the client through the page web management platform.

Specifically, when the data is changed, after the client performs data modification operation through the page web management platform, the server determines the node of the province closest to the position node initiated by the client request, performs modification operation on the data of the province, and then synchronizes the modified data into other multiple province databases through the node of the province.

The data processing method provided by the embodiment of the application can provide the fastest transmission speed of each node data based on the bandwidth of the target network environment, and because the service is directly deployed in the large network node, the path from the large network to the service is removed, the time delay of database to database data synchronization is greatly reduced, the network quality is reliable, and the page control center is deployed in each node, thereby saving the time of request response and bringing good use experience for users.

Fig. 4 is a schematic diagram of a data query timing sequence of a data processing method according to an embodiment of the present application. As shown in fig. 4, the client performs a data query operation, determines, through the target network environment, a virtual network node with the shortest IP address path of the client network node, that is, the node a, and then queries a corresponding result in a graph database of the node a, and feeds back the query result to the client.

Fig. 5 is a schematic diagram of a data modification timing sequence of a data processing method according to an embodiment of the present application. As shown in fig. 5, the client performs a data modification operation, determines, through the target network environment, a virtual network node with the shortest IP address path of the client network node, that is, a C-province node, modifies the history data corresponding to the map database of the C-province node, then the C-province sends the synchronization data to be modified to a plurality of other unsynchronized provinces such as A, B, D, the other provinces send the synchronization result back to the C-province node after the synchronization modification, and finally the C-province node feeds the synchronization modification result back to the client.

Fig. 6 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present application. As shown in fig. 6, the data processing apparatus 60 includes: an acquisition module 601, a determination module 602, a response module 603 and a transmission module 604. Wherein:

an obtaining module 601, configured to obtain a first data synchronization instruction sent by a first client, where the first data synchronization instruction includes address information and modified data information of the first client;

a determining module 602, configured to determine, according to address information of a first client, a first virtual network node in a target network system, where the first virtual network node is a virtual node constructed according to the first network node, and an address of the first network node and an address of the client meet a preset address requirement;

the response module 603 is configured to perform synchronization update on the data information recorded in the first virtual network node according to the modified data information, so that after the synchronization update of the first virtual network node is completed, the first virtual network node sends the modified data information to the second virtual network node, and makes the second virtual network node perform synchronization update according to the modified data information, where the second virtual network node is a virtual node constructed according to the second network node, and both the second network node and the first network node are nodes in the target network environment;

And the sending module 604 is configured to, after the synchronization update of the second virtual network node is completed, feed back a synchronization update result to the first virtual network node by the second virtual network node, so that the first virtual network node feeds back the synchronization update result to the first client.

In an embodiment of the present application, the determining module 602 may also be configured to:

configuring DOTS network protocol according to the virtual network node;

comparing the address information of the client with the node address of the network node, and determining a first network node in the network node, wherein the address information of the first network node and the client meet the preset address requirement;

In an embodiment of the present application, the response module 603 may also be configured to:

determining a DOTS server in the first virtual network node;

and sending the data query result to the second client.

As can be seen from the above, the data processing apparatus according to the embodiment of the present application has an obtaining module 601, configured to obtain a first data synchronization instruction sent by a first client, where the first data synchronization instruction includes address information and modified data information of the first client; a determining module 602, configured to determine, according to address information of a first client, a first virtual network node in a target network system, where the first virtual network node is a virtual node constructed according to the first network node, and an address of the first network node and an address of the client meet a preset address requirement; the response module 603 is configured to perform synchronization update on the data information recorded in the first virtual network node according to the modified data information, so that after the synchronization update of the first virtual network node is completed, the first virtual network node sends the modified data information to the second virtual network node, and makes the second virtual network node perform synchronization update according to the modified data information, where the second virtual network node is a virtual node constructed according to the second network node, and both the second network node and the first network node are nodes in the target network environment; and the sending module 604 is configured to, after the synchronization update of the second virtual network node is completed, feed back a synchronization update result to the first virtual network node by the second virtual network node, so that the first virtual network node feeds back the synchronization update result to the first client. Therefore, the embodiment of the application can realize the data consistency of all nodes of the whole network according to the data processing device, shorten the request response time of the client, reduce the time delay of database data synchronization and improve the data transmission efficiency.

Fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application. As shown in fig. 7, the electronic device 70 includes:

the electronic device 70 may include one or more processing cores 'processors 701, one or more computer-readable storage media's memory 702, network interfaces 703, and the like. Wherein the processor 701, the memory 702 and the network interface 703 are connected via a bus 704.

In a specific implementation, at least one processor 701 executes computer-executable instructions stored in a memory 702, such that the at least one processor 701 performs the data processing method as described above.

The specific implementation process of the processor 701 can be referred to the above method embodiment, and its implementation principle and technical effects are similar, and this embodiment will not be described herein again.

In the embodiment shown in fig. 7, it should be understood that the processor may be a central processing unit (english: central Processing Unit, abbreviated as CPU), or may be other general purpose processors, digital signal processors (english: digital Signal Processor, abbreviated as DSP), application specific integrated circuits (english: application Specific Integrated Circuit, abbreviated as ASIC), or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present application may be embodied directly in a hardware processor for execution, or in a combination of hardware and software modules in a processor for execution.

The Memory may comprise high-speed Memory (Random Access Memory, RAM) or may further comprise Non-volatile Memory (NVM), such as at least one disk Memory.

The network interface may be a wireless network interface or a wired network interface, which is typically used to establish communication connections between the electronic device and other electronic devices. For example, a network interface is used to connect an electronic device with an external terminal through a network, establish a data transmission channel and a communication connection between the electronic device and the external terminal, and the like.

The bus may be an industry standard architecture (Industry Standard Architecture, ISA) bus, an external device interconnect (Peripheral Component, PCI) bus, or an extended industry standard architecture (Extended Industry Standard Architecture, EISA) bus, among others. The buses may be divided into address buses, data buses, control buses, etc. For ease of illustration, the buses in the drawings of the present application are not limited to only one bus or to one type of bus.

In some embodiments, a computer program product is also proposed, comprising a computer program or instructions which, when executed by a processor, implement the steps of any of the above-mentioned data processing methods.

Those of ordinary skill in the art will appreciate that all or a portion of the steps in the various methods of the above embodiments may be performed by instructions, or by instructions controlling associated hardware, which may be stored in any computer-readable storage medium and loaded and executed by a processor.

To this end, an embodiment of the present application provides a computer readable storage medium having stored therein a plurality of instructions capable of being loaded by a processor to perform the steps of any of the data processing methods provided by the embodiments of the present application.

Wherein the storage medium may include: read Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic or optical disk, and the like.

According to one aspect of the present application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium.

The instructions stored in the storage medium may perform steps in any data processing method provided by the embodiments of the present application, so that the beneficial effects that any data processing method provided by the embodiments of the present application can be achieved, which are detailed in the previous embodiments and are not described herein.

The specific implementation of each operation above may be referred to the previous embodiments, and will not be described herein.

Other embodiments of the application will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. This application is intended to cover any variations, uses, or adaptations of the application following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the application pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.

It is to be understood that the application is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the application is limited only by the appended claims.

Claims

1. A data processing method, applied to a target network system, comprising:

Determining a first virtual network node in the target network system according to the address information of the first client, wherein the first virtual network node is a virtual node constructed according to the first network node, and the address of the first network node and the address of the client meet preset address requirements;

according to the modified data information, synchronously updating the data information recorded in the first virtual network node, so that after the synchronous updating of the first virtual network node is completed, the first virtual network node sends the modified data information to a second virtual network node, and enables the second virtual network node to synchronously update according to the modified data information, wherein the second virtual network node is a virtual node constructed according to the second network node, and the second network node and the first network node are nodes in a target network environment;

after the second virtual network node completes the synchronous updating, the second virtual network node feeds back a synchronous updating result to the first virtual network node so that the first virtual network node feeds back the synchronous updating result to the first client.

2. The method according to claim 1, wherein prior to said determining a first virtual network node in said target network system from said first client's address information, said method further comprises:

determining network node information of a target network environment in the target network system, wherein the network node information comprises network nodes and configuration information of the network nodes;

and constructing a virtual network environment according to the virtual network node so as to execute the step of determining a first virtual network node in the target network system according to the address information of the client.

3. The method of claim 2, wherein said constructing a virtual network environment from said virtual network node comprises:

configuring DOTS network protocol according to the virtual network node;

configuring DOTS servers of the virtual network nodes according to the DOTS network protocol;

and arranging a page management platform and a map database in the DOTS server of each virtual network node to obtain a virtual network environment.

4. The method of claim 1, wherein the determining a first virtual network node in the target network system according to the address information of the first client comprises:

acquiring configuration information of a network node of a target network environment in the target network system;

comparing the address information of the first client with the node address of the network node, and determining the first network node of the network node, which meets the preset address requirement with the address information of the first client;

and determining the first virtual network node according to the first network node.

5. The method according to claim 1, wherein the step of synchronously updating the data information recorded in the first virtual network node according to the modified data information, so that after the synchronous updating of the first virtual network node is completed, the first virtual network node sends the modified data information to a second virtual network node, and the second virtual network node synchronously updates according to the modified data information includes:

Determining a DOTS server in the first virtual network node;

determining the data information recorded in the first virtual network node according to the DOTS server in the first virtual network node;

and synchronously updating the data information recorded in the first virtual network node according to the modified data information, so that after the synchronous updating of the first virtual network node is completed, the first virtual network node sends the modified data information to a second virtual network node, and the second virtual network node synchronously updates according to the modified data information.

6. The method according to claim 1, wherein the method further comprises:

and sending the data query result to the second client.

7. The method of claim 6, wherein said determining a third virtual network node from said second client address comprises;

comparing the address information of the second client with the node address of the network node, and determining a third network node in the network node, wherein the address information of the third network node and the second client meet preset address requirements;

and determining the third virtual network node according to the third network node.

8. A data processing apparatus, comprising:

the system comprises an acquisition module, a data synchronization module and a data synchronization module, wherein the acquisition module is used for acquiring a first data synchronization instruction sent by a first client, and the first data synchronization instruction comprises address information and modified data information of the first client;

the determining module is used for determining a first virtual network node in a target network system according to the address information of the first client, wherein the first virtual network node is a virtual node constructed according to the first network node, and the address of the first network node and the address of the client meet preset address requirements;

the response module is used for synchronously updating the data information recorded in the first virtual network node according to the modified data information, so that after the synchronous updating of the first virtual network node is completed, the first virtual network node sends the modified data information to a second virtual network node and enables the second virtual network node to synchronously update according to the modified data information, wherein the second virtual network node is a virtual node constructed according to the second network node, and the second network node and the first network node are nodes in a target network environment;

And the sending module is used for feeding back a synchronous updating result to the first virtual network node by the second virtual network node after the synchronous updating of the second virtual network node is completed, so that the first virtual network node feeds back the synchronous updating result to the first client.

9. An electronic device, comprising: a processor, and a memory communicatively coupled to the processor;

the memory stores computer-executable instructions;

the processor executes computer-executable instructions stored in the memory to implement the data processing method of any one of claims 1 to 7.

10. A computer-readable storage medium, in which computer-executable instructions are stored, which computer-executable instructions, when executed by a processor, are for implementing a data processing method according to any one of claims 1 to 7.