CN113220361A - Data synchronization method and system based on ICE - Google Patents
Data synchronization method and system based on ICE Download PDFInfo
- Publication number
- CN113220361A CN113220361A CN202110471583.6A CN202110471583A CN113220361A CN 113220361 A CN113220361 A CN 113220361A CN 202110471583 A CN202110471583 A CN 202110471583A CN 113220361 A CN113220361 A CN 113220361A
- Authority
- CN
- China
- Prior art keywords
- data
- equipment
- management
- service
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 26
- 238000007726 management method Methods 0.000 claims abstract description 82
- 230000001360 synchronised effect Effects 0.000 claims abstract description 55
- 230000005540 biological transmission Effects 0.000 claims abstract description 33
- 238000013523 data management Methods 0.000 claims abstract description 18
- 230000003993 interaction Effects 0.000 claims abstract description 17
- 238000012800 visualization Methods 0.000 claims abstract description 4
- 238000012545 processing Methods 0.000 claims description 61
- 238000004891 communication Methods 0.000 claims description 47
- 238000012549 training Methods 0.000 claims description 37
- 238000009434 installation Methods 0.000 claims description 26
- 238000007619 statistical method Methods 0.000 claims description 10
- 238000013500 data storage Methods 0.000 claims description 9
- 230000002452 interceptive effect Effects 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 4
- 230000007547 defect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44505—Configuring for program initiating, e.g. using registry, configuration files
- G06F9/4451—User profiles; Roaming
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Abstract
The invention relates to a data synchronization method and a system based on ICE, comprising the following steps: constructing a basic configuration layer and integrating configuration files required by the service of a central node of the system; constructing a user data application layer, establishing various management service functions facing a user, and storing the functions to a data storage center of an equipment end; a data management layer is constructed, and a node network is utilized to acquire user management data from a user data application layer for centralized management and visualization; and constructing a central synchronous service layer to realize synchronous management data transmission between the user data application layer and the system central node service. Data synchronization is carried out between equipment, information is gathered and checked in a webpage system, convenience and convenience of a user are maximized, personnel management cost is saved, the original use interaction mode of the equipment is changed, functions of data sharing, equipment management, appointment scheduling and data statistics among multiple equipment are provided, and the problem that the data cannot be synchronously shared among the equipment in the prior art is overcome.
Description
Technical Field
The invention relates to the technical field of mobile information communication, in particular to a data synchronization method and system based on ICE.
Background
At present, the existing equipment side software all adopts a local database as a storage medium, and only function realization is considered in the initial implementation stage, so all user data, use data and the like are stored locally. For example, a user has A, B, C three devices. The client A registers user information on the device A yesterday, and three training are performed, wherein the training comprises information such as training records and training reports. Today, when a client A goes to a shop for training, the user finds that the device A is already occupied, the user guides the client A to go to the device B for training, and the device B does not have user information of the client A, so the user has to register the information of the client A again on the device B, the training condition of the device A yesterday needs to be checked, the training parameters are set on the device B for the client A, and meanwhile, the training on the device B needs to be started for the client A. After a period of training of the client A is finished, the training condition of the client A can be seen only by finding out training information of the client A on A, B, C three pieces of equipment and manually exporting the records and sorting the training information into one piece. Failure of one of the devices will result in incomplete viewing of the information of the client A, resulting in many repetitive operations and risks. And a lot of troubles are brought to the maintenance, management and use of the system in the future.
In addition, all existing device side software adopt a local database to realize the functional requirements, and the problems of data sharing and information fusion are not considered in the initial implementation stage, so that user information and training records generated by the use of a device A by a client cannot be shared by other devices, each device is operated independently, the client information registration of the user with multiple devices is required on the multiple devices, and the repeated operation is increased. The customer trains on a plurality of devices, and the complete training situation of the customer cannot be integrally displayed.
Disclosure of Invention
The invention aims to provide a data synchronization method and a data synchronization system based on ICE (Internet communications and Internet communications), which can be used for realizing the maximum convenience and quickness of a user by performing data synchronization among devices and information summarization and check in a webpage system, saving the cost of personnel management, changing the original use interaction mode of the devices, providing the functions of data sharing, device management, reservation scheduling and data statistics among a plurality of devices and solving the problems and defects in the prior art.
In order to achieve the purpose, the technical scheme of the invention is as follows:
an ICE-based data synchronization method, characterized in that: the method comprises the following steps:
constructing a basic configuration layer, integrating configuration files required by system center node service, establishing a propagation mechanism of a standard ICE communication protocol and carrying out information interaction with the system center node service;
a user data application layer is built, various management service functions facing a user are integrated, information of a basic configuration layer is synchronized, structured management data are independently generated and initially logged in a system center node service, and the system center node service feeds back and acquires unique identification authentication of the management data and stores the unique identification authentication to a data storage center of an equipment end;
a data management layer is constructed, and a node network is utilized to acquire user management data from a user data application layer for centralized management and visualization;
the method comprises the steps of constructing a central synchronous service layer, and constructing a management data transmission basic framework by using a service center communicator, an equipment data communicator and a Storm subscriber communicator, wherein the server communicator is used for initializing a system central node service network and acquiring a configuration file of a basic configuration layer, the equipment data communicator is used for realizing synchronous management data transmission of a user data application layer and system central node service, and the Storm subscriber communicator is used for constructing a point-to-point distribution communication mode to judge whether transmission equipment bearing the user data application layer is on line or not.
Further, the specific implementation of the basic configuration layer is as follows:
establishing a communication mode, and carrying out initialization multicast communication according to a port appointed in a configuration file of a system installation configuration tool;
constructing a service installation mode, and integrating a third-party application required to be installed in a system center node service and a program required to be installed by the center synchronous service layer;
the method comprises the steps of establishing a centralized configuration mode, acquiring an IP (Internet protocol) of a system center node service by using a network transmission node established in a communication mode, sending the IP to an equipment end, writing the IP into a configuration file of the equipment end after the equipment end receives the IP of the system center node service, connecting the system center node service through a standard ICE (Internet communications interface) communication protocol, and loading the configuration file when the equipment end is started.
Further, the specific implementation manner of the system center node service performing unique identifier authentication on the user data application layer is as follows:
after the equipment end synchronously loads the configuration file, a standard ICE communication network is initialized, the MAC address and the equipment type of the equipment end are transmitted through a registered equipment interface, initial login is carried out on a system center node service, and after the login is successful, the system center node service returns an equipment serial number with a unique identifier as a key parameter of subsequent data transmission of the equipment end.
Further, the data management layer converts management data acquired from a data storage center of the device side into corresponding display information according to the management service function to which the user belongs, wherein the display information includes user identity information, user training statistical analysis information, follow-up visit management information and newly-added user information.
Further, when the management data of the user data application layer is in an online state before being synchronized with the central synchronization service layer, a synchronization record log needs to be formed at the device end first, and a to-be-sent state needs to be maintained at the device end, and in this to-be-sent state, the management data obtained from the user data application layer is synchronously transmitted through a serialization thread and a sending thread, wherein,
the serialized thread processing comprises the following steps:
periodically processing the synchronous recording logs at millisecond time intervals for processing records in the synchronous recording logs;
extracting the processed required synchronous record, performing transmission serialization operation to satisfy the same format of the synchronous record transmission, and putting the synchronous record into a data queue to be transmitted,
the send thread processing comprises the steps of:
extracting data to be sent in the data queue to be sent, and synchronously sending the data to be sent to the system center node for service;
and receiving feedback information of the service of the system center node, and identifying the sent data in the corresponding synchronous record.
Further, when the management data of the user data application layer is in an offline state before being synchronized with the central synchronization service layer:
the device randomly starts a reconnection mechanism, enters an offline mode, carries out binary stream serialization on data in a log to be synchronously recorded and writes the data into an offline file;
after the device end is successfully reconnected, reading data in the log to be synchronously recorded, deserializing the byte stream into a structural body to be sent, putting the structural body into a data queue to be sent, and waiting for the extraction processing of the sending thread;
the server of the equipment end receives and writes the data into the data storage center, and marks the data to be sent in the synchronous initial equipment and feeds back the data to the system center node;
the system center node service receives the data to be sent of the identification and transmits the data to other online equipment or offline and registered equipment, and the data to be sent is continuously and synchronously transmitted after the equipment end is online next time;
after receiving the data to be sent, the on-line equipment end replies to the central node service of the system and identifies the processing state of the central node service.
Further, when the system center node service performs unique identification authentication on the user data application layer:
when the access equipment is of the same type, all data to be transmitted are transmitted to the equipment of the same type;
when the access devices are of different types, the system center node services to synchronize and analyze the data of the different types of devices, sends the acceptable data to be transmitted to the different types of devices, and directly filters the unacceptable data to be transmitted.
Further, in the peer-to-peer communication mode, when the system center node service synchronously distributes data to the user data application layer, the synchronous management data is not sent to the non-online device which bears the user data application layer at the moment.
As a second aspect of the present invention, an ICE-based data synchronization system includes:
the system comprises an installation configuration system, a central node service management system and a central node service management system, wherein the installation configuration system is used for installing the central node service of the whole system and assisting the central node service of the system to remotely and centrally configure the system, and comprises a communication module, a service installation module and a centralized configuration module, wherein the communication module is used for carrying out initialization multicast communication on a port appointed in a configuration file of the installation configuration system; the service installation module is used for integrating third-party applications required to be installed in the system center node service; the centralized configuration module acquires an IP address of a system center node service by using a network transmission node established by the communication module and sends the IP to the equipment end, and loading a configuration file when the equipment end is started is completed;
the equipment application system integrates various management service functions facing the user, synchronizes the information of the installation configuration system and stores the information to a data storage center of the equipment end, wherein the equipment application system comprises a training module, a data synchronization module and a data storage module, the training module establishes a data interaction interface of the equipment end and selects different training schemes for training the data interaction interface aiming at the user; the data synchronization module transmits the data interaction information of the equipment end to a system central node service through the communication module and further transmits the data interaction information to other equipment ends through the system central node service; the data storage module stores data interacted at the equipment end so as to be used for sending the data to be shared to other equipment ends through the data synchronization module;
the data management system is used for carrying out centralized management on interactive data information in the data storage module and visualizing a user, and comprises a client management module, a follow-up visit management module, a shift arrangement management module and a statistical analysis module which are connected with a system setting module, wherein the client management module is used for maintaining basic information, training records, follow-up visit records, questionnaire management and information printing of a client; the follow-up visit management module is used for reminding the user before the follow-up visit date; the scheduling management module is used for executing the reservation scheduling management of the user; the statistical analysis module is used for analyzing and counting the training condition of the user;
and the central synchronization service system is connected with the data management system and is used for realizing data synchronization among a plurality of devices and distributing, storing and analyzing synchronous data information on each device.
Furthermore, the central synchronization service system includes a serialization thread processing module, a sending thread processing module, an equipment online processing module and an equipment offline processing module, wherein the serialization thread processing module is connected to the sending thread processing module and is used for performing synchronous transmission processing on the interactive data in the equipment application system, the equipment online processing module is respectively connected to the serialization thread processing module and the sending thread processing module and is used for performing synchronous transmission processing on the equipment in an online state, and the equipment offline processing module is connected to the sending thread processing module and is used for performing synchronous transmission processing on the equipment in an offline state.
Compared with the prior art, the invention has the beneficial effects that:
data synchronization is carried out between equipment, information is gathered and checked in a webpage system, convenience and convenience of a user are maximized, personnel management cost is saved, the original use interaction mode of the equipment is changed, functions of sharing data among multiple equipment, managing the equipment, reserving scheduling and data statistics are provided, and the problem defect in the prior art is solved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below, and it is apparent that the drawings in the following description are only some embodiments of the present invention. Wherein:
FIG. 1 is a flow diagram of the overall system architecture in one embodiment of the invention;
FIG. 2 is a flow diagram illustrating a system center node service performing unique identity authentication in one embodiment of the present invention;
FIG. 3 is a flow diagram illustrating the processing of a serialized thread and a send thread in one embodiment of the invention;
fig. 4 is a schematic flow chart of data transmission implemented by the device side and center synchronization service in an embodiment of the present invention;
FIG. 5 is a system architecture diagram of a data management system according to an embodiment of the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, shall fall within the scope of protection of the present invention.
Fig. 1 shows a flow of an overall system architecture of an ICE-based data synchronization method according to an embodiment of the present invention, including the following steps:
the method comprises the following steps of constructing a basic configuration layer, installing a basic configuration module in a system center node service, integrating basic configuration file information required by the system center node service, establishing a propagation mechanism of a standard ICE (Internet Communications Engine) communication protocol and carrying out information interaction with the system center node service, wherein the specific processing mode is as follows: the method comprises the steps that equipment end software monitors a designated port through SOCKET multicast, an installation configuration tool is operated on a system center node service, the installation configuration tool acquires an IP address of the system center node service and distributes the IP address to all the equipment end software through multicast, and the equipment end software receives IP information of the system center node service and writes a configuration file with a local data synchronization function;
the method comprises the following steps of constructing a user data application layer, collecting various application service information of a user by an equipment terminal, receiving communication information to synchronize basic configuration file information in a system center node service, initially logging in the system center node service, feeding back unique identification authentication of the application service information by the system center node service, and storing the unique identification authentication in a data storage center of the equipment terminal, wherein the specific implementation mode is as follows: after the equipment end software is configured by the installation configuration tool, loading a data synchronization configuration file, initializing an ICE (Internet communications and Internet communications) network, transmitting a local MAC (media access control) address and an equipment type to a system center node through a registered equipment interface, and after the equipment is successfully registered, returning an equipment serial number with a unique identifier to the system center node as a key parameter of subsequent data transmission;
a data management layer is established, and a device side acquires user application information from a data storage center by using a node network for centralized management and visualization;
constructing a central synchronous service layer, constructing a basic management data transmission framework by using a service center communicator, an equipment data communicator and a Storm subscriber communicator, wherein, the server communicator is used for initializing the system central node service network and acquiring the configuration file of the basic configuration layer, the device data communicator is used for realizing the synchronous management data transmission of the user data application layer and the system central node service, the Storm subscriber communicator constructs a point-to-point distribution communication mode for judging whether the transmission device bearing the user data application layer is on-line or not, in the point-to-point communication mode, when the system center node service synchronously distributes data to the user data application layer, for the non-online device carrying the user data application layer at the moment and not sending the synchronous management data, and synchronizing the data to be issued when the user data application layer is loaded and the online equipment is online next time.
As an embodiment of the present invention, the specific implementation manner of the basic configuration layer is:
establishing a communication mode, and carrying out initialization multicast communication according to a port appointed in a configuration file of a system installation configuration tool;
constructing a service installation mode, and integrating a third-party application required to be installed in a system center node service and a program required to be installed in a center synchronous service layer;
the method comprises the steps of establishing a centralized configuration mode, acquiring an IP (Internet protocol) of a system center node service by using a network transmission node established in a communication mode, sending the IP to an equipment end, writing the IP into a configuration file of the equipment end after the equipment end receives the IP of the system center node service, connecting the system center node service through a standard ICE (Internet communications protocol) and loading the configuration file when the equipment end is started.
As an embodiment of the present invention, a data management layer converts management data acquired from a data storage center of an equipment end into corresponding display information according to a management service function to which a user belongs, where the display information includes user identity information, user training statistical analysis information, follow-up management information, and new user information, where the client information may be displayed in a list form on the data management layer, and a user may be newly created in the data management layer, and the newly created user may be sent to other equipment ends through a central synchronization service layer, and a client training record, a history record of training performed by the user at the equipment end may be displayed through the data management layer, and a statistical analysis may be performed on the training history record and the usage record of the equipment in a month or a period of time.
As an embodiment of the present invention, as shown in fig. 3, when the management data of the user data application layer is in an online state before being synchronized with the central synchronization service layer, it is required to form a synchronization record log at the device end first, and maintain a to-be-sent state at the device end, and in this to-be-sent state, perform synchronous transmission processing on the management data obtained from the user data application layer through the serialization thread and the sending thread, wherein,
the serialized thread processing comprises the following steps: periodically processing the synchronous recording logs at millisecond time intervals for processing records in the synchronous recording logs; extracting the processed required synchronous record, performing transmission serialization operation to meet the same format of the synchronous record transmission, and putting the synchronous record into a data queue to be sent;
the sending thread processing comprises the following steps: extracting data to be sent in a data queue to be sent, and synchronously sending the data to be sent to a system center node for service; receiving feedback information of a system center node service, identifying the sending data in the corresponding synchronous record, writing the synchronous record of the equipment as the sending record into a Redis cache after the system center node service receives the data to be sent, waiting for a sending thread to take out the data from the Redis cache for sending, and sending the data from the system center node service to the equipment end by adopting AMI (asynchronous access encapsulation engine) asynchronous sending of ICE (Internet access control).
As an embodiment of the present invention, as shown in fig. 4, when the management data of the user data application layer is in an offline state before being synchronized with the central synchronization service layer:
the device randomly starts a reconnection mechanism, enters an offline mode, carries out binary stream serialization on data in a log to be synchronously recorded and writes the data into an offline file;
after the device end is successfully reconnected, reading data in the log to be synchronously recorded, deserializing the byte stream into a structural body to be sent, putting the structural body into a data queue to be sent, and waiting for the extraction processing of a sending thread;
a server at the equipment end receives and writes the data into a data storage center, and identifies the data to be sent in synchronous initial equipment and feeds back the data to a system center node;
the system center node service receives the data to be sent of the identification and transmits the data to other online equipment or offline and registered equipment, and the data to be sent is continuously and synchronously transmitted after the equipment end is online next time;
after receiving the data to be sent, the on-line equipment end replies to the central node service of the system and identifies the processing state of the central node service.
As an embodiment of the present invention, as shown in fig. 2, when the system center node service performs unique identification authentication on the user data application layer:
when the access equipment is of the same type, all data to be transmitted are transmitted to the equipment of the same type;
when the access devices are of different types, the system center node services to synchronize and analyze data of the different types of devices, sends the acceptable data to be transmitted to the different types of devices, and directly filters the unacceptable data to be transmitted.
The invention also provides an ICE-based data synchronization system applied to the method, which comprises the following steps:
the system comprises an installation configuration system, a central node service management system and a central node service management system, wherein the installation configuration system is used for installing the central node service of the whole system and assisting the central node service of the system to remotely and centrally configure the system, and comprises a communication module, a service installation module and a centralized configuration module, wherein the communication module is used for carrying out initialization multicast communication on a port appointed in a configuration file of the installation configuration system; the service installation module is used for integrating third-party applications required to be installed in the system center node service; the centralized configuration module acquires an IP address of a system center node service by using a network transmission node established by the communication module and sends the IP to the equipment end, and loading a configuration file when the equipment end is started is completed;
the equipment application system integrates various management service functions facing the user, synchronously installs and configures system information, and stores the system information to a data storage center of the equipment end, wherein the equipment application system comprises a training module, a data synchronization module and a data storage module, the training module establishes a data interaction interface of the equipment end and trains the equipment end by selecting different training schemes aiming at the user; the data synchronization module transmits the data interaction information of the equipment end to a system central node service through the communication module and further transmits the data interaction information to other equipment ends through the system central node service; the data storage module stores data interacted at the equipment end so as to send the data to be shared to other equipment ends through the data synchronization module;
as shown in fig. 5, the data management system is configured to perform centralized management on the interactive data information in the data storage module and visualize the user, and the data management system includes a client management module, a follow-up management module, a shift arrangement management module, and a statistical analysis module, which are connected to the system setting module, where the client management module is configured to maintain basic information, train records, follow-up records, questionnaire management, and print information of the client; the follow-up visit management module is used for reminding the user before the follow-up visit date; the scheduling management module is used for executing the reservation scheduling management of the user; the statistical analysis module is used for analyzing and counting the training condition of the user;
the central synchronous service system is connected with the data management system and is used for realizing data synchronization among a plurality of devices and distributing, storing and analyzing synchronous data information on each device, wherein, the central synchronous service system comprises a serialization thread processing module, a sending thread processing module, an equipment on-line processing module and an equipment off-line processing module, wherein the serialization thread processing module is connected with the sending thread processing module and is used for synchronously transmitting and processing the interactive data in the equipment application system, the equipment on-line processing module is respectively connected with the serialization thread processing module and the sending thread processing module, the device offline processing module is connected with the sending thread processing module and is used for synchronously transmitting the devices in the offline state.
While the invention has been described with reference to specific embodiments, the invention is not limited thereto, and various equivalent modifications and substitutions can be easily made by those skilled in the art within the technical scope of the invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. An ICE-based data synchronization method, comprising the steps of:
constructing a basic configuration layer, integrating configuration files required by system center node service, establishing a propagation mechanism of a standard ICE communication protocol and carrying out information interaction with the system center node service;
establishing a user data application layer, establishing various management service functions facing a user, synchronizing information of a basic configuration layer, independently generating structured management data and performing initial login to a system center node service, feeding back a unique identification certificate of the management data by the system center node service, and storing the unique identification certificate to a data storage center of an equipment end;
a data management layer is constructed, and a node network is utilized to acquire user data from a user data application layer for centralized management and visualization;
the method comprises the steps of constructing a central synchronous service layer, and constructing a management data transmission basic framework by using a service center communicator, an equipment data communicator and a Storm subscriber communicator, wherein the server communicator is used for initializing a system central node service network and acquiring a configuration file of a basic configuration layer, the equipment data communicator is used for realizing synchronous management data transmission of a user data application layer and system central node service, and the Storm subscriber communicator is used for constructing a point-to-point distribution communication mode to judge whether transmission equipment bearing the user data application layer is on line or not.
2. The ICE-based data synchronization method as claimed in claim 1, wherein the basic configuration layer is implemented by:
establishing a communication mode, and carrying out initialization multicast communication according to a port appointed in a configuration file of a system installation configuration tool;
constructing a service installation mode, and integrating a third-party application required to be installed in a system center node service and a program required to be installed by the center synchronous service layer;
the method comprises the steps of establishing a centralized configuration mode, acquiring an IP (Internet protocol) of a system center node service by using a network transmission node established in a communication mode, sending the IP to an equipment end, writing the IP into a configuration file of the equipment end after the equipment end receives the IP of the system center node service, connecting the system center node service through a standard ICE (Internet communications interface) communication protocol, and loading the configuration file when the equipment end is started.
3. The ICE-based data synchronization method of claim 1, wherein the specific implementation manner of the system center node service performing unique identification authentication on the user data application layer is as follows:
after the equipment end synchronously loads the configuration file, a standard ICE communication network is initialized, the MAC address and the equipment type of the equipment end are transmitted through a registered equipment interface, initial login is carried out on a system center node service, and after the login is successful, the system center node service returns an equipment serial number with a unique identifier as a key parameter of subsequent data transmission of the equipment end.
4. The ICE-based data synchronization method as claimed in claim 1, wherein the data management layer converts the management data obtained from the data storage center of the device side into corresponding display information according to the management service function to which the user belongs, and the display information includes user identity information, user training statistical analysis information, follow-up management information, and new user information.
5. The ICE-based data synchronization method as claimed in claim 1, wherein when the management data of the user data application layer is in an online state before being synchronized with the central synchronization service layer, a synchronization log is formed at a device end, and a to-be-sent state is maintained at the device end, in which to-be-sent state, the management data obtained from the user data application layer is synchronously transmitted through a serialization thread and a sending thread, wherein,
the serialized thread processing comprises the following steps:
periodically processing the synchronous recording logs at millisecond time intervals for processing records in the synchronous recording logs;
extracting the processed required synchronous record, performing transmission serialization operation to satisfy the same format of the synchronous record transmission, and putting the synchronous record into a data queue to be transmitted,
the send thread processing comprises the steps of:
extracting data to be sent in the data queue to be sent, and synchronously sending the data to be sent to the system center node for service;
and receiving feedback information of the service of the system center node, and identifying the sent data in the corresponding synchronous record.
6. An ICE-based data synchronization method according to claim 1 or 5, characterized in that when the management data of the user data application layer is in an offline state before being synchronized with the central synchronization service layer:
the device randomly starts a reconnection mechanism, enters an offline mode, carries out binary stream serialization on data in a log to be synchronously recorded and writes the data into an offline file;
after the device end is successfully reconnected, reading data in the log to be synchronously recorded, deserializing the byte stream into a structural body to be sent, putting the structural body into a data queue to be sent, and waiting for the extraction processing of the sending thread;
the server of the equipment end receives and writes the data into the data storage center, and marks the data to be sent in the synchronous initial equipment and feeds back the data to the system center node;
the system center node service receives the data to be sent of the identification and transmits the data to other online equipment or offline and registered equipment, and the data to be sent is continuously and synchronously transmitted after the equipment end is online next time;
after receiving the data to be sent, the on-line equipment end replies to the central node service of the system and identifies the processing state of the central node service.
7. The ICE-based data synchronization method of claim 3, wherein when the system hub node service performs unique identification authentication with the user data application layer:
when the access equipment is of the same type, all data to be transmitted are transmitted to the equipment of the same type;
when the access devices are of different types, the system center node services to synchronize and analyze the data of the different types of devices, sends the acceptable data to be transmitted to the different types of devices, and directly filters the unacceptable data to be transmitted.
8. The ICE-based data synchronization method as claimed in claim 1, wherein, in the peer-to-peer communication mode, when the system center node services synchronously distributes data to the user data application layer, the synchronous data is not sent to the offline device which carries the user data application layer at that time.
9. A data synchronization system according to the ICE-based data synchronization method of any of claims 1 to 8, comprising:
the system comprises an installation configuration system, a central node service management system and a central node service management system, wherein the installation configuration system is used for installing the central node service of the whole system and assisting the central node service of the system to remotely and centrally configure the system, and comprises a communication module, a service installation module and a centralized configuration module, wherein the communication module is used for carrying out initialization multicast communication on a port appointed in a configuration file of the installation configuration system; the service installation module is used for integrating third-party applications required to be installed in the system center node service; the centralized configuration module acquires an IP address of a system center node service by using a network transmission node established by the communication module and sends the IP to the equipment end, and loading a configuration file when the equipment end is started is completed;
the equipment application system integrates various management service functions facing the user, synchronizes the information of the installation configuration system and stores the information to a data storage center of the equipment end, wherein the equipment application system comprises a training module, a data synchronization module and a data storage module, the training module establishes a data interaction interface of the equipment end and selects different training schemes for training the data interaction interface aiming at the user; the data synchronization module transmits the data interaction information of the equipment end to a system central node service through the communication module and further transmits the data interaction information to other equipment ends through the system central node service; the data storage module stores data interacted at the equipment end so as to be used for sending the data to be shared to other equipment ends through the data synchronization module;
the data management system is used for carrying out centralized management on interactive data information in the data storage module and visualizing a user, and comprises a client management module, a follow-up visit management module, a shift arrangement management module and a statistical analysis module which are connected with a system setting module, wherein the client management module is used for maintaining basic information, training records, follow-up visit records, questionnaire management and information printing of a client; the follow-up visit management module is used for reminding the user before the follow-up visit date; the scheduling management module is used for executing the reservation scheduling management of the user; the statistical analysis module is used for analyzing and counting the training condition of the user;
and the central synchronization service system is connected with the data management system and is used for realizing data synchronization among a plurality of devices and distributing, storing and analyzing synchronous data information on each device.
10. The ICE-based data synchronization system according to claim 9, wherein the central synchronization service system includes a serialization thread processing module, a sending thread processing module, an equipment online processing module, and an equipment offline processing module, wherein the serialization thread processing module is connected to the sending thread processing module for performing synchronous transmission processing on the interactive data in the equipment application system, the equipment online processing module is respectively connected to the serialization thread processing module and the sending thread processing module for performing synchronous transmission processing on the equipment in an online state, and the equipment offline processing module is connected to the sending thread processing module for performing synchronous transmission processing on the equipment in an offline state.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110471583.6A CN113220361A (en) | 2021-04-29 | 2021-04-29 | Data synchronization method and system based on ICE |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110471583.6A CN113220361A (en) | 2021-04-29 | 2021-04-29 | Data synchronization method and system based on ICE |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113220361A true CN113220361A (en) | 2021-08-06 |
Family
ID=77089906
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110471583.6A Pending CN113220361A (en) | 2021-04-29 | 2021-04-29 | Data synchronization method and system based on ICE |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113220361A (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106713363A (en) * | 2017-02-27 | 2017-05-24 | 北京亚太东方通信网络有限公司 | Method for constructing interactive network service based on global transmission sharing |
| CN111541786A (en) * | 2020-07-08 | 2020-08-14 | 中科全维科技(苏州)有限公司 | P2P network-oriented geospatial situation system and construction method |
-
2021
- 2021-04-29 CN CN202110471583.6A patent/CN113220361A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106713363A (en) * | 2017-02-27 | 2017-05-24 | 北京亚太东方通信网络有限公司 | Method for constructing interactive network service based on global transmission sharing |
| CN111541786A (en) * | 2020-07-08 | 2020-08-14 | 中科全维科技(苏州)有限公司 | P2P network-oriented geospatial situation system and construction method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109118347B (en) | Automatic cooperation method and system | |
| CN105915633B (en) | Automatic operation and maintenance system and method | |
| CN108509392B (en) | Multi-mechanism account checking method, system, computer equipment and storage medium | |
| CN102377817A (en) | Connection management system, and a method for linking connection management server in thin client system | |
| US20150169288A1 (en) | System operation tracing method on distributed system | |
| CN102298647A (en) | Inspection and allocation system and method of data file | |
| CN110290185B (en) | Internet of things equipment integration system based on Agent and application method thereof | |
| CN106375458A (en) | Service call system, method and device | |
| CN109766201A (en) | Task distribution method, server, client and system | |
| CN110096545A (en) | One kind being based on big data platform data processing domain architecting method | |
| CN116319732A (en) | Message queue centralized configuration management system and method based on RabbitMQ | |
| CN106993015A (en) | Synchronous method, system and the security server of transaction | |
| CN109783330B (en) | Log processing method, log display method, and related device and system | |
| CN107147663A (en) | The synchronous communication method and system of a kind of computer cluster | |
| CN111984216B (en) | Graphic auditing method and system for character operation and maintenance | |
| CN113452732B (en) | Electric power internet of things network management system and method | |
| CN113220361A (en) | Data synchronization method and system based on ICE | |
| CN111953525A (en) | Special equipment operation and maintenance monitoring system | |
| EP2690560A2 (en) | Method of benchmarking the behaviour of a replacement information system with the old system | |
| CN102571953B (en) | Remote management method and device thereof | |
| CN107145427A (en) | A kind of method and system of automatic classification monitoring application service daily record | |
| CN109118151B (en) | Work order transaction processing method and work order transaction processing system | |
| CN115589419A (en) | Monitoring data analysis system | |
| CN113194119B (en) | Configuration file acquisition method and device | |
| CN102130944B (en) | Method for monitoring and managing ATM and self-service system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |