CN107645531B - Data synchronization method and system - Google Patents
Data synchronization method and system Download PDFInfo
- Publication number
- CN107645531B CN107645531B CN201610589142.5A CN201610589142A CN107645531B CN 107645531 B CN107645531 B CN 107645531B CN 201610589142 A CN201610589142 A CN 201610589142A CN 107645531 B CN107645531 B CN 107645531B
- Authority
- CN
- China
- Prior art keywords
- image file
- sent
- retransmission
- recording system
- fails
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Information Transfer Between Computers (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data synchronization method, which comprises the following steps: A. the service platform system sends an image file of a list to be recorded to a corresponding list recording system; B. after the image file is sent to the recording system, whether the image file fails to be sent is analyzed according to a preset analysis rule; C. if so, establishing a retransmission queue for the image file files which are failed to be transmitted, retransmitting each image file which is failed to be transmitted to the document recording system according to the retransmission queue, counting the retransmission times, and judging whether the image file which is retransmitted fails to be transmitted exists; D. if yes, the steps B and C are repeatedly executed until the image file which is sent again is successfully sent or the number of times of sending again reaches the preset threshold value. The invention also discloses a data synchronization system. The invention can ensure the successful transmission of the image file in the data synchronization process to the maximum extent and effectively improve the efficiency of data synchronization.
Description
Technical Field
The present invention relates to the field of data synchronization technologies, and in particular, to a data synchronization method and system.
Background
When a service platform system interacts with an external system, a large amount of data sometimes needs to be synchronized, and in the process of synchronizing the data, a normal flow may have little problem, but is easy to be ignored or improperly processed for abnormal situations, such as: the existing mass data synchronization mechanism lacks an effective processing means in the face of data loss, synchronization failure, retransmission re-failure and the like in data synchronization. Meanwhile, for the synchronization of big data, the existing large-amount data synchronization mechanism adopts a single-thread processing mode, so that the synchronization efficiency is low, the consumed time is long, and the timeliness is poor.
Disclosure of Invention
The present invention mainly aims to provide a data synchronization method and system, which aims to perform effective failure retransmission processing in data synchronization and improve data synchronization efficiency.
In order to achieve the above object, the present invention provides a data synchronization method, including the following steps:
A. the service platform system sends an image file of a list to be recorded to a corresponding list recording system in real time or at regular time;
B. after the service platform system sends the image file to the corresponding recording system, whether the image file fails to be sent is analyzed according to a preset analysis rule;
C. if the image file is failed to be sent, the service platform system establishes a retransmission queue for the image file which is failed to be sent, resends each image file which is failed to be sent to a corresponding document recording system according to the retransmission queue at regular time, counts the resending times corresponding to the image file which is resent, and analyzes whether the resended image file fails to be sent according to a preset analysis rule;
D. and if the sending of the image file which is sent again fails and the number of times of sending again corresponding to the image file which is sent again is smaller than the preset threshold value, the steps B and C are repeatedly executed until the sending of the image file which is sent again is successful or the number of times of sending again reaches the preset threshold value.
Preferably, the method further comprises:
if the sending of the image file which is sent again fails and the number of times of sending again corresponding to the image file which is sent again is not smaller than a preset threshold value, the service platform system sends reminding information to a predetermined terminal to remind that the image file which is sent again cannot be sent to a corresponding list recording system.
Preferably, the preset analysis rule includes:
after an image file is sent to the corresponding recording system, if a receiving failure message sent by the corresponding recording system is received within a first preset time, it is determined that the image file fails to be sent.
Preferably, the preset analysis rule further includes:
after an image file is sent to the corresponding recording system, if a receiving feedback message sent by the corresponding recording system is not received within a second preset time, it is determined that the sending of the image file fails.
Preferably, the method further comprises:
after an image file is successfully sent, if the entry information corresponding to the image file and returned by the corresponding entry system is not received within a third preset time, the service platform system sends entry reminding information to a predetermined terminal and/or the corresponding entry system so as to remind that the entry operation of the image file is completed as soon as possible.
In addition, to achieve the above object, the present invention further provides a data synchronization system, including:
the sending module is used for sending the image file of the list to be recorded to the corresponding list recording system in real time or at regular time;
the analysis module is used for analyzing whether the image file fails to be sent or not according to a preset analysis rule after the image file is sent to the corresponding recording system;
the failure retransmission module is used for establishing a retransmission queue for the image file with failed transmission if the image file fails to be transmitted, retransmitting each image file with failed transmission to a corresponding recording system according to the retransmission queue at regular time, counting the retransmission times corresponding to the image file after retransmission, and analyzing whether the image file with retransmitted transmission fails or not according to a preset analysis rule;
and the return calling module is used for returning and calling the analysis module and the failure retransmission module if the retransmitted image file fails to be transmitted and the retransmission times corresponding to the retransmitted image file are less than a preset threshold value until the retransmitted image file is successfully transmitted or the retransmission times reach the preset threshold value.
Preferably, the data synchronization system further comprises:
and the first reminding module is used for sending reminding information to a predetermined terminal to remind that the retransmitted image file cannot be sent to the corresponding recording system if the retransmitted image file fails to be sent and the retransmission times corresponding to the retransmitted image file is not less than a preset threshold value.
Preferably, the preset analysis rule includes:
after an image file is sent to the corresponding recording system, if a receiving failure message sent by the corresponding recording system is received within a first preset time, it is determined that the image file fails to be sent.
Preferably, the preset analysis rule further includes:
after an image file is sent to the corresponding recording system, if a receiving feedback message sent by the corresponding recording system is not received within a second preset time, it is determined that the sending of the image file fails.
Preferably, the data synchronization system further comprises:
and the second reminding module is used for sending the order recording reminding information to a predetermined terminal and/or the corresponding order recording system to remind that the order recording operation of the image file is completed as soon as possible if the entry information corresponding to the image file returned by the corresponding order recording system is not received within the third preset time after the image file is successfully sent.
The invention provides a data synchronization method and a data synchronization system, which are used for synchronizing data according to preset analysis rulesAnalysis ofAnd when the service platform system fails to send the image file sent by the corresponding recording system, the service platform system regularly resends each image file which fails to send to the corresponding recording system according to the established retransmission queue and counts the retransmission times, and if the image file which is resent fails to send and the retransmission times is less than a preset threshold value, the service platform system resends the failure. When the synchronization of the image file between the service platform system and the corresponding recording list system fails, the service platform system can perform failure retransmission processing on the image file, and when the resynchronization of the image file fails and the number of times of the failure retransmission is smaller than a preset threshold value, the service platform system can repeat the failure retransmission processing on the image file, so that the successful transmission of the image file in the data synchronization process is ensured to the maximum extent. In addition, when the failed retransmission processing is carried out on the video file, a retransmission queue mode is adopted for a plurality of video filesAnd the image file which fails to be sent is sent asynchronously and multithreadedly, so that the efficiency of data synchronization is effectively improved.
Drawings
FIG. 1 is a flowchart illustrating a first embodiment of a data synchronization method according to the present invention;
FIG. 2 is a flowchart illustrating a data synchronization method according to a second embodiment of the present invention;
FIG. 3 is a flowchart illustrating a data synchronization method according to a third embodiment of the present invention;
FIG. 4 is a functional block diagram of a data synchronization system according to a first embodiment of the present invention;
FIG. 5 is a functional block diagram of a data synchronization system according to a second embodiment of the present invention;
fig. 6 is a functional block diagram of a data synchronization system according to a third embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The invention provides a data synchronization method.
Referring to fig. 1, fig. 1 is a flowchart illustrating a data synchronization method according to a first embodiment of the present invention.
In a first embodiment, the data synchronization method includes:
step S10, the service platform system sends the image file of the list to be recorded to the corresponding list recording system in real time or at regular time;
in this embodiment, the service platform system may be a car insurance service platform system, a bank card service platform system, or the like, and certainly, the service platform system is not limited to be another system that needs to perform data interaction and synchronization with an external system, and in this embodiment, the specific description is given by taking as an example that the service platform system performs interaction and synchronization of the image file with an external recording system. When the service platform system interacts with an external recording system to perform image file interaction, the service platform system firstly sends an image file of a to-be-recorded list to the corresponding recording system in real time or at regular time so that the corresponding recording system can complete recording operation of the image file after successfully receiving the image file.
Step S20, after the service platform system sends the image file to the corresponding recording system, analyzing whether the image file fails to be sent according to a preset analysis rule;
after the service platform system sends the image file to the corresponding list recording system, whether the image file is failed to be sent or not can be analyzed according to a preset analysis rule, if the image file is successfully received or failed information fed back to the service platform system by the corresponding list recording system is used for judging whether the image file is failed to be sent or not, and data interaction detection information such as a detection tool, a detection zone bit and the like can be inserted when the service platform system sends the image file to the corresponding list recording system so as to monitor the sending condition of the image file.
Step S30, if the image file fails to be sent, the service platform system establishes a retransmission queue for the image file failed to be sent, resends each image file failed to be sent to the corresponding list recording system according to the retransmission queue at regular time, counts the resending times corresponding to the resent image file, and analyzes whether the resended image file fails to be sent according to a preset analysis rule;
if the image file transmission fails according to the preset analysis rule, the service platform system conducts failure retransmission processing on the image file with the transmission failure. When the service platform system performs failure retransmission processing on a plurality of image file files, an asynchronous multithreading data processing mode can be adopted to perform failure retransmission on the plurality of image file files. In one embodiment, the service platform system establishes a retransmission queue for the image file which fails to be transmitted, sequentially retransmits each image file which fails to be transmitted to the corresponding document recording system in real time or at regular time according to the retransmission queue, and analyzes whether the image file which is retransmitted fails to be transmitted according to a preset analysis rule; meanwhile, the retransmission times corresponding to the retransmitted image file files are respectively counted, so that whether the retransmitted image file files need to be retransmitted again or not is subsequently evaluated.
Step S40, if there is a failure in sending the resent video file, and the number of resending times corresponding to the resent video file is less than the preset threshold, the steps S20 and S30 are repeated until the resend video file is successfully sent or the number of resending times reaches the preset threshold.
If the image file retransmitted according to the retransmission queue still fails to be transmitted according to the preset analysis rule, and the counted retransmission times corresponding to the retransmitted image file are smaller than the preset threshold (for example, 3 times), it indicates that although the retransmitted image file fails to be retransmitted, the retransmission times are not too many, and there is a possibility of being affected by an emergency such as a poor network environment of the current node, that is, the retransmitted image file still may be successfully transmitted in the next retransmission failure. Therefore, the processing of retransmitting and analyzing the retransmitted video file and performing the failed retransmission on the retransmitted video file according to the retransmission queue is returned and repeated. In the process of repeatedly retransmitting the retransmitted image file, in one case, if the retransmitted image file is successfully transmitted, the retransmission can be immediately finished, and the transmission of the image file is completed; in another case, if the image file is retransmitted in failure for multiple times, and the retransmission times reach the preset threshold value, the retransmission is still failed, which indicates that the image file cannot be transmitted through the multiple times of retransmission in failure, and the retransmission is finished.
In this embodiment, when the service platform system analyzes that the transmission of the image file sent to the corresponding recording system by the service platform system fails according to the preset analysis rule, the service platform system periodically resends each image file with the transmission failure to the corresponding recording system according to the established retransmission queue and counts the retransmission times, and if the retransmission of the image file with the retransmission fails and the retransmission times is less than the preset threshold, the retransmission of the failure is performed again. When the synchronization of the image file between the service platform system and the corresponding recording list system fails, the service platform system can perform failure retransmission processing on the image file, and when the resynchronization of the image file fails and the number of times of the failure retransmission is smaller than a preset threshold value, the service platform system can repeat the failure retransmission processing on the image file, so that the successful transmission of the image file in the data synchronization process is ensured to the maximum extent. In addition, asynchronous multi-thread transmission is carried out on a plurality of image file files which fail to be transmitted by adopting a retransmission queue mode when the image file files are subjected to failure retransmission processing, so that the efficiency of data synchronization is effectively improved.
Further, in other embodiments, the preset analysis rule includes:
after an image file is sent to the corresponding recording system, if a receiving failure message sent by the corresponding recording system is received within a first preset time, it is determined that the image file fails to be sent.
In this embodiment, after the service platform system sends an image file to the corresponding document recording system, when analyzing whether the sending of the image file fails, if a receiving failure message sent by the corresponding document recording system is received within a first preset time (for example, within 2 seconds), the service platform system may directly analyze and determine that the sending of the image file fails.
Further, in other embodiments, the preset analysis rule further includes:
after an image file is sent to the corresponding recording system, if a receiving feedback message sent by the corresponding recording system is not received within a second preset time, it is determined that the sending of the image file fails.
In this embodiment, after the service platform system sends an image file to the corresponding document recording system, when analyzing whether the sending of the image file fails, if a receiving feedback message sent by the corresponding document recording system is not received within a first preset time (for example, within 2 seconds), it indicates that the image file may have data loss, data damage, and the like during the sending process, and then the service platform system may analyze and determine that the sending of the image file fails.
Further, as shown in fig. 2, a second embodiment of the present invention proposes a data synchronization method, and on the basis of the above embodiment, the data synchronization method further includes:
step S50, if there is a failure in sending the resent image file, and the number of resending times corresponding to the resent image file is not less than a preset threshold, the service platform system sends a reminding message to a predetermined terminal to remind that the resent image file cannot be sent to the corresponding entry system.
In this embodiment, if it is analyzed according to a preset analysis rule that the image file retransmitted according to the retransmission queue still fails to be transmitted, and the counted retransmission times corresponding to the retransmitted image file are greater than or equal to a preset threshold (for example, 3 times), it indicates that the retransmission of the retransmitted image file is failed for multiple times, and finally the retransmission still fails, and there is probably an abnormal situation that the image file cannot be recovered in a short time, such as disconnection of a data communication link. The service platform system sends a reminding message to a predetermined terminal, and the reminding message can inform a predetermined terminal user that the image file can not be sent to the corresponding list recording system after repeated failed retransmission so as to remind the predetermined terminal user to check a data communication link and the like between the service platform system and the corresponding list recording system in time and process faults.
Further, as shown in fig. 3, a third embodiment of the present invention proposes a data synchronization method, and on the basis of the above embodiment, the data synchronization method further includes:
step S60, after an image file is successfully sent, if the entry information corresponding to the image file and returned by the corresponding entry system is not received within a third preset time, the service platform system sends an entry reminding message to a predetermined terminal and/or the corresponding entry system to remind that the entry job of the image file is completed as soon as possible.
In this embodiment, after an image file is successfully sent, if the entry information corresponding to the image file and returned by the corresponding entry system is not received within a second preset time (for example, within 48 hours), the service platform system sends an entry reminding message to a predetermined terminal and/or the corresponding entry system to remind a user to complete an entry job for the image file as soon as possible, so as to avoid occurrence of a situation that the image file is successfully sent but an entry is not entered into the corresponding entry system due to omission.
The invention further provides a data synchronization system.
Referring to fig. 4, fig. 4 is a functional block diagram of a data synchronization system according to a first embodiment of the present invention.
In a first embodiment, the data synchronization system includes:
the sending module 01 is used for sending the image file of the list to be recorded to the corresponding list recording system in real time or at regular time;
in this embodiment, the data synchronization system, i.e., the service platform system, may be a car insurance service platform system, a bank card service platform system, etc., and certainly, the service platform system is not limited to be another system that needs to perform data interaction and synchronization with an external system, and in this embodiment, the specific description is given by taking as an example that the service platform system performs interaction and synchronization of the image file with an external recording system. When the service platform system interacts with an external recording system to perform image file interaction, the service platform system firstly sends an image file of a to-be-recorded list to the corresponding recording system in real time or at regular time so that the corresponding recording system can complete recording operation of the image file after successfully receiving the image file.
The analysis module 02 is used for analyzing whether the image file fails to be sent according to a preset analysis rule after the image file is sent to the corresponding recording system;
after the service platform system sends the image file to the corresponding list recording system, whether the image file is failed to be sent or not can be analyzed according to a preset analysis rule, if the image file is successfully received or failed information fed back to the service platform system by the corresponding list recording system is used for judging whether the image file is failed to be sent or not, and data interaction detection information such as a detection tool, a detection zone bit and the like can be inserted when the service platform system sends the image file to the corresponding list recording system so as to monitor the sending condition of the image file.
The failure retransmission module 03 is configured to establish a retransmission queue for the image file with the failed transmission if the image file fails to be transmitted, retransmit each image file with the failed transmission to the corresponding entry system at regular time according to the retransmission queue, count retransmission times corresponding to the image file after retransmission, and analyze whether the image file with the failed transmission fails to be transmitted according to a preset analysis rule;
if the image file transmission fails according to the preset analysis rule, the service platform system conducts failure retransmission processing on the image file with the transmission failure. When the service platform system performs failure retransmission processing on a plurality of image file files, an asynchronous multithreading data processing mode can be adopted to perform failure retransmission on the plurality of image file files. In one embodiment, the service platform system establishes a retransmission queue for the image file which fails to be transmitted, sequentially retransmits each image file which fails to be transmitted to the corresponding document recording system in real time or at regular time according to the retransmission queue, and analyzes whether the image file which is retransmitted fails to be transmitted according to a preset analysis rule; meanwhile, the retransmission times corresponding to the retransmitted image file files are respectively counted, so that whether the retransmitted image file files need to be retransmitted again or not is subsequently evaluated.
And the return calling module 04 is configured to return to call the analysis module and the failure retransmission module if the retransmitted image file fails to be transmitted and the retransmission times corresponding to the retransmitted image file are less than a preset threshold value until the retransmitted image file is successfully transmitted or the retransmission times reach the preset threshold value.
If the image file retransmitted according to the retransmission queue still fails to be transmitted according to the preset analysis rule, and the counted retransmission times corresponding to the retransmitted image file are smaller than the preset threshold (for example, 3 times), it indicates that although the retransmitted image file fails to be retransmitted, the retransmission times are not too many, and there is a possibility of being affected by an emergency such as a poor network environment of the current node, that is, the retransmitted image file still may be successfully transmitted in the next retransmission failure. Therefore, the processing of retransmitting and analyzing the retransmitted video file and performing the failed retransmission on the retransmitted video file according to the retransmission queue is returned and repeated. In the process of repeatedly retransmitting the retransmitted image file, in one case, if the retransmitted image file is successfully transmitted, the retransmission can be immediately finished, and the transmission of the image file is completed; in another case, if the image file is retransmitted in failure for multiple times, and the retransmission times reach the preset threshold value, the retransmission is still failed, which indicates that the image file cannot be transmitted through the multiple times of retransmission in failure, and the retransmission is finished.
In this embodiment, when the service platform system analyzes that the transmission of the image file sent to the corresponding recording system by the service platform system fails according to the preset analysis rule, the service platform system periodically resends each image file with the transmission failure to the corresponding recording system according to the established retransmission queue and counts the retransmission times, and if the retransmission of the image file with the retransmission fails and the retransmission times is less than the preset threshold, the retransmission of the failure is performed again. When the synchronization of the image file between the service platform system and the corresponding recording list system fails, the service platform system can perform failure retransmission processing on the image file, and when the resynchronization of the image file fails and the number of times of the failure retransmission is smaller than a preset threshold value, the service platform system can repeat the failure retransmission processing on the image file, so that the successful transmission of the image file in the data synchronization process is ensured to the maximum extent. In addition, asynchronous multi-thread transmission is carried out on a plurality of image file files which fail to be transmitted by adopting a retransmission queue mode when the image file files are subjected to failure retransmission processing, so that the efficiency of data synchronization is effectively improved.
Further, in other embodiments, the preset analysis rule includes:
after an image file is sent to the corresponding recording system, if a receiving failure message sent by the corresponding recording system is received within a first preset time, it is determined that the image file fails to be sent.
In this embodiment, after the service platform system sends an image file to the corresponding document recording system, when analyzing whether the sending of the image file fails, if a receiving failure message sent by the corresponding document recording system is received within a first preset time (for example, within 2 seconds), the service platform system may directly analyze and determine that the sending of the image file fails.
Further, in other embodiments, the preset analysis rule further includes:
after an image file is sent to the corresponding recording system, if a receiving feedback message sent by the corresponding recording system is not received within a second preset time, it is determined that the sending of the image file fails.
In this embodiment, after the service platform system sends an image file to the corresponding document recording system, when analyzing whether the sending of the image file fails, if a receiving feedback message sent by the corresponding document recording system is not received within a first preset time (for example, within 2 seconds), it indicates that the image file may have data loss, data damage, and the like during the sending process, and then the service platform system may analyze and determine that the sending of the image file fails.
Further, as shown in fig. 5, a second embodiment of the present invention proposes a data synchronization system, and on the basis of the above embodiment, the data synchronization system further includes:
the first reminding module 05 is configured to send reminding information to a predetermined terminal to remind that a retransmitted image file cannot be sent to a corresponding recording system if the retransmitted image file fails to be sent and the retransmission times corresponding to the retransmitted image file is not less than a preset threshold.
In this embodiment, if it is analyzed according to a preset analysis rule that the image file retransmitted according to the retransmission queue still fails to be transmitted, and the counted retransmission times corresponding to the retransmitted image file are greater than or equal to a preset threshold (for example, 3 times), it indicates that the retransmission of the retransmitted image file is failed for multiple times, and finally the retransmission still fails, and there is probably an abnormal situation that the image file cannot be recovered in a short time, such as disconnection of a data communication link. The service platform system sends a reminding message to a predetermined terminal, and the reminding message can inform a predetermined terminal user that the image file can not be sent to the corresponding list recording system after repeated failed retransmission so as to remind the predetermined terminal user to check a data communication link and the like between the service platform system and the corresponding list recording system in time and process faults.
Further, as shown in fig. 6, a third embodiment of the present invention provides a data synchronization system, and on the basis of the above embodiment, the data synchronization system further includes:
and the second reminding module 06 is configured to, after an image file is successfully sent, send a document recording reminding message to a predetermined terminal and/or a corresponding document recording system if the entry message corresponding to the image file and returned by the corresponding document recording system is not received within a third preset time, so as to remind that a document recording operation of the image file is completed as soon as possible.
In this embodiment, after an image file is successfully sent, if the entry information corresponding to the image file and returned by the corresponding entry system is not received within a second preset time (for example, within 48 hours), the service platform system sends an entry reminding message to a predetermined terminal and/or the corresponding entry system to remind a user to complete an entry job for the image file as soon as possible, so as to avoid occurrence of a situation that the image file is successfully sent but an entry is not entered into the corresponding entry system due to omission.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments. Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (6)
1. A method of data synchronization, the method comprising the steps of:
A. a service platform system sends an image file of a list to be recorded to a corresponding list recording system in real time or at regular time, and inserts data interaction detection information when the service platform system sends the image file to the corresponding list recording system, wherein the data interaction detection information comprises a detection tool and a detection marker bit so as to monitor the sending condition of the image file;
B. after the service platform system sends the image file to the corresponding recording system, whether the image file fails to be sent is analyzed according to a preset analysis rule, wherein the preset analysis rule comprises the following steps:
after an image file is sent to a corresponding recording system, if a receiving feedback message sent by the corresponding recording system is not received within a second preset time, which indicates that the image file is likely to have data loss and data damage and cannot be used in the sending process, determining that the sending of the image file fails;
C. if the image file is failed to be sent, the service platform system establishes a retransmission queue for the image file which is failed to be sent, resends each image file which is failed to be sent to a corresponding document recording system according to the retransmission queue at regular time, counts the resending times corresponding to the image file which is resent, and analyzes whether the resended image file fails to be sent according to a preset analysis rule;
D. if the image file which is retransmitted fails to be transmitted and the retransmission times corresponding to the image file which is retransmitted are less than the preset threshold value, the steps B and C are repeatedly executed until the image file which is retransmitted is successfully transmitted or the retransmission times reach the preset threshold value, wherein when the service platform system performs failure retransmission processing on a plurality of image files, the service platform system can perform failure retransmission on the plurality of image files in an asynchronous multithreading data processing mode;
the method further comprises the following steps:
after an image file is successfully sent, if the entry information corresponding to the image file and returned by the corresponding entry system is not received within a third preset time, the service platform system sends entry reminding information to a predetermined terminal and/or the corresponding entry system so as to remind that the entry operation of the image file is completed as soon as possible.
2. The data synchronization method of claim 1, further comprising:
if the sending of the image file which is sent again fails and the number of times of sending again corresponding to the image file which is sent again is not smaller than a preset threshold value, the service platform system sends reminding information to a predetermined terminal to remind that the image file which is sent again cannot be sent to a corresponding list recording system.
3. The data synchronization method according to claim 1 or 2, wherein the preset analysis rule further comprises:
after an image file is sent to the corresponding recording system, if a receiving failure message sent by the corresponding recording system is received within a first preset time, it is determined that the image file fails to be sent.
4. A data synchronization system, characterized in that the data synchronization system comprises:
the system comprises a sending module, a receiving module and a processing module, wherein the sending module is used for sending an image file of a list to be recorded to a corresponding list recording system in real time or at regular time, and inserting data interaction detection information when the service platform system sends the image file to the corresponding list recording system, and the data interaction detection information comprises a detection tool and a detection zone bit so as to monitor the sending condition of the image file;
the analysis module is used for analyzing whether the image file fails to be sent or not according to a preset analysis rule after the image file is sent to the corresponding recording system; the preset analysis rule comprises:
after an image file is sent to a corresponding recording system, if a receiving feedback message sent by the corresponding recording system is not received within a second preset time, which indicates that the image file is likely to have data loss and data damage and cannot be used in the sending process, determining that the sending of the image file fails;
the failure retransmission module is used for establishing a retransmission queue for the image file with failed transmission if the image file fails to be transmitted, retransmitting each image file with failed transmission to a corresponding recording system according to the retransmission queue at regular time, counting the retransmission times corresponding to the image file after retransmission, and analyzing whether the image file with retransmitted transmission fails or not according to a preset analysis rule;
the return calling module is used for returning and calling the analysis module and the failure retransmission module if the retransmitted image file fails to be transmitted and the retransmission times corresponding to the retransmitted image file are less than a preset threshold value until the retransmitted image file is successfully transmitted or the retransmission times reach the preset threshold value;
the data synchronization system further includes:
and the second reminding module is used for sending the order recording reminding information to a predetermined terminal and/or the corresponding order recording system to remind that the order recording operation of the image file is completed as soon as possible if the entry information corresponding to the image file returned by the corresponding order recording system is not received within the third preset time after the image file is successfully sent.
5. The data synchronization system of claim 4, further comprising:
and the first reminding module is used for sending reminding information to a predetermined terminal to remind that the retransmitted image file cannot be sent to the corresponding recording system if the retransmitted image file fails to be sent and the retransmission times corresponding to the retransmitted image file is not less than a preset threshold value.
6. The data synchronization system of claim 4 or 5, wherein the preset analysis rule further comprises:
after an image file is sent to the corresponding recording system, if a receiving failure message sent by the corresponding recording system is received within a first preset time, it is determined that the image file fails to be sent.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610589142.5A CN107645531B (en) | 2016-07-22 | 2016-07-22 | Data synchronization method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610589142.5A CN107645531B (en) | 2016-07-22 | 2016-07-22 | Data synchronization method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107645531A CN107645531A (en) | 2018-01-30 |
| CN107645531B true CN107645531B (en) | 2021-08-24 |
Family
ID=61109796
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610589142.5A Active CN107645531B (en) | 2016-07-22 | 2016-07-22 | Data synchronization method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107645531B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109391692A (en) * | 2018-10-23 | 2019-02-26 | 深圳壹账通智能科技有限公司 | Batch data centralization processing method and system based on buffer pool strategy |
| CN109413179A (en) * | 2018-10-24 | 2019-03-01 | 中国银行股份有限公司 | A kind of method and device of the multifile asynchronous retransmission based on HTTP request |
| CN110287060B (en) * | 2019-06-06 | 2021-06-22 | 郑州阿帕斯科技有限公司 | Data processing method and device |
| CN111147917A (en) * | 2019-12-24 | 2020-05-12 | 上海文化广播影视集团有限公司 | Image-text publishing system for public early warning |
| CN115118710B (en) * | 2022-05-25 | 2024-04-19 | 中银金融科技有限公司 | File transmission method and device |
| CN115629890A (en) * | 2022-10-27 | 2023-01-20 | 圣名科技(广州)有限责任公司 | Sensor data acquisition method and device and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101304430A (en) * | 2008-06-30 | 2008-11-12 | 中兴通讯股份有限公司 | Method and system for forwarding north direction document of telecommunication network management system |
| CN101997661A (en) * | 2009-08-14 | 2011-03-30 | 华为技术有限公司 | Data packet sending method, data packet acquiring method and device |
| CN104168093A (en) * | 2013-05-20 | 2014-11-26 | 腾讯科技（深圳）有限公司 | File transmission method and device |
| CN104184753A (en) * | 2013-05-20 | 2014-12-03 | 腾讯科技（深圳）有限公司 | File transmission method and device thereof |
| CN105448150A (en) * | 2015-11-09 | 2016-03-30 | 天脉聚源（北京）教育科技有限公司 | Information sending method and device for teaching system |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| BR0305027A (en) * | 2002-06-05 | 2004-07-20 | Lg Electronics Inc | Structure of a bonding area formed on a high density read-only recording medium and method and apparatus for making / reproducing it |
| US8527660B2 (en) * | 2006-12-22 | 2013-09-03 | Palm, Inc. | Data synchronization by communication of modifications |
| JP5609336B2 (en) * | 2010-07-07 | 2014-10-22 | ソニー株式会社 | Image data transmitting apparatus, image data transmitting method, image data receiving apparatus, image data receiving method, and image data transmitting / receiving system |
-
2016
- 2016-07-22 CN CN201610589142.5A patent/CN107645531B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101304430A (en) * | 2008-06-30 | 2008-11-12 | 中兴通讯股份有限公司 | Method and system for forwarding north direction document of telecommunication network management system |
| CN101997661A (en) * | 2009-08-14 | 2011-03-30 | 华为技术有限公司 | Data packet sending method, data packet acquiring method and device |
| CN104168093A (en) * | 2013-05-20 | 2014-11-26 | 腾讯科技（深圳）有限公司 | File transmission method and device |
| CN104184753A (en) * | 2013-05-20 | 2014-12-03 | 腾讯科技（深圳）有限公司 | File transmission method and device thereof |
| CN105448150A (en) * | 2015-11-09 | 2016-03-30 | 天脉聚源（北京）教育科技有限公司 | Information sending method and device for teaching system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107645531A (en) | 2018-01-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107645531B (en) | Data synchronization method and system | |
| KR101362609B1 (en) | Methods and apparatus to avoid mobile station transmission of duplicate event-based and polled ackn0wledgments | |
| CN103138905A (en) | Radio link control (RLC) data package transmission confirmation method and RLC acknowledge mode (AM) entity sender | |
| CN113746900B (en) | Intranet data transmission method, electronic device and computer readable storage medium | |
| CN101507318B (en) | Radio communication device and method used in mobile communication system | |
| US20100254320A1 (en) | Wireless transmitting apparatus, wireless receiving apparatus and wireless communication method | |
| CN103684707A (en) | Server-side and user-side message transmission processing method, message transmission method and message transmission system | |
| CN117040692A (en) | Method and device for transmitting service data, electronic equipment and storage medium | |
| CN113645103B (en) | Method and device for detecting communication link abnormity between video monitoring platform and front-end equipment | |
| CN109391373A (en) | Data repeating method, base station, terminal and system | |
| CN105634894B (en) | A kind of enhanced CAN bus data re-transmitting method and device | |
| CN111934893B (en) | Problem positioning processing method and device for uplink abnormal data | |
| CN111367795A (en) | Performance test method based on benchmark service and related equipment | |
| EP1662704B1 (en) | Monitoring system, apparatus to be monitored, monitoring apparatus and monitoring method | |
| CN112187408B (en) | Data processing method, system, device, storage medium and processor | |
| CN112702371B (en) | Message sending method and device and intelligent terminal | |
| CN111432441B (en) | Audio data transmitting method and device and computer readable storage medium | |
| CN109245816A (en) | A kind of chain circuit detecting method and device | |
| CN110611663A (en) | Detection method, device and system | |
| CN114979987B (en) | Abnormal short message identification re-sending method and device, electronic equipment and storage medium | |
| CN111131001A (en) | Message sending method, device, storage medium and server | |
| CN115150031B (en) | Distributed system message response method and device based on distributed message | |
| CN109818719B (en) | Uplink data retransmission processing method and device and user equipment | |
| EP4319254A1 (en) | Load query processing method and apparatus, storage medium, and electronic apparatus | |
| CN116366704A (en) | Control method, system and interactive terminal of bidirectional forwarding detection session |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |