CN103220343B - Big data multi-system retransmission method - Google Patents
Big data multi-system retransmission method Download PDFInfo
- Publication number
- CN103220343B CN103220343B CN201310109669.XA CN201310109669A CN103220343B CN 103220343 B CN103220343 B CN 103220343B CN 201310109669 A CN201310109669 A CN 201310109669A CN 103220343 B CN103220343 B CN 103220343B
- Authority
- CN
- China
- Prior art keywords
- text
- data
- building together
- building
- ftp server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 77
- 230000004044 response Effects 0.000 claims abstract description 19
- 230000003993 interaction Effects 0.000 claims abstract description 15
- 230000005540 biological transmission Effects 0.000 claims description 11
- 230000008569 process Effects 0.000 claims description 10
- 238000005516 engineering process Methods 0.000 description 3
- 238000010276 construction Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000033772 system development Effects 0.000 description 1
- 230000026676 system process Effects 0.000 description 1
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Computer And Data Communications (AREA)
Abstract
Big data multi-system retransmission method, including multiple method, system and servers of building together, method, system of building together connects described server respectively, a kind of text formatting of method, system of respectively building together agreement, it would be desirable to mutual data genaration text also uploads onto the server；After text has been uploaded, call, by service interface, method, system of respectively building together, inform the other side's literal filename, notify that the other side goes text is processed；Build together method, system when receiving service call, checks the text notified in message, after confirming text, respond return at once, after completing response return, then oneself individually text is processed.The present invention multisystem build together cooperation requirement under, multiple build together safe and accurate between system, carry out big data interaction timely, and ensure the concordance of each inter-system data.
Description
Technical field
The invention belongs to field of computer technology, relate to data transmission, for the big data multi-system retransmission method of one.
Background technology
Citizen Card Item be applied to government's public affairs service that social security is representative, with urban transportation be representative utility service, with small amount payment be representative commerce services and with bank card be representative the four big applications such as financial service there is the basic functions such as information gathering, identification, electronic certificate, information service and financial payment, that take as the leading factor with social security, realize a card of three card unifications of social security, bank, small electronic wallet.
Citizen Card Item improves the situation that the existing multi-card of society is mixed, it is integrated with several functions, therefore, it is also required to ensure the service collaboration of card between each Construction Party, the routine work requests such as the distribution of Citizen Card Item, use, loss, cancellation can timely responding to service, the whole life cycle of Citizen Card Item can effectively be managed by final construction.
Owing to Citizen Card Item is the card of a multifunctional unit, simultaneously again owing to it comprises the important personal information such as social security, medical insurance, bank, therefore the business of this card is changed, such as card drawing, change card, report the loss, mend card etc., it is necessary to notify the respectively side of building together real-time accurately.Based on the universality that particularity and each citizen of Citizen Card Item can have, in the early stage during high-volume hair fastener, it is possible to the service interaction of big data quantity can be related to.Actual test data show, generic interface service call mode, complete the interaction time of a business probably at about 1 to 2 second, including the system of building together, interaction time such as social security, the traffic handling time of banking system and service interface, if but disposable interaction data is relatively big, reach several thousand even several ten thousand cards time, each interaction time will steeply rise be 1 minute even more of a specified duration.And this waiting time, for region be directly facing user foreground business personnel be unacceptable, this allows for us have to adopt a kind of method, it is possible to meet high-volume data safe and accurate, mutual timely while, it is also possible to have quick response.How can multiple build together safe and accurate between system, carry out big data interaction timely, and ensure the concordance of each inter-system data, just become the difficult problem during system development is built.
Summary of the invention
The problem to be solved in the present invention is: multisystem build together cooperation requirement under, how multiple build together safe and accurate between system, carry out big data interaction, the response speed between quickening system timely, and ensure the concordance of each inter-system data.
The technical scheme is that big data multi-system retransmission method, including multiple method, system and ftp servers of building together, method, system of building together connects described server respectively, respectively builds together and carries out data interaction process between method, system, and data forward and comprise the following steps:
1) a kind of text data format of method, system of respectively building together agreement, self is needed the text of text data format described in mutual data genaration by method, system of building together, and the text of generation is uploaded to ftp server assigned catalogue；
2) after text has been uploaded, send the method, system of building together of data by calling the service interface of method, system self of building together, transmission interface message, described interface packets is informed and receives the literal filename that the method, system oneself of building together of data uploads onto the server, notify that the other side goes acquisition text is processed；
3) what receive data builds together method, system when receiving described interface packets, go server checks the text notified in described interface packets, text file is had in confirming ftp server assigned catalogue, and after the text data format that this document format character contract is fixed, first send response to the method, system of building together sending data to return, after completing response return, then oneself individually process from the server described text of acquisition.
Method, system of building together arranges data-quantity threshold, when method, system of building together judges that the data volume to send exceedes described threshold value, by step 1)-3) forward data, the service interface otherwise directly invoking method, system self of building together directly transmits data.
The service interface that described method, system of building together provides includes webservice and socket.
Text is uploaded onto the server by FTP mode.
The maximum advantage of the inventive method is in that to save the method, system process time for big data quantity of building together, and method, system of building together when only text being verified and do not carry out data processing, can respond return to sending data side immediately.Whole processing procedure, including file by the FTP time uploaded, time file verified with method, system of building together, generally also can complete interaction response in 3 to 5 seconds, improve Business Processing speed, thus alleviating the pressure of the foreground business personnel that region be directly facing user greatly, and improve the service satisfaction of client.Meanwhile, also reducing the requirement when method, system of building together receiving data processes response, receiving data side only need to when receiving service call notification, the text of notice is verified, then can respond return, to the process of high-volume data in file, can complete voluntarily later.
The inventive method is based on existing method, system of building together, improve the response speed between the transmission speed of data and system, transform without to existing method, system of building together, it is easily achieved, especially to the transmission of a large number of services data and response, the Business Processing speed of method, system of building together can be significantly improved compared to existing technology.
Accompanying drawing explanation
Fig. 1 is the flow chart of the present invention.
Detailed description of the invention
In prior art, the operation of the types such as the business variation for such as Citizen Card Item, build together method, system when carrying out data interaction to each other, it is all directly transmit data, sender is until the response that the reception data of recipient complete, complete a data interaction, for webservice and the socket service interface that method, system of building together is conventional, small amount of data can quickly be transmitted, if data volume is more big, data transmission period is more long, the time of wait-for-response is also more long, and what have a strong impact on business handles speed.
This present invention is proposed a kind of new data interaction retransmission method, for disposable substantial amounts of pending data, sender is also not directed through service interface transmission data, but it is quickly transferred to server by the mode of FTP, then additionally an interface packets is sent to recipient, after recipient confirms to have the data of correspondence in the server according to interface packets, first reply to sender's response, go to obtain data again to process, such mode improves the transmission speed of data on the one hand, FTP transmission means can successfully manage the quick transmission of mass data, data are no longer directly transmitted on the other hand between the side of building together, but intercommunication message, response speed is guaranteed.
Below for the service data interaction of Citizen Card Item, illustrate the enforcement of the present invention.
Consider the service such as webservice, socket for small data quantity mutual on have and compare total solution, the present invention is retaining on the existing basis calling the services such as webservice, socket, big data quantity is added the mode of file transmission, utilizes the mode of " file+interface service " to process the mutual of big data quantity.
First, the text data format that method, system of respectively building together agreement is unified, first high-volume is needed mutual data genaration text, for instance suffix is the text of .txt.The form of text file can be appointed with each side such as social security, bank in advance, comprise in file build together method, system alternately required for data, every data is a line, and interfield is with CSV, and is uploaded onto the server assigned catalogue by FTP mode.Then, after text has been uploaded, again through service interfaces such as webservice, socket, send interface packets, call the method, system of respectively building together receiving data, such as social security, banking system, inform the other side's literal filename, notify that the other side goes file is processed.Recipient builds together method, system when receiving service call, check the file notified in interface packets, after confirmed service device has described file really, file specifically wouldn't be processed, but response is back to the method, system of building together of sender at once, after completing service response, then the process oneself individually file being correlated with.
It is embodied as step as follows:
1, certain method, system of building together is according to concrete service conditions, obtains associated traffic data, for instance card drawing data；
2, this method, system automatic decision associated traffic data of building together, determines processing mode according to data volume.Such as, the situation according to reality test, when card drawing number is more than 10 (the high-volume card drawing of such as some unit), it is believed that be big data quantity；During less than or equal to 10, it is believed that be small data quantity.Particular number can be adjusted according to actual business requirement；
3 if small data quantity, directly invoking the service interface such as webservice, socket of relevant build together method, system such as social security, banking system, sending business datum, and wait that the other side carries out Business Processing and response；
4 if big data quantity, business datum first generates the text that suffix is .txt, and concrete file format can be appointed with each side such as social security, bank in advance, comprises method, system required data alternately of building together in file, every data is a line, and interfield is with CSV；
5, send data method, system of building together by text by the FTP assigned catalogue uploaded onto the server；
6, after text has been uploaded, by calling the service interfaces such as webservice, socket of relevant method, system of building together, literal filename is informed recipient by interface packets by sender, and waits that the other side responds.Now recipient builds together method, system after receiving call request, and whether Connection Service device checking text exists and correctness；After confirming text, file specifically wouldn't be processed, but at once sender be responded return, after completing response, then be obtained text by server, voluntarily the business datum in text is carried out the Business Processing of correspondence.
Claims (3)
1. big data multi-system retransmission method, is characterized in that including multiple method, system and ftp server of building together, and method, system of building together connects described ftp server respectively, respectively builds together and carries out data interaction process between method, system, and data forward and comprise the following steps:
1) a kind of text data format of method, system of respectively building together agreement, self is needed the text of text data format described in mutual data genaration by method, system of building together, and the text of generation is uploaded to ftp server assigned catalogue；
2) after text has been uploaded, send the method, system of building together of data by calling the service interface of method, system self of building together, transmission interface message, described interface packets being informed, the method, system oneself of building together receiving data is uploaded to the literal filename of ftp server, notifies that the other side goes to obtain text and processes；
3) what receive data builds together method, system when receiving described interface packets, go ftp server checks the text notified in described interface packets, text file is had in confirming ftp server assigned catalogue, and after the text data format that this document format character contract is fixed, first send response to the method, system of building together sending data to return, after completing response return, then oneself individually process from the ftp server described text of acquisition；
Wherein, method, system of building together arranges data-quantity threshold, when method, system of building together judges that the data volume to send exceedes described threshold value, by step 1)-3) forward data, the service interface otherwise directly invoking method, system self of building together directly transmits data.
2. big data multi-system retransmission method according to claim 1, the service interface that method, system of building together described in it is characterized in that provides includes webservice and socket.
3. big data multi-system retransmission method according to claim 1, is characterized in that text is uploaded to ftp server by FTP mode.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310109669.XA CN103220343B (en) | 2013-03-29 | 2013-03-29 | Big data multi-system retransmission method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310109669.XA CN103220343B (en) | 2013-03-29 | 2013-03-29 | Big data multi-system retransmission method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103220343A CN103220343A (en) | 2013-07-24 |
| CN103220343B true CN103220343B (en) | 2016-07-06 |
Family
ID=48817794
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310109669.XA Expired - Fee Related CN103220343B (en) | 2013-03-29 | 2013-03-29 | Big data multi-system retransmission method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103220343B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104915336B (en) * | 2014-03-12 | 2021-03-23 | 腾讯科技（深圳）有限公司 | Document translation method and device |
| WO2016093836A1 (en) | 2014-12-11 | 2016-06-16 | Hewlett Packard Enterprise Development Lp | Interactive detection of system anomalies |
| US10803074B2 (en) | 2015-08-10 | 2020-10-13 | Hewlett Packard Entperprise Development LP | Evaluating system behaviour |
| CN106778302A (en) * | 2016-12-06 | 2017-05-31 | 金航数码科技有限责任公司 | A kind of secure exchange and sharing method of the electronic document of cross-system |
| US10419269B2 (en) | 2017-02-21 | 2019-09-17 | Entit Software Llc | Anomaly detection |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101094026A (en) * | 2006-06-19 | 2007-12-26 | 上海全成通信技术有限公司 | Method for synchronizing, transmitting mass data, and inputting mass data to database |
| CN101132269A (en) * | 2007-07-26 | 2008-02-27 | 中兴通讯股份有限公司 | Data synchronization method and IPTV content distribution network system using the same |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8892699B2 (en) * | 2008-12-31 | 2014-11-18 | Schneider Electric USA, Inc. | Automatic firmware updates for intelligent electronic devices |
-
2013
- 2013-03-29 CN CN201310109669.XA patent/CN103220343B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101094026A (en) * | 2006-06-19 | 2007-12-26 | 上海全成通信技术有限公司 | Method for synchronizing, transmitting mass data, and inputting mass data to database |
| CN101132269A (en) * | 2007-07-26 | 2008-02-27 | 中兴通讯股份有限公司 | Data synchronization method and IPTV content distribution network system using the same |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103220343A (en) | 2013-07-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103220343B (en) | Big data multi-system retransmission method | |
| EP3402136B1 (en) | Information interaction method, client and device | |
| CN102655481B (en) | A kind of instant messaging chat content inspection method based on webpage and system | |
| CN103647701B (en) | The control method and device of instantaneous communication system message forwarding | |
| CN105825409B (en) | Electronic invoice message pushing system and method | |
| HK1097375A1 (en) | System and method for communicating asynchronouslywith web services using message set definitions | |
| CN105357110B (en) | E-mail sending method, apparatus and system | |
| US20140302779A1 (en) | Method, device and system for establishing conversation relationship | |
| CN104270302B (en) | The transmission system of online order and transfer approach | |
| CN104331974A (en) | Bluetooth number-taking method and system | |
| EP3007365A1 (en) | Secure information interaction method for electronic resources transfer | |
| CN111240862A (en) | Universal interface platform and data conversion method | |
| CN103457802A (en) | Information transmission system and method | |
| CN110290218A (en) | File annotation method and system, computer-readable medium | |
| US10582563B2 (en) | Service data group sending method, apparatus, and server | |
| CN110458250A (en) | A kind of instant fabrication method of social security card | |
| JP5961471B2 (en) | Output comparison method in multiple information systems | |
| CN109040331B (en) | Electronic business card processing method and device, computing equipment and storage medium | |
| CN101145912A (en) | An electronic order secure transmission method based on ebMS | |
| CN103457962B (en) | Access method, microblogging client and the system of microblogging photograph album | |
| CN105260346A (en) | Monitoring data processing method, device and system | |
| CN109885815B (en) | Electronic protocol acquisition method, system and server | |
| CN101106547A (en) | A method and system for transferring files in instant communication tool | |
| CN101227488A (en) | Registration type portal program communication system, communication device and communication method | |
| CN113726731A (en) | Method and system for realizing real-time communication between terminal APP and server based on TCP |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160706 |