CN103220343A - Big data multi-system forwarding method - Google Patents
Big data multi-system forwarding method Download PDFInfo
- Publication number
- CN103220343A CN103220343A CN201310109669XA CN201310109669A CN103220343A CN 103220343 A CN103220343 A CN 103220343A CN 201310109669X A CN201310109669X A CN 201310109669XA CN 201310109669 A CN201310109669 A CN 201310109669A CN 103220343 A CN103220343 A CN 103220343A
- Authority
- CN
- China
- Prior art keywords
- data
- text
- building together
- server
- text file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 66
- 230000004044 response Effects 0.000 claims abstract description 21
- 230000003993 interaction Effects 0.000 claims description 11
- 238000012545 processing Methods 0.000 claims description 10
- 230000005540 biological transmission Effects 0.000 claims description 8
- 238000010276 construction Methods 0.000 abstract description 11
- 230000008569 process Effects 0.000 abstract description 4
- 230000008859 change Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 230000000875 corresponding effect Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000033772 system development Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Abstract
The invention discloses a big data multi-system forwarding method, which comprises a plurality of co-construction party systems and a server, wherein the co-construction party systems are connected with the server respectively; each co-construction party system appoints a text format, generates a text file according to data required to be interacted and uploads the text file to the server; after the text file is uploaded, each co-construction party system is called through a service interface, an opposite side is informed of a text file name, and the opposite side is informed to process the text file; and when each co-construction party system receives service call, the text file informed in a message is checked, a response is returned immediately after the text file is confirmed, and after the response is returned, the co-construction party system independently processes the text file. Under the requirement of multi-system co-construction and cooperation, big data is interacted among the co-construction systems safely, accurately and timely, and the consistency of the data among the systems is ensured.
Description
Technical field
The invention belongs to field of computer technology, relate to transfer of data, be a kind of big data multisystem retransmission method.
Background technology
Citizen card is that to be applied to the social security be government's public affairs service of representative, be the utility service of representative with the urban transportation, with the small amount payment be the commerce services of representative and with the bank card be representative four big applications such as financial service have basic functions such as information gathering, identification, electronic certificate, information service and financial payment, take as the leading factor with social security, realize that three of social security, bank, small amount stored value card engages a card of one.
Citizen block and have improved the situation that social existing multiple card is used with, integrated multiple function, therefore, also need between each Construction Party, guarantee the service collaboration of card, can be to timely respond services of routine work request such as the distribution of citizen card, use, loss, cancellations, final construction can effectively be managed the whole life of citizen's card.
Because citizen's card is a multi-functional integrated card, simultaneously again because it has comprised important personal information such as social security, medical insurance, bank, therefore for the business change of this card, as card drawing, change card, report the loss, mend card etc., just need notify accurately real-time the respectively side of building together.Particularity and the generality that each citizen can have based on citizen's card during the hair fastener in enormous quantities in the early stage, may relate to the service interaction of big data quantity.Actual test data shows, generic interface service call mode, finish the once professional mutual time probably about 1 to 2 second, comprise the system of building together, as the mutual time of the traffic handling time and the service interface of social security, banking system, if but disposable interaction data is bigger, when reaching several thousand even several ten thousand cards, each mutual time will sharply rise to 1 minute even more of a specified duration.And this stand-by period, for direct user oriented foreground business personnel is unacceptable, this just makes us must adopt a kind of method, can satisfy the safe, accurately, mutual timely the time, response fast can be arranged also of data in enormous quantities.How can carry out big data interaction between system safely, accurately, timely, and guarantee the consistency of each inter-system data, just to become the difficult problem in the system development construction a plurality of building together.
Summary of the invention
The problem to be solved in the present invention is: under multisystem is built together the requirement of cooperation, and how in a plurality of safety between system of building together, carry out big data interaction accurately, timely, the response speed between the quickening system, and guarantee the consistency of each inter-system data.
Technical scheme of the present invention is: big data multisystem retransmission method, comprise a plurality of method, system and ftp servers of building together, and the method, system of building together connects described server respectively, respectively builds together and carries out the data interaction processing between the method, system, and data forwarding may further comprise the steps:
1) method, system of respectively building together is arranged a kind of text data form, and the method, system of building together will self need mutual data to generate the text of described text data form, and the text that generates is uploaded to the ftp server assigned catalogue;
2) after text is uploaded and is finished, the method, system of building together that sends data is by calling the service interface of the method, system self of building together, the transmission interface message, in described interface packets, inform the text name that the method, system oneself of building together that receives data uploads onto the server, notify the other side to go to handle obtaining text;
3) the reception data builds together method, system when receiving described interface packets, remove to check in the server text of being notified in the described interface packets, in confirming the ftp server assigned catalogue, text file is arranged, and behind the fixed text data form of this document format character contract, at first sending response to the method, system of building together that sends data returns, finish the response return after, obtain described text from server again and oneself handle separately.
The method, system of building together is provided with the data volume threshold value, when the method, system of building together judges that the data volume that will send surpasses described threshold value, by step 1)-3) transmit data, otherwise the service interface that directly calls the method, system self of building together directly sends data.
The service interface that the described method, system of building together provides comprises webservice and socket.
Text uploads onto the server by the FTP mode.
The advantage of the inventive method maximum has been to save the processing time of method, system for big data quantity of building together, the method, system of building together can not carry out only text being carried out verification under the situation that data service handles, responds and returns sending data side immediately.The entire process process, comprise the time that file is uploaded by FTP, the time of file being carried out verification with the method, system of building together, generally also can in 3 to 5 seconds, finish interaction response, improved Business Processing speed, thereby alleviated direct user oriented foreground business personnel's pressure greatly, and promoted client's service satisfaction.Simultaneously, also reduced receiving the requirement during method, system processing response of building together of data, receiving data side only needs when receiving service call notification, text to notice is verified, can respond then and return, to the processing of data in enormous quantities in the file, can after finish voluntarily.
The inventive method is based on the existing method, system of building together, the transmission speed of data and the response speed between the system have been improved, and need not the existing method, system transformation of building together, be easy to realize, especially to the transmission and the response of a large number of services data, can significantly improve the Business Processing speed of the method, system of building together compared to existing technology.
Description of drawings
Fig. 1 is a flow chart of the present invention.
Embodiment
In the prior art, at for example operation of the types such as business change of citizen's card, build together method, system when carrying out data interaction to each other, all be directly to send data, when transmit leg is waited until the response that recipient's reception data finish, finish a data interaction, for method, system webservice and the socket service interface commonly used of building together, small amount of data can be transmitted fast and finish, data transmission period is long more if data volume is big more, the time of wait-for-response is also long more, has a strong impact on the professional speed of handling.
This be the present invention proposes a kind of new data interaction retransmission method, for disposable a large amount of pending data, transmit leg does not directly send data by service interface, but transfer to server fast by the mode of FTP, send an interface packets to the recipient in addition then, after the recipient confirms that according to interface packets corresponding data are arranged in server, reply to the transmit leg response earlier, going to obtain data again handles, such mode has improved the transmission speed of data on the one hand, the FTP transmission means can successfully manage the quick transmission of mass data, no longer directly transmit data on the other hand between the side of building together, but the intercommunication message, response speed is guaranteed.
Service data interaction with citizen's card is an example below, specifies enforcement of the present invention.
The services such as webservice, socket of considering have the comparison total solution on small data quantity mutual, the present invention is keeping on the existing basis of calling services such as webservice, socket, big data quantity is increased the mode of file transfer, utilized the mode of " file+interface service " to handle the mutual of big data quantity.
At first, the text data form that the method, system of respectively building together agreement is unified will need mutual data to generate text earlier in enormous quantities, and for example suffix is the text of .txt.The form of text file can in advance and each side such as social security, bank appoint that comprise the mutual required data of the method, system of building together in the file, every data are delegation, interfield is with CSV, and by the FTP mode assigned catalogue that uploads onto the server.Then, text upload finish after, again by service interfaces such as webservice, socket, send interface packets, call the method, system of respectively building together that receives data, as social security, banking system, inform the other side's text name, notify the other side to go file is handled.The recipient builds together method, system when receiving service call, check the file of being notified in the interface packets, after in confirming server, described file being arranged really, wouldn't specifically handle file, but response at once is back to the method, system of building together of transmit leg, after finishing service response, own again processing of separately file being correlated with.
Concrete implementation step is as follows:
1, certain method, system of building together obtains the related service data, for example card drawing data according to concrete service conditions;
2, this method, system of building together is judged the related service data automatically, according to data volume decision processing mode.For example, according to the situation of reality test,, think big data quantity when card drawing number during greater than 10 (for example card drawing in enormous quantities of some unit); During smaller or equal to 10, think small data quantity.Concrete quantity can be adjusted according to actual business requirement;
3 if small data quantity, directly calling the service interfaces such as webservice, socket of relevant build together method, system such as social security, banking system, sends business datum, and waits for that the other side carries out Business Processing and response;
4 if big data quantity, earlier business datum is generated the text that suffix is .txt, concrete file format can be in advance and each side such as social security, bank appoint, comprise the mutual required data of the method, system of building together in the file, every data are delegation, and interfield is with CSV;
5, send the method, system of building together of data uploads onto the server text by FTP assigned catalogue;
6, after text was uploaded and finished, by calling the service interfaces such as webservice, socket of the relevant method, system of building together, transmit leg was informed the recipient by interface packets with the text name, and waited for the other side's response.This moment, the recipient built together method, system after receiving call request, and whether Connection Service device checking text exists and correctness; After confirming text, wouldn't specifically handle file, return but at once transmit leg is responded, after finishing response, obtain text by server again, voluntarily the business datum in the text is carried out corresponding service and handle.
Claims (4)
1. big data multisystem retransmission method is characterized in that comprising a plurality of method, system and ftp servers of building together, and the method, system of building together connects described server respectively, respectively builds together and carries out the data interaction processing between the method, system, and data forwarding may further comprise the steps:
1) method, system of respectively building together is arranged a kind of text data form, and the method, system of building together will self need mutual data to generate the text of described text data form, and the text that generates is uploaded to the ftp server assigned catalogue;
2) after text is uploaded and is finished, the method, system of building together that sends data is by calling the service interface of the method, system self of building together, the transmission interface message, in described interface packets, inform the text name that the method, system oneself of building together that receives data uploads onto the server, notify the other side to go to handle obtaining text;
3) the reception data builds together method, system when receiving described interface packets, remove to check in the server text of being notified in the described interface packets, in confirming the ftp server assigned catalogue, text file is arranged, and behind the fixed text data form of this document format character contract, at first sending response to the method, system of building together that sends data returns, finish the response return after, obtain described text from server again and oneself handle separately.
2. big data multisystem retransmission method according to claim 1, the method, system that it is characterized in that building together is provided with the data volume threshold value, when the method, system of building together judges that the data volume that will send surpasses described threshold value, by step 1)-3) transmit data, otherwise the service interface that directly calls the method, system self of building together directly sends data.
3. big data multisystem retransmission method according to claim 1 and 2 is characterized in that the service interface that the described method, system of building together provides comprises webservice and socket.
4. big data multisystem retransmission method according to claim 1 and 2 is characterized in that text uploads onto the server by the FTP mode.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310109669.XA CN103220343B (en) | 2013-03-29 | 2013-03-29 | Big data multi-system retransmission method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310109669.XA CN103220343B (en) | 2013-03-29 | 2013-03-29 | Big data multi-system retransmission method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103220343A true CN103220343A (en) | 2013-07-24 |
| CN103220343B CN103220343B (en) | 2016-07-06 |
Family
ID=48817794
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310109669.XA Expired - Fee Related CN103220343B (en) | 2013-03-29 | 2013-03-29 | Big data multi-system retransmission method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103220343B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104915336A (en) * | 2014-03-12 | 2015-09-16 | 腾讯科技（深圳）有限公司 | Document translation method and device |
| CN106778302A (en) * | 2016-12-06 | 2017-05-31 | 金航数码科技有限责任公司 | A kind of secure exchange and sharing method of the electronic document of cross-system |
| US10419269B2 (en) | 2017-02-21 | 2019-09-17 | Entit Software Llc | Anomaly detection |
| US10803074B2 (en) | 2015-08-10 | 2020-10-13 | Hewlett Packard Entperprise Development LP | Evaluating system behaviour |
| US10884891B2 (en) | 2014-12-11 | 2021-01-05 | Micro Focus Llc | Interactive detection of system anomalies |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101094026A (en) * | 2006-06-19 | 2007-12-26 | 上海全成通信技术有限公司 | Method for synchronizing, transmitting mass data, and inputting mass data to database |
| CN101132269A (en) * | 2007-07-26 | 2008-02-27 | 中兴通讯股份有限公司 | Data synchronization method and IPTV content distribution network system using the same |
| US20100169876A1 (en) * | 2008-12-31 | 2010-07-01 | Square D Company | Automatic firmware updates for intelligent electronic devices |
-
2013
- 2013-03-29 CN CN201310109669.XA patent/CN103220343B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101094026A (en) * | 2006-06-19 | 2007-12-26 | 上海全成通信技术有限公司 | Method for synchronizing, transmitting mass data, and inputting mass data to database |
| CN101132269A (en) * | 2007-07-26 | 2008-02-27 | 中兴通讯股份有限公司 | Data synchronization method and IPTV content distribution network system using the same |
| US20100169876A1 (en) * | 2008-12-31 | 2010-07-01 | Square D Company | Automatic firmware updates for intelligent electronic devices |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104915336A (en) * | 2014-03-12 | 2015-09-16 | 腾讯科技（深圳）有限公司 | Document translation method and device |
| CN104915336B (en) * | 2014-03-12 | 2021-03-23 | 腾讯科技（深圳）有限公司 | Document translation method and device |
| US10884891B2 (en) | 2014-12-11 | 2021-01-05 | Micro Focus Llc | Interactive detection of system anomalies |
| US10803074B2 (en) | 2015-08-10 | 2020-10-13 | Hewlett Packard Entperprise Development LP | Evaluating system behaviour |
| CN106778302A (en) * | 2016-12-06 | 2017-05-31 | 金航数码科技有限责任公司 | A kind of secure exchange and sharing method of the electronic document of cross-system |
| US10419269B2 (en) | 2017-02-21 | 2019-09-17 | Entit Software Llc | Anomaly detection |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103220343B (en) | 2016-07-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109191144B (en) | Laboratory information service management system based on block chain and working method | |
| CN104253741B (en) | A kind of method for sending information, relevant apparatus and system | |
| CN108462758A (en) | Bank-corporate express communication means, device, equipment and computer readable storage medium | |
| CN105825409B (en) | Electronic invoice message pushing system and method | |
| CN103220343A (en) | Big data multi-system forwarding method | |
| EP2417787B1 (en) | Arrangement for an nfc compatible mobile device for delayed transfer of an established friend connection and a related method | |
| CN110266658B (en) | Information updating method and device, electronic equipment and storage medium | |
| CN111614761B (en) | Block chain message transmission method, device, computer and readable storage medium | |
| CN105184883A (en) | Intelligent attendance bracelets and attendance checking method based on user ID and fingerprint recognition | |
| CN105357110B (en) | E-mail sending method, apparatus and system | |
| CN103647701B (en) | The control method and device of instantaneous communication system message forwarding | |
| CN104270302B (en) | The transmission system of online order and transfer approach | |
| US9350733B2 (en) | Emergency server access for offline users | |
| CN105787674A (en) | Paperless mobile office system | |
| CN103457802A (en) | Information transmission system and method | |
| CN105225045A (en) | A kind of movable attendance checking system based on user ID and fingerprint recognition and Work attendance method | |
| CN103684974A (en) | Mail processing method and system | |
| CN110290218A (en) | File annotation method and system, computer-readable medium | |
| CN110503559B (en) | Block chain-based clearing method, device, equipment and computer storage medium | |
| CN104050204A (en) | Method of combining network data and mobile device using the same | |
| CN110378494B (en) | Remote facing slip method, remote facing slip device, storage medium and computer equipment | |
| CN109040331B (en) | Electronic business card processing method and device, computing equipment and storage medium | |
| KR20140013892A (en) | Method of comparing output in a plurality of information systems | |
| CN111341039B (en) | Card-retaining processing method and system, client and server | |
| CN103581843A (en) | Personal information transmission method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160706 |