CN105791399B - More trunk interconnection net big data method for pushing and system - Google Patents
More trunk interconnection net big data method for pushing and system Download PDFInfo
- Publication number
- CN105791399B CN105791399B CN201610111050.6A CN201610111050A CN105791399B CN 105791399 B CN105791399 B CN 105791399B CN 201610111050 A CN201610111050 A CN 201610111050A CN 105791399 B CN105791399 B CN 105791399B
- Authority
- CN
- China
- Prior art keywords
- data
- task
- push
- pushing
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 96
- 238000007726 management method Methods 0.000 claims abstract description 59
- 238000012545 processing Methods 0.000 claims abstract description 20
- 238000013524 data verification Methods 0.000 claims abstract description 16
- 230000008569 process Effects 0.000 claims description 44
- 230000003139 buffering effect Effects 0.000 claims description 14
- 230000006835 compression Effects 0.000 claims description 11
- 238000007906 compression Methods 0.000 claims description 11
- 238000007781 pre-processing Methods 0.000 claims description 9
- 238000001514 detection method Methods 0.000 claims description 8
- 239000012634 fragment Substances 0.000 claims description 8
- 238000012544 monitoring process Methods 0.000 claims description 6
- 230000002159 abnormal effect Effects 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 claims description 5
- 238000013500 data storage Methods 0.000 claims description 5
- 238000012790 confirmation Methods 0.000 claims description 3
- 238000012163 sequencing technique Methods 0.000 claims description 3
- 206010000234 Abortion spontaneous Diseases 0.000 claims description 2
- 241001269238 Data Species 0.000 claims description 2
- 238000013502 data validation Methods 0.000 claims description 2
- 208000015994 miscarriage Diseases 0.000 claims description 2
- 208000000995 spontaneous abortion Diseases 0.000 claims description 2
- 230000006855 networking Effects 0.000 claims 1
- 238000005201 scrubbing Methods 0.000 claims 1
- 238000013523 data management Methods 0.000 abstract description 2
- 101150012579 ADSL gene Proteins 0.000 abstract 1
- 102100020775 Adenylosuccinate lyase Human genes 0.000 abstract 1
- 108700040193 Adenylosuccinate lyases Proteins 0.000 abstract 1
- 230000006870 function Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 4
- 238000011084 recovery Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 230000008439 repair process Effects 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 238000010200 validation analysis Methods 0.000 description 3
- 238000012795 verification Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 2
- 230000007812 deficiency Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 102100024412 GTPase IMAP family member 4 Human genes 0.000 description 1
- 101000833375 Homo sapiens GTPase IMAP family member 4 Proteins 0.000 description 1
- 101001094649 Homo sapiens Popeye domain-containing protein 3 Proteins 0.000 description 1
- 101000608234 Homo sapiens Pyrin domain-containing protein 5 Proteins 0.000 description 1
- 101000578693 Homo sapiens Target of rapamycin complex subunit LST8 Proteins 0.000 description 1
- 102100027802 Target of rapamycin complex subunit LST8 Human genes 0.000 description 1
- 238000002679 ablation Methods 0.000 description 1
- 238000012550 audit Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 210000004209 hair Anatomy 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000011900 installation process Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/55—Push-based network services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1073—Registration or de-registration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Multimedia (AREA)
- Information Transfer Between Computers (AREA)
Abstract
More trunk interconnection net big data method for pushing and system, including interface management, task management, name registration, data prediction, data-pushing, data relaying, data receiver, data verification management, buffered data management.Application example completes big data push and is precisely sent to task, task, processing, push, relaying, reception, the method and flow checked, be sent to, and its full-duplex mode of operation are pushed comprising big data is received by name registration and login.System based on the above method is rationally after deployment, can completely reliable, high efficiency, automatically pushing huge data to another Internet access points of distal end from a general internet access point；One-to-many push, offline push, incoming end belong to when different linking Internet operators, and present system selects suitable transistroute, avoids the data channel bottleneck between linking Internet operator, effectively utilizes ADSL asymmetry.
Description
Technical field
The invention belongs to internet big data push technology, and in particular to more trunk interconnection net big data method for pushing and be
System.
Background technology
Some application fields usually require substantial amounts of data being pushed to remote another place from a place, such as
By tens million of individual medical image files, (generally each file size is in 500KB --- 25MB, a small number of files arrive greatly 1GB ---
Strange land 5GB) is pushed to as disaster-tolerant backup.The medical image data that there are tens thousand of medical institutions the country is much larger than above-mentioned quantity.
Our live and work gradually marches toward the big data epoch, and similar application demand is more and more.Data-pushing has needed to have
Three complete reliable, high efficiency, automation essential characteristics：It is not in the overwhelming majority applies that data, which have the loss of only a few or damage,
Allow；Data-pushing will raise application cost slowly, or influence user experience, influence operating efficiency；Mass data
Push obviously can not by hand operate and all possible failure must be reduced to greatest extent, when failure occurs
Reduce manual intervention.Pushed if connected using Leased line, because track stability is high, speed is relatively fast, not only efficiency
Fundamental Solutionss are determined, and out of order probability also also reduces significantly, it might even be possible to are not done special processing, needed the work of automatic business processing
Also it is relative to reduce, but Leased line link cost is high, does not possess and is widely applied to basic unit, the condition to family, community.Interconnection
The data link of net has bottleneck problem between different linking Internet operators, if the both ends of data-pushing use difference
Linking Internet operator incoming end, the speed of mutual propelling data using same linking Internet operator compared to being connect
Enter the application at end, speed is much lower.In addition, linking Internet is with ADSL (Asymmetric Digital at present
Subscriber Line, Asymmetrical Digital Subscriber Line) based on technology, asymmetry is characterized in, that is, is downloaded more than upload
It hurry up.
The method that data-pushing can be realized at present has a lot.Email is that everybody uses earliest, widest file
Transmission method；FTP (FTP) is the standard file transfer protocols of another international endorsement again, by FTP, SMTP,
The transmission that the basic achievable data of the further programming of POP3, IMAP4 are substantial amounts of, automate, but for handling above mentioned problem, it is difficult
A lot, some can not even break through.The design of Email in itself is not intended to transmit big data.FTP is due to establishing the mark
Accurate Different Period, background and context is different, and when being pushed for big data, efficiency and security are inadequate, its reliability and reality
Now automation needs substantial amounts of program to handle, and exploitation amount is big.The complexity of system is generally negatively correlated with reliability, structure and journey
Sequence is more complicated, is more easily reduced reliability.QQ off-line files, which are sent, wechat file is sent can send out one file or limited of push
One batch file.Some video websites provide data-pushing and supported, push oneself video interested in office or music is got home
In phone, may download completion when going home at night, will not often wait for downloading because of network problem during viewing.Cloud is provided
Each service provider of disk service also all supports data to upload and download.
Realize at present and mode that everybody commonly uses, there is a series of problems during in face of the demand：Service provider is simultaneously
Do not ensure that the data of user's push are bound to accurately arrive at, in fact we are frequently necessary to send out by hand again
Cross but unsuccessful file；The quantity of documents of manual operations push and size are restricted every time, do not reach mass data push far
Requirement；Bottleneck problem between linking Internet operator, the application problem of the asymmetric features of ADSL could not be efficiently solved.
Although publication No. be the A of CN 104601668 application for a patent for invention " data push method based on condition managing,
Device and system ", publication No. are the A of CN 104408132 application for a patent for invention " data push method and system ", and publication No. is
The A of CN 104516989 application for a patent for invention " incremental data supplying system and method ", publication No. are the A's of CN 104378399
A kind of files such as application for a patent for invention " data push method, Platform Server, client and system ", and some have delivered
Paper all mention data push method, but can not solve a series of problems recited above.
The content of the invention
It is an object of the invention to overcome the deficiencies in the prior art, to meet reliable, efficient, the automation of magnanimity big data
Push demand, and solve can between popularization and different linking Internet operators data channel bottleneck problem, carry
For a kind of more trunk interconnection net big data method for pushing and system.
The present invention is more, and trunk interconnection net big data method for pushing includes：
Sequencing or manual operations receive big data push task, tissue and pretreatment are carried out to task, to pretreatment
Treat that propelling data is managed, next reception example pushed data into by data-pushing thread under task management coordination,
Data are carried out with consistency checking after eventually arriving at push destination address, confirmation pushes successfully, receives the data that example will receive
Pass through the interface person that submits to data application；
Push demand and application environment in application, one-to-one push or one-to-many push, it is real by target is received
Whether example often connects, and whether push example linking Internet end and object instance linking Internet end are same linking Internet
The selection of the condition criterions such as operator passes through 0 or multiple relaying example propelling datas；
Described example is by name registration and logs in be mutually distinguishable the title of push source, relaying and object instance and IP
Address；
When automation data pushes the general failure that can temporarily skip of appearance in processing procedure and occurs expendable
Exception reporting is sent during abnormal failure respectively；
Each example full bi-directional mode of operation, can push and receive simultaneously.
The present invention also provides a kind of more trunk interconnection net big data supplying systems, including：
Data-pushing module, for pushing target data to another example from an example of system；
Data reception module, the data that an example push comes in reception system；
Task management module, centered on the goal task of propelling data, to the related process module progress around task
United Dispatching, and management role record and execution status of task；
Data preprocessing module, for checking the data that will be pushed, and task description data are generated, according to need
Carry out the compression of target data；
Data buffering memory management module, for being managed to pretreated data and the data received, magnetic
Disc storage space deficiency alarm simultaneously starts relevant treatment program；
Data Verification module, be compared for the data that receive with push initial data, the result determine into
Enter task to complete or enter to perform flow again；
Interface administration module, for receiving data-pushing task, the data of reception are submitted to destination application, sending
Information and reception manual intervention control information during intermediate treatment；
Name registration service module, for providing name registration, registration and the address lookup of example；
Network detection module, for detecting net between computer network interface card working condition, internet connection status and example
Network connection status, network connection is automatic after disconnecting to recover connection.
Key operations in the inventive method and system --- " data-pushing ", uploaded different from usually said data,
Download.Push is that directly content need not be confirmed to user, reception.Push sender has whip hand, and recipient is
Passive；And recipient is needed actively to be downloaded operation after uploading data.
Above-mentioned more trunk interconnection net big data method for pushing and system can be transported using infinite copy copy as example one by one
Row in institute it is in need push and receive big data computer on, all processes are based on automatic business processing, target data and task
Be compressed coding push, push front and back end carries out highly reliable comparison of coherence, realize on the internet it is completely reliable,
High efficiency, automatically push big data；By one or more levels relaying push, the data between linking Internet operator are avoided
Passage bottleneck, is effectively utilized ADSL asymmetry in one-to-many push, is also different from present using data center as core
Upload and download pattern, simplify deployment, reduce cost, the raising in performance and stability is obtained while reducing complexity,
Network resource utilization is higher simultaneously.
Before present system stable operation, big data stable biography on the internet that common wide accesses is not found always
Defeated or propelling data method, lettergram mode, FTP modes, each cloud storage upload the modes such as download and are all unable to meet demand,
Data are pushed or transmitted under above-mentioned condition and mode reach 10GB or so begin to meet difficulty.Present inventor has performed one section
The direct experiment for pushing or transmitting data by TCP/IP connections of time, runs into many problems, for example interconnect access carrier
Between can not connect, data channel bottleneck very little, network normal off line etc..After present system stable operation, in concrete application
In completed automation and push 1,000,000 256KB -5GB medical image class and the file of correlation, after data reach target
It is completely the same with push source data, being capable of normal use.According to operational monitoring, the internet of the machine of some push example operations
The average 2-3 minutes meeting short interruption of connection is once；But present system still can for a long time, stably, automatically propelling data
Data.
Beneficial effects of the present invention：Completely reliable, high efficiency is realized on the internet, automatically pushes big data；
Disposed simplifying, reduce cost, also improve performance and stability while reducing complexity, network resource utilization is also more
It is high.
Brief description of the drawings
Fig. 1 is the basic flow sheet of more trunk interconnection net big data method for pushing of embodiment；
Fig. 2 is the task management flow chart of more trunk interconnection net big data method for pushing of embodiment；
Fig. 3 is the task record structure and flow chart of more trunk interconnection net big data method for pushing of embodiment；
Fig. 4 is that a pair two of more trunk interconnection net big data method for pushing of embodiment push away, tape relay pushes application flow
Schematic diagram；" example " represents a copy of present system；
Fig. 5 is the relaying push schematic flow sheet of more trunk interconnection net big data method for pushing of embodiment；
Fig. 6 is the data verification schematic flow sheet of more trunk interconnection net big data method for pushing of embodiment；
Fig. 7 is the general structure schematic diagram of more trunk interconnection net big data supplying systems of embodiment；
Fig. 8 is the interface administration module internal cell structure signal of more trunk interconnection net big data supplying systems of embodiment
Figure；
Fig. 9 is the name registration inside modules cellular construction signal of more trunk interconnection net big data supplying systems of embodiment
Figure；In one embodiment, present system is deployed in each place of access internet, between each other according to user's needs
Propelling data, because linking Internet is more without based on fixed IP, to be identified between each other by a unique title.The name
Claim use before register, behind introduce in be referred to as instance name or site name；
Figure 10 is that the task management module internal cell structure of more trunk interconnection net big data supplying systems of embodiment shows
It is intended to；
Figure 11 is single inside the data buffering memory management module of more trunk interconnection net big data supplying systems of embodiment
Meta structure schematic diagram；
Figure 12 is that the Data Verification module internal cell structure of more trunk interconnection net big data supplying systems of embodiment shows
It is intended to；
Figure 13 is the sequential logic schematic diagram of the more trunk interconnection net big data supplying systems of embodiment.
Embodiment
1~13 pair of following examples combination accompanying drawing implementation technical scheme of the invention is further elaborated on.
More trunk interconnection net big data method for pushing include：
See Fig. 1, be the basic flow sheet of more trunk interconnection net big data method for pushing.
Step S101, push task is received, and interface management task manager is given push task；Basic job order
Position is a file or a catalogue；
The gateway of step S110, interface management, task data and message.Receive the propelling data entered from step S101
Task, the data received are submitted by step S191, are occurred in whole more trunk interconnection net big data method for pushing handling processes
Need to remind or the message that alerts from step S105 by exporting here, the control message of manual intervention is equally input to from S105
Here, and it is submitted to following task management process S130.
Data to be pushed are put into embodiment the push buffer directory specified, such as " D:\
SendingBuffer " catalogue.It is possible to further which data directory title to be pushed is put into the file specified, such as：
“D:SendingTask PacketTasks_IncludeAllSubDirs.txt ", all specific items below such assigned catalogue
Record can be all pushed away.
In embodiment, the destination address title of push can specify in buffer directory to be pushed, such as：“D:\
SendingBuffer medical image backup center ", wherein " medical image backup center " is a destination address title, put
Content below the catalogue can be pushed on the computer of " medical image backup center " this example operation.
Step S120, instance address title management, one of them has the calculating of fixed ip address or fixed domain name sensing
The example run on machine receives registration, logs in and inquire about, referred to as name registration Service Instance；Other instance names log in, IP
Address updates and the address name and IP address of inquiry push task relevant party.
In embodiment, the security of push and reception example is controlled by name registration Service Instance, that is, carries out title
Examination ＆ verification, login password authentication.
Step S130, pushing and receiving for task is managed, wherein specific management process is as follows：
See Fig. 2, be the task management flow chart of more trunk interconnection net big data method for pushing of embodiment.
Step S210, push task is received, and the basic description information of task is stored in task entity record table, into waiting to push away
Send task queue.Task record flow and structure are shown in Fig. 3.
Step S220, take out ancestral task in task queue to be pushed and give process of data preprocessing, monitoring and management are pre-
Process after processing, the task data to be pushed for further having standardized and having refined after pretreatment is registered and updates shape
State；The step for generate task record file, with further reference to S330；
Task status includes in embodiment：Wait, be ready to, pushing progress, reception is carried out, finished receiving, having pushed
Into, hang up, stop, retry；
It is to treat the number of files included in push task, file size, document time in embodiment Playsization and refinement
Analyzed and recorded, generate assignment file, push process performs suitable method for pushing according to assignment file；
Step S230, data-pushing processing procedure is given ready assignment file and push task data, monitoring is appointed
Business data-pushing progress, and update progress status；
Step S240, Monitoring Data receive process, receiving for task is added to task master record table, and updates the data and connect
Receipts state；
Step S250, data validation process is called, the data for pushing and receiving are verified, be proved to be successful into completion
Flow or relaying push flow, authentication failed are gone further data-pushing flow again；
Step S260, push are completed, and state and break data processing after the completion of push instance processes task, are received real
Example logger task state simultaneously passes through interface management S110：Process submits the data received.
The structure and flow for pushing task record are described as follows：
See Fig. 3, be the task record structure and flow chart of embodiment method.
Step S320, push task is received from S101 and S210, the main description information of task recorded main task record sheet
In；The main description information of task is similarly write main task record sheet when receiving push task from S240.
In embodiment, main task description information includes：Mission number, push person, recipient, current location, progress shape
State, retry state, priority, task type, task size, task time, task data original position, buffered data position, appoint
Business customer number, task correlation number.
Step S330, in S140 and S220 generation assignment files, the specific exercisable pushed information of one task of record.
Assignment file includes but is not limited to following information in embodiment：The file header of description task main information and treat
Pushing files list information, wherein including：File name, size and time attribute, subtask ID, working condition, compression code,
MD5 is encoded.
One main task generally comprises multiple subtasks, that is, main task is a catalogue file collection, and subtask is one
Individual file.MD5 (Message Digest Algorithm, Message Digest Algorithm 5) is used for data consistency checking.
In embodiment, compression code 0 represents uncompressed, and 1 represents the ZIP compressions of standardization, and other compression codes are by pushing away
Send and defined with recipient's application program.
Record push piece segment information in step S340, S160 and S170 implementation procedure.
In embodiment, S160 often pushes a successfully packet, the record information in fragment log file.Whenever push
When midway Network Abnormal disconnects or other problemses cause to interrupt, recover first to attempt to recover to push from interruption position again, if connect
If debit approves, continue to push, otherwise from the beginning.Although processing mode is different, " breakpoint continues this process with current
Biography " technology has same effect.
Step S140, to carrying out overcompression or other numbers encoded after propelling data pre-processes and receives propelling data
According to being recovered.The example of push role is worked in, is extracted simultaneously in push preprocessing process and treats that propelling data summary info is mended
Be charged to main task record sheet, generate assignment file, task status, which enters, gets out state, by task management process S130 dispatch into
Enter following push flow.
Step S150, it is pretreated to process to treat propelling data, assignment file, push fragment log file, receive
Data and program process caused by ephemeral data be managed.It is therein management operation include storage space management,
Stale data cleaning, file and data storage, reading.
Such as in embodiment, the buffered data storage dish of the computer of an example operation is 100GB, and ADSL broadbands connect
Enter the about daily 8GB-10GB of propelling data, mass data periods of months or longer push and relaying produces ephemeral data and held very much
Easily buffered data storage dish is filled with, there may be exception, including computer operation system for each link during memory space inadequate
System.Step S150 effectively controls buffered data storage dish excessively to use.
Step S160, is dispatched by S130, and data to be pushed are extracted from S150, are communicated by TCP/IP, are found from S120
Destination address or relay address IP are pushed, assignment file and target data are pushed to next destination address.
In embodiment, the primitive each pushed is 4KB, if remaining data is less than 4KB, by actual number
Pushed according to size, but be not less than 48byte；If remaining data less than 48byte, behind mend " 0 ".
Further, more last step S160 processing procedures, increase primitive size, attempt increase every time
512Byte,, can be increase before better than increase with carrying out the comparison under comparable conditions before increase after increasing 3-5 days
Size afterwards is as primitive size.Most suitable primitive size is found by this principle, but scope exists
2KB——32KB。
Step S165, the uniformity of the data after verifying the source data being pushed and arriving at, checking are divided into from small
To big checking step by step and overall checking, wherein it is as follows specifically to introduce flow：
Fig. 6 is the data verification schematic flow sheet of embodiment.
Step S610, extract push task summary info, including assignment file quantity, task total size, Data Position,
File name list, the size of each file, the MD5 codes of file；
Step S620, propelling data fragment consistency checking, and breakpoint can succession checkings after recovering.Often push is completed
One data slot, verifies its consistency immediately；Lead often interrupt push after recover again push when, detection both sides succeed push
Data slot, find consistent point and recover push；
Step S630, pushing files consistency checking：A file is completed in push, and source file data are verified by MD5 codes
With the uniformity for the file data for reaching target ground；
Step S640, push task totally verify, after each file subtask is proved to be successful, main task confirm checking into
Work(；
Step S650, is reaffirmed in batches：Flow is once reaffirmed in batches after a collection of task is completed in push.
Basic process is to push the file for one XML format of task summarization generation that example confirms needs, is pushed to data-pushing mesh
Example is marked, object instance requires to confirm whether data are normal using the application program of target data after receiving, then result
Return to push example.The flow is filled in a form as the taskpad in routine work confirmation.
After S650 checkings flow further avoids data from being correctly pushed to destination address, due to data application person's miscarriage
Loss of data caused by a short time or damage.Such as：Target data application person causes loss of data in unloading data procedures, or
Person's maloperation in the case of no backup have modified initial data.
In embodiment, batch of data is completed in push, in 15 minutes during no reception new task, is automatically initiated and is once criticized
Amount is reaffirmed；12 points of every night automatically initiates once to be reaffirmed in batches；Generation report after reaffirming successfully in batches,
By S105, the administrative staff specified are notified in the form of mail, wechat etc..If buffer-stored disk space is less, completely
Task correlation ephemeral data after pushing successfully is eliminated immediately.
Step S170, kept for one with data-pushing example or upper relaying example and be often connected, the number for waiting push
According to and receive data.
, will be by task management process when the reception data that one pushes task are completed and after by checking in embodiment
S130 enters the flow of next step.From logic flow, it is real that relaying push is pushed to next target again after finishing receiving
Example, is this process below：
See Fig. 4, be that a pair two of the more trunk interconnection net big data method for pushing of embodiment push away, tape relay pushes application flow
Schematic diagram.
In embodiment：
S410 represents the execution example that source data is pushed, and when a push task occurs, first object is example 3
(S430) assignment file and target data, are pushed respectively；Second target is example 5 (S450), only pushes assignment file, number of targets
According to not repeatedly push；
S420 is a relaying flow, and the flow receives the laggard row buffering storage of data, one of assignment file sum
First aim S430 is pushed to according to copy；When receiving second push assignment file, because target data is buffering
In, assignment file and target data are directly pushed to next target S440；
S430 is a data receiving stream journey；
S440 is a relaying flow, similar S420, turns to push the difference is that S440 belongs to direct repeating system.
S450 is a data receiving stream journey, identical with S430.
In embodiment, solve the data channel bottleneck problem between different linking Internet operators, be below implementation
Method：
See Fig. 5, be that the relaying of embodiment pushes schematic flow sheet.
In embodiment：
S530 is a relaying instance processes flow；S531 represents propelling data from linking Internet operator
Line attachment, S532 represent the line attachment propelling data from another linking Internet operator.So each push and connect
Linking Internet connection between the pairing example of receipts is all same access carrier, and pushing speed and stability have substance
Lifting.
In embodiment, the method that path is selected in multilevel relay push is that one-level relaying is a fixed instance name
Address, the push destination address of push person are the instance names of two level relaying, and it is real that two level relaying sets next stage to turn push target
Example, by that analogy, is finally pushed to target location.
Such as：Source data push instance name is Zhang San, pushes the entitled Li Si of object instance.Actual push route is real
Example title=Zhang San → instance name=service → instance name=mobile UNICOM's relaying → instance name=Li Si.Wherein one-level
Relaying is used as a fixed instance name, and two level relaying is specified to be relayed by another Instance Name in name registration and pushed.
Step S180, internet connection status is detected, whether can find, detection pairing work if detecting the example of pairing work
The connection status of the example of work.
Step S191, normal work information and abnormal failure feedback of the information to administrative staff, and receive administrative staff
The management code of transmission.
In embodiment, reserved cell-phone number, WeChat ID when according to name registration and auditing, wechat concern embodiment are specified
Public service number after, S191 call Tencent wechat message push interface, data-pushing progress msg is issued management
Personnel.Same mode, S191 can receive the control information that administrative staff send and transfer to task management flow.Custodian
The identity of member confirms that anti-locking system is attacked by information during name registration.
Such as：" on Monday on January 11st, 2016, today, you received the batch of data come from the push of XXX hospitals：General assignment
Number：480, total files：3680, total size：8.65GB, failure quantity：0”.
For another example：“XXX：There is a collection of propelling data to you, but your website is not connected with, it may be possible to network failure or computer
It has been shut down that, please check.”
In embodiment, control routine：
！11：Submit Top Line Report；
！12：Submit memory space situation；
！13：Submit push Task Progress；
！14：Submit and receive Task Progress；
！77=【Customer number】>【Instance name】：The task for the customer number that client is specified turns to be pushed to the reality specified
Example title.
Customer number is generated by application person, may be repeated in embodiment, but for one pushes example, uses this
A number oneself easily identified is arranged during invention system propelling data, is not repeated generally.
Control routine is not particularly limited and implication, is only a kind of agreement.
Further, control message includes multiple parameters, and middle symbol " ^ " separates, each section of first symbol table
Show the type of message in section, symbol "！" represent to perform, " P " represents control password.In true running example, control message all bands
There is password；Only control password normally can just be acted accordingly.
More trunk interconnection net big data supplying systems based on the above method, as shown in fig. 7, comprises：Interface administration module
710th, network detection 714, name registration service module 718, task management module 722, data preprocessing module 726, data push away
Send module 730, Data Verification module 734, data buffering memory management module 738, data reception module 742.In embodiment,
A minimum of three copies of system, hereinafter referred to as example, run on the computer of more than three of access internet, a computer
An example is run, wherein a computer there are fixed IP or fixed domain name mappings to point to.
In practical application, the application for having big data push demand can install an example, register instance name and step on
Can push or reception data after record.Can so there is unlimited number of example in an Application Example.
The effect of above-mentioned each module is as follows：
Interface administration module 710 receives data-pushing task, the data of reception are submitted to destination application, sent
Between message and receive manual intervention control information in processing procedure, wherein comprising with lower unit：
See Fig. 8, be the interface administration module internal cell structure schematic diagram of embodiment supplying system, wherein：
Interface management unit 7101, for unit in management interface management module, interface shape can have more
Change, is increased according to demand；
Windows messaging task is received with submitting unit 7103, with windows message mechanisms sendmessage
(windows hairs close message basis function) function receives push task, and is sent out after receiving data by windows message mechanisms
Put up a notice.Message code is WM_COPYDATA=$ 004A, data directory or file parameters to be pushed, and finish receiving
Data directory, file PCopyDataStruct structure transmission；
Windows API tasks, which receive, submits unit 7105, and push is received by API (application programming interface) mode
Task and submit finish receiving after data.The parameter of push interface function includes object instance title, task type, push mesh
Mark data directory or file, the option for whether including subdirectory；Receiving the parameter of data notification function includes task type, push
Person, data directory or file；
Fixed position task extraction unit 7107, timing automatic check specifies catalogue to be pushed, if it find that have data,
With regard to extracting and submitting push；Manage the data submitted but also unconfirmed being sent to；
Message pushes and message control unit 7109, occurs needing the message reminded or alerted in whole system handling process
Managed by sending, while receive the control message of manual intervention, task management module is submitted to after parsing；
In embodiment, the message push of management type is sent in the form of mail, wechat etc..Such as：Push is completed a collection of
Data, distant place propelling data have been sent, data have reached, relay turn the information such as propelling data amount report related example custodian；
The classes that give a warning such as the failure that necessary example is not keyed up occurring automatically recovering in operation, data-pushing and processing procedure disappear
Cease the cell-phone number registered to related example custodian in name registration, WeChat ID and e-mail address；
In embodiment, unit 7109 increases communication module, can receive SMS, example manual intervention control message
Sent with mobile phone short messages.
Name registration service module 718, there is provided name registration, registration and the address lookup of example；System main advantage exists
Most of big data, ADSL broadbands is pushed between ADSL broadband internet incoming ends does not have fixed ip address, therefore the module
Not only admin instance title, Mobile state renewal is also entered to the IP address of example.The module is included with lower unit：
See Fig. 9, show for the name registration inside modules cellular construction of the more trunk interconnection net big data supplying systems of embodiment
It is intended to.
Name registration unit 7181, registration instance name, set whether password, detection title repeat；Example is the system
One operation copy, with we be accustomed in a system user it is close but incomplete same, be a kind of use of specific type
Family；
Further, when increasing Subscriber Management System in embodiment, the instance name of registration can be with association user name, phase
Mutually binding, association user can be notified by having during associated message；User can also manage associated instance title；
Title audits unit 7183, is a selectable unit, and whether the example of responsible examination ＆ verification registration is normal and allow
Add；
Title applying unit 7185, there are three functions：IP address after more new change, pass through registration when example brings into operation
Instance name and login password login authentication, search push object instance title and address.Push and the safety for receiving example
Thus property controls, i.e. propelling data must reach real object instance, without being intercepted.
Task management module 722 is centered on the goal task of propelling data, to the related process module around task
Carry out United Dispatching, and management role record and execution status of task；Including with lower unit：
See Figure 10, show for the task management module internal cell structure of the more trunk interconnection net big data supplying systems of embodiment
It is intended to.
Task record table administrative unit 7221, manages the main task record of push, and main task record represents that a push is appointed
The basic description information of business, such as Data Position, form, size, task state of progress etc..In embodiment, master record table is adopted
It is managed with relevant database, type of database is unlimited, such as can be ACCESS, SQLServer of Microsoft etc.,
But because the main advantage of the present invention is the data-pushing between extensive linking Internet end, example deployment is extremely simple,
Direct copying downloads decompression can operation, and can enters working condition after login, therefore uses data base administration director
During business record, prioritizing selection ACCESS one kind installation process does not need the database of manual intervention；
Further, in order to improve versatility and reduce installation difficulty, unit 7221 provides main task record sheet management energy
Power, including increase, delete, inquiring about, extracting, the function of mobile main task record；
Thread-management unit 7223, according to the execution state of progress of task, the execution thread in modules is dispatched, is coordinated
The logical sum data flow of the cross-thread concurrently performed, complete push task.Than waiting task, data prediction if any substantial amounts of
Data prediction thread in module is pre-processed, and has ready number when propelling data in log-on data pushing module
According to push thread, in data reception module network connection and etc. propelling data thread to be received be in listening state, data preparation
With finish receiving after call data verification thread, multithreading collaboration, concurrent efforts, to improve efficiency.
Task status administrative unit 7225, the working condition of management push tasks carrying process.Set according to according to progress
Task status is pushed, such as wait state, push state, push carry out state is got out, receives carry out state, finishes receiving shape
State；Further, according to the returning result of current state, and Current transaction, next state value is determined, such as in wait state,
First time data prediction have failed, it may be possible to which file is just occupied, by trial and success three times, then next state
It is to retry state；If have attempted to ten times it is also unsuccessful, next state is failure abort state；
Task status in various embodiments may be different, is not limited only to the state description occurred in the present embodiment；
Affair managing unit 7227, manage course of normal operation in summing-up work report generation, push process and
The generation of the general message, warning class message, failure classes message that occur in correlated process, and administrative staff's manual intervention disappear
Breath performs scheduling.
Data preprocessing module 726, after propelling data pre-process and receive propelling data after to carry out overcompression or its
The data that he encodes are recovered, and extract and generate the summary info for treating propelling data, generate main task record description data, raw
Into assignment file；A data prediction thread is included in this module, above-mentioned processing performs in thread, can be with other threads simultaneously
Row performs；
Data-pushing module 730, thread is handled comprising a data-pushing, is extracted from pre-processing in ready buffering area
Propelling data is treated, by ICP/IP protocol, connects the example of next present system, and number is pushed to it with ICP/IP protocol
According to.Module 730 records propelling data bag summary, the function of breakpoint recovery push；
Data Verification module 734, there is provided data slot or be packet, single file, in a catalogue All Files and
The data verification function of a collection of task, including with lower unit：
See Figure 12, be the Data Verification module structural representation of the more trunk interconnection net big data supplying systems of embodiment.
Metadata digest information extraction unit 7341, there is provided search catalogue file, obtain assignment file quantity, total size, text
Part list, calculation document MD5 codes, CRC32 codes；
Data verification units 7343, there is provided data slot, file and file set based on basic file attributes, MD5 codes and
CRC32 uniformity comparison；
Breakpoint recovers authentication unit 7345, and the uniformity of push instance data push position record and data receiver record is tested
Card, and the receiving portion verification of correctness of a file；
Batch validation unit 7347, there is provided batch tasks reaffirm function：The mission bit stream of a collection of task is made a summary and given birth to
Into the batch validation application list file of an XML format, be pushed to push object instance, object instance receive after by batch validation
Whether list requirement records, correctly can use to user's checking data of target data one by one respectively, as a result insert application form, so
Result is returned to push example afterwards, receives the application form after checking, reads checking record, understands and phase inversion answers processing module.
Data buffering memory management module 738, to pretreated data, the data received and course of work data
It is managed, there is provided cache disk management, the data management of buffer-stored, buffered data accesses and the issued transaction of correlation, its
Include with lower unit：
See Figure 11, be single inside the data buffering memory management module of the more trunk interconnection net big data supplying systems of embodiment
Meta structure schematic diagram.
Buffer-stored disk management unit 7381, the state of disk storage space is monitored, clear up stale data, memory space
Start relevant treatment program when less, seldom；
Access visit administrative unit 7383, tissue treat propelling data, assignment file, the storage knot of intermediate buffering storage file
Structure, there is provided directory creating, file read-write, push fragment information record function.
Share and access unit 7385, washability processing unit, to the file of super large file, such as more than 500MB, there is provided wound
Build in ablation process, while the ability for relaying push again is read by another thread.
Data reception module 742, receive the data that the push of example comes in the system, wherein comprising a thread with
And TCP/IP network connection managements；When working in repeater mode, it is pushed to again after data verification is optionally passed through from flow
Next example, in slave module structure, subsequent treatment transfers to task management module decision-making.
Network detection module 714, for detecting between computer network interface card working condition, internet connection status and example
Network connection state, network connection is disconnected when postcondition possesses to recover to connect automatically.
The basic implementation procedure of embodiment is：(1) one of download system self solves briquetting, size about 2.0MB, self-extracting,
Automatic running；(2) instance name is registered, ID, site name, login system are also referred to as the ease of understanding；
(3) mode of one of which increase task, such as the choosing increase push task operating in task menu are selected, and selects one
Data directory, selection include subdirectory option, and type is packet, and click starts to push；(4) data-pushing relays to first
Example, this is one and installed and the system example of normal operation, alternatively referred to as services sites, although all examples are
The same, but the services sites is required with separate tP address, reliable network condition；Four domestic cloud services are rented at present
Device and an external Cloud Server take the role；After (five) first relaying examples complete a task reception, target is searched
Whether example or two level relaying example are movable, and the task data finished receiving is pushed to next stage example if activity, no
Then notify subordinate instance management people starts shooting to receive in a manner of mail or wechat；(6) two level relaying is if it exists, perform same
The same processing of 5th step；(7) after object instance finishes receiving task data, the uniformity of data is verified, circularizes data
User or the application program using data；(8) carry out push task after a collection of task of data-pushing side's completion and reaffirm stream
Journey, after the person that obtains data application confirms successfully, remove buffering ephemeral data and operational data；(9) broken down during all
When limited number of time attempt automatic recover.
See Figure 13, the sequential logic schematic diagram of the more trunk interconnection net big data supplying systems provided for the present embodiment, use
To further illustrate example operation principle and flow.800 represent task entrance；810 represent the push work role of system example；
812 represent the main relaying role with fixed ip address of system example, and the usual relaying is as substantial amounts of push application example
" " center ", each application example find presence and the address of object instance by the relaying；814 represent in the inter-network of system example
After work role, running the computer of present example has two or more network interface cards, connects the network of diverse access point respectively；
816 be the data receiver work role of system example, is the data-pushing destination of a push flow, but flow is not tied also
Beam；821 represent taskings and data prediction flow, and taskings include generation main task record sheet, assignment file, task
Description is submitted to next relaying, and data prediction flow is shown in noted earlier；822 be data buffering storage management flow；823 are
Data-pushing flow；824 be data receiver flow；825 be data recovery and data verification flow, and data recovery is included to compression
Or the data recovery that recompiles was carried out to initial state；826 be that data are finally sent to flow, sees S110 and S191；828 are
Attempt to repair the handling process pushed, start trial when returning to push failed message from push target and repair push flow, review
The data of front and back end are pushed, search discrepancy；829 complete follow-up processing flow for push, comprising message informing push people, receive
People, delete the ephemeral data not used；830 represent to repair push implementation procedures, equivalent to pushing flow again, but have pushed away
Send successful data to be not repeated to push, actually push flow and include this function.
One workflow includes 2-4 example, is 810,812,814,816 respectively, wherein in most cases 814 can be with
Omit, it is actual to include three examples.Operation principle is readily appreciated that from sequential logic schematic diagram, supplements the flow of elaboration here
It is：After data arrive at, success or failure is confirmed according to data verification flow, assignment file is inversely pushed to return push
Side；If data verification success, push main task terminates, but flow does not terminate, i.e., assignment file will also return to push side.
One embodiment of the present of invention is the foregoing is only, is only used for explaining the present invention, the present invention can not be limited with this,
It is all the present invention thought and method in the range of, any modification, the improvement made, should be included in the scope of protection of the invention it
It is interior.Module and unit in the present invention, quantity can both exist in the form of single, and form that can also be multiple is present, the present invention
It is defined not to this.Step label and module, element numerals in the present invention do not represent the sequencing of flow.
Claims (4)
- A kind of 1. more trunk interconnection net big data method for pushing, it is characterised in that basic process：Sequencing or manual operations receive big data push task, carry out tissue and pretreatment to task, pretreatment is waited to push away Send data to be managed, next reception example is pushed data into by data-pushing thread under task management coordination, finally Data are carried out with consistency checking after reaching push destination address, confirmation pushes successfully, receives example and passes through the data received Interface submits to data application person, and perform according to the following steps:Step S120, instance address title management, one of them has on fixed ip address or the computer of fixed domain name sensing The example of operation receives registration, logs in and inquire about, referred to as name registration Service Instance；Step S130, pushing and receiving for task is managed, wherein specific management process is as follows：Step S210, push task is received, and the basic description information of task is stored in task entity record table, task deposit is treated Push task queue；Step S220, take out ancestral task in task queue to be pushed and give process of data preprocessing, monitoring and management pretreatment Process, the task data to be pushed for further having standardized and having refined after pretreatment is registered and more new state；This Step generates task record file, with further reference to S330；Task status includes：Wait, be ready to, pushing progress, receiving and carry out, finish receiving, pushing completion, hang-up, termination, again Examination；Step S230, data-pushing processing procedure is given ready assignment file and push task data, monitors number of tasks According to push progress, and update progress status；Step S240, Monitoring Data receive process, receiving for task is added to task master record table, and updates the data reception shape State；Step S250, data validation process is called, the data for pushing and receiving are verified, be proved to be successful into completion flow Or relaying push flow, authentication failed are gone further data-pushing flow again；Step S260, push are completed, and push the state and data after the completion of instance processes task, receive example logger task shape State and by interface management S110 processes by the data received the person that submits to data application；The structure and flow for pushing task record are described as follows：Step S320, push task is received from S101 and S210, task description information record is into main task record sheet；From S240 Task description information is similarly write main task record sheet when receiving push task；S101 is the entrance for receiving push task；Main task description information includes：Mission number, push person, recipient, current location, progress status, retry state, be preferential Level, task type, task size, task time, task data original position, buffered data position, task customer number, task phase Close numbering；Step S330, in S140 and S220 generation assignment files, the specific exercisable pushed information of one task of record；Assignment file includes following information：The file header of description task main information and pushing files list information is treated, wherein Comprising：File name, size and time attribute, subtask ID, working condition, compression code, MD5 codings；One main task generally comprises multiple subtasks, that is, main task is a catalogue file collection, and subtask is a text Part, MD5 are used for data consistency checking；Compression code 0 represents uncompressed, and 1 represents the ZIP compressions of standardization, and other compression codes apply journey by push and recipient Sequence defines；Record push piece segment information in step S340, S160 and S170 implementation procedure；S160 often pushes a successfully packet, the record information in fragment log file；Whenever push midway Network Abnormal breaks Open or when other problemses cause to interrupt, recover first to attempt again to recover to push from interruption position, if recipient approves, after Continuous push, otherwise from the beginning；Step S140, the data for carrying out overcompression or other codings are entered after propelling data pre-processes and receives propelling data Row recovers；The example of push role is worked in, is extracted simultaneously in push preprocessing process and treats that propelling data summary info adds to Main task record sheet, assignment file is generated, task status, which enters, gets out state, under being entered by task management process S130 scheduling The push flow in face；Step S150, to treating propelling data, assignment file, push fragment log file, the number received by pretreated Ephemeral data is managed according to this and caused by program process；Management operation therein includes storage space management, expired Data scrubbing, file and data storage, reading；Step S160, is dispatched by S130, and data to be pushed are extracted from S150, are communicated by TCP/IP, and push is found from S120 Destination address or relay address IP, assignment file and target data are pushed to next destination address；Step S165, the uniformity of the data after verifying the source data being pushed and arriving at, checking are divided into from small to large Checking step by step and it is overall verify, wherein idiographic flow is as follows：Step S610, extract the summary info of push task, including assignment file quantity, task total size, Data Position, file Name list, the size of each file, the MD5 codes of file；Step S620, propelling data fragment consistency checking, and breakpoint can succession checkings after recovering；Often push completes one Data slot, its consistency is verified immediately；Lead often interrupt push after recover again push when, detection both sides succeed push data Fragment, find consistent point and recover push；Step S630, pushing files consistency checking：A file is completed in push, verifies source file data with arriving by MD5 codes Up to the uniformity of the file data on target ground；Step S640, push task is totally verified, after each file subtask is proved to be successful, main task confirms to be proved to be successful；Step S650, is reaffirmed in batches：Flow is once reaffirmed in batches after a collection of task is completed in push, its mistake Journey is to push the file for one XML format of task summarization generation that example confirms needs, is pushed to data-pushing object instance, Object instance requires to confirm whether data are normal using the application program of target data after receiving, then result is returned to and pushed away Send example；After S650 checkings flow further avoids data from being correctly pushed to destination address, because data application person's miscarriage is short-term Loss of data caused by interior or damage；Step S170, kept for one with data-pushing example or upper relaying example and be often connected, wait the data that push comes simultaneously Receive data.
- 2. the method as described in claim 1, it is characterised in that push demand and application environment in application, it is one-to-one to push away Send or one-to-many push, by receiving whether object instance often connects, push example linking Internet end interconnects with object instance Whether net incoming end is same linking Internet operator to judge selection by 0 or multiple relaying example propelling datas, And perform according to the following steps:S410 represents the execution example that source data is pushed, and when a push task occurs, first object is example 3 (S430), Assignment file and target data are pushed respectively；Second target is example 5 (S450), only pushes assignment file, and target data does not weigh Multiple push；S420 is a relaying flow, and the flow receives the laggard row buffering storage of data, one of assignment file and data pair Originally it is pushed to first aim S430；When receiving second push assignment file, because target data is in buffering, directly Connect an assignment file and target data is pushed to next target S440；S430 is a data receiving stream journey；S440 is a relaying flow, belongs to direct repeating system and turns push；S450 is a data receiving stream journey, identical with S430；The implementing method for solving the data channel bottleneck problem between different linking Internet operators is：S530 is a relaying instance processes flow；S531 represents access of the propelling data from a linking Internet operator Circuit, S532 represent the line attachment propelling data from another linking Internet operator；There is S530 S531 and S532 to connect Enter the line attachment of the Liang Jia linking Internets operator of internet；It is mutual between the pairing example for so each pushing and receiving Networking access connection is all same access carrier；The method that path is selected in multilevel relay push is that one-level relaying is a fixed instance name address, and push person's pushes away The instance name that destination address is two level relaying is sent, two level relaying sets next stage to turn push object instance, by that analogy, finally It is pushed to target location；Step S180, internet connection status is detected, whether can find, detect pairing work if detecting the example of pairing work The connection status of example；Step S191, normal work information and abnormal failure feedback of the information to administrative staff, and receive administrative staff's transmission Management code.
- 3. the method as described in claim 1, it is characterised in that the primitive each pushed is 4KB, if remainder During according to less than 4KB, pushed by real data size, but be not less than 48byte；If remaining data less than 48byte, behind mend “0”；Further, more last step S160 processing procedures, increase primitive size, attempt increase every time 512Byte,, can be increase before better than increase with carrying out the comparison under comparable conditions before increase after increasing 3-5 days Size afterwards is as primitive size；Find most suitable primitive size by this, but scope 2KB- 32KB。
- 4. a kind of supplying system, for method for pushing as claimed in claim 1, including：Data-pushing module, for pushing target data to another example from an example of system；Data reception module, the data that an example push comes in reception system；Task management module, centered on the goal task of propelling data, to carrying out unification around the related process module of task Scheduling, and management role record and execution status of task；Data preprocessing module, for checking the data that will be pushed, and task description data are generated, entered as needed The compression of row target data；Data buffering memory management module, for being managed to pretreated data and the data received, disk is deposited Storage insufficient space alarm simultaneously starts relevant treatment program；Data Verification module, the data for receiving are compared with push initial data, determined according to the result of comparison Complete program into task or enter to perform flow again；Interface administration module, for receiving data-pushing task, the data of reception are submitted to destination application, sending centre Information and reception manual intervention control information in processing procedure；Name registration service module, for providing name registration, registration and the address lookup of example；Network detection module, connect for detecting network between computer network interface card working condition, internet connection status and example State is connect, network connection is automatic after disconnecting to recover connection.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610111050.6A CN105791399B (en) | 2016-02-29 | 2016-02-29 | More trunk interconnection net big data method for pushing and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610111050.6A CN105791399B (en) | 2016-02-29 | 2016-02-29 | More trunk interconnection net big data method for pushing and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105791399A CN105791399A (en) | 2016-07-20 |
| CN105791399B true CN105791399B (en) | 2018-02-09 |
Family
ID=56403886
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610111050.6A Active CN105791399B (en) | 2016-02-29 | 2016-02-29 | More trunk interconnection net big data method for pushing and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105791399B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20220342731A1 (en) * | 2021-04-26 | 2022-10-27 | Visa International Service Association | System and method for timed data transmission |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107707328B (en) * | 2016-08-08 | 2020-11-24 | 北京京东尚科信息技术有限公司 | Abstract information transmission method and device |
| CN108241616B (en) * | 2016-12-23 | 2023-07-25 | 阿里巴巴集团控股有限公司 | Message pushing method and device |
| CN107844575B (en) * | 2017-11-06 | 2021-10-15 | 国家计算机网络与信息安全管理中心 | Personal data sharing system and method for Internet financial platform |
| CN109067690B (en) * | 2018-08-07 | 2021-03-26 | 腾讯科技（深圳）有限公司 | Method and device for pushing offline calculation result data |
| CN112752353B (en) * | 2019-10-31 | 2022-06-10 | 中移物联网有限公司 | Connection method and terminal equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1771701A (en) * | 2003-04-11 | 2006-05-10 | 艾利森电话股份有限公司 | Multi-user diversity forwarding |
| CN102571565A (en) * | 2010-12-24 | 2012-07-11 | 株式会社日立制作所 | Packet transport node |
| CN103209435A (en) * | 2013-03-15 | 2013-07-17 | 河海大学 | Congestion control based wireless multi-hop network multicast method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| SG177957A1 (en) * | 2007-01-08 | 2012-02-28 | Freesystems Pte Ltd | A multi-node media content relay system |
-
2016
- 2016-02-29 CN CN201610111050.6A patent/CN105791399B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1771701A (en) * | 2003-04-11 | 2006-05-10 | 艾利森电话股份有限公司 | Multi-user diversity forwarding |
| CN102571565A (en) * | 2010-12-24 | 2012-07-11 | 株式会社日立制作所 | Packet transport node |
| CN103209435A (en) * | 2013-03-15 | 2013-07-17 | 河海大学 | Congestion control based wireless multi-hop network multicast method |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20220342731A1 (en) * | 2021-04-26 | 2022-10-27 | Visa International Service Association | System and method for timed data transmission |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105791399A (en) | 2016-07-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105791399B (en) | More trunk interconnection net big data method for pushing and system | |
| US11915281B1 (en) | Multiple data store authentication | |
| CN101711386B (en) | Synchronizing email messages between an external and/or local email server and/or a wireless device | |
| CN101194233B (en) | System and method of testing wireless component applications | |
| CN102193899B (en) | System and method for the data of the multiple environment of management spanning | |
| CN101355524B (en) | Method, system, server and terminal for processing information | |
| JP5246332B2 (en) | Enhanced messaging platform | |
| CN105357110B (en) | E-mail sending method, apparatus and system | |
| CN101043519B (en) | Network storage system | |
| US9442925B2 (en) | Regulated texting solution for mobile devices | |
| CN101132459A (en) | Method for computer remote control by mobile phone | |
| CN101854351A (en) | The system and/or the method that are used for measured transmission of messages | |
| CN102498486A (en) | System, server, and mobile device for content provider website interaction and method therefore | |
| CN101146051A (en) | An enterprise-level instant communication interconnection system and method for realizing enterprise interconnection | |
| CN101897204A (en) | System and method for facilitating the growth of a mobile community | |
| CN101310545A (en) | Internet mail client system for mobile devices using remote computer systems and method thereof | |
| EP2324605B1 (en) | A communication device | |
| CN1973282A (en) | System and method for managing a change to a cluster configuration | |
| CN108055199A (en) | Support the mobile method for pushing and system that deferred information preserves | |
| CN107274304A (en) | It is self-service to move in System and method for of checking out | |
| CN103078879B (en) | A kind of user's authentication registration system and method thereof | |
| CN101001213B (en) | Short message transmission system and method | |
| EP1993245A1 (en) | A system and method for realizing message service | |
| CN100558188C (en) | Message processing device, system and method | |
| CN114710311A (en) | Multi-project message management method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180428 Address after: 650000 B007 2, 11 building, Shilin street, Chenggong District, Kunming, Yunnan. Patentee after: Yunnan open secret science and Technology Co., Ltd. Address before: 650000 701 unit 1, 36 building, 343 Longquan Road, Kunming, Yunnan. Patentee before: Zheng Jialiang |