CN108898448A - A kind of ad data synchronous method and device - Google Patents
A kind of ad data synchronous method and device Download PDFInfo
- Publication number
- CN108898448A CN108898448A CN201810833142.4A CN201810833142A CN108898448A CN 108898448 A CN108898448 A CN 108898448A CN 201810833142 A CN201810833142 A CN 201810833142A CN 108898448 A CN108898448 A CN 108898448A
- Authority
- CN
- China
- Prior art keywords
- data
- synchronous
- storage system
- node
- processing platform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0277—Online advertisement
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Abstract
The present invention provides a kind of ad data synchronous method and devices, are related to network data synchronizing technical field.The ad data synchronous method includes：It is connected to storage system host node；The synchronization ad data of the storage system host node is written by flow data processing platform using collector；The synchronous ad data in the flow data processing platform is transmitted to by code calling module of each storage system from node using distributor.The method increase ad data synchronous reliability, concurrent stability and Information Securities.
Description
Technical field
The present invention relates to network data synchronizing technical fields, in particular to a kind of ad data synchronous method and dress
It sets.
Background technique
It is real compared with real advertising page etc. with the rapid development of Internet technology and electronical display terminal device and universal
Advertisement on body carrier, the selection of more and more advertisers user is more, spread speed faster, launch the lower interconnection of cost
The advertisement of electronic data type is launched in net.Therefore, with calculating the development of advertisement technology, calculating the development of advertising business, entirely
The core competitiveness for having become advertisement and launching manufacturer of technology is launched in nodularization advertisement.
But in the whole world of advertisement is launched, single service node can because network delay it is high, vulnerable to Network status shadow
It rings, the reasons such as server-side concurrency is big, is easy to appear situations such as advertising display speed is slow, advertising display failure rate is high, it can be very big
Influence advertisement launch effect.In order to guarantee service quality that the advertisement in each area in the whole world is launched, it is necessary to global each
Service node is all established in area, services each region nearby, and then more, service is launched technology there is also service nodes in existing advertisement
Device problem at high cost.
Summary of the invention
In view of this, the embodiment of the present invention is designed to provide a kind of advertisement placement method and device, it is above-mentioned to solve
In the prior art advertising data transmission vulnerable to more than network condition influence, ad placement services unstable quality, service node and
Server problem at high cost.
In a first aspect, being applied to host node server, institute the embodiment of the invention provides a kind of ad data synchronous method
Stating ad data synchronous method includes：It is connected to storage system host node；Using collector by the storage system host node
Flow data processing platform is written in synchronous ad data；Using distributor by the synchronous advertisement in the flow data processing platform
Data forwarding gives code calling module of each storage system from node.
It is comprehensive in a first aspect, it is described be connected to storage system host node before, the ad data synchronous method also wraps
It includes：Using the calling collector as storage system from node.
Synthesis is in a first aspect, described be written fluxion for the synchronization ad data of the storage system host node using collector
According to processing platform, including：The synchronization ad data sent based on master-slave synchronisation mechanism by the storage system host node is received,
The synchronous ad data includes the write operation to ad data；The synchronous ad data is written by flow data using collector
Processing platform.
Synthesis is in a first aspect, described turned the synchronous ad data in the flow data processing platform using distributor
Code calling module is issued, including：The synchronous ad data is read using distributor；Each storage system of concurrent invocation is from node
Code calling module, the synchronous ad data is transmitted to code calling module of each storage system from node.
Second aspect, the embodiment of the invention provides a kind of ad data synchronizing device, the ad data synchronizing device
Including：Link block, for being connected to storage system host node；Flow data processing platform writing module, for using collector
Flow data processing platform is written into the synchronization ad data of the storage system host node；Forwarding module, for using distributor
The synchronous ad data in the flow data processing platform is transmitted to code calling module of each storage system from node.
Comprehensive second aspect, the flow data processing platform writing module include：Receiving unit is based on principal and subordinate for receiving
The synchronization ad data that synchronization mechanism is sent by the storage system host node, the synchronous ad data include to advertisement number
According to write operation；Writing unit, for flow data processing platform to be written in the synchronous ad data using collector.
Comprehensive second aspect, the forwarding module include：Reading unit, for reading the synchronous advertisement using distributor
Data；Concurrent invocation unit, for each storage system of concurrent invocation from the code calling module of node, by the synchronous advertisement number
According to being transmitted to code calling module of each storage system from node.
Comprehensive second aspect, the ad data synchronizing device further include：From node writing module, for receiving code tune
With the calling of module, storage system is written into from node in synchronous ad data.
The third aspect, it is described computer-readable the embodiment of the invention also provides a kind of computer-readable storage medium
It takes and is stored with computer program instructions in storage medium, when the computer program instructions are read and run by a processor, make
It obtains the computer and executes above-mentioned method.
Beneficial effect provided by the invention is：
The present invention provides a kind of ad data synchronous method and device, the method includes：It is connected to storage system master
Node；The synchronization ad data of the storage system host node is written by flow data processing platform using collector；Using distribution
The synchronous ad data in the flow data processing platform is transmitted to each storage system and calls mould from the code of node by device
Block.
Ad data is carried out more from principal and subordinate's data between node are synchronous by storage system host node and storage system
Newly, the applicability of the ad data synchronous method is improved；This method only uses collector to connect with storage system host node, drop
The low load of storage system host node improves the synchronous reliability and stability of ad data.Further, pass through fluxion
According to the concurrent processing of the concurrent mechanism and distributor of processing platform, advertisement can be sent to greater amount of storage system from node
Data improve the synchronous efficiency of ad data；It transmits ad data by public network and connects without maintaining simultaneously, to network
Fluctuation has higher patience, further improves the synchronous reliability and stability of ad data；Meanwhile ad data is in public affairs
Online transmission uses the authentication mechanism of flow data processing platform, improves the safety of advertising data transmission.
Other features and advantages of the present invention will be illustrated in subsequent specification, also, partly be become from specification
It is clear that by implementing understanding of the embodiment of the present invention.The objectives and other advantages of the invention can be by written theory
Specifically noted structure is achieved and obtained in bright book, claims and attached drawing.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be to needed in the embodiment attached
Figure is briefly described, it should be understood that the following drawings illustrates only certain embodiments of the present invention, therefore is not construed as pair
The restriction of range for those of ordinary skill in the art without creative efforts, can also be according to this
A little attached drawings obtain other relevant attached drawings.
Fig. 1 is a kind of flow diagram for ad data synchronous method that first embodiment of the invention provides；
Flow data processing platform write-in step in a kind of ad data synchronous method that Fig. 2 provides for first embodiment of the invention
Rapid flow chart；
Fig. 3 is a kind of module diagram for ad data synchronizing device that second embodiment of the invention provides；
Fig. 4 is a kind of structure that can be applied to the electronic equipment in the embodiment of the present application that third embodiment of the invention provides
Block diagram.
Icon：100- ad data synchronizing device；110- link block；120- flow data processing platform writing module；
130- forwarding module；140- is from node writing module；200- electronic equipment；201- memory；202- storage control；At 203-
Manage device；204- Peripheral Interface；205- input-output unit；206- audio unit；207- display unit.
Specific embodiment
Below in conjunction with attached drawing in the embodiment of the present invention, technical solution in the embodiment of the present invention carries out clear, complete
Ground description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.Usually exist
The component of the embodiment of the present invention described and illustrated in attached drawing can be arranged and be designed with a variety of different configurations herein.Cause
This, is not intended to limit claimed invention to the detailed description of the embodiment of the present invention provided in the accompanying drawings below
Range, but it is merely representative of selected embodiment of the invention.Based on the embodiment of the present invention, those skilled in the art are not doing
Every other embodiment obtained under the premise of creative work out, shall fall within the protection scope of the present invention.
It should be noted that：Similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined in a attached drawing, does not then need that it is further defined and explained in subsequent attached drawing.Meanwhile of the invention
In description, term " first ", " second " etc. are only used for distinguishing description, are not understood to indicate or imply relative importance.
First embodiment
Through the applicant the study found that most of the advertisement placement method of existing globalization is based on redis storage system
The master-slave database of system carries out advertisement dispensing, and wherein redis is that a key-value storage system is similar with Memcached,
It supports the value type of storage relatively more, including string (character string), list (chained list), set (set), zset
(sorted set- ordered set) and hash (hash type).These data types all support push/pop, add/remove and
Intersection union and difference set and richer operation are taken, and these operations are all atomicities, on this basis, redis is supported
The sequence of various different modes.As memcached, for guaranteed efficiency, data are all to cache in memory, and difference is
The data of update periodically can be written disk or modification is operated the additional record file of write-in by redis, and herein
On the basis of to realize master-slave (principal and subordinate) synchronous.But when largely from node connection with a host node, redis
Storage system has that host node load excessive influences the stability and reliability of data transmission；Redis storage system is logical
It crosses Transmission Control Protocol to carry out data transmission, the data transfer delay when encountering mass data and synchronizing between main and subordinate node can be larger, together
When its data be transmitted without carry out it is any encryption, directly transmitted on public network, there is a problem of that Information Security is lower.For
It solves the above problems, first embodiment of the invention provides a kind of ad data synchronous method, it should be appreciated that described wide
It accuses method of data synchronization and is applied to host node server, the host node server can be with multiple from node server composition one
A ad data synchronous updating system controls each storage nodes for connecting.
Referring to FIG. 1, Fig. 1 is a kind of process signal for ad data synchronous method that first embodiment of the invention provides
Figure.The step of ad data synchronous method, can be as follows：
Step S10：It is connected to storage system host node.
Step S20：It is using collector that the synchronization ad data write-in flow data processing of the storage system host node is flat
Platform.
Step S30：The synchronous ad data in the flow data processing platform is transmitted to using distributor and is respectively deposited
Code calling module of the storage system from node.
As an alternative embodiment, above-mentioned storage system host node and storage system can be respectively from node
The host node of redis storage system and from node.All service operations in the present embodiment are in Amazon Web Services
(AWS) it on the EC2 cluster virtual machine provided, by means of AWS in more than ten global of data center, can very easily set up
Distributed more service node advertisement delivery systems.
It, should be only by collector conduct when host node server is connected to storage system host node for step S10
Connect from puppet from node (pseudo slave) with storage system host node, avoid multiple storage systems of each data center from
Node Direct Attached Storage system host node improves ad data synchronized update to reduce the load of storage system host node
Reliability.Therefore, before step S10, step can also be performed：Using the calling collector as storage system from section
Point.
For step S20, referring to FIG. 2, the step may include following sub-step：
Step S21：The synchronization ad data sent based on master-slave synchronisation mechanism by the storage system host node is received,
The synchronous ad data includes the write operation to ad data.
Step S22：The synchronous ad data is written by flow data processing platform using collector.
In the present embodiment, the collector (collector) is the software module for completing step S21, S22, its conduct
The slave node of host node server described in step S10 is attached thereto, receives its synchrodata, and flow data processing platform is written.
For step S21, the master-slave synchronisation mechanism can be redis master-slave synchronisation mechanism, support simple and easy-to-use
Leader follower replication (master-slave replication) function, which can allow storage system from node i.e. from service
Device (slave server) becomes the exact duplicate of storage system host node, that is, primary server (master server), and one
A primary server can have it is multiple from server, not only primary server can have from server, can also have oneself from server
Slave server, it is multiple from may be constructed a figure shape structure between server.It is generally first carried out when carrying out master-slave synchronisation complete
Amount synchronizes, and enters back into increment synchronization step.Wherein, Redis full dose, which synchronizes, typically occurs in Slave initial phase, at this moment
Slave needs all data on Master replicating portion；Redis increment synchronization starts normally after referring to Slave initialization
The write operation that primary server occurs when work is synchronized to the process from server.
For step S22, the collector (collector) storage system that disguised oneself as from node is connected to storage system
Host node, work are concentrated mainly on during increment synchronization, and the flow data processing platform can be kinesis platform,
Kinesis platform can be collected real-time streaming data, handles and analyze, to be responded in time to new information, branch
Multiple client is held by respective progress reading data flow, the starting point of reading can with when past 24 hours in any point-in-time, lead to
It crosses and the synchronous concurrency of ad data and fault-tolerance can be improved using kinesis platform.
As an alternative embodiment, Kinesis service in the present embodiment can also with using AWS SQS to replace,
The difference of the two is that SQS is a task queue, and each task can only be processed primary；And Kinesis is a data flow
Processing platform, its data can access in 24 hours.
Optionally, above-mentioned steps S21-S22 can be described by following pseudocode：
For step S30, i.e.,：The synchronous ad data in the flow data processing platform is forwarded using distributor
To each storage system from the code calling module of node.Step S30 may particularly include following sub-step：
Step S31：The synchronous ad data is read using distributor.
Step S32：Each storage system of concurrent invocation forwards the synchronous ad data from the code calling module of node
To each storage system from the code calling module of node.
In the present embodiment, the distributor is the software module for completing step S31, S32.It can be from step S20
Kinesis data flow reads the synchronous ad data, code calling module of each storage system of concurrent invocation from node.
In the present embodiment, the code calling module can be AWS Lambda, be that a serverless backup calculates service,
Code can be run to carry out response events and manage bottom computing resource automatically for you.AWS Lambda can be used for patrolling by customized
It collects to extend other AWS service, or creation self-demand by AWS scale, the back-end services of performance and safety operation.AWS
The code run on Lambda is referred to as " Lambda function ", after creating Lambda function, as long as soon as trigger the function, it
It can behave immediately, " Lambda function " is uploaded to after AWS Lambda, " Lambda function " and specific AWS are provided
Source (such as specific Amazon S3 bucket, Amazon DynamoDB table, Amazon Kinesis stream or Amazon SNS lead to
Know) it associates, then, when resource changes, Lambda will optionally execute " Lambda function " and manage calculating money
Source, to keep in touch with incoming request.Wherein, it is usually across public network, AWS that " the Lambda function " of AWS Lambda, which calls,
SDK be all and to have oneself authorization and authentication mechanism by https and service interaction, it is ensured that the safety of data.
Optionally, above-mentioned steps S31-S32 can be described by following pseudocode：
It should be understood that in addition to host node server, it is also necessary to be carried out from node server to storage system from node
Management.Therefore, the kind ad data synchronous method in the present embodiment further includes the steps that being applied to from node server：Receive generation
Storage system is written from node in synchronous ad data by the calling of code calling module.
As an implementation, when redis storage system in the present embodiment uses increment synchronization, the data of transmission
The actually write order of redis.This system relates to the problem of " being cold-started ", i.e., at the beginning of system starting, " region
Redis in 0 " has had a data, still without data in other data centers, needs first that data with existing is synchronous.For this
A problem, we use the method for " rewriting data " to trigger synchronization, i.e., by Manage Scripts, read the data in host node
After re-write wherein, data corresponding in this way can be synchronized to each data center.When in new data center's unlatching
Service node, can equally take this method.
Further, the most important problem of increment synchronization is exactly the consistency it cannot be guaranteed that data, such as a data,
Only it malfunctions when dispatcher calls the lambda service of data center " region 2 ", the data in " region 2 " are just
It is inconsistent with others, and without extraneous intervene, this error in data oneself will not restore.It is asked for this
Topic, our wrong feedback mechanisms, i.e., when mistake occurs for the components such as collector, dispatcher and lambda, they
The data that cannot be synchronized by mistake can be recorded in AWS SQS, then the watchman module by operating on AWS lambda
Processing, re-writes redis and synchronizes.
Second embodiment
For the ad data synchronous method for preferably cooperating first embodiment of the invention to provide, the present invention second is real
Embodiment provides a kind of ad data synchronizing device 100.
Referring to FIG. 3, Fig. 3 is a kind of module signal for ad data synchronizing device that second embodiment of the invention provides
Figure.
Ad data synchronizing device 100 includes link block 110, flow data processing platform writing module 120 and forwarding mould
Block 130.
Link block 110, for being connected to storage system host node.
Flow data processing platform writing module 120, for using collector that synchronizing for the storage system host node is wide
It accuses data and flow data processing platform is written.
Forwarding module 130, for being turned the synchronous ad data in the flow data processing platform using distributor
Issue code calling module of each storage system from node.
Optionally, flow data processing platform writing module 120 includes receiving unit and writing unit.The receiving unit,
For receiving the synchronization ad data sent based on master-slave synchronisation mechanism by the storage system host node, the synchronous advertisement
Data include the write operation to ad data.Said write unit, for the synchronous ad data to be written using collector
Flow data processing platform.
Optionally, forwarding module 130 includes reading unit and concurrent invocation unit.The reading unit is divided for using
It sends out device and reads the synchronous ad data.The concurrent invocation unit, for each storage system of concurrent invocation from the code of node
The synchronous ad data is transmitted to code calling module of each storage system from node by calling module.
Further, ad data synchronizing device 100 can also include：From node writing module 140, for receiving code
Storage system is written from node in synchronous ad data by the calling of calling module.
It is apparent to those skilled in the art that for convenience and simplicity of description, the device of foregoing description
Specific work process, no longer can excessively be repeated herein with reference to the corresponding process in preceding method.
3rd embodiment
Referring to FIG. 4, Fig. 4 is a kind of electronics that can be applied in the embodiment of the present application that third embodiment of the invention provides
The structural block diagram of equipment.Electronic equipment 200 may include ad data synchronizing device 100, memory 201, storage control
202, processor 203, Peripheral Interface 204, input-output unit 205, audio unit 206, display unit 207.
The memory 201, storage control 202, processor 203, Peripheral Interface 204, input-output unit 205, sound
Frequency unit 206, each element of display unit 207 are directly or indirectly electrically connected between each other, to realize the transmission or friendship of data
Mutually.It is electrically connected for example, these elements can be realized between each other by one or more communication bus or signal wire.The advertisement
Data synchronization unit 100 includes that at least one can be stored in the memory 201 in the form of software or firmware (firmware)
In or the software function module that is solidificated in the operating system (operating system, OS) of ad data synchronizing device 100.
The processor 203 is used to execute the executable module stored in memory 201, such as ad data synchronizing device 100 includes
Software function module or computer program.
Wherein, memory 201 may be, but not limited to, random access memory (Random Access Memory,
RAM), read-only memory (Read Only Memory, ROM), programmable read only memory (Programmable Read-Only
Memory, PROM), erasable read-only memory (Erasable Programmable Read-Only Memory, EPROM),
Electricallyerasable ROM (EEROM) (Electric Erasable Programmable Read-Only Memory, EEPROM) etc..
Wherein, memory 201 is for storing program, and the processor 203 executes described program after receiving and executing instruction, aforementioned
Method performed by the server that the stream process that any embodiment of the embodiment of the present invention discloses defines can be applied to processor 203
In, or realized by processor 203.
Processor 203 can be a kind of IC chip, the processing capacity with signal.Above-mentioned processor 203 can
To be general processor, including central processing unit (Central Processing Unit, abbreviation CPU), network processing unit
(Network Processor, abbreviation NP) etc.；Can also be digital signal processor (DSP), specific integrated circuit (ASIC),
Ready-made programmable gate array (FPGA) either other programmable logic device, discrete gate or transistor logic, discrete hard
Part component.It may be implemented or execute disclosed each method, step and the logic diagram in the embodiment of the present invention.General processor
It can be microprocessor or the processor 203 be also possible to any conventional processor etc..
Various input/output devices are couple processor 203 and memory 201 by the Peripheral Interface 204.Some
In embodiment, Peripheral Interface 204, processor 203 and storage control 202 can be realized in one single chip.Other one
In a little examples, they can be realized by independent chip respectively.
Input-output unit 205 realizes user and the server (or local terminal) for being supplied to user input data
Interaction.The input-output unit 205 may be, but not limited to, the equipment such as mouse and keyboard.
Audio unit 206 provides a user audio interface, may include one or more microphones, one or more raises
Sound device and voicefrequency circuit.
Display unit 207 provides an interactive interface (such as user's operation circle between the electronic equipment 200 and user
Face) or for display image data give user reference.In the present embodiment, the display unit 207 can be liquid crystal display
Or touch control display.It can be the capacitance type touch control screen or resistance of support single-point and multi-point touch operation if touch control display
Formula touch screen etc..Single-point and multi-point touch operation is supported to refer to that touch control display can sense on the touch control display one
Or at multiple positions simultaneously generate touch control operation, and the touch control operation that this is sensed transfer to processor 203 carry out calculate and
Processing.
It is appreciated that structure shown in Fig. 4 is only to illustrate, the electronic equipment 200 may also include more than shown in Fig. 4
Perhaps less component or with the configuration different from shown in Fig. 4.Each component shown in Fig. 4 can use hardware, software
Or combinations thereof realize.
It is apparent to those skilled in the art that for convenience and simplicity of description, the device of foregoing description
Specific work process, no longer can excessively be repeated herein with reference to the corresponding process in preceding method.
In conclusion the embodiment of the invention provides a kind of ad data synchronous method and device, the method includes：Even
It is connected to storage system host node；The synchronization ad data write-in flow data of the storage system host node is handled using collector
Platform；The synchronous ad data in the flow data processing platform is transmitted to from node by each storage system using distributor
Code calling module.
Ad data is carried out more from principal and subordinate's data between node are synchronous by storage system host node and storage system
Newly, the applicability of the ad data synchronous method is improved；This method only uses collector to connect with storage system host node, drop
The low load of storage system host node improves the synchronous reliability and stability of ad data.Further, pass through fluxion
According to the concurrent processing of the concurrent mechanism and distributor of processing platform, advertisement can be sent to greater amount of storage system from node
Data improve the synchronous efficiency of ad data；It transmits ad data by public network and connects without maintaining simultaneously, to network
Fluctuation has higher patience, further improves the synchronous reliability and stability of ad data；Meanwhile ad data is in public affairs
Online transmission uses the authentication mechanism of flow data processing platform, improves the safety of advertising data transmission.
In several embodiments provided herein, it should be understood that disclosed device and method can also pass through
Other modes are realized.The apparatus embodiments described above are merely exemplary, for example, flow chart and block diagram in attached drawing
Show the device of multiple embodiments according to the present invention, the architectural framework in the cards of method and computer program product,
Function and operation.In this regard, each box in flowchart or block diagram can represent the one of a module, section or code
Part, a part of the module, section or code, which includes that one or more is for implementing the specified logical function, to be held
Row instruction.It should also be noted that function marked in the box can also be to be different from some implementations as replacement
The sequence marked in attached drawing occurs.For example, two continuous boxes can actually be basically executed in parallel, they are sometimes
It can execute in the opposite order, this depends on the function involved.It is also noted that every in block diagram and or flow chart
The combination of box in a box and block diagram and or flow chart can use the dedicated base for executing defined function or movement
It realizes, or can realize using a combination of dedicated hardware and computer instructions in the system of hardware.
In addition, each functional module in each embodiment of the present invention can integrate one independent portion of formation together
Point, it is also possible to modules individualism, an independent part can also be integrated to form with two or more modules.
It, can be with if the function is realized and when sold or used as an independent product in the form of software function module
It is stored in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially in other words
The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a
People's computer, server or network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention.
And storage medium above-mentioned includes：USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), arbitrary access are deposited
The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic or disk.
The foregoing is only a preferred embodiment of the present invention, is not intended to restrict the invention, for the skill of this field
For art personnel, the invention may be variously modified and varied.All within the spirits and principles of the present invention, made any to repair
Change, equivalent replacement, improvement etc., should all be included in the protection scope of the present invention.It should be noted that：Similar label and letter exist
Similar terms are indicated in following attached drawing, therefore, once being defined in a certain Xiang Yi attached drawing, are then not required in subsequent attached drawing
It is further defined and explained.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain
Lid is within protection scope of the present invention.Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or equipment including the element.
Claims (10)
1. a kind of ad data synchronous method, which is characterized in that be applied to host node server, the ad data synchronous method
Including：
It is connected to storage system host node；
The synchronization ad data of the storage system host node is written by flow data processing platform using collector；
The synchronous ad data in the flow data processing platform is transmitted to from node by each storage system using distributor
Code calling module.
2. ad data synchronous method according to claim 1, which is characterized in that be connected to the main section of storage system described
Before point, the ad data synchronous method further includes：
Using the calling collector as storage system from node.
3. ad data synchronous method according to claim 1, which is characterized in that described to use collector by the storage
Flow data processing platform is written in the synchronization ad data of system host node, including：
Receive the synchronization ad data sent based on master-slave synchronisation mechanism by the storage system host node, the synchronous advertisement
Data include the write operation to ad data；
The synchronous ad data is written by flow data processing platform using collector.
4. ad data synchronous method according to claim 1, which is characterized in that described to use distributor by the fluxion
It is transmitted to code calling module according to the synchronous ad data in processing platform, including：
The synchronous ad data is read using distributor；
The synchronous ad data is transmitted to each storage system from the code calling module of node by each storage system of concurrent invocation
From the code calling module of node.
5. a kind of ad data synchronous method, which is characterized in that be applied to from node server, the ad data synchronous method
Including：
Storage system is written from node in synchronous ad data by the calling for receiving code calling module.
6. a kind of ad data synchronizing device, which is characterized in that the ad data synchronizing device includes：
Link block, for being connected to storage system host node；
Flow data processing platform writing module, for being write the synchronization ad data of the storage system host node using collector
Stream data processing platform；
Forwarding module is respectively deposited for being transmitted to the synchronous ad data in the flow data processing platform using distributor
Code calling module of the storage system from node.
7. ad data synchronizing device according to claim 6, which is characterized in that mould is written in the flow data processing platform
Block includes：
Receiving unit, for receiving the synchronization advertisement number sent based on master-slave synchronisation mechanism by the storage system host node
According to the synchronous ad data includes the write operation to ad data；
Writing unit, for flow data processing platform to be written in the synchronous ad data using collector.
8. ad data synchronizing device according to claim 6, which is characterized in that the forwarding module includes：
Reading unit, for reading the synchronous ad data using distributor；
Concurrent invocation unit, for each storage system of concurrent invocation from the code calling module of node, by the synchronous advertisement number
According to being transmitted to code calling module of each storage system from node.
9. ad data synchronizing device according to claim 6, which is characterized in that the ad data synchronizing device also wraps
It includes：
From node writing module, for receiving the calling of code calling module, storage system is written into from section in synchronous ad data
Point.
10. a kind of computer-readable storage medium, which is characterized in that be stored with meter in the computer-readable storage medium
Calculation machine program instruction, when the computer program instructions are read and run by a processor, perform claim requires any one of 1-5 institute
State the step in method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810833142.4A CN108898448A (en) | 2018-07-25 | 2018-07-25 | A kind of ad data synchronous method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810833142.4A CN108898448A (en) | 2018-07-25 | 2018-07-25 | A kind of ad data synchronous method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108898448A true CN108898448A (en) | 2018-11-27 |
Family
ID=64351755
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810833142.4A Pending CN108898448A (en) | 2018-07-25 | 2018-07-25 | A kind of ad data synchronous method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108898448A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110544136A (en) * | 2019-09-10 | 2019-12-06 | 恩亿科(北京)数据科技有限公司 | Method, device, equipment and storage medium for calculating synchronous putting probability |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106060138A (en) * | 2016-06-06 | 2016-10-26 | 北京小米移动软件有限公司 | Method and apparatus for updating data |
| CN107423404A (en) * | 2017-07-27 | 2017-12-01 | 东软集团股份有限公司 | Flow instance data synchronizing processing method and device |
| CN107888666A (en) * | 2017-10-27 | 2018-04-06 | 北京奇艺世纪科技有限公司 | A kind of cross-region data-storage system and method for data synchronization and device |
| CN108038157A (en) * | 2017-12-05 | 2018-05-15 | 北京星河星云信息技术有限公司 | Master-slave database reading/writing method, system, storage device and server |
| CN108121782A (en) * | 2017-12-18 | 2018-06-05 | 新华三云计算技术有限公司 | Distribution method, database middleware system and the electronic equipment of inquiry request |
-
2018
- 2018-07-25 CN CN201810833142.4A patent/CN108898448A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106060138A (en) * | 2016-06-06 | 2016-10-26 | 北京小米移动软件有限公司 | Method and apparatus for updating data |
| CN107423404A (en) * | 2017-07-27 | 2017-12-01 | 东软集团股份有限公司 | Flow instance data synchronizing processing method and device |
| CN107888666A (en) * | 2017-10-27 | 2018-04-06 | 北京奇艺世纪科技有限公司 | A kind of cross-region data-storage system and method for data synchronization and device |
| CN108038157A (en) * | 2017-12-05 | 2018-05-15 | 北京星河星云信息技术有限公司 | Master-slave database reading/writing method, system, storage device and server |
| CN108121782A (en) * | 2017-12-18 | 2018-06-05 | 新华三云计算技术有限公司 | Distribution method, database middleware system and the electronic equipment of inquiry request |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110544136A (en) * | 2019-09-10 | 2019-12-06 | 恩亿科(北京)数据科技有限公司 | Method, device, equipment and storage medium for calculating synchronous putting probability |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI698108B (en) | Blockchain-based data processing method and device | |
| CN111091429B (en) | Electronic bill identification distribution method and device and electronic bill generation system | |
| US10585691B2 (en) | Distribution system, computer, and arrangement method for virtual machine | |
| CN104809201B (en) | A kind of method and apparatus of database synchronization | |
| CN106815218B (en) | Database access method and device and database system | |
| CN105187464B (en) | Method of data synchronization, apparatus and system in a kind of distributed memory system | |
| CN109408523B (en) | Data sharing method and device, data sharing platform and electronic equipment | |
| CN106993064A (en) | A kind of system and its construction method and application that the storage of mass data scalability is realized based on Openstack cloud platforms | |
| US10326655B1 (en) | Infrastructure replication | |
| US10990455B2 (en) | Management of application programming interface (API) retention | |
| CN107273440A (en) | Computer application, date storage method, micro services and microdata storehouse | |
| CN108897638A (en) | Data back up method, device, computer equipment and storage medium | |
| CN110209730A (en) | Change synchronous method, device, computer equipment and the computer storage medium of data | |
| CN111460285A (en) | Information processing method, device, electronic equipment and storage medium | |
| CN110543354A (en) | Task scheduling method, device, equipment and storage medium | |
| CN108200070A (en) | A kind of method and device for generating list | |
| CN110474820A (en) | Traffic playback method, device, electronic equipment | |
| CN110795443A (en) | Method, device, equipment and computer readable medium for data synchronization | |
| CN110457263A (en) | A kind of date storage method and device | |
| CN111352592B (en) | Disk read-write control method, device, equipment and computer readable storage medium | |
| CN114443908A (en) | Graph database construction method, system, terminal and storage medium | |
| CN108898448A (en) | A kind of ad data synchronous method and device | |
| CN109614271A (en) | Control method, device, equipment and the storage medium of multiple company-data consistency | |
| TW201737069A (en) | Method and system for generating queue based applications dependencies in virtual machines | |
| US10079883B2 (en) | Primary device selection at operating system initialization |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181127 |
|
| RJ01 | Rejection of invention patent application after publication |