CN109815028A - Data synchronous system, method, apparatus and computer storage medium - Google Patents
Data synchronous system, method, apparatus and computer storage medium Download PDFInfo
- Publication number
- CN109815028A CN109815028A CN201811615533.5A CN201811615533A CN109815028A CN 109815028 A CN109815028 A CN 109815028A CN 201811615533 A CN201811615533 A CN 201811615533A CN 109815028 A CN109815028 A CN 109815028A
- Authority
- CN
- China
- Prior art keywords
- data
- data source
- message queue
- module
- synchronization
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The embodiment of the present invention is supplied to a kind of data synchronous system, method, apparatus and computer storage medium.The system comprises data decryptor module, message distribution module, data simultaneous module and configuration management modules；Data decryptor module obtains the data change record of data source for being monitored data source；Data change record is added in message queue by message distribution module for creating message queue corresponding with data source；Configuration management module, for managing the synchronization configuration parameter of data source；Data simultaneous module, for obtaining synchronous configuration parameter, according to synchronous configuration parameter creation consumption association journey；The queue of journey monitoring information is assisted by consumption, updates data change record into target storage according to synchronous configuration parameter.
Description
Technical field
The present invention relates to processing data information technical fields, more particularly, to data synchronous system, the data side of synchronization
Method, data synchronization unit and computer storage medium.
Background technique
When the data stored in certain data equipments change, the such data needs stored in other data equipments are done
Corresponding to change, so that the equipment stored in all data is consistent, it is synchronous that here it is data.In big data era, data
It synchronizes and becomes more and more important.Either during the processing of data, or in the extraction and transmission process of data, all
It is synchronous to need to carry out data.
In the prior art, the synchronous tool used of data usually has datax, sqoop etc..These tools are fixed by timing
Data are synchronized in specified storage by the mode of amount, cannot be synchronized immediately after in data source, data change occurs, can not
Achieve the effect that real-time synchronization.
Summary of the invention
According to the first aspect of the invention, a kind of data synchronous system, including data decryptor module, message distribution mould are provided
Block, data simultaneous module and configuration management module；
The data decryptor module, for monitoring data source, to obtain the data change record of the data source；
The message distribution module, for creating message queue corresponding with the data source, from the data decryptor mould
Block obtains the data change record of the data source and is added to the data change record of the data source and the data source
In corresponding message queue；
The configuration management module, for managing the synchronization configuration parameter of the data source, the synchronization of the data source is matched
Set the mark that parameter includes the mark of the data source, the position of target storage and message queue corresponding with the data source
Know；
The data simultaneous module obtains the synchronous configuration ginseng of the data source for monitoring the configuration management module
Number creates consumption corresponding with the message queue according to the synchronization configuration parameter of the data source and assists journey；And disappeared by described
Fei Xiecheng monitors the corresponding message queue and is pressed with consuming the data change record being written in the corresponding message queue
The data change record being written in the message queue is updated to corresponding target according to the synchronization configuration parameter of the data source
In storage.
Alternatively and preferably, the message distribution module subscribes to message system using Kafka distributed post.
Alternatively and preferably, the configuration management module uses Zookeeper distributed application program coordination service system
System.
Alternatively and preferably, the synchronization configuration parameter of the data source further includes message corresponding with data source team
The concurrent speed of column；The data simultaneous module, be also used to determine according to the concurrent speed need it is creating with the message
The quantity of the corresponding consumption association journey of queue.
Alternatively and preferably, the data decryptor module is also used to convert the data change record of the data source
For preset format, the preset format is that the analysable format of journey is assisted in the consumption.
Alternatively and preferably, the data simultaneous module is also used to for itself being registered in the configuration management module,
The working condition of the data simultaneous module is monitored by the configuration management module.
Alternatively and preferably, the message queue is the message queue of persistence.
According to the second aspect of the invention, a kind of method of data synchronization is provided, comprising:
Data source is monitored, to obtain the data change record of the data source；
Create corresponding with data source message queue, by the data change record of the data source be added to it is described
In the corresponding message queue of data source；
The synchronization configuration parameter of the data source is monitored, according to the data source synchronization configuration parameter creation with
Journey is assisted in the corresponding consumption of the message queue；Wherein, the synchronization configuration parameter of the data source include the data source mark,
The position of target storage and the mark of message queue corresponding with the data source；And
The corresponding message queue monitored by consumption association journey, is written in the corresponding message queue with consuming
Data change record, according to the synchronization configuration parameter of the data source by the data change record being written in the message queue more
Newly into the storage of corresponding target.
According to the third aspect of the invention we, a kind of computer storage medium is provided, executable computer instruction, institute are stored with
When stating executable computer instruction and being executed by processor, the method provided such as second aspect of the present invention is realized.
According to the fourth aspect of the invention, a kind of data synchronization unit, including processor and memory are provided；The storage
Device is stored with executable computer instruction, when the executable computer instruction is executed by the processor, realizes such as the present invention
The method that second aspect provides.
Method of data synchronization, system, computer storage medium and data synchronization unit provided in an embodiment of the present invention use
Data change record is added in message queue by message queue subscribing mechanism, the consumption by consumption association journey to message queue
The change of data source is written in real time in target storage, the real-time synchronization for realizing data updates.In addition, the embodiment of the present invention
Method of data synchronization, system, computer storage medium and the data synchronization unit of offer, according to synchronous configuration parameter setting consumption
Journey is assisted, and consumes association's journey and carries out data update according to synchronous configuration parameter, when synchronous configuration parameter is updated by user, data
Synchronization system can increase in time, delete or modify consumption association journey, and therefore, the data synchronous system of the embodiment of the present invention is also
With considerable flexibility and scalability.
Detailed description of the invention
It is combined in the description and the attached drawing for constituting part of specification shows the embodiment of the present invention, and even
With its explanation together principle for explaining the present invention.
Fig. 1 shows the hardware configuration schematic diagram of data synchronous system provided in an embodiment of the present invention；
Fig. 2 shows the schematic diagrames of data synchronous system provided in an embodiment of the present invention；
Fig. 3 shows the schematic diagram of data simultaneous module provided in an embodiment of the present invention.
Fig. 4 shows the flow chart of method of data synchronization provided in an embodiment of the present invention.
Specific embodiment
Carry out the various exemplary embodiments of detailed description of the present invention now with reference to attached drawing.It should also be noted that unless in addition having
Body explanation, the unlimited system of component and the positioned opposite of step, numerical expression and the numerical value otherwise illustrated in these embodiments is originally
The range of invention.
Be to the description only actually of at least one exemplary embodiment below it is illustrative, never as to the present invention
And its application or any restrictions used.
Technology known to related fields ordinary skill personage, method and apparatus may be not discussed in detail, but suitable
In the case of, the technology, method and apparatus should be considered as part of specification.
It is shown here and discuss all examples in, any occurrence should be construed as merely illustratively, without
It is as limitation.Therefore, other examples of exemplary embodiment can have different values.
It should also be noted that similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined in a attached drawing, then in subsequent attached drawing does not need that it is further discussed.
<data synchronous system>
As shown in Figure 1, the data synchronous system of the embodiment of the present invention can be realized by server 400.
400 offer processing of server, database, communications service service point.Server 400 can be monolithic servers
Or the decentralized service device across multicomputer or computer data center.Server 400 can be it is various types of, such as but
It is not limited to, network server, NEWS SERVER, mail server, message server, Advertisement Server, file server, applies
Server, interactive server, database server or proxy server.In some embodiments, server 400 may include
Hardware, software, or the embedded logic module or two or more of proper function supported or realized for execute server 400
The combination of this class component.For example, server 400 can be the server farm being made of multiple servers, it may include above-mentioned
One of server of type is a variety of etc..
In one example, server 400 can be as shown in Figure 1, include processor 4010, memory 4020, interface dress
Set 4030, communication device 4040, display device 4050, input unit 4060 etc..Although server also may include loudspeaker, wheat
Gram wind etc., still, these components are unrelated to the invention, therefore omit herein.
Wherein, processor 4010 is such as can be central processor CPU, Micro-processor MCV.Memory 4020 for example wraps
Include ROM (read-only memory), RAM (random access memory), nonvolatile memory of hard disk etc..Interface arrangement 4030
For example including USB interface, serial line interface, infrared interface etc..Communication device 4040 is for example able to carry out wired or wireless communication.It is aobvious
Showing device 4050 is, for example, liquid crystal display, LED display touch display screen etc..Input unit 4060 for example may include touching
Screen, keyboard etc..
Although showing multiple devices to server 400 in Fig. 1, the present invention can only relate to part therein
Device, for example, server 400 pertains only to memory 4020 and processor 4010.
In the foregoing description, technical staff can the instruction of the conceptual design according to provided by the disclosure.How instruction controls
Processor is operated, this is it is known in the art that therefore being not described in detail herein.
Data synchronous system shown in FIG. 1 is only explanatory, and never be intended to limitation the disclosure, its application or
Purposes.
It is shown in Figure 2, illustrate data synchronous system provided in an embodiment of the present invention.
Data synchronous system includes data decryptor module 20, message distribution module 30, data simultaneous module 40 and configuration
Management module 50.
Data decryptor module 20, for monitoring data source 10, to obtain the data change record of data source 10.Number
It can be one or more according to source 10.That is, the data synchronous system of the embodiment of the present invention can be simultaneously to multiple numbers
It is synchronous that data are carried out according to source 10.
Message distribution module 30, for creating corresponding with data source message queue, that is, data source and message queue are one
One-to-one correspondence.Message distribution module 30 from data decryptor module 20 obtains the data change record of data source and by data source
Data change record be added in message queue corresponding with data source.
Configuration management module 50, for managing the synchronization configuration parameter of data source, the synchronization configuration parameter of data source includes
Mark, the position of target storage 60 and the mark of message queue corresponding with data source of data source.
Data simultaneous module 40 obtains the synchronization configuration parameter of data source for monitoring configuration management module 20, according to
The synchronization configuration parameter of data source creates consumption corresponding with message queue and assists journey；And corresponding disappear is monitored by consumption association journey
Breath queue will be disappeared with consuming the data change record being written in corresponding message queue according to the synchronization configuration parameter of data source
The data change record being written in breath queue is updated into corresponding target storage 60.Assisting journey is a kind of program assembly, is process
In a relatively independent, schedulable execution unit entity.Assist journey generally more light weight and flexibly, can be in designated position
It hangs up and restores to execute.Consumption association journey is a kind of association's journey for serving as consumer role, for consuming the message in message queue.Figure
3 target storages 60 are shown in 2, in practical applications, the data of multiple data sources 10 can be merged and are synchronized to a mesh
In mark storage, the data of a data source 10 can also be synchronized to respectively in multiple target storages.
Data synchronous system provided in an embodiment of the present invention is added data change record using message queue subscribing mechanism
Enter into message queue, the change of data source is written to the consumption of message queue by target storage by consumption association's journey in real time
In, the real-time synchronization for realizing data updates.
Data synchronous system provided in an embodiment of the present invention according to synchronous configuration parameter setting consumption association journey, and is consumed
Journey is assisted to carry out data update according to synchronous configuration parameter, when synchronous configuration parameter is updated by user, data synchronous system can be with
Increase, delete or modify consumption association journey in time, therefore, the data synchronous system of the embodiment of the present invention also has good spirit
Activity and scalability.
In a specific example, the synchronization configuration parameter of data source can also include the concurrent speed of message queue.
In one example, multiple consumption associations journey corresponding with the same message queue can be in concurrent form from the message queue
Consumption data.The quantity of association's journey is consumed by setting, can the speed consumed of the message in control message queue, that is, control
The concurrent speed of message queue processed.Data simultaneous module is also used to determine need to create and message queue according to concurrent speed
The quantity of corresponding consumption association journey, that is to say, that the concurrent speed of message queue is higher, consumes the consumption association of this message queue
The quantity of journey is more.Data synchronous system provided in an embodiment of the present invention can easily pass through the number of extension consumption association journey
Amount is to increase synchronizing speed.
Shown in Figure 3 in a specific example, main association's journey 41 of data simultaneous module 40 monitors configuration management mould
Block 50, when the synchronization configuration parameter of data source is updated, main association's journey 41 can obtain updated synchronous configuration parameter in time,
Consumption association Cheng Jinhang is increased, deleted or modified according to updated synchronous configuration parameter.
In the example shown in Fig. 3, the corresponding message queue of second data source is message queue 2, second data source
Synchronization configuration parameter in define that concurrent speed is 1, main association journey 41 creates 1 consumption association journey (journey 424 is assisted in consumption) monitoring and disappears
Cease queue 1.The corresponding message queue of first data source is message queue 1, is limited in the synchronization configuration parameter of first data source
Having determined concurrent speed is 3, main association journey 41 will create 3 consumption association journeys (respectively consume and assist journey 421,422,423) while listening for
Message queue 1, message queue subscribing mechanism itself can guarantee that 1 message can only be by 1 consumer spending, that is to say, that every
One data change record only can be by a consumption association journey consumption, without being repeatedly processed through vaporization, condensation and absorption.
In a specific example, data decryptor module 20 is also used to convert the data change record of data source to
Preset format, so that the format of the data change record in message queue is unified, and this preset format should
It is the consumption association analysable format of journey, to facilitate the journey consumption of consumption association.For example, the format of first data source is Binlog lattice
Formula, the change record of the first data source are also Binlog format；The format of second data source is Oplog format, the second data
The change record in source is also Oplog format；Preset format is JSON format, and data synchronous system can be by first data source
Data change record is JSON format by Binlog format conversion, converts the change record of second data source to by Oplog
JSON format, then the data change record of JSON format is passed into message queue.
In a specific example, data simultaneous module 40 is also used to for itself being registered in configuration management module 50,
By the working condition of 50 monitored data synchronization module 40 of configuration management module, user is allowed to observe consumption association journey in time
Consumption progress.
In a specific example, the message queue that message distribution module 30 creates is the message queue of persistence, is made
Obtaining data change record will not lose easily.When starting or retroversion return to some after consuming association's journey and needing to suspend, suspend
Between point when being consumed again, required data change record can be read from message queue.
In a specific example, the message queue that message distribution module 30 creates uses first in first out mechanism, so that
Consumption association journey can consume the data change record in message queue in sequence.
In a specific example, message distribution module 30 subscribes to message system using Kafka distributed post.
Kafka distributed post subscribes to message system, is the open source stream process platform developed by Apache Software Foundation, by
Scala and Java language are write.Kafka is that a kind of distributed post of high-throughput subscribes to message system, it, which can handle, disappears
Everything flow data in the website of the person's of expense scale.By using Kafka as message distribution module 30, this implementation can be made
Data synchronous system handling capacity with higher in example, and the message queue of persistence easy to accomplish.In addition, being based on
The mechanism of Kafka message distribution module itself can guarantee that 1 message can only be by 1 consumer spending, that is to say, that each
Data change record only can be by a consumption association journey consumption, without being repeatedly processed through vaporization, condensation and absorption, to ensure that the synchronous standard of data
Really efficiently.
In a specific example, configuration management module 50 uses the coordination service of Zookeeper distributed application program
System.Zookeeper distributed application program coordination service system is the realization of an open source of Google, is Distributed Application
Consistency service is provided, the function of providing includes: configuring maintenance, domain name service, distributed synchronization, group service etc..Zookeeper
Distributed application program coordination service system has informing mechanism.By using Zookeeper as configuration management module, so that
The performance efficiency of configuration management module 50 and reliable.In addition, the notice itself being had based on Zookeeper configuration management module
Mechanism can be realized the effect of user's real time modifying synchronous task.
In a specific example, data simultaneous module 40 can be realized using finger daemon.Finger daemon is a kind of
The special process of the one kind on backstage is operated in, can be executed independently of controlling terminal and periodically at certain task or waiting
Manage the event of certain generations.
Message system is subscribed to using Kafka distributed post with message distribution module 30 below, configuration management module 50 is adopted
With Zookeeper distributed application program coordination service system, data simultaneous module 40 illustrates this hair using for finger daemon
The data synchronous system that bright embodiment provides:
Data synchronous system include data decryptor module, Kafka message distribution module, data simultaneous module and
Zookeeper configuration management module.
Data decryptor module monitors data source, to obtain the data change record of data source.The change of data source
Record is for example including the following contents: the mark of data source, the mark of the affiliated database of data source, the timestamp of this change, this
It is secondary to change the field that is related to, before changing after content etc..
Kafka message distribution module, for creating Kafka message queue corresponding with data source, that is, data source and message
Queue is one-to-one relationship.Kafka message distribution module obtains the data change record of data source from data decryptor module,
The data change record of data source is added in Kafka message queue corresponding with data source.
Zookeeper configuration management module, for being managed collectively the synchronization configuration parameter of each data source.Data source it is same
Step configuration parameter includes the mark of the mark of data source, the position of target storage and Kafka message queue corresponding with data source
Know.The synchronization configuration parameter of data source for example can also include: the field for needing synchronized update, corresponding with the data source
Concurrent speed of Kafka message queue etc..
On the one hand, user is managed collectively the synchronization configuration parameter of each data source by Zookeeper configuration management module.
Based on the informing mechanism that Zookeeper configuration management module has itself, when user is repaired by Zookeeper configuration management module
When changing synchronous configuration parameter, it can be known in time by main association's journey of data simultaneous module, main association's journey is timely according to synchronous configuration parameter
Consuming process is adjusted, to realize the effect of user's real time modifying synchronous task.
On the other hand, data simultaneous module itself will be registered in Zookeeper configuration management module, by Zookeeper
The working condition of configuration management module monitored data synchronization module.When consumption association Cheng Yichang is closed, can be matched by Zookeeper
It sets management module to capture in time, user is allowed to observe the state of synchronous task in time.
Specifically:
Main association's journey of data simultaneous module is corresponding with Kafka message queue according to the synchronization configuration parameter creation of data source
Consumption association journey.Corresponding Kafka message queue monitored by consumption association journey, is written in corresponding Kafka message queue with consuming
Data change record updates the data change record being written in Kafka message queue according to the synchronization configuration parameter of data source
Into the storage of corresponding target.
Main association's journey of data simultaneous module monitors Zookeeper configuration management module, when the synchronization configuration parameter of data source
When being updated, main association's journey can obtain updated synchronous configuration parameter in time, be offseted according to updated synchronous configuration parameter
Fei Xiecheng is increased, deleted or is modified.
Based on the mechanism of Kafka message distribution module itself, can guarantee 1 message can only by 1 consumer spending,
That is each data change record only can be by a consumption association journey consumption, without being repeatedly processed through vaporization, condensation and absorption.
Kafka message queue is the message queue of persistence, so that data change record will not be lost easily.When consumption is assisted
Journey needs to suspend, starts after pause or falls back when returning to some time point and being consumed again, can disappear from Kafka
Required data change record is read in breath queue.Also, Kafka message queue follows first in first out mechanism, guarantees consumption
The order of process.
For Kafka message distribution module, data decryptor module is its contents producer, and data simultaneous module disappears
Fei Xiecheng is its content consumer.Kafka message distribution module itself has Decoupling Characteristics, can be by contents producer and content
Consumer's decoupling, shields the perception between contents producer and content consumer, when data decryptor module and data simultaneous module
Any one of module when something goes wrong, all will not influence the normal work of another module.
Data are changed and are remembered using Kafka message subscribing distribution mechanisms by data synchronous system provided in an embodiment of the present invention
Record is added in Kafka message queue, is write the change of data source in real time to the consumption of Kafka message queue by consumption association journey
Enter into target storage, the real-time synchronization for realizing data updates.
<method of data synchronization>
As shown in figure 4, the embodiment of the invention also provides a kind of method of data synchronization, comprising the following steps:
Step S110, data source is monitored, to obtain the data change record of data source.
Step S120, the data change record of data source is added to and number by creation message queue corresponding with data source
According in the corresponding message queue in source.
Step S130, the synchronization configuration parameter of data source is monitored, is created according to the synchronization configuration parameter of data source
Journey is assisted in consumption corresponding with message queue；Wherein, the synchronization configuration parameter of data source includes that the mark of data source, target store
The mark of position and message queue corresponding with data source.
Step S140, corresponding message queue is monitored by consumption association journey, to consume the number being written in corresponding message queue
According to change record, the data change record being written in message queue is updated to corresponding according to the synchronization configuration parameter of data source
In target storage.
Method of data synchronization provided in an embodiment of the present invention is added data change record using message queue subscribing mechanism
Enter into message queue, the change of data source is written to the consumption of message queue by target storage by consumption association's journey in real time
In, the real-time synchronization for realizing data updates.
In a specific example, the synchronization configuration parameter of data source further includes message queue corresponding with data source
Concurrent speed.Consumption corresponding with message queue is created according to the synchronization configuration parameter of data source and assists journey, further includes according to concurrent
Speed determines the quantity of consumption association corresponding with message queue journey.
In a specific example, data source is monitored, to obtain the data change record of data source, further includes
Preset format is converted by the data change record of data source, preset format is the consumption association analysable format of journey.
In one example, message system is subscribed to using Kafka distributed post and realizes message distribution module.
In one example, configuration management module is realized using Zookeeper distributed application program coordination service.
In one example, the synchronization configuration parameter of data source further includes the concurrent speed of message queue corresponding with data source
Degree；Data simultaneous module is also used to determine the number for consumption association corresponding with the message queue journey for needing to create according to concurrent speed
Amount.
In one example, data simultaneous module is also used to for itself being registered in configuration management module, by configuration management
The working condition of module monitored data synchronization module.
In a specific example, message queue is the message queue of persistence.
In a specific example, message queue uses first in first out mechanism.
Method of data synchronization provided in this embodiment with the data synchronous system that previous embodiment provides be it is corresponding, it is aforementioned
The embodiment of data synchronous system can be used for explaining the method for data synchronization in the present embodiment, repeat no more in the present embodiment.
Similarly, method of data synchronization provided in an embodiment of the present invention is changed data using message queue subscribing mechanism
Record is added in message queue, and the change of data source is written to target in real time to the consumption of message queue by consumption association journey
In storage, the real-time synchronization for realizing data updates.In addition, method of data synchronization provided in an embodiment of the present invention, according to synchronization
Configuration parameter setting consumption association journey, and consume association's journey and carry out data update according to synchronous configuration parameter, when synchronous configuration parameter
When being updated by user, it can increase, delete or modify consumption association journey, therefore, the data side of synchronization of the embodiment of the present invention in time
Method also has considerable flexibility and scalability.
<data synchronization unit>
The embodiment of the invention also provides a kind of data synchronization units, including processor and memory；The memory is deposited
Containing executable computer instruction can be realized aforementioned data when the executable computer instruction is executed by the processor
The method of data synchronization that synchronous method embodiment provides.
Specifically, the embodiment of aforementioned data synchronous method can be used for explaining the data synchronization unit of the present embodiment, this number
According to being repeated no more in the embodiment of synchronizing device.
<computer storage medium>
The embodiment of the invention also provides a kind of computer storage medium, the computer storage medium is stored with executable
Computer instruction when the executable computer instruction is executed by processor, can be realized aforementioned data synchronous method embodiment
The method of data synchronization of offer.
Specifically, the embodiment of aforementioned data synchronous method can be used for explaining the computer storage medium of the present embodiment, this
It is repeated no more in the embodiment of computer storage medium.
The present invention can be system, method and/or computer program product.Computer program product may include computer
Readable storage medium storing program for executing, containing for making processor realize the computer-readable program instructions of various aspects of the invention.
Computer readable storage medium, which can be, can keep and store the tangible of the instruction used by instruction execution equipment
Equipment.Computer readable storage medium for example can be-- but it is not limited to-- storage device electric, magnetic storage apparatus, optical storage
Equipment, electric magnetic storage apparatus, semiconductor memory apparatus or above-mentioned any appropriate combination.Computer readable storage medium
More specific example (non exhaustive list) includes: portable computer diskette, hard disk, random access memory (RAM), read-only deposits
It is reservoir (ROM), erasable programmable read only memory (EPROM or flash memory), static random access memory (SRAM), portable
Compact disk read-only memory (CD-ROM), digital versatile disc (DVD), memory stick, floppy disk, mechanical coding equipment, for example thereon
It is stored with punch card or groove internal projection structure and the above-mentioned any appropriate combination of instruction.Calculating used herein above
Machine readable storage medium storing program for executing is not interpreted that instantaneous signal itself, the electromagnetic wave of such as radio wave or other Free propagations lead to
It crosses the electromagnetic wave (for example, the light pulse for passing through fiber optic cables) of waveguide or the propagation of other transmission mediums or is transmitted by electric wire
Electric signal.
Computer-readable program instructions as described herein can be downloaded to from computer readable storage medium it is each calculate/
Processing equipment, or outer computer or outer is downloaded to by network, such as internet, local area network, wide area network and/or wireless network
Portion stores equipment.Network may include copper transmission cable, optical fiber transmission, wireless transmission, router, firewall, interchanger, gateway
Computer and/or Edge Server.Adapter or network interface in each calculating/processing equipment are received from network to be counted
Calculation machine readable program instructions, and the computer-readable program instructions are forwarded, for the meter being stored in each calculating/processing equipment
In calculation machine readable storage medium storing program for executing.
Computer program instructions for executing operation of the present invention can be assembly instruction, instruction set architecture (ISA) instructs,
Machine instruction, machine-dependent instructions, microcode, firmware instructions, condition setup data or with one or more programming languages
The source code or object code that any combination is write, the programming language include the programming language-of object-oriented such as
Smalltalk, C++ etc., and conventional procedural programming languages-such as " C " language or similar programming language.Computer
Readable program instructions can be executed fully on the user computer, partly execute on the user computer, be only as one
Vertical software package executes, part executes on the remote computer or completely in remote computer on the user computer for part
Or it is executed on server.In situations involving remote computers, remote computer can pass through network-packet of any kind
It includes local area network (LAN) or wide area network (WAN)-is connected to subscriber computer, or, it may be connected to outer computer (such as benefit
It is connected with ISP by internet).In some embodiments, by utilizing computer-readable program instructions
Status information carry out personalized customization electronic circuit, such as programmable logic circuit, field programmable gate array (FPGA) or can
Programmed logic array (PLA) (PLA), the electronic circuit can execute computer-readable program instructions, to realize each side of the invention
Face.
Referring herein to according to the method for the embodiment of the present invention, the flow chart of device (system) and computer program product and/
Or block diagram describes various aspects of the invention.It should be appreciated that flowchart and or block diagram each box and flow chart and/
Or in block diagram each box combination, can be realized by computer-readable program instructions.
These computer-readable program instructions can be supplied to general purpose computer, special purpose computer or other programmable datas
The processor of processing unit, so that a kind of machine is produced, so that these instructions are passing through computer or other programmable datas
When the processor of processing unit executes, function specified in one or more boxes in implementation flow chart and/or block diagram is produced
The device of energy/movement.These computer-readable program instructions can also be stored in a computer-readable storage medium, these refer to
It enables so that computer, programmable data processing unit and/or other equipment work in a specific way, thus, it is stored with instruction
Computer-readable medium then includes a manufacture comprising in one or more boxes in implementation flow chart and/or block diagram
The instruction of the various aspects of defined function action.
Computer-readable program instructions can also be loaded into computer, other programmable data processing units or other
In equipment, so that series of operation steps are executed in computer, other programmable data processing units or other equipment, to produce
Raw computer implemented process, so that executed in computer, other programmable data processing units or other equipment
Instruct function action specified in one or more boxes in implementation flow chart and/or block diagram.
The flow chart and block diagram in the drawings show the system of multiple embodiments according to the present invention, method and computer journeys
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
One module of table, program segment or a part of instruction, the module, program segment or a part of instruction include one or more use
The executable instruction of the logic function as defined in realizing.In some implementations as replacements, function marked in the box
It can occur in a different order than that indicated in the drawings.For example, two continuous boxes can actually be held substantially in parallel
Row, they can also be executed in the opposite order sometimes, and this depends on the function involved.It is also noted that block diagram and/or
The combination of each box in flow chart and the box in block diagram and or flow chart, can the function as defined in executing or dynamic
The dedicated hardware based system made is realized, or can be realized using a combination of dedicated hardware and computer instructions.It is right
For art technology personage it is well known that, by hardware mode realize, by software mode realize and pass through software and
It is all of equal value that the mode of combination of hardware, which is realized,.
Various embodiments of the present invention are described above, above description is exemplary, and non-exclusive, and
It is not limited to disclosed each embodiment.Without departing from the scope and spirit of illustrated each embodiment, for this skill
Many modifications and changes are obvious for the ordinary skill personage in art field.The selection of term used herein, purport
In principle, the practical application or to the technological improvement in market for best explaining each embodiment, or make the art its
Its ordinary skill personage can understand each embodiment disclosed herein.The scope of the present invention is defined by the appended claims.
Claims (10)
1. a kind of data synchronous system, which is characterized in that the system comprises data decryptor modules, message distribution module, data
Synchronization module and configuration management module；
The data decryptor module, for monitoring data source, to obtain the data change record of the data source；
The message distribution module is obtained for creating message queue corresponding with the data source from the data decryptor module
It takes the data change record of the data source and is added to the data change record of the data source corresponding with the data source
Message queue in；
The configuration management module, for managing the synchronization configuration parameter of the data source, the synchronous configuration ginseng of the data source
Number includes the mark of the mark of the data source, the position of target storage and message queue corresponding with the data source；
The data simultaneous module obtains the synchronization configuration parameter of the data source for monitoring the configuration management module,
Consumption corresponding with the message queue, which is created, according to the synchronization configuration parameter of the data source assists journey；And by the consumption
Journey is assisted to monitor the corresponding message queue, to consume the data change record being written in the corresponding message queue, according to
The synchronization configuration parameter of the data source, which updates the data change record being written in the message queue to corresponding target, deposits
Chu Zhong.
2. system according to claim 1, wherein the message distribution module is disappeared using the subscription of Kafka distributed post
Breath system.
3. system according to claim 1, wherein the configuration management module uses Zookeeper Distributed Application journey
Sequence coordination service system.
4. system according to claim 1, wherein the synchronization configuration parameter of the data source further includes and the data source
The concurrent speed of corresponding message queue；The data simultaneous module is also used to need to create according to the concurrent speed determination
It is corresponding with the message queue consumption association journey quantity.
5. system according to claim 1, wherein the data decryptor module is also used to the data of the data source
Change record is converted into preset format, and the preset format is that the analysable format of journey is assisted in the consumption.
6. system according to claim 1, wherein the data simultaneous module is also used to for itself being registered to described match
It sets in management module, the working condition of the data simultaneous module is monitored by the configuration management module.
7. system according to claim 1, wherein the message queue is the message queue of persistence.
8. a kind of method of data synchronization, comprising:
Data source is monitored, to obtain the data change record of the data source；
Message queue corresponding with the data source is created, the data change record of the data source is added to and the data
In the corresponding message queue in source；
The synchronization configuration parameter of the data source is monitored, according to the data source synchronization configuration parameter creation with it is described
Journey is assisted in the corresponding consumption of message queue；Wherein, the synchronization configuration parameter of the data source includes the mark of the data source, target
The mark of the position of storage and message queue corresponding with the data source；And
The corresponding message queue is monitored by consumption association journey, to consume the data being written in the corresponding message queue
Change record arrives the data change record being written in message queue update according to the synchronization configuration parameter of the data source
In corresponding target storage.
9. a kind of computer storage medium is stored with executable computer instruction, the executable computer instruction is by processor
When execution, method according to any one of claims 8 is realized.
10. a kind of data synchronization unit, including processor and memory；The memory is stored with executable computer instruction,
When the executable computer instruction is executed by the processor, method according to any one of claims 8 is realized.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811615533.5A CN109815028B (en) | 2018-12-27 | 2018-12-27 | System, method, apparatus and computer storage medium for data synchronization |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811615533.5A CN109815028B (en) | 2018-12-27 | 2018-12-27 | System, method, apparatus and computer storage medium for data synchronization |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109815028A true CN109815028A (en) | 2019-05-28 |
| CN109815028B CN109815028B (en) | 2022-02-08 |
Family
ID=66602587
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811615533.5A Active CN109815028B (en) | 2018-12-27 | 2018-12-27 | System, method, apparatus and computer storage medium for data synchronization |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109815028B (en) |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110427426A (en) * | 2019-08-02 | 2019-11-08 | 中国工商银行股份有限公司 | A kind of data synchronizing processing method and device |
| CN110489249A (en) * | 2019-08-23 | 2019-11-22 | 行吟信息科技（上海）有限公司 | A kind of processing method and system of message |
| CN110727736A (en) * | 2019-10-24 | 2020-01-24 | 中国建设银行股份有限公司 | Data synchronization method and device, electronic equipment and storage medium |
| CN110990476A (en) * | 2019-12-17 | 2020-04-10 | 腾讯科技（深圳）有限公司 | Data importing method, device, server and storage medium |
| CN111026774A (en) * | 2019-12-03 | 2020-04-17 | 深圳前海环融联易信息科技服务有限公司 | Data sequence synchronization method and device, computer equipment and storage medium |
| CN111031336A (en) * | 2019-12-10 | 2020-04-17 | 北京达佳互联信息技术有限公司 | Live broadcast list data updating method and device, electronic equipment and storage medium |
| CN111177173A (en) * | 2020-01-02 | 2020-05-19 | 普元信息技术股份有限公司 | System and method for realizing data synchronization optimization processing under big data environment |
| CN111193656A (en) * | 2019-12-03 | 2020-05-22 | 中国建设银行股份有限公司 | Message pushing method and device |
| CN111339186A (en) * | 2020-02-19 | 2020-06-26 | 平安科技（深圳）有限公司 | Workflow engine data synchronization method, device, medium and electronic equipment |
| CN111367692A (en) * | 2020-03-09 | 2020-07-03 | 政采云有限公司 | Search engine data processing method and device, electronic equipment and medium |
| CN111506337A (en) * | 2020-04-15 | 2020-08-07 | 中国银行股份有限公司 | Application software updating method and device |
| CN111552575A (en) * | 2019-12-31 | 2020-08-18 | 远景智能国际私人投资有限公司 | Message queue-based message consumption method, device and equipment |
| CN111767343A (en) * | 2020-06-23 | 2020-10-13 | 中国工商银行股份有限公司 | Test data synchronization method and device based on message queue, equipment and medium |
| CN111813868A (en) * | 2020-08-13 | 2020-10-23 | 中国工商银行股份有限公司 | Data synchronization method and device |
| CN112000350A (en) * | 2020-07-29 | 2020-11-27 | 新华三大数据技术有限公司 | Dynamic rule updating method, device and storage medium |
| CN112069265A (en) * | 2020-09-11 | 2020-12-11 | 中国工商银行股份有限公司 | Configuration data synchronization method, service data system, computer system and medium |
| CN113032491A (en) * | 2021-04-07 | 2021-06-25 | 工银科技有限公司 | Method, device, electronic equipment and medium for realizing static data synchronization |
| CN113377863A (en) * | 2020-03-10 | 2021-09-10 | 阿里巴巴集团控股有限公司 | Data synchronization method and device, electronic equipment and computer readable storage medium |
| WO2021174537A1 (en) * | 2020-03-06 | 2021-09-10 | 深圳市欢太科技有限公司 | Data transmission method and apparatus |
| CN113448725A (en) * | 2021-05-27 | 2021-09-28 | 深圳震有科技股份有限公司 | Data pushing method, device, terminal and storage medium |
| CN113656221A (en) * | 2021-08-18 | 2021-11-16 | 中国邮政储蓄银行股份有限公司 | Data processing method and device, computer readable storage medium and processor |
| US11200255B2 (en) | 2019-08-22 | 2021-12-14 | Adp, Llc | Robust data synchronization solution between databases |
| CN113805910A (en) * | 2020-11-26 | 2021-12-17 | 北京沃东天骏信息技术有限公司 | Method and system for sharing data in application |
| CN115080366A (en) * | 2022-08-22 | 2022-09-20 | 深圳依时货拉拉科技有限公司 | Alarm method, alarm device, computer equipment and storage medium |
| CN115237630A (en) * | 2022-07-25 | 2022-10-25 | 小米汽车科技有限公司 | Data processing method and device, vehicle, storage medium and chip |
| CN116821245A (en) * | 2023-07-05 | 2023-09-29 | 贝壳找房(北京)科技有限公司 | Data aggregation synchronization method and storage medium in distributed scene |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100100688A1 (en) * | 2008-10-16 | 2010-04-22 | Microsoft Corporation | Low-level conditional synchronization support |
| US20160197849A1 (en) * | 2015-01-07 | 2016-07-07 | Mckesson Corporation | Method and Apparatus for Implementing a Messaging Interface |
| CN106390453A (en) * | 2016-08-31 | 2017-02-15 | 腾讯科技（深圳）有限公司 | Game system and game processing method |
| CN106713487A (en) * | 2017-01-16 | 2017-05-24 | 腾讯科技（深圳）有限公司 | Data synchronization method and device |
| CN106815338A (en) * | 2016-12-25 | 2017-06-09 | 北京中海投资管理有限公司 | A kind of real-time storage of big data, treatment and inquiry system |
| CN107038162A (en) * | 2016-02-03 | 2017-08-11 | 滴滴（中国）科技有限公司 | Real time data querying method and system based on database journal |
| CN107395729A (en) * | 2017-07-27 | 2017-11-24 | 深圳乐信软件技术有限公司 | A kind of consumption system of message queue, method and device |
| CN107729366A (en) * | 2017-09-08 | 2018-02-23 | 广东省建设信息中心 | A kind of pervasive multi-source heterogeneous large-scale data synchronization system |
| CN107783975A (en) * | 2016-08-24 | 2018-03-09 | 北京京东尚科信息技术有限公司 | The method and apparatus of distributed data base synchronization process |
| CN108156181A (en) * | 2018-02-01 | 2018-06-12 | 杭州安恒信息技术股份有限公司 | A kind of vulnerability detection method and its vulnerability scanning system based on the association asynchronous IO of journey |
| CN108173917A (en) * | 2017-12-22 | 2018-06-15 | 杭州顺网珑腾信息技术有限公司 | A kind of Internet chatroom message repeater system of distribution no maximum |
| CN108763387A (en) * | 2018-05-20 | 2018-11-06 | 湖北九州云仓科技发展有限公司 | Big data fusion method, electronic equipment, storage medium and the system of heterogeneous platform |
| CN108769172A (en) * | 2018-05-21 | 2018-11-06 | 杭州有赞科技有限公司 | A kind of method of data synchronization and system |
-
2018
- 2018-12-27 CN CN201811615533.5A patent/CN109815028B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100100688A1 (en) * | 2008-10-16 | 2010-04-22 | Microsoft Corporation | Low-level conditional synchronization support |
| US20160197849A1 (en) * | 2015-01-07 | 2016-07-07 | Mckesson Corporation | Method and Apparatus for Implementing a Messaging Interface |
| CN107038162A (en) * | 2016-02-03 | 2017-08-11 | 滴滴（中国）科技有限公司 | Real time data querying method and system based on database journal |
| CN107783975A (en) * | 2016-08-24 | 2018-03-09 | 北京京东尚科信息技术有限公司 | The method and apparatus of distributed data base synchronization process |
| CN106390453A (en) * | 2016-08-31 | 2017-02-15 | 腾讯科技（深圳）有限公司 | Game system and game processing method |
| CN106815338A (en) * | 2016-12-25 | 2017-06-09 | 北京中海投资管理有限公司 | A kind of real-time storage of big data, treatment and inquiry system |
| CN106713487A (en) * | 2017-01-16 | 2017-05-24 | 腾讯科技（深圳）有限公司 | Data synchronization method and device |
| CN107395729A (en) * | 2017-07-27 | 2017-11-24 | 深圳乐信软件技术有限公司 | A kind of consumption system of message queue, method and device |
| CN107729366A (en) * | 2017-09-08 | 2018-02-23 | 广东省建设信息中心 | A kind of pervasive multi-source heterogeneous large-scale data synchronization system |
| CN108173917A (en) * | 2017-12-22 | 2018-06-15 | 杭州顺网珑腾信息技术有限公司 | A kind of Internet chatroom message repeater system of distribution no maximum |
| CN108156181A (en) * | 2018-02-01 | 2018-06-12 | 杭州安恒信息技术股份有限公司 | A kind of vulnerability detection method and its vulnerability scanning system based on the association asynchronous IO of journey |
| CN108763387A (en) * | 2018-05-20 | 2018-11-06 | 湖北九州云仓科技发展有限公司 | Big data fusion method, electronic equipment, storage medium and the system of heterogeneous platform |
| CN108769172A (en) * | 2018-05-21 | 2018-11-06 | 杭州有赞科技有限公司 | A kind of method of data synchronization and system |
Non-Patent Citations (1)
| Title |
|---|
| 李若鹏: "基于大数据的网络异常行为检测平台的设计与实现", 《中国优秀博硕士学位论文全文数据库(硕士)信息科技辑》 * |
Cited By (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110427426A (en) * | 2019-08-02 | 2019-11-08 | 中国工商银行股份有限公司 | A kind of data synchronizing processing method and device |
| US11200255B2 (en) | 2019-08-22 | 2021-12-14 | Adp, Llc | Robust data synchronization solution between databases |
| CN110489249A (en) * | 2019-08-23 | 2019-11-22 | 行吟信息科技（上海）有限公司 | A kind of processing method and system of message |
| CN110489249B (en) * | 2019-08-23 | 2022-03-22 | 行吟信息科技（上海）有限公司 | Message processing method and system |
| CN110727736A (en) * | 2019-10-24 | 2020-01-24 | 中国建设银行股份有限公司 | Data synchronization method and device, electronic equipment and storage medium |
| CN111026774A (en) * | 2019-12-03 | 2020-04-17 | 深圳前海环融联易信息科技服务有限公司 | Data sequence synchronization method and device, computer equipment and storage medium |
| CN111193656A (en) * | 2019-12-03 | 2020-05-22 | 中国建设银行股份有限公司 | Message pushing method and device |
| CN111031336A (en) * | 2019-12-10 | 2020-04-17 | 北京达佳互联信息技术有限公司 | Live broadcast list data updating method and device, electronic equipment and storage medium |
| CN110990476B (en) * | 2019-12-17 | 2023-04-07 | 腾讯科技（深圳）有限公司 | Data importing method, device, server and storage medium |
| CN110990476A (en) * | 2019-12-17 | 2020-04-10 | 腾讯科技（深圳）有限公司 | Data importing method, device, server and storage medium |
| CN111552575B (en) * | 2019-12-31 | 2023-09-12 | 远景智能国际私人投资有限公司 | Message consumption method, device and equipment based on message queue |
| CN111552575A (en) * | 2019-12-31 | 2020-08-18 | 远景智能国际私人投资有限公司 | Message queue-based message consumption method, device and equipment |
| CN111177173A (en) * | 2020-01-02 | 2020-05-19 | 普元信息技术股份有限公司 | System and method for realizing data synchronization optimization processing under big data environment |
| CN111339186A (en) * | 2020-02-19 | 2020-06-26 | 平安科技（深圳）有限公司 | Workflow engine data synchronization method, device, medium and electronic equipment |
| CN111339186B (en) * | 2020-02-19 | 2022-09-30 | 平安科技（深圳）有限公司 | Workflow engine data synchronization method, device, medium and electronic equipment |
| WO2021174537A1 (en) * | 2020-03-06 | 2021-09-10 | 深圳市欢太科技有限公司 | Data transmission method and apparatus |
| CN111367692A (en) * | 2020-03-09 | 2020-07-03 | 政采云有限公司 | Search engine data processing method and device, electronic equipment and medium |
| CN111367692B (en) * | 2020-03-09 | 2023-08-22 | 政采云有限公司 | Search engine data processing method and device, electronic equipment and medium |
| CN113377863A (en) * | 2020-03-10 | 2021-09-10 | 阿里巴巴集团控股有限公司 | Data synchronization method and device, electronic equipment and computer readable storage medium |
| CN113377863B (en) * | 2020-03-10 | 2022-04-29 | 阿里巴巴集团控股有限公司 | Data synchronization method and device, electronic equipment and computer readable storage medium |
| CN111506337A (en) * | 2020-04-15 | 2020-08-07 | 中国银行股份有限公司 | Application software updating method and device |
| CN111767343A (en) * | 2020-06-23 | 2020-10-13 | 中国工商银行股份有限公司 | Test data synchronization method and device based on message queue, equipment and medium |
| CN112000350A (en) * | 2020-07-29 | 2020-11-27 | 新华三大数据技术有限公司 | Dynamic rule updating method, device and storage medium |
| CN111813868A (en) * | 2020-08-13 | 2020-10-23 | 中国工商银行股份有限公司 | Data synchronization method and device |
| CN111813868B (en) * | 2020-08-13 | 2023-11-10 | 中国工商银行股份有限公司 | Data synchronization method and device |
| CN112069265A (en) * | 2020-09-11 | 2020-12-11 | 中国工商银行股份有限公司 | Configuration data synchronization method, service data system, computer system and medium |
| CN112069265B (en) * | 2020-09-11 | 2024-01-30 | 中国工商银行股份有限公司 | Synchronization method of configuration data, business data system, computer system and medium |
| CN113805910A (en) * | 2020-11-26 | 2021-12-17 | 北京沃东天骏信息技术有限公司 | Method and system for sharing data in application |
| CN113032491B (en) * | 2021-04-07 | 2023-01-06 | 工银科技有限公司 | Method, device, electronic equipment and medium for realizing static data synchronization |
| CN113032491A (en) * | 2021-04-07 | 2021-06-25 | 工银科技有限公司 | Method, device, electronic equipment and medium for realizing static data synchronization |
| CN113448725A (en) * | 2021-05-27 | 2021-09-28 | 深圳震有科技股份有限公司 | Data pushing method, device, terminal and storage medium |
| CN113656221A (en) * | 2021-08-18 | 2021-11-16 | 中国邮政储蓄银行股份有限公司 | Data processing method and device, computer readable storage medium and processor |
| CN115237630A (en) * | 2022-07-25 | 2022-10-25 | 小米汽车科技有限公司 | Data processing method and device, vehicle, storage medium and chip |
| CN115237630B (en) * | 2022-07-25 | 2023-11-21 | 小米汽车科技有限公司 | Data processing method, device, vehicle, storage medium and chip |
| CN115080366A (en) * | 2022-08-22 | 2022-09-20 | 深圳依时货拉拉科技有限公司 | Alarm method, alarm device, computer equipment and storage medium |
| CN116821245A (en) * | 2023-07-05 | 2023-09-29 | 贝壳找房(北京)科技有限公司 | Data aggregation synchronization method and storage medium in distributed scene |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109815028B (en) | 2022-02-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109815028A (en) | Data synchronous system, method, apparatus and computer storage medium | |
| Pargmann et al. | Intelligent big data processing for wind farm monitoring and analysis based on cloud-technologies and digital twins: A quantitative approach | |
| CN107850882B (en) | Automation and control distributed | |
| CN105653425B (en) | Monitoring system based on complex event processing engine | |
| CN109214704A (en) | A kind of distributed intelligence operation platform, method, apparatus and readable storage medium storing program for executing | |
| D'silva et al. | Real-time processing of IoT events with historic data using Apache Kafka and Apache Spark with dashing framework | |
| CN108733532B (en) | Health degree control method and device for big data platform, medium and electronic equipment | |
| CN105205231A (en) | DCOM (distributed component object model)-based digital simulation system for distribution network | |
| CN111327692A (en) | Model training method and device and cluster system | |
| CN109905286A (en) | A kind of method and system of monitoring device operating status | |
| WO2023246347A1 (en) | Digital twin processing method and digital twin system | |
| JP7114772B2 (en) | Certificate sending method, certificate receiving method, cloud and terminal equipment | |
| US10110679B2 (en) | Timed functions for distributed decentralized real time systems | |
| CN110673938A (en) | Task processing method, system, server and storage medium | |
| CN105553732B (en) | A kind of distributed network analogy method and system | |
| Nguyen et al. | A low-cost two-tier fog computing testbed for streaming IoT-based applications | |
| CN110321283A (en) | Interface testing case generation method, device, computer installation and storage medium | |
| CN108108986A (en) | A kind of design method of CRM system, device and electronic equipment | |
| Corradi et al. | SIRDAM4. 0: A support infrastructure for reliable data acquisition and management in industry 4.0 | |
| CN106021270B (en) | The method and system of synergistic data intelligence between data warehouse and big data storage | |
| CN115774573B (en) | Application integration method, device, electronic equipment and storage medium | |
| Pham | A big data analytics framework for IoT applications in the cloud | |
| CN110536283A (en) | Terminal identifier acquisition method, device, electronic equipment and medium | |
| CN110221910A (en) | Method and apparatus for executing MPI operation | |
| Bovina et al. | The evolution of monitoring system: the INFN-CNAF case study |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20201218 Address after: Room 168, building 6, 741 Hangzhou Road, Yangpu District, Shanghai 200090 Applicant after: HANHAI INFORMATION TECHNOLOGY SHANGHAI Co.,Ltd. Address before: Room Bnan 1231, 2 bungalows, No. 5 Road, College, Haidian District, Beijing, 100191 Applicant before: BEIJING MOBIKE TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP02 | Change in the address of a patent holder | ||
| CP02 | Change in the address of a patent holder |
Address after: 200090 Room 102, block D2 (Building 8), No. 221, Huangxing Road, Yangpu District, Shanghai Patentee after: HANHAI INFORMATION TECHNOLOGY SHANGHAI Co.,Ltd. Address before: Room 168, building 6, 741 Hangzhou Road, Yangpu District, Shanghai 200090 Patentee before: HANHAI INFORMATION TECHNOLOGY SHANGHAI Co.,Ltd. |