CN105446651A - Memory mirroring method and system, data emitter, and data receiver - Google Patents
Memory mirroring method and system, data emitter, and data receiver Download PDFInfo
- Publication number
- CN105446651A CN105446651A CN201410224634.5A CN201410224634A CN105446651A CN 105446651 A CN105446651 A CN 105446651A CN 201410224634 A CN201410224634 A CN 201410224634A CN 105446651 A CN105446651 A CN 105446651A
- Authority
- CN
- China
- Prior art keywords
- data
- buffer memory
- write
- memory
- send
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0626—Reducing size or complexity of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
- G06F3/0659—Command handling arrangements, e.g. command buffers, queues, command scheduling
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer And Data Communications (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides a memory mirroring method and system, a data emitter, and a data receiver; the method comprises the following steps: building a data emitting memory in a data emission end, building a data receiving memory in a data reception end, and building a transmission link between the data emitting memory and the data receiving memory; writing data into the data emitting memory, and sending the data, written in the data emitting memory, to the data receiving memory through the transmission link. The method and system can avoid the disk processing capability bottleneck, can obviously reduce developing work aiming at various adaption logics, and can reduce operation and maintenance quantity.
Description
Technical field
Embodiment of the present invention relates to technical field of data transmission, more specifically, relates to a kind of memory mirror method and system and data sending device and data sink.
Background technology
In the current information age, various information equipment arises at the historic moment: have landline telephone, the mobile phone for Tone Via; There are the server for information resources share, process and PC; There are various televisors shown for video data etc.These equipment are all produce for solving actual demand in specific area.Along with the arrival that E-consumer, computing machine, communication (3C) are merged, notice has been put in the research that fully utilizes the information equipment of each different field by people more and more, better serves to make full use of existing resource equipment for people.
In various real-time system, often need real-time for the data of up-to-date generation to render in application system, applied to allow real time data.This has just related to the internal storage data stationary problem of one-to-many.In the prior art, first by real-time system by the data dump in internal memory in disk, and write as file; And then by pp file transmission instruments such as ftp/scp, by network, file serial is distributed on business machine.Then, instrument timing on business machine is read (load) this file and is stored in disk, again from the internal memory of disk write business machine, the line ordering and index and wait action of going forward side by side, last business machine informing business process use or for inquiry service process.
But this internal memory is to disk, and disk is to network, and network is to disk, and disk, to the data transfer mode of internal memory, at least has its own shortcomings:
1, cost of development is high: need exploitation dump mathematical logic, load mathematical logic and call the logics such as ftp/scp, also needs the logic of exploitation timing defrag and checks whether data transmit complete logic.
2, the transmission time is long: the time that the dump time of file, file serial send (runs into large files and also needs speed limit across machine room transmission, then the time is more of a specified duration), time of timer timing load file, be exactly total the transmission time of the cumulative sum of these times.
3, there is a large amount of O&M amounts: due to will disk be write, cannot image file generation be carried out when machine disk failure or when disk is full.And the method also relies on third party software.When carrying out machine migration, also having a large amount of scripts needs migration.
Summary of the invention
Embodiment of the present invention proposes a kind of memory mirror method, to reduce cost of development.
Embodiment of the present invention also proposed a kind of memory mirror system, to reduce cost of development.
Embodiment of the present invention also proposed a kind of data sending device, to reduce cost of development.
Embodiment of the present invention also proposed a kind of data sink, to reduce cost of development.
The concrete scheme of embodiment of the present invention is as follows:
A kind of memory mirror method, the method comprises:
Create data at data sending terminal and send internal memory, create data receiver internal memory at data receiver, and set up transmission link between described data transmission internal memory and described data receiver internal memory;
Data are write described data and send internal memory, and based on described transmission link, the described data that described for write data send internal memory are sent to described data receiver internal memory.
A kind of memory mirror system, comprises data sending terminal and data receiver, and described data sending terminal comprises data and sends internal memory, and described data receiver comprises data receiver internal memory; Send between internal memory and described data receiver internal memory in described data and there is transmission link;
Described data for generating data, being write described data and sending internal memory, and based on described transmission link, the described data that described for write data send internal memory are sent to described data receiver internal memory by described data sending terminal;
Described data receiver, for obtaining the data that described data receiver internal memory receives.
A kind of data sending device, comprise data send write buffer memory, data send and read buffer memory and distribution control module, wherein: data send and read to have transmission link between buffer memory and the internal memory of data sink;
Data send and write buffer memory, for writing data;
Data send and read buffer memory, for described data being sent to based on described transmission link the internal memory of described data sink;
Distribution control module, for send in data write data write buffer memory after to send in described data and write buffer memory and described data and send and read to switch between buffer memory.
A kind of data sink, comprises that data receiver writes buffer memory, data receiver reads buffer memory and reception control unit, wherein: data receiver is write between buffer memory and the internal memory of data sending device has transmission link;
Data receiver writes buffer memory, for writing data based on described transmission link from the internal memory of described data sending device;
Data receiver reads buffer memory, for described data are sent to data processing equipment;
Reception control unit, writes buffer memory and described data receiver is read to switch between buffer memory at described data receiver after writing buffer memory at data write data receiver.
As can be seen from technique scheme, in embodiments of the present invention, create data at data sending terminal and send internal memory, create data receiver internal memory at data receiver, and set up transmission link between described data transmission internal memory and described data receiver internal memory; Data are write described data and send internal memory, and based on described transmission link, the described data that described for write data send internal memory are sent to described data receiver internal memory.As can be seen here, different with the data transfer mode of ", to disk, disk is to network, and network is to disk, and disk is to internal memory for internal memory " in prior art, the transmission mode that the present invention uses " internal memory-network-internal memory ".Owing to directly transmitting data between internal memory by network, the processing power bottleneck of disk can be avoided, and significantly can reduce the development for various adaptation, logic, and reduce O&M amount.
In addition, embodiment of the present invention achieves the memory mirror service architecture of one-to-many.Based on the one-to-many host-host protocol of such as ask agreement and so on, by the mode that internal memory transmits, allow a large amount of data receivers (such as kiosk) obtain fast and the on all four internal storage data block of data sending terminal (such as main control computer), thus the service of memory mirror can be externally provided.
Accompanying drawing explanation
Fig. 1 is according to embodiment of the present invention memory mirror method flow diagram;
Fig. 2 is according to embodiment of the present invention memory mirror system construction drawing;
Fig. 3 is according to embodiment of the present invention memory mirror process schematic diagram;
Fig. 4 is the structural drawing according to embodiment of the present invention data sending device;
Fig. 5 is the structural drawing according to embodiment of the present invention data sink.
Embodiment
For making the object, technical solutions and advantages of the present invention clearly, below in conjunction with accompanying drawing, the present invention is described in further detail.
Succinct and directly perceived in order to what describe, hereafter by description some representational embodiments, the solution of the present invention is set forth.Details a large amount of in embodiment only understands the solution of the present invention for helping.But these details can be not limited to when clearly, technical scheme of the present invention realizes.In order to avoid unnecessarily fuzzy the solution of the present invention, some embodiments do not describe meticulously, but only give framework.Hereinafter, " comprising " refers to " including but not limited to ", " according to ... " refer to " at least basis ..., but be not limited to only basis ... ".Due to the speech habits of Chinese, when hereinafter not particularly pointing out the quantity of a composition, mean that this composition can be one also can be multiple, or can be regarded as at least one.
Based in the various application of internet; backstage exploitation often can run into such demand: internal storage data (as: certain writes the internal storage data table of data, and certain builds up the sorted data structure of the index) one-way pushing on certain machine is delivered in the internal memory of other machines.
Embodiment of the present invention proposes a kind of unidirectional internal memory transmission service newly, can be transferred to directly unidirectional for the data of write memory on the internal memory of distributed type assemblies.Based on various one-to-many host-host protocol (such as ask agreement), the quick distribution of various memory mirror can be carried out, ensure the consistance of data and the real-time of application, and the reliability improving distribution also greatly reduces O&M amount simultaneously.
Fig. 1 is according to embodiment of the present invention memory mirror method flow diagram.
As shown in Figure 1, the method comprises:
Step 101: create data at data sending terminal and send internal memory, create data receiver internal memory at data receiver, and transmission link is set up between described data transmission internal memory and described data receiver internal memory.
Step 102: data are write described data and send internal memory, and based on described transmission link, the described data that described for write data send internal memory are sent to described data receiver internal memory.
In one embodiment:
Described data send internal memory and comprise data and send and write buffer memory and data and send and read buffer memory; Described data receiver internal memory comprises data receiver and writes buffer memory and data receiver reads buffer memory; Described transmission link is that described data send and read buffer memory and described data receiver and write transmission link between buffer memory;
Describedly data are write described data and send internal memory, and be sent to described data receiver internal memory based on the described data that the described data of write to be sent internal memory by described transmission link and comprise:
Data are write described data to send and write buffer memory, and send in described data after data write and write buffer memory and described data and send and read to switch between buffer memory;
Based on described transmission link the data after described switching are sent and read data described in buffer memory and be sent to data receiver and write buffer memory, and write buffer memory and data receiver is read to switch between buffer memory at described data receiver after data are sent.
In one embodiment:
The method comprises further:
Data after being switched described in judgement send the capacity writing buffer memory and whether meet next round write data volume, and if so, the data after being switched described in employing send writes buffer memory reception next round write data; If not, create the new data transmission meeting described next round write data volume and write buffer memory.
In one embodiment:
Data are write described data receiver to write buffer memory and comprise:
Judge that whether the capacity that described data receiver writes buffer memory meets the described data of write, if it is adopt described data receiver to write buffer memory and receive described data; If not, then create the data receiver meeting described data and write buffer memory, and utilize the data receiver meeting described data of described establishment to write buffer memory to receive described data.
As can be seen here, different with the data transfer mode of ", to disk, disk is to network, and network is to disk, and disk is to internal memory for internal memory " in prior art, the transmission mode that the present invention uses " internal memory-network-internal memory ".Owing to directly transmitting data between internal memory by network, the processing power bottleneck of disk can be avoided, and can significantly reduce various adaptation, logic, and reduce O&M amount.
Based on above-mentioned labor, embodiment of the present invention also proposed a kind of memory mirror system.
Fig. 2 is according to embodiment of the present invention memory mirror system construction drawing.
As shown in Figure 2, this system comprises data sending terminal 201 and data receiver 302, and described data sending terminal 201 comprises data and sends internal memory, and described data receiver 202 comprises data receiver internal memory; Send between internal memory and described data receiver internal memory in described data and there is transmission link;
Described data for generating data, being write described data and sending internal memory, and based on described transmission link, the described data that described for write data send internal memory are sent to described data receiver internal memory by described data sending terminal 201;
Described data receiver 202, for obtaining the data that described data receiver internal memory receives.
In one embodiment:
Described data send internal memory and comprise data and send and write buffer memory and data and send and read buffer memory; Described data receiver internal memory comprises data receiver and writes buffer memory and data receiver reads buffer memory; Described transmission link is that described data send and read buffer memory and described data receiver and write transmission link between buffer memory;
Data, for generating data, are write described data and send and write buffer memory by described data sending terminal 201, and send in described data after data write and write buffer memory and described data and send and read to switch between buffer memory; Based on described transmission link the data after described switching are sent and read data described in buffer memory and be sent to data receiver and write buffer memory, and write buffer memory and data receiver is read to switch between buffer memory at described data receiver after data are sent.
In one embodiment:
Data sending terminal 201, sends for the data after being switched described in judging the capacity writing buffer memory and whether meets next round write data volume, and the data after being switched described in if it is adopting send to be write buffer memory and receive next round write data; If not, then create the new data transmission meeting described next round write data volume and write buffer memory.
In one embodiment:
Data receiver 201, is further used for judging whether the capacity that described data receiver writes buffer memory meets the described data of write, if it is adopts described data receiver to write buffer memory and receives described data; If not, then create the data receiver meeting described data and write buffer memory, and utilize the data receiver meeting described data of described establishment to write buffer memory to receive described data.
In one embodiment:
Data sending terminal 201 and data receiver 202 have the mapping relations of one-to-many.As can be seen here, embodiment of the present invention achieves the memory mirror service architecture of one-to-many.Such as, can based on the one-to-many host-host protocol of such as ask agreement and so on, by the mode that internal memory transmits, allow thousands of data receivers (such as kiosk) obtain fast and the on all four internal storage data block of data sending terminal (such as main control computer), the service of memory mirror is externally provided.
Illustrate below and set forth the present invention in further detail.
Fig. 3 is according to embodiment of the present invention memory mirror process schematic diagram.Based on processing procedure shown in Fig. 3, parallel transmission internal storage data can be realized between main control computer and multiple kiosk.Wherein:
Main control computer: for generating the machine of internal storage data; Kiosk: for receiving internal storage data and using the machine of this internal storage data; Host-host protocol: the internal memory host-host protocol refering in particular to one-to-many, includes but not limited to ask agreement.
Main control computer and kiosk, after startup distribution services, create two pieces of shared drives respectively, and to set up double buffering, wherein one piece for reading buffer memory, and buffer memory is write in other one piece of conduct.Such as, as seen from Figure 3, main control computer comprises and writes buffer memory a and read buffer memory b; Kiosk comprises to be write buffer memory c and reads buffer memory d.
Main control computer starts distribution services, kiosk starts internal memory and receive service, reading buffer memory b and writing between buffer memory c to set up transmission link based on host-host protocol.Main control computer write buffer memory a for from be arranged in main control computer data generation system write data, or from be positioned at outside main control computer data generation system write data; Main control computer read buffer memory b for keeping transmission link with the buffer memory c that writes of kiosk, and data are sent to kiosk write buffer memory c; Kiosk write buffer memory c for keeping transmission link with the buffer memory b that reads of main control computer, and from main control computer read buffer memory b write data; Kiosk read buffer memory d for data being sent to the operation system be positioned within kiosk, use for operation system, or data be sent to the operation system be positioned at outside kiosk, use for operation system.
Particularly, the data of generation are write in buffer memory a by the data generation system invoke memory mirror image distributed components on main control computer.After data write the end of operation of buffer memory a, main control computer carries out double buffering switching, and is read on buffer memory to the current of main control computer by the Cache associativity of writing of kiosk based on the distribution services of host-host protocol.Namely, main control computer with write buffer memory a displace current using read buffer memory b, based on the distribution services of host-host protocol, by new buffer memory of reading, (namely original buffer memory of writing a) is associated with on the current write cache c of kiosk.Then, main control computer can start the request of data processing kiosk, and replys new data to kiosk.Now be replaced get off read buffer memory b, using the current write cache as main control computer, for follow-up data write.If the current write cache of this main control computer (namely original read buffer memory b) is large not, then can destroy current write cache (namely original read buffer memory b), what re-create applicable size writes buffer memory.
And, in business machine side, write the size of data that first buffer memory c obtains this secondary reception before receiving data.After the size of data of this secondary reception is greater than the current capacities writing buffer memory c, destroy current write cache c, and newly-built applicable size write buffer memory c.Set up new write buffer memory c after, the write of reception data is newly-established writes buffer memory c, and after data receiver, with this newly-established write buffer memory c displace current using read buffer memory d, and operation system on informing business machine uses and new reads buffer memory d to read data.
What be now replaced reads buffer memory d, using as the write writing buffer memory c and wait for lower secondary data.If the data write still are greater than the size writing buffer memory c (what be namely replaced reads buffer memory d), then first destroy and current write buffer memory c (what be namely replaced reads buffer memory d), what then re-create new applicable size writes buffer memory.
To be positioned within kiosk or outside operation system, invoke memory distributed components directly can obtain data and be applied in business.
Wherein, user can perform the process sending media information on various main control computer or kiosk, these main control computers and kiosk can include, but are not limited to: functional mobile phone, smart mobile phone, palm PC, PC (PC), panel computer or personal digital assistant (PDA), etc.
Although enumerate the instantiation of main control computer and kiosk above in detail, those skilled in the art can recognize, these are enumerated is only purposes of illustration, is not intended to limit the present invention the protection domain of embodiment.
Principal feature based on the memory mirror distribution approach of host-host protocol is as follows:
(1), second level Data dissemination: meet the requirement of real-time system to real-time property completely.
(2), save cost of development: the directly mirroring service of memory-to-memory, business is developed without the need to oneself, directly can use the data of internal memory, and business is without the need to being concerned about the problem how synchronously how to upgrade of data.
(3), reliable and stable, save O&M cost: the process of data syn-chronization is the transmission mode of directly " internal memory-network-internal memory ", can not through the process of " internal memory is to disk; disk is to network; network is to disk, and disk is to internal memory ", be decreased out abnormal possible by the process of simplifying.
(4), business side's unaware: business side when usage data complete unaware carry out Data Update and replacement, without the need to restarting business process.
(5), distributed type assemblies is applicable to: the data transmission of one-to-many, is suitable for large-scale distributed applied business.
(6), disaster tolerance: in transmitting procedure, if platform receiver is delayed machine arbitrarily, ask agreement can ensure that other machines can normal receive data.Can continue to issue data to it after failed machines starts again, the machine having accepted data can not be influenced.In receiving course, the machine if main control computer is delayed, after receiver writes the data that the last item receives, then start to wait for the arrival of also again asking next data, because read-write cache independently separates, read buffer memory and normally for business side, can not produce any impact.Until after main control computer starts again, can continue to issue remaining data to kiosk, the data sent do not need to resend.
In fact, the present invention can be implemented in various applications.Below send out the network promotion (such as web advertisement position) and sequence information is that example is described.
When discovery order data or advertisement position data (include but not limited to tables of data, structure, the various forms of internal storage datas such as resource picture) when changing, now need order and advertisement position data syn-chronization on the multiple stage machine of adx Ask-Bid System (operation system).
Now, main control computer starts and issues service, adx machine starts the service of reception; Main control computer checking tool (data generation system) will write buffer memory in digital independent write memory; Exchange after writing data and read buffer memory and Write post.There occurs read-write exchange when distribution services is checked through, then start to connect and new read buffer memory.If now receive the request of data of adx machine (receiver), then start to utilize ask agreement synchronously to issue data to multiple stage adx machine.
Adx machine (receiver) checks that current to write buffer memory whether enough large, if it is too little to write buffer memory, destroy current write cache, what re-create applicable size writes buffer memory.After confirming that writing buffer memory is ready to, the data received are write in buffer memory, write rear exchange and read buffer memory and write buffer memory.Adx Ask-Bid System, when queries ad position and sequence information, if find that read-write cache occurs to exchange, connects and new reads buffer memory, read queries ad position and sequence information in buffer memory in new.
Embodiment of the present invention is applicable to plurality of application scenes.Such as, the scene of the unidirectional reliable transmission of data fast of the one-to-many of small data quantity (being no more than 2G) is particularly useful for.Such as: 1, in adx advertisement bidding system, ad spot information and sequence information is issued to adxServer; 2, in based data service, issue ip database data to all service servers, carry out local ip data query for business; 3, in log service system, in real time to kiosk distribution dyeing configuration data.
In embodiments of the present invention, only need be obtained the start address of shared drive when transmitting terminal business uses by various interfaces such as get_buf, then write data, call the various interfaces such as update after writing data and start to issue data.When each usage data, receiving end business has checked whether that new data arrives, if find that new data calls the various interfaces such as receiving terminal get_data and can use new data.The DRP data reception process business of receiving end is unaware, only after data receiver, just can revise state, allows the business side of receiving end be checked through new data and arrives.
Based on above-mentioned labor, embodiment of the present invention also proposed a kind of data sending device.Fig. 4 is the structural drawing according to embodiment of the present invention data sending device.
As shown in Figure 4,
This data sending device comprise data send write buffer memory 401, data send and read buffer memory 402 and distribution control module 403, wherein: data send read buffer memory 402 and the data sink outside this data sending device internal memory between there is transmission link;
Data send and write buffer memory 401, for writing data;
Data send and read buffer memory 402, for described data being sent to based on described transmission link the internal memory of described data sink;
Distribution control module 403, for send in data write data write buffer memory after to send in described data and write buffer memory and described data and send and read to switch between buffer memory.
In one embodiment, data send and write buffer memory 401, for obtaining write data from the data generation system be positioned within data sending device.
In one embodiment:
Distribution control module 403, is further used for the data after being switched described in judging and sends the capacity writing buffer memory and whether meet next round write data volume, and the data after being switched described in if it is adopting send to be write buffer memory and receive next round write data; If not, then create the new data transmission meeting described next round write data volume and write buffer memory.
Based on above-mentioned labor, embodiment of the present invention also proposed a kind of data sink.Fig. 5 is the structural drawing according to embodiment of the present invention data sink.
As shown in Figure 5, data sink comprises that data receiver writes buffer memory 501, data receiver reads buffer memory 502 and reception control unit 503, wherein: have transmission link between the internal memory that data receiver writes buffer memory 501 and the data sending device outside this data sink;
Data receiver writes buffer memory 501, for writing data based on described transmission link from the internal memory of described data sending device;
Data receiver reads buffer memory 502, for described data are sent to data processing equipment;
Reception control unit 503, writes buffer memory and described data receiver is read to switch between buffer memory at described data receiver after writing buffer memory at data write data receiver.
In one embodiment:
Reception control unit 503, is further used for judging whether the capacity that described data receiver writes buffer memory meets the described data of write, if it is adopts described data receiver to write buffer memory and receives described data; If not, then create the data receiver meeting described data and write buffer memory, and utilize the data receiver meeting described data of described establishment to write buffer memory to receive described data.
In fact, memory mirror method and system that embodiment of the present invention proposes and data sending device and data sink can specifically be implemented by various ways.
Such as, the application programming interfaces of certain specification can be followed, memory mirror method is written as the plug-in card program be installed in PC, mobile terminal etc., also can be encapsulated as application program and download use voluntarily for user.When being written as plug-in card program, the multiple card format such as ocx, dll, cab can be implemented as.Also can implement by the concrete technology such as Flash plug-in unit, RealPlayer plug-in unit, MMS plug-in unit, MIDI staff plug-in unit, ActiveX plug-in unit the memory mirror method that embodiment of the present invention proposes.
The memory mirror method that embodiment of the present invention is proposed by the storing mode that can be stored by instruction or instruction set is stored on various storage medium.These storage mediums include, but are not limited to: floppy disk, CD, DVD, hard disk, flash memory, USB flash disk, CF card, SD card, mmc card, SM card, memory stick (MemoryStick), xD card etc.
In addition, the memory mirror method that embodiment of the present invention can also be proposed is applied in the storage medium based on flash memory (Nandflash), such as USB flash disk, CF card, SD card, SDHC card, mmc card, SM card, memory stick, xD card etc.
In sum, in embodiments of the present invention, create data at data sending terminal and send internal memory, create data receiver internal memory at data receiver, and set up transmission link between described data transmission internal memory and described data receiver internal memory; Data are write described data and send internal memory, and based on described transmission link, the described data that described for write data send internal memory are sent to described data receiver internal memory.As can be seen here, different with the data transfer mode of ", to disk, disk is to network, and network is to disk, and disk is to internal memory for internal memory " in prior art, the transmission mode that the present invention uses " internal memory-network-internal memory ".Owing to directly transmitting data between internal memory by network, the processing power bottleneck of disk can be avoided, and can significantly reduce various adaptation, logic, and reduce O&M amount.
In addition, embodiment of the present invention achieves the memory mirror service architecture of one-to-many.Based on the host-host protocol of such as ask agreement and so on, by the mode that internal memory transmits, allow a large amount of data receivers (such as kiosk) obtain fast and the on all four internal storage data block of data sending terminal (such as main control computer), thus the service of memory mirror can be externally provided.
And the present invention also has following advantages:
(1), second level Data dissemination: meet real-time system completely and can meet the requirement of real-time system to real-time property to the requirement of real-time property.
(2), save cost of development: the directly mirroring service of memory-to-memory, business is developed without the need to oneself, directly can use the data of internal memory, and business is without the need to being concerned about the problem how synchronously how to upgrade of data.
(3), reliable and stable, save O&M cost: the process of data syn-chronization is the transmission mode of directly " internal memory-network-internal memory ", can not through the process of " internal memory is to disk; disk is to network; network is to disk, and disk is to internal memory ", be decreased out abnormal possible by the process of simplifying.
(4), business side's unaware: business side when usage data complete unaware carry out Data Update and replacement, without the need to restarting business process.
(5), distributed type assemblies is applicable to: the data transmission of one-to-many, is suitable for large-scale distributed applied business.
(6), disaster tolerance: in transmitting procedure, if platform receiver is delayed machine arbitrarily, the host-host protocol of one-to-many can ensure that other machines can normal receive data.Can continue to issue data to it after failed machines starts again, the machine having accepted data can not be influenced.In receiving course, the machine if main control computer is delayed, after receiver writes the data that the last item receives, then start to wait for the arrival of also again asking next data, because read-write cache independently separates, read buffer memory and normally for business side, can not produce any impact.Until after main control computer starts again, can continue to issue remaining data to kiosk, the data sent do not need to resend.
The above, be only preferred embodiment of the present invention, be not intended to limit protection scope of the present invention.Within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (13)
1. a memory mirror method, is characterized in that, the method comprises:
Create data at data sending terminal and send internal memory, create data receiver internal memory at data receiver, and set up transmission link between described data transmission internal memory and described data receiver internal memory;
Data are write described data and send internal memory, and based on described transmission link, the described data that described for write data send internal memory are sent to described data receiver internal memory.
2. memory mirror method according to claim 1, is characterized in that, described data send internal memory and comprise data and send and write buffer memory and data and send and read buffer memory; Described data receiver internal memory comprises data receiver and writes buffer memory and data receiver reads buffer memory; Described transmission link is that described data send and read buffer memory and described data receiver and write transmission link between buffer memory;
Describedly data are write described data and send internal memory, and be sent to described data receiver internal memory based on the described data that the described data of write to be sent internal memory by described transmission link and comprise:
Data are write described data to send and write buffer memory, and send in described data after data write and write buffer memory and described data and send and read to switch between buffer memory;
Based on described transmission link the data after described switching are sent and read data described in buffer memory and be sent to data receiver and write buffer memory, and write buffer memory and data receiver is read to switch between buffer memory at described data receiver after data are sent.
3. memory mirror method according to claim 2, it is characterized in that, the method comprises further:
Data after being switched described in judgement send the capacity writing buffer memory and whether meet next round write data volume, and if so, the data after being switched described in employing send writes buffer memory reception next round write data; If not, create the new data transmission meeting described next round write data volume and write buffer memory.
4. memory mirror method according to claim 2, is characterized in that, describedly data is write described data receiver and writes buffer memory and comprise:
Judge that whether the capacity that described data receiver writes buffer memory meets the described data of write, if it is adopt described data receiver to write buffer memory and receive described data; If not, then create the data receiver meeting described data and write buffer memory, and utilize the data receiver meeting described data of described establishment to write buffer memory to receive described data.
5. a memory mirror system, is characterized in that, comprises data sending terminal and data receiver, and described data sending terminal comprises data and sends internal memory, and described data receiver comprises data receiver internal memory; Send between internal memory and described data receiver internal memory in described data and there is transmission link;
Described data for generating data, being write described data and sending internal memory, and based on described transmission link, the described data that described for write data send internal memory are sent to described data receiver internal memory by described data sending terminal;
Described data receiver, for obtaining the data that described data receiver internal memory receives.
6. memory mirror system according to claim 5, is characterized in that, described data send internal memory and comprise data and send and write buffer memory and data and send and read buffer memory; Described data receiver internal memory comprises data receiver and writes buffer memory and data receiver reads buffer memory; Described transmission link is that described data send and read buffer memory and described data receiver and write transmission link between buffer memory;
Data, for generating data, are write described data and send and write buffer memory by described data sending terminal, and send in described data after data write and write buffer memory and described data and send and read to switch between buffer memory; Based on described transmission link the data after described switching are sent and read data described in buffer memory and be sent to data receiver and write buffer memory, and write buffer memory and data receiver is read to switch between buffer memory at described data receiver after data are sent.
7. memory mirror system according to claim 6, is characterized in that,
Described data sending terminal, sends for the data after being switched described in judging the capacity writing buffer memory and whether meets next round write data volume, and the data after being switched described in if it is adopting send to be write buffer memory and receive next round write data; If not, then create the new data transmission meeting described next round write data volume and write buffer memory.
8. memory mirror system according to claim 6, is characterized in that,
Described data receiver, is further used for judging whether the capacity that described data receiver writes buffer memory meets the described data of write, if it is adopts described data receiver to write buffer memory and receives described data; If not, then create the data receiver meeting described data and write buffer memory, and utilize the data receiver meeting described data of described establishment to write buffer memory to receive described data.
9. memory mirror system according to claim 6, is characterized in that,
Described data sending terminal and described data receiver have the mapping relations of one-to-many.
10. a data sending device, is characterized in that, comprise data send write buffer memory, data send read buffer memory and distribution control module, wherein: data send read, between buffer memory and the internal memory of data sink, there is transmission link;
Data send and write buffer memory, for writing data;
Data send and read buffer memory, for described data being sent to based on described transmission link the internal memory of described data sink;
Distribution control module, for send in data write data write buffer memory after to send in described data and write buffer memory and described data and send and read to switch between buffer memory.
11. data sending devices according to claim 10, is characterized in that,
Distribution control module, is further used for the data after being switched described in judging and sends the capacity writing buffer memory and whether meet next round write data volume, and the data after being switched described in if it is adopting send to be write buffer memory and receive next round write data; If not, then create the new data transmission meeting described next round write data volume and write buffer memory.
12. 1 kinds of data sinks, is characterized in that, comprise that data receiver writes buffer memory, data receiver reads buffer memory and reception control unit, wherein: data receiver is write between buffer memory and the internal memory of data sending device has transmission link;
Data receiver writes buffer memory, for writing data based on described transmission link from the internal memory of described data sending device;
Data receiver reads buffer memory, for described data are sent to data processing equipment;
Reception control unit, writes buffer memory and described data receiver is read to switch between buffer memory at described data receiver after writing buffer memory at data write data receiver.
13. data sinks according to claim 12, is characterized in that,
Reception control unit, is further used for judging whether the capacity that described data receiver writes buffer memory meets the described data of write, if it is adopts described data receiver to write buffer memory and receives described data; If not, then create the data receiver meeting described data and write buffer memory, and utilize the data receiver meeting described data of described establishment to write buffer memory to receive described data.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410224634.5A CN105446651B (en) | 2014-05-26 | 2014-05-26 | Memory mirror method and system and data sending device and data sink |
| PCT/CN2015/079693 WO2015180602A1 (en) | 2014-05-26 | 2015-05-25 | Memory mirroring method and system, data sending apparatus, and data receiving apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410224634.5A CN105446651B (en) | 2014-05-26 | 2014-05-26 | Memory mirror method and system and data sending device and data sink |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105446651A true CN105446651A (en) | 2016-03-30 |
| CN105446651B CN105446651B (en) | 2018-12-11 |
Family
ID=54698089
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410224634.5A Active CN105446651B (en) | 2014-05-26 | 2014-05-26 | Memory mirror method and system and data sending device and data sink |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105446651B (en) |
| WO (1) | WO2015180602A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107562550A (en) * | 2017-09-01 | 2018-01-09 | 成都瀚蓝科技有限公司 | A kind of data distributing method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101022551A (en) * | 2007-03-15 | 2007-08-22 | 上海交通大学 | Motion compensating module pixel prefetching device in AVS video hardware decoder |
| US20080222330A1 (en) * | 2007-03-08 | 2008-09-11 | Ricoh Company, Limited | Semiconductor integrated circuit and image processing apparatus having the same |
| JP2009070012A (en) * | 2007-09-12 | 2009-04-02 | Seiko Epson Corp | Information processor, information processing method, and data transfer unit |
| US20120066531A1 (en) * | 2010-09-14 | 2012-03-15 | Sarance Technologies, Inc. | Method and apparatus for adaptive power control in a multi-lane communication channel |
| CN102467479A (en) * | 2010-11-17 | 2012-05-23 | 英业达股份有限公司 | Method for transmitting data between hosts |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101193050B (en) * | 2006-11-24 | 2011-12-28 | 中兴通讯股份有限公司 | A method for data receiving and transmitting of core node switching device in optical sudden network |
-
2014
- 2014-05-26 CN CN201410224634.5A patent/CN105446651B/en active Active
-
2015
- 2015-05-25 WO PCT/CN2015/079693 patent/WO2015180602A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080222330A1 (en) * | 2007-03-08 | 2008-09-11 | Ricoh Company, Limited | Semiconductor integrated circuit and image processing apparatus having the same |
| CN101022551A (en) * | 2007-03-15 | 2007-08-22 | 上海交通大学 | Motion compensating module pixel prefetching device in AVS video hardware decoder |
| JP2009070012A (en) * | 2007-09-12 | 2009-04-02 | Seiko Epson Corp | Information processor, information processing method, and data transfer unit |
| US20120066531A1 (en) * | 2010-09-14 | 2012-03-15 | Sarance Technologies, Inc. | Method and apparatus for adaptive power control in a multi-lane communication channel |
| CN102467479A (en) * | 2010-11-17 | 2012-05-23 | 英业达股份有限公司 | Method for transmitting data between hosts |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107562550A (en) * | 2017-09-01 | 2018-01-09 | 成都瀚蓝科技有限公司 | A kind of data distributing method |
| CN107562550B (en) * | 2017-09-01 | 2020-09-22 | 成都瀚蓝科技有限公司 | Data distribution method |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2015180602A1 (en) | 2015-12-03 |
| CN105446651B (en) | 2018-12-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112788074B (en) | Data transmitting method, processing method, receiving method, apparatus thereof, and storage medium | |
| WO2018086580A1 (en) | Extensible heterogeneous cloud platform adaptation method and system thereof | |
| CN102567224B (en) | Efficient high-speed cache management | |
| CN110427284B (en) | Data processing method, distributed system, computer system, and medium | |
| CN105337923A (en) | Data distribution method and system, data transmitting apparatus and data receiving apparatus | |
| US20220409999A1 (en) | Rendering method and apparatus | |
| CN110196844B (en) | Data migration method, system and storage medium | |
| CN109358965B (en) | Cloud computing cluster resource scheduling method, medium, device and computing equipment | |
| CN102411598A (en) | Method and system for realizing data consistency | |
| CN104252466A (en) | Stream computing processing method, equipment and system | |
| CN112199442B (en) | Method, device, computer equipment and storage medium for distributed batch downloading files | |
| CN103294610A (en) | Reusable content addressable stores | |
| US20210397374A1 (en) | Function processing using storage controllers for load sharing | |
| CN115801699A (en) | CDN scheduling method, device and system | |
| CN111400350B (en) | Configuration data reading method, system, electronic device and storage medium | |
| CN109542841B (en) | Method for creating data snapshot in cluster and terminal equipment | |
| CN104158899A (en) | Mobile terminal information pushing method, device and system based on service-oriented architecture (SOA) | |
| CN105446651A (en) | Memory mirroring method and system, data emitter, and data receiver | |
| CN111400072B (en) | Interface calling method, storage medium and related equipment | |
| CN116820527B (en) | Program upgrading method, device, computer equipment and storage medium | |
| CN104486215A (en) | Message transmitting method and equipment | |
| CN114328434A (en) | Data processing system, method, device and storage medium | |
| CN113641641A (en) | Switching method, switching system, equipment and storage medium of file storage service | |
| CN112527760A (en) | Data storage method, device, server and medium | |
| CN111078736A (en) | Data aggregation processing method and device, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |