CN110134662A - SDN distributed memory system, data processing method and storage medium - Google Patents
SDN distributed memory system, data processing method and storage medium Download PDFInfo
- Publication number
- CN110134662A CN110134662A CN201810129342.1A CN201810129342A CN110134662A CN 110134662 A CN110134662 A CN 110134662A CN 201810129342 A CN201810129342 A CN 201810129342A CN 110134662 A CN110134662 A CN 110134662A
- Authority
- CN
- China
- Prior art keywords
- data
- sdn
- storage
- target
- application
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/214—Database migration support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2272—Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2471—Distributed queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Abstract
The embodiment of the present invention provides a kind of SDN distributed memory system, data processing method and storage medium.The SDN distributed memory system, applied in the SDN control platform including multiple SDN controllers, it include: unified access interface, storage unit, it is connect by the unified access interface with SDN service application, for being based on data processing request, Xiang Suoshu SDN service application provides data processing service.
Description
Technical field
The present invention relates to network technique field more particularly to a kind of software defined network (Software Defined
Network, SDN) distributed memory system, data processing method and storage medium.
Background technique
The core of SDN technology is control and forwarding separation, and SDN controller is the core component of SDN technology, is responsible for realizing net
The control logic of network scene, and forwarding device is sent instructions to by control protocol.After forwarding device receives instruction parsing
Implement the controlling behavior to flow.
For specific network service scene, SDN controller needs to realize matched service logic, and using differentiation
Memory mechanism is to meet requirement of the business scenario to data access.For example, under post factum (Re-Active) interactive mode,
It is required that controller can quickly calculate forwarding logic and distribute to specified forwarding device, this scene visits SDN controller
The real-time and low time delay for asking data storage have higher requirement.For another example, for anticipation (Pro-Active) interaction mould
Formula, SDN controller need to analyze the network overall situation, in advance planning control strategy and under send instructions, need SDN controller read
Take all data of business association, it is desirable that accomplish that the data volume of storage is big, and data reliability is high, but for data access
Requirement of real-time it is low.Since specific business scenario is different, there are notable differences for Data Structure Design to be stored, for SDN
The flexibility and scalability of the data storage of controller proposes very high requirement.
In order to meet the demand of high flexibility and enhanced scalability that SDN controller stores data, mention in the prior art
Three kinds of storage modes based on SDN technology out:
The first: existing open source SDN controller platform mostly uses memory as data storage method, this design architecture
Advantage is that data access is flexible, and SDN service application scalability is high, and data access speed is fast, time delay is low.This mode exists
The problem of include 1) data storage scale limited by server memory size, be difficult to meet need in the case where data volume is big
Ask data volume big;2) situations such as data storing reliability is low, and powering off once occurs in server or system crash is restarted, internal storage data
It loses, SDN service application is difficult to restore.
Second: saving SDN data using Database Systems.The advantage of this design is maintainable data volume more
Greatly, data reliability is high.But the problem of this mode, is, and 1) time delay of data access is longer, and 2) development cost is high, it uses
Database mechanisms, in addition to design and implementation service logic, it is also necessary to the function code interacted with Database Systems is additionally developed,
3) Data Structure Design is inflexible, and when extending SDN service application, the design of data structure is by Database Systems memory mechanism
Constraint.
The third: being developed respectively by SDN service application and realize one group of independent storage logic, is customized according to this business demand
Melt hair storage logic.The advantage of this implementation is that the SDN service application of the carrying on SDN controller platform is cleverer
It is living, the data access demand of different scenes can be adapted to.But this mode there are the problem of include 1) SDN controller realize
The development amount of new business application is big, each SDN service application in the process of development other than needing to consider service logic,
Also need the special storage logic of design and implementation;2) SDN controller platform architecture is complicated, it is difficult to implement unified storage management
Strategy, such as data backup memory, security control etc..
In summary it is found that regardless of which kind of mode all there is corresponding defect using.
Summary of the invention
In view of this, an embodiment of the present invention is intended to provide a kind of SDN distributed memory system, data processing method and storages
Medium at least solves the above problems
In order to achieve the above objectives, the technical scheme of the present invention is realized as follows:
In a first aspect, the present embodiment provides a kind of SDN distributed memory system, applied to including multiple SDN controllers
In SDN control platform, comprising:
Unified access interface,
Storage unit is connect by the unified access interface with SDN service application, for being based on data processing request,
Data processing service is provided to the SDN service application.
Optionally, storage unit includes:
Data management module, for carrying out data prediction;
Processing module is stored, for executing data storage based on the pretreatment.
Optionally, the data management module, specifically for data abstraction, using registration and index management at least within
One of;
And/or
The storage processing module, be specifically used for management memory mechanism, based on the memory mechanism execute data storage and
Data access.
Optionally, the data management module, including it is following at least one:
Using registration submodule, for registering memory mechanism for SDN service application;
Data formatization handles submodule, for carrying out the formatting and reduction format data of data;
Global index manages submodule, for creating and safeguarding that global index records.
Optionally, global index's record includes at least one of;
Index mark ID is generated by global index management submodule, and for identifying the data saved;
Application layer data ID is provided by the SDN service application, and is submitting the data in the SDN service application
Global index's submodule is transferred to when processing request;
Storage level data ID, is generated by storage processing module;
SDN service application ID, is provided by SDN service application;
Memory mechanism type is answered by global index management submodule according to the data type and the SDN business
It is generated with ID;
Storage location;
Store renewal time.
Optionally, the storage processing module include it is following at least one:
Memory card registers submodule, for extending and providing memory mechanism;
Implementation sub-module is stored, for executing data storage and data access based on memory mechanism;
Storage migration submodule, for carrying out Data Migration based on different memory mechanisms.
Optionally, the storage unit further include:
Policy management module, for providing Data Migrating Strategy.
Second aspect, the embodiment of the present invention provide a kind of data processing method, and it is distributed to be applied to software defined network SDN
In storage system, comprising:
The data processing request that SDN service application is sent is received from unified access interface;
The data processing request is responded, Xiang Suoshu SDN application provides data processing service.
Optionally, the response data processing request, Xiang Suoshu SDN application provide data processing service, comprising:
Response data access request, the global index for searching target data record to position the target data;
The target data found is returned into the SDN application.
Optionally, the response data processing request, Xiang Suoshu SDN application provide data processing service, further includes:
Call the memory mechanism of the target data;
According to the memory mechanism, the target data of formatting is restored;
The target data that will be found returns to the SDN application, comprising:
The target data after reduction is sent to the SDN application.
Optionally, the response data processing request, Xiang Suoshu SDN application provide data processing service, comprising:
Response data storage request stores the target data that the SDN application is submitted and generates global index's record.
Optionally, the response data storage request stores the target data that the SDN application is submitted and generates global rope
Draw record, comprising:
The data storage request is responded, the memory mechanism of the SDN application registration is searched;
The target data is formatted according to the memory mechanism;
Store the formatted target data;
Generate global index's record of the target data.
Optionally, the method also includes:
Determine whether the SDN application is registered applications;
The response data processing request, Xiang Suoshu SDN application provide data processing service, comprising:
If it is registered applications that the SDN, which is applied, responds the data processing request and provide data to SDN application
Processing service.
Optionally, the method also includes:
If it is unregistered application that the SDN, which is applied, the data processing request is refused to respond.
Optionally, the method also includes:
Data Migration is carried out when meeting preset condition.
It is optionally, described that Data Migration is carried out when meeting preset condition, comprising:
Original storage mechanism and the original storage position for determining target data are recorded according to the global index of target data;
If the original storage mechanism is identical with target memory mechanism, the number of targets is read from the original storage position
Target storage position is arrived according to storage;
Delete the target data of the original storage position;
Update global index's record of the target data.
It is optionally, described that Data Migration is carried out when meeting preset condition, comprising:
Original storage mechanism and the original storage position for determining target data are recorded according to the global index of target data;
The target data is read from the original storage position;
If the original storage mechanism and the target memory mechanism be not identical, according to the original storage mechanism and target
The target data is converted to data corresponding with the target memory mechanism by memory mechanism;
By treated, the target data is stored to target storage position;
Update global index's record of the target data.
Optionally, described to carry out Data Migration, including at least one of when meeting preset condition:
The corresponding memory capacity of original storage mechanism reaches capacity threshold;
Receive the migration request that SDN service application is sent;
If memory mechanism is unavailable.
Optionally, described that Data Migration, including at least one of are carried out when meeting preset condition:
If Data Migrating Strategy is whole migration strategies, the target data for being stored in original storage position is moved into mesh
Storage location is marked, and the subsequent data provided of the SDN service application are stored to target storage position;
If Data Migrating Strategy is subsequent migration strategy, the original storage position of storing data is kept, by the SDN
The data that service application is subsequent supplied to are stored to target storage position.
The third aspect, the embodiment of the present invention provide a kind of computer storage medium, and the computer storage medium is stored with
Computer program;After the computer program is performed, it can be realized aforementioned one or more data processing methods provided.
SDN distributed memory system, data processing method and storage medium provided in an embodiment of the present invention, provide one kind
SDN distributed memory system can be that the SDN application in SDN service application can be by unified access interface, to storage unit
Data are written or read data from storage unit.And unified access interface and storage unit can be set in SDN controller, or
Person is provided in storage unit in the storage equipment of SDN controller connection, and the SDN controller by being located at different location is formed
The SDN distributed memory system can solve the problems, such as that very well memory capacity is inadequate using distributed storage, divide due to using
Cloth storage, is stored relative to using single integrated apparatus, has the characteristics that data reliability is high.Due to SDN controller
Itself participates in the composition of SDN distributed memory system, facilitates storage and access so as to convenient, improves data processing speed
Rate, and enable to not have to provide storage logic during SDN application and development, data can be carried out by unified access interface
It stores and accesses.
Detailed description of the invention
Fig. 1 is a kind of structural schematic diagram of SDN distributed memory system provided in an embodiment of the present invention;
Fig. 2 is a kind of structural schematic diagram of storage unit provided in an embodiment of the present invention;
Fig. 3 is a kind of flow diagram of data processing method provided in an embodiment of the present invention;
Fig. 4 is a kind of flow diagram of data access provided in an embodiment of the present invention;
Fig. 5 is a kind of flow diagram of reading data provided in an embodiment of the present invention;
Fig. 6 is a kind of Data Migration schematic diagram provided in an embodiment of the present invention;
Fig. 7 is the structural schematic diagram of another kind SDN distributed memory system provided in an embodiment of the present invention;
Fig. 8 is a kind of data Stored Procedure schematic diagram provided in an embodiment of the present invention;
Fig. 9 is a kind of data access process schematic diagram provided in an embodiment of the present invention;
Figure 10 is a kind of data Stored Procedure schematic diagram provided in an embodiment of the present invention;
Figure 11 is a kind of data access process schematic diagram provided in an embodiment of the present invention;
Figure 12 is the Data Migration flow diagram under a kind of identical memory mechanism provided in an embodiment of the present invention;
Figure 13 is the Data Migration flow diagram under a kind of different memory mechanisms provided in an embodiment of the present invention.
Specific embodiment
Technical solution of the present invention is further described in detail with reference to the accompanying drawings and specific embodiments of the specification.
As shown in Figure 1, the present embodiment provides a kind of SDN distributed memory system, applied to including multiple SDN controllers
In SDN control platform, comprising:
Unified access interface 100,
Storage unit 110 is connect, for based on the data with SDN service application by the unified access interface 100
Processing request, Xiang Suoshu SDN service application unit provide data processing service, wherein the data processing service includes: data
Storage service and data access service.
In some embodiments, the SDN control platform can only include SDN controller, these SDN controllers can be distributed
Formula setting.In further embodiments, the SDN control platform includes: SDN controller and connect with the SDN controller
Equipment is stored, which provides the storage region.
For example, at least described unified access interface 100 is arranged in the SDN controller;The storage unit 110 can be set
It sets in the SDN controller or the storage equipment being connect with the SDN controller.
In some embodiments, the SDN distributed memory system is additionally provided with SDN service application unit, can correspond to
The application layer of SDN controller, it is mountable to there are one or more SDN to apply.In further embodiments, the SDN service application
Unit, which can be set, to be in the SDN equipment of the SDN controller connection.In short, being equipped in the SDN service application unit
One or more SDN applications.Different SDN applications can all generate business datum, need to be provided by SDN distributed memory system
Data storage and reading data demand.Multiple SDN App are shown in Fig. 1, for example, SDN App1, SDN App2,
SDN App3 and SDN App n etc..
In the present embodiment, between the SDN service application unit with unified access is provided with before storage unit 110
Interface 100, for example, unified application programmable interface (Application Programming Interface, API) etc..Institute
Various data processing requests can be generated by stating the SDN App installed in SDN service application unit, for example, data storage request, data
Access request and Data Migration request, data removal request, data update request etc..
The storage unit 110 may include one or more storage server in the present embodiment, can be used for carrying out SDN
The business datum of interior various SDN APP stores and management.
Optionally, as shown in Fig. 2, storage unit 110 includes:
Data management module 111, for carrying out data prediction;
Processing module 112 is stored, for executing data storage based on the pretreatment.
The storage unit 110 is divided for data management module 111 and storage processing module 112 in the present embodiment.
For example, the data management module 111 is mainly used for carrying out data prediction, which includes: data storage
Pretreatment before pretreatment before and data access.For example, the pretreatment before the data storage includes: that data are taken out
As using registration etc..Pretreatment before the data access can include: the inquiry of global index's record of access target data
Deng.
The data abstraction can include: data object or data standard format etc. are defined, once data abstraction is once completed
It just will form the data structure for data storage.
The data management module 111, specifically for executing the processing such as the data search in data storage and data access.
Optionally, the data management module 111, specifically for data abstraction, using registration and index management at least
One of them.
Optionally, the storage processing module 112 is specifically used for management memory mechanism, is executed based on the memory mechanism
Data storage and data access.
Optionally, the data management module 111, including it is following at least one:
Using registration submodule 1101, for registering memory mechanism for SDN service application;
Data formatization handles submodule 1102, for carrying out the formatting and reduction format data of data;
Global index manages submodule 1103, for creating and safeguarding that global index records.
Submodule 1101 is registered in the application in the present embodiment, for carrying out the note of memory mechanism for SDN service application
Volume, once after memory mechanism is registered, it is equivalent to the execution logic for having registered and carrying out the processing such as data storage, then data management
Module 111 can carry out the operation such as the conversion of data format and the reduction of data format based on the memory mechanism of registration.Another
In some embodiments, if once memory mechanism is determined, storages of the data in SDN distributed memory system determined that
Parameter, for example, storage location and storage format etc..
The memory mechanism may include following several optional ways in some embodiments:
Memory storage stores data in the memory of SDN distributed memory system;
Structured database stores after data structured, there are Data Format Transform and also during data storage
The processing such as original;
Unstructured database can be stored according to the unprocessed form of data.
File system is stored using file system using file.
The storage parameter that the memory mechanism limits may include one or more below:
The data type of storage, for example, binary word throttling, text, file or other self-defining data structures etc.;
The network service protocol of support, for example, the network service protocol may include ICP/IP protocol, IPX/SPX agreement
And NetBEUI agreement etc..
It may need to register one or more of following information when carrying out memory mechanism registration:
The type of memory mechanism;
The mark of memory mechanism, for example, network identity, which includes but is not limited to: network protocol
At least one of the address (Internet Protocol, IP) and port numbers;
The network service protocol that memory mechanism is supported;
The data type that memory mechanism is supported;
The data manipulation mode that memory mechanism provides, for example, allowing the various operations such as addition, deletion, the reading of data;
The process resource that memory mechanism uses, for example, thread resources and storage resource etc..
The global index manages submodule 1103, is mainly used for carrying out the creation and maintenance of global index's record.At this
The maintenance of the record of global index described in embodiment can include: update, deletion of global index's record of global index's record etc.
Operation.
Optionally, global index's record includes at least one of;
Index mark ID is generated by global index management submodule 1103, and for identifying the data saved;
Application layer data ID is provided by the SDN service application unit, and submitted in the SDN service application unit
Global index's submodule is transferred to when the data processing request;
Storage level data ID, is generated by storage processing module 112;
SDN service application ID is provided by SDN service application unit;
Memory mechanism type, by global index management submodule 1103 according to the data type and the SDN industry
What application ID of being engaged in generated;
Storage location;
Store renewal time.
The storage location is storage location of the corresponding data in SDN distributed memory system.
Storing renewal time can be the time of data last time processing, when also may include the data update of last n times
Between.
The generation that is recorded by global index can be according to carrying when subsequent SDN application access data in access request
The various information such as index mark, determine the storage location of data requested access to, and find out number from determining storage location
It is applied according to corresponding SDN is returned to.
Optionally, the storage processing module 112 include it is following at least one:
Memory card registers submodule 1201, for extending and providing memory mechanism;
Implementation sub-module 1202 is stored, for executing data storage and data access based on memory mechanism;
Storage migration submodule 1203, for carrying out Data Migration based on different memory mechanisms.
The memory card registers submodule 1201 in the present embodiment, registers submodule 1201 for memory card, can
It with the memory mechanism supported for extending SDN distributed memory system, and provides for alternative memory mechanism, facilitates SDN
It is suitable for the memory mechanism of data storage using selection.
Optionally, the storage unit 110 further include: policy management module 113, for providing Data Migrating Strategy.?
Data Migrating Strategy described in the present embodiment is the rule etc. of the Data Migration limited.If carry out Data Migration, storage processing
Module 112 reads the Data Migrating Strategy from the policy management module 113 and carries out Data Migration.
As shown in figure 3, being deposited the present embodiment provides a kind of data processing method applied to software defined network SDN distribution
In storage system, comprising:
Step S110: the data processing request that SDN service application is sent is received from unified access interface;
Step S120: responding the data processing request, and Xiang Suoshu SDN application provides data processing service, wherein described
Data storage service includes at least: storing the data that the SDN application provides;And the SDN application is returned to SDN application
The data of access.
In the present embodiment, the SDN distributed memory system can be SDN distributed memory system above-mentioned, it may include:
Multiple SDN controllers for being distributed in different location and the storage equipment etc. of SDN controller connection.
In step s 110 the data processing request that SDN service application is sent can be received from unified access interface.At this
Data processing request described in embodiment may include various types of processing requests, for example, data storage request, data access are asked
It asks, data removal request, Data Migration are requested, data update the various request of data such as request.
The data processing request can be responded, in the step s 120 to provide data processing service to SDN application.?
In the present embodiment, the data processing service is included at least: data storage service and data access service etc..
Optionally, as shown in figure 4, the step S120 can include:
Step S121: response data access request, the global index for searching target data record to position the number of targets
According to;
Step S122: the target data found is returned into the SDN and is applied.
The target data is the data requested access in the present embodiment, in the present embodiment response data access request
When, first search global index's record of the target data;Record has the storage location of target data in global index's record,
Therefore the storage location in being recorded according to global index navigates to target data, reads target data and the number of targets by reading
According to the SDN for sending data access request application is returned to, thus data access.
If the memory mechanism of the target data requested access to is non-structural database, the data of possible SDN application
It is exactly to be stored according to the raw data format or data structure of data in SDN distributed memory system, then it can be direct
The target data of inquiry is returned into SDN application.
But in some embodiments, the memory mechanism of the target data is structural database, then needs to tie at this time
Structure (formats) data convert of storage into unprocessed form, is then forwarded to the SDN application.Therefore in some embodiments,
The step S120 further include: call the memory mechanism of the target data;According to the memory mechanism, the institute of formatting is restored
State target data;The step S122 can include: the target data after reduction is sent to the SDN and is applied.
In short, the step S120 in the present embodiment can include: inquire target data according to the data processing request
Global index record, determine the memory mechanism and storage location of the target data;
According to the memory mechanism, it is determined whether need to carry out data format to the data read from the storage location to turn
Change (for example, initial format that format data is reduced to data);
If the memory mechanism is storage Jie that structured database etc. carries out data format processing in data storage
Matter then needs to restore the target data read from the storage location, then the data after reduction is returned to the SDN and are applied.
Further, the step S120 further include: response data storage request stores the mesh that the SDN application is submitted
Mark data simultaneously generate global index's record.
If the data processing request is data storage request, SDN distributed memory system can store SDN application and submit
Data, and global index's record is generated according to the storage location of target data.
In some embodiments, it determines the memory mechanism that the target data uses, mesh is determined according to the memory mechanism
Storage location is marked, and whether needs to carry out data format processing, if desired carries out data format processing, then after formatting
Data store to target storage position, do not need such as carry out data format processing, then the data storage of unprocessed form is arrived
Target storage position.At the same time, if data are to be written for the first time, need to create global index's record, if this data
The data storage being stored as in data update then needs to update global index's record, for example, updating in global index's record
Storage location and the storage information such as renewal time.
Optionally, the response data storage request stores the target data that the SDN application is submitted and generates global rope
Draw record, comprising: respond the data storage request, search the memory mechanism of the SDN application registration;According to the storage machine
System formats the target data;Store the formatted target data;Generate global index's note of the target data
Record.It is the equal of the memory mechanism progress for needing to carry out data format processing using structured database etc. in the embodiment
Data storage.
In some embodiments, the method also includes:
Determine whether the SDN application is registered applications;
The response data processing request, Xiang Suoshu SDN application provide data processing service, comprising:
If it is registered applications that the SDN, which is applied, responds the data processing request and provide data to SDN application
Processing service.
In some embodiments, storage parameter is carried in the data processing request, for example, SDN application is answered
With ID, the parameter of the data type of the target data of processing is requested, these parameters can be used for SDN distributed storage system
System, determines whether current SDN application has been completed registration, or completes the registration of corresponding data type.For example, the SDN
Using unfinished registration, then SDN application refuses to respond the data processing request, on the one hand avoids illegally writing for illegal SDN application
Enter Information Security problem caused by data or illegal reading data, on the other hand, avoid registering because SDN application does not complete,
It can not determine the problem of data storage caused by the data storage mechanism used using determining storing data cannot achieve.
Optionally, the method also includes:
Data Migration is carried out when meeting preset condition.
In some cases, due to the capacity problem of SDN application distribution formula server, or the request based on SDN application
Etc. reasons, need to carry out Data Migration.
According to the variation of the memory mechanism used before and after Data Migration, the Data Migration can be divided into two major classes:
The first kind: the Data Migration based on identical memory mechanism, for example, carrying out data using identical data storage mechanism
The data processings such as storage, access, but need data moving to new storage location (target storage position from original storage position
It sets);
Second class: the Data Migration based on different memory mechanisms.This Data Migration is used due to Data Migration front and back
Memory mechanism is different, then may handle along with conversion of data format etc..
Specifically such as, as shown in figure 5, described carry out Data Migration when meeting preset condition, comprising:
Step S201: it is recorded according to the global index of target data and determines the original storage mechanism of target data and original deposit
Storage space is set;
Step S202: it if the original storage mechanism is identical with target memory mechanism, is read from the original storage position
The target data is stored to target storage position;
Step S203: the target data of the original storage position is deleted;
Step S204: global index's record of the target data is updated.
The target data is the data for needing to migrate in the present embodiment.In the present embodiment according to the complete of target data
Office's index record determines original storage mechanism and the original storage position of target data, the original storage mechanism of the target data and
Original storage position is all recorded in global index's record.For example, when carrying out Data Migration, according to the rope of target data
Draw global index's record that ID inquires the target data.
If original storage medium is identical with target memory mechanism, show the storage medium that target data migration front and back uses
It is identical, then it is not necessarily to carry out the conversion of data format.Therefore target data is read from original storage position in the present embodiment and is directly deposited
Store up target storage position.The target data that original storage position is deleted in step S203, to reduce repetition
Storage.The target data of the original storage position is deleted in the present embodiment, it may include: the number of erasing original storage position
According to, or abrogate the storage index record of original storage position.In the present embodiment, it also will be updated global index's note of target data
Record, for example, by global index record in storage location be changed to the target storage position.
In some embodiments, as shown in fig. 6, described carry out Data Migration when meeting preset condition, comprising:
Step S301: it is recorded according to the global index of target data and determines the original storage mechanism of target data and original deposit
Storage space is set;
Step S302: the target data is read from the original storage position;
Step S303: if the original storage mechanism and the target memory mechanism be not identical, according to the original storage
The target data is converted to data corresponding with the target memory mechanism by mechanism and target memory mechanism;
Step S304: by treated, target data is stored to target storage position;
Step S305: global index's record of the target data is updated.
There are many implementations of the step S303, several optional ways presented below:
The first:
If the original storage mechanism is the memory mechanism of format data, the target memory mechanism is unformatted number
According to memory mechanism, then the step S303 can include: restore the target data, in some embodiments, may also include that by
The target data after reduction is converted to the data type that the target memory mechanism is supported.
Second: the original storage mechanism is the memory mechanism of nonformatted data, and the target memory mechanism is non-
The memory mechanism of format data, the step S303 can include: be converted to the target data read from original storage position
The data type that the target memory mechanism is supported.
The third: if the original storage mechanism is the memory mechanism of format data, the target memory mechanism is lattice
The memory mechanism of formula data, the step S303 can include: restore the target data read from original storage position, and will
Target data after reduction is formatted according to the data format that target memory mechanism is supported;It in step s 304 will again
Formatted target data is stored to target storage position.
4th kind: if the original storage mechanism is the memory mechanism of nonformatted data, the target memory mechanism is
The memory mechanism of format data;The step S303 can include: read the target data from the original storage position, press
According to data format required by the target memory mechanism, the target data is formatted.In step s 304 by formatting
Target data is stored to target storage position.
Optionally, described to carry out Data Migration, including at least one of when meeting preset condition:
The corresponding memory capacity of original storage mechanism reaches capacity threshold;
Receive the migration request that SDN service application is sent;
If memory mechanism is unavailable.
The original storage mechanism corresponds to memory capacity and reaches capacity threshold in the present embodiment, if continuing storage will lead to
The problem of storage failure.Therefore Data Migration caused by carrying out data dilatation is needed in the present embodiment.
It receives and is mounted on the migration request that the SDN application of SDN service application unit is sent, if receiving migration request,
Then the SDN application may be moved according to the transfer etc. for needing to carry out data storage mechanism of itself so as to will lead to data
It moves.
If current memory mechanism is unavailable, for example, memory mechanism breaks down, but in order to meet data storage and visit
It asks demand, then first migrates data, to ensure the offer of data processing service.
Optionally, described that Data Migration, including at least one of are carried out when meeting preset condition:
If Data Migrating Strategy is whole migration strategies, the target data for being stored in original storage position is moved into mesh
Storage location is marked, and the subsequent data provided of the SDN service application unit are stored to target storage position.
If Data Migrating Strategy is subsequent migration strategy, the original storage position of storing data is kept, by the SDN
The data that service application unit is subsequent supplied to are stored to the position Mu Biao Heng.
According to whole migration strategies, then not only need not stored data are subsequent to write target storage position, herein
Target storage position can correspond to target storage domain or target storage network, a not single very small storage location.
By stored target data from original storage position, move to target storage position, can also by stored target data from
Original storage position moves to target storage position.It is deposited in this way, all data under the memory mechanism is made to be stored in target
Storage space is set.
If Data Migrating Strategy is subsequent migration strategy, the original storage position of storing data is kept, but can be incited somebody to action
The follow-up data that SDN service application provides is stored to target storage position.In this way, a part of data are deposited before and after Data Migration
In original storage position, the data of follow-up storage are stored in target storage position for storage.Be stored in the data of original storage position according to
It can so be read out and delete operation, but without movements such as data addition and data rewritings, i.e., no longer to original storage
New data are written in position.
A SDN distributed memory system is also provided in some embodiments, comprising:
One or more SDN controllers, for realizing aforementioned one or more technical solutions by executing computer program
The data processing method of offer is written data to the storage equipment or deposits from described according to the request of data that SDN application is sent
Store up the data of equipment read requests access.Data processing method performed by the SDN application distribution storage system.
A SDN distributed memory system is also provided in other embodiments, comprising:
One or more storage equipment;
One or more SDN controllers are connect with the storage equipment, computer program are executed for passing through, before realization
The data processing method that one or more technical solutions provide is stated, according to the request of data that SDN application is sent, is set to the storage
Standby write-in data or the data accessed from the storage equipment read requests.Number performed by the SDN application distribution storage system
According to processing method.
The present embodiment provides a kind of computer storage medium, the computer storage medium is stored with computer program;Institute
It states after computer program is performed, can be realized the data processing method that aforementioned one or more technical solutions provide.
Several specific examples are provided below in conjunction with above-mentioned any embodiment:
Example 1:
As shown in fig. 7, this example proposes to realize a unified storage management layer in SDN controller, provided to operation layer
Unified data store access interface, and SDN service application only focuses on the control of service logic itself, do not need additional designs storage
Logic;SDN controller is managed collectively storage strategy and data storage mechanism, carries out data storage;The storage of SDN controller platform
Layer supports a variety of memory mechanisms, and supports to need data distributed and saved to be adapted to the personalized storage of different SDN service applications
It asks.
This example proposes a kind of SDN distributed memory system, and the program makes SDN controller establish unification as subsystem
Data storage service, simplify SDN service application development logic, optimize SDN controller platform data management policies.
Distributed memory system externally provides unified data storage access interface (i.e. aforementioned unified access interface), SDN
For service application by the interface, the SDN distributed memory system into SDN controller platform submits data storage or data to visit
Ask request.
SDN distributed memory system includes two core processing modules: data management module and storage processing module.Data
Management module for realizing the pretreatment before data storage and access, including data abstraction, using registration and index management logic;
Storage processing module stores and accesses data, and the application memory plan between memory mechanism for managing memory mechanism, implementation
Slightly, including data format, storage are adapted to and the logics such as storage synchronizes.
SDN App1 to SDN App4 is shown in Fig. 7, is not limited to 4 SDN App in specific implementation.In Fig. 7
" module " or " submodule " is omitted and has carried out simplified description.
Example 2:
As shown in figure 8, this example provides a kind of date storage method based on the SDN system architecture extracted in example 1, packet
It includes:
SDN service application passes through unified access interface and submits data storage request;
SDN distributed memory system searches the data storage mechanism of SDN service application registration;
According to the memory mechanism found, data formatization processing is executed to the data that SDN service application is submitted;
According to the memory mechanism found, memory mechanism plug-in unit is called to execute data storage, storage is formatted
Data;
Update global index's record;For example, being data distribution index ID, according to the storage location for indexing ID, data and deposit
The information such as storage mechanism generate global index's record.
Process terminates.
Example 3:
As shown in figure 9, this example provides a kind of method for reading data based on the SDN system architecture extracted in example 1, packet
It includes:
SDN service application passes through unified access interface and submits data read request;
SDN distributed memory system searches global index's record, positions target data;
It is recorded according to the global index of lookup, finds the memory mechanism that target data uses, and read the formatting of preservation
Data;
It is recorded according to global index, the format data read out is restored;
It restores obtained initial data and returns to SDN service application.
Process terminates
Example 4:
The system architecture for the SDN that this example is provided based on example 1, it is further provided with lower module, for enriching system
Function.
Using registration submodule, which stores machine to the data of storage system registration preference for SDN service application
System.One SDN service application can register one or more kinds of data storage mechanisms to unified memory module, if registration is a variety of
Data storage mechanism then needs the mapping relations between explicit data type and memory mechanism.Storage system provides interface polls
The data storage mechanism supported, SDN service application registers the memory mechanism that will be used by interface, and utilizes this kind of machine
The data type of storage management processed.By the offer of application registration module, facilitate using according to from the storage demand set, registration is deposited
Storage mechanism, so that the compatible memory mechanism of data for selecting current application generation carries out data storage;Realize data storage
Optimization.
Data formatization handles submodule, is used to execute data format processing and format data for the submodule
Reduction treatment.Under default situations, storage system saves the data that SDN service application is submitted using byte arrays, and data are submitted to
It is converted into byte arrays after storage system, and is reduced to original data structure from byte arrays when reading data.The module
The expansion interface for formatting processing logic is provided to SDN service application, SDN service application can register customization by expansion interface
The form that the data formatization and reduction logic and data of change save, for example, byte arrays, character string text, etc..SDN industry
Business is applied when using interface log-on data formats logical, and the corresponding relationship of explicit data type and formats logical is needed.Needle
To every kind of specific data type, storage system only supports one group of data formatization processing and reduction logic.
It is handled by data format, it is convenient that the data of storage are managed collectively, avoid data format disunity from leading
The storage failure such as the data corruption of cause and high-incidence storage failure.
As shown in Figure 10, this example also provides a kind of data format method, comprising:
SDN service application submits data;
It formats processing module inspection and submits whether the SDN service application of data carried out registration;
Inspection result finds that SDN service application the request of data that do not register, and returns to error message, and terminate process
Inspection result finds SDN service application chartered request of data, inquires the data of SDN service application registration
Formats logical list;
Identify pending data type;
It analyzes in the data format list obtained after obtained data type according to inquiry and searches matched processing logic;
If finding matched formats logical, the logic is called;If not finding matched formats logical, data are called
Format the default form logic of processing module;
Data formatization processing is executed according to the formats logical of selection;
Process terminates.
As shown in figure 11, this example also provides a kind of method for restoring format data, comprising:
SDN service application submits data read request;
Storage system reads SDN service application from request, and checks whether the module has been registered;
Inspection result finds that service application the request of data that do not register, and returns to error message, and terminate process;
Inspection result finds SDN service application chartered request of data, inquires the data format of the Module registers
Logic list;
Data access request searches the corresponding global index's record of target data;
The global index found records and analyzes target data type;
The format data for searching the registration of SDN service application restores logic;
If finding matched format data reduction logic, the logic is called;If not finding matched format
Change data convert logic, then the default of data format processing module is called to restore logic;
Data after the global index's record reading format found;
According to the reduction logic of selection, the data read based on global index's record are restored;
Process terminates.
Example 5:
This example advanced optimizes the system architecture of SDN on the basis of example 1 or example 4, also adds with lower die
Block:
Memory card registers submodule, and memory card registration module is used for the memory mechanism that extension storage system is supported, deposits
Storage mechanism includes memory, structured database, unstructured database, file system etc..Memory card includes following 2 when registering
Step registration: 1) memory mechanism essential information is registered;2) memory mechanism access mode is registered.
Every kind of data storage mechanism should at least provide following information when registering essential information:
The type of data storage mechanism;
The network identity of data storage mechanism, including but not limited to: network ip address, port numbers
The network service protocol that data storage mechanism is supported;
Data storage mechanism can support the data type of storage, for example, binary word throttles, text, file, other are made by oneself
Adopted data structure, etc.
Every kind of data storage mechanism of data storage mechanism when registering access mode, need to provide under the mechanism data addition,
The method interfaces of three kinds of operations such as deletion, reading.
Memory card group book module is that a plug-in unit example and one group is respectively created in every kind of registered memory mechanism
Thread resources, when SDN service application is registered, distribution one is independent from corresponding thread resources automatically for storage system
Threading service SDN service application.
Global index manages submodule, and the module is for managing and maintaining global index's record.SDN service application is to storage
After system submits data storage request, this module is one global index's record of stored data creation automatically.Global index
Record includes following information:
ID is indexed, this ID is generated by the sub- management module of global index, and the data that each has saved have unique index
ID
Application layer data ID, this ID is distributed by SDN service application, and is supplied to global rope when submitting data storage request
Skirt manages submodule
Storage level data ID, this ID have memory mechanism generation, after data are submitted to memory mechanism, fed back by memory mechanism
Submodule is managed to global index
SDN service application ID, this information provide when submitting data storage request by SDN service application
Memory mechanism type, this information by global index's submodule in storing data, according to data type and SDN industry
Application ID analytical calculation of being engaged in obtains
Storage location, this information is returned after executing storage by specific storage resource, for cooperating distributed storage frame
Structure, location data actual stored position
Renewal time is stored, this information generates after executing storage, the record data time that last time updates in storage.
The SDN distributed memory system further include:
Implementation sub-module is stored, is executed for storage system and gives memory mechanism data-pushing, and read from memory mechanism
Access is operated according to storage system etc. is arrived.Storage execution module is responsible for that the plug-in unit of memory mechanism is called to execute operation, to realize storage
A variety of memory mechanisms such as system integration memory system, structured database, unstructured database, file system, storage execute
Module uses api-driver two-tier system.Storage execution module defines unified operation API, and every kind of memory mechanism is right respectively
The operation interface of API definition is realized.
To support storage system to realize the storage of data distributing, it includes data storage behaviour that the api layer for storing execution module, which removes,
Make outside (increase is deleted, modification) and read operation, further includes the statistics and inquiry operation to memory mechanism current storage status.
Storage execution module executes a status inquiry to the memory mechanism used after storage operates in each execute, and then updates
The state statistical information of the memory mechanism;The storage state statistical information updated using last time, storage execution module are being held every time
Row storage operation before, application memory policy calculation be suitble to save target data type memory mechanism and storage location (including
The information such as network address and serve port).
Storage migration submodule, for data to be migrated between different memory mechanisms, for coping with SDN service application master
When the failures such as unavailable occur in operation in dynamic adjustment storage strategy or part memory mechanism, storage system entirety is improved
Reliability.
Data storage migration includes migration and different memory mechanisms between the heterogeneous networks position of same memory mechanism
Between migrate two kinds.Unified access interface triggering or setting storage strategy automatic trigger can be called by SDN service application
Store migration operation.
Storage migration operation between identical memory mechanism different location realizes concrete function by the plug-in unit of memory mechanism,
And after completing data migration operation, the storage location information in global index's record is updated.
As shown in figure 12, the storage migration step between identical memory mechanism different location includes:
Storage system receives the operation requests that data migrate between same memory mechanism, and the source of the request may be
SDN service application is called, or according to storage strategy automatic trigger;
Storage system identifies data type to be migrated and application layer ID;
Search global index's record of target data;
Identify target data currently used memory mechanism and storage location;
Call the corresponding memory card of currently stored mechanism, and from original storage position reading format data;Calling is worked as
The corresponding memory card of preceding memory mechanism, the storage location after storing data into migration;
It migrates successfully, then deletes the corresponding data in original storage position;
The storage location information for updating target data in global index's record, terminates process;
Migration failure, then the failure of flag data storage migration operation, process terminate.
As shown in figure 13, migration operation between different memory mechanisms, including step performed below:
Storage system receives the operation requests that data migrate between different memory mechanisms, and the source of the request may be
SDN service application is called, or according to storage strategy automatic trigger;
Identify data type to be migrated and application layer ID;
Search global index's record of target data;
Identify target data currently used memory mechanism and storage location;
Call the corresponding memory card of currently stored mechanism, and from original storage position reading format data;Using working as
The format data of preceding memory mechanism restores logic, and obtained data are restored;The data format of invocation target memory mechanism
Change logic, obtained data are reformatted;The corresponding memory card of invocation target memory mechanism, stores data into migration
Storage location afterwards;
It migrates successfully, then deletes the corresponding data in original storage position;Target data deposits in update global index record
Location information is stored up, process is terminated;
Migration failure, then the failure of flag data storage migration operation, process terminate.
SDN service application or user can customize storage migration strategy, and storage system strategically stores machine to data
The corresponding rule of system application, or execute storage management operations.For example, SDN service application can be customized by policy management module
Data store migration strategy:
Between memory mechanism of the same race, support to execute migration according to capacity threshold.
It between memory mechanism of the same race, supports to execute migration according to data type, that is, specifies certain categorical datas to use specific
Network site is stored.
Between different memory mechanisms, support to execute migration according to capacity.
Between different memory mechanisms, specified redundancy scheme is supported, for automatic when finding that certain memory mechanism is unavailable
It is stored using redundancy scheme adapter tube data.
Storage migration strategy has the feature that
Original storage mechanism,
Target memory mechanism, if it is the strategy of migrating data between similar memory mechanism, then target memory mechanism type with
Original storage mechanism type is identical;
Target storage position, this attribute can not specify, and be automatically selected by storage system according to memory mechanism registration information
Target position;
Trigger event is migrated, migration event type includes capacity threshold, stores unavailable, Dynamic trigger three classes.
Capacity threshold, it is each execute storage operation after, inquire the current state information of memory mechanism, and with target threshold
Value is compared, and reaches threshold value, then automatic trigger migrates trigger event;
It stores unavailable, probe message is periodically sent between memory mechanism, if it find that target memory mechanism is unavailable,
Then automatic trigger migrates trigger event.
Dynamic trigger, storage system provide storage migration operation interface, SDN industry to SDN service application by unified interface
Business application can send migration event according to service logic dynamic.
Migration circle, including whole migrations and subsequent migration.If setting all migrations, are triggered in migration event
Afterwards, the existing data of original storage mechanism are all moved to the desired network location of target memory mechanism.If set subsequent
Migration, then after migration event triggering, storage system no longer sends data storage request to original storage mechanism, but can continue
The operation of reading data and deletion is sent to original storage position.
SDN storage assembly provides unified access interface to application, and each SDN service application does not need the visit of stand-alone development data
The functional unit asked reduces SDN business module development difficulty.SDN service application can be counted by unified storage unit
It according to interaction, does not need additionally to develop data access interface, optimizes the interaction logic on SDN platform between multiple SDN service applications.
A variety of data storage mechanisms are mixed, the individual demand of different SDN service applications is met, promote the scalability of SDN controller.
Global index records the data consistency and integrality demand for meeting SDN controller cluster environment.
In several embodiments provided herein, it should be understood that disclosed device and method can pass through it
Its mode is realized.Apparatus embodiments described above are merely indicative, for example, the division of the unit, only
A kind of logical function partition, there may be another division manner in actual implementation, such as: multiple units or components can combine, or
It is desirably integrated into another system, or some features can be ignored or not executed.In addition, shown or discussed each composition portion
Mutual coupling or direct-coupling or communication connection is divided to can be through some interfaces, the INDIRECT COUPLING of equipment or unit
Or communication connection, it can be electrical, mechanical or other forms.
Above-mentioned unit as illustrated by the separation member, which can be or may not be, to be physically separated, aobvious as unit
The component shown can be or may not be physical unit, it can and it is in one place, it may be distributed over multiple network lists
In member;Some or all of units can be selected to achieve the purpose of the solution of this embodiment according to the actual needs.
In addition, each functional unit in various embodiments of the present invention can be fully integrated into a processing module, it can also
To be each unit individually as a unit, can also be integrated in one unit with two or more units;It is above-mentioned
Integrated unit both can take the form of hardware realization, can also realize in the form of hardware adds SFU software functional unit.
Those of ordinary skill in the art will appreciate that: realize that all or part of the steps of above method embodiment can pass through
The relevant hardware of program instruction is completed, and program above-mentioned can be stored in a computer readable storage medium, the program
When being executed, step including the steps of the foregoing method embodiments is executed;And storage medium above-mentioned include: movable storage device, it is read-only
Memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or
The various media that can store program code such as person's CD.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain
Lid is within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.
Claims (20)
1. a kind of software defined network SDN distributed memory system, which is characterized in that applied to including multiple SDN controllers
In SDN control platform, comprising:
Unified access interface,
Storage unit is connect, for being based on data processing request, to institute with SDN service application by the unified access interface
It states SDN service application and data processing service is provided.
2. system according to claim 1, which is characterized in that
Storage unit includes:
Data management module, for carrying out data prediction;
Processing module is stored, for executing data storage based on the pretreatment.
3. system according to claim 2, which is characterized in that
The data management module, specifically for data abstraction, using at least one of registration and index management;
And/or
The storage processing module, be specifically used for management memory mechanism and/or based on the memory mechanism execute data storage and
Data access.
4. system according to claim 3, which is characterized in that
The data management module, including it is following at least one:
Using registration submodule, for registering memory mechanism for SDN service application;
Data formatization handles submodule, for carrying out the formatting and reduction format data of data;
Global index manages submodule, for creating and safeguarding that global index records.
5. system according to claim 4, which is characterized in that
Global index's record includes at least one of;
Index mark ID is generated by global index management submodule, and for identifying the data saved;
Application layer data ID is provided by the SDN service application, and is submitting the data processing in the SDN service application
Global index's submodule is transferred to when request;
Storage level data ID, is generated by storage processing module;
SDN service application ID, is provided by SDN service application;
Memory mechanism type, by global index management submodule according to the data type and the SDN service application ID
It generates;
Storage location;
Store renewal time.
6. system according to claim 3, which is characterized in that
The storage processing module include it is following at least one:
Memory card registers submodule, for extending and providing memory mechanism;
Implementation sub-module is stored, for executing data storage and data access based on memory mechanism;
Storage migration submodule, for carrying out Data Migration based on different memory mechanisms.
7. system according to claim 2, which is characterized in that
The storage unit further include:
Policy management module, for providing Data Migrating Strategy.
8. a kind of data processing method, which is characterized in that be applied in software defined network SDN distributed memory system, comprising:
The data processing request that SDN service application is sent is received from unified access interface;
The data processing request is responded, Xiang Suoshu SDN application provides data processing service.
9. according to the method described in claim 8, it is characterized in that, the response data processing request, Xiang Suoshu SDN are answered
With offer data processing service, comprising:
Response data access request, the global index for searching target data record to position the target data;
The target data found is returned into the SDN application.
10. according to the method described in claim 9, it is characterized in that,
The response data processing request, Xiang Suoshu SDN application provide data processing service, further includes:
Call the memory mechanism of the target data;
According to the memory mechanism, the target data of formatting is restored;
The target data that will be found returns to the SDN application, comprising:
The target data after reduction is sent to the SDN application.
11. according to the method described in claim 8, it is characterized in that, the response data processing request, Xiang Suoshu SDN
Using offer data processing service, comprising:
Response data storage request stores the target data that the SDN application is submitted and generates global index's record.
12. according to the method for claim 9 it is characterized in that,
The response data storage request stores the target data that the SDN application is submitted and generates global index's record, packet
It includes:
The data storage request is responded, the memory mechanism of the SDN application registration is searched;
The target data is formatted according to the memory mechanism;
Store the formatted target data;
Generate global index's record of the target data.
13. according to the method described in claim 8, it is characterized in that, the method also includes:
Determine whether the SDN application is registered applications;
The response data processing request, Xiang Suoshu SDN application provide data processing service, comprising:
If it is registered applications that the SDN, which is applied, responds the data processing request and provide data processing to SDN application
Service.
14. according to the method for claim 13, which is characterized in that the method also includes:
If it is unregistered application that the SDN, which is applied, the data processing request is refused to respond.
15. according to the method described in claim 8, it is characterized in that, the method also includes:
Data Migration is carried out when meeting preset condition.
16. according to the method for claim 15, which is characterized in that
It is described that Data Migration is carried out when meeting preset condition, comprising:
Original storage mechanism and the original storage position for determining target data are recorded according to the global index of target data;
If the original storage mechanism is identical with target memory mechanism, the target data is read from the original storage position and is deposited
Store up target storage position;
Delete the target data of the original storage position;
Update global index's record of the target data.
17. according to the method for claim 15, which is characterized in that
It is described that Data Migration is carried out when meeting preset condition, comprising:
Original storage mechanism and the original storage position for determining target data are recorded according to the global index of target data;
The target data is read from the original storage position;
If the original storage mechanism and the target memory mechanism be not identical, stored according to the original storage mechanism and target
The target data is converted to data corresponding with the target memory mechanism by mechanism;
By treated, the target data is stored to target storage position;
Update global index's record of the target data.
18. according to the method for claim 15, which is characterized in that
It is described to carry out Data Migration, including at least one of when meeting preset condition:
The corresponding memory capacity of original storage mechanism reaches capacity threshold;
Receive the migration request that SDN service application is sent;
If memory mechanism is unavailable.
19. according to the method for claim 15, which is characterized in that
It is described that Data Migration, including at least one of are carried out when meeting preset condition:
If Data Migrating Strategy is whole migration strategies, the target data for being stored in original storage position is moved into target and is deposited
Storage space is set, and the subsequent data provided of the SDN service application are stored to target storage position;
If Data Migrating Strategy is subsequent migration strategy, the original storage position of storing data is kept, by the SDN business
Using the data storage being subsequent supplied to target storage position.
20. a kind of computer storage medium, the computer storage medium is stored with computer program;The computer program quilt
After execution, the data processing method that any one of claim 8 to 19 provides can be realized.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810129342.1A CN110134662A (en) | 2018-02-08 | 2018-02-08 | SDN distributed memory system, data processing method and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810129342.1A CN110134662A (en) | 2018-02-08 | 2018-02-08 | SDN distributed memory system, data processing method and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN110134662A true CN110134662A (en) | 2019-08-16 |
Family
ID=67567735
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810129342.1A Pending CN110134662A (en) | 2018-02-08 | 2018-02-08 | SDN distributed memory system, data processing method and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110134662A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111949213A (en) * | 2020-07-28 | 2020-11-17 | 新华三半导体技术有限公司 | Memory particle access control chip, memory particle access control system and method |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101873335A (en) * | 2009-04-24 | 2010-10-27 | 同济大学 | Distributed type searching method of cross-domain semantic Web service |
US20150112933A1 (en) * | 2013-10-18 | 2015-04-23 | Cisco Technology, Inc. | System and method for software defined network aware data replication |
CN106170024A (en) * | 2012-12-24 | 2016-11-30 | 华为技术有限公司 | A kind of system, method and node processed based on data in software defined network |
CN107122355A (en) * | 2016-02-24 | 2017-09-01 | 阿里巴巴集团控股有限公司 | Data mover system and method |
CN107515863A (en) * | 2016-06-15 | 2017-12-26 | 上海宽带技术及应用工程研究中心 | The method and system that a kind of SDN clusters based on distributed data base are realized |
-
2018
- 2018-02-08 CN CN201810129342.1A patent/CN110134662A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101873335A (en) * | 2009-04-24 | 2010-10-27 | 同济大学 | Distributed type searching method of cross-domain semantic Web service |
CN106170024A (en) * | 2012-12-24 | 2016-11-30 | 华为技术有限公司 | A kind of system, method and node processed based on data in software defined network |
US20150112933A1 (en) * | 2013-10-18 | 2015-04-23 | Cisco Technology, Inc. | System and method for software defined network aware data replication |
CN107122355A (en) * | 2016-02-24 | 2017-09-01 | 阿里巴巴集团控股有限公司 | Data mover system and method |
CN107515863A (en) * | 2016-06-15 | 2017-12-26 | 上海宽带技术及应用工程研究中心 | The method and system that a kind of SDN clusters based on distributed data base are realized |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111949213A (en) * | 2020-07-28 | 2020-11-17 | 新华三半导体技术有限公司 | Memory particle access control chip, memory particle access control system and method |
CN111949213B (en) * | 2020-07-28 | 2022-08-30 | 新华三半导体技术有限公司 | Memory particle access control chip, memory particle access control system and method |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103067433B (en) | A kind of data migration method of distributed memory system, equipment and system | |
CN107787490A (en) | Function is directly connected in distributed data base grid | |
CN109144994A (en) | Index updating method, system and relevant apparatus | |
CN102158540A (en) | System and method for realizing distributed database | |
JP2005522787A5 (en) | ||
CN111984696B (en) | Novel database and method | |
CN106021370A (en) | Memory database instance management method and device | |
CN104272259A (en) | System and method for supporting version based routing in a transactional middleware machine environment | |
CN110196851A (en) | A kind of date storage method, device, equipment and storage medium | |
KR20080043517A (en) | Apparatus and method for parsing domain profile in software communication architecture | |
JP2009237826A (en) | Storage system and volume management method therefor | |
CN105471662A (en) | Cloud server and virtual network strategy centralized control system and method | |
CN114090580A (en) | Data processing method, device, equipment, storage medium and product | |
US10642817B2 (en) | Index table update method, and device | |
JP2022543306A (en) | Blockchain data processing method, apparatus, equipment and readable storage medium | |
CN106533961A (en) | Flow control method and device | |
CN110134662A (en) | SDN distributed memory system, data processing method and storage medium | |
JP2516703B2 (en) | Logic automatic generation method and logic automatic generation system | |
JP6035934B2 (en) | Data store management device, data providing system, and data providing method | |
US11048547B2 (en) | Method and system for routing and executing transactions | |
CN110532000B (en) | Kbroker distributed operating system for operation publishing and operation publishing system | |
US20210144212A1 (en) | Workflow engine framework for cross-domain extension | |
CN111680069B (en) | Database access method and device | |
US20040139205A1 (en) | Hot standby server system | |
CN112699148A (en) | Method, device and equipment for refreshing cache and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190816 |
|
RJ01 | Rejection of invention patent application after publication |