CN102523251A - Cloud storage architecture for processing mass data and cloud storage platform using the same - Google Patents
Cloud storage architecture for processing mass data and cloud storage platform using the same Download PDFInfo
- Publication number
- CN102523251A CN102523251A CN2011103820013A CN201110382001A CN102523251A CN 102523251 A CN102523251 A CN 102523251A CN 2011103820013 A CN2011103820013 A CN 2011103820013A CN 201110382001 A CN201110382001 A CN 201110382001A CN 102523251 A CN102523251 A CN 102523251A
- Authority
- CN
- China
- Prior art keywords
- cloud storage
- cloud
- virtual unit
- memory space
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a cloud storage architecture for processing mass data and a cloud storage platform using the same, comprising at least one cloud storage managing node, at least one cloud storage space and at least one virtual device, wherein the cloud storage managing node, the cloud storage space and the virtual device form private cloud; a plurality of cloud storage managing nodes can take charge of one another mutually; the cloud storage managing node is used for managing each cloud storage space and each virtual device; each cloud storage space is connected with the cloud storage managing node; the cloud storage space is used for mapping a plurality of virtual devices into one virtual device; and the virtual device is used for accessing data and virtually managing physical memory, an internal disc, and disc arrays of various interfaces and protocols. The cloud storage architecture for processing mass data and the cloud storage platform using the same adopt a cloud storage way to access data, have the advantages of large capacity, high performance, simplicity for extension and simplicity for management, and can implement real-time and efficient processing of mass network signaling data.
Description
Technical field
The present invention relates to field of computer technology, particularly a kind of cloud storage architecture, especially a kind of to mass data processing the cloud storage architecture and be used for the cloud storage platform of this framework.
Background technology
When signaling data being handled, need real-time analysis client behavior, and combine other user data, could hold marketing opportunity exactly, for the client provides personalized, marketing service targetedly through mobile communications network.But; Because the signaling data in the mobile communications network is huge; The medium and small network at one 1000 general-purpose family; The nearly TB level of data volume that every day is newly-increased, this handles for signaling data has in real time increased very big difficulty, and adopting at present, conventional database or the data warehouse technology of marketing almost is can't accomplishing of task.
In addition, the existing method that signaling data is handled normally adopts two kinds of the mode of focusing on and multiple machine distributing processing modes, aspect storage, can adopt centralized stores mode or distributed way.Wherein, the centralized stores mode has the simple relatively advantage of manageability, software development, and its shortcoming is that cost height, poor expandability, performance are limited; Extensibility is good, cost is low, the advantage of better performances and the distributed storage mode has, but software development is complicated, manageability not.
Summary of the invention
To the weak point of above-mentioned technology, the present invention provides a kind of employing cloud storage mode that data message is carried out access, have that capacity is big, high-performance, be prone to expansion, manageable to mass data processing the cloud storage architecture and be used for the cloud storage platform of this framework.
For realizing above-mentioned purpose; The present invention provides a kind of cloud storage architecture to mass data processing; Said cloud storage architecture comprises at least one cloud storage administration node, at least one cloud memory space and at least one virtual unit, and said cloud storage administration node, said cloud memory space and said virtual unit constitute privately owned cloud; Can take over each other between a plurality of said cloud storage administration nodes, said cloud storage administration node is used for said each cloud memory space and said each virtual unit are managed; Said each cloud memory space all is connected with said cloud storage administration node, and said cloud memory space is used for a plurality of said virtual units are mapped as a virtual memory facilities; Said virtual unit is used for access data, and the disk array of virtual management physical memory, built-in disk and various interface, agreement.
Said cloud storage administration node is provided with the application access inlet, and external application/service is through calling the said cloud memory space of said application access inlet visit.
Be built-in with data dictionary in the said cloud storage administration node, said data dictionary is used to store the relevant information of said cloud memory space and said virtual unit.
Said cloud storage administration node carries out newly-built, deletion and disposes said cloud memory space and said virtual unit, to carry out system backup, recovery and dilatation.
Said cloud storage administration node finds corresponding said cloud memory space and said virtual unit through the related data in its inner said data dictionary.
Said cloud memory space is made up of at least one said virtual unit; Perhaps constitute by at least one virtual unit group; Perhaps the virtual unit group is combined constitutes with at least one by at least one said virtual unit, a memory space in the corresponding physical storage device of said virtual unit or the physical storage device.
Said virtual unit group is made up of the said virtual unit of a plurality of identical characteristics.
The present invention also provides the cloud storage platform of a kind of application to the cloud storage architecture of mass data processing simultaneously; Said cloud storage platform comprises at least one cloud storage administration node, at least one cloud memory space and at least one virtual unit, and said cloud storage administration node, said cloud memory space and said virtual unit constitute privately owned cloud; Can take over each other between a plurality of said cloud storage administration nodes, said cloud storage administration node is used for said each cloud memory space and said each virtual unit are managed; Said each cloud memory space all is connected with said cloud storage administration node, and said cloud memory space storage is used for a plurality of said virtual units are mapped as a virtual memory facilities; Said virtual unit is used for access data, and the disk array of virtual management physical memory, built-in disk and various interface, agreement.
Said cloud storage administration node is provided with the application access inlet; External application/service is through calling the said cloud memory space of said application access inlet visit; Be built-in with data dictionary in the said cloud storage administration node; Said data dictionary is used to store the relevant information of said cloud memory space and said virtual unit, and said cloud storage administration node finds corresponding said cloud memory space and said virtual unit through the related data in its inner said data dictionary.
Said cloud memory space is made up of at least one said virtual unit; Perhaps constitute by at least one virtual unit group; Perhaps the virtual unit group is combined constitutes with at least one by at least one said virtual unit; A memory space in the corresponding physical storage device of said virtual unit or the physical storage device, said virtual unit group is made up of the said virtual unit of a plurality of identical characteristics.
Compared with prior art, the present invention has the following advantages:
Cloud storage architecture provided by the invention and cloud storage platform form a privately owned cloud, can realize the network signal data of magnanimity are carried out in real time, efficiently handled.
Cloud storage architecture provided by the invention and cloud storage platform adopt the cloud storage mode that data message is carried out access, have that capacity is big, a high-performance, be prone to expansion, manageable advantage.Present invention can be implemented under the low-cost mode, satisfy to the magnanimity signaling data handle in real time, professional constantly the variation and the ever-increasing demand of data.
Description of drawings
Fig. 1 is the structured flowchart of the cloud storage architecture to mass data processing provided by the invention;
Fig. 2 is the structured flowchart of the embodiment of Fig. 1;
Fig. 3 is the structured flowchart of application provided by the invention to the cloud storage platform of the cloud storage architecture of mass data processing;
Fig. 4 is the structured flowchart of the embodiment of Fig. 3.
Embodiment
Below in conjunction with accompanying drawing and embodiment the present invention is done further explain.
As shown in Figure 1; The present invention provides a kind of cloud storage architecture to mass data processing; This cloud storage architecture comprises at least one cloud storage administration node 100; At least one cloud memory space and at least one virtual unit, cloud storage administration node, cloud memory space and virtual unit constitute privately owned cloud.Wherein, the cloud memory space be divided into cloud memory space a200, cloud memory space b210 ..., cloud memory space n2n0, virtual unit be divided into virtual unit a1300, virtual unit a2310 ..., virtual unit an3n0; Virtual unit b1400, virtual unit b2410 ..., virtual unit bn4n0; Virtual unit n1500, virtual unit n2510 ..., virtual unit nn5n0.
This cloud storage architecture is when implementing; Take over each other between a plurality of cloud storage administration nodes; Can equally loaded between a plurality of cloud storage administration nodes and therein a cloud storage administration node when breaking down, take over the unfailing performance when guaranteeing the system operation based on this cloud storage architecture each other.Cloud storage administration node is used for each cloud memory space and each virtual unit are managed.Each cloud memory space all is connected with cloud storage administration node, and the cloud memory space is used for a plurality of virtual units are mapped as a virtual memory facilities.Virtual unit is used for access data, and the disk array of virtual management physical memory, built-in disk and various interface, agreement.Cloud storage administration node is provided with the application access inlet, and external application/service is through invokes application access entrance visit cloud memory space.Be built-in with data dictionary in the cloud storage administration node, data dictionary is used to store the relevant information of cloud memory space and virtual unit, and cloud storage administration node finds corresponding cloud memory space and virtual unit through the related data in its inner data dictionary.Cloud storage administration node carries out newly-built, deletion and disposes cloud memory space and virtual unit, to carry out system backup, recovery and dilatation.The cloud memory space is made up of at least one virtual unit; Perhaps constitute by at least one virtual unit group; Perhaps the virtual unit group is combined constitutes with at least one by at least one virtual unit, a memory space in the corresponding physical storage device of virtual unit or the physical storage device.The virtual unit group can be joined one group of virtual unit in the cloud memory space through the virtual unit group by the virtual unit of a plurality of identical characteristics easily.
As shown in Figure 2, in the present embodiment, this cloud storage architecture comprises two cloud memory nodes, three cloud memory spaces and a plurality of virtual unit, and three cloud memory spaces and a plurality of virtual unit constitute a privately owned cloud.Wherein, Two cloud storage administration nodes are respectively cloud storage administration node a100 and cloud storage administration node b110; Three cloud memory spaces are respectively cloud memory space a200, cloud memory space b210 and cloud memory space c220, a plurality of virtual units be divided into virtual unit a1300, virtual unit a2310 ..., virtual unit an3n0; Virtual unit b1400, virtual unit b2410 ..., virtual unit bn4n0; Virtual unit c1500, virtual unit c2510 ..., virtual unit cn5n0.Cloud storage administration node a100 and cloud storage administration node b110 interconnect; Take over each other between two cloud storage administration nodes; Can equally loaded between two cloud storage administration nodes and therein a cloud storage administration node when breaking down, take over the unfailing performance when guaranteeing the system operation based on this cloud storage architecture each other.Wherein, Two cloud storage administration nodes can be managed three cloud memory spaces and a plurality of virtual unit respectively; Its management comprises newly-built, deletion that three cloud memory spaces and a plurality of virtual unit are carried out and disposes, to carry out system backup, recovery and dilatation.Be built-in with data dictionary in each cloud storage administration node; Data dictionary is used to store the relevant information of cloud memory space and virtual unit, and cloud storage administration node finds corresponding cloud memory space and virtual unit through the related data in its inner data dictionary.In addition, each cloud storage administration node is provided with unified application access inlet, and this application access inlet is application programming interfaces, and application program/service is through calling this application access inlet visit cloud memory space.
Cloud memory space a200, cloud memory space b210 are connected with cloud storage administration node b110 with cloud storage administration node a100 respectively with cloud memory space c220, and cloud storage administration node finds corresponding cloud memory space through its inner data dictionary.In the cloud memory space, include a plurality of virtual units; Comprise among the cloud memory space a200 virtual unit a1300, virtual unit a2310 ..., virtual unit an3n0, cloud memory space a200 can with virtual unit a1300, virtual unit 2310 ..., virtual unit an3n0 is mapped as a virtual memory facilities.Comprise among the cloud memory space b210 virtual unit b1400, virtual unit b2410 ..., virtual unit bn4n0, cloud memory space b210 can with virtual unit b1400, virtual unit b2410 ..., virtual unit bn4n0 is mapped as a virtual memory facilities.Comprise among the cloud memory space c220 virtual unit c1500, virtual unit c2510 ..., virtual unit cn5n0, cloud memory space c220 can with virtual unit c1500, virtual unit c2510 ..., virtual unit cn5n0 is mapped as a virtual memory facilities.
Virtual unit a1300, virtual unit a2310 ..., virtual unit an3n0 all is connected with cloud memory space a200; In addition; Because virtual unit a1300 is the identical virtual unit of characteristic with virtual unit a2310; So virtual unit a1300 and virtual unit a2310 also constitute a virtual unit group a700, a700 has simplified the management to two virtual units through this virtual unit group.Virtual unit b1400, virtual unit b2410 ..., virtual unit bn4n0 all is connected with cloud memory space b210; Virtual unit c1500, virtual unit c2510 ..., virtual unit cn5n0 all is connected with cloud memory space c220, above-mentioned a plurality of virtual units are used for access data.Wherein, each virtual unit all can be mapped as raw device, memory field, file system or the memory file system etc. in the operating system, and the disk array of virtual management physical memory, built-in disk and various interface, agreement.In addition; Because virtual unit c1500, virtual unit c2510 ..., virtual unit cn5n0 is the identical virtual unit of characteristic; So; In the present embodiment, virtual unit c1500, virtual unit c2510 ..., virtual unit cn5n0 can constitute a virtual unit group b700, b700 has simplified the management to a plurality of virtual units through this virtual unit group.
A plurality of virtual units can be distinguished a memory space in a corresponding physical storage device or the physical storage device.In the present embodiment; Virtual unit a1300, virtual unit a2310 ..., virtual unit an3n0 respectively with physical storage device a1800, physical storage device a2810 ..., physical storage device an8n0 is connected, thereby with data information memory in above-mentioned physical storage device.Virtual unit b1400, virtual unit b2410 ..., virtual unit bn4n0 respectively with physical storage device b1900, physical storage device b2910 ..., physical storage device bn9n0 is connected, thereby with data information memory in above-mentioned physical storage device.Virtual unit c1500, virtual unit c2510 ..., virtual unit cn5n0 all is connected with physical storage device c1000, thereby with data information memory in above-mentioned physical storage device.
Outside application program/service a600 and application program/service b610 respectively with the cloud storage architecture in cloud storage administration node a100 be connected with cloud storage administration node b110.Because cloud storage administration node is provided with unified application access inlet, therefore, thereby application program/service is visited corresponding cloud memory space through the interface function of invokes application access entrance.Application program/service meeting indicates corresponding information in visit or any cloud memory space of access, or cloud memory space and virtual unit is managed through application access inlet.Application program/service connects through the invokes application access entrance goes up cloud storage administration node; Then application program/service meeting indicates the cloud memory space, filename, side-play amount, accessing operation etc. of visit through API; Cloud storage administration node is accomplished accessing operation with final operated allocated according to the information connecting inner data dictionary that these API imported into to one or more concrete physical storage devices, return access results through cloud storage administration node at last.
Above-mentioned cloud storage architecture is applicable to Linux, MacOs, Unix and Windows operating system.
As shown in Figure 3; The present invention provides a kind of cloud storage platform to mass data processing; This cloud storage platform comprises at least one cloud storage administration node, at least one cloud memory space and at least one virtual unit, and cloud storage administration node, cloud memory space and virtual unit constitute privately owned cloud.Wherein, the cloud memory space be divided into cloud memory space a2000, cloud memory space b2100 ..., cloud memory space n2n00, virtual unit be divided into virtual unit a13000, virtual unit a23100 ..., virtual unit an3n00; Virtual unit b14000, virtual unit b24100 ..., virtual unit bn4n00; Virtual unit n15000, virtual unit n25100 ..., virtual unit nn5n00.
This cloud storage platform is when implementing; Take over each other between a plurality of cloud storage administration nodes; Can equally loaded between a plurality of cloud storage administration nodes and therein a cloud storage administration node when breaking down, take over the unfailing performance when guaranteeing the operation of cloud storage platform each other.Cloud storage administration node is used for each cloud memory space and each virtual unit are managed.Each cloud memory space all is connected with cloud storage administration node, and the cloud memory space is used for a plurality of virtual units are mapped as a virtual memory facilities.Virtual unit is used for access data, and the disk array of virtual management physical memory, built-in disk and various interface, agreement.Cloud storage administration node is provided with the application access inlet, and external application/service is through invokes application access entrance visit cloud memory space.Be built-in with data dictionary in the cloud storage administration node, data dictionary is used to store the relevant information of cloud memory space and virtual unit, and cloud storage administration node finds corresponding cloud memory space and virtual unit through the related data in its inner data dictionary.Cloud storage administration node carries out newly-built, deletion and disposes cloud memory space and virtual unit, to carry out system backup, recovery and dilatation.The cloud memory space is made up of at least one virtual unit; Perhaps constitute by at least one virtual unit group; Perhaps the virtual unit group is combined constitutes with at least one by at least one virtual unit, a memory space in the corresponding physical storage device of virtual unit or the physical storage device.The virtual unit group can be joined one group of virtual unit in the cloud memory space through the virtual unit group by the virtual unit of a plurality of identical characteristics easily.
As shown in Figure 4, in the present embodiment, this cloud storage architecture comprises two cloud memory nodes, three cloud memory spaces and a plurality of virtual unit, and three cloud memory spaces and a plurality of virtual unit constitute a privately owned cloud.Wherein, Two cloud storage administration nodes are respectively cloud storage administration node a1000 and cloud storage administration node b1100; Three cloud memory spaces are respectively cloud memory space a2000, cloud memory space b2100 and cloud memory space c2200, a plurality of virtual units be divided into virtual unit a13000, virtual unit a23100 ..., virtual unit an3n00; Virtual unit b14000, virtual unit b24100 ..., virtual unit bn4n00; Virtual unit c15000, virtual unit c25100 ..., virtual unit cn5n00.Cloud storage administration node a1000 and cloud storage administration node b1100 interconnect; Take over each other between two cloud storage administration nodes; Can equally loaded between two cloud storage administration nodes and therein a cloud storage administration node when breaking down, take over the unfailing performance when guaranteeing the system operation based on this cloud storage architecture each other.Wherein, Two cloud storage administration nodes can be managed three cloud memory spaces and a plurality of virtual unit respectively; Its management comprises newly-built, deletion that three cloud memory spaces and a plurality of virtual unit are carried out and disposes, to carry out system backup, recovery and dilatation.Be built-in with data dictionary in each cloud storage administration node; Data dictionary is used to store the relevant information of cloud memory space and virtual unit, and cloud storage administration node finds corresponding cloud memory space and virtual unit through the related data in its inner data dictionary.In addition, each cloud storage administration node is provided with unified application access inlet, and this application access inlet is application programming interfaces, and application program/service is through calling this application access inlet visit cloud memory space.
Cloud memory space a2000, cloud memory space b2100 are connected with cloud storage administration node b1100 with cloud storage administration node a1000 respectively with cloud memory space c2200, and cloud storage administration node finds corresponding cloud memory space through its inner data dictionary.In the cloud memory space, include a plurality of virtual units; Comprise among the cloud memory space a2000 virtual unit a13000, virtual unit a23100 ..., virtual unit an3n00, cloud memory space a2000 can with virtual unit a13000, virtual unit 23100 ..., virtual unit an3n00 is mapped as a virtual memory facilities.Comprise among the cloud memory space b2100 virtual unit b14000, virtual unit b24100 ..., virtual unit bn4n00, cloud memory space b2100 can with virtual unit b14000, virtual unit b24100 ..., virtual unit bn4n00 is mapped as a virtual memory facilities.Comprise among the cloud memory space c2200 virtual unit c15000, virtual unit c25100 ..., virtual unit cn5n00, cloud memory space c2200 can with virtual unit c15000, virtual unit c25100 ..., virtual unit cn5n00 is mapped as a virtual memory facilities.
Virtual unit a13000, virtual unit a23100 ..., virtual unit an3n00 all is connected with cloud memory space a2000; In addition; Because virtual unit a13000 is the identical virtual unit of characteristic with virtual unit a23100; So virtual unit a13000 and virtual unit a23100 also constitute a virtual unit group a7000, a7000 has simplified the management to two virtual units through this virtual unit group.Virtual unit b14000, virtual unit b24100 ..., virtual unit bn4n00 all is connected with cloud memory space b2100; Virtual unit c15000, virtual unit c25100 ..., virtual unit cn5n00 all is connected with cloud memory space c2200, above-mentioned a plurality of virtual units are used for access data.Wherein, each virtual unit all can be mapped as raw device, memory field, file system or the memory file system etc. in the operating system, and the disk array of virtual management physical memory, built-in disk and various interface, agreement.In addition; Because a plurality of virtual unit c15000, virtual unit c25100 ..., virtual unit cn5n00 is the identical virtual unit of characteristic; So; In the present embodiment, virtual unit c15000, virtual unit c25100 ..., virtual unit cn5n00 can constitute a virtual unit group b7000, b7000 has simplified the management to a plurality of virtual units through this virtual unit group.
A plurality of virtual units can be distinguished a memory space in a corresponding physical storage device or the physical storage device.In the present embodiment; Virtual unit a13000, virtual unit a23100 ..., virtual unit an3n00 respectively with physical storage device a18000, physical storage device a28100 ..., physical storage device an8n00 is connected, thereby with data information memory in above-mentioned physical storage device.Virtual unit b14000, virtual unit b24100 ..., virtual unit bn4n0 respectively with physical storage device b19000, physical storage device b29100 ..., physical storage device bn9n00 is connected, thereby with data information memory in above-mentioned physical storage device.Virtual unit c15000, virtual unit c25100 ..., virtual unit cn5n00 all is connected with physical storage device c10000, thereby with data information memory in above-mentioned physical storage device.
Outside application program/service a6000 and application program/service b6100 respectively with the cloud storage architecture in cloud storage administration node a1000 be connected with cloud storage administration node b1100.Because cloud storage administration node is provided with unified application access inlet, therefore, thereby application program/service is visited corresponding cloud memory space through the interface function of invokes application access entrance.Application program/service meeting indicates corresponding information in visit or any cloud memory space of access, or cloud memory space and virtual unit is managed through application access inlet.Application program/service connects through the invokes application access entrance goes up cloud storage administration node; Then application program/service meeting indicates the cloud memory space, filename, side-play amount, accessing operation etc. of visit through API; Cloud storage administration node is accomplished accessing operation with final operated allocated according to the information connecting inner data dictionary that these API imported into to one or more concrete physical storage devices, return access results through cloud storage administration node at last.
Above-mentioned cloud storage architecture is applicable to Linux, MacOs, Unix and Windows operating system.
In cloud storage architecture provided by the invention and cloud storage platform; Cloud storage administration node, cloud memory space and virtual unit constitute privately owned cloud; Satisfied network signal data application data layer to the high-performance of storage, be prone to needs such as expansion, high available, low-cost, highly reliable, the real-time processing of mass data; Shielded the complexity of mass memory management, help efficient more with in real time for application layer provides service, the realization of convenient service.Wherein, Cloud storage administration node is the actual management person in this cloud storage architecture and the cloud storage platform; Can carry out operations such as newly-built, deletion and configuration to the cloud memory space in cloud storage architecture and the cloud storage platform and virtual unit setting, thereby realization is to backup, recovery and the dilatation of system.Cloud storage administration node is the logic entity and the physical entity of application program/service access cloud storage architecture and cloud storage platform.Cloud storage architecture and cloud storage platform generally are made up of two or more cloud storage administration nodes; Interconnecting between a plurality of cloud storage administration nodes can equally loaded; In addition; When one of them cloud storage administration node breaks down, can also take over by other cloud storage administration node that is connected with this fault cloud storage administration node, thus the stability when improving the operation of cloud storage platform.
Cloud storage administration node provides the unified application access inlet that application program/service conducts interviews that is used for for outside application program/service, thereby application program/service is visited corresponding cloud memory space through the interface function of calls application interface.
Virtual unit is the storage entity in cloud storage architecture and the cloud storage platform, and application program/service is through cloud memory space access data, thereby application program/service has access to the data message in the cloud storage through visit cloud memory space.The cloud memory space can be made up of one or more virtual units, the cloud memory space with a plurality of virtual units virtual be in logic a virtual memory facilities.
Above-mentioned cloud storage architecture and cloud storage platform are applicable to Linux, MacOs, Unix and Windows operating system.
The present invention compared with prior art has the following advantages:
1, memory capacity is big, and disposal ability is strong: memory capacity can quantity-unlimitingly improve, and access capability can have the lifting of several times in the unit interval;
2, real-time capacity is good: signaling data can be finished dealing with in real time, does not overstock;
3, implementation cost is low: with respect to jumbo high-end storage systems nowadays, both can utilize the built-in storage of cheap PC server, and also can use the disk array of many low and middle-ends, or mix and use built-in storage and disk array, implementation cost reduces greatly;
4, favorable expandability: when off-capacity, increase memory device or get final product with the PC server of built-in storage, application need not done any change;
5, application and development is simple: whole as storage in logic is transparent to upper layer application, uses exploitation easily and management.
The above is merely preferred embodiment of the present invention, and is in order to restriction the present invention, not all within spirit of the present invention and principle, any modification of being done, is equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. cloud storage architecture to mass data processing; It is characterized in that; Said cloud storage architecture comprises at least one cloud storage administration node, at least one cloud memory space and at least one virtual unit, and said cloud storage administration node, said cloud memory space and said virtual unit constitute privately owned cloud;
Can take over each other between a plurality of said cloud storage administration nodes, said cloud storage administration node is used for said each cloud memory space and said each virtual unit are managed;
Said cloud memory space is used for a plurality of said virtual units are mapped as a virtual memory facilities;
Said virtual unit is used for access data, and the disk array of virtual management physical memory, built-in disk and various interface, agreement.
2. the cloud storage architecture to mass data processing according to claim 1; It is characterized in that; Said cloud storage administration node is provided with the application access inlet, and external application/service is through calling the said cloud memory space of said application access inlet visit.
3. the cloud storage architecture to mass data processing according to claim 2 is characterized in that, is built-in with data dictionary in the said cloud storage administration node, and said data dictionary is used to store the relevant information of said cloud memory space and said virtual unit.
4. the cloud storage architecture to mass data processing according to claim 3 is characterized in that, said cloud storage administration node carries out newly-built, deletion and disposes said cloud memory space and said virtual unit, to carry out system backup, recovery and dilatation.
5. the cloud storage architecture to mass data processing according to claim 4 is characterized in that, said cloud storage administration node finds corresponding said cloud memory space and said virtual unit through the related data in its inner said data dictionary.
6. the cloud storage architecture to mass data processing according to claim 5; It is characterized in that; Said cloud memory space is made up of at least one said virtual unit; Perhaps be made up of at least one virtual unit group, perhaps the virtual unit group is combined constitutes with at least one by at least one said virtual unit, a memory space in the corresponding physical storage device of said virtual unit or the physical storage device.
7. the cloud storage architecture to mass data processing according to claim 6 is characterized in that said virtual unit group is made up of the said virtual unit of a plurality of identical characteristics.
8. an application rights requires 1 said cloud storage architecture; Cloud storage platform to mass data processing; It is characterized in that; Said cloud storage platform comprises at least one cloud storage administration node, at least one cloud memory space and at least one virtual unit, and said cloud storage administration node, said cloud memory space and said virtual unit constitute privately owned cloud; Can take over each other between a plurality of said cloud storage administration nodes, said cloud storage administration node is used for said each cloud memory space and said each virtual unit are managed; Said cloud memory space is used for a plurality of said virtual units are mapped as a virtual memory facilities; Said virtual unit is used for access data, and the disk array of virtual management physical memory, built-in disk and various interface, agreement.
9. said according to Claim 8 application is to the cloud storage platform of the cloud storage architecture of mass data processing; It is characterized in that; Said cloud storage administration node is provided with the application access inlet; External application/service is through calling the said cloud memory space of said application access inlet visit; Be built-in with data dictionary in the said cloud storage administration node, said data dictionary is used to store the relevant information of said cloud memory space and said virtual unit, and said cloud storage administration node finds corresponding said cloud memory space and said virtual unit through the related data in its inner said data dictionary.
10. according to the cloud storage platform of the said application of claim 9 to the cloud storage architecture of mass data processing; It is characterized in that; Said cloud memory space is made up of at least one said virtual unit; Perhaps constitute by at least one virtual unit group; Perhaps the virtual unit group is combined constitutes with at least one by at least one said virtual unit, a memory space in the corresponding physical storage device of said virtual unit or the physical storage device, and said virtual unit group is made up of the said virtual unit of a plurality of identical characteristics.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011103820013A CN102523251A (en) | 2011-11-25 | 2011-11-25 | Cloud storage architecture for processing mass data and cloud storage platform using the same |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011103820013A CN102523251A (en) | 2011-11-25 | 2011-11-25 | Cloud storage architecture for processing mass data and cloud storage platform using the same |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102523251A true CN102523251A (en) | 2012-06-27 |
Family
ID=46294040
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011103820013A Pending CN102523251A (en) | 2011-11-25 | 2011-11-25 | Cloud storage architecture for processing mass data and cloud storage platform using the same |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102523251A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103365972A (en) * | 2013-06-27 | 2013-10-23 | 北京中科金财科技股份有限公司 | Intelligent processing system for mass data |
| CN103491150A (en) * | 2013-09-13 | 2014-01-01 | 浪潮电子信息产业股份有限公司 | Multi-type storage mixed utilization method based on OS |
| CN103546572A (en) * | 2013-10-30 | 2014-01-29 | 北京荣之联科技股份有限公司 | Cloud storage device and multi-cloud storage networking system and method |
| CN103617003A (en) * | 2013-11-20 | 2014-03-05 | 浪潮电子信息产业股份有限公司 | Organization method and architecture for storage resources in cloud storage environment |
| CN104283912A (en) * | 2013-07-04 | 2015-01-14 | 北京中科同向信息技术有限公司 | Cloud backup dynamic balance technology |
| CN105069152A (en) * | 2015-08-25 | 2015-11-18 | 航天恒星科技有限公司 | Data processing method and apparatus |
| CN106033369A (en) * | 2015-03-10 | 2016-10-19 | 杭州华三通信技术有限公司 | A memory device using method and device |
| CN107330056A (en) * | 2017-06-29 | 2017-11-07 | 河北工业大学 | Wind power plant SCADA system and its operation method based on big data cloud computing platform |
| CN107566536A (en) * | 2017-10-29 | 2018-01-09 | 长沙准光里电子科技有限公司 | The big data processing platform network architecture |
| CN108829709A (en) * | 2018-05-03 | 2018-11-16 | 广州金山安全管理系统技术有限公司 | Distributed database management method, apparatus, storage medium and processor |
| CN109460185A (en) * | 2018-10-29 | 2019-03-12 | 锐捷网络股份有限公司 | Set up method, apparatus, storage pool and the storage medium of piecemeal group CKG |
| CN112667160A (en) * | 2020-12-25 | 2021-04-16 | 深圳创新科技术有限公司 | Rapid equalization method and device for mass storage system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100274772A1 (en) * | 2009-04-23 | 2010-10-28 | Allen Samuels | Compressed data objects referenced via address references and compression references |
| CN102202044A (en) * | 2011-02-25 | 2011-09-28 | 北京兴宇中科科技开发股份有限公司 | Portable cloud storage method and device |
-
2011
- 2011-11-25 CN CN2011103820013A patent/CN102523251A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100274772A1 (en) * | 2009-04-23 | 2010-10-28 | Allen Samuels | Compressed data objects referenced via address references and compression references |
| CN102202044A (en) * | 2011-02-25 | 2011-09-28 | 北京兴宇中科科技开发股份有限公司 | Portable cloud storage method and device |
Non-Patent Citations (2)
| Title |
|---|
| 谭生龙: "存储虚拟化技术的研究", 《微计算机应用》, vol. 31, no. 1, 31 January 2010 (2010-01-31) * |
| 赵肄江，胡蓉: "基于虚拟化的绿色云计算", 《湖南科技大学学报（自然科学版）》, 31 December 2010 (2010-12-31) * |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103365972A (en) * | 2013-06-27 | 2013-10-23 | 北京中科金财科技股份有限公司 | Intelligent processing system for mass data |
| CN104283912A (en) * | 2013-07-04 | 2015-01-14 | 北京中科同向信息技术有限公司 | Cloud backup dynamic balance technology |
| CN103491150A (en) * | 2013-09-13 | 2014-01-01 | 浪潮电子信息产业股份有限公司 | Multi-type storage mixed utilization method based on OS |
| CN103546572B (en) * | 2013-10-30 | 2017-04-05 | 北京荣之联科技股份有限公司 | A kind of cloudy storing networking system and method |
| CN103546572A (en) * | 2013-10-30 | 2014-01-29 | 北京荣之联科技股份有限公司 | Cloud storage device and multi-cloud storage networking system and method |
| CN103617003B (en) * | 2013-11-20 | 2017-05-10 | 浪潮电子信息产业股份有限公司 | Organization method and architecture for storage resources in cloud storage environment |
| CN103617003A (en) * | 2013-11-20 | 2014-03-05 | 浪潮电子信息产业股份有限公司 | Organization method and architecture for storage resources in cloud storage environment |
| CN106033369A (en) * | 2015-03-10 | 2016-10-19 | 杭州华三通信技术有限公司 | A memory device using method and device |
| CN105069152A (en) * | 2015-08-25 | 2015-11-18 | 航天恒星科技有限公司 | Data processing method and apparatus |
| CN107330056A (en) * | 2017-06-29 | 2017-11-07 | 河北工业大学 | Wind power plant SCADA system and its operation method based on big data cloud computing platform |
| CN107330056B (en) * | 2017-06-29 | 2020-10-16 | 河北工业大学 | Wind power plant SCADA system based on big data cloud computing platform and operation method thereof |
| CN107566536A (en) * | 2017-10-29 | 2018-01-09 | 长沙准光里电子科技有限公司 | The big data processing platform network architecture |
| CN108829709A (en) * | 2018-05-03 | 2018-11-16 | 广州金山安全管理系统技术有限公司 | Distributed database management method, apparatus, storage medium and processor |
| CN109460185A (en) * | 2018-10-29 | 2019-03-12 | 锐捷网络股份有限公司 | Set up method, apparatus, storage pool and the storage medium of piecemeal group CKG |
| CN109460185B (en) * | 2018-10-29 | 2022-03-18 | 锐捷网络股份有限公司 | Method and device for building block group CKG, virtual storage pool and storage medium |
| CN112667160A (en) * | 2020-12-25 | 2021-04-16 | 深圳创新科技术有限公司 | Rapid equalization method and device for mass storage system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102523251A (en) | Cloud storage architecture for processing mass data and cloud storage platform using the same | |
| US10795905B2 (en) | Data stream ingestion and persistence techniques | |
| US10691716B2 (en) | Dynamic partitioning techniques for data streams | |
| US11042569B2 (en) | System and method for load, aggregate and batch calculation in one scan in a multidimensional database environment | |
| US10635644B2 (en) | Partition-based data stream processing framework | |
| US11995336B2 (en) | Bucket views | |
| US9020802B1 (en) | Worldwide distributed architecture model and management | |
| CN102255962B (en) | Distributive storage method, device and system | |
| CN110100229A (en) | It is accessed using the direct cloud of the low delay of file system hierarchy structurally and semantically | |
| CA2978889A1 (en) | Opportunistic resource migration to optimize resource placement | |
| US10509766B2 (en) | Storing and retrieving restricted datasets to and from a cloud network with non-restricted datasets | |
| CN105975210A (en) | Data storage system and data storage control method | |
| CN103890729A (en) | Collaborative management of shared resources | |
| CN105338118A (en) | Distributed storage system | |
| CN104603739A (en) | Block-level access to parallel storage | |
| EP2984551A1 (en) | Creating global aggregated namespaces for storage management | |
| CN103237046A (en) | Distributed file system supporting mixed cloud storage application and realization method thereof | |
| US20210055885A1 (en) | Enhanced data access using composite data views | |
| CN105095103B (en) | For the storage device management method and apparatus under cloud environment | |
| EP2880556A1 (en) | Supporting multi-tenancy in a federated data management system | |
| CN103312624A (en) | Message queue service system and method | |
| CN104933114A (en) | Mass log management cloud platform | |
| CN104050248A (en) | File storage system and storage method | |
| CN106570113B (en) | Mass vector slice data cloud storage method and system | |
| CN104794150A (en) | Cloud storage model and management method based on space knowledge cloud environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20120627 |