CN107948191A - A kind of cloud storage system and its data access method - Google Patents
A kind of cloud storage system and its data access method Download PDFInfo
- Publication number
- CN107948191A CN107948191A CN201711393023.3A CN201711393023A CN107948191A CN 107948191 A CN107948191 A CN 107948191A CN 201711393023 A CN201711393023 A CN 201711393023A CN 107948191 A CN107948191 A CN 107948191A
- Authority
- CN
- China
- Prior art keywords
- cloud
- control server
- cloud storage
- data block
- medium data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/48—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/146—Markers for unambiguous identification of a particular session, e.g. session cookie or URL-encoding
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Library & Information Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of cloud storage system and its data access method, belong to computer techno-stress information technology field, the cloud control server of the cloud storage system is at least two, collection terminal determines cloud control server according to default hash function and multimedia sources mark, and the information of multi-medium data block is saved in cloud control server determined by institute.System provided in an embodiment of the present invention, server is controlled due to the use of multiple clouds, improve the read-write concurrent capability of cloud storage system, at the same time, the compass of competency division of labor is carried out by default hash function by multimedia sources to cloud control server, ensure that the harmony and uniformity of each cloud control server load.
Description
Technical field
The present invention relates to computer techno-stress information technology field, more particularly to a kind of cloud storage system and its data storage
Method.
Background technology
With the continuous development at computer and network and the popularization of HD video, the space stored needed for multimedia is continuous
Increase, traditional storage architecture has been difficult meet demand.Cloud storage with the memory space of its magnanimity, high reliability, high concurrent,
The characteristic such as enhanced scalability and high performance-price ratio gradually demonstrates the brilliance.Mainstream cloud storage using google file system GFS as representative
File system is general in whole cluster there was only a cloud control server in logic for the consideration of data consistency.Cloud controls
Although server does not store real data, cloud control server needs to monitor the operating status of cloud storage service device, same to eight-legged essay
The read-write operation of part is required for cloud to control Server assistance, and with increasing for cloud storage service device quantity, cloud control server is born
Lotus is heavy, thus the performance of cloud control server restricts the scale of cloud storage.
The content of the invention
The technical problem to be solved in the present invention is to provide a kind of cloud storage system and its date storage method, to alleviate cloud control
Restriction of the control server performance to cloud storage system concurrent capability and scale.
Technical solution is as follows used by the present invention solves above-mentioned technical problem：
According to an aspect of the present invention, there is provided a kind of cloud storage system include by network connection：Collection terminal, extremely
Few two clouds control server and at least two cloud storage service devices, collection terminal are used to split multi-medium data by the sampling time
At least two multi-medium data blocks into energy independent play-out are stored into different cloud storage service devices；Collection terminal is additionally operable to basis
Default hash function and multimedia sources mark determines cloud control server, and the information of multi-medium data block is saved in and is determined
Cloud control server in.Cloud storage service device is used for storing multimedia data block respectively and is sent out according to the download request received
Send the multi-medium data block specified；Cloud control server is used to preserve the information of multi-medium data block and according to the inquiry received
Cloud storage service device where the multi-medium data block that request feedback is specified；Preferably, collection terminal is specifically used for multimedia sources
Mark is mapped to cloud control server using default hash function and numbers.Preferably, hash function includes：MD4, MD5 or
SHA-1.Preferably, cloud storage system further includes the client for controlling server and cloud storage service device to pass through network connection with cloud
End, client are used to determine cloud control server according to the default hash function and multimedia sources mark identical with collection terminal,
Cloud storage service device to where the multi-medium data block needed for the control server lookup of identified cloud, is deposited from the cloud inquired
Store up server and obtain required multi-medium data block.
According to another aspect of the present invention, there is provided the data access method of cloud storage system a kind of include：Work as storage
During data, collection terminal determines cloud control server according to default hash function and multimedia sources mark, and multi-medium data is pressed
Sampling time be divided into can the multi-medium data block of independent play-out store into different cloud storage service devices, and by multimedia number
It is saved according to the relevant information of block in definite cloud control server；When obtaining data, client is according to identical with collection terminal
Default hash function and multimedia sources mark determine cloud control server, to needed for definite cloud control server lookup
Cloud storage service device where multi-medium data block, required multi-medium data block is obtained from the cloud storage service device inquired.
Preferably, the information of multi-medium data block includes：Multi-medium data block identification, multimedia sources identify, cloud storage service device identifies,
Starting and end time.Preferably, cloud control service utensil is determined according to default hash function and multimedia sources mark
Body includes：At least two cloud control servers are numbered；Multimedia sources are identified and are mapped to using default hash function
Cloud controls the numbering of server.Preferably, hash function includes：MD4, MD5 or SHA-1.Preferably, clothes are controlled to definite cloud
The cloud storage service device where multi-medium data block needed for business device inquiry includes：According to multimedia sources mark and the time started to
Cloud storage service device where cloud control first multi-medium data block of server lookup；And/or according to multimedia sources mark and
The end time of a upper multi-medium data block to cloud control the next multi-medium data block of server lookup where cloud storage
Server.
System and method provided by the invention, compared with the prior art, controlling server due to the use of multiple clouds, improve
The read-write concurrent capability of cloud storage system, meanwhile, cloud control server is carried out by multimedia sources by default hash function
Compass of competency is divided the work, and ensure that the harmony and uniformity of each cloud control server load.
Brief description of the drawings
Fig. 1 is a kind of structure diagram of cloud storage system provided in an embodiment of the present invention；
Fig. 2 is a kind of function structure chart for cloud storage system that the preferred embodiment of the present invention provides；
Fig. 3 is a kind of flow chart of date storage method provided in an embodiment of the present invention；
Fig. 4 is a kind of flow chart for data capture method that the preferred embodiment of the present invention provides；
Fig. 5 is a kind of flow chart for video data acquisition methods that the preferred embodiment of the present invention provides.
Embodiment
Below in conjunction with drawings and examples, the present invention will be described in further detail.
Client 40 that Fig. 1 and Fig. 2 and a kind of cloud storage system provided in an embodiment of the present invention include being connected by network,
Collection terminal 30, at least two cloud control servers 20 and at least two cloud storage service devices 10, wherein：Cloud storage service device 10,
The multi-medium data block for the energy independent play-out split for storing collection terminal 30 respectively by the sampling time；It is additionally operable to receive client
40 request sends required multi-medium data block to client 40；Further, cloud storage service device 10 is stored including data
Module 101 and download module 102, data memory module 101 are used for the multi-medium data block for storing the upload of collection terminal 30, download mould
The request that block 102 is used to receive client 40 sends required multi-medium data block to client 40.Data memory module 101 can
To store at least two multi-medium data blocks, the total number of the multi-medium data block stored on all cloud storage service devices 10 determines
The scale of cloud storage system.Cloud controls server 20, for preserving the multi-medium data block stored in cloud storage service device 10
Relevant information；Be additionally operable to receive client 40 request feed back the multi-medium data block specified to client 40 where cloud deposit
Store up server 10.
Further, cloud control server 20 includes information storage module 201 and information inquiry module 202, information storage
Module 201 is used for the relevant information for preserving the multi-medium data block stored in cloud storage service device 10；Wherein, multi-medium data block
Relevant information include：Multi-medium data block identification, multimedia sources mark, cloud storage service device mark, time started and end
Time, can specifically utilize database to preserve multi-medium data block message.Information inquiry module 202 is used to receive client 40
Ask the cloud storage service device 10 where feeding back the multi-medium data block specified to client 40.Collection terminal 30, by multimedia number
It is divided into the multi-medium data block of energy independent play-out to store into different cloud storage service devices 10 according to by the sampling time, and will be more
The relevant information of media data block is saved in controls server according to the definite cloud of default hash function and multimedia sources mark
In 20；Specifically, every cloud control server is numbered by 0 to n-1, and collection terminal uses default hash function, by more matchmakers
The information of multi-medium data block is saved in by body source identity map to the numbering on section [0, n-1], obtaining cloud control server
In the corresponding cloud control server of numbering.Client 40, for according to the default hash function identical with collection terminal and more
Media source identity determines that cloud controls server 20, and required multi-medium data block institute is inquired about to identified cloud control server 20
Cloud storage service device 10, required multi-medium data block is obtained from the cloud storage service device 10 inquired.
System provided by the invention, controls server, the read-write for improving cloud storage system is concurrent due to the use of multiple clouds
Ability, meanwhile, the compass of competency division of labor is carried out by default hash function by multimedia sources to cloud control server, ensure that each
Cloud controls the harmony and uniformity of server load.
If Fig. 3 is a kind of flow chart of date storage method provided in an embodiment of the present invention, this method comprises the following steps：
S301, according to default hash function and multimedia sources mark determine cloud control server；Before this step, to every
Platform cloud controls server to be numbered by 0 to n-1, presets hash function, its hash function is obtained under any input parameter
Result all on [0, n-1] section, so ensure by multimedia sources mark can be mapped in the numbering of server, obtain cloud
The numbering of server is controlled, the information of multi-medium data block is saved in the corresponding cloud control server of the numbering.It is specific next
Say, using default hash function, the numbering for calculating cloud control server is identified according to multimedia sources, so as to select corresponding cloud
Control server.That is multimedia sources are identified to the numbering that cloud control server is mapped to using default hash function.
Wherein, hash function can have multiple choices, such as MD4, MD5, SHA-1 etc..
S302, by multi-medium data by the sampling time be divided into can independent play-out the storage of multi-medium data block to different
In cloud storage service device, and the relevant information of multi-medium data block is saved in identified cloud control server.Pass through this
Embodiment, selects cloud to control server according to multimedia sources mark by hash function, so that each cloud control server is orderly
Division of labor management, while also balanced load.
If Fig. 4 is a kind of flow chart of data capture method provided in an embodiment of the present invention, this method comprises the following steps：
S401, according to default hash function and multimedia sources mark determine cloud control server；Specifically, using thing
First definite hash function, the numbering for calculating cloud control server is identified according to multimedia sources, so as to select corresponding cloud to control
Server.Wherein, hash function can have multiple choices, such as MD4, MD5, SHA-1 etc..It should be noted that step S401
With S301 identical hash function must be used to ensure that same multimedia sources identify cloud control server be calculated and number
Unanimously.
S402, to identified cloud control server lookup needed for multi-medium data block where cloud storage service device；
Specifically, client can be identified according to multimedia sources and the time started controls first multi-medium data of server lookup to cloud
Cloud storage service device where block；It can also be identified according to multimedia sources and the end time of a upper multi-medium data block is to cloud
Control the cloud storage service device where the next multi-medium data block of server lookup.
S403, obtain required multi-medium data block from the cloud storage service device inquired.Specifically, client is from cloud control
After the storage service where multi-medium data block needed for control server acquisition, deposited with the cloud where required multi-medium data block
Storage server establishes session, receives required multi-medium data block.
It is including following such as the flow chart of acquisition methods that Fig. 5 is a kind of video data that the preferred embodiment of the present invention provides
Step：
S501, client are identified according to the video source of default hash function and required video data determines cloud control service
Device；This method each cloud control server between without data synchronization in the case of describe, if can guarantee that each cloud control
In the case of control server data consistency, then optionally server can be controlled by cloud during read block, that is to say, that need not
Step S501.
S502, client are identified according to the video source of required video data and the time started is to cloud control server request the
Cloud storage service device where one block of video data；Wherein, video source mark and time started are generally by having access to history video
User setting.User generally by client set needed for have access to the video source mark of video data, time started, cut-off
Time etc..
S503, cloud control server to the cloud storage service device 1 where first data block of client feedback；
S504, client and cloud storage service device 1 establish session, ask first block of video data；
S505, cloud storage service device 1 send first data block to client；
Whether the end time for the multi-medium data block that S506 judges currently to get is default deadline, is held if not
Row step S507, otherwise terminates flow；
S507, client are identified according to the video source of required video data and the upper end of data block time controls to cloud
Cloud storage service device where the next block of video data of server lookup；
S508, cloud control server to the cloud storage service device 2 where the next block of video data of client feedback；
S509, client and cloud storage service device 2 establish session, ask next block of video data；
S510, cloud storage service device 2 send next block of video data to client.
Circulation performs step S506-S510, is default section until the end time of the block of video data currently got
The only time, i.e. untill having received required video data.In order to save the resource of client, the efficiency of client is improved, works as visitor
After the completion of family end often receives a block of video data, the session with current cloud storage service device can be disconnected.
System and method provided by the invention, compared with the prior art, controlling server due to the use of multiple clouds, improve
The read-write concurrent capability of cloud storage system, meanwhile, cloud control server is carried out by multimedia sources by default hash function
Compass of competency is divided the work, and ensure that the harmony and uniformity of each cloud control server load.
Claims (3)
1. a kind of cloud storage system, including：Server is controlled by the collection terminal of network connection, cloud and at least two cloud storages take
Business device, wherein, collection terminal is used at least two multimedia numbers that multi-medium data is divided into energy independent play-out by the sampling time
According to block storage into different cloud storage service devices；Cloud storage service device be used for store respectively the multi-medium data block and according to
The download request received sends the multi-medium data block specified；Cloud control server is used to preserve the multi-medium data block
Information and the cloud storage service device according to where the inquiry request received feeds back the multi-medium data block specified；Its feature exists
In the quantity of the cloud control server is at least two, and the collection terminal is additionally operable to according to default hash function and more matchmakers
Body source mark determines cloud control server, and the information of the multi-medium data block is saved in identified cloud control server
In.
2. cloud storage system according to claim 1, it is characterised in that the information of multi-medium data block includes：Multimedia
Data block identifier, multimedia sources mark, cloud storage service device mark, starting and end time.
3. cloud storage system according to claim 1, it is characterised in that the collection terminal is specifically used for multimedia sources mark
Know the numbering that cloud control server is mapped to using default hash function.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711393023.3A CN107948191A (en) | 2017-12-14 | 2017-12-14 | A kind of cloud storage system and its data access method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711393023.3A CN107948191A (en) | 2017-12-14 | 2017-12-14 | A kind of cloud storage system and its data access method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107948191A true CN107948191A (en) | 2018-04-20 |
Family
ID=61941610
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711393023.3A Pending CN107948191A (en) | 2017-12-14 | 2017-12-14 | A kind of cloud storage system and its data access method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107948191A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108834212A (en) * | 2018-06-15 | 2018-11-16 | 深圳市广和通无线股份有限公司 | Method of locating terminal, device, computer equipment and storage medium |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103312815A (en) * | 2013-06-28 | 2013-09-18 | 安科智慧城市技术（中国）有限公司 | Cloud storage system and data access method thereof |
-
2017
- 2017-12-14 CN CN201711393023.3A patent/CN107948191A/en active Pending
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103312815A (en) * | 2013-06-28 | 2013-09-18 | 安科智慧城市技术（中国）有限公司 | Cloud storage system and data access method thereof |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108834212A (en) * | 2018-06-15 | 2018-11-16 | 深圳市广和通无线股份有限公司 | Method of locating terminal, device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109714330B (en) | Cross-network breakpoint resume method and system | |
| CN111200657B (en) | Method for managing resource state information and resource downloading system | |
| CN106506587A (en) | A kind of Docker image download methods based on distributed storage | |
| CN104348859B (en) | File synchronisation method, device, server, terminal and system | |
| US20170134495A1 (en) | Method and apparatus for sharing collaboratively edited document | |
| US9479578B1 (en) | Randomized peer-to-peer synchronization of shared content items | |
| CN106357778A (en) | Session information sharing method, device and system | |
| WO2016095149A1 (en) | Data compression and storage method and device, and distributed file system | |
| CN106790552B (en) | A kind of content providing system based on content distributing network | |
| CN109299157A (en) | A kind of data export method and device of distributed big single table | |
| CN104182487A (en) | Unified storage method supporting various storage modes | |
| WO2016169237A1 (en) | Data processing method and device | |
| WO2019080232A1 (en) | Task information transmission method and apparatus in workflow system, and computer device | |
| CN106202848A (en) | The acquisition methods of medical image file, user terminal and master server | |
| CN105656964B (en) | The implementation method and device of data-pushing | |
| CN111447265A (en) | File storage method, file downloading method, file processing method and related components | |
| US10257272B2 (en) | Randomized peer-to-peer synchronization of shared content items | |
| CN112351068A (en) | Information synchronization method, system, device, computer equipment and storage medium | |
| CN105320676A (en) | Customer data query service method and device | |
| CN103312815A (en) | Cloud storage system and data access method thereof | |
| CN111193789A (en) | Subscription information pushing method and device, computer equipment and readable storage medium | |
| CN107948191A (en) | A kind of cloud storage system and its data access method | |
| CN110012298A (en) | Information processing equipment, video transmission equipment and its control method | |
| CN105450679A (en) | Method and system for performing data cloud storage | |
| CN105069012B (en) | A kind of file access method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180420 |
|
| WD01 | Invention patent application deemed withdrawn after publication |