CN107612990A - A kind of cloud storage terminal device based on cloud information cloud computing service - Google Patents
A kind of cloud storage terminal device based on cloud information cloud computing service Download PDFInfo
- Publication number
- CN107612990A CN107612990A CN201710824187.0A CN201710824187A CN107612990A CN 107612990 A CN107612990 A CN 107612990A CN 201710824187 A CN201710824187 A CN 201710824187A CN 107612990 A CN107612990 A CN 107612990A
- Authority
- CN
- China
- Prior art keywords
- cloud
- data
- planes
- hard disk
- control module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0626—Reducing size or complexity of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention provides a kind of cloud storage terminal device based on cloud information cloud computing service, it is characterized in that：It is made up of hard disk, control module, USB interface, connected between hard disk and USB interface by control module, described hard disk is made up of a main Service controll group of planes, a memory node group of planes, an application node group of planes, a calculate node group of planes, defeated people's equipment and output equipment, and described control module is made up of central processing unit, internal memory, solid-state memory, wireless network module, cable network module, USB interface, com interface, network interface, MC interfaces, SPK interfaces.It is an advantage of the invention that：The equipment requirement of client is minimum, uses also most convenient, and intelligence arranges document automatic synchronization Dropbox, realizes the data and Application share between distinct device.
Description
Technical field
The present invention relates to the storage terminal of computerized information, more particularly to a kind of cloud based on cloud information cloud computing service is deposited
Store up terminal device.
Background technology
Traditional Dropbox is occurred to mailbox and instant messaging this two product offer supplement, to meet of user
Property demand.With WEB2.0 rise, traditional Dropbox forms complete product line from auxiliary product is independent, to meet user
Various network storage demand, the greater demand of traditional Dropbox is still to store user and resource-sharing.As backing up
A part for journey, write the data to using backup software or system equipment in tape or Automated Tape Library, data quilt from disk
It is saved on tape.These tapes and the data that they are included by normal backup and are specified during a very long reservation by area
Separate, typically from 10 years to endless.When data backup is deleted from the disc driver of server, these filings
Tape is sent to strange land storage device and permanently stored.Tape it is unfavorable be exactly have to before you can fetch data wait tape from
Strange land is fetched, and is then also required to the time and is carried out scanning tape, is found the data for needing to recover, is re-created tape storage data.This
The data of its outer confining blast, which increase, to be caused to reduce backup window in the past, the ability of reservation is limited, without practicable hand
Section verifies the integrality of tape-shaped medium and its data storage time limit.
The rise of the immoderate increase of data storage and Web2.0 applications forces people to think deeply storage again.Because data are deposited
Reserves are increased with 60% speed every year, and enterprise faces a kind of fearful situation.Put into more hard disks and can no longer solve storage and ask
Topic.In field of storage, up to now, the minimum path of resistance is to take stopgap measures, and buys more hard disks, causes substantial amounts of fund wave
Take！For the data of video monitoring, because Network Video Surveillance is network audio/video flow transmission, regarded in a large amount of sounds
The performance of video surveillance management server can be produced a very large impact in the case of frequency streaming, data are more, video monitoring pipe
Reason server just becomes more complicated to the scheduling of I/O operation and the management of caching, often occurs that more cameras take to separate unit
It is engaged in device, for multiple servers to the situation of a back-end storage device, the frequent access and multiple cameras to storage device are more
The storage demand of individual server have impact on its disposal ability, it is necessary to take substantial amounts of resource.
The content of the invention
In order to solve the problems, such as that background technology is present, the technical scheme of use is as follows：One kind is taken based on the cloud computing of cloud information
The cloud storage terminal device of business, it is characterized in that：It is made up of hard disk, control module, USB interface, passes through between hard disk and USB interface
Control module connects.
Described hard disk is by an a main Service controll group of planes, memory node group of planes, an application node group of planes, a calculate node group of planes, defeated
People's equipment and output equipment composition.
Described control module by central processing unit, internal memory, solid-state memory, wireless network module, cable network module,
USB interface, com interface, network interface, MC interfaces, SPK interfaces composition.
Cloud information is that server needs client mass data amount to be processed, and these data volumes are probably document or come from
Various application programs, have it is local also have it is online.Cloud computing is grid computing, Distributed Calculation, parallel computation, effect
The product merged with the traditional computers such as calculating, network storage, virtualization, load balancing and network technical development.By making meter
Calculation is distributed on substantial amounts of distributed computer, rather than in local computer or remote server, the operation of enterprise data center
Will be more like with internet.This enable enterprise will in the application of resource switch to needs, according to demand access computer and
Storage system.Cloud computing is a kind of method of emerging shared architecture.It is managed collectively substantial amounts of physical resource, and by this
A little resource virtualizings, form a huge virtual resources pond.Cloud be it is a kind of parallel and distributed system, these systems by
A series of virtual machine composition of interconnections.These virtual machines be based on SLA (supplier and consumer it
Ask that negotiation determines) exist by Dynamical Deployment, and as one or more unified computing resources.Cloud computing can be according to
User is to the demand Dynamical Deployment virtual resource of resource and computing capability, without being limited by physical resource.User is all to be based on
The calculating and application of cloud are operated in the resource of virtualization, it is not necessary to are concerned about these resource deployments on which physical resource, are used
Family can easily change the demand to computing resource.Cloud storage passes through cluster application, grid or distributed file system
Etc. function, a large amount of various types of storage devices in network are gathered into collaborative work by application software, it is common right
The outer system that data storage and Operational Visit function are provided.When the core of cloud computing system computing and processing is mass data
Storage and management when, just need to configure substantial amounts of storage device in cloud computing system, then cloud computing system be transformed into for
One cloud storage system.Compared with traditional storage device, cloud storage is not only a hardware, but a network equipment,
The complexity of some such as storage device, server, application software, public access interface, access network and client-side program compositions
System.Each several part externally provides data storage and Operational Visit service using storage device as core by application software.
The advantages of patent of the present invention is：The equipment requirement of client is minimum, uses also most convenient, and intelligence arranges document
Automatic synchronization Dropbox, realize data and Application share between distinct device.
Brief description of the drawings
Fig. 1 is frame construction drawing provided in an embodiment of the present invention.
Embodiment
Set as shown in Figure 1 for the frame construction drawing of the present invention, a kind of cloud storage terminal based on cloud information cloud computing service
It is standby, it is characterized in that：It is made up of hard disk, control module, USB interface, is connected between hard disk and USB interface by control module.Institute
The hard disk stated is by a main Service controll group of planes, a memory node group of planes, an application node group of planes, a calculate node group of planes, defeated people's equipment and defeated
Go out equipment composition.Described control module is by central processing unit, internal memory, solid-state memory, wireless network module, cable network mould
Block, USB interface, com interface, network interface, MC interfaces, SPK interfaces composition.USB interface by control module to disk read-write,
Realize cloud information cloud computing service.
The resource pool layer of cloud storage terminal be by the resource composition isomorphism of a large amount of same types or the resource pool close to isomorphism,
Such as computing resource pond, data resource pond.Structure resource pool is more the integrated and management work of physical resource, such as studies
2000 servers how are loaded in the space of a TEU (Twenty-foot Equivalent Unit), solve the problems, such as that radiating and malfunctioning node are replaced and reduced
Energy consumption.Management middleware layer is responsible for being managed the resource of cloud computing, and numerous application tasks are scheduled, and enables resource
Enough is efficiently and safely using offer service.Cloud computing ability is packaged into standard by Services Oriented Achitecture layer
WebServices is serviced, and is brought Services Oriented Achitecture coating systems into and be managed and use, including service interface,
Service registry, service search, service access and Service Workflow etc..It is cloud computing technology to manage middleware layer and resource pool layer
Most critical part, the function of Services Oriented Achitecture layer more provide by outside plant.User mutual interface is to application
Access interface is provided in a manner of WebServices, obtains user's request.Service catalogue is the service inventory that user can access.
All available resources are responsible for and distributed to system management module, and its core is load balancing.Configuration tool is responsible for distributing
Node on eligible task running environment.Monitoring statistical module is responsible for monitoring the running status of node, and completes user and use section
The statistics of point situation.Implementation procedure is simultaneously uncomplicated, and user mutual interface allows user to be chosen from catalogue and call a service,
After the request passes to system management module, it will distribute appropriate resource for user, and it is that user is accurate then to call configuration tool
Standby running environment.
The node of whole system is divided into three classes role by cloud computing：Client, master server and data block server.Client
End is available to the access interface of application program, and it is one group of special purpose interface, not in accordance with POSIX specifications, in the form of library file
There is provided.Application program directly invokes these built-in functions, and is linked together with the storehouse.Master server is management node, in logic
Upper only one, it preserves the metadata of system, is responsible for the management of whole file system, is the brain in file system.Data
Block server is responsible for specific storage work.Data are stored on data block server in the form of a file, data block server
Number can have multiple, its number directly determines the scale of system.File is carried out piecemeal by system according to fixed size,
Acquiescence is 64MB, and each piece is referred to as a data block, and each data block has a corresponding call number.
Client accesses primary server joint first in the system of access, obtains the data block that will be interacted therewith
Server info, then directly access these data block servers and complete data access.This design method realizes controlling stream
With the separation of data flow.There was only controlling stream between client and master server, and no data stream thus significantly reduces master
The load of server, it is allowed to not turn into a bottleneck of systematic function.Number is directly transmitted between client and data block server
According to stream, simultaneously because file, which is divided into multiple data blocks, carries out distributed storage, client can access multiple data blocks simultaneously
Server, so that whole system highly-parallel, systematic entirety can be improved.
Accumulation layer is the most basic part of cloud storage, and equipment can be FC fibre channel storages, can be NAS and
The DAS storage devices such as the IP such as iSCSI storage devices or SCSI or SAS.Often quantity is huge for storage device in cloud storage
Greatly and different geographical is distributed in, is linked together each other by wide area network, internet or FC fiber channel networks.Storage
It is a uniform storage device management system on equipment, it is possible to achieve the logical Virtual management of storage device, multilink are superfluous
Remaining management, and the condition monitoring and Breakdown Maintenance of hardware device.
Basic management layer is the most crucial part of cloud storage, and the part being most difficult in cloud storage.Basic management
Layer realizes the collaboration between multiple storage devices in cloud storage by technologies such as cluster, distributed file system and grid computings
Work, multiple storage devices is externally provided same service, and bigger stronger more preferable data access performance is provided.
CDN content dissemination system, data encryption technology ensure that the data in cloud storage will not be accessed by the user of unauthorized, meanwhile,
It can ensure that the data in cloud storage will not lose by measures such as data backup and disaster tolerance technologies, ensure the peace of cloud storage itself
Entirely and stably.
Application-interface layer is the most flexible and changeable part of cloud storage.Different cloud storage units of operation can be according to actual industry
Service type, develop different application service interfaces, there is provided different application services.Such as video surveillance applications platform, video point
Broadcast application platform, network hard disc quotes platform and remote data backup application platform etc..In order to realize access limit control, every part
Data are except needing key.Outside encryption, it is also necessary to a public private key pair, for the data after encryption carry out signature and
For being verified to signature result.
Any one authorized user in access layer can log in cloud storage system by the public application interface of standard
System, enjoy cloud storage service.It is unit of operation's difference of cloud storage, the access type and addressing meanses provided is also different.
When using hard disk, upload procedure is：The local file to be uploaded is selected, when performing upload operation, first
The fileinfo and other information that will be uploaded are sent to master server, after server receives fileinfo, first according to text
Part size carries out stripping and slicing calculating, and file is divided into the block of fixed dimension.When creating for each piece, server-assignment gives it
The block handle of one constant, globally unique position is identified to it, and block server is stored in using block as linux files
On filesystem hard disks, and block number evidence is read and write according to specified block handle and bytes range.There is provided according to monitoring system
Nodal information judges memory node state, by blocks of files equilibrium assignment to each node；Finally, by fileinfo and file block message
Database is inserted into, file block message is sent to client by server in xml format, and client is established for each memory node
One blocks of files queue, blocks of files is uploaded to parallel corresponding node.After memory node often receives a blocks of files, to clothes
Business device sends a confirmation, and the state of this document block in database is changed to 1 expression and has uploaded success by server.Work as text
After all pieces of part all uploads successfully, the state of this document in database is changed to 1 by server.When server by monitoring letter in real time
Breath, when finding some node failure, re-starts distribution by the partial document uploaded immediately.
Downloading process is：The file to be downloaded is selected, sends a download request to server, server receives download
After request, the block message of this document is searched from database, when node wants searching resource, by band searching resource
The searching request of mark is sent to central server, and central server is responsible for retrieving resource index, and announcing resource requestor, which gathers around, to deposit
Put node and the path of information.File block message is sent to client by server in xml format.Client is according to receiving
File block message, a thread is created for each memory node, by blocks of files Parallel download to local computer temporary folder
In.After the complete All Files block of client downloads, a complete file is integrated into, and delete blocks of files.When server leads to
Real-time monitoring information is crossed, when finding some node failure, the partial document downloaded is re-started into distribution immediately.From data
The suitable node of node selection and read request is concurrently sent, it for different blocks can also be same that read request, which can be,
The different piece of block, but will not be same piece of same part.Different requests can typically be sent to different data
Node.Different back end carries out content aggregation after receiving data, is then displayed to user.
Claims (1)
1. a kind of cloud storage terminal device based on cloud information cloud computing service, it is characterized in that：Connect by hard disk, control module, USB
Mouth composition, is connected between hard disk and USB interface by control module.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710824187.0A CN107612990A (en) | 2017-09-13 | 2017-09-13 | A kind of cloud storage terminal device based on cloud information cloud computing service |
| LU100457A LU100457B1 (en) | 2017-09-13 | 2017-09-26 | Cloud storage terminal device based on cloud information & cloud computing service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710824187.0A CN107612990A (en) | 2017-09-13 | 2017-09-13 | A kind of cloud storage terminal device based on cloud information cloud computing service |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107612990A true CN107612990A (en) | 2018-01-19 |
Family
ID=61063660
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710824187.0A Pending CN107612990A (en) | 2017-09-13 | 2017-09-13 | A kind of cloud storage terminal device based on cloud information cloud computing service |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107612990A (en) |
| LU (1) | LU100457B1 (en) |
-
2017
- 2017-09-13 CN CN201710824187.0A patent/CN107612990A/en active Pending
- 2017-09-26 LU LU100457A patent/LU100457B1/en active IP Right Grant
Also Published As
| Publication number | Publication date |
|---|---|
| LU100457B1 (en) | 2018-01-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10795905B2 (en) | Data stream ingestion and persistence techniques | |
| US10691716B2 (en) | Dynamic partitioning techniques for data streams | |
| US10740287B2 (en) | System and method of managing service oriented data | |
| US9276959B2 (en) | Client-configurable security options for data streams | |
| US11005933B2 (en) | Providing queueing in a log streaming messaging system | |
| US9794135B2 (en) | Managed service for acquisition, storage and consumption of large-scale data streams | |
| EP3069228B1 (en) | Partition-based data stream processing framework | |
| Wu et al. | Cloud storage as the infrastructure of cloud computing | |
| CA2930026C (en) | Data stream ingestion and persistence techniques | |
| US8838529B2 (en) | Applying replication rules to determine whether to replicate objects | |
| CA3109311C (en) | Aggregated service status reporter | |
| CN104050216A (en) | File system manager for customized resource allocation | |
| CN202872848U (en) | Cloud storage terminal equipment based on cloud information and cloud computing services | |
| US10182104B1 (en) | Automatic propagation of resource attributes in a provider network according to propagation criteria | |
| US10474696B2 (en) | Replication groups for content libraries | |
| CN107203639A (en) | Parallel file system based on High Performance Computing | |
| CN107612990A (en) | A kind of cloud storage terminal device based on cloud information cloud computing service | |
| Vergadia | Visualizing Google Cloud: 101 Illustrated References for Cloud Engineers and Architects | |
| AU2020296847B2 (en) | Distributed global object storage | |
| KR101523143B1 (en) | Hadoop-based system for providing distributed multimedia streaming service for cloud computing environment and method therof | |
| Patel et al. | Distributed Storage Infrastructure: Foundations, Analytics, Tools, and Applications | |
| US11829500B2 (en) | File interface to dynamically manage access to remote files | |
| Ren et al. | Scheme construction of vr cloud integration intelligent system based on internet of things | |
| US10592415B2 (en) | Modified consistency hashing rings for object store controlled WAN cache infrastructure | |
| WO2024012082A1 (en) | Big data cluster deployment method and apparatus, device, and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180119 |
|
| WD01 | Invention patent application deemed withdrawn after publication |