CN103152423A - Cloud storage system and data access method thereof - Google Patents

Cloud storage system and data access method thereof Download PDF

Info

Publication number
CN103152423A
CN103152423A CN2013100828031A CN201310082803A CN103152423A CN 103152423 A CN103152423 A CN 103152423A CN 2013100828031 A CN2013100828031 A CN 2013100828031A CN 201310082803 A CN201310082803 A CN 201310082803A CN 103152423 A CN103152423 A CN 103152423A
Authority
CN
China
Prior art keywords
multimedia data
cloud storage
cloud
server
data block
Prior art date
Application number
CN2013100828031A
Other languages
Chinese (zh)
Inventor
李磊磊
Original Assignee
安科智慧城市技术(中国)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 安科智慧城市技术(中国)有限公司 filed Critical 安科智慧城市技术(中国)有限公司
Priority to CN2013100828031A priority Critical patent/CN103152423A/en
Publication of CN103152423A publication Critical patent/CN103152423A/en

Links

Abstract

The invention discloses a cloud storage system and a data access method thereof. The system comprises acquisition sides, a cloud control server and at least two cloud storage servers, which are connected through a network, wherein the acquisition sides are used for splitting multimedia data into at least two multimedia data blocks capable of being separately played according to sampling time, storing the multimedia data blocks into the different cloud storage servers and storing the information of the multimedia data blocks into the cloud control server; the cloud storage servers are used for respectively storing the multimedia data blocks uploaded by the acquisition sides and also sending specified multimedia data blocks according to received downloading requests; and the cloud control server is used for storing the information of the multimedia data blocks and also feeding back the cloud storage servers with the specified multimedia data blocks according to received query requests. When the embodiment of the invention is adopted, the access of multimedia data is simplified, consequently, the efficiency of multimedia data access is increased, and meanwhile, overdue multimedia data can be deleted in time, so that storage spaces can be saved.

Description

一种云存储系统及其数据存取方法 One kind of cloud storage system and a data access method

技术领域 FIELD

[0001] 本发明涉及计算机及网络信息技术领域,尤其涉及一种云存储系统及其数据存储和获取方法。 [0001] The present invention relates to the field of computer and network technology information, particularly to a cloud storage system and its data storage and retrieval methods.

背景技术 Background technique

[0002] 随着计算机和网路的不断发展及高清视频的普及,存储多媒体所需的空间不断的增长,传统的存储架构已经很难满足需求。 [0002] With the popularization and development of computer networks and high-definition video, the space required to store multimedia continues to grow, traditional storage architectures has been difficult to meet the demand. 云存储以其海量的存储空间、高可靠性、高并发、高可扩展性及高性价比等特性逐渐展露头角。 Cloud storage space for its storage, high reliability, high concurrency and high scalability and cost-effective mass and other characteristics gradually fling.

[0003] 然而以google文件系统GFS为代表的主流云存储系统往往是以虚拟文件的形式来组织数据的,用户只能以文件名(或文件ID) +偏移量的方式来获取数据,对于大的多媒体数据的存取,就必须有一个附加的索引系统将用户需求(如视频数据的访问一般是以摄像头+时间为索引的)转换为文件名(或文件ID)+偏移量,当多媒体数据达到一定规模时,附加的索引系统就难以承载在一般的主流数据库上,势必导致其存储和获取数据设计非常复杂,降低了数据的存取效率。 [0003] However, in order to google GFS file system as the representative of mainstream cloud storage is often in the form of a virtual file system to organize the data, the user can only file name (or file ID) + offset a way to get the data, for large multimedia data access, it is necessary to have an additional indexing system user needs (such as access to video camera data is usually time index +) is converted to a file name (or file ID) + offset, when multimedia data reaches a certain size, additional indexing system would be difficult to carry on the general mainstream database, which will inevitably lead to store and retrieve data design is very complex, reducing the efficiency of data access.

发明内容 SUMMARY

[0004] 有鉴于此,本发明要解决的技术问题是提供一种云存储系统及其数据存储和获取方法,在云存储系统高容量、高可靠性及高可扩展性的基础上,简化多媒体数据的存取,提高了存取多媒体数据的效率。 [0004] Accordingly, the present invention is to solve the technical problem of providing a cloud storage system and its data acquisition and storage methods, based on high-capacity, high reliability and high scalability cloud storage system, a simplified multimedia data access, improves the efficiency of accessing multimedia data.

[0005] 本发明解决上述技术问题所采用的技术方案如下: [0005] The present invention solves the above technical problem technical solution as follows:

[0006] 根据本发明的一个方面,提供的一种云存储系统包括通过网络连接的采集端、云控制服务器和至少两台云存储服务器,其中: [0006] In accordance with one aspect of the invention a cloud storage system include capture terminal connected via a network, and at least two control server cloud cloud storage server, wherein:

[0007] 采集端,用于将多媒体数据按采样时间分割成能独立播放的至少两个多媒体数据块存储到不同的云存储服务器中,并将多媒体数据块的信息保存到云控制服务器中; [0007] collection end, at least two blocks of multimedia data of multimedia data is divided by the sample time to play independently stored in different cloud storage server, and stores the multimedia data block information control server to the cloud;

[0008] 云存储服务器,用于分别存储采集端上传的多媒体数据块;还用于根据接收到的下载请求发送指定的多媒体数据块; [0008] The cloud storage server for storing multimedia data are uploaded collection terminal block; further used to request transmission of multimedia data block specified by the received download;

[0009] 云控制服务器,用于保存多媒体数据块的信息;还用于根据接收到的查询请求反馈指定的多媒体数据块所在的云存储服务器。 [0009] Cloud control server for storing information of the multimedia data block; a further cloud storage server is in accordance with the received query request feedback specified multimedia data block.

[0010] 优选地,云控制服务器还用于定期删除云存储服务器中过期的多媒体数据块,并更新当前保存的多媒体数据块的信息。 [0010] Preferably, the control server further configured to periodically cloud deleting the multimedia data block is expired cloud storage server, and updates the information of the multimedia data block is currently stored.

[0011] 优选地,多媒体数据块的信息包括:多媒体数据块标识、多媒体源标识、云存储服务器标识、开始时间和结束时间。 [0011] Preferably, the information of the multimedia data block comprising: a block identifier the multimedia data, the multimedia source identifier, cloud storage server identifier, start time and end time.

[0012] 优选地,上述系统还包括客户端,与云控制服务器和云存储服务器通过网络连接,用于向云控制服务器查询所需的多媒体数据块所在的云存储服务器,并与相应的云存储服务器建立连接,获取所需的多媒体数据块。 [0012] Preferably, the system further includes a client, via a network connection with the control server cloud and the cloud storage server for controlling the cloud to a cloud storage server multimedia server queries the desired data block is located, and the corresponding cloud storage connections to the server, obtaining the multimedia data block required.

[0013] 根据本发明的另一个方面,提供的一种云存储系统的数据存取方法包括以下步骤: [0013] According to another aspect of the present invention, a method of data access provided by the cloud storage system comprising the steps of:

[0014] 采集端将多媒体数据按采样时间分割成能独立播放的至少两个多媒体数据块存储到不同的云存储服务器中,并将多媒体数据块的信息保存到云控制服务器中; [0014] The multimedia data collection terminal sampling time by dividing into at least two independently play the multimedia data blocks stored in different cloud storage server, and stores the multimedia data block information control server to the cloud;

[0015] 客户端向云控制服务器查询所需的多媒体数据块所在的云存储服务器; [0015] Client query to the control server cloud cloud storage servers required in the multimedia data block is located;

[0016] 客户端与查询到的云存储服务器建立连接,获取所需的多媒体数据块。 [0016] Client query to establish a connection with the cloud storage server for the multimedia data block is required.

[0017] 优选地,多媒体数据块的信息包括:多媒体数据块标识、多媒体源标识、云存储服务器标识、开始时间和结束时间。 [0017] Preferably, the information of the multimedia data block comprising: a block identifier the multimedia data, the multimedia source identifier, cloud storage server identifier, start time and end time.

[0018] 优选地,多媒体数据块的播放时间长度相等。 [0018] Preferably, the multimedia playback time equal to the length of the data block.

[0019] 优选地,客户端向云控制服务器查询所需的多媒体数据所在的云存储服务器包括: [0019] Preferably, the cloud storage server client to the control server cloud multimedia data where the desired query comprises:

[0020] 根据多媒体源标识和开始时间向云控制服务器查询第一个多媒体数据块所在的云存储服务器;和/或根据多媒体源标识和上一个多媒体数据块的结束时间向云控制服务器查询下一个多媒体数据块所在的云存储服务器。 [0020] The multimedia source identification and start time to control the cloud server cloud storage server queries a first multimedia data block is located; and / or to control the cloud server queries the next display end time in accordance with the source identifier and a multimedia data block cloud storage server of the multimedia data block is located.

[0021] 优选地,上述方法还包括:当客户端获取完一个多媒体数据块后,断开与当前云存储服务器的连接。 [0021] Preferably, the method further comprising: when the client gets a complete block of the multimedia data, disconnect the current cloud storage server.

[0022] 优选地,上述方法之后还包括:云控制服务器定期删除云存储服务器中过期的多媒体数据块,并更新云控制服务器中保存的多媒体数据块的信息。 [0022] Preferably, after the above-described method further comprises: controlling the cloud server expires periodically deleting the multimedia data block cloud storage servers, and updates the control information cloud data blocks stored in the multimedia server.

[0023] 根据本发明的实施例的系统和方法,直接通过采集端将多媒体数据按采样时间分割成多媒体数据块存储到云存储服务器,而云控制服务器保存云存储服务器存储的多媒体数据块的信息供客户端查询,从而使客户端不用附加的索引系统将用户需求转换为文件名(或文件ID) +偏移量,就能从所需的多媒体数据块所在的云服务器下载多媒体数据块。 [0023] The system and method of embodiments of the present invention, directly to end the multimedia data is divided into by the acquisition by the sampling time of the multimedia data blocks to cloud storage servers, and the cloud control information of the multimedia data block server saves cloud storage server storage query for the client, so the client system without additional indexes user needs to convert the file name (or file ID) + offset, be able to download the multimedia data block is required from the cloud server of the multimedia data block is located. 因此,跟现有技术相比,减少了获取视频数据时查询文件偏移的环节,简化了多媒体数据的存取,从而提高了多媒体数据的存取效率;同时也减少了可能出错的环节,增加系统的可靠性,此外,通过云控制服务器定期删除过期的多媒体数据块,节省了存储空间。 Thus, compared with the prior art, to reduce the file offset of the query links when acquiring video data, multimedia data access is simplified, thereby improving the efficiency of accessing multimedia data; also reduces the possibility of error and add more reliability of the system, in addition, the multimedia data block is deleted by the expiration of the control server cloud periodically saving the storage space.

附图说明 BRIEF DESCRIPTION

[0024] 图1为本发明实施例提供的一种云存储系统的结构示意图; [0024] FIG. 1 is a schematic structure of a cloud storage system according to an embodiment of the present invention;

[0025]图2为本发明优选实施例提供的一种云存储系统的模块结构图; [0025] FIG. 2 is preferably block configuration diagram of a cloud storage system according to an embodiment of the present invention;

[0026] 图3为本发明实施例提供的一种云存储系统的数据存取方法的流程图; [0026] FIG 3 a flow diagram of a method of accessing data cloud storage system according to an embodiment of the present invention;

[0027] 图4为本发明优选实施例提供的一种云存储系统的数据删除流程图。 [0027] FIG. 4 one kind of cloud data storage system according to an embodiment of the present invention is preferably a flowchart deleted.

[0028] 图5为本发明优选实施例提供的一种视频数据的获取方法的流程图。 [0028] FIG 5 is preferably a flowchart of a method for obtaining a video data according to an embodiment of the present invention.

具体实施方式 Detailed ways

[0029] 为了使本发明所要解决的技术问题、技术方案及有益效果更加清楚、明白,以下结合附图和实施例,对本发明进行进一步详细说明。 [0029] In order to make the technical problem to be solved by the present invention, technical solutions and beneficial effects more clearly understand, in conjunction with the accompanying drawings and the following embodiments, the present invention will be further described in detail. 应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。 It should be understood that the specific embodiments described herein are only intended to illustrate the present invention and are not intended to limit the present invention.

[0030] 请参阅图1和图2,本发明实施例提供的一种云存储系统包括通过网络连接的采集端10、云控制服务器20和至少两台云存储服务器30,其中: [0030] Please refer to FIG. 1 and FIG. 2, one kind of embodiment of the present invention is provided in the cloud storage system comprises a collection terminal 10 connected via a network, a cloud server 20 and at least two control cloud storage server 30, wherein:

[0031] 采集端10,用于将多媒体数据按采样时间分割成能独立播放的至少两个多媒体数据块存储到不同的云存储服务器30中,并将多媒体数据块的信息保存到云控制服务器20中; [0031] collection end 10 for the sampling time by dividing the multimedia data into at least two independently play the multimedia data blocks stored in different cloud storage server 30, and stores the multimedia data block information to the control server cloud 20 in;

[0032] 云控制服务器20,用于保存多媒体数据块的信息;还用于根据接收到的查询请求反馈指定的多媒体数据块所在的云存储服务器。 [0032] Cloud control server 20, for storing information of the multimedia data block; a further cloud storage server is in accordance with the received query request feedback specified multimedia data block.

[0033] 进一步地,云控制服务器20包括信息存储模块201和信息查询模块202,信息存储模块201用于保存云存储服务器30中存储的多媒体数据块的信息;其中,多媒体数据块的信息包括:多媒体数据块标识、多媒体源标识、云存储服务器标识、开始时间和结束时间,具体可以利用数据库保存多媒体数据块信息。 [0033] Further, the control server cloud 20 includes an information storage module 201 and the module information 202, the information storing module 201 for information of the multimedia data block is stored in the cloud storage server 30 stored; wherein the information of the multimedia data block comprises: multimedia data block identifier, the multimedia source identifier, cloud storage server identifier, start time and end time, can use the database specific data blocks stored multimedia information. 信息查询模块202用于接收客户端的请求向客户端反馈指定的多媒体数据块所在的云存储服务器。 Information query request receiving module 202 for client to the client feedback cloud storage server specified multimedia data block is located.

[0034] 优选地,为了及时删除过期的数据块节省存储空间,云控制服务器20还包括数据删除模块203,数据删除模块203用于定期删除云存储服务器30中过期的多媒体数据块,并更新当前保存的多媒体数据块的信息。 [0034] Preferably, the data block to promptly remove outdated save storage space, the control server 20 further comprising a cloud data deleting module 203, a data deleting module 203 for periodically deleting the multimedia data block is expired cloud storage server 30, and updates the current the multimedia data stored in information blocks. 当然,云控制服务器20还可以用于维护云存储服务器30的状态信息。 Of course, the control server cloud 20 may also be used to maintain the status information of the cloud storage server 30.

[0035] 云存储服务器30,用于分别存储采集端10上传的多媒体数据块;还用于根据接收到的下载请求发送指定的多媒体数据块; [0035] The cloud storage server 30, 10 for respectively storing the multimedia data acquired upload end block; further used to request transmission of multimedia data block specified by the received download;

[0036] 进一步地,云存储服务器30包括数据存储模块301和下载模块302,数据存储模块301用于存储采集端10上传的多媒体数据块,下载模块302用于接收客户端的请求向客户端发送所需的多媒体数据块。 [0036] Further, the cloud storage server 30 includes a data storage module 301 and a download module 302, data storage module 301 for uploading the multimedia data block 10 stored collection terminal, receiving a request for downloading module 302 transmits to the client the client required multimedia data block. 数据存储模块301可以存储多个多媒体数据块,所有云存储服务器30上存储的多媒体数据块的总数目决定了云存储系统的规模。 The data storage module 301 may store a plurality of multimedia data blocks, the total number of the multimedia data block stored on all cloud storage server 30 determines the size of the cloud storage system.

[0037] 本实例中还可以包括客户端40,与云控制服务器20和云存储服务器30通过网络连接,用于向云控制服务器20查询所需的多媒体数据块所在的云存储服务器,并与相应的云存储服务器30建立连接,获取所需的多媒体数据块。 [0037] This example also may include a client 40, the control server 20 is connected to the cloud and the cloud storage server 30 via the network, for controlling the cloud to a cloud storage server multimedia server 20 queries the desired data block is located, and the corresponding cloud storage server 30 establish a connection, the required block of multimedia data acquisition.

[0038] 根据本发明的实施例的系统,直接通过采集端将多媒体数据按采样时间分割成多媒体数据块存储到云存储服务器,而云控制服务器保存云存储服务器存储的多媒体数据块的信息供客户端查询,从而使客户端不用附加的索引系统将用户需求转换为文件名(或文件ID) +偏移量,就能从所需的多媒体数据块所在的云服务器下载多媒体数据块,简化了多媒体数据的存取,从而提高了多媒体数据的存取效率;同时也减少了可能出错的环节,增加系统的可靠性,此外,通过云控制服务器定期删除过期的多媒体数据块,节省了存储空间。 [0038] system according to an embodiment of the present invention, directly to end the multimedia data is divided into by the acquisition by the sampling time of the multimedia data blocks to cloud storage servers, and the information of the multimedia data block cloud control server saves the cloud storage server stores for customers to end of the query, so that the client does not need additional indexing system converts the user demand for the file name (or file ID) + offset, be able to download the multimedia data block is required from the cloud server where the multimedia data block, the multimedia simplified access to the data, thereby improving the efficiency of accessing multimedia data; also reduces the possibility of error sectors, increase the reliability of the system, in addition, the multimedia data block is deleted periodically cloud expired control server, saving storage space.

[0039] 如图3为本发明实施例提供的一种云存储系统的数据存取方法的流程图,该方法包括以下步骤: [0039] FIG 3 a flow diagram of a method of accessing data cloud storage system according to an embodiment of the present invention, the method comprising the steps of:

[0040] S301、将多媒体数据按采样时间分割成能独立播放的多媒体数据块存储到不同的云存储服务器中,并将多媒体数据块的信息保存到云控制服务器中; [0040] S301, the sampling time by dividing the multimedia data into a multimedia data playback independently stored in different blocks of the cloud storage server, and stores the multimedia data block information control server to the cloud;

[0041] 其中,多媒体数据块的信息包括:多媒体数据块标识、多媒体源标识、云存储服务器标识、开始时间和结束时间,具体可以采用数据库的形式保存。 [0041] wherein the information of the multimedia data block comprising: a block identifier the multimedia data, the multimedia source identifier, cloud storage server identifier, start time and end time, the database may take the form of specific storage.

[0042] 举例而言,假设应用在视频监控领域中,本步骤具体为:将视频数据按摄像头的拍摄时间分割成能独立播放且时间长度相等的视频数据块,存储到云存储系统中不同的云存储服务器上,同时将视频数据块信息保存到云控制服务器的数据库。 [0042] For example, assume the application in the field of video surveillance, this step is specifically: the video data is divided by time taken camera to independently play and the time of equal length blocks of video data stored in the cloud storage system different cloud storage server, while the information blocks of video data stored in the database of the control server cloud. 需要说明地是,播放时间的长度相等时为了更简单而优化性能,实际应用中也可以播放时间长度不相等。 Note that the, in order to optimize performance and simpler equal length of playback time, playback can also be a practical application the length of time is not equal.

[0043] S302、客户端向云控制服务器查询所需的多媒体数据块所在的云存储服务器;[0044] 具体地,客户端可以根据多媒体源标识和开始时间向云控制服务器查询第一个多媒体数据块所在的云存储服务器;还可以根据多媒体源标识和上一个多媒体数据块的结束时间向云控制服务器查询下一个多媒体数据块所在的云存储服务器。 [0043] S302, the cloud storage server to the client control server cloud desired query multimedia data block is located; [0044] In particular, the client can query the server to control the first multimedia data to the cloud multimedia source identification and start time cloud storage server block is located; may also control the query server cloud storage servers in a multimedia data block is located to the cloud identifier in accordance with the multimedia source and a multimedia data end time block.

[0045] S303、客户端与查询到的云存储服务器建立连接,获取所需的多媒体数据块。 [0045] S303, the client establishes a connection with a query to the cloud storage server for the multimedia data block is required.

[0046] 具体地,客户端从云控制服务器获取所需的多媒体数据块所在的存储服务后,与所需的多媒体数据块所在的云存储服务器建立会话,接收所需的多媒体数据块。 After [0046] Specifically, the client acquired from the cloud storage service required multimedia data block is located in the control server, with the desired cloud storage server where the multimedia data block to establish a session, receiving the multimedia data block is required.

[0047] 需要说明地是,一次操作有且只有一个多媒体源标识,如果需要获取多个多媒体源采集的多媒体数据,那就是多个独立的过程。 [0047] Incidentally be a primary operation and only one multimedia source identification, if the need to obtain a plurality of multimedia data of multimedia acquisition sources, that is, a plurality of independent processes.

[0048] 优选地,在本发明的又一个实施例中,为了节省云存储服务器的存储空间,该方法之中还包括:定期删除云存储服务器中过期的多媒体数据块,并更新云控制服务器中保存的多媒体数据块的信息。 [0048] Preferably, in a further embodiment of the present invention, in order to save storage space in the cloud storage server, in the method further comprising: periodically delete expired multimedia data block cloud storage servers, and updates the control server cloud the multimedia data stored in information blocks. 具体来说,云控制服务器定期查询超期的多媒体数据块,向超期的多媒体数据块所在的云存储服务器发送删除数据的命令,同时更新当前保存的多媒体数据块的信息。 Specifically, the cloud control servers periodically query the multimedia data block is extended, the cloud storage server to block extended multimedia data resides send commands to delete data, and update information of the multimedia data block currently stored.

[0049] 根据本发明的实施例的方法,跟现有技术相比,不用将客户端需求转换为文件名(或文件ID)+偏移量,减少了获取视频数据时根据采样时间查询文件偏移的环节,简化了多媒体数据的存取,从而提高视频数据的效率;同时也减少了可能出错的环节,增加系统的可靠性。 [0049] The methods according to embodiments of the present invention, compared with the prior art, without the client needs to convert the file name (or file ID) + offset, is reduced when the partial video data is acquired according to the sampling time of the query file shifting links, simplifying access to multimedia data, thereby increasing the efficiency of video data; also reduces the possibility of error sectors, increasing system reliability.

[0050] 如图4为本发明优选实施例提供的本发明优选实施例提供的一种云存储系统的数据删除流程图,该方法包括以下步骤: [0050] FIG. 4 one kind of cloud data storage system according to an embodiment of deleting a flowchart of a preferred embodiment of the present invention is preferably present invention, the method comprising the steps of:

[0051] S401、查询数据库中的过期的多媒体数据块信息,生成列表。 [0051] S401, expired multimedia data block information query the database, generating a list.

[0052] 具体来说,遍历数据库中的多媒体数据块信息,查询结束时间在事先设定的保存期限之前的多媒体数据块,将这些多媒体数据块的信息组成列表,列表中至少包括多媒体数据块标识和所在的云存储服务器标识; [0052] Specifically, the multimedia data block information traversing the database, query the end time of the multimedia data block before the retention period set in advance, the information of the multimedia data blocks such composition list, the list including at least the multimedia data block identifier and cloud storage server's identity;

[0053] S402、判断列表是否为空,如果为空则执行S403 ;否则执行S404 ; [0053] S402, to determine whether the list is empty, if empty then perform S403; otherwise, execute S404;

[0054] S403、判断是否达到预定的清盘时间,如果达到则执行S401 ;否则继续等待; [0054] S403, it determines whether a predetermined winding-up time is reached S401 is executed; otherwise, continue to wait;

[0055] S404、取出列表中的第一个多媒体数据块信息; [0055] S404, retrieves the first data block of multimedia information list;

[0056] S405、向多媒体数据块所在的云存储服务器发送删除该多媒体数据块的命令; [0056] S405, the cloud storage server is transmitted to the multimedia data block command to delete the multimedia data block;

[0057] S406、更新数据库中的多媒体数据块信息,执行S402。 [0057] S406, the update of multimedia information database of the data block, performing S402.

[0058] 多媒体数据的存储过程一般是持续进行的且有一定的有效期(如视频监控领域中摄像头会不断的捕获视频数据),这就要求文件系统必须可以向文件尾部追加数据,并且可以从文件头部及时删除过期数据以释放存储空间。 Stored Procedures [0058] multimedia data generally and have a certain duration ongoing (e.g., field of video surveillance cameras will continue to capture video data), which requires the file system must be data to the end of the file is added, and may be from a file head timely deletion of expired data to free storage space. 也就是说向已存在的文件头部删除数据或者尾部添加数据,但文件的原有部分不会收到影响,不需要重新写入文件系统。 That is to delete the file header existing data or add data to the tail, but the original part of the file does not receive the impact is no need to re-write file system. 现有技术中,虽然少数主流的云存储系统可以向文件尾部追加数据,但删除数据必须以文件为单位(这里的文件是云存储系统向外界展示的逻辑上的文件),如果文件划分过小势必使文件数量变多,影响系统执行效率;如果文件划分过大则过期的多媒体数据就无法及时删除。 The prior art, although a small number of mainstream cloud storage system can append data to the end of the file, but you must delete the data in units of files (documents on file here is the logical cloud storage system to the outside world show), if the file is too small division it is bound to make the number of files increases, affect the efficiency of the system; if the file is too large expired divided multimedia data can not be promptly deleted. 例如一个视频采样的时间是从某天的O时到第二天的O时,需要保留7天,意味着从第8天O时开始,就陆续有视频数据超过保留时间。 For example, a video sampling time is the time from one day to the next day's O O, required seven days, it means the beginning of the first eight days from O, a succession of video data retention over time. 如果这段视频被打包在同一个文件里,且文件只能整天删除,那我们必须等到第九天才能清理掉过期的视频数据。 If this video is packaged in the same file, and the file can only delete all day, then we have to wait until the ninth day to clean out the video data expired. 如果分割成一个小时一个文件,那么每隔一个小时就可以把过期部分清除,不许要等待I整天。 If a file is divided into one hour, then every hour you can put expired partially cleared, I can not wait all day. [0059] 如图5为本发明优选实施例提供的一种视频数据的获取方法的流程图,该方法包括以下步骤: [0059] FIG 5 is a flowchart of the method for obtaining a provided video data of the present preferred embodiment of the invention, the method comprising the steps of:

[0060] S501、客户端根据所需视频数据的视频源标识和开始时间向云控制服务器请求第一个视频数据块所在的云存储服务器; [0060] S501, the client requests the control server cloud storage server a first block of video data where a video source in accordance with the cloud identifier and a start time of the desired video data;

[0061] 其中,视频源标识和开始时间一般由调阅历史视频的用户设定的。 [0061] wherein the video source identification and start time by a general history of access to the video user setting. 用户一般通过客户端设置所需调阅视频数据的视频源标识、开始时间、截止时间等。 Provided by the client user typically needed to identify the video data access to the video source, start time, off time.

[0062] S502、云控制服务器向客户端反馈第一个数据块所在的云存储服务器I ; [0062] S502, the cloud feedback control server to the client I cloud storage server where the first data block;

[0063] S503、客户端与云存储服务器I建立会话,请求第一个视频数据块; [0063] S503, the client and the cloud storage server I establish a session, the first request for a block of video data;

[0064] S504、云存储服务器I向客户端发送第一个数据块; [0064] S504, the cloud storage server I transmits a first block of data to the client;

[0065] S505判断当前获取到的多媒体数据块的结束时间是否为预设的截止时间,若否执行步骤S506,否则结束流程; [0065] S505 to determine whether the current end time acquired multimedia data block is a preset deadline, if not perform step S506, the flow ends or;

[0066] S506、客户端根据所需视频数据的视频源标识和上一个数据块结束时间向云控制服务器查询下一个视频数据块所在的云存储服务器; [0066] S506, the client end according to a video source identification data and the video data block of time required to control the cloud storage server cloud server queries a next block of video data is located;

[0067] S507、云控制服务器向客户端反馈下一个视频数据块所在的云存储服务器2 ; [0067] S507, the cloud feedback control server to the client a cloud storage server 2 next block of video data is located;

[0068] S508、客户端与云存储服务器2建立会话,请求下一个视频数据块; [0068] S508, the client and the cloud storage server 2 establishes a session, requests the next block of video data;

[0069] S509、云存储服务器2向客户端发送下一个视频数据块。 [0069] S509, the cloud storage server 2 to the client transmits a next block of video data terminal.

[0070] 循环执行步骤S505-S509,直到当前获取到的视频数据块的结束时间为预设的截止时间,即,接收完所需的视频数据为止。 [0070] The loop step S505-S509, until the end of the current time acquired block of video data is a preset deadline, i.e., the receiving end until the desired video data. 为了节省客户端的资源,提高客户端的效率,当客户端每接收一个视频数据块完成后,可以断开与当前云存储服务器的会话。 To save resources of the client, the client improve efficiency, when the client receives each of a block of video data is complete, this can disconnect a session with the cloud storage server.

[0071] 举例来说,如用户需要调阅摄像头34020000001310000001采集的2013年I月2日O时O分O秒至2013年I月2日3时O分O秒直接的录像,而视频数据块的采集时间均为一个小时,则执行以下步骤:客户端向云控制服务器查询34020000001310000001采集的2013年I月2日O时O分O秒至2013年I月2日3时O分O的视频数据;云控制服务器将云存储服务器I的信息反馈给客户端;客户端从云存储服务器I获取第一个视频数据块,此视频数据块为O时O分O秒至I时O分O秒的视频;客户端向云控制服务器查询34020000001310000001采集的2013年I月2日I时O分O秒至2013年I月2日3时O分O的视频数据;云控制服务器将云存储服务器2的信息反馈给客户端;客户端从云存储服务器2获取第二个视频数据块,此视频数据块为I时O分O秒至2时O分O秒的视频;客户端向云控制服务器查询34020000001310000001采集的2013年I月2日I时O分O秒至2013年I月 [0071] For example, as when the user needs access to the camera 34020000001310000001 collected 2 May 2013 O O I O minutes to seconds during May 3, 2013 2 I O O points directly seconds video, and the video data block collection times are one hour, perform the following steps: the client to the cloud control server queries May 2, 2013 I O O O seconds to minutes I May 3, 2013 when the 2nd O O points 34020000001310000001 video data acquisition; minutes seconds of video O O I client acquires the first block of video data from the cloud storage server, this block of video data when O O O seconds to minutes I; cloud information to the control server cloud storage server I feedback to the client ; the client queries to the control server 34020000001310000001 collected in 2013 I May 2 O points O seconds to 2013 I May 3, when the 2nd O points O video data when I; cloud control server information cloud storage server 2 feedback to the client; the client obtains the second block of video data from the cloud storage server 2, O seconds to minutes and O 2 O O minutes when this second video block of video data is I; clients to query the control server cloud collected 34020000001310000001 O O sub-seconds to 2013 when I dated May 2, 2013 I I 2日3时O分O的视频数据;云控制服务器将云存储服务器3的信息反馈给客户端;客户端从云存储服务器3获取第三个视频数据块,此视频数据块为2时O分O秒至3时O分O秒的视频,获取完所需的视频数据块后结束流程。 When points O 3 O 2 video data; cloud information to the control server 3, the cloud storage server back to the client; client obtains a third block of video data from the cloud storage server 3, this block of video data is divided 2 O when seconds to 3 O O O minutes seconds of video, the flow is terminated after obtaining the desired block of video data.

[0072] 根据本实施例,客户端从云控制服务器查询所需的多媒体数据块所在的云存储服务器,然后从查询到的云存储服务器下载多媒体数据,跟现有技术相比,不必将客户端需求转换为文件名(或文件ID) +偏移量,减少了获取视频数据时根据采样时间查询文件偏移的环节,简化了多媒体数据的存取步骤,从而提高了存取多媒体数据的效率,同时减少了出错环节,提高了可靠性。 [0072] According to the present embodiment, the control server the client query from the cloud storage server cloud desired multimedia data block is located, and then download the multimedia data from a query to the cloud storage server, as compared with the prior art, the client does not have to needs to convert the file name (or file ID) + offset, is reduced when acquiring video data query link file offset according to the sampling time, simplifying the step of accessing multimedia data, thereby improving the efficiency of accessing multimedia data, while reducing the error links and improve reliability.

[0073] 以上参照附图说明了本发明的优选实施例,并非因此局限本发明的权利范围。 [0073] Brief description of the above preferred embodiment of the present invention is not so limited the scope of the claimed invention. 本领域技术人员不脱离本发明的范围和实质,可以有多种变型方案实现本发明,比如作为一个实施例的特征可用于另一实施例而得到又一实施例。 Those skilled in the art without departing from the scope and spirit of the invention, various modifications can be implemented embodiment of the present invention, such as features of one embodiment may be used with another embodiment to obtain a still further embodiment. 凡在运用本发明的技术构思之内所作的任何修改、等同替换和改进,均应在本发明的权利范围之内。 Any modifications made within the technical concept of the use of the present invention, equivalent substitutions and modifications can be made within the scope of the present invention.

Claims (10)

1.一种云存储系统,其特征在于,所述系统包括通过网络连接的采集端、云控制服务器和至少两台云存储服务器,其中: 所述采集端,用于将多媒体数据按采样时间分割成能独立播放的至少两个多媒体数据块存储到不同的云存储服务器中,并将所述多媒体数据块的信息保存到云控制服务器中; 所述云存储服务器,用于分别存储所述采集端上传的多媒体数据块;还用于根据接收到的下载请求发送指定的多媒体数据块; 所述云控制服务器,用于保存所述多媒体数据块的信息;还用于根据接收到的查询请求反馈指定的多媒体数据块所在的云存储服务器。 A cloud storage system, wherein said system comprises a collection terminal connected via a network, and at least two control server cloud cloud storage server, wherein: the collection end, the multimedia data is divided by a sample time at least two independent blocks of multimedia data is stored into play different cloud storage server, and stores information of the multimedia data block is to control the cloud server; the cloud storage server for storing the collected end respectively upload the multimedia data block; also sends multimedia data block is specified for the request according to the received downloading; cloud the control server for saving the information of the multimedia data block; feedback for further specified in terms of the received query request cloud storage server of the multimedia data block is located.
2.根据权利要求1所述的云存储系统,其特征在于,所述云控制服务器还用于定期删除所述云存储服务器中过期的多媒体数据块,并更新当前保存的多媒体数据块的信息。 2. The cloud storage system according to claim 1, wherein said control server further configured to periodically cloud deleting the multimedia data block is expired cloud storage server, and updates the information of the multimedia data block is currently stored.
3.根据权利要求1或2所述的云存储系统,其特征在于,所述多媒体数据块的信息包括:多媒体数据块标识、多媒体源标识、云存储服务器标识、开始时间和结束时间。 The cloud storage system according to claim 1, wherein the information of the multimedia data block comprising: a block identifier the multimedia data, the multimedia source identifier, cloud storage server identifier, start time and end time.
4.根据权利要求1或2所述的云存储系统,其特征在于,所述系统还包括: 客户端,与所述云控制服务器和云存储服务器通过网络连接,用于向所述云控制服务器查询所需的多媒体数据块所在的云存储服务器,并与相应的云存储服务器建立连接,获取所需的多媒体数据块。 The cloud storage system according to claim 1, characterized in that the system further comprises: a client, via a network connected to the cloud and the cloud storage server control server, the control server to the cloud for cloud storage server desired query multimedia data block is located, and to establish a connection with the corresponding cloud storage server for the multimedia data block is required.
5.一种云存储系统的数据存取方法,其特征在于,所述方法包括: 采集端将多媒体数据按采样时间分割成能独立播放的至少两个多媒体数据块存储到不同的云存储服务器中,并将所述多媒体数据块的信息保存到云控制服务器中; 客户端向云控制服务器查询所需的多媒体数据块所在的云存储服务器; 客户端与查询到的云存储服务器建立连接,获取所需的多媒体数据块。 5. A method for accessing data cloud storage system, wherein, said method comprising: dividing the multimedia data collection terminal according to the sampling time in at least two independent blocks of multimedia data is stored into play different cloud storage server , and stores the multimedia data block information to the control server in the cloud; cloud storage server to the client control server cloud desired query multimedia data block is located; client establishing a connection with a query to the cloud storage server for the required multimedia data block.
6.根据权利要求5所述的数据存取方法,其特征在于,所述多媒体数据块的信息包括:多媒体数据块标识、多媒体源标识、云存储服务器标识、开始时间和结束时间。 6. The data access method according to claim 5, wherein the information of the multimedia data block comprising: a block identifier the multimedia data, the multimedia source identifier, cloud storage server identifier, start time and end time.
7.根据权利要求5所述的数据存储方法,其特征在于,所述多媒体数据块的播放时间长度相等。 The data storage method as claimed in claim 5, characterized in that the play time is equal to the length of the multimedia data block.
8.根据权利要求5所述的数据获取方法,其特征在于,所述客户端向云控制服务器查询所需的多媒体数据所在的云存储服务器包括: 根据多媒体源标识和开始时间向所述云控制服务器查询第一个多媒体数据块所在的云存储服务器;和/或根据多媒体源标识和上一个多媒体数据块的结束时间向所述云控制服务器查询下一个多媒体数据块所在的云存储服务器。 8. The data acquisition method according to claim 5, characterized in that, the client queries to the control server cloud storage server where the desired multimedia data comprising: a control according to the cloud multimedia source identification and start time a multimedia server queries the first data block is located cloud storage servers; and / or cloud storage servers in querying the control server cloud where a multimedia data block identifier based on the multimedia source and a multimedia data end time block.
9.根据权利要求8所述的数据存储方法,其特征在于,还包括: 当客户端获取完一个多媒体数据块后,断开与当前云存储服务器的连接。 A data storage method according to claim 8, characterized in that, further comprising: when the client gets a complete block of the multimedia data, disconnect the current cloud storage server.
10.根据权利要求5-9任意一项权利要求所述的数据存储方法,其特征在于,所述方法之后还包括:云控制服务器定期删除所述云存储服务器中过期的多媒体数据块,并更新所述云控制服务器中保存的多媒体数据块的信息。 10. The data storage method as claimed in any one of claims 5-9 claim, characterized in that, after the method further comprising: controlling the cloud server expires periodically delete the multimedia data block cloud storage server, and update information of the multimedia data block stored in the control server in the cloud.
CN2013100828031A 2013-03-15 2013-03-15 Cloud storage system and data access method thereof CN103152423A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2013100828031A CN103152423A (en) 2013-03-15 2013-03-15 Cloud storage system and data access method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2013100828031A CN103152423A (en) 2013-03-15 2013-03-15 Cloud storage system and data access method thereof

Publications (1)

Publication Number Publication Date
CN103152423A true CN103152423A (en) 2013-06-12

Family

ID=48550282

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2013100828031A CN103152423A (en) 2013-03-15 2013-03-15 Cloud storage system and data access method thereof

Country Status (1)

Country Link
CN (1) CN103152423A (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103312815A (en) * 2013-06-28 2013-09-18 安科智慧城市技术(中国)有限公司 Cloud storage system and data access method thereof
CN103310008A (en) * 2013-06-28 2013-09-18 安科智慧城市技术(中国)有限公司 Cloud control server and file index method
CN103414748A (en) * 2013-07-12 2013-11-27 广东电子工业研究院有限公司 Cloud platform monitoring architecture and monitoring realizing method thereof
CN103729470A (en) * 2014-01-20 2014-04-16 刘强 Secure storage method based on different cloud storage ends
CN103995890A (en) * 2014-05-30 2014-08-20 杭州智屏软件有限公司 Method for updating and searching for data of real-time audio fingerprint search library
CN104468489A (en) * 2013-09-24 2015-03-25 张生福 File security mechanism for cloud video recorder
CN104469100A (en) * 2013-09-24 2015-03-25 张生福 Distributed type cloud video recording platform
CN105320711A (en) * 2014-08-01 2016-02-10 纬创资通股份有限公司 Methods for accessing big data and systems using the same
CN105338027A (en) * 2014-07-30 2016-02-17 杭州海康威视系统技术有限公司 Method, system and device for cloud storage of video data
CN105450679A (en) * 2014-08-06 2016-03-30 杭州海康威视系统技术有限公司 Method and system for performing data cloud storage
CN105828017A (en) * 2015-10-20 2016-08-03 广东亿迅科技有限公司 Cloud storage access system and method for video conferences
CN105979278A (en) * 2016-06-17 2016-09-28 武汉斗鱼网络科技有限公司 Saving method and device of live videos
CN106598973A (en) * 2015-10-14 2017-04-26 杭州海康威视数字技术股份有限公司 Intelligent searching method and system based on cloud storage management
WO2017118318A1 (en) * 2016-01-06 2017-07-13 阿里巴巴集团控股有限公司 Data storage and service processing method and device
CN108206933A (en) * 2016-12-16 2018-06-26 杭州海康威视数字技术股份有限公司 A kind of video data acquisition methods and device based on video cloud storage system
WO2019024910A1 (en) * 2017-08-04 2019-02-07 杭州海康威视系统技术有限公司 Storage resource recovery method, apparatus and system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101141627A (en) * 2007-10-23 2008-03-12 深圳市迅雷网络技术有限公司 Storage system and method of stream media file
CN101198037A (en) * 2008-01-03 2008-06-11 中兴通讯股份有限公司 Method for managing monitor video
CN101483762A (en) * 2008-12-31 2009-07-15 中兴通讯股份有限公司 Platform video recording method, system and customer terminal
CN101605148A (en) * 2009-05-21 2009-12-16 何吴迪 Method for structuring parallel system for cloud storage
CN101753944A (en) * 2008-12-08 2010-06-23 北京中星微电子有限公司;中星电子股份有限公司 Method and device for video management of video monitoring system
CN101794306A (en) * 2010-03-02 2010-08-04 上海华平信息技术股份有限公司 Multi-type video file block storage system and method
CN102685123A (en) * 2012-05-04 2012-09-19 安科智慧城市技术(中国)有限公司 Cloud-storage-based streaming media publication device, system and method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101141627A (en) * 2007-10-23 2008-03-12 深圳市迅雷网络技术有限公司 Storage system and method of stream media file
CN101198037A (en) * 2008-01-03 2008-06-11 中兴通讯股份有限公司 Method for managing monitor video
CN101753944A (en) * 2008-12-08 2010-06-23 北京中星微电子有限公司;中星电子股份有限公司 Method and device for video management of video monitoring system
CN101483762A (en) * 2008-12-31 2009-07-15 中兴通讯股份有限公司 Platform video recording method, system and customer terminal
CN101605148A (en) * 2009-05-21 2009-12-16 何吴迪 Method for structuring parallel system for cloud storage
CN101794306A (en) * 2010-03-02 2010-08-04 上海华平信息技术股份有限公司 Multi-type video file block storage system and method
CN102685123A (en) * 2012-05-04 2012-09-19 安科智慧城市技术(中国)有限公司 Cloud-storage-based streaming media publication device, system and method

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103310008A (en) * 2013-06-28 2013-09-18 安科智慧城市技术(中国)有限公司 Cloud control server and file index method
CN103310008B (en) * 2013-06-28 2018-06-01 安科智慧城市技术(中国)有限公司 A kind of cloud control server and its file index method
CN103312815A (en) * 2013-06-28 2013-09-18 安科智慧城市技术(中国)有限公司 Cloud storage system and data access method thereof
CN103414748B (en) * 2013-07-12 2016-12-28 广东电子工业研究院有限公司 A kind of cloud platform monitoring framework and monitoring implementation method thereof
CN103414748A (en) * 2013-07-12 2013-11-27 广东电子工业研究院有限公司 Cloud platform monitoring architecture and monitoring realizing method thereof
CN104469100A (en) * 2013-09-24 2015-03-25 张生福 Distributed type cloud video recording platform
CN104468489A (en) * 2013-09-24 2015-03-25 张生福 File security mechanism for cloud video recorder
CN103729470A (en) * 2014-01-20 2014-04-16 刘强 Secure storage method based on different cloud storage ends
CN103995890A (en) * 2014-05-30 2014-08-20 杭州智屏软件有限公司 Method for updating and searching for data of real-time audio fingerprint search library
CN105338027B (en) * 2014-07-30 2019-01-25 杭州海康威视系统技术有限公司 Carry out the method, system and device of video data cloud storage
CN105338027A (en) * 2014-07-30 2016-02-17 杭州海康威视系统技术有限公司 Method, system and device for cloud storage of video data
CN105320711A (en) * 2014-08-01 2016-02-10 纬创资通股份有限公司 Methods for accessing big data and systems using the same
CN105320711B (en) * 2014-08-01 2019-08-30 纬创资通股份有限公司 Mass data access method and the system for using this method
CN105450679A (en) * 2014-08-06 2016-03-30 杭州海康威视系统技术有限公司 Method and system for performing data cloud storage
CN105450679B (en) * 2014-08-06 2019-06-28 杭州海康威视系统技术有限公司 Carry out the method and system of data cloud storage
CN106598973A (en) * 2015-10-14 2017-04-26 杭州海康威视数字技术股份有限公司 Intelligent searching method and system based on cloud storage management
CN105828017B (en) * 2015-10-20 2019-09-03 广东亿迅科技有限公司 A kind of cloud storage access system and method towards video conference
CN105828017A (en) * 2015-10-20 2016-08-03 广东亿迅科技有限公司 Cloud storage access system and method for video conferences
WO2017118318A1 (en) * 2016-01-06 2017-07-13 阿里巴巴集团控股有限公司 Data storage and service processing method and device
CN105979278A (en) * 2016-06-17 2016-09-28 武汉斗鱼网络科技有限公司 Saving method and device of live videos
CN108206933A (en) * 2016-12-16 2018-06-26 杭州海康威视数字技术股份有限公司 A kind of video data acquisition methods and device based on video cloud storage system
WO2019024910A1 (en) * 2017-08-04 2019-02-07 杭州海康威视系统技术有限公司 Storage resource recovery method, apparatus and system

Similar Documents

Publication Publication Date Title
EP1988684B1 (en) Method for large payload distribution in a network
US10237625B2 (en) Byte range caching
US8190674B2 (en) Variable rate media delivery system
CN100431320C (en) Method and appts. for real-time parallel delivery of segments of large payload file
US8880650B2 (en) System and method for storing streaming media file
EP2175383A1 (en) Method and apparatus for improving file access performance of distributed storage system
JP2016531466A (en) An Adaptive Data Streaming Method with Push Message Control
US6047309A (en) Recording observed and reported response characteristics at server and/or client nodes in a replicated data environment, and selecting a server to provide data based on the observed and/or reported response characteristics
CN102014158B (en) Cloud storage service client high-efficiency fine-granularity data caching system and method
US20110191445A1 (en) Efficient streaming server
CN100571281C (en) A great magnitude of data hierarchical storage method
RU2343536C2 (en) Mechanism of peer broadcasting of information content
CN101636726B (en) Video distribution system including progressive playback
US8612668B2 (en) Storage optimization system based on object size
CN102769781B (en) Method and device for recommending television program
US10262005B2 (en) Method, server and system for managing content in content delivery network
US9532114B2 (en) Optimizing caches for media streaming
US20110307534A1 (en) Distributed file system supporting data block dispatching and file processing method thereof
EP1364510A2 (en) Method and system for managing distributed content and related metadata
EP2359536A1 (en) Adaptive network content delivery system
EP1368948A2 (en) Method and apparatus for large payload distribution in a network
US9003462B2 (en) Content archive model
CN101228523A (en) System and method for caching network file systems
US8719889B2 (en) Live time-shift system based on P2P technology and method thereof
US8341118B2 (en) Method and system for dynamically replicating data within a distributed storage system

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
RJ01