CN112559799A - Object cloud storage method and system - Google Patents
Object cloud storage method and system Download PDFInfo
- Publication number
- CN112559799A CN112559799A CN201910853035.2A CN201910853035A CN112559799A CN 112559799 A CN112559799 A CN 112559799A CN 201910853035 A CN201910853035 A CN 201910853035A CN 112559799 A CN112559799 A CN 112559799A
- Authority
- CN
- China
- Prior art keywords
- file
- cloud storage
- key frame
- frame index
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/71—Indexing; Data structures therefor; Storage structures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Abstract
The embodiment of the application provides an object cloud storage method, which comprises the following steps: the client sends an object cloud storage request; calling a cloud storage terminal interface, and establishing an object storage file, wherein the object storage file comprises a data file and a key frame index file; the object storage file is uploaded to the cloud storage end, and the technical problems that in the prior art, due to lack of real-time performance, the pressure on the cloud storage service performance is large due to impact on network surge on the whole, and due to the fact that data indexes are not available, if random positioning playing is needed, positioning can be performed only in a sequential scanning mode, a large amount of non-playing data are read by cloud service, and accordingly the cloud service pressure is large and the positioning time is long are solved.
Description
Technical Field
The embodiment of the application relates to the field of cloud storage, in particular to an object cloud storage method and system.
Background
The cloud storage service has the characteristics of safety, reliability, high capacity, good expansibility and easy maintenance, and is more and more widely applied to the video security industry. The interface provided by the cloud storage service is generally an object mode. The interface is characterized in that: data can be written in once, can be written in sequence only, data which is written in is not modifiable, and an object file cannot be opened again for writing after being written in again and closed. Only reading and random reading capability is provided after shutdown.
Currently, there are two ways to record video on cloud storage:
prior art scheme 1:
the video is recorded at the local machine. And uploading the recorded file to a cloud storage service.
Prior art scheme 2:
the video data is directly written into the cloud storage service; or by using a relatively simple TS (Transport Stream full name MPEG2-TS) Stream encapsulation method.
Above two kinds of prior art schemes, because the video recording is carried out by local machine, before the video recording is accomplished and is uploaded, other people can not visit, lack the real-time. And the whole device impacts network surge, so that the pressure on the cloud storage service performance is large. The video is stored in a streaming data mode, data indexes are not available, the video can be played in a sequential mode during playback, and if the playing position needs to be randomly defined, the video can be positioned in a sequential scanning mode, so that a cloud service reads a large amount of non-playing data, the pressure of the cloud service is increased, and the positioning time is long.
Disclosure of Invention
The embodiment of the application provides an object cloud storage method and an object cloud storage system, and solves the technical problems that the existing two prior art schemes lack real-time performance, impact on network surge on the whole is caused, the pressure on cloud storage service performance is large, data indexes are not provided, and if random positioning playing is needed, positioning can be carried out only in a sequential scanning mode, so that a large amount of non-playing data are read by cloud service, the cloud service pressure is large, and the positioning time is long.
The embodiment of the application provides an object cloud storage method, which comprises the following steps:
the client sends an object cloud storage request;
calling a cloud storage terminal interface, and establishing an object storage file, wherein the object storage file comprises a data file and a key frame index file;
and uploading the object storage file to the cloud storage terminal.
Specifically, the creating an object storage file specifically includes:
naming the data file and the key frame index file;
and recording the key frame in the data file, and writing the position of the key frame in the data file and the corresponding timestamp as a key frame index information node into the key frame index file.
Specifically, the naming process specifically includes:
setting the data file suffix name to be GTS and setting the key frame index file suffix name to be GIX by presetting;
and naming the data file and the key frame index file according to the file name formats of the same file name and different suffix names.
Preferably, the key frame index file at least contains one key frame index information node.
Preferably, the data files among 2 key frame index inodes are a group of GOPs.
Preferably, the GOP duration does not exceed 30 minutes.
Preferably, the data file and the key frame index file are in one-to-one correspondence.
Preferably, the data file is a video stream data file, and the video stream data file conforms to the specification of ISO-IEC-13818.
Preferably, when the object storage file is read;
if the data files need to be read sequentially, calling a cloud storage end interface to read the data files with the suffix name of GTS uploaded to the cloud storage end;
and if random positioning reading is needed, downloading the key frame index file with the suffix name of. GIX uploaded to the cloud storage end to a client, extracting the key frame index information node corresponding to the position needing positioning reading from the key frame index file, and positioning and reading the data file with the suffix name of.GTS uploaded to the cloud storage end corresponding to the key frame index information node according to the key frame index information node.
An embodiment of the present application provides an object cloud storage system, including:
the communication unit is used for establishing communication connection between the object cloud storage system and the client;
the receiving unit is used for receiving an object cloud storage request and a reading request sent by a client;
the storage unit is used for storing an object storage file uploaded by a client, wherein the object storage file comprises a data file and a key frame index file;
and the reading unit is used for reading the data file according to a reading request sent by a client, wherein the reading request comprises a sequential reading request and a random positioning reading request.
According to the technical scheme, the embodiment of the application has the following advantages:
the embodiment of the application provides an object cloud storage method, which comprises the following steps: the client sends an object cloud storage request; calling a cloud storage terminal interface, and establishing an object storage file, wherein the object storage file comprises a data file and a key frame index file; the object storage file is uploaded to the cloud storage end, and the technical problems that the existing two prior art schemes lack real-time performance, impact on network surge on the whole is caused, the cloud storage service performance is stressed greatly, data indexes are not available, positioning is only carried out in a sequential scanning mode if random positioning playing is needed, the cloud service reads a large amount of non-playing data, and the cloud service is stressed greatly and is long in positioning time are solved.
Drawings
Fig. 1 is a schematic flowchart of an embodiment of an object cloud storage method in an embodiment of the present application;
FIG. 2 is a schematic diagram of an object cloud storage system according to an embodiment of the present application;
FIG. 3 is a schematic diagram of file structures of a data file and a key frame index file in an embodiment of the present application;
FIG. 4 is a diagram illustrating a GOP between two key frames in an embodiment of the present application;
fig. 5 is a schematic diagram illustrating a video writing process according to an embodiment of an object cloud storage method in an embodiment of the present application;
fig. 6 is a schematic diagram illustrating a video playback flow of an embodiment of an object cloud storage method in an embodiment of the present application.
Reference numerals:
an object cloud storage method 100;
an object cloud storage system 200;
a communication unit 201;
a receiving unit 202;
a storage unit 203;
the cell 204 is read.
Detailed Description
The embodiment of the application provides an object cloud storage method and an object cloud storage system, and solves the technical problems that the existing two prior art schemes lack real-time performance, impact on network surge on the whole is caused, the pressure on cloud storage service performance is large, data indexes are not provided, and if random positioning playing is needed, positioning can be carried out only in a sequential scanning mode, so that a large amount of non-playing data are read by cloud service, the cloud service pressure is large, and the positioning time is long.
In order to make the objects, features and advantages of the embodiments of the present application more obvious and understandable, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the embodiments described below are only a part of the embodiments of the present application, but not all the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without any creative effort belong to the protection scope of the embodiments in the present application.
Referring to fig. 1, an embodiment of an object cloud storage method 100 provided in an embodiment of the present application includes:
the client sends an object cloud storage request;
calling a cloud storage terminal interface, and establishing an object storage file, wherein the object storage file comprises a data file and a key frame index file;
and uploading the object storage file to the cloud storage terminal.
In some specific embodiments, the creating an object storage file specifically includes:
naming the data file and the key frame index file;
and recording the key frame in the data file, and writing the position of the key frame in the data file and the corresponding timestamp as a key frame index information node into the key frame index file.
In some specific embodiments, the naming process specifically includes:
setting the data file suffix name to be GTS and setting the key frame index file suffix name to be GIX by presetting;
and naming the data file and the key frame index file according to the file name formats of the same file name and different suffix names.
Specifically, the key frame index file at least contains one key frame index information node.
Specifically, the data files among 2 key frame index inodes are a group of GOPs.
Preferably, the GOP is not more than 30 minutes.
It should be noted that, in some specific implementations of the object cloud storage method 100 provided in the embodiment of the present application, the data files and the key frame index files correspond to each other one to one.
Specifically, the data file is a video stream data file, and the video stream data file conforms to the specification of ISO-IEC-13818.
In some specific embodiments of the object cloud storage method 100 provided in the embodiment of the present application, when the object storage file is read;
if the data files need to be read sequentially, calling a cloud storage end interface to read the data files with the suffix name of GTS uploaded to the cloud storage end;
and if random positioning reading is needed, downloading the key frame index file with the suffix name of. GIX uploaded to the cloud storage end to a client, extracting the key frame index information node corresponding to the position needing positioning reading from the key frame index file, and positioning and reading the data file with the suffix name of.GTS uploaded to the cloud storage end corresponding to the key frame index information node according to the key frame index information node.
As shown in fig. 2, a cloud storage system 200 provided in the embodiment of the present application includes:
the communication unit 201 is used for establishing communication connection between the object cloud storage system and the client;
a receiving unit 202, configured to receive an object cloud storage request and a read request sent by a client;
the storage unit 203 is configured to store an object storage file uploaded by a client, where the object storage file includes a data file and a key frame index file;
the reading unit 204 is configured to read the data file according to a reading request sent by a client, where the reading request includes a sequential reading request and a random positioning reading request.
The object cloud storage method 100 and the object cloud storage system 200 provided by the embodiment of the application have the following advantages:
1) the video recording is realized in real time in the cloud service without local cache, the real-time playback of the video is realized, and the real-time performance of the system is enhanced.
2) The key frame index file is introduced, so that the playback is quickly and randomly positioned and played, and the playback user experience is enhanced.
As shown in fig. 3, in an embodiment of an object cloud storage method 100 provided in an embodiment of the present application, when an object storage file is established, the object storage file is composed of a data file and a key frame index file. The two files are distinguished by different suffix names. The data file format is a custom header + TS format. The subsequent name is GTS, the key frame index file uses a custom format with a suffix name of GIX, e.g., a.gts, a.gix denotes object storage file a.
Referring to fig. 5, a video writing process in an embodiment of an object cloud storage method 100 provided in the present application includes the following steps:
step one, establishing a video file: calling a cloud storage terminal interface, establishing a video file GTS file, and writing in custom header information; and establishing GIX corresponding key frame index file, and writing the self-defined header information.
Step two, writing video data: and calling a cloud storage terminal interface to write the video frame, and if the video frame is a key video frame, writing the position information of the key frame in the TS file and the timestamp information of the key frame into a key frame index file GIX. This step is repeated until the file is divided.
Preferably, to control the size of the key frame index file GIX, in the embodiment of the present application, 30 minutes is used as a video segment.
Step three, closing the file: and calling the cloud storage interface to finish the GTS video object file and the GIX video object file.
And step four, repeating the step one, the step two and the step three to realize continuous real-time video recording.
Referring to fig. 4 and 6, a video playing process in an embodiment of an object cloud storage method 100 provided in the embodiment of the present application includes the following steps:
the method comprises the following steps: inputting the name of the video object to be played, and respectively generating X.GTS and X.GIX object names according to the input video object name X (X represents the name of the video).
Step two: and calling a cloud storage terminal interface to download the X.GIX into a local play service memory, establishing related index corresponding information, and GIX only indexing key frames.
As shown in fig. 4, when the GOP interval is 1 second, the code rate is 4Mbyte per second, the duration is 30 minutes, and the size of the key frame index file GIX is only about 20 KByte. Fast downloading and complete local memory caching can be achieved.
Step three: reading a video frame:
1) and if the data frames need to be played sequentially, calling a cloud storage end interface, and sequentially reading the data frames from the X.GTS file according to the TS format.
2) If random positioning playing is required, the key frame index information node at the corresponding position is found in the key frame index file GIX downloaded to the memory, and playing is performed according to the position of the key frame index information node in the GTS file object file and the flow when playing is performed sequentially.
According to the object cloud storage method 100 and the object cloud storage system 200 provided by the embodiment of the application, the independent key frame index file is used, and the condition that other video file formats (such as AVI) need to adapt to the characteristic of the object cloud storage service by rewriting and writing data at a later stage is avoided. Meanwhile, the introduction of the index avoids the problem that a pure streaming object cannot be quickly positioned without the index, so that the real-time video recording of the real-time video in the object cloud storage service is realized.
And playing the cloud storage object video to download the key frame index data to a local memory, and randomly playing at the later stage by using the local key frame index, thereby achieving quick positioning.
The system can realize real-time video recording and playback of fast random positioning playing in the object cloud storage service by using the independent key frame index file.
The above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.
Claims (10)
1. An object cloud storage method, comprising:
the client sends an object cloud storage request;
calling a cloud storage terminal interface, and establishing an object storage file, wherein the object storage file comprises a data file and a key frame index file;
and uploading the object storage file to the cloud storage terminal.
2. The object cloud storage method according to claim 1, wherein the establishing of the object storage file specifically includes:
naming the data file and the key frame index file;
and recording the key frame in the data file, and writing the position of the key frame in the data file and the corresponding timestamp as a key frame index information node into the key frame index file.
3. The object cloud storage method according to claim 2, wherein the naming process specifically includes:
setting the data file suffix name to be GTS and setting the key frame index file suffix name to be GIX by presetting;
and naming the data file and the key frame index file according to the file name formats of the same file name and different suffix names.
4. The object cloud storage method of claim 3, wherein the key frame index file contains at least one key frame index inode.
5. The object cloud storage method of claim 4, wherein the data files between 2 key frame index inodes are a group of GOPs.
6. The object cloud storage method according to claim 5, wherein the GOP duration is not more than 30 minutes.
7. The object cloud storage method of claim 1, wherein the data files and the key frame index files are in one-to-one correspondence.
8. The object cloud storage method according to claim 1, wherein the data file is a video stream data file, and the video stream data file conforms to the ISO-IEC-13818 specification.
9. The object cloud storage method according to any one of claims 1 to 8, wherein when the object storage file is read;
if the data files need to be read sequentially, calling a cloud storage end interface to read the data files with the suffix name of GTS uploaded to the cloud storage end;
and if random positioning reading is needed, downloading the key frame index file with the suffix name of. GIX uploaded to the cloud storage end to a client, extracting the key frame index information node corresponding to the position needing positioning reading from the key frame index file, and positioning and reading the data file with the suffix name of.GTS uploaded to the cloud storage end corresponding to the key frame index information node according to the key frame index information node.
10. An object cloud storage system, comprising:
the communication unit is used for establishing communication connection between the object cloud storage system and the client;
the receiving unit is used for receiving an object cloud storage request and a reading request sent by a client;
the storage unit is used for storing an object storage file uploaded by a client, wherein the object storage file comprises a data file and a key frame index file;
and the reading unit is used for reading the data file according to a reading request sent by a client, wherein the reading request comprises a sequential reading request and a random positioning reading request.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910853035.2A CN112559799A (en) | 2019-09-10 | 2019-09-10 | Object cloud storage method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910853035.2A CN112559799A (en) | 2019-09-10 | 2019-09-10 | Object cloud storage method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112559799A true CN112559799A (en) | 2021-03-26 |
Family
ID=75028850
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910853035.2A Pending CN112559799A (en) | 2019-09-10 | 2019-09-10 | Object cloud storage method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112559799A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113742519A (en) * | 2021-08-31 | 2021-12-03 | 杭州登虹科技有限公司 | Multi-object storage cloud video Timeline storage method and system |
-
2019
- 2019-09-10 CN CN201910853035.2A patent/CN112559799A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113742519A (en) * | 2021-08-31 | 2021-12-03 | 杭州登虹科技有限公司 | Multi-object storage cloud video Timeline storage method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4481889B2 (en) | Data recording apparatus and method, program, and recording medium | |
| CN103559165B (en) | Comprise the video distribution system of broadcasting continuously | |
| JP5876480B2 (en) | Multimedia stream file storage file format, storage method, and client device using the same | |
| CN107231581B (en) | Method and system for video playing and streaming media playing control server | |
| JP2002341882A (en) | Method and apparatus for electronic distribution of digital multi-media information | |
| KR20070007160A (en) | Method and streams in distributed storage systems | |
| JP2003114845A (en) | Media conversion method and media conversion device | |
| CN102969013B (en) | Data processing equipment and control method thereof | |
| CN104639900A (en) | RTMP-to-M3U8 video slicing system and method | |
| CN111131786A (en) | Video monitoring storage system applying cloud storage | |
| US20090113501A1 (en) | Distribution Apparatus and Playback Apparatus | |
| JP4689996B2 (en) | Multimedia content high-speed download service apparatus and method | |
| CN101651795A (en) | Method and device for receiving, storing and playing media files transmitted by digital satellite | |
| CN112559799A (en) | Object cloud storage method and system | |
| US20110235995A1 (en) | Methods for reserving index memory space in avi recording apparatus | |
| CN1312921C (en) | Moving picture processing apparatus | |
| CN1848939B (en) | Information management system, information management apparatus and information management method | |
| JP4040343B2 (en) | Moving image processing device | |
| JP4242581B2 (en) | Data converter | |
| JP2004128938A (en) | Av data recording/reproducing device and method | |
| CN100559487C (en) | The method and system of the recording capacity of management accounts equipment | |
| CN110572685B (en) | 5G storage hard disk and digital movie standby playing method and system | |
| CN110636368B (en) | Media playing method, system, device and storage medium | |
| CN115250266B (en) | Video processing method and device, streaming media equipment and storage on-demand system | |
| CN100454225C (en) | An apparatus for and a method of storing a real time stream of digital information signals |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |