CN114189752A - Video storage scheme based on object storage service - Google Patents
Video storage scheme based on object storage service Download PDFInfo
- Publication number
- CN114189752A CN114189752A CN202111410400.6A CN202111410400A CN114189752A CN 114189752 A CN114189752 A CN 114189752A CN 202111410400 A CN202111410400 A CN 202111410400A CN 114189752 A CN114189752 A CN 114189752A
- Authority
- CN
- China
- Prior art keywords
- video
- data
- index table
- scheme based
- slice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000013523 data management Methods 0.000 claims description 8
- 238000013500 data storage Methods 0.000 description 6
- 239000012634 fragment Substances 0.000 description 5
- 238000012217 deletion Methods 0.000 description 2
- 230000037430 deletion Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000000034 method Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
- H04N21/23113—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion involving housekeeping operations for stored content, e.g. prioritizing content for deletion because of storage space restrictions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/232—Content retrieval operation locally within server, e.g. reading video streams from disk arrays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
Abstract
The invention relates to the field of video storage, in particular to a video storage scheme based on object storage service. Which comprises the following steps: s1, establishing a video data hierarchical index table; s2, acquiring a real-time video stream from a video source; s3, the data obtained is converted and packaged into ts format; s4, slicing the ts format video data; s5, writing the video slice into the OSS; and S6, writing the structured data of the video slice into a structured data warehouse. The invention improves the storage capacity, reliability, retrieval speed and instantaneity.
Description
Technical Field
The invention relates to the field of video storage, in particular to a video storage scheme based on object storage service.
Background
With the rapid development of communication technology, the application of video data in various industries is continuously deepened. The video data as an unstructured data is characterized by large data volume, complex data format and poor data readability. Video data owners often face video data management challenges. The storage of video data generally has four measurement indexes, namely storage capacity, storage reliability, retrieval speed and real-time performance. Storage capacity: a size of the stored video data; storage reliability: video data is resistant to loss and corruption; retrieval speed: the response speed of video storage data query; real-time performance: the video data is stored and then retrieved for the required time.
The traditional storage mode of the video recorder is to realize the storage and retrieval of video data through disk blocking and I frame indexing. Due to the fact that frame lengths generated after video data are coded are inconsistent, the size of a fixed disk block is not matched with the size of the video data, and therefore the waste of disk space is caused; the reliability of the video data storage mode without redundancy design is low; the video data is stored dispersedly, is unfavorable for the application to insert.
Disclosure of Invention
The invention aims to provide a video storage scheme based on an object storage service, which improves the storage capacity, reliability, retrieval speed and real-time performance, aiming at the problems in the background art.
The technical scheme of the invention is a video storage scheme based on object storage service, which comprises the following steps:
s1, establishing a video data hierarchical index table;
s2, acquiring a real-time video stream from a video source;
s3, the data obtained is converted and packaged into ts format;
s4, slicing the ts format video data;
s5, writing the video slice into the OSS;
and S6, writing the structured data of the video slice into a structured data warehouse.
S7, retrieving video data;
s8, performing data management according to a preset video data management rule;
s9, data warehouse structured data archiving.
Preferably, the hierarchical index table is layered into three layers, which are a device index table, a video index table and a fragment index table.
Preferably, in S2, the standard streaming media protocol supported by the streaming protocol is taken: RTMP, RTSP, HTTP-FLV.
Preferably, in S4, the size of the ts video slice depends on the I-frame interval of the video and the specified video slice size.
Preferably, in S7, the structured index data of the video data is queried according to the conditions of the device id, the start time, and the end time.
Compared with the prior art, the invention has the following beneficial technical effects:
the invention solves the problem of mass data storage of video data by using the characteristics of the OSS, and the data storage has reliability; the object index is established by using the structured data, and the speed and the real-time performance of video retrieval are considered.
Drawings
FIG. 1 is a flow chart of video data storage according to the present invention;
FIG. 2 is a frame diagram of a video data index structured hierarchical design according to the present invention.
Detailed Description
As shown in fig. 1, the video storage scheme based on the object storage service proposed by the present invention includes the following steps:
s1, establishing a video data hierarchical index table, as shown in fig. 2, the hierarchical index table is layered into three layers, which are an equipment index table, a video index table, and a fragment index table, where:
device index table: in order to manage the data of the mass video sources conveniently, the equipment generating the video sources is coded to form an equipment index table;
video index table: the video index table stores the video data index information of the specific equipment every day;
a fragment index table: the fragment index table stores video data fragment index information of a certain day of equipment;
s2, acquiring a real-time video stream from a video source, and acquiring a standard streaming media protocol supported by a streaming protocol: RTMP, RTSP, HTTP-FLV;
s3, the data obtained are converted and packaged into ts format, the ts fixed packet length is convenient for finding the initial position of the frame, and the method is suitable for video slicing and hls protocols;
s4, slicing the ts format video data, wherein the size of the ts video slice depends on the I frame interval of the video and the size of the designated video slice;
s5, writing the video slice into the OSS;
s6, writing the structured data of the video slice into a structured data warehouse;
s7, retrieving video data, and inquiring the structured index data of the video data through the conditions of the device id, the start time and the end time;
s8, performing data management according to a preset video data management rule;
s9, data warehouse structured data archiving.
An OSS (operation Support systems) system is an operation Support system, and provides an object storage capability that naturally matches the storage of video data, a slice of video data corresponds to the concept of an object (object) in the OSS, and the mass storage capability provided by the OSS can satisfy the demand for a large amount of video data. The structured processing of the metadata information of the object in the OSS greatly improves the retrieval capability of the video data, and indirectly increases the readability of the video data.
The invention solves the problem of mass data storage of video data by using the characteristics of the OSS, and the data storage has reliability; the object index is established by using the structured data, and the speed and the real-time performance of video retrieval are considered. The application of video on demand, downloading and the like can be realized by utilizing the structured index data of the video object data, and the management of the video object data can be realized by utilizing the structured index data of the video object data, specifically comprising data management operations of overtime deletion, ultra-capacity deletion and the like of the video data. In order to relieve the pressure of the structured data warehouse, the data in the structured data table can be archived by writing the structured in-memory data into the OSS.
The embodiments of the present invention have been described in detail with reference to the drawings, but the present invention is not limited thereto, and various changes can be made within the knowledge of those skilled in the art without departing from the gist of the present invention.
Claims (6)
1. A video storage scheme based on an object storage service, comprising the steps of:
s1, establishing a video data hierarchical index table;
s2, acquiring a real-time video stream from a video source;
s3, the data obtained is converted and packaged into ts format;
s4, slicing the ts format video data;
s5, writing the video slice into the OSS;
and S6, writing the structured data of the video slice into a structured data warehouse.
2. The video storage scheme based on the object storage service according to claim 1, further comprising:
s7, retrieving video data;
s8, performing data management according to a preset video data management rule;
s9, data warehouse structured data archiving.
3. The video storage scheme based on the object storage service according to claim 2, wherein the hierarchical index table is layered into three layers, which are a device index table, a video index table, and a slice index table.
4. The video storage scheme based on the object storage service according to claim 3, wherein in S2, the standard streaming media protocol supported by the streaming protocol is taken: RTMP, RTSP, HTTP-FLV.
5. The video storage scheme of claim 4, wherein in S4, the size of ts video slice depends on the I frame interval of the video and the specified video slice size.
6. The video storage scheme based on the object storage service according to claim 5, wherein in S7, the structured index data of the video data is queried according to the conditions of device id, start time and end time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111410400.6A CN114189752A (en) | 2021-11-25 | 2021-11-25 | Video storage scheme based on object storage service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111410400.6A CN114189752A (en) | 2021-11-25 | 2021-11-25 | Video storage scheme based on object storage service |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114189752A true CN114189752A (en) | 2022-03-15 |
Family
ID=80602518
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111410400.6A Pending CN114189752A (en) | 2021-11-25 | 2021-11-25 | Video storage scheme based on object storage service |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114189752A (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101799827A (en) * | 2010-03-11 | 2010-08-11 | 浙江大学 | Video database management method based on layering structure |
| CN102244758A (en) * | 2011-07-08 | 2011-11-16 | 杭州华三通信技术有限公司 | Video-recording-file-based data acquisition method and equipment |
| CN103442259A (en) * | 2013-08-21 | 2013-12-11 | 杭州浦禾通信技术有限公司 | Method and device for reconstructing media data |
| CN104427351A (en) * | 2013-08-30 | 2015-03-18 | 北京计算机技术及应用研究所 | Time-overlapped video stream rapid-positioning method and system for video monitoring |
| CN105100716A (en) * | 2015-07-23 | 2015-11-25 | 浙江立元通信技术股份有限公司 | Safe memory cell used for network video monitoring and system thereof |
| CN105898204A (en) * | 2014-12-25 | 2016-08-24 | 支录奎 | Intelligent video recorder enabling video structuralization |
| CN106230768A (en) * | 2016-06-16 | 2016-12-14 | 北京数智源科技股份有限公司 | Structuring system for managing video |
| CN106598973A (en) * | 2015-10-14 | 2017-04-26 | 杭州海康威视数字技术股份有限公司 | Intelligent searching method and system based on cloud storage management |
| CN107291889A (en) * | 2017-06-20 | 2017-10-24 | 郑州云海信息技术有限公司 | A kind of date storage method and system |
| CN107340971A (en) * | 2016-04-28 | 2017-11-10 | 上海优刻得信息科技有限公司 | A kind of data storage is with recovering framework and method |
| CN108391085A (en) * | 2018-02-07 | 2018-08-10 | 深圳市亿联智能有限公司 | It is a kind of with high safety performance based on IP Camera cloud video recording system |
-
2021
- 2021-11-25 CN CN202111410400.6A patent/CN114189752A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101799827A (en) * | 2010-03-11 | 2010-08-11 | 浙江大学 | Video database management method based on layering structure |
| CN102244758A (en) * | 2011-07-08 | 2011-11-16 | 杭州华三通信技术有限公司 | Video-recording-file-based data acquisition method and equipment |
| CN103442259A (en) * | 2013-08-21 | 2013-12-11 | 杭州浦禾通信技术有限公司 | Method and device for reconstructing media data |
| CN104427351A (en) * | 2013-08-30 | 2015-03-18 | 北京计算机技术及应用研究所 | Time-overlapped video stream rapid-positioning method and system for video monitoring |
| CN105898204A (en) * | 2014-12-25 | 2016-08-24 | 支录奎 | Intelligent video recorder enabling video structuralization |
| CN105100716A (en) * | 2015-07-23 | 2015-11-25 | 浙江立元通信技术股份有限公司 | Safe memory cell used for network video monitoring and system thereof |
| CN106598973A (en) * | 2015-10-14 | 2017-04-26 | 杭州海康威视数字技术股份有限公司 | Intelligent searching method and system based on cloud storage management |
| CN107340971A (en) * | 2016-04-28 | 2017-11-10 | 上海优刻得信息科技有限公司 | A kind of data storage is with recovering framework and method |
| CN106230768A (en) * | 2016-06-16 | 2016-12-14 | 北京数智源科技股份有限公司 | Structuring system for managing video |
| CN107291889A (en) * | 2017-06-20 | 2017-10-24 | 郑州云海信息技术有限公司 | A kind of date storage method and system |
| CN108391085A (en) * | 2018-02-07 | 2018-08-10 | 深圳市亿联智能有限公司 | It is a kind of with high safety performance based on IP Camera cloud video recording system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110764706B (en) | Storage system, data management method, and storage medium | |
| KR101884725B1 (en) | Apparatus and method for transmitting live media content | |
| US20110307534A1 (en) | Distributed file system supporting data block dispatching and file processing method thereof | |
| CN103927265A (en) | Content hierarchical storage device, content acquisition method and content acquisition device | |
| US9055268B2 (en) | Multi-tier recorder to enable seek-back unique copy recording | |
| CN103744913A (en) | Database retrieval method based on search engine technology | |
| US10331738B2 (en) | Segmented video content storage | |
| CN102204266B (en) | Linear hint video streaming | |
| CN101477575A (en) | Multimedia information storing and playing method and apparatus | |
| CN101707633A (en) | Message-oriented middleware persistent message storing method based on file system | |
| US8214343B2 (en) | Purposing persistent data through hardware metadata tagging | |
| CN102497542A (en) | Video positioning playback system and method thereof | |
| CN102332284A (en) | Multimedia data processing method and processing system suitable for digital media broadcast | |
| CN111163297A (en) | Method for realizing high concurrency and quick playback of video monitoring cloud storage | |
| CN112188246B (en) | Video cloud storage method | |
| CN114189752A (en) | Video storage scheme based on object storage service | |
| CN101196916A (en) | Method and device for fragment storage file | |
| CN102195936A (en) | Method and system for storing multimedia file and method and system for reading multimedia file | |
| US8051090B2 (en) | File management method of a ring buffer and related file management apparatus | |
| US20220279235A1 (en) | Caching recorded content segments on playback | |
| WO2024021491A1 (en) | Data slicing method, apparatus and system | |
| CN109521954A (en) | A kind of distribution FTU fixed point file management method and device | |
| CN113407770A (en) | Cloud playback index service method and system based on redis | |
| CN109710782B (en) | Bayonet picture management optimization method | |
| KR20050022266A (en) | Content data recording apparatus and content data recording method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |