CN113742519A - Multi-object storage cloud video Timeline storage method and system - Google Patents

Multi-object storage cloud video Timeline storage method and system Download PDF

Info

Publication number
CN113742519A
CN113742519A CN202111014874.9A CN202111014874A CN113742519A CN 113742519 A CN113742519 A CN 113742519A CN 202111014874 A CN202111014874 A CN 202111014874A CN 113742519 A CN113742519 A CN 113742519A
Authority
CN
China
Prior art keywords
storage
raw file
object storage
key
raw
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111014874.9A
Other languages
Chinese (zh)
Inventor
周莹
方泽梁
陈帅斌
蒋泽飞
夏虹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Denghong Technology Co ltd
Original Assignee
Hangzhou Denghong Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Denghong Technology Co ltd filed Critical Hangzhou Denghong Technology Co ltd
Priority to CN202111014874.9A priority Critical patent/CN113742519A/en
Publication of CN113742519A publication Critical patent/CN113742519A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/71Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/14Details of searching files based on file metadata
    • G06F16/144Query formulation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/14Details of searching files based on file metadata
    • G06F16/148File search processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/172Caching, prefetching or hoarding of files
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73Querying
    • G06F16/732Query formulation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/231Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
    • H04N21/23103Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion using load balancing strategies, e.g. by placing or distributing content on different disks, different memories or different servers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/231Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
    • H04N21/23113Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion involving housekeeping operations for stored content, e.g. prioritizing content for deletion because of storage space restrictions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/231Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
    • H04N21/2312Data placement on disk arrays

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Mathematical Physics (AREA)
  • Library & Information Science (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a cloud video Timeline storage method and a cloud video Timeline storage system with multi-object storage, wherein the method comprises the following steps: acquiring an object storage, and calculating the quality score of the object storage; selecting an object storage with the optimal quality score as a target object storage; generating a raw file and a raw file key, and storing the raw file and the raw file key in a target object storage; and judging whether the current target object storage is changed or not, and if so, saving the object storage change record. According to the method and the system, raw file meta information can be coded into the object storage key during storage, so that the object storage key can realize a self-description function, a raw file list is matched through a raw file key rule during query, and the Timeline is reversely generated from the matched raw file list, so that a separately set Timeline index is not needed, and the storage cost and the operation and maintenance complexity are remarkably reduced.

Description

Multi-object storage cloud video Timeline storage method and system
Technical Field
The invention relates to the technical field of storage, in particular to a cloud video Timeline storage method and system for multi-object storage.
Background
With the development of cloud computing and cloud storage technologies, video data storage of the camera gradually turns to a cloud from local, and a cloud video platform provides a service for video cloud storage. With the rapid increase of the access of a cloud video platform to a camera, how to reliably store and efficiently retrieve video data becomes an urgent problem to be solved. Video data can be divided into raw files and time indices. The original video is generally divided into raw files by time (about one minute), and the raw files are stored in an object storage service provided by a cloud service provider through encoding, encryption and the like. the time index records the storage path, the starting time, the ending time and other meta information of the raw file, and the raw file of the target time can be quickly searched through the time index.
At present, the timeline index is generally stored in a MySQL traditional relational database in the industry, and horizontal database partitioning and table partitioning are performed to construct a MySQL cluster so as to meet the capacity expansion to a certain degree. However, this memory architecture has three drawbacks:
one is the introduction of additional storage costs. raw file storage is necessary, and the storage of the timeline index is additionally generated on the basis of the raw file, and the storage cost of the timeline index is high.
Secondly, the cluster load cannot be balanced dynamically. Once the rules of the cluster database partitioning and table partitioning are determined, the rules cannot be changed any more, so that the load difference between database instances in the cluster is large over time until a hot spot database is generated, the performance of the whole cluster is limited, and great negative influence is brought to the service quality of the platform.
And thirdly, deleting the overdue timeline index consumes excessive resources. Since conventional databases typically do not have an automatic expiration policy, a special service is required to periodically clean up expired timeline indexes. Clean-up services consume considerable service resources while competing with normal traffic for database resources.
Disclosure of Invention
One of the purposes of the present invention is to provide a method and a system for storing a cloud video Timeline stored in multiple objects, where in the method and the system, raw file meta information may be encoded into an object storage key during storage, so that the object storage key may implement a self-description function, and thus a raw file list is matched through a raw file key rule during query, and a Timeline is reversely generated from the matched raw file list, so that a Timeline index set separately is not needed, and storage cost and operation and maintenance complexity are significantly reduced.
Another object of the present invention is to provide a method and a system for storing a cloud video Timeline with multi-object storage, where the method and the system implement automatic cleaning of raw files by means of a life cycle of an object storage service, and do not need to deploy a cleaning service separately, so that service resources can be saved, and competition between the cleaning service and normal services for storage resources is avoided.
The invention also aims to provide a cloud video Timeline storage method and system for multi-object storage, wherein the method and system store a plurality of raw files into different objects, the cloud video of one camera can be stored into a plurality of object storages through the storage of the plurality of objects, the storage resources can be dynamically expanded through the combined query of the plurality of object storages, the factors such as the availability, the storage load, the regions, the network and the like of the object storage are comprehensively considered, the preferred storage is realized, and the flexibility and the reliability of the storage are improved.
In order to achieve at least one of the above objects, the present invention further provides a cloud video Timeline storage method for multi-object storage, including the following steps:
acquiring an object storage, and calculating the quality score of the object storage;
selecting an object storage with the optimal quality score as a target object storage;
generating a raw file and a raw file key, and storing the raw file and the raw file key in a target object storage;
and judging whether the current target object storage is changed or not, and if so, saving the object storage change record.
According to one preferred embodiment of the present invention, the method for generating raw file keys includes the following steps:
acquiring a unique identification of a camera, and acquiring a video starting timestamp and a video ending timestamp of a raw file;
converting the raw file video starting timestamp into time in a year, month and day format;
combining the unique camera identification, the start timestamp of the raw file video, the end timestamp of the raw file video and the time converted into the year, month and day format to generate a raw file key in a character string form;
and saving the generated raw file key.
According to another preferred embodiment of the invention, the generated raw file key is acquired, the expiration time of the raw file is set, and if the time exceeds the expiration time, the raw file in the target object storage is automatically cleaned.
According to another preferred embodiment of the present invention, if the currently used object storage is determined to be the same as the last time, if the currently used object storage is different from the last time, an object storage change record is generated, and the object storage change record is stored in the database.
According to another preferred embodiment of the present invention, the method includes a query phase, the query phase including: and acquiring change records of the camera, filtering according to a query time range preset by a user, and acquiring the change records in a target change range.
According to another preferred embodiment of the present invention, a key prefix is generated according to the raw file key generation rule, and the key prefix includes a character string in days and a character string in hours.
According to another preferred embodiment of the present invention, the query phase further comprises: calling an object storage service to acquire all raw files matched with the key prefixes; traversing all change records of the object storage service, calling all object storages in the change records, summarizing all raw files conforming to the query time range, generating a raw file list, analyzing the raw file list, reversely generating timeline,
according to another preferred embodiment of the present invention, the query phase further comprises: and acquiring the attribute dimension of object storage, and performing duplicate removal query according to the attribute dimension.
In order to achieve at least one of the above objects, the present invention further provides a cloud video Timeline storage system with multi-object storage, where the system executes the above cloud video Timeline storage method with multi-object storage.
The present invention further provides a computer-readable storage medium storing a computer program that can be executed by a processor to perform the above-mentioned cloud video Timeline storage method for multi-object storage.
Drawings
Fig. 1 is a schematic flow chart showing a cloud video Timeline storage method for multi-object storage according to the present invention.
Fig. 2 is a schematic flow chart showing a query phase in the cloud video Timeline storage method for multi-object storage according to the present invention.
Detailed Description
The following description is presented to disclose the invention so as to enable any person skilled in the art to practice the invention. The preferred embodiments in the following description are given by way of example only, and other obvious variations will occur to those skilled in the art. The basic principles of the invention, as defined in the following description, may be applied to other embodiments, variations, modifications, equivalents, and other technical solutions without departing from the spirit and scope of the invention.
It is understood that the terms "a" and "an" should be interpreted as meaning that a number of one element or element is one in one embodiment, while a number of other elements is one in another embodiment, and the terms "a" and "an" should not be interpreted as limiting the number.
Referring to fig. 1 and fig. 2, the present invention discloses a method and a system for storing a cloud video Timeline stored in multiple objects, where the method mainly includes the following steps: first, in the storage phase, since the video of each camera can be stored in the multi-object storage, the multi-object storage may be different types of object storage provided by different cloud service providers, or may be object storage in a plurality of different areas provided by the same cloud service provider. Through the combined query according to different dimensions, the query results stored by different objects are collected and then reversely generated to the timeline, so that the timeline service is not required to be set, the service maintenance cost is reduced, the object storage resources can be dynamically expanded, the object storage can be dynamically adjusted when a node fails, and the storage stability is improved.
Specifically, a raw file of the camera is obtained first, the raw file is a video storage file of the camera, and the raw file can be generated when the camera starts video shooting. Calling a storage service in a storage phase, wherein the storage service acquires attributes of a plurality of object storages, and determines an optimal object storage to store according to the attributes of the object storages, wherein the object storage attributes include, but are not limited to, availability, load, storage location, network condition, and the like, wherein the object storage attributes may be quantized to specific values, for example, the availability may be quantized to a ratio of the available storage quantity to the total object storage quantity, and the load may be quantized to: the storage positions can be local storage and different cloud storages, quantitative assignment is carried out according to the storage effect, and the network condition can calculate network delay amount to carry out quantitative assignment. Further, the quality score stored in the current object is calculated according to the attribute stored in the current object, wherein the value of the quality score may be weighted and summed according to the attribute stored in different objects, and the weight value stored in each different object may be configured according to requirements, which is not described in detail herein.
Executing a calling operation of related object storage by taking the mass fraction as a raw storage strategy of the camera, and when a raw file is generated at the head end of the camera, performing key assignment on the raw file, wherein the key assignment method comprises the following steps:
acquiring and generating a unique identifier of a camera corresponding to the raw file; acquiring a video starting timestamp and a video ending timestamp of a current raw file; converting the raw file video starting timestamp into a time character string taking days as a unit, converting the raw file video starting timestamp into a time character string taking hours as a unit, and further combining the character strings into a raw file key, wherein the form of the raw file key can be as follows:
raw_file/{deviceId}/{yyyyMMdd}/{HH}/{startTime}_{endTime};
wherein raw _ file represents a raw file, deviceId represents a unique identifier of a corresponding camera, yyyMMdd represents a time string in days, HH represents a time string in hours, startTime represents a raw file video start timestamp, and endTime represents a raw file video end timestamp. Wherein the brackets in the form of the raw file key are filled with corresponding string values. For example:
the camera deviceId is: ab28965dc491, the timestamp generated is: 1629343440000-1629343500000, the corresponding time strings are respectively: 2021-08-1911: 24: 00-2021-08-1911: 25:00, and the value of the raw file key may be:
raw_file/ab28965dc491/20210819/11/1629343440000_1629343500000。
and further storing the object with the optimal storage value of the raw file and the raw file key, setting the storage expiration time of the raw file and the raw file key, and if the storage time of the stored object is greater than the storage expiration time, automatically clearing the raw file and the raw file key, so that the regular clearing operation of timeline can be realized by means of a life cycle management strategy of object storage service, the clearing service does not need to be separately deployed, and the non-service storage resource competition is reduced. And if the raw file and the raw file key are called currently and last time, the change record of the object storage call is indicated.
It is worth mentioning that the storage method further comprises a query phase, wherein the query phase comprises:
calling query service of object storage, and acquiring storage change records of the camera;
performing a deduplication operation according to dimensions of an object store, the deduplication operation comprising: judging whether the inquired object storage is the same object storage according to the dimensions of the storage position, the change record and the like, and deleting the same object storage if the inquired object storage is the same object storage;
obtaining raw files in a specified time range required to be inquired by a user in inquiry service
Generating a key prefix for matching query according to a generation rule of the raw file key;
calling an object storage service to match all raw files according to the key prefix;
traversing all change records, calling object storage of all related raw files, and summarizing the raw files in the object storage according to the key prefixes to generate a raw file list;
analyzing the raw file list and reversely generating timeline;
the reverse generated timeline;
the form of the key prefix respectively comprises a query form taking day as a unit and a query form taking hour as a unit, and the query form taking day as a unit is as follows: raw _ file/{ deviceId }/{ yyymmdd }, the query form in hours is: raw _ file/{ deviceId }/{ yyymmdd }/{ HH }.
In particular, according to the embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication section, and/or installed from a removable medium. The computer program, when executed by a Central Processing Unit (CPU), performs the above-described functions defined in the method of the present application. It should be noted that the computer readable medium mentioned above in the present application may be a computer readable signal medium or a computer readable storage medium or any combination of the two. The computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wire segments, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present application, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In this application, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless section, wire section, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
It will be understood by those skilled in the art that the embodiments of the present invention described above and illustrated in the drawings are given by way of example only and not by way of limitation, the objects of the invention having been fully and effectively achieved, the functional and structural principles of the present invention having been shown and described in the embodiments, and that various changes or modifications may be made in the embodiments of the present invention without departing from such principles.

Claims (10)

1. A cloud video Timeline storage method for multi-object storage is characterized by comprising the following steps:
acquiring an object storage, and calculating the quality score of the object storage;
selecting an object storage with the optimal quality score as a target object storage;
acquiring a raw file, generating a raw file key, and storing the raw file and the raw file key in a target object storage;
and judging whether the current target object storage is changed or not, and if so, saving the object storage change record.
2. The method for storing the cloud video Timeline stored in the multi-object manner according to claim 1, wherein the method for generating the raw file key comprises the following steps:
acquiring a unique identification of a camera, and acquiring a video starting timestamp and a video ending timestamp of a raw file;
converting the raw file video starting timestamp into time in a year, month and day format;
combining the unique camera identification, the start timestamp of the raw file video, the end timestamp of the raw file video and the time converted into the year, month and day format to generate a raw file key in a character string form;
and saving the generated raw file key.
3. The method according to claim 1, wherein an expiration time of a raw file is set when the generated raw file key is acquired, and if the time exceeds the expiration time, the raw file in the target object storage is automatically cleaned.
4. The method of claim 1, wherein if it is determined whether the current object store is the same as the last object store, if not, generating an object store change record, and storing the object store change record in a database.
5. The method of claim 1, wherein the method comprises a query phase comprising: and acquiring change records of the camera, filtering according to a query time range preset by a user, and acquiring the change records in a target change range.
6. The method of claim 5, wherein a key prefix is generated according to the raw file key generation rule, and the key prefix comprises a string in days and a string in hours.
7. The method of claim 6, wherein the query phase further comprises: calling an object storage service to acquire all raw files matched with the key prefixes; and traversing all change records of the object storage service, calling all object storages in the change records, summarizing all raw files meeting the query time range, generating a raw file list, analyzing the raw file list, and reversely generating timeline.
8. The method for multi-object stored cloud video Timeline storage according to claim 5, wherein said query phase further comprises: and acquiring the attribute dimension of object storage, and performing duplicate removal query according to the attribute dimension.
9. A multi-object-storage cloud video Timeline storage system, wherein the system executes the multi-object-storage cloud video Timeline storage method according to any of claims 1 to 8.
10. A computer-readable storage medium storing a computer program executable by a processor to perform a multi-object stored cloud video Timeline storage method according to any of claims 1-8.
CN202111014874.9A 2021-08-31 2021-08-31 Multi-object storage cloud video Timeline storage method and system Pending CN113742519A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111014874.9A CN113742519A (en) 2021-08-31 2021-08-31 Multi-object storage cloud video Timeline storage method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111014874.9A CN113742519A (en) 2021-08-31 2021-08-31 Multi-object storage cloud video Timeline storage method and system

Publications (1)

Publication Number Publication Date
CN113742519A true CN113742519A (en) 2021-12-03

Family

ID=78734413

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111014874.9A Pending CN113742519A (en) 2021-08-31 2021-08-31 Multi-object storage cloud video Timeline storage method and system

Country Status (1)

Country Link
CN (1) CN113742519A (en)

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101510209A (en) * 2009-03-30 2009-08-19 北京金山软件有限公司 Method, system and server for implementing real time search
CN101540896A (en) * 2008-03-17 2009-09-23 中国移动通信集团公司 Method, device and system for testing video service quality
CN103634552A (en) * 2012-08-28 2014-03-12 华为技术有限公司 Monitoring video storage method, system and central management server
CN105282495A (en) * 2014-07-11 2016-01-27 联咏科技股份有限公司 Archive searching method and image processor
CN106326382A (en) * 2016-08-16 2017-01-11 广东中星电子有限公司 Video data storage and search method and device based on layered code stream
CN107562810A (en) * 2017-08-10 2018-01-09 北京时代云英科技有限公司 Video big data is classified storage method
CN108391179A (en) * 2018-04-26 2018-08-10 腾讯科技(深圳)有限公司 live data processing method, device, server, terminal and storage medium
CN110198432A (en) * 2018-10-30 2019-09-03 腾讯科技(深圳)有限公司 Processing method, device, computer-readable medium and the electronic equipment of video data
CN110213672A (en) * 2019-07-04 2019-09-06 腾讯科技(深圳)有限公司 Video generation, playback method, system, device, storage medium and equipment
CN111221478A (en) * 2020-01-13 2020-06-02 阿里巴巴集团控股有限公司 Data writing method, data reading method, data writing device, data reading device and machine-readable storage medium
CN112203115A (en) * 2020-10-10 2021-01-08 腾讯科技(深圳)有限公司 Video identification method and related device
CN112559799A (en) * 2019-09-10 2021-03-26 高新兴科技集团股份有限公司 Object cloud storage method and system
CN112988863A (en) * 2021-02-09 2021-06-18 苏州中科蓝迪软件技术有限公司 Elasticissearch-based efficient search engine method for heterogeneous multiple data sources

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101540896A (en) * 2008-03-17 2009-09-23 中国移动通信集团公司 Method, device and system for testing video service quality
CN101510209A (en) * 2009-03-30 2009-08-19 北京金山软件有限公司 Method, system and server for implementing real time search
CN103634552A (en) * 2012-08-28 2014-03-12 华为技术有限公司 Monitoring video storage method, system and central management server
CN105282495A (en) * 2014-07-11 2016-01-27 联咏科技股份有限公司 Archive searching method and image processor
CN106326382A (en) * 2016-08-16 2017-01-11 广东中星电子有限公司 Video data storage and search method and device based on layered code stream
CN107562810A (en) * 2017-08-10 2018-01-09 北京时代云英科技有限公司 Video big data is classified storage method
CN108391179A (en) * 2018-04-26 2018-08-10 腾讯科技(深圳)有限公司 live data processing method, device, server, terminal and storage medium
CN110198432A (en) * 2018-10-30 2019-09-03 腾讯科技(深圳)有限公司 Processing method, device, computer-readable medium and the electronic equipment of video data
CN110213672A (en) * 2019-07-04 2019-09-06 腾讯科技(深圳)有限公司 Video generation, playback method, system, device, storage medium and equipment
CN112559799A (en) * 2019-09-10 2021-03-26 高新兴科技集团股份有限公司 Object cloud storage method and system
CN111221478A (en) * 2020-01-13 2020-06-02 阿里巴巴集团控股有限公司 Data writing method, data reading method, data writing device, data reading device and machine-readable storage medium
CN112203115A (en) * 2020-10-10 2021-01-08 腾讯科技(深圳)有限公司 Video identification method and related device
CN112988863A (en) * 2021-02-09 2021-06-18 苏州中科蓝迪软件技术有限公司 Elasticissearch-based efficient search engine method for heterogeneous multiple data sources

Similar Documents

Publication Publication Date Title
US20200310686A1 (en) Concurrently performing normal system operations and garbage collection
US20210342264A1 (en) Scalable garbage collection for deduplicated storage
US8126997B2 (en) Hot data management method based on hit counter
US10872037B2 (en) Estimating worker nodes needed for performing garbage collection operations
CN108683692B (en) Service request processing method and device
US20160048430A1 (en) Method of operating a shared nothing cluster system
US20190384674A1 (en) Data processing apparatus and method
KR100946694B1 (en) System and Method for managing and detecting duplicate moving picture files based on video contents
CN112905638B (en) Horn-shaped time slice processing method
US20200310965A1 (en) Deleting data in storage systems that perform garbage collection
CN102193995B (en) Method and device for establishing multimedia data index and retrieval
CN106156209A (en) Data processing method and device
CN109918369B (en) Data storage method and device
CN108228432A (en) A kind of distributed link tracking, analysis method and server, global scheduler
CN108574718A (en) A kind of cloud host creation method and device
CN113742519A (en) Multi-object storage cloud video Timeline storage method and system
CN114817293B (en) Data query method and system based on distributed SQL
CN113055490B (en) Data storage method and device
KR100896335B1 (en) System and Method for managing and detecting duplicate movie files based on audio contents
US11392408B1 (en) System and method for assigning tasks to computer system elements
JP6097660B2 (en) Input data aggregation processing apparatus, system and method
CN111782588A (en) File reading method, device, equipment and medium
CN111563123A (en) Live warehouse metadata real-time synchronization method
US10248411B2 (en) Dynamic data ingestion
CN115904810B (en) Data replication disaster recovery method and disaster recovery system based on artificial intelligence

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20211203