CN111930993A - Monitoring video image management platform based on big data - Google Patents
Monitoring video image management platform based on big data Download PDFInfo
- Publication number
- CN111930993A CN111930993A CN202010671704.7A CN202010671704A CN111930993A CN 111930993 A CN111930993 A CN 111930993A CN 202010671704 A CN202010671704 A CN 202010671704A CN 111930993 A CN111930993 A CN 111930993A
- Authority
- CN
- China
- Prior art keywords
- module
- data storage
- storage unit
- data
- result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 48
- 238000013500 data storage Methods 0.000 claims abstract description 99
- 238000004458 analytical method Methods 0.000 claims abstract description 23
- 238000007726 management method Methods 0.000 claims abstract description 23
- 238000010801 machine learning Methods 0.000 claims abstract description 13
- 238000007405 data analysis Methods 0.000 claims abstract description 9
- 238000004364 calculation method Methods 0.000 claims description 18
- 238000003384 imaging method Methods 0.000 claims description 12
- 230000003993 interaction Effects 0.000 claims description 10
- 238000000034 method Methods 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000007418 data mining Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/71—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/73—Querying
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/73—Querying
- G06F16/732—Query formulation
- G06F16/7335—Graphical querying, e.g. query-by-region, query-by-sketch, query-by-trajectory, GUIs for designating a person/face/object as a query predicate
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Abstract
The invention provides a monitoring video image management platform based on big data, which comprises: the data acquisition module comprises a real-time monitoring data module and a user instruction data module; the data storage module comprises a monitoring data storage unit, a command data storage unit, a result data storage unit and a result coded data storage unit; the data analysis module comprises a machine learning module, an image matching analysis module, an image retrieval module and a relation index module. According to the method, the relevant comparison result video can be quickly matched and found and the video content can be accessed by inputting the characteristic picture which needs to be inquired by the user, self-matching training is obtained through the big data cloud platform, the searching speed is high, and the searching result is accurate; by the aid of video data coding information in the user result temporary storage module, result data can be accessed quickly in multiple channels, the situation that data in the real-time data module is monitored in a single access mode is avoided, and pressure of the data storage module is relieved.
Description
Technical Field
The invention relates to the technical field of video monitoring, in particular to a monitoring video image management platform based on big data.
Background
Video surveillance has become a major surveillance tool because it can provide rich, intuitive, and accurate information, and a large number of video surveillance systems have been established around the world. Video data has a very large volume, at least 24G of high-definition videos need to be collected by a single high-definition video monitoring device every day, a monitoring network is built, a large number of high-definition video monitors are needed, and the storage pressure of the data can be relieved only by expanding a large-scale integrated storage. With the advent of the cloud era, big data attracts more and more attention, and a monitoring video image management platform is built based on the big data and becomes a first choice for relieving storage pressure.
Chinese patent 201810693429.1 discloses a video monitoring system based on big data, which comprises a video intelligent analysis system, a knowledge database and a distributed cloud platform; the distributed cloud platform comprises a front end and a background, wherein the front end comprises a sensor and a preprocessing module, and the background comprises a network module and a data center. The invention solves the problems of large video volume, various data formats, low single file value and low processing speed in the existing video monitoring system; the effectiveness of data storage is improved, the storage management is optimized, and different requirements of end users are met; the resource integration is realized, and a uniform computing and storing environment is provided for complex data analysis and application such as data mining, semantic reasoning and the like. However, in the video monitoring system, the video query result is not organized and disclosed, and the video information is not encoded and transferred in a picture mode, so that the speed of acquiring the characteristic video after the user inputs the characteristic image is low.
Disclosure of Invention
In view of this, the invention provides a monitoring video image management platform based on big data, which solves the problem that in the prior art, the response speed of acquiring a feature video after a user inputs a feature image is slow.
To this end, in one aspect, the present invention provides a big data based surveillance video image management platform, which includes:
the data acquisition module comprises a real-time monitoring data module and a user instruction data module;
the data storage module comprises a monitoring data storage unit, a command data storage unit, a result data storage unit and a result coded data storage unit, wherein the monitoring data storage unit, the command data storage unit, the result data storage unit and the result coded data storage unit are sequentially connected;
the data analysis module comprises a machine learning module, an image matching analysis module, an image retrieval module and a relation index module, and the machine learning module, the image matching analysis module, the image retrieval module and the relation index module are sequentially connected;
the data calculation module comprises a video image coding marking unit and a video imaging calculation unit, and the video image coding marking unit is connected with the video imaging calculation unit;
the cloud platform comprises an index training database, a cloud service memory, a user result temporary storage module and a human-computer interaction interface, wherein the index training database, the cloud service memory, the user result temporary storage module and the human-computer interaction interface are sequentially connected.
Furthermore, the monitoring real-time data module is connected with the monitoring data storage unit, and the user instruction data module is connected with the command data storage unit.
Furthermore, the image matching analysis module is respectively connected with the monitoring data storage unit and the command data storage unit, and the image retrieval module is respectively connected with the monitoring data storage unit and the command data storage unit.
Furthermore, the video image coding and marking unit is respectively connected with the image matching analysis module, the image retrieval module and the relation index module, and the video imaging calculation unit is respectively connected with the image matching analysis module, the image retrieval module and the relation index module.
Furthermore, the image matching analysis module is respectively connected with the result data storage unit and the result coded data storage unit, and the image retrieval module is respectively connected with the result data storage unit and the result coded data storage unit.
Further, the cloud service storage is connected with the monitoring data storage unit.
Furthermore, the user result temporary storage module is respectively connected with the result data storage unit and the result coded data storage unit.
Further, the machine learning module is connected with an index training database.
In the monitoring video image management platform based on big data, the index training database provided by the cloud platform is adopted, so that the machine learning module in the data analysis module continuously completes self-training of image matching; the data of the real-time data analyzing and monitoring module is called and analyzed to be compared with the data in the user instruction data module through the image matching analysis module and the image retrieval module, and the comparison result is fed back in the form of video data and coded data through the calculation of the video image coding and marking unit and the video imaging calculation unit and is stored in the result data storage unit and the result coded data storage unit; the relation index module generates target video data storage position coding information, the result data storage unit calls and stores the target video from the monitoring data storage unit, the result coding data storage unit stores and transmits the coding information generated by the index module to the user result temporary storage module, and a user can access a human-computer interaction interface in the cloud platform to obtain a retrieval result; the monitoring data storage unit synchronizes the stored data into the cloud service storage in sequence.
Therefore, compared with the prior art, the invention has the following beneficial effects:
1) the video with the related comparison result can be quickly matched and found and the video content can be accessed by inputting the feature picture which needs to be inquired by the user, self-matching training is obtained through the big data cloud platform, the searching speed is high, and the searching result is accurate;
2) by the aid of the video data coding information in the user result temporary storage module, video data in the result data storage unit can be directionally and quickly accessed, video data in the cloud service storage can be accessed, and even data in the monitoring real-time data module can be accessed, so that the result data can be quickly accessed in multiple channels, the situation that data in the monitoring real-time data module is accessed singly is avoided, and pressure of the data storage module is relieved.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 is an overall block diagram of a big data-based surveillance video image management platform according to an embodiment of the present invention;
fig. 2 is a block diagram of a data analysis module in a big data-based surveillance video image management platform according to an embodiment of the present invention;
fig. 3 is a block diagram of a data storage module in a big data-based surveillance video image management platform according to an embodiment of the present invention;
fig. 4 is a block diagram of a cloud platform in a monitoring video image management platform based on big data according to an embodiment of the present invention.
Wherein, 1-a data acquisition module; 11-monitoring real-time data module; 12-a user instruction data module; 2-a data storage module; 21-a monitoring data storage unit; 22-command data storage unit; 23-a result data storage unit; 24-a result encoded data storage unit; 3-a data analysis module; 31-a machine learning module; 32-an image matching analysis module; 33-an image retrieval module; 34-a relationship indexing module; 4-a data calculation module; 41-video image coding marking unit; 42-a video imaging calculation unit; 5-a cloud platform; 51-index training database; 52-cloud services storage; 53-user result temporary storage module; 54-human-computer interaction interface.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
The first embodiment is as follows:
referring to fig. 1 to 4, the present embodiment provides a monitoring video image management platform based on big data, wherein, first,:
the data acquisition module 1 comprises a monitoring real-time data module 11 and a user instruction data module 12;
the data storage module 2 comprises a monitoring data storage unit 21, a command data storage unit 22, a result data storage unit 23 and a result coded data storage unit 24, wherein the monitoring data storage unit 21, the command data storage unit 22, the result data storage unit 23 and the result coded data storage unit 24 are sequentially connected;
the data analysis module 3 comprises a machine learning module 31, an image matching analysis module 32, an image retrieval module 33 and a relation index module 34, wherein the machine learning module 31, the image matching analysis module 32, the image retrieval module 33 and the relation index module 34 are sequentially connected;
the data calculation module 4 comprises a video image coding marking unit 41 and a video imaging calculation unit 42, wherein the video image coding marking unit 41 is connected with the video imaging calculation unit 42;
the cloud platform 5 comprises an index training database 51, a cloud service memory 52, a user result temporary storage module 53 and a human-computer interaction interface 54, wherein the index training database 51, the cloud service memory 52, the user result temporary storage module 53 and the human-computer interaction interface 54 are sequentially connected.
Referring to fig. 1 to 4, specifically, the monitoring real-time data module 11 is connected to the monitoring data storage unit 21, the user instruction data module 12 is connected to the command data storage unit 22, the image matching analysis module 32 is connected to the monitoring data storage unit 21 and the command data storage unit 22, the image retrieval module 33 is connected to the monitoring data storage unit 21 and the command data storage unit 22, the video image coding and marking unit 41 is connected to the image matching analysis module 32, the image retrieval module 33 and the relationship indexing module 34, and the video imaging calculation unit 42 is connected to the image matching analysis module 32, the image retrieval module 33 and the relationship indexing module 34.
In the big data-based surveillance video image management platform provided by the embodiment, the index training database provided by the cloud platform is adopted, so that the machine learning module in the data analysis module continuously completes self-training of image matching; the data of the real-time data analyzing and monitoring module is called and analyzed to be compared with the data in the user instruction data module through the image matching analysis module and the image retrieval module, and the comparison result is fed back in the form of video data and coded data through the calculation of the video image coding and marking unit and the video imaging calculation unit and is stored in the result data storage unit and the result coded data storage unit; the relation index module generates target video data storage position coding information, the result data storage unit calls and stores the target video from the monitoring data storage unit, the result coding data storage unit stores and transmits the coding information generated by the index module to the user result temporary storage module, and a user can access a human-computer interaction interface in the cloud platform to obtain a retrieval result; the monitoring data storage unit synchronizes the stored data into the cloud service storage in sequence.
Therefore, compared with the prior art, the invention has the following beneficial effects:
1) the video with the related comparison result can be quickly matched and found and the video content can be accessed by inputting the feature picture which needs to be inquired by the user, self-matching training is obtained through the big data cloud platform, the searching speed is high, and the searching result is accurate;
2) by the aid of the video data coding information in the user result temporary storage module, video data in the result data storage unit can be directionally and quickly accessed, video data in the cloud service storage can be accessed, and even data in the monitoring real-time data module can be accessed, so that the result data can be quickly accessed in multiple channels, the situation that data in the monitoring real-time data module is accessed singly is avoided, and pressure of the data storage module is relieved.
Example two:
referring to fig. 1 to fig. 4, a monitoring video image management platform based on big data according to a second embodiment of the present invention is shown in the drawings, and the present embodiment further makes the following technical solutions as improvements on the basis of the above embodiments: the image matching analysis module 32 is respectively connected with the result data storage unit 23 and the result coded data storage unit 24, the image retrieval module 33 is respectively connected with the result data storage unit 23 and the result coded data storage unit 24, the cloud service memory 52 is connected with the monitoring data storage unit 21, the user result temporary storage module 53 is respectively connected with the result data storage unit 23 and the result coded data storage unit 24, and the machine learning module 31 is connected with the index training database 51. By uploading the video data and the target video data storage location coding information to the cloud platform 5 at the same time, the user can send an instruction through the human-computer interaction interface 54 to directly access the video in the cloud service storage 52 according to the target video data storage location coding information in the user result temporary storage module 53.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (8)
1. A big data-based surveillance video image management platform is characterized by comprising:
the data acquisition module (1) comprises a monitoring real-time data module (11) and a user instruction data module (12);
the data storage module (2) comprises a monitoring data storage unit (21), a command data storage unit (22), a result data storage unit (23) and a result coded data storage unit (24), wherein the monitoring data storage unit (21), the command data storage unit (22), the result data storage unit (23) and the result coded data storage unit (24) are sequentially connected;
the data analysis module (3) comprises a machine learning module (31), an image matching analysis module (32), an image retrieval module (33) and a relation index module (34), wherein the machine learning module (31), the image matching analysis module (32), the image retrieval module (33) and the relation index module (34) are sequentially connected;
the data calculation module (4) comprises a video image coding marking unit (41) and a video imaging calculation unit (42), wherein the video image coding marking unit (41) is connected with the video imaging calculation unit (42);
the cloud platform (5) comprises an index training database (51), a cloud service memory (52), a user result temporary storage module (53) and a human-computer interaction interface (54), wherein the index training database (51), the cloud service memory (52), the user result temporary storage module (53) and the human-computer interaction interface (54) are sequentially connected.
2. A big data based surveillance video image management platform according to claim 1, wherein the surveillance real-time data module (11) is connected to the surveillance data storage unit (21), and the user instruction data module (12) is connected to the command data storage unit (22).
3. A big data based surveillance video image management platform according to claim 1, wherein the image matching analysis module (32) is connected to the surveillance data storage unit (21) and the command data storage unit (22), respectively, and the image retrieval module (33) is connected to the surveillance data storage unit (21) and the command data storage unit (22), respectively.
4. A big data based surveillance video image management platform according to claim 1, wherein the video image coding and marking unit (41) is connected to the image matching analysis module (32), the image retrieval module (33) and the relationship index module (34), respectively, and the video imaging calculation unit (42) is connected to the image matching analysis module (32), the image retrieval module (33) and the relationship index module (34), respectively.
5. The big data based surveillance video image management platform according to claim 1, wherein the image matching analysis module (32) is connected to the result data storage unit (23) and the result coded data storage unit (24), respectively, and the image retrieval module (33) is connected to the result data storage unit (23) and the result coded data storage unit (24), respectively.
6. A big data based surveillance video image management platform according to claim 1, wherein the cloud service storage (52) is connected to the surveillance data storage unit (21).
7. The big data based surveillance video image management platform according to claim 1, wherein the user result temporary storage module (53) is connected to the result data storage unit (23) and the result coded data storage unit (24), respectively.
8. A big data based surveillance video image management platform according to claim 1, characterized in that the machine learning module (31) is connected to the index training database (51).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010671704.7A CN111930993A (en) | 2020-07-13 | 2020-07-13 | Monitoring video image management platform based on big data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010671704.7A CN111930993A (en) | 2020-07-13 | 2020-07-13 | Monitoring video image management platform based on big data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111930993A true CN111930993A (en) | 2020-11-13 |
Family
ID=73313556
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010671704.7A Pending CN111930993A (en) | 2020-07-13 | 2020-07-13 | Monitoring video image management platform based on big data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111930993A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114263488A (en) * | 2021-12-24 | 2022-04-01 | 四川省交通勘察设计研究院有限公司 | Highway tunnel ventilation control method and system based on external environment self-learning |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104252539A (en) * | 2014-09-24 | 2014-12-31 | 深圳市傲天智能系统有限公司 | Intelligent video analysis and management method and system based on search engine |
| WO2017080169A1 (en) * | 2015-11-13 | 2017-05-18 | 乐视控股（北京）有限公司 | Video platform monitoring and analysis system |
| CN110661999A (en) * | 2018-06-29 | 2020-01-07 | 江苏三棱智慧物联发展股份有限公司 | Video monitoring system based on big data |
-
2020
- 2020-07-13 CN CN202010671704.7A patent/CN111930993A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104252539A (en) * | 2014-09-24 | 2014-12-31 | 深圳市傲天智能系统有限公司 | Intelligent video analysis and management method and system based on search engine |
| WO2017080169A1 (en) * | 2015-11-13 | 2017-05-18 | 乐视控股（北京）有限公司 | Video platform monitoring and analysis system |
| CN110661999A (en) * | 2018-06-29 | 2020-01-07 | 江苏三棱智慧物联发展股份有限公司 | Video monitoring system based on big data |
Non-Patent Citations (1)
| Title |
|---|
| 靳明;单飞;蒋雨波;: "基于大数据的公路监控智能视频分析系统的构建", 电子设计工程, no. 04 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114263488A (en) * | 2021-12-24 | 2022-04-01 | 四川省交通勘察设计研究院有限公司 | Highway tunnel ventilation control method and system based on external environment self-learning |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3830714B1 (en) | Systems and methods for generating metadata describing unstructured data objects at the storage edge | |
| US11899681B2 (en) | Knowledge graph building method, electronic apparatus and non-transitory computer readable storage medium | |
| CN102880854B (en) | Distributed processing and Hash mapping-based outdoor massive object identification method and system | |
| US20020183984A1 (en) | Modular intelligent multimedia analysis system | |
| US11429664B1 (en) | Hyperzoom attribute analytics on the edge | |
| US11900688B2 (en) | People and vehicle analytics on the edge | |
| CN111427911A (en) | Data query method and device, computer equipment and storage medium | |
| CN114943287A (en) | Computer big data acquisition and processing system, method, equipment and medium | |
| Alam et al. | Intellibvr-intelligent large-scale video retrieval for objects and events utilizing distributed deep-learning and semantic approaches | |
| CN111930993A (en) | Monitoring video image management platform based on big data | |
| CN114461853A (en) | Training sample generation method, device and equipment of video scene classification model | |
| CN112115281A (en) | Data retrieval method, device and storage medium | |
| US10943172B1 (en) | Real-time predictive knowledge pattern machine | |
| CN111581420B (en) | Flink-based medical image real-time retrieval method | |
| Morin | Intensive use of correspondence analysis for information retrieval | |
| CN115687701A (en) | Text processing method | |
| CN113886631A (en) | Video archive generation method and device and storage medium | |
| CN114329049A (en) | Video search method and device, computer equipment and storage medium | |
| CN114723454A (en) | Identity recognition method and device, electronic equipment and readable storage medium | |
| KR101643979B1 (en) | Method For Augmenting Video Content | |
| KR102590388B1 (en) | Apparatus and method for video content recommendation | |
| Huang et al. | Video Recommendation Method Based on Deep Learning of Group Evaluation Behavior Sequences | |
| CN111506754B (en) | Picture retrieval method, device, storage medium and processor | |
| CN113703986B (en) | Information management system and method based on big data | |
| US10585934B2 (en) | Method and system for populating a concept database with respect to user identifiers |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |