CN117097868A - Video analysis processing system based on distributed data - Google Patents

Video analysis processing system based on distributed data Download PDF

Info

Publication number
CN117097868A
CN117097868A CN202311108568.0A CN202311108568A CN117097868A CN 117097868 A CN117097868 A CN 117097868A CN 202311108568 A CN202311108568 A CN 202311108568A CN 117097868 A CN117097868 A CN 117097868A
Authority
CN
China
Prior art keywords
video
distributed
subsystem
data
management unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311108568.0A
Other languages
Chinese (zh)
Inventor
周云飞
张洪岭
邹翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhongchuang Huayuan Technology Co ltd
Original Assignee
Zhongchuang Huayuan Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhongchuang Huayuan Technology Co ltd filed Critical Zhongchuang Huayuan Technology Co ltd
Priority to CN202311108568.0A priority Critical patent/CN117097868A/en
Publication of CN117097868A publication Critical patent/CN117097868A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
    • H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
    • H04L63/0442—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload wherein the sending and receiving network entities apply asymmetric encryption, i.e. different keys for encryption and decryption
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/08—Key distribution or management, e.g. generation, sharing or updating, of cryptographic keys or passwords
    • H04L9/0891—Revocation or update of secret information, e.g. encryption key update or rekeying
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40—Network security protocols

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Computer Hardware Design (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a video analysis processing system based on distributed data in the technical field of video analysis processing, which comprises a distributed video file subsystem, a resource management unit, a distributed video subscription subsystem, a management configuration unit, a system service management unit, an internal authority management unit and a user data management unit; distributed video file subsystem: an interactive interface for providing unstructured data; resource management unit: for providing uniform resource management and scheduling services; distributed video subscription subsystem: the system is used for transferring messages, and the modules transfer messages and data through a distributed video subscription subsystem; management configuration unit: the method comprises the steps of performing parameter configuration on current information, data and network connection; the video analysis processing system based on the distributed data can avoid the reduction of the error rate of manual searching, improve the searching efficiency, avoid the leakage of user data and improve the safety of user authority management.

Description

Video analysis processing system based on distributed data
Technical Field
The invention relates to the technical field of video analysis processing, in particular to a video analysis processing system based on distributed data.
Background
Video data is unstructured data, and is faced with great challenges in the aspects of storage, content processing and the like of massive video data, and with the rapid increase of the video data volume, a series of real problems are brought to video monitoring.
The existing network has the disadvantages of tense bandwidth, huge storage space, multiplied requirements on performance, high investment and maintenance cost, expanded upgrading pressure of a system and the like, the traditional centralized video processing capability and data processing capability are insufficient, the storage capability and the processing capability are not expandable, in practical application, a certain interest target or interest event is usually required to be searched from massive offline video files, the manual searching efficiency is low, errors are easy to occur, user permission data are easy to intercept and cause user permission leakage due to server management and distribution, and the safety problem of user permission management exists.
Disclosure of Invention
The invention aims to provide a video analysis processing system based on distributed data, which aims to solve the problems that in the background technology, in actual application, a certain interest target or interest event is usually required to be searched from a large amount of offline video files, the manual searching efficiency is low, errors are easy to occur, user permission data is easy to intercept and cause user permission leakage due to the fact that the user permission data is managed and distributed through a server, and the safety problem of user permission management exists.
In order to achieve the above purpose, the present invention provides the following technical solutions: the video analysis processing system based on the distributed data comprises a distributed video file subsystem, a resource management unit, a distributed video subscription subsystem, a management configuration unit, a system service management unit, an internal authority management unit and a user data management unit;
distributed video file subsystem: an interactive interface for providing unstructured data;
resource management unit: for providing uniform resource management and scheduling services;
distributed video subscription subsystem: the system is used for transferring messages, and the modules transfer messages and data through a distributed video subscription subsystem;
management configuration unit: the method comprises the steps of performing parameter configuration on current information, data and network connection;
system service management unit: the service framework and the service classification of the whole system of the distributed video file subsystem are managed;
an internal right management unit: the system comprises a distributed video subscription subsystem, a user management subsystem and a user management subsystem, wherein the distributed video subscription subsystem is used for managing the authority of the user set by the distributed video subscription subsystem;
user data management unit: for managing and cryptographically storing user data for a distributed video file subsystem.
Preferably, the distributed file sub-system realizes file synchronization on the Internet through cloud computing, a user can store and share files and folders, supports automatic synchronization in various operations of a plurality of computers, can be used as a large-capacity network hard disk, and is connected with a node (which can be simply understood as a computer) through a computer network; or a complete hierarchical file system formed by combining a plurality of different logical disk partitions or labels.
Preferably, a certain file system fixed at a certain place is extended to any of a plurality of places/a plurality of file systems, and a plurality of nodes form a file system network, each node can be distributed at different places, and communication and data transmission among the nodes are performed through the network.
Preferably, the resource management unit acquires the video stream shot by the monitoring camera, converts the video stream into a video frame sequence, stores the video frame sequence, the video encoding node periodically sends a key update instruction to the video decoding node receiving the video stream, the video encoding node generates a public key according to the sequence numbers corresponding to the video decoding node receiving the video stream and the key update instruction, encrypts the encoded video stream by using the public key, and sends the encrypted video stream and the public key to the video decoding node after encryption.
Preferably, the distributed video file subsystem stores the pedestrian track and the corresponding picture intercepted from the video data through the data interaction interface.
Preferably, the service backup method includes the steps of obtaining the condition that all nodes in the distributed video file subsystem provide services, finding out that a plurality of nodes with higher priority level will perform service backup on all nodes providing service processing, and taking over the service when the service backup node detects that the service effective value of the nodes providing service processing is reduced to exceed a set threshold or is out of connection.
Preferably, one or more video frame sequence segments are obtained, one or more of the video frame sequence segments are processed in parallel, the processing results of each video frame sequence segment are combined according to the repeated areas of two adjacent video frame sequence segments, and the combined intermediate processing results are stored in the form of video frame sequences.
Preferably, when the user is operating, the authority of the current user is arbitrated by calling the internal authority management unit, the internal authority management unit queries the authority of the current user stored in all nodes through the blockchain contract to determine the validity of the authority, and if the validity is greater than the set authority threshold, the current user operates with the authority.
Compared with the prior art, the invention has the beneficial effects that:
1. according to the video analysis processing system based on the distributed data, file synchronization on the Internet is achieved through cloud computing, a user can store and share files and folders, a certain file system fixed at a certain place is expanded to any place/multiple file systems, a plurality of nodes form a file system network, each node can be distributed at different places, communication and data transmission among the nodes are conducted through the network, accordingly, the reduction of manual searching error rate can be avoided, and meanwhile searching efficiency is improved.
2. According to the video analysis processing system based on the distributed data, the video stream shot by the monitoring camera is acquired, the video stream is converted into the video frame sequence, the video frame sequence is stored, the video encoding node regularly sends a key updating instruction to the video decoding node receiving the video stream, the video encoding node generates a public key according to the sequence numbers corresponding to the video decoding node receiving the video stream and the key updating instruction, the public key is used for encrypting the encoded video stream, the encrypted video stream and the public key are sent to the video decoding node after encryption, and the data interaction interface stores pedestrian tracks and corresponding pictures intercepted from the video data, so that user data leakage can be avoided, and the safety of user authority management is improved.
Drawings
Fig. 1 is a schematic structural diagram of a video parsing processing system based on distributed data according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Embodiment one:
referring to fig. 1, the present invention provides the following technical solutions: the video analysis processing system based on the distributed data comprises a distributed video file subsystem, a resource management unit, a distributed video subscription subsystem, a management configuration unit, a system service management unit, an internal authority management unit and a user data management unit;
distributed video file subsystem: an interactive interface for providing unstructured data;
resource management unit: for providing uniform resource management and scheduling services;
distributed video subscription subsystem: the system is used for transferring messages, and the modules transfer messages and data through a distributed video subscription subsystem;
management configuration unit: the method comprises the steps of performing parameter configuration on current information, data and network connection;
system service management unit: the service framework and the service classification of the whole system of the distributed video file subsystem are managed;
an internal right management unit: the system comprises a distributed video subscription subsystem, a user management subsystem and a user management subsystem, wherein the distributed video subscription subsystem is used for managing the authority of the user set by the distributed video subscription subsystem;
user data management unit: for managing and cryptographically storing user data for a distributed video file subsystem.
The distributed file sub-system realizes file synchronization on the Internet through cloud computing, a user can store and share files and folders, supports automatic synchronization in various operations of a plurality of computers, can be used as a large-capacity network hard disk, and is connected with nodes (which can be simply understood as a computer) through a computer network; or a complete hierarchical file system formed by combining a plurality of different logical disk partitions or labels.
A certain file system fixed at a certain place is expanded to any of a plurality of places/a plurality of file systems, a plurality of nodes form a file system network, each node can be distributed at different places, and communication and data transmission among the nodes are carried out through the network.
Through cloud computing, file synchronization on the Internet is realized, a user can store and share files and folders, a certain file system fixed at a certain place is expanded to any multiple places/multiple file systems, a plurality of nodes form a file system network, each node can be distributed at different places, communication and data transmission among the nodes are carried out through the network, so that the reduction of the error rate of manual searching can be avoided, and meanwhile, the searching efficiency is also improved.
Embodiment two:
referring to fig. 1, the present invention provides the following technical solutions: the video analysis processing system based on the distributed data comprises a distributed video file subsystem, a resource management unit, a distributed video subscription subsystem, a management configuration unit, a system service management unit, an internal authority management unit and a user data management unit;
distributed video file subsystem: an interactive interface for providing unstructured data;
resource management unit: for providing uniform resource management and scheduling services;
distributed video subscription subsystem: the system is used for transferring messages, and the modules transfer messages and data through a distributed video subscription subsystem;
management configuration unit: the method comprises the steps of performing parameter configuration on current information, data and network connection;
system service management unit: the service framework and the service classification of the whole system of the distributed video file subsystem are managed;
an internal right management unit: the system comprises a distributed video subscription subsystem, a user management subsystem and a user management subsystem, wherein the distributed video subscription subsystem is used for managing the authority of the user set by the distributed video subscription subsystem;
user data management unit: for managing and cryptographically storing user data for a distributed video file subsystem.
The distributed file sub-system realizes file synchronization on the Internet through cloud computing, a user can store and share files and folders, supports automatic synchronization in various operations of a plurality of computers, can be used as a large-capacity network hard disk, and is connected with nodes (which can be simply understood as a computer) through a computer network; or a complete hierarchical file system formed by combining a plurality of different logical disk partitions or labels.
A certain file system fixed at a certain place is expanded to any of a plurality of places/a plurality of file systems, a plurality of nodes form a file system network, each node can be distributed at different places, and communication and data transmission among the nodes are carried out through the network.
The resource management unit acquires the video stream shot by the monitoring camera, converts the video stream into a video frame sequence, stores the video frame sequence, the video encoding node periodically sends a key updating instruction to the video decoding node receiving the video stream, the video encoding node generates a public key according to the video decoding node receiving the video stream and a serial number corresponding to the key updating instruction, encrypts the encoded video stream by using the public key, and sends the encrypted video stream and the public key to the video decoding node after encryption.
And the distributed video file subsystem stores the pedestrian track and the corresponding picture intercepted from the video data through the data interaction interface.
And acquiring the condition that all nodes in the distributed video file subsystem provide service, finding out that all nodes providing service processing in the nodes with higher priority perform service backup, and taking over the service when the service backup node detects that the service effective value of the nodes providing service processing is reduced by more than a set threshold or is out of connection.
And obtaining one or more video frame sequence segments, carrying out parallel processing on one or more video frame sequence segments, merging processing results of each video frame sequence segment according to repeated areas of two adjacent video frame sequence segments, and storing the merged intermediate processing results in a video frame sequence mode.
When a user operates, the authority of the current user is arbitrated by calling the internal authority management unit, the internal authority management unit inquires the authorities of the current user stored in all nodes through the blockchain contract to determine the validity of the authorities, and if the validity is larger than a set authority threshold, the current user operates with the authorities.
The video encoding node periodically sends a key updating instruction to a video decoding node receiving the video stream, the video encoding node generates a public key according to the sequence numbers corresponding to the video decoding node receiving the video stream and the key updating instruction, encrypts the encoded video stream by the public key, sends the encrypted video stream and the public key to the video decoding node after encryption, and stores the pedestrian track and the corresponding picture intercepted from the video data by the data interaction interface, thereby avoiding user data leakage and improving the safety of user authority management.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
Although the invention has been described hereinabove with reference to embodiments, various modifications thereof may be made and equivalents may be substituted for elements thereof without departing from the scope of the invention. In particular, the features of the disclosed embodiments may be combined with each other in any manner so long as there is no structural conflict, and the exhaustive description of these combinations is not given in this specification merely for the sake of brevity and resource saving. Therefore, it is intended that the invention not be limited to the particular embodiment disclosed, but that the invention will include all embodiments falling within the scope of the appended claims.

Claims (8)

1. The video analysis processing system based on the distributed data is characterized in that: the system comprises a distributed video file subsystem, a resource management unit, a distributed video subscription subsystem, a management configuration unit, a system service management unit, an internal authority management unit and a user data management unit;
distributed video file subsystem: an interactive interface for providing unstructured data;
resource management unit: for providing uniform resource management and scheduling services;
distributed video subscription subsystem: the system is used for transferring messages, and the modules transfer messages and data through a distributed video subscription subsystem;
management configuration unit: the method comprises the steps of performing parameter configuration on current information, data and network connection;
system service management unit: the service framework and the service classification of the whole system of the distributed video file subsystem are managed;
an internal right management unit: the system comprises a distributed video subscription subsystem, a user management subsystem and a user management subsystem, wherein the distributed video subscription subsystem is used for managing the authority of the user set by the distributed video subscription subsystem;
user data management unit: for managing and cryptographically storing user data for a distributed video file subsystem.
2. The distributed data based video analytics processing system of claim 1, wherein: the distributed file sub-system realizes file synchronization on the Internet through cloud computing, a user can store and share files and folders, supports automatic synchronization in various operations of a plurality of computers, can be used as a large-capacity network hard disk, and is connected with nodes (which can be simply understood as a computer) through a computer network; or a complete hierarchical file system formed by combining a plurality of different logical disk partitions or labels.
3. The distributed data based video analytics processing system of claim 1, wherein: a certain file system fixed at a certain place is expanded to any of a plurality of places/a plurality of file systems, a plurality of nodes form a file system network, each node can be distributed at different places, and communication and data transmission among the nodes are carried out through the network.
4. The distributed data based video analytics processing system of claim 1, wherein: the resource management unit acquires the video stream shot by the monitoring camera, converts the video stream into a video frame sequence, stores the video frame sequence, the video encoding node periodically sends a key updating instruction to the video decoding node receiving the video stream, the video encoding node generates a public key according to the video decoding node receiving the video stream and a serial number corresponding to the key updating instruction, encrypts the encoded video stream by using the public key, and sends the encrypted video stream and the public key to the video decoding node after encryption.
5. The distributed data based video analytics processing system of claim 1, wherein: and the distributed video file subsystem stores the pedestrian track and the corresponding picture intercepted from the video data through the data interaction interface.
6. The distributed data based video analytics processing system of claim 1, wherein: and acquiring the condition that all nodes in the distributed video file subsystem provide service, finding out that all nodes providing service processing in the nodes with higher priority perform service backup, and taking over the service when the service backup node detects that the service effective value of the nodes providing service processing is reduced by more than a set threshold or is out of connection.
7. The distributed data based video analytics processing system of claim 1, wherein: and obtaining one or more video frame sequence segments, carrying out parallel processing on one or more video frame sequence segments, merging processing results of each video frame sequence segment according to repeated areas of two adjacent video frame sequence segments, and storing the merged intermediate processing results in a video frame sequence mode.
8. The distributed data based video analytics processing system of claim 1, wherein: when a user operates, the authority of the current user is arbitrated by calling the internal authority management unit, the internal authority management unit inquires the authorities of the current user stored in all nodes through the blockchain contract to determine the validity of the authorities, and if the validity is larger than a set authority threshold, the current user operates with the authorities.
CN202311108568.0A 2023-08-31 2023-08-31 Video analysis processing system based on distributed data Pending CN117097868A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311108568.0A CN117097868A (en) 2023-08-31 2023-08-31 Video analysis processing system based on distributed data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311108568.0A CN117097868A (en) 2023-08-31 2023-08-31 Video analysis processing system based on distributed data

Publications (1)

Publication Number Publication Date
CN117097868A true CN117097868A (en) 2023-11-21

Family

ID=88777069

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311108568.0A Pending CN117097868A (en) 2023-08-31 2023-08-31 Video analysis processing system based on distributed data

Country Status (1)

Country Link
CN (1) CN117097868A (en)

Similar Documents

Publication Publication Date Title
CN109254733B (en) Method, device and system for storing data
CN113986873B (en) Method for processing, storing and sharing data modeling of mass Internet of things
EP3285186B1 (en) Methods and procedures for timestamp-based indexing of items in real-time storage
US20180189315A1 (en) Method and device for calling a distributed file system
CN103440244A (en) Large-data storage and optimization method
CN103902410A (en) Data backup acceleration method for cloud storage system
CN104184812A (en) Multi-point data transmission method based on private cloud
CN111177159B (en) Data processing system and method and data updating equipment
CN110109874A (en) A kind of non-stop layer distributed document retrieval method based on block chain
CN107040576A (en) Information-pushing method and device, communication system
CN110413571A (en) Based on the extensive remote sensing image data distributed storage method of MongoDB
CN114374701B (en) Transparent sharing device for sample model of multistage linkage artificial intelligent platform
CN109474458B (en) Method for accessing regional medical information platform to local medical information system
CN112073212B (en) Parameter configuration method, device, terminal equipment and storage medium
CN105610823A (en) Stream media processing method and processing system architecture based on task vectors
CN117097868A (en) Video analysis processing system based on distributed data
Swagatika et al. Cloud-based backup and data recovery
CN116186099A (en) Data query method, device, electronic equipment and storage medium
CN116016561A (en) Data synchronization method and device
KR102202645B1 (en) Data Sharing Method for Relational Edge Servers
CN113609091B (en) Log management method, device, equipment and storage medium
US20220035872A1 (en) Direct cloud storage intake and upload architecture
Nirmalan et al. An intelligent surveillance video analytics framework using NACT-Hadoop/MapReduce on cloud services
CN116107801A (en) Transaction processing method and related product
CN110032548B (en) Unstructured data distributed management method and system for power communication network monitoring platform

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination