CN106331616A - Heterogeneous environment-based massive video structured analysis system and method - Google Patents

Heterogeneous environment-based massive video structured analysis system and method Download PDF

Info

Publication number
CN106331616A
CN106331616A CN201610706955.8A CN201610706955A CN106331616A CN 106331616 A CN106331616 A CN 106331616A CN 201610706955 A CN201610706955 A CN 201610706955A CN 106331616 A CN106331616 A CN 106331616A
Authority
CN
China
Prior art keywords
module
video
task
analysis
transcoding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610706955.8A
Other languages
Chinese (zh)
Inventor
王维
王维一
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan Fiberhome Digtal Technology Co Ltd
Original Assignee
Wuhan Fiberhome Digtal Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan Fiberhome Digtal Technology Co Ltd filed Critical Wuhan Fiberhome Digtal Technology Co Ltd
Priority to CN201610706955.8A priority Critical patent/CN106331616A/en
Publication of CN106331616A publication Critical patent/CN106331616A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234336Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by media transcoding, e.g. video is transformed into a slideshow of still pictures or audio is converted into text

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention relates to a heterogeneous environment-based massive video structured analysis system and method. The system comprises a task management module, a streaming media receiving module, a transcoding module and a video analysis module; the task management module is used for dividing a received task into a plurality of sub-tasks, allocating the sub-tasks to the streaming media receiving module, and carrying out merging unified management according to the analysis results of the sub-tasks; after the streaming media receiving module receives streaming media codes from a heterogeneous environment, the task management module allocates a transcoding task to the transcoding module; after transcoding is completed, the task management module imports a transcoded standard video file into a view library, and then allocates the sub-tasks to analysis nodes; the analysis nodes carry out video structured analysis based on the standard video file; and the task management module merges the analysis results of the sub-tasks and imports merged analysis results into the view library, so that the merged analysis results can be managed in a unified manner.

Description

A kind of massive video structured analysis system and method based on isomerous environment
Technical field
The present invention relates to field of video monitoring, in particular, relate to a kind of massive video based on isomerous environment knot Structure fractional analysis system and method.
Background technology
In field of video monitoring, video structure analyzing is a kind of good application to massive video resource, by using Video is analyzed by various algorithms, allows computer generation replace and manually extracts valuable information from the video resource of magnanimity.Depending on The Accuracy and high efficiency of frequency analysis is often user and the common requirements of algorithm service provider.At present, due to each video Monitor supervision platform, the video capture device source of access is the most various, the Video coding mode that different video capture devices uses Also being not quite similar, the Video coding mode so making different video monitoring platforms provide differs from ten thousand with video file format thousand Not, even a lot of video files can only be decoded by the SDK that video capture device provider provides, and causes algorithm service to carry Need to study various video format and the SDK of video capture device provider offer for business, increase video structure analyzing The difficulty of system docking, is unfavorable for the application of video structure analyzing and popularizes.It addition, conventional serial analytical model also cannot be expired The video data of foot magnanimity analyzes demand.
Summary of the invention
In view of this, it is necessary to for the problems referred to above, it is provided that a kind of massive video structured analysis based on isomerous environment System and method, by video decoding function from analysis module independent so that analyze module be solely focused on algorithm Analysis part, and do not spend and be concerned about the encoding and decoding problem of video resource under different video monitoring platform, simplify video structural and divide Analysis system accesses, and uses task cutting, transcoding and certain task scheduling and administrative mechanism to carry out resource process, and raising regards The efficiency of frequency analysis..
To achieve these goals, technical scheme is as follows:
A kind of massive video structured analysis system based on isomerous environment, receives including task management module, Streaming Media Module, transcoding module, analysis module;
Described task management module for being divided into some subtasks by receiving of task, and is assigned to Streaming Media reception mould Block, carries out closing and being managed collectively according to the analysis result of each subtask;
Described Streaming Media receiver module is for obtaining video flowing according to the subtask of task management module distribution;
Described transcoding module is for carrying out transcoding, unified file format by the video file received from task management module;
Described analysis module is used for the video file received from task manager module is carried out structured analysis, and Analysis result is back to task management module.
As preferably, also including some video monitoring platforms, described steaming media platform is downloaded from video monitoring platform and is regarded Frequency stream, and notify that task management module has been downloaded.
As preferably, described task management module, Streaming Media receiver module, transcoding module and analysis module are all wrapped Include a communicator module, communicate for an intermodule.
As preferably, described analysis module includes some video analysis submodules, described video analysis submodule With video monitoring platform one_to_one corresponding.
As preferably, also include a view storehouse, for storing the standard video file after transcoding and each subtask Analysis result.
One carries out massive video structural workflow net according to said system, comprises the following steps:
S1, task cutting;Task is cut into some subtasks, and each subtask is sent to Streaming Media reception mould Block;
S2, streaming media resource obtain;
S3, video resource transcoding;
S4, video structure analyzing;
S5, task merging.
As preferably, described step S2 specifically includes: what Streaming Media receiver module received that task management module issues appoints After business, downloading video recording resource from monitor supervision platform, after having downloaded, communicator module sends task to task management module and has downloaded Become notice.
As preferably, described step S3 specifically includes: task management module receives Streaming Media receiver module task and downloads After completion notice, transcoding task is sent to transcoding module by task management module;After transcoding module receives transcoding task, transcoding mould Block carries out transcoding to video file, after transcoding completes, sends task transcoding completion notice to task management module.
As preferably, described step S4 specifically includes: transcoding notifies task management module, task management module after completing Video analytic tasks is sent to analysis module, after analysis module receives video analytic tasks, video file is entered Row structured analysis, after having analyzed, sends task analysis completion notice to task management module.
As preferably, described step S5 specifically includes: it is complete that task management module receives analysis module task analysis After becoming notice, it is judged that all subtasks have the most all been analyzed, if having analyzed, then by task merging, notice user task is complete Become, if also subtask is not fully complete, wait that other subtask completes.
Compared with prior art, the beneficial effects of the present invention is: the present invention is by dividing video decoding function from video Analysis module is independent so that analyzes module and is solely focused on the analysis part of algorithm, and does not spend care different video monitoring and put down The encoding and decoding problem of video resource under platform.Task is cut into multiple subtask by task management module, is assigned to each Streaming Media Receiver module, transcoding module, analysis module, concurrently perform and complete task so that task from the acquisition of streaming media resource, Multiple dimension such as video code conversion, video analysis is concurrently carried out, and improves the efficiency of video structure analyzing.The present invention have followed mark Pseudo-crystalline lattice communication protocol, has autgmentability, reliable stability and efficientibility flexibly, can be transplanted to other phases simultaneously Closing among scene, transcoding module the most of the present invention supports soft transcoding and the hard transcoding of GPU, makes full use of hardware resource, improves and divides Analysis efficiency.
Accompanying drawing explanation
Fig. 1 is the system architecture diagram of the embodiment of the present invention;
Fig. 2 is the method flow diagram of the embodiment of the present invention;
Fig. 3 is that the streaming media resource of the embodiment of the present invention obtains handling process schematic diagram;
Fig. 4 is the video resource transcoding handling process schematic diagram of the embodiment of the present invention;
Fig. 5 is the video structure analyzing handling process schematic diagram of the embodiment of the present invention.
Detailed description of the invention
With embodiment, a kind of massive video structuring based on isomerous environment of the present invention is divided below in conjunction with the accompanying drawings Analysis system and method are described further.
The following is a kind of massive video structured analysis system and method based on isomerous environment of the present invention Good example, the most therefore limits protection scope of the present invention.
Fig. 1 shows a kind of massive video structured analysis system based on isomerous environment, including task management module, stream Media receiver module, transcoding module, analysis module;
Described task management module for being divided into some subtasks by receiving of task, and is assigned to Streaming Media reception mould Block, carries out closing and being managed collectively according to the analysis result of each subtask;Streaming Media receiver module obtains Streaming Media from isomerous environment After code stream, transcoding task is assigned to transcoding module by task management module, and after transcoding completes, task management module is by after transcoding Standard video file import view storehouse, is then assigned to analysis node by each subtask, and analysis node is based on standard video file Carrying out video structure analyzing, the analysis result of each subtask is merged by task management module, and import view storehouse is entered Row unified management.
Described Streaming Media receiver module obtains video flowing for the subtask distributed according to task management module, depending on Frequently, image resource;
Described transcoding module for the video file received from task management module being carried out transcoding, unified file format, In the present embodiment, obtain AVI video resource and the JPG image resource of standard, can be in conjunction with CPU transcoding;
Described analysis module is used for the video file received from task manager module is carried out structured analysis, and Analysis result is back to task management module.
As preferably, also including n video monitoring platform, described steaming media platform is from video monitoring platform foradownloaded video Stream, and notify that task management module has been downloaded.
As preferably, described task management module, Streaming Media receiver module, transcoding module and analysis module are all wrapped Include a communicator module, communicate for an intermodule.
As preferably, described analysis module includes n video analysis submodule, described video analysis submodule with Video monitoring platform one_to_one corresponding.
As preferably, also including a view storehouse, task management module is by the standard video file import view after transcoding Storehouse, the analysis result of each subtask is merged by task management module, and import view storehouse is managed collectively.
One carries out massive video structural workflow net according to said system, comprises the following steps:
S1, task cutting;Task is cut into some subtasks, and each subtask is sent to Streaming Media reception mould Block;
S2, streaming media resource obtain;
S3, video resource transcoding;
S4, video structure analyzing;
S5, task merging.
As preferably, described step S2 specifically includes: what Streaming Media receiver module received that task management module issues appoints After business, downloading video recording resource from monitor supervision platform, after having downloaded, communicator module sends task to task management module and has downloaded Become notice.
As preferably, described step S3 specifically includes: task management module receives Streaming Media receiver module task and downloads After completion notice, transcoding task is sent to transcoding module by task management module;After transcoding module receives transcoding task, transcoding mould Block carries out transcoding to video file, after transcoding completes, sends task transcoding completion notice to task management module.
As preferably, described step S4 specifically includes: transcoding notifies task management module, task management module after completing Video analytic tasks is sent to analysis module, after analysis module receives video analytic tasks, video file is entered Row structured analysis, after having analyzed, sends task analysis completion notice to task management module.
As preferably, described step S5 specifically includes: it is complete that task management module receives analysis module task analysis After becoming notice, it is judged that all subtasks have the most all been analyzed, if having analyzed, then by task merging, notice user task is complete Become, if also subtask is not fully complete, wait that other subtask completes.
Compared with prior art, the beneficial effects of the present invention is: the present invention is by dividing video decoding function from video Analysis module is independent so that analyzes module and is solely focused on the analysis part of algorithm, and does not spend care different video monitoring and put down The encoding and decoding problem of video resource under platform.Task is cut into multiple subtask by task management module, is assigned to each Streaming Media Receiver module, transcoding module, analysis module, concurrently perform and complete task so that task from the acquisition of streaming media resource, Multiple dimension such as video code conversion, video analysis is concurrently carried out, and improves the efficiency of video structure analyzing.The present invention have followed mark Pseudo-crystalline lattice communication protocol, has autgmentability, reliable stability and efficientibility flexibly, can be transplanted to other phases simultaneously Closing among scene, transcoding module the most of the present invention supports soft transcoding and the hard transcoding of GPU, makes full use of hardware resource, improves and divides Analysis efficiency.
Embodiment described above only have expressed the several embodiments of the present invention, and it describes more concrete and detailed, but also Therefore the restriction to the scope of the claims of the present invention can not be interpreted as.It should be pointed out that, for those of ordinary skill in the art For, without departing from the inventive concept of the premise, it is also possible to make some deformation and improvement, these broadly fall into the guarantor of the present invention Protect scope.Therefore, the protection domain of patent of the present invention should be as the criterion with claims.

Claims (10)

1. a massive video structured analysis system based on isomerous environment, it is characterised in that include task management module, stream Media receiver module, transcoding module, analysis module;
Described task management module for being divided into some subtasks by receiving of task, and is assigned to Streaming Media receiver module, Analysis result according to each subtask carries out closing and being managed collectively;
Described Streaming Media receiver module is for obtaining video flowing according to the subtask of task management module distribution;
Described transcoding module is for carrying out transcoding, unified file format by the video file received from task management module;
Described analysis module for carrying out structured analysis by the video file received from task manager module, and will divide Analysis result is back to task management module.
Massive video structured analysis system based on isomerous environment the most according to claim 1, it is characterised in that also wrap Including some video monitoring platforms, described steaming media platform is from video monitoring platform download video stream, and notifies task management module Download completes.
Massive video structured analysis system based on isomerous environment the most according to claim 1, it is characterised in that described Task management module, Streaming Media receiver module, transcoding module and analysis module all include a communicator module, for a mould Communicate between block.
Massive video structured analysis system based on isomerous environment the most according to claim 1, it is characterised in that described Analysis module includes some video analysis submodules, described video analysis submodule and video monitoring platform one_to_one corresponding.
Massive video structured analysis system based on isomerous environment the most according to claim 1, it is characterised in that also wrap Include a view storehouse, the standard video file after storing transcoding and the analysis result of each subtask.
6. carrying out a massive video structural workflow net according to the arbitrary described system of claim 1 to 5, its feature exists In, comprise the following steps:
S1, task cutting;Task is cut into some subtasks, and each subtask is sent to Streaming Media receiver module;
S2, streaming media resource obtain;
S3, video resource transcoding;
S4, video structure analyzing;
S5, task merging.
Massive video structural workflow net the most according to claim 6, it is characterised in that described step S2 is specifically wrapped Including: after Streaming Media receiver module receives the task that task management module issues, download video recording resource from monitor supervision platform, download completes After, communicator module sends task to task management module and downloads completion notice.
Massive video structural workflow net the most according to claim 7, it is characterised in that described step S3 is specifically wrapped Include: after task management module receives Streaming Media receiver module task download completion notice, transcoding task is sent out by task management module Give transcoding module;After transcoding module receives transcoding task, transcoding module carries out transcoding to video file, after transcoding completes, to Task management module sends task transcoding completion notice.
Massive video structural workflow net the most according to claim 6, it is characterised in that described step S4 is specifically wrapped Include: transcoding notifies task management module after completing, and video analytic tasks is sent to analysis module by task management module, depending on After frequency analysis module receives video analytic tasks, video file is carried out structured analysis, after having analyzed, to task management mould Block sends task analysis completion notice.
Massive video structural workflow net the most according to claim 6, it is characterised in that described step S5 is specifically wrapped Include: after task management module receives analysis module task analysis completion notice, it is judged that all subtasks have the most all been analyzed Becoming, if having analyzed, then by task merging, notice user task completes, if also subtask is not fully complete, waits other subtask Complete.
CN201610706955.8A 2016-08-23 2016-08-23 Heterogeneous environment-based massive video structured analysis system and method Pending CN106331616A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610706955.8A CN106331616A (en) 2016-08-23 2016-08-23 Heterogeneous environment-based massive video structured analysis system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610706955.8A CN106331616A (en) 2016-08-23 2016-08-23 Heterogeneous environment-based massive video structured analysis system and method

Publications (1)

Publication Number Publication Date
CN106331616A true CN106331616A (en) 2017-01-11

Family

ID=57741866

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610706955.8A Pending CN106331616A (en) 2016-08-23 2016-08-23 Heterogeneous environment-based massive video structured analysis system and method

Country Status (1)

Country Link
CN (1) CN106331616A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106791717A (en) * 2017-02-27 2017-05-31 广州林邦信息科技有限公司 Method for processing video frequency and device
CN108363713A (en) * 2017-12-20 2018-08-03 武汉烽火众智数字技术有限责任公司 Video image information resolver, system and method
CN108391082A (en) * 2017-12-18 2018-08-10 武汉烽火众智数字技术有限责任公司 It is a kind of based on GB28181 agreements target structural service cut-in method, device and system
CN109246444A (en) * 2018-11-28 2019-01-18 中电科(德阳广汉)特种飞机系统工程有限公司 Operation monitoring system, method, apparatus and the readable storage medium storing program for executing of mission payload
CN109246151A (en) * 2018-11-05 2019-01-18 国家电网有限公司 A kind of transmission line of electricity video intelligent inspection analysis dispatching method
CN109814996A (en) * 2019-01-04 2019-05-28 平安科技(深圳)有限公司 Streaming media control method, device and storage medium, computer equipment
CN110121060A (en) * 2019-05-27 2019-08-13 中国电子科技网络信息安全有限公司 A kind of intelligence enhancing device and method for IP Camera
WO2021056893A1 (en) * 2019-09-29 2021-04-01 上海依图网络科技有限公司 Video processing method and apparatus, medium and system thereof
CN113672386A (en) * 2021-08-09 2021-11-19 浙江大华技术股份有限公司 Video structured analysis method, device and equipment and computer storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130297679A1 (en) * 2012-05-02 2013-11-07 Industry-Academic Cooperation Foundation, Yonsei University Distributed transcoding apparatus and method using multiple servers
CN104008489A (en) * 2013-02-21 2014-08-27 文翰易德(北京)文化传媒有限公司 Internet video advertisement putting system and method based on face detection technology
CN104581423A (en) * 2013-10-12 2015-04-29 北京航天长峰科技工业集团有限公司 Comprehensive scheduling and load balancing method for intelligent massive video analysis system
CN105828105A (en) * 2015-12-10 2016-08-03 广东亿迅科技有限公司 Distributed environment-based video transcoding system and video transcoding method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130297679A1 (en) * 2012-05-02 2013-11-07 Industry-Academic Cooperation Foundation, Yonsei University Distributed transcoding apparatus and method using multiple servers
CN104008489A (en) * 2013-02-21 2014-08-27 文翰易德(北京)文化传媒有限公司 Internet video advertisement putting system and method based on face detection technology
CN104581423A (en) * 2013-10-12 2015-04-29 北京航天长峰科技工业集团有限公司 Comprehensive scheduling and load balancing method for intelligent massive video analysis system
CN105828105A (en) * 2015-12-10 2016-08-03 广东亿迅科技有限公司 Distributed environment-based video transcoding system and video transcoding method

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106791717B (en) * 2017-02-27 2019-06-21 广州林邦信息科技有限公司 Method for processing video frequency and device
CN106791717A (en) * 2017-02-27 2017-05-31 广州林邦信息科技有限公司 Method for processing video frequency and device
CN108391082A (en) * 2017-12-18 2018-08-10 武汉烽火众智数字技术有限责任公司 It is a kind of based on GB28181 agreements target structural service cut-in method, device and system
CN108363713A (en) * 2017-12-20 2018-08-03 武汉烽火众智数字技术有限责任公司 Video image information resolver, system and method
CN109246151B (en) * 2018-11-05 2021-03-30 国家电网有限公司 Intelligent video inspection analysis scheduling method for power transmission line
CN109246151A (en) * 2018-11-05 2019-01-18 国家电网有限公司 A kind of transmission line of electricity video intelligent inspection analysis dispatching method
CN109246444A (en) * 2018-11-28 2019-01-18 中电科(德阳广汉)特种飞机系统工程有限公司 Operation monitoring system, method, apparatus and the readable storage medium storing program for executing of mission payload
CN109814996A (en) * 2019-01-04 2019-05-28 平安科技(深圳)有限公司 Streaming media control method, device and storage medium, computer equipment
WO2020140625A1 (en) * 2019-01-04 2020-07-09 平安科技(深圳)有限公司 Streaming media transmission control method and apparatus, storage medium, and computer device
CN109814996B (en) * 2019-01-04 2024-03-22 平安科技(深圳)有限公司 Streaming media transmission control method and device, storage medium and computer equipment
CN110121060A (en) * 2019-05-27 2019-08-13 中国电子科技网络信息安全有限公司 A kind of intelligence enhancing device and method for IP Camera
WO2021056893A1 (en) * 2019-09-29 2021-04-01 上海依图网络科技有限公司 Video processing method and apparatus, medium and system thereof
CN113672386A (en) * 2021-08-09 2021-11-19 浙江大华技术股份有限公司 Video structured analysis method, device and equipment and computer storage medium

Similar Documents

Publication Publication Date Title
CN106331616A (en) Heterogeneous environment-based massive video structured analysis system and method
JP7202432B2 (en) Correlation between thread strength and heap usage to identify stack traces hoarding the heap
Leivadeas et al. VNF placement optimization at the edge and cloud
US10061858B2 (en) Method and apparatus for processing exploding data stream
US9413858B2 (en) Real-time compressive data collection for cloud monitoring
US20170262518A1 (en) Advanced database systems and methods for use in a multi-tenant system
JP2020521238A (en) Method of data aggregation for cache optimization and efficient processing
KR102589876B1 (en) Method and apparatus for step-assisted workflow
CN110096420A (en) A kind of data processing method, system and device
CN106713909A (en) Video encoding method, device and system
CN104166701A (en) Machine learning method and system
Yang et al. A framework for visual fog computing
Liu Design and implementation of an intelligent environmental-control system: Perception, network, and application with fused data collected from multiple sensors in a Greenhouse at Jiangsu, China
CN110781180A (en) Data screening method and data screening device
Heikkinen et al. Distributed multimedia content analysis with MapReduce
US9807139B2 (en) System and method for active transcoding of content in a distributed system
CN102387121A (en) Management server, image dissemination control system and image dissemination control method
CN116996112B (en) Real-time preprocessing method for remote sensing satellite data
Schmidt et al. An approach for processing large and non-uniform media objects on mapreduce-based clusters
EP3780632B1 (en) System for distributing audiovisual content
CN109542867A (en) Distribution type data collection method and device
US20110213663A1 (en) Service intelligence module program product
García et al. NUBOMEDIA: an elastic PaaS enabling the convergence of real-time and big data multimedia
CN113377877A (en) Multi-engine big data platform
CN110688504A (en) Image data management method, apparatus, system, device and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170111

RJ01 Rejection of invention patent application after publication