CN116916064A - Video data processing method based on picture frame extraction, terminal equipment and storage medium - Google Patents
Video data processing method based on picture frame extraction, terminal equipment and storage medium Download PDFInfo
- Publication number
- CN116916064A CN116916064A CN202310825452.2A CN202310825452A CN116916064A CN 116916064 A CN116916064 A CN 116916064A CN 202310825452 A CN202310825452 A CN 202310825452A CN 116916064 A CN116916064 A CN 116916064A
- Authority
- CN
- China
- Prior art keywords
- frame extraction
- video
- data processing
- video data
- analysis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000605 extraction Methods 0.000 title claims abstract description 68
- 238000003672 processing method Methods 0.000 title claims abstract description 19
- 238000004458 analytical method Methods 0.000 claims abstract description 69
- 238000012545 processing Methods 0.000 claims abstract description 29
- 238000003745 diagnosis Methods 0.000 claims abstract description 20
- 238000000034 method Methods 0.000 claims abstract description 20
- 238000004891 communication Methods 0.000 claims abstract description 10
- 238000012423 maintenance Methods 0.000 claims abstract description 9
- 238000012549 training Methods 0.000 claims abstract description 9
- 230000006399 behavior Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 2
- 238000005728 strengthening Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234381—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0127—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The invention relates to the technical field of video data processing, in particular to a video data processing method and a video data processing system based on picture frame extraction, which allow a user to customize frame extraction frequency in the process of issuing, select the most suitable analysis frequency according to different service scenes and user requirements, maximally utilize limited resources to realize the highest performance, establish an image library based on a unified video platform and support operation and maintenance teams to carry out secondary processing or repeated training on frame extraction contents; comprising the following steps: task management, namely issuing a diagnosis task, customizing a frame extraction frequency, and carrying out scheduling analysis after receiving the diagnosis task; frame extraction management, namely performing low-frequency frame extraction on the selected equipment; and (5) communication management, namely acquiring video and transmitting result information. The invention can greatly save the occupation amount of video analysis service resources by applying the picture frame extraction technology, and can be used for supporting the basic operation and maintenance units of the electric power company to meet the requirements of personnel behavior specifications.
Description
Technical Field
The invention relates to the technical field of video data processing, in particular to a video data processing method and system based on picture frame extraction.
Background
In the power supply management process of the electric company, various business scenes such as security supervision, business hall and the like needing to standardize personnel behavior standard exist, and dangerous points and illegal behaviors in a return picture need to be analyzed in a targeted manner.
The current analysis is mainly carried out aiming at video data in a cloud analysis mode. The number of the professional video terminals is numerous, and a single-channel video with 1500 frames per minute brings great application pressure to software and hardware of an artificial intelligent analysis platform, so that the existing analysis resources can not meet the requirement of analysis of the massive video resources.
Meanwhile, the demand frequency of each professional value data has larger difference, partial on-site pictures can have more frequent change, and higher extraction frequency is needed to meet the supervision demand of the illegal behaviors.
Disclosure of Invention
The invention provides a video data processing method and a system based on picture frame extraction, which overcome the defects of the prior art, and can effectively solve the problems that the existing analysis resources can not meet the requirement of mass video resource analysis and part of on-site pictures are frequently changed.
One of the technical schemes of the invention is realized by the following measures: a video data processing method based on picture frame extraction allows a user to customize frame extraction frequency in the process of issuing, selects the most suitable analysis frequency according to different service scenes and user requirements, maximally utilizes limited resources to realize the highest performance, establishes an image library based on a unified video platform, and supports an operation and maintenance team to carry out secondary processing or repeated training on frame extraction content; comprising the following steps:
task management, namely issuing a diagnosis task, customizing a frame extraction frequency, and carrying out scheduling analysis after receiving the diagnosis task;
frame extraction management, namely performing low-frequency frame extraction on the selected equipment;
and (5) communication management, namely acquiring video and transmitting result information.
The following are further optimizations and/or improvements to one of the above-described inventive solutions:
when task management is performed, the method can comprise the following steps: task issuing, namely diagnosing tasks through unified video issuing equipment; diagnostic tasks are performed.
The key frames of the real-time video and the historical video can be extracted at fixed time, the pictures are transmitted to the video data processing system for analysis, and then the analysis results are obtained from the video data processing system and stored in the unified video image library.
The method specifically comprises the following steps: the platform side issues a diagnosis task and receives the diagnosis task; extracting video or real-time video of equipment to be analyzed through a frame extraction service; transmitting the frame-extracted picture into a corresponding algorithm port of a video data processing system for analysis; and warehousing the analysis result, and displaying the analysis result on the platform side.
The second technical scheme of the invention is realized by the following measures:
a video data processing system based on picture frame extraction, comprising:
the task management module is used for issuing diagnostic tasks, customizing the frame extraction frequency, and carrying out scheduling analysis after receiving the diagnostic tasks;
the frame extraction management module is used for carrying out low-frequency frame extraction on the selected equipment;
and the communication management module is used for acquiring the video and transmitting the result information.
The third technical scheme of the invention is realized by the following measures: the terminal equipment comprises a memory and a processor, wherein a program capable of running on the processor is stored in the memory, and the processor realizes the video data processing method based on picture frame extraction when executing the program.
The fourth technical scheme of the invention is realized by the following measures: a storage medium storing one or more programs executable by one or more processors to implement the above-described picture-frame-based video data processing method.
The invention tracks and rewinds the pictures pushed to the video data processing system for analysis, and builds an intelligent analysis sample library in the unified video platform. The method supports the calling of a plurality of independent analysis algorithm modules in the analysis process, allows n pairs of n tasks to be issued, and generates multi-angle diagnosis information by a single task. According to the invention, by establishing a sample library composed of the original video stream of the analysis video, the frame extraction image and the analysis result, all products in the intelligent analysis process can be tracked, and aiming at the misleading and error-prone analysis sample, repeated analysis strengthening can be carried out as a training model, so that the accuracy of an intelligent analysis algorithm is further improved. The invention can greatly save the occupation amount of video analysis service resources by applying the picture frame extraction technology. The method supports the self-defined frame extraction of the real-time frames and the historical video of the fixed video and the law enforcement instrument video, can dump the frame extraction original image and the analysis image returned by the video data processing system, stores the circulation data into a unified video image library, and is convenient for secondary analysis and algorithm training plan making. The invention establishes a set of intelligent analysis modules with higher efficiency, perfection and huge expansion potential, and can be used for supporting the basic operation and maintenance units of the electric power company to meet the requirements of personnel behavior specifications.
Drawings
Fig. 1 is a schematic diagram of a frame extraction task management flow according to an embodiment of the present invention.
Fig. 2 is a schematic diagram of a local analysis service flow according to an embodiment of the present invention.
Detailed Description
The present invention is not limited by the following examples, and specific embodiments can be determined according to the technical scheme and practical situations of the present invention.
In the present invention, for convenience of description, the description of the relative positional relationship of each component is described according to the layout manner of the drawings in the specification, such as: the positional relationship of the front, rear, upper, lower, left, right, etc. is determined in accordance with the layout direction of the drawings of the specification.
The invention is further described below with reference to examples and figures:
example 1: as shown in fig. 1 and 2, the video data processing method based on picture frame extraction allows a user to define frame extraction frequency in the process of issuing, selects the most suitable analysis frequency according to different service scenes and user requirements, maximally utilizes limited resources to realize the highest performance, establishes an image library based on a unified video platform, and supports an operation and maintenance team to perform secondary processing or repeated training on frame extraction content; comprising the following steps:
task management, namely issuing a diagnosis task, customizing a frame extraction frequency, and carrying out scheduling analysis after receiving the diagnosis task;
frame extraction management, namely performing low-frequency frame extraction on the selected equipment; in the embodiment of the invention, the frame extraction service belongs to a sub-module of the intelligent analysis service module.
Communication management, which is to acquire video and transmit result information through HTTP communication.
When the task management is carried out, the method comprises the following steps:
task issuing, namely diagnosing tasks through unified video issuing equipment, filling in task necessary filling information and self-defining frame extraction intervals;
executing the diagnosis task, wherein the execution progress of the task which is just issued can be seen in the diagnosis task list, and the result after diagnosis is finished is written into a diagnosis result table.
According to the embodiment of the invention, the key frames of the real-time video and the historical video are extracted at fixed time, the picture is transmitted to the video data processing system for analysis, and then the analysis result is obtained from the video data processing system and stored in the unified video image library. The method specifically comprises the following steps:
(1) The platform side issues a diagnosis task and receives the diagnosis task;
(2) Extracting video or real-time video of equipment to be analyzed through a frame extraction service;
(3) Transmitting the frame-extracted picture into a corresponding algorithm port of a video data processing system for analysis;
(4) And warehousing the analysis result, and displaying the analysis result on the platform side.
The embodiment of the invention can check the basic data such as the intelligent analysis frame drawing picture and the original video returned by the law enforcement instrument in a 'view management' - 'original data' module in the unified video platform, and support the secondary processing of the data in the modes such as export and the like. The unified video platform is an existing video platform.
The embodiment of the invention tracks and rewinds the pictures pushed to the video data processing system for analysis, and builds an intelligent analysis sample library in the unified video platform. The method is used for video image frame extraction based on a unified video platform, and is mainly suitable for various business scenes requiring standardized personnel behavior specification, such as security supervision, business halls and the like. And calling a plurality of analysis algorithm independent modules in the analysis process, allowing n pairs of n tasks to be issued, and generating multi-angle diagnosis information by a single task. According to the embodiment of the invention, by establishing the sample library composed of the original video stream of the analysis video, the frame extraction image and the analysis result, all products in the intelligent analysis process can be tracked, and aiming at the misleading and error-prone analysis sample, repeated analysis strengthening can be carried out as a training model, so that the accuracy of an intelligent analysis algorithm is further improved. The embodiment of the invention can greatly save the occupation amount of video analysis service resources by applying the picture frame extraction technology. The method supports the self-defined frame extraction of the real-time frames and the historical video of the fixed video and the law enforcement instrument video, can dump the frame extraction original image and the analysis image returned by the video data processing system, stores the circulation data into a unified video image library, and is convenient for secondary analysis and algorithm training plan making. The embodiment of the invention establishes a set of intelligent analysis modules with higher efficiency, perfection and great expansion potential, and can be used for supporting the basic operation and maintenance units of the electric power company to meet the requirements of the practice personnel on the specification.
Example 2: an embodiment of the present invention provides a video data processing system based on frame extraction, including:
the task management module is used for issuing diagnostic tasks, customizing the frame extraction frequency, and carrying out scheduling analysis after receiving the diagnostic tasks;
the frame extraction management module is used for carrying out low-frequency frame extraction on the selected equipment;
and the communication management module is used for acquiring the video and transmitting the result information.
The video data processing system based on picture frame extraction allows a user to customize frame extraction frequency in the process of issuing, selects the most suitable analysis frequency according to different service scenes and user requirements, maximally utilizes limited resources to achieve the highest performance, and can establish an image library based on a unified video platform to support operation and maintenance teams to carry out secondary processing or repeated training on frame extraction contents.
The embodiment of the invention tracks and rewinds the pictures pushed to the video data processing system for analysis, and builds an intelligent analysis sample library in the unified video platform. The method is used for video image frame extraction based on a unified video platform, and is mainly suitable for various business scenes requiring standardized personnel behavior specification, such as security supervision, business halls and the like. The embodiment of the invention establishes a set of intelligent analysis modules with higher efficiency, perfection and great expansion potential, and can be used for supporting the basic operation and maintenance units of the electric power company to meet the requirements of the practice personnel on the specification.
Example 3: the embodiment of the invention provides a terminal device, which comprises a memory, a processor, a communication interface and a communication bus, wherein a program capable of running on the processor is stored in the memory, and the processor realizes the video data processing method based on picture frame extraction in the embodiment when executing the program.
The processor may be a central processing unit, or may be other general purpose processors, digital signal processors, application specific integrated circuits, field programmable gate arrays or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or a combination of the foregoing types of chips.
The memory is used as a non-transitory computer readable storage medium for storing non-transitory software programs, non-transitory computer executable programs, and units, such as corresponding program units in the above-described method embodiments of the invention. The processor executes various functional applications of the processor and the processing of the work data by running non-transitory software programs, instructions and modules stored in the memory, that is, the video data processing method based on picture frame extraction described in the above embodiments is implemented.
The memory may include a memory program area and a memory data area, wherein the memory program area may store an operating system, at least one application program required for a function; the storage data area may store data created by the processor, etc. In addition, the memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. The memory may optionally include memory provided remotely from the processor, the remote memory being connectable to the processor through a network. The one or more programs are stored in the memory and when executed by the processor, perform the picture-frame based video data processing method described in the above embodiments.
Example 4: an embodiment of the present invention provides a storage medium, configured to store one or more programs, where the one or more programs are executable by one or more processors, to implement the video data processing method based on frame extraction according to any one of the embodiments of the present invention.
The storage medium may be an internal storage unit of the terminal device, for example, a hard disk or a memory of the terminal device. The storage medium may also be an external storage device of the terminal device, such as a plug-in hard disk, a smart memory card, a secure digital card, a flash memory card, etc. provided on the terminal device.
The technical characteristics form the embodiment of the invention, have stronger adaptability and implementation effect, and can increase or decrease unnecessary technical characteristics according to actual needs so as to meet the requirements of different situations.
Claims (7)
1. A video data processing method based on picture frame extraction is characterized in that a user is allowed to define frame extraction frequency in the process of issuing, the most suitable analysis frequency is selected according to different service scenes and user requirements, the highest performance is realized by maximally utilizing limited resources, an image library is built based on a unified video platform, and an operation and maintenance team is supported to conduct secondary processing or repeated training on frame extraction content; comprising the following steps:
task management, namely issuing a diagnosis task, customizing a frame extraction frequency, and carrying out scheduling analysis after receiving the diagnosis task;
frame extraction management, namely performing low-frequency frame extraction on the selected equipment;
and (5) communication management, namely acquiring video and transmitting result information.
2. The video data processing method based on picture frame extraction according to claim 1, wherein the task management comprises the steps of: task issuing, namely diagnosing tasks through unified video issuing equipment; diagnostic tasks are performed.
3. The video data processing method based on frame extraction according to claim 1 or 2, wherein the pictures are transmitted to a video data processing system for analysis by regularly extracting key frames of real-time video and historical video, and then the analysis results are obtained from the video data processing system and stored in a unified video image library.
4. The video data processing method based on picture frame extraction according to claim 1 or 2, characterized by comprising the following steps: the platform side issues a diagnosis task and receives the diagnosis task; extracting video or real-time video of equipment to be analyzed through a frame extraction service; transmitting the frame-extracted picture into a corresponding algorithm port of a video data processing system for analysis; and warehousing the analysis result, and displaying the analysis result on the platform side.
5. A video data processing system based on picture frame extraction, comprising:
the task management module is used for issuing diagnostic tasks, customizing the frame extraction frequency, and carrying out scheduling analysis after receiving the diagnostic tasks;
the frame extraction management module is used for carrying out low-frequency frame extraction on the selected equipment;
and the communication management module is used for acquiring the video and transmitting the result information.
6. A terminal device comprising a memory and a processor, the memory having stored thereon a program executable on the processor, wherein the processor implements the picture-frame based video data processing method according to any one of claims 1 to 4 when executing the program.
7. A storage medium storing one or more programs executable by one or more processors to implement the picture-frame based video data processing method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310825452.2A CN116916064A (en) | 2023-07-06 | 2023-07-06 | Video data processing method based on picture frame extraction, terminal equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310825452.2A CN116916064A (en) | 2023-07-06 | 2023-07-06 | Video data processing method based on picture frame extraction, terminal equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116916064A true CN116916064A (en) | 2023-10-20 |
Family
ID=88357424
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310825452.2A Pending CN116916064A (en) | 2023-07-06 | 2023-07-06 | Video data processing method based on picture frame extraction, terminal equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116916064A (en) |
-
2023
- 2023-07-06 CN CN202310825452.2A patent/CN116916064A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108681667A (en) | A kind of unit type recognition methods, device and processing equipment | |
| CN107958456A (en) | Dispensing detection method, device and electronic equipment | |
| CN104022913B (en) | For method of testing and the device of data cluster | |
| CN109639791A (en) | Cloud workflow schedule method and system under a kind of container environment | |
| CN106354616A (en) | Method and device for monitoring application execution performance and high-performance computing system | |
| CN108540541A (en) | Information processing method, information processing unit and interchanger | |
| CN108108230A (en) | Cloud platform delivery system based on docker | |
| CN117692611A (en) | Security image transmission method and system based on 5G | |
| CN108111578A (en) | The method of distribution terminal data acquisition platform access terminal equipment based on NIO | |
| CN116916064A (en) | Video data processing method based on picture frame extraction, terminal equipment and storage medium | |
| CN111913861A (en) | Performance test method, device, equipment and medium of Internet of things system | |
| CN107766497A (en) | The method and terminal of Data Collection based on container | |
| CN109992614A (en) | Data capture method, device and server | |
| CN115756448A (en) | Method, device, equipment and medium for acquiring vehicle cloud data acquisition system architecture | |
| CN108550030A (en) | Method, device and system for approval and computer readable medium | |
| CN105528737A (en) | Swap station data processing system, method and device | |
| CN115511321A (en) | Multi-stage interconnection method and device based on management platform and storage medium | |
| CN110544063B (en) | Logistics platform driver on-site support system based on AR and method thereof | |
| CN116737351A (en) | Image processing system operation management method and device, storage medium and electronic equipment | |
| CN112631675A (en) | Workflow configuration method, device, equipment and computer readable storage medium | |
| CN104572316A (en) | Game program and running platform interaction method and system | |
| CN107526818A (en) | One kind is based on enterprise's private clound big data processing system and method | |
| CN116912963A (en) | Intelligent analysis method, terminal equipment and storage medium for custom analysis object | |
| CN103544863A (en) | Track traffic integrated supervision training simulation system data interaction module and working method | |
| CN117992528B (en) | Data interaction method and system of digital exhibition management platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |