CN113453074A - Video multi-editing and time sequence analysis method - Google Patents
Video multi-editing and time sequence analysis method Download PDFInfo
- Publication number
- CN113453074A CN113453074A CN202110768358.9A CN202110768358A CN113453074A CN 113453074 A CN113453074 A CN 113453074A CN 202110768358 A CN202110768358 A CN 202110768358A CN 113453074 A CN113453074 A CN 113453074A
- Authority
- CN
- China
- Prior art keywords
- video
- time
- block
- abnormal
- video block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 21
- 238000012300 Sequence Analysis Methods 0.000 title claims abstract description 11
- 230000009471 action Effects 0.000 claims abstract description 57
- 230000002159 abnormal effect Effects 0.000 claims abstract description 40
- 230000037430 deletion Effects 0.000 claims abstract description 4
- 238000012217 deletion Methods 0.000 claims abstract description 4
- 230000008707 rearrangement Effects 0.000 claims abstract description 4
- 238000004458 analytical method Methods 0.000 claims description 6
- 238000012731 temporal analysis Methods 0.000 claims description 4
- 238000000700 time series analysis Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 claims description 3
- 238000000354 decomposition reaction Methods 0.000 claims description 2
- 238000004519 manufacturing process Methods 0.000 abstract description 20
- 230000000694 effects Effects 0.000 abstract description 7
- 230000006872 improvement Effects 0.000 abstract description 4
- 230000009286 beneficial effect Effects 0.000 description 5
- 238000007728 cost analysis Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 238000002513 implantation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/74—Browsing; Visualisation therefor
- G06F16/743—Browsing; Visualisation therefor a collection of video files or sequences
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/7867—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/787—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
Abstract
The invention discloses a video multiple editing and time sequence analysis method, which comprises the following steps: playing the video and starting to record time data; decomposing the video into a plurality of action element video blocks according to the actions of people or equipment in the video; counting invalid time of abnormal actions in each action element video block, and splitting the action element video block into an abnormal video block superposed with an effective time block and an effective video block superposed with the effective time block according to the counted invalid time; performing more than two times of one of disassembly, combination, rearrangement and deletion of effective video blocks and abnormal video blocks on the video to output a new video file; and collecting the disassembled video blocks into a corresponding man-hour video library and a man-hour database, and configuring different action codes for the video blocks to form an action code library. The invention enables the lean production of enterprises to be digitalized, the video and the improvement effect to be visualized, forms a large amount of analyzed valuable video data, and can reduce the time of a large amount of repeated work.
Description
Technical Field
The invention relates to the technical field of video editing, in particular to a video multi-editing and time sequence analysis method.
Background
At present, in the prior art, operations such as single clipping, subtitle, audio and special effect superposition implantation are only performed on videos, multiple editing and time analysis are not performed on the videos according to the relation between actions and time, that is, the video comprehensive structure including time and space cannot be realized on the same video, and the video comprehensive structure cannot be applied to the field of industrial engineering, so that the field of industrial engineering can only realize the statistics of working hours by means of paper pen recording or electronic report recording, a large amount of time is required for measuring the working hours and the statistical report, meanwhile, the production beat and scheduling can only be deduced through various theories, the specific conditions of effective or ineffective actions in the production process and the actual effect of balanced production beat and production line cannot be obtained through processing the videos, and enterprises cannot realize lean production digitalization; therefore, it is necessary to provide a video multiple editing and time sequence analysis method for solving the problem of the unicity of the existing video editing, and multiple analyses are performed on the same video through the relationship between the action and the time, so as to enhance the granularity of video analysis and editing, and enable the video and the time data to be formed and linked with the action in the industrial engineering, so that an enterprise can obtain valuable data by watching the video, and the measuring time and the statistical reporting time are reduced.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides a video multi-editing and time sequence analysis method.
The technical scheme of the invention is as follows:
a video multi-editing and time sequence analysis method comprises the following steps:
s1, playing the video to be edited and starting to record time data;
s2, in the playing process of the video, the video is disassembled into a plurality of action element video blocks according to the actions of the characters or the equipment in the video;
s3, sequentially carrying out secondary analysis and disassembly on each action element video block to realize the statistics of invalid time of abnormal actions in the action element video block, and dividing the action element video block into an abnormal video block and an effective video block according to the counted invalid time, wherein each abnormal video block is correspondingly superposed with an invalid time block, and each effective video block is correspondingly superposed with an effective time block;
s4, performing more than two times of one or more of disassembly, combination, rearrangement and deletion of the effective video block and the abnormal video block on the video processed in the step S3 to output a new video file;
and S5, collecting the disassembled effective video blocks into a standard man-hour video library and a standard man-hour database, collecting the disassembled abnormal video blocks into an abnormal man-hour video library and an abnormal man-hour database, and configuring different action codes for each video block to form an action code library.
Further, the time data is actually measured data, and the time data is obtained according to the playing progress.
Further, a specific implementation manner of the step S2 is to perform action decomposition on the video in the form of splitting one video block by one action according to the action of the person or the device in the video to implement the splitting of the video into several action element video blocks.
Further, the time of the invalid time block of step S3 corresponds to the invalid time of the action element video block, and the time of the valid time block corresponds to the valid time of the action element video block.
Further, in the specific operation of the disassembling in step S4, any specific frame of any effective video block or abnormal video block is used as a disassembling point to disassemble the video block into two new video blocks, and the time data corresponding to the video is also updated synchronously, so that the effective time or the ineffective time in the new video block corresponds to the specific frame position of the video in millisecond level.
Further, the specific operations of merging, reordering, and deleting in step S4 are to combine or position-adjust or delete the split valid video block and abnormal video block according to actual requirements.
Further, the new video file output by the step S4 includes:
a. adjusting any position of the disassembled effective video block or abnormal video block, and combining the video blocks to recombine a single-element video file;
b. and overlapping, merging, rearranging and deleting the video blocks of the disassembled effective video block and abnormal video block to be recombined into a combined integral video file.
By adopting the scheme, the invention has the following beneficial effects:
the invention can provide effective help for enterprises in lean production, reasonable layout of a factory production line, stations, tool fixtures and automation equipment, design of action stroke, personnel, equipment proportion, production plan scheduling and cost analysis and accounting, replaces the traditional mode of recording data by paper pens or electronic reports to realize data statistics, replaces the traditional mode of deducing production tempo scheduling and cost accounting from theory, can visually know the actual effects of effective action, abnormal action, production tempo and production line balance by watching video files in a video library, is beneficial to knowing how much time, manpower, equipment and cost are needed by a single service and what stations and actions can be used for realizing delivery, greatly reduces the labor intensity of data statistics personnel, effectively shortens the measuring time and the counting and reporting time, thereby realizing the lean production digitization of the enterprises, The video and the improvement effect are visualized, a large amount of analyzed valuable video data are formed, the efficiency is improved for introducing new products and receiving new orders for enterprises, and the time for a large amount of repeated work can be shortened.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the structures shown in the drawings without creative efforts.
FIG. 1 is a flow chart of a video multiple editing and time sequence analysis method according to the present invention;
FIG. 2 is a logic diagram of multiple video editing in the video multiple editing and time sequence analysis method of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
The invention is described in detail below with reference to the figures and the specific embodiments.
Referring to fig. 1 to 2, the present invention provides a video multi-editing and time-series analysis method, including the following steps:
s1, playing the video to be edited and starting to record time data; the time data is actually measured data, and the time data is corresponding time obtained according to the playing progress;
s2, in the playing process of the video, according to the action of the person or the equipment in the video, the action of the video is decomposed in the form of splitting one video block by one action so as to realize the splitting of the video into a plurality of action element video blocks;
s3, each of the action element video blocks is sequentially analyzed and disassembled for secondary analysis to count invalid time for actions (also called abnormal actions or invalid actions, hereinafter referred to as abnormal actions collectively as expressions) that are not essential in the action element video block, and the action element video block is divided into an abnormal video block and an effective video block according to the counted invalid time, wherein each of the abnormal video blocks is correspondingly superimposed with an invalid time block, each of the effective video blocks is correspondingly superimposed with an effective time block, specifically, the time of the invalid time block corresponds to the invalid time of the action element video block, and similarly, the time of the effective time block corresponds to the effective time of the action element video block, and the effective time can be obtained by subtracting the invalid time from the total time of the action element video block;
s4, performing one or more of disassembly, combination, rearrangement and deletion of the effective video block and the abnormal video block for more than two times on the video processed in the step S3 to output a new video file, in order to quickly look up the required video information, specifically, the specific operation of the disassembly in this step is to disassemble any one specific frame of any effective video block or abnormal video block into two new video blocks by taking the video block as a disassembly point, and synchronously update the time data corresponding to the video, therefore, the effective time or the invalid time in the new video block is in millisecond-level correspondence with the specific frame position of the video, the specific operations of merging, rearranging and deleting in the step are to combine or adjust or delete the position of the disassembled effective video block and the abnormal video block according to the actual requirement, and then the new video file output in the step comprises the following steps:
a. adjusting any position of the disassembled effective video block or abnormal video block, and combining the video blocks to recombine a single-element video file after the adjustment is finished;
b. overlapping, merging, rearranging and deleting the video blocks of the disassembled effective video block and abnormal video block to be recombined into a combined integral video file;
s5, collecting the disassembled effective video blocks into a standard man-hour video library and a standard man-hour database, collecting the disassembled abnormal video blocks into an abnormal man-hour video library and an abnormal man-hour database, configuring different action codes for each video block to form an action code library, thereby realizing the deep linkage among the action codes, the action element videos, the effective time, the invalid time, the standard man-hour and the action method, and being beneficial to realizing that AI automatically identifies the standard action, the abnormal action, the effective action, the valuable and the useless and lays a solid big data foundation.
Compared with the prior art, the invention has the following beneficial effects:
the invention can provide effective help for enterprises in lean production, reasonable layout of a factory production line, stations, tool fixtures and automation equipment, design of action stroke, personnel, equipment proportion, production plan scheduling and cost analysis and accounting, replaces the traditional mode of recording data by paper pens or electronic reports to realize data statistics, replaces the traditional mode of deducing production tempo scheduling and cost accounting from theory, can visually know the actual effects of effective action, abnormal action, production tempo and production line balance by watching video files in a video library, is beneficial to knowing how much time, manpower, equipment and cost are needed by a single service and what stations and actions can be used for realizing delivery, greatly reduces the labor intensity of data statistics personnel, effectively shortens the measuring time and the counting and reporting time, thereby realizing the lean production digitization of the enterprises, The video and the improvement effect are visualized, a large amount of analyzed valuable video data are formed, the efficiency is improved for introducing new products and receiving new orders for enterprises, and the time for a large amount of repeated work can be shortened.
The present invention is not limited to the above preferred embodiments, and any modifications, equivalent substitutions and improvements made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (7)
1. A video multi-editing and time sequence analysis method is characterized by comprising the following steps:
s1, playing the video to be edited and starting to record time data;
s2, in the playing process of the video, the video is disassembled into a plurality of action element video blocks according to the actions of the characters or the equipment in the video;
s3, sequentially carrying out secondary analysis and disassembly on each action element video block to realize the statistics of invalid time of abnormal actions in the action element video block, and dividing the action element video block into an abnormal video block and an effective video block according to the counted invalid time, wherein each abnormal video block is correspondingly superposed with an invalid time block, and each effective video block is correspondingly superposed with an effective time block;
s4, performing more than two times of one or more of disassembly, combination, rearrangement and deletion of the effective video block and the abnormal video block on the video processed in the step S3 to output a new video file;
and S5, collecting the disassembled effective video blocks into a standard man-hour video library and a standard man-hour database, collecting the disassembled abnormal video blocks into an abnormal man-hour video library and an abnormal man-hour database, and configuring different action codes for each video block to form an action code library.
2. The method for video multi-editing and time series analysis according to claim 1, wherein the time data is actually measured data, and the time data is obtained according to a playing schedule.
3. The method for video multi-editing and time-series analysis according to claim 1, wherein the step S2 is implemented by performing motion decomposition on the video in the form of splitting one video block by one motion according to the motion of the person or device in the video to realize the splitting of the video into several motion element video blocks.
4. The method of claim 1, wherein the time of the invalid time block in step S3 corresponds to the invalid time of the action element video block, and the time of the valid time block corresponds to the valid time of the action element video block.
5. The method for video multiple editing and time sequence analysis according to claim 1, wherein the parsing in step S4 is performed by parsing any specific frame of any valid video block or abnormal video block into two new video blocks, and synchronously updating the time data corresponding to the video, so that the valid time or invalid time in the new video block corresponds to the position of the specific frame of the video in millisecond level.
6. The method of claim 1, wherein the merging, reordering and deleting of step S4 are performed by combining or adjusting positions of the broken valid video blocks and abnormal video blocks according to actual requirements.
7. The video multiple editing and time series analysis method according to claim 1, wherein the new video file outputted at step S4 includes:
a. adjusting any position of the disassembled effective video block or abnormal video block, and combining the video blocks to recombine a single-element video file;
b. and overlapping, merging, rearranging and deleting the video blocks of the disassembled effective video block and abnormal video block to be recombined into a combined integral video file.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110768358.9A CN113453074A (en) | 2021-07-07 | 2021-07-07 | Video multi-editing and time sequence analysis method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110768358.9A CN113453074A (en) | 2021-07-07 | 2021-07-07 | Video multi-editing and time sequence analysis method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113453074A true CN113453074A (en) | 2021-09-28 |
Family
ID=77815375
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110768358.9A Pending CN113453074A (en) | 2021-07-07 | 2021-07-07 | Video multi-editing and time sequence analysis method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113453074A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000261757A (en) * | 1999-03-10 | 2000-09-22 | Nippon Telegr & Teleph Corp <Ntt> | Method and system for classifying video block for edit and recording medium recording this method |
| CN101082940A (en) * | 2006-05-31 | 2007-12-05 | 株式会社日立制作所 | Work movement analysis method, work movement analysis apparatus, and work movement analysis program |
| CN101452546A (en) * | 2007-12-07 | 2009-06-10 | 李郁贞 | Simulation job program learning and applying method |
| WO2012011641A1 (en) * | 2010-07-23 | 2012-01-26 | Lee Jin Yong | Method for analyzing a process to enhance productivity |
| CN103634533A (en) * | 2012-08-23 | 2014-03-12 | 广州春晓信息科技有限公司 | Working video analysis method and device |
| CN105144741A (en) * | 2013-03-05 | 2015-12-09 | 英国电讯有限公司 | Video data provision |
| WO2016114462A1 (en) * | 2015-01-13 | 2016-07-21 | 주식회사 위즈메타 | User interface method for video file block combination |
| CN106295840A (en) * | 2015-06-09 | 2017-01-04 | 北京福田康明斯发动机有限公司 | A kind of optimize the method for production line operation, device and production line |
| CN107766823A (en) * | 2017-10-25 | 2018-03-06 | 中国科学技术大学 | Anomaly detection method in video based on key area feature learning |
-
2021
- 2021-07-07 CN CN202110768358.9A patent/CN113453074A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000261757A (en) * | 1999-03-10 | 2000-09-22 | Nippon Telegr & Teleph Corp <Ntt> | Method and system for classifying video block for edit and recording medium recording this method |
| CN101082940A (en) * | 2006-05-31 | 2007-12-05 | 株式会社日立制作所 | Work movement analysis method, work movement analysis apparatus, and work movement analysis program |
| CN101452546A (en) * | 2007-12-07 | 2009-06-10 | 李郁贞 | Simulation job program learning and applying method |
| WO2012011641A1 (en) * | 2010-07-23 | 2012-01-26 | Lee Jin Yong | Method for analyzing a process to enhance productivity |
| CN103634533A (en) * | 2012-08-23 | 2014-03-12 | 广州春晓信息科技有限公司 | Working video analysis method and device |
| CN105144741A (en) * | 2013-03-05 | 2015-12-09 | 英国电讯有限公司 | Video data provision |
| WO2016114462A1 (en) * | 2015-01-13 | 2016-07-21 | 주식회사 위즈메타 | User interface method for video file block combination |
| CN106295840A (en) * | 2015-06-09 | 2017-01-04 | 北京福田康明斯发动机有限公司 | A kind of optimize the method for production line operation, device and production line |
| CN107766823A (en) * | 2017-10-25 | 2018-03-06 | 中国科学技术大学 | Anomaly detection method in video based on key area feature learning |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110750650A (en) | Construction method and device of enterprise knowledge graph | |
| CN109492875A (en) | Construction site role's management-control method based on BIM | |
| TW200619963A (en) | System and method for auditing a network | |
| CN108764610A (en) | Standard technology construction management of project method based on big data, storage medium | |
| Czumanski et al. | Integral analysis of labor productivity | |
| CN113741883B (en) | RPA lightweight data middling station system | |
| CN110730100A (en) | Alarm information processing method and device and server | |
| CN107276854B (en) | MOLAP statistical analysis method under big data | |
| CN113453074A (en) | Video multi-editing and time sequence analysis method | |
| CN103186713A (en) | Method and web application for OEE-analysis | |
| US7844601B2 (en) | Quality of service feedback for technology-neutral data reporting | |
| CN113255307A (en) | Intelligent reporting method and system for power system | |
| Trzcionkowska et al. | Practical aspects of event logs creation for industrial process modelling | |
| CN1536517A (en) | Personal achievement check system and method | |
| CN101546273B (en) | Method for forecasting execution time of software process | |
| CN111143304A (en) | Micro-service system abnormal log analysis method based on request link | |
| Skoogh et al. | Time-consumption analysis of input data activities in discrete event simulation projects | |
| CN114757658A (en) | Nuclear facility decommissioning simulation process and cost estimation method and system | |
| Schreiber et al. | Data Value chains in manufacturing: data-based process transparency through traceability and process mining | |
| KR20180131018A (en) | Real-time 3d facility monitoring system | |
| CN112667469A (en) | Method, system and readable medium for automatically generating diversified big data statistical report | |
| CN1704947A (en) | Mold processing productivity load disposal system and method | |
| CN1588361A (en) | Method for expression data digging flow | |
| CN114202158A (en) | Production data processing method based on python technology | |
| JP2013225317A (en) | Data collection device, and control method and control program for the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210928 |