CN115129927A - Monitoring video stream backtracking method, electronic equipment and storage medium - Google Patents
Monitoring video stream backtracking method, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN115129927A CN115129927A CN202210986507.3A CN202210986507A CN115129927A CN 115129927 A CN115129927 A CN 115129927A CN 202210986507 A CN202210986507 A CN 202210986507A CN 115129927 A CN115129927 A CN 115129927A
- Authority
- CN
- China
- Prior art keywords
- event information
- stage
- video stream
- user
- current stage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 81
- 238000000034 method Methods 0.000 title claims abstract description 36
- 238000004590 computer program Methods 0.000 claims description 9
- 238000004891 communication Methods 0.000 description 5
- 238000010191 image analysis Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 239000000284 extract Substances 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/73—Querying
- G06F16/735—Filtering based on additional data, e.g. user or group profiles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/71—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/73—Querying
- G06F16/732—Query formulation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/7837—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using objects detected or recognised in the video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/7844—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using original textual content or text extracted from visual content or transcript of audio data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Library & Information Science (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The application relates to the technical field of video monitoring, and particularly provides a monitoring video stream backtracking method, electronic equipment and a storage medium, wherein the method comprises the following steps: generating a plurality of event information according to the monitoring video stream; dividing the monitoring video stream according to the event information to obtain corresponding monitoring video segments; after the user selects event information at the current stage, pushing a plurality of pieces of event information at the next stage related to the event information selected at the current stage based on the event information selected at the current stage until the user stops selecting the event information; combining all event information selected by a user to generate an event chain; extracting corresponding monitoring video clips according to the event chain and integrating the corresponding monitoring video clips into a backtracking video; the method can effectively reduce the labor intensity of the backtracking of the monitoring video stream and improve the convenience of the backtracking of the monitoring video stream.
Description
Technical Field
The application relates to the technical field of video monitoring, in particular to a monitoring video stream backtracking method, electronic equipment and a storage medium.
Background
The video monitoring technology mainly comprises audio and video data acquisition, data playback and data storage. The basic working principle of the video monitoring system is that an audio and video acquisition device, such as a camera, is used for acquiring video information, and then an encoder is used for encoding, so that video data are digitized. The digitized video data, except for real-time monitoring, generally needs to be stored for subsequent review.
At present, in the fields of production management, quality management, security protection and the like, video online monitoring is only stored in different time periods, when a monitored video stream needs to be backtracked, all contents need to be retrieved according to time, and a required monitored video segment needs to be found out from the retrieved contents.
In view of the above problems, no effective technical solution exists at present.
Disclosure of Invention
The application aims to provide a surveillance video stream backtracking method, an electronic device and a storage medium, which can effectively reduce the labor intensity of surveillance video stream backtracking.
In a first aspect, the present application provides a surveillance video stream backtracking method, which includes the steps of:
generating a plurality of event information according to the monitoring video stream;
dividing the monitoring video stream according to the event information to obtain corresponding monitoring video segments;
after a user selects event information at the current stage, pushing a plurality of next-stage event information related to the event information selected at the current stage based on the event information selected at the current stage until the user stops selecting the event information;
combining all the event information selected by the user to generate an event chain;
and extracting corresponding monitoring video clips according to the event chain and integrating the corresponding monitoring video clips into a backtracking video.
The application provides a surveillance video stream backtracking method, which comprises the steps of firstly segmenting a surveillance video stream according to a plurality of event information to obtain surveillance video segments, then combining all event information selected by a user to generate an event chain, finally extracting corresponding surveillance video segments according to the event chain and integrating the corresponding surveillance video segments into a backtracking video, since the selected object of the user is the event information, and after the user selects the event information at the current stage, the method pushes a plurality of event information of the next stage related to the selected event information of the current stage, therefore, when the monitoring video stream needs to be backtracked, the user can obtain the backtracking video only by selecting the event information, namely the user does not need to search all the contents in the monitoring video stream according to time, therefore, the labor intensity of the backtracking of the monitoring video stream is effectively reduced, and the convenience of the backtracking of the monitoring video stream is improved.
Optionally, the event information includes a plurality of tags, and after the user selects an event information at a current stage, the step of pushing a plurality of event information at a next stage related to the event information selected at the current stage based on the event information selected at the current stage until the user terminates selecting the event information includes:
after a user selects event information at the current stage, setting the event information which is not selected yet and has the same label quantity with the event information selected at the current stage and is more than or equal to a preset first threshold value as the event information of the next stage, and pushing the event information of the next stage until the user stops selecting the event information.
Optionally, the event information includes four tags, the preset first threshold is three, and after the user selects one event information of the current stage, the event information that is not selected yet and has the same number of tags as the event information of the current stage that is greater than or equal to three is set as the event information of the next stage.
Optionally, after the user selects more than two pieces of event information, analyzing the selection preference of the user according to the selected event information, and pushing a plurality of next-stage event information related to the event information selected at the current stage based on the selection preference.
Optionally, the step of analyzing the user's selection preferences according to the selected event information includes:
acquiring a common label in the selected event information;
analyzing the selection preference of the user according to the common label.
Optionally, the event information includes a tag, and after the user selects an event information at a current stage, pushing event information of a plurality of next stages related to the event information selected at the current stage based on the event information selected at the current stage until the user terminates selecting the event information includes:
and after the user selects event information at the current stage, setting the event information which is not selected yet and has the similarity with the event information selected at the current stage greater than or equal to a preset second threshold value as the event information of the next stage, and pushing the event information of the next stage until the user terminates the selection of the event information.
Optionally, the step of dividing the surveillance video stream according to the event information to obtain corresponding surveillance video segments includes:
adding a first identification point and a second identification point in the monitoring video stream according to the event information;
and segmenting the monitoring video stream based on the first identification point and the second identification point to obtain a corresponding monitoring video segment.
Optionally, the step of dividing the surveillance video stream according to the event information to obtain corresponding surveillance video segments and the step of pushing a plurality of next-stage event information related to the event information selected at the current stage based on the event information selected at the current stage after the user selects an event information at the current stage until the user terminates selecting the event information further includes the steps of:
and analyzing the selection tendency of the user according to the historical record of the event information selected by the user, and pushing the event information of the first stage based on the selection tendency.
In a second aspect, the present application further provides an electronic device, comprising a processor and a memory, where the memory stores computer-readable instructions, and the computer-readable instructions, when executed by the processor, perform the steps of the method as provided in the first aspect.
In a third aspect, the present application also provides a storage medium having a computer program stored thereon, where the computer program runs the steps of the method as provided in the first aspect when executed by a processor.
From the above, the surveillance video stream backtracking method, the electronic device and the storage medium provided by the present application divide the surveillance video stream according to a plurality of event information to obtain surveillance video segments, combine all event information selected by the user to generate an event chain, extract corresponding surveillance video segments according to the event chain and integrate into a backtracking video, since the user's selection object is event information, and after the user selects event information at the current stage, the method pushes a plurality of event information of the next stage related to the selected event information of the current stage, therefore, when the monitoring video stream needs to be backtracked, the user can obtain the backtracking video only by selecting the event information, namely the user does not need to search all the contents in the monitoring video stream according to time, therefore, the labor intensity of the backtracking of the monitoring video stream is effectively reduced, and the convenience of the backtracking of the monitoring video stream is improved.
Additional features and advantages of the present application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the embodiments of the present application. The objectives and other advantages of the application may be realized and attained by the structure particularly pointed out in the written description and drawings.
Drawings
Fig. 1 is a flowchart of a surveillance video stream backtracking method according to an embodiment of the present disclosure.
Fig. 2 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Reference numerals: 101. a processor; 102. a memory; 103. a communication bus.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
In a first aspect, as shown in fig. 1, the present application provides a surveillance video stream backtracking method, which includes the steps of:
s1, generating a plurality of event information according to the monitoring video stream;
s2, dividing the monitoring video stream according to the event information to obtain corresponding monitoring video segments;
s3, after the user selects the event information at the current stage, pushing a plurality of event information at the next stage related to the event information selected at the current stage based on the event information selected at the current stage until the user stops selecting the event information;
s4, combining all event information selected by the user to generate an event chain;
and S5, extracting corresponding monitoring video clips according to the event chain and integrating the corresponding monitoring video clips into a backtracking video.
The event information in step S1 may be a tag, an entry, semantic information, or the like, and in step S1, the video stream may be automatically analyzed by using an existing image analysis algorithm, an existing image analysis model, an existing video analysis algorithm, or an existing video analysis model, to generate corresponding event information. For example, for a parking lot video, the existing image analysis algorithm analyzes that a vehicle with a license plate A and a vehicle type B enters a parking lot, and if event information is a label, the event information comprises two labels of the license plate A and the vehicle type B in the video; for example, for a production-type video, the conventional image analysis model analyzes that the workpiece C is processed in the device D, and if the event information is semantic information, the event information is that the device D processes the workpiece C. Since the monitoring video stream includes a plurality of events, step S1 may generate a plurality of event information according to the monitoring video stream. It should be understood that event information may include several tags, several entries or several semantics, and different event information may include different numbers of tags, entries or semantics, e.g. one event information includes four tags and another event information includes five tags.
The surveillance video segment of step S2 is a video segment corresponding to one of the events, and since one event information represents one event in the surveillance video stream and the surveillance video stream includes a plurality of events, step S2 may segment the surveillance video stream according to the event information to obtain the surveillance video segment.
The work flow of step S3 is: 1. after a user selects event information from a plurality of event information at the current stage, acquiring a plurality of next-stage event information based on the event information selected at the current stage, wherein the next-stage event information is the event information which is not selected and is related to the event information selected at the current stage; 2. pushing event information of the next stage; 3. and circularly executing the step 1 and the step 2 until the user terminates the selection of the event information. Step 1 may obtain event information related to the event information selected at the current stage by determining whether the matching degree or the similarity between the event information not selected and the event information selected at the current stage is greater than or equal to a preset second threshold, and if the matching degree or the similarity between the event information not selected and the event information selected at the current stage is less than the preset second threshold, the event information is considered to be unrelated to the event information selected at the current stage. Step 2 may push the event information of the next stage to the user by adopting a direct push manner, or step 2 may push the event information of the next stage to the user by adopting an indirect push manner, for example, the event information of all the next stages is firstly sorted into a catalog or an index, and then the catalog or the index is pushed to the user.
After the user terminates the selection of the event information, step S4 combines all the event information selected by the user in the order in which the event information was selected by the user to generate an event chain. After the event chain is generated, step S5 extracts the surveillance video clips corresponding to the event information in the event chain from the surveillance video stream according to the event chain, and integrates all the extracted surveillance video clips into a backtracking video.
The working principle of the embodiment is as follows: because one event information corresponds to one event in the surveillance video stream, and the surveillance video segment is a video segment corresponding to one event in the surveillance video stream, that is, one event information corresponds to one surveillance video segment, when the surveillance video stream needs to be traced back, a user only needs to select a plurality of event information to obtain the corresponding traced back video, so that the user does not need to search all contents in the surveillance video stream according to time, thereby effectively reducing the labor intensity of tracing back the surveillance video stream and improving the convenience of tracing back the surveillance video stream.
The application provides a surveillance video stream backtracking method, which comprises the steps of firstly segmenting a surveillance video stream according to a plurality of event information to obtain surveillance video segments, then combining all event information selected by a user to generate an event chain, finally extracting corresponding surveillance video segments according to the event chain and integrating the corresponding surveillance video segments into a backtracking video, since the selected object of the user is the event information, and after the user selects the event information at the current stage, the method pushes a plurality of event information of the next stage related to the selected event information of the current stage, therefore, when the monitoring video stream needs to be backtracked, the user can obtain the backtracking video only by selecting the event information, namely the user does not need to search all the contents in the monitoring video stream according to time, therefore, the labor intensity of the backtracking of the monitoring video stream is effectively reduced, and the convenience of the backtracking of the monitoring video stream is improved.
In some embodiments, step S5 includes the steps of:
s51, extracting corresponding monitoring video clips according to the event chain;
s52, sequencing the monitoring video clips according to the sequence of the event information in the event chain;
and S53, integrating the sequenced monitoring video clips into a backtracking video.
After the corresponding surveillance video segments are extracted, the extracted surveillance video segments are sorted according to the arrangement sequence of the event information in the event chain, and because the event information selected at the current stage is related to the event information at the next stage and the event information in the event chain is sorted according to the relevance when the event information is selected, the embodiment is equivalent to sorting the surveillance video segments according to the relevance of the surveillance video segments and integrating the sorted surveillance video segments into the backtracking video.
Since the event information of the next stage is only the event information related to the event information selected at the current stage, the event information of the next stage may occur before the event information selected at the current stage, and the above embodiment generates the event chain according to the order of the event information selected by the user, a situation that the next extracted surveillance video clip occurs before the currently extracted surveillance video clip may occur, thereby resulting in low fluency of the backtracking video. To solve this technical problem, in some embodiments, step S5 includes the steps of:
s51', extracting corresponding monitoring video clips according to the event chain;
s52', sorting the extracted monitoring video clips according to the sequence of the monitoring video clips in the monitoring video stream;
s53', the sequenced monitoring video clips are integrated into a backtracking video.
After the extraction of the corresponding surveillance video segments is completed, the extracted surveillance video segments are sequenced according to the sequence of the surveillance video segments in the surveillance video stream, and the sequenced surveillance video segments are integrated into the backtracking video, so that the situation that the next extracted surveillance video segment occurs before the currently extracted surveillance video segment is effectively avoided, and the fluency of the backtracking video is effectively improved.
In some embodiments, the event information includes a plurality of tags, and step S3 includes:
and S31, after the user selects the event information at the current stage, setting the event information which is not selected yet and has the same label quantity with the event information selected at the current stage as the event information of the next stage, wherein the label quantity is larger than or equal to a preset first threshold value, and pushing the event information of the next stage until the user terminates the selection of the event information.
Each event information comprises a plurality of labels, for example, for a production video, the labels can be job numbers, batch numbers, product types, equipment models, production time and the like; for example, for an office building video, the labels may be time, floor, location, role, etc.; for example, for a traffic video, the labels may be a license plate, a vehicle type, time, the number of vehicles, and the like. The first threshold is a preset value, and those skilled in the art can adjust the size of the first threshold according to actual needs, and the determination logic of step S31 is: if the number of the same tags of the event information selected at the current stage and the event information not selected yet is larger than or equal to a first threshold value, the event information not selected yet is considered to be related to the event information selected at the current stage; and if the number of the same tags of the event information selected in the current stage and the event information not selected yet is less than a first threshold value, the event information not selected yet is considered to be irrelevant to the event information selected in the current stage. Step S31 is to acquire all event information having the same tag number as that of the event information selected at the current stage or greater than or equal to the first threshold from the event information not yet selected, set all the acquired event information as the event information at the next stage and push the event information at the next stage, and repeat the two steps until the user terminates the selection of the event information. For example, each event message includes four tags, the preset first threshold is three, and after a user selects a current stage of event messages, event messages that have not been selected yet and have the same number of tags as the current stage of event messages greater than or equal to three are set as next stage of event messages. The embodiment quickly determines the event information of the next stage by comparing the same tag number of the event information which has not been selected with the event information selected at the current stage with the first threshold value.
In some embodiments, the event information includes a tag, and step S3 includes:
s31', when the user selects an event information at the current stage, setting all the event information that has not been selected yet and whose similarity to the event information selected at the current stage is greater than or equal to a preset second threshold as the event information at the next stage, and pushing the event information at the next stage until the user terminates selecting the event information.
Each event message includes a label, the label may be a numeric string or a character string, or the label may be a semantic conversion of multiple labels in the previous embodiment, for example, the label in the previous embodiment includes an employee a, a time B, and a job C, and the label in this embodiment is that the employee a performs the job C at the time B. The second threshold is a preset value, and the logic of step S31' is: if the label similarity between the event information selected at the current stage and the event information not selected is greater than or equal to a second threshold value, the event information not selected is considered to be related to the event information selected at the current stage; and if the label similarity between the event information selected at the current stage and the event information which is not selected yet is smaller than a second threshold value, the event information which is not selected yet is considered to be irrelevant to the event information selected at the current stage. Step S31' first obtains all event information whose similarity with the event information selected at the current stage is greater than or equal to the second threshold from the event information that has not been selected, then sets all the obtained event information as the event information at the next stage and pushes the event information at the next stage, and repeats these two steps until the user terminates selecting the event information. The embodiment quickly determines the event information of the next stage by comparing the label similarity of the event information which is not selected and the event information selected at the current stage with a second threshold value.
In some embodiments, after the user selects more than two pieces of event information, the selection preference of the user is analyzed according to the selected event information, and a plurality of pieces of event information of a next stage related to the event information selected at the current stage are pushed based on the selection preference. Wherein the selection preference indicates which event information the user prefers to select when selecting event information. Specifically, the step of analyzing the user's selection preferences based on the selected event information includes: acquiring a common label in the selected event information; analyzing the user's selection preferences based on the common labels. The common label can represent the label selected by the user each time the event information is selected, so that the common label can reflect which labels the user likes to select when the event information is selected, namely the selection preference of the user can be analyzed according to the common label. When the user selects more than two pieces of event information, the embodiment can analyze the selection preference of the user according to the selected event information and push the event information of a plurality of next stages based on the selection preference, so that the pushed event information of the next stages is more suitable for the requirements of the user.
In some embodiments, step S2 includes:
s21, adding a first identification point and a second identification point in the monitoring video stream according to the event information;
and S22, dividing the monitoring video stream based on the first identification point and the second identification point to obtain corresponding monitoring video segments.
In step S21, a first identification point is added at the start time of the event information, and a second identification point is added at the end time of the event information, for example, employee a starts work C at time B and ends work C at time D, the first identification point is added at the time corresponding to time B in the surveillance video stream, and the second identification point is added at the time corresponding to time D in the surveillance video stream. Step S22 is to segment the surveillance video stream based on the first identification point and the second identification point, where the video segment between the first identification point and the second identification point is the surveillance video segment.
Since there may be overlapping portions in different surveillance video segments, there may be repeated segments in the integrated backtracking video, thereby resulting in a reduced backtracking experience for the user. In order to solve the technical problem, in some embodiments, before integrating the extracted surveillance video segments into a backtracking video, whether different surveillance video segments have overlapping segments is detected according to a first identification point and a second identification point of the surveillance video segments, if yes, the overlapping segments in the surveillance video segments are removed, and then the surveillance video segments are integrated into the backtracking video; if not, directly integrating the monitoring video stream into the backtracking video. Before the backtracking video is integrated, the embodiment can detect whether different monitoring video segments have overlapped segments or not, and if the overlapped segments exist, the overlapped segments can be removed, so that the backtracking video integrated by the embodiment cannot have repeated segments, and the backtracking experience of a user is effectively improved.
In some embodiments, step S6 is further included between step S2 and step S3:
and analyzing the selection tendency of the user according to the historical record of the event information selected by the user, and pushing the event information in the first stage based on the selection tendency.
The history record is a record of event information selected by a user before, and the event information with the most or more selection times in the history record is generally event information preferred to be selected by the user, that is, the event information with the most or more selection times in the history record can reflect which event information the user tends to select when selecting the event information, so that the selection tendency of the user can be analyzed according to the history record of the event information selected by the user, and after the selection tendency of the user is analyzed, the event information of the first stage is pushed according to the selection tendency, so that the user can select the event information of the first stage more quickly and conveniently. For example, for production-type videos, the history of the user is that the user frequently selects tags with a product type A and a device model B before, so the analyzed selection tendency is that the user tends to select event information of the tags including the product type A and the device model B, and the event information of the first stage of pushing includes the product type A and the device signal B; for example, in the case of an office building video, the history of the user is that the user frequently selects the label of the floor C before, so the analyzed selection tendency is that the user tends to select the event information including the label of the floor C, and the event information of the first stage of push includes the floor C.
From the above, the surveillance video stream backtracking method provided by the present application includes segmenting a surveillance video stream according to a plurality of event information to obtain surveillance video segments, combining all event information selected by a user to generate an event chain, extracting corresponding surveillance video segments according to the event chain and integrating the corresponding surveillance video segments into a backtracking video, since the user's selection object is event information, and after the user selects event information at the current stage, the method pushes a plurality of event information of the next stage related to the selected event information of the current stage, therefore, when the monitoring video stream needs to be backtracked, the user can obtain the backtracking video only by selecting the event information, namely the user does not need to search all the contents in the monitoring video stream according to time, therefore, the labor intensity of the backtracking of the monitoring video stream is effectively reduced, and the convenience of the backtracking of the monitoring video stream is improved.
In a second aspect, please refer to fig. 2, where fig. 2 is a schematic structural diagram of an electronic device according to an embodiment of the present application, and the present application provides an electronic device including: a processor 101 and a memory 102, the processor 101 and the memory 102 being interconnected and communicating with each other via a communication bus 103 and/or other form of connection mechanism (not shown), the memory 102 storing a computer program executable by the processor 101, the computer program being executed by the processor 101 when the electronic device is running to perform the method in any alternative implementation of the embodiment to implement the following functions: generating a plurality of event information according to the monitoring video stream; segmenting the monitoring video stream according to the event information to obtain corresponding monitoring video segments; after the user selects event information at the current stage, pushing a plurality of next-stage event information related to the event information selected at the current stage based on the event information selected at the current stage until the user stops selecting the event information; combining all event information selected by a user to generate an event chain; and extracting corresponding monitoring video clips according to the event chain and integrating the corresponding monitoring video clips into a backtracking video.
In a third aspect, the present application provides a storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the computer program executes the method in any optional implementation manner of the embodiments to implement the following functions: generating a plurality of event information according to the monitoring video stream; dividing the monitoring video stream according to the event information to obtain corresponding monitoring video segments; after the user selects event information at the current stage, pushing a plurality of next-stage event information related to the event information selected at the current stage based on the event information selected at the current stage until the user stops selecting the event information; combining all event information selected by a user to generate an event chain; and extracting corresponding monitoring video clips according to the event chain and integrating the corresponding monitoring video clips into a backtracking video. The storage medium may be implemented by any type of volatile or nonvolatile storage device or combination thereof, such as a Static Random Access Memory (SRAM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), an Erasable Programmable Read-Only Memory (EPROM), a Programmable Read-Only Memory (PROM), a Read-Only Memory (ROM), a magnetic Memory, a flash Memory, a magnetic disk, or an optical disk.
From the above, the surveillance video stream backtracking method, the electronic device and the storage medium provided by the present application divide the surveillance video stream according to a plurality of event information to obtain surveillance video segments, combine all event information selected by the user to generate an event chain, extract corresponding surveillance video segments according to the event chain and integrate into a backtracking video, since the user's selection object is event information, and after the user selects event information at the current stage, the method pushes a plurality of event information of next stage related to the selected event information of current stage, therefore, when the monitoring video stream needs to be backtracked, the user can obtain the backtracking video only by selecting the event information, namely the user does not need to search all the contents in the monitoring video stream according to time, therefore, the labor intensity of the backtracking of the monitoring video stream is effectively reduced, and the convenience of the backtracking of the monitoring video stream is improved.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, for example, the division of the above-described units is only a logical functional division, and other division manners may be available in actual implementation, and for example, a plurality of units or components may be combined or integrated into another robot, or some features may be omitted or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
In addition, units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may ascend to one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
Furthermore, the functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (10)
1. A surveillance video stream backtracking method is characterized by comprising the following steps:
generating a plurality of event information according to the monitoring video stream;
dividing the monitoring video stream according to the event information to obtain corresponding monitoring video segments;
after a user selects event information at the current stage, pushing a plurality of next-stage event information related to the current-stage selected event information based on the current-stage selected event information until the user terminates selecting the event information;
combining all event information selected by the user to generate an event chain;
and extracting corresponding monitoring video clips according to the event chain and integrating the corresponding monitoring video clips into a backtracking video.
2. The surveillance video stream backtracking method according to claim 1, wherein the event information comprises a plurality of tags, and the step of pushing a plurality of next-stage event information related to the current-stage selected event information based on the current-stage selected event information after the user selects an event information at the current stage comprises:
after a user selects event information at the current stage, setting the event information which is not selected yet and has the same label quantity with the event information selected at the current stage and is larger than or equal to a preset first threshold value as the event information of the next stage, and pushing the event information of the next stage until the user terminates selecting the event information.
3. The method according to claim 2, wherein the event information includes four tags, the preset first threshold is three, and after the user selects one event information of the current stage, the event information that is not selected yet and has the same number of tags as the event information of the current stage that is greater than or equal to three is set as the event information of the next stage.
4. The method of claim 2, wherein after the user selects two or more pieces of event information, the user's selection preferences are analyzed according to the selected event information, and event information of several next stages related to the event information selected at the current stage is pushed based on the selection preferences.
5. The surveillance video stream backtracking method of claim 4, wherein the step of analyzing the user's selection preferences based on the selected event information comprises:
acquiring a common label in the selected event information;
analyzing the user's selection preferences based on the common tags.
6. The method as claimed in claim 1, wherein the event information includes a tag, and the step of pushing a plurality of event information of next stage related to the event information selected at the current stage based on the event information selected at the current stage after the user selects the event information at the current stage comprises:
after a user selects event information at the current stage, setting all event information which is not selected yet and has similarity with the event information selected at the current stage larger than or equal to a preset second threshold value as the event information of the next stage, and pushing the event information of the next stage until the user stops selecting the event information.
7. The surveillance video stream backtracking method according to claim 1, wherein the step of segmenting the surveillance video stream according to the event information to obtain corresponding surveillance video segments comprises:
adding a first identification point and a second identification point in the monitoring video stream according to the event information;
and segmenting the surveillance video stream based on the first identification point and the second identification point to obtain corresponding surveillance video segments.
8. The surveillance video stream backtracking method according to claim 1, wherein the step of dividing the surveillance video stream according to the event information to obtain corresponding surveillance video segments and the step of pushing a plurality of event information of a next stage related to the event information selected at the current stage based on the event information selected at the current stage after the user selects the event information at the current stage further comprises the steps of:
and analyzing the selection tendency of the user according to the historical record of the event information selected by the user, and pushing the event information of the first stage based on the selection tendency.
9. An electronic device comprising a processor and a memory, said memory storing computer readable instructions which, when executed by said processor, perform the steps of the method according to any one of claims 1 to 8.
10. A storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, performs the steps of the method according to any one of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210986507.3A CN115129927B (en) | 2022-08-17 | 2022-08-17 | Monitoring video stream backtracking method, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210986507.3A CN115129927B (en) | 2022-08-17 | 2022-08-17 | Monitoring video stream backtracking method, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115129927A true CN115129927A (en) | 2022-09-30 |
| CN115129927B CN115129927B (en) | 2023-05-02 |
Family
ID=83387745
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210986507.3A Active CN115129927B (en) | 2022-08-17 | 2022-08-17 | Monitoring video stream backtracking method, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115129927B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101860731A (en) * | 2010-05-20 | 2010-10-13 | 杭州普维光电技术有限公司 | Video information processing method, system and server |
| CN105141915A (en) * | 2015-08-26 | 2015-12-09 | 广东创我科技发展有限公司 | Video searching method and video searching system |
| US20160093338A1 (en) * | 2014-07-07 | 2016-03-31 | Google Inc. | Method and System for Categorizing Detected Motion Events |
| CN106411927A (en) * | 2016-10-28 | 2017-02-15 | 北京奇虎科技有限公司 | Monitoring video recording method and device |
| CN107483879A (en) * | 2016-06-08 | 2017-12-15 | 中兴通讯股份有限公司 | Video marker method, apparatus and video frequency monitoring method and system |
| CN109361904A (en) * | 2018-11-21 | 2019-02-19 | 佛山市云团科技有限公司 | A kind of monitor video slice storage method and system |
| CN113347502A (en) * | 2021-06-02 | 2021-09-03 | 宁波星巡智能科技有限公司 | Video review method, video review device, electronic equipment and medium |
| CN113556485A (en) * | 2021-07-23 | 2021-10-26 | 上海商汤智能科技有限公司 | Video generation method and device, electronic equipment and storage medium |
| CN114758271A (en) * | 2022-03-24 | 2022-07-15 | 京东科技信息技术有限公司 | Video processing method, device, computer equipment and storage medium |
-
2022
- 2022-08-17 CN CN202210986507.3A patent/CN115129927B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101860731A (en) * | 2010-05-20 | 2010-10-13 | 杭州普维光电技术有限公司 | Video information processing method, system and server |
| US20160093338A1 (en) * | 2014-07-07 | 2016-03-31 | Google Inc. | Method and System for Categorizing Detected Motion Events |
| CN105141915A (en) * | 2015-08-26 | 2015-12-09 | 广东创我科技发展有限公司 | Video searching method and video searching system |
| CN107483879A (en) * | 2016-06-08 | 2017-12-15 | 中兴通讯股份有限公司 | Video marker method, apparatus and video frequency monitoring method and system |
| CN106411927A (en) * | 2016-10-28 | 2017-02-15 | 北京奇虎科技有限公司 | Monitoring video recording method and device |
| CN109361904A (en) * | 2018-11-21 | 2019-02-19 | 佛山市云团科技有限公司 | A kind of monitor video slice storage method and system |
| CN113347502A (en) * | 2021-06-02 | 2021-09-03 | 宁波星巡智能科技有限公司 | Video review method, video review device, electronic equipment and medium |
| CN113556485A (en) * | 2021-07-23 | 2021-10-26 | 上海商汤智能科技有限公司 | Video generation method and device, electronic equipment and storage medium |
| CN114758271A (en) * | 2022-03-24 | 2022-07-15 | 京东科技信息技术有限公司 | Video processing method, device, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115129927B (en) | 2023-05-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108520270B (en) | Part matching method, system and terminal | |
| CN110704603A (en) | Method and device for discovering current hot event through information | |
| CN112800061B (en) | Data storage method, device, server and storage medium | |
| CN112055172A (en) | Method and device for processing monitoring video and storage medium | |
| CN111881320A (en) | Video query method, device, equipment and readable storage medium | |
| CN112200067A (en) | Intelligent video event detection method, system, electronic equipment and storage medium | |
| CN110869942A (en) | Self-feedback deep learning method and system | |
| CN112445915A (en) | Document map extraction method and device based on machine learning and storage medium | |
| CN110807050B (en) | Performance analysis method, device, computer equipment and storage medium | |
| CN111476685A (en) | Behavior analysis method, device and equipment | |
| CN110704699A (en) | Data image construction method and device, computer equipment and storage medium | |
| CN112231272B (en) | Information processing method based on remote online office and computer equipment | |
| CN115129927A (en) | Monitoring video stream backtracking method, electronic equipment and storage medium | |
| CN112214737A (en) | Method, system, device and medium for identifying picture-based fraudulent webpage | |
| CN109635688B (en) | Method and system for managing books on bookshelf based on image recognition | |
| CN108170838B (en) | Topic evolution visualization display method, application server and computer readable storage medium | |
| CN110322391A (en) | Visual alarm affair analytical method based on multithreading | |
| CN115205584A (en) | Product SKU classification method, storage medium and electronic equipment | |
| CN112232295B (en) | Method and device for confirming newly-added target ship and electronic equipment | |
| CN114116811A (en) | Log processing method, device, equipment and storage medium | |
| CN112434071B (en) | Metadata blood relationship and influence analysis platform based on data map | |
| CN113918762A (en) | Method, device and equipment for processing video structured information and storage medium | |
| CN114331569A (en) | User consumption behavior analysis method and system for different scenes in business space | |
| CN112528893A (en) | Abnormal state identification method and device and computer readable storage medium | |
| CN113706207A (en) | Order transaction rate analysis method, device, equipment and medium based on semantic analysis |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |