CN113891163B - Video key information processing method, device, storage medium and equipment - Google Patents
Video key information processing method, device, storage medium and equipment Download PDFInfo
- Publication number
- CN113891163B CN113891163B CN202010634509.7A CN202010634509A CN113891163B CN 113891163 B CN113891163 B CN 113891163B CN 202010634509 A CN202010634509 A CN 202010634509A CN 113891163 B CN113891163 B CN 113891163B
- Authority
- CN
- China
- Prior art keywords
- value
- characteristic data
- characteristic
- key information
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000010365 information processing Effects 0.000 title claims description 18
- 238000003672 processing method Methods 0.000 title claims description 10
- 238000000034 method Methods 0.000 claims abstract description 56
- 238000012545 processing Methods 0.000 claims abstract description 33
- 238000012512 characterization method Methods 0.000 claims description 21
- 230000011218 segmentation Effects 0.000 claims description 20
- 238000004590 computer program Methods 0.000 claims description 7
- 230000004044 response Effects 0.000 claims description 7
- 230000008859 change Effects 0.000 abstract description 17
- 230000000694 effects Effects 0.000 abstract description 6
- 239000002609 medium Substances 0.000 description 13
- 230000008569 process Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 239000012120 mounting media Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/91—Television signal processing therefor
- H04N5/93—Regeneration of the television signal or of selected parts thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Abstract
The embodiment of the application discloses a method, a device, a storage medium and equipment for processing key information of video. The method comprises the following steps: responding to the acquisition request of the video data, and acquiring the video data and the characteristic data of the key information; segmenting the characteristic data according to the video playback time length, and determining an upper limit value and a lower limit value of the characteristic data; determining a characteristic curve in the video playback time length according to the difference ratio of the upper limit value and the lower limit value; and displaying the characteristic curve on a video playback interface so as to enable a user to determine key information of the video. By executing the scheme, the key information in the video can be determined according to the change condition of the concerned key feature by recording the change of the key feature and displaying the key information to the user during video playback, so that the determination of the key information meets the requirement of the user, and the effect of assisting the user in rapidly determining the occurrence time of the key information in the video can be realized.
Description
Technical Field
The embodiment of the application relates to the technical field of video processing, in particular to a method, a device, a storage medium and equipment for processing key information of video.
Background
In the process of recording and playing back video, in order to be able to pay attention to the key information of the video quickly, many users often browse the video quickly, which can lead to the problem of incomplete video information reception, but can save a great deal of time and cost for the users. Especially for the surveillance video of security protection, it is important to control key information. The key information may be information important for the user to browse the video, such as the number of people in the video, the key people, the ambient temperature at the time of shooting, the picture temperature, and the like. The traditional key information is often marked based on image recognition or manual annotation and other forms, a user can view related prompts to further view the key information when playing back the video, the key information recognition mode is not strict, and is often determined in an auxiliary mode according to a preset mode or other existing modes, so that excessive or missed alarms are caused, the key information is difficult to control by the user, and the problem that the prompt of the key information is difficult to provide effective auxiliary effects for the user is caused.
Disclosure of Invention
The embodiment of the application provides a method, a device, a storage medium and equipment for processing key information of a video, which can record the change of key characteristics and display the key information to a user during video playback, so that the user can determine the key information in the video according to the change condition of the concerned key characteristics, thereby realizing the effect that the determination of the key information meets the requirement of the user and assisting the user in rapidly determining the occurrence time of the key information in the video.
In a first aspect, an embodiment of the present application provides a method for processing key information of a video, where the method includes:
responding to the acquisition request of the video data, and acquiring the video data and the characteristic data of the key information;
segmenting the characteristic data according to the video playback time length, and determining an upper limit value and a lower limit value of the characteristic data;
determining a characteristic curve in the video playback time length according to the difference ratio of the upper limit value and the lower limit value;
and displaying the characteristic curve on a video playback interface so as to enable a user to determine key information of the video.
Further, the key information comprises instant key information;
correspondingly, the segmentation processing is carried out on the characteristic data according to the video playback time length, and the upper limit value and the lower limit value of the characteristic data are determined, which comprises the following steps:
Segmenting the feature data according to the video playback time length to obtain at least two segmented feature data;
determining the average value of the characteristic data of each segment, and determining the phase difference degree value of each segment according to the difference value between the highest value of the characteristic data of each segment and the average value and the difference value between the lowest value of the characteristic data of each segment and the average value; and taking the highest value in the phase difference degree values of the segments and the lowest value in the phase difference degree values of the segments as an upper limit value and a lower limit value of the characteristic curve.
Further, the key information comprises statistical key information;
correspondingly, the segmentation processing is carried out on the characteristic data according to the video playback time length, and the upper limit value and the lower limit value of the characteristic data are determined, which comprises the following steps:
segmenting the feature data according to the video playback time length to obtain at least two segmented feature data;
determining the characteristic data of at least two sub-segments in each segment, and determining the sum of the characteristic data of each sub-segment as the characteristic data of each segment;
determining the average value of the characteristic data of each segment, and determining the phase difference degree value of each segment according to the difference value between the highest value of the characteristic data of each segment and the average value and the difference value between the lowest value of the characteristic data of each segment and the average value;
And taking the highest value in the phase difference degree values of the segments and the lowest value in the phase difference degree values of the segments as an upper limit value and a lower limit value of the characteristic curve.
Further, after taking the highest value of the phase difference degree values of the segments and the lowest value of the phase difference degree values of the segments as the upper limit value and the lower limit value of the characteristic curve, the method further comprises:
determining characteristic data characterization values of at least two sub-segments of characteristic data of each segment, and taking the characteristic data characterization values of the characteristic data of each sub-segment as characteristic points of the sub-segments forming a characteristic curve;
and connecting the characteristic points of all the sub-segments to form a characteristic curve of the characteristic data.
Further, determining characteristic data characterization values of at least two sub-segments of the characteristic data of each segment, and according to the characterization values of the characteristic data of each sub-segment, using the characteristic data characterization values as characteristic points of the sub-segments forming the characteristic curve, wherein the characteristic points comprise:
determining the maximum value of the characteristic data of the sub-segments or the minimum value of the characteristic data of the sub-segments in the characteristic data of at least two sub-segments of the characteristic data of each segment, and taking the maximum value or the minimum value of the characteristic data of the sub-segments as the characteristic data characterization value of at least two sub-segments of the characteristic data of each segment;
and determining the characteristic points of the sub-segments forming the characteristic curve according to the difference ratio of the characteristic value of the characteristic data of each sub-segment and the upper limit value or the lower limit value of the characteristic curve.
Further, the key information comprises statistical key information;
correspondingly, the segmentation processing is carried out on the characteristic data according to the video playback time length, and the upper limit value and the lower limit value of the characteristic data are determined, which comprises the following steps:
segmenting the feature data according to the video playback time length to obtain at least two segmented feature data;
determining the highest value and the lowest value of the characteristic data of each segment, and taking the highest value and the lowest value of the characteristic data of each segment as the upper limit value and the lower limit value of the characteristic curve;
or, the key information comprises instant key information; acquiring all the characteristic data in the video playback time length, determining the highest value and the lowest value in all the characteristic data, and taking the highest value and the lowest value in all the characteristic data as the upper limit value and the lower limit value of the characteristic curve respectively;
determining the difference ratio of the characteristic data of each segment to the upper limit value and the lower limit value as the characteristic point of each segment;
and connecting the characteristic points of all the segments to form a characteristic curve of the characteristic data.
Further, before acquiring the video data and the feature data of the key information, the method further includes:
displaying the type of the stored key information through a graphical interface;
Determining the key information of the target type in response to the selection operation of the type of the key information;
correspondingly, acquiring the video data and the characteristic data of the key information comprises the following steps:
and acquiring video data and characteristic data of the key information of the target type according to the key information of the target type.
In a second aspect, an embodiment of the present application provides a key information processing apparatus for video, including:
the characteristic data acquisition module is used for responding to the acquisition request of the video data and acquiring the characteristic data of the video data and the key information;
the upper limit value and lower limit value determining module is used for carrying out segmentation processing on the characteristic data according to the video playback time length and determining the upper limit value and the lower limit value of the characteristic data;
the characteristic curve determining module is used for determining a characteristic curve in the video playback time length according to the difference ratio of the upper limit value and the lower limit value;
and the key information display module is used for displaying the characteristic curve on a video playback interface so as to enable a user to determine the key information of the video.
In a third aspect, embodiments of the present application provide a computer-readable storage medium having stored thereon a computer program that, when executed by a processor, implements a method for processing key information of a video according to embodiments of the present application.
In a fourth aspect, embodiments of the present application provide an apparatus, including a memory, a processor, and a computer program stored on the memory and executable by the processor, where the processor implements a method for processing key information of a video according to embodiments of the present application when the computer program is executed by the processor.
According to the technical scheme provided by the embodiment of the application, the characteristic data of the video data and the key information are acquired in response to the acquisition request of the video data; segmenting the characteristic data according to the video playback time length, and determining an upper limit value and a lower limit value of the characteristic data; determining a characteristic curve in the video playback time length according to the difference ratio of the upper limit value and the lower limit value; and displaying the characteristic curve on a video playback interface so as to enable a user to determine key information of the video. By adopting the technical scheme provided by the application, the key information in the video can be determined by recording the change of the key characteristics and displaying the key information to the user during video playback according to the change condition of the concerned key characteristics, so that the determination of the key information meets the user requirement, and the effect of rapidly determining the occurrence time of the key information in the video can be assisted by the user.
Drawings
Fig. 1 is a flowchart of a method for processing key information of a video according to an embodiment of the present application;
FIG. 2 is a flowchart of a method for processing key information of a video according to an embodiment of the present application;
FIG. 3 is a flowchart of a method for processing key information of a video according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a key information processing apparatus for video provided in an embodiment of the present application;
fig. 5 is a schematic structural diagram of an apparatus according to an embodiment of the present application.
Detailed Description
The present application is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the application and not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present application are shown in the drawings.
Before discussing exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart depicts steps as a sequential process, many of the steps may be implemented in parallel, concurrently, or with other steps. Furthermore, the order of the steps may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figures. The processes may correspond to methods, functions, procedures, subroutines, and the like.
Fig. 1 is a flowchart of a method for processing key information of a video according to an embodiment of the present application, where the embodiment is applicable to determining key information when playing back a captured video, and the method may be performed by a device for processing key information of a video according to an embodiment of the present application, where the device may be implemented by software and/or hardware, and may be integrated in a device such as an intelligent terminal.
As shown in fig. 1, the key information processing method of the video includes:
s110, responding to the acquisition request of the video data, and acquiring the video data and the characteristic data of the key information.
The video data acquisition request may be a device terminal, such as a video monitor terminal, used by the front end to acquire and view video. It can be understood that the video mentioned in the scheme is not limited to the security monitoring video, but can be other types of video, such as video shot by other people, or recorded video, etc.
In general, video data may be stored in a server or in a video recording device, and thus, a video data acquisition request may be sent to the server or to a video recording device with storage capability, where the acquisition request may be accessed based on an address or may be based on sharing of the video recording device.
For a general video, taking a security monitoring video as an example, key information may be sound information, shooting environment temperature information, shooting picture temperature information, personnel information in a shooting picture, and the like. The sound information may be sound information recorded by a microphone or the like of the image pickup apparatus, and for example, the sound information may include frequency, amplitude, and the like of sound. The shooting environment temperature information can be the environment temperature acquired by a temperature sensor of the image pickup device, and the shooting picture temperature information can be the temperature value of each object in a picture captured by an infrared temperature sensor, and can be the picture temperature information of a frame of image obtained uniformly by sampling, averaging and other modes. The personnel information in the shooting picture can comprise the number of personnel, whether key persons exist or not, and the like, wherein the number of personnel can be instant data, for example, the number of the personnel in a certain frame of picture can be determined, and the statistics result can be obtained, for example, the number of the personnel passing through the shooting range in 5 seconds is counted. In addition, the key information may include other information.
In combination with the above example, the feature data of the key information may be a frequency value, an amplitude value, an ambient temperature value, a picture temperature value, and the number of persons passing through the shooting range in a certain time, etc. Under the general shooting requirement, 25 to 30 frames of images can be included in 1 second, one piece of characteristic data can be stored every 1 second for the convenience of statistics of the characteristic data and storage space saving, and compression processing and the like can be performed on the characteristic data.
In this embodiment, optionally, before acquiring the video data and the feature data of the key information, the method further includes:
displaying the type of the stored key information through a graphical interface;
determining the key information of the target type in response to the selection operation of the type of the key information;
correspondingly, acquiring the video data and the characteristic data of the key information comprises the following steps:
and acquiring video data and characteristic data of the key information of the target type according to the key information of the target type.
The stored key information types can be displayed through a graphical interface, wherein the key information types can comprise sound, environment temperature, picture temperature, people entering and exiting, key people and the like. In this case, the stored key information type may be notified to the user, so that the user can determine the key information of interest to which the user is compared according to the stored key information type, for example, when the user wants to inquire about when the parked vehicle is scratched, the "sound" may be selected as the key information type of interest, because the vehicle will trigger an alarm after being scratched, and a higher volume sound may be continuously emitted, so that the user may be assisted in quickly determining the occurrence time of the information that the user wants to inquire in the video by providing the selection of the key information.
The method and the device for determining the key information of the target type according to the selection of the user and acquiring the characteristic data of the key information of the target type can accurately position the requirement of the user and assist the user to quickly determine the occurrence time of the information concerned by the user in the video.
S120, carrying out segmentation processing on the characteristic data according to the video playback time length, and determining an upper limit value and a lower limit value of the characteristic data.
The segmentation method may be equally divided according to the video playback time length, or may be divided according to a fixed duration, for example, divided into segments every 50 seconds. In the scheme, the video can be divided into 100 segments according to time, each segment comprises a time span not smaller than 50s, and if the time span is smaller than 50s, the video is divided into one segment according to each 50 s.
After the segmentation is completed, an upper limit value and a lower limit value for each segment may be determined. The upper limit value and the lower limit value may be determined according to the type of the feature data, for example, the type of the feature data is transient, such as sound intensity, and then the value with the highest decibel in each segment may be used as the upper limit value and the value with the lowest decibel may be used as the lower limit value.
In this embodiment, the average value of the features of the feature data in each segment may be calculated, and the average value is used as the base value of the segment, so that different time periods may be eliminated, the numerical bases of the feature data are different, for example, the temperature difference between the day and the night of the highway is relatively large, and if the same base value is adopted, the volume change at night is not easy to be reflected. After the base value of each segment is calculated, the highest value and the lowest value are found in each segment, the highest value and the lowest value are respectively differenced with the base value to calculate the phase difference degree, and then the phase difference degree of 100 segments is compared to obtain the highest phase difference degree and the lowest phase difference degree as the upper limit value and the lower limit value of the whole waveform diagram of the characteristic data.
S130, determining a characteristic curve in the video playback time length according to the difference ratio of the upper limit value and the lower limit value.
The point positions of the values in the waveform diagram can be determined according to the difference ratio of the values to the upper limit value and the lower limit value in the video playback time of the characteristic data, so that the characteristic curve can be obtained through connection.
In this scheme, optionally, each segment may be divided into sub-segments again, which may help to reduce the amount of data calculation and increase the calculation speed.
And S140, displaying the characteristic curve on a video playback interface so as to enable a user to determine key information of the video.
The way in which the positions in the video that are highlighted for some changes may be marked, but other ways are possible. For example, the user pays attention to the sound size in the video, and the user can click and browse by determining the position where the sound change amplitude is large and marking the position in a high-brightness form in the progress bar.
The width of the progress bar can be widened by displaying the characteristic curve through the progress bar, and the characteristic curve of key information is displayed in the progress bar. Therefore, the change rule of the key information focused by the user is shown, and the occurrence time of the video image which the user wants to find in the video can be determined according to the change rule of the characteristic curve. Therefore, the characteristic curve is displayed in the progress bar, so that the consistency of data changing along with time can be realized, the change rule of the key information can be displayed to the user, the user is assisted in quickly determining the occurrence time, the occurrence process and the like of the things concerned by the user, and the problem that the result of the positioning of the things concerned by the user is inaccurate due to the fact that the specific position of the key information on the progress bar is determined according to the rule in advance in the prior art is avoided.
In the scheme, the instant display difference value is largest or smallest in each sub-segment, and can be preferentially obtained, if the difference value between the instant display difference value and the average value of the current sub-segment is not large or equal, the instant display difference value is compared with the data of the adjacent sub-segment, if the difference value is larger than the adjacent sub-segment, the instant display difference value is replaced, otherwise, the instant display difference value is destroyed. Thus, the difference can be more obviously reflected.
According to the technical scheme provided by the embodiment of the application, the characteristic data of the video data and the key information are acquired in response to the acquisition request of the video data; segmenting the characteristic data according to the video playback time length, and determining an upper limit value and a lower limit value of the characteristic data; determining a characteristic curve in the video playback time length according to the difference ratio of the upper limit value and the lower limit value; and displaying the characteristic curve on a video playback interface so as to enable a user to determine key information of the video. By adopting the technical scheme provided by the application, the key information in the video can be determined by recording the change of the key characteristics and displaying the key information to the user during video playback according to the change condition of the concerned key characteristics, so that the determination of the key information meets the user requirement, and the effect of rapidly determining the occurrence time of the key information in the video can be assisted by the user.
Fig. 2 is a flowchart of a method for processing key information of a video according to an embodiment of the present application. On the basis of the technical scheme, the scheme is further optimized, and is specifically: the key information comprises instant key information; correspondingly, the segmentation processing is carried out on the characteristic data according to the video playback time length, and the upper limit value and the lower limit value of the characteristic data are determined, which comprises the following steps: segmenting the feature data according to the video playback time length to obtain at least two segmented feature data; determining the average value of the characteristic data of each segment, and determining the phase difference degree value of each segment according to the difference value between the highest value of the characteristic data of each segment and the average value and the difference value between the lowest value of the characteristic data of each segment and the average value; and taking the highest value in the phase difference degree values of the segments and the lowest value in the phase difference degree values of the segments as an upper limit value and a lower limit value of the characteristic curve. As shown in fig. 2, the specific flow is as follows:
s210, responding to a video data acquisition request, and acquiring the video data and the characteristic data of the key information.
Wherein the key information includes instant key information. The instant key information can be key information which can be directly determined without statistical calculation, such as environment temperature, video temperature, irrelevant key personnel in video, and the like, and can be obtained without statistics of data in a period of time. Also associated with this is statistical key information, such as counting the number of persons passing through the shooting range over a period of time, etc. According to the scheme, by distinguishing the instant key information and the statistical key information, the occurrence time of each point in the curve can be determined in different modes in the determination process of the characteristic curve, so that the characteristic curve is more representative.
S220, segmenting the characteristic data according to the video playback time length to obtain at least two segmented characteristic data.
Wherein, for example, the user wishes to view the surveillance video between 5 and 6 points in the morning, the playback time length of the video may be determined to be 60 minutes. The playback length of the video may be selected by the user or may be determined according to the user's requirement by the amount of data received, for example, the user wants to view the data information of the first 1 hour, and the video data is stored as one video file every two hours, so that the video data of the first two hours can be returned to the user, and the playback time length is 120 minutes. The characteristic data can be segmented according to the video playback time length, and the specific segmentation mode is that the characteristic data can be directly segmented into 100 segments according to the time length, and each segment comprises a time span not less than 50 seconds, and if the time span is insufficient, the characteristic data is segmented according to one segment every 50 seconds. So that the characteristic data of each segment can be obtained.
S230, determining an average value of the characteristic data of each segment, and determining a phase difference degree value of each segment according to a difference value between the highest value of the characteristic data of each segment and the average value and a difference value between the lowest value of the characteristic data of each segment and the average value; and taking the highest value in the phase difference degree values of the segments and the lowest value in the phase difference degree values of the segments as an upper limit value and a lower limit value of the characteristic curve.
Wherein, since the key information is instant key information, the feature data in each segment can be added and averaged to obtain an average value. For example, 50 temperature data may be included within 50 seconds of the first segment, and the 50 temperature data may be averaged to obtain the temperature average data for the first segment.
After determining the average value of each segment, the highest and lowest values in the current segment may be used to determine the degree of phase difference. For example, the highest value in the current segment is 20 degrees, the lowest value is 0 degrees, and the average value is 5 degrees, then the difference between 20 degrees and 5 degrees can be used as the first phase difference degree, and the difference between 0 degrees and 5 degrees can be used as the second phase difference degree. Thus, two degrees of phase difference can be obtained for each piece of segment data.
The first phase difference degree is the largest and the second phase difference degree is the smallest among all the segment data, and may be determined as the upper limit value and the lower limit value of the characteristic curve.
S240, determining characteristic data characterization values of at least two sub-segments of the characteristic data of each segment, and taking the characteristic data characterization values of the characteristic data of each sub-segment as characteristic points of the sub-segments forming the characteristic curve.
After the upper and lower values have been determined, the segments may be divided into at least two sub-segments, e.g. into 10 sub-segments, each of which may be 5 seconds or longer. The numerical value of each sub-segment can be compared with the average value of the segment to which the sub-segment belongs, and the segment with the largest difference, for example, the average value of the segment to which the sub-segment belongs is 5 degrees, and the data range in the sub-segment is 0-15 degrees, so that the 15 degrees in the sub-segment and the average value of the segment to which the sub-segment belongs have the largest difference, and the 15 degrees can be determined as the characterization value of the sub-segment.
After the characterization value is determined, the feature point of each sub-segment can be determined according to the characterization value, that is, a point is determined for each sub-segment, so that a curve can be formed by the points of all the sub-segments of all the segments, that is, the feature curve.
In this aspect, optionally, determining at least two sub-segment feature data characterization values of each segment feature data includes: and determining the maximum value or the minimum value of the sub-segment characteristic data in at least two sub-segment characteristic data of each segment characteristic data as the characteristic value of the at least two sub-segment characteristic data of each segment characteristic data.
Based on the above technical solutions, optionally, according to the characterization value of each sub-segment feature data, as a sub-segment feature point forming a feature curve, the method includes:
and determining the sub-segment characteristic points forming the characteristic curve according to the difference ratio of the characteristic value of each sub-segment characteristic data and the upper limit value or the lower limit value of the characteristic curve.
The characteristic values of the sub-segment characteristic data in the sub-segment characteristic data are used as characteristic values of the sub-segment characteristic data in the sub-segment characteristic data according to the fact that the maximum value and the minimum value in the sub-segment characteristic data are different from the average value of the segment to which the current sub-segment belongs, and the characteristic curves can be used as characteristic values of the sub-segment characteristic data in the sub-segment characteristic data according to the fact that the difference is large.
S250, connecting the feature points of all the sub-segments to form a feature curve of the feature data.
After the sub-feature points are obtained, the sub-feature points may be sequentially connected to form a feature curve of the feature data.
And S260, displaying the characteristic curve on a video playback interface so as to enable a user to determine key information of the video.
On the basis of the embodiment, the embodiment provides a display mode processing for highlighting the difference of the instant key data, so that the characteristic curve can highlight the difference of the key information, and the user is assisted to quickly determine the occurrence time of the information concerned by the user in the video.
Fig. 3 is a flowchart of a method for processing key information of a video according to an embodiment of the present application. On the basis of the technical scheme, the scheme is further optimized, and is specifically: the key information comprises statistical key information; correspondingly, the segmentation processing is carried out on the characteristic data according to the video playback time length, and the upper limit value and the lower limit value of the characteristic data are determined, which comprises the following steps: segmenting the feature data according to the video playback time length to obtain at least two segmented feature data; determining the characteristic data of at least two sub-segments in each segment, and determining the sum of the characteristic data of each sub-segment as the characteristic data of each segment; determining the average value of the characteristic data of each segment, and determining the phase difference degree value of each segment according to the difference value between the highest value of the characteristic data of each segment and the average value and the difference value between the lowest value of the characteristic data of each segment and the average value; and taking the highest value in the phase difference degree values of the segments and the lowest value in the phase difference degree values of the segments as an upper limit value and a lower limit value of the characteristic curve. As shown in fig. 3, the specific flow is as follows:
S310, responding to the acquisition request of the video data, and acquiring the video data and the characteristic data of the key information.
Wherein the key information includes statistical key information.
S320, segmenting the characteristic data according to the video playback time length to obtain at least two segmented characteristic data.
The data segmentation in this step may refer to the data segmentation process in the above scheme, and may be divided into 100 segments, or into one segment every 50 seconds, until the segmentation is completed.
S330, determining the characteristic data of at least two sub-segments in each segment, and determining the sum of the characteristic data of each sub-segment as the characteristic data of each segment.
The segmentation of data at this step may be referred to as a procedure in the scheme described above. Since the data to be used here is the feature data of the statistical key information, it is necessary to determine the sum of the sub-segments as the feature data of each segment after dividing into the sub-segments. For example, it is necessary to determine the sum of the number of persons passing through the photographing range every 5 seconds to determine how many persons in total pass through the photographing range within 50 seconds.
S340, determining an average value of the characteristic data of each segment, and determining a phase difference degree value of each segment according to a difference value between the highest value of the characteristic data of each segment and the average value and a difference value between the lowest value of the characteristic data of each segment and the average value; and taking the highest value in the phase difference degree values of the segments and the lowest value in the phase difference degree values of the segments as an upper limit value and a lower limit value of the characteristic curve.
The average value can be obtained as a base value after the average value is obtained from the segment data, and then the difference value between the highest value and the lowest value of the segment characteristic data and the base value is determined, and the largest value is taken as the phase difference degree. And taking the highest value in the phase difference degree values of the segments and the lowest value in the phase difference degree values of the segments as an upper limit value and a lower limit value of the characteristic curve.
S350, determining characteristic data characterization values of at least two sub-segments of the characteristic data of each segment, and taking the characteristic data characterization values of the characteristic data of each sub-segment as characteristic points of the sub-segments forming the characteristic curve.
In this scheme, the sum of all the sub-segments can be respectively differenced from the base value determined in the foregoing, and then the amplitude value is determined according to the ratio of the difference between the sum and the upper limit value and the lower limit value, namely the point position of each sub-segment.
S360, connecting the feature points of all the sub-segments to form a feature curve of the feature data.
And S370, displaying the characteristic curve on a video playback interface so as to enable a user to determine key information of the video.
In this embodiment, a manner of drawing a characteristic curve for characteristic data of statistical key information is provided, and by adopting the scheme, the data of the statistical key information type can be displayed with outstanding differences, so that a user can be assisted in determining a specific position of the concerned key information in a video.
In each of the above technical solutions, optionally, the key information includes statistical key information;
correspondingly, carrying out segmentation processing on the characteristic data according to the video playback time length, and determining an upper limit value and a lower limit value of the characteristic data; and determining a characteristic curve in the video playback time length according to the difference ratio of the upper limit value and the lower limit value, wherein the characteristic curve comprises the following steps:
segmenting the feature data according to the video playback time length to obtain at least two segmented feature data;
determining the highest value and the lowest value of the characteristic data of each segment, and taking the highest value and the lowest value of the characteristic data of each segment as the upper limit value and the lower limit value of the characteristic curve;
or, the key information comprises instant key information; acquiring all the characteristic data in the video playback time length, determining the highest value and the lowest value in all the characteristic data, and taking the highest value and the lowest value in all the characteristic data as the upper limit value and the lower limit value of the characteristic curve respectively;
determining the difference ratio of the characteristic data of each segment to the upper limit value and the lower limit value as the characteristic point of each segment;
and connecting the characteristic points of all the segments to form a characteristic curve of the characteristic data.
Two methods for displaying characteristic data curves by using real data are provided. The method comprises the steps of determining a characteristic curve of characteristic data according to real data display mode, wherein the characteristic data can be segmented according to video playback time length to obtain at least two segmented characteristic data in the process of determining the characteristic curve of the characteristic data according to real data display mode whether the characteristic data are instant key information or statistical key information; determining the highest value and the lowest value of each piece of sectional characteristic data, and taking the highest value and the lowest value of each piece of sectional characteristic data as the upper limit value and the lower limit value of a characteristic curve; determining the difference ratio of each piece of sectional feature data to the upper limit value and the lower limit value as each piece of sectional feature point; all the segment feature points are connected to form a feature curve of the feature data.
Because of the instant key information, the data statistics is not needed, and therefore, a segmentation mode is adopted, or curve drawing is directly carried out on all characteristic data in the whole video playback time length, and the obtained results are the same. Therefore, for instant key information, a method of directly taking the highest value and the lowest value as the upper limit value and the lower limit value of all feature data in the whole video playback time length can be adopted.
According to the technical scheme, based on the technical scheme, the method for displaying the characteristic curve of the instant key information and the statistical key information by adopting the real data display mode is provided, the change rule of the data size is truly reflected by the method, more data display modes can be provided for users, and the operability is improved.
Fig. 4 is a schematic structural diagram of a key information processing apparatus for video according to an embodiment of the present application. As shown in fig. 4, the key information processing apparatus of a video includes:
a feature data obtaining module 410, configured to obtain feature data of the video data and the key information in response to an obtaining request of the video data;
the upper limit value and lower limit value determining module 420 is configured to segment the feature data according to the video playback time length, and determine an upper limit value and a lower limit value of the feature data;
a characteristic curve determining module 430, configured to determine a characteristic curve within a video playback time period according to a difference ratio between the upper limit value and the lower limit value;
the key information display module 440 is configured to display the characteristic curve on the video playback interface, so that the user can determine the key information of the video.
The product can execute the method provided by the embodiment of the application, and has the corresponding functional modules and beneficial effects of the execution method.
The present embodiments also provide a storage medium containing computer executable instructions, which when executed by a computer processor, are for performing a key information processing method of a video, the method comprising:
responding to the acquisition request of the video data, and acquiring the video data and the characteristic data of the key information;
segmenting the characteristic data according to the video playback time length, and determining an upper limit value and a lower limit value of the characteristic data;
determining a characteristic curve in the video playback time length according to the difference ratio of the upper limit value and the lower limit value;
and displaying the characteristic curve on a video playback interface so as to enable a user to determine key information of the video.
Storage media-any of various types of memory devices or storage devices. The term "storage medium" is intended to include: mounting media such as CD-ROM, floppy disk or tape devices; computer system memory or random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, lanbas (Rambus) RAM, etc.; nonvolatile memory such as flash memory, magnetic media (e.g., hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. In addition, the storage medium may be located in a computer system in which the program is executed, or may be located in a different second computer system connected to the computer system through a network (such as the internet). The second computer system may provide program instructions to the computer for execution. The term "storage medium" may include two or more storage media that may reside in different locations (e.g., in different computer systems connected by a network). The storage medium may store program instructions (e.g., embodied as a computer program) executable by one or more processors.
Of course, the storage medium containing the computer executable instructions provided in the embodiments of the present application is not limited to the key information processing operation of the video described above, and may also perform the related operation in the key information processing method of the video provided in any embodiment of the present application.
The embodiment of the application provides equipment, and the key information processing device of the video provided by the embodiment of the application can be integrated in the equipment. Fig. 5 is a schematic structural diagram of an apparatus according to an embodiment of the present application. As shown in fig. 5, the present embodiment provides an apparatus 500, which includes: one or more processors 520; a storage 510 for storing one or more programs, which when executed by the one or more processors 520, cause the one or more processors 520 to implement a method for processing key information of video provided by an embodiment of the present application, the method comprising:
responding to the acquisition request of the video data, and acquiring the video data and the characteristic data of the key information;
segmenting the characteristic data according to the video playback time length, and determining an upper limit value and a lower limit value of the characteristic data;
Determining a characteristic curve in the video playback time length according to the difference ratio of the upper limit value and the lower limit value;
and displaying the characteristic curve on a video playback interface so as to enable a user to determine key information of the video.
Of course, those skilled in the art will appreciate that the processor 520 also implements the technical solution of the key information processing method of video provided in any embodiment of the present application.
The apparatus 500 shown in fig. 5 is merely an example, and should not be construed as limiting the functionality and scope of use of the embodiments herein.
As shown in fig. 5, the apparatus 500 includes a processor 520, a storage device 510, an input device 530, and an output device 540; the number of processors 520 in the device may be one or more, one processor 520 being taken as an example in fig. 5; the processor 520, the storage 510, the input 530, and the output 540 in the apparatus may be connected by a bus or otherwise, as illustrated in fig. 5 by a bus 550.
The storage device 510 is a computer readable storage medium, and may be used to store a software program, a computer executable program, and program instructions corresponding to a method for processing key information of a video in an embodiment of the present application.
The storage device 510 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, at least one application program required for functions; the storage data area may store data created according to the use of the terminal, etc. In addition, the storage 510 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, storage 510 may further include memory located remotely from processor 520, which may be connected via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input means 530 may be used to receive input numeric, character information or voice information and to generate key signal inputs related to user settings of the device and function control. Output 540 may include a display screen, speakers, etc.
The device provided by the embodiment of the application can record the change of the key feature and display the change to the user during video playback, so that the user can determine the key information in the video according to the change condition of the concerned key feature, the determination of the key information meets the user requirement, and the user can be assisted in rapidly determining the effect of the occurrence time of the key information in the video.
The key information processing device, the storage medium and the equipment for video provided in the above embodiments can execute the key information processing method for video provided in any embodiment of the present application, and have the corresponding functional modules and beneficial effects of executing the method. Technical details not described in detail in the above embodiments may be referred to the key information processing method of video provided in any embodiment of the present application.
Note that the above is only a preferred embodiment of the present application and the technical principle applied. Those skilled in the art will appreciate that the present application is not limited to the particular embodiments described herein, but is capable of numerous obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the present application. Therefore, while the present application has been described in connection with the above embodiments, the present application is not limited to the above embodiments, but may include many other equivalent embodiments without departing from the spirit of the present application, the scope of which is defined by the scope of the appended claims.
Claims (10)
1. A method for processing key information of a video, the method comprising:
acquiring video data and characteristic data of key information in response to an acquisition request of the video data, wherein the key information is derived from the video data;
Segmenting the characteristic data according to the video playback time length, and determining an upper limit value and a lower limit value of the characteristic data;
determining a characteristic curve in the video playback time length according to the difference ratio of the upper limit value and the lower limit value;
and displaying the characteristic curve on a video playback interface so as to enable a user to determine key information of the video.
2. The method of claim 1, wherein the critical information comprises instant critical information;
correspondingly, the segmentation processing is carried out on the characteristic data according to the video playback time length, and the upper limit value and the lower limit value of the characteristic data are determined, which comprises the following steps:
segmenting the feature data according to the video playback time length to obtain at least two segmented feature data;
determining the average value of the characteristic data of each segment, and determining the phase difference degree value of each segment according to the difference value between the highest value of the characteristic data of each segment and the average value and the difference value between the lowest value of the characteristic data of each segment and the average value;
and taking the highest value in the phase difference degree values of the segments and the lowest value in the phase difference degree values of the segments as an upper limit value and a lower limit value of the characteristic curve.
3. The method of claim 1, wherein the critical information comprises statistical critical information;
Correspondingly, the segmentation processing is carried out on the characteristic data according to the video playback time length, and the upper limit value and the lower limit value of the characteristic data are determined, which comprises the following steps:
segmenting the feature data according to the video playback time length to obtain at least two segmented feature data;
determining the characteristic data of at least two sub-segments in each segment, and determining the sum of the characteristic data of each sub-segment as the characteristic data of each segment;
determining the average value of the characteristic data of each segment, and determining the phase difference degree value of each segment according to the difference value between the highest value of the characteristic data of each segment and the average value and the difference value between the lowest value of the characteristic data of each segment and the average value;
and taking the highest value in the phase difference degree values of the segments and the lowest value in the phase difference degree values of the segments as an upper limit value and a lower limit value of the characteristic curve.
4. A method according to claim 2 or 3, characterized in that after taking the highest value of the phase difference values of the segments and the lowest value of the phase difference values of the segments as the upper limit value and the lower limit value of the characteristic curve, the method further comprises:
determining characteristic data characterization values of at least two sub-segments of characteristic data of each segment, and taking the characteristic data characterization values of the characteristic data of each sub-segment as characteristic points of the sub-segments forming a characteristic curve;
And connecting the characteristic points of all the sub-segments to form a characteristic curve of the characteristic data.
5. The method according to claim 4, wherein determining the characteristic data characterization value of at least two sub-segments of the characteristic data of each segment and taking the characterization value of the characteristic data of each sub-segment as the characteristic point of the sub-segment constituting the characteristic curve comprises:
determining the maximum value of the characteristic data of the sub-segments or the minimum value of the characteristic data of the sub-segments in the characteristic data of at least two sub-segments of the characteristic data of each segment, and taking the maximum value or the minimum value of the characteristic data of the sub-segments as the characteristic data characterization value of at least two sub-segments of the characteristic data of each segment;
and determining the characteristic points of the sub-segments forming the characteristic curve according to the difference ratio of the characteristic value of the characteristic data of each sub-segment and the upper limit value or the lower limit value of the characteristic curve.
6. The method of claim 1, wherein the critical information comprises statistical critical information;
correspondingly, carrying out segmentation processing on the characteristic data according to the video playback time length, and determining an upper limit value and a lower limit value of the characteristic data; and determining a characteristic curve in the video playback time length according to the difference ratio of the upper limit value and the lower limit value, wherein the characteristic curve comprises the following steps:
Segmenting the feature data according to the video playback time length to obtain at least two segmented feature data;
determining the highest value and the lowest value of the characteristic data of each segment, and taking the highest value and the lowest value of the characteristic data of each segment as the upper limit value and the lower limit value of the characteristic curve;
or, the key information comprises instant key information; acquiring all the characteristic data in the video playback time length, determining the highest value and the lowest value in all the characteristic data, and taking the highest value and the lowest value in all the characteristic data as the upper limit value and the lower limit value of the characteristic curve respectively;
determining the difference ratio of the characteristic data of each segment to the upper limit value and the lower limit value as the characteristic point of each segment;
and connecting the characteristic points of all the segments to form a characteristic curve of the characteristic data.
7. The method of claim 1, wherein prior to acquiring the video data and the characterization data of the key information, the method further comprises:
displaying the type of the stored key information through a graphical interface;
determining the key information of the target type in response to the selection operation of the type of the key information;
correspondingly, acquiring the video data and the characteristic data of the key information comprises the following steps:
And acquiring video data and characteristic data of the key information of the target type according to the key information of the target type.
8. A key information processing apparatus for video, the apparatus comprising:
the device comprises a characteristic data acquisition module, a characteristic data processing module and a characteristic data processing module, wherein the characteristic data acquisition module is used for responding to an acquisition request of video data and acquiring characteristic data of video data and key information, and the key information is derived from the video data;
the upper limit value and lower limit value determining module is used for carrying out segmentation processing on the characteristic data according to the video playback time length and determining the upper limit value and the lower limit value of the characteristic data;
the characteristic curve determining module is used for determining a characteristic curve in the video playback time length according to the difference ratio of the upper limit value and the lower limit value;
and the key information display module is used for displaying the characteristic curve on a video playback interface so as to enable a user to determine the key information of the video.
9. A computer-readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the key information processing method of a video according to any one of claims 1-7.
10. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the key information processing method of a video according to any one of claims 1-7 when executing the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010634509.7A CN113891163B (en) | 2020-07-02 | 2020-07-02 | Video key information processing method, device, storage medium and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010634509.7A CN113891163B (en) | 2020-07-02 | 2020-07-02 | Video key information processing method, device, storage medium and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113891163A CN113891163A (en) | 2022-01-04 |
| CN113891163B true CN113891163B (en) | 2024-03-08 |
Family
ID=79012773
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010634509.7A Active CN113891163B (en) | 2020-07-02 | 2020-07-02 | Video key information processing method, device, storage medium and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113891163B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104918067A (en) * | 2014-03-12 | 2015-09-16 | 乐视网信息技术（北京）股份有限公司 | Method and system for performing curve processing on video hot degree |
| CN105792006A (en) * | 2016-03-04 | 2016-07-20 | 广州酷狗计算机科技有限公司 | Interactive information display method and device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107241622A (en) * | 2016-03-29 | 2017-10-10 | 北京三星通信技术研究有限公司 | video location processing method, terminal device and cloud server |
-
2020
- 2020-07-02 CN CN202010634509.7A patent/CN113891163B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104918067A (en) * | 2014-03-12 | 2015-09-16 | 乐视网信息技术（北京）股份有限公司 | Method and system for performing curve processing on video hot degree |
| CN105792006A (en) * | 2016-03-04 | 2016-07-20 | 广州酷狗计算机科技有限公司 | Interactive information display method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113891163A (en) | 2022-01-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101852284B1 (en) | Alarming method and device | |
| WO2020094091A1 (en) | Image capturing method, monitoring camera, and monitoring system | |
| US11483657B2 (en) | Human-machine interaction method and device, computer apparatus, and storage medium | |
| CN111726689B (en) | Video playing control method and device | |
| CN111698553A (en) | Video processing method and device, electronic equipment and readable storage medium | |
| WO2019206243A1 (en) | Material display method, terminal, and computer storage medium | |
| CN109241345B (en) | Video positioning method and device based on face recognition | |
| CN113157246B (en) | Volume adjusting method and device, electronic equipment and storage medium | |
| US20120144312A1 (en) | Information processing apparatus and information processing system | |
| CN106249508A (en) | Atomatic focusing method and system, filming apparatus | |
| WO2020052062A1 (en) | Detection method and device | |
| CN112689221A (en) | Recording method, recording device, electronic device and computer readable storage medium | |
| CN113014844A (en) | Audio processing method and device, storage medium and electronic equipment | |
| JP2011070629A (en) | Advertising effect measurement system and advertising effect measurement device | |
| JP6214762B2 (en) | Image search system, search screen display method | |
| CN112055237B (en) | Method, system, apparatus, device and storage medium for determining screen-to-screen delay | |
| CN113891163B (en) | Video key information processing method, device, storage medium and equipment | |
| US10628681B2 (en) | Method, device, and non-transitory computer readable medium for searching video event | |
| CN112565604A (en) | Video recording method and device and electronic equipment | |
| US20220343931A1 (en) | Information processing method, electronic equipment, and storage medium | |
| CN111918139B (en) | Video playing method, device, equipment and storage medium | |
| CN111489757B (en) | Audio processing method, device, electronic equipment and readable storage medium | |
| CN114205632A (en) | Video preview method and device, electronic equipment and computer readable storage medium | |
| CN113596582A (en) | Video preview method and device and electronic equipment | |
| CN113886273A (en) | Performance test method, device, test equipment and medium of application program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |