CN114205632A - Video preview method and device, electronic equipment and computer readable storage medium - Google Patents
Video preview method and device, electronic equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN114205632A CN114205632A CN202111553206.3A CN202111553206A CN114205632A CN 114205632 A CN114205632 A CN 114205632A CN 202111553206 A CN202111553206 A CN 202111553206A CN 114205632 A CN114205632 A CN 114205632A
- Authority
- CN
- China
- Prior art keywords
- video information
- video
- filtered
- preview
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 238000005070 sampling Methods 0.000 claims abstract description 85
- 238000001914 filtration Methods 0.000 claims abstract description 61
- 238000004590 computer program Methods 0.000 claims description 8
- 238000012545 processing Methods 0.000 abstract description 11
- 238000012544 monitoring process Methods 0.000 description 16
- 238000013473 artificial intelligence Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 7
- 238000000605 extraction Methods 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 4
- 238000007726 management method Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2181—Source of audio or video content, e.g. local disk arrays comprising remotely distributed storage units, e.g. when movies are replicated over a plurality of video servers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234381—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Studio Devices (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The embodiment of the application discloses a video preview method, a video preview device, electronic equipment and a computer readable storage medium, wherein the method comprises the following steps: after a preview instruction sent by a mobile terminal is received, sampling original video information corresponding to the preview instruction to obtain sampled video information; sending the sampled video information to a second cloud end so that the second cloud end filters the sampled video information to generate filtered video information; and receiving the filtered video information sent by the second cloud, and sending the filtered video information to the mobile terminal, wherein the filtered video information is used for previewing and displaying on the mobile terminal. Through sampling and filtering processing of the original video information, the data frame of the filtered video information is smaller than that of the original video information, the progress of video preview is accelerated, and the video preview efficiency is improved.
Description
Technical Field
The embodiment of the application relates to the technical field of computers, in particular to a video previewing method and device, electronic equipment and a computer readable storage medium.
Background
With the rapid development of computer technology, smart homes are more and more intelligent and convenient, and with the popularization of smart security, smart homes are more and more widely applied to smart security, for example, a monitoring camera is one of the smart homes. At present, a user can check the monitoring video collected by a monitoring camera through equipment such as a mobile phone, but the monitoring video is long, so that the user cannot check the monitoring video conveniently.
At present, when a monitoring video is checked, a previewing mode has a double-speed playing mode, the playing speed of the video can be improved through the double-speed playing mode, but even if the video is played at a high speed, the video still needs a certain time to be checked, and key information in the video is easily missed in the high-speed playing mode, so that the user experience is reduced.
Disclosure of Invention
The embodiment of the application provides a video previewing method and device, electronic equipment and a computer readable storage medium, which can realize quick and effective previewing of videos and improve user experience.
The embodiment of the application provides a video preview method, which is applied to a first cloud and comprises the following steps:
after a preview instruction sent by a mobile terminal is received, sampling original video information corresponding to the preview instruction to obtain sampled video information;
sending the sampled video information to a second cloud end so that the second cloud end filters the sampled video information to generate filtered video information;
and receiving the filtered video information sent by the second cloud, and sending the filtered video information to the mobile terminal, wherein the filtered video information is used for previewing and displaying on the mobile terminal.
Correspondingly, this application embodiment still provides a video preview device, integrates in first high in the clouds, includes:
the sampling module is used for sampling original video information corresponding to a preview instruction after receiving the preview instruction sent by the mobile terminal to obtain sampled video information;
the sampling information sending module is used for sending the sampling video information to a second cloud end so that the second cloud end can filter the sampling video information and generate filtered video information;
and the display module is used for receiving the filtered video information sent by the second cloud end and sending the filtered video information to the mobile end, wherein the filtered video information is used for previewing and displaying on the mobile end.
Optionally, in some embodiments of the present invention, the sampling module includes:
the first determining unit is used for determining original video information to be previewed according to the preview instruction;
the analysis unit is used for analyzing the original video information to obtain an original video frame sequence list;
and the extraction unit is used for extracting at least one frame of target video image from the original video frame sequence list according to a preset time interval threshold value to obtain sampling video information.
Wherein the determination unit includes:
the analysis subunit is used for analyzing the preview instruction to obtain target video name information and video time period information corresponding to the preview instruction;
the first determining subunit is configured to determine, according to the target video name information and the video time period information, actual target video information corresponding to the preview instruction;
and the second determining subunit is configured to determine the actual target video information as original video information corresponding to the preview instruction.
The embodiment of the application provides a video preview method, which is applied to a second cloud and comprises the following steps:
receiving sampling video information sent by a first cloud, wherein the sampling video information is obtained by sampling original video information corresponding to a preview instruction by the first cloud;
filtering the sampled video information to generate filtered video information;
sending the filtered video information to the first cloud end, so that the first cloud end sends the filtered video information to the mobile end, and the filtered video information is used for previewing and displaying on the mobile end.
Correspondingly, this application embodiment still provides a video preview device, integrates in the second high in the clouds, includes:
the receiving module is used for receiving sampling video information sent by a first cloud, wherein the sampling video information is obtained by sampling original video information corresponding to a preview instruction by the first cloud;
the filtering module is used for filtering the sampled video information to generate filtered video information;
the filtering information sending module is used for sending the filtered video information to the first cloud end, so that the first cloud end sends the filtered video information to the mobile end, and the filtered video information is used for previewing and displaying on the mobile end.
Wherein, the filtration module includes:
the calculating unit is used for calculating the actual similarity between two adjacent target video images in the sampling video information;
the second determining unit is used for determining a video image to be filtered from the two target video images according to a preset similarity threshold and the actual similarity;
and the filtering unit is used for filtering the video image to be filtered based on the sampling video information to obtain filtered video information.
Wherein the second determining unit includes:
a third determining subunit, configured to determine a first target video image and a second target video image in the two target video images, where the second target video image is located after the shooting time of the first target video image;
and the fourth determining subunit is configured to determine the second target video image as the video image to be filtered, when the actual similarity is greater than a preset similarity threshold.
The embodiment of the present application further provides an electronic device, where the electronic device includes a memory, a processor, and a computer program stored in the memory and capable of running on the processor, and the processor implements the steps in the video preview method when executing the computer program.
An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps in the video preview method are implemented.
The embodiment of the application is through the sampling to original video information, make the video frame number of the sampling video information that obtains after the sampling be less than original video information, and after filtering sampling video information, make the video frame number of the video information after the filtration that obtains after the filtration be more less than original video information, video frame number when having reduced the video preview of mobile terminal, wherein, through sampling and filtering to video information, the validity of previewing video information has been promoted, promote video preview speed and efficiency, wherein, carry out sampling and filtering operation respectively through two high in the clouds, can reduce the processing burden in single high in the clouds.
Drawings
In order to more clearly illustrate the technical solutions in the present application, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a scene schematic diagram of a video preview method provided in an embodiment of the present application;
fig. 2 is a schematic flowchart of a video preview method provided in an embodiment of the present application;
fig. 3 is another schematic flow chart of a video preview method provided by an embodiment of the present application;
fig. 4 is a schematic diagram illustrating a filtering process of original video information of a video preview method according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a video preview device provided in an embodiment of the present application;
fig. 6 is another schematic structural diagram of a video preview device provided in an embodiment of the present application;
fig. 7 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.
Detailed Description
The technical solutions in the present application will be described clearly and completely with reference to the accompanying drawings in the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the application provides a video preview method, a video preview device, electronic equipment and a computer readable storage medium. Specifically, the embodiment of the application provides a video preview device suitable for an electronic device, wherein the electronic device may be a terminal or a cloud (or a cloud server) or other devices. The terminal device comprises a camera, a video recorder or a mobile phone and the like, and the cloud end can comprise an audio and video cloud or an Artificial Intelligence (AI) cloud and the like.
In the embodiment of the application, the video preview method can be executed by the terminal alone, or the video preview method can be executed by the cloud alone, or the video preview method can be executed by the terminal and the cloud together, please refer to fig. 1, which takes the case that the video preview method is executed by the terminal and the cloud together as an example, wherein other devices can be added on the basis of the terminal and the cloud to assist in completing the video preview method, and the types of the other devices are not limited; the terminal is connected with the cloud end through a network, and the specific execution process is as follows:
a user starts a preview function of a target video through the terminal device 10, and then the terminal device 10 generates a preview instruction of the target video according to the start operation of the user and sends the preview instruction to the cloud 11;
the cloud 11 determines original video information to be previewed according to the preview instruction, samples the original video information to obtain sampled video information, and then the cloud 11 sends the sampled video information to the cloud 12;
the cloud end 12 receives the sampled video information sent by the cloud end 11, filters the sampled video information to obtain filtered video information, and then the cloud end 12 sends the filtered video information to the cloud end 11;
after receiving the filtered video information sent by the cloud 12, the cloud 11 sends the filtered video information to the terminal device 10;
after receiving the filtered video information sent by the cloud 11, the terminal device 10 displays the filtered video information on a display screen of the terminal device 10, so that the filtered video information is displayed, and a user can preview the filtered video information conveniently.
In this embodiment, the cloud end 11 includes an audio/video cloud, and the cloud end 12 includes an Artificial Intelligence (AI) cloud.
In the embodiment of the application, the original video information can be video information formed by a monitoring camera after monitoring video, and the user can quickly and effectively preview the video information through sampling and filtering the video information, so that the condition that the preview speed of the effective video is influenced due to the existence of multi-frame repeated video images is avoided.
In the embodiment of the application, because the duration of the surveillance video is long, and the pictures of the surveillance video are often repeated within a period of time, the video images can be collected according to the time interval, so as to reduce the number of the repeated pictures in the video and improve the efficiency of video preview, wherein the time interval threshold can be flexibly selected according to the actual needs, and in the embodiment of the application, the specific value of the time interval threshold is not limited.
In the embodiment of the present application, the repeated pictures may also be filtered, so as to further reduce the number of video frames in the preview video.
In the embodiment of the application, the video images obtained after sampling and filtering are spliced according to the sequence of the actual shooting time of each video image, so that the preview video corresponding to the original video can be formed, and a user can preview the original video conveniently.
The embodiment of the application is through the sampling to original video information, make the video frame number of the sampling video information that obtains after the sampling be less than original video information, and after filtering sampling video information, make the video frame number of the video information after the filtration that obtains after the filtration be more less than original video information, video frame number when having reduced the video preview of mobile terminal, wherein, through sampling and filtering to video information, the validity of previewing video information has been promoted, promote video preview speed and efficiency, wherein, carry out sampling and filtering operation respectively through two high in the clouds, can reduce the processing burden in single high in the clouds.
The following are detailed below. It should be noted that the description sequence of the following embodiments is not intended to limit the priority sequence of the embodiments.
Referring to fig. 2, fig. 2 is a flowchart illustrating a video preview method according to an embodiment of the present application. The video preview method is applied to the first cloud, and the specific process can be as follows:
101. and after a preview instruction sent by the mobile terminal is received, sampling original video information corresponding to the preview instruction to obtain sampled video information.
In the embodiment of the application, the first cloud end comprises an audio and video cloud end, the preview instruction is a data instruction formed after a user triggers a preview operation at the mobile end, and the cloud end can acquire a target video (including a video) which the user desires to preview through the preview instruction.
The original video information is sampled, so that the video frame number of the sampled video information is smaller than that of the original video frame number, and the video previewing speed is improved.
In this embodiment of the present application, original video information may be sampled in a video frame extraction manner, that is, optionally, in some embodiments, the step "sampling original video information corresponding to the preview instruction to obtain sampled video information" includes:
determining original video information to be previewed according to the preview instruction;
analyzing the original video information to obtain an original video frame sequence list;
and extracting at least one frame of target video image from the original video frame sequence list according to a preset time interval threshold value to obtain sampled video information.
In this embodiment, the original video information is an unfiltered original video that a user desires to preview, for example, video information obtained by real-time acquisition by a monitoring camera. The original video frame sequence list corresponding to the original video information can be obtained by analyzing the original video information, wherein the original video frame sequence list comprises at least one frame of original video image with ordered shooting time.
In the embodiment of the application, the problems that a plurality of frames of repeated videos exist in an original video, the speed is low, the time consumption is long, and effective target information is difficult to obtain quickly when a user previews the videos are mainly solved.
The target video image is extracted from the original video frame sequence list through the preset time interval threshold, the number of preview video frames in subsequent preview video information can be reduced, and the video previewing speed of a user is increased.
Because a plurality of frames of video images can be formed in a short acquisition time period, and because the acquisition time period is short, in fact, the plurality of frames of video images in the time period are often repeated, and the extraction of the video images in the original video frame sequence table through the time interval threshold value can reduce the number of the repeated video images in the original video information, thereby realizing the extraction of effective video images.
In the embodiment of the present application, the specific value of the preset time interval threshold may be set according to actual needs; the action of extracting the video images in the original video frame sequence table according to the time interval threshold value can be converted into a script, and the corresponding video images at the corresponding time interval threshold values are extracted according to the execution of the script.
In this embodiment of the present application, the original video information to be previewed by the user may be determined according to a preview instruction, that is, optionally, in some embodiments, the step "determining the original video information to be previewed according to the preview instruction" includes:
analyzing the preview instruction to obtain target video name information and video time period information corresponding to the preview instruction;
determining actual target video information corresponding to the preview instruction according to the target video name information and the video time period information;
and determining the actual target video information as the original video information corresponding to the preview instruction.
The original video clip desired to be viewed by the user can be obtained by obtaining the name information of the target video and the video time period information in the preview instruction, for example, the user selects a section of video desired to be viewed within the start time and the end time for the target monitoring video, and takes the video as the original video to be previewed in the embodiment of the application.
In the embodiment of the application, the video information in the specified time period is acquired through the video time period information, so that the accuracy and efficiency of acquiring the video data can be improved, and the previewing efficiency of the effective video information is further improved.
102. And sending the sampled video information to a second cloud end so that the second cloud end filters the sampled video information to generate filtered video information.
Wherein the number of video frames of the preview video can be further reduced by filtering the sampled video information. The second cloud is used for filtering the sampled video, so that the number of video frames in the filtered video information can be fully reduced, and the video preview speed is increased.
103. And receiving the filtered video information sent by the second cloud, and sending the filtered video information to the mobile terminal, wherein the filtered video information is used for previewing and displaying on the mobile terminal.
The mobile terminal sends the filtered video information to the mobile terminal, so that the mobile terminal can display the sampled and filtered video information, a user at the mobile terminal can display the sampled and filtered video information when triggering preview of an original video, and the video preview speed is increased.
In the embodiment of the application, after receiving the filtered video information sent by the second cloud, the first cloud may sort and combine the filtered video information with each video frame image according to a time sequence to generate preview video information, and send the finally combined preview video information to the mobile terminal, so that the mobile terminal displays the preview video information.
The embodiment of the application is through the sampling to original video information, make the video frame number of the sampling video information that obtains after the sampling be less than original video information, and after filtering sampling video information, make the video frame number of the video information after the filtration that obtains after the filtration be more less than original video information, video frame number when having reduced the video preview of mobile terminal, wherein, through sampling and filtering to video information, the validity of previewing video information has been promoted, promote video preview speed and efficiency, wherein, carry out sampling and filtering operation respectively through two high in the clouds, can reduce the processing burden in single high in the clouds.
Referring to fig. 3, fig. 3 is a flowchart illustrating a video preview method according to an embodiment of the present application. The video preview method is applied to the second cloud, and the specific process can be as follows:
201. receiving sampling video information sent by a first cloud, wherein the sampling video information is obtained by sampling original video information corresponding to a preview instruction by the first cloud.
In the embodiment of the application, the second cloud end comprises an artificial intelligence cloud end, the first cloud end comprises an audio and video cloud end, and the sampled video information is processed by the second cloud end conveniently by receiving the sampled video information sampled and processed by the first cloud end.
202. And filtering the sampled video information to generate filtered video information.
The sampled video information is filtered, so that the video frame number of the filtered video information is smaller than that of the original video information, and the video can be previewed quickly.
In this embodiment of the present application, the filtering process may be performed on the images according to the similarity between the images, and the repeated and invalid video images are filtered, that is, optionally, in some embodiments, the step "filtering the sampled video information to generate the filtered video information" includes:
calculating the actual similarity between two adjacent target video images in the sampled video information;
determining a video image to be filtered from the two target video images according to a preset similarity threshold and the actual similarity;
and filtering the video image to be filtered based on the sampling video information to obtain filtered video information.
The method comprises the steps of acquiring sampling video information, acquiring the actual similarity between two adjacent target video images in the sampling video information, determining the similarity between the two adjacent target video images in the shooting time, and determining the target video images to be filtered and deleted according to the similarity, so that the two residual adjacent target video images are different.
The extracted video images are filtered again, so that only non-repeated video images are reserved in the finally generated filtered video information, repeated and invalid video images are filtered, and the video previewing speed is increased.
In the embodiment of the present application, filtering of effective video images can be avoided by comparing two video images of adjacent shooting times, for example, when a moving object appears in a video and then leaves a video monitoring range, the video images before the object appears and after the object disappears are the same, and if all similar images are filtered, information that the moving object leaves a monitoring picture cannot be obtained, that is, only the video images before the object appears and when the object appears are obtained, and the video images after the object leaves cannot be obtained any more.
For example, the first frame video image is the same as the third frame video image, and a moving object appears in the second frame, that is, the second frame is different from both the first frame video image and the second frame video image, if the similar images are filtered, the third frame video image is filtered, and the third frame video image means that the object leaves the monitoring range, so that if the third frame video image is filtered, the information that the object leaves the monitoring range cannot be acquired, and the user loses the acquisition of the effective information when previewing the filtered preview video.
In this embodiment of the present application, after performing similarity identification on adjacent images, when the similarity reaches a threshold, a subsequent video image may be filtered and deleted, that is, optionally, in some embodiments, the step "determining a video image to be filtered from the two target video images according to a preset similarity threshold and the actual similarity" includes:
determining a first target video image and a second target video image in the two target video images, wherein the second target video image is obtained after the shooting time of the first target video image;
and when the actual similarity is larger than a preset similarity threshold, determining the second target video image as a video image to be filtered.
The video images positioned at the back of the shooting time are deleted, and the video images at the front of the shooting time are reserved, so that the time information of the event starting to occur in the video images is reserved, wherein the event information of the event starting to occur has important significance, and the reservation of effective monitoring information is realized.
In this embodiment of the present application, the similarity between images may be obtained by calculating a cross-over ratio between the images, that is, optionally, in some embodiments, the step "calculating an actual similarity between two adjacent target video images in the sample video information" includes:
determining two target video images with adjacent shooting time according to the sampling video information;
calculating the intersection ratio between the two target video images, and determining the similarity between the two target video images according to the intersection ratio;
or the like, or, alternatively,
performing gray level processing on the two target video images respectively to obtain two target gray level images;
carrying out difference image processing on the two target gray level images to obtain a difference value;
and determining the similarity of the two target video images according to the difference value.
Wherein the coincidence ratio is used to describe the degree of coincidence between two images, and the similarity between the two images can be determined by the magnitude of the degree of coincidence.
In the embodiment of the present application, the intersection ratio between two images is the ratio of the area of the overlapped region of the two images to the area of the merged region of the two images, and the similarity between the two images can be determined through the ratio.
Wherein the similarity between the two images can also be determined by calculating the difference value between the two images.
According to the embodiment of the application, the sampled video image is filtered again, so that the obtained filtered video information is further reduced in the number of video frames compared with the sampled video information, and the video preview speed is further improved. The sampled video information is filtered according to the similarity of the images, so that the effectiveness of the filtered video information is ensured, and the quality and the preview efficiency of the preview information are improved.
In the embodiment of the application, the original video information may be stored locally in the terminal device, and may also be stored in the cloud, and in the embodiment of the application, the original video information is stored in the cloud, and accordingly, the extraction of the target video image according to the preset time interval threshold may be performed by the first cloud (e.g., an audio/video cloud) to obtain the target video image. In this embodiment of the application, the extracted sampled video information is filtered again and then can be processed by the second cloud, where the second cloud includes an artificial intelligence cloud (also called artificial intelligence cloud, abbreviated as AI cloud).
For example, referring to fig. 4, fig. 4 is a schematic diagram of a filtering process of original video information in an embodiment of the present application, which specifically includes:
211. a user selects video information and a time period which are expected to be previewed through the app in the mobile terminal;
212. the app uploads the time period and the video information selected by the user to the audio and video cloud;
213. determining original video information expected to be previewed by the audio and video cloud according to the time period and the video information;
214. the audio and video cloud extracts at least one frame of target video image from the original video information according to a preset time interval threshold value to obtain sampled video information;
215. the audio and video cloud uploads the sampled video information to the artificial intelligence cloud;
216. calculating the similarity of target video images adjacent to the shooting time in the sampled video information by the artificial intelligence cloud, and filtering repeated target video images with the later shooting time according to the similarity to obtain filtered video information;
217. the artificial intelligence cloud returns the filtered video information to the audio and video cloud;
218. merging the target video images in the filtered video information into a preview video information file by the audio and video cloud;
219. the audio and video cloud returns the preview video information file and the video frame sequence list corresponding to the preview video information file to the mobile terminal app;
220. the video information can be displayed in the app in a video or image list mode for the user to preview.
The method comprises the steps that an original video information which a user desires to preview is determined through an audio and video cloud, and a target video image in the original video information is extracted, so that primary filtering of a repeated video image in the original video information is achieved; and the artificial intelligence cloud is used for filtering again after similarity comparison is carried out on the sampled video information extracted by the audio and video cloud, so that the occurrence of repeated video images in the obtained preview video information is reduced, the time for previewing the video is shortened, and the user can quickly and effectively preview the original video.
According to the embodiment of the application, the partial video images are extracted from the original video information through the preset time interval threshold, and the preview video information is generated by the extracted partial video images, so that a user can preview the preview video information instead of the original video information, and the speed and the efficiency of video preview are improved. The extracted video images are filtered again, and the similar video images of the adjacent shooting time are deleted and filtered, so that repeated video images are reduced in the generated preview video information, the time length of previewing the video is shortened, and the original video information is quickly and effectively previewed.
In order to better implement the video preview method of the application, the application also provides a video preview device based on the video preview method. The terms are the same as those in the video preview method, and the details of the implementation can be referred to the description in the method embodiment.
Referring to fig. 5, fig. 5 is a schematic structural diagram of a video preview device provided in the present application, where the video preview device is integrated in a first cloud, and may include a sampling module 301, a sampling information sending module 302, and a display module 303, and specifically may be as follows:
the sampling module 301 is configured to, after receiving a preview instruction sent by the mobile terminal, sample original video information corresponding to the preview instruction to obtain sampled video information.
Optionally, in some embodiments of the present invention, the sampling module 301 includes:
the first determining unit is used for determining original video information to be previewed according to the preview instruction;
the analysis unit is used for analyzing the original video information to obtain an original video frame sequence list;
and the extraction unit is used for extracting at least one frame of target video image from the original video frame sequence list according to a preset time interval threshold value to obtain sampling video information.
Wherein the determination unit includes:
the analysis subunit is used for analyzing the preview instruction to obtain target video name information and video time period information corresponding to the preview instruction;
the first determining subunit is configured to determine, according to the target video name information and the video time period information, actual target video information corresponding to the preview instruction;
and the second determining subunit is configured to determine the actual target video information as original video information corresponding to the preview instruction.
The sampling information sending module 302 is configured to send the sampling video information to a second cloud, so that the second cloud filters the sampling video information to generate filtered video information.
The display module 303 is configured to receive the filtered video information sent by the second cloud, and send the filtered video information to the mobile terminal, where the filtered video information is used for preview display on the mobile terminal.
In the embodiment of the application, the sampling module 301 samples the original video corresponding to the preview instruction to obtain the sampled video information, then the sampled video information is sent to the second cloud end by the sampled information sending module 302, the sampled video information is filtered by the second cloud end to obtain the filtered video information, then the filtered video information sent by the second cloud end is received by the display module 303, and the filtered video information is sent to the mobile terminal for the mobile terminal to display the filtered video information.
Wherein, this application embodiment is through the sampling to original video information, make the video frame number of the sampling video information that obtains after the sampling be less than original video information, and after filtering sampling video information, make the video frame number of the video information after the filtration that obtains after the filtration be more less than original video information, video frame number when having reduced the video preview of mobile terminal, wherein, through sampling and filtering to video information, the validity of previewing video information has been promoted, promote video preview speed and efficiency, wherein, carry out sampling and filtering operation respectively through two high in the clouds, can reduce the processing burden in single high in the clouds.
Referring to fig. 6, fig. 6 is a schematic structural diagram of a video preview device provided in the present application, where the video preview device is integrated in a second cloud, and may include a receiving module 311, a filtering module 312, and a filtering information sending module 313, which may specifically be as follows:
the receiving module 311 is configured to receive sampled video information sent by a first cloud, where the sampled video information is obtained by sampling, by the first cloud, original video information corresponding to the preview instruction.
And a filtering module 312, configured to filter the sampled video information, and generate filtered video information.
Wherein, the filtering module 312 includes:
the calculating unit is used for calculating the actual similarity between two adjacent target video images in the sampling video information;
the second determining unit is used for determining a video image to be filtered from the two target video images according to a preset similarity threshold and the actual similarity;
and the filtering unit is used for filtering the video image to be filtered based on the sampling video information to obtain filtered video information.
Wherein the second determining unit includes:
a third determining subunit, configured to determine a first target video image and a second target video image in the two target video images, where the second target video image is located after the shooting time of the first target video image;
and the fourth determining subunit is configured to determine the second target video image as the video image to be filtered, when the actual similarity is greater than a preset similarity threshold.
The filtering information sending module 313 is configured to send the filtered video information to the first cloud, so that the first cloud sends the filtered video information to the mobile terminal, and the filtered video information is used for preview display on the mobile terminal.
In the embodiment of the application, the receiving module 311 receives the sampled video information sent by the first cloud, receives the sampled video information, the filtering module 312 filters the sampled video information to obtain filtered video information, then the filtered video information is sent to the first cloud by the filtered information sending module 313, the filtered video information is merged by the first cloud to generate preview video information, and the preview video information is sent to the mobile terminal by the first cloud for the mobile terminal to preview and display the preview video information.
According to the embodiment of the application, the sampled video image is filtered again, so that the obtained filtered video information is further reduced in the number of video frames compared with the sampled video information, and the video preview speed is further improved. The sampled video information is filtered according to the similarity of the images, so that the effectiveness of the filtered video information is ensured, and the quality and the preview efficiency of the preview information are improved.
In addition, the present application also provides an electronic device, as shown in fig. 7, which shows a schematic structural diagram of the electronic device related to the present application, specifically:
the electronic device may include components such as a processor 401 of one or more processing cores, memory 402 of one or more computer-readable storage media, a power supply 403, and an input unit 404. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 7 does not constitute a limitation of the electronic device and may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. Wherein:
the processor 401 is a control center of the electronic device, connects various parts of the whole electronic device by various interfaces and lines, performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 402 and calling data stored in the memory 402, thereby performing overall monitoring of the electronic device. Optionally, processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 401.
The memory 402 may be used to store software programs and modules, and the processor 401 executes various functional applications and data processing by operating the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data created according to use of the electronic device, and the like. Further, the memory 402 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 access to the memory 402.
The electronic device further comprises a power supply 403 for supplying power to the various components, and preferably, the power supply 403 is logically connected to the processor 401 through a power management system, so that functions of managing charging, discharging, and power consumption are realized through the power management system. The power supply 403 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.
The electronic device may further include an input unit 404, and the input unit 404 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.
Although not shown, the electronic device may further include a display unit and the like, which are not described in detail herein. Specifically, in this embodiment, the processor 401 in the electronic device loads the executable file corresponding to the process of one or more application programs into the memory 402 according to the following instructions, and the processor 401 runs the application program stored in the memory 402, thereby implementing the steps in any video preview method provided by the embodiment of the present application.
The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.
The embodiment of the application is through the sampling to original video information, make the video frame number of the sampling video information that obtains after the sampling be less than original video information, and after filtering sampling video information, make the video frame number of the video information after the filtration that obtains after the filtration be more less than original video information, video frame number when having reduced the video preview of mobile terminal, wherein, through sampling and filtering to video information, the validity of previewing video information has been promoted, promote video preview speed and efficiency, wherein, carry out sampling and filtering operation respectively through two high in the clouds, can reduce the processing burden in single high in the clouds.
It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor.
To this end, the present application provides a computer-readable storage medium having stored thereon a computer program, which can be loaded by a processor to perform the steps of any of the video preview methods provided herein.
The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.
Wherein the computer-readable storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.
Since the instructions stored in the computer-readable storage medium can execute the steps in any of the video previews provided by the present application, the beneficial effects that can be achieved by any of the video previewing methods provided by the present application can be achieved, for details, see the foregoing embodiments, and are not described herein again.
The video preview method, apparatus, electronic device and computer-readable storage medium provided in the present application are described in detail above, and a specific example is applied in the present application to illustrate the principle and implementation of the present invention, and the description of the above embodiment is only used to help understanding the method and the core idea of the present invention; meanwhile, for those skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A video preview method is applied to a first cloud end and comprises the following steps:
after a preview instruction sent by a mobile terminal is received, sampling original video information corresponding to the preview instruction to obtain sampled video information;
sending the sampled video information to a second cloud end so that the second cloud end filters the sampled video information to generate filtered video information;
and receiving the filtered video information sent by the second cloud, and sending the filtered video information to the mobile terminal, wherein the filtered video information is used for previewing and displaying on the mobile terminal.
2. The method of claim 1, wherein the sampling original video information corresponding to the preview instruction to obtain sampled video information comprises:
determining original video information to be previewed according to the preview instruction;
analyzing the original video information to obtain an original video frame sequence list;
and extracting at least one frame of target video image from the original video frame sequence list according to a preset time interval threshold value to obtain sampled video information.
3. The method of claim 2, wherein the determining original video information to be previewed according to the preview instruction comprises:
analyzing the preview instruction to obtain target video name information and video time period information corresponding to the preview instruction;
determining actual target video information corresponding to the preview instruction according to the target video name information and the video time period information;
and determining the actual target video information as the original video information corresponding to the preview instruction.
4. A video preview method is applied to a second cloud terminal and comprises the following steps:
receiving sampling video information sent by a first cloud, wherein the sampling video information is obtained by sampling original video information corresponding to a preview instruction by the first cloud;
filtering the sampled video information to generate filtered video information;
sending the filtered video information to the first cloud end, so that the first cloud end sends the filtered video information to the mobile end, and the filtered video information is used for previewing and displaying on the mobile end.
5. The method of claim 4, wherein filtering the sampled video information to generate filtered video information comprises:
calculating the actual similarity between two adjacent target video images in the sampled video information;
determining a video image to be filtered from the two target video images according to a preset similarity threshold and the actual similarity;
and filtering the video image to be filtered based on the sampling video information to obtain filtered video information.
6. The method according to claim 5, wherein the determining a video image to be filtered from the two target video images according to a preset similarity threshold and the actual similarity comprises:
determining a first target video image and a second target video image in the two target video images, wherein the second target video image is obtained after the shooting time of the first target video image;
and when the actual similarity is larger than a preset similarity threshold, determining the second target video image as a video image to be filtered.
7. A video preview device, integrated in a first cloud, comprising:
the sampling module is used for sampling original video information corresponding to a preview instruction after receiving the preview instruction sent by the mobile terminal to obtain sampled video information;
the sampling information sending module is used for sending the sampling video information to a second cloud end so that the second cloud end can filter the sampling video information and generate filtered video information;
and the display module is used for receiving the filtered video information sent by the second cloud end and sending the filtered video information to the mobile end, wherein the filtered video information is used for previewing and displaying on the mobile end.
8. A video preview device integrated in a second cloud, comprising:
the receiving module is used for receiving sampling video information sent by a first cloud, wherein the sampling video information is obtained by sampling original video information corresponding to a preview instruction by the first cloud;
the filtering module is used for filtering the sampled video information to generate filtered video information;
the filtering information sending module is used for sending the filtered video information to the first cloud end, so that the first cloud end sends the filtered video information to the mobile end, and the filtered video information is used for previewing and displaying on the mobile end.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps in the video preview method of any of claims 1-3 or 4-6 when executing the computer program.
10. A computer-readable storage medium, having stored thereon a computer program which, when executed by a processor, performs the steps in the video preview method of any of claims 1-3 or 4-6.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111553206.3A CN114205632A (en) | 2021-12-17 | 2021-12-17 | Video preview method and device, electronic equipment and computer readable storage medium |
| PCT/CN2022/124972 WO2023109284A1 (en) | 2021-12-17 | 2022-10-12 | Video preview method and apparatus, and electronic device and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111553206.3A CN114205632A (en) | 2021-12-17 | 2021-12-17 | Video preview method and device, electronic equipment and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114205632A true CN114205632A (en) | 2022-03-18 |
Family
ID=80654987
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111553206.3A Pending CN114205632A (en) | 2021-12-17 | 2021-12-17 | Video preview method and device, electronic equipment and computer readable storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114205632A (en) |
| WO (1) | WO2023109284A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023109284A1 (en) * | 2021-12-17 | 2023-06-22 | 深圳Tcl新技术有限公司 | Video preview method and apparatus, and electronic device and computer-readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103546828A (en) * | 2012-07-16 | 2014-01-29 | 腾讯科技（深圳）有限公司 | Method and device for generating program preview |
| CN111182359A (en) * | 2019-12-30 | 2020-05-19 | 咪咕视讯科技有限公司 | Video preview method, video frame extraction method, video processing device and storage medium |
| CN112291618A (en) * | 2020-10-13 | 2021-01-29 | 北京沃东天骏信息技术有限公司 | Video preview content generating method and device, computer device and storage medium |
| CN113051236A (en) * | 2021-03-09 | 2021-06-29 | 北京沃东天骏信息技术有限公司 | Method and device for auditing video and computer-readable storage medium |
| WO2021143273A1 (en) * | 2020-01-19 | 2021-07-22 | 北京字节跳动网络技术有限公司 | Live streaming sampling method and apparatus, and electronic device |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107016061A (en) * | 2017-03-15 | 2017-08-04 | 海尔优家智能科技（北京）有限公司 | Video monitoring document handling method and device |
| CN107454454A (en) * | 2017-08-30 | 2017-12-08 | 微鲸科技有限公司 | Method for information display and device |
| CN110505495B (en) * | 2019-08-23 | 2021-12-07 | 北京达佳互联信息技术有限公司 | Multimedia resource frame extraction method, device, server and storage medium |
| CN114205632A (en) * | 2021-12-17 | 2022-03-18 | 深圳Tcl新技术有限公司 | Video preview method and device, electronic equipment and computer readable storage medium |
-
2021
- 2021-12-17 CN CN202111553206.3A patent/CN114205632A/en active Pending
-
2022
- 2022-10-12 WO PCT/CN2022/124972 patent/WO2023109284A1/en unknown
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103546828A (en) * | 2012-07-16 | 2014-01-29 | 腾讯科技（深圳）有限公司 | Method and device for generating program preview |
| CN111182359A (en) * | 2019-12-30 | 2020-05-19 | 咪咕视讯科技有限公司 | Video preview method, video frame extraction method, video processing device and storage medium |
| WO2021143273A1 (en) * | 2020-01-19 | 2021-07-22 | 北京字节跳动网络技术有限公司 | Live streaming sampling method and apparatus, and electronic device |
| CN112291618A (en) * | 2020-10-13 | 2021-01-29 | 北京沃东天骏信息技术有限公司 | Video preview content generating method and device, computer device and storage medium |
| CN113051236A (en) * | 2021-03-09 | 2021-06-29 | 北京沃东天骏信息技术有限公司 | Method and device for auditing video and computer-readable storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023109284A1 (en) * | 2021-12-17 | 2023-06-22 | 深圳Tcl新技术有限公司 | Video preview method and apparatus, and electronic device and computer-readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023109284A1 (en) | 2023-06-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111698553B (en) | Video processing method and device, electronic equipment and readable storage medium | |
| CN105100748B (en) | A kind of video monitoring system and method | |
| CN111464761A (en) | Video processing method and device, electronic equipment and computer readable storage medium | |
| CN111163278B (en) | Camera control method and device | |
| CN114902687A (en) | Game screen recording method and device and computer readable storage medium | |
| CN110580508A (en) | video classification method and device, storage medium and mobile terminal | |
| KR20050030590A (en) | Systems and methods for locating a video file | |
| WO2015184861A1 (en) | Method and device for processing audio and image information, and terminal device | |
| CN114205632A (en) | Video preview method and device, electronic equipment and computer readable storage medium | |
| EP4206945A1 (en) | Search content matching method and apparatus, and electronic device and storage medium | |
| JP6230386B2 (en) | Image processing apparatus, image processing method, and image processing program | |
| CN113709368A (en) | Image display method, device and equipment | |
| CN113741814A (en) | Data processing method, data processing device, computer readable storage medium and computer equipment | |
| CN111385508B (en) | Video processing method, device, equipment and storage medium | |
| CN115278355B (en) | Video editing method, device, equipment, computer readable storage medium and product | |
| CN114143429B (en) | Image shooting method, device, electronic equipment and computer readable storage medium | |
| CN112861612A (en) | Method and device for shooting image, electronic equipment and storage medium | |
| CN112843736A (en) | Method and device for shooting image, electronic equipment and storage medium | |
| CN113038261A (en) | Video generation method, device, equipment, system and storage medium | |
| CN112843696A (en) | Shooting method, shooting device, electronic equipment and storage medium | |
| CN112860372B (en) | Method and device for shooting image, electronic equipment and storage medium | |
| CN114143610B (en) | Shooting guiding method, shooting guiding device, server and electronic equipment | |
| CN113286115B (en) | Video monitoring guide library distribution control method and device and related equipment | |
| CN110691256B (en) | Video associated information processing method and device, server and storage medium | |
| CN116939130A (en) | Video generation method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |