CN114173152A - Communication video screening method and system - Google Patents

Communication video screening method and system Download PDF

Info

Publication number
CN114173152A
CN114173152A CN202111300482.9A CN202111300482A CN114173152A CN 114173152 A CN114173152 A CN 114173152A CN 202111300482 A CN202111300482 A CN 202111300482A CN 114173152 A CN114173152 A CN 114173152A
Authority
CN
China
Prior art keywords
video
communication
screening
processed
video frames
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202111300482.9A
Other languages
Chinese (zh)
Inventor
周国强
许晋铠
蒋昊宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN202111300482.9A priority Critical patent/CN114173152A/en
Publication of CN114173152A publication Critical patent/CN114173152A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

The invention provides a communication video screening method and system, and relates to the technical field of video processing. Firstly, acquiring a to-be-processed communication video sent by first video communication terminal equipment, wherein the to-be-processed communication video comprises a plurality of communication video frames, the plurality of communication video frames are continuous in time sequence, and the plurality of communication video frames are formed by carrying out video acquisition on corresponding first communication terminal users on the basis of the first video communication terminal equipment; secondly, determining screening proportion information of the communication video to be processed, wherein the screening proportion information represents the maximum proportion of the communication video frames screened out when the communication video to be processed is screened; and then, screening the multi-frame communication video frames included in the communication video to be processed based on the screening proportion information to obtain the corresponding target communication video. Based on the method, the problem of poor video screening effect in the prior art can be solved.

Description

Communication video screening method and system
Technical Field
The invention relates to the technical field of video processing, in particular to a communication video screening method and system.
Background
Video communication, also known as video telephony, has been widely used and developed as an important communication means. The video communication generally refers to a communication mode for transmitting human voice and images in real time between terminal devices such as mobile phones and the like based on the internet and a mobile internet terminal. In some video communication applications, after the background server acquires the communication video, the background server generally screens the communication video and then sends the communication video to other communication terminals. However, in the prior art, the communication video is generally subjected to de-duplication screening, and thus, the problem of poor screening effect may be caused.
Disclosure of Invention
In view of the above, the present invention provides a method and a system for screening a communication video to improve the problem of poor video screening effect in the prior art.
In order to achieve the above purpose, the embodiment of the invention adopts the following technical scheme:
a communication video screening method is applied to a video communication server, the video communication server is in communication connection with a first video communication terminal device, and the method comprises the following steps:
acquiring a to-be-processed communication video sent by the first video communication terminal device, wherein the to-be-processed communication video comprises a plurality of communication video frames, the plurality of communication video frames are continuous in time sequence, and the plurality of communication video frames are formed by carrying out video acquisition on corresponding first communication terminal users on the basis of the first video communication terminal device;
determining screening proportion information of the communication video to be processed, wherein the screening proportion information represents the maximum proportion of screened communication video frames when the communication video to be processed is screened;
and screening the multi-frame communication video frame included in the communication video to be processed based on the screening proportion information to obtain a target communication video corresponding to the communication video to be processed.
In some preferred embodiments, in the communication video screening method, the step of acquiring a to-be-processed communication video sent by the first video communication terminal device includes:
judging whether video communication request information sent by the first video communication terminal device is received or not, and after the video communication request information is received, analyzing the video communication request information to obtain a second video communication terminal device which determines to request for video communication;
performing communication verification processing on the first video communication terminal equipment and the second video communication terminal equipment to obtain corresponding video communication verification results;
if the video communication verification result is that the verification fails, generating corresponding video communication request failure information, and sending the video communication request failure information to the first video communication terminal equipment, wherein the first video communication terminal equipment is used for displaying the video communication request failure information to a corresponding first communication terminal user;
if the video communication verification result is that the verification is passed, generating corresponding video communication request success information, and sending the video communication request success information to the first video communication terminal equipment, wherein the first video communication terminal equipment is used for carrying out video acquisition on the corresponding first communication terminal user based on the video communication request success information to form a communication video to be processed;
and acquiring the to-be-processed communication video which is successfully acquired and sent by the first communication terminal equipment based on the video communication request.
In some preferred embodiments, in the communication video screening method, the step of performing communication verification processing on the first video communication terminal device and the second video communication terminal device to obtain corresponding video communication verification results includes:
acquiring equipment identity information of the first video communication terminal equipment, acquiring first equipment identity information of the first video communication terminal equipment, acquiring equipment identity information of the second video communication terminal equipment, and acquiring second equipment identity information of the second video communication terminal equipment;
determining whether a communication identity corresponding relation exists between the first equipment identity information and the second equipment identity information in a target communication relation database;
if the communication identity corresponding relationship exists between the first equipment identity information and the second equipment identity information, a video communication verification result used for representing that the verification is passed is obtained, and if the communication identity corresponding relationship does not exist between the first equipment identity information and the second equipment identity information, a video communication verification result used for representing that the verification is not passed is obtained.
In some preferred embodiments, in the communication video screening method, the step of determining the screening proportion information of the communication video to be processed includes:
determining the number of communication video frames included in the communication video to be processed to obtain a first video frame number corresponding to the communication video to be processed, and determining the number of historical communication video frames included in a historical communication video corresponding to the first video communication terminal equipment to obtain a second video frame number corresponding to the historical communication video;
and determining the screening proportion information of the communication video to be processed based on the number of the first video frames and the number of the second video frames.
In some preferred embodiments, in the method for screening communication videos, the step of determining the screening proportion information of the communication videos to be processed based on the first number of video frames and the second number of video frames includes:
determining the frequency of video communication of the first video communication terminal equipment in history to obtain the historical communication frequency corresponding to the first video communication terminal equipment, calculating the proportion between the number of the second video frames and the historical communication frequency to obtain the average value of the number of the video frames corresponding to the number of the second video frames, and performing weighted summation calculation on the number of the first video frames and the average value of the number of the video frames based on a first weight coefficient corresponding to the number of the first video frames and a second weight coefficient corresponding to the average value of the number of the video frames to obtain a corresponding first screening representation coefficient;
screening multiple representative communication video frames from multiple communication video frames included in the communication video to be processed, wherein any two representative communication video frames in the multiple representative communication video frames have discontinuous time sequence in the multiple communication video frames, and the multiple representative communication video frames include the earliest and latest communication video frames in the time sequence in the multiple communication video frames;
calculating a video frame difference value between every two adjacent representative communication video frames in the multi-frame representative communication video frames, and calculating a sum value of the video frame difference values between every two adjacent representative communication video frames in the multi-frame representative communication video frames to obtain a video frame difference total value corresponding to the multi-frame representative communication video frames;
and determining a corresponding second screening characterization coefficient based on the video frame difference total value, performing fusion processing on the second screening characterization coefficient and the first screening characterization coefficient to obtain a corresponding screening characterization coefficient fusion value, and determining screening proportion information of the communication video to be processed based on the screening characterization coefficient fusion value.
In some preferred embodiments, in the method for screening a communication video, the determining a corresponding second screening characterization coefficient based on the total video frame difference value, performing fusion processing on the second screening characterization coefficient and the first screening characterization coefficient to obtain a corresponding screening characterization coefficient fusion value, and determining the screening ratio information of the communication video to be processed based on the screening characterization coefficient fusion value includes:
normalizing the first screening characterization coefficient based on a first threshold value configured in advance to obtain a first normalized value corresponding to the first screening characterization coefficient;
determining a negative correlation value of the video frame difference total value as a corresponding second screening characterization coefficient, and performing normalization processing on the second screening characterization coefficient based on a second threshold value configured in advance to obtain a second normalization value corresponding to the second screening characterization coefficient;
calculating a weighted value of the first normalization value and the second normalization value, and determining the weighted value as a corresponding screening characterization coefficient fusion value, wherein the weighting coefficient corresponding to the first normalization value is greater than the weighting coefficient corresponding to the second normalization value;
and determining the screening proportion information of the communication video to be processed with positive correlation based on the screening characterization coefficient fusion value.
In some preferred embodiments, in the method for screening a communication video, the step of screening the multiple frames of communication video frames included in the communication video to be processed based on the screening ratio information to obtain a target communication video corresponding to the communication video to be processed includes:
screening out a plurality of communication video frames from the plurality of communication video frames included in the communication video to be processed as a plurality of candidate communication video frames corresponding to the communication video to be processed;
and performing duplicate removal screening processing on the multiple candidate communication video frames corresponding to the communication video to be processed based on the screening proportion information to obtain a target communication video corresponding to the communication video to be processed, wherein the target communication video comprises other communication video frames except the candidate communication video frames and the candidate communication video frames which are not screened out.
The embodiment of the invention also provides a communication video screening system, which is applied to a video communication server, wherein the video communication server is in communication connection with a first video communication terminal device, and the system comprises:
the communication video acquisition module is used for acquiring a to-be-processed communication video sent by the first video communication terminal device, wherein the to-be-processed communication video comprises a plurality of communication video frames, the plurality of communication video frames are continuous multi-frame video frames in a time sequence, and the plurality of communication video frames are formed by carrying out video acquisition on corresponding first communication terminal users on the basis of the first video communication terminal device;
the screening proportion determining module is used for determining screening proportion information of the communication video to be processed, wherein the screening proportion information represents the maximum proportion of screened communication video frames when the communication video to be processed is screened;
and the communication video screening module is used for screening the multi-frame communication video frames included in the communication video to be processed based on the screening proportion information to obtain a target communication video corresponding to the communication video to be processed.
In some preferred embodiments, in the communication video screening system, the screening ratio determining module is specifically configured to:
determining the number of communication video frames included in the communication video to be processed to obtain a first video frame number corresponding to the communication video to be processed, and determining the number of historical communication video frames included in a historical communication video corresponding to the first video communication terminal equipment to obtain a second video frame number corresponding to the historical communication video;
and determining the screening proportion information of the communication video to be processed based on the number of the first video frames and the number of the second video frames.
In some preferred embodiments, in the communication video screening system, the communication video screening module is specifically configured to:
screening out a plurality of communication video frames from the plurality of communication video frames included in the communication video to be processed as a plurality of candidate communication video frames corresponding to the communication video to be processed;
and performing duplicate removal screening processing on the multiple candidate communication video frames corresponding to the communication video to be processed based on the screening proportion information to obtain a target communication video corresponding to the communication video to be processed, wherein the target communication video comprises other communication video frames except the candidate communication video frames and the candidate communication video frames which are not screened out.
According to the communication video screening method and system provided by the embodiment of the invention, after the to-be-processed communication video sent by the first video communication terminal device is obtained, the screening proportion information of the to-be-processed communication video can be determined, and then the multi-frame communication video frames included in the to-be-processed communication video are screened based on the screening proportion information to obtain the corresponding target communication video. Based on this, because the screening proportion information for screening is determined in advance, namely the maximum proportion of the communication video frames screened out when the communication video to be processed is screened is limited, the problem of excessive communication video distortion caused by screening out the communication video with an excessive proportion can be avoided, the reliable effect of screening is ensured, and the problem of poor effect of video screening in the prior art is improved.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
Fig. 1 is a schematic view of an application system of a video communication server according to an embodiment of the present invention.
Fig. 2 is a schematic flow chart of a communication video screening method according to an embodiment of the present invention.
Fig. 3 is a block diagram of a communication video screening system according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, an embodiment of the present invention provides a video communication server. Wherein the video communication server may include a memory and a processor.
In detail, the memory and the processor are electrically connected directly or indirectly to realize data transmission or interaction. For example, they may be electrically connected to each other via one or more communication buses or signal lines. The memory can have stored therein at least one software function (computer program) which can be present in the form of software or firmware. The processor may be configured to execute the executable computer program stored in the memory, so as to implement the communication video screening method provided by the embodiment of the present invention.
For example, in some examples of possible implementations, the Memory may be, but is not limited to, Random Access Memory (RAM), Read Only Memory (ROM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), electrically Erasable Programmable Read-Only Memory (EEPROM), and the like.
For example, in some examples of possible implementations, the Processor may be a general-purpose Processor including a Central Processing Unit (CPU), a Network Processor (NP), a System on Chip (SoC), and so on; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components.
For example, in some possible implementation examples, the structure shown in fig. 1 is only an illustration, and the video communication server may further include more or fewer components than those shown in fig. 1, or have a different configuration from that shown in fig. 1, and may include a communication unit for information interaction with other devices (such as the first video communication terminal device and the second video communication terminal device), for example.
With reference to fig. 2, an embodiment of the present invention further provides a communication video screening method, which is applicable to the video communication server. The method steps defined by the related flow of the communication video screening method can be realized by the video communication server, and the video communication server is in communication connection with a first video communication terminal device. The specific process shown in FIG. 2 will be described in detail below.
And step 110, acquiring a to-be-processed communication video sent by the first video communication terminal device.
In this embodiment of the present invention, the video communication server may first execute step 110, so as to obtain the to-be-processed communication video sent by the first video communication terminal device. The communication video to be processed comprises a plurality of communication video frames, the plurality of communication video frames are continuous in time sequence, and the plurality of communication video frames are formed by carrying out video acquisition on corresponding first communication terminal users on the basis of the first video communication terminal equipment.
And step 120, determining the screening proportion information of the communication video to be processed.
In this embodiment of the present invention, the video communication server may first execute step 120, so as to determine the screening ratio information of the to-be-processed communication video, where the screening ratio information represents the maximum ratio of the communication video frames screened out when the to-be-processed communication video is screened.
And step 130, performing screening processing on multi-frame communication video frames included in the communication video to be processed based on the screening proportion information to obtain a target communication video corresponding to the communication video to be processed.
In this embodiment of the present invention, the video communication server may first execute step 130, so that the multi-frame communication video frames included in the communication video to be processed may be filtered based on the filtering ratio information, so as to obtain the target communication video corresponding to the communication video to be processed.
Based on the steps included in the communication video screening method, after the to-be-processed communication video sent by the first video communication terminal device is obtained, screening proportion information of the to-be-processed communication video can be determined, and then, multi-frame communication video frames included in the to-be-processed communication video are screened based on the screening proportion information to obtain the corresponding target communication video. Based on this, because the screening proportion information for screening is determined in advance, namely the maximum proportion of the communication video frames screened out when the communication video to be processed is screened is limited, the problem of excessive communication video distortion caused by screening out the communication video with an excessive proportion can be avoided, the reliable effect of screening is ensured, and the problem of poor effect of video screening in the prior art is improved.
For example, in some possible implementation examples, when step 110 in the above examples is executed, the following sub-steps may be specifically executed to obtain the to-be-processed communication video sent by the first video communication terminal device:
firstly, judging whether video communication request information sent by the first video communication terminal equipment is received or not, and after the video communication request information is received, analyzing and processing the video communication request information to obtain second video communication terminal equipment which determines to request for carrying out video communication;
secondly, communication verification processing is carried out on the first video communication terminal equipment and the second video communication terminal equipment to obtain corresponding video communication verification results;
then, if the video communication verification result is that the verification fails, generating corresponding video communication request failure information, and sending the video communication request failure information to the first video communication terminal device, wherein the first video communication terminal device is used for displaying the video communication request failure information to a corresponding first communication terminal user;
then, if the video communication verification result is that the verification is passed, generating corresponding video communication request success information, and sending the video communication request success information to the first video communication terminal device, wherein the first video communication terminal device is used for performing video acquisition on a corresponding first communication terminal user based on the video communication request success information to form a communication video to be processed;
and finally, acquiring the to-be-processed communication video which is successfully acquired and sent by the first communication terminal equipment based on the video communication request.
For example, in some possible implementation examples, when the step "perform communication verification processing on the first video communication terminal device and the second video communication terminal device to obtain corresponding video communication verification results" in the above example is executed, the following sub-steps may be specifically executed:
firstly, acquiring equipment identity information of the first video communication terminal equipment, acquiring first equipment identity information (such as equipment fingerprints or unique identification information of a pre-registered account and the like) of the first video communication terminal equipment, and acquiring equipment identity information of the second video communication terminal equipment, and acquiring second equipment identity information of the second video communication terminal equipment;
secondly, determining whether a communication identity corresponding relation exists between the first equipment identity information and the second equipment identity information in a target communication relation database (pre-constructed);
then, if it is determined that the communication identity corresponding relationship exists between the first device identity information and the second device identity information, a video communication verification result used for representing that the verification is passed is obtained, and if it is determined that the communication identity corresponding relationship does not exist between the first device identity information and the second device identity information, a video communication verification result used for representing that the verification is not passed is obtained.
For example, in some possible implementation examples, when the step 120 in the above example is executed, the following sub-steps may be specifically executed to determine the filtering ratio information of the to-be-processed communication video:
firstly, determining the number of communication video frames included in the communication video to be processed to obtain a first video frame number corresponding to the communication video to be processed, and determining the number of historical communication video frames included in the historical communication video corresponding to the first video communication terminal equipment to obtain a second video frame number corresponding to the historical communication video;
and secondly, determining screening proportion information of the communication video to be processed based on the number of the first video frames and the number of the second video frames.
For example, in some possible implementation examples, when the step "determining the screening ratio information of the to-be-processed communication video based on the first number of video frames and the second number of video frames" in the above example is performed, the following sub-steps may be specifically performed:
firstly, determining the frequency of video communication performed by the first video communication terminal equipment in history to obtain the historical communication frequency corresponding to the first video communication terminal equipment, calculating the proportion between the second video frame number and the historical communication frequency to obtain the video frame number average value corresponding to the second video frame number, and performing weighted summation calculation on the first video frame number and the video frame number average value based on a first weight coefficient corresponding to the first video frame number and a second weight coefficient corresponding to the video frame number average value to obtain a corresponding first screening representation coefficient;
secondly, screening a plurality of representative communication video frames from a plurality of communication video frames included in the communication video to be processed, wherein any two representative communication video frames in the plurality of representative communication video frames have discontinuous time sequence in the plurality of communication video frames, and the representative communication video frames of the plurality of representative communication video frames include the communication video frames with earliest and latest time sequence in the plurality of communication video frames;
then, aiming at each two adjacent frames in the multi-frame representative communication video frame to represent the communication video frame, calculating a video frame difference value between the two adjacent frames to represent the communication video frame, and calculating a sum value of the video frame difference values between each two adjacent frames in the multi-frame representative communication video frame to represent the communication video frame to obtain a video frame difference total value corresponding to the multi-frame representative communication video frame;
and then, determining a corresponding second screening characterization coefficient based on the video frame difference total value, performing fusion processing on the second screening characterization coefficient and the first screening characterization coefficient to obtain a corresponding screening characterization coefficient fusion value, and determining screening proportion information of the communication video to be processed based on the screening characterization coefficient fusion value.
For example, in some possible implementation examples, when the step "determine a corresponding second screening characterization coefficient based on the video frame difference total value, perform fusion processing on the second screening characterization coefficient and the first screening characterization coefficient to obtain a corresponding screening characterization coefficient fusion value, and determine the screening scale information of the communication video to be processed based on the screening characterization coefficient fusion value" in the above example is performed, the following sub-steps may be specifically performed:
firstly, normalizing the first screening characterization coefficient based on a first preset threshold value to obtain a first normalized value corresponding to the first screening characterization coefficient;
secondly, determining a negative correlation value of the total difference value of the video frames as a corresponding second screening characterization coefficient, and performing normalization processing on the second screening characterization coefficient based on a second threshold value configured in advance to obtain a second normalization value corresponding to the second screening characterization coefficient;
then, calculating a weighted value of the first normalization value and the second normalization value, and determining the weighted value as a corresponding screening characterization coefficient fusion value, wherein the weighting coefficient corresponding to the first normalization value is greater than the weighting coefficient corresponding to the second normalization value;
and then, determining screening proportion information of the communication video to be processed with positive correlation based on the screening characterization coefficient fusion value.
For example, in some possible implementation examples, when the step 130 in the above examples is executed, the following sub-steps may be specifically executed to perform a filtering process on the multiple frames of communication video frames included in the communication video to be processed based on the filtering ratio information, so as to obtain a target communication video corresponding to the communication video to be processed:
firstly, screening out a plurality of communication video frames from the plurality of communication video frames included in the communication video to be processed as a plurality of candidate communication video frames corresponding to the communication video to be processed;
secondly, performing duplicate removal screening processing on the multiple candidate communication video frames corresponding to the communication video to be processed based on the screening proportion information to obtain a target communication video corresponding to the communication video to be processed, wherein the target communication video comprises other communication video frames except the candidate communication video frames and the candidate communication video frames which are not screened out.
For example, in some possible implementation examples, when the step "screen out multiple communication video frames from the multiple communication video frames included in the communication video to be processed as multiple candidate communication video frames corresponding to the communication video to be processed" in the above example is performed, the following sub-steps may be specifically performed:
firstly, selecting a first number of groups of video frame combinations from the multi-frame communication video frames included in the communication video to be processed, wherein each group of video frame combinations comprises two adjacent communication video frames, each communication video frame comprises a second number of sub-communication video frames (formed by segmentation), and the second number of sub-communication video frames are spliced to form a corresponding one-frame communication video frame;
secondly, aiming at each group of video frame combination in the first number of groups of video frame combinations, calculating the sub-video frame similarity between each sub-communication video frame corresponding to one frame of communication video frame included in the video frame combinations and each sub-communication video frame corresponding to the other frame of communication video frame to obtain a second number of square sub-video frame similarities;
then, for each group of video frame combination in the first number of groups of video frame combinations, calculating the video frame similarity between two frame communication video frames included in the video frame combination based on the second number of square sub-video frame similarities corresponding to the video frame combination;
then, for each group of video frame combination in the first number of groups of video frame combinations, respectively calculating similarity difference values between the similarity of the second number of square sub-video frames corresponding to the video frame combination and the similarity of the video frames corresponding to the video frame combination, and calculating a sum value of the similarity difference values to obtain a total similarity difference value corresponding to the video frame combination;
further, for each group of video frame combinations in the first number of groups of video frame combinations, determining a relative size relationship between the video frame similarity corresponding to the video frame combination and a preconfigured video frame similarity threshold, and determining a relative size relationship between the total similarity difference value corresponding to the video frame combination and a preconfigured similarity difference threshold;
finally, for each group of video frame combinations in the first number of groups of video frame combinations, if the video frame similarity corresponding to the video frame combination is less than or equal to the video frame similarity threshold and the total similarity difference value corresponding to the video frame combination is greater than or equal to the similarity difference threshold, determining two communication video frames included in the video frame combination as candidate communication video frames, and if the video frame similarity corresponding to the video frame combination is greater than the video frame similarity threshold or the total similarity difference value corresponding to the video frame combination is less than the similarity difference threshold, not determining the two communication video frames included in the video frame combination as candidate communication video frames.
With reference to fig. 3, an embodiment of the present invention further provides a communication video screening system, which is applicable to the video communication server. The communication video screening system can comprise the following modules:
the communication video acquisition module is used for acquiring a to-be-processed communication video sent by the first video communication terminal device, wherein the to-be-processed communication video comprises a plurality of communication video frames, the plurality of communication video frames are continuous multi-frame video frames in a time sequence, and the plurality of communication video frames are formed by carrying out video acquisition on corresponding first communication terminal users on the basis of the first video communication terminal device;
the screening proportion determining module is used for determining screening proportion information of the communication video to be processed, wherein the screening proportion information represents the maximum proportion of screened communication video frames when the communication video to be processed is screened;
and the communication video screening module is used for screening the multi-frame communication video frames included in the communication video to be processed based on the screening proportion information to obtain a target communication video corresponding to the communication video to be processed.
For example, in some possible implementation examples, the screening ratio determination module is specifically configured to:
determining the number of communication video frames included in the communication video to be processed to obtain a first video frame number corresponding to the communication video to be processed, and determining the number of historical communication video frames included in a historical communication video corresponding to the first video communication terminal equipment to obtain a second video frame number corresponding to the historical communication video; and determining the screening proportion information of the communication video to be processed based on the number of the first video frames and the number of the second video frames.
For example, in some possible implementation examples, the communication video screening module is specifically configured to:
screening out a plurality of communication video frames from the plurality of communication video frames included in the communication video to be processed as a plurality of candidate communication video frames corresponding to the communication video to be processed; and performing duplicate removal screening processing on the multiple candidate communication video frames corresponding to the communication video to be processed based on the screening proportion information to obtain a target communication video corresponding to the communication video to be processed, wherein the target communication video comprises other communication video frames except the candidate communication video frames and the candidate communication video frames which are not screened out.
In summary, according to the communication video screening method and system provided by the present invention, after the to-be-processed communication video sent by the first video communication terminal device is obtained, the screening proportion information of the to-be-processed communication video may be determined, and then the multi-frame communication video frames included in the to-be-processed communication video are screened based on the screening proportion information to obtain the corresponding target communication video. Based on this, because the screening proportion information for screening is determined in advance, namely the maximum proportion of the communication video frames screened out when the communication video to be processed is screened is limited, the problem of excessive communication video distortion caused by screening out the communication video with an excessive proportion can be avoided, the reliable effect of screening is ensured, and the problem of poor effect of video screening in the prior art is improved.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (10)

1. A communication video screening method is applied to a video communication server which is in communication connection with a first video communication terminal device, and comprises the following steps:
acquiring a to-be-processed communication video sent by the first video communication terminal device, wherein the to-be-processed communication video comprises a plurality of communication video frames, the plurality of communication video frames are continuous in time sequence, and the plurality of communication video frames are formed by carrying out video acquisition on corresponding first communication terminal users on the basis of the first video communication terminal device;
determining screening proportion information of the communication video to be processed, wherein the screening proportion information represents the maximum proportion of screened communication video frames when the communication video to be processed is screened;
and screening the multi-frame communication video frame included in the communication video to be processed based on the screening proportion information to obtain a target communication video corresponding to the communication video to be processed.
2. The method for screening communication video according to claim 1, wherein the step of obtaining the to-be-processed communication video transmitted by the first video communication terminal device comprises:
judging whether video communication request information sent by the first video communication terminal device is received or not, and after the video communication request information is received, analyzing the video communication request information to obtain a second video communication terminal device which determines to request for video communication;
performing communication verification processing on the first video communication terminal equipment and the second video communication terminal equipment to obtain corresponding video communication verification results;
if the video communication verification result is that the verification fails, generating corresponding video communication request failure information, and sending the video communication request failure information to the first video communication terminal equipment, wherein the first video communication terminal equipment is used for displaying the video communication request failure information to a corresponding first communication terminal user;
if the video communication verification result is that the verification is passed, generating corresponding video communication request success information, and sending the video communication request success information to the first video communication terminal equipment, wherein the first video communication terminal equipment is used for carrying out video acquisition on the corresponding first communication terminal user based on the video communication request success information to form a communication video to be processed;
and acquiring the to-be-processed communication video which is successfully acquired and sent by the first communication terminal equipment based on the video communication request.
3. The method for screening communication video according to claim 2, wherein the step of performing communication verification processing on the first video communication terminal device and the second video communication terminal device to obtain corresponding video communication verification results comprises:
acquiring equipment identity information of the first video communication terminal equipment, acquiring first equipment identity information of the first video communication terminal equipment, acquiring equipment identity information of the second video communication terminal equipment, and acquiring second equipment identity information of the second video communication terminal equipment;
determining whether a communication identity corresponding relation exists between the first equipment identity information and the second equipment identity information in a target communication relation database;
if the communication identity corresponding relationship exists between the first equipment identity information and the second equipment identity information, a video communication verification result used for representing that the verification is passed is obtained, and if the communication identity corresponding relationship does not exist between the first equipment identity information and the second equipment identity information, a video communication verification result used for representing that the verification is not passed is obtained.
4. The method for screening communication videos as claimed in claim 1, wherein the step of determining the screening ratio information of the communication videos to be processed includes:
determining the number of communication video frames included in the communication video to be processed to obtain a first video frame number corresponding to the communication video to be processed, and determining the number of historical communication video frames included in a historical communication video corresponding to the first video communication terminal equipment to obtain a second video frame number corresponding to the historical communication video;
and determining the screening proportion information of the communication video to be processed based on the number of the first video frames and the number of the second video frames.
5. The method for screening communication videos as claimed in claim 4, wherein the step of determining the screening ratio information of the communication videos to be processed based on the first number of video frames and the second number of video frames comprises:
determining the frequency of video communication of the first video communication terminal equipment in history to obtain the historical communication frequency corresponding to the first video communication terminal equipment, calculating the proportion between the number of the second video frames and the historical communication frequency to obtain the average value of the number of the video frames corresponding to the number of the second video frames, and performing weighted summation calculation on the number of the first video frames and the average value of the number of the video frames based on a first weight coefficient corresponding to the number of the first video frames and a second weight coefficient corresponding to the average value of the number of the video frames to obtain a corresponding first screening representation coefficient;
screening multiple representative communication video frames from multiple communication video frames included in the communication video to be processed, wherein any two representative communication video frames in the multiple representative communication video frames have discontinuous time sequence in the multiple communication video frames, and the multiple representative communication video frames include the earliest and latest communication video frames in the time sequence in the multiple communication video frames;
calculating a video frame difference value between every two adjacent representative communication video frames in the multi-frame representative communication video frames, and calculating a sum value of the video frame difference values between every two adjacent representative communication video frames in the multi-frame representative communication video frames to obtain a video frame difference total value corresponding to the multi-frame representative communication video frames;
and determining a corresponding second screening characterization coefficient based on the video frame difference total value, performing fusion processing on the second screening characterization coefficient and the first screening characterization coefficient to obtain a corresponding screening characterization coefficient fusion value, and determining screening proportion information of the communication video to be processed based on the screening characterization coefficient fusion value.
6. The method for screening communication videos according to claim 5, wherein the step of determining a corresponding second screening characterization coefficient based on the total video frame difference value, performing a fusion process on the second screening characterization coefficient and the first screening characterization coefficient to obtain a corresponding screening characterization coefficient fusion value, and determining the screening ratio information of the communication video to be processed based on the screening characterization coefficient fusion value includes:
normalizing the first screening characterization coefficient based on a first threshold value configured in advance to obtain a first normalized value corresponding to the first screening characterization coefficient;
determining a negative correlation value of the video frame difference total value as a corresponding second screening characterization coefficient, and performing normalization processing on the second screening characterization coefficient based on a second threshold value configured in advance to obtain a second normalization value corresponding to the second screening characterization coefficient;
calculating a weighted value of the first normalization value and the second normalization value, and determining the weighted value as a corresponding screening characterization coefficient fusion value, wherein the weighting coefficient corresponding to the first normalization value is greater than the weighting coefficient corresponding to the second normalization value;
and determining the screening proportion information of the communication video to be processed with positive correlation based on the screening characterization coefficient fusion value.
7. The method according to any one of claims 1 to 6, wherein the step of performing the screening process on the multiple frames of communication video frames included in the communication video to be processed based on the screening ratio information to obtain the target communication video corresponding to the communication video to be processed includes:
screening out a plurality of communication video frames from the plurality of communication video frames included in the communication video to be processed as a plurality of candidate communication video frames corresponding to the communication video to be processed;
and performing duplicate removal screening processing on the multiple candidate communication video frames corresponding to the communication video to be processed based on the screening proportion information to obtain a target communication video corresponding to the communication video to be processed, wherein the target communication video comprises other communication video frames except the candidate communication video frames and the candidate communication video frames which are not screened out.
8. The utility model provides a communication video screening system which characterized in that is applied to the video communication server, video communication server communication connection has first video communication terminal equipment, the system includes:
the communication video acquisition module is used for acquiring a to-be-processed communication video sent by the first video communication terminal device, wherein the to-be-processed communication video comprises a plurality of communication video frames, the plurality of communication video frames are continuous multi-frame video frames in a time sequence, and the plurality of communication video frames are formed by carrying out video acquisition on corresponding first communication terminal users on the basis of the first video communication terminal device;
the screening proportion determining module is used for determining screening proportion information of the communication video to be processed, wherein the screening proportion information represents the maximum proportion of screened communication video frames when the communication video to be processed is screened;
and the communication video screening module is used for screening the multi-frame communication video frames included in the communication video to be processed based on the screening proportion information to obtain a target communication video corresponding to the communication video to be processed.
9. The communication video screening system of claim 8, wherein the screening ratio determination module is specifically configured to:
determining the number of communication video frames included in the communication video to be processed to obtain a first video frame number corresponding to the communication video to be processed, and determining the number of historical communication video frames included in a historical communication video corresponding to the first video communication terminal equipment to obtain a second video frame number corresponding to the historical communication video;
and determining the screening proportion information of the communication video to be processed based on the number of the first video frames and the number of the second video frames.
10. The communication video screening system of claim 8, wherein the communication video screening module is specifically configured to:
screening out a plurality of communication video frames from the plurality of communication video frames included in the communication video to be processed as a plurality of candidate communication video frames corresponding to the communication video to be processed;
and performing duplicate removal screening processing on the multiple candidate communication video frames corresponding to the communication video to be processed based on the screening proportion information to obtain a target communication video corresponding to the communication video to be processed, wherein the target communication video comprises other communication video frames except the candidate communication video frames and the candidate communication video frames which are not screened out.
CN202111300482.9A 2021-11-04 2021-11-04 Communication video screening method and system Withdrawn CN114173152A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111300482.9A CN114173152A (en) 2021-11-04 2021-11-04 Communication video screening method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111300482.9A CN114173152A (en) 2021-11-04 2021-11-04 Communication video screening method and system

Publications (1)

Publication Number Publication Date
CN114173152A true CN114173152A (en) 2022-03-11

Family

ID=80478270

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111300482.9A Withdrawn CN114173152A (en) 2021-11-04 2021-11-04 Communication video screening method and system

Country Status (1)

Country Link
CN (1) CN114173152A (en)

Similar Documents

Publication Publication Date Title
CN114724215A (en) Sensitive image identification method and system
CN114140710A (en) Monitoring data transmission method and system based on data processing
CN113949881B (en) Business processing method and system based on smart city data
CN114140712A (en) Automatic image recognition and distribution system and method
CN114925348A (en) Security verification method and system based on fingerprint identification
CN114139016A (en) Data processing method and system for intelligent cell
CN112686205B (en) Parameter updating method and device and multi-terminal network architecture
CN111178347B (en) Ambiguity detection method, ambiguity detection device, ambiguity detection equipment and ambiguity detection storage medium for certificate image
CN115375886A (en) Data acquisition method and system based on cloud computing service
CN114173152A (en) Communication video screening method and system
CN115457467A (en) Building quality hidden danger positioning method and system based on data mining
CN113965759A (en) Video frame compression method and system
CN114095734A (en) User data compression method and system based on data processing
CN114723456A (en) Payment method and payment system
CN112165594A (en) Service handling method and device based on video communication and computer equipment
CN114173086A (en) User data screening method based on data processing
CN114167763A (en) Validity confirmation method of intelligent health data
CN115171028B (en) Intelligent glasses adjustment control method and system based on image processing
CN114154011A (en) Safe storage method and system based on intelligent health data effective confirmation
CN112233014B (en) Face processing method and face processing platform based on big data and artificial intelligence
CN115471767A (en) Building quality prediction method and system based on data mining
CN114153654A (en) User data backup method and system based on data processing
CN113836402A (en) Order screening method based on data processing
CN114140714A (en) Data processing method and system for smart city
CN114201676A (en) User recommendation method and system based on intelligent cell user matching

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20220311