CN113434102A - Remote same-screen interaction method and device based on cloud computing and computer storage medium - Google Patents
Remote same-screen interaction method and device based on cloud computing and computer storage medium Download PDFInfo
- Publication number
- CN113434102A CN113434102A CN202110696772.3A CN202110696772A CN113434102A CN 113434102 A CN113434102 A CN 113434102A CN 202110696772 A CN202110696772 A CN 202110696772A CN 113434102 A CN113434102 A CN 113434102A
- Authority
- CN
- China
- Prior art keywords
- video
- remote
- receiving end
- video receiving
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a remote on-screen interaction method, equipment and a computer storage medium based on cloud computing, which respectively carry out pause phenomenon analysis and audio information synchronous analysis on remote on-screen interaction interfaces of a video transmitting end and a video receiving end in real time after a remote on-screen interaction interface is established, thereby obtaining a video end with pause phenomenon, a pause time period, an asynchronous video end and an asynchronous time period, so that the video end with pause phenomenon in the pause time period and the asynchronous video end of the remote on-screen interaction interface corresponding to the video transmitting end and the video receiving end are identified, the asynchronous video end is identified in the asynchronous time period, the identification can remind a user in time, and the occurrence of invalid interaction condition caused by interaction of the other video end when the pause phenomenon and the asynchronous audio phenomenon occur in one of the video ends is greatly avoided, the interactive effectiveness is improved, and the remote interactive experience of the user is further enhanced.
Description
Technical Field
The invention belongs to the technical field of on-screen interaction, and particularly relates to a remote on-screen interaction method and device based on cloud computing and a computer storage medium.
Background
With the popularization of multimedia devices such as smart phones, tablet computers, network set-top boxes and smart televisions in homes, the same-screen sharing technology is increasingly used. In the same local area network, the same-screen sharing technology is to push the video data played by the sending end of the multimedia device to the receiving end of the multimedia device, and the receiving end of the multimedia device plays the video, and the receiving end of the multimedia device can also play the video consistent with the sending end of the multimedia device while the sending end of the multimedia device plays the video, thereby realizing the same-screen sharing. However, the current one-screen sharing technology needs to limit the sending end and the receiving end of the multimedia device to be in the same space, however, along with the demand of people for one-screen sharing in different places, the current one-screen sharing technology is extended to a remote one-screen technology, for example, a remote video talkback technology, the sending end and the receiving end of a video are not in the same space, after the sending end of the video sends a video request to the receiving end of the video, the receiving end of the video receives the video request, so that a remote one-screen interaction interface is established, and the demand of people for one-screen sharing in different places is fully met.
In the process of carrying out remote on-screen interaction, because the network transmission at video both ends has the difference, the video picture that leads to video sending end and video receiving terminal to correspond remote on-screen interaction interface easily exists the card pause phenomenon, audio information easily exists asynchronous phenomenon, and the analysis is caught not to above condition to the remote on-screen interaction interface that present video sending end and video receiving terminal correspond, and then do not show in time when the above condition appears, make the user can't in time know, the probability that invalid interaction appears has been increased, thereby remote on-screen interaction experience is felt has been reduced.
Disclosure of Invention
In order to solve the technical problems, the invention is realized by the following technical scheme:
in a first aspect, the present invention provides a cloud computing-based remote on-screen interaction method, which is composed of a video sending end and a video receiving end, and the specific implementation process of the method includes the following steps:
step 1, establishing a remote one-screen interactive interface, namely, sending a video request through a video sending end, and establishing the remote one-screen interactive interface after a video receiving end receives the video request;
step 2, acquiring network transmission speed, namely acquiring the network transmission speed of a video transmitting end and a video receiving end in real time during the establishment of a remote on-screen interaction interface;
step 3, adjusting video image quality parameters of the remote one-screen interactive interface, namely adjusting the video image quality parameters of the remote one-screen interactive interface corresponding to the video sending end and the video receiving end in real time according to the network transmission speed of the collected video sending end and the video receiving end;
step 4, analyzing the remote same-screen interactive interface blocking phenomenon, namely analyzing the blocking phenomenon of the remote same-screen interactive interfaces of the video sending end and the video receiving end in real time to obtain a video end with the blocking phenomenon and a blocking time period, and identifying the video end with the blocking phenomenon in the blocking time period of the remote same-screen interactive interfaces corresponding to the video sending end and the video receiving end;
step 5, audio synchronous analysis of the remote on-screen interactive interface, namely acquiring audio information sent by a video sending end and a video receiving end in real time, and synchronously analyzing the acquired audio information to obtain an asynchronous video end and an asynchronous time period, so that the asynchronous video end is identified on the remote on-screen interactive interface corresponding to the video sending end and the video receiving end in the asynchronous time period;
step 6, interactive audio tone quality parameter detection, namely intercepting interactive audio information of a video sending end and a video receiving end corresponding to a remote same-screen interactive interface in a predefined detection time period, and carrying out tone quality parameter detection on the intercepted interactive audio information;
step 7, interactive audio timbre coefficient evaluation, namely evaluating the interactive audio timbre coefficients of the remote same-screen interactive interface corresponding to the video sending end and the video receiving end according to timbre parameters corresponding to the detected interactive audio information of the remote same-screen interactive interface corresponding to the video sending end and the video receiving end;
and 8, displaying the interactive audio tone quality coefficients, namely correspondingly displaying the interactive audio tone quality coefficients of the remote one-screen interactive interfaces corresponding to the video sending end and the video receiving end on the remote one-screen interactive interfaces corresponding to the video sending end and the video receiving end.
According to a preferred embodiment of the first aspect of the present invention, the remote on-screen interactive interface is composed of a video sending end picture area and a video receiving end picture area.
According to a preferred embodiment of the first aspect of the present invention, the video quality parameters include a bit rate, a frame rate and a resolution.
According to a preferred embodiment of the first aspect of the present invention, in step 3, video image quality parameters of the remote on-screen interactive interface corresponding to the video sending end and the video receiving end are adjusted in real time according to the acquired network transmission speeds of the video sending end and the video receiving end, and the specific adjustment method performs the following steps:
s1, comparing the network transmission speeds of the video sending end and the video receiving end with the preset network transmission speed ranges corresponding to various video image quality levels respectively, and screening out the video image quality levels corresponding to the video sending end and the video receiving end;
s2, matching the video image quality grades corresponding to the screened video sending end and video receiving end with the standard video image quality parameters corresponding to the preset various video image quality grades to obtain the standard video image quality parameters corresponding to the video sending end and the video receiving end;
s3, respectively collecting the current video image quality parameters of the remote same-screen interaction interface corresponding to the video sending end and the video receiving end;
s4, comparing the current video image quality parameter of the collected video sending end corresponding to the remote same-screen interaction interface with the standard video image quality parameter corresponding to the video sending end, if the current video image quality parameter is not consistent with the standard video image quality parameter, adjusting the value of the video image quality parameter to make the value consistent with the standard value corresponding to the video image quality parameter;
and S5, comparing the current video image quality parameters of the acquired video receiving end corresponding to the remote on-screen interactive interface with the standard video image quality parameters corresponding to the video receiving end, and processing according to the method in the step S4.
According to a preferred embodiment of the first aspect of the present invention, in step 4, a stuck phenomenon analysis is performed on remote on-screen interactive interfaces of a video sending end and a video receiving end in real time, so as to obtain a video end and a stuck time period in which a stuck phenomenon occurs, and the specific operation steps are as follows:
h1, acquiring picture areas corresponding to a video receiving end and a video receiving end from remote same-screen interaction interfaces corresponding to the video transmitting end and the video receiving end respectively;
h2, acquiring the video sending end picture images corresponding to the acquisition time periods from the video receiving end picture area according to the set acquisition time periods, and acquiring the video receiving end picture images corresponding to the acquisition time periods from the video receiving end picture area;
h3, numbering the video sending terminal picture images corresponding to each acquisition time period according to the sequence of the acquisition time periods, comparing the video sending terminal picture images corresponding to each acquisition time period with the video sending terminal picture images corresponding to the adjacent acquisition time periods according to the numbering sequence, judging whether the video sending terminal picture images corresponding to the adjacent acquisition time periods are the same, if so, indicating that the video sending terminal has a pause phenomenon between the adjacent acquisition time periods, and marking the adjacent acquisition time periods as pause time periods;
h4, numbering the video receiving end picture images corresponding to each acquisition time period according to the sequence of the acquisition time periods, comparing the video receiving end picture images corresponding to each acquisition time period with the video receiving end picture images corresponding to the adjacent acquisition time periods according to the numbering sequence, judging whether the video receiving end picture images corresponding to the adjacent acquisition time periods are the same, if so, indicating that the video receiving end has a pause phenomenon between the adjacent acquisition time periods, and marking the adjacent acquisition time periods as pause time periods.
According to a preferred embodiment of the first aspect of the present invention, in step 5, audio information sent by the video sending end and the video receiving end is collected in real time, and the collected audio information is analyzed synchronously, so as to obtain an asynchronous video end and an asynchronous time period, and the specific operation steps are as follows:
d1, acquiring audio information sent by the video sending end and the video receiving end in real time through the built-in microphones of the video sending end and the video receiving end, and acquiring an audio sending time period corresponding to the audio information in real time after acquiring the audio information;
d2, when audio information sent by the video sending end is collected, the audio information of the video sending end is captured on the remote same-screen interactive interface corresponding to the video receiving end in the audio sending time period corresponding to the audio information, if the audio information is not captured, the audio information sent by the video sending end is asynchronous, and the audio sending time period is recorded as an asynchronous time period;
d3, when the audio information sent by the video receiving end is collected, the audio information of the video receiving end is captured on the remote same-screen interactive interface corresponding to the video sending end in the audio sending time period corresponding to the audio information, if the audio information is not captured, the audio information sent by the video receiving end is not synchronous, and the audio sending time period is recorded as an asynchronous time period.
According to a preferred embodiment of the first aspect of the present invention, the psychoacoustic parameters include a frequency of audio interruptions and a total duration of audio interruptions.
According to a preferred implementation manner of the first aspect of the present invention, the calculation formula of the interactive audio timbre coefficient of the video sending end corresponding to the remote on-screen interactive interface is as follows
Is expressed as interactive audio tone quality coefficient, t, of the video sending end corresponding to the remote same-screen interactive interfaceHair-like device、mHair-like deviceRespectively representing the total audio interruption duration and the total audio interruption frequency corresponding to the interactive audio information of the remote same-screen interactive interface corresponding to the video sending end, wherein T represents a predefined detection time period;
the calculation formula of the interactive audio tone quality coefficient of the video receiving end corresponding to the remote same-screen interactive interface is
Is expressed as an interactive audio tone quality coefficient, t, of the video receiving end corresponding to the remote same-screen interactive interfaceHarvesting machine、mHarvesting machineRespectively expressed as the total time of audio interruption and the total time of audio interruption corresponding to the interactive audio information of the remote same-screen interactive interface corresponding to the video receiving endThe total frequency is cut off.
In a second aspect, the present invention provides an apparatus, comprising a processor, and a memory and a network interface connected to the processor; the network interface is connected with a nonvolatile memory in the server; the processor calls a computer program from the nonvolatile memory through the network interface during running, and runs the computer program through the memory so as to execute the remote on-screen interaction method based on cloud computing.
In a third aspect, the present invention provides a computer storage medium, wherein a computer program is burned in the computer storage medium, and when the computer program runs in a memory of a server, the remote on-screen interaction method based on cloud computing according to the present invention is implemented.
Based on any one of the above aspects, the invention has the following beneficial effects:
(1) the invention analyzes the pause phenomenon of the remote one-screen interactive interface between the video sending end and the video receiving end in real time after the remote one-screen interactive interface is established, so as to obtain the video end with the pause phenomenon and the pause time period, collects the audio information sent by the video sending end and the video receiving end in real time, and synchronously analyzes the collected audio information, so as to obtain the asynchronous video end and the asynchronous time period, thereby identifying the video end with the pause phenomenon in the pause time period of the remote one-screen interactive interface corresponding to the video sending end and the video receiving end, and identifying the asynchronous video end in the asynchronous time period, overcoming the defect that the picture pause phenomenon and the audio asynchronous phenomenon of the remote one-screen interactive interface corresponding to the video sending end and the video receiving end are not captured and analyzed in the remote one-screen interactive process at present, and through carrying out the sign to the video end that the phenomenon appears blocking and the video end of asynchronous, can in time remind the user, be convenient for the user really know current interactive situation, avoided one of them video end to appear blocking and when the phenomenon is asynchronous with the audio frequency greatly, another video end still is carrying out the emergence that the interdynamic caused invalid interactive condition, has improved interactive validity, and then has strengthened user's long-range interactive experience and has felt.
(2) After the remote one-screen interactive interface is established, the video image quality parameters of the remote one-screen interactive interface corresponding to the video sending end and the video receiving end are adjusted in real time according to the network transmission speed, so that the video image quality parameters of the remote one-screen interactive interface corresponding to the video sending end and the video receiving end can be matched with the network transmission speed in real time, the video image blocking phenomenon is greatly reduced, and the continuity of the video images is improved.
(3) After the remote one-screen interactive interface is established, tone quality parameter detection is carried out on interactive audio information of the video transmitting end and the video receiving end corresponding to the remote one-screen interactive interface, and interactive audio tone quality coefficients of the video transmitting end and the video receiving end corresponding to the remote one-screen interactive interface are evaluated according to the tone quality parameter detection, so that users of the video transmitting end and the video receiving end can visually know tone quality conditions of interactive audio, a reference basis is provided for whether interactive communication is continued, and the condition that useless work is caused by the fact that the interactive communication is carried out under the condition of poor tone quality is avoided.
Drawings
The invention is further illustrated by means of the attached drawings, but the embodiments in the drawings do not constitute any limitation to the invention, and for a person skilled in the art, other drawings can be obtained on the basis of the following drawings without inventive effort.
FIG. 1 is a flow chart of the method steps of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, in a first aspect, the present invention provides a cloud computing-based remote on-screen interaction method, where the method is composed of a video sending end and a video receiving end, where the video sending end and the video receiving end may be a mobile phone, a tablet, or a computer, and the method includes the following steps:
step 1, establishing a remote one-screen interactive interface, namely, sending a video request through a video sending end, and establishing the remote one-screen interactive interface after a video receiving end receives the video request, wherein the remote one-screen interactive interface consists of a picture area of the video sending end and a picture area of the video receiving end;
step 2, acquiring network transmission speed, namely acquiring the network transmission speed of a video transmitting end and a video receiving end in real time during the establishment of a remote on-screen interaction interface;
and 3, adjusting video image quality parameters of the remote same-screen interactive interface, namely adjusting the video image quality parameters of the remote same-screen interactive interface corresponding to the video sending end and the video receiving end in real time according to the network transmission speed of the collected video sending end and the video receiving end, wherein the video image quality parameters comprise bit rate, frame rate and resolution, and the specific adjusting method comprises the following steps:
s1, comparing the network transmission speeds of the video sending end and the video receiving end with the preset network transmission speed ranges corresponding to various video image quality levels respectively, and screening out the video image quality levels corresponding to the video sending end and the video receiving end;
s2, matching the video image quality levels corresponding to the screened video sending end and video receiving end with standard video image quality parameters corresponding to various preset video image quality levels to obtain standard video image quality parameters corresponding to the video sending end and the video receiving end, wherein the standard video image quality parameters comprise a standard bit rate, a standard frame rate and a standard resolution;
s3, respectively collecting the current video image quality parameters of the remote same-screen interaction interface corresponding to the video sending end and the video receiving end;
s4, comparing the current video image quality parameter of the collected video sending end corresponding to the remote same-screen interaction interface with the standard video image quality parameter corresponding to the video sending end, if the current video image quality parameter is not consistent with the standard video image quality parameter, adjusting the value of the video image quality parameter to make the value consistent with the standard value corresponding to the video image quality parameter;
s5, comparing the current video image quality parameter of the collected video receiving end corresponding to the remote same-screen interaction interface with the standard video image quality parameter corresponding to the video receiving end, and processing according to the method of the step S4;
in this embodiment, after the remote on-screen interactive interface is established, video image quality parameters of the video sending end and the video receiving end corresponding to the remote on-screen interactive interface are adjusted in real time according to the network transmission speed, so that the video image quality parameters of the video sending end and the video receiving end corresponding to the remote on-screen interactive interface can be matched with the network transmission speed in real time, the occurrence of video image blocking is greatly reduced, and the continuity of video images is improved;
the video image quality parameters selected by the embodiment are three parameters, namely bit rate, frame rate and resolution, because the bit rate, the frame rate and the resolution have large influence on the video image quality, compared with the method of only selecting the resolution as the video image quality parameters, the video image quality parameter indexes selected by the invention are more comprehensive, so that the video image quality is more specifically adjusted, and the impression of a user is more satisfied;
step 4, remote on-screen interactive interface stuck phenomenon analysis, namely performing stuck phenomenon analysis on remote on-screen interactive interfaces of a video sending end and a video receiving end in real time to obtain a video end with a stuck phenomenon and a stuck time period, wherein the specific operation steps are as follows:
h1, acquiring picture areas corresponding to a video receiving end and a video receiving end from remote same-screen interaction interfaces corresponding to the video transmitting end and the video receiving end respectively;
h2, acquiring the video sending end picture images corresponding to the acquisition time periods from the video receiving end picture area according to the set acquisition time periods, and acquiring the video receiving end picture images corresponding to the acquisition time periods from the video receiving end picture area;
h3, numbering the video sending terminal picture images corresponding to each acquisition time period according to the sequence of the acquisition time periods, comparing the video sending terminal picture images corresponding to each acquisition time period with the video sending terminal picture images corresponding to the adjacent acquisition time periods according to the numbering sequence, judging whether the video sending terminal picture images corresponding to the adjacent acquisition time periods are the same, if so, indicating that the video sending terminal has a pause phenomenon between the adjacent acquisition time periods, and marking the adjacent acquisition time periods as pause time periods;
h4, numbering the video receiving end picture images corresponding to each acquisition time period according to the sequence of the acquisition time periods, comparing the video receiving end picture images corresponding to each acquisition time period with the video receiving end picture images corresponding to the adjacent acquisition time periods according to the numbering sequence, judging whether the video receiving end picture images corresponding to the adjacent acquisition time periods are the same, if so, indicating that the video receiving end has a pause phenomenon between the adjacent acquisition time periods, and marking the adjacent acquisition time periods as pause time periods;
therefore, the video end with the pause phenomenon is identified in the pause time period of the remote same-screen interactive interface corresponding to the video sending end and the video receiving end so as to remind both the video end with the same screen of noticing;
in the embodiment, in the process of analyzing the stuck phenomenon of the remote on-screen interactive interface corresponding to the video sending end and the video receiving end, the mode that the picture image of the video sending end corresponding to each acquisition time period is subjected to picture image comparison corresponding to the adjacent acquisition time period and the picture image of the video receiving end corresponding to each acquisition time period is subjected to picture image comparison corresponding to the adjacent acquisition time period is adopted, because when the pause phenomenon does not occur, the video sending end picture image and the video receiving end picture image in each acquisition time period are rarely identical, and when the pause phenomenon occurs, the picture images are static and freeze, the video sending end picture image or the video receiving end picture image corresponding to each collected time period is the same, and the analysis result is more accurate and reliable by adopting the Kanton phenomenon analysis mode;
and 5, performing audio synchronous analysis on the remote same-screen interactive interface, namely acquiring audio information sent by a video sending end and a video receiving end in real time, and performing synchronous analysis on the acquired audio information to further obtain an asynchronous video end and an asynchronous time period, wherein the audio synchronous analysis comprises the following specific operation steps:
d1, acquiring audio information sent by the video sending end and the video receiving end in real time through the built-in microphones of the video sending end and the video receiving end, and acquiring an audio sending time period corresponding to the audio information in real time after acquiring the audio information;
d2, when audio information sent by the video sending end is collected, the audio information of the video sending end is captured on the remote same-screen interactive interface corresponding to the video receiving end in the audio sending time period corresponding to the audio information, if the audio information is not captured, the audio information sent by the video sending end is asynchronous, and the audio sending time period is recorded as an asynchronous time period;
d3, when audio information sent by the video receiving terminal is collected, carrying out video receiving terminal audio information capture on the remote same-screen interactive interface corresponding to the video sending terminal in the audio sending time period corresponding to the audio information, if the audio information is not captured, the audio information sent by the video receiving terminal is not synchronous, and the audio sending time period is recorded as an asynchronous time period;
therefore, the asynchronous video ends are identified in asynchronous time periods on remote same-screen interactive interfaces corresponding to the video sending end and the video receiving end so as to remind the two parties of the same-screen video ends of noticing;
in the embodiment, after the remote on-screen interactive interface is established, the remote on-screen interactive interface of the video transmitting end and the video receiving end is respectively subjected to the pause phenomenon analysis and the audio information synchronous analysis in real time, so as to obtain the video end with the pause phenomenon, the pause time period, the asynchronous video end and the asynchronous time period, thereby identifying the video end with the pause phenomenon in the pause time period and identifying the asynchronous video end of the remote on-screen interactive interface corresponding to the video transmitting end and the video receiving end, overcoming the defect that the picture pause phenomenon and the audio phenomenon of the remote on-screen interactive interface corresponding to the video transmitting end and the video receiving end are not captured and analyzed in the process of performing remote on-screen interaction at present, and identifying the video end with the pause phenomenon and the asynchronous video end, the method has the advantages that the user can be reminded in time, the user can conveniently and truly know the current interaction condition, the situation that when one video end is blocked and the audio is asynchronous is greatly avoided, the other video end still interacts to cause invalid interaction is avoided, the interaction effectiveness is improved, and the remote interaction experience of the user is further enhanced;
in the process of identifying the video end with the pause phenomenon and the asynchronous video end, the identification mode adopted by the embodiment can be a character identification and a voice prompt identification;
step 6, interactive audio tone quality parameter detection, namely intercepting interactive audio information of a video sending end and a video receiving end corresponding to a remote same-screen interactive interface in a predefined detection time period, wherein the interactive audio information comprises audio information of one end of a video and audio information of the other end of the video, and performing tone quality parameter detection on the intercepted interactive audio information, wherein the tone quality parameters comprise audio interruption frequency and total audio interruption time;
in this embodiment, the duration corresponding to the set detection time period is less than the remote on-screen interaction duration;
and 7, interactive audio timbre coefficient evaluation, namely evaluating the interactive audio timbre coefficients of the video sending end and the video receiving end corresponding to the remote same-screen interactive interface according to the timbre parameters corresponding to the detected interactive audio information of the remote same-screen interactive interface corresponding to the video sending end and the video receiving end, wherein the interactive audio timbre coefficients of the remote same-screen interactive interface corresponding to the video sending end have the calculation formula of
Is expressed as interactive audio tone quality coefficient, t, of the video sending end corresponding to the remote same-screen interactive interfaceHair-like device、mHair-like deviceRespectively representing the total duration and the sound of the audio interruption corresponding to the interactive audio information of the remote same-screen interactive interface corresponding to the video sending endThe total frequency of frequent interruption, T is a predefined detection time period, and the calculation formula of the interactive audio tone quality coefficient of the video receiving end corresponding to the remote same-screen interactive interface is
Is expressed as an interactive audio tone quality coefficient, t, of the video receiving end corresponding to the remote same-screen interactive interfaceHarvesting machine、mHarvesting machineRespectively representing the total audio interruption duration and the total audio interruption frequency corresponding to the interactive audio information of the remote same-screen interactive interface corresponding to the video receiving end, wherein the larger the interactive audio tone quality coefficient is, the better the interactive audio tone quality is;
in this embodiment, after the remote one-screen interaction interface is established, tone quality parameter detection is performed on the interaction audio information of the video sending end and the video receiving end corresponding to the remote one-screen interaction interface, and accordingly, the interaction audio tone quality coefficients of the video sending end and the video receiving end corresponding to the remote one-screen interaction interface are evaluated, so that users of the video sending end and the video receiving end can intuitively know the tone quality condition of the interaction audio, a reference basis is provided for whether to continue to perform the interaction call, and the condition that the interaction call is performed under the condition of poor tone quality to cause useless work is avoided;
and 8, displaying the interactive audio tone quality coefficients, namely correspondingly displaying the interactive audio tone quality coefficients of the remote one-screen interactive interfaces corresponding to the video sending end and the video receiving end on the remote one-screen interactive interfaces corresponding to the video sending end and the video receiving end.
In a second aspect, the present invention provides an apparatus, comprising a processor, and a memory and a network interface connected to the processor; the network interface is connected with a nonvolatile memory in the server; the processor calls a computer program from the nonvolatile memory through the network interface during running, and runs the computer program through the memory so as to execute the remote on-screen interaction method based on cloud computing.
In a third aspect, the present invention provides a computer storage medium, wherein a computer program is burned in the computer storage medium, and when the computer program runs in a memory of a server, the remote on-screen interaction method based on cloud computing according to the present invention is implemented.
The foregoing is merely exemplary and illustrative of the present invention and various modifications, additions and substitutions may be made by those skilled in the art to the specific embodiments described without departing from the scope of the invention as defined in the following claims.
Claims (10)
1. A remote same-screen interaction method based on cloud computing is characterized by comprising a video sending end and a video receiving end, and the specific implementation process of the method comprises the following steps:
step 1, establishing a remote one-screen interactive interface, namely, sending a video request through a video sending end, and establishing the remote one-screen interactive interface after a video receiving end receives the video request;
step 2, acquiring network transmission speed, namely acquiring the network transmission speed of a video transmitting end and a video receiving end in real time during the establishment of a remote on-screen interaction interface;
step 3, adjusting video image quality parameters of the remote one-screen interactive interface, namely adjusting the video image quality parameters of the remote one-screen interactive interface corresponding to the video sending end and the video receiving end in real time according to the network transmission speed of the collected video sending end and the video receiving end;
step 4, analyzing the remote same-screen interactive interface blocking phenomenon, namely analyzing the blocking phenomenon of the remote same-screen interactive interfaces of the video sending end and the video receiving end in real time to obtain a video end with the blocking phenomenon and a blocking time period, and identifying the video end with the blocking phenomenon in the blocking time period of the remote same-screen interactive interfaces corresponding to the video sending end and the video receiving end;
step 5, audio synchronous analysis of the remote on-screen interactive interface, namely acquiring audio information sent by a video sending end and a video receiving end in real time, and synchronously analyzing the acquired audio information to obtain an asynchronous video end and an asynchronous time period, so that the asynchronous video end is identified on the remote on-screen interactive interface corresponding to the video sending end and the video receiving end in the asynchronous time period;
step 6, interactive audio tone quality parameter detection, namely intercepting interactive audio information of a video sending end and a video receiving end corresponding to a remote same-screen interactive interface in a predefined detection time period, and carrying out tone quality parameter detection on the intercepted interactive audio information;
step 7, interactive audio timbre coefficient evaluation, namely evaluating the interactive audio timbre coefficients of the remote same-screen interactive interface corresponding to the video sending end and the video receiving end according to timbre parameters corresponding to the detected interactive audio information of the remote same-screen interactive interface corresponding to the video sending end and the video receiving end;
and 8, displaying the interactive audio tone quality coefficients, namely correspondingly displaying the interactive audio tone quality coefficients of the remote one-screen interactive interfaces corresponding to the video sending end and the video receiving end on the remote one-screen interactive interfaces corresponding to the video sending end and the video receiving end.
2. The remote on-screen interaction method based on cloud computing as claimed in claim 1, wherein: the remote on-screen interactive interface consists of a video sending end picture area and a video receiving end picture area.
3. The remote on-screen interaction method based on cloud computing as claimed in claim 1, wherein: the video quality parameters include bit rate, frame rate, and resolution.
4. The remote on-screen interaction method based on cloud computing as claimed in claim 1, wherein: in the step 3, video image quality parameters of the remote co-screen interactive interface corresponding to the video sending end and the video receiving end are adjusted in real time according to the acquired network transmission speed of the video sending end and the video receiving end, and the specific adjusting method comprises the following steps:
s1, comparing the network transmission speeds of the video sending end and the video receiving end with the preset network transmission speed ranges corresponding to various video image quality levels respectively, and screening out the video image quality levels corresponding to the video sending end and the video receiving end;
s2, matching the video image quality grades corresponding to the screened video sending end and video receiving end with the standard video image quality parameters corresponding to the preset various video image quality grades to obtain the standard video image quality parameters corresponding to the video sending end and the video receiving end;
s3, respectively collecting the current video image quality parameters of the remote same-screen interaction interface corresponding to the video sending end and the video receiving end;
s4, comparing the current video image quality parameter of the collected video sending end corresponding to the remote same-screen interaction interface with the standard video image quality parameter corresponding to the video sending end, if the current video image quality parameter is not consistent with the standard video image quality parameter, adjusting the value of the video image quality parameter to make the value consistent with the standard value corresponding to the video image quality parameter;
and S5, comparing the current video image quality parameters of the acquired video receiving end corresponding to the remote on-screen interactive interface with the standard video image quality parameters corresponding to the video receiving end, and processing according to the method in the step S4.
5. The remote on-screen interaction method based on cloud computing as claimed in claim 1, wherein: in the step 4, the remote same-screen interactive interface of the video sending end and the video receiving end is analyzed for the pause phenomenon in real time, and then the video end with the pause phenomenon and the pause time period are obtained, and the specific operation steps are as follows:
h1, acquiring picture areas corresponding to a video receiving end and a video receiving end from remote same-screen interaction interfaces corresponding to the video transmitting end and the video receiving end respectively;
h2, acquiring the video sending end picture images corresponding to the acquisition time periods from the video receiving end picture area according to the set acquisition time periods, and acquiring the video receiving end picture images corresponding to the acquisition time periods from the video receiving end picture area;
h3, numbering the video sending terminal picture images corresponding to each acquisition time period according to the sequence of the acquisition time periods, comparing the video sending terminal picture images corresponding to each acquisition time period with the video sending terminal picture images corresponding to the adjacent acquisition time periods according to the numbering sequence, judging whether the video sending terminal picture images corresponding to the adjacent acquisition time periods are the same, if so, indicating that the video sending terminal has a pause phenomenon between the adjacent acquisition time periods, and marking the adjacent acquisition time periods as pause time periods;
h4, numbering the video receiving end picture images corresponding to each acquisition time period according to the sequence of the acquisition time periods, comparing the video receiving end picture images corresponding to each acquisition time period with the video receiving end picture images corresponding to the adjacent acquisition time periods according to the numbering sequence, judging whether the video receiving end picture images corresponding to the adjacent acquisition time periods are the same, if so, indicating that the video receiving end has a pause phenomenon between the adjacent acquisition time periods, and marking the adjacent acquisition time periods as pause time periods.
6. The remote on-screen interaction method based on cloud computing as claimed in claim 1, wherein: in the step 5, the audio information sent by the video sending end and the video receiving end is collected in real time, and the collected audio information is synchronously analyzed, so that an asynchronous video end and an asynchronous time period are obtained, wherein the method specifically comprises the following operation steps:
d1, acquiring audio information sent by the video sending end and the video receiving end in real time through the built-in microphones of the video sending end and the video receiving end, and acquiring an audio sending time period corresponding to the audio information in real time after acquiring the audio information;
d2, when audio information sent by the video sending end is collected, the audio information of the video sending end is captured on the remote same-screen interactive interface corresponding to the video receiving end in the audio sending time period corresponding to the audio information, if the audio information is not captured, the audio information sent by the video sending end is asynchronous, and the audio sending time period is recorded as an asynchronous time period;
d3, when the audio information sent by the video receiving end is collected, the audio information of the video receiving end is captured on the remote same-screen interactive interface corresponding to the video sending end in the audio sending time period corresponding to the audio information, if the audio information is not captured, the audio information sent by the video receiving end is not synchronous, and the audio sending time period is recorded as an asynchronous time period.
7. The remote on-screen interaction method based on cloud computing as claimed in claim 1, wherein: the tone quality parameters comprise audio interruption frequency and total audio interruption duration.
8. The remote on-screen interaction method based on cloud computing as claimed in claim 1, wherein: the calculation formula of the interactive audio tone quality coefficient of the video sending end corresponding to the remote same-screen interactive interface is
Is expressed as interactive audio tone quality coefficient, t, of the video sending end corresponding to the remote same-screen interactive interfaceHair-like device、mHair-like deviceRespectively representing the total audio interruption duration and the total audio interruption frequency corresponding to the interactive audio information of the remote same-screen interactive interface corresponding to the video sending end, wherein T represents a predefined detection time period;
the calculation formula of the interactive audio tone quality coefficient of the video receiving end corresponding to the remote same-screen interactive interface is
Is expressed as an interactive audio tone quality coefficient, t, of the video receiving end corresponding to the remote same-screen interactive interfaceHarvesting machine、mHarvesting machineRespectively expressed as a video receiving end corresponding to a remote same-screen interactive interfaceThe total duration of audio interruption and the total frequency of audio interruption corresponding to the interactive audio information.
9. An apparatus, characterized by: the system comprises a processor, a memory and a network interface, wherein the memory and the network interface are connected with the processor; the network interface is connected with a nonvolatile memory in the server; the processor, when running, retrieves a computer program from the non-volatile memory via the network interface and runs the computer program via the memory to perform the method of any of claims 1-8.
10. A computer storage medium, characterized in that: the computer storage medium is burned with a computer program, which when run in the memory of the server implements the method of any of the above claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110696772.3A CN113434102A (en) | 2021-06-23 | 2021-06-23 | Remote same-screen interaction method and device based on cloud computing and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110696772.3A CN113434102A (en) | 2021-06-23 | 2021-06-23 | Remote same-screen interaction method and device based on cloud computing and computer storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113434102A true CN113434102A (en) | 2021-09-24 |
Family
ID=77753503
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110696772.3A Withdrawn CN113434102A (en) | 2021-06-23 | 2021-06-23 | Remote same-screen interaction method and device based on cloud computing and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113434102A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115086725A (en) * | 2022-05-27 | 2022-09-20 | 平安银行股份有限公司 | Remote same-screen method, device and equipment based on browser and storage medium |
-
2021
- 2021-06-23 CN CN202110696772.3A patent/CN113434102A/en not_active Withdrawn
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115086725A (en) * | 2022-05-27 | 2022-09-20 | 平安银行股份有限公司 | Remote same-screen method, device and equipment based on browser and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8553148B2 (en) | Methods and apparatus to distinguish a signal originating from a local device from a broadcast signal | |
| CN104584571B (en) | Audio-frequency fingerprint sequence is produced at set top box | |
| CN110225367A (en) | It has been shown that, recognition methods and the device of object information in a kind of video | |
| WO2010094220A1 (en) | Method and device for acquiring two-dimensional code from video signal | |
| CN110335590B (en) | Voice recognition test method, device and system | |
| EP3163868A1 (en) | Method and device for detecting video conference hotspot scenario | |
| CN108737885A (en) | A kind of analysis Online Video plays the method and device of interim card | |
| CN111050204A (en) | Video clipping method and device, electronic equipment and storage medium | |
| CN110677542A (en) | Call control method and related product | |
| CN105120366A (en) | A presentation method for an image local enlarging function in video call | |
| CN113434102A (en) | Remote same-screen interaction method and device based on cloud computing and computer storage medium | |
| CN106097225A (en) | Weather information timely dissemination method and system based on mobile terminal | |
| CN103581729B (en) | Interaction method and system based on video monitoring | |
| CN109511010A (en) | Method for processing video frequency, video process apparatus, electronic equipment and storage medium | |
| US10762913B2 (en) | Image-based techniques for audio content | |
| CN112735455B (en) | Sound information processing method and device | |
| CN113923523A (en) | Video pushing method, device, equipment and storage medium | |
| CN108307233B (en) | Audience statistical method, statistical system and intelligent audience terminal | |
| KR20060021544A (en) | Broadcasting preference research method using a face recognition of mobile communication terminal user | |
| TWI813153B (en) | Video processing method and associated system on chip | |
| CN113572901B (en) | Method for detecting video color bell playing effect in real time | |
| US20220215231A9 (en) | Audio correlation for viewership determination | |
| CN116610830A (en) | Image generation method, device, equipment and computer storage medium | |
| CN113314114A (en) | Voice recognition noise reduction method of intelligent water dispenser | |
| CN115209174A (en) | Audio processing method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20210924 |
|
| WW01 | Invention patent application withdrawn after publication |