CN115379270A - Video screen projection method and device, cloud device and storage medium - Google Patents

Video screen projection method and device, cloud device and storage medium Download PDF

Info

Publication number
CN115379270A
CN115379270A CN202210936368.3A CN202210936368A CN115379270A CN 115379270 A CN115379270 A CN 115379270A CN 202210936368 A CN202210936368 A CN 202210936368A CN 115379270 A CN115379270 A CN 115379270A
Authority
CN
China
Prior art keywords
video
webpage
video website
window
cloud
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210936368.3A
Other languages
Chinese (zh)
Other versions
CN115379270B (en
Inventor
王志军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Happycast Technology Co Ltd
Original Assignee
Shenzhen Happycast Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Happycast Technology Co Ltd filed Critical Shenzhen Happycast Technology Co Ltd
Priority to CN202210936368.3A priority Critical patent/CN115379270B/en
Publication of CN115379270A publication Critical patent/CN115379270A/en
Application granted granted Critical
Publication of CN115379270B publication Critical patent/CN115379270B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H04N21/26208Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43076Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/64Addressing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8166Monomedia components thereof involving executable data, e.g. software
    • H04N21/8173End-user applications, e.g. Web browser, game
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The application provides a video screen projection method, a video screen projection device, cloud equipment and a storage medium, wherein the video screen projection method comprises the following steps: responding to the triggering of a webpage casting control at the screen casting client side, and returning a video website input page to the screen casting client side; acquiring a video website submitted by a user through a video website input page, opening a webpage corresponding to the video website, and analyzing the webpage corresponding to the video website to obtain irrelevant content in the webpage corresponding to the video website; and shielding the irrelevant content, fusing the webpage after shielding the irrelevant content to the cloud desktop, and pushing the webpage to the display equipment. According to the embodiment of the application, refreshing screen projection of the video website can be achieved, and smoothness of display of important video content is guaranteed, so that the impression experience of a user is improved.

Description

Video screen projection method and device, cloud equipment and storage medium
Technical Field
The application relates to the technical field of screen projection in cloud conference application, in particular to a video screen projection method and device, cloud equipment and a storage medium.
Background
The cloud discussion group currently supports functions of file casting and screen casting, when a user needs to display a video published on a third-party website, a common method is to download the video, and cast the video in a local video mode, and under the condition that the copyright awareness is gradually strengthened, most of the videos are downloaded for payment, that is, the mode of downloading the videos as local videos and then casting the videos is not preferable. On the other hand, some irrelevant contents exist in the video on the third-party website inevitably, and the smoothness of displaying important contents in the video is influenced by projecting the original video, so that the user experience is poor.
Disclosure of Invention
In order to solve the problems, the application provides a video screen projection method, a video screen projection device, a cloud device and a storage medium, so that refreshing screen projection of a video website can be realized, smoothness of display of important video content is guaranteed, and accordingly the viewing experience of a user is improved.
In order to achieve the above object, a first aspect of the embodiments of the present application provides a video screen projection method, which is applied to a cloud device, and the method includes:
responding to the triggering of a webpage casting control at the screen casting client side, and returning a video website input page to the screen casting client side;
acquiring a video website submitted by a user through a video website input page, opening a webpage corresponding to the video website, and analyzing the webpage corresponding to the video website to obtain irrelevant content in the webpage corresponding to the video website;
and shielding the irrelevant content, fusing the webpage after shielding the irrelevant content to the cloud desktop, and pushing the webpage to the display equipment.
With reference to the first aspect, in a possible implementation manner, analyzing a web page to obtain irrelevant content in the web page includes:
analyzing the webpage to locate a plurality of windows in the webpage;
acquiring a contribution coefficient of each window in the plurality of windows to determining a video window to be displayed from the plurality of windows;
calculating to obtain a reference value corresponding to each window according to the contribution coefficient;
irrelevant content is determined from the plurality of windows according to the reference value.
With reference to the first aspect, in a possible implementation manner, the obtaining a contribution coefficient of each of multiple windows to determining a video window to be displayed from the multiple windows includes:
for each window, acquiring m image frames of each window, and randomly selecting a target image frame from the m image frames, wherein m is an integer greater than 2;
and calculating the area ratio of the target image frame to the picture of the webpage corresponding to the video website, and determining the area ratio as the contribution coefficient of each window.
With reference to the first aspect, in a possible implementation manner, the calculating a reference value corresponding to each window according to the contribution coefficient includes:
acquiring the similarity between the 1 st image frame and the rest (m-1) image frames in the m image frames to obtain (m-1) similarity;
obtaining a weight coefficient of each window according to the contribution coefficient;
and (m-1) calculating to obtain a reference value by using the similarity and the weight coefficient.
With reference to the first aspect, in one possible implementation manner, before returning the video website entry page to the screen-casting client, the method further includes:
judging whether the screen projection client is in a cloud conference group room or not;
if the screen projection client is in the cloud conference group room, generating a graphic verification code for identity verification and a unique identifier of the screen projection client;
and sending the unique identifier to a mobile phone number bound by the screen-casting client through a short message, and identifying the graphic verification code in the cloud space.
With reference to the first aspect, in one possible implementation manner, the video website entry page includes a video website entry field, a unique identifier entry field, and a plurality of graphical verification codes, and the method further includes:
acquiring an identification number to be verified submitted by a user through the unique identification input field and a graphic verification code to be verified selected from the plurality of graphic verification codes;
respectively verifying the identification number to be verified and the pattern verification code to be verified by adopting the unique identification and the pattern verification code to be verified;
and under the condition that the identification number to be verified and the graphic verification code to be verified pass verification, executing the operation of opening the webpage corresponding to the video website.
With reference to the first aspect, in one possible implementation, the method further includes:
determining a window with the minimum reference value in the plurality of windows as a video window to be displayed;
determining irrelevant content from a plurality of windows according to the reference value, comprising:
and determining the content displayed by the window with the reference value not being the minimum in the plurality of windows as the irrelevant content.
A second aspect of the embodiment of the present application provides a video screen projection device, which is applied to a cloud device, and includes an interaction unit and a processing unit;
the interactive unit is used for responding to the triggering of the webpage casting control at the screen casting client side and returning a video website input page to the screen casting client side;
the processing unit is used for acquiring a video website submitted by a user through a video website input page, opening a webpage corresponding to the video website, and analyzing the webpage corresponding to the video website to obtain irrelevant content in the webpage corresponding to the video website; and shielding the irrelevant content, fusing the webpage after shielding the irrelevant content to the cloud desktop, and pushing the webpage to the display equipment.
A third aspect of the embodiments of the present application provides a cloud device, where the cloud device includes an input device, an output device, and a processor, and is adapted to implement one or more instructions; and a memory storing one or more computer programs adapted to be loaded by the processor and to perform the steps of the method according to the first aspect.
A fourth aspect of embodiments of the present application provides a computer storage medium storing one or more instructions adapted to be loaded by a processor and execute the steps of the method according to the first aspect.
According to the method and the device, a user can submit a screen throwing request of a video website to a cloud device by triggering a webpage throwing control on a screen throwing client side, the cloud device responds to the triggering of the webpage throwing control and returns a video website input page to the screen throwing client side, the user inputs the video website needing to be thrown into the video website input page displayed by the screen throwing client side and then submits the video website needing to be thrown into the cloud device, the cloud device opens a webpage corresponding to the video website and analyzes the webpage corresponding to the video website to obtain irrelevant content in the webpage corresponding to the video website, the irrelevant content is shielded, the webpage shielded by the irrelevant content is fused to a cloud desktop and pushed to a display device, the display device only plays the video content in an important video window without playing the irrelevant content displayed by windows such as advertisements, the refreshing playing effect after the video website throwing is achieved, the smoothness of the video content in the important video window is guaranteed, and the user experience is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic diagram of an application environment provided in an embodiment of the present application;
fig. 2 is a schematic flowchart of a video screen projection method according to an embodiment of the present application;
fig. 3 is a schematic interface diagram of a screen projection client according to an embodiment of the present disclosure;
fig. 4 is a schematic diagram of a video website entry page provided in the embodiment of the present application;
fig. 5 is a schematic view of another video website entry page provided in the embodiment of the present application;
FIG. 6 is a diagram illustrating a plurality of windows in a web page according to an embodiment of the present disclosure;
fig. 7 is a schematic flowchart of another video screen projection method according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a video screen projection apparatus according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of a cloud device according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions of the present application better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "comprising" and "having," and any variations thereof, as appearing in the specification, claims and drawings of this application, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements but may alternatively include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. Furthermore, the terms "first," "second," and "third," etc. are used to distinguish between different objects and are not used to describe a particular order.
Referring to fig. 1, fig. 1 is a schematic view of an application environment provided in an embodiment of the present disclosure, as shown in fig. 1, the application environment includes a cloud device and a local device a, a local device B and a local device C, and the cloud device, the local device a, the local device B and the local device C may be connected through any one or more of a local area network, a metropolitan area network and a wide area network. The cloud application of screen projection can be installed on the cloud equipment, a cloud conference group can be established on the cloud equipment by the cloud application, screen projection clients are installed on the local equipment A, the local equipment B and the local equipment C, and a user can initiate the cloud conference group, invite participants, screen projection display and the like through the screen projection clients. The conference creator can initiate a cloud conference group creation request through a screen-casting client on the local device A, the cloud conference group is created under the condition that the cloud device receives the request, the conference creator automatically enters the cloud conference group, a room number or a link can be sent to conference participants through the local device A, and the conference participants join the cloud conference group through the screen-casting clients on the local devices (such as the local device B and the local device C). The user at any local equipment side can acquire the control authority of the conference desktop of the cloud conference through interaction with the cloud equipment, and the control process is displayed at the screen end, so that the user becomes a speaker of the current conference. The "control" may include not only operation control on a shared file in a cloud space, but also operation of the capability of implementing instant messaging between screens of the local device a, the local device B, and the local device C, where the instant messaging refers to operation of acquiring video information of one or more users associated with the cloud space in real time and playing the video information among the local device a, the local device B, and the local device C, for example, acquiring video information of a speaker and playing the video information among the local device a, the local device B, and the local device C. A user at any local equipment side can upload a shared file to the cloud equipment through the screen projection client side, and request the cloud equipment to project a screen, a webpage and the like. The cloud device may push a shared file uploaded by a user, a screen or a webpage to be shared to a conference desktop (or become a cloud desktop) for sharing, and optionally, the cloud device may store the shared file uploaded by the user in a cloud space, where the cloud space refers to a resource space (software and hardware resources) configured for processing and storing data (control plane data and data plane data) of a cloud conference by the cloud device, and is used for bearing various shared files uploaded by the user, and the shared files include diagrams/texts, audio/videos, screen images, files, and the like. For example, the local device a, the local device B, and the local device C may be large-screen devices (screen projection devices in a conference room), or may be terminal devices of a user, such as: personal user equipment such as mobile phones and computers.
Referring to fig. 2, fig. 2 is a schematic flow chart of a video screen projection method according to an embodiment of the present application, where the method may be implemented based on the application environment shown in fig. 1, and may be specifically applied to a cloud device, as shown in fig. 2, including steps 201 to 203:
201: and responding to the trigger of a webpage casting control at the screen casting client side, and returning a video website input page to the screen casting client side.
In the embodiment of the application, as shown in fig. 3, the screen-casting client provides functions of casting a file, casting a screen, and casting a web page, the conference creator can trigger the web-casting control on the screen-casting client, the cloud device can create a cloud conference group in response to the triggering, and generate a room number, a screen-casting code or a link of the cloud conference group, and other conference participants can enter the cloud conference group through the room number, the screen-casting code or the link shared by the conference creator. After the cloud conference group is successfully created, as shown in fig. 4, the cloud device returns a video website entry page to the screen projection client, and the screen projection client receives and displays the video website entry page, where the video website entry page at least includes a video website entry field. Optionally, the webpage casting control may also be triggered by other conference participants (non-conference creators) entering the cloud conference group through a screen casting client on their local devices, for example, after the other conference participants accept the invitation of the conference creators to enter the cloud conference group, the screen casting client may be operated to enter the functional interface shown in fig. 3, and then the webpage casting control is clicked to initiate a request for casting a video webpage to the cloud device, and the cloud device returns a video website entry page shown in fig. 4 in response to the request.
202: and acquiring a video website submitted by a user through a video website input page, opening a webpage corresponding to the video website, and analyzing the webpage corresponding to the video website to obtain irrelevant content in the webpage corresponding to the video website.
In this application embodiment, before returning the video website to the screen projection client and entering the page, the cloud device can also judge whether the screen projection client is in the cloud conference group room, for example: inquiring whether the user at the screen projection client side of the house owner of the cloud conference group is still in the cloud conference group or not through a popup window, wherein the house owner of the cloud conference group can be a conference creator or other conference participants after the conference creator hands over the house owner. The cloud device generates a graphical verification code for identity verification and a unique identifier of the screen-casting client under the condition that the screen-casting client initiating the webpage casting is determined to be in the cloud conference group room. For example: 10 graphic verification codes are stored in the cloud space, 1 graphic verification code is randomly selected from 10 graphic verification codes each time authentication is needed, the graphic verification code is identified as a graphic verification code a for authenticating the screen projection client, and the graphic verification code is pushed to display equipment for displaying. The unique identification of the screen-casting client can be obtained by performing hash calculation on the ID of a user logged in by the screen-casting client, and after the unique identification is generated, the cloud equipment can store the unique identification in a cloud space and send the unique identification to a mobile phone number bound by the screen-casting client.
For example, in the case of generating the unique identifier and the graphical verification code of the screen projection client, as shown in fig. 5, the video website entry page returned by the cloud device may include the unique identifier entry field and the plurality of graphical verification codes in addition to the video website entry field, and prompt the user to select one of the plurality of graphical verification codes which is the same as the graphical verification code displayed on the display device. The plurality of graphical verification codes can be 4 randomly selected by the cloud device from the stored 10 graphical verification codes, and the graphical verification codes comprise graphical verification codes a identified by the cloud device.
The method further comprises the following steps:
acquiring an identification number to be verified submitted by a user through the unique identification input field and a graphic verification code to be verified selected from the plurality of graphic verification codes;
respectively verifying the identification number to be verified and the pattern verification code to be verified by adopting the unique identification and the pattern verification code to be verified;
and under the condition that the identification number to be verified and the graphic verification code to be verified pass verification, executing the operation of opening the webpage corresponding to the video website.
It should be understood that the identification number to be verified, which is input by the user in the unique identification input field shown in fig. 5, is the selected pattern, which is the graphic verification code to be verified. The cloud device judges whether the identification number to be verified is matched with the unique identification, judges whether the graphic verification code to be verified is a graphic verification code a, and determines that malicious attack does not exist in the input of the screen projection client if the graphic verification code a to be verified is verified, namely the video website is trustable. In the embodiment, the identity of the screen projection client is verified based on the pre-generated unique identifier and the graphical verification code so as to determine whether the video website input by the user has malicious attack, and the method is favorable for preventing illegal users who are not in the cloud conference group room from providing illegal websites for the cloud server.
Illustratively, analyzing the web page to obtain irrelevant content in the web page includes:
analyzing the webpage to locate a plurality of windows in the webpage;
acquiring a contribution coefficient of each window in the multiple windows to the determination of a video window to be displayed from the multiple windows;
calculating to obtain a reference value corresponding to each window according to the contribution coefficient;
irrelevant content is determined from the plurality of windows based on the reference value.
Specifically, as shown in fig. 6, the cloud device may analyze, by using a machine learning model, a picture presented by a webpage corresponding to the video website to locate a plurality of windows in the webpage, such as: the plurality of windows may include a video window to be presented, a recommended video window for a video website, an advertising window, a video category ranking window (e.g., movies, television shows, educational), etc. For each positioned window, m image frames of the window are obtained within a certain time, then a target image frame is randomly selected from the m image frames, the area ratio of the target image frame to the image of the webpage corresponding to the video website is calculated, and the area ratio is determined as the contribution coefficient c of each window to the determination of the video window to be displayed from the plurality of windows. Such as: in fig. 6, the ratio of the area of the video window to be displayed to the area of the whole web page is used as the contribution coefficient of the video window to be displayed, and since the video window to be displayed in the web page is usually the window with the largest area, the contribution coefficient is usually the largest, that is, the contribution degree of the window to the determination of the content to be displayed at the front end is the highest. Wherein m is an integer greater than 2. For each window, calculating the similarity d between the 1 st image frame and the rest (m-1) image frames in the m image frames to obtain (m-1) similarities, and simultaneously mapping the contribution coefficient of each window to the weight coefficient thereof by adopting a preset formula:
Figure BDA0003780386610000081
α=α 21
α 21
wherein, theta i Weight coefficient representing the ith window, c i Representing the contribution factor of the ith window, alpha representing the formula parameter, alpha 1 ∈[0,1],α 2 ∈[0,1]And e represents a natural constant. Because the video in the video window to be displayed is played all the time, the (m-1) similarity d of the m image frames shows a decreasing trend, even lower and lower, and the video or advertisement of other windows usually plays circularly or presents a static picture within a certain time, and the (m-1) similarity d is obviously different from the video window to be displayed in the change amplitude, therefore, a decreasing function theta is adopted i Will contribute coefficient c i Mapped to corresponding weight coefficients. That is to say that the weight factor of the video window to be presented is minimal. The similarity d of (m-1) of the ith window is summed to obtain
Figure BDA0003780386610000082
Wherein d is j And expressing the jth similarity in the (m-1) similarities, and calculating the reference value of the ith window by adopting the following formula:
f i =∑ 1≤j≤m-1,1≤i≤n θ i d j
wherein f is i A reference value of an ith window is indicated, and n indicates the number of a plurality of windows. Because the (m-1) similarity d of the video window to be displayed is in a decreasing trend, the sum of the similarity d is
Figure BDA0003780386610000083
The minimum weight coefficient is multiplied by the minimum sum of the similarity, so that the difference of reference values between the video window to be displayed and other video windows is more obvious, the window with the minimum reference value can be visually seen as the video window to be displayed, and the contents displayed by other windows with the reference values which are not the minimum can be determined as irrelevant contents.
203: and shielding the irrelevant content, fusing the webpage after shielding the irrelevant content to the cloud desktop, and pushing the webpage to the display equipment.
In the embodiment of the application, after determining the window corresponding to the irrelevant content, the cloud device shields the window corresponding to the irrelevant content in the webpage to shield the irrelevant content, for example: the windows corresponding to the irrelevant content are shielded in the Uniform Resource Locator (URL) of the web page. The cloud device fuses the webpage with the irrelevant content shielded off to the cloud desktop, and pushes the webpage to the display device so as to play the video in the video window to be displayed on the display device, and therefore refreshing playing of screen projection of the video screen is achieved. Such as: the display device may be a large screen device of a conference room.
It can be seen that, in the embodiment of the application, a user can submit a screen casting request of a video website to a cloud device by triggering a screen casting page control at a screen casting client side, the cloud device responds to the triggering of the screen casting page control and returns a video website input page to the screen casting client side, the user inputs the video website to be cast into the video website input page displayed by the screen casting client side and then submits the video website to the cloud device, the cloud device opens a webpage corresponding to the video website and analyzes the webpage corresponding to the video website to obtain irrelevant content in the webpage corresponding to the video website, the irrelevant content is shielded, the webpage after the irrelevant content is shielded is fused to a cloud desktop and pushed to a display device, the display device only plays the video content in an important video window without playing the irrelevant content displayed by windows such as advertisements, the refreshing playing effect after the video website casting is achieved, the smoothness of the video content displayed in the important video window is favorably guaranteed, and the user experience is improved.
Referring to fig. 7, fig. 7 is a schematic flowchart of another video screen projection method according to an embodiment of the present application, where the method is applied to a cloud device, as shown in fig. 7, and includes steps 701 to 706:
701: responding to the triggering of a webpage casting control at the screen casting client side, and returning a video website input page to the screen casting client side;
702: acquiring a video website submitted by a user through a video website input page, and opening a webpage corresponding to the video website;
703: analyzing the webpage to locate a plurality of windows in the webpage, and acquiring the contribution coefficient of each window in the plurality of windows to the determination of the window of the video to be displayed from the plurality of windows;
illustratively, obtaining a contribution coefficient of each of the multiple windows to determining a video window to be displayed from the multiple windows includes:
for each window, acquiring m image frames of each window, and randomly selecting a target image frame from the m image frames, wherein m is an integer greater than 2;
and calculating the area ratio of the target image frame to the image of the webpage corresponding to the video website, and determining the area ratio as the contribution coefficient of each window.
704: calculating to obtain a reference value corresponding to each window according to the contribution coefficient;
illustratively, the calculating the reference value corresponding to each window according to the contribution coefficient includes:
acquiring the similarity between the 1 st image frame and the rest (m-1) image frames in the m image frames to obtain (m-1) similarity;
obtaining a weight coefficient of each window according to the contribution coefficient;
and (m-1) similarity and weight coefficients are adopted to calculate to obtain a reference value.
705: determining irrelevant content from the plurality of windows according to the reference value;
706: and shielding the irrelevant content, fusing the webpage after shielding the irrelevant content to the cloud desktop, and pushing the webpage to the display equipment.
The specific implementation of steps 701-706 can refer to the related description in the embodiment shown in fig. 2, and can achieve the same or similar beneficial effects, which are not described herein again.
Based on the description of the above video screen projection method embodiment, please refer to fig. 8, fig. 8 is a schematic structural diagram of a video screen projection apparatus provided in the embodiment of the present application, and as shown in fig. 8, the apparatus includes an interaction unit 801 and a processing unit 802; wherein:
the interaction unit 801 is used for responding to triggering of a webpage casting control at a screen casting client side and returning a video website input page to the screen casting client side;
the processing unit 802 is configured to acquire a video website submitted by a user through a video website input page, open a webpage corresponding to the video website, and analyze the webpage corresponding to the video website to obtain irrelevant content in the webpage corresponding to the video website; and shielding the irrelevant content, fusing the webpage after shielding the irrelevant content to the cloud desktop, and pushing the webpage to the display equipment.
It can be seen that, in the video screen projection device shown in fig. 8, a user can submit a screen projection request of a video website to a cloud device by triggering a screen projection page control at a screen projection client side, the cloud device returns a video website entry page to the screen projection client in response to the triggering of the screen projection page control, the user enters the video website to be projected into the video website entry page displayed at the screen projection client, and then submits the video website to the cloud device, the cloud device opens a webpage corresponding to the video website and analyzes the webpage corresponding to the video website to obtain irrelevant content in the webpage corresponding to the video website, the irrelevant content is shielded, the webpage shielded by the irrelevant content is fused to a cloud desktop and pushed to a display device, the display device only plays the video content in an important video window without playing the irrelevant content displayed by windows such as advertisements, the playing effect after the video screen projection is realized, the smoothness of the video content displayed in the important video window is favorably ensured, and the user experience is improved.
In a possible implementation manner, in analyzing the web page to obtain the irrelevant content in the web page, the processing unit 802 is specifically configured to:
analyzing the webpage to locate a plurality of windows in the webpage;
acquiring a contribution coefficient of each window in the plurality of windows to determining a video window to be displayed from the plurality of windows;
calculating to obtain a reference value corresponding to each window according to the contribution coefficient;
irrelevant content is determined from the plurality of windows based on the reference value.
In a possible implementation manner, in obtaining a contribution coefficient of each of the multiple windows to determining a video window to be displayed from the multiple windows, the processing unit 802 is specifically configured to:
for each window, acquiring m image frames of each window, and randomly selecting a target image frame from the m image frames, wherein m is an integer greater than 2;
and calculating the area ratio of the target image frame to the image of the webpage corresponding to the video website, and determining the area ratio as the contribution coefficient of each window.
In a possible implementation manner, in terms of calculating the reference value corresponding to each window according to the contribution coefficient, the processing unit 802 is specifically configured to:
acquiring the similarity between the 1 st image frame and the rest (m-1) image frames in the m image frames to obtain (m-1) similarity;
obtaining a weight coefficient of each window according to the contribution coefficient;
and (m-1) calculating to obtain a reference value by using the similarity and the weight coefficient.
In a possible implementation, the interaction unit 801 is further configured to:
judging whether the screen projection client is in a cloud conference group room or not;
if the screen projection client is in the cloud conference group room, generating a graphic verification code for identity verification and a unique identifier of the screen projection client;
and sending the unique identifier to a mobile phone number bound by the screen projection client through a short message, and identifying the graphic verification code in the cloud space.
In a possible implementation manner, the video website input page includes a video website input field, a unique identifier input field and a plurality of graphic verification codes, and the interaction unit 801 is further configured to:
acquiring an identification number to be verified submitted by a user through the unique identification input field and a graphic verification code to be verified selected from the plurality of graphic verification codes;
respectively verifying the identification number to be verified and the pattern verification code to be verified by adopting the unique identification and the pattern verification code to be verified;
and under the condition that the identification number to be verified and the graphic verification code to be verified pass verification, executing the operation of opening the webpage corresponding to the video website.
In one possible implementation, the processing unit 802 is further configured to:
determining a window with the minimum reference value in the plurality of windows as a video window to be displayed;
in terms of determining irrelevant content from multiple windows according to the reference value, the processing unit 802 is specifically configured to:
and determining the content displayed by the window with the reference value not being the minimum in the plurality of windows as the irrelevant content.
Based on the description of the method embodiment and the device embodiment, the embodiment of the application further provides the cloud device. Referring to fig. 9, the cloud device at least includes a processor 901, an input device 902, an output device 903, and a memory 904. The processor 901, the input device 902, the output device 903, and the memory 904 in the cloud device may be connected by a bus or other means.
The memory 904 is used for storing a computer program comprising program instructions, and the processor 901 is used for executing the program instructions stored by the memory 904. The processor 901 (or Central Processing Unit, CPU) is a computing core and a control core of the cloud device, and is adapted to implement one or more instructions, and in particular, adapted to load and execute the one or more instructions so as to implement a corresponding method flow or a corresponding function.
In an embodiment, the processor 901 of the cloud device provided in the embodiment of the present application may be configured to perform a series of processing of a video screen projection method:
responding to the triggering of a webpage casting control at the screen casting client side, and returning a video website input page to the screen casting client side;
acquiring a video website submitted by a user through a video website input page, opening a webpage corresponding to the video website, and analyzing the webpage corresponding to the video website to obtain irrelevant content in the webpage corresponding to the video website;
and shielding the irrelevant content, fusing the webpage after shielding the irrelevant content to the cloud desktop, and pushing the webpage to the display equipment.
In another embodiment, the processor 901 performs analysis on the web page to obtain irrelevant content in the web page, including:
analyzing the webpage to locate a plurality of windows in the webpage;
acquiring a contribution coefficient of each window in the plurality of windows to determining a video window to be displayed from the plurality of windows;
calculating to obtain a reference value corresponding to each window according to the contribution coefficient;
irrelevant content is determined from the plurality of windows according to the reference value.
In another embodiment, the processor 901 performs the step of obtaining a contribution coefficient of each of the plurality of windows to determining the video window to be displayed from the plurality of windows, including:
for each window, acquiring m image frames of each window, and randomly selecting a target image frame from the m image frames, wherein m is an integer greater than 2;
and calculating the area ratio of the target image frame to the image of the webpage corresponding to the video website, and determining the area ratio as the contribution coefficient of each window.
In another embodiment, the processor 901 performs calculation to obtain the reference value corresponding to each window according to the contribution coefficient, including:
acquiring the similarity between the 1 st image frame and the rest (m-1) image frames in the m image frames to obtain (m-1) similarity;
obtaining a weight coefficient of each window according to the contribution coefficient;
and (m-1) calculating to obtain a reference value by using the similarity and the weight coefficient.
In yet another embodiment, before returning the video website entry page to the screen-casting client, the processor 901 is further configured to perform:
judging whether the screen projection client is in a cloud conference group room or not;
if the screen projection client is in the cloud conference group room, generating a graphic verification code for identity verification and a unique identifier of the screen projection client;
and sending the unique identifier to a mobile phone number bound by the screen projection client through a short message, and identifying the graphic verification code in the cloud space.
In another embodiment, the video website input page includes a video website input field, a unique identifier input field and a plurality of graphic verification codes, and the processor 901 is further configured to:
acquiring an identification number to be verified submitted by a user through the unique identification input field and a graphic verification code to be verified selected from the plurality of graphic verification codes;
respectively verifying the identification number to be verified and the pattern verification code to be verified by adopting the unique identification and the pattern verification code to be verified;
and under the condition that the identification number to be verified and the graphic verification code to be verified pass verification, executing the operation of opening the webpage corresponding to the video website.
In yet another embodiment, the processor 901 is further configured to perform:
and determining the window with the minimum reference value in the plurality of windows as the video window to be displayed.
Processor 901 performs the determination of irrelevant content from multiple windows based on reference values, including:
and determining the content displayed by the window with the reference value not being the minimum in the plurality of windows as the irrelevant content.
Exemplary cloud devices include, but are not limited to, a processor 901, an input device 902, an output device 903, and a memory 904. And may also include memory, power supplies, etc. It will be appreciated by those skilled in the art that the schematic diagram is merely an example of a cloud device, and is not intended to be limiting, and may include more or fewer components than those shown, or some components may be combined, or different components may be included.
It should be noted that, since the steps in the video screen projection method are implemented when the processor 901 of the cloud device executes the computer program, the embodiments of the video screen projection method are all applicable to the cloud device, and all can achieve the same or similar beneficial effects.
The embodiment of the application also provides a computer storage medium (Memory), which is a Memory device in the cloud device and is used for storing programs and data. It is understood that the computer storage medium herein may include a built-in storage medium in the terminal, and may also include an extended storage medium supported by the terminal. The computer storage medium provides a storage space that stores an operating system of the terminal. Also stored in this memory space are one or more instructions, which may be one or more computer programs (including program code), suitable for loading and execution by processor 901. The computer storage medium may be a high-speed RAM memory, or may be a non-volatile memory (non-volatile memory), such as at least one disk memory; in the alternative, the computer storage media may be at least one computer storage medium located remotely from the processor 901. In one embodiment, one or more instructions stored in a computer storage medium may be loaded and executed by processor 901 to perform the corresponding steps described above with respect to the video projection method.
Illustratively, the computer program of the computer storage medium includes computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, or the like. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, read-Only Memory (ROM), random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like.
It should be noted that, since the computer program of the computer storage medium is executed by the processor to implement the steps in the video screen projection method, all the embodiments of the video screen projection method are applicable to the computer storage medium, and can achieve the same or similar beneficial effects.
The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, the specific implementation manner and the application scope may be changed, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (10)

1. A video screen projection method is applied to a cloud device, and comprises the following steps:
responding to the triggering of a webpage casting control at a screen casting client side, and returning a video website input page to the screen casting client side;
acquiring a video website submitted by a user through the video website input page, opening a webpage corresponding to the video website, and analyzing the webpage corresponding to the video website to obtain irrelevant content in the webpage corresponding to the video website;
and shielding the irrelevant content, fusing the webpage after shielding the irrelevant content to a cloud desktop, and pushing the webpage to display equipment.
2. The method of claim 1, wherein analyzing the web page to obtain irrelevant content in the web page comprises:
analyzing the webpage to locate a plurality of windows in the webpage;
acquiring a contribution coefficient of each window in the plurality of windows to determining a video window to be displayed from the plurality of windows;
calculating a reference value corresponding to each window according to the contribution coefficient;
and determining the irrelevant content from the plurality of windows according to the reference value.
3. The method according to claim 2, wherein said obtaining a contribution coefficient of each of the plurality of windows to determining a video window to be displayed from the plurality of windows comprises:
for each window, acquiring m image frames of each window, and randomly selecting a target image frame from the m image frames, wherein m is an integer greater than 2;
and calculating the area ratio of the target image frame to the image of the webpage corresponding to the video website, and determining the area ratio as the contribution coefficient of each window.
4. The method according to claim 3, wherein said calculating the reference value corresponding to each window according to the contribution coefficient comprises:
acquiring the similarity between the 1 st image frame and the rest (m-1) image frames in the m image frames to obtain (m-1) similarity;
obtaining a weight coefficient of each window according to the contribution coefficient;
and calculating the reference value by adopting the (m-1) similarity and the weight coefficient.
5. The method of any of claims 1-4, wherein prior to returning a video website entry page to the screen-casting client, the method further comprises:
judging whether the screen projection client is in a cloud conference group room or not;
if the screen projection client is in the cloud conference group room, generating a graphic verification code for identity verification and a unique identifier of the screen projection client;
and sending the unique identifier to a mobile phone number bound by the screen projection client through a short message, and identifying the graphic verification code in a cloud space.
6. The method of claim 5, wherein the video website entry page includes a video website input field, a unique identification input field, and a plurality of graphical validation codes, the method further comprising:
acquiring an identification number to be verified submitted by a user through the unique identification input field and a graphic verification code to be verified selected from the plurality of graphic verification codes;
verifying the identification number to be verified and the pattern verification code to be verified respectively by adopting the unique identification and the pattern verification code to be verified;
and under the condition that the identification number to be verified and the graphic verification code to be verified pass verification, executing the operation of opening the webpage corresponding to the video website.
7. The method of claim 2, further comprising:
determining the window with the minimum reference value in the plurality of windows as the video window to be displayed;
the determining the irrelevant content from the plurality of windows according to the reference value comprises:
determining content shown in a window of the plurality of windows in which the reference value is not the smallest as the irrelevant content.
8. The video screen projection device is applied to cloud equipment and comprises an interaction unit and a processing unit;
the interaction unit is used for responding to the triggering of a webpage casting control at the screen casting client side and returning a video website input page to the screen casting client side;
the processing unit is used for acquiring a video website submitted by a user through the video website input page, opening a webpage corresponding to the video website, and analyzing the webpage corresponding to the video website to obtain irrelevant content in the webpage corresponding to the video website; and shielding the irrelevant content, fusing the webpage after shielding the irrelevant content to a cloud desktop, and pushing the webpage to display equipment.
9. The utility model provides a high in the clouds equipment, includes input device and output device, its characterized in that still includes:
a processor adapted to implement one or more computer programs; and (c) a second step of,
memory storing one or more computer programs adapted to be loaded by the processor and to perform the method according to any of claims 1-7.
10. A computer storage medium having stored thereon one or more instructions adapted to be loaded by a processor and to perform the method of any of claims 1-7.
CN202210936368.3A 2022-08-03 2022-08-03 Video screen projection method and device, cloud device and storage medium Active CN115379270B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210936368.3A CN115379270B (en) 2022-08-03 2022-08-03 Video screen projection method and device, cloud device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210936368.3A CN115379270B (en) 2022-08-03 2022-08-03 Video screen projection method and device, cloud device and storage medium

Publications (2)

Publication Number Publication Date
CN115379270A true CN115379270A (en) 2022-11-22
CN115379270B CN115379270B (en) 2023-07-14

Family

ID=84064205

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210936368.3A Active CN115379270B (en) 2022-08-03 2022-08-03 Video screen projection method and device, cloud device and storage medium

Country Status (1)

Country Link
CN (1) CN115379270B (en)

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050102177A1 (en) * 2002-09-02 2005-05-12 Hiromitsu Takayama Advertisement delivery method and system
CN102291425A (en) * 2010-06-18 2011-12-21 国际商业机器公司 Intelligent filtering method and system for render status determination in a screen sharing system
CN103024608A (en) * 2012-11-19 2013-04-03 Tcl集团股份有限公司 Network media playing method and device
CN103886088A (en) * 2014-03-28 2014-06-25 北京金山网络科技有限公司 Method and device for intercepting advertisements in webpage
CN103957608A (en) * 2014-05-12 2014-07-30 罗建平 Multi-screen interactive device matching and connecting method
CN104090914A (en) * 2014-06-10 2014-10-08 广东九联科技股份有限公司 Wireless router capable of automatically shielding advertising information and shielding method thereof
CN107895436A (en) * 2017-11-08 2018-04-10 东莞市康茂电子有限公司 One kind is shared with screen device management system and its control method
US20200126564A1 (en) * 2018-10-18 2020-04-23 Bellface Inc. Review system for online communication, method, and computer program
CN112073758A (en) * 2020-11-11 2020-12-11 深圳乐播科技有限公司 Cloud desktop screen projection method and device, computer equipment, computer readable storage medium and cloud desktop screen projection interaction system
CN112764853A (en) * 2021-01-19 2021-05-07 深圳乐播科技有限公司 Screen projection method, equipment and system
CN114780054A (en) * 2022-06-20 2022-07-22 深圳乐播科技有限公司 Split screen display method and related device
CN114827094A (en) * 2022-06-30 2022-07-29 深圳乐播科技有限公司 Cloud desktop-based authority control method and device, computer equipment and medium

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050102177A1 (en) * 2002-09-02 2005-05-12 Hiromitsu Takayama Advertisement delivery method and system
CN102291425A (en) * 2010-06-18 2011-12-21 国际商业机器公司 Intelligent filtering method and system for render status determination in a screen sharing system
CN103024608A (en) * 2012-11-19 2013-04-03 Tcl集团股份有限公司 Network media playing method and device
CN103886088A (en) * 2014-03-28 2014-06-25 北京金山网络科技有限公司 Method and device for intercepting advertisements in webpage
CN103957608A (en) * 2014-05-12 2014-07-30 罗建平 Multi-screen interactive device matching and connecting method
CN104090914A (en) * 2014-06-10 2014-10-08 广东九联科技股份有限公司 Wireless router capable of automatically shielding advertising information and shielding method thereof
CN107895436A (en) * 2017-11-08 2018-04-10 东莞市康茂电子有限公司 One kind is shared with screen device management system and its control method
US20200126564A1 (en) * 2018-10-18 2020-04-23 Bellface Inc. Review system for online communication, method, and computer program
CN112073758A (en) * 2020-11-11 2020-12-11 深圳乐播科技有限公司 Cloud desktop screen projection method and device, computer equipment, computer readable storage medium and cloud desktop screen projection interaction system
CN112764853A (en) * 2021-01-19 2021-05-07 深圳乐播科技有限公司 Screen projection method, equipment and system
CN114780054A (en) * 2022-06-20 2022-07-22 深圳乐播科技有限公司 Split screen display method and related device
CN114827094A (en) * 2022-06-30 2022-07-29 深圳乐播科技有限公司 Cloud desktop-based authority control method and device, computer equipment and medium

Also Published As

Publication number Publication date
CN115379270B (en) 2023-07-14

Similar Documents

Publication Publication Date Title
CN110365996B (en) Live broadcast management method, live broadcast management platform, electronic device and storage medium
US10313726B2 (en) Distributing media content via media channels based on associated content being provided over other media channels
JP6293269B2 (en) Content viewing confirmation apparatus and method
CN110134880B (en) Comment data providing method, comment data displaying method, comment data providing device, comment data displaying device, electronic equipment and storage medium
CN111836112B (en) Multimedia file output method, device, medium and electronic equipment
US20090204819A1 (en) Advertisement-based human interactive proof
US10127373B1 (en) Systems and methods for distinguishing among human users and software robots
CN113157157B (en) Live broadcast-based interactive image management method, device, equipment and storage medium
US11172258B1 (en) Protecting against an impersonation scam in a live video stream
US9990487B1 (en) Systems and methods for distinguishing among human users and software robots
CN112153582B (en) Verification code short message display method and device
US10812948B2 (en) Providing a summary of media content to a communication device
CN113573090A (en) Content display method, device and system in game live broadcast and storage medium
CN113014934A (en) Product display method, product display device, computer equipment and storage medium
CN112073740A (en) Information display method, device, server and storage medium
CN115190366A (en) Information display method and device, electronic equipment and computer readable medium
US20170171628A1 (en) Method and electronic device for quickly playing video
CN115379270A (en) Video screen projection method and device, cloud device and storage medium
US20140149192A1 (en) Verification of online advertisement security
CN115037905A (en) Screen recording file processing method, electronic equipment and related products
CN115357800A (en) Resource association method, device, electronic equipment, storage medium and program product
CN115278352A (en) Video playing method, device, equipment and storage medium
CN117354548A (en) Comment display method and device, electronic equipment and computer readable medium
AU2017412612B2 (en) Systems and methods for distinguishing among human users and software robots
CN111885139A (en) Content sharing method, device and system, mobile terminal and server

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant