CN115379270B - Video screen projection method and device, cloud device and storage medium - Google Patents

Video screen projection method and device, cloud device and storage medium Download PDF

Info

Publication number
CN115379270B
CN115379270B CN202210936368.3A CN202210936368A CN115379270B CN 115379270 B CN115379270 B CN 115379270B CN 202210936368 A CN202210936368 A CN 202210936368A CN 115379270 B CN115379270 B CN 115379270B
Authority
CN
China
Prior art keywords
window
video
video website
screen
windows
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210936368.3A
Other languages
Chinese (zh)
Other versions
CN115379270A (en
Inventor
王志军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Happycast Technology Co Ltd
Original Assignee
Shenzhen Happycast Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Happycast Technology Co Ltd filed Critical Shenzhen Happycast Technology Co Ltd
Priority to CN202210936368.3A priority Critical patent/CN115379270B/en
Publication of CN115379270A publication Critical patent/CN115379270A/en
Application granted granted Critical
Publication of CN115379270B publication Critical patent/CN115379270B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H04N21/26208Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43076Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/64Addressing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8166Monomedia components thereof involving executable data, e.g. software
    • H04N21/8173End-user applications, e.g. Web browser, game
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The application provides a video screen projection method, a device, cloud equipment and a storage medium, wherein the video screen projection method comprises the following steps: responding to the triggering of a webpage throwing control at the side of the screen throwing client, and returning a video website inputting page to the screen throwing client; acquiring a video website submitted by a user through a video website entry page, opening a webpage corresponding to the video website, and analyzing the webpage corresponding to the video website to obtain irrelevant contents in the webpage corresponding to the video website; and shielding the irrelevant content, fusing the web pages subjected to the irrelevant content shielding to a cloud desktop, and pushing the web pages to the display equipment. According to the embodiment of the application, refreshing screen projection of the video website can be realized, and smoothness of displaying important video content is guaranteed, so that the user's impression experience is improved.

Description

Video screen projection method and device, cloud device and storage medium
Technical Field
The application relates to the technical field of screen projection in cloud conference application, in particular to a video screen projection method, a device, cloud equipment and a storage medium.
Background
The cloud discussion group currently supports the functions of file projection and screen projection, when a user needs to display videos published on a third-party website, the common practice is to download the videos and then project the videos in a local video mode, and under the condition that copyright awareness is gradually strengthened, most of the downloading of the videos is paid, that is, the downloading of the videos is not advisable in a mode of projecting the videos for the local videos. On the other hand, the video on the third-party website inevitably contains some irrelevant contents, and the original video is projected to the screen, so that the fluency of displaying important contents in the video can be influenced, and the user experience is poor.
Disclosure of Invention
Aiming at the problems, the application provides a video screen projection method, a video screen projection device, cloud equipment and a storage medium, which can realize refreshing screen projection of video websites and ensure fluency of displaying important video contents, thereby improving the viewing experience of users.
In order to achieve the above objective, a first aspect of an embodiment of the present application provides a video screen projection method, which is applied to a cloud device, and the method includes:
responding to the triggering of a webpage throwing control at the side of the screen throwing client, and returning a video website inputting page to the screen throwing client;
acquiring a video website submitted by a user through a video website entry page, opening a webpage corresponding to the video website, and analyzing the webpage corresponding to the video website to obtain irrelevant contents in the webpage corresponding to the video website;
and shielding the irrelevant content, fusing the web pages subjected to the irrelevant content shielding to a cloud desktop, and pushing the web pages to the display equipment.
With reference to the first aspect, in one possible implementation manner, analyzing the web page to obtain irrelevant content in the web page includes:
analyzing the web page to locate a plurality of windows in the web page;
acquiring contribution coefficients of each window in the plurality of windows to a video window to be displayed from the plurality of windows;
calculating a reference value corresponding to each window according to the contribution coefficient;
and determining irrelevant contents from a plurality of windows according to the reference value.
With reference to the first aspect, in one possible implementation manner, obtaining a contribution coefficient of each window in the plurality of windows to determine a video window to be displayed from the plurality of windows includes:
for each window, acquiring m image frames of each window, randomly selecting a target image frame from the m image frames, wherein m is an integer greater than 2;
and calculating the area ratio of the target image frame to the picture of the webpage corresponding to the video website, and determining the area ratio as the contribution coefficient of each window.
With reference to the first aspect, in one possible implementation manner, the calculating, according to the contribution coefficient, a reference value corresponding to each window includes:
obtaining the similarity between the 1 st image frame and the rest (m-1) image frames in the m image frames to obtain (m-1) similarity;
obtaining a weight coefficient of each window according to the contribution coefficient;
and calculating to obtain a reference value by adopting (m-1) similarity and weight coefficients.
With reference to the first aspect, in one possible implementation manner, before returning the video website entry page to the screen-casting client, the method further includes:
judging whether the screen-throwing client is in a cloud conference group room or not;
if the screen-throwing client is in the cloud conference group room, generating a graphical verification code for identity verification and a unique identifier of the screen-throwing client;
and sending the unique identification to the mobile phone number bound by the screen-throwing client through the short message, and identifying the graphic verification code in the cloud space.
With reference to the first aspect, in one possible implementation manner, the video website entry page includes a video website entry field, a unique identification entry field, and a plurality of graphic verification codes, and the method further includes:
acquiring an identification number to be verified submitted by a user through a unique identification input field and a graphic verification code to be verified selected from a plurality of graphic verification codes;
respectively verifying the identification number to be verified and the graphic verification code to be verified by adopting the unique identification and the graphic verification code to be verified;
and executing the operation of opening the webpage corresponding to the video website under the condition that the identification number to be verified and the graphic verification code to be verified pass verification.
With reference to the first aspect, in a possible implementation manner, the method further includes:
determining a window with the minimum reference value in the windows as a video window to be displayed;
determining irrelevant content from a plurality of windows according to the reference value, including:
and determining the content displayed by the window with the reference value which is not the smallest in the windows as irrelevant content.
The second aspect of the embodiment of the application provides a video screen projection device, which is applied to cloud equipment and comprises an interaction unit and a processing unit;
the interaction unit is used for responding to the triggering of the webpage throwing control at the side of the screen throwing client and returning a video website inputting page to the screen throwing client;
the processing unit is used for acquiring a video website submitted by a user through the video website entry page, opening a webpage corresponding to the video website, and analyzing the webpage corresponding to the video website to obtain irrelevant contents in the webpage corresponding to the video website; and shielding the irrelevant content, fusing the web pages subjected to the irrelevant content shielding to a cloud desktop, and pushing the web pages to the display equipment.
A third aspect of the embodiments of the present application provides a cloud device, where the cloud device includes an input device and an output device, and further includes a processor, adapted to implement one or more instructions; and a memory storing one or more computer programs adapted to be loaded by the processor and to perform the steps of the method according to the first aspect.
A fourth aspect of the embodiments provides a computer storage medium storing one or more instructions adapted to be loaded by a processor and to perform the steps of the method according to the first aspect.
It can be seen that, in the embodiment of the application, a user can submit a screen throwing request of a video website to a cloud device by triggering a screen throwing control on a screen throwing client side, the cloud device returns a video website input page to the screen throwing client in response to the triggering of the screen throwing control, the user inputs a video website needing to be thrown on the video website input page displayed by the screen throwing client, and submits the video website input page to the cloud device, the cloud device opens a webpage corresponding to the video website, analyzes the webpage corresponding to the video website, obtains irrelevant contents in the webpage corresponding to the video website, shields the irrelevant contents, fuses the webpage shielded by the irrelevant contents to a cloud desktop, pushes the webpage to a display device, only plays video contents in an important video window, and does not need to play the irrelevant contents displayed by the window such as advertisements, so that the effect of refreshing and playing after the video website is realized, the smoothness of video content display in the important video window is facilitated, and the viewing experience of the user is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic diagram of an application environment provided in an embodiment of the present application;
fig. 2 is a flow chart of a video screen projection method according to an embodiment of the present application;
fig. 3 is an interface schematic diagram of a screen-throwing client according to an embodiment of the present application;
fig. 4 is a schematic diagram of a video website entry page according to an embodiment of the present application;
FIG. 5 is a schematic diagram of another video website entry page according to an embodiment of the present disclosure;
FIG. 6 is a schematic diagram of a plurality of windows in a web page according to an embodiment of the present application;
fig. 7 is a flowchart of another video screen projection method according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a video projection device according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of a cloud device according to an embodiment of the present application.
Detailed Description
In order to make the present application solution better understood by those skilled in the art, the following description will be made in detail and with reference to the accompanying drawings in the embodiments of the present application, it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, shall fall within the scope of the present application.
The terms "comprising" and "having" and any variations thereof, as used in the specification, claims and drawings, are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those listed steps or elements but may include other steps or elements not listed or inherent to such process, method, article, or apparatus. Furthermore, the terms "first," "second," and "third," etc. are used for distinguishing between different objects and not for describing a particular sequential order.
Referring to fig. 1, fig. 1 is a schematic diagram of an application environment provided in an embodiment of the present application, where, as shown in fig. 1, the application environment includes a cloud device and a local device a, a local device B, and a local device C, where the cloud device, the local device a, the local device B, and the local device C may be connected through any one or more of a local area network, a metropolitan area network, and a wide area network. The cloud device is provided with a cloud application for screen projection, the cloud application can create a cloud conference group on the cloud device, a screen projection client is arranged on the local device A, the local device B and the local device C, and a user can initiate the cloud conference group, invite conference participants, screen projection display and the like through the screen projection client. The conference creator can initiate a cloud conference group creation request through a screen projection client on the local device A, the cloud device establishes the cloud conference group under the condition that the cloud device receives the request, the conference creator automatically enters the cloud conference group, and can send a room number or a link to conference participants through the local device A, and the conference participants join the cloud conference group through the screen projection client on own local devices (such as the local device B and the local device C). A user at any local equipment side can acquire the control authority of the conference desktop of the cloud conference through interaction with the cloud equipment, and display the control process at the screen end, so that the user becomes a presenter of the current conference. The "control" may include not only operation control of the shared file in the cloud space, but also operation of realizing instant communication between the screens of the local device a, the local device B and the local device C, where instant communication refers to operation of collecting audio-visual information of one or more users associated with the cloud space in real time and playing the audio-visual information between the local device a, the local device B and the local device C, such as collecting audio-visual information of a speaker and playing the audio-visual information between the local device a, the local device B and the local device C. A user at any local equipment side can upload the shared file to the cloud equipment through the screen throwing client, and request the cloud equipment to throw a screen, throw a webpage and the like. The cloud device may push the shared file uploaded by the user, the screen or the webpage to be shared to the conference desktop (or become a cloud desktop) to share, and optionally, the cloud device may store the shared file uploaded by the user in a cloud space, where the cloud space refers to a resource space (software and hardware resources) configured by the cloud device for processing and storing data (control plane data and data plane data) of the cloud conference, and is used for carrying various shared files uploaded by the user, where the shared files include graphics/text, audio/video, screen images, files, and the like. The local device a, the local device B, and the local device C may be large screen devices (screen projection devices of conference rooms), or may be terminal devices of users, for example: personal user equipment such as mobile phones and computers.
Referring to fig. 2, fig. 2 is a flowchart of a video projection method according to an embodiment of the present application, where the method may be implemented based on the application environment shown in fig. 1, and may be specifically applied to a cloud device, as shown in fig. 2, and includes steps 201 to 203:
201: and responding to the trigger of the webpage throwing control at the side of the screen throwing client, and returning a video website input page to the screen throwing client.
In this embodiment, as shown in fig. 3, a screen-throwing client provides functions of file throwing, screen throwing and webpage throwing, a meeting creator can trigger a webpage throwing control on the screen-throwing client, cloud equipment can respond to the triggering to create a cloud meeting group and generate a room number, screen throwing code or link of the cloud meeting group, and other meeting participants can enter the cloud meeting group through the room number, screen throwing code or link shared by the meeting creator. After the cloud conference group is successfully created, as shown in fig. 4, the cloud device returns a video website input page to the screen-throwing client, and the screen-throwing client receives and displays the video website input page, wherein the video website input page at least comprises a video website input column. Optionally, the web-throwing control may be triggered by other meeting personnel (non-meeting creator) entering the cloud conference group through a screen-throwing client on their local device, for example, after the other meeting personnel accept the invitation of the meeting creator to enter the cloud conference group, the screen-throwing client may be operated to enter the functional interface shown in fig. 3, and then click on the web-throwing control to initiate a request for throwing a video web page to the cloud device, and the cloud device returns a video website entry page shown in fig. 4 in response to the request.
202: acquiring a video website submitted by a user through a video website entry page, opening a webpage corresponding to the video website, and analyzing the webpage corresponding to the video website to obtain irrelevant contents in the webpage corresponding to the video website.
In this embodiment of the present application, before returning the video website entry page to the screen-throwing client, the cloud device may further determine whether the screen-throwing client is in a cloud conference group room, for example: and inquiring whether the user at the screen-throwing client side of the homeowner of the cloud conference group is still in the cloud conference group through the popup window, wherein the homeowner of the cloud conference group can be a conference creator or other conference participants after the conference creator hands over the homeowner. And the cloud device generates a graphical verification code for identity verification and a unique identifier of the screen-throwing client under the condition that the screen-throwing client initiating the webpage is determined to be in a cloud conference group room. For example: and 10 graphic verification codes are stored in the cloud space, 1 graphic verification code is randomly selected from 10 graphic verification codes each time identity verification is needed, the graphic verification code is identified as a graphic verification code a for carrying out identity verification on the screen-throwing client, and the graphic verification code is pushed to display equipment for display. The unique identifier of the screen-throwing client can be obtained by carrying out hash calculation on the user ID logged in by the screen-throwing client, and after the unique identifier is generated, the cloud device can store the unique identifier into a cloud space and send the unique identifier to a mobile phone number bound by the screen-throwing client.
For example, in the case of generating the unique identifier and the graphic verification code of the screen-throwing client, as shown in fig. 5, the video website input page returned by the cloud device may include, in addition to the video website input field, a unique identifier input field and a plurality of graphic verification codes, and prompt the user to select the same one of the plurality of graphic verification codes as the graphic verification code displayed on the display device. The plurality of graphic verification codes can be 4 randomly selected by the cloud device from the stored 10 graphic verification codes, and the plurality of graphic verification codes comprise graphic verification codes a identified by the cloud device.
The method further comprises the steps of:
acquiring an identification number to be verified submitted by a user through a unique identification input field and a graphic verification code to be verified selected from a plurality of graphic verification codes;
respectively verifying the identification number to be verified and the graphic verification code to be verified by adopting the unique identification and the graphic verification code to be verified;
and executing the operation of opening the webpage corresponding to the video website under the condition that the identification number to be verified and the graphic verification code to be verified pass verification.
It should be understood that the identification number input by the user in the unique identification input field shown in fig. 5 is the identification number to be verified, and the selected pattern is the graphic verification code to be verified. The cloud device judges whether the identification number to be verified is matched with the unique identification, judges whether the graphic verification code to be verified is a graphic verification code a, and if the identification number to be verified passes verification, determines that no malicious attack exists in the input of the screen-throwing client, namely the video website is trusted. In the embodiment, the authentication is performed on the screen-throwing client based on the unique identification and the graphic authentication code which are generated in advance, so that whether the video website input by the user has malicious attack or not is determined, and illegal users who are not in the cloud conference group room are prevented from providing illegal websites to the cloud server.
Illustratively, analyzing the web page to obtain irrelevant content in the web page includes:
analyzing the web page to locate a plurality of windows in the web page;
acquiring contribution coefficients of each window in the plurality of windows to a video window to be displayed from the plurality of windows;
calculating a reference value corresponding to each window according to the contribution coefficient;
and determining irrelevant contents from a plurality of windows according to the reference value.
Specifically, as shown in fig. 6, the cloud device may analyze a frame presented by a web page corresponding to a video website by using a machine learning model to locate a plurality of windows in the web page, for example: the plurality of windows may include a video window to be presented, a recommended video window for a video website, an advertising window, a video category ranking window (e.g., movie class, television series, educational class), and so forth. For each positioned window, m image frames of the window are acquired within a certain time, then one target image frame is randomly selected from the m image frames, the area ratio of the target image frame to the picture of the webpage corresponding to the video website is calculated, and the area ratio is determined as the contribution coefficient c of each window to the video window to be displayed, which is determined from a plurality of windows. Such as: in fig. 6, the ratio of the area of the video window to be displayed to the area of the whole webpage is taken as the contribution coefficient of the video window to be displayed, and since the video window to be displayed in the webpage is usually the window with the largest area, the contribution coefficient is usually the largest, that is, the contribution degree of the window to the content to be displayed at the front end is determined to be the highest. Wherein m is an integer greater than 2. For each window, calculating the similarity d between the 1 st image frame in m image frames and the rest (m-1) image frames to obtain (m-1) similarity, and simultaneously adopting a preset formula to map the contribution coefficient of each window into the weight coefficient of each window:
Figure BDA0003780386610000081
α=α 21
α 21
wherein θ i A weight coefficient representing the ith window, c i Represents the contribution coefficient of the ith window, alpha represents the formula parameter, alpha 1 ∈[0,1],α 2 ∈[0,1]E represents a natural constant. Since the video in the video window to be displayed is always playing, the (m-1) similarity d of m image frames is decreasing, even lower and lowerThe video or advertisement of his window is usually a cyclic playing or presenting still picture over a certain period of time, with (m-1) similarities d that differ significantly in amplitude from the video window to be presented, thus using a decreasing function θ i Will contribute coefficient c i Mapping to corresponding weight coefficients. That is to say that the weighting coefficients of the video window to be presented are minimal. Summing the (m-1) similarity d of the ith window to obtain
Figure BDA0003780386610000082
Wherein d j Representing the j-th similarity in the (m-1) similarity, and calculating to obtain a reference value of the i-th window by adopting the following formula:
f i =∑ 1≤j≤m-1,1≤i≤n θ i d j
wherein f i A reference value representing an ith window, and n represents the number of the plurality of windows. Since the (m-1) similarity d of the video window to be displayed is in a decreasing trend, the sum of the similarity d
Figure BDA0003780386610000083
The window with the minimum reference value is the video window to be displayed, and the content displayed by other windows with the reference value which is not the minimum reference value can be determined as irrelevant content.
203: and shielding the irrelevant content, fusing the web pages subjected to the irrelevant content shielding to a cloud desktop, and pushing the web pages to the display equipment.
In this embodiment of the present application, after determining a window corresponding to an irrelevant content, the cloud device masks the window corresponding to the irrelevant content in a web page, so as to implement masking of the irrelevant content, for example: windows corresponding to irrelevant content are masked out in the uniform resource locator (uniform resource locator, URL) of the web page. The cloud device merges the web pages with the irrelevant contents shielded to the cloud desktop, and pushes the web pages to the display device so as to play the video in the video window to be displayed on the display device, thereby realizing refreshing playing of the video projection screen. Such as: the display device may be a large screen device of a conference room.
It can be seen that, in the embodiment of the application, a user can submit a screen throwing request of a video website to a cloud device by triggering a screen throwing control on the side of a screen throwing client, the cloud device returns a video website input page to the screen throwing client in response to the triggering of the screen throwing control, the user inputs a video website needing to be thrown on the video website input page displayed by the screen throwing client, and submits the video website to the cloud device, the cloud device opens a webpage corresponding to the video website, analyzes the webpage corresponding to the video website, obtains irrelevant contents in the webpage corresponding to the video website, shields the irrelevant contents, fuses the webpage after the irrelevant contents are shielded to a cloud desktop, pushes the webpage to a display device, only plays video contents in an important video window, and does not need to play irrelevant contents displayed by windows such as advertisements, so that the effect of refreshing playing after the video website is achieved, the smoothness of video content display in the important video window is beneficial to guaranteeing the smoothness of video content display in the important video window, and the experience of the user is improved.
Referring to fig. 7, fig. 7 is a flowchart of another video screen projection method provided in an embodiment of the present application, where the method is applied to a cloud device, as shown in fig. 7, and includes steps 701-706:
701: responding to the triggering of a webpage throwing control at the side of the screen throwing client, and returning a video website inputting page to the screen throwing client;
702: acquiring a video website submitted by a user through a video website entry page, and opening a webpage corresponding to the video website;
703: analyzing the webpage to locate a plurality of windows in the webpage, and acquiring contribution coefficients of each window in the plurality of windows to a video window to be displayed from the plurality of windows;
illustratively, obtaining a contribution coefficient of each window in the plurality of windows to a video window to be displayed determined from the plurality of windows includes:
for each window, acquiring m image frames of each window, randomly selecting a target image frame from the m image frames, wherein m is an integer greater than 2;
and calculating the area ratio of the target image frame to the picture of the webpage corresponding to the video website, and determining the area ratio as the contribution coefficient of each window.
704: calculating a reference value corresponding to each window according to the contribution coefficient;
exemplary, the calculating according to the contribution coefficient obtains the reference value corresponding to each window includes:
obtaining the similarity between the 1 st image frame and the rest (m-1) image frames in the m image frames to obtain (m-1) similarity;
obtaining a weight coefficient of each window according to the contribution coefficient;
and calculating to obtain a reference value by adopting (m-1) similarity and weight coefficients.
705: determining irrelevant contents from a plurality of windows according to the reference value;
706: and shielding the irrelevant content, fusing the web pages subjected to the irrelevant content shielding to a cloud desktop, and pushing the web pages to the display equipment.
The specific implementation of steps 701-706 may be described with reference to the embodiment shown in fig. 2, and the same or similar advantages may be achieved, which will not be described herein.
Based on the description of the embodiments of the video projection method, please refer to fig. 8, fig. 8 is a schematic structural diagram of a video projection device provided in the embodiments of the present application, as shown in fig. 8, where the device includes an interaction unit 801 and a processing unit 802; wherein:
the interaction unit 801 is configured to return a video website entry page to the screen-throwing client in response to a trigger of the screen-throwing client-side webpage throwing control;
the processing unit 802 is configured to obtain a video website submitted by a user through a video website entry page, open a web page corresponding to the video website, and analyze the web page corresponding to the video website to obtain irrelevant content in the web page corresponding to the video website; and shielding the irrelevant content, fusing the web pages subjected to the irrelevant content shielding to a cloud desktop, and pushing the web pages to the display equipment.
It can be seen that in the video screen projection device shown in fig. 8, a user can submit a screen projection request of a video website to a cloud device by triggering a webpage projection control on a screen projection client side, the cloud device returns a video website input page to the screen projection client in response to the triggering of the webpage projection control, the user inputs a video website to be projected on the screen to the video website input page displayed by the screen projection client, and then submits the video website to the cloud device, the cloud device opens a webpage corresponding to the video website and analyzes the webpage corresponding to the video website to obtain irrelevant contents in the webpage corresponding to the video website, shields the irrelevant contents, fuses the webpage shielded by the irrelevant contents to a cloud desktop, pushes the webpage to a display device, and only plays the video contents in an important video window without playing the irrelevant contents displayed by a window such as advertisements, so that the effect of refreshing and playing after the video website projection is achieved, the smoothness of video content display in the important video window is facilitated, and the viewing experience of the user is improved.
In one possible implementation, the processing unit 802 is specifically configured to, in analyzing the web page to obtain irrelevant contents in the web page:
analyzing the web page to locate a plurality of windows in the web page;
acquiring contribution coefficients of each window in the plurality of windows to a video window to be displayed from the plurality of windows;
calculating a reference value corresponding to each window according to the contribution coefficient;
and determining irrelevant contents from a plurality of windows according to the reference value.
In one possible implementation manner, in acquiring a contribution coefficient of each window in the plurality of windows to determine a video window to be displayed from the plurality of windows, the processing unit 802 is specifically configured to:
for each window, acquiring m image frames of each window, randomly selecting a target image frame from the m image frames, wherein m is an integer greater than 2;
and calculating the area ratio of the target image frame to the picture of the webpage corresponding to the video website, and determining the area ratio as the contribution coefficient of each window.
In one possible implementation manner, the processing unit 802 is specifically configured to, in calculating a reference value corresponding to each window according to the contribution coefficient:
obtaining the similarity between the 1 st image frame and the rest (m-1) image frames in the m image frames to obtain (m-1) similarity;
obtaining a weight coefficient of each window according to the contribution coefficient;
and calculating to obtain a reference value by adopting (m-1) similarity and weight coefficients.
In a possible implementation, the interaction unit 801 is further configured to:
judging whether the screen-throwing client is in a cloud conference group room or not;
if the screen-throwing client is in the cloud conference group room, generating a graphical verification code for identity verification and a unique identifier of the screen-throwing client;
and sending the unique identification to the mobile phone number bound by the screen-throwing client through the short message, and identifying the graphic verification code in the cloud space.
In a possible implementation, the video website entry page includes a video website input field, a unique identification input field, and a plurality of graphic verification codes, and the interaction unit 801 is further configured to:
acquiring an identification number to be verified submitted by a user through a unique identification input field and a graphic verification code to be verified selected from a plurality of graphic verification codes;
respectively verifying the identification number to be verified and the graphic verification code to be verified by adopting the unique identification and the graphic verification code to be verified;
and executing the operation of opening the webpage corresponding to the video website under the condition that the identification number to be verified and the graphic verification code to be verified pass verification.
In one possible implementation, the processing unit 802 is further configured to:
determining a window with the minimum reference value in the windows as a video window to be displayed;
in determining the extraneous content from the plurality of windows according to the reference values, the processing unit 802 is specifically configured to:
and determining the content displayed by the window with the reference value which is not the smallest in the windows as irrelevant content.
Based on the description of the method embodiment and the device embodiment, the embodiment of the application also provides cloud equipment. Referring to fig. 9, the cloud device at least includes a processor 901, an input device 902, an output device 903, and a memory 904. The processor 901, the input device 902, the output device 903, and the memory 904 in the cloud device may be connected by a bus or other means.
The memory 904 is configured to store a computer program comprising program instructions, and the processor 901 is configured to execute the program instructions stored in the memory 904. The processor 901 (or CPU (Central Processing Unit, central processing unit)) is a computing core and a control core of the cloud device, which are adapted to implement one or more instructions, in particular to load and execute one or more instructions to implement a corresponding method flow or a corresponding function.
In one embodiment, the processor 901 of the cloud device provided in the embodiment of the present application may be configured to perform a series of processing of a video projection method:
responding to the triggering of a webpage throwing control at the side of the screen throwing client, and returning a video website inputting page to the screen throwing client;
acquiring a video website submitted by a user through a video website entry page, opening a webpage corresponding to the video website, and analyzing the webpage corresponding to the video website to obtain irrelevant contents in the webpage corresponding to the video website;
and shielding the irrelevant content, fusing the web pages subjected to the irrelevant content shielding to a cloud desktop, and pushing the web pages to the display equipment.
In yet another embodiment, the processor 901 performs an analysis of a web page to obtain unrelated content in the web page, including:
analyzing the web page to locate a plurality of windows in the web page;
acquiring contribution coefficients of each window in the plurality of windows to a video window to be displayed from the plurality of windows;
calculating a reference value corresponding to each window according to the contribution coefficient;
and determining irrelevant contents from a plurality of windows according to the reference value.
In yet another embodiment, the processor 901 performs obtaining a contribution coefficient of each window in the plurality of windows to determine a video window to be presented from the plurality of windows, including:
for each window, acquiring m image frames of each window, randomly selecting a target image frame from the m image frames, wherein m is an integer greater than 2;
and calculating the area ratio of the target image frame to the picture of the webpage corresponding to the video website, and determining the area ratio as the contribution coefficient of each window.
In yet another embodiment, the processor 901 performs calculation to obtain a reference value corresponding to each window according to the contribution coefficient, including:
obtaining the similarity between the 1 st image frame and the rest (m-1) image frames in the m image frames to obtain (m-1) similarity;
obtaining a weight coefficient of each window according to the contribution coefficient;
and calculating to obtain a reference value by adopting (m-1) similarity and weight coefficients.
In yet another embodiment, the processor 901 is further configured to, prior to returning the video website entry page to the drop client:
judging whether the screen-throwing client is in a cloud conference group room or not;
if the screen-throwing client is in the cloud conference group room, generating a graphical verification code for identity verification and a unique identifier of the screen-throwing client;
and sending the unique identification to the mobile phone number bound by the screen-throwing client through the short message, and identifying the graphic verification code in the cloud space.
In yet another embodiment, the video website entry page includes a video website entry field, a unique identification entry field, and a plurality of graphical passcodes, and the processor 901 is further configured to perform:
acquiring an identification number to be verified submitted by a user through a unique identification input field and a graphic verification code to be verified selected from a plurality of graphic verification codes;
respectively verifying the identification number to be verified and the graphic verification code to be verified by adopting the unique identification and the graphic verification code to be verified;
and executing the operation of opening the webpage corresponding to the video website under the condition that the identification number to be verified and the graphic verification code to be verified pass verification.
In yet another embodiment, the processor 901 is further configured to perform:
and determining the window with the smallest reference value in the windows as the video window to be displayed.
The processor 901 performs a determination of extraneous content from a plurality of windows based on a reference value, including:
and determining the content displayed by the window with the reference value which is not the smallest in the windows as irrelevant content.
Exemplary cloud devices include, but are not limited to, a processor 901, an input device 902, an output device 903, and a memory 904. And may also include memory, power supplies, etc. Those skilled in the art will appreciate that the schematic diagram is merely an example of a cloud device and is not limiting of the cloud device, and may include more or fewer components than shown, or certain components in combination, or different components.
It should be noted that, because the steps in the video screen projection method are implemented when the processor 901 of the cloud device executes the computer program, the embodiments of the video screen projection method are applicable to the cloud device, and the same or similar beneficial effects can be achieved.
The embodiment of the application also provides a computer storage medium (Memory), which is a Memory device in the cloud device and is used for storing programs and data. It will be appreciated that the computer storage medium herein may include both a built-in storage medium in the terminal and an extended storage medium supported by the terminal. The computer storage medium provides a storage space that stores an operating system of the terminal. Also stored in this memory space are one or more instructions, which may be one or more computer programs (including program code), adapted to be loaded and executed by the processor 901. The computer storage medium herein may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as at least one magnetic disk memory; alternatively, it may be at least one computer storage medium located remotely from the processor 901. In one embodiment, one or more instructions stored in a computer storage medium may be loaded and executed by processor 901 to implement the corresponding steps described above with respect to the video projection method.
The computer program of the computer storage medium may illustratively include computer program code, which may be in source code form, object code form, executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth.
It should be noted that, since the steps in the video projection method described above are implemented when the computer program of the computer storage medium is executed by the processor, all embodiments of the video projection method described above are applicable to the computer storage medium, and the same or similar beneficial effects can be achieved.
The foregoing has outlined rather broadly the more detailed description of embodiments of the present application, wherein specific examples are provided herein to illustrate the principles and embodiments of the present application, the above examples being provided solely to assist in the understanding of the methods of the present application and the core ideas thereof; meanwhile, as those skilled in the art will have modifications in the specific embodiments and application scope in accordance with the ideas of the present application, the present description should not be construed as limiting the present application in view of the above.

Claims (7)

1. A video screen projection method, applied to a cloud device, the method comprising:
responding to the triggering of a webpage throwing control at the side of a screen throwing client, and returning a video website inputting page to the screen throwing client;
acquiring a video website submitted by a user through the video website entry page, opening a webpage corresponding to the video website, and analyzing the webpage corresponding to the video website to obtain irrelevant contents in the webpage corresponding to the video website;
shielding the irrelevant content, fusing the web pages subjected to the irrelevant content shielding to a cloud desktop, and pushing the web pages to display equipment;
the analyzing the web page to obtain irrelevant contents in the web page comprises the following steps:
analyzing the web page to locate a plurality of windows in the web page;
acquiring contribution coefficients of each window in the plurality of windows to a video window to be displayed from the plurality of windows;
calculating a reference value corresponding to each window according to the contribution coefficient;
determining the irrelevant content from the windows according to the reference value;
the obtaining the contribution coefficient of each window in the plurality of windows to the video window to be displayed is determined from the plurality of windows, and the method comprises the following steps:
for each window, m image frames of each window are acquired, one target image frame is randomly selected from the m image frames, and m is an integer greater than 2;
calculating the ratio of the areas of the frames of the target image frame and the web page corresponding to the video website, and determining the ratio of the areas as the contribution coefficient of each window;
the calculating according to the contribution coefficient to obtain the reference value corresponding to each window includes:
obtaining the similarity between the 1 st image frame and the rest (m-1) image frames in the m image frames to obtain (m-1) similarity;
obtaining a weight coefficient of each window according to the contribution coefficient;
and calculating the reference value by adopting the (m-1) similarity and the weight coefficient.
2. The method of claim 1, wherein prior to returning a video website entry page to the screen-casting client, the method further comprises:
judging whether the screen-throwing client is in a cloud conference group room or not;
if the screen-throwing client is in a cloud conference group room, generating a graphical verification code for identity verification and a unique identifier of the screen-throwing client;
and sending the unique identification to the mobile phone number bound by the screen throwing client through a short message, and identifying the graphic verification code in a cloud space.
3. The method of claim 2, wherein the video website entry page includes a video website entry field, a unique identification entry field, and a plurality of graphical passcodes, the method further comprising:
acquiring an identification number to be verified submitted by a user through the unique identification input field and a graphic verification code to be verified selected from the plurality of graphic verification codes;
respectively verifying the identification number to be verified and the graphic verification code to be verified by adopting the unique identification and the graphic verification code to be verified;
and executing the operation of opening the webpage corresponding to the video website under the condition that the identification number to be verified and the graphic verification code to be verified pass verification.
4. The method according to claim 1, wherein the method further comprises:
determining a window with the minimum reference value in the windows as the video window to be displayed;
the determining the irrelevant content from the windows according to the reference value comprises the following steps:
and determining the content displayed by the window with the reference value which is not the smallest in the windows as the irrelevant content.
5. The video screen projection device is characterized by being applied to cloud equipment and comprising an interaction unit and a processing unit;
the interaction unit is used for responding to the triggering of the webpage throwing control at the side of the screen throwing client and returning a video website input page to the screen throwing client;
the processing unit is used for acquiring a video website submitted by a user through the video website entry page, opening a webpage corresponding to the video website, and analyzing the webpage corresponding to the video website to obtain irrelevant contents in the webpage corresponding to the video website; shielding the irrelevant content, fusing the web pages subjected to the irrelevant content shielding to a cloud desktop, and pushing the web pages to display equipment;
in the aspect of analyzing the web page to obtain irrelevant contents in the web page, the processing unit is specifically configured to:
analyzing the web page to locate a plurality of windows in the web page;
acquiring contribution coefficients of each window in the plurality of windows to a video window to be displayed from the plurality of windows;
calculating a reference value corresponding to each window according to the contribution coefficient;
determining the irrelevant content from the windows according to the reference value;
in the aspect of acquiring the contribution coefficient of each window in the plurality of windows to determining the video window to be displayed from the plurality of windows, the processing unit is specifically configured to:
for each window, m image frames of each window are acquired, one target image frame is randomly selected from the m image frames, and m is an integer greater than 2;
calculating the ratio of the areas of the frames of the target image frame and the web page corresponding to the video website, and determining the ratio of the areas as the contribution coefficient of each window;
in terms of calculating the reference value corresponding to each window according to the contribution coefficient, the processing unit is specifically configured to:
obtaining the similarity between the 1 st image frame and the rest (m-1) image frames in the m image frames to obtain (m-1) similarity;
obtaining a weight coefficient of each window according to the contribution coefficient;
and calculating the reference value by adopting the (m-1) similarity and the weight coefficient.
6. The utility model provides a high in clouds equipment, includes input device and output device, its characterized in that still includes:
a processor adapted to implement one or more computer programs; the method comprises the steps of,
a memory storing one or more computer programs adapted to be loaded by the processor and to perform the method of any of claims 1-4.
7. A computer storage medium storing one or more instructions adapted to be loaded by a processor and to perform the method of any one of claims 1-4.
CN202210936368.3A 2022-08-03 2022-08-03 Video screen projection method and device, cloud device and storage medium Active CN115379270B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210936368.3A CN115379270B (en) 2022-08-03 2022-08-03 Video screen projection method and device, cloud device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210936368.3A CN115379270B (en) 2022-08-03 2022-08-03 Video screen projection method and device, cloud device and storage medium

Publications (2)

Publication Number Publication Date
CN115379270A CN115379270A (en) 2022-11-22
CN115379270B true CN115379270B (en) 2023-07-14

Family

ID=84064205

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210936368.3A Active CN115379270B (en) 2022-08-03 2022-08-03 Video screen projection method and device, cloud device and storage medium

Country Status (1)

Country Link
CN (1) CN115379270B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112073758A (en) * 2020-11-11 2020-12-11 深圳乐播科技有限公司 Cloud desktop screen projection method and device, computer equipment, computer readable storage medium and cloud desktop screen projection interaction system
CN112764853A (en) * 2021-01-19 2021-05-07 深圳乐播科技有限公司 Screen projection method, equipment and system

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004177936A (en) * 2002-09-02 2004-06-24 Hiromitsu Takayama Method, system, and server for advertisement downloading, and client terminal
US20110314387A1 (en) * 2010-06-18 2011-12-22 International Business Machines Corporation Intelligent filtering for render status determination in a screen sharing system
CN103024608B (en) * 2012-11-19 2016-08-03 Tcl集团股份有限公司 The method and device that a kind of network media is play
CN103886088B (en) * 2014-03-28 2017-05-17 北京金山网络科技有限公司 Method and device for intercepting advertisements in webpage
CN103957608B (en) * 2014-05-12 2018-10-19 罗建平 A kind of multi-screen interactive equipment pairing connection method
CN104090914A (en) * 2014-06-10 2014-10-08 广东九联科技股份有限公司 Wireless router capable of automatically shielding advertising information and shielding method thereof
CN107895436A (en) * 2017-11-08 2018-04-10 东莞市康茂电子有限公司 One kind is shared with screen device management system and its control method
JP6485935B1 (en) * 2018-10-18 2019-03-20 ベルフェイス株式会社 Online communication review system, method, and computer program
CN114780054B (en) * 2022-06-20 2022-09-13 深圳乐播科技有限公司 Split screen display method and related device
CN114827094B (en) * 2022-06-30 2022-09-27 深圳乐播科技有限公司 Cloud desktop-based authority control method and device, computer equipment and medium

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112073758A (en) * 2020-11-11 2020-12-11 深圳乐播科技有限公司 Cloud desktop screen projection method and device, computer equipment, computer readable storage medium and cloud desktop screen projection interaction system
CN112764853A (en) * 2021-01-19 2021-05-07 深圳乐播科技有限公司 Screen projection method, equipment and system

Also Published As

Publication number Publication date
CN115379270A (en) 2022-11-22

Similar Documents

Publication Publication Date Title
US10313726B2 (en) Distributing media content via media channels based on associated content being provided over other media channels
US9424516B2 (en) Comprehensive human computation framework
JP6293269B2 (en) Content viewing confirmation apparatus and method
KR101418039B1 (en) Detecting and rejecting annoying documents
US10007776B1 (en) Systems and methods for distinguishing among human users and software robots
US10127373B1 (en) Systems and methods for distinguishing among human users and software robots
US20060026692A1 (en) Network resource access authentication apparatus and method
CN105760521A (en) Information input method and device
US9372601B2 (en) Information processing apparatus, information processing method, and program
CN113157157A (en) Interactive image management method, device, equipment and storage medium based on live broadcast
US20220303735A1 (en) Providing a summary of media content to a communication device
US20190158623A1 (en) Performance evaluation in a network community
US11172258B1 (en) Protecting against an impersonation scam in a live video stream
US20100287231A1 (en) Method and apparatus for certifying hyperlinks
US20170278130A1 (en) Method and Electronic Device for Matching Advertisement Data
CN115379270B (en) Video screen projection method and device, cloud device and storage medium
KR101994564B1 (en) Method and apparatus for verifying user
CN114026559A (en) Tamper-resistant interactive data
US10593222B1 (en) Video filming and discovery system
KR20210003547A (en) Method, apparatus and program for generating website automatically using gan
CN115357800A (en) Resource association method, device, electronic equipment, storage medium and program product
CN111885139B (en) Content sharing method, device and system, mobile terminal and server
JP6122138B2 (en) Method and device for optimizing information diffusion between communities linked by interaction similarity
AU2017412612B2 (en) Systems and methods for distinguishing among human users and software robots
US20200226379A1 (en) Computer system, pavilion content changing method and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant