CN113727180B - Screen throwing play control method and device, equipment and medium thereof - Google Patents

Screen throwing play control method and device, equipment and medium thereof Download PDF

Info

Publication number
CN113727180B
CN113727180B CN202111017131.7A CN202111017131A CN113727180B CN 113727180 B CN113727180 B CN 113727180B CN 202111017131 A CN202111017131 A CN 202111017131A CN 113727180 B CN113727180 B CN 113727180B
Authority
CN
China
Prior art keywords
screen
application
throwing
playing
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111017131.7A
Other languages
Chinese (zh)
Other versions
CN113727180A (en
Inventor
曾衍
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Cubesili Information Technology Co Ltd
Original Assignee
Guangzhou Cubesili Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Cubesili Information Technology Co Ltd filed Critical Guangzhou Cubesili Information Technology Co Ltd
Priority to CN202111017131.7A priority Critical patent/CN113727180B/en
Publication of CN113727180A publication Critical patent/CN113727180A/en
Application granted granted Critical
Publication of CN113727180B publication Critical patent/CN113727180B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866Management of end-user data
    • H04N21/25891Management of end-user data being end-user preferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/466Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H04N21/4668Learning process for intelligent management, e.g. learning user preferences for recommending movies for recommending content, e.g. movies
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/482End-user interface for program selection
    • H04N21/4826End-user interface for program selection using recommendation lists, e.g. of programs or channels sorted out according to their score
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • H04N21/8549Creating video summaries, e.g. movie trailer

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Graphics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application discloses a screen throwing play control method, a device, equipment and a medium thereof, wherein the method comprises the following steps: displaying a screen-throwing resource list, wherein the list comprises a plurality of video abstracts, and the video abstracts are created according to the screen-throwing resource information; responding to a screen throwing instruction acting on any video abstract in a screen throwing resource list, displaying a screen throwing application list, wherein the list comprises a plurality of application abstracts, and each application abstract points to a second application which is suitable for establishing a screen throwing communication link with the application; responding to a selected instruction of any one application abstract in the screen-throwing application list, establishing a screen-throwing communication link of a second application corresponding to the application abstract, and pushing screen-throwing resource information pointed by the video abstract to the second application for loading and playing; and monitoring a resource pushing event of the second application to establish a remote communication link with the playing terminal pointed by the resource pushing event. The method and the device realize synchronous control of the playing of the screen-throwing video in the local area network and the wide area network, and break through the limitation of the screen-throwing protocol.

Description

Screen throwing play control method and device, equipment and medium thereof
Technical Field
The application relates to the technical field of screen projection, in particular to a screen projection play control method, and further relates to a device, equipment and a nonvolatile storage medium corresponding to the method.
Background
The existing screen-throwing playing is generally realized by means of a WeChat screen-throwing technology such as DLNA, a screen-throwing output party in terminal equipment can push video data to a playing application in other terminal equipment for playing in a screen-throwing mode, the function of throwing video data of one equipment to a screen of another equipment for playing is realized, the playing effect of video is improved, the screen-throwing technology is applied to public places such as a mall and the like by controlling the playing of the screen-throwing video in a receiver through the screen-throwing output party, and the purpose of throwing advertisement video to a larger playing terminal for playing is realized, so that the advertising effect of the advertisement video is improved, and customers are attracted for consumption.
However, because the screen-throwing technology is limited in the local area network, long-distance screen-throwing playing and control cannot be realized, when the area of public places such as a mall is large, due to the short data transmission distance of the local area network, merchants cannot throw advertisement videos into a huge amount of playing terminals in the mall to output and play through the screen-throwing technology, and meanwhile, the playing of the advertisement videos in each playing terminal cannot be controlled in a centralized manner, obviously, the screen-throwing technology can only realize the purpose of sharing video content of data media by throwing a screen across devices in the local area network, and is often incapable of throwing a screen scene with a large transmission distance.
In view of the limitations of various existing screen projection technologies in terms of transmission distance, the applicant has made corresponding exploration for this purpose.
Disclosure of Invention
The present application aims to meet the needs of the prior art or overcome at least some of the shortcomings of the prior art to provide a screen-projection playing control method, and a corresponding device, electronic equipment and nonvolatile storage medium thereof.
In order to achieve the purposes of the application, the following technical scheme is adopted:
the screen-throwing play control method suitable for one of the purposes of the application comprises the following steps: displaying a screen-throwing resource list, wherein the screen-throwing resource list comprises a plurality of video abstracts, the video abstracts are created according to screen-throwing resource information, and the screen-throwing resource information is historical information generated by an external application program in the local equipment through a screen-throwing communication link to the application screen;
responding to a screen-throwing instruction acting on any video abstract in the screen-throwing resource list, displaying a screen-throwing application list, wherein the screen-throwing application list comprises a plurality of application abstracts, and each application abstract points to a second application which is suitable for establishing the screen-throwing communication link with the application;
responding to a selected instruction of any one application abstract in the screen-throwing application list, establishing a screen-throwing communication link of a second application corresponding to the application abstract, and pushing screen-throwing resource information pointed by the video abstract to the second application for loading and playing;
And monitoring a resource pushing event of the second application to establish a remote communication link with a playing terminal pointed by the resource pushing event so as to control the playing of the screen throwing resource information in the playing terminal.
In a further embodiment, before the displaying the on-screen resource list, the method further includes the following steps:
establishing a screen-throwing communication link with an external application program in the local equipment;
receiving screen projection resource information sent by an external application program through the screen projection communication link, and taking the screen projection resource information as history information of the external application program;
and creating a corresponding video abstract according to the screen-throwing resource information, and storing the video abstract into the screen-throwing resource list for display.
In a preferred embodiment, the step of establishing a screen-drop communication link with an external application in the local device includes:
receiving a multicast message which is broadcasted by an external application according to a preset protocol specification and used for searching a first application which is suitable for establishing the screen-throwing communication link and comprises the application;
unicast feedback of the first application preconfigured equipment information to the external application is performed in response to the multicast message, wherein the equipment information comprises communication configuration information;
The application and the external application establish a screen-throwing communication link according to the communication configuration information to realize binding.
In a further embodiment, in response to a selected instruction of any one application abstract in the screen-throwing application list, a screen-throwing communication link of a second application corresponding to the application abstract is established, and screen-throwing resource information pointed by the video abstract is pushed to the second application for loading and playing, including the steps of:
pushing the screen-throwing resource information to the second application through the screen-throwing communication link, wherein the screen-throwing resource information comprises a reference address of a video source, and the video source is selected from a video source list provided by a graphical user interface of a corresponding external application;
and monitoring a video loading and playing event of the second application to control the playing of the video data pointed by the reference address loaded by the second application.
In a further embodiment, the step of monitoring the second application for a screen-throwing device event to establish a remote communication link with the external device to which the same device event points, so as to control the playing of the screen-throwing resource in the external device, includes the following steps executed by the second application:
Responding to a resource pushing instruction, displaying a network receiver list in a current video playing page, wherein one or more playing terminals establishing a remote communication link with the second application are displayed in the list;
responding to a pushing instruction acting on one or more playing terminals in the network receiver list, and pushing the screen projection resource information to each playing terminal through the remote communication link;
and displaying a play control page, wherein the video play page of each selected play terminal is displayed in a list manner in the page so as to intensively control the play of the screen throwing resource information in each play terminal.
In a further embodiment, after the step of controlling the playing of the screen-throwing resource information in the playing terminal, the method further includes the following steps:
displaying a screen-throwing control page, wherein one or more video playing pages of a second application for receiving the screen-throwing resource information are displayed in the page;
and responding to a control instruction acting on any video playing page in the screen-throwing control interface, and controlling the playing of screen-throwing resource information in a second application corresponding to the video playing page.
In a preferred embodiment, after the step of controlling the playing of the screen-throwing resource information in the playing terminal, the method further includes the following steps:
Displaying a remote control page, wherein the remote control page displays one or more play control pages of a second application for receiving the screen-throwing resource information;
responding to a selected instruction acting on any play control page in the remote control interface, and outputting the play control page in a full screen mode;
and responding to a control instruction acting on any play terminal in the play control page, and controlling the play of the screen throwing resource information in the play terminal.
According to the purpose of this application, put forward a throw screen broadcast controlling means, it includes:
the screen-throwing resource list display module is used for displaying a screen-throwing resource list, wherein the screen-throwing resource list comprises a plurality of video abstracts, the video abstracts are created according to screen-throwing resource information, and the screen-throwing resource information is historical information generated by an external application program in the local equipment through a screen-throwing communication link to the application screen;
the play instruction response module is used for responding to a screen projection instruction acting on any video abstract in the screen projection resource list, displaying a screen projection application list, wherein the screen projection application list comprises a plurality of application abstracts, and each application abstract points to a second application suitable for establishing a screen projection communication link with the application;
The screen-throwing resource information pushing module is used for responding to a selected instruction of any one application abstract in the screen-throwing application list, establishing a screen-throwing communication link of a second application corresponding to the application abstract, and pushing the screen-throwing resource information pointed by the video abstract to the second application for loading and playing;
and the pushing event monitoring module is used for monitoring the resource pushing event of the second application so as to establish a remote communication link with the playing terminal pointed by the resource pushing event, and controlling the playing of the screen throwing resource information in the playing terminal.
In a further embodiment, the screen-projection resource information pushing module includes:
an information pushing sub-module, configured to push, to the second application through the screen-casting communication link, the screen-casting resource information including a reference address of a video source, where the video source is selected from a video source list provided by a graphical user interface of a corresponding external application;
and the loading playing event monitoring sub-module is used for monitoring the video loading playing event of the second application so as to control the playing of the video data pointed by the reference address loaded by the second application.
In a further embodiment, the push event listening module includes:
the resource pushing instruction response sub-module is used for responding to the resource pushing instruction, displaying a network receiver list in the current video playing page, and displaying one or more playing terminals which establish a remote communication link with the second application in the list;
the pushing instruction submodule is used for responding to a pushing instruction acting on one or more playing terminals in the network receiver list and pushing the screen throwing resource information to each playing terminal through the remote communication link;
the playing control page display sub-module is used for displaying the playing control page, and the video playing page of each selected playing terminal is displayed in a list manner in the page so as to intensively control the playing of the screen throwing resource information in each playing terminal.
An electronic device adapted for the purpose of the present application comprises a central processor and a memory, the central processor being adapted to invoke the execution of a computer program stored in the memory for executing the steps of the screen-cast play control method.
A non-volatile storage medium adapted to the purpose of the present application stores a computer program implemented according to the method for controlling the on-screen playback, and when the computer program is invoked by a computer to run, the computer program executes the steps included in the corresponding method.
Compared with the prior art, the method has the following advantages:
firstly, the limitation of the screen projection technology is broken through, the screen projection technology is applied to the wide area network, the screen projection data in the local area network are transmitted to the playing terminal in the wide area network to be projected and played through the wide area network, so that a user can control the playing of the screen projection video in each playing application in the local area network through the control terminal, synchronously control the playing of the screen projection video in the playing terminal deployed in the wide area network, and each playing application in the local area network can also control the playing of the screen projection video in the playing terminal in the wide area network.
Secondly, recording and storing screen throwing resources delivered by each application in the local equipment, creating corresponding video summaries for each screen throwing resource, loading the video summaries into a video play list for output display, enriching video resources of video play applications, enabling a user to select different screen throwing resources from the application for carrying out screen throwing and pushing of a wide area network, and carrying out centralized management on the screen throwing resources delivered by different applications.
In addition, the video screen-throwing function among different applications in the same equipment is realized, the video data sharing among the applications is realized in a screen-throwing mode, further, the sharing operation of the video data among the applications is simplified, the applications in the same equipment acquire corresponding video data from other applications through a screen-throwing communication link to load and play, the situation that sharing cannot be realized because the application program providing a video source does not support downloading is prevented, the application acquiring the video data can play the video data which cannot be acquired from a network or a storage space of the equipment, and video resources of the application are enriched.
Additional aspects and advantages of the application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:
FIG. 1 is a schematic diagram of a typical network deployment architecture relevant to implementing the technical solutions of the present application;
FIG. 2 is a flowchart illustrating an exemplary embodiment of a method for controlling a video playback according to the present application;
FIG. 3 is a schematic diagram of a screen-drop resource list of the present application in a graphical user interface as described herein;
FIG. 4 is a schematic diagram of a list of video sources of an external application in a graphical user interface as described herein;
FIG. 5 is a schematic diagram of a drop-in application list of the present application in a graphical user interface as described herein;
FIG. 6 is a flowchart illustrating steps performed in the embodiment of step S13 in FIG. 2;
FIG. 7 is a flowchart illustrating steps performed in the embodiment of step S14 in FIG. 2;
FIG. 8 is a schematic diagram illustrating a switching between graphical user interfaces of a second application in the implementation process of the second application when the second application performs the resource pushing event;
FIG. 9 is a flowchart of an embodiment of a method for controlling on-screen playback according to the present application, with a pre-step added;
FIG. 10 is a schematic diagram of product architecture of the present application and external application in the case where the screen-cast communication link of the present application conforms to the communication specification of the DLNA protocol;
FIG. 11 is a flowchart illustrating steps performed in the embodiment of step S08 in FIG. 9;
FIG. 12 is a flowchart of an embodiment of a method for controlling on-screen playback according to the present application, with a post-step added;
fig. 13 is a schematic diagram of a graphical user interface of the present application when performing screen-casting resource information play control of the second application through a screen-casting control page;
FIG. 14 is a flowchart of another embodiment of the method for controlling on-screen display according to the present application, with a post-step added;
fig. 15 is a schematic diagram of a graphical user interface of the present application when performing screen-casting resource information playing control of a playing terminal through a remote control page;
FIG. 16 is a functional block diagram of an exemplary embodiment of a cast-in-screen play control device of the present application;
fig. 17 is a basic structural block diagram of a computer device according to an embodiment of the present application.
Detailed Description
Embodiments of the present application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary only for the purpose of illustrating the present application and are not to be construed as limiting the present application.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless expressly stated otherwise, as understood by those skilled in the art. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. The term "and/or" as used herein includes all or any element and all combination of one or more of the associated listed items.
It will be understood by those skilled in the art that all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs unless defined otherwise. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
As used herein, "client," "terminal device," and "terminal device" are understood by those skilled in the art to include both devices that include only wireless signal receivers without transmitting capabilities and devices that include receiving and transmitting hardware capable of two-way communication over a two-way communication link. Such a device may include: a cellular or other communication device such as a personal computer, tablet, or the like, having a single-line display or a multi-line display or a cellular or other communication device without a multi-line display; a PCS (Personal Communications Service, personal communication system) that may combine voice, data processing, facsimile and/or data communication capabilities; a PDA (Personal Digital Assistant ) that can include a radio frequency receiver, pager, internet/intranet access, web browser, notepad, calendar and/or GPS (Global Positioning System ) receiver; a conventional laptop and/or palmtop computer or other appliance that has and/or includes a radio frequency receiver. As used herein, "client," "terminal device" may be portable, transportable, installed in a vehicle (aeronautical, maritime, and/or land-based), or adapted and/or configured to operate locally and/or in a distributed fashion, at any other location(s) on earth and/or in space. As used herein, a "client," "terminal device," or "terminal device" may also be a communication terminal, an internet terminal, or a music/video playing terminal, for example, a PDA, a MID (Mobile Internet Device ), and/or a mobile phone with music/video playing function, or may also be a device such as a smart tv, a set top box, or the like.
The hardware referred to by the names "server", "client", "service node" and the like in the present application is essentially an electronic device having the performance of a personal computer, and is a hardware device having necessary components disclosed by von neumann's principle, such as a central processing unit (including an arithmetic unit and a controller), a memory, an input device, and an output device, and a computer program is stored in the memory, and the central processing unit calls the program stored in the external memory to run in the memory, executes instructions in the program, and interacts with the input/output device, thereby completing a specific function.
It should be noted that the concept of "server" as referred to in this application is equally applicable to the case of a server farm. The servers should be logically partitioned, physically separate from each other but interface-callable, or integrated into a physical computer or group of computers, according to network deployment principles understood by those skilled in the art. Those skilled in the art will appreciate this variation and should not be construed as limiting the implementation of the network deployment approach of the present application.
Referring to fig. 1, the hardware base required for implementing the related technical solution of the present application may be deployed according to the architecture shown in the figure. The current application (the present application) distributes the screen-throwing resource information (local area network) sent by the application in the receiving same-machine device to the second applications which establish the screen-throwing communication link with the current application, and each second application distributes the screen-throwing resource information to the playing terminal through a remote communication link (wide area network), so that the current application controls the playing of the screen-throwing resource information in the second application through the screen-throwing communication link, controls the playing of the screen-throwing resource information in the playing terminal through the remote communication link relayed by the second application, and correspondingly, the second application can control the playing of the screen-throwing resource information in the playing terminal through the remote communication link.
The application (application program) refers to an application program running on a server or terminal equipment, the application program adopts a programming mode to realize the related technical scheme of the application, the program codes of the application program can be stored in a nonvolatile storage medium which can be identified by a computer in the form of computer executable instructions, and the program codes can be called into a memory by a central processing unit to run, and the related device of the application is constructed by the running of the application program on the computer.
The technical solution suitable for implementation in a terminal device in the present application may also be programmed to be built into an application providing live webcasting as part of which the functionality is extended. The network live broadcast refers to a live broadcast room network service realized based on the network deployment architecture.
Those skilled in the art will appreciate that: although the various methods of the present application are described based on the same concepts so as to be common to each other, the methods may be performed independently, unless otherwise indicated. Similarly, for each of the embodiments disclosed herein, the concepts presented are based on the same inventive concept, and thus, the concepts presented for the same description, and concepts that are merely convenient and appropriately altered although they are different, should be equally understood.
Referring to fig. 2, in an exemplary embodiment of the present application, a method for controlling a screen-casting playing includes the following steps:
step S11, a screen-throwing resource list is displayed, wherein the screen-throwing resource list comprises a plurality of video summaries, the video summaries are created according to screen-throwing resource information, and the screen-throwing resource information is historical information generated by an external application program in the local equipment through a screen-throwing communication link to the local application program:
And displaying the screen-throwing resource list in a graphical user interface of the application, wherein a plurality of video summaries are displayed in the screen-throwing resource list, and each video summary is created by the screen-throwing resource information pushed to the screen throwing of the current application by the external application program of the local equipment.
The current application and the external application program are application programs running on the same machine equipment, the current application and the external application program establish the screen-throwing communication link in the equipment to push the screen-throwing resource information, so that the current application creates a corresponding video abstract according to the screen-throwing resource information, outputs the video abstract to the screen-throwing resource list to be displayed, and compared with the common application program which shares a video data playing page of the current application program into other applications in a network link mode, the current application can jump to the video data playing page through the link to be different, after the current application acquires the screen-throwing resource information, the current application can throw the screen-throwing resource information into the second application to be output and played, and the second application can push the screen-throwing resource information into the playing terminal to be output and played through the remote communication link, accordingly, the current application can participate in controlling the playing of the screen-throwing resource information of the second application and the playing terminal, for example, suspending video playing, starting video playing or adjusting video playing progress and the like.
Referring to fig. 3, the screen-drop resource list 301 shown in fig. 3 is a display of the screen-drop resource list in a graphical user interface of a current application, and displays a plurality of video summaries, where each video summary is classified by an external application to which it belongs.
And under the condition that the external application program in the local equipment and the current application establish the screen-throwing communication link, the external application program can push the screen-throwing resource information to the current application through the screen-throwing communication link.
The screen-throwing communication link generally refers to a data communication link conforming to a communication specification of a DLNA protocol, the current application and the second application are taken as receivers of the screen-throwing resource information, the current application and the external application are generally regarded as DMP (Digital Media Player) in the DLNA protocol, the current application and the external application are generally regarded as DMS (Digital Media Server) in the DLNA protocol, and the current application takes the screen-throwing resource information as a history record of the external application after receiving the screen-throwing resource information which is pushed by the external application through the screen-throwing communication link.
For the implementation of establishing the screen-on communication link between the current application program and the external application program in the local device, please refer to the related implementation in step S08, which is not repeated herein.
After each external application program of the local equipment pushes the screen-throwing resource information to the current application through the screen-throwing communication link, each screen-throwing resource information is stored as history information by the current application so as to realize the pre-recording of the screen-throwing resource information pushed by each external application program, and even if the screen-throwing communication link established by the current application and the external application is disconnected, each screen-throwing resource information still can be stored by the current application as the history information.
The current application creates corresponding video abstracts for each screen-throwing resource information through the historical information, loads the video abstracts into the screen-throwing resource list for output display, and is convenient for a user to select the screen-throwing resource information pointed by the corresponding video abstracts through the screen-throwing resource list, pushes the screen-throwing resource information into a second application for output display, and correspondingly, the second application can push the screen-throwing resource information to a display terminal for output display through a remote communication link.
The video abstract generally refers to image-text information of the video source pointed by the video resource information, and the image-text information is generally data encapsulated into the screen-throwing resource information by the external application program, so that the current application creates the video abstract corresponding to the video resource information according to the image-text information included in the video resource information, loads the video abstract into the screen-throwing resource list for output display, and is convenient for a user to determine the video source pointed by the video resource information through the video abstract.
The current application can receive the screen-throwing resource information sent by a plurality of external application programs through the screen-throwing communication link in the local equipment, store and record the screen-throwing resource information as the history information, create the corresponding video abstract according to the screen-throwing resource information, output the video abstract to the screen-throwing resource list for output and display, so that a user can select the video resource information which is thrown to the current application in advance by the external application programs through the screen-throwing resource list, and output and play the selected video resource information through a screen-throwing protocol.
Referring to fig. 3 and 4, regarding the process of pushing the screen resource information by the external application of the local device through the screen-throwing communication link, fig. 4 is a graphical user interface of the external application a in the local device, the video source included in the external application a is shown in the video source list 401, the selected video source a is pushed to the current application as the screen-throwing resource information by touching the control of the screen-throwing push 402, the video summary information includes a video source a summary picture 403 and a video source a summary name 404, so that the current application creates a corresponding video summary for the screen-throwing resource information of the video source a through the video source a summary picture 403 and the video source a summary name 404, as shown in fig. 3, the video a summary picture 304 is the video source a summary picture 403, and the video a summary name 305 is the video source a summary name 404.
Step S12, a screen-throwing instruction acting on any video abstract in the screen-throwing resource list is responded, a screen-throwing application list is displayed, the screen-throwing application list comprises a plurality of application abstracts, and each application abstract points to a second application suitable for establishing the screen-throwing communication link with the application:
the current application responds to the screen-throwing instruction acting on any video abstract in the screen-throwing resource list to display the screen-throwing application list in a current graphical user interface, wherein the screen-throwing application list comprises a plurality of application abstracts, and each application abstract is used for representing the second application suitable for establishing the screen-throwing communication link with the current application.
The screen-throwing application list displays the application abstracts of a plurality of second applications which are suitable for establishing the screen-throwing communication link with the current application, so that a user can select a corresponding second application through the screen-throwing application list to establish the screen-throwing communication link so as to push screen-throwing resource information selected from the screen-throwing abstract list into the second application, and after the second application receives the screen-throwing resource information, the screen-throwing resource information can be loaded for playing and outputting, or pushed into a corresponding playing terminal for playing through a remote communication link.
The application abstract in the screen-throwing application list is created by the current application according to the second application searched by the current application under the same local area network, the current application broadcasts the multicast message to the application and the equipment under the same local area network according to the preset protocol specification, searches the second application suitable for establishing the screen-throwing communication link with the second application, creates the application abstract for each second application, and loads the application abstract into the screen-throwing application list for display.
The current application typically broadcasts the multicast message via a UDP user data protocol, which provides a way for an application to send encapsulated IP packets without establishing a connection, so that the second application can push the multicast message to the first application without establishing the on-screen communication link.
Referring to fig. 5, a screen-throwing application list 501 in fig. 5 is a screen-throwing application list described in the present application, and application summaries of a plurality of second applications are displayed in the screen-throwing application list 501, so that a user can select a corresponding second application to establish the screen-throwing communication link through the list, and push the screen-throwing resource information.
Referring to fig. 3 and fig. 5, a user selects the screen-throwing resource information of the video a abstract to perform screen-throwing pushing by touching a screen-throwing 303 control in the screen-throwing resource list 301 of the graphical user interface of the current application, and the graphical user interface of the current application displays the screen-throwing application list 501 of fig. 5, so that the current user selects a corresponding application abstract as a second application for establishing the screen-throwing communication link with the current application through the screen-throwing application list 501, thereby performing screen-throwing pushing of the screen-throwing resource information of the video a abstract.
Step S13, responding to a selected instruction of any one application abstract in the screen-throwing application list, establishing a screen-throwing communication link of a second application corresponding to the application abstract, and pushing screen-throwing resource information pointed by the video abstract to the second application for loading and playing:
the current application responds to a selected instruction acting on any one of the application abstracts in the screen-throwing application list, so that the screen-throwing communication link is established with a second application pointed by the selected instruction, and the screen-throwing resource information selected in the screen-throwing resource list is pushed to the second application for loading and playing.
Referring to fig. 3 and 5, the user touches the screen-projection 502 control through the screen-projection application list 501 displayed in the graphical user interface of the current application to select the B application program as the second application for establishing the screen-projection communication link with the current application, and pushes the screen-projection resource information selected from the screen-projection resource list 301 of fig. 3 to the B application program for loading and playing.
After the current application responds to the selected instruction, determining the second application pointed by the selected instruction, analyzing the device information which is fed back by unicast in advance by the second application, and acquiring the communication configuration information contained in the device information so as to perform corresponding configuration according to the communication configuration information and establish the screen-throwing communication link with the second application.
The configuration information refers to information of the second application itself for establishing the screen-throwing communication link with other applications, the equipment information includes the communication configuration information, the communication configuration information includes an ip address and an up np service port of the second application, and after the current application receives the configuration information, the screen-throwing communication link is established with the second application according to the communication configuration information included in the configuration information.
After the current application and the second application pointed by the selected instruction finish the establishment of the screen-throwing communication link, the screen-throwing resource information selected in the screen-throwing resource list is pushed to the second application through the screen-throwing communication link, so that the second application loads the screen-throwing resource information to a player built in the second application for output and playing.
The screen-throwing resource information generally refers to a reference address or a local cache path used for acquiring video data, and after the second application acquires the screen-throwing resource information, the video data pointed by the video data is acquired through the reference address or the local cache path contained in the screen-throwing resource information.
The video data generally refers to video data obtained from a network or a local area by the external application, the video data can be loaded and played by the external application and the second application, and the current application and the second application can control the playing of the video data, for example, pause playing, start playing, adjust the playing progress, adjust the playing volume, and the like.
Referring to fig. 6, regarding an embodiment in which the current application pushes the screen-throwing resource information, and the second application loads the screen-throwing resource information for playing and outputting, the specific steps are as follows:
Step S131, pushing, to the second application, the screen-drop resource information through the screen-drop communication link, where the screen-drop resource information includes a reference address of a video source, and the video source is selected from a list of video sources provided by a graphical user interface of a corresponding external application:
after the current application and the second application complete the establishment of the screen-throwing communication link, the screen-throwing resource information comprising the reference address of the video source is pushed to the second application through the screen-throwing communication link.
And the second application receives the screen projection resource information sent by the current application through the screen projection communication link, and loads the video source selected by the corresponding external application through the video source list provided in the graphical user interface according to the reference address of the video source included in the screen projection resource information.
The reference address generally refers to a URL, and after the second application obtains the reference address, the video data pointed by the URL may be obtained from the media server pointed by the reference address (URL) for loading and playing.
After the second application obtains the reference address, a built-in player of the second application is called to load and play the video data pointed by the reference address, specifically, the second application establishes connection with a media server pointed by the reference address through the reference address, so as to obtain the video data pointed by the reference address from the media server, and the video data is loaded into the built-in player for playing.
Step S132, monitoring a video loading playing event of the second application to control playing of the video data pointed to by the reference address loaded by the second application:
the current application monitors whether the second application finishes the video loading playing event after the loading playing of the video data pointed by the reference address, and after the second application finishes, the current application can control the playing of the video data in the second application by pushing a corresponding control instruction to the second application, for example, suspending the playing of the video data, adjusting the playing progress of the video data, ending the playing of the video data, and the like.
Step S14, monitoring a resource pushing event of the second application to establish a remote communication link with a playing terminal pointed by the resource pushing event so as to control the playing of the screen throwing resource information in the playing terminal:
the current application monitors the resource pushing event of the second application, and establishes the remote communication link with the playing terminal pointed by the resource pushing event so as to control the playing of the screen throwing resource information in the playing terminal.
The resource pushing event refers to an event that a second application pushes the screen-throwing resource information acquired from a current application to a corresponding playing terminal through the remote communication link to output and play, and after the current application monitors that the second application completes the resource pushing event, the playing terminal which receives the screen-throwing resource information in the resource pushing event and plays the screen-throwing resource information to output and play is used for establishing the remote communication link so as to control the playing of the screen-throwing resource information in the playing terminal, for example, the playing progress of the screen-throwing resource information in the playing terminal is regulated, the playing of the screen-throwing resource information in the playing terminal is suspended, or the playing of the screen-throwing resource information in the playing terminal is canceled.
The remote communication link is a data communication link in the wide area network, so that a second application pushes corresponding screen throwing resource information to the playing terminal through the remote communication link, the playing of the screen throwing resource information in the playing terminal is controlled, the current application is convenient to relay the screen throwing resource information in the playing terminal which receives the screen throwing resource information pushed by the second application through the remote communication link, compared with the mode of normally remotely controlling the playing of videos existing in the playing terminal, the video played by the playing terminal is obtained from a corresponding server through the wide area network by combining the wide area network and the local area network, the current application can be connected with the playing terminal through the second application while controlling the second application through the local area network, the current application can serve as a relay of the current application and the playing application in the remote communication link of the wide area network, the current application pushes corresponding control instructions to the second application through the local area network, the second application can relay the control instructions, the control instructions are pushed to the corresponding playing terminal through the remote communication link, and the playing control instructions are carried out on the video in the playing terminal, and the playing control of the current application is realized.
Regarding the implementation manner of controlling the playing of the video in the playing terminal by the current application through the remote communication link, please refer to the corresponding post-step of the present application, and this step is not repeated.
Referring to fig. 7, regarding an embodiment of the second application performing the resource pushing event, the specific steps are as follows:
step S141, in response to the resource pushing instruction, displaying a network receiver list in the current video playing page, where one or more playing terminals that establish a remote communication link with the second application are displayed in the list:
the second application responds to the resource pushing instruction in a video playing page for playing the screen throwing resource information, so that the network receiver list is displayed in the video playing page, and one or more playing terminals for establishing the remote communication link with the second application are displayed in the network receiver list.
Referring to fig. 8, fig. a is a diagram illustrating the video playing page of the second application, in which the screen-throwing resource information is played and output in a screen-throwing resource information playing window a-802, and a user generates the resource pushing instruction by touching a screen-throwing resource information pushing control a-801 in the video playing page, so that the second application responds to the resource pushing instruction, displays a network receiver list B-801 in fig. B in a current video page, and displays a plurality of playing terminals that establish the remote pre-link with the second application.
Step S142, in response to a pushing instruction acting on one or more playing terminals in the network receiver list, pushing the screen-throwing resource information to each playing terminal through the remote communication link:
and the second application responds to push instructions acting on one or more play terminals in the network receiver list, and sends screen-throwing resource information played in the video play page to play terminals corresponding to the push instructions through the remote communication link to generate and play.
Referring to fig. 8, a user selects a corresponding playing terminal as a receiving party of the screen-throwing resource information through a corresponding selected B-802 control by touching the network receiving party list B-801 in fig. B, and touches a push screen-throwing resource information control B-803 to generate push instructions corresponding to the selected playing terminals, so that the second application responds to the push instructions to push the screen-throwing resource information to the playing terminals corresponding to the push instructions through the remote communication link for output playing.
Step S143, displaying a play control page, in which video play pages of the selected play terminals are displayed in a list, so as to centrally control the play of the screen-throwing resource information in each play terminal:
After the second application pushes the screen throwing resource information to the playing terminals corresponding to the pushing instructions, the playing control page is displayed, and the video playing page of each playing terminal is displayed in the page, so that a user can control each playing terminal to play the screen throwing resource information through the playing control page.
Referring to fig. 8, after the second application completes pushing the screen-throwing resource information, the playing control page shown in fig. C is displayed, where video playing pages of a plurality of playing terminals that receive the screen-throwing resource information for playing are displayed in the playing control page, so that a user centrally manages playing of the screen-throwing resource information in each of the playing terminals through the playing control page.
The above exemplary embodiments and variations thereof fully disclose embodiments of the method for controlling on-screen playback of the present application, but various variations of the method may still be deduced by transforming and augmenting some technical means, and the following summary illustrates other embodiments:
in one embodiment, referring to fig. 9, before the displaying the on-screen resource list, the method further includes the following steps:
Step S08, a screen-throwing communication link is established with an external application program in the local equipment:
the current application establishes the screen-in communication link with the external application running in the on-machine device.
Referring to fig. 10, the on-screen communication link is generally an on-screen communication link conforming to the communication specification of the DLNA protocol, by configuring the current application 1002 and the external application 1001 to be respectively located in virtual devices with different communication addresses, the external application 1001 has a DMS module (digital media server) through which the on-screen resource information is pushed to the current application 902 through the on-screen communication link conforming to the DLNA protocol as a provider of the video data, and the external application 1001 has a DMC module (digital media server) that can control the playing of the video data acquired according to the on-screen resource information in the current application; the current application 902 has a DMP module (digital media player) having the functions of a DMC module and a DMR module (digital media renderer), through which video data acquired according to the screen-on resource information is rendered for playback, and the playback of the video data is controlled.
Correspondingly, the process of establishing the screen-throwing communication link between the current application and the second application can refer to the implementation mode of the step, the current application is used as a provider of screen-throwing resource information, and the second application is used as a receiver of the screen-throwing resource information.
Referring to fig. 11, regarding an embodiment of establishing the screen-drop communication link between the current application program and the external application program, the specific steps are as follows:
step S081, receiving a multicast message broadcasted by an external application according to a preset protocol specification for searching a first application including the present application adapted to establish the screen-cast communication link:
and the external application program broadcasts the multicast message to the application programs and devices under the same local area network according to the preset protocol specification so as to search for the occurrence of the application suitable for establishing the screen-throwing communication link with the application programs, the current application program receives the multicast message, and the screen-throwing communication link is established by the external application program.
The external application typically broadcasts the multicast message via a UDP user data protocol, which provides a method for an application to send encapsulated IP packets without establishing a connection, so that the external application can push the multicast message to the current application without establishing the on-screen communication link.
And the external application program broadcasts the multicast message to the application programs and devices under the same local area network according to the preset protocol specification so as to push the multicast message to the address and the port of the current application program, so that the current application program receives the multicast message to respond, and the screen-throwing communication link between the two parties is established.
Step S082, responding to the multicast message and feeding back the first application preconfigured device information to the external application in a unicast way, wherein the device information comprises communication configuration information:
after the current application program receives the multicast message, the current application program will respond to the multicast message to acquire the address and the port contained in the multicast message, so as to unicast and feed back the self-preconfigured equipment information containing the communication configuration information to the external application program through the address and the port.
The configuration information refers to information of the current application program itself for establishing the screen-throwing communication link with other applications, the equipment information comprises the communication configuration information, the communication configuration information comprises an ip address and an up np service port of the current application program, and after the external application program receives the configuration information, the screen-throwing communication link is established with the current application program according to the communication configuration information contained in the configuration information.
Step S083, the application and the external application establish a screen-throwing communication link according to the communication configuration information to realize binding:
the external application program receives the device information fed back by the current application program in a unicast mode, and establishes the screen-throwing communication link with the current application program according to the communication configuration information contained in the device information so as to achieve the binding of the screen-throwing communication links of the two parties.
Step S09, receiving the screen projection resource information sent by the external application program through the screen projection communication link, and taking the screen projection resource information as the history information of the external application program:
after the current application program establishes the screen-throwing communication link with an external application program in the local equipment, the external application program can throw the screen to the screen-throwing resource information to the current application program through the screen-throwing communication link, so that the current application program takes the screen-throwing resource information as the history information of the external application program.
The current application program stores the history information of each external application program in the local equipment so as to record the screen-throwing resource information which is sent by each external application program in a pre-throwing mode, and a user can conveniently select the screen-throwing resource information of each external application program in a pre-throwing mode to output and play through each history information.
Step S10, creating a corresponding video abstract according to the screen-throwing resource information, and storing the video abstract into the screen-throwing resource list for display:
the current application program creates corresponding video resources for the screen-throwing resource information according to the image-text information included in the screen-throwing resource information sent by the external application program, and stores the video abstracts into the screen-throwing resource list so as to output and display the video abstracts corresponding to the video information when the screen-throwing resource list is loaded to the video playing page.
In one embodiment, referring to fig. 12, after the method for controlling the playing of the screen-cast resource information in the playing terminal, the method further includes the following steps:
step S15, displaying a screen-throwing control page, wherein one or more video playing pages of a second application for receiving the screen-throwing resource information are displayed in the page:
and displaying the screen throwing control page in a graphical user interface of the current application, wherein the video playing page of one or more second applications for receiving the screen throwing resources sent by the current application through the screen throwing communication link is displayed in the page.
Referring to fig. 13, a screen-throwing control page is shown in fig. a, where a plurality of video playing pages of the second applications that receive the screen-throwing resource information are displayed in the screen-throwing control page, so that a user determines, in real time, a playing condition of playing the real-time screen-throwing resource information by each of the second applications through the screen-throwing control page.
Step S16, responding to a control instruction acting on any one of the video playing pages in the screen-throwing control interface, and controlling the playing of screen-throwing resource information in a second application corresponding to the video playing page:
the current application responds to the control instruction acting on any one of the video playing pages in the screen-throwing control interface to control the playing of the screen-throwing resource information in the corresponding second application in the video playing page pointed by the control instruction, for example, suspending the playing of the screen-throwing resource information in the second application, adjusting the playing progress of the screen-throwing resource information or canceling the playing of the screen-throwing resource information by the second application, and the like.
After the current application responds to the control instruction, a corresponding play control instruction is pushed to the second application through the screen-throwing communication link so as to control the play of the screen-throwing resource information in the second application.
Referring to fig. 13, a current application responds to a selected instruction in the image a, which acts on a video playing page of the second application, to switch the screen-throwing control page of the current application to a graphical user interface shown in the image B, where the video playing page of the second application is displayed in the graphical user interface, and each control is provided to generate the responsive control instruction to control playing of the screen-throwing resource information in the second application, for example, by adjusting a video playing progress B-1301 control, controlling the playing progress of the screen-throwing resource information in the second application, or by suspending playing of the B-1302 control by touch, suspending playing of the screen-throwing resource information in the second application.
In another embodiment, referring to fig. 14, after the method for controlling the playing of the screen-throwing resource information in the playing terminal, the method further includes the following steps:
step S15', displaying a remote control page, where one or more play control pages of the second application that receives the screen-casting resource information are displayed in the remote control page:
the current application displays the remote control page, and one or more play control pages of the second application receiving the screen-throwing resource information are displayed in the remote control page, wherein the play control pages and the play control pages in the steps S141 to S143.
Referring to fig. 15, the graphical user interface shown in fig. a is a remote control page, where the play control pages of the second applications are displayed in the remote control page, so that a user determines, through the remote control page, a play condition of the screen-throwing resource information in each play terminal in each second application.
Step S16', responding to the selected instruction acting on any one of the play control pages in the remote control interface, and outputting the play control page in full screen:
the current application responds to a selected instruction of a playing control page of any one of the second applications in the remote control interface, so that the playing control page corresponding to the second application pointed by the selected instruction is output to a graphical user interface of the current application in a full screen mode for display.
Referring to fig. 15, in response to the selected instruction acting on the play control page a-1501 of the second application a in the remote control interface shown in fig. a, the current application program switches the graphical user interface of the current application from fig. a to the graphical user interface shown in fig. B, where the interface shown in fig. B is the play control page of the second application a, and a video play page of the play terminal loading and playing the screen-throwing resource information pushed by the second application a through a plurality of remote communication links is shown in the page.
Step S17', responding to the control instruction of any one play terminal in the play control page, and controlling the play of the screen throwing resource information in the play terminal:
the current application responds to the control instruction of any play terminal in the play control page of the selected instruction so as to control the play of the screen throwing resource information in the play terminal corresponding to the control instruction.
After the current application responds to the control instruction, pushing the control instruction to the second application through the screen-throwing communication link so as to trigger the second application to push the control instruction to a playing terminal corresponding to the control instruction through the remote communication link, so as to control the playing of the screen-throwing resource information in the playing terminal.
Referring to fig. 15, a current application responds to a selection instruction of a video playing page B-1501 of a playing terminal a in the diagram B to switch a playing control page of a second application a of the current application to a graphical user interface shown in the diagram C, wherein the graphical user interface displays the video playing page of the playing terminal a, and provides the control instructions for generating responses to control the playing of the screen throwing resource information in the playing terminal a, for example, by adjusting a video playing progress C-1501 control, controlling the playing progress of the screen throwing resource information in the playing terminal a, or by suspending the playing of the control C-1502 by touch, suspending the playing of the screen throwing resource information in the playing terminal a.
Further, by performing functionalization on each step in the method disclosed in each of the foregoing embodiments, a projection screen play control device of the present application may be constructed, and according to this idea, please refer to fig. 16, in one exemplary embodiment, the device includes: the screen-throwing resource list display module 11 is used for displaying a screen-throwing resource list, wherein the screen-throwing resource list comprises a plurality of video summaries, the video summaries are created according to screen-throwing resource information, and the screen-throwing resource information is historical information generated by an external application program in the local equipment through a screen-throwing communication link to the application; a play instruction response module 12, configured to respond to a screen-throwing instruction acting on any video abstract in the screen-throwing resource list, and display a screen-throwing application list, where the screen-throwing application list includes a plurality of application abstracts, and each application abstract points to a second application adapted to establish the screen-throwing communication link with the application; the screen-throwing resource information pushing module 13 is configured to respond to a selected instruction of any one application abstract in the screen-throwing application list, establish a screen-throwing communication link of a second application corresponding to the application abstract, and push screen-throwing resource information pointed by the video abstract to the second application for loading and playing; the push event monitoring module 14 is configured to monitor a resource push event of the second application, so as to establish a remote communication link with a playing terminal pointed by the resource push event, so as to control playing of the screen-throwing resource information in the playing terminal.
In one embodiment, the screen-projection resource information pushing module 13 includes: an information pushing sub-module, configured to push, to the second application through the screen-casting communication link, the screen-casting resource information including a reference address of a video source, where the video source is selected from a video source list provided by a graphical user interface of a corresponding external application; and the loading playing event monitoring sub-module is used for monitoring the video loading playing event of the second application so as to control the playing of the video data pointed by the reference address loaded by the second application.
In one embodiment, the push event listening module 14 includes: the resource pushing instruction response sub-module is used for responding to the resource pushing instruction, displaying a network receiver list in the current video playing page, and displaying one or more playing terminals which establish a remote communication link with the second application in the list; the pushing instruction submodule is used for responding to a pushing instruction acting on one or more playing terminals in the network receiver list and pushing the screen throwing resource information to each playing terminal through the remote communication link; the playing control page display sub-module is used for displaying the playing control page, and the video playing page of each selected playing terminal is displayed in a list manner in the page so as to intensively control the playing of the screen throwing resource information in each playing terminal.
In order to solve the above technical problems, the embodiments of the present application further provide a computer device, configured to run a computer program implemented according to the screen-drop play control method. Referring specifically to fig. 17, fig. 17 is a basic structural block diagram of a computer device according to the present embodiment.
As shown in fig. 17, the internal structure of the computer device is schematically shown. The computer device includes a processor, a non-volatile storage medium, a memory, and a network interface connected by a system bus. The nonvolatile storage medium of the computer device stores an operating system, a database and computer readable instructions, the database can store a control information sequence, and when the computer readable instructions are executed by a processor, the processor can realize a screen throwing playing control method. The processor of the computer device is used to provide computing and control capabilities, supporting the operation of the entire computer device. The memory of the computer device may store computer readable instructions that, when executed by the processor, cause the processor to perform a method of controlling a video playback. The network interface of the computer device is for communicating with a terminal connection. It will be appreciated by those skilled in the art that the structure shown in fig. 17 is merely a block diagram of a portion of the structure associated with the present application and is not limiting of the computer device to which the present application applies, and that a particular computer device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.
In this embodiment, the processor is configured to execute specific functions of each module/sub-module in the screen-projection play control device of the present invention, and the memory stores program codes and various data required for executing the modules. The network interface is used for data transmission between the user terminal or the server. The memory in this embodiment stores program codes and data required for executing all modules/sub-modules in the screen-cast play control device, and the server can call the program codes and data of the server to execute the functions of all the sub-modules.
The present application also provides a non-volatile storage medium, where the above-mentioned method of controlling on-screen display is written as a computer program, and the computer program is stored in the storage medium in the form of computer readable instructions, where the computer readable instructions when executed by one or more processors mean that the program runs in a computer, thereby causing the one or more processors to execute the steps of the method of controlling on-screen display in any of the above-mentioned embodiments.
Those skilled in the art will appreciate that implementing all or part of the above-described methods in accordance with the embodiments may be accomplished by way of a computer program stored in a computer-readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. The storage medium may be a nonvolatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a random access Memory (Random Access Memory, RAM).
In summary, the present application breaks through the limitation of the screen-projection technology, applies the screen-projection technology to the wide area network, and sends the screen-projection data in the local area network to the playing terminal in the wide area network to perform screen-projection playing in a manner of the wide area network, so that a user controls the playing of the screen-projection video in each playing application in the local area network through the control terminal, synchronously controls the playing of the screen-projection video in the playing terminal deployed in the wide area network, and each playing application in the local area network can also control the playing of the screen-projection video in the playing terminal in the wide area network.
It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited in order and may be performed in other orders, unless explicitly stated herein. Moreover, at least some of the steps in the flowcharts of the figures may include a plurality of sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, the order of their execution not necessarily being sequential, but may be performed in turn or alternately with other steps or at least a portion of the other steps or stages.
Those of skill in the art will appreciate that the various operations, methods, steps in the flow, actions, schemes, and alternatives discussed in the present application may be alternated, altered, combined, or eliminated. Further, other steps, means, or steps in a process having various operations, methods, or procedures discussed in this application may be alternated, altered, rearranged, split, combined, or eliminated. Further, steps, measures, schemes in the prior art with various operations, methods, flows disclosed in the present application may also be alternated, altered, rearranged, decomposed, combined, or deleted.
The foregoing is only a partial embodiment of the present application, and it should be noted that, for a person skilled in the art, several improvements and modifications can be made without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.

Claims (10)

1. The screen throwing play control method is characterized by comprising the following steps of:
displaying a screen-throwing resource list, wherein the screen-throwing resource list comprises a plurality of video abstracts, the video abstracts are created according to screen-throwing resource information, the screen-throwing resource information is historical information generated by a digital media server module of an external application program in local equipment for throwing a screen to the application through a screen-throwing communication link, the application can render video data of the screen-throwing resource information to the digital media player module through the digital media renderer module for playing, and the application and the external application program are provided with a digital media controller module for controlling the video data played by the application;
Responding to a screen projection instruction acting on any video abstract in the screen projection resource list, displaying a screen projection application list, wherein the screen projection application list comprises a plurality of application abstracts, each application abstract points to a second application suitable for establishing the screen projection communication link with the application, and the application, an external application program and the second application are respectively positioned in virtual equipment with different communication addresses;
responding to a selected instruction of any one application abstract in the screen-throwing application list, establishing a screen-throwing communication link of a second application corresponding to the application abstract through a digital media server module, and pushing screen-throwing resource information pointed by the video abstract to the second application for loading and playing, wherein the second application can play video data of the screen-throwing resource information to the digital media player module through the digital media renderer module, and the second application and the application are provided with a digital media controller module for controlling the video data played by the second application;
and monitoring a resource pushing event of the second application to establish a remote communication link with a playing terminal pointed by the resource pushing event so as to control the playing of the screen throwing resource information in the playing terminal through a digital media controller module.
2. The method of claim 1, further comprising, prior to said presenting the list of on-screen resources, the steps of:
establishing a screen-throwing communication link with an external application program in the local equipment;
receiving screen projection resource information sent by an external application program through the screen projection communication link, and taking the screen projection resource information as history information of the external application program;
and creating a corresponding video abstract according to the screen-throwing resource information, and storing the video abstract into the screen-throwing resource list for display.
3. The method of claim 2, wherein the step of establishing a screen-cast communication link with an external application in the local device comprises:
receiving a multicast message which is broadcasted by an external application according to a preset protocol specification and used for searching a first application which is suitable for establishing the screen-throwing communication link and comprises the application;
unicast feedback of the first application preconfigured equipment information to the external application is performed in response to the multicast message, wherein the equipment information comprises communication configuration information;
the application and the external application establish a screen-throwing communication link according to the communication configuration information to realize binding.
4. The method according to claim 1, wherein the step of establishing a screen-throwing communication link of a second application corresponding to the application abstract in the application in response to a selected instruction of any one application abstract in the screen-throwing application list, and pushing screen-throwing resource information pointed by the video abstract to the second application for loading and playing includes:
Pushing the screen-throwing resource information to the second application through the screen-throwing communication link, wherein the screen-throwing resource information comprises a reference address of a video source, and the video source is selected from a video source list provided by a graphical user interface of a corresponding external application;
and monitoring a video loading and playing event of the second application to control the playing of the video data pointed by the reference address loaded by the second application.
5. The method of claim 1, wherein the step of listening for a resource push event of the second application to establish a remote communication link with a playback terminal to which the resource push event is directed to control playback of the screen-cast resource information in the playback terminal by the digital media controller module comprises the steps performed by the second application of:
responding to a resource pushing instruction, displaying a network receiver list in a current video playing page, wherein one or more playing terminals establishing a remote communication link with the second application are displayed in the list;
responding to a pushing instruction acting on one or more playing terminals in the network receiver list, and pushing the screen projection resource information to each playing terminal through the remote communication link;
And displaying a play control page, wherein the video play page of each selected play terminal is displayed in a list manner in the page so as to intensively control the play of the screen throwing resource information in each play terminal.
6. The method of claim 5, further comprising the steps of, after said controlling the playing of said on-screen resource information in the playing terminal:
displaying a screen-throwing control page, wherein one or more video playing pages of a second application for receiving the screen-throwing resource information are displayed in the page;
and responding to a control instruction acting on any video playing page in the screen-throwing control interface, and controlling the playing of screen-throwing resource information in a second application corresponding to the video playing page.
7. The method of claim 5, further comprising the steps of, after said controlling the playing of said on-screen resource information in the playing terminal:
displaying a remote control page, wherein the remote control page displays one or more play control pages of a second application for receiving the screen-throwing resource information;
responding to a selected instruction acting on any play control page in the remote control page, and outputting the play control page in a full screen mode;
And responding to a control instruction acting on any play terminal in the play control page, and controlling the play of the screen throwing resource information in the play terminal.
8. The utility model provides a throw screen broadcast controlling means which characterized in that, it includes:
the system comprises a screen throwing resource list display module, a screen throwing resource list display module and a display module, wherein the screen throwing resource list is used for displaying a screen throwing resource list, the screen throwing resource list comprises a plurality of video summaries, the video summaries are created according to screen throwing resource information, the screen throwing resource information is historical information generated by a digital media server module of an external application program in local equipment through screen throwing of the application through a screen throwing communication link, the application can render video data of the screen throwing resource information to the digital media player module through the digital media renderer module to play, and the application and the external application program are provided with a digital media controller module for controlling the video data played by the application;
the playing instruction response module is used for responding to a screen throwing instruction acting on any video abstract in the screen throwing resource list, displaying a screen throwing application list, wherein the screen throwing application list comprises a plurality of application abstracts, each application abstract points to a second application suitable for establishing the screen throwing communication link with the application, and the application, an external application program and the second application are respectively positioned in virtual equipment with different communication addresses;
The screen projection resource information pushing module is used for responding to a selected instruction of any one application abstract in the screen projection application list, establishing a screen projection communication link of a second application corresponding to the application abstract through the digital media server module, and pushing the screen projection resource information pointed by the video abstract to the second application for loading and playing, wherein the second application can render video data of the screen projection resource information to the digital media player module for playing through the digital media renderer module, and the second application and the application are provided with a digital media controller module for controlling the video data played by the second application;
and the pushing event monitoring module is used for monitoring the resource pushing event of the second application so as to establish a remote communication link with the playing terminal pointed by the resource pushing event, and the playing of the screen throwing resource information in the playing terminal is controlled through the digital media controller module.
9. An electronic device comprising a central processor and a memory, characterized in that the central processor is adapted to invoke a computer program stored in the memory for performing the steps of the method according to any of claims 1 to 7.
10. A non-volatile storage medium, characterized in that it stores in the form of computer readable instructions a computer program implemented according to the method of any one of claims 1 to 7, which when invoked by a computer, performs the steps comprised by the method.
CN202111017131.7A 2021-08-31 2021-08-31 Screen throwing play control method and device, equipment and medium thereof Active CN113727180B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111017131.7A CN113727180B (en) 2021-08-31 2021-08-31 Screen throwing play control method and device, equipment and medium thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111017131.7A CN113727180B (en) 2021-08-31 2021-08-31 Screen throwing play control method and device, equipment and medium thereof

Publications (2)

Publication Number Publication Date
CN113727180A CN113727180A (en) 2021-11-30
CN113727180B true CN113727180B (en) 2024-01-19

Family

ID=78680209

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111017131.7A Active CN113727180B (en) 2021-08-31 2021-08-31 Screen throwing play control method and device, equipment and medium thereof

Country Status (1)

Country Link
CN (1) CN113727180B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114401429B (en) * 2022-01-14 2024-02-27 烽火通信科技股份有限公司 Remote screen projection method and electronic equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105338406A (en) * 2014-08-04 2016-02-17 阿里巴巴集团控股有限公司 Television switching method and device
CN110519628A (en) * 2019-09-20 2019-11-29 青岛海信移动通信技术股份有限公司 A kind of picture-in-picture display methods and display equipment
CN111736785A (en) * 2020-05-29 2020-10-02 北京百度网讯科技有限公司 Control method, device and equipment for screen projection playing and computer storage medium
CN112738620A (en) * 2020-12-23 2021-04-30 深圳乐播科技有限公司 Media resource screen projection method, equipment and system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6381187B2 (en) * 2013-08-09 2018-08-29 キヤノン株式会社 Information processing apparatus, information processing method, and program

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105338406A (en) * 2014-08-04 2016-02-17 阿里巴巴集团控股有限公司 Television switching method and device
CN110519628A (en) * 2019-09-20 2019-11-29 青岛海信移动通信技术股份有限公司 A kind of picture-in-picture display methods and display equipment
CN111736785A (en) * 2020-05-29 2020-10-02 北京百度网讯科技有限公司 Control method, device and equipment for screen projection playing and computer storage medium
CN112738620A (en) * 2020-12-23 2021-04-30 深圳乐播科技有限公司 Media resource screen projection method, equipment and system

Also Published As

Publication number Publication date
CN113727180A (en) 2021-11-30

Similar Documents

Publication Publication Date Title
US11800165B2 (en) Virtual live streaming method and apparatus, device and storage medium
US20230267143A1 (en) Searching and displaying multimedia search results
CN113727178B (en) Screen-throwing resource control method and device, equipment and medium thereof
CN110557674A (en) Intelligent screen projection playing and transmitting method and device
CN105323628B (en) Cross-screen playing method and system based on DLNA (digital Living network alliance), browser end device and playing device
CN114422460B (en) Method and system for establishing same-screen communication sharing in instant communication application
CN114189729A (en) Data relay playing method and intelligent device
CN106897077A (en) Application control method
CN113794928B (en) Audio playing method and display device
CN113727180B (en) Screen throwing play control method and device, equipment and medium thereof
CN113573083A (en) Live wheat-connecting interaction method and device and computer equipment
CN113613027A (en) Live broadcast room recommendation method and device and computer equipment
CN113596504A (en) Live broadcast room virtual gift presenting method and device and computer equipment
CN113824979A (en) Live broadcast room recommendation method and device and computer equipment
CN113727177B (en) Screen-throwing resource playing method and device, equipment and medium thereof
CN114205366A (en) Cross-platform data synchronization method and device, equipment, medium and product thereof
CN114222190B (en) Remote control processing and response method and device, equipment, medium and product thereof
CN113556610B (en) Video synthesis control method and device, equipment and medium thereof
CN114302163B (en) Live broadcasting room advertisement processing method and device, equipment and medium thereof
CN114915810B (en) Media resource pushing method and intelligent terminal
CN114116278A (en) Live broadcast fault detection processing method and device, equipment, medium and product thereof
CN108289226B (en) Method, server and system for showing digital movie video data
CN113727133B (en) Live broadcast control method and device, equipment and medium thereof
CN113596495A (en) Live broadcast stream pushing processing method and device, equipment and medium thereof
CN111314462A (en) Resource processing method, device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant