CN113727180A

CN113727180A - Screen projection playing control method and device, equipment and medium thereof

Info

Publication number: CN113727180A
Application number: CN202111017131.7A
Authority: CN
Inventors: 曾衍
Original assignee: Guangzhou Cubesili Information Technology Co Ltd
Current assignee: Guangzhou Cubesili Information Technology Co Ltd
Priority date: 2021-08-31
Filing date: 2021-08-31
Publication date: 2021-11-30
Anticipated expiration: 2041-08-31
Also published as: CN113727180B

Abstract

The application discloses a screen projection playing control method, a device, equipment and a medium thereof, wherein the method comprises the following steps: displaying a screen-casting resource list, wherein the list comprises a plurality of video abstracts, and the video abstracts are created according to screen-casting resource information; responding to a screen-casting instruction acting on any video abstract in the screen-casting resource list, and displaying a screen-casting application list, wherein the list comprises a plurality of application abstracts, and the application abstracts respectively point to second applications which are suitable for establishing screen-casting communication links with the applications; responding to a selected instruction of any application abstract in the screen-casting application list, establishing a screen-casting communication link of a second application corresponding to the application abstract, and pushing screen-casting resource information pointed by the video abstract to the second application for loading and playing; and monitoring a resource pushing event of the second application to establish a remote communication link with the playing terminal pointed by the resource pushing event. The method and the device realize the synchronous control of the playing of the screen-projected videos in the local area network and the wide area network, and break through the limitation of the screen-projected protocol.

Description

Screen projection playing control method and device, equipment and medium thereof

Technical Field

The present application relates to the field of screen projection technologies, and in particular, to a screen projection play control method, and further, to an apparatus, a device, and a non-volatile storage medium corresponding to the method.

Background

The existing screen projection playing is generally realized by means of a WeChat screen projection technology such as DLNA (digital Living network alliance), a screen projection output party in terminal equipment can push video data to a playing application in other terminal equipment for playing in a screen projection mode, the function of projecting the video data of one equipment to a screen of another equipment for playing is realized, the video playing effect is improved, the screen projection output party can control the playing of screen projection videos in a receiving party, the screen projection technology is applied to public places such as markets, the advertisement videos are projected to a larger playing terminal for playing, the advertisement effect of the advertisement videos is improved, and customers are attracted to consume in the front.

However, because the screen projection technology is only limited in the local area network, long-distance screen projection playing and control cannot be realized, when the area of public places such as shopping malls is large, and because the data transmission distance of the local area network is short, a merchant cannot realize the output playing of advertisement videos by the screen projection technology when the advertisement videos are projected to a large number of playing terminals in the shopping malls, and cannot control the playing of the advertisement videos in each playing terminal in a centralized manner, obviously, the screen projection technology can only realize the cross-device screen projection sharing of the video content of the data media in the local area network, and is often unable to do the best for screen projection scenes with large transmission distances.

In view of the limitations of various existing screen projection technologies in terms of transmission distance, the applicant has made a corresponding search for this purpose.

Disclosure of Invention

The present application is directed to a method for controlling a screen-projection playing, and a corresponding apparatus, an electronic device, and a non-volatile storage medium, which meet the needs of the prior art or overcome at least some of the disadvantages of the prior art.

In order to realize the purpose of the application, the following technical scheme is adopted:

one of the objectives of the present application is to provide a screen-casting playing control method, which includes the following steps: displaying a screen-casting resource list, wherein the screen-casting resource list comprises a plurality of video abstracts, the video abstracts are created according to screen-casting resource information, and the screen-casting resource information is historical information generated by screen casting of an external application program to the application through a screen-casting communication link in the local equipment;

responding to a screen-casting instruction acting on any video abstract in the screen-casting resource list, and displaying a screen-casting application list, wherein the screen-casting application list comprises a plurality of application abstracts, and each application abstract points to a second application suitable for establishing a screen-casting communication link with the application;

responding to a selected instruction of any application abstract in the screen-casting application list, establishing a screen-casting communication link of a second application corresponding to the application abstract and the application abstract, and pushing screen-casting resource information pointed by the video abstract to the second application for loading and playing;

and monitoring the resource pushing event of the second application to establish a remote communication link with a playing terminal pointed by the resource pushing event so as to control the playing of the screen-projecting resource information in the playing terminal.

In a further embodiment, before the displaying the screen-shot resource list, the method further comprises the following steps:

establishing a screen projection communication link with an external application program in the local equipment;

receiving screen projection resource information sent by an external application program through the screen projection communication link, and taking the screen projection resource information as historical information of the external application program;

and creating a corresponding video abstract according to the screen projection resource information, and storing the video abstract into the screen projection resource list for displaying.

In a preferred embodiment, the step of establishing a screen-projected communication link with an external application in the native device comprises:

receiving a multicast message broadcasted by an external application according to a preset protocol specification and used for searching a first application including the application and suitable for establishing the screen-casting communication link;

responding to the multicast message and feeding back equipment information pre-configured by the first application to an external application in a unicast mode, wherein the equipment information comprises communication configuration information;

and the application and the external application establish a screen projection communication link according to the communication configuration information to realize binding.

In a further embodiment, in response to a selected instruction of any one application abstract in the screen-casting application list, a screen-casting communication link of a second application corresponding to the application abstract of the application is established, and screen-casting resource information pointed by the video abstract is pushed to the second application for loading and playing, including:

pushing the screen projection resource information to the second application through the screen projection communication link, wherein the screen projection resource information comprises a reference address of a video source, and the video source is selected from a video source list provided by a graphical user interface of a corresponding external application;

and monitoring a video loading and playing event of the second application to control the playing of the video data pointed by the reference address loaded by the second application.

In a further embodiment, the step of monitoring the screen-projected device event of the second application to establish a remote communication link with the external device to which the same device event is directed, so as to control the playing of the screen-projected resource in the external device includes the following steps executed by the second application:

responding to a resource pushing instruction, displaying a network receiver list in a current video playing page, and displaying one or more playing terminals establishing a remote communication link with the second application in the list;

responding to a push instruction acting on one or more play terminals in the network receiver list, and pushing the screen-throwing resource information to each play terminal through the remote communication link;

and displaying a playing control page, wherein the video playing pages of the selected playing terminals are listed and displayed in the page so as to intensively control the playing of the screen-projecting resource information in the playing terminals.

In a further embodiment, after the controlling the playing of the screen-casting resource information in the playing terminal, the method further includes the following steps:

displaying a screen projection control page, wherein one or more video playing pages of a second application receiving the screen projection resource information are displayed in the page;

and responding to a control instruction acting on any one video playing page in the screen projection control interface, and controlling the playing of the screen projection resource information in the second application corresponding to the video playing page.

In a preferred embodiment, after the controlling the playing of the screen-shot resource information in the playing terminal, the method further includes the following steps:

displaying a remote control page, wherein the play control page of one or more second applications for receiving the screen-casting resource information is displayed in the remote control page;

responding to a selected instruction acting on any one play control page in the remote control interface, and outputting the play control page in a full screen mode;

and responding to a control instruction acting on any one playing terminal in the playing control page, and controlling the playing of the screen-projecting resource information in the playing terminal.

A screen projection playing control device adapted to the purpose of the present application, comprising:

the screen-casting resource list display module is used for displaying a screen-casting resource list, the screen-casting resource list comprises a plurality of video abstracts, the video abstracts are created according to screen-casting resource information, and the screen-casting resource information is historical information generated by screen casting of an external application program to the application through a screen-casting communication link in the local equipment;

the display instruction response module is used for responding to a screen projection instruction acting on any video abstract in the screen projection resource list and displaying a screen projection application list, wherein the screen projection application list comprises a plurality of application abstracts, and each application abstract points to a second application suitable for establishing the screen projection communication link with the application;

the screen-casting resource information pushing module is used for responding to a selected instruction of any application abstract in the screen-casting application list, establishing a screen-casting communication link of a second application corresponding to the application abstract and the application abstract, and pushing screen-casting resource information pointed by the video abstract to the second application for loading and playing;

and the push event monitoring module is used for monitoring the resource push event of the second application so as to establish a remote communication link with the play terminal pointed by the resource push event and control the play of the screen-projecting resource information in the play terminal.

In a further embodiment, the screen projection resource information pushing module includes:

the information pushing submodule is used for pushing the screen projection resource information to the second application through the screen projection communication link, the screen projection resource information comprises a reference address of a video source, and the video source is selected from a video source list provided by a graphical user interface of the corresponding external application;

and the loading and playing event monitoring submodule is used for monitoring the video loading and playing event of the second application so as to control the playing of the video data pointed by the reference address loaded by the second application.

In a further embodiment, the push event listening module includes:

the resource pushing instruction response submodule is used for responding to a resource pushing instruction, displaying a network receiver list in a current video playing page, and displaying one or more playing terminals establishing a remote communication link with the second application in the list;

the push instruction submodule is used for responding to a push instruction acting on one or more play terminals in the network receiver list and pushing the screen-throwing resource information to each play terminal through the remote communication link;

and the playing control page display submodule is used for displaying the playing control page, and the video playing pages of the selected playing terminals are displayed in a row in the page so as to intensively control the playing of the screen-projecting resource information in the playing terminals.

The electronic device comprises a central processing unit and a memory, wherein the central processing unit is used for calling and running a computer program stored in the memory to execute the steps of the screen projection playing control method.

The non-volatile storage medium stores a computer program implemented according to the screen-casting playing control method, and when the computer program is called by a computer and is run, the computer program executes the steps included in the corresponding method.

Compared with the prior art, the application has the following advantages:

firstly, the application breaks through the limitation of the screen projection technology, the screen projection technology is applied to a wide area network, screen projection data in the local area network are sent to a playing terminal in the wide area network in a wide area network mode to be projected and played, so that a user can control the playing of screen projection videos in playing applications in the local area network through a control terminal and synchronously control the playing of screen projection videos in the playing terminal arranged in the wide area network, and each playing application in the local area network can also control the playing of screen projection videos in the playing terminal in the wide area network.

Secondly, according to the method and the device, screen-casting resources delivered by screens of all applications in the device are recorded and stored, corresponding video summaries are created for the screen-casting resources and loaded into a video play list to be output and displayed, the video resources of the video play applications are enriched, a user can select different screen-casting resources from the applications to carry out screen-casting pushing of a wide area network, and the screen-casting resources delivered by different applications are managed in a centralized mode.

In addition, the video screen projection function among different applications in the same equipment is realized, cross-application video data sharing is realized in a screen projection mode, further, cross-application video data sharing operation is simplified, corresponding video data are obtained from other applications for loading and playing by the applications in the same equipment through a screen projection communication link, the situation that sharing cannot be realized due to the fact that an application program providing a video source does not support downloading is prevented, the applications on the side of obtaining the video data can play the video data which cannot be obtained from a network or a storage space of the equipment, and video resources of the applications are enriched.

Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.

Drawings

The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

fig. 1 is a schematic diagram of a typical network deployment architecture related to implementing the technical solution of the present application;

fig. 2 is a schematic flowchart of an exemplary embodiment of a screen projection play control method according to the present application;

FIG. 3 is a schematic diagram of a list of screen shot resources of the present application in a graphical user interface;

FIG. 4 is a schematic diagram of a video source list for an external application in a graphical user interface according to the present application;

FIG. 5 is a schematic diagram of a list of screen shot applications of the present application in a graphical user interface;

FIG. 6 is a flowchart illustrating specific steps of step S13 in FIG. 2;

FIG. 7 is a flowchart illustrating specific steps of step S14 in FIG. 2;

fig. 8 is a schematic diagram illustrating switching between graphical user interfaces of a second application in an implementation process of the second application when the second application performs the resource pushing event according to the present application;

fig. 9 is a schematic flowchart of an embodiment of a screen projection playing control method according to the present application, in which a preceding step is added;

fig. 10 is a schematic product architecture diagram of the present application and an external application in a case where a screen projection communication link of the present application conforms to a communication specification of a DLNA protocol;

FIG. 11 is a flowchart illustrating specific steps of step S08 in FIG. 9;

fig. 12 is a schematic flowchart of an embodiment of a screen projection playing control method according to the present application, in which a post step is added;

fig. 13 is a schematic diagram of a graphical user interface of the application when the application performs playback control of screen projection resource information of a second application through a screen projection control page;

fig. 14 is a schematic flowchart of another embodiment of a screen projection playing control method according to the present application, in which a post step is added;

fig. 15 is a schematic diagram of a graphical user interface of the application when the application performs playback control of screen projection resource information of the playback terminal through a remote control page;

FIG. 16 is a functional block diagram of an exemplary embodiment of a screen projection play control apparatus of the present application;

fig. 17 is a block diagram of a basic structure of a computer device according to an embodiment of the present application.

Detailed Description

Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.

As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.

It will be understood by those within the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

As will be appreciated by those skilled in the art, "client," "terminal," and "terminal device" as used herein include both devices that are wireless signal receivers, which are devices having only wireless signal receivers without transmit capability, and devices that are receive and transmit hardware, which have receive and transmit hardware capable of two-way communication over a two-way communication link. Such a device may include: cellular or other communication devices such as personal computers, tablets, etc. having single or multi-line displays or cellular or other communication devices without multi-line displays; PCS (Personal Communications Service), which may combine voice, data processing, facsimile and/or data communication capabilities; a PDA (Personal Digital Assistant), which may include a radio frequency receiver, a pager, internet/intranet access, a web browser, a notepad, a calendar and/or a GPS (Global Positioning System) receiver; a conventional laptop and/or palmtop computer or other device having and/or including a radio frequency receiver. As used herein, a "client," "terminal device" can be portable, transportable, installed in a vehicle (aeronautical, maritime, and/or land-based), or situated and/or configured to operate locally and/or in a distributed fashion at any other location(s) on earth and/or in space. The "client", "terminal Device" used herein may also be a communication terminal, a web terminal, a music/video playing terminal, such as a PDA, an MID (Mobile Internet Device) and/or a Mobile phone with music/video playing function, and may also be a smart tv, a set-top box, and the like.

The hardware referred to by the names "server", "client", "service node", etc. is essentially an electronic device with the performance of a personal computer, and is a hardware device having necessary components disclosed by the von neumann principle such as a central processing unit (including an arithmetic unit and a controller), a memory, an input device, an output device, etc., a computer program is stored in the memory, and the central processing unit calls a program stored in an external memory into the internal memory to run, executes instructions in the program, and interacts with the input and output devices, thereby completing a specific function.

It should be noted that the concept of "server" as referred to in this application can be extended to the case of a server cluster. According to the network deployment principle understood by those skilled in the art, the servers should be logically divided, and in physical space, the servers may be independent from each other but can be called through an interface, or may be integrated into one physical computer or a set of computer clusters. Those skilled in the art will appreciate this variation and should not be so limited as to restrict the implementation of the network deployment of the present application.

Referring to fig. 1, the hardware basis required for implementing the related art embodiments of the present application may be deployed according to the architecture shown in the figure. The current application (the present application) distributes the screen-casting resource information (local area network) received by the application communication in the same device to the second application establishing a screen-casting communication link with the current application, and each second application distributes the screen-casting resource information to the playing terminal through the remote communication link (wide area network), so that the current application controls the playing of the screen-casting resource information in the second application through the screen-casting communication link, and controls the playing of the screen-casting resource information in the playing terminal through the remote communication link relayed by the second application, and accordingly, the second application can control the playing of the screen-casting resource information in the playing terminal through the remote communication link.

The application (application program) refers to an application program running on a server or a terminal device, and the application program implements the related technical scheme of the application in a programming mode, and a program code of the application program can be saved in a nonvolatile storage medium which can be identified by a computer in a form of computer executable instructions and called into a memory by a central processing unit to run, and the related device of the application is constructed by running the application program on the computer.

The technical scheme suitable for being implemented in the terminal device in the application can also be programmed and built in an application program providing live webcasting, and the technical scheme is used as a part of extended functions. The live webcast refers to a live webcast room network service realized based on the network deployment architecture.

The person skilled in the art will know this: although the various methods of the present application are described based on the same concept so as to be common to each other, they may be independently performed unless otherwise specified. In the same way, for each embodiment disclosed in the present application, it is proposed based on the same inventive concept, and therefore, concepts of the same expression and concepts of which expressions are different but are appropriately changed only for convenience should be equally understood.

Referring to fig. 2, a screen-projection playing control method according to the present application, in an exemplary embodiment, includes the following steps:

step S11, displaying a screen projection resource list, wherein the screen projection resource list comprises a plurality of video abstracts, the video abstracts are created according to screen projection resource information, and the screen projection resource information is historical information generated by screen projection of an external application program to the application through a screen projection communication link in the local equipment:

the screen-casting resource list is displayed in a graphical user interface of the application, a plurality of video abstracts are displayed in the screen-casting resource list, and each video abstract is created by screen-casting resource information pushed to the current application screen by the external application program of the local device.

The current application and the external application program are application programs running on the same-machine equipment, the current application and the external application program carry out the pushing of the screen-casting resource information by establishing the screen-casting communication link in the equipment, so that the current application creates a corresponding video abstract according to the screen-casting resource information and outputs the video abstract to the screen-casting resource list for displaying, compared with a common application program, video data playing pages of the current application are shared to other applications in a network link mode, other applications are enabled to jump to different video data playing pages through the link, after the current application acquires the screen-casting resource information, the current application can cast the screen-casting resource information to the second application for output playing, and the second application can push the screen-casting resource information to a playing terminal through a remote communication link for output playing, accordingly, the current application may participate in controlling the second application and the playing of the screen-projecting resource information of the playing terminal, for example, pausing video playing, starting video playing, or adjusting video playing progress.

Referring to fig. 3, a screen shot resource list 301 shown in fig. 3 is a display of the screen shot resource list in a currently applied graphical user interface, and displays a plurality of video summaries, each video summary being classified by an external application program to which the video summary belongs.

And under the condition that the external application program and the current application in the local equipment establish the screen projection communication link, the external application program can push the screen projection resource information to the current application through the screen projection communication link.

The screen-casting communication link generally refers to a data communication link conforming to a communication specification of a DLNA protocol, the current application and the second application serve as receivers of the screen-casting resource information, the current application and the second application are generally regarded as a dmp (digital Media player) in the DLNA protocol, the current application and the external application program serve as a pushing party of the screen-casting resource information, the current application and the external application program are generally regarded as a dms (digital Media server) in the DLNA protocol, and after the current application receives the screen-casting resource information pushed by the external application program through the screen-casting communication link, the screen-casting resource information serves as a history record of the external application program.

Regarding the implementation manner for establishing the screen-casting communication link between the current application program and the external application program in the local device, please refer to the related implementation manner in step S08, which is not repeated herein.

After each external application program of the local device pushes the screen-throwing resource information to the current application through the screen-throwing communication link, each screen-throwing resource information is stored by the current application as historical information so as to record the screen-throwing resource information pushed by each external application program in advance, and even if the screen-throwing communication link established between the current application and the external application is disconnected, each screen-throwing resource information can still be stored by the current application as the historical information.

The current application creates the corresponding video abstract for each screen-projecting resource information through the historical information, loads the video abstract into the screen-projecting resource list for output display, so that a user can select the screen-projecting resource information pointed by the corresponding video abstract through the screen-projecting resource list, pushes the screen-projecting resource information to a second application for output play, and correspondingly, the second application can push the screen-projecting resource information to a play terminal through a remote communication link for output play.

The video abstract generally refers to image-text information of a video source pointed by the video resource information, and the image-text information generally refers to data encapsulated into the screen projection resource information by the external application program, so that the current application creates the video abstract corresponding to the video resource information according to the image-text information included in the video resource information, and loads the video abstract into the screen projection resource list for output and display, and a user can conveniently determine the video source pointed by the video resource information through the video abstract.

The current application can receive screen-casting resource information sent by a plurality of external application programs in the local equipment through screen casting of the screen-casting communication link, so that the screen-casting resource information is used as historical information to be stored and recorded, corresponding video abstracts are created according to the screen-casting resource information and are output to the screen-casting resource list to be output and displayed, and therefore a user can select the video resource information which is pre-cast to the current application by each external application program through the screen-casting resource list and output and play the selected video resource information through a screen-casting protocol.

Referring to fig. 3 and 4, regarding the process of pushing the screen-shot resource information by the external application of the native device through the screen-shot communication link, fig. 4 is a graphical user interface of an external application a in the native device, a video source list 401 shows video sources included in the external application a, by touching the control of the screen-casting push 402, the selected video source A is used as screen-casting resource information to be screen-cast and pushed to the current application program, the video summary information includes video source a summary picture 403 and video source a summary name 404, so that the current application creates a corresponding video summary for the screen-casting resource information of video source a through the video source a summary picture 403 and the video source a summary name 404, as shown in fig. 3, the video a summary picture 304 is a video source a summary picture 403, and the video a summary name 305 is a video source a summary name 404.

Step S12, responding to a screen-casting instruction acting on any video abstract in the screen-casting resource list, displaying a screen-casting application list, wherein the screen-casting application list comprises a plurality of application abstracts, and each application abstract points to a second application suitable for establishing the screen-casting communication link with the application:

the current application responds to the screen-casting instruction acting on any one video abstract in the screen-casting resource list so as to display the screen-casting application list in a current graphical user interface, wherein the screen-casting application list comprises a plurality of application abstracts, and each application abstract is used for representing the second application suitable for establishing the screen-casting communication link with the current application.

The screen-casting application list displays a plurality of application abstracts of second applications suitable for establishing the screen-casting communication link with the current application, so that a user can select the corresponding second applications through the screen-casting application list to establish the screen-casting communication link so as to push screen-casting resource information selected from the screen-casting abstract list to the second applications, and after the second applications receive the screen-casting resource information, the screen-casting resource information can be loaded to be played and output, or the screen-casting resource information is pushed to the corresponding playing terminals through a remote communication link to be played.

The application abstract in the screen-casting application list is created by the current application according to the second application searched under the same local area network, the current application broadcasts the multicast message to the applications and equipment under the same local area network according to the preset protocol specification, the second application suitable for establishing the screen-casting communication link with the current application is searched, and the application abstract is created for each second application and is loaded into the screen-casting application list for displaying.

The current application generally broadcasts the multicast packet via the UDP user data protocol, which provides a method for an application program to send an encapsulated IP packet without establishing a connection, so that the second application can push the multicast packet to the first application without establishing the screen-casting communication link.

Referring to fig. 5, a screen-casting application list 501 in fig. 5 is a screen-casting application list described in the present application, and a plurality of application summaries of the second applications are displayed in the screen-casting application list 501, so that a user selects a corresponding second application through the list to establish the screen-casting communication link, and push the screen-casting resource information.

Referring to fig. 3 and 5, a user selects screen-casting resource information of a video a abstract to perform screen-casting pushing by touching a screen-casting 303 control in a screen-casting resource list 301 of a graphical user interface of a current application, and the graphical user interface of the current application displays a screen-casting application list 501 of fig. 5, so that the current user selects a corresponding application abstract through the screen-casting application list 501 as a second application establishing the screen-casting communication link with the current application to perform screen-casting pushing of the screen-casting resource information of the video a abstract.

Step S13, responding to a selected instruction of any one application abstract in the screen-casting application list, establishing a screen-casting communication link between the application and a second application corresponding to the application abstract, and pushing screen-casting resource information pointed by the video abstract to the second application for loading and playing:

and responding to a selected instruction which acts on any one application abstract in the screen-casting application list by the current application to establish the screen-casting communication link with a second application pointed by the selected instruction so as to push the selected screen-casting resource information in the screen-casting resource list to the second application for loading and playing.

Referring to fig. 3 and 5, the user touches the screen projection 502 control through the screen projection application list 501 displayed in the graphical user interface of the current application to select the B application as the second application establishing the screen projection communication link with the current application, and pushes the screen projection resource information selected from the screen projection resource list 301 of fig. 3 into the B application for loading and playing.

And after the current application responds to the selected instruction, determining the second application pointed by the selected instruction, analyzing the device information fed back by the second application in a unicast mode in advance, acquiring the communication configuration information contained in the device information, performing corresponding configuration according to the communication configuration information, and establishing the screen-projecting communication link with the second application.

The configuration information refers to information of the second application, which is used for establishing the screen-casting communication link with other applications, the device information includes the communication configuration information, the communication configuration information includes an ip address and an upnp service port of the second application, and after the current application receives the configuration information, the screen-casting communication link is established with the second application according to the communication configuration information included in the configuration information.

After the current application and a second application pointed by the selected instruction complete establishment of the screen projecting communication link, screen projecting resource information selected in the screen projecting resource list is pushed to the second application through the screen projecting communication link, so that the second application can load the screen projecting resource information to a player built in the second application for output and play.

The screen projection resource information generally refers to a reference address or a local cache path for acquiring video data, and after the second application acquires the screen projection resource information, the video data pointed by the video data is acquired through the reference address or the local cache path included in the screen projection resource information.

The video data generally refers to video data acquired by the external application from a network or a local place, the video data can be loaded and played by the external application and the second application, and the current application and the second application can control the playing of the video data, for example, operations such as pausing the playing, starting the playing, adjusting the playing progress, adjusting the playing volume, and the like.

Referring to fig. 6, regarding the implementation manner in which the current application pushes the screen-projected resource information and the second application loads the screen-projected resource information for playing and outputting, the specific steps are as follows:

step S131, screen-casting resource information is pushed to the second application through the screen-casting communication link, the screen-casting resource information includes a reference address of a video source, and the video source is selected from a video source list provided by a graphical user interface of a corresponding external application:

after the current application and the second application complete the establishment of the screen projecting communication link, the screen projecting resource information including the reference address of the video source is pushed to the second application through the screen projecting communication link.

And the second application receives the screen projection resource information sent by the current application through the screen projection communication link, and loads the video source selected by the corresponding external application through the video source list provided in the graphical user interface of the external application according to the reference address of the video source included in the screen projection resource information.

The reference address generally refers to a URL, and after the second application acquires the reference address, the second application may acquire video data pointed by the URL from a media server pointed by the reference address (URL) to load and play the video data.

After the second application acquires the reference address, it calls its own built-in player to load and play the video data pointed by the reference address, specifically, the second application establishes a connection with the media server pointed by the reference address through the reference address to acquire the video data pointed by the reference address from the media server, and loads the video data into the built-in player to play.

Step S132, monitoring a video loading and playing event of the second application to control playing of the video data pointed by the reference address loaded by the second application:

the current application monitors whether the second application finishes the video loading and playing event after the loading and playing of the video data pointed by the reference address are finished, and after the second application finishes, the current application can push a corresponding control instruction to the second application to control the playing of the video data in the second application, for example, the playing of the video data is paused, the playing progress of the video data is adjusted, the playing of the video data is ended, and the like.

Step S14, monitoring the resource pushing event of the second application to establish a remote communication link with the playback terminal to which the resource pushing event points, so as to control the playback of the screen-projected resource information in the playback terminal:

and the current application monitors the resource pushing event of the second application, and establishes the remote communication link with a playing terminal pointed by the resource pushing event so as to control the playing of the screen-projecting resource information in the playing terminal.

The resource pushing event refers to an event that the second application pushes the screen-casting resource information acquired from the current application to a corresponding playing terminal for output playing through the remote communication link, and after monitoring that the second application completes the resource pushing event, the current application establishes the remote communication link with the playing terminal that receives the screen-casting resource information from the resource pushing event and outputs playing so as to control the playing of the screen-casting resource information in the playing terminal, for example, the playing progress of the screen-casting resource information in the playing terminal is adjusted, the playing of the screen-casting resource information in the playing terminal is paused or the playing of the screen-casting resource information in the playing terminal is cancelled.

The remote communication link is a data communication link in a wide area network, so that a second application can push corresponding screen projection resource information to the playing terminal through the remote communication link, control the playing of the screen projection resource information in the playing terminal, and conveniently control the playing of the screen projection resource information in the playing terminal which receives the screen projection resource information pushed by the second application through the remote communication link, compared with the playing mode of the video existing in the general remote control playing terminal, the video played by the playing terminal is obtained from a corresponding server in the way of the wide area network by combining the wide area network and a local area network, and the second application is controlled by the current application in the way of the local area network, and meanwhile, the second application and the playing terminal are connected through the second application, so that the second application is used as a relay of the current application and the playing application in the remote communication link of the wide area network, the current application pushes a corresponding control instruction to the second application in a screen projection mode through the local area network so that the second application can carry out relay, the control instruction is pushed to the corresponding playing terminal through the remote communication link to carry out video playing control, and the video playing in the playing terminal is controlled by the current application.

For the implementation mode that the current application controls the playing of the video in the playing terminal through the remote communication link, please refer to the post-step corresponding to the present application, which is not repeated herein.

Referring to fig. 7, the specific steps of the implementation of the resource pushing event performed by the second application are as follows:

step S141, responding to the resource pushing instruction, displaying a network receiver list in the current video playing page, where one or more playing terminals establishing a remote communication link with the second application are displayed in the list:

and the second application responds to the resource pushing instruction in a video playing page for playing the screen-casting resource information so as to display the network receiver list in the video playing page, and one or more playing terminals establishing the remote communication link with the second application are displayed in the list.

Referring to fig. 8, fig. a is the video playing page of the second application, the screen-casting resource information is played and output in a screen-casting resource information playing window a-802 in the page, and a user touches a screen-casting resource information pushing control a-801 in the video playing page to generate the resource pushing instruction, so that the second application responds to the resource pushing instruction, displays a network receiver list B-801 in fig. B in the current video page, and displays a plurality of playing terminals that establish the remote pre-link with the second application.

Step S142, responding to a push instruction acting on one or more of the plurality of broadcast terminals in the network receiver list, pushing the screen-casting resource information to each broadcast terminal through the remote communication link:

and the second application responds to a push instruction acting on one or more playing terminals in the network receiver list and sends screen projection resource information played in the video playing page to the playing terminals corresponding to the push instructions for generating and playing through the remote communication link.

Referring to fig. 8, a user selects a corresponding playing terminal as a receiving party of the screen-casting resource information by touching a corresponding selected B-802 control through a network receiving party list B-801 in fig. B, and touches and pushes a screen-casting resource information control B-803 to generate a push instruction corresponding to each selected playing terminal, so that the second application responds to each push instruction, and pushes the screen-casting resource information to the playing terminal corresponding to each push instruction through the remote communication link for output playing.

Step S143, displaying a play control page, in which the video play pages of the selected play terminals are listed and displayed, so as to collectively control the play of the screen-casting resource information in each play terminal:

and after the second application pushes the screen-casting resource information to the playing terminals corresponding to the pushing instructions, displaying the playing control page, wherein the video playing page of each playing terminal is displayed in the page, so that a user can control each playing terminal to play the screen-casting resource information through the playing control page.

Referring to fig. 8, after the second application finishes pushing the screen-casting resource information, the playback control page shown in fig. C is displayed, and a plurality of video playback pages of the playback terminals that receive the screen-casting resource information for playback are displayed in the playback control page, so that the user centrally manages the playback of the screen-casting resource information in each of the playback terminals through the playback control page.

The above exemplary embodiments and variations thereof fully disclose the embodiments of the present application's on-screen-projection-playback control method, but many variations of the method can be deduced by transforming and augmenting some technical means, and other embodiments are summarized as follows:

in an embodiment, referring to fig. 9, before the displaying the list of screen resources, the method further includes the following steps:

step S08, establishing a screen-projection communication link with an external application in the local device:

the current application establishes the screen-casting communication link with the external application running in the peer device.

Referring to fig. 10, the screen-casting communication link is generally a screen-casting communication link conforming to the communication specification of the DLNA protocol, the external application 1001 has a DMS module (digital media server) through which the screen-casting resource information is pushed to the current application 902 through the screen-casting communication link conforming to the DLNA protocol by configuring the current application 1002 and the external application 1001 as virtual devices respectively located at different communication addresses from each other, and the external application 1001 has a DMC module (digital media server) capable of controlling the playback of the video data acquired according to the screen-casting resource information in the current application; the current application 902 has a DMP module (digital media player) that has functions of a DMC module and a DMR module (digital media renderer), and plays video data acquired according to the screen-casting resource information by rendering the video data through the DMP module, and controls the playing of the video data.

Correspondingly, the process of establishing the screen-casting communication link between the current application and the second application may also refer to the implementation manner of this step, where the current application serves as a provider of screen-casting resource information, and the second application serves as a receiver of the screen-casting resource information.

Referring to fig. 11, regarding an implementation of the current application program and the external application program establishing the screen-casting communication link, the specific steps are as follows:

step S081, receiving a multicast packet broadcasted by an external application according to a preset protocol specification for searching a first application including the application suitable for establishing the screen-casting communication link:

and the external application program broadcasts the multicast message to the application programs and equipment in the same local area network according to the preset protocol specification so as to search for the application appearance suitable for establishing the screen projection communication link with the external application program, and the current application program receives the multicast message so as to establish the screen projection communication link with the external application program.

The external application generally broadcasts the multicast packet via a UDP user data protocol, which provides a method for an application program to send an encapsulated IP packet without establishing a connection, so that the external application program can push the multicast packet to the current application program without establishing the screen-casting communication link.

And the external application program broadcasts the multicast message to the application programs and equipment in the same local area network according to the preset protocol specification so as to push the multicast message to the address and the port of the current application program, so that the current application program receives the multicast message and responds to establish the screen-casting communication link between the two parties.

Step S082, responding to the multicast message and feeding back the device information preconfigured by the first application to the external application unicast, where the device information includes communication configuration information:

and after receiving the multicast message, the current application program responds to the multicast message, acquires an address and a port contained in the multicast message, and feeds back equipment information which is pre-configured by the current application program and contains the communication configuration information to the external application program through the address and the port in a unicast mode.

The configuration information refers to information of a current application program used for establishing the screen-casting communication link with other applications, the device information comprises the communication configuration information, the communication configuration information comprises an ip address and an upnp service port of the current application program, and after the external application program receives the configuration information, the screen-casting communication link is established with the current application program according to the communication configuration information contained in the configuration information.

Step S083, the application and the external application establish a screen projection communication link according to the communication configuration information to realize binding:

and the external application program receives the equipment information fed back by the current application program unicast, and establishes the screen-projecting communication link with the current application program according to the communication configuration information contained in the equipment information so as to realize the mutual binding of the screen-projecting communication links of the two parties.

Step S09, receiving screen projection resource information delivered by the external application program through the screen projection communication link, and using the screen projection resource information as history information of the external application program:

after the screen projection communication link is established between the current application program and the external application program in the local device, the external application program can project screen projection resource information to the current application program through the screen projection communication link, so that the current application program takes the screen projection resource information as the historical information of the external application program.

The current application program stores the historical information of each external application program in the local equipment so as to record the screen projection resource information which is delivered by each external application program through screen projection in advance, and a user can select the screen projection resource information of each external application program through each historical information to output and play.

Step S10, creating a corresponding video abstract according to the screen projection resource information, and storing the video abstract into the screen projection resource list for displaying:

the current application program creates corresponding video resources for each screen projection resource information according to image-text information included in the screen projection resource information sent by each external application program through screen projection, and stores each video abstract into the screen projection resource list so as to output and display the video abstract corresponding to each video information when the screen projection resource list is loaded to the video playing page.

In an embodiment, referring to fig. 12, after the controlling the playing of the screen-casting resource information in the playing terminal, the method further includes the following steps:

step S15, displaying a screen projection control page, where one or more video playing pages of the second application that receive the screen projection resource information are displayed:

and displaying the screen-casting control page in a graphical user interface of the current application, wherein one or more video playing pages of a second application for receiving screen-casting resources sent by the current application through the screen-casting communication link are displayed in the screen-casting control page.

Referring to fig. 13, a screen projection control page is shown in fig. a, and a plurality of video playing pages of the second application that receives the screen projection resource information are displayed in the screen projection control page, so that a user can determine, in real time, a playing situation of each second application for playing the real-time screen projection resource information through the screen projection control page.

Step S16, responding to a control instruction acting on any one of the video playback pages in the screen-playing control interface, and controlling the playback of the screen-playing resource information in the second application corresponding to the video playback page:

the current application responds to a control instruction acting on any one video playing page in the screen-projecting control interface to control the playing of the screen-projecting resource information in the corresponding second application in the video playing page pointed by the control instruction, for example, the playing of the screen-projecting resource information in the second application is paused, the playing progress of the screen-projecting resource information is adjusted, or the second application is cancelled to play the screen-projecting resource information.

And after the current application responds to the control instruction, pushing a corresponding play control instruction to the second application through the screen-projecting communication link so as to control the play of the screen-projecting resource information in the second application.

Referring to fig. 13, the current application responds to a selected instruction acting on the video playback page of the second application a in the graph a to switch the screen-casting control page of the current application to the graphical user interface shown in the graph B, the video playback page of the second application a is displayed in the graphical user interface, and the control instruction used by each control to generate a response is provided to control the playback of the screen-casting resource information in the second application a, for example, by adjusting the video playback progress B-1301 control, controlling the playback progress of the screen-casting resource information in the second application a, or by touching the playback pause control B-1302, pausing the playback of the screen-casting resource information in the second application a.

In another embodiment, referring to fig. 14, after the controlling the playing of the screen-shot resource information in the playing terminal, the method further includes the following steps:

step S15', showing a remote control page, in which the play control page of one or more second applications that receive the screen-casting resource information is shown:

the current application displays the remote control page, and the play control page of one or more second applications receiving the screen-casting resource information, the play control page and the play control pages in steps S141 to S143 are displayed in the remote control page.

Referring to fig. 15, the graphical user interface shown in fig. a is a remote control page, where the remote control page shows a plurality of the playback control pages of the second application, so that a user can determine, through the remote control page, a playback condition of the screen-casting resource information in each playback terminal in each second application.

Step S16', in response to a selected instruction acting on any one of the playback control pages in the remote control interface, outputting the playback control page in full screen:

and responding to a selected instruction of a play control page of any one second application in the remote control interface by the current application, and outputting the play control page corresponding to the second application pointed by the selected instruction to the graphical user interface of the current application in a full screen mode for displaying.

Referring to fig. 15, in response to the selected instruction acting on the play control page a-1501 of the second application a in the remote control interface shown in fig. a, the current application program switches the graphical user interface of the current application from fig. a to the graphical user interface shown in fig. B, where the interface shown in fig. B is the play control page of the second application a, and a video play page of the play terminal is displayed in the play control page, where the play terminal loads and plays the screen-casting resource information pushed by the second application a through a plurality of remote communication links.

Step S17', in response to a control instruction acting on any one of the playback terminals in the playback control page, controlling playback of the screen-casting resource information in the playback terminal:

and responding to a control instruction of any one playing terminal in the playing control page applied to the selected instruction by the current application so as to control the playing of the screen-projecting resource information in the playing terminal corresponding to the control instruction.

After the current application responds to the control instruction, the control instruction is pushed to the second application through the screen-throwing communication link so as to trigger the second application to push the control instruction to a playing terminal corresponding to the control instruction through the remote communication link, so that the playing of the screen-throwing resource information in the playing terminal is controlled.

Referring to fig. 15, the current application response graph B acts on the video playing page B-1501 selection instruction of the playing terminal a to switch the playing control page of the second application a currently applied to the graphical user interface shown in the graph C, the video playing page of the playing terminal a is displayed in the graphical user interface, and the control instruction used by each control to generate a response is provided to control the playing of the screen-casting resource information in the playing terminal a, for example, the playing progress of the screen-casting resource information in the playing terminal a is controlled by adjusting the video playing progress C-1501 control, or the playing of the screen-casting resource information in the playing terminal a is paused by touching the pause playing C-1502 control.

Further, a screen-casting playing control device of the present application can be constructed by functionalizing the steps in the methods disclosed in the above embodiments, according to this idea, please refer to fig. 16, wherein in an exemplary embodiment, the device includes: the screen-casting resource list display module 11 is configured to display a screen-casting resource list, where the screen-casting resource list includes a plurality of video abstracts, the video abstracts are created according to screen-casting resource information, and the screen-casting resource information is history information generated by external applications in the local device by screen-casting to the local application through a screen-casting communication link; a play instruction response module 12, configured to respond to a screen-casting instruction acting on any one video abstract in the screen-casting resource list, and display a screen-casting application list, where the screen-casting application list includes multiple application abstracts, and each application abstract points to a second application that is suitable for establishing the screen-casting communication link with the application; the screen-casting resource information pushing module 13 is configured to respond to a selected instruction of any one application abstract in the screen-casting application list, establish a screen-casting communication link of a second application corresponding to the application abstract, and push screen-casting resource information pointed by the video abstract to the second application for loading and playing; a push event monitoring module 14, configured to monitor a resource push event of the second application, so as to establish a remote communication link with a play terminal pointed by the resource push event, so as to control playing of the screen-projected resource information in the play terminal.

In one embodiment, the screen-casting resource information pushing module 13 includes: the information pushing submodule is used for pushing the screen projection resource information to the second application through the screen projection communication link, the screen projection resource information comprises a reference address of a video source, and the video source is selected from a video source list provided by a graphical user interface of the corresponding external application; and the loading and playing event monitoring submodule is used for monitoring the video loading and playing event of the second application so as to control the playing of the video data pointed by the reference address loaded by the second application.

In one embodiment, the push event listening module 14 comprises: the resource pushing instruction response submodule is used for responding to a resource pushing instruction, displaying a network receiver list in a current video playing page, and displaying one or more playing terminals establishing a remote communication link with the second application in the list; the push instruction submodule is used for responding to a push instruction acting on one or more play terminals in the network receiver list and pushing the screen-throwing resource information to each play terminal through the remote communication link; and the playing control page display submodule is used for displaying the playing control page, and the video playing pages of the selected playing terminals are displayed in a row in the page so as to intensively control the playing of the screen-projecting resource information in the playing terminals.

In order to solve the above technical problem, an embodiment of the present application further provides a computer device, configured to run a computer program implemented according to the screen-casting play control method. Referring to fig. 17, fig. 17 is a block diagram of a basic structure of a computer device according to the present embodiment.

As shown in fig. 17, the internal structure of the computer device is schematically illustrated. The computer device includes a processor, a non-volatile storage medium, a memory, and a network interface connected by a system bus. The non-volatile storage medium of the computer device stores an operating system, a database and computer readable instructions, the database can store control information sequences, and the computer readable instructions can enable the processor to realize a screen projection playing control method when being executed by the processor. The processor of the computer device is used for providing calculation and control capability and supporting the operation of the whole computer device. The memory of the computer device may have computer readable instructions stored therein, which when executed by the processor, may cause the processor to perform a method for controlling on-screen playback. The network interface of the computer device is used for connecting and communicating with the terminal. Those skilled in the art will appreciate that the architecture shown in fig. 17 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

In this embodiment, the processor is configured to execute specific functions of each module/sub-module in the screen projection play control device of the present invention, and the memory stores program codes and various data required for executing the modules. The network interface is used for data transmission to and from a user terminal or a server. The memory in this embodiment stores program codes and data required for executing all modules/submodules in the screen projection play control device, and the server can call the program codes and data of the server to execute the functions of all the submodules.

The present application further provides a non-volatile storage medium, wherein the screen-casting playing control method is written as a computer program, and the computer program is stored in the storage medium in the form of computer readable instructions, and when the computer readable instructions are executed by one or more processors, the computer program is executed in a computer, so that the one or more processors execute the steps of the screen-casting playing control method according to any one of the above embodiments.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the computer program is executed. The storage medium may be a non-volatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a Random Access Memory (RAM).

In summary, the present application breaks through the limitation of the screen projection technology, applies the screen projection technology to the wide area network, and sends the screen projection data in the local area network to the playing terminal in the wide area network for screen projection playing in a manner of the wide area network, so that the user can control the playing of the screen projection video in each playing application in the local area network through the control terminal, and synchronously control the playing of the screen projection video in the playing terminal deployed in the wide area network, and each playing application in the local area network can also control the playing of the screen projection video in the playing terminal in the wide area network.

It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least a portion of the steps in the flow chart of the figure may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

Those of skill in the art will appreciate that the various operations, methods, steps in the processes, acts, or solutions discussed in this application can be interchanged, modified, combined, or eliminated. Further, other steps, measures, or schemes in various operations, methods, or flows that have been discussed in this application can be alternated, altered, rearranged, broken down, combined, or deleted. Further, steps, measures, schemes in the prior art having various operations, methods, procedures disclosed in the present application may also be alternated, modified, rearranged, decomposed, combined, or deleted.

The foregoing is only a partial embodiment of the present application, and it should be noted that, for those skilled in the art, several modifications and decorations can be made without departing from the principle of the present application, and these modifications and decorations should also be regarded as the protection scope of the present application.

Claims

1. A screen projection playing control method is characterized by comprising the following steps:

displaying a screen-casting resource list, wherein the screen-casting resource list comprises a plurality of video abstracts, the video abstracts are created according to screen-casting resource information, and the screen-casting resource information is historical information generated by screen casting of an external application program to the application through a screen-casting communication link in the local equipment;

2. The method of claim 1, further comprising, before the presenting the list of screen-cast resources, the steps of:

3. The method of claim 2, wherein the step of establishing a screen-cast communication link with an external application in the native device comprises:

4. The method of claim 1, wherein the step of establishing a screen-casting communication link of a second application corresponding to the application summary of the application in response to a selected instruction of any application summary in the screen-casting application list, and pushing screen-casting resource information pointed by the video summary to the second application for loading and playing comprises:

5. The method of claim 1, wherein the step of listening for a screen-projected device event of the second application to establish a remote communication link with the external device to which the same device event is directed to control the playing of the screen-projected resource in the external device comprises the steps performed by the second application of:

6. The method according to any one of claims 1 to 7, further comprising, after the step of controlling the playing of the screen-shot resource information in the playing terminal, the steps of:

7. The method according to claim 5, further comprising the following steps after the step of controlling the playing of the screen-shot resource information in the playing terminal:

8. A screen projection playing control device is characterized by comprising:

9. An electronic device comprising a central processor and a memory, wherein the central processor is configured to invoke execution of a computer program stored in the memory to perform the steps of the method according to any one of claims 1 to 7.

10. A non-volatile storage medium, characterized in that it stores, in the form of computer-readable instructions, a computer program implemented according to the method of any one of claims 1 to 7, which, when invoked by a computer, performs the steps comprised by the method.