CN113727177A

CN113727177A - Screen-projecting resource playing method and device, equipment and medium thereof

Info

Publication number: CN113727177A
Application number: CN202111015409.7A
Authority: CN
Inventors: 曾衍
Original assignee: Guangzhou Cubesili Information Technology Co Ltd
Current assignee: Guangzhou Cubesili Information Technology Co Ltd
Priority date: 2021-08-31
Filing date: 2021-08-31
Publication date: 2021-11-30
Anticipated expiration: 2041-08-31
Also published as: CN113727177B

Abstract

The application discloses a screen projection resource playing method, a device, equipment and a medium thereof, wherein the method comprises the following steps: receiving a screen projection request of a second application running on the same terminal device as the application; responding to the screen projection request, and establishing a screen projection communication link between the application and a second application; analyzing video data information sent by a second application through the screen projection communication link, and acquiring an acquisition address contained in the video data information; and calling the application built-in player to load and play the video data pointed by the acquisition address. According to the method and the device, the screen projection function of cross-application in the same equipment is realized, screen projection communication of each application in the same equipment is established, and each application in the equipment shares respective video resource in a screen projection mode so as to enrich the playing resource of the application.

Description

Screen-projecting resource playing method and device, equipment and medium thereof

Technical Field

The application relates to the field of network videos, in particular to a screen projection resource playing method, and further relates to a device, equipment and a nonvolatile storage medium corresponding to the method.

Background

Most streaming media software on the market can provide a screen projection function, so that a user can push streaming media data in the software to other equipment for playing in a screen projection mode, one prior art for transferring the playing of a video from one interface to another interface is realized by means of a wireless screen projection technology such as DLNA (digital living network alliance), an intelligent mobile equipment client can display screen images and sounds of the intelligent mobile equipment to another display equipment through the wireless screen projection technology, the function of projecting the video data of one equipment to a screen of another equipment for playing is realized, generally, a display picture of a small-screen equipment is projected to a screen of a large-screen equipment for playing, and the user can enjoy better video playing effect. However, obviously, such screen projection technology can only implement screen projection sharing of video content of data media across devices, and cannot be used for cross-application sharing of the same device.

In view of the problem of cross-application video source sharing in the same device, which is not satisfied by the various prior art techniques, the applicant has made a corresponding search in view of satisfying this need.

Disclosure of Invention

The present application is directed to a method for playing a screen-shot resource, and a corresponding apparatus, electronic device, and non-volatile storage medium thereof, which meet the needs of the prior art or overcome at least some of the disadvantages of the prior art.

In order to realize the purpose of the application, the following technical scheme is adopted:

a method for playing a screen-casting resource, which is adapted to one of the objectives of the present application, includes the following steps:

receiving a screen projection request of a second application running on the same terminal device as the application;

responding to the screen projection request, and establishing a screen projection communication link between the application and a second application;

analyzing video data information sent by a second application through the screen projection communication link, and acquiring an acquisition address contained in the video data information;

and calling the application built-in player to load and play the video data pointed by the acquisition address.

In a further embodiment, before receiving a screen-casting request of a second application running on the same terminal device as the application, the method further includes the following steps:

presenting a list of available programs listing a plurality of said second applications in the native device;

responding to a selected instruction of any second application in the list, and starting or awakening the selected second application;

and monitoring a screen projection request initiated by the second application and feeding back the screen projection request.

the second application responds to the screen projection instruction and displays a screen projection receiver list on a video source playing interface of the second application;

the second application searches a first application which is suitable for establishing the screen projection communication link with the second application and comprises the second application in the local equipment, and index information of the first application is added to a screen projection receiver list;

and the second application responds to a selected instruction of the index information of the application in the screen projection receiver list and sends the screen projection request to the application.

In a further embodiment, the step of establishing a screen-casting communication link between the application and the second application in response to the screen-casting request includes:

responding to the screen-casting request and feeding back equipment information pre-configured by the current application to the second application in a unicast mode, wherein the equipment information comprises communication configuration information;

and after the second application completes configuration according to the communication configuration information, the establishment of a screen projection communication link is realized.

In a further embodiment, the step of parsing the video data information sent by the second application through the screen-casting communication link and acquiring an acquisition address included in the video data information includes:

receiving video data information sent by the second application through the screen-casting communication link, wherein the video data information comprises a reference address of a video source, and the video source is selected from a video source list provided by a graphical user interface of the second application;

and analyzing the video data information, and acquiring the reference address of the video source from the video data information as the acquisition address.

receiving video data information sent by the second application through the screen-casting communication link, wherein the video data information comprises a local cache path of a video source, and the video source is selected from a video source list provided by a graphical user interface of the second application;

and the current application analyzes the video data information and acquires a local cache path of the video data sent by the second application as the acquisition address.

In a preferred embodiment, the step of invoking the in-application player to load and play the video data pointed by the acquisition address includes:

receiving one or more synthetic operation instructions acting on the video data, and synthesizing image-text elements corresponding to the synthetic operation instructions into the video data;

and loading the video data synthesizing the image-text elements into a built-in player for playing.

In a further embodiment, after the invoking of the application built-in player loads and plays the video data pointed by the acquisition address, the method further includes the following steps:

acquiring the playing state information of the built-in player, and sending the playing state information to a second application through the screen projection communication link so that the second application synchronizes the playing state of a corresponding video source according to the playing state information;

monitoring the playing state information sent by the second application through the screen projecting communication link, and controlling a built-in player to play the video data according to the playing state information so that the playing state of the video data is synchronous with the playing state of the video source in the second application.

In a further embodiment, in the step of establishing the screen projecting communication link between the application and the second application in response to the screen projecting request, the application and the second application are configured as different virtual devices, so that the screen projecting communication link is established according to the communication specification of the DLNA protocol.

A screen projection resource playing device adapted to the purpose of the present application, comprising:

the request receiving module is used for receiving a screen projection request of a second application which is operated by the same terminal equipment as the application;

the request response module is used for responding to the screen projection request and establishing a screen projection communication link between the application and the second application;

the address acquisition module is used for analyzing the video data information sent by the second application through the screen-casting communication link and acquiring an acquisition address contained in the video data information;

and the video playing module is used for calling the application built-in player to load and play the video data pointed by the acquisition address.

In a further embodiment, the request response module includes:

the device information feedback submodule is used for responding to the screen projection request and feeding back the device information pre-configured by the current application to the second application in a unicast mode, and the device information comprises communication configuration information;

and the link establishing submodule is used for realizing the establishment of the screen projection communication link after the second application completes configuration according to the communication configuration information.

In a further embodiment, the address obtaining module includes:

the video data information receiving submodule is used for receiving video data information sent by the second application through the screen projection communication link, the video data information comprises a reference address of a video source, and the video source is selected from a video source list provided by a graphical user interface of the second application;

and the reference address acquisition submodule is used for analyzing the video data information and acquiring the reference address of the video source from the video data information as the acquisition address.

In a preferred embodiment, the address obtaining module further includes:

the video data information receiving submodule is used for receiving the video data information sent by the second application through the screen projection communication link, the video data information comprises a local cache path of a video source, and the video source is selected from a video source list provided by a graphical user interface of the second application;

and the local cache path acquisition submodule is used for analyzing the video data information by the current application and acquiring a local cache path of the video data sent by the second application as the acquisition address.

In a further embodiment, the video playing module includes:

the instruction receiving submodule is used for receiving one or more synthetic operation instructions acting on the video data and synthesizing image-text elements corresponding to the synthetic operation instructions into the video data;

and the element synthesis submodule is used for loading the video data for synthesizing the image-text elements into a built-in player for playing.

In a preferred embodiment, the video playing module further includes:

the information sending submodule is used for acquiring the playing state information of the built-in player and sending the playing state information to a second application through the screen projection communication link so that the second application synchronizes the playing state of a corresponding video source according to the playing state information;

and the information monitoring submodule is used for monitoring the playing state information sent by the second application through the screen projection communication link, and controlling a built-in player to play the video data according to the playing state information so that the playing state of the video data is synchronous with the playing state of the video source in the second application.

The electronic device comprises a central processing unit and a memory, wherein the central processing unit is used for calling and running a computer program stored in the memory to execute the steps of the screen projection resource playing method.

The non-volatile storage medium stores a computer program implemented according to the screen projection resource playing method, and when the computer program is called by a computer and runs, the computer program executes the steps included in the corresponding method.

Compared with the prior art, the application has the following advantages:

according to the method and the device, the video screen projection function between different applications in the same device is constructed, and the function allows different applications in the same device to acquire corresponding video data from other applications for loading and playing in a screen projection mode through a mode of establishing a screen projection communication link.

Firstly, the video screen projection function among different applications in the same equipment is realized, cross-application video data sharing is realized in a screen projection mode, further, the sharing operation of the cross-application video data is simplified, the applications in the same equipment acquire corresponding video data from other applications through a screen projection communication link to be loaded and played, the situation that sharing cannot be realized due to the fact that an application program providing a video source does not support downloading is prevented, the applications acquiring the video data can play the video data which cannot be acquired from a network or a storage space of the equipment, and the video resources of the applications are enriched.

Secondly, the application in the same device can be used as a playing control party of video data of other applications, the application is superior to built-in players of other applications, the playing mode of the video data is controlled by using different playing functions, the playing effect of the video data in the device is optimized, and the integral playing impression of the video is improved.

In addition, the screen projection resource receiving application can provide a video element synthesis function, the application provides a video element synthesis instruction responding to a user, and corresponding video elements are synthesized into video data received by screen projection, so that the picture representation capability of screen projection videos is improved, and the playing pictures of the video data of screen projection of other applications are enriched.

Moreover, the live broadcast application of the same equipment can acquire video data from other applications, share the video data acquired by screen projection as the video content of a live broadcast room, synthesize the video picture of the video data to the live broadcast stream and push the video picture to the live broadcast room to play, enrich the video material of the live broadcast stream, and the video synthesis function of the live broadcast application, right implement corresponding video special effects on the video data, and improve the playing effect of the live broadcast stream.

Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.

Drawings

The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

fig. 1 is a schematic diagram of a typical network deployment architecture related to implementing the technical solution of the present application;

FIG. 2 is a flowchart illustrating an exemplary embodiment of a method for playing a screen-casting resource according to the present application;

fig. 3 is a schematic product architecture diagram of a current application and a second application in a case that a screen-casting communication link of the present application conforms to a communication specification of a DLNA protocol;

FIG. 4 is a flowchart illustrating specific steps of step S12 in FIG. 2;

FIG. 5 is a flowchart illustrating specific steps of step S13 in FIG. 2;

FIG. 6 is a schematic diagram of a video source list for a second application of the present application;

FIG. 7 is a flowchart illustrating specific steps of another embodiment of step S13 in FIG. 2;

FIG. 8 is a flowchart illustrating specific steps of step S14 in FIG. 2;

FIG. 9 is a flowchart illustrating specific steps of another embodiment of step S14 in FIG. 2;

FIG. 10 is a flowchart illustrating an embodiment of a method for playing a screen-casting resource according to the present application, with relative addition of a preceding step;

FIG. 11 is a schematic diagram of a graphical user interface associated with a second application of the present application when the second application is an initiator for establishing a screen-cast communication link;

FIG. 12 is a flowchart illustrating another embodiment of a method for playing a screen-casting resource according to the present application, with a pre-step added;

FIG. 13 is a schematic diagram of a graphical user interface associated with a current application (the present application) when the current application is an initiator for establishing a screen-cast communication link;

FIG. 14 is a flowchart illustrating an embodiment of a method for playing a screen-casting resource according to the present application, with a post-step added;

fig. 15 is a schematic view of a graphical user interface of a current application (the present application) when a live stream containing video data is shown in a live room;

FIG. 16 is a functional block diagram of an exemplary embodiment of a projected resource playback device of the present application;

fig. 17 is a block diagram of a basic structure of a computer device according to an embodiment of the present application.

Detailed Description

Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.

As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.

It will be understood by those within the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

As will be appreciated by those skilled in the art, "client," "terminal," and "terminal device" as used herein include both devices that are wireless signal receivers, which are devices having only wireless signal receivers without transmit capability, and devices that are receive and transmit hardware, which have receive and transmit hardware capable of two-way communication over a two-way communication link. Such a device may include: cellular or other communication devices such as personal computers, tablets, etc. having single or multi-line displays or cellular or other communication devices without multi-line displays; PCS (Personal Communications Service), which may combine voice, data processing, facsimile and/or data communication capabilities; a PDA (Personal Digital Assistant), which may include a radio frequency receiver, a pager, internet/intranet access, a web browser, a notepad, a calendar and/or a GPS (Global Positioning System) receiver; a conventional laptop and/or palmtop computer or other device having and/or including a radio frequency receiver. As used herein, a "client," "terminal device" can be portable, transportable, installed in a vehicle (aeronautical, maritime, and/or land-based), or situated and/or configured to operate locally and/or in a distributed fashion at any other location(s) on earth and/or in space. The "client", "terminal Device" used herein may also be a communication terminal, a web terminal, a music/video playing terminal, such as a PDA, an MID (Mobile Internet Device) and/or a Mobile phone with music/video playing function, and may also be a smart tv, a set-top box, and the like.

The hardware referred to by the names "server", "client", "service node", etc. is essentially an electronic device with the performance of a personal computer, and is a hardware device having necessary components disclosed by the von neumann principle such as a central processing unit (including an arithmetic unit and a controller), a memory, an input device, an output device, etc., a computer program is stored in the memory, and the central processing unit calls a program stored in an external memory into the internal memory to run, executes instructions in the program, and interacts with the input and output devices, thereby completing a specific function.

It should be noted that the concept of "server" as referred to in this application can be extended to the case of a server cluster. According to the network deployment principle understood by those skilled in the art, the servers should be logically divided, and in physical space, the servers may be independent from each other but can be called through an interface, or may be integrated into one physical computer or a set of computer clusters. Those skilled in the art will appreciate this variation and should not be so limited as to restrict the implementation of the network deployment of the present application.

Referring to fig. 1, the hardware basis required for implementing the related art embodiments of the present application may be deployed according to the architecture shown in the figure. The server 80 is deployed at the cloud end, and serves as a business server, and is responsible for further connecting to a related data server and other servers providing related support, so as to form a logically associated server cluster to provide services for related terminal devices, such as a smart phone 81 and a personal computer 82 shown in the figure, or a third-party server (not shown in the figure). Both the smart phone and the personal computer can access the internet through a known network access mode, and establish a data communication link with the cloud server 80 so as to run a terminal application program related to the service provided by the server.

For the server, the application program is usually constructed as a service process, and a corresponding program interface is opened for remote call of the application program running on various terminal devices.

The application program refers to an application program running on a server or a terminal device, the application program implements the related technical scheme of the application in a programming mode, a program code of the application program can be saved in a nonvolatile storage medium which can be identified by a computer in a form of a computer executable instruction, and is called into a memory by a central processing unit to run, and the related device of the application is constructed by running the application program on the computer.

For various terminal devices which are popular at present, particularly for mobile devices such as tablets and mobile phones, camera devices such as a camera are usually built in, or a personal computer can be externally connected to the camera devices.

The technical scheme suitable for being implemented in the terminal device in the application can also be programmed and built in an application program providing live webcasting, and the technical scheme is used as a part of extended functions. The live webcast refers to a live webcast room network service realized based on the network deployment architecture.

The live broadcast room is a video chat room realized by means of an internet technology, generally has an audio and video broadcast control function and comprises a main broadcast user and audience users, wherein the audience users can comprise registered users registered in a platform or unregistered tourist users; either registered users who are interested in the anchor user or registered or unregistered users who are not interested in the anchor user. The interaction between the anchor user and the audience user can be realized through known online interaction modes such as voice, video, characters and the like, generally, the anchor user performs programs for the audience user in the form of audio and video streams, and economic transaction behaviors can also be generated in the interaction process. Of course, the application form of the live broadcast room is not limited to online entertainment, and can be popularized to other relevant scenes, such as an educational training scene, a video conference scene, a product recommendation and sale scene, and any other scene needing similar interaction.

The person skilled in the art will know this: although the various methods of the present application are described based on the same concept so as to be common to each other, they may be independently performed unless otherwise specified. In the same way, for each embodiment disclosed in the present application, it is proposed based on the same inventive concept, and therefore, concepts of the same expression and concepts of which expressions are different but are appropriately changed only for convenience should be equally understood.

The embodiments to be disclosed herein can be flexibly constructed by cross-linking related technical features of the embodiments unless the mutual exclusion relationship between the related technical features is stated in the clear text, as long as the combination does not depart from the inventive spirit of the present application and can meet the needs of the prior art or solve the deficiencies of the prior art. Those skilled in the art will appreciate variations therefrom.

Referring to fig. 2, a method for playing a screen-shot resource according to an exemplary embodiment of the present application includes the following steps:

step S11, receiving a screen-casting request of a second application running on the same terminal device as the present application:

and the current application in the terminal equipment receives the screen projection request pushed by the second application in the equipment so as to establish screen projection communication links of the two parties.

The screen-casting request is pushed by the second application operated by the same terminal, so that the current application (the application) responds to the screen-casting request, the screen-casting communication link between the current application and the second application is established, video data information pushed by the second application is received, and video data pointed by the video data information is acquired and loaded into a built-in player for output and play.

Specifically, the screen-casting communication link generally refers to a screen-casting communication link conforming to a communication specification of a DLNA protocol, the screen-casting request generally refers to a multicast message used by the second application to search for an application program suitable for establishing the screen-casting communication link conforming to the DLNS protocol with the second application, the second application searches for the application program suitable for establishing the screen-casting communication link with the second application by broadcasting the multicast message (screen-casting request) to the application program located under the same local area network, and after receiving the multicast message (screen-casting request) and responding, the current application program (the present application) regards the current application program as the application program suitable for establishing the screen-casting communication link with the second application program.

The second application generally refers to an application program capable of independently playing video data and pushing video data information, and may be used as an output party of video data to screen the video data into a graphical user interface of a current application (this application) for playing, and may also be used as a play controller of video data to control the playing of the video data in the current application, and the second application pushes the video data information of the selected video data to the current application by establishing the screen-throwing communication link with the current application, so that the current application loads the video data pointed by the video data for playing and outputting.

The current application (the present application) and the second application are application programs running on the same device, the current application and the second application perform the pushing of the video data information by establishing the screen-casting communication link in the device, so that the current application loads the video data pointed by the video data information into a player built in the current application for output playing, the video data playing page of the current application is shared into other applications by a network link mode compared with a common application program, other applications jump to the video data playing page through the link differently, after the current application acquires the video data information, the corresponding video data can be acquired through the acquisition address included in the video data information and loaded into the built-in player of the current application for playing, and the second application can also participate in controlling the playing of the video data of the current application, for example, pausing the video data playback, starting the video data playback, or adjusting the video data playback progress, etc.

Step S12, responding to the screen projection request, establishing a screen projection communication link between the application and a second application:

and the current application responds to the screen projection request to establish the screen projection communication link with the second application pointed by the screen projection request, and corresponding screen projection operation is carried out.

When the screen-casting communication link is a data communication link conforming to the communication specification of the DLNA protocol, the screen-casting request is to send the multicast message to the second application, and after the current application (the current application) responds to the screen-casting request, the current application is regarded as an application program suitable for establishing the screen-casting communication link by the second application.

After the current application (the current application) responds to the screen projection request, the current application feeds back the device information pre-configured by the current application to the second application to which the screen projection request belongs in a unicast mode, wherein the device information comprises communication configuration information, so that the second application establishes the screen projection communication link between the second application and the current application according to the communication configuration information contained in the device information.

Referring to fig. 3, the screen-casting communication link is generally a screen-casting communication link conforming to the communication specification of the DLNA protocol, the first application 302 and the second application 301 are configured to be respectively located in virtual devices with different communication addresses, the second application 301 has a DMS module (digital media server) through which the video data information is pushed to the first application 302 through the screen-casting communication link conforming to the DLNA protocol as a provider of the video data, and the second application 301 has a DMC module (digital media server) capable of controlling the playing of the video data acquired according to the video data information in the first application; the first application 302 has a DMP module (digital media player) having functions of a DMC module and a DMR module (digital media renderer), renders video data acquired according to the video data information through the DMP module to be played, and controls playing of the video data.

Referring to fig. 4, regarding the implementation of the current application (the present application) establishing the screen-casting communication link with the second application after responding to the screen-casting request, the specific implementation steps are as follows:

step S121, responding to the screen-casting request, unicast-feeding back the device information preconfigured by the current application to the second application, where the device information includes communication configuration information:

and after responding to the screen projection request, the first application acquires the address and the port contained in the screen projection request, and feeds back the equipment information containing the communication configuration information pre-configured by the first application to the second application in a unicast mode through the address and the port.

The configuration information refers to information of a current application for establishing the screen-casting communication link with other applications (second applications), the device information includes the communication configuration information, the communication configuration information includes an ip address and an upnp service port of the current application, and the second applications establish the screen-casting communication link with the current application according to the communication configuration information included in the configuration information after receiving the configuration information.

Step S122, after the second application completes configuration according to the communication configuration information, the establishment of a screen projection communication link is realized:

and the second application receives the equipment information fed back by the current application unicast, and establishes the screen-casting communication link with the current application according to the communication configuration information contained in the equipment information so as to realize the mutual binding of the screen-casting communication links of the two parties.

Step S13, parsing the video data information sent by the second application through the screen-casting communication link, and acquiring an acquisition address included in the video data information:

after the screen-casting communication link is established between the current application (the current application) and the second application, the current application can receive the video data information pushed by the second application through the screen-casting communication link, analyze the video data information, and acquire the acquisition address contained in the video data information, so that the video data acquired through the acquisition address is loaded into a built-in player for playing and outputting.

The video data is generally obtained from the network or the local by the second application, the video data can be loaded and played by the current application and the second application, and the current application and the second application can be used as a control party for controlling the playing of the video data so as to control operations of pausing playing, starting playing, adjusting playing progress, adjusting playing volume and the like of the video data.

The current application acquires a video event through triggering, corresponding video data is selected from a second application established by the current application, the second application responds to the acquired video event, the video data pointed by the acquired video event is determined, and the video data information pointed to the video data is pushed to the current application.

In one embodiment, the second application selects corresponding video data from its own application to trigger a push video event, and pushes the video data information pointing to the video data to the current first application, so that the first application loads the video data pointed by the video data information into a live stream.

After the first application obtains the video data through the video data information, it generally calls a built-in player of the first application to load the video data for playing, and the first application can control the playing operation of the video data through the built-in player, and can also synthesize a corresponding special animation effect in the video data for displaying, for example, synthesize a video filter or a synthesized picture, or change the playing sound effect of the video data, for example, tune the playing sound effect, and the like.

Referring to fig. 5 and 6, regarding the implementation of analyzing the video data information for video data by the current application to obtain the obtaining address of the video data information, when the obtaining address is a reference address of the video data, the specific implementation steps are as follows:

step S131, receiving video data information sent by the second application via the screen-casting communication link, where the video data information includes a reference address of a video source, and the video source is selected from a video source list provided by a graphical user interface of the second application:

and the current application receives the video data information sent by the second application through the screen projection communication link so as to analyze the video data information to acquire the reference address of the video source included by the current application.

After the screen-casting communication link is established between the second application and the current application, a corresponding video source can be selected through the video source list provided in the graphical user interface of the second application to push video data information, a plurality of video sources acquired by the second application through the internet are displayed in the video source list, and the video sources are displayed in the video source list in a visual format of pictures, texts or plain texts.

The reference address generally refers to a URL, and after the first application acquires the reference address, the first application may acquire video data pointed by the URL from a media server pointed by the reference address (URL) to load and play the video data.

Specifically, referring to fig. 6, the video source list is shown as a video source list 601 in the figure, and is displayed in a graphical user interface of a second application that establishes the screen-casting communication link with a current application, a plurality of video sources capable of screen casting to a first application are displayed in the video source list 601, and when a screen-casting push 602 control is touched, the video data information of the video source C is generated, and the video data information is pushed to the current application through the screen-casting communication link.

Step S132, parsing the video data information, and acquiring a reference address of the video source from the video data information as the acquisition address:

after the current application acquires the video data information, the current application analyzes the video data information, acquires the reference address in the video data information, and takes the reference address as the acquisition address to load the video data pointed by the acquisition address.

Referring to fig. 7, regarding the implementation of analyzing the video data information for video data by the current application to obtain the obtaining address of the video data information, when the obtaining address is a local cache path of the video data, the specific implementation steps are as follows:

step S131', receiving video data information sent by the second application via the screen projection communication link, where the video data information includes a local cache path of a video source, and the video source is selected from a video source list provided by a graphical user interface of the second application:

and the current application receives the video data information sent by the second application through the screen projection communication link, analyzes and acquires the reference address local cache path of the video source included in the video data information so as to load the video source selected by the second application through the video source list provided in the graphical user interface of the second application.

After the screen-casting communication link is established between the second application and the current application, a corresponding video source can be selected through the video source list provided in the graphical user interface of the second application to push video data information, a plurality of video sources stored in a memory space of equipment of the second application are shown in the video source list, and the video sources are shown in the video source list in a visual format of pictures, texts or plain texts.

Step S132', the current application parses the video data information, and obtains a local cache path of the video data sent by the second application as the obtaining address:

after the current application acquires the video data information, the video data information is analyzed, the local cache path in the video data information is acquired, and the local cache path is used as the acquisition address, so that the video data pointed by the path is acquired from the memory space of the local equipment according to the local cache path and is loaded.

Step S14, invoking the application built-in player to load and play the video data pointed by the acquisition address:

after the current application (the current application) acquires the acquisition address, the video data pointed by the current application is acquired through the acquisition address, and the built-in player of the current application is called to load the video data into the built-in player for output playing.

And after the current application acquires the reference address from the video data information, acquiring the video data pointed by the reference address from the media server corresponding to the second application through the reference address, loading the video data into the built-in player, and outputting and playing the video data into a graphical user interface of the current application.

In one embodiment, after the previous application acquires the local cache path from the video data information, the previous application acquires corresponding video data from a memory control of the local device through the local cache path, loads the video data into the built-in player, and outputs and plays the video data to the graphical user interface of the current application.

In an embodiment, referring to fig. 8, after the current application obtains the video data, a composition operation of video elements may be performed on the video data to enrich a playing effect of the video data in the built-in player, and the specific implementation steps are as follows:

step S141, receiving one or more composition operation instructions acting on the video data, and composing the graphics and text elements corresponding to the composition operation instructions into the video data:

the current application has a video element synthesizing function, a user provides the synthesizing function, synthesizing operation of corresponding video elements is carried out on the video data, synthesizing operation instructions of the video elements are triggered and generated, so that the current application receives the synthesizing operation instructions, the video elements corresponding to the synthesizing operation instructions and the synthesizing positions of the video elements in the video elements are determined, and the video elements are synthesized into the corresponding positions in the video data.

The video element generally refers to visual graphics and text information synthesized into a video stream, and is used for beautifying the playing effect of the video data in a built-in player, and the types of the video element include: the operation user can select corresponding video elements to carry out synthesis operation and trigger and generate corresponding synthesis operation instructions so that the current application receives the synthesis operation instructions, determines the video elements corresponding to the synthesis operation instructions and the synthesis positions of the video elements in the video elements and synthesizes the video elements into the corresponding positions in the video data.

Step S142, loading the video data for synthesizing the image-text elements into a built-in player for playing:

and the current application responds to each synthesis operation instruction, synthesizes the video elements corresponding to the synthesis operation instructions to the corresponding positions of the video data, and loads the video data of which the synthesis of the video elements is finished into the built-in player for playing.

In an embodiment, referring to fig. 9, the current application and the second application can synchronize the playing progress of the video data or the video source, and the specific implementation steps are as follows:

step S141' acquires the playing status information of the built-in player, and sends the playing status information to a second application through the screen-casting communication link, so that the second application synchronizes the playing status of the corresponding video source according to the playing status information:

and the current application program acquires the playing state information of the video data currently played by the built-in player, and the playing state information records the playing progress of the video data currently played by the built-in player.

The current application pushes the acquired play state information to the second application through the screen-casting communication link, so that the second application determines a video source pointed by the play state information according to the play state information, and the play progress of the video source in a player of the second application and the play progress of the current application playing the video data are synchronously played.

The playing status information can synchronize the playing progress of the video source, and can also be used to control the playing of the video source, for example, pause the playing of the video source, continue the playing of the video source, or terminate the playing of the video source.

Step S142', monitoring the playing status information sent by the second application through the screen-casting communication link, and controlling the built-in player to play the video data according to the playing status information, so that the playing status of the video data is synchronized with the playing status of the video source in the second application:

and the current application monitors the playing state information sent by the second application through the screen projecting communication link in real time so as to control a built-in player to play the video data according to the playing state information, so that the video data and the playing state of the video source in the second application are synchronized.

For example, when the playing state of the video source is a pause playing state, the second application may pause the playing of the video data by pushing the playing state information representing the pause playing to the current application, and of course, may also control the playing progress of the video data played in the currently applied built-in player to be synchronized with the playing progress of the video source by adjusting the playing progress of the video source and pushing the playing state information representing the corresponding playing timestamp to the current application.

The above exemplary embodiments and variations thereof fully disclose the embodiments of the method for displaying a screen-rendered asset of the present application, but many variations of the method can be deduced by transforming and augmenting some technical means, and other embodiments are summarized as follows:

in an embodiment, referring to fig. 10, before the step of receiving a screen-casting request of a second application running on the same terminal device as the present application, the method further includes the following steps:

step S08, presenting an available program list listing a plurality of the second applications in the native device:

and displaying the available program list in a graphical user interface of the current application program, wherein a plurality of second applications in the local device are displayed in the available program list.

Referring to fig. 11, a diagram a of fig. 11 illustrates a graphical user interface of a current application, and a video data output side control a-1101 is selected by touch to display an available program list B-1101 of fig. B in the current graphical user interface, where a plurality of second application programs are displayed in the available program list.

Step S09, responding to a selected instruction of any one of the second applications in the list, starting or waking the selected second application:

the current application responds to a selected instruction of any one second application shown in the available program list so as to start or wake the second application when the local device is triggered.

Referring to fig. 11, the list of available programs B-1101 in fig. B is shown in the gui of the current application, and after the B-1102 control is touched, the device running the current application starts or wakes up the B application (the second application).

Step S10, monitoring the screen-casting request initiated by the second application and feeding back the screen-casting request:

and the current application program monitors the screen projection request of the selected second application mode in the available program list in real time, and receives and responds to the screen projection request after monitoring the screen projection request so as to establish the screen projection communication link between the current application and the second application.

In an embodiment, referring to fig. 12, before the step of receiving a screen-casting request of a second application running on the same terminal device as the present application, the method further includes the following steps:

step S08', the second application displays a list of screen projection recipients in response to the screen projection instruction on its video source playing interface:

and the second application responds to the screen projection instruction in the video source playing interface of the same-device equipment, and displays the screen projection receiver list in the current interface, wherein the screen projection receiver list is used for displaying the first application which is suitable for establishing the screen projection communication link with the second application.

Referring to fig. 13, fig. a of fig. 13 is a diagram of the video source playing interface of the second application, where the screen projection instruction is output by touching a video data screen projection control a-1301, so that the second application responds to the screen projection instruction, and displays a screen projection receiver list B-1301 in fig. B in the current video source playing interface.

Step S09', the second application searches for a first application, including the first application, in the local device, which is suitable for establishing the screen-casting communication link with the second application, and adds the index information of the first application to the screen-casting recipient list:

after the second application displays the screen projection receiving party list in a video source playing interface of the second application, first applications suitable for establishing a search screen projection communication link with the second application are searched in the local equipment, and the first applications comprise current applications (the application) of the application, so that all information of the first applications is added to the search screen projection receiving party list.

Referring to fig. 13, after the second application searches for a first application, including the present application, in the native device, which is suitable for establishing the screen-casting communication link with the second application, a screen-casting recipient list B-1301 of fig. B shows summary information of a plurality of the first applications, where the summary information is used to represent names of the first applications, so that a user can select, through each of the first applications shown in the screen-casting recipient list B-1301, a corresponding current application (the present application) described in the present application to push the screen-casting request.

Step S10', the second application sends the screen-casting request to the application in response to the selected instruction of the index information of the application in the screen-casting recipient list:

and the second application responds to the selected instruction, determines that the first application pointed by the selected instruction is the current application (the current application) in the screen projection receiver list, and pushes the screen projection request to the current application (the current application).

Referring to fig. 13, assuming that the application B in fig. B is the current application (the present application) described in this application, the selected instruction pointing to the application B is generated by referring to the screen-projection B-1302 control in the screen-projection receiving party list B-1301, so that the second application responds to the selected instruction and pushes the screen-projection request to the application B.

In an embodiment, referring to fig. 14, after the step of calling the application built-in player to load and play the video data pointed by the acquisition address is executed, the method further includes the following steps:

step S15, pushing a live stream containing the video data to a live broadcast room controlled by the application:

and after the current application (the current application) acquires the video data pointed by the video data information through the acquisition address and loads the video data to a built-in player for output and play, the current application can push a live stream containing the video data to a live broadcast room controlled by the current application.

The current application pushes the acquired video data to a service server associated with the live broadcast room, and drives the service server to synthesize the video data into a live broadcast stream to which the current application belongs, so that the live broadcast stream is broadcasted to the live broadcast room for output and play.

In one embodiment, the current application pushes the obtained address to the service server serving the live broadcast service thereof, so as to drive the service server to obtain corresponding video data from the server pointed by the reference address according to the reference address, synthesize the video data into a live broadcast stream of a live broadcast room where the current application is located, and push the live broadcast stream to the live broadcast room for playing.

Referring to fig. 15, after the live stream containing the video data is pushed to the currently applied live broadcast room, the video data video frame 1502 of the video data is displayed in the live stream played by the live broadcast window 1501 of the live broadcast room, so as to enrich the playing effect of the live broadcast stream.

Further, a screen-casting resource playing apparatus of the present application can be constructed by functionalizing the steps in the methods disclosed in the above embodiments, according to this idea, please refer to fig. 16, wherein in an exemplary embodiment, the apparatus includes: the request receiving module 11 is configured to receive a screen-casting request of a second application running on the same terminal device as the application; a request response module 12, configured to respond to the screen-casting request and establish a screen-casting communication link between the application and a second application; the address acquisition module 13 is configured to analyze video data information sent by a second application through the screen-casting communication link, and acquire an acquisition address included in the video data information; and the video playing module 14 is configured to call the application built-in player to load and play the video data pointed by the acquisition address.

In one embodiment, the request response module 12 includes: the device information feedback submodule is used for responding to the screen projection request and feeding back the device information pre-configured by the current application to the second application in a unicast mode, and the device information comprises communication configuration information; and the link establishing submodule is used for realizing the establishment of the screen projection communication link after the second application completes configuration according to the communication configuration information.

In one embodiment, the address obtaining module 13 includes: the video data information receiving submodule is used for receiving video data information sent by the second application through the screen projection communication link, the video data information comprises a reference address of a video source, and the video source is selected from a video source list provided by a graphical user interface of the second application; and the reference address acquisition submodule is used for analyzing the video data information and acquiring the reference address of the video source from the video data information as the acquisition address.

In another embodiment, the address obtaining module 13 further includes: the video data information receiving submodule is used for receiving the video data information sent by the second application through the screen projection communication link, the video data information comprises a local cache path of a video source, and the video source is selected from a video source list provided by a graphical user interface of the second application; and the local cache path acquisition submodule is used for analyzing the video data information by the current application and acquiring a local cache path of the video data sent by the second application as the acquisition address.

In one embodiment, the video playing module 14 includes: the instruction receiving submodule is used for receiving one or more synthetic operation instructions acting on the video data and synthesizing image-text elements corresponding to the synthetic operation instructions into the video data; and the element synthesis submodule is used for loading the video data for synthesizing the image-text elements into a built-in player for playing.

In another embodiment, the video playing module 14 further includes: the information sending submodule is used for acquiring the playing state information of the built-in player and sending the playing state information to a second application through the screen projection communication link so that the second application synchronizes the playing state of a corresponding video source according to the playing state information; and the information monitoring submodule is used for monitoring the playing state information sent by the second application through the screen projection communication link, and controlling a built-in player to play the video data according to the playing state information so that the playing state of the video data is synchronous with the playing state of the video source in the second application.

In order to solve the above technical problem, an embodiment of the present application further provides a computer device, configured to run a computer program implemented according to the screen-casting resource playing method. Referring to fig. 17, fig. 17 is a block diagram of a basic structure of a computer device according to the present embodiment.

As shown in fig. 17, the internal structure of the computer device is schematically illustrated. The computer device includes a processor, a non-volatile storage medium, a memory, and a network interface connected by a system bus. The non-volatile storage medium of the computer device stores an operating system, a database and computer readable instructions, the database can store control information sequences, and the computer readable instructions, when executed by the processor, can enable the processor to realize a screen projection resource playing method. The processor of the computer device is used for providing calculation and control capability and supporting the operation of the whole computer device. The memory of the computer device may have stored therein computer readable instructions that, when executed by the processor, cause the processor to perform a method for playing a screen-cast resource. The network interface of the computer device is used for connecting and communicating with the terminal. Those skilled in the art will appreciate that the architecture shown in fig. 17 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

In this embodiment, the processor is configured to execute specific functions of each module/sub-module in the screen projection resource playing device of the present invention, and the memory stores program codes and various data required for executing the modules. The network interface is used for data transmission to and from a user terminal or a server. The memory in this embodiment stores program codes and data required for executing all modules/sub-modules in the screen-casting resource playing device, and the server can call the program codes and data of the server to execute the functions of all sub-modules.

The present application further provides a non-volatile storage medium, where the screen-casting resource playing method is written as a computer program, and the computer program is stored in the storage medium in the form of computer-readable instructions, and when the computer-readable instructions are executed by one or more processors, the computer-readable instructions mean that the program is executed in a computer, so that the one or more processors execute the steps of the screen-casting resource playing method according to any one of the above embodiments.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the computer program is executed. The storage medium may be a non-volatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a Random Access Memory (RAM).

To sum up, the screen projection function across applications in the same equipment is achieved, screen projection communication of each application in the same equipment is established, and each application in the equipment shares respective video resources in a screen projection mode, so that the playing resources of the applications are enriched.

It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least a portion of the steps in the flow chart of the figure may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

Those of skill in the art will appreciate that the various operations, methods, steps in the processes, acts, or solutions discussed in this application can be interchanged, modified, combined, or eliminated. Further, other steps, measures, or schemes in various operations, methods, or flows that have been discussed in this application can be alternated, altered, rearranged, broken down, combined, or deleted. Further, steps, measures, schemes in the prior art having various operations, methods, procedures disclosed in the present application may also be alternated, modified, rearranged, decomposed, combined, or deleted.

The foregoing is only a partial embodiment of the present application, and it should be noted that, for those skilled in the art, several modifications and decorations can be made without departing from the principle of the present application, and these modifications and decorations should also be regarded as the protection scope of the present application.

Claims

1. A screen-casting resource playing method is characterized by comprising the following steps:

2. The method according to claim 1, wherein before receiving a screen-casting request of a second application running on the same terminal device as the application, the method further comprises the following steps:

3. The method according to claim 1, wherein before receiving a screen-casting request of a second application running on the same terminal device as the application, the method further comprises the following steps:

4. The method of claim 1, wherein the step of establishing a screen-casting communication link between the application and a second application in response to the screen-casting request comprises:

5. The method of claim 1, wherein the step of parsing the video data information sent by the second application via the screen-casting communication link to obtain the obtaining address contained in the video data information comprises:

6. The method of claim 1, wherein the step of parsing the video data information sent by the second application via the screen-casting communication link to obtain the obtaining address contained in the video data information comprises:

7. The method according to claim 1, wherein the step of invoking the app-embedded player to load and play the video data pointed by the acquisition address comprises:

8. The method according to claim 1, wherein the step of invoking the app-embedded player to load and play the video data pointed by the acquisition address comprises:

9. The method according to any one of claims 1 to 8, wherein after the invoking in-application player loads and plays the video data pointed by the acquisition address, the method further comprises the following steps:

pushing a live stream containing the video data to a live room controlled by the application.

10. The method according to any one of claims 1 to 9, wherein in the step of establishing the screen-casting communication link between the application and the second application in response to the screen-casting request, the application and the second application are configured as different virtual devices, so as to establish the screen-casting communication link according to the communication specification of the DLNA protocol.

11. A screen-casting resource playing device is characterized by comprising:

12. An electronic device comprising a central processor and a memory, characterized in that the central processor is configured to invoke execution of a computer program stored in the memory to perform the steps of the method according to any one of claims 1 to 10.

13. A non-volatile storage medium, characterized in that it stores, in the form of computer-readable instructions, a computer program implemented according to the method of any one of claims 1 to 10, which, when invoked by a computer, performs the steps comprised by the method.