WO2022135553A1

WO2022135553A1 - Screen projection method capable of continuously playing videos, and apparatus and system

Info

Publication number: WO2022135553A1
Application number: PCT/CN2021/141041
Authority: WO
Inventors: 刘晓鹏; 包锐
Original assignee: 花瓣云科技有限公司
Priority date: 2020-12-24
Filing date: 2021-12-24
Publication date: 2022-06-30
Also published as: CN114679610A; CN114679610B

Abstract

Provided are a screen projection method capable of continuously playing videos, and a related apparatus and system. In the method, after a user executes a screen projection operation on an electronic device end, a large-screen device can realize the continuous playing of a plurality of videos, and during this process, the electronic device does not need to maintain a communication connection with the large-screen device. Therefore, after each video is finished playing, the continuation of a further video no longer relies on the real-time online control of the electronic device, and thus the problem of it not being possible for the large-screen device to perform continuous playing after the communication connection between the electronic device and the large-screen device is disconnected after screen projection can be solved.

Description

Screen projection method, device and system for continuously playing video

This application claims the priority of the Chinese patent application with the application number 202011555733.3 and the application title "Screen projection method, device and system for continuously playing video", which was filed with the China Patent Office on December 24, 2020, the entire contents of which are incorporated by reference in this application.

technical field

The embodiments of the present application relate to screen projection technologies, and in particular, to a screen projection method, device, and system for continuously playing videos.

Background technique

Among the video applications currently installed on electronic devices, more and more video applications support the screen-casting function. Among them, the digital living network alliance (DLNA) protocol is one of the commonly used screen projection protocols. After logging in a video application program that supports the DLAN function in the electronic device, the user searches for a large-screen device that can cast a screen and establishes a communication connection, so as to share the video and other media content on the electronic device to the large-screen device for playback.

At present, users have higher and higher requirements for online screen projection, and hope that the large-screen device can continuously play videos during the screen projection process. However, in the current screen projection process, the electronic device and the large-screen device must maintain a communication connection, so that the large-screen device can continuously play multiple videos.

SUMMARY OF THE INVENTION

The present application provides a screen projection method, device and system capable of continuously playing videos, which solves the problem that the large-screen device cannot play continuously after the communication connection between the electronic device and the large-screen device is disconnected after screen projection.

In a first aspect, an embodiment of the present application provides a screen projection method that can continuously play videos. The method is applied to a screen projection system, where the screen projection system includes an electronic device, a large-screen device, and a server. The method includes: the electronic device Receive a first operation, and establish a communication connection with the large-screen device in response to the first operation; the electronic device sends first information to the large-screen device based on the communication connection, the first information indicating that multiple videos are in the large-screen device. The storage location in the server; the communication connection between the electronic device and the large-screen device is disconnected; the large-screen device requests the server to obtain the plurality of videos according to the first information; the server sends the plurality of videos to the large-screen device screen device; the large screen device plays the multiple videos.

Implementing the method provided in the first aspect can realize that in the process of screen projection, after the large-screen device receives the first information from the electronic device, and before the large-screen device plays the video, the continuous work of multiple videos no longer depends on the real-time online of the electronic device. Control, even if the communication connection between the electronic device and the large-screen device is disconnected, the large-screen device can still play video continuously, improving the user's screen projection experience.

In a second aspect, an embodiment of the present application provides a screen projection method that can play videos continuously. The method is applied to a screen projection system, where the screen projection system includes an electronic device, a large-screen device, and a server, and the method includes: the electronic device Receive a first operation, and establish a communication connection with the large-screen device in response to the first operation; the electronic device sends first information to the large-screen device based on the communication connection, the first information indicating that multiple videos are in the large-screen device. The storage location in the server; the large-screen device requests the server to obtain the multiple videos according to the first information; the server sends the multiple videos to the large-screen device; the large-screen device plays the video in the multiple videos For the first video, the communication connection between the electronic device and the large-screen device is disconnected; the large-screen device plays the second video among the plurality of videos.

Implementing the method provided in the second aspect can realize that in the process of screen projection, after each video on the large-screen device ends, the continuation of another video no longer depends on the real-time online control of the electronic device, which solves the problem of the large-screen device. During the video playback process, the communication connection between the electronic device and the large-screen device is disconnected, and the large-screen device can still play the video continuously, which improves the user's screen projection experience.

With reference to the first aspect or the second aspect, in some embodiments, before the electronic device detects the first operation, the method further includes: the electronic device plays a third video; after the electronic device detects the first operation, the above-mentioned method further includes: The method further includes: the electronic device displays a video option; the electronic device receives a second operation, the second operation acts on the option of the fourth video in the video option; the electronic device sends the identification of the third video to the server , and, the identifier of the fourth video; the above-mentioned server sends second information to the electronic device, and the second information indicates the storage location of the third video and the fourth video in the server; wherein, the first information The plurality of videos in includes the third video and the fourth video.

In this way, the user can select a desired video from the videos recommended on the electronic device side for screencasting, so as to meet the user's personalized needs and improve the user's screencasting experience.

With reference to the first aspect or the second aspect, in some embodiments, before the electronic device sends the first information to the large-screen device based on the communication connection, the method further includes: the electronic device sends the third video to the server identification; the server determines the fifth video, and sends second information to the electronic device, where the second information indicates the storage location of the third video and the fifth video in the server; wherein, in the first information The plurality of videos includes the third video and the fifth video.

In this way, the server can recommend the video required by the user for screen projection, so as to meet the user's personalized needs and improve the user's screen projection experience.

With reference to the first aspect or the second aspect, in an implementation manner, the first information is a first uniform resource locator URL, and the first URL corresponds to the storage location of the above-mentioned multiple videos in the server: the electronic device is based on the Before the communication connection sends the first information to the large-screen device, the method further includes: the server generates the first URL according to the respective URLs of the multiple videos, and sends the first URL to the electronic device.

In this way, the large-screen device can acquire multiple videos from the server according to the above-mentioned first URL, so as to continuously play the multiple videos.

In a third aspect, an embodiment of the present application provides a screen projection method that can continuously play videos, the method is applied to an electronic device, and the method includes: the electronic device receives a first operation, and responds to the first operation and a large The screen device establishes a communication connection; the electronic device sends first information to the large-screen device based on the communication connection, where the first information indicates the storage locations of multiple videos in the server, and the first information is used for the large-screen device Acquire the plurality of videos; before the large-screen device plays the plurality of videos, or during the process of playing the plurality of videos on the large-screen device, the electronic device and the large-screen device disconnect the communication connection.

Implementing the method provided in the third aspect can realize that after the large-screen device receives the first information from the electronic device during the projection process, the continuous work of multiple videos no longer depends on the real-time online control of the electronic device, and solves the problem of electronic devices after projection. After the communication connection between the device and the large-screen device is disconnected, the large-screen device cannot play continuously, which improves the user's screen casting experience.

With reference to the third aspect, in some embodiments, before the electronic device detects the first operation, the method further includes: the electronic device plays a third video; after the electronic device detects the first operation, the method further includes: The electronic device displays a video option; the electronic device receives a second operation, the second operation acts on the option of the fourth video in the video option; the electronic device sends the identification of the third video to the server, and the The identification of the fourth video; the electronic device receives the second information sent by the server, the second information indicates the storage location of the third video and the fourth video in the server; wherein, the first information in the The plurality of videos includes the third video and the fourth video.

With reference to the third aspect, in some embodiments, the video corresponding to the above-mentioned video option includes one or more of the following: a video whose correlation with the above-mentioned third video exceeds a threshold, a video recommended by an electronic device according to user information, or an electronic The video recommended by the device according to the click-through rate.

With reference to the third aspect, in some embodiments, before the electronic device sends the first information to the large-screen device based on the communication connection, the method further includes: the electronic device sends a first message to the server, where the first message includes : the identifier of the third video; the electronic device receives the second information sent by the server, where the second information indicates the storage location of the third video and the fifth video determined by the server in the server. Wherein, the plurality of videos in the first information includes the third video and the fifth video.

With reference to the third aspect, in some embodiments, the fifth video determined by the server includes one or more of the following: a video with a degree of association with the third video exceeding a threshold, a video recommended by the server according to user information, or , the server recommends videos according to the click-through rate.

With reference to the third aspect, in some implementations, in one implementation, the above-mentioned first information is a first uniform resource locator URL, and the first URL corresponds to the storage location of the above-mentioned plurality of videos in the server: the above-mentioned electronic Before the device sends the first information to the large-screen device based on the communication connection, the method further includes: the electronic device receives a first URL, where the first URL is generated by the server according to the respective URLs of the plurality of videos.

With reference to the third aspect, in one embodiment, the above-mentioned first information is a screen projection interpretation file, and the screen projection interpretation file includes the respective URLs of the above-mentioned multiple videos; the above-mentioned electronic device sends the first information to the large-screen device based on the communication connection. Before, the method further includes: the electronic device receives the screen projection interpretation file described above, where the screen projection interpretation file is generated by the server according to the respective URLs of the multiple videos.

In this way, the large-screen device can acquire multiple videos from the server according to the above-mentioned screen projection interpretation file, so as to realize the continuous playback of the multiple videos.

With reference to the third aspect, in one embodiment, the above-mentioned first information is a screen projection interpretation file, and the screen projection interpretation file includes the respective URLs of the above-mentioned multiple videos; the above-mentioned electronic device sends the first information to the large-screen device based on the communication connection. Before, the above method further includes: the electronic device receives the respective URLs of multiple videos sent by the server; then, the electronic device generates the screen projection interpretation file according to the respective URLs of the multiple videos.

With reference to the third aspect, in some embodiments, the above-mentioned screen projection interpretation file further includes one or more of the following: the version number of the screen projection interpretation file, the number of the multiple videos, the respective durations of the multiple videos, the The total duration of the multiple videos, the playback mode of the multiple videos, the playback order of the multiple videos, or the video names of the multiple videos.

In this way, the large-screen device can display the content that the user wants to know in the above-mentioned screencasting explanation file, so as to satisfy the user's screencasting experience.

In a fourth aspect, an embodiment of the present application provides a screen projection method that can continuously play videos. The method is applied to a large-screen device. The method includes: establishing a communication connection between the large-screen device and the electronic device; the large-screen device is based on the large-screen device. The communication connection receives the first information sent by the electronic device, the first information indicates the storage locations of multiple videos in the server; the large-screen device and the electronic device disconnect the communication connection; the large-screen device according to the first information A message requests the server to obtain the plurality of videos; the large-screen device receives the plurality of videos sent by the server, and then the large-screen device plays the plurality of videos.

Implementing the method provided in the fourth aspect can realize that after the large-screen device receives the first information from the electronic device during the projection process, the continuous work of multiple videos no longer depends on the real-time online control of the electronic device, and solves the problem of electronic devices after projection. After the communication connection between the device and the large-screen device is disconnected, the large-screen device cannot play continuously, which improves the user's screen casting experience.

In a fifth aspect, an embodiment of the present application provides a screen projection method that can continuously play videos. The method is applied to a large-screen device. The method includes: establishing a communication connection between the large-screen device and the electronic device; and the large-screen device based on the large-screen device. The communication connection obtains first information from the electronic device, where the first information indicates the storage locations of the plurality of videos in the server; the large-screen device requests the server to obtain the plurality of videos according to the first information; the large-screen device requests the server to obtain the plurality of videos; The large-screen device receives the multiple videos sent by the server; the large-screen device plays the first video among the multiple videos; the large-screen device and the electronic device disconnect the communication connection; the large-screen device continues to play the multiple videos The second video of the videos.

Implementing the method provided in the fifth aspect can realize that after the large-screen device receives the first information from the electronic device during the projection process, the continuous work of multiple videos no longer depends on the real-time online control of the electronic device, which solves the problem of electronic devices after projection. After the communication connection between the device and the large-screen device is disconnected, the large-screen device cannot play continuously, which improves the user's screen casting experience.

With reference to the fourth or fifth aspect, in an embodiment, the above-mentioned first information is a first uniform resource locator URL, and the first URL corresponds to the storage location of the plurality of videos in the server.

With reference to the fourth or fifth aspect, in some embodiments, the above-mentioned large-screen device plays the above-mentioned multiple videos, which specifically includes: the large-screen device plays the multiple videos in sequence according to the order in which the multiple videos are acquired.

With reference to the fourth or fifth aspect, in an embodiment, the above-mentioned first information is a screen projection interpretation file, and the screen projection interpretation file includes respective URLs of the multiple videos.

With reference to the fourth or fifth aspect, in one embodiment, the above-mentioned method further includes: the large-screen device displays a screen projection list, and the screen projection list includes: options for the plurality of videos; the large-screen device responds to the action on The third operation of the screen projection list is to perform any one or more of the following: adjust the playback order of the multiple videos, and adjust the playback mode of the multiple videos.

In this way, the large-screen device can display the screen projection list to meet the personalized needs of the user, and the large-screen device can also accept user operations to realize the playback order of multiple videos and the functions of adjusting the playback modes of the multiple videos.

With reference to the fourth or fifth aspect, in some embodiments, the above-mentioned screen projection interpretation file further includes one or more of the following: the version number of the screen projection interpretation file, the number of the multiple videos, the respective duration, the total duration of the multiple videos, the playback mode of the multiple videos, the playback order of the multiple videos, or the video names of the multiple videos.

With reference to the fourth or fifth aspect, in some embodiments, the large-screen device requests the server to acquire the plurality of videos according to the first information, which specifically includes: the large-screen device sends the first information to the CDN ; the large-screen device obtains the plurality of videos from the server according to the CDN; the large-screen device plays the plurality of videos.

In a sixth aspect, an embodiment of the present application provides an electronic device, the electronic device includes one or more processors and one or more memories; wherein, the one or more memories are coupled to the one or more processors, The one or more memories are used to store computer program code, the computer program code comprising computer instructions that, when executed by the one or more processors, cause the electronic device to perform the method as described in the embodiment of the third aspect .

In a seventh aspect, an embodiment of the present application provides a large-screen device, where the large-screen device includes one or more processors and one or more memories; wherein, the one or more memories and the one or more processors Coupling, the one or more memories are used to store computer program code, the computer program code includes computer instructions, when the one or more processors execute the computer instructions, make the large screen device perform as the fourth aspect or the fifth aspect A method as described in any one of the embodiments of the aspect.

In an eighth aspect, an embodiment of the present application provides a computer program product containing instructions, when the computer program product is run on an electronic device, the electronic device is caused to execute the method described in the embodiment of the third aspect.

In a ninth aspect, an embodiment of the present application provides a computer-readable storage medium, including instructions, when the instructions are executed on an electronic device, the electronic device causes the electronic device to execute the method described in the embodiment of the third aspect.

In a tenth aspect, an embodiment of the present application provides a computer program product including instructions, when the computer program product runs on a large-screen device, the large-screen device is made to perform any one of the fourth aspect or the fifth aspect The method described in the embodiment.

In an eleventh aspect, an embodiment of the present application provides a computer-readable storage medium, including an instruction, when the instruction is executed on a large-screen device, the large-screen device is caused to perform any one of the fourth aspect or the fifth aspect The method described in this embodiment.

In a twelfth aspect, an embodiment of the present application provides a screen projection system, the screen projection system includes an electronic device, a large-screen device, and a server, the electronic device is the electronic device described in the third aspect, and the large-screen device is the fourth The large-screen device described in the aspect or the fifth aspect.

Implementing the screen projection method that can continuously play videos provided by this application, after the user performs the screen projection operation on the electronic device, the large-screen device can realize the continuous playback of multiple videos, and in this process, the electronic device and the large-screen device are connected. There is no need to maintain a communication connection between them. In this way, after each video is played, the continuation of another video no longer depends on the real-time online control of the electronic device. The device cannot play continuously.

Description of drawings

FIG. 1 is a schematic diagram of an existing screen projection technology;

FIG. 2 is a schematic structural diagram of a screen projection system 10 according to an embodiment of the present application;

FIG. 3A is a schematic diagram of a hardware structure of an electronic device 100 according to an embodiment of the present application;

FIG. 3B is a schematic diagram of a software structure of the electronic device 100 provided by an embodiment of the present application;

FIG. 4A is a schematic diagram of a hardware structure of a large-screen device 200 provided by an embodiment of the present application;

FIG. 4B is a block diagram of the software structure of the large-screen device 200 provided by the embodiment of the present application;

FIG. 5A is a schematic diagram of a hardware structure of a server 300 according to an embodiment of the present application;

FIG. 5B is a schematic diagram of the software structure of the server 300 provided by the embodiment of the present application;

FIG. 6 is a flowchart of the method for screen projection provided in Embodiment 1 of the present application;

7A-7G are schematic diagrams of a set of user interfaces provided by an embodiment of the present application;

8 is a schematic diagram of a user interface provided by an embodiment of the present application;

9 is a flowchart of a method for screen projection provided in Embodiment 2 of the present application;

FIGS. 10A-10E are schematic diagrams of another set of user interfaces provided by this embodiment of the present application;

FIG. 11 is a flowchart of the method for screen projection provided in Embodiment 3 of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be described clearly and in detail below with reference to the accompanying drawings. Wherein, in the description of the embodiments of the present application, unless otherwise specified, “/” means or, for example, A/B can mean A or B; “and/or” in the text is only a description of an associated object The association relationship indicates that there can be three kinds of relationships, for example, A and/or B can indicate that A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of this application , "plurality" means two or more than two.

Hereinafter, the terms "first" and "second" are only used for descriptive purposes, and should not be construed as implying or implying relative importance or implying the number of indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, unless otherwise specified, the "multiple" The meaning is two or more.

The term "user interface (UI)" in the following embodiments of this application is a medium interface for interaction and information exchange between an application program or an operating system and a user, which realizes the internal form of information and the form acceptable to the user. conversion between. The user interface is the source code written in a specific computer language such as java and extensible markup language (XML). A commonly used form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed graphically. It can be text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, and other visual interface elements displayed on the display screen of the electronic device.

In the embodiments of the present application, the screen projection between the electronic device and the large-screen device may be based on the DLNA standard. The following is a brief introduction to DLNA.

DLNA is a solution for sharing data. In the same local area network, different devices can share media files based on DLNA. The devices involved in the DLNA standard include a digital media controller (DMC), a digital media renderer (DMR) and a digital media server (DMS).

DMS is a provider of media content and can provide media content for DMC and DMR, such as cloud servers.

The DMC can be used as a remote control device, which can search for the media content on the DMS and designate a DMR that can play the media content, such as mobile phones, tablet computers and other electronic devices.

As a controlled device, the DMR can receive and play the media content specified by the DMC. Specifically, DMR can acquire and play media content from DMS, typical devices such as smart TVs, smart screens and other large-screen devices.

Referring to FIG. 1 , FIG. 1 exemplarily shows a schematic diagram of the existing DLAN-based screen projection technology.

As shown in Figure 1, the current screen projection process based on the DLAN protocol includes:

1. When an electronic device runs a video application to play a video, the user performs a screen projection operation on the currently playing video, and the electronic device sends a screen projection request to the server to obtain the uniform resource locator (URL) of the currently playing video of the electronic device. .

2. The electronic device sends the URL of the video to the large-screen device based on the communication connection with the large-screen device.

3. The large-screen device obtains the corresponding video stream from the server according to the URL.

4. The large screen device receives the video stream and plays the video.

In the above process, the electronic device and the large-screen device must maintain a communication connection to realize continuous video playback.

If the electronic device maintains a communication connection with the large-screen device, the electronic device can monitor the current video playback end event of the large-screen device, and automatically request the server to obtain the URL of the next video. The next video can be the next video of the finished video. one episode.

Once the electronic device is disconnected from the large-screen device, the electronic device cannot monitor the current video playback end event of the large-screen device, so it cannot continuously push the URL of the next video to the large-screen device to continuously play the video.

In order to solve the deficiencies of the prior art, the following embodiments of the present application provide a screen projection method that can continuously play videos. In this method, after the user performs a screen projection operation on the electronic device, the large-screen device can realize continuous playback of multiple videos, and during this process, there is no need to maintain a communication connection between the electronic device and the large-screen device. In this way, after each video is played, the continuation of another video no longer depends on the real-time online control of the electronic device. The device cannot play continuously.

In addition, the multiple videos continuously played by the large-screen device may be videos selected by the user and/or videos recommended by the server, which further meets the user's personalized needs and improves the user's screen projection experience.

In order to introduce the screen projection method provided by the embodiment of the present application more clearly and in detail, the screen projection system 10 provided by the embodiment of the present application is first introduced below.

Referring to FIG. 2 , FIG. 2 shows a screen projection system 10 provided by an embodiment of the present application.

As shown in FIG. 2 , the screen projection system 10 includes: an electronic device 100 , a large-screen device 200 , a server 300 and a CDN 400 .

In this embodiment of the present application, the electronic device 100 may establish a communication connection with the large-screen device 200 . The communication connection may be a DLNA connection. DLAN connections include wired network connections that conform to the 802.3.i/u protocol established by the Institute of Electrical and Electronics Engineers (IEEE), and wireless networks that conform to the 802.11/a/b/g/n/ac protocol. Connection, such as Wi-Fi Direct (such as Wi-Fi P2P). The communication connection may also be a Bluetooth connection conforming to the 802.15 protocol, which is not limited in this embodiment of the present application.

In other embodiments, the electronic device 100 and the large-screen device 200 may establish a remote connection. For example, the electronic device 100 and the large-screen device 200 may log in to the same account (eg, a Huawei account), and then connect using a server that manages the account.

In this embodiment of the present application, the electronic device 100 can push the new URL returned by the server 300 to the large-screen device 200 based on the communication connection with the large-screen device 200, and the large-screen device 200 can obtain the playlist according to the new URL separate URLs for each video and associated video in the URL, and play videos continuously based on these URLs.

The electronic device 100 may include, but is not limited to, a smart phone, a tablet computer, a personal digital assistant (PDA), a wearable electronic device with a wireless communication function (eg, a smart watch, smart glasses), and the like. Exemplary embodiments of electronic devices include, but are not limited to, onboard

Portable electronic devices with Linux or other operating systems. The above-mentioned electronic device may also be other portable electronic device, such as a laptop computer (Laptop) and the like. It should also be understood that, in some other embodiments, the above-mentioned electronic device may not be a portable electronic device, but a desktop computer. In this embodiment of the present application, the electronic device 100 may also be a DMC in the DLAN standard.

The large-screen device 200 refers to an electronic device having a large-sized display screen, such as a television, a smart screen, or an electronic billboard. The larger size of the display screen configured by the large-screen device 200 is relative to that of the electronic device 100 , that is, the size of the display screen of the large-screen device 200 is larger than that of the electronic device 100 . In some embodiments, the TV set can be used with a TV box, and the TV box is used to convert the received digital signal into an analog signal and then send it to the TV set for display. In some embodiments, the large-screen device 200 may be a TV set with a digital-to-analog conversion function, or a TV set equipped with a TV box. In this embodiment of the present application, the large-screen device 200 may also be a DMR in the DLAN standard.

In some embodiments, the electronic device 100 and the large-screen device 200 may be the same type of device, as long as the sizes of the display screens have relative sizes. For example, the electronic device 100 may be an ordinary smart phone, and the large-screen device may be a large-screen smart phone with a flexible screen.

In some embodiments, the large-screen device 200 may also be used in conjunction with a remote control. Communication between the remote controller and the large-screen device 200 may be through infrared signals.

The server 300 is a provider of media content, and the media content that the user needs to play is stored in the server 300 . The server 300 may be a server that stores various media contents, such as a Huawei video server that provides audio and video services. The number of servers 300 may be one or more. The server 300 may also be implemented as a cloud server.

In this embodiment of the present application, the server 300 is also a DMS in the DLAN standard. The server 300 can not only provide media content for the electronic device 100 and the large-screen device 200, but also provide functions such as video management, video projection and arrangement, and video recommendation. Specifically, the server 300 recommends a series of related videos according to the playlist created by the user, integrates the URLs of each video and the related videos in the playlist into a new URL, and then sends the new URL to the electronic device.

CDN400 is an intelligent virtual network built on the basis of the existing network, relying on edge servers deployed in various places, through the load balancing, content distribution, scheduling and other functional modules of the central platform, so that users can obtain the desired content nearby, reducing network congestion, Improve user access response speed and hit rate. The key technologies of CDN400 mainly include content storage and distribution technologies. In the embodiment of the present application, the CDN 400 is mainly responsible for storing the URL of the video, obtaining the corresponding video from the server 300 according to the URL, and sending the video to the large-screen device in the form of streaming media.

Based on the above introduction to the screen projection system 10 provided by the embodiments of the present application, it is convenient for users to have a deeper understanding of the screen projection methods provided by the embodiments of the present application. Next, the software and hardware structures of the devices involved in the screen projection system 10 are described in detail.

FIG. 3A shows a schematic diagram of the hardware structure of the electronic device 100 .

Taking a smartphone as an example, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, key 190, motor 191, indicator 192, camera 193, a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195 and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.

It can be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100 . In other embodiments of the present application, the electronic device 100 may include more or less components than shown, or combine some components, or separate some components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

The controller may be the nerve center and command center of the electronic device 100 . The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the electronic device 100 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA) and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 . In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the same device as at least part of the modules of the processor 110 .

The wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellites Wireless communication solutions such as global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared technology (IR). The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , demodulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .

In this embodiment of the present application, the wireless communication module 160 may be configured to establish a communication connection with the server 300, and request the server 300 to obtain a new URL based on the communication connection.

The wireless communication module 160 is further configured to establish a communication connection with the large-screen device 200, and push the new URL generated by the server 300 to the large-screen device 200 based on the communication connection. In addition, based on the communication connection between the wireless communication module 160 and the large-screen device 200, the user can perform operations such as pause/continue, double-speed, fast-forward, etc. on the currently playing video in the video application program on the electronic device side to realize the large-screen device. Pause/Resume, Double Speed, Fast Forward the currently playing video. The communication connection may be the aforementioned DLAN connection or Bluetooth connection.

In some embodiments, the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc. The GNSS may include global positioning system (global positioning system, GPS), global navigation satellite system (global navigation satellite system, GLONASS), Beidou navigation satellite system (beidou navigation satellite system, BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite based augmentation systems (SBAS).

The electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

Display screen 194 is used to display images, videos, and the like. In this embodiment of the present application, the display screen 194 may display a user interface of a video application program in the electronic device 100 that is using the screen casting function. For example, the display screen 194 may be used to display the user interface of the Huawei Video application currently running on the electronic device 100 .

The internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM).

Touch sensor 180K, also called "touch panel". The touch sensor 180K may be disposed on the display screen 194 , and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to touch operations may be provided through display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 , which is different from the location where the display screen 194 is located.

The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The embodiments of the present application take an Android system with a layered architecture as an example to exemplarily describe the software structure of the electronic device 100 .

FIG. 3B is a block diagram of the software structure of the electronic device 100 provided by the embodiment of the present application.

The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, which are, from top to bottom, an application layer, an application framework layer, an Android runtime (Android runtime) and a system library, and a kernel layer.

The application layer can include a series of application packages.

As shown in FIG. 3B, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, video applications, and the like.

The video applications in the embodiments of the present application provide audio and video services for the electronic device 100 . The electronic device 100 may run a video application, and obtain network video from a server corresponding to the video application. The number of video applications may be one or more, for example, Huawei Video may be included. The server corresponding to the video application refers to a server provided by the developer of the video application for managing the application and providing audio and video services for the application, such as the server 300 shown in FIG. 1 .

Video applications include modules such as projection sending, projection control, and projection list management. The screen projection sending module can establish a connection with the screen projection receiving module on the large screen device 200 for sending the new URL generated by the server 300 . The screen projection control module can be used by the user to control the state of the video playing on the large-screen device on the electronic device side, such as fast forward, pause, double speed, etc. Modules such as screencasting list management can support users to manually create playlists when screencasting.

The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

As shown in Figure 3B, the application framework layer may include a window manager, a content provider, a telephony manager, a resource manager, a notification manager, a view system, and the like.

A window manager is used to manage window programs. The window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, take screenshots, etc.

Content providers are used to store and retrieve data and make these data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, etc.

The phone manager is used to provide the communication function of the electronic device 100 . For example, the management of call status (including connecting, hanging up, etc.).

The resource manager provides various resources for the application, such as localization strings, icons, pictures, layout files, video files and so on.

The notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear automatically after a brief pause without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also display notifications in the status bar at the top of the system in the form of graphs or scroll bar text, such as notifications of applications running in the background, and notifications on the screen in the form of dialog windows. For example, text information is prompted in the status bar, a prompt sound is issued, the electronic device vibrates, and the indicator light flashes.

The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. View systems can be used to build applications. A display interface can consist of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.

Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.

The core library consists of two parts: one is the function functions that the java language needs to call, and the other is the core library of Android.

The application layer and the application framework layer run in virtual machines. The virtual machine executes the java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, safety and exception management, and garbage collection.

A system library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.

The Surface Manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

The media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is the layer between hardware and software. The kernel layer contains at least display drivers, camera drivers, audio drivers, and sensor drivers.

Referring to FIG. 4A , FIG. 4A is a schematic diagram of a hardware structure of a large-screen device 200 according to an embodiment of the present application.

As shown in FIG. 4A, the large-screen device 200 may include: a video codec 121, a processor 122, a memory 123, a wireless communication processing module 124, a power switch 125, a wired LAN communication processing module 126, a high-definition multimedia interface (high-definition multimedia interface) definition multimedia interface, HDMI) communication processing module 127, USB communication processing module 128, display screen 129, audio module 130. The individual modules can be connected via a bus. in:

The processor 122 may be used to read and execute computer readable instructions. In a specific implementation, the processor 122 may mainly include a controller, an arithmetic unit and a register. Among them, the controller is mainly responsible for instruction decoding, and sends out control signals for the operations corresponding to the instructions. The arithmetic unit is mainly responsible for performing fixed-point or floating-point arithmetic operations, shift operations, and logical operations, and can also perform address operations and conversions. Registers are mainly responsible for saving register operands and intermediate operation results temporarily stored during instruction execution. In a specific implementation, the hardware architecture of the processor 122 may be an application specific integrated circuit (ASIC) architecture, a MIPS architecture, an ARM architecture, an NP architecture, or the like.

In this embodiment of the present application, the processor 122 may be configured to parse a signal received by the wireless communication processing module 124, such as a new URL sent by the electronic device 100, and acquire multiple videos and associated videos in the playlist according to the new URL.

The wireless communication processing module 124 may include a WLAN communication processing module 124A, and may further include a Bluetooth (BT) communication processing module 124B, an NFC processing module 124C, a cellular mobile communication processing module (not shown), and the like.

In this embodiment of the present application, the wireless communication processing module 124 may be configured to establish a communication connection with the electronic device 100, and receive a new URL sent by the electronic device 100 and generated by the server 300 based on the communication connection. The communication connection established between the wireless communication processing module 124 and the electronic device 100 may be various. For example, the WLAN communication processing module 124A can be used to establish a Wi-Fi Direct communication connection with the electronic device 100, the Bluetooth (BT) communication processing module 124B can be used to establish a Bluetooth communication connection with the electronic device 100, and the NFC processing module 124C can be used to establish a Bluetooth communication connection with the electronic device 100 establishes an NFC connection and so on.

In this embodiment of the present application, the wireless communication processing module 124 may also be configured to establish a communication connection with the CDN 400, and receive a video stream sent by the CDN 400 based on the communication connection. The communication connection established by the wireless communication processing module 124 and the CDN 400 may perform data transmission based on the HTTP protocol, and the present application does not impose any restrictions on the communication connection type and data transmission protocol between the devices.

Memory 123 is coupled to processor 122 for storing various software programs and/or sets of instructions. In specific implementations, memory 123 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The memory 123 can store operating systems, such as embedded operating systems such as uCOS, VxWorks, RTLinux, and the like. The memory 123 may also store communication programs that may be used to communicate with the electronic device 100, one or more servers, or additional devices.

The power switch 125 can be used to control the power supply of the power supply to the large screen device 200 .

The wired LAN communication processing module 126 can be used to communicate with other devices in the same LAN through the wired LAN, and can also be used to connect to the WAN through the wired LAN, and can communicate with the devices in the WAN.

The HDMI communication processing module 127 may be used to communicate with other devices through an HDMI interface (not shown).

The USB communication processing module 128 may be used to communicate with other devices through a USB interface (not shown).

Display screen 129 may be used to display images, video, and the like. The display screen 129 may adopt a display screen such as LCD, OLED, AMOLED, FLED, and QLED. For the content displayed on the display screen 129, reference may be made to the related descriptions of the subsequent method embodiments.

In this embodiment of the present application, the display screen 129 can continuously play multiple videos according to the video streams of the multiple videos, such as the playlist and the associated video, which are received by the wireless communication module 124 from the server 300 .

Audio module 130 . The audio module 130 can be used to output audio signals through the audio output interface, so that the large-screen display device 200 can support audio playback. The audio module 130 can also be used to receive audio data through the audio input interface. The audio module 130 may include, but is not limited to, a microphone, a speaker, a receiver, and the like.

In some embodiments, the large-screen device 200 may further include a serial interface such as an RS-232 interface. The serial interface can be connected to other devices, such as audio amplifiers such as speakers, so that the display and audio amplifiers can cooperate to play audio and video.

It can be understood that the structure shown in FIG. 4A does not constitute a specific limitation on the large-screen device 200 . In other embodiments of the present application, the large-screen device 200 may include more or less components than shown, or combine some components, or separate some components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The software system of the large-screen device 200 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture, and so on. Exemplarily, the software system of the large-screen device 200 may include but is not limited to

Linux or other operating systems.

For Huawei's Hongmeng system.

As shown in FIG. 4B , the software system of the large-screen device 200 may include a screen projection receiving module and a screen projection playing module. The screen projection receiving module can establish a communication connection with the electronic device 100. Based on the communication connection, the large-screen device 200 can receive a new URL, and then obtain the independent URLs of each video and the associated video in the playlist according to the new URL, so as to continuously Play the video.

FIG. 5A shows the hardware structure of a server 300 for providing a video service according to an embodiment of the present application.

As shown in FIG. 5A , server 300 may include: one or more processors 301 , memory 302 , communication interface 303 , transmitter 305 , receiver 306 , coupler 307 , and antenna 308 . These components may be connected through a bus 304 or in other ways, and FIG. 5A takes the connection through a bus as an example. in:

The communication interface 303 can be used for the server 300 to communicate with other communication devices, such as the electronic device 100 , the large-screen device 200 , and the CDN 400 . Specifically, the communication interface 303 may be a 3G communication interface, a Long Term Evolution (LTE) (4G) communication interface, a 5G communication interface, a WLAN communication interface, a WAN communication interface, and the like. Not limited to the wireless communication interface, the server 300 may also be configured with a wired communication interface 303 to support wired communication, for example, the backhaul link between the server 300 and other servers may be a wired communication connection.

In some embodiments of the present application, the transmitter 305 and the receiver 306 may be regarded as a wireless modem. The transmitter 305 can be used for transmitting and processing the signal output by the processor 301 . A receiver 306 may be used to receive signals. In the server 300, the number of the transmitter 305 and the receiver 306 may be one or more. Antenna 308 may be used to convert electromagnetic energy in a transmission line to electromagnetic waves in free space, or to convert electromagnetic waves in free space to electromagnetic energy in a transmission line. The coupler 307 can be used to divide the mobile communication signal into multiple paths for distribution to a plurality of receivers 306 . It will be appreciated that the antenna 308 of the network device may be implemented as a large scale antenna array.

Memory 302 is coupled to processor 301 for storing various software programs and/or sets of instructions. Specifically, memory 302 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.

The memory 302 may store an operating system (hereinafter referred to as a system), such as an embedded operating system such as uCOS, VxWorks, and RTLinux. The memory 302 can also store a network communication program, and the network communication program can be used to communicate with the electronic device 100 and the large-screen device 200 .

In this embodiment of the present application, the memory 302 may store a user account of a registered user of a video application program, such as a user name, an avatar, a mobile phone number, and the like.

In this embodiment of the present application, the processor 301 may be configured to read and execute computer-readable instructions. Specifically, the processor 301 may be configured to call a program stored in the memory 302, such as an implementation program on the server 300 side of the screen projection method for continuously playing video provided by one or more embodiments of the present application, and execute the program included in the program instruction.

It should be noted that the server 300 shown in FIG. 5A is only an implementation manner of the embodiment of the present application. In practical applications, the server 300 may further include more or less components, which is not limited here.

As shown in FIG. 5B , the software system of the server 300 may include an origin site, a video recommendation module, and a video projection and arrangement module.

The origin site is used to store the original video file, and can be used to obtain the video stream of the corresponding video according to the URL of the video when the large-screen device 200 requests to play the video through the CDN 400 . In this embodiment of the present application, the URL points to the storage location of the video in the source site.

The video recommendation module is used to recommend a series of videos associated with the videos in the playlist sent by the electronic device 100 according to certain recommendation rules in response to the screen projection request of the electronic device 100, wherein the recommendation rules can be described in detail with reference to the following, I won't go into details here

The video projection screen arrangement module is used to generate a new URL corresponding to the multiple videos in the playlist and the associated video, and store the new URL in the origin site.

Based on the foregoing schematic diagram of the screen projection system 10 shown in FIG. 2 , the hardware and software structure diagrams of the electronic device 100 shown in FIGS. 3A and 3B , and the software and hardware structure diagrams of the large-screen device 200 shown in FIGS. 4A and 4B , And the schematic diagram of the software and hardware structure of the server 300 shown in FIG. 5A and FIG. 5B, next, in conjunction with the flowchart and user interface of the screen projection method for continuously playing video provided by Embodiment 1, Embodiment 2, and Embodiment 3 of the present application, to The screen projection methods respectively provided by the three embodiments of the present application are described in detail.

Example 1

In Embodiment 1, the electronic device 100 may create a playlist in response to a user operation, and then send the playlist to the server 300 that provides video services, and the server 300 recommends a series of related videos according to the playlist, and generates the playlist The corresponding new URLs of the respective videos and associated videos in the system are then sent to the electronic device 100 . The electronic device 100 can push the new URL to the large-screen device 200 based on the communication connection with the large-screen device 200, and the large-screen device 200 can obtain each video and associated video in the playlist according to the new URL, so as to realize Play the video continuously. Therefore, the large-screen device can realize the continuous playback of multiple videos, and during this process, there is no need to maintain a communication connection between the electronic device and the large-screen device. In this way, after each video is played, the continuous playback of another video no longer depends on the real-time online control of the electronic device. The problem that the screen device cannot play continuously.

For the specific method flow, please refer to the detailed description below.

FIG. 6 exemplarily shows the flow of the screen projection method provided in Embodiment 1 of the present application. The following is a detailed introduction:

S101, the electronic device 100 enables the "automatic continuous screen projection" function.

FIG. 7A exemplarily shows a user interface 710 of the electronic device 100 to enable the "automatic continuous screen projection" function.

The user interface 710 is a setting interface provided by a video application program. The setting interface may include a control provided to the user for enabling/disabling the "automatic continuous screen projection" function of the electronic device 100. The user operates to enable the "automatic continuous screen projection" function of the electronic device 100 .

As shown in FIG. 7A , the screen projection setting bar 711 in the user interface 710 includes a control 711A, and the control 711A is used to enable/disable the “automatic continuous screen projection” function. For example, the electronic device 100 may turn on the "automatic continuous screen projection" function of the electronic device 100 in response to the operation acting on the control 711A as shown in FIG. 7A .

It can be understood that the user interface 710 shown in FIG. 7A is a setting interface of any video application program that can provide a screen projection function. Exemplarily, the video application may be Huawei Video. It can be understood that, FIG. 7A only exemplarily shows a user interface of the electronic device 100, which should not constitute a limitation to the embodiments of the present application.

Not limited to the manner of enabling the "automatic continuous screen projection" function shown in FIG. 7A , the electronic device 100 may also enable the "automatic continuous screen projection" function in other manners. For example, the electronic device 100 can also enable the "automatic continuous screen projection" function in response to a control provided by the user on the system setting interface, or enable the "automatic continuous screen projection" function in response to a voice command, or the electronic device 100 enables the "automatic continuous screen projection" function by default. screen” function.

"Automatic continuous screen projection" may be a service or function provided by the electronic device 100, which may support the electronic device 100 to obtain URLs of multiple videos, so that the large-screen device 200 can continuously play videos. The specific implementation of the electronic device 100 acquiring the URLs of multiple videos is as follows:

In some embodiments, the "automatic continuous screen projection" can support the video application in the electronic device 100 to provide a series of videos for the user to select. The end 300 obtains the video URL in the first playlist. Among them, the video application program provides a strategy for videos that can be selected by the user, and, for the specific process of creating the first playlist by the user, please refer to the detailed description of FIG. 7B-FIG. 7D later, and the content of the first playlist can refer to Detailed description in Table 1 below. The first playlist is also the aforementioned playlist.

In other embodiments, "automatic continuous screen projection" can support the electronic device 100 to connect directly via Wi-Fi (such as Wi-Fi p2p), or cellular mobile communication technologies such as 3G, LTE, and 5G, or a wide area network (wide area network). network, WAN) technology to transmit data to a cloud device (eg, server 300 ) that the electronic device 100 can access. For example, the electronic device 100 may request the server 300 to recommend a series of videos related to the videos in the first playlist, and the server 300 may, in response to the request of the electronic device 100, recommend a series of related videos according to certain recommendation rules to form a second playlist, and then Get the video URL in the second list. The rules for recommending related videos and the content of the second playlist may refer to the detailed description of step S104 and Table 1 below.

It can be understood that "automatic continuous screen projection" is only a word used in this embodiment, and its representative meaning has been recorded in this embodiment, and its name does not constitute any limitation to this embodiment. In addition, in some other embodiments of the present application, "automatic continuous screen projection" may also be referred to as other terms such as "continuous screen projection".

S102, the electronic device 100 creates a first playlist.

The first playlist contains relevant information of one or more videos, such as video name, video category, playing time and so on.

7B-7D exemplarily illustrate a user interface 720 for the electronic device 100 to create a first playlist.

The user interface 720 shown in FIG. 7B may be a user interface displayed when the user selects any video provided by the video application program to play. For example, the user interface displayed by the user selecting the video A provided by Huawei Video to play.

As shown in FIG. 7B , the user interface 720 displays a play window 721 . The playback window 721 includes: a return control 721A, a favorite icon 721B, a screen projection icon 721C, a playback pause/resume control 721E, a playback progress bar 721F, and a full-screen playback icon 721G. in:

When the electronic device 100 detects that the user clicks the screen projection icon 721C, that is, after the electronic device 100 detects that the user has enabled the "screen projection" function, the electronic device 100 pops up a window 725 as shown in FIG. 7C .

As shown in FIG. 7C, window 725 includes: prompt information 725A, cancel control 725B, create control 725C, icons for videos (eg, video A, video B, video C, video D, etc.).

It can be understood that the above video icons are only examples, which are not limited in this embodiment of the present application. The video corresponding to the video icon may be, the electronic device 100 recommends some related videos according to the web browsing records of users who log in to Huawei Video, or videos whose correlation degree with the currently playing video of Huawei Video exceeds a threshold, or a popular video with a high click rate. video. For example, if a user who logs in to Huawei Video has browsed some foreign drama videos, Huawei Video can recommend some foreign drama videos such as Video C and Video D. The videos whose relevance degree with the currently playing video exceeds the threshold includes: other series of videos related to one or more of the video category, video duration, video director, and actor of the currently playing video.

The prompt information 725A in the window 725 is used to prompt the user that the window is the window for creating the first playlist. The specific steps for creating the first playlist are as follows:

1. The user clicks the screen-casting icon 721C shown in FIG. 7B , and the electronic device 100 pops up a window 725 for creating a first playlist.

2. The user can click the video icon in the window 725. The first video icon in the window 725 is the icon of the video currently being played by the electronic device 100, so the first video is selected by default, and the videos that the user can select are a series of videos recommended by video applications. For example, the videos that the user can select include video B, video C, and video D.

The user can select a video by inputting a user operation (such as a click operation, a touch operation) on the video icon, and when the user selects the video icon, the selected video icon will display a number. The number represents the sequence number when the video is selected, and is also the sequence number corresponding to each video in the first playlist. In some embodiments, after the user selects a video icon, the electronic device may also display other things, for example, the selected video icon may be displayed with a shadow effect or the like.

FIG. 7C exemplarily shows the user interface before the user selects the video icon in the click window 725 . As shown in FIG. 7C , video A is the video currently being played by the electronic device 100 , so the video has been selected by default.

FIG. 7D exemplarily shows the user interface after the user clicks one or more video icons. For example, the user can also select video C and video D.

3. The user clicks the creation control 725C shown in FIG. 7D to create the first playlist. The first playlist may contain related information of one or more videos, such as video name, video category, playing time and so on. Referring to Table 1, Table 1 exemplarily shows the detailed content of the first playlist. The videos in the first list are sorted according to the order in which the video is being played by the electronic device and the user selects the relevant videos.

序号serial number	视频名称video name	视频类别video category		播放时长Play time
11	视频AVideo A	动画 animation	110分钟110 minutes
22	视频C Video C		爱情love	195分钟195 minutes
33	视频D Video D		亲情affection	120分钟120 minutes

Table 1

It is not limited to the case where the user selects one or more other video icons based on the default selected video icon as shown in Figs. 7C and 7D. In some other embodiments, the user may not select other video pictures, that is, the user may click the creation control 725C shown in FIG. 7C to create a screencast playlist. It can be understood that the manners shown in FIGS. 7B-7D are only examples, and in a specific implementation, the first playlist may also be created in other manners. For example, in response to the user clicking the screen casting icon 721C shown in FIG. 7B , the electronic device 100 may not pop up the window 725 for creating the first playlist. That is, the electronic device 100 can automatically create a first playlist, and the first playlist only has information related to the video being played in the current play window. In this way, the screen projection operation is simplified, which is more simple and convenient for the user, and improves the user experience of the screen projection.

S103, the electronic device 100 sends a first message to the server 300, where the first message is used to request the server 300 to obtain a new URL.

The electronic device 100 sends the first message to the server 300 based on the communication connection established with the server 300 . Based on the communication connection established with the server 300, the electronic device 100 can perform data transmission based on protocols such as TCP/UDP, and the present application does not impose any restrictions on the communication connection type and data transmission protocol between the devices.

The first message carries: a first playlist. The first message may also carry one or more of the following: the user ID of the video application program logged in the electronic device 100 or the ID of the electronic device 100 .

In some embodiments, the first message may further carry a flag bit or an information bit, which is used to instruct the first message to request the server 300 to recommend a series of videos related to the videos in the first playlist.

S104: After receiving the first message, the server 300 recommends a related video in response to the first message, and generates a second playlist.

Specifically, the server 300 may store a large number of videos, and in response to the received first message, the server 300 may recommend related videos according to certain recommendation rules, and generate a second playlist. The maximum upper limit of the number of associated videos recommended by the server 300 can be controlled through configuration.

The recommended rules can be of the following three types:

1. According to the first playlist, the server 300 may recommend a series of videos associated with the videos in the first playlist. For example, if the videos in the first playlist include video A, video C, video D, etc., animation and emotion videos, the server 300 may recommend animation and emotion videos such as video E and video F.

2. According to the first playlist and the user portrait, the server 300 may recommend related videos. Among them, the user portrait means that the server 300 can search a large amount of data (such as the user's web browsing content) stored in the database in the server 300 according to the user ID, analyze and mine, and affix a "tag" to the user, and the tag indicates that the user feature identification to generate user portraits. For example, after the server 300 receives the first message, in response to the first message, the server 300 can find the corresponding user portrait according to the user ID, and then according to the "tag" with the user characteristics recorded in the user portrait, for example, the user likes to watch Comedy, the server 300 may recommend comedy videos such as video G, and finally generate a second playlist.

3. According to the first playlist and the historical browsing records of users who log in to the video application, the server 300 may recommend some series of related videos. For example, if the user has browsed some war videos before, the server 300 may recommend war videos such as video H and video I.

The second playlist generated by the server 300 may include related information of one or more videos, such as video name, video category, playing time, etc., the one or more videos are the videos selected by the user in step S102, and the server 300 Recommended video. Referring to Table 2, Table 2 exemplarily shows the detailed content of the second playlist generated by the server 300 .

The order of the videos in the second playlist is in descending order according to the order of the videos in the first playlist and the degree of association with the associated videos recommended by the server 300 .

serial number

video name

video category

Play time

11	视频AVideo A	动画 animation	110分钟110 minutes
22	视频C Video C		爱情love	195分钟195 minutes
33	视频D Video D		亲情affection	120分钟120 minutes
44	视频EVideo E	爱情love	180分钟180 minutes
55	视频F Video F		动画animation	110分钟110 minutes

Table 2

It can be understood that, the video content included in the second playlist may be the same as the video content in the first playlist, or more than the video content in the first playlist. When the server does not recommend the associated video, or the associated video recommended by the server is the same as the video in the first playlist, the video content included in the second playlist is the same as the video content in the first playlist. When there are one or more related videos recommended by the server, and the recommended related videos are not exactly the same as the videos in the first playlist, the second playlist contains more video content than the first playlist. .

S105, the server 300 obtains the URL of each video in the second playlist.

The server 300 searches for the URL corresponding to each video according to the video information (for example, the video name) recorded in the second playlist. The server 300 stores a large number of videos and URLs corresponding to each video. Different URLs represent the storage locations of different videos in the origin site.

Specifically, the screen projection arrangement module sends the second playlist to the source station, so as to query the URL of each independent video in the second playlist. The origin site sends the URL of each independent video in the queried second playlist to the screen projection arrangement module.

S106, the server 300 generates a new URL.

Specifically, the server 300 integrates the original index files of the multiple videos in the second playlist, creates a new index file, and then generates a new URL corresponding to the new index file, and the new URL points to the multiple videos in the second playlist. The storage location of the video. The new index file contains all the segment files that make up the above multiple videos.

For the process of creating a new index file by the server 300, reference may be made to FIG. 7E, which exemplarily shows a schematic diagram of the server 300 creating a new index file.

Among them, each video is composed of multiple segment files, for example, a video with a playback duration of 10 minutes may be composed of 10 segment files with a duration of 1 minute. The duration of the segmented file is not unique, it is determined by the settings during video compression. The index file contains: the identification of the video, and related information such as identification, quantity, order and so on of the segment files that make up the video.

S107 , the server 300 sends the new URL to the electronic device 100 .

The server 300 transmits the new URL to the electronic device 100 based on the communication connection with the electronic device 100 . The communication connection is a network communication connection, and data transmission can be performed based on the HTTP protocol. This application does not impose any restrictions on the communication connection type and data transmission protocol between devices.

S108 , the electronic device 100 sends a new URL to the large-screen device 200 .

The electronic device 100 sends a new URL to the large-screen device 200 based on the communication connection established with the large-screen device 200 . The communication connection may include, but is not limited to, the aforementioned: Wi-Fi P2P communication connection, Bluetooth communication connection, and the like. The communication connection is used for screen projection between the electronic device 100 and the large-screen device 200 .

For the process of establishing a communication connection between the electronic device 100 and the large-screen device 200, reference may be made to the detailed description below.

In some embodiments, in response to the electronic device 100 detecting that the user clicks the creation control 725C as shown in FIG. 7C to create the first playlist, the electronic device 100 displays the electronic device 100 and the large-screen device exemplarily shown in FIG. 7F . 200 A user interface for establishing a communication connection.

In other embodiments, in response to the electronic device 100 detecting that the user clicks the screen-casting icon 721C shown in FIG. 7B , the electronic device 100 displays that the electronic device 100 exemplarily shown in FIG. 7F establishes a communication connection with the large-screen device 200 user interface.

When the electronic device 100 turns on one or more of WLAN and Bluetooth in the wireless communication module 160, and can discover the nearby electronic device 100 through one or more wireless communication technologies of Wi-Fi Direct, Bluetooth, and NFC A large screen device that can be mirrored. For example, the electronic device 100 may scan other nearby devices through Wi-Fi Direct technology, and discover the nearby large-screen device 200 and other large-screen devices (eg, "TV in the living room" shown in FIG. 7F ).

As shown in FIG. 7F, the window 726 may display an interface indicator 726A, an icon 726B, an image 726C of a large-screen device discovered by the electronic device, and a logo 726D.

The interface indicator 726A is used to indicate that the content displayed in the window 726 is the information of the large-screen device discovered after the first playlist is created. The icon 726B is used to indicate that the electronic device 100 is still discovering other surrounding large-screen devices. When the electronic device 100 has not found a nearby large-screen device, the number of large-screen devices displayed in the window 726 is 0. The image 726C and/or the logo 726D may receive a user operation (eg, a touch operation), and in response to the user operation, the electronic device 100 may initiate a request to establish a communication connection to the large-screen device corresponding to the image 726C and/or the logo 726D.

In some embodiments, the electronic device 100 may display the user interface 720 as shown in FIG. 7C after the user clicks the image 726C and/or the logo 726D as shown in FIG. 7F , and then may select as shown in FIG. 7C . icon of the video (eg, video A, video B, video C, video D, etc.), and click the create control 725C as shown in FIG. 7D.

In some embodiments, the large-screen device 200 may display a user interface 730 displayed on the display screen after the large-screen device 200 receives the request for establishing the first communication connection sent by the electronic device 100 as exemplarily shown in FIG. 7G . The user interface 730 displays a window 731 . The window 731 is used to prompt the user electronic device 100 to request the establishment of the first communication connection. The large-screen device 200 can detect the operation of determining to establish a communication connection with the electronic device 100. For example, as shown in FIG. 7G, the user clicks the control 731A through the remote control. communication connection. Or, the large-screen device 200 detects an operation of refusing to establish a communication connection with the electronic device 100 . For example, as shown in FIG. 7F , the user clicks the control 731B through the remote control. In response to this operation, the large-screen device 200 refuses to establish a communication connection with the electronic device 100 Establish a communication connection.

It is not limited to the manner of establishing a communication connection between the electronic device 100 and the large-screen device 200 shown in FIG. 7B-FIG. 7G. In other embodiments, the communication connection may also be established in other manners, which is not limited here. For example, the large-screen device 200 may provide an NFC tag, and the NFC tag carries the identification (eg, MAC address) of the large-screen device 200. When the user brings the electronic device 100 close to the large-screen device 200, the electronic device 100 can read the NFC tag. The identifier in the NFC tag, and directly establishes a communication connection with the large-screen device 200 corresponding to the identifier. The communication connection may also be a Wi-Fi P2P connection, a Bluetooth connection, an NFC connection, and the like.

S109, the large-screen device 200 obtains the video included in the second playlist from the server 300 through the CDN 400 according to the received new URL, and continuously plays the video.

The new URL sent by the large-screen device 200 to the CDN 400, and the CDN 400 searches for the corresponding video in the original video stored in the server 300 according to the new URL. The server 300 sends the searched video to the CDN 400 in the form of streaming media, and the CDN 400 then sends the video to the large-screen device 200 in the form of streaming media. The large-screen device 200 plays the video in real time.

Specifically, the source station in the server 300 sequentially sends the video stream to the CDN 400 in the order in the second playlist, and the CDN 400 sends the video stream to the large-screen device 200 . The large-screen device 200 plays the video while receiving. The videos played by the large-screen device 200 are multiple videos in the second playlist. During the process of playing the multiple videos on the large-screen device 200, the multiple videos are continuously played in the order of the videos in the second list. Saying it is equivalent to playing a new, longer video composed of multiple videos above.

FIG. 8 exemplarily shows a user interface 810 in which the large-screen device 200 plays a video. FIG. 8 includes a playback progress bar 811 and a resume/pause playback control 812 . The playback progress bar 811 may prompt the user of the current video playback progress. The resume/pause control 812 can resume/pause the current video on a large-screen device.

In the process of playing the video on the large-screen device 200, the user can manipulate the large-screen device 200 to make the large-screen device 200 perform any one of the following operations: pause/continue/fast-forward/double-speed play the video in the second playlist. These manipulations may be implemented by a user acting on a video application program on the electronic device 100 or a remote controller adapted to the large-screen device. Wherein, the remote control and the large-screen device 200 can communicate through infrared signals.

In some embodiments, the large-screen device 200 can be a touch screen, and the user can pause/resume video playback on the large-screen device 200 by touching controls such as the resume/pause control 812 of the large-screen device 200 .

In some embodiments, step S104 is an optional step. For example, after the user selects one or more videos to create the first playlist, the server 300 may not provide the service of recommending related videos. The server 300 only generates a new URL corresponding to the video in the first playlist created by the user, and sends the new URL to the electronic device 100 . In this way, the workload of the server is reduced, the screen projection delay is reduced, and the screen projection efficiency is improved.

It can be seen that in the screen projection method for continuously playing videos provided in Embodiment 1, the server 300 recommends a series of associated videos according to the first playlist, and generates new URLs corresponding to each video in the first playlist and the associated videos , after the user only performs the screen projection operation on the electronic device 100, the electronic device 100 can send a new URL including multiple videos to the large-screen device 200 at one time, and the large-screen device 200 can realize the continuous playback of multiple videos , and there is no need to maintain a communication connection between the electronic device and the large-screen device during this process. In this way, after each video is played, the continuous playback of another video no longer depends on the real-time online control of the electronic device. The problem that the screen device cannot play continuously.

In this embodiment of the present application, the first operation may be an operation in which the user clicks the screen projection icon 721C shown in FIG. 7B , and in response to the first operation, the electronic device 100 establishes a communication connection with the large-screen device 200 selected by default;

Alternatively, the first operation may also be an operation in which the user clicks the screen projection icon 721C shown in FIG. 7B on the electronic device 100, and the user clicks the image 726C and/or the logo 726D shown in FIG. 7F .

In this embodiment of the present application, the second operation may be to select the icon of a video (eg, video A, video B, video C, video D, etc.) as shown in FIG. 7C and then click the create control 725C shown in FIG. 7D .

When the first operation is the operation of the user clicking the screen-casting icon 721C shown in FIG. 7B , the second operation may be performed after the user clicks the screen-casting icon 721C shown in FIG. 7B .

When the first operation is the operation of the user clicking the screen projection icon 721C shown in FIG. 7B , and the user clicking the image 726C and/or the logo 726D shown in FIG. 7F , the second operation can be performed when the user clicks the image 726C and/or the logo 726D shown in FIG. 7F . It is performed after the user clicks the image 726C and/or the logo 726D shown in FIG. 7B , or after the user clicks the image 726C and/or the logo 726D as shown in FIG.

In this embodiment of the present application, the third operation may be that during the process of playing a video on the large-screen device 200, the user acts on the large-screen device 200 through a remote controller adapted to the large-screen device 200, and triggers the large-screen device to perform any one of the following Actions: Pause/Resume/Fast-Forward/Double-speed play the video in the second playlist. For example, control the operation of the remote control to click the resume/pause playback control 812, so as to realize the large-screen device 200 to pause/resume playing the video and the like. The third operation may also be an operation of touching controls such as the resume/pause control 812 of the large-screen device 200 .

In this embodiment of the present application, the first video is any video in the second playlist, and the second video is any video after the first video in the sequence of the second playlist.

In this embodiment of the present application, the third video is the video A currently being played by the electronic device 100 .

In this embodiment of the present application, the video options displayed by the electronic device 100 before sending the first information to the large-screen device may include the videos shown in FIG. 7D recommended by the electronic device 100 (for example, video A, video B, icon for Video C, Video D, etc.).

In this embodiment of the present application, the fourth video may be the video selected by the user in the user interface shown in FIG. 7D , for example, the video corresponding to the video icon receiving the second operation in FIG. 7D , such as the video A shown in FIG. 7D . , video C, video corresponding to the video icon of video D.

In this embodiment of the present application, the fifth video is a video recommended by the server 300, such as video E and video F in Table 2.

Example 2

In Embodiment 2, the server 300 may generate a projection interpretation file containing URLs of multiple independent videos. During the screen projection process, the electronic device 100 directly sends the URL of the screen projection interpretation file to the large-screen device 200 . After the large-screen device 200 downloads the screen-casting interpretation file according to the URL of the screen-casting interpretation file, it continuously plays the videos in the second playlist and displays related information based on the URLs and related information of the multiple videos in the second playlist in the interpretation file. information.

FIG. 9 exemplarily shows the flow of the screen projection method provided in Embodiment 2 of the present application. The following is a detailed introduction:

Wherein, for steps S201-S205, reference may be made to steps S101-S105 in Embodiment 1, and details are not described here for the time being.

S206, the server 300 generates a screen projection interpretation file.

The server 300 organizes the obtained URLs of the multiple videos in the second playlist to generate a screen projection interpretation file. Other relevant information in the screen projection interpretation file may include one or more of the following: the version number of the screen projection interpretation file, the number of multiple videos, the respective durations of the multiple videos, the total duration of the multiple videos, the multiple videos The playback mode (sequential playback, loop playback), the playback sequence of multiple videos, the video names of multiple videos, or the URLs corresponding to multiple videos.

Wherein, when the version numbers of the screen projection interpretation files are different, the formats of the text files of the screen projection interpretation files or the contents contained therein are different. For example, the screencasting interpretation file for version 1.0 can be a text file containing the following contents:

Screencasting explanation file version number: version 1.0.

The total number of videos in the playlist of this screencast: 2.

The total length of the video in the playlist of this screencast: 305 minutes.

Play Mode: Loop playback.

Play Video 1: Video A.

URL of Video A: http://13579.

Play Video 2: Video C.

URL of video C: http://24680.

The order of playing videos defined by the screen projection interpretation file may be sorted according to the order of the videos selected by the user in step S102 and the relatedness of the related videos recommended by the server 300 in descending order.

It can be understood that, the foregoing screen projection interpretation file may also include other content, which is not limited in this embodiment of the present application.

S207, the server 300 stores the screen projection interpretation file.

The server 300 stores the generated screen projection interpretation file in the origin site, so as to obtain the URL of the screen projection interpretation file on the origin site. It is convenient for the large-screen device 200 to download the screen-casting interpretation file from the source site through the CDN 400 according to the URL of the screen-casting interpretation file.

S208 , the server 300 sends the URL of the screen projection interpretation file to the electronic device 100 .

Based on the communication connection with the electronic device 100 , the server 300 sends the URL of the screencasting interpretation file to the electronic device 100 . The URL of the screen projection interpretation file points to the storage location of the screen projection interpretation file in the server 300 .

S209 , the electronic device 100 sends the URL of the screen projection interpretation file to the large-screen device 200 .

Based on the communication connection established with the large-screen device 200 , the electronic device 100 sends the large-screen device 200 the URL of the screen-casting interpretation file. The communication connection may include, but is not limited to, a Wi-Fi P2P communication connection, a Bluetooth communication connection, and the like.

For the process of establishing a communication connection between the electronic device 100 and the large-screen device 200, reference may be made to the foregoing related descriptions. I won't go into details here.

S210, the large-screen device 200 obtains the screen-casting interpretation file from the server 300 through the CDN 400 according to the screen-casting interpretation file URL.

The large-screen device 200 sends the screencasting interpretation file URL to the CDN 400, and the CDN400 searches the media content stored in the server 300 for the corresponding screencasting interpretation file according to the URL of the screencasting interpretation file, and then sends the searched screencasting interpretation file to Large screen device 200.

S211, the large-screen device 200 parses the screen projection interpretation file.

The large-screen device 200 parses the received screen projection interpretation file, reads the URLs of multiple independent videos in the second playlist, and other related information. For example, a large-screen device can read the screen projection interpretation file. The total number of playback videos is 2, the total video playback time is 315 minutes, the video playback mode is loop playback, the first played video is video A, and the first played video The URL of the video is http://13579, and the second played video is video C. The URL of the second played video is http://24680.

S212 , the large-screen device 200 obtains the video stream from the server 300 through the CDN 400 according to the URL of the first video played through the analysis.

Based on the communication connection with the CDN 400, the large-screen device 200 sends the URL of the first playing video in the read screen projection interpretation file to the CDN 400. The CDN 400 searches the media content stored in the server 300 for the corresponding video according to the URL of the first video, and then the CDN 400 sends the first played video to the large-screen device 200 in the form of streaming media. The large-screen device 200 plays the video in real time.

The first video is the first video defined in the video playback order in the projection interpretation file, for example, the first video can be video A.

S213, the large-screen device 200 plays the first video and displays other related information.

FIG. 10A exemplarily shows a user interface 1010 for the large-screen device 200 to play a video. The first video played by the large-screen device 200 is the first video in the second playlist, for example, video A.

FIG. 10A includes an interface indicator 1011 , a playback progress bar 1012 , a resume/pause playback control 1013 , and a screen projection detail control 1014 . The interface indicator 1011 is used to indicate the name of the video currently being played on the large-screen device. The playback progress bar 1012 may prompt the user of the current video playback progress. The resume/pause control 1013 can resume/pause the current video on a large-screen device. The screen projection details control 1014 is used to view other related information defined in the screen projection interpretation file, such as the number of videos in the second playlist, the total duration of video playback, video playback mode (sequential playback, loop playback), video playback sequence number, and the like.

When the large-screen device 200 detects that the user clicks the screen projection details control 1014 shown in FIG. 10A through the remote control, the large-screen device 200 will pop up the window 1015 shown in FIG. 10B in the user interface 1010 .

As exemplarily shown in FIG. 10B , the window 1015 includes the playback sequence number and video option 1015A of the videos in the second playlist, the number of videos 1015B, the playback order 1015C, the playback mode 1015D, and the playback duration 1015E.

It can be understood that the window 1015 in which the large-screen device 200 displays the relevant information in the second playlist may not be implemented by clicking the screen projection details control 1014 shown in FIG. 10A . For example, the large-screen device 200 may directly display the window 1015 in the user interface 1010 as shown in FIG. 10A .

S214 , the large-screen device 200 monitors the playing state of the current video, and after the video is played, plays the next video of the currently playing video in the second playlist.

The large-screen device 200 monitors the playback status of the currently playing video in real time. When the large-screen device 200 monitors the current video playback end event, the large-screen device 200 automatically obtains the video stream of the next playing video from the server 300 through the CDN 400 and plays it. .

Specifically, the large-screen device 200 sends the URL of the next video to the CDN 400 . The CDN 400 searches the source site of the server 300 for a corresponding video according to the URL, and then sends the video to the large-screen device 200 in the form of streaming media. The large-screen device 200 receives the video stream and plays the video in real time.

FIG. 10C exemplarily shows a user interface 1010 for continuously playing the next video when the large-screen device monitors the current video playback end event. For example, the playback of the current video A ends, and the next video, such as video C, is continuously played.

FIG. 10C includes icon 1016 , icon indicator 1017 . The icon 1016 indicates that the next playing video is being acquired, and the icon indicator 1017 is used to indicate the name of the next playing video, such as video C.

S215, the large-screen device 200 receives the user operation, and changes the video playback order in the second playlist.

When the user clicks the play sequence 1015C in the window 1015 shown in FIG. 10B through the remote control and presses the left/right button, the large-screen device 200 pops up the window 1018 shown in FIG. Name identification, eg Video A 1018A, Video C 1018B, Video D 1018C, OK Control 1018D and Cancel Control 1018E. The user can click on the name identifiers of each video in sequence according to their own wishes, and click the OK control 1018D to adjust the playback order of the large-screen device 200 . For example, the user clicks the name identifiers of each video in sequence as video D1018C, video A1018A, and video C1018B, and clicks the OK control 1018D. Then the large screen device 200 will display the user interface 1010 as shown in FIG. 10E , and the video playback sequence numbers and their names in the actual window 1015 in the user interface 1010 become: 1 video D, 2 video A, 3 video C.

In some embodiments, in response to the user's operation of changing the playback order of the videos in the second playlist, the large-screen device 200 may play the videos according to the changed video playback order after the current video is played, or the large-screen device 200 can directly switch to play the first video in the changed video playback order, and then play the next video continuously according to the changed video playback order.

It can be understood that step S215 is an optional step, and the operation of changing the playback order of the videos in the second playlist in step S215 may not occur during the video playback process of the large-screen device 200 . That is to say, the large-screen device 200 may pop up a window before acquiring the URL of the first video in the default second playlist, and the window may display the content in the window 1015 as shown in FIG. 10B . action to change the second playlist order. The default video playback order in the second playlist is the video playback order defined in the screencasting interpretation file, and is also the video order in the second playlist before the user changes the second playlist order through an operation.

In addition to the above-mentioned operation that the user can change the video playback order, during the video playback process on the large-screen device 200, the user can also control the large-screen device 200, so that the large-screen device 200 performs any of the following operations:

The user clicks any video option in the window 1015 shown in FIG. 10B through the remote control, and the large-screen device 200 can jump and play the video.

When the user clicks the loop play in the window 1015 shown in FIG. 10B through the remote control and presses the left button, the play sequence changes from loop play to sequential play.

The user can manipulate the large-screen device 200 to pause/continue/fast-forward/double-speed play the video in the second playlist. These manipulations can be implemented by the user acting on a video application program on the end of the electronic device 100 or a remote controller adapted to the large-screen device. Wherein, the remote control and the large-screen device 200 can communicate through infrared signals.

It can be understood that FIGS. 10A to 10E are only for exemplarily describing the user interface of the large-screen device 200 provided by the embodiment of the present application for playing a video, and should not constitute a limitation to the embodiment of the present application.

It can be seen that in the screen projection method for continuously playing videos provided in Embodiment 2, the electronic device 100 directly sends the URL of the screen projection interpretation file generated by the server 300 to the large screen device 200, and the large screen device 200 interprets the file according to the URL of the screen projection interpretation file. After downloading the screen-casting interpretation file from the URL, based on the URLs and related information of multiple videos in the second playlist in the interpretation file, the videos in the second playlist are continuously played and related information is displayed, and during this process, the electronic device and the There is no need to maintain a communication connection between large-screen devices. In this way, after each video is played, the continuous playback of another video no longer depends on the real-time online control of the electronic device, which solves the problem that after the screen is projected, the communication connection between the electronic device and the large-screen device is disconnected. The device cannot play continuously.

In addition, the multiple videos continuously played by the large-screen device may be videos selected by the user and/or videos recommended by the server. At the same time, the large-screen device can not only display relevant information of the video in the second playlist during the video playback process, but the user can also operate the large-screen device to change the playback mode and playback order. In this way, by providing an entrance into the interactive experience, the user's personalized needs are further met, and the user's screen projection experience is improved.

Example 3

In Embodiment 3, the electronic device 100 may generate a screen projection interpretation file that includes URLs corresponding to multiple independent videos respectively. During the screen projection process, the electronic device 100 directly sends the screen projection interpretation file to the large-screen device 200 . The large screen device 200 parses the screen projection interpretation file, and based on URLs and related information of multiple videos in the second playlist included in the screen projection interpretation file, continuously plays the videos in the second playlist and displays relevant information. For the specific method flow, please refer to the detailed description below.

FIG. 11 exemplarily shows the flow of the screen projection method provided in Embodiment 3 of the present application. The following is a detailed introduction:

Wherein, for steps S301-S305, reference may be made to steps S101-S105 in Embodiment 1, and details are not described here for the time being.

S306, the server 300 sends the independent URL of each video in the second playlist to the electronic device 100.

Based on the communication connection with the electronic device 100 , the server 300 sends the URL of each independent video in the second playlist to the electronic device 100 .

In some embodiments, the server 300 may also send more information to the mobile phone from the electronic device 100 . For example, the server 300 may send the total number of videos in the second playlist, the total playing time of the videos, and so on.

S307, the electronic device 100 receives the URL of each independent video in the second playlist, and generates a screen projection interpretation file.

The electronic device 100 organizes the URLs of the multiple independent videos in the second playlist searched from the source site and generates a screen projection interpretation file. For the detailed definition of the screen projection interpretation file, reference may be made to the description of the foregoing step S206, which will not be repeated here.

S308 , the electronic device 100 sends the screen projection interpretation file to the large-screen device 200 .

The electronic device 100 sends a screen projection interpretation file to the large-screen device 200 based on the communication connection with the large-screen device 200 . The communication connection may include, but is not limited to, a Wi-Fi P2P communication connection, a Bluetooth communication connection, and the like.

S309, the large-screen device 200 receives the screen projection interpretation file, and parses the screen projection interpretation file.

The large-screen device 200 parses the received screen projection interpretation file, reads the URLs of multiple independent videos in the second playlist, and other related information. The screen projection interpretation file is parsed, and the specific description of the content therein can be read by referring to the foregoing step S211.

For the method for continuously playing videos by the large-screen device 200 in steps S310-S313, reference may be made to the detailed description of the foregoing steps S212-S215, which will not be repeated here.

It can be seen that in the screen projection method for continuously playing videos provided in Embodiment 3, by generating a screen projection interpretation file on the electronic device 100, after the user performs a screen projection operation on the electronic device 100, the electronic device 100 can convert the generated The screen projection interpretation file containing the URLs and related information of multiple independent videos in the second playlist is sent to the large-screen device 200, and the large-screen device 200 parses the screen projection interpretation file, and realizes continuous playback based on the URLs of the multiple independent videos. During this process, there is no need to maintain a communication connection between the electronic device and the large-screen device. In this way, after each video is played, the continuous playback of another video no longer depends on the real-time online control of the electronic device, which solves the problem that after the screen is projected, the communication connection between the electronic device and the large-screen device is disconnected. The device cannot play continuously.

Compared with Embodiment 2, Embodiment 3 adopts the method of generating a screen projection interpretation file by the electronic device 100 and passing it to the large-screen device 200, and the large-screen device 200 can directly parse the screen projection interpretation file. The method provided in Embodiment 3 saves the network space for the source site to store the screencasting interpretation file, and saves the time for the large-screen device 200 to obtain the screencasting interpretation file from the source site through the CDN 400, improves the screencasting playback efficiency, and further satisfies the user's casting requirements. screen requirements.

In this embodiment of the present application, the first information may be the new URL in step S108 in the above-mentioned embodiment 1, or the URL of the screen projection interpretation file in step S209 in the above-mentioned embodiment 2, or the URL in the above-mentioned embodiment 3. The screen projection interpretation file in step S308.

In this embodiment of the present application, the second information may be the new URL in step S107 in the above embodiment 1, or the URL of the screen projection interpretation file in step S208 in the above embodiment 2, or the URL in the above embodiment 3 The independent URL of each video in the second playlist in step S306.

An embodiment of the present application also provides an electronic device, the electronic device includes one or more processors and one or more memories; wherein, the one or more memories are coupled with the one or more processors, and the one or more memories are used for For storing computer program code, the computer program code includes computer instructions that, when executed by one or more processors, cause the electronic device to perform the methods described in the above embodiments.

The embodiments of the present application further provide a computer program product containing instructions, when the computer program product is run on the electronic device, the electronic device is made to execute the method described in the above embodiments.

The embodiments of the present application also provide a computer-readable storage medium, including instructions, when the instructions are executed on the electronic device, the electronic device is made to execute the method described in the foregoing embodiments.

It can be understood that the various embodiments of the present application can be arbitrarily combined to achieve different technical effects.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The computer program instructions, when loaded and executed on a computer, result in whole or in part of the processes or functions described herein. The computer may be a general purpose computer, special purpose computer, computer network, or other programmable device. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be downloaded from a website site, computer, server, or data center Transmission to another website site, computer, server, or data center by wire (eg, coaxial cable, optical fiber, digital subscriber line) or wireless (eg, infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes an integration of one or more available media. The usable media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk), and the like.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented. The process can be completed by instructing the relevant hardware by a computer program, and the program can be stored in a computer-readable storage medium. When the program is executed , which may include the processes of the foregoing method embodiments. The aforementioned storage medium includes: ROM or random storage memory RAM, magnetic disk or optical disk and other mediums that can store program codes.

In a word, the above descriptions are merely examples of the technical solutions of the present application, and are not intended to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of this application shall be included within the protection scope of this application.

Claims

A screen projection method capable of continuously playing videos, characterized in that the method is applied to a screen projection system, and the screen projection system includes an electronic device, a large-screen device, and a server, and the method includes:

The electronic device receives the first operation, and establishes a communication connection with the large-screen device in response to the first operation;

The electronic device sends first information to the large-screen device based on the communication connection, where the first information indicates storage locations of multiple videos in the server;

Disconnecting the communication connection between the electronic device and the large-screen device;

The large-screen device requests the server to acquire the plurality of videos according to the first information;

sending, by the server, the plurality of videos to the large-screen device;

The large-screen device plays the plurality of videos.
A screen projection method capable of continuously playing videos, characterized in that the method is applied to a screen projection system, and the screen projection system includes an electronic device, a large-screen device, and a server, and the method includes:

The electronic device receives the first operation, and establishes a communication connection with the large-screen device in response to the first operation;

The electronic device sends first information to the large-screen device based on the communication connection, where the first information indicates storage locations of multiple videos in the server;

The large-screen device requests the server to acquire the plurality of videos according to the first information;

sending, by the server, the plurality of videos to the large-screen device;

The large-screen device plays the first video of the plurality of videos;

Disconnecting the communication connection between the electronic device and the large-screen device;

The large-screen device continues to play the second video of the plurality of videos.
The method according to claim 1 or 2, wherein before the electronic device detects the first operation, the method further comprises: the electronic device plays a third video;

Before the electronic device sends the first information to the large-screen device based on the communication connection, the method further includes:

the electronic device displays a video option;

The electronic device receives a second operation, and the second operation acts on the option of the fourth video in the video options;

The electronic device sends the identifier of the third video and the identifier of the fourth video to the server;

The server sends second information to the electronic device, where the second information indicates the storage locations of the third video and the fourth video in the server;

The multiple videos in the first information include the third video and the fourth video.
The method according to any one of claims 1-3, wherein before the electronic device sends the first information to the large-screen device based on the communication connection, the method further comprises:

sending, by the electronic device, the identifier of the third video to the server;

The server determines the fifth video, and sends second information to the electronic device, where the second information indicates the storage locations of the third video and the fifth video in the server;

The multiple videos in the first information include the third video and the fifth video.
The method according to any one of claims 1-4, wherein the first information is a first uniform resource locator URL, and the first URL corresponds to the URL of the plurality of videos in the server. storage location:

Before the electronic device sends the first information to the large-screen device based on the communication connection, the method further includes:

The server generates the first URL according to the respective URLs of the multiple videos, and sends the first URL to the electronic device.
A screen projection method capable of continuously playing videos, wherein the method is applied to an electronic device, and the method includes:

The electronic device receives the first operation, and establishes a communication connection with the large-screen device in response to the first operation;

The electronic device sends first information to the large-screen device based on the communication connection, where the first information indicates storage locations of multiple videos in the server, and the first information is used for the large-screen device the device obtains the plurality of videos;

Before the large-screen device plays the plurality of videos, or during the process of playing the plurality of videos by the large-screen device, the electronic device and the large-screen device disconnect the communication connection.
The method according to claim 6, wherein before the electronic device detects the first operation, the method further comprises: the electronic device plays a third video;

After the electronic device detects the first operation, the method further includes:

the electronic device displays a video option;

The electronic device receives a second operation, and the second operation acts on the option of the fourth video in the video options;

The electronic device sends the identifier of the third video and the identifier of the fourth video to the server;

The electronic device receives second information sent by the server, where the second information indicates the storage locations of the third video and the fourth video in the server;

The multiple videos in the first information include the third video and the fourth video.
The method according to claim 7, wherein the video corresponding to the video option includes one or more of the following: a video with a degree of association with the third video exceeding a threshold, a video recommended by the electronic device according to user information, or , the video recommended by the electronic device according to the click-through rate.
The method according to any one of claims 6-8, wherein before the electronic device sends the first information to the large-screen device based on the communication connection, the method further comprises:

The electronic device sends a first message to the server, where the first message includes: an identifier of the third video;

The electronic device receives second information sent by the server, where the second information indicates the storage location of the third video and the fifth video determined by the server in the server;

The multiple videos in the first information include the third video and the fifth video.
The method according to claim 9, wherein the fifth video determined by the server comprises one or more of the following: a video with a degree of association with the third video exceeding a threshold, the server according to the user The video recommended by the information, or the video recommended by the server according to the click-through rate.
The method according to any one of claims 6-10, wherein the first information is a first uniform resource locator URL, and the first URL corresponds to the URL of the plurality of videos in the server. storage location:

Before the electronic device sends the first information to the large-screen device based on the communication connection, the method further includes:

The electronic device receives the first URL, where the first URL is generated by the server according to the respective URLs of the multiple videos.
The method according to any one of claims 6-10, wherein the first information is a screen projection interpretation file, and the screen projection interpretation file includes respective URLs of the multiple videos;

Before the electronic device sends the first information to the large-screen device based on the communication connection, the method further includes:

The electronic device receives the screen projection interpretation file, where the screen projection interpretation file is generated by the server according to respective URLs of the multiple videos.
The method according to any one of claims 6-10, wherein the first information is a screen projection interpretation file, and the screen projection interpretation file includes respective URLs of the multiple videos;

Before the electronic device sends the first information to the large-screen device based on the communication connection, the method further includes:

The electronic device receives the respective URLs of the multiple videos sent by the server;

The electronic device generates the screen projection interpretation file according to the respective URLs of the multiple videos.
According to the method according to claim 12 or 13, the screen projection interpretation file further comprises one or more of the following: a version number of the screen projection interpretation file, the number of the multiple videos, each of the multiple videos duration, the total duration of the multiple videos, the playback mode of the multiple videos, the playback order of the multiple videos, or the video names of the multiple videos.
A screen projection method capable of continuously playing videos, characterized in that the method is applied to large-screen devices, and the method includes:

establishing a communication connection between the large-screen device and the electronic device;

The large-screen device receives, based on the communication connection, first information sent by the electronic device, where the first information indicates storage locations of multiple videos in the server;

Disconnecting the communication connection between the large-screen device and the electronic device;

The large-screen device requests the server to acquire the plurality of videos according to the first information;

The large-screen device receives the multiple videos sent by the server;

The large-screen device plays the plurality of videos.
A screen projection method capable of continuously playing videos, characterized in that the method is applied to large-screen devices, and the method includes:

establishing a communication connection between the large-screen device and the electronic device;

The large-screen device obtains first information from the electronic device based on the communication connection, where the first information indicates storage locations of multiple videos in the server;

The large-screen device requests the server to acquire the plurality of videos according to the first information;

The large-screen device receives the multiple videos sent by the server;

The large-screen device plays the first video of the plurality of videos;

Disconnecting the communication connection between the large-screen device and the electronic device;

The large-screen device continues to play the second video of the plurality of videos.
The method according to claim 15 or 16, wherein the first information is a first uniform resource locator URL, and the first URL corresponds to a storage location of the plurality of videos in the server.
According to claims 15-17, the large-screen device plays the multiple videos, specifically including:

The large-screen device plays the multiple videos in sequence according to the sequence in which the multiple videos are acquired.
The method according to any one of claims 15-18, wherein the first information is a screen projection interpretation file, and the screen projection interpretation file includes respective URLs of the multiple videos.
The method of claim 19, wherein the method further comprises:

The large-screen device displays a screen projection list, and the screen projection list includes: options for the multiple videos;

In response to the third operation acting on the screen projection list, the large-screen device performs any one or more of the following: adjusting the playback order of the multiple videos, and adjusting the playback mode of the multiple videos.
The screen projection interpretation file according to claim 19 further comprises one or more of the following: a version number of the screen projection interpretation file, the number of the multiple videos, the respective durations of the multiple videos, the multiple The total duration of the multiple videos, the playback mode of the multiple videos, the playback order of the multiple videos, or the video names of the multiple videos.
The method according to any one of claims 15-21, wherein,

The large-screen device requests the server to acquire the multiple videos according to the first information, which specifically includes:

The large-screen device sends the first information to the CDN;

The large-screen device obtains the plurality of videos from the server according to the CDN;

The large-screen device plays the plurality of videos.
An electronic device, characterized in that the electronic device comprises one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, the one or more memories for storing computer program code, the computer program code comprising computer instructions that, when executed by the one or more processors, cause the electronic device to perform any of claims 6-14 method described in item.
A large-screen device, characterized in that the large-screen device includes one or more processors and one or more memories; wherein, the one or more memories are coupled with the one or more processors, and the The one or more memories are used to store computer program code, the computer program code comprising computer instructions that, when executed by the one or more processors, cause the electronic device to perform as claimed in claims 15-22 The method of any one.
A computer program product comprising instructions, characterized in that, when the computer program product is run on an electronic device, the electronic device is caused to perform the method of any one of claims 6-14.
A computer-readable storage medium comprising instructions, characterized in that, when the instructions are executed on an electronic device, the electronic device is caused to perform the method of any one of claims 6-14.
A computer program product comprising instructions, characterized in that, when the computer program product is run on a large-screen device, the large-screen device is caused to perform the method according to any one of claims 15-22.
A computer-readable storage medium comprising instructions, characterized in that, when the instructions are executed on a large-screen device, the large-screen device is caused to execute the method according to any one of claims 15-22.
A screen projection system, characterized in that, the screen projection system includes an electronic device, a large-screen device, and a server, and the electronic device is used to execute the method according to any one of claims 6-14, and the large-screen device A screen device for performing the method of any of claims 15-22.