WO2025123763A1 - 一种显示设备及投屏续播方法 - Google Patents

一种显示设备及投屏续播方法 Download PDF

Info

Publication number
WO2025123763A1
WO2025123763A1 PCT/CN2024/113671 CN2024113671W WO2025123763A1 WO 2025123763 A1 WO2025123763 A1 WO 2025123763A1 CN 2024113671 W CN2024113671 W CN 2024113671W WO 2025123763 A1 WO2025123763 A1 WO 2025123763A1
Authority
WO
WIPO (PCT)
Prior art keywords
projection
screen
display device
playback
resume
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/CN2024/113671
Other languages
English (en)
French (fr)
Other versions
WO2025123763A9 (zh
Inventor
张敬坤
周春平
刘美玉
庞秀娟
庄广海
刘丽英
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hisense Visual Technology Co Ltd
Original Assignee
Hisense Visual Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hisense Visual Technology Co Ltd filed Critical Hisense Visual Technology Co Ltd
Priority to CN202480038736.XA priority Critical patent/CN121359462A/zh
Publication of WO2025123763A1 publication Critical patent/WO2025123763A1/zh
Publication of WO2025123763A9 publication Critical patent/WO2025123763A9/zh
Anticipated expiration legal-status Critical
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4333—Processing operations in response to a pause request
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H04N21/42607—Internal components of the client ; Characteristics thereof for processing the incoming bitstream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43076—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43078—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen for seamlessly watching content streams when changing device, e.g. when watching the same programme sequentially on a TV and then on a tablet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4367—Establishing a secure communication between the client and a peripheral device or smart card

Definitions

  • the present disclosure relates to the technical field of display devices, and in particular to a display device and a screen projection and continuous broadcasting method.
  • Display devices are intelligent devices that can present user interfaces and support user interaction. Taking smart TVs as an example, smart TVs are based on Internet application technology, have open operating systems and chips, have open application platforms, can realize two-way human-computer interaction functions, and are TV products that integrate multiple functions such as audio and video, entertainment, and data to meet the diverse and personalized needs of users.
  • Display devices can establish communication connections with terminal devices such as mobile phones, and based on specific screen projection protocols, obtain the screen projection data of terminal devices, so as to display the screen projection images of terminal devices through display devices.
  • the playback cannot be controlled in the conventional video playback method.
  • the user controls the display device to jump to other interfaces by pressing the return button on the remote control. In this case, the display device will disconnect the projection connection during the jump and will no longer receive the projection data transmitted by the terminal device.
  • the display device needs to re-push the projection screen through the terminal device, and the user needs to manually fast forward to the previous playback progress in order to complete the continued playback of the projection screen, which reduces the user experience.
  • a display device comprising: a display configured to display a screen projection interface; a user input interface configured to receive instructions from a user; a communication device configured to establish a screen projection connection with a terminal device; a memory configured to store computer instructions and data associated with the display device; at least one processor connected to the display, the user input interface, the communication device and the memory, and configured to execute computer instructions so that the display device executes: in response to a playback instruction for playing a screen projection, obtaining resume information of the screen projection, the resume information being information recorded when exiting the playback of the screen projection, the resume information including a screen projection protocol type, a media asset playback address, a media asset playback progress, and playback effect information set by a user; creating a virtual session object based on the resume information, the virtual session object being used to replace the terminal device to establish a virtual screen projection connection with the display device according to the screen projection protocol type; obtaining screen projection data from the media asset playback address through the
  • the embodiment of the present disclosure also provides a screen projection and playback method, comprising: in response to a playback instruction for playing a projection screen, obtaining playback information of the projection screen, wherein the playback information is a method for resuming playback of the projection screen after exiting the playback of the projection screen.
  • FIG1 is a schematic diagram of an operation scenario between a display device and a control device according to some embodiments
  • FIG2 is a schematic diagram of a hardware configuration of a display device according to some embodiments.
  • FIG4 is a schematic diagram of software configuration of a display device according to some embodiments.
  • FIG5 is a schematic diagram of mirror screen projection according to some embodiments.
  • FIG6 is a schematic diagram of push screen projection according to some embodiments.
  • FIG7 is a schematic diagram of a process of recording and replaying information according to some embodiments.
  • FIG8 is a schematic diagram of a process of generating broadcast continuation information according to the remaining duration according to some embodiments.
  • FIG9 is a schematic diagram of a screen casting and playback start interface according to some embodiments.
  • FIG10 is a schematic diagram of a process of recording the resume information of the exit instruction input time according to some embodiments.
  • FIG11 is a schematic diagram of a playback function module according to some embodiments.
  • FIG12 is a schematic diagram of a process of deleting resume broadcast information according to some embodiments.
  • FIG14 is a schematic diagram of a process of continuing to broadcast and project a screen through a virtual session object according to some embodiments
  • the display device 200 also communicates data with the server 400 through various communication methods.
  • the display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.
  • LAN local area network
  • WLAN wireless local area network
  • the display device 200 may also provide an intelligent network television function with computer support functions, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.
  • IPTV Internet Protocol television
  • Fig. 2 is a block diagram of a hardware configuration of a display device according to some embodiments.
  • the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, at least one processor 250, a display 260, an audio output interface 270, a memory, a power supply, and a user input interface.
  • the detector 230 can be used to collect signals from the external environment or from the external environment.
  • the detector 230 includes a light receiver, a sensor for collecting ambient light intensity; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, for receiving external sounds.
  • the display 260 may include a display screen component for presenting images, and a driving component for driving image display, for receiving image signals output from a processor, and for displaying video content, image content, and a menu control interface component and a user control UI interface, etc.
  • the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types.
  • the display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.
  • the communication device 220 can enable the display device 200 to communicate with the external device or server 400 by wireless or wired connection.
  • the wired connection can connect the display device 200 with the external device through components such as data cables and interfaces.
  • the wireless connection can connect the display device 200 with the external device through wireless signals or wireless networks.
  • the display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.
  • the display device 200 may also support establishing a communication connection relationship with multiple external devices at the same time. Multiple external devices may be connected through the same.
  • the external device is a terminal device 500 such as a mobile phone or a tablet computer.
  • the first terminal device 510 and the second terminal device 520 may establish a communication connection with the display device 200 by accessing the wireless local area network where the display device 200 is located.
  • Multiple external devices may also be connected to the display device 200 through different types of connection methods.
  • the first terminal device 510 is connected to the display device 200 via a wireless local area network; the second terminal device 520 is connected to the display device 200 via Bluetooth.
  • the display device 200 and the terminal device 500 are respectively provided with communication devices supporting the same communication type.
  • the display device 200 is provided with a communication device 220 including a WiFi module
  • the terminal device 500 should also be provided with a communication device including a WiFi module.
  • a specific communication transmission protocol is also required between the display device 200 and the terminal device 500 for data transmission. For example, WiFi protocol, Bluetooth connection protocol, ZigBee protocol, NFC protocol, etc.
  • the processor 250 may include a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input/output.
  • the processor 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory.
  • the processor 250 controls the overall operation of the display device 200.
  • the processor 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the processor 250 is located, such as an external set-top box.
  • a user may input a user command in a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user interface 280 is an interface that can be used to receive control input.
  • Fig. 3 is a block diagram of a hardware configuration of a control device according to some embodiments.
  • the control device 100 may include a processor 110, a communication interface 130, a user input/output interface, a memory, and a power supply.
  • the control device 100 can be configured to control the display device 200, and can receive the user's input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing a role in the interaction between the user and the display device 200. Mediating effect.
  • control device 100 may be a smart device, for example, the control device 100 may be installed with various applications for controlling the display device 200 according to user requirements.
  • the mobile terminal 300 or other intelligent electronic device can perform similar functions as the control device 100 after installing an application for operating the display device 200 .
  • the processor 110 may include a RAM 113 and a ROM 114, a communication interface 130, and a communication bus.
  • the processor 110 may be used to control the operation and operation of the control device 100, as well as the communication and cooperation between the internal components and the external and internal data processing functions.
  • the communication interface 130 can realize the communication of control signals and data signals with the display device 200.
  • the communication interface 130 may include at least one of other near field communication modules such as a WiFi chip 131, a Bluetooth module 132, and an NFC module 133.
  • the user input/output interface 140 wherein the input interface includes at least one of other input interfaces such as a microphone 141 , a touch panel 142 , a sensor 143 , and a button 144 .
  • control device 100 includes at least one of a communication interface 130 and an input/output interface 140.
  • the control device 100 is configured with a communication interface 130, such as a WiFi, Bluetooth, NFC or other module, and can encode the user input command through the WiFi protocol, Bluetooth protocol, or NFC protocol and send it to the display device 200.
  • the memory 190 may be used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the processor.
  • the memory 190 may store various control signal instructions input by the user.
  • the power supply 180 can be used to provide operating power support for each component of the control device 100 under the control of the processor.
  • the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as “application layer”), the application framework layer (Application Framework) layer (referred to as “framework layer”), the Android runtime (Android runtime) and system library layer (referred to as “system runtime library layer”), and the kernel layer.
  • Application layer Applications
  • Application Framework Application Framework
  • Android runtime Android runtime
  • system library layer system runtime library layer
  • At least one application is running in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. provided by the operating system, or applications developed by third-party developers.
  • the application packages in the application layer are not limited to the above examples.
  • the application framework layer in the disclosed embodiment includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc.
  • the manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to the application package currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.
  • the activity manager is used to manage the life cycle of each application and the common navigation back function, such as controlling the exit, opening, back, etc. of the application.
  • the window manager is used to manage all window programs. For example, obtaining the size of the display screen, determining whether there is a status bar, locking the screen, capturing a screenshot, and controlling changes in the display window, for example, shrinking the display window, shaking the display, distorting the display, etc.
  • the system runtime layer provides support for the upper layer, namely the framework layer.
  • the Android operating system will run the C/C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.
  • the kernel layer is a layer between hardware and software. As shown in FIG4 , the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.
  • the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.
  • the display device 200 can establish a screen projection connection channel, and transmit the projection data based on the screen projection connection, so that the display device 200 can display the projection screen of the terminal device 500.
  • the user in order to establish a screen projection connection relationship, can send a screen projection connection request through the terminal device 500, and send the screen projection connection request to the display device 200 through the WiFi network.
  • the display device 200 then completes the transmission protocol configuration according to the screen projection connection request, thereby establishing a transmission channel for the projection data with the terminal device 500.
  • the display device 200 can also achieve a screen projection connection with the terminal device 500 through different connection methods. For example, when the display device 200 and the terminal device 500 are connected to the same wireless local area network, a screen projection connection can be established based on a WiFi network. For another example, when both the display device 200 and the terminal device 500 are provided with a Near Field Communication (NFC) component, a screen projection connection relationship can be established through the NFC component.
  • NFC Near Field Communication
  • other wired or wireless connection methods can also be used between the display device 200 and the terminal device 500 to establish a screen projection connection relationship, such as RF radio frequency connection, infrared connection, cellular network, and other connection methods that can be associated with those skilled in the art based on the connection methods provided in the above embodiments.
  • the display device 200 can receive the screen projection related data of the terminal device 500 through the screen projection data channel, so as to play the screen projection related content in the display device 200.
  • the screen projection data obtained by the display device 200 is in different forms.
  • the display device 200 and the terminal device 500 can establish a screen projection connection through the Digital Living Network Alliance (DLNA) protocol, Miracast protocol, AirPlay push protocol, WiDi screen projection, NFC mirror screen projection, LeTV screen projection and other protocols.
  • DLNA Digital Living Network Alliance
  • the DLNA protocol is a protocol for sharing media resources between devices.
  • the protocol uses network technology (wired or wireless) to interconnect various devices and exchange data through standard protocols, so that media resources can be shared between devices.
  • the DLNA protocol is based on the UPnP protocol, which enables devices to discover and control each other and achieve seamless transmission and sharing of media resources.
  • the DLNA protocol supports a variety of devices, including TVs, speakers, mobile phones, computers, etc., allowing users to seamlessly switch and share media content between different devices.
  • Miracast protocol is a wireless display standard developed by Wi-Fi Alliance based on Wi-Fi direct connection.
  • Miracast screen projection protocol is applicable to Android devices, that is, Android devices can share video images through Miracast screen projection.
  • Smart devices with Android 5.0 or above have built-in Miracast protocol, so you can directly wirelessly project the screen through the WiFi P2P function between the projection device and the WiFi network card of the receiving device without installing any software.
  • Miracast screen projection also supports synchronous transmission of audio and video.
  • Airplay protocol is a wireless playback technology launched by Apple, which is suitable for wireless screen projection protocol of iOS and Mac systems.
  • Apple series devices have built-in Airplay screen projection function. When used with a screen projection device that supports AirPlay server service, the effect is clear and stable. The protocol comes with a screen projection code function. However, it is necessary to ensure that the Apple device and the screen projection device are used in the same LAN (same network segment), and cannot be used across network segments or VLANs.
  • WiDi screen projection is a wireless playback technology led by Intel, and is also based on WiFi Direct technology. Windows 8/10/11 laptops natively support WiDi screen projection, which can be directly projected without installing any software, and supports USB reverse control function.
  • projection data can be transmitted through mirror mode and push mode.
  • the mirror mode refers to the display device 200 synchronously displaying the screen content displayed by the terminal device 500.
  • the display device 200 displays the main interface of the terminal device 500, and when the user performs an interactive operation on the terminal device 500, causing the content of the main interface to change, the content displayed by the display device 200 also changes.
  • the terminal device 500 can generate a projection data stream in the form of a video based on the display content, and send the projection data stream to the display device 200 for display.
  • the push mode means that the display device 200 accesses the network link according to the network link pushed by the terminal device 500 to obtain the corresponding projection screen.
  • a projection control is provided in the upper right corner of the play interface. After the user clicks the projection control and selects the display device 200 as the device for displaying the projection screen, the terminal device 500 can send the URL address of the currently playing video media to the display device 200. After receiving the URL address, the display device 200 accesses the URL address to obtain the video media data and plays the video media.
  • the display device 200 can obtain the link address of a resource in the terminal device 500 through the screen projection data channel, and obtain the media content data by accessing the link address, so as to play the media data.
  • the display device 200 can also obtain the control instructions sent by the terminal device 500 through the screen projection data channel when playing the media data, such as fast forward, pause, stop screen projection, etc.
  • the terminal device 500 such as a mobile phone and the display device 200 will negotiate the device functions and network conditions to select a suitable audio and video transmission format.
  • a series of real-time streaming protocol (RTSP) control commands are used to control the playback and termination of the audio and video streaming.
  • the display device 200 can directly obtain the video data stream from the terminal device 500.
  • the video data stream can be the video data stream corresponding to the final display screen of the display unit of the terminal device 500, that is, the video data stream includes the media content screen, UI interface, and other video screen content that can be displayed in the display unit of the terminal device 500.
  • the video data stream can also be only the video data that can be obtained in the terminal device 500, such as the media video data being played.
  • the terminal device 500 can be used as a signal source for the display device 200, and the display device 200 can continuously obtain video data through the screen projection data channel, and display it in real time on the display 260, so as to achieve the effect of synchronous display with the terminal device 500.
  • the display device 200 Since the data source of the projection screen is special, that is, the display device 200 obtains the projection data from the terminal device 500 and then plays it to form the projection screen. Therefore, the display device 200 is restricted in its control of the projection data playback by the projection protocol, the terminal device 500 and other conditions, which makes the display device 200 in a passive playback mode, and it is difficult to complete the playback recording, adjustment, switching and other control processes according to the media playback process.
  • the user can input an exit command based on different interactive operations. For example, for a display device 200 that supports touch interactive operations, when the display device 200 displays the screen projection interface, the user can control the display device 200 to exit the screen projection interface by sliding upward from the bottom edge of the display 260. That is, the exit command can be input through touch interaction. For another example, for a display device 200 that supports voice interactive operations, when the display device 200 displays the screen projection interface, the user can input a voice such as "exit screen projection" to control the display device 200 to exit the screen projection interface, that is, the exit command can be input through voice interaction.
  • a voice such as "exit screen projection"
  • the other type is a passive exit command, which is an exit command passively generated when the display device 200 switches the display content from the projection interface to other interfaces according to the operating state or user interaction action. For example, when the display device 200 displays the projection interface, the user plugs the gaming device into the HDMI interface. At this time, the display device 200 automatically jumps to the signal source setting interface, and the display device 200 can generate an exit command according to the plug-in signal.
  • the display device 200 can read the configuration file of the screen projection interface, and the configuration file can record the screen projection protocol used by the display device 200 when establishing a screen projection connection with the terminal device 500.
  • the display device 200 will first create a configuration file when rendering the screen projection interface, and record the DLNA protocol related fields in the configuration file.
  • the display device 200 can call the configuration file again and read the DLNA protocol related fields from the configuration file, thereby recording that the current screen projection protocol type is the DLNA protocol.
  • the display device 200 can also determine the type of screen projection protocol based on the screen projection data. Since different screen projection protocols can use different data formats and compression algorithms for screen projection data, the type of screen projection protocol can be determined by reading the data format and compression algorithm of the screen projection data. For example, the Miracast protocol uses WiFi Direct technology for data transmission, while the AirPlay protocol uses Apple's proprietary data format for transmission. When the data transmission format conforms to WiFi Direct technology, the screen projection protocol type can be determined to be the Miracast protocol.
  • the display device 200 can also obtain and record the type of screen projection protocol according to the screen projection application. For example, when the A video application is installed and run on both the display device 200 and the terminal device 500, the user can click the screen projection control in the upper right corner of the A video application interface of the terminal device 500, and the terminal device 500 can establish a screen projection connection with the display device 200 through the screen projection protocol supported by the A video application. Therefore, when recording the screen projection protocol type, the display device 200 can determine that the current screen projection application is the A video application by reading the package name information of the screen projection application, and then query the default or supported screen projection protocol of the A video application to obtain the screen projection protocol type.
  • the display device 200 can also record the media asset playback address.
  • the media asset playback address can be obtained by reading the signal source address of the player. For example, after the display device 200 establishes a screen projection connection with the terminal device 500, the terminal device 500 can send the URL address of the screen projection data to the display device 200 based on the push screen projection method. The display device 200 sets the data source of the player according to the received URL address. Therefore, when recording the media asset playback address, the display device 200 can directly read the data source of the player to obtain the media asset playback address.
  • the display device 200 can also write the media playback address sent by the terminal device 500 into the configuration file. Therefore, in some embodiments, the display device 200 can also obtain and record the media playback address by reading the configuration file.
  • the display device 200 can also record the media playback progress according to the input time of the exit command, that is, record the media playback progress at the time when the exit command is input.
  • the media playback progress can be expressed by playback time or by percentage.
  • the display device 200 can obtain the start time T0 of the player playing the projection data and the total media duration T1 of the projection data through the decoding result of the projection data, and then calculate the media playback progress in combination with the input time T of the exit command.
  • the display device 200 can calculate the difference between the input time T and the start time T0, that is, T-T0 to obtain the media playback progress.
  • the display device 200 can calculate the percentage of the difference and the total media duration T1 after the difference between the input time T and the start time T0, that is, the media playback progress is equal to (T-T0) /T1.
  • the display device 200 may also record other relevant information that facilitates the user to perform interactive operations, including user setting information and display content information. For example, in response to an exit instruction, the display device 200 may also record the media ID (name, title, etc.), thumbnail, and playback effect information such as speed, audio track, subtitle, and zoom mode set by the user.
  • the active exit command is actively input by the user, and may include the user's intention to actively stop screen projection.
  • the passive exit command is caused by events such as unexpected operations, and therefore does not include the user's intention to actively stop screen projection. In the state where there is no intention to actively stop screen projection, the user needs to continue the screen projection. Therefore, in some embodiments, the display device 200 may only record the resume information when receiving the passive exit command.
  • the display device 200 can also detect the progress of media playback and the type of media to determine whether the playback progress or the type of media supports screen projection and continuation.
  • the continuation information can be generated according to the remaining duration through the process shown in Figure 8, as shown in Figure 8, including the following steps:
  • S802 Calculate the remaining duration of the media resource according to the total duration of the media resource and the progress of the media resource playback;
  • S803 Determine whether the remaining duration of the media resource is greater than or equal to a preset duration threshold
  • the display device 200 can generate the resume information according to the screen projection protocol type, the media asset playback address, the media asset playback progress and the playback effect information. If the remaining time of the media asset is less than the preset time threshold, it means that the remaining time of the screen projection media asset is relatively short, and it is not convenient to continue the screen projection, so the display device 200 can directly close the screen projection connection channel with the terminal device 500.
  • the display device 200 when the display device 200 exits the screen projection interface, it can determine whether the video corresponding to the screen projection has been played or is a live video. If the remaining time of the video is greater than 1 minute, it is determined that the current screen projection supports continued playback. Therefore, the display device 200 can record the media playback address and media playback progress, and generate continued playback information. If the remaining time of the video is less than 1 minute, it is determined that the current screen projection does not support continued playback, so you can exit directly. When it is detected that the playback time (or remaining time) is 0, it can be determined that the current screen projection is a live video and does not support continued playback, so you can also exit directly.
  • S300 Generate the resume broadcast information according to the screen projection protocol type, the media resource playback address, the media resource playback progress, and the playback effect information;
  • the display device 200 After recording the screen projection protocol type, media resource playback address, media resource playback progress, and playback effect information, the display device 200 can convert the recorded information according to a preset data format to generate resume broadcast information.
  • the display device 200 can record and manage the resume information through a specific application. That is, the display device 200 is provided with a screen projection entry application, which is an application that provides a screen projection start interface. For example, the display device 200 can save the information recorded in the above embodiment in the screen projection entry application through the Setting.Global process for use.
  • the screen casting entry application displays the screen casting start interface.
  • the screen projection start interface can be built into the signal source selection interface or be the same interface as the signal source selection interface.
  • multiple signal source options can be included, such as live TV signal source, HDMI interface signal source, USB interface signal source, projection signal source, etc.
  • the signal source type can be displayed through view controls such as title text, icons, and thumbnails for users to choose.
  • the display device 200 may record the projection protocol type, media asset playback address, media asset playback progress, and playback effect information, and then record the projection screen content at the time of inputting the exit command, i.e., the resume information.
  • the display device 200 may generate a resume image (S1001) according to the media asset playback progress, and perform compression processing on the projection image to generate a thumbnail (S1002), and then add the thumbnail to the resume information (S1003).
  • the thumbnail is the content displayed to the user through the above-mentioned signal source option, it is used to allow the user to quickly browse the video screen corresponding to the media playback progress through the thumbnail, rather than to tell the display device how to perform the resume function. Therefore, after the resume image is generated through S1001, the resume image can be directly added to the resume information (S1004). That is, when recording the resume information, the resume image is not compressed to generate a thumbnail.
  • the resumed broadcast image is used to display the content of the projection screen at the time when the exit command is input.
  • the display device 200 can obtain the resumed broadcast image in different ways.
  • the display device 200 can extract the resumed broadcast graphics from the data stream of the projection screen, that is, the resumed broadcast image is a picture frame extracted from the data stream of the projection screen according to the progress of the media playback.
  • the display device 200 can obtain the projection screen data and form a projection screen data stream based on the URL address sent by the terminal device 500.
  • the projection screen data stream includes multiple continuous picture frames, each of which is provided with a timestamp for playback.
  • the display device 200 can record the input time of the exit command, read the timestamp of the picture frame according to the input time, determine the picture frame with the smallest time difference with the input time, and copy the picture frame to generate a resumed broadcast image.
  • the display device 200 can take a screenshot of the current projection interface by calling the screenshot process to obtain a resumed image. That is, the resumed image is an image obtained by taking a screenshot of the projection screen by calling the screenshot interface.
  • Bitmap bitmap Bitmap.createBitmap(viewToCapture.getWidth(), viewToCapture.getHeight(), Bitmap.Config.ARGB_8888)" instruction to create a Bitmap object for storing the screenshot image
  • Canvas canvas new Canvas(bitmap)” instruction to create a Canvas object and use the Bitmap object as its bitmap; then use the viewToCapture.draw(canvas) instruction to draw the View to be screenshot onto the Canvas
  • the display device 200 may also extract a continued broadcast image from the frame buffer of the projection interface, that is, the continued broadcast image is a picture frame extracted from the frame buffer of the projection interface according to the time corresponding to the progress of the media playback.
  • the projection interface of the display device 200 is a superimposed screen of a video layer and a graphics (On Screen Display, OSD) layer, that is, the image content of the projection interface can be rendered by a graphics processor GPU component, thereby forming a screen frame for display in the synthesis module.
  • the synthesis module can store the screen frames through a frame buffer and a video buffer, respectively, and form the screen content in the corresponding layers through the video process module.
  • the image frames corresponding to the projection screen of the projection process form the screen content through the video layer (video plane), and the image frames of other image screens in the projection interface (such as controls, progress bars and other graphics of the UI interface) form the screen content through the OSD layer (OSD plane).
  • the display device 200 forms the final screen for display through the blending unit (blend) of the video process module. Therefore, the display device 200 can extract the screen frame of the final screen at the time of inputting the exit instruction in the blending unit, or extract the screen frame in the video buffer (video buffer) corresponding to the video layer as a continuous broadcast image.
  • the display device 200 can also directly obtain the resumed image through the data source of the projection data.
  • the display device 200 can access the website link corresponding to the media playback address for a second time through a multimedia framework service (such as ffmpeg), and encapsulate it as getScaledFrameAtTime(time, option, width, height) to obtain a thumbnail frame corresponding to the media playback progress.
  • a multimedia framework service such as ffmpeg
  • the display device 200 can store the resume broadcast information.
  • the display device 200 can construct a specific storage file format to save the resume broadcast information.
  • the display device 200 can construct a resume broadcast information data table.
  • the resume broadcast information data table multiple table items can be included, namely the current media asset playback address, media asset playback progress, screen projection protocol type, media asset title, and playback effect information that can be manually set by the user.
  • the playback effect information may include playback speed, audio track, subtitles, zoom mode, etc.
  • Each table item can set a corresponding specific value according to the recorded resume broadcast information content.
  • the resume information can be stored in a specific storage area in the memory of the display device 200, and the resume information can be set to a state that can be called by the screen projection entry application or other applications.
  • the display device 200 can execute an exit instruction to exit the screen projection state, that is, close the screen projection connection channel with the terminal device 500. After closing the screen projection connection channel between the display device 200 and the terminal device 500, the display device 200 can switch from displaying the screen projection interface to displaying other interfaces.
  • the resume information can also be stored according to the set duration.
  • the implementation can be shown in FIG12, including the following steps:
  • S1202 Determine whether the storage duration is greater than or equal to a preset storage threshold
  • the preset storage threshold can be set to 24 hours based on the average time interval for the display device 200 to re-establish the projection connection relationship after exiting the projection.
  • the display device 200 can record the storage time of the resume information. When the storage time exceeds 24 hours, the display device 200 can delete the resume information.
  • the preset storage threshold not only can the situation where the user can still see this entrance in the projection start interface for a long time be reduced, but also the storage space occupied by the resume information can be reduced, saving storage space.
  • the display device 200 can also reduce the matching amount of the resume information in the subsequent resume process, so as to facilitate the quick completion of the resume.
  • the display device 200 can monitor the start event of the projection screen during the existence of the resume broadcast information. When it is monitored that the current projection screen has been resumed according to the resume broadcast information, the display device 200 can clear the resume broadcast information so that the playback progress after the resume broadcast can also be recorded and stored, thereby achieving the effect of continuous resume broadcast.
  • the display device 200 can also monitor the screen projection connection operation of other terminal devices, and after monitoring that the display device 200 establishes a screen projection connection with other terminal devices, the resume information of the corresponding projection screen of the original terminal device is cleared. For example, after the display device 200 stores the resume information A of the projection screen corresponding to terminal A, during the period of the continuation information A, the display device 200 can monitor the projection request of other terminal devices. When it monitors that the display device 200 establishes a screen projection connection with terminal B, the display device 200 can clear the resume information to avoid the original projection screen from continuing to play when the new projection screen is playing, affecting the user experience.
  • the display device 200 can record information such as the screen projection protocol type, media playback address, and media playback progress during the screen projection process when exiting the screen projection interface.
  • the recorded information is saved in the form of resume information, so that the display device 200 can resume the projection screen based on the resume information, as shown in Figure 13.
  • the display device 200 After the display device 200 stores the resume information according to the method provided in the above embodiment, it can call the resume information when playing the projection screen in the subsequent process and perform playback control based on the resume information.
  • the resume information is the information recorded when exiting the projection screen, and the resume information includes the projection protocol type, the media playback address, and the media playback progress.
  • the display device 200 can receive a playback instruction for playing the projected screen.
  • the playback instruction can also be actively input by the user, or generated by the display device 200 through the judgment of the operating status.
  • the user can input the instruction based on the interactive operation methods such as the terminal device 500, remote control, touch, voice, etc. supported by the display device 200.
  • the user can click the screen projection icon button in the upper right corner of the playback interface on the terminal device 500 to control the terminal device 500 to send a screen projection request to the display device 200, that is, input a playback instruction to the display device 200.
  • the display device 200 can monitor the current operating state to determine whether the current state meets the set playback conditions, and generate a playback instruction when the playback conditions are met. For example, after exiting the projection interface, the display device 200 can record the exit time of the projection interface to determine the length of time after the display device 200 exits the projection interface. If the projection interface is returned within the preset return time, the display device 200 can automatically generate a playback instruction.
  • the playback instructions generated by the display device 200 should be conducive to the continued broadcast of the projection screen and will not affect the user's normal projection operation. For example, when returning to the projection interface in a short time, the display device 200 should detect the projection connection relationship after returning to the projection interface. If after returning to the projection interface, the terminal device 500 that establishes a projection connection relationship with the display device 200 is still the terminal device when exiting the projection interface, then the display device 200 can automatically generate a playback instruction.
  • the display device 200 can detect the URL address of the current projection screen to determine whether it is the original projection screen, and automatically generate a playback instruction when the URL address at the time of return is the same as the URL address before exiting.
  • the display device 200 can also provide a screen projection interactive interface.
  • Preparation 200 can call the screen projection entry application and obtain the resume information of the projection screen through the screen projection entry application. Then control the screen projection entry application to generate a screen projection start interface according to the resume information.
  • the screen projection start interface includes at least one screen projection control, and the display content of the screen projection control is generated according to the resume information.
  • the display device 200 can control the display to display the screen casting start interface, and the user can input the playback instruction through at least one screen casting control in the screen casting start interface.
  • the display device 200 After receiving the screen projection request sent by the terminal device 500, the display device 200 obtains the resume information of the current screen projection. If the resume information of the current screen projection is stored in the display device 200, the screen projection entry application can be called to control the display device 200 to display the screen projection start interface through the screen projection entry application.
  • the projection start interface may include projection options corresponding to the current projection screen.
  • the projection options may be associated with a resume control for the user to select.
  • the display device 200 may play the projection screen according to the resume information.
  • the display device 200 may also generate the above-mentioned playback instructions.
  • the action to start the resume playback is monitored, that is, whether the user clicks the resume playback control in the screen casting start interface. If there is no data, the screen casting entry interface is displayed, and after the user clicks the screen casting control, it jumps to the screen casting guide page to re-establish the screen casting connection relationship.
  • S500 Acquire screen projection data from the media resource playback address through the virtual session object.
  • the display device 200 can parse the resume information, thereby reading data such as the projection protocol type, the media asset playback address, and the media asset playback progress in the resume information.
  • the projection screen is then resumed based on the parsed data, that is, the display device 200 can obtain the projection data from the media asset playback address and form a projection data stream for the player to play.
  • the user When the display device 200 and the terminal device 500 establish a screen projection connection, the user needs to perform corresponding connection operation steps. For example, the user needs to first open the video playback interface through the terminal device 500, and then click the screen projection button in the video playback interface. And when the display device 200 displays the screen projection start interface, the user also needs to click the resume control in the screen projection start interface to complete the resume operation, and there are many operation steps.
  • the display device 200 can complete the screen projection connection through a virtual session instead of the terminal device 500. That is, as shown in FIG14, after obtaining the resume information through the aforementioned process, the display device 200 creates a virtual session object based on the resume information, wherein the virtual session object is used to replace the terminal device to establish a virtual screen projection connection with the display device according to the screen projection protocol type.
  • the display device 200 in order to create a virtual session object based on the resume information, can also respond to the trigger indication of at least one screen projection control after monitoring the user clicking at least one screen projection control in the above-mentioned screen projection start page, and determine the target screen projection control corresponding to the trigger indication. Then, query the resume application associated with the projection screen according to the target screen projection control. Next, run the resume application, and send the resume information to the resume application to control the resume application to create a virtual session object based on the resume information.
  • the resume application is an application used to form a projection screen.
  • the display device 200 may be configured with a fusion screen projection service.
  • the fusion screen projection service will monitor this Action message and notify the adaptation layer of the resume application to create a virtual Session (i.e., a virtual session object) through the protocol type.
  • Session can be used to store the properties and configuration information required for a specific user session.
  • the display device 200 can automatically create a Session.
  • the session expires or is abandoned, the display device 200 will terminate the session.
  • the resume information may not be stored locally. Instead, part of the resume information is stored in the screen projection control, and the rest is stored in the resume application. For example, the media playback address, user-set playback effect information, etc. can be stored in the screen projection control, and the screen projection protocol type, media playback progress, etc. can be stored in the resume application. In this way, after determining the target screen projection control triggered by the user, the resume information can be obtained from the target screen projection control and the resume application corresponding to the target screen projection control.
  • the virtual session object created by the display device 200 can replace the terminal device 500 to establish a virtual screen projection connection with the display device 200 according to the screen projection protocol type recorded in the resume broadcast information, so that the display device 200 does not need to repeatedly re-establish the screen projection connection relationship with the terminal device 500, but directly uses the media resource playback address recorded in the resume broadcast information to obtain the screen projection data, that is, obtains the screen projection data from the media resource playback address through the virtual session object.
  • the virtual session object can also be used to obtain resume information, and use the resume information as a control variable in the playback process for use by the player of the display device 200. That is, the adaptation layer of the resume application creates a virtual Session and obtains the saved resume information upon receiving the resume message.
  • S600 Play the start time of the projection data according to the media resource playback progress, and play the projection data from the start time based on the playback effect information.
  • the display device 200 can input the projection data into the player, and the player performs playback operations such as decoding, rendering, and outputting the screen on the input projection data to form a projection screen.
  • the display device 200 can send the media playback progress in the resume information and the playback effect information manually set by the user to the player, so that the player determines the start time of the projection data according to the media playback progress, and plays the projection data from the start time according to the effect set in the playback effect information (such as the speed of the aforementioned video playback, audio track, subtitles, etc.).
  • the playback progress of media asset A: 0:38:25, speed: 1.2, subtitles: not displayed, and other playback effect information may be recorded in the playback information acquired by the display device 200.
  • the display device 200 may acquire the data stream from the playback address of media asset A at 0:38:25, and input the acquired data stream into the player.
  • the player may decode and render the media asset data after 0:38:25, and output the picture to the display 260, so that the display 260 plays the projection picture after 0:38:25 at 1.2 times the speed.
  • the above-mentioned embodiment can record the resume information when projecting the screen in a push mode, and call the recorded resume information when playing the projected screen, so that the display device 200 can play the projected screen data according to the media playback progress in the resume information, thereby achieving the projected screen resume effect.
  • the functions supported after establishing the corresponding screen projection connection are also different.
  • different video applications support the resume function differently, that is, for the display device 200 system video application and the video application developed by the third-party application provider that has a cooperative relationship with the display device 200 operator, the resume information can be recorded and read according to the cooperation specifications, but for the third-party video application without a cooperative relationship, because it does not have the corresponding recording and reading algorithm built in, it does not support the screen projection resume function.
  • the display device of the embodiment of the present disclosure can also perform screen projection resume according to the application type. When implemented, it can be shown in Figure 15, including the following steps:
  • S1501 Determine the application type of the continued broadcast application
  • the application type may include a first type of application that supports screen casting and continued broadcasting or a second type of application that does not support screen casting and continued broadcasting.
  • the application package name information may be read to obtain the application name, developer and other description information, and the application type of the application may be determined by matching the application package name information with a preset matching table.
  • the developer of application A is the operator of display device 200, that is, application A is a system application of display device 200.
  • application A supports the screen casting and continuous broadcasting function, that is, the application type of application A is a first-class application. If it is determined by reading the application package name information that the developer of application B is not the operator of display device 200, and the developer of application B does not have a cooperative relationship with the operator of display device 200, it can be determined that application B does not support the screen casting and resume function, that is, the application type of application B is a second-category application.
  • S1504 Receive the screen projection data fed back by the terminal device according to the screen projection connection request.
  • the application type is a second type of application, it means that the resumed broadcast application does not support the screen casting resumed broadcast function.
  • a screen casting connection request can be sent to the terminal device 500, and the screen casting data fed back by the terminal device 500 according to the screen casting connection request can be received. That is, when the display device 200 determines that the resumed broadcast application does not support screen casting resumed broadcast in the manner of recording resumed broadcast information, it can resend the screen casting connection request to the terminal device 500 to re-establish the screen casting connection relationship.
  • the display device 200 can also monitor the switching event of the projection interface when determining that the application type of the resume application is a second type of application (S1601).
  • the switching event refers to an event that triggers the display device 200 to switch from displaying the projection interface to displaying other interfaces, which can be triggered by an exit instruction or by other conditional judgment methods.
  • the display device 200 can generate a pause play instruction in response to the switching event (S1602).
  • the pause play instruction is used to pause the playback of the projection data corresponding to the projection screen. That is, the display device 200 can control the projection screen to pause through the pause play instruction, and switch the projection interface to the background operation (S1603).
  • the display device 200 implements different ways of pausing playback. When the projection connection is established by push, the playback process is executed by the player of the display device 200. Then, the display device 200 can directly respond to the pause play instruction after generating the pause play instruction to pause the playback process of the projection data.
  • the terminal device 500 When the projection connection is established by mirroring, since the playback process is not executed by the player of the display device 200, but by the terminal device 500, it is possible to send a pause play instruction to the terminal device 500 after generating the pause play instruction, so that the terminal device 500 responds to the pause play instruction and pauses the playback process of the projection data.
  • the display device 200 can monitor the return event of the projection interface within the preset time (S1604). After monitoring the return event, the display device 200 responds to the return event and generates a resume playback instruction (S1605), that is, resumes playing the projection data corresponding to the projection screen, and controls the display 260 to display the projection interface (S1606).
  • a resume playback instruction S1605
  • the display device 200 can adopt different methods to realize screen projection and continuation according to the application type of the resumed application, so that the display device 200 can adapt to more types of resumed applications to solve the problem that the screen projection playback process cannot be resumed.
  • the embodiment of the present disclosure also provides a screen projection and continuation method, including: in response to a playback instruction for playing a projection screen, obtaining the continuation information of the projection screen, the continuation information being the information recorded when exiting the playback of the projection screen, the continuation information including the projection protocol type, the media asset playback address, the media asset playback progress, and the playback effect information set by the user; creating a virtual session object based on the continuation information, the virtual session object being used to replace the terminal device to establish a virtual projection connection with the display device according to the projection protocol type; obtaining projection data from the media asset playback address through the virtual session object; playing the start time of the projection data according to the media asset playback progress, and playing the projection data from the start time based on the playback effect information.
  • this method can record the resume broadcast information when the display device cuts out the projection interface, and when returning to the projection interface, it supports the display device to obtain the previously saved resume broadcast information, and jump to the corresponding media resource playback progress according to the resume broadcast information, so as to realize the resume broadcast of the projection screen, so as to solve the problem that the projection playback process cannot be resumed.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本公开提供了一种显示设备及投屏续播方法，该方法可响应于用于播放投屏画面的播放指令，获取投屏画面的续播信息，该续播信息可包括投屏协议类型、媒资播放地址、媒资播放进度，以及用户设定的播放效果信息；基于续播信息创建虚拟会话对象，该虚拟会话对象用于代替终端设备按照投屏协议类型与显示设备建立虚拟的投屏连接；通过虚拟会话对象从媒资播放地址获取投屏数据；根据媒资播放进度播放投屏数据的起播时刻，并基于播放效果信息从起播时刻播放投屏数据，以在显示设备切出投屏界面时记录续播信息，并在返回投屏界面时获取已保存的续播信息，继而跳转到相应的媒资播放进度，实现投屏画面的续播，以解决投屏播放过程无法续播的问题。

Description

一种显示设备及投屏续播方法
相关申请的交叉引用
本公开要求在2023年12月15日提交、申请号为202311734403.4的中国申请的优先权，其全部内容通过引用结合在本公开中。
技术领域
本公开涉及显示设备技术领域，尤其涉及一种显示设备及投屏续播方法。
背景技术
显示设备是能够呈现用户界面，并支持用户交互的智能设备。以智能电视为例，智能电视是基于Internet应用技术，具备开放式操作系统与芯片，拥有开放式应用平台，可实现双向人机交互功能，集影音、娱乐、数据等多种功能于一体的电视产品，用于满足用户多样化和个性化需求。显示设备可以与手机等终端设备建立通信连接，并基于特定的投屏协议，获取终端设备的投屏数据，以通过显示设备显示终端设备的投屏画面。
由于显示设备在显示投屏画面的过程中，投屏画面的数据源由终端设备提供或推送，而显示设备和终端设备作为两个相互独立的个体，不能按照常规视频播放方式进行播放控制。例如，在显示设备通过投屏播放界面显示投屏画面的过程中，用户通过遥控器上的返回键，控制显示设备跳转至其他界面，则显示设备在跳转过程中会断开投屏连接，不再接收终端设备传递的投屏数据，因此在用户控制显示设备回到显示投屏画面的状态时，显示设备需要通过终端设备重新推送投屏画面，并且需要用户手动快进到之前的播放进度，才能完成投屏画面的续播，降低用户体验。
发明内容
第一方面，本公开实施例中提供一种显示设备，包括：显示器，被配置为显示投屏界面；用户输入接口，被配置接收来自用户的指令；通信装置，被配置为与终端设备建立投屏连接；存储器，被配置为保存计算机指令和与显示设备关联的数据；至少一个处理器，与所述显示器，用户输入接口，通信装置和存储器连接，被配置执行计算机指令以使得所述显示设备执行：响应于用于播放投屏画面的播放指令，获取所述投屏画面的续播信息，所述续播信息为在退出播放所述投屏画面时记录的信息，所述续播信息包括投屏协议类型、媒资播放地址、媒资播放进度，以及用户设定的播放效果信息；基于所述续播信息创建虚拟会话对象，所述虚拟会话对象用于代替所述终端设备按照所述投屏协议类型与显示设备建立虚拟的投屏连接；通过所述虚拟会话对象从所述媒资播放地址获取投屏数据；根据所述媒资播放进度播放所述投屏数据的起播时刻，并基于所述播放效果信息从所述起播时刻播放所述投屏数据。
第二方面，本公开实施例还提供了一种投屏续播方法，包括：响应于用于播放投屏画面的播放指令，获取所述投屏画面的续播信息，所述续播信息为在退出播放所述投屏画面 时记录的信息，所述续播信息包括投屏协议类型、媒资播放地址、媒资播放进度，以及用户设定的播放效果信息；基于所述续播信息创建虚拟会话对象，所述虚拟会话对象用于代替所述终端设备按照所述投屏协议类型与显示设备建立虚拟的投屏连接；通过所述虚拟会话对象从所述媒资播放地址获取投屏数据；根据所述媒资播放进度播放所述投屏数据的起播时刻，并基于所述播放效果信息从所述起播时刻播放所述投屏数据。
附图说明
图1为根据一些实施例的显示设备与控制设备之间操作场景的示意图；
图2为根据一些实施例的显示设备的硬件配置示意图；
图3为根据一些实施例的控制设备的硬件配置示意图；
图4为根据一些实施例的显示设备的软件配置示意图；
图5为根据一些实施例的镜像投屏示意图；
图6为根据一些实施例的推送投屏示意图；
图7为根据一些实施例的记录续播信息流程示意图；
图8为根据一些实施例的根据剩余时长生成续播信息的流程示意图；
图9为根据一些实施例的投屏起播界面示意图；
图10为根据一些实施例的记录退出指令输入时刻的续播信息的流程示意图；
图11为根据一些实施例的播放功能模块示意图；
图12为根据一些实施例的删除续播信息流程示意图；
图13为根据一些实施例的投屏续播流程示意图；
图14为根据一些实施例的通过虚拟会话对象续播投屏的流程示意图；
图15为根据一些实施例的根据应用类型执行投屏续播的流程示意图；
图16为根据一些实施例的第二类应用续播投屏流程示意图。
具体实施方式
图1为根据一些实施例的显示设备与控制设备之间操作场景的示意图。如图1中示出，用户可通过触控操作、移动终端300和控制设备100操作显示设备200。其中，控制设备100可以为遥控器、触控笔等。
在一些实施例中，移动终端300可与显示设备200安装软件应用，通过网络通信协议实现连接通信，实现一对一控制操作和数据通信的目的。也可以将移动终端300上显示音视频内容传输到显示设备200上，实现同步显示功能。
如图1中还示出，显示设备200还与服务器400通过多种通信方式进行数据通信。可允许显示设备200通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。
显示设备200除了提供广播接收电视功能之外，还可以附加提供计算机支持功能的智能网络电视功能，包括但不限于，网络电视、智能电视、互联网协议电视(IPTV)等。
图2为根据一些实施例的显示设备硬件配置框图。如图2所示，显示设备200可包括调谐解调器210、通信装置220、检测器230、装置接口240、至少一个处理器250、显示器260、音频输出接口270、存储器、供电电源、用户输入接口中的至少一种。
在一些实施例中，检测器230可用于采集外部环境或与外部交互的信号。例如，检测 器230包括光接收器，用于采集环境光线强度的传感器；或者，检测器230包括图像采集器，如摄像头，可以用于采集外部环境场景、用户的属性或用户交互手势，再或者，检测器230包括声音采集器，如麦克风等，用于接收外部声音。
在一些实施例中，显示器260可包括用于呈现画面的显示屏组件，以及驱动图像显示的驱动组件，用于接收源自处理器输出的图像信号，进行显示视频内容、图像内容以及菜单操控界面的组件以及用户操控UI界面等。
在一些实施例中，通信装置220是用于根据各种通信协议类型与外部设备或服务器400进行通信的组件。显示设备200可以根据支持的通信方式的不同，设置有多个通信装置220。例如，显示设备200支持无线网络通信时，显示设备200可以设有包含WiFi功能的通信装置220。显示设备200支持蓝牙连接通信时，显示设备200需要设有包含蓝牙功能的通信装置220。
通信装置220可以通过无线或有线连接的方式使显示设备200与外部设备或服务器400进行通信连接。其中，有线连接可以通过数据线、接口等组件将显示设备200与外部设备连接。无线连接则可以通过无线信号或无线网络将显示设备200与外部设备连接。显示设备200可以直接与外部设备建立连接关系，也可以通过网关、路由、连接设备等间接建立连接关系。
在一些实施例中，显示设备200还可以支持同时与多个外部设备建立通信连接关系。多个外部设备可以通过相同。例如，外部设备为手机、平板电脑等终端设备500。第一终端设备510和第二终端设备520可以通过接入显示设备200所在的无线局域网，与显示设备200建立通信连接。多个外部设备还可以通过不同类型的连接方式连接显示设备200。例如，第一终端设备510通过无线局域网连接显示设备200；第二终端设备520通过蓝牙连接显示设备200。
为了实现显示设备200与终端设备500之间的通信连接，显示设备200和终端设备500上分别设有支持相同通信类型的通信装置。例如，显示设备200上设有包含WiFi模块的通信装置220时，终端设备500上也应设有包含WiFi模块的通信装置。并且，在设有相同类型的通信装置的同时，显示设备200与终端设备500之间还需要特定的通信传输协议进行数据传递。例如，WiFi协议、蓝牙连接协议、ZigBee协议、NFC协议等。
在一些实施例中，处理器250可包括视频处理器，音频处理器，图形处理器，RAM，ROM，用于输入/输出的第一接口至第n接口，处理器250通过存储在存储器上中各种软件控制程序，来控制显示设备的工作和响应用户的操作。处理器250控制显示设备200的整体操作。
在一些实施例中，处理器250和调谐解调器210可以位于不同的分体设备中，即调谐解调器210也可在处理器250所在的主体设备的外置设备中，如外置机顶盒等。
在一些实施例中，用户可在显示器260上显示的图形用户界面(Graphical User Interface，GUI)输入用户命令，则用户输入接口通过图形用户界面(GUI)接收用户输入命令。
在一些实施例中，用户接口280，为可用于接收控制输入的接口。
图3为根据一些实施例的控制设备的硬件配置框图。如图3所示，控制设备100可包括处理器110、通信接口130、用户输入/输出接口、存储器、供电电源。
控制设备100可被配置为控制显示设备200，以及可接收用户的输入操作指令，且将操作指令转换为显示设备200可识别和响应的指令，起到用户与显示设备200之间交互中 介作用。
在一些实施例中，控制设备100可以是一种智能设备。如：控制设备100可根据用户需求安装控制显示设备200的各种应用。
在一些实施例中，如图1所示，移动终端300或其他智能电子设备，可在安装操控显示设备200的应用之后，可以起到控制设备100类似功能。
处理器110可包括RAM 113和ROM 114、通信接口130以及通信总线。处理器110可用于控制控制设备100的运行和操作，以及内部各部件之间通信协作以及外部和内部的数据处理功能。
通信接口130在处理器110的控制下，可实现与显示设备200之间控制信号和数据信号的通信。通信接口130可包括WiFi芯片131、蓝牙模块132、NFC模块133等其他近场通信模块中至少之一种。
用户输入/输出接口140，其中，输入接口包括麦克风141、触控板142、传感器143、按键144等其他输入接口中至少一者。
在一些实施例中，控制设备100包括通信接口130和输入输出接口140中至少一者。控制设备100中配置通信接口130，如：WiFi、蓝牙、NFC等模块，可将用户输入指令通过WiFi协议、或蓝牙协议、或NFC协议编码，发送至显示设备200。
存储器190，可用于在处理器的控制下存储驱动和控制控制设备100的各种运行程序、数据和应用。存储器190，可以存储用户输入的各类控制信号指令。
供电电源180，可用于在处理器的控制下为控制设备100各元件提供运行电力支持。
如图4，在一些实施例中，将系统分为四层，从上至下分别为应用程序(Applications)层(简称“应用层”)，应用程序框架(Application Framework)层(简称“框架层”)，安卓运行时(Android runtime)和系统库层(简称“系统运行库层”)，以及内核层。
在一些实施例中，应用程序层中运行有至少一个应用程序，这些应用程序可以是操作系统自带的窗口(Window)程序、系统设置程序或时钟程序等；也可以是第三方开发者所开发的应用程序。在具体实施时，应用程序层中的应用程序包不限于以上举例。
框架层为应用程序提供应用编程接口(application Programming Interface，API)和编程框架。应用程序框架层包括一些预先定义的函数。应用程序框架层相当于一个处理中心，这个中心决定让应用层中的应用程序做出动作。应用程序通过API接口，可在执行中访问系统中的资源和取得系统的服务。
如图4所示，本公开实施例中应用程序框架层包括视图系统(View System)、管理器(Managers)，内容提供者(Content Provider)等，其中，视图系统可设计和实现应用程序的界面和交互，视图系统包括列表(lists)、网络(grids)、文本框(text boxes)、按钮(buttons)等。管理器包括以下模块中的至少一个：活动管理器(Activity Manager)用于和系统中正在运行的所有活动进行交互；位置管理器(Location Manager)用于给系统服务或应用提供了系统位置服务的访问；文件包管理器(Package Manager)用于检索当前安装在设备上的应用程序包相关的各种信息；通知管理器(Notification Manager)用于控制通知消息的显示和清除；窗口管理器(Window Manager)用于管理用户界面上的图标、窗口、工具栏、壁纸和桌面部件。
在一些实施例中，活动管理器用于管理各个应用程序的生命周期以及通常的导航回退功能，比如控制应用程序的退出、打开、后退等。窗口管理器用于管理所有的窗口程序， 比如获取显示屏大小，判断是否有状态栏，锁定屏幕，截取屏幕，控制显示窗口变化，例如，将显示窗口缩小显示、抖动显示、扭曲变形显示等。
在一些实施例中，系统运行库层为上层即框架层提供支撑，当框架层被使用时，安卓操作系统会运行系统运行库层中包含的C/C++库以实现框架层要实现的功能。
在一些实施例中，内核层是硬件和软件之间的层。如图4所示，内核层至少包含以下驱动中的至少一种：音频驱动、显示驱动、蓝牙驱动、摄像头驱动、WIFI驱动、USB驱动、HDMI驱动、传感器驱动(如指纹传感器，温度传感器，压力传感器等)、以及电源驱动等。
上述显示设备200可以在与终端设备500建立通信连接关系后，建立投屏连接通道，并基于投屏连接传递投屏数据，以使显示设备200可以显示终端设备500的投屏画面。在一些实施例中，为了建立投屏连接关系，用户可以通过终端设备500发出投屏连接请求，并通过WiFi网络将投屏连接请求发送给显示设备200。显示设备200再根据投屏连接请求完成传输协议配置，从而与终端设备500之间建立投屏数据的传输通道。
显示设备200还可以通过不同连接方式实现与终端设备500之间的投屏连接。例如，在显示设备200和终端设备500接入同一个无线局域网时，可以基于WiFi网络建立投屏连接。又例如，在显示设备200和终端设备500上均设有近场通信(Near Field Communication，NFC)组件时，可以通过NFC组件建立投屏连接关系。显然，显示设备200与终端设备500之间还可以采用其他有线或无线连接方式，从而建立投屏连接关系，例如RF射频连接、红外连接、蜂窝网络以及本领域技术人员在上述实施例提供的连接方式基础上所能够联想到的其他连接方式。
在建立投屏连接后，显示设备200可以通过投屏数据通道接收终端设备500的投屏相关数据，从而在显示设备200中播放投屏相关内容。在不同的投屏数据传输协议下，显示设备200获取的投屏数据形式不同。例如，显示设备200与终端设备500可以通过数字生活网络联盟(Digital Living Network Alliance，DLNA)协议、Miracast协议、AirPlay推送协议、WiDi投屏、NFC镜像投屏、乐播投屏等协议建立投屏连接。
其中，DLNA协议是一种用于实现设备间媒体资源共享的协议。该协议利用网络技术(有线或者无线)，将各种设备互联，通过标准的协议进行数据交互，使得媒体资源可以在设备间共享。DLNA协议基于UPnP协议，使得设备能够互相发现和控制，实现媒体资源的无缝传输和共享。DLNA协议支持多种设备，包括电视、音响、手机、电脑等，使得用户可以在不同设备间无缝切换和共享媒体内容。
Miracast协议是由Wi-Fi联盟制定，以Wi-Fi直连为基础的无线显示标准。Miracast投屏协议可适用于Android设备，即Android设备可通过Miracast投屏的方式分享视频画面。Android5.0以上的智能设备内置Miracast协议，因此可以在无需安装任何软件的情况下直接通过投屏设备与接收端设备WiFi网卡间的WiFi P2P功能进行直接无线投屏。此外，Miracast投屏还支持音视频同步传输。
Airplay协议是由苹果公司推出的一种无线播放技术，适用于iOS和Mac系统的无线投屏协议。苹果系列设备内置Airplay投屏功能，配合支持AirPlay server服务的投屏器使用，效果清晰稳定，协议自带投屏码功能。但是，需保证苹果设备与投屏器在同一个局域网下(同网段)使用，不能跨网段、跨VLAN使用。
WiDi投屏是Intel主导的一种无线播放技术，也基于WiFi Direct直连技术。 Windows8/10/11笔记本电脑原生支持WiDi投屏，可以无需安装任何软件直接投屏，并且支持USB反向控制功能。
在一些实施例中，显示设备200与终端设备500建立投屏连接后，可以通过镜像模式和推送模式传递投屏数据。其中，镜像模式是指显示设备200同步显示终端设备500显示的画面内容。例如，如图5所示，显示设备200显示终端设备500的主界面，并且在用户针对终端设备500执行交互操作，导致主界面内容变化时，显示设备200显示的内容也同样变化。为此，终端设备500可以基于显示内容生成视频形式的投屏数据流，并将投屏数据流发送给显示设备200进行显示。
推送模式是指显示设备200根据终端设备500推送的网络链接，并访问该网络链接，获取对应的投屏画面。例如，如图6所示，终端设备500在播放视频媒资时，在播放界面的右上角设有投屏控件，用户点击该投屏控件并选择显示设备200作为显示投屏画面的设备后，终端设备500可以向显示设备200发送当前播放的视频媒资的URL地址。显示设备200在接收到该URL地址后，访问URL地址以获得视频媒资数据，并播放该视频媒资。
显示设备200和终端设备500所支持的投屏协议中，部分协议基于镜像模式，部分协议基于推送模式。例如，在DLNA协议下，显示设备200可以通过投屏数据通道获取终端设备500中某一资源的链接地址，并通过访问该链接地址获取媒资内容数据，从而播放该媒资数据。同时显示设备200还可以在播放媒资数据时，通过投屏数据通道获取终端设备500发送的控制指令，如快进、暂停、停止投屏等。例如，通过通讯协议建立好连接后，手机等终端设备500与显示设备200会进行设备功能与网络条件的协商，以选择适合的影音传输格式。建立影音串流的联机协议(Session)后，再通过一连串的实时串流协议(Real Time Streaming Protocol，RTSP)控制命令，以控制影音串流的播放及终止。
而在Miracast投屏、Airplay投屏、NFC镜像投屏、乐播投屏等其他投屏连接协议下，显示设备200可以直接从终端设备500获取视频数据流。该视频数据流可以是终端设备500的显示单元最终显示画面对应的视频数据流，即该视频数据流中包括终端设备500中的媒资内容画面、UI界面以及其他可在显示单元中显示的视频画面内容。视频数据流也可以仅为终端设备500中可被获取视频数据，如正在播放的媒资视频数据等。此时，终端设备500可以作为显示设备200的一个信号源，显示设备200可以通过投屏数据通道不断获取视频数据，并实时显示在显示器260中，实现与终端设备500同步显示的效果。
需要说明的是，上述投屏协议不仅能够获取终端设备500中的视频数据流，而且能够获取终端设备500中的音频数据流，从而可以将视频数据和音频数据同步发送给显示设备200，使显示设备200能够同步播放视频和音频。
终端设备500根据不同的投屏协议能够获取不同的投屏数据。例如，对于系统应用或直接在系统层级进行投屏，终端设备500可以采用Miracast投屏、Airplay投屏或WiDi投屏协议建立投屏数据通道。由于上述Miracast投屏协议和Airplay投屏协议需要系统级应用权限，因此Miracast投屏协议和Airplay投屏协议仅适用于系统应用，或者同一厂商的显示设备200和终端设备500通过操作系统内置规则直接建立投屏连接。
显示设备200基于上述投屏协议中的任一种与终端设备500建立投屏连接后，可以根据终端设备500发送的投屏数据形成投屏画面，投屏画面可以通过特定的用户界面进行显示，在本公开实施例中，用于显示投屏画面用户界面可以称为投屏界面。应当理解的是，投屏界面可以是独立的界面，例如，投屏界面为悬浮显示的投屏窗口。投屏界面也可以是 显示设备200的播放界面，例如，建立投屏连接后，显示设备200全屏显示投屏内容时，整个全屏显示的画面内容均为投屏界面。
由于投屏画面的数据来源具有特殊性，即显示设备200从终端设备500获得投屏数据后，进行播放形成投屏画面。因此，显示设备200对投屏数据的播放控制收到投屏协议、终端设备500等条件的限制，使得显示设备200处于被动播放模式下，难以按照媒资播放过程完成播放记录、调整、切换等控制过程。
例如，在镜像投屏模式下，显示设备200仅能够实时显示终端设备500发送的镜像投屏数据流，对投屏过程的控制，也仅限于退出等基础操作。而在推送投屏模式下，显示设备200通过访问终端设备500推送的媒资播放地址，获取投屏数据。但由于投屏数据是由终端设备500推送的，数据源默认仍然为终端设备500，因此显示设备200在退出投屏界面后，会直接断开投屏连接关系，不会记录任何播放数据，如果用户想要续播投屏画面，则需要重新建立显示设备200与终端设备500之间的投屏连接关系，并通过快进操作手动调整到退出时的播放进度，进行投屏画面续播。可见，这样的投屏续播方式操作繁琐，续播等待时间长，会降低用户体验。
为了解决投屏过程无法续播的问题，本公开实施例提供一种显示设备200。该显示设备200可以通过记录在退出投屏时的续播信息，并在用户选择续播投屏画面时，根据续播信息自动跳转到退出时的播放进度，实现自动续播投屏画面的目的。为满足上述功能的实施，显示设备200可包括显示器、用户输入接口、通信装置、存储器以及至少一个处理器。其中，显示器260被配置为显示投屏界面、用户输入接口，被配置接收来自用户的指令、通信装置被配置为与终端设备建立投屏连接，存储器，被配置为保存计算机指令和与显示设备关联的数据、至少一个处理器，与显示器，用户输入接口，通信装置和存储器连接，被配置执行计算机指令以使得显示设备执行投屏续播方法对应的步骤，如图7所示，包括以下步骤：
S100：获取用于退出投屏界面的退出指令。
在本公开实施例中，用于退出投屏界面的退出指令可以包括两种类型，一种类型为主动退出指令，即用户通过特定交互操作主动退出投屏界面的退出指令。例如，在显示设备200显示投屏界面的过程中，用户通过按下显示设备200配套遥控器上的返回键，控制显示设备200退出显示投屏界面时的退出指令。
在一些实施例中，用户可以基于不同的交互操作输入退出指令，例如，对于支持触控交互操作的显示设备200，当显示设备200显示投屏界面时，用户可以通过从显示器260底部边缘向上滑动的退出手势，控制显示设备200退出投屏界面，即退出指令可以通过触控交互输入。还例如，对于支持语音交互操作的显示设备200，当显示设备200显示投屏界面时，用户可以输入“退出投屏”等内容的语音，控制显示设备200退出投屏界面，即退出指令可以通过语音交互输入。
另一种类型为被动退出指令，即显示设备200根据运行状态或用户交互动作，将显示内容从投屏界面切换至其他界面时被动生成的退出指令。例如，在显示设备200显示投屏界面的过程中，用户在HDMI接口插入游戏设备，此时，显示设备200会自动跳转到信号源设置界面，此时显示设备200可以根据插拔信号，生成退出指令。
根据显示设备200操作系统设定的界面切换规则，被动退出指令可以在不同的运行状态下生成，并且，退出指令还可以由控制装置100或外接设备输入或生成。例如，用户通 过按下遥控器上的主页键，控制显示设备200从投屏界面切换至主页界面时，显示设备200可以生成并执行退出指令。还例如，对于支持视频(或语音)通话的显示设备200，如果在显示设备200显示投屏界面时，接收到视频通话请求，则显示设备200也可以从投屏界面切换至视频通话界面。
S200：响应于所述退出指令，记录所述投屏界面的投屏协议类型和媒资播放地址，以及，记录所述退出指令输入时刻的媒资播放进度和播放效果信息。
为了获取投屏协议类型，显示设备200可以读取投屏界面的配置文件，配置文件中可以记录有显示设备200在与终端设备500建立投屏连接时所使用的投屏协议。例如，当用户通过系统默认DLNA协议控制显示设备200与终端设备500建立投屏连接时，显示设备200在渲染投屏界面时，会先创建配置文件，并在配置文件中记录DLNA协议相关字段。在记录投屏协议类型时，显示设备200可以再次调用配置文件，并从配置文件中读取DLNA协议相关字段，从而记录当前投屏协议类型为DLNA协议。
在一些实施例中，显示设备200还可以根据投屏数据判断投屏协议类型。由于不同的投屏协议对投屏数据可采用不同的数据格式和压缩算法，因此可以通过读取投屏数据的数据格式和压缩算法，确定投屏协议类型。例如，Miracast协议使用WiFi Direct技术进行数据传输，而AirPlay协议则使用苹果专有的数据格式进行传输，则当数据传输格式符合WiFi Direct技术时，可以确定投屏协议类型为Miracast协议。
在一些实施例中，显示设备200还可以根据投屏应用获取并记录投屏协议类型。例如，在显示设备200和终端设备500上均安装并运行A视频应用时，用户可以通过在终端设备500的A视频应用界面右上角点击投屏控件，则终端设备500可以通过A视频应用支持的投屏协议与显示设备200建立投屏连接。因此，显示设备200在记录投屏协议类型时，可以通过读取投屏应用的包名信息，确定当前投屏应用为A视频应用，再查询A视频应用默认或支持的投屏协议，获得投屏协议类型。
在记录投屏协议类型的同时，显示设备200还可以记录媒资播放地址。其中，媒资播放地址可以通过读取播放器的信号源地址获得，例如，在显示设备200与终端设备500建立投屏连接后，终端设备500可以基于推送投屏的方式，将投屏数据的URL地址发送给显示设备200，显示设备200则根据接收到的URL地址，设置播放器的数据源，因此，在记录媒资播放地址时，显示设备200可以直接读取播放器的数据源，从而获取的媒资播放地址。
由于投屏界面的配置文件是在建立投屏连接关系时创建的，在创建配置文件时，显示设备200也可以将终端设备500发送的媒资播放地址写入配置文件中，因此，在一些实施例中，显示设备200还可以通过读取配置文件获取并记录媒资播放地址。
基于上述实施例记录投屏协议类型和媒资播放地址的同时，显示设备200还可以根据退出指令的输入时刻记录媒资播放进度，即记录退出指令输入时刻的媒资播放进度。其中，媒资播放进度可以通过播放时间进行表示，也可以通过百分比进行表示。例如，显示设备200可以通过对投屏数据的解码结果，获取播放器播放投屏数据的开始时间T0以及投屏数据的媒资总时长T1，再结合退出指令的输入时刻T，计算媒资播放进度。当使用时间表示媒资播放进度时，显示设备200可以计算输入时刻T与开始时间T0的差值，即T-T0获得媒资播放进度。当使用百分比表示媒资播放进度时，显示设备200可以在输入时刻T与开始时间T0的差值后，再计算差值与媒资总时长T1的百分比，即媒资播放进度等于(T-T0) /T1。
在一些实施例中，显示设备200除记录投屏协议类型、媒资播放地址以及媒资播放进度外，还可以记录其他便于用户执行交互操作的相关信息，包括用户的设置信息和显示内容信息。例如，显示设备200可以响应于退出指令，还记录媒资ID(名称、标题等)、缩略图以及用户设置的倍速、音轨、字幕、缩放模式等播放效果信息。
需要说明的是，对于显示设备200，主动退出指令是由用户主动输入的，可以包含用户主动停止投屏的意图。而被动退出指令则是由于意外操作等事件导致的，因此不包含用户主动停止投屏的意图。而在不具有主动停止投屏意图的状态下，用户更需要进行投屏续播，因此，在一些实施例中，显示设备200可以仅在接收到被动退出指令记录续播信息。
在记录媒资播放进度的过程中，显示设备200还可以对媒资播放进度和媒资类型进行检测，确定播放进度或媒资类型是否支持投屏续播。例如，对于电影等视频媒资，当媒资播放进度较大，已完成正片播放时，再执行续播仅播放片尾曲内容，对于用户的使用意义不大，因此可以不再对该投屏画面执行续播，即不记录该投屏画面对应的续播信息。又例如，直播类视频，由于没有固定的长度，无法实现续播，因此也可以不记录该投屏画面对应的续播信息。对此可通过图8所示流程根据剩余时长生成续播信息，具体如图8所述，包括以下步骤：
S801：获取投屏画面的媒资总时长；
S802：根据媒资总时长和媒资播放进度，计算媒资剩余时长；
S803：判断媒资剩余时长是否大于或等于预设时长阈值；
S804：若是，则根据投屏协议类型、媒资播放地址、媒资播放进度以及播放效果信息，生成续播信息；
S805：若否，则关闭与终端设备的投屏连接通道。
如果媒资剩余时长大于或等于预设时长阈值，说明投屏媒资剩余时长较长，便于进行投屏续播，则显示设备200可以根据投屏协议类型、媒资播放地址、媒资播放进度以及播放效果信息，生成续播信息。如果媒资剩余时长小于预设时长阈值，则说明投屏媒资剩余时长较短，不便于进行投屏续播，因此显示设备200可以直接关闭与终端设备500的投屏连接通道。
例如，当显示设备200退出投屏界面时，可以判断投屏画面对应的视频是否播放完成或者为直播类视频，如果视频剩余时长大于1min，则确定当前投屏画面支持续播，因此显示设备200可以记录媒资播放地址以及媒资播放进度，并生成续播信息。如果视频剩余时长小于1min，则确定当前投屏画面不支持续播，因此可以直接退出。而当检测到播放时长(或者剩余时长)为0，则可以确定当前投屏画面为直播视频，也不支持续播，因此也可以直接退出。
S300：根据所述投屏协议类型、所述媒资播放地址、所述媒资播放进度，以及所述播放效果信息生成所述续播信息；
在记录投屏协议类型、媒资播放地址、媒资播放进度以及播放效果信息后，显示设备200可以将记录的信息按照预设的数据格式进行转换，以生成续播信息。
在一些实施例中，显示设备200可以通过特定的应用记录和管理续播信息。即显示设备200中设有投屏入口应用，投屏入口应用为提供投屏起播界面的应用。例如，显示设备200可以将上述实施例中记录的信息，通过Setting.Global进程保存在投屏入口应用中，供 投屏入口应用展示投屏起播界面。
由于投屏过程相当于为显示设备200提供投屏信号源，因此，投屏起播界面可以内置在信号源选择界面中或者与信号源选择界面为同一个界面。如图9所示，在投屏起播界面中，可以包括多个信号源选项，如电视直播信号源、HDMI接口信号源、USB接口信号源、投屏信号源等。在这些信号源选项可以通过标题文字、图标以及缩略图等视图控件对信号源类型进行展示，以供用户选择。
在一些实施例中，显示设备200可以记录投屏协议类型、媒资播放地址、媒资播放进度以及播放效果信息后，记录退出指令输入时刻的投屏画面内容，即续播信息。实施时可如图10所示，显示设备200可以根据媒资播放进度生成续播图像(S1001)，并对投屏图像执行压缩处理，以生成缩略图(S1002)，再将缩略图添加至续播信息(S1003)。
为便于用户快速找到想要续播的视频，还可在投屏起播界面的信号源选项中，添加信号源对应视频的视频名称，以及根据视频的媒资播放进度生成的续播图像对应的缩略图，例如前述图9所示的信号源选项USB1。
此外，考虑到缩略图是通过上述信号源选项向用户展示的内容，其用于使用户通过缩略图快速浏览到媒资播放进度对应时刻的视频画面，而非用于告知显示设备如何执行续播功能，因此，还可在通过S1001生成续播图像后，直接将续播图像添加至续播信息(S1004)。即，在记录续播信息时，不对续播图像进行压缩生成缩略图。
其中，续播图像用于展示退出指令输入时刻的投屏画面内容。根据图像获取规则的不同，显示设备200可以采用不同的方式获取续播图像。在一些实施例中，显示设备200可以在投屏画面的数据流中提取续播图形，即续播图像为按照媒资播放进度在投屏画面的数据流中提取的画面帧。在显示设备200与终端设备500建立投屏连接关系以后，显示设备200可以基于终端设备500发送的URL地址，获取投屏数据并形成投屏数据流。投屏数据流包括多个连续画面帧，每个画面帧设有用于播放的时间戳。显示设备200可以在获取退出指令时，记录退出指令的输入时间，并根据输入时间去读取画面帧的时间戳，确定与输入时间的时间差最小的画面帧，并复制该画面帧以生成续播图像。
在一些实施例中，显示设备200可以通过调用截图进程，对当前投屏界面执行截图，获得续播图像。即续播图像为通过调用截图接口对投屏画面执行截图获得的图像。例如，显示设备200在接收到退出指令时，可以调用Android的开发者API来调用系统的截图进程。即显示设备200先通过“import android.graphics.Bitmap；import android.graphics.Canvas；import android.view.View；import android.widget.ImageView”指令调用截图进程；再通过“View viewToCapture＝findViewById(R.id.view_to_capture)”指令获取要截图的View；
接下来创建Bitamp对象，并将Bitmap对象作为其位图。实施时可按照“Bitmap bitmap＝Bitmap.createBitmap(viewToCapture.getWidth(),viewToCapture.getHeight(),Bitmap.Config.ARGB_8888)”指令创建一个用于存储截图图像的Bitmap对象再按照“Canvas canvas＝new Canvas(bitmap)”指令创建一个Canvas对象，并将Bitmap对象作为其位图；再通过viewToCapture.draw(canvas)指令将要截图的View绘制到Canvas上；最后按照“MediaStore.Images.Media.insertImage(getContentResolver(),bitmap,"Screenshot",null)；catch(FileNotFoundException e)e.printStackTrace()”指令将截图保存到显示设备200的相册中。
在一些实施例中，显示设备200还可以从投屏界面的帧缓冲区中提取续播图像，即续播图像为按照媒资播放进度对应的时间从投屏界面的帧缓冲区中提取的画面帧。例如，如 图11所示，显示设备200的投屏界面为视频层和图形(On Screen Display,OSD)层的叠加画面，即投屏界面的图像内容可以通过图形处理器GPU组件渲染，从而在合成模块形成用于显示的画面帧。其中，合成模块中可以分别通过帧缓冲器(frame buffer)和视频缓冲器(video buffer)存储画面帧，并通过视频过程模块分别在相应的图层形成画面内容。即投屏过程的投屏画面对应的图像帧通过视频层(video plane)形成画面内容，而投屏界面中的其他图像画面(如UI界面的控件、进度条等图形)的图像帧通过OSD层(OSD plane)形成画面内容。最后，显示设备200通过视频过程模块的混合单元(blend)形成最终画面进行显示。因此，显示设备200可以在混合单元中提取退出指令输入时刻的最终画面的画面帧，或者在视频层对应的视频缓冲器(video buffer)中提取画面帧，作为续播图像。
在一些实施例中，显示设备200还可以通过投屏数据的数据源直接获取续播图像，例如，显示设备200可以通过多媒体框架服务(如ffmpeg)二次访问媒资播放地址对应的网站链接，并上层封装为getScaledFrameAtTime(time,option,width,height)，获取媒资播放进度对应的一帧缩略图画面。
根据上述实施例中的方式，生成续播信息后，显示设备200可以对续播信息进行存储。在存储续播信息的过程中，显示设备200可以构建特定的存储文件格式将续播信息进行保存。例如，显示设备200可以构建续播信息数据表，在续播信息数据表中，可以包括多个表项，即当前媒资播放地址、媒资播放进度、投屏协议类型、媒资标题、以及可供用户手动设定的播放效果信息，播放效果信息可包括如播放的倍速、音轨、字幕、缩放模式等。每个表项可以根据记录的续播信息内容，设置对应的具体值。
续播信息可以存储在显示设备200的存储器中的特定存储区内，并且，续播信息可以设置为能够被投屏入口应用或者其他应用调用的状态。在存储续播信息后，显示设备200可以执行退出指令，退出投屏状态，即关闭与终端设备500的投屏连接通道。在关闭显示设备200与终端设备500的投屏连接通道后，显示设备200可以从显示投屏界面切换至显示其他界面。
由于续播信息用户后续进行投屏画面的续播操作，而续播操作有较高的概率发生在用户退出投屏之后，短时间内再次建立投屏连接的场景中，因此，续播信息也可以按照设定时长进行存储，实施时可如图12所示，包括以下步骤：
S1201；获取续播信息的存储时长和预设存储阈值；
S1202：判断存储时长是否大于或等于预设存储阈值；
S1203：若是，则删除续播信息；
例如，预设存储阈值可以根据显示设备200在退出投屏后重新建立投屏连接关系的间隔时长的平均值设定为24h。则显示设备200在存储续播信息后，可以对续播信息的存储时长进行记录，当存储时长超过24h时，显示设备200可以删除续播信息。通过设置预设存储阈值，不仅可以减少导致用户出现较久时间依然可以在投屏起播界面看到此入口的情况，而且可以减少续播信息对存储空间的占用，节约存储空间。此外，通过定期主动清除续播信息，显示设备200还可以在后续续播过程中，减少续播信息的匹配量，便于快速完成续播。
S1204：若否，则监听续播信息对应投屏画面的起播事件；
S1205：判断是否监听到起播事件；若监听到起播事件则跳转至上述步骤S1203，否则返回上述步骤S1204继续监听。
如果存储时长小于预设存储阈值，显示设备200可以维持续播信息的存储状态。显然，当显示设备200已经完成续播时，之前存储的续播信息便没有继续存储的意义，即显示设备200还可以监听续播信息对应投屏画面的起播事件，以及在监听到起播事件后，删除续播信息。
例如，显示设备200可以在续播信息的存续期间，监听投屏画面的起播事件，当监听到当前投屏画面已经按照续播信息进行续播后，显示设备200可以清除续播信息，以使续播后的播放进度也能够被记录和存储，实现持续续播的效果。
在一些实施例中，显示设备200还可以对其他终端设备的投屏连接操作进行监听，并在监听到显示设备200与其他终端设备建立投屏连接后，将原终端设备对应投屏画面的续播信息清除。例如，在显示设备200存储终端A对应投屏画面的续播信息A后，在续播信息A的存续期间，显示设备200可以监听其他终端设备的投屏请求时，当监听到显示设备200与终端B建立投屏连接后，显示设备200可以清除续播信息，避免新投屏画面播放时，原投屏画面依旧可以续播，影响用户体验。
上述S100～S300的步骤中，展示了显示设备200可以在退出投屏界面时对投屏过程中投屏协议类型、媒资播放地址以及媒资播放进度等信息进行记录，记录的信息以续播信息的形式进行保存，以使显示设备200可以基于续播信息，对投屏画面进行续播，如图13所示。
S400：响应于用于播放投屏画面的播放指令，获取所述投屏画面的续播信息。
显示设备200根据上述实施例中提供的方式存储续播信息后，可以在后续播放投屏画面时，调用续播信息，并基于续播信息进行播放控制。其中，续播信息为在退出播放投屏画面时记录的信息，续播信息包括投屏协议类型、媒资播放地址以及媒资播放进度。
即显示设备200可以接收用于播放投屏画面的播放指令。播放指令同样可以由用户主动输入，或者由显示设备200通过对运行状态的判断生成。对于主动输入的播放指令，用户可以基于显示设备200所支持的终端设备500、遥控器、触控、语音等交互操作方式，进行指令输入。例如，用户可以在终端设备500上点击播放界面右上角的投屏图标按钮，控制终端设备500向显示设备200发送投屏请求，即向显示设备200输入播放指令。
对于显示设备200生成的播放指令，显示设备200可以通过监听当前的运行状态，判断当前状态是否满足设定的播放条件，并且在满足播放条件时，生成播放指令。例如，显示设备200可以在退出投屏界面后，记录退出投屏界面的退出时刻，以确定显示设备200退出投屏界面后所经历的时长。如果在预设返回时间内，返回投屏界面。则显示设备200可以自动生成播放指令。
需要说明的是，显示设备200生成的播放指令应有利于实现投屏画面的续播，并且不会影响到用户的正常投屏操作。例如，在短时间内返回投屏界面时，显示设备200应对返回投屏界面后的投屏连接关系进行检测，如果返回投屏界面后，与显示设备200建立投屏连接关系的终端设备500仍旧为退出投屏界面时的终端设备，则显示设备200可以自动生成播放指令。如果返回投屏界面后，与显示设备200建立投屏连接关系的终端设备500不为退出投屏界面时的终端设备，则显示设备200可以对当前投屏画面的URL地址进行检测，以确定是否为原投屏画面，在返回时的URL地址与退出前URL地址相同时，自动生成播放指令。
为了便于用户执行交互操作，显示设备200还可以提供投屏交互界面。例如，显示设 备200可调用投屏入口应用，并通过投屏入口应用获取投屏画面的续播信息。再控制投屏入口应用根据续播信息生成投屏起播界面。其中，投屏起播界面中包括至少一个投屏控件，投屏控件的显示内容根据续播信息生成。
在投屏入口应用生成投屏起播界面后，显示设备200可以控制显示器显示该投屏起播界面，用户可通过该投屏起播界面中的至少一个投屏控件来输入播放指令。
例如，显示设备200在接收到终端设备500发送的投屏请求后，获取当前投屏画面的续播信息。如果显示设备200中存储有当前投屏画面的续播信息，则可以调用投屏入口应用，以通过投屏入口应用控制显示设备200显示投屏起播界面。
在投屏起播界面中，可以包括当前投屏画面对应的投屏选项，投屏选项可以关联一个续播控件供用户选择，当用户点击续播控件时，显示设备200可以按照续播信息对投屏画面进行播放，同时，显示设备200还可以生成上述播放指令。
例如，用户通过遥控器拉起投屏入口应用时，若此时ContentProvider中有缩略图信息并且Setting.Global中有视频标题，则监听启动续播的Action，即检测用户是否在投屏起播界面中点击续播控件。若没有数据，则展示投屏入口界面，并在用户点击投屏控件后，跳转到投屏引导页，以重新建立投屏连接关系。
S500：通过所述虚拟会话对象从所述媒资播放地址获取投屏数据。
在响应于播放指令获取续播信息后，显示设备200可以对续播信息进行解析，从而在续播信息中读取投屏协议类型、媒资播放地址以及媒资播放进度等数据。再基于解析的数据进行投屏画面续播，即显示设备200可以从媒资播放地址获取投屏数据，并形成投屏数据流供播放器进行播放。
由于显示设备200与终端设备500在建立投屏连接时，需要用户执行相应的连接操作步骤。例如，用户需要先通过终端设备500打开视频播放界面，并再点击视频播放界面中的投屏按钮。并且当显示设备200显示投屏起播界面时，用户还需要点击投屏起播界面中的续播控件，才能完成续播操作，操作步骤较多。
因此，为了简化用户操作，在一些实施例中，显示设备200可以通过虚拟会话代替终端设备500完成投屏连接。即如图14所示，显示设备200通过前述流程在获取续播信息后，基于续播信息创建虚拟会话对象，其中，虚拟会话对象用于代替终端设备按照投屏协议类型与显示设备建立虚拟的投屏连接。
在一些实施例中，为了基于续播信息创建虚拟会话对象，显示设备200还可以在监听到用户通过点击上述投屏起播页面中的至少一个投屏控件后，响应对至少一个投屏控件的触发指示，确定该触发指示对应的目标投屏控件。然后，根据目标投屏控件查询投屏画面关联的续播应用。接下来，运行该续播应用，并通过将续播信息发送至续播应用以控制该续播应用基于续播信息创建虚拟会话对象。其中，续播应用为用于形成投屏画面的应用。
例如，显示设备200中可以配置有融合投屏服务，当投屏入口应用响应于用户对目标投屏控件的点击操作，发送Action消息后，融合投屏服务会监听到此Action消息，并通过协议类型，通知续播应用的适配层创建虚拟Session(即虚拟会话对象)。Session可用于存储特定用户会话所需的属性及配置信息。当用户在应用界面之间跳转时，存储在Session对象中的变量将不会丢失，而是在整个用户会话中一直存在下去。当用户请求来自应用界面时，如果该用户还没有会话，则显示设备200可以自动创建一个Session。当会话过期或被放弃后，显示设备200将终止该会话。
为降低显示设备关于续播信息的存储量，通过步骤S100-S300生成续播信息后，可以不将续播信息存储在本地。而是将部分续播信息存储在投屏控件中，并将余下部分存储在续播应用。例如，可将媒资播放地址、用户设定的播放效果信息等存在投屏控件中，并将投屏协议类型、媒资播放进度等存在续播应用中。这样，在确定用户触发的目标投屏控件后，可从目标投屏控件和目标投屏控件对应的续播应用中获取到该续播信息。
显示设备200创建的虚拟会话对象，可以代替终端设备500按照续播信息中记录的投屏协议类型与显示设备200建立虚拟的投屏连接，使得显示设备200无需重复与终端设备500重新建立投屏连接关系，而是直接利用续播信息中记录的媒资播放地址去获取投屏数据，即通过虚拟会话对象从媒资播放地址获取投屏数据。
在一些实施例中，虚拟会话对象还可以用于获取续播信息，并将续播信息作为播放过程中的控制变量供显示设备200的播放器使用。即续播应用的适配层在接收到续播消息，创建虚拟Session，获取保存的续播信息。
S600：根据所述媒资播放进度播放所述投屏数据的起播时刻，并基于所述播放效果信息从所述起播时刻播放所述投屏数据。
在获取投屏数据后，显示设备200可以将投屏数据输入到播放器，播放器则对输入投屏数据执行解码、渲染、输出画面等播放操作，以形成投屏画面。同时，显示设备200可以将续播信息中的媒资播放进度以及用户手动设置的播放效果信息发送给播放器，使播放器按照媒资播放进度确定投屏数据的起播时刻，并按照播放效果信息设定效果(例如前述视频播放的倍速，音轨，字幕等)从起播时刻开始播放该投屏数据。
例如，显示设备200获取的续播信息中，可以记录有媒资A的播放进度：0:38:25，以及倍速：1.2、字幕：不显示，等播放效果信息，则显示设备200可以按照0:38:25从媒资A的播放地址开始获取数据流，并将获取的数据流输入播放器。则播放器可以解码、渲染0:38:25后的媒资数据，并输出画面给显示器260，以使显示器260以1.2倍速播放0:38:25后的投屏画面。
上述实施例可以针对推送方式进行投屏时，通过记录续播信息，并在播放投屏画面时，调用记录的续播信息，使显示设备200能够按照续播信息中的媒资播放进度播放投屏数据，实现投屏续播效果。
由于不同的显示设备200所支持的投屏方式不同，相应建立投屏连接后所支持的功能也不同，例如对于显示设备200通过视频应用建立投屏连接时，不同的视频应用对于续播功能的支持情况也不同，即对于显示设备200系统视频应用以及与显示设备200运营商具有合作关系的第三方应用商开发的视频应用，可以按照合作规范记录和读取续播信息，但是对于没有合作关系的第三方视频应用，因其没有内置相应的记录和读取算法，导致其不支持投屏续播功能。基于此，本公开实施例的显示设备还可以根据应用类型执行投屏续播，实施时可如图15所示，包括以下步骤：
S1501：判断续播应用的应用类型；
该应用类型可包括支持投屏续播的第一类应用或不支持投屏续播的第二类应用。实施时，可通过读取应用包名信息，可以获取应用的名称、开发商等描述信息，并通过预设的匹配表进行匹配，来确定应用的应用类型。
例如，应用A的开发商为显示设备200的运营商，即应用A为显示设备200的系统应用，此时可以确定应用A支持投屏续播功能，即应用A的应用类型为第一类应用。相应的， 如果通过读取应用包名信息，确定应用B的开发商不是显示设备200的运营商，且应用B的开发商与显示设备200运营商不具有合作关系，则可以确定应用B不支持投屏续播功能，即应用B的应用类型为第二类应用。
S1502：若应用类型为第一类应用，则将续播信息发送至续播应用；
S1503：若应用类型为第二类应用，则向终端设备发送投屏连接请求；
S1504：接收终端设备根据投屏连接请求反馈的投屏数据。
如果应用类型为第二类应用，则说明续播应用不支持投屏续播功能，此时可向终端设备500发送投屏连接请求，以及接收终端设备500根据投屏连接请求反馈的投屏数据。即显示设备200可以在确定续播应用不支持按照记录续播信息的方式进行投屏续播时，向终端设备500重新发送投屏连接请求，以重新建立投屏连接关系。
为了实现续播功能，如图16所示，显示设备200还可以在确定续播应用的应用类型为第二类应用时，监听投屏界面的切换事件(S1601)。其中，切换事件是指触发显示设备200从显示投屏界面切换至显示其他界面的事件，可以通过退出指令触发，也可以通过其他条件判断方式触发。
监听到切换事件以后，显示设备200可以响应于切换事件，生成暂停播放指令(S1602)。暂停播放指令用于暂停播放投屏画面对应的投屏数据。即显示设备200可以通过暂停播放指令，控制投屏画面暂停，并将投屏界面切换至后台运行(S1603)。针对不同的投屏方式，显示设备200实现暂停播放的方式不同，当通过推送的方式建立投屏连接时，播放过程由显示设备200的播放器执行，则显示设备200可以在生成暂停播放指令后，直接响应暂停播放指令，暂停投屏数据的播放过程。而当通过镜像方式建立投屏连接时，由于播放过程不是由显示设备200的播放器执行的，是由终端设备500执行的，因此可以在生成暂停播放指令后，向终端设备500发送暂停播放指令，以使终端设备500响应暂停播放指令，暂停投屏数据的播放过程。
将投屏界面切换至后台运行后，显示设备200可以监听在预设时间内投屏界面的返回事件(S1604)。当监听到返回事件后，显示设备200再响应于返回事件，生成恢复播放指令(S1605)，即恢复播放投屏画面对应的投屏数据，以及控制显示器260显示投屏界面(S1606)。
可见，在上述实施例中，显示设备200可以根据续播应用的应用类型采用不同的方式实现投屏续播，可以使显示设备200适应更多类型的续播应用，以解决投屏播放过程无法续播的问题。
基于上述显示设备200，本公开实施例还提供一种投屏续播方法，包括：响应于用于播放投屏画面的播放指令，获取所述投屏画面的续播信息，所述续播信息为在退出播放所述投屏画面时记录的信息，所述续播信息包括投屏协议类型、媒资播放地址、媒资播放进度，以及用户设定的播放效果信息；基于所述续播信息创建虚拟会话对象，所述虚拟会话对象用于代替所述终端设备按照所述投屏协议类型与显示设备建立虚拟的投屏连接；通过所述虚拟会话对象从所述媒资播放地址获取投屏数据；根据所述媒资播放进度播放所述投屏数据的起播时刻，并基于所述播放效果信息从所述起播时刻播放所述投屏数据。
通过上述流程可知，该方法可以在显示设备切出投屏界面时记录续播信息，并在返回投屏界面时，支持显示设备获取之前保存的续播信息，并根据续播信息跳转到相应的媒资播放进度，实现投屏画面的续播，以解决投屏播放过程无法续播的问题。

Claims (10)

  1. 一种显示设备，包括：
    显示器，被配置为显示投屏界面；
    用户输入接口，被配置接收来自用户的指令；
    通信装置，被配置为与终端设备建立投屏连接；
    存储器，被配置为保存计算机指令和与显示设备关联的数据；
    至少一个处理器，与所述显示器，用户输入接口，通信装置和存储器连接，被配置执行计算机指令以使得所述显示设备执行：
    响应于用于播放投屏画面的播放指令，获取所述投屏画面的续播信息，所述续播信息为在退出播放所述投屏画面时记录的信息，所述续播信息包括投屏协议类型、媒资播放地址、媒资播放进度，以及用户设定的播放效果信息；
    基于所述续播信息创建虚拟会话对象，所述虚拟会话对象用于代替所述终端设备按照所述投屏协议类型与显示设备建立虚拟的投屏连接；
    通过所述虚拟会话对象从所述媒资播放地址获取投屏数据；
    根据所述媒资播放进度播放所述投屏数据的起播时刻，并基于所述播放效果信息从所述起播时刻播放所述投屏数据。
  2. 根据权利要求1所述的显示设备，所述至少一个处理器，被进一步配置为执行计算机指令以使得所述显示设备执行：
    获取用于退出投屏界面的退出指令；
    响应于所述退出指令，记录所述投屏界面的投屏协议类型和媒资播放地址，以及，记录所述退出指令输入时刻的媒资播放进度和播放效果信息；
    根据所述投屏协议类型、所述媒资播放地址、所述媒资播放进度，以及所述播放效果信息生成所述续播信息；
    存储所述续播信息，以及关闭与所述终端设备的投屏连接通道。
  3. 根据权利要求2所述的显示设备，所述至少一个处理器，被进一步配置为执行计算机指令以使得所述显示设备执行：
    存储所述续播信息前，根据所述媒资播放地址和所述媒资播放进度生成续播图像；所述续播图像为按照所述媒资播放进度在所述投屏画面的数据流中提取的画面帧；或者，所述续播图像为通过调用截图接口对所述投屏画面执行截图获得的图像；
    对所述投屏图像执行压缩处理，以生成缩略图；
    将所述缩略图添加至所述续播信息。
  4. 根据权利要求3所述的显示设备，所述至少一个处理器，被进一步配置为执行计算机指令以使得所述显示设备执行：
    所述续播信息后，获取所述续播信息的存储时长和预设存储阈值；
    如果所述存储时长大于或等于所述预设存储阈值，删除所述续播信息；
    如果所述存储时长小于所述预设存储阈值，监听所述续播信息对应投屏画面起播事件，以及在监听到所述起播事件后，删除所述续播信息。
  5. 根据权利要求2所述的显示设备，所述至少一个处理器，被进一步配置为执行计算机指令以使得所述显示设备执行：
    记录所述媒资播放地址、所述媒资播放进度以及所述播放效果信息后，获取所述投屏 画面的媒资总时长；
    根据所述媒资总时长和所述媒资播放进度，计算媒资剩余时长；
    如果所述媒资剩余时长大于或等于预设时长阈值，执行根据所述投屏协议类型、媒资播放地址以及媒资播放进度生成所述续播信息的步骤；
    如果所述媒资剩余时长小于所述预设时长阈值，执行关闭与所述终端设备的投屏连接通道的步骤。
  6. 根据权利要求1所述的显示设备，所述至少一个处理器，具体被配置为执行计算机指令以使得所述显示设备通过下述方式接收所述播放指令：
    调用投屏入口应用，所述投屏入口应用为提供投屏起播界面的应用；
    通过投屏入口应用获取所述投屏画面的续播信息；
    控制所述投屏入口应用根据所述续播信息生成投屏起播界面，所述投屏起播界面中包括至少一个投屏控件，所述投屏控件的显示内容根据所述续播信息生成；
    控制所述显示器显示所述投屏起播界面，以通过所述投屏起播界面接收所述播放指令。
  7. 根据权利要求6所述的显示设备，所述至少一个处理器，具体被配置为执行计算机指令以使得所述显示设备通过下述执行基于所述续播信息创建虚拟会话对象：
    响应于对所述至少一个投屏控件的触发指示，确定所述触发指示对应的目标投屏控件；
    根据所述目标投屏控件查询所述投屏画面关联的续播应用，所述续播应用为用于形成投屏画面的应用；
    运行所述续播应用，以及将所述续播信息发送至所述续播应用；
    控制所述续播应用基于所述续播信息创建虚拟会话对象。
  8. 根据权利要求7所述的显示设备，所述至少一个处理器，被进一步配置为执行计算机指令以使得所述显示设备执行：
    检测所述续播应用的应用类型，所述应用类型为支持投屏续播的第一类应用或不支持投屏续播的第二类应用；
    如果所述应用类型为第一类应用，执行将所述续播信息发送至所述续播应用的步骤；
    如果所述应用类型为第二类应用，向所述终端设备发送投屏连接请求，以及接收所述终端设备根据所述投屏连接请求反馈的投屏数据。
  9. 根据权利要求8所述的显示设备，所述至少一个处理器，被进一步配置为执行计算机指令以使得所述显示设备执行：
    若所述应用类型为第二类应用，则监听所述投屏界面的切换事件；
    响应于所述切换事件，生成暂停播放指令，所述暂停播放指令用于暂停播放所述投屏画面对应的投屏数据；
    将所述投屏界面切换至后台运行；
    监听在预设时间内所述投屏界面的返回事件；
    响应于所述返回事件，生成恢复播放指令，以及控制所述显示器显示所述投屏界面，所述恢复播放指令用于恢复播放所述投屏画面对应的投屏数据。
  10. 一种投屏续播方法，包括：
    响应于用于播放投屏画面的播放指令，获取所述投屏画面的续播信息，所述续播信息为在退出播放所述投屏画面时记录的信息，所述续播信息包括投屏协议类型、媒资播放地址、媒资播放进度，以及用户设定的播放效果信息；
    基于所述续播信息创建虚拟会话对象，所述虚拟会话对象用于代替所述终端设备按照所述投屏协议类型与显示设备建立虚拟的投屏连接；
    通过所述虚拟会话对象从所述媒资播放地址获取投屏数据；
    根据所述媒资播放进度播放所述投屏数据的起播时刻，并基于所述播放效果信息从所述起播时刻播放所述投屏数据。
PCT/CN2024/113671 2023-12-15 2024-08-21 一种显示设备及投屏续播方法 Pending WO2025123763A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202480038736.XA CN121359462A (zh) 2023-12-15 2024-08-21 一种显示设备及投屏续播方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202311734403.4A CN120166248A (zh) 2023-12-15 2023-12-15 一种显示设备及投屏续播方法
CN202311734403.4 2023-12-15

Publications (2)

Publication Number Publication Date
WO2025123763A1 true WO2025123763A1 (zh) 2025-06-19
WO2025123763A9 WO2025123763A9 (zh) 2025-11-13

Family

ID=96003928

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2024/113671 Pending WO2025123763A1 (zh) 2023-12-15 2024-08-21 一种显示设备及投屏续播方法

Country Status (2)

Country Link
CN (2) CN120166248A (zh)
WO (1) WO2025123763A1 (zh)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140245185A1 (en) * 2013-02-28 2014-08-28 Ricoh Company, Ltd. Electronic Information Collaboration System
CN110557674A (zh) * 2018-05-30 2019-12-10 环球天成科技(北京)有限公司 智能投屏播放、传输方法及装置
CN111741352A (zh) * 2020-07-09 2020-10-02 腾讯科技（深圳）有限公司 一种投屏控制的方法、投屏播放的方法以及相关装置
CN116233522A (zh) * 2023-02-17 2023-06-06 海信视像科技股份有限公司 一种显示设备及连续投屏的方法
CN116932957A (zh) * 2023-07-25 2023-10-24 北京字跳网络技术有限公司 一种同步浏览方法、装置、计算机设备及存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140245185A1 (en) * 2013-02-28 2014-08-28 Ricoh Company, Ltd. Electronic Information Collaboration System
CN110557674A (zh) * 2018-05-30 2019-12-10 环球天成科技(北京)有限公司 智能投屏播放、传输方法及装置
CN111741352A (zh) * 2020-07-09 2020-10-02 腾讯科技（深圳）有限公司 一种投屏控制的方法、投屏播放的方法以及相关装置
CN116233522A (zh) * 2023-02-17 2023-06-06 海信视像科技股份有限公司 一种显示设备及连续投屏的方法
CN116932957A (zh) * 2023-07-25 2023-10-24 北京字跳网络技术有限公司 一种同步浏览方法、装置、计算机设备及存储介质

Also Published As

Publication number Publication date
CN120166248A (zh) 2025-06-17
CN121359462A (zh) 2026-01-16
WO2025123763A9 (zh) 2025-11-13

Similar Documents

Publication Publication Date Title
CN112333509B (zh) 一种媒资推荐方法、推荐媒资的播放方法及显示设备
CN113242444B (zh) 一种显示设备、服务器及媒资播放方法
KR101913254B1 (ko) 서비스 처리 장치 및 서비스 처리 방법
CN119299782A (zh) 一种投屏模式处理方法及显示设备
CN115119051B (zh) 一种视频播放控制方法及显示设备
CN116708390B (zh) 显示设备、贴片广告的显示方法、及存储介质
CN115119022A (zh) 一种跳过视频广告的控制方法及显示设备
WO2026067027A1 (zh) 显示设备和投屏方法
CN116233522A (zh) 一种显示设备及连续投屏的方法
WO2025102986A1 (zh) 一种显示设备及多路投屏控制方法
US12621534B2 (en) Picture mode refreshing method and display apparatus
WO2024260182A1 (zh) 一种显示设备及投屏方法
WO2025123763A9 (zh) 一种显示设备及投屏续播方法
WO2022066604A1 (en) Content casting from digital televisions
WO2024169421A1 (zh) 显示设备和显示处理方法
CN113766300B (zh) 一种显示设备及节目数据的缓存方法
CN119729067B (zh) 一种显示设备及投屏模式切换方法
CN118646923A (zh) 一种显示设备及频道管理方法
CN114173195B (zh) 一种显示设备及统计媒资有效播放时长的方法
KR101614946B1 (ko) 장면 간의 링크를 이용한 멀티미디어 컨텐츠 재생 방법 및 장치
CN118828080A (zh) 一种显示设备及视频切换方法
CN120017891A (zh) 一种显示设备及多路窗口切换方法
CN120166249A (zh) 一种显示设备、存储服务器及投屏内容续播的方法
CN120017894A (zh) 一种显示设备及一种多路投屏声音播控方法
CN119135967B (zh) 显示设备与免打扰模式启动方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24902189

Country of ref document: EP

Kind code of ref document: A1