WO2021212668A1 - 一种投屏显示方法及显示设备 - Google Patents

一种投屏显示方法及显示设备 Download PDF

Info

Publication number
WO2021212668A1
WO2021212668A1 PCT/CN2020/101156 CN2020101156W WO2021212668A1 WO 2021212668 A1 WO2021212668 A1 WO 2021212668A1 CN 2020101156 W CN2020101156 W CN 2020101156W WO 2021212668 A1 WO2021212668 A1 WO 2021212668A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
recommended
user
instruction
film source
Prior art date
Application number
PCT/CN2020/101156
Other languages
English (en)
French (fr)
Inventor
高雯雯
宋虎
Original Assignee
海信视像科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 海信视像科技股份有限公司 filed Critical 海信视像科技股份有限公司
Publication of WO2021212668A1 publication Critical patent/WO2021212668A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43637Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4431OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB characterized by the use of Application Program Interface [API] libraries
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/466Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H04N21/4668Learning process for intelligent management, e.g. learning user preferences for recommending movies for recommending content, e.g. movies
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/482End-user interface for program selection
    • H04N21/4826End-user interface for program selection using recommendation lists, e.g. of programs or channels sorted out according to their score
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/858Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL

Definitions

  • the present invention relates to the technical field of display devices, in particular to a projection screen display method and display device.
  • the DLNA (IGITAL LIVING NETWORK ALLIANCE, Digital Living Network Alliance) protocol is one of the commonly used multi-screen interactive protocols. Many applications in the terminal Search for TVs that can be projected in a WIFI environment, thereby sharing video, music, pictures and other content on the terminal device to a large-screen display device such as a TV for playback.
  • the user pushes a video source on the terminal device to the TV.
  • the TV will play the video.
  • the TV will exit the playback and return to Home. page.
  • This method relies on the screen projection operation performed by the user on the terminal device. Once the terminal device exits the screen projection operation, the TV does not respond after returning to the Home page, the screen projection content is single, and the user experience is poor.
  • the present invention provides a viewing history display method and display device.
  • the present invention provides a display device, including:
  • Communicator used to communicate with terminal equipment and server
  • the prompt pop-up window is used to ask the user whether to allow connection with the terminal device and play the recommended video source;
  • the controller is further configured to:
  • the first instruction is generated according to the keyword, so that the server searches for recommended information associated with the initial film source, and the recommended information includes the URI of the recommended film source.
  • the switching instruction is an instruction generated when the playback process of the original film source reaches an end.
  • the controller is further configured to:
  • the recommended information list includes thumbnails and jump controls generated according to the URI of each recommended film source.
  • the switching instruction is an instruction generated after the user inputs a click operation on the recommended film source to trigger the jump control.
  • the controller is further configured to:
  • the first instruction is resent.
  • the present invention provides a projection screen display method, including:
  • control the display In response to receiving the screen projection request sent by the terminal device, control the display to display a prompt pop-up window; the prompt pop-up window is used to ask the user whether to allow connection with the terminal device and play the recommended video source;
  • the method further includes;
  • the first instruction is generated according to the keyword, so that the server searches for recommended information associated with the initial film source, and the recommended information includes the URI of the recommended film source.
  • the switching instruction is an instruction generated when the playback process of the original source reaches an end.
  • the method further includes:
  • the recommended information list includes thumbnails and jump controls generated according to the URI of each recommended film source.
  • the switching instruction is an instruction generated after the user inputs a click operation on the recommended film source to trigger the jump control.
  • the method further includes:
  • the first instruction is resent.
  • the present invention provides a display device, including:
  • Communicator used to communicate with terminal equipment and server
  • the prompt pop-up window is used to ask the user whether to allow connection with the terminal device;
  • the initial film source corresponding to the screen projection request is started on the display, and at the same time, the recommended film contained in the recommendation information is displayed on the display. source.
  • the recommended film source is associated with the initial film source.
  • the present invention provides a display device, including:
  • Communicator used to communicate with terminal equipment and server
  • the prompt pop-up window is used to ask the user whether to allow connection with the terminal device;
  • the initial film source corresponding to the screen projection request is started on the display, and at the same time, the recommended film contained in the recommendation information is displayed on the display. source;
  • the recommended film source is automatically played on the display.
  • the present invention provides a projection screen display method, including:
  • the prompt pop-up window is used to ask the user whether to allow connection with the terminal device;
  • the initial film source corresponding to the screen projection request is started on the display, and at the same time, the recommended film contained in the recommendation information is displayed on the display. source.
  • the present invention provides a projection screen display method, including:
  • the prompt pop-up window is used to ask the user whether to allow connection with the terminal device;
  • the initial film source corresponding to the screen projection request is started on the display, and at the same time, the recommended film contained in the recommendation information is displayed on the display. source;
  • the recommended film source is automatically played on the display.
  • FIG. 1 exemplarily shows a schematic diagram of an operation scene between the display device 200 and the control device 100;
  • FIG. 2 exemplarily shows a hardware configuration block diagram of the control device 100 in FIG. 1;
  • FIG. 3 exemplarily shows a hardware configuration block diagram of the display device 200 in FIG. 1;
  • FIG. 4 exemplarily shows a block diagram of the architecture configuration of the operating system in the memory of the display device 200
  • Fig. 5 exemplarily shows a schematic diagram of a search device interface in a terminal device
  • Fig. 6 exemplarily shows a schematic diagram of the interface of the terminal device projecting the initial film source
  • FIG. 7 exemplarily shows a display schematic diagram of a prompt pop-up window
  • Fig. 8 exemplarily shows a play interface of an initial film source
  • Fig. 9 exemplarily shows another play interface of the original film source
  • Fig. 10(a) exemplarily shows a schematic diagram of the interface when the recommended information list is hidden
  • Figure 10(b) exemplarily shows a schematic diagram of the interface when the recommended information list pops up
  • FIG. 11 exemplarily shows a method for controlling screen projection
  • Fig. 12 exemplarily shows an interactive flow chart of a method for controlling projection.
  • module refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that can perform functions related to the element.
  • Fig. 1 exemplarily shows a schematic diagram of an operation scene between a display device and a control device.
  • the control device 100 and the display device 200 can communicate in a wired or wireless manner.
  • control device 100 is configured to control the display device 200, which can receive operation instructions input by the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, and act as an intermediary for the interaction between the user and the display device 200 effect.
  • the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the channel addition and subtraction operations.
  • the control device 100 may be a remote controller 100A, including infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc., to control the display device 200 in a wireless or other wired manner.
  • the user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, etc.
  • the user can control the display device 200 by inputting corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, and power on/off keys on the remote control. Function.
  • the control device 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, and the like.
  • a smart device such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, and the like.
  • an application program running on a smart device is used to control the display device 200.
  • the application can be configured to provide users with various controls through an intuitive user interface (UI) on the screen associated with the smart device.
  • UI intuitive user interface
  • the mobile terminal 100B can install a software application with the display device 200, realize connection communication through a network communication protocol, and realize the purpose of one-to-one control operation and data communication.
  • the mobile terminal 100B can establish a control instruction protocol with the display device 200, and realize the functions of the physical keys arranged on the remote control 100A by operating various function keys or virtual buttons of the user interface provided on the mobile terminal 100B.
  • the audio and video content displayed on the mobile terminal 100B can also be transmitted to the display device 200 to realize the synchronous display function.
  • the display device 200 may provide a broadcast receiving function and a network TV function of a computer support function.
  • the display device can be implemented as digital TV, Internet TV, Internet Protocol TV (IPTV), and so on.
  • the display device 200 may be a liquid crystal display, an organic light emitting display, or a projection device.
  • the specific display device type, size and resolution are not limited.
  • the display device 200 also performs data communication with the server 300 through a variety of communication methods.
  • the display device 200 may be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN), and other networks.
  • the server 300 may provide various contents and interactions to the display device 200.
  • the display device 200 can send and receive information, such as receiving electronic program guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library.
  • EPG electronic program guide
  • the server 300 can be one group or multiple groups, and can be one type or multiple types of servers.
  • the server 300 provides other network service content such as video-on-demand and advertising services.
  • control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, an output interface 150, and a power supply 160.
  • the controller 110 includes a RAM (Random Access Memory) 111, a ROM (Read-Only Memory) 112, a processor 113, a communication interface, and a communication bus.
  • the controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components, and external and internal data processing functions.
  • the controller 110 may control to generate a signal corresponding to the detected interaction, and This signal is sent to the display device 200.
  • the memory 120 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller 110.
  • the memory 120 can store various control signal instructions input by the user.
  • the communicator 130 realizes the communication of control signals and data signals with the display device 200 under the control of the controller 110.
  • the control device 100 sends a control signal (such as a touch signal or a button signal) to the display device 200 via the communicator 130, and the control device 100 can receive the signal sent by the display device 200 via the communicator 130.
  • the communicator 130 may include an infrared module 131 (infrared signal interface) and a radio frequency signal interface 132.
  • an infrared signal interface the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and sent to the display device 200 via the infrared sending module.
  • a radio frequency signal interface a user input instruction needs to be converted into a digital signal, which is then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency sending terminal.
  • the user input interface 140 may include at least one of a microphone 141, a touch panel 142, a sensor 143, a button 144, etc., so that the user can input user instructions for controlling the display device 200 to the control device through voice, touch, gesture, pressing, etc. 100.
  • the output interface 150 outputs a user instruction received by the user input interface 140 to the display device 200, or outputs an image or voice signal received by the display device 200.
  • the output interface 150 may include an LED interface 151, a vibration interface 152 that generates vibration, a sound output interface 153 that outputs a sound, a display 154 that outputs an image, and the like.
  • the remote controller 100A can receive output signals such as audio, video, or data from the output interface 150, and display the output signals as images on the display 154, as audio on the sound output interface 153, or as vibration on the vibration interface 152. form.
  • the power supply 160 is used to provide operating power support for each element of the control device 100 under the control of the controller 110.
  • the form can be battery and related control circuit.
  • FIG. 3 exemplarily shows a block diagram of the hardware configuration of the display device 200.
  • the display device 200 may include a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, Audio processor 280, audio output interface 285, and power supply 290.
  • the tuner and demodulator 210 which receives broadcast television signals through wired or wireless means, can perform modulation and demodulation processing such as amplification, mixing and resonance, and is used to demodulate the television selected by the user from multiple wireless or cable broadcast television signals
  • modulation and demodulation processing such as amplification, mixing and resonance
  • the audio and video signals carried in the frequency of the channel, as well as additional information (such as EPG data).
  • the tuner and demodulator 210 can be selected by the user and controlled by the controller 250 to respond to the frequency of the television channel selected by the user and the television signal carried by the frequency.
  • the tuner and demodulator 210 can receive signals in many ways according to different broadcasting formats of TV signals, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting; and according to different modulation types, it can be digital modulation or analog Modulation method; and according to different types of received TV signals, analog signals and digital signals can be demodulated.
  • different broadcasting formats of TV signals such as terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting
  • modulation types it can be digital modulation or analog Modulation method
  • received TV signals, analog signals and digital signals can be demodulated.
  • the tuner demodulator 210 may also be in an external device, such as an external set-top box.
  • the set-top box outputs a TV signal after modulation and demodulation, and is input to the display device 200 through the external device interface 240.
  • the communicator 220 is a component used to communicate with external devices or external servers according to various types of communication protocols.
  • the display device 200 may transmit content data to an external device connected via the communicator 220, or browse and download content data from an external device connected via the communicator 220.
  • the communicator 220 may include a network communication protocol module such as a WIFI module 221, a Bluetooth module 222, and a wired Ethernet module 223 or a near field communication protocol module, so that the communicator 220 can receive the control signal of the control device 100 according to the control of the controller 250, and Realize the control signal as WIFI signal, Bluetooth signal, radio frequency signal, etc.
  • the detector 230 is a component of the display device 200 for collecting signals from the external environment or interacting with the outside.
  • the detector 230 may include a sound collector 231, such as a microphone, which may be used to receive a user's voice, such as a voice signal of a control instruction for the user to control the display device 200; or, it may collect environmental sounds used to identify the type of environmental scene to realize display
  • the device 200 can adapt to environmental noise.
  • the detector 230 may also include an image collector 232, such as a camera, a camera, etc., which may be used to collect external environment scenes to adaptively change the display parameters of the display device 200; and to collect The attributes of the user or interactive gestures with the user to achieve the function of interaction between the display device and the user.
  • an image collector 232 such as a camera, a camera, etc., which may be used to collect external environment scenes to adaptively change the display parameters of the display device 200; and to collect The attributes of the user or interactive gestures with the user to achieve the function of interaction between the display device and the user.
  • the detector 230 may further include a light receiver (not shown in the figure), which is used to collect the ambient light intensity to adapt to changes in display parameters of the display device 200 and so on.
  • the detector 230 may also include a temperature sensor (not shown in the figure).
  • the display device 200 may adaptively adjust the display color temperature of the image. Exemplarily, when the temperature is relatively high, the color temperature of the display device 200 can be adjusted to be colder; when the temperature is relatively low, the color temperature of the display device 200 can be adjusted to be warmer.
  • the external device interface 240 is a component that provides the controller 250 to control data transmission between the display device 200 and external devices.
  • the external device interface 240 can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), and additional information (such as EPG). ) And other data.
  • the external device interface 240 may include: HDMI (High Definition Multimedia Interface) terminal 241, CVBS (Composite Video Blanking and Sync, composite video blanking synchronization) terminal 242, component (analog or digital) terminal 243, USB Any one or more of the (Universal Serial Bus) terminal 244, a component terminal (not shown in the figure), and a red, green and blue (RGB) terminal (not shown in the figure).
  • HDMI High Definition Multimedia Interface
  • CVBS Composite Video Blanking and Sync, composite video blanking synchronization
  • component analog or digital
  • a component terminal not shown in the figure
  • RGB red, green and blue
  • the controller 250 controls the work of the display device 200 and responds to user operations by running various software control programs (such as an operating system and various application programs) stored on the memory 260.
  • various software control programs such as an operating system and various application programs
  • the controller 250 includes a RAM (Random Access Memory) 251, a ROM (Read Only Memory) 252, a graphics processor 253, a CPU processor 254, a communication interface 255, and a communication bus 256.
  • the RAM 251, the ROM 252, the graphics processor 253, the CPU processor 254, and the communication interface 255 are connected through a communication bus 256.
  • ROM252 used to store various system startup instructions. For example, when the power-on signal is received, the power of the display device 200 starts to start, and the CPU processor 254 runs the system start-up instruction in the ROM 252, and copies the operating system stored in the memory 260 to the RAM 251 to start running the start-up operating system. After the operating system is started up, the CPU processor 254 copies various application programs in the memory 260 to the RAM 251, and then starts to run and start various application programs.
  • the graphics processor 253 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics.
  • the graphics processor 253 may include an arithmetic unit, which is used to perform operations by receiving various interactive instructions input by the user, and then display various objects according to display attributes; and includes a renderer, which is used to generate various objects obtained based on the arithmetic unit, and perform The rendered result is displayed on the display 275.
  • the CPU processor 254 is used to execute the operating system and application program instructions stored in the memory 260, and execute various application programs, data and content processing according to the received user input instructions, so as to finally display and play various sounds Video content.
  • the CPU processor 254 may include multiple processors.
  • the multiple processors may include a main processor and multiple or one sub-processors.
  • the main processor is configured to perform some initialization operations of the display device 200 in the display device preloading mode, and/or, to display screen operations in the normal mode. Multiple or one sub-processor, used to perform an operation in the standby mode of the display device.
  • the communication interface 255 may include a first interface, a second interface to the nth interface. These interfaces may be network interfaces connected to external devices via a network.
  • the controller 250 may control the overall operation of the display device 200. For example, in response to receiving a user input command for selecting a GUI (Graphical User Interface) object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.
  • GUI Graphic User Interface
  • the object can be any one of the selectable objects, such as a hyperlink or an icon.
  • the operation related to the selected object for example, the operation of displaying the page, document, image, etc. connected to the hyperlink, or the operation of executing the program corresponding to the object.
  • the user input command for selecting the GUI object may be a command input through various input devices (for example, a mouse, a keyboard, a touch pad, etc.) connected to the display device 200 or a voice command corresponding to a voice spoken by the user.
  • the memory 260 is used to store various types of data, software programs or application programs for driving and controlling the operation of the display device 200.
  • the memory 260 may include volatile and/or non-volatile memory.
  • the term “memory” includes the memory 260, the RAM 251 and ROM 252 of the controller 250, or the memory card in the display device 200.
  • the memory 260 is specifically used to store the operating program that drives the controller 250 in the display device 200; to store various application programs built in the display device 200 and downloaded from external devices by the user; and to store the configuration provided by the display 275 Data such as various GUIs, various objects related to the GUI, and visual effect images of the selector used to select GUI objects.
  • the memory 260 is specifically used to store drivers and related data of the tuner and demodulator 210, the communicator 220, the detector 230, the external device interface 240, the video processor 270, the display 275, the audio processor 280, etc.
  • external data such as audio and video data
  • user data such as key information, voice information, touch information, etc.
  • the memory 260 specifically stores software and/or programs used to represent an operating system (OS). These software and/or programs may include, for example, a kernel, middleware, and application programming interface (Application Programming Interface). Interface, API) and/or application.
  • OS operating system
  • these software and/or programs may include, for example, a kernel, middleware, and application programming interface (Application Programming Interface). Interface, API) and/or application.
  • the kernel can control or manage system resources and functions implemented by other programs (such as the middleware, API, or application program); at the same time, the kernel can provide interfaces to allow middleware, API, or application program access control To control or manage system resources.
  • FIG. 4 exemplarily shows a block diagram of the architecture configuration of the operating system in the memory of the display device 200.
  • the operating system architecture consists of the application layer, the middleware layer, and the kernel layer from top to bottom.
  • Application layer system built-in applications and non-system-level applications belong to the application layer. Responsible for direct interaction with users.
  • the application layer can include multiple applications, such as settings applications, e-post applications, media center applications, and so on. These applications can be implemented as web applications, which are executed based on the WebKit engine, and specifically can be developed and executed based on HTML5, Cascading Style Sheets (CSS) and JavaScript.
  • CSS Cascading Style Sheets
  • HTML HyperText Markup Language
  • HTML tags are used to describe text, graphics, animations, sounds, tables, For links, the browser will read the HTML document, explain the content of the tags in the document, and display it in the form of a web page.
  • CSS the full name of Cascading Style Sheets (Cascading Style Sheets), is a computer language used to express the style of HTML documents, and can be used to define style structures, such as fonts, colors, and positions. CSS styles can be directly stored in HTML web pages or in separate style files to achieve control over styles in web pages.
  • JavaScript is a language used in web page programming, which can be inserted into HTML pages and interpreted and executed by the browser.
  • the interaction logic of the web application is implemented through JavaScript.
  • JavaScript can encapsulate the JavaScript extension interface through the browser to realize the communication with the kernel layer,
  • the middleware layer can provide some standardized interfaces to support the operation of various environments and systems.
  • the middleware layer can be implemented as the Multimedia and Hypermedia Experts Group (MHEG) of the middleware related to data broadcasting, and can also be implemented as the DLNA (Digital Living Network Alliance (Digital Living Network Alliance) middleware can also be implemented as middleware that provides a browser environment for various applications in the display device.
  • MHEG Multimedia and Hypermedia Experts Group
  • DLNA Digital Living Network Alliance
  • middleware can also be implemented as middleware that provides a browser environment for various applications in the display device.
  • the kernel layer provides core system services, such as file management, memory management, process management, network management, system security authority management and other services.
  • the kernel layer can be implemented as a kernel based on various operating systems, for example, a kernel based on the Linux operating system.
  • the kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: providing display drivers for displays, camera drivers for cameras, button drivers for remote controls, and WIFI modules Provide WiFi driver, audio driver for audio output interface, power management driver for Power Management (PM) module, etc.
  • device driver services for various hardware, such as: providing display drivers for displays, camera drivers for cameras, button drivers for remote controls, and WIFI modules Provide WiFi driver, audio driver for audio output interface, power management driver for Power Management (PM) module, etc.
  • PM Power Management
  • the user interface 265 receives various user interactions. Specifically, it is used to send the input signal of the user to the controller 250, or to transmit the output signal from the controller 250 to the user.
  • the remote control 100A may send input signals input by the user, such as a power switch signal, a channel selection signal, and a volume adjustment signal, to the user interface 265, and then the user interface 265 transfers to the controller 250; or the remote control 100A may Receive output signals such as audio, video, or data output from the user interface 265 after the controller 250 processes, and display the received output signal or output the received output signal as audio or vibration.
  • the user may input a user command on a graphical user interface (GUI) displayed on the display 275, and the user interface 265 receives the user input command through the GUI.
  • GUI graphical user interface
  • the user interface 265 may receive user input commands for controlling the position of the selector in the GUI to select different objects or items.
  • the user may input a user command by inputting a specific sound or gesture, and the user interface 265 recognizes the sound or gesture through the sensor to receive the user input command.
  • the video processor 270 is used to receive external video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal.
  • video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal.
  • the video signal displayed or played directly on the display 275.
  • the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.
  • the demultiplexing module is used to demultiplex the input audio and video data stream, such as the input MPEG-2 stream (based on the compression standard of digital storage media moving images and voice), then the demultiplexing module will demultiplex it Multiplexed into video signals and audio signals, etc.
  • the video decoding module is used to process the demultiplexed video signal, including decoding and scaling.
  • An image synthesis module such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator with the zoomed video image according to the user input or itself, so as to generate an image signal for display.
  • the frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of the input 60Hz video to a frame rate of 120Hz or 240Hz, and the usual format is realized by such as frame interpolation.
  • the display formatting module is used to change the signal output by the frame rate conversion module to a signal conforming to the display format such as a display, for example, format the signal output by the frame rate conversion module to output RGB data signals.
  • the display 275 is used to receive the image signal input from the video processor 270 to display video content, images, and a menu control interface.
  • the displayed video content can be from the video content in the broadcast signal received by the tuner and demodulator 210, or from the video content input by the communicator 220 or the external device interface 240.
  • the display 275 simultaneously displays a user manipulation interface UI generated in the display device 200 and used to control the display device 200.
  • the display 275 may include a display screen component for presenting a picture and a driving component for driving image display.
  • the display 275 may also include a projection device and a projection screen.
  • the audio processor 280 is used to receive external audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing, so that it can be stored in the speaker 286 The audio signal to be played.
  • the audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), High Efficiency AAC (HE-AAC) and other formats.
  • AAC Advanced Audio Coding
  • HE-AAC High Efficiency AAC
  • the audio output interface 285 is used to receive the audio signal output by the audio processor 280 under the control of the controller 250.
  • the audio output interface 285 may include a speaker 286, or output to an external audio output terminal 287 of a generator of an external device, such as a headset Output terminal.
  • the video processor 270 may include one or more chips.
  • the audio processor 280 may also include one or more chips.
  • the video processor 270 and the audio processor 280 may be separate chips, or may be integrated with the controller 250 in one or more chips.
  • the power supply 290 is used to provide power supply support for the display device 200 with power input from an external power supply under the control of the controller 250.
  • the power supply 290 may be a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200.
  • the user logs in an application (APP) that supports the DLNA screen projection function in the terminal device and enters the screen projection interface.
  • search for the display device to be projected Taking the display device as a smart TV as an example, as shown in Figure 5, initiate a screen projection
  • Both the terminal device and the TV as the target of the projection need to be connected to WiFi.
  • the terminal device can search for the TV in the same WiFi network environment and list the searched TV devices that can establish a projection connection in the interface.
  • the current WiFi is MERCURY_6ABC
  • a TV device is searched.
  • the information of the TV device is Living Room Aurora TV (365D), and the IP address is 192.168.1.101.
  • the user clicks on the TV device he can choose to connect to the device.
  • each TV device has a selection control, as shown in the small square in Figure 5. By touching this selection control, one or more devices in the list of connectable devices can be selected for screen projection.
  • Figure 6 shows an interface for projecting an original film source on a terminal device.
  • the interface can include the original film source thumbnail, film source name, rating, style and profile, etc. and film source information.
  • the original film source thumbnail can be A certain frame of image taken from the source.
  • the method of initiating a screen projection request in the terminal device, the interface operation, and the content displayed on the interface are not limited to those shown in this embodiment and the drawings, and are specifically related to different types of terminal devices and applications.
  • the media center application After the DLNA protocol stack configured on the TV side responds to the screen projection request, it sends the first indication information to the media center application on the TV side, and the media center application displays a prompt pop-up window on the TV display according to the first indication information.
  • Figure 7 shows a prompt pop-up window.
  • the prompt pop-up window is used to ask the user whether to allow connection to the terminal device and play the recommended video source, such as "a terminal device is connecting to your TV, is it allowed to connect and play the recommended video source? ?”, and it can also display the Mac Address (Media Access Control Address) of the terminal device requesting to establish a connection.
  • Each device in the network has a unique network identifier, namely the Mac address, to confirm the network The location of the device.
  • the prompt pop-up window you can set the "Permanent consent” checkbox.
  • the TV will automatically allow the establishment of device connection and agree to play the recommended source after receiving the screencast request in the future, so The prompt pop-up window will no longer be displayed.
  • the prompt pop-up window also has “agree” and “disagree” options.
  • the TV can send the first instruction to the server. After the server responds to the first instruction, it will search for some recommended film sources. Film sources of the same type and style, or recently-broadcast film sources, high-rated film sources, etc., that is, the film sources that the user may be interested in watching are recommended to the user.
  • the recommendation information can include the URI of each recommended source, and then the original source can be started.
  • the playback interface of the original source is shown in Figure 8, that is, the original source is pushed by the terminal device. The source is projected to the TV for playback, so as to experience the large-screen viewing effect.
  • the user can directly display the recommended information list to the user, so that the user can view the recommended film source, and select a recommended film source to start broadcasting according to the degree of interest.
  • the recommended information list can be displayed at a preset position, such as the bottom of the interface; the recommended information list can be displayed in rows, that is, it includes 1 row and multiple columns. The user can swipe left and right to view the list.
  • the recommended information list can be displayed in columns, that is, it includes multiple rows and one column.
  • the user can swipe up and down to view the recommended sources included in the list; or, the recommended information list can be displayed in a grid. , Which includes multiple rows and multiple columns.
  • the presentation form of the recommended information list is not limited.
  • the recommended information list can include a thumbnail of each recommended source, and the bottom of the thumbnail can also be accompanied by the basic information of the recommended source, such as the name of the source and the number of corresponding episodes. /Periods/parts, main features and duration, etc.
  • the thumbnails are associated with jump controls, so that when users click on a recommended film source, the jump control of the recommended film source is triggered, and the original film source can be changed.
  • the display content of the recommended information list is not limited to that described in this embodiment, and can be specifically configured according to actual UI display requirements.
  • the ratio of the recommended information list to the overall display interface should be as small as possible to ensure the viewing effect of the current original film source.
  • a pop control 41 can also be set in the playback interface of the original film source, and the pop control 41 is used to hide or pop up the recommended information list.
  • the recommended information list can be hidden by default.
  • the pop-up control 41 is located at the bottom of the interface, and the original film source is played in full screen; when the user wants to view the recommendations In the information list, you can click the pop control 41, and then the pop control 41 expands in the direction of the arrow shown in Figure 10(a), so that the rows of the recommended information list pop up gradually from bottom to top until Figure 10(b) shows The recommended information list is in the display state.
  • the configuration and control mode of the pop control 41 are not limited to those described in this embodiment. This embodiment shows a gradual popping type, and other dynamic effects may also be used, for example, a playback effect of a slide show can be referred to.
  • the pop control 41 can fade or blur the display to avoid affecting the playback effect of the film source.
  • the pop-up control 41 such as some gesture control, voice control, remote click/double-click interface, etc.; or use timing display and hide, such as automatically pop up when the initial source is played to half of the total duration Recommended information list, within a preset time (such as 5 seconds) if the user has no operation or response, the recommended information list will be automatically hidden; or the recommended information list will be automatically displayed at the end of the initial film source playback, allowing the user to choose which one to continue playing next Recommended film source.
  • a preset time such as 5 seconds
  • the recommended information list will be automatically hidden; or the recommended information list will be automatically displayed at the end of the initial film source playback, allowing the user to choose which one to continue playing next Recommended film source.
  • there are various control modes for hiding and displaying the recommended information list You can set a variety of display and hiding control modes for the recommended information list in the "screen setting" of the TV for the user to choose and set. This embodiment will not repeat them. .
  • FIG. 11 shows an embodiment of a method for controlling screen projection.
  • the method is configured to be executed by the controller 250 of the display device, that is, the controller 250 is the execution body of the method, and the method includes the following program steps:
  • Step S10 in response to receiving the screen projection request sent by the terminal device, control the display to display a prompt pop-up window; the prompt pop-up window is used to ask the user whether to allow connection with the terminal device and play the recommended video source.
  • Step S20 In response to the permission instruction input by the user, the first instruction is sent to the server.
  • the first instruction is sent to the server, and the first instruction is used to instruct the server to obtain recommendation information.
  • the server responds to the first command, it will search for some recommended film sources.
  • the recommended film sources can be those related to the original film source, such as a different episode of the same TV series, or a film source of the same type and style as the original film source. Or it may be popular movie sources, high-scoring movie sources, etc., to recommend movie sources that users may be interested in watching.
  • the terminal device will send the URI of the original film source to the display device.
  • the keyword of the original film source can be parsed through the URI of the original film source, and the keyword may be important information such as the name of the film source.
  • the URI of the original film source is http://192.168.0.121:38520/ExportContent/Dream Therapy.mp4, and the keyword is Dream Therapy.
  • the recommendation information includes multiple recommended films. Required information such as the URI of the source.
  • the recommended film source obtained in this way has the highest relevance/similarity to the original film source, so that the recommended film source can be closer to the user's viewing interest and taste, and the user experience is greatly improved.
  • Step S30 When receiving the recommendation information sent by the server according to the first instruction, start broadcasting the original film source corresponding to the screen projection request.
  • the server when the server searches for relevance/similarity film sources based on keyword matching, the possibility of not being searched is very low. Even if it is not found, the server can According to the priority, select some sources with slightly lower relevance/similarities, or directly recommend some high-scoring, newly released or high-volume/recommended/collected sources as recommended sources. It should be noted that the manner in which the server obtains the recommended film source is not limited to that described in this embodiment, and this does not affect the essence of the solution.
  • the display device sends the first message to the server again.
  • One instruction until the recommended information returned by the server is not empty it means that a valid recommended film source is obtained, and then a play instruction can be generated, and the play instruction is used to instruct the display to start playing the original film source.
  • Step S40 in response to the switching instruction, exit the original film source, and start broadcasting the recommended film source corresponding to the recommended information.
  • step S40 when the original source is played, the playback process of the original source is detected.
  • the playback process reaches the end, that is, when the playback of the original source ends, a list of recommended information can be automatically displayed for the user to select the list One of the recommended sources in the video continues to play.
  • the display device after the display device receives the recommendation information, it sorts all the recommended sources in the recommendation information according to a certain sorting rule, and then generates a recommendation information list.
  • the sorting rule is, for example, according to the relevance or relevance to the original source. Sorting in descending order of similarity, or sorting in descending order of reference factors such as playback volume/collection volume/rating, etc., the sorting rules can be set according to actual conditions, which is not limited in this embodiment.
  • the original source is played, the recommended source in the recommended information list is started, and the recommended source in the list can be played in sequence according to the order of the recommended list if the user does not perform any operation or response.
  • the user can switch the film source while the original film source is not playing, and in response to receiving the display instruction input by the user, the recommended information list is displayed in the current playback interface.
  • the display instruction described here can be in the form of an operation on the pop control 41, or a gesture control instruction, a tap/double-click interface in the remote control, etc., or a voice instruction, for example, the user inputs "display a list of recommended information" through voice input.
  • the user enters a click operation on a recommended source in the list to trigger the jump control and generate a switching instruction, and then exit the playback of the original source and jump to the selected recommended source Continue to play, so as to realize the switching of the film source during the original film source playing process.
  • the application in this application applicable to the terminal device supports the DLNA function
  • the display device has a corresponding DLNA protocol stack
  • the DLNA protocol stack realizes the flow control of the initial film source pushed by the playback terminal.
  • the prompt pop-up window will ask the user whether to allow connection with the terminal device and play the recommended video source.
  • the recommended video source is allowed to be played and what to take Send a first instruction to the server, and the server will search for some recommended information in response to the first instruction.
  • the recommended information may include related recommended film sources related to the original film source.
  • the original film source is the first episode of TV series A, then the recommended film source It can be the second to Nth episodes of TV series A.
  • the original source pushed by the terminal can be played. If the switch instruction is received during or at the end of the original source, the original source will be exited.
  • Recommended video source for the start of the broadcast This application can not only play the original film source, but also play the recommended film source pushed by the server, so that the screen projection no longer only depends on the user's continuous request to project the film source, improves the screen projection function, and enhances the user experience.
  • FIG. 12 exemplarily shows an interactive flowchart of a projection control method, including a terminal device, a display device 200, and a server 300.
  • the display device is in communication connection with the terminal device and the server.
  • Devices include, but are not limited to, mobile terminals 100B such as smart phones, tablets, and laptops.
  • the display devices can be large screen devices such as TVs and theater screens.
  • the display devices and terminal devices support DLNA protocol and run on the same WiFi network. For other DLNA content, please refer to the prior art, which will not be repeated in this application.
  • the display device may include a DLNA protocol stack and a media center application.
  • the terminal device initiates a screen projection, it sends a screen projection request to the DLNA protocol stack.
  • the DLNA protocol stack receives the screencast request, it sends the onCheckBlackList callback information to the media center application;
  • the CheckBlackList interface of the media center application responds to the onCheckBlackList callback information, starts the CheckBlackList logic, controls the display to display the prompt pop-up window, and detects whether the permission command input by the user is received , If the user input permission instruction is not detected, that is, the user chooses "disagree", then the screencast request is rejected and the process ends; if the user input permission instruction is received, the user selects "agree” or “permanently agree” , Then enter the next processing logic.
  • the terminal device When the user responds to the screen request and allows the device to connect and play the recommended source, the terminal device sends the URI of the original source to the display device. After receiving the URI of the original source, the DLNA protocol stack sends the onSetURI callback information to the media center application.
  • the onSetURI callback information carries the URI of the original film source; the SetURI interface of the media center application responds to the onSetURI callback information, starts the onSetURI logic, and parses the keywords of the original film source.
  • the DLNA protocol stack sends the onCheckMsg callback information to the media center application; the CheckMsg interface of the media center application responds to the onCheckMsg callback information, starts the CheckMsg logic, generates the first instruction according to the keyword, and sends the first instruction to the server; the server responds first After the instruction, the recommended information is obtained, and the recommended information is sent to the media center application.
  • the DLNA protocol stack judges whether the recommended information is empty according to the recommended information fed back by the media center application; if the recommended information is not empty, it sends the play instruction onPlay to the media center application, and the media center application starts the play logic: the display starts the initial play according to the play instruction Film source.
  • the present invention also provides a computer storage medium, wherein the computer storage medium may store a program, and when the computer storage medium is located in a display device, the program execution may include steps that the controller 250 is configured to execute.
  • the computer storage medium may be a magnetic disk, an optical disc, a read-only memory (English: read-only memory, abbreviated as: ROM) or a random access memory (English: random access memory, abbreviated as: RAM), etc.

Abstract

本申请公开一种投屏显示方法及显示设备,显示设备包括:显示器;通信器,用于与终端设备和服务器通信连接;用户接口,用于接收用户输入;控制器,用于执行:响应于接收到终端设备发送的投屏请求,控制所述显示器显示提示弹窗;所述提示弹窗用于询问用户是否允许与所述终端设备连接并播放推荐片源;响应于用户输入的允许指令,向服务器发送第一指令;当接收到所述服务器根据所述第一指令发送的推荐信息时,起播与所述投屏请求对应的初始片源;响应于切换指令,退出所述初始片源,起播所述推荐信息对应的推荐片源。本申请不仅能播放初始片源,还能播放服务器推荐的片源,使得投屏不再仅依赖于用户不断的请求投射片源,改进投屏功能,提升用户体验。

Description

一种投屏显示方法及显示设备
本申请要求在2020年4月22日提交中国专利局、申请号为CN202010321156.5、申请名称为“一种投屏显示方法及显示设备”的优先权;其全部内容通过引用结合在本申请中。
技术领域
本发明涉及显示设备技术领域,尤其涉及一种投屏显示方法及显示设备。
背景技术
DLNA(IGITAL LIVING NETWORK ALLIANCE,数字生活网络联盟)协议是常用的多屏互动协议之一,终端设备中很多应用程序支持DLNA功能,用户在终端设备中登录支持DLNA功能的应用程序后,可以在当前WIFI环境下搜索可投射的电视,从而将终端设备上的视频、音乐、图片等内容共享到电视等大屏显示设备上进行播放。
目前在使用DLNA功能的过程中,用户在终端设备向电视端推送一个片源,终端设备与电视端建立连接后,电视会播放该片源,片源播放结束之后,电视退出播放并回到Home页面。这样方式依赖于用户在终端设备执行的投屏操作,一旦终端设备退出投屏操作,电视端返回Home页面后没有响应,投屏内容单一,用户体验差。
发明内容
为解决上述技术问题,本发明提供一种观看历史显示方法及显示设备。
第一方面,本发明提供一种显示设备,包括:
显示器;
通信器,用于与终端设备和服务器通信连接;
用户接口,用于接收用户输入;
控制器,用于执行:
响应于接收到终端设备发送的投屏请求,控制所述显示器显示提示弹窗;所述提示弹窗用于询问用户是否允许与所述终端设备连接并播放推荐片源;
响应于用户输入的允许指令,向服务器发送第一指令;
当接收到所述服务器根据所述第一指令发送的推荐信息时,起播与所述投屏请求对应的初始片源;
响应于切换指令,退出所述初始片源,起播所述推荐信息对应的推荐片源。
一些实施例中,所述控制器还被配置为:
响应于用户输入的允许指令,根据所述终端设备发送的所述初始片源的URI,解析所述初始片源的关键字;
根据所述关键字生成所述第一指令,以使所述服务器搜索与所述初始片源相关联的推荐信息,所述推荐信息包括所述推荐片源的URI。
一些实施例中,所述切换指令为所述初始片源的播放进程达到终点时生成的指令。
一些实施例中,所述控制器还被配置为:
所述初始片源播放过程中,响应于接收到用户输入的显示指令,在当前播放界面中显示推荐信息列表;
其中,所述推荐信息列表中包括根据每个推荐片源的URI生成的缩略图和跳转控件。
一些实施例中,所述切换指令为用户输入对所述推荐片源的点击操作,触发所述跳转控件后生成的指令。
一些实施例中,所述控制器还被配置为:
当所述推荐信息为非空信息时,生成播放指令,所述播放指令用于指示所述显示器起播所述初始片源;
当所述推荐信息为空信息时,重新发送所述第一指令。
第二方面,本发明提供一种投屏显示方法,包括:
响应于接收到终端设备发送的投屏请求,控制显示器显示提示弹窗;所述提示弹窗用于询问用户是否允许与所述终端设备连接并播放推荐片源;
响应于用户输入的允许指令,向服务器发送第一指令;
当接收到所述服务器根据所述第一指令发送的推荐信息时,起播与所述投屏请求对应的初始片源;
响应于切换指令,退出所述初始片源,起播所述推荐信息对应的推荐片源。
在一些实施例中,所述方法还包括;
响应于用户输入的允许指令,根据所述终端设备发送的所述初始片源的URI,解析所述初始片源的关键字;
根据所述关键字生成所述第一指令,以使所述服务器搜索与所述初始片源相关联的推荐信息,所述推荐信息包括所述推荐片源的URI。
在一些实施例中,所述切换指令为所述初始片源的播放进程达到终点时生成的指令。
在一些实施例中,所述方法还包括:
所述初始片源播放过程中,响应于接收到用户输入的显示指令,在当前播放界面中显示推荐信息列表;
其中,所述推荐信息列表中包括根据每个推荐片源的URI生成的缩略图和跳转控件。
在一些实施例中,所述切换指令为用户输入对所述推荐片源的点击操作,触发所述跳转控件后生成的指令。
在一些实施例中,所述方法还包括:
当所述推荐信息为非空信息时,生成播放指令,所述播放指令用于指示所述显示器起播所述初始片源;
当所述推荐信息为空信息时,重新发送所述第一指令。
第三方面,本发明提供一种显示设备,包括:
显示器;
通信器,用于与终端设备和服务器通信连接;
用户接口,用于接收用户输入;
控制器,用于执行:
响应于接收到终端设备发送的投屏请求,控制所述显示器显示提示弹窗;所述提示弹窗用于询问用户是否允许与所述终端设备连接;
响应于用户输入的允许指令,向服务器发送第一指令;
当接收到所述服务器根据所述第一指令发送的推荐信息时,在显示器上起播与所述投屏请求对应的初始片源,同时,在显示器上显示所述推荐信息中包含的推荐片源。
在一些实施例中,所述推荐片源与所述初始片源相关联。
第四方面,本发明提供一种显示设备,包括:
显示器;
通信器,用于与终端设备和服务器通信连接;
用户接口,用于接收用户输入;
控制器,用于执行:
响应于接收到终端设备发送的投屏请求,控制所述显示器显示提示弹窗;所述提示弹窗用于询问用户是否允许与所述终端设备连接;
响应于用户输入的允许指令,向服务器发送第一指令;
当接收到所述服务器根据所述第一指令发送的推荐信息时,在显示器上起播与所述投屏请求对应的初始片源,同时,在显示器上显示所述推荐信息中包含的推荐片源;
在监听到所述初始片源播放结束时,在显示器上自动播放所述推荐片源。
第五方面,本发明提供一种投屏显示方法,包括:
响应于接收到终端设备发送的投屏请求,控制所述显示器显示提示弹窗;所述提示弹窗用于询问用户是否允许与所述终端设备连接;
响应于用户输入的允许指令,向服务器发送第一指令;
当接收到所述服务器根据所述第一指令发送的推荐信息时,在显示器上起播与所述投屏请求对应的初始片源,同时,在显示器上显示所述推荐信息中包含的推荐片源。
第六方面,本发明提供一种投屏显示方法,包括:
响应于接收到终端设备发送的投屏请求,控制所述显示器显示提示弹窗;所述提示弹窗用于询问用户是否允许与所述终端设备连接;
响应于用户输入的允许指令,向服务器发送第一指令;
当接收到所述服务器根据所述第一指令发送的推荐信息时,在显示器上起播与所述投屏请求对应的初始片源,同时,在显示器上显示所述推荐信息中包含的推荐片源;
在监听到所述初始片源播放结束时,在显示器上自动播放所述推荐片源。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1中示例性示出了显示设备200与控制装置100之间操作场景的示意图;
图2中示例性示出了图1中控制装置100的硬件配置框图;
图3中示例性示出了图1中显示设备200的硬件配置框图;
图4中示例性示出了显示设备200的存储器中操作系统的架构配置框图;
图5中示例性示出了终端设备中的搜索设备界面示意图;
图6中示例性示出了终端设备投射初始片源的界面示意图;
图7中示例性示出了一种提示弹窗的显示示意图;
图8中示例性示出了一种初始片源的播放界面;
图9中示例性示出了另一种初始片源的播放界面;
图10(a)中示例性示出了隐藏推荐信息列表时的界面示意图;
图10(b)中示例性示出了弹出推荐信息列表时的界面示意图;
图11中示例性示出了一种投屏控制方法;
图12中示例性示出了一种投屏控制方法的交互流程图。
具体实施方式
为使本申请示例性实施例的目的、实施方案和优点更加清楚,下面将结合本申请示例性实施例中的附图,对本申请示例性实施例中的实施方案进行清楚、完整地描述,显然,所描述的示例性实施例仅是本申请一部分实施例,而不是全部的实施例。
基于本申请中示出的示例性实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。此外,虽然本申请中公开内容按照示范性一个或几个实例来介绍,但应理解,可以就这些公开内容的各个方面也可以单独构成一个完整技术方案。
本申请中使用的术语“包括”和“具有”以及他们的任何变形,意图在于覆盖但不排他的包含,例如,包含了一系列组件的产品或设备不必限于清楚地列出的那些组件,而是可包括没有清楚地列出的或对于这些产品或设备固有的其它组件。
本申请中使用的术语“模块”,是指任何已知或后来开发的硬件、软件、固件、人工智能、模糊逻辑或硬件或/和软件代码的组合,能够执行与该元件相关的功能。
图1中示例性示出了显示设备与控制装置之间操作场景的示意图。如图1所示,控制装置100和显示设备200之间可以有线或无线方式进行通信。
其中,控制装置100被配置为控制显示设备200,其可接收用户输入的操作指令,且将操作指令转换为显示设备200可识别和响应的指令,起着用户与显示设备200之间交互的中介作用。如:用户通过操作控制装置100上频道加减键,显示设备200响应频道加减的操作。
控制装置100可以是遥控器100A,包括红外协议通信或蓝牙协议通信,及其他短距离通信方式等,通过无线或其他有线方式来控制显示设备200。用户可以通过遥控器上按键、语音输入、控制面板输入等输入用户指令,来控制显示设备200。如:用户可以通过遥控器上音量加减键、频道控制键、上/下/左/右的移动按键、语音输入按键、菜单键、开关机按键等输入相应控制指令,来实现控制显示设备200的功能。
控制装置100也可以是智能设备,如移动终端100B、平板电脑、计算机、笔记本电脑等。例如,使用在智能设备上运行的应用程序控制显示设备200。该应用程序通过配置可以在与智能设备关联的屏幕上,通过直观的用户界面(User Interface,UI)为用户提供各种控制。
示例性的,移动终端100B可与显示设备200安装软件应用,通过网络通信协议实现 连接通信,实现一对一控制操作的和数据通信的目的。如:可以使移动终端100B与显示设备200建立控制指令协议,通过操作移动终端100B上提供的用户界面的各种功能键或虚拟按钮,来实现如遥控器100A布置的实体按键的功能。也可以将移动终端100B上显示的音视频内容传输到显示设备200上,实现同步显示功能。
显示设备200可提供广播接收功能和计算机支持功能的网络电视功能。显示设备可以实施为,数字电视、网络电视、互联网协议电视(IPTV)等。
显示设备200,可以是液晶显示器、有机发光显示器、投影设备。具体显示设备类型、尺寸大小和分辨率等不作限定。
显示设备200还与服务器300通过多种通信方式进行数据通信。这里可允许显示设备200通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。服务器300可以向显示设备200提供各种内容和互动。示例的,显示设备200可以发送和接收信息,例如:接收电子节目指南(Electronic Program Guide,EPG)数据、接收软件程序更新、或访问远程储存的数字媒体库。服务器300可以一组,也可以多组,可以一类或多类服务器。通过服务器300提供视频点播和广告服务等其他网络服务内容。
图2中示例性示出了控制装置100的配置框图。如图2所示,控制装置100包括控制器110、存储器120、通信器130、用户输入接口140、输出接口150、供电电源160。
控制器110包括RAM(Random Access Memory,随机存取存储器)111、ROM(Read-Only Memory,只读存储器)112、处理器113、通信接口以及通信总线。控制器110用于控制控制装置100的运行和操作,以及内部各部件之间的通信协作、外部和内部的数据处理功能。
示例性的,当检测到用户按压在遥控器100A上布置的按键的交互或触摸在遥控器100A上布置的触摸面板的交互时,控制器110可控制产生与检测到的交互相应的信号,并将该信号发送到显示设备200。
存储器120,用于在控制器110的控制下存储驱动和控制控制装置100的各种运行程序、数据和应用。存储器120,可以存储用户输入的各类控制信号指令。
通信器130在控制器110的控制下,实现与显示设备200之间控制信号和数据信号的通信。如:控制装置100经由通信器130将控制信号(例如触摸信号或按钮信号)发送至显示设备200上,控制装置100可经由通信器130接收由显示设备200发送的信号。通信器130可以包括红外模块131(红外信号接口)和射频信号接口132。例如:红外信号接口时,需要将用户输入指令按照红外控制协议转化为红外控制信号,经红外发送模块进行发送至显示设备200。再如:射频信号接口时,需将用户输入指令转化为数字信号,然后 按照射频控制信号调制协议进行调制后,由射频发送端子发送至显示设备200。
用户输入接口140,可包括麦克风141、触摸板142、传感器143、按键144等中至少一者,从而用户可以通过语音、触摸、手势、按压等将关于控制显示设备200的用户指令输入到控制装置100。
输出接口150,通过将用户输入接口140接收的用户指令输出至显示设备200,或者,输出由显示设备200接收的图像或语音信号。这里,输出接口150可以包括LED接口151、产生振动的振动接口152、输出声音的声音输出接口153和输出图像的显示器154等。例如,遥控器100A可从输出接口150接收音频、视频或数据等输出信号,并且将输出信号在显示器154上显示为图像形式、在声音输出接口153输出为音频形式或在振动接口152输出为振动形式。
供电电源160,用于在控制器110的控制下为控制装置100各元件提供运行电力支持。形式可以为电池及相关控制电路。
图3中示例性示出了显示设备200的硬件配置框图。如图3所示,显示设备200中可以包括调谐解调器210、通信器220、检测器230、外部装置接口240、控制器250、存储器260、用户接口265、视频处理器270、显示器275、音频处理器280、音频输出接口285、供电电源290。
调谐解调器210,通过有线或无线方式接收广播电视信号,可以进行放大、混频和谐振等调制解调处理,用于从多个无线或有线广播电视信号中解调出用户所选择的电视频道的频率中所携带的音视频信号,以及附加信息(例如EPG数据)。
调谐解调器210,可根据用户选择,以及由控制器250控制,响应用户选择的电视频道的频率以及该频率所携带的电视信号。
调谐解调器210,根据电视信号的广播制式不同,可以接收信号的途径有很多种,诸如:地面广播、有线广播、卫星广播或互联网广播等;以及根据调制类型不同,可以数字调制方式或模拟调制方式;以及根据接收电视信号的种类不同,可以解调模拟信号和数字信号。
在其他一些示例性实施例中,调谐解调器210也可在外部设备中,如外部机顶盒等。这样,机顶盒通过调制解调后输出电视信号,经过外部装置接口240输入至显示设备200中。
通信器220,是用于根据各种通信协议类型与外部设备或外部服务器进行通信的组件。例如显示设备200可将内容数据发送至经由通信器220连接的外部设备,或者,从经由通信器220连接的外部设备浏览和下载内容数据。通信器220可以包括WIFI模块221、蓝牙 模块222、有线以太网模块223等网络通信协议模块或近场通信协议模块,从而通信器220可根据控制器250的控制接收控制装置100的控制信号,并将控制信号实现为WIFI信号、蓝牙信号、射频信号等。
检测器230,是显示设备200用于采集外部环境或与外部交互的信号的组件。检测器230可以包括声音采集器231,如麦克风,可以用于接收用户的声音,如用户控制显示设备200的控制指令的语音信号;或者,可以采集用于识别环境场景类型的环境声音,实现显示设备200可以自适应环境噪声。
在其他一些示例性实施例中,检测器230,还可以包括图像采集器232,如相机、摄像头等,可以用于采集外部环境场景,以自适应变化显示设备200的显示参数;以及用于采集用户的属性或与用户交互手势,以实现显示设备与用户之间互动的功能。
在其他一些示例性实施例中,检测器230,还可以包括光接收器(图中未示出),用于采集环境光线强度,以自适应显示设备200的显示参数变化等。
在其他一些示例性实施例中,检测器230,还可以包括温度传感器(图中未示出),如通过感测环境温度,显示设备200可自适应调整图像的显示色温。示例性的,当温度偏高的环境时,可调整显示设备200显示图像色温偏冷色调;当温度偏低的环境时,可以调整显示设备200显示图像色温偏暖色调。
外部装置接口240,是提供控制器250控制显示设备200与外部设备间数据传输的组件。外部装置接口240可按照有线/无线方式与诸如机顶盒、游戏装置、笔记本电脑等外部设备连接,可接收外部设备的诸如视频信号(例如运动图像)、音频信号(例如音乐)、附加信息(例如EPG)等数据。
其中,外部装置接口240可以包括:HDMI(High Definition Multimedia Interface,高清多媒体接口)端子241、CVBS(Composite Video Blanking and Sync,复合视频消隐同步)端子242、分量(模拟或数字)端子243、USB(Universal Serial Bus,通用串行总线)端子244、组件(Component)端子(图中未示出)、红绿蓝(RGB)端子(图中未示出)等任一个或多个。
控制器250,通过运行存储在存储器260上的各种软件控制程序(如操作系统和各种应用程序),来控制显示设备200的工作和响应用户的操作。
如图3所示,控制器250包括RAM(随机存取存储器)251、ROM(只读存储器)252、图形处理器253、CPU处理器254、通信接口255以及通信总线256。其中,RAM251、ROM252以及图形处理器253、CPU处理器254和通信接口255通过通信总线256相连接。
ROM252,用于存储各种系统启动指令。如在接收到开机信号时,显示设备200电源 开始启动,CPU处理器254运行ROM252中的系统启动指令,将存储在存储器260的操作系统拷贝至RAM251中,以开始运行启动操作系统。当操作系统启动完成后,CPU处理器254再将存储器260中各种应用程序拷贝至RAM251中,然后,开始运行启动各种应用程序。
图形处理器253,用于产生各种图形对象,如图标、操作菜单、以及用户输入指令显示图形等。图形处理器253可以包括运算器,用于通过接收用户输入各种交互指令进行运算,进而根据显示属性显示各种对象;以及包括渲染器,用于产生基于运算器得到的各种对象,将进行渲染的结果显示在显示器275上。
CPU处理器254,用于执行存储在存储器260中的操作系统和应用程序指令,以及根据接收的用户输入指令,来执行各种应用程序、数据和内容的处理,以便最终显示和播放各种音视频内容。
在一些示例性实施例中,CPU处理器254,可以包括多个处理器。多个处理器可包括一个主处理器以及多个或一个子处理器。主处理器,用于在显示设备预加载模式中执行显示设备200的一些初始化操作,和/或,在正常模式下显示画面的操作。多个或一个子处理器,用于执行在显示设备待机模式等状态下的一种操作。
通信接口255,可包括第一接口、第二接口到第n接口。这些接口可以是经由网络被连接到外部设备的网络接口。
控制器250可以控制显示设备200的整体操作。例如:响应于接收到用于选择在显示器275上显示的GUI(Graphical User Interface,图形用户界面)对象的用户输入命令,控制器250便可以执行与由用户输入命令选择的对象有关的操作。
其中,该对象可以是可选对象中的任何一个,例如超链接或图标。该与所选择的对象有关的操作,例如显示连接到超链接页面、文档、图像等操作,或者执行与对象相对应的程序的操作。该用于选择GUI对象的用户输入命令,可以是通过连接到显示设备200的各种输入装置(例如,鼠标、键盘、触摸板等)输入命令或者与由用户说出语音相对应的语音命令。
存储器260,用于存储驱动和控制显示设备200运行的各种类型的数据、软件程序或应用程序。存储器260可以包括易失性和/或非易失性存储器。而术语“存储器”包括存储器260、控制器250的RAM251和ROM252、或显示设备200中的存储卡。
在一些实施例中,存储器260具体用于存储驱动显示设备200中控制器250的运行程序;存储显示设备200内置的和用户从外部设备下载的各种应用程序;存储用于配置由显示器275提供的各种GUI、与GUI相关的各种对象及用于选择GUI对象的选择器的视觉 效果图像等数据。
在一些实施例中,存储器260具体用于存储调谐解调器210、通信器220、检测器230、外部装置接口240、视频处理器270、显示器275、音频处理器280等的驱动程序和相关数据,例如从外部装置接口接收的外部数据(例如音视频数据)或用户接口接收的用户数据(例如按键信息、语音信息、触摸信息等)。
在一些实施例中,存储器260具体存储用于表示操作系统(operating system,OS)的软件和/或程序,这些软件和/或程序可包括,例如:内核、中间件、应用编程接口(Application Programming Interface,API)和/或应用程序。示例性的,内核可控制或管理系统资源,以及其它程序所实施的功能(如所述中间件、API或应用程序);同时,内核可以提供接口,以允许中间件、API或应用程序访问控制器,以实现控制或管理系统资源。
图4中示例性示出了显示设备200存储器中操作系统的架构配置框图。该操作系统架构从上到下依次是应用层、中间件层和内核层。
应用层,系统内置的应用程序以及非系统级的应用程序都是属于应用层。负责与用户进行直接交互。应用层可包括多个应用程序,如设置应用程序、电子帖应用程序、媒体中心应用程序等。这些应用程序可被实现为Web应用,其基于WebKit引擎来执行,具体可基于HTML5、层叠样式表(CSS)和JavaScript来开发并执行。
这里,HTML,全称为超文本标记语言(HyperText Markup Language),是一种用于创建网页的标准标记语言,通过标记标签来描述网页,HTML标签用以说明文字、图形、动画、声音、表格、链接等,浏览器会读取HTML文档,解释文档内标签的内容,并以网页的形式显示出来。
CSS,全称为层叠样式表(Cascading Style Sheets),是一种用来表现HTML文件样式的计算机语言,可以用来定义样式结构,如字体、颜色、位置等的语言。CSS样式可以直接存储与HTML网页或者单独的样式文件中,实现对网页中样式的控制。
JavaScript,是一种应用于Web网页编程的语言,可以插入HTML页面并由浏览器解释执行。其中Web应用的交互逻辑都是通过JavaScript实现。JavaScript可以通过浏览器,封装JavaScript扩展接口,实现与内核层的通信,
中间件层,可以提供一些标准化的接口,以支持各种环境和系统的操作。例如,中间件层可以实现为与数据广播相关的中间件的多媒体和超媒体信息编码专家组(Multimedia and Hypermedia Experts Group,MHEG),还可以实现为与外部设备通信相关的中间件的DLNA(Digital Living Network Alliance,数字生活网络联盟)中间件,还可以实现为提供显示设备内各应用程序所运行的浏览器环境的中间件等。
内核层,提供核心系统服务,例如:文件管理、内存管理、进程管理、网络管理、系统安全权限管理等服务。内核层可以被实现为基于各种操作系统的内核,例如,基于Linux操作系统的内核。
内核层也同时提供系统软件和硬件之间的通信,为各种硬件提供设备驱动服务,例如:为显示器提供显示驱动程序、为摄像头提供摄像头驱动程序、为遥控器提供按键驱动程序、为WIFI模块提供WiFi驱动程序、为音频输出接口提供音频驱动程序、为电源管理(Power Management,PM)模块提供电源管理驱动等。
用户接口265,接收各种用户交互。具体的,用于将用户的输入信号发送给控制器250,或者,将从控制器250的输出信号传送给用户。示例性的,遥控器100A可将用户输入的诸如电源开关信号、频道选择信号、音量调节信号等输入信号发送至用户接口265,再由用户接口265转送至控制器250;或者,遥控器100A可接收经控制器250处理从用户接口265输出的音频、视频或数据等输出信号,并且显示接收的输出信号或将接收的输出信号输出为音频或振动形式。
在一些实施例中,用户可在显示器275上显示的图形用户界面(GUI)输入用户命令,则用户接口265通过GUI接收用户输入命令。确切的说,用户接口265可接收用于控制选择器在GUI中的位置以选择不同的对象或项目的用户输入命令。
或者,用户可通过输入特定的声音或手势进行输入用户命令,则用户接口265通过传感器识别出声音或手势,来接收用户输入命令。
视频处理器270,用于接收外部的视频信号,根据输入信号的标准编解码协议,进行解压缩、解码、缩放、降噪、帧率转换、分辨率转换、图像合成等视频数据处理,可得到直接在显示器275上显示或播放的视频信号。
示例的,视频处理器270,包括解复用模块、视频解码模块、图像合成模块、帧率转换模块、显示格式化模块等。
其中,解复用模块,用于对输入音视频数据流进行解复用处理,如输入MPEG-2流(基于数字存储媒体运动图像和语音的压缩标准),则解复用模块将其进行解复用成视频信号和音频信号等。
视频解码模块,用于对解复用后的视频信号进行处理,包括解码和缩放处理等。
图像合成模块,如图像合成器,其用于将图形生成器根据用户输入或自身生成的GUI信号,与缩放处理后视频图像进行叠加混合处理,以生成可供显示的图像信号。
帧率转换模块,用于对输入视频的帧率进行转换,如将输入的60Hz视频的帧率转换为120Hz或240Hz的帧率,通常的格式采用如插帧方式实现。
显示格式化模块,用于将帧率转换模块输出的信号,改变为符合诸如显示器显示格式的信号,如将帧率转换模块输出的信号进行格式转换以输出RGB数据信号。
显示器275,用于接收源自视频处理器270输入的图像信号,进行显示视频内容、图像以及菜单操控界面。显示视频内容,可以来自调谐解调器210接收的广播信号中的视频内容,也可以来自通信器220或外部装置接口240输入的视频内容。显示器275,同时显示显示设备200中产生且用于控制显示设备200的用户操控界面UI。
以及,显示器275可以包括用于呈现画面的显示屏组件以及驱动图像显示的驱动组件。或者,倘若显示器275为一种投影显示器,还可以包括一种投影装置和投影屏幕。
音频处理器280,用于接收外部的音频信号,根据输入信号的标准编解码协议,进行解压缩和解码,以及降噪、数模转换、和放大处理等音频数据处理,得到可以在扬声器286中播放的音频信号。
示例性的,音频处理器280可以支持各种音频格式。例如MPEG-2、MPEG-4、高级音频编码(AAC)、高效AAC(HE-AAC)等格式。
音频输出接口285,用于在控制器250的控制下接收音频处理器280输出的音频信号,音频输出接口285可包括扬声器286,或输出至外接设备的发生装置的外接音响输出端子287,如耳机输出端子。
在其他一些示例性实施例中,视频处理器270可以包括一个或多个芯片组成。音频处理器280,也可以包括一个或多个芯片组成。
以及,在其他一些示例性实施例中,视频处理器270和音频处理器280,可以为单独的芯片,也可以与控制器250一起集成在一个或多个芯片中。
供电电源290,用于在控制器250的控制下,将外部电源输入的电力为显示设备200提供电源供电支持。供电电源290可以是安装在显示设备200内部的内置电源电路,也可以是安装在显示设备200外部的电源。
用户在终端设备中登录支持DLNA投屏功能的应用程序(APP),并进入投屏界面,首先搜索要投射的显示设备,以显示设备为智能电视为例,如图5所示,发起投屏的终端设备和作为被投射对象的电视都需要连接WiFi,终端设备可以搜索到与其处于同一个WiFi网络环境下的电视,并将搜索到的可建立投屏连接的电视设备在界面中列举出来,比如图5中,当前WiFi为MERCURY_6ABC,搜索到了一个电视设备,该电视设备的信息为客厅极光TV(365D),IP地址为192.168.1.101,用户点击该电视设备后,即可选择要向该设备投射的初始片源。在可连接设备列表中,每个电视设备都有一个选择控件,如图5中小方块,通过触控这个选择控件,可以选中可连接设备列表其中的一个或多个设备进行投屏。
图6示出了一种终端设备投射初始片源的界面,界面中可以包括初始片源的缩略图、片源名称、评分、风格和简介等与片源信息,初始片源的缩略图可以是从片源中截取的某一帧图像。界面中还要设有触发投屏请求的控件,比如图6中的“电视播放”,用户点击“电视播放”后,即生成投屏请求,投屏请求中携带有电视设备信息等信息,从而实现向目标投射对象的电视端请求投射该初始片源。需要说明的是,终端设备中发起投屏请求的方式、界面操作和界面显示的内容不限于本实施例及附图所示,具体与不同型号终端设备和应用程序有关。
电视端配置的DLNA协议栈响应于投屏请求后,向电视端中的媒体中心应用发送第一指示信息,媒体中心应用根据第一指示信息,在电视的显示器上显示提示弹窗。图7示出一种提示弹窗,提示弹窗用于询问用户是否允许与终端设备连接并播放推荐片源,比如显示“一台终端设备正在连接你的电视,是否允许连接并播放推荐片源?”,并可以一并显示请求建立连接的终端设备的Mac Address(Media Access Control Address,媒体存取控制位址),网络中每台设备都有唯一的网络标识即Mac地址,用以确认网络设备的位置。同时在提示弹窗中,可以设置“永久同意”选框,当“永久同意”被勾选并确认后,以后电视接收到投屏请求后会自动允许建立设备连接并同意播放推荐片源,所以不会再显示提示弹窗。提示弹窗中还设置有“同意”选项和“不同意”选项,当用户点击“不同意”,则取消设备连接并销毁提示弹窗,电视继续保持原显示状态;当用户点击“同意”,而没有勾选“永久同意”时,即说明仅允许本次授权连接,后续再接收到投屏请求时还要继续显示提示弹窗。
当用户在提示弹窗中输入允许指令后,接收终端设备发送的初始片源的URI(Uniform Resource Identifier,统一资源标识符),后续即可根据初始片源的URI播放初始片源。接下来就需要获取推荐片源。电视可以向服务器发送第一指令,服务器响应第一指令后,会搜索一些推荐片源,该推荐片源可以是与初始片源有关的片源,比如属于同一电视剧的不同集,或者是与初始片源同一类型风格的片源,又或者是近期热播的片源、高评分片源等,即将用户可能感兴趣观看的片源推荐给用户。当电视接收到服务器反馈的推荐信息,推荐信息可以包括各个推荐片源的URI,然后即可起播初始片源,初始片源的播放界面如图8所示,即将终端设备推送给的初始片源投屏到电视上进行播放,从而体验大屏观看效果。
为了实现投屏功能的丰富性,在初始片源播放过程中,可以直接用户向用户展示推荐信息列表,方便用户查看推荐片源,并根据感兴趣程度选出某个推荐片源进行起播。在具体实现中,如图9所示,推荐信息列表可以在预设位置进行显示,比如界面底部;推荐信 息列表可以按行进行展示,即包括1行多列,用户通过左右滑动来查看列表中包括的各项推荐片源。
在其他实现中,推荐信息列表可以按列进行展示,即包括多行1列,用户通过上下滑动来查看列表中包括的各项推荐片源;又或者,推荐信息列表可以按网格形式进行展示,即包括多行多列。推荐信息列表的呈现形式不限定,推荐信息列表中可以包括每个推荐片源的缩略图,缩略图底部也可附带该推荐片源的基本信息,基本信息比如是片源名称、对应的集数/期数/部数、主要看点和时长等信息,缩略图关联有跳转控件,以使用户点击某个推荐片源时,触发该推荐片源的跳转控件,则即可将初始片源的播放界面跳转切换至该推荐片源的播放界面。推荐信息列表的显示内容不限于本实施例所述,具体可根据实际UI显示需求进行配置。推荐信息列表占整体显示界面的比例应尽量小,以保证当前初始片源的观看效果。
此外,在初始片源的播放界面中还可设置弹动控件41,弹动控件41用于隐藏或弹出推荐信息列表。当初始片源开始启动播放时,可以默认推荐信息列表处于隐藏状态,这时如图10(a)所示,弹动控件41位于界面底边,初始片源全屏播放;当用户想要查看推荐信息列表时,可以点击弹动控件41,这时弹动控件41按照图10(a)所示的箭头方向展开,使得推荐信息列表的行从下至上逐渐弹出,直至图10(b)所示的显示界面,则推荐信息列表处于显示状态,这时初始片源上推荐信息列表的上部播放;在图10(b)的状态下再点击一次弹动控件41,则弹动控件41按照图10(b)所示的箭头方向复位,使得推荐信息列表的行从上至下逐渐关闭,直至图10(a)所示的隐藏状态。需要说明的是,弹动控件41的配置和控件方式不限于本实施例所述,本实施例示出的是渐变弹动式,还可以采用其他动态效果,比如可参照幻灯片具有的播放效果。弹动控件41可以淡化或虚化显示,以避免影响片源的播放效果。
在实际应用中也可不设置弹动控件41,比如采用一些手势控制,语音控制、遥控器点击/双击界面等形式;或者采用定时显隐,比如在初始片源播放至总时长的一半时自动弹出推荐信息列表,在预设时间内(比如5秒)用户无操作和响应,则自动隐藏推荐信息列表;又或者在初始片源播放结束时自动显示推荐信息列表,让用户选择接下来继续播放哪个推荐片源。总之,推荐信息列表隐藏和显示的控制模式多种多样,可以在电视的“投屏设置”里设定多种推荐信息列表的显隐控制模式,供用户选择和设置,本实施例不再赘述。
图11示出一种投屏控制方法的实施例,该方法由显示设备的控制器250被配置执行,即控制器250为方法的执行主体,该方法包括如下程序步骤:
步骤S10,响应于接收到终端设备发送的投屏请求,控制显示器显示提示弹窗;所述 提示弹窗用于询问用户是否允许与所述终端设备连接并播放推荐片源。
步骤S20,响应于用户输入的允许指令,向服务器发送第一指令。
当用户在提示弹窗中选择“同意”或“永久同意”时,即输入了允许指令,则向服务器发送第一指令,第一指令用于指示服务器获取推荐信息。服务器响应第一指令后,会搜索一些推荐片源,该推荐片源可以是与初始片源有关的片源,比如属于同一电视剧的不同集,或者是与初始片源同一类型风格的片源,又或者是近期热播的片源、高评分片源等,即将用户可能感兴趣观看的片源推荐给用户。
在一种实施例中,当用户输入允许指令后,终端设备会向显示设备发送初始片源的URI。显示设备接收到初始片源的URI后,通过初始片源的URI可以解析初始片源的关键字,关键字可以是片源名称等重要信息。比如初始片源的URI为http://192.168.0.121:38520/ExportContent/Dream Therapy.mp4,则关键字为Dream Therapy。然后根据关键字生成第一指令,或者也可以直接将关键字发送给服务器,然后由服务器根据关键字进行关联性/相似性片源的匹配搜索,得到推荐信息,推荐信息中包括多个推荐片源的URI等所需信息。通过这种方式获得的推荐片源与初始片源的关联性/相似性最高,使得推荐片源能够更贴近用户的观看兴趣和品味,极大地提升了用户体验。
步骤S30,当接收到所述服务器根据所述第一指令发送的推荐信息时,起播与所述投屏请求对应的初始片源。
在一些实施例中,由于全网中片源资源众多,因此服务器根据关键字匹配搜索关联性/相似性片源时,搜索不到的可能性非常低,即便真的没有搜索到,服务器也可以根据优先级选取一些关联性/相似性稍微低一些的片源,或者直接推荐一些高评分、最新上映或是播放量/推荐量/收藏量高的片源,作为推荐片源。需要说明的是,服务器获取推荐片源的方式不限于本实施例所述,这并不影响本方案的实质。
因此,如果遇到服务器返回的推荐信息是空信息的情况,可能是由于服务器工作状态异常,或是服务器与显示设备通信异常等因素导致,这时需要重试,即显示设备重新向服务器发送第一指令,直至服务器返回的推荐信息非空。当推荐信息非空时,说明获取到了有效的推荐片源,即可生成播放指令,所述播放指令用于指示显示器起播初始片源。
步骤S40,响应于切换指令,退出所述初始片源,起播所述推荐信息对应的推荐片源。
在步骤S40进一步的实施例中,在初始片源播放时,检测初始片源的播放进程,当播放进程达到终点时,即初始片源播放结束时,可以自动显示推荐信息列表,供用户选择列表中的一个推荐片源继续播放。
在其他实现方式中,显示设备接收到推荐信息后,根据一定的排序规则对推荐信息中 的所有推荐片源进行排序,然后生成推荐信息列表,排序规则比如是按照与初始片源的关联性或相似性降序排列,或者按照播放量/收藏量/评分等参考因素降序排列,排序规则可根据实际情况进行设置,本实施例不限定。当初始片源播放结束后,起播推荐信息列表中排在首位的推荐片源,之后再用户没有进行操作和响应的情况下,可以按照推荐列表的排序依次播放列表中的推荐片源。
在其他实现方式中,可以在初始片源播放未结束的过程中,供用户切换片源,响应于接收到用户输入的显示指令,在当前播放界面中显示推荐信息列表,这里所述的显示指令可以是对弹动控件41的操作,或是手势控制指令,遥控器中的点击/双击界面等形式,也可以是语音形式的指令,比如用户通过语音输入“显示推荐信息列表”。在推荐信息列表显示时,用户输入对列表中某个推荐片源的点击操作,即可触发跳转控件并生成切换指令,即可退出初始片源的播放,跳转至被选中的推荐片源继续播放,从而在初始片源播放过程中实现片源的切换。
本申请中适用于终端设备中的应用程序支持DLNA功能,显示设备中具有对应的DLNA协议栈,通过DLNA协议栈实现播放终端推送的初始片源的流程控制。当终端设备发起投屏请求时,提示弹窗会询问用户是否允许与终端设备连接并播放推荐片源,当用户允许终端与显示设备连接时,那么就一并允许了播放推荐片源,拿什么向服务器发送第一指令,服务器响应于第一指令会搜索一些推荐信息,推荐信息可以包括与初始片源有关的相关推荐片源,比如初始片源是电视剧A的第1集,那么推荐片源就可以是电视剧A的第2集~第N集,当推荐信息获取之后,可以播放终端推送的初始片源,在初始片源播放过程中或者播放结束时收到切换指令,则退出初始片源的播放,起播推荐片源。本申请不仅能播放初始片源,还能播放服务器推送的推荐片源,使得投屏不再仅依赖于用户不断的请求投射片源,改进投屏功能,提升了用户体验。
在其他可能的实施例中,图12中示例性示出了一种投屏控制方法的交互流程图,包括终端设备、显示设备200和服务器300,显示设备分别与终端设备和服务器通信连接,终端设备包括但不限于智能手机、平板电脑和笔记本电脑等移动终端100B,显示设备可以是电视、影院屏幕等大屏设备,显示设备和终端设备之间支持DLNA协议,并在同一WiFi网络下运行。其他关于DLNA的内容可参照现有技术,本申请不再赘述。
在图12中,显示设备中可以包括DLNA协议栈和媒体中心应用,终端设备发起投屏时向DLNA协议栈发送投屏请求。DLNA协议栈接收到投屏请求后,向媒体中心应用发送onCheckBlackList回调信息;媒体中心应用的CheckBlackList接口响应onCheckBlackList回调信息,启动CheckBlackList逻辑,控制显示器显示提示弹窗,检测是否接收到用户输 入的允许指令,如果未检测到用户输入的允许指令,即用户选择“不同意”,则拒绝本次投屏请求,结束流程;如果接收到用户输入的允许指令,即用户选择“同意”或“永久同意”,则进入下一步处理逻辑。
当用户响应投屏请求,允许设备连接以及播放推荐片源时,终端设备向显示设备发送初始片源的URI,DLNA协议栈接收到初始片源的URI之后,向媒体中心应用发送onSetURI回调信息,onSetURI回调信息携带有初始片源的URI;媒体中心应用的SetURI接口响应onSetURI回调信息,启动onSetURI逻辑,解析初始片源的关键字。
然后,DLNA协议栈向媒体中心应用发送onCheckMsg回调信息;媒体中心应用的CheckMsg接口响应onCheckMsg回调信息,启动CheckMsg逻辑,根据关键字生成第一指令,并将第一指令发送至服务器;服务器响应第一指令后获取推荐信息,并将推荐信息发送给媒体中心应用。
DLNA协议栈根据媒体中心应用反馈的推荐信息,判断推荐信息是否为空;如果推荐信息为非空,则向媒体中心应用发送播放指令onPlay,媒体中心应用启动播放逻辑:显示器根据播放指令起播初始片源。初始片源播放过程中,检测是否接收到用户对推荐片源的点击操作;如果接收到对推荐片源的点击操作,退出初始片源并起播推荐片源;如果未接收到对推荐片源的点击操作,则检测初始片源是否播放结束;如果初始片源播放结束,则起播推荐片源,如果初始片源未播放结束,则返回继续检测是否接收到用户对推荐片源的点击操作。
本领域的技术人员可以清楚地了解到本发明实施例中的技术可借助软件加必需的通用硬件平台的方式来实现。具体实现中,本发明还提供一种计算机存储介质,其中,该计算机存储介质可存储有程序,当计算机存储介质位于显示设备中时,该程序执行时可包括控制器250被配置执行的步骤。其中,计算机存储介质可为磁碟、光盘、只读存储记忆体(英文:read-only memory,简称:ROM)或随机存储记忆体(英文:random access memory,简称:RAM)等。
为了方便解释,已经结合具体的实施方式进行了上述说明。但是,上述示例性的讨论不是意图穷尽或者将实施方式限定到上述公开的具体形式。根据上述的教导,可以得到多种修改和变形。上述实施方式的选择和描述是为了更好的解释原理以及实际的应用,从而使得本领域技术人员更好的使用所述实施方式以及适于具体使用考虑的各种不同的变形的实施方式。

Claims (15)

  1. 一种显示设备,其特征在于,包括:
    显示器;
    通信器,用于与终端设备和服务器通信连接;
    用户接口,用于接收用户输入;
    控制器,用于执行:
    响应于接收到终端设备发送的投屏请求,控制所述显示器显示提示弹窗;所述提示弹窗用于询问用户是否允许与所述终端设备连接;
    响应于用户输入的允许指令,向服务器发送第一指令;
    当接收到所述服务器根据所述第一指令发送的推荐信息时,在显示器上起播与所述投屏请求对应的初始片源,同时,在显示器上显示所述推荐信息中包含的推荐片源。
  2. 根据权利要求1所述的显示设备,其特征在于,所述推荐片源与所述初始片源相关联。
  3. 一种显示设备,其特征在于,包括:
    显示器;
    通信器,用于与终端设备和服务器通信连接;
    用户接口,用于接收用户输入;
    控制器,用于执行:
    响应于接收到终端设备发送的投屏请求,控制所述显示器显示提示弹窗;所述提示弹窗用于询问用户是否允许与所述终端设备连接;
    响应于用户输入的允许指令,向服务器发送第一指令;
    当接收到所述服务器根据所述第一指令发送的推荐信息时,在显示器上起播与所述投屏请求对应的初始片源,同时,在显示器上显示所述推荐信息中包含的推荐片源;
    在监听到所述初始片源播放结束时,在显示器上自动播放所述推荐片源。
  4. 一种显示设备,其特征在于,包括:
    显示器;
    通信器,用于与终端设备和服务器通信连接;
    用户接口,用于接收用户输入;
    控制器,用于执行:
    响应于接收到终端设备发送的投屏请求,控制所述显示器显示提示弹窗;所述提 示弹窗用于询问用户是否允许与所述终端设备连接并播放推荐片源;
    响应于用户输入的允许指令,向服务器发送第一指令;
    当接收到所述服务器根据所述第一指令发送的推荐信息时,起播与所述投屏请求对应的初始片源;
    响应于切换指令,退出所述初始片源,起播所述推荐信息对应的推荐片源。
  5. 根据权利要求4所述的显示设备,其特征在于,所述控制器还被配置为:
    响应于用户输入的允许指令,根据所述终端设备发送的所述初始片源的URI,解析所述初始片源的关键字;
    根据所述关键字生成所述第一指令,以使所述服务器搜索与所述初始片源相关联的推荐信息,所述推荐信息包括所述推荐片源的URI。
  6. 根据权利要求4所述的显示设备,其特征在于,所述切换指令为所述初始片源的播放进程中或达到终点时生成的指令。
  7. 根据权利要求5所述的显示设备,其特征在于,所述控制器还被配置为:
    所述初始片源播放过程中,响应于接收到用户输入的显示指令,在当前播放界面中显示推荐信息列表;
    其中,所述推荐信息列表中包括根据每个推荐片源的URI生成的缩略图和跳转控件。
  8. 根据权利要求6所述的显示设备,其特征在于,所述切换指令为用户输入对所述推荐片源的点击操作,触发所述跳转控件后生成的指令。
  9. 一种投屏显示方法,其特征在于,包括:
    响应于接收到终端设备发送的投屏请求,控制显示器显示提示弹窗;所述提示弹窗用于询问用户是否允许与所述终端设备连接并播放推荐片源;
    响应于用户输入的允许指令,向服务器发送第一指令;
    当接收到所述服务器根据所述第一指令发送的推荐信息时,起播与所述投屏请求对应的初始片源;
    响应于切换指令,退出所述初始片源,起播所述推荐信息对应的推荐片源。
  10. 根据权利要求9所述的方法,其特征在于,还包括:
    响应于用户输入的允许指令,根据所述终端设备发送的所述初始片源的URI,解析所述初始片源的关键字;
    根据所述关键字生成所述第一指令,以使所述服务器搜索与所述初始片源相关联的推荐信息,所述推荐信息包括所述推荐片源的URI。
  11. 根据权利要求10所述的方法,其特征在于,还包括:
    所述初始片源播放过程中,响应于接收到用户输入的显示指令,在当前播放界面中显示推荐信息列表;
    其中,所述推荐信息列表中包括根据每个推荐片源的URI生成的缩略图和跳转控件。
  12. 根据权利要求11所述的方法,其特征在于,所述切换指令为用户输入对所述推荐片源的点击操作,触发所述跳转控件后生成的指令。
  13. 一种投屏显示方法,其特征在于,包括:
    响应于接收到终端设备发送的投屏请求,控制所述显示器显示提示弹窗;所述提示弹窗用于询问用户是否允许与所述终端设备连接;
    响应于用户输入的允许指令,向服务器发送第一指令;
    当接收到所述服务器根据所述第一指令发送的推荐信息时,在显示器上起播与所述投屏请求对应的初始片源,同时,在显示器上显示所述推荐信息中包含的推荐片源。
  14. 根据权利要求13所述的方法,其特征在于,所述推荐片源与所述初始片源相关联。
  15. 一种投屏显示方法,其特征在于,包括:
    响应于接收到终端设备发送的投屏请求,控制所述显示器显示提示弹窗;所述提示弹窗用于询问用户是否允许与所述终端设备连接;
    响应于用户输入的允许指令,向服务器发送第一指令;
    当接收到所述服务器根据所述第一指令发送的推荐信息时,在显示器上起播与所述投屏请求对应的初始片源,同时,在显示器上显示所述推荐信息中包含的推荐片源;
    在监听到所述初始片源播放结束时,在显示器上自动播放所述推荐片源。
PCT/CN2020/101156 2020-04-22 2020-07-09 一种投屏显示方法及显示设备 WO2021212668A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010321156.5 2020-04-22
CN202010321156.5A CN111464844A (zh) 2020-04-22 2020-04-22 一种投屏显示方法及显示设备

Publications (1)

Publication Number Publication Date
WO2021212668A1 true WO2021212668A1 (zh) 2021-10-28

Family

ID=71679583

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/101156 WO2021212668A1 (zh) 2020-04-22 2020-07-09 一种投屏显示方法及显示设备

Country Status (2)

Country Link
CN (1) CN111464844A (zh)
WO (1) WO2021212668A1 (zh)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114401429A (zh) * 2022-01-14 2022-04-26 烽火通信科技股份有限公司 远程投屏方法和电子设备
CN114501120A (zh) * 2022-01-11 2022-05-13 烽火通信科技股份有限公司 多终端无线投屏切换方法与电子设备
CN114630191A (zh) * 2022-03-28 2022-06-14 北京优酷科技有限公司 基于投屏场景的控制方法、装置和智能终端
CN114745581A (zh) * 2022-04-11 2022-07-12 上海哔哩哔哩科技有限公司 多媒体内容联播方法及装置
CN115334365A (zh) * 2022-04-27 2022-11-11 亦非云科技(上海)有限公司 一种智能电视免安装第三方应用即可直接使用的设计方法
WO2024082435A1 (zh) * 2022-10-21 2024-04-25 湖南快乐阳光互动娱乐传媒有限公司 信息提示方法和装置

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112039741B (zh) * 2020-09-04 2022-04-05 青岛海信移动通信技术股份有限公司 基于nfc的显示设备、控制终端及设备控制系统
CN114173184A (zh) * 2020-09-10 2022-03-11 华为终端有限公司 投屏方法和电子设备
CN112351305B (zh) * 2020-10-15 2024-04-30 深圳Tcl新技术有限公司 显示网络内容的方法、显示设备及计算机可读存储介质
CN112367543B (zh) * 2020-10-27 2023-08-15 海信视像科技股份有限公司 显示设备、移动终端、投屏方法及投屏系统
CN112732089A (zh) * 2021-01-18 2021-04-30 海信视像科技股份有限公司 一种虚拟现实设备及快捷交互方法
CN115086734A (zh) * 2021-03-12 2022-09-20 北京字节跳动网络技术有限公司 一种基于视频的信息展示方法、装置、设备及介质
CN112995575B (zh) * 2021-05-13 2021-10-01 广州朗国电子科技股份有限公司 一种无线投屏中转装置、中转控制方法和无线投屏系统
CN113055710A (zh) * 2021-05-19 2021-06-29 北京爱奇艺科技有限公司 视频投屏系统、方法、装置、服务器、终端及存储介质
CN113542839B (zh) * 2021-06-09 2022-10-18 荣耀终端有限公司 电子设备的投屏方法和电子设备
CN113891129A (zh) * 2021-09-18 2022-01-04 海信视像科技股份有限公司 显示设备、内容推送及接力方法
CN114363692A (zh) * 2021-12-30 2022-04-15 Tcl华星光电技术有限公司 应用于即视频设备的芯片系统、即视频设备和显示系统
CN115294968A (zh) * 2022-06-23 2022-11-04 中国第一汽车股份有限公司 车载语音中自动提取关键词并检索的方法及装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103501449A (zh) * 2013-10-08 2014-01-08 十分(北京)信息科技有限公司 与电视节目关联的视频源推荐方法及推荐装置
CN103533399A (zh) * 2013-09-30 2014-01-22 深圳创维-Rgb电子有限公司 一种视频信息显示方法和装置
CN104717549A (zh) * 2013-12-13 2015-06-17 中国移动通信集团公司 一种多屏间信息交互方法和设备
CN109451345A (zh) * 2018-11-05 2019-03-08 四川长虹电器股份有限公司 一种Android智能电视上DLNA投屏权限管控的方法
CN109725863A (zh) * 2018-11-14 2019-05-07 北京风行在线技术有限公司 一种用于进行投屏的方法、装置、设备和系统
CN109963178A (zh) * 2019-03-15 2019-07-02 北京领度信息技术有限公司 使用安全投屏器进行投屏的方法和安全投屏器

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103533399A (zh) * 2013-09-30 2014-01-22 深圳创维-Rgb电子有限公司 一种视频信息显示方法和装置
CN103501449A (zh) * 2013-10-08 2014-01-08 十分(北京)信息科技有限公司 与电视节目关联的视频源推荐方法及推荐装置
CN104717549A (zh) * 2013-12-13 2015-06-17 中国移动通信集团公司 一种多屏间信息交互方法和设备
CN109451345A (zh) * 2018-11-05 2019-03-08 四川长虹电器股份有限公司 一种Android智能电视上DLNA投屏权限管控的方法
CN109725863A (zh) * 2018-11-14 2019-05-07 北京风行在线技术有限公司 一种用于进行投屏的方法、装置、设备和系统
CN109963178A (zh) * 2019-03-15 2019-07-02 北京领度信息技术有限公司 使用安全投屏器进行投屏的方法和安全投屏器

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114501120A (zh) * 2022-01-11 2022-05-13 烽火通信科技股份有限公司 多终端无线投屏切换方法与电子设备
CN114501120B (zh) * 2022-01-11 2023-06-09 烽火通信科技股份有限公司 多终端无线投屏切换方法与电子设备
CN114401429A (zh) * 2022-01-14 2022-04-26 烽火通信科技股份有限公司 远程投屏方法和电子设备
CN114401429B (zh) * 2022-01-14 2024-02-27 烽火通信科技股份有限公司 远程投屏方法和电子设备
CN114630191A (zh) * 2022-03-28 2022-06-14 北京优酷科技有限公司 基于投屏场景的控制方法、装置和智能终端
CN114745581A (zh) * 2022-04-11 2022-07-12 上海哔哩哔哩科技有限公司 多媒体内容联播方法及装置
CN115334365A (zh) * 2022-04-27 2022-11-11 亦非云科技(上海)有限公司 一种智能电视免安装第三方应用即可直接使用的设计方法
WO2024082435A1 (zh) * 2022-10-21 2024-04-25 湖南快乐阳光互动娱乐传媒有限公司 信息提示方法和装置

Also Published As

Publication number Publication date
CN111464844A (zh) 2020-07-28

Similar Documents

Publication Publication Date Title
WO2021212668A1 (zh) 一种投屏显示方法及显示设备
WO2021109487A1 (zh) 音频数据流输出的控制方法及显示设备
WO2021147318A1 (zh) 一种节目语言的确定方法及显示设备
WO2021114560A1 (zh) 一种提示语显示方法及显示设备
WO2021174663A1 (zh) 观看历史显示方法及显示设备
CN111343490A (zh) 显示设备及内容推荐方法
WO2021217435A1 (zh) 流媒体同步方法及显示设备
WO2021169168A1 (zh) 一种视频文件预览方法及显示设备
WO2021189712A1 (zh) 网页视频全屏播放切换小窗口播放的方法及显示设备
WO2021232558A1 (zh) 流媒体文件播放方法及显示设备
CN111726673B (zh) 一种频道切换方法及显示设备
WO2021232914A1 (zh) 一种显示方法及显示设备
WO2021139045A1 (zh) 播放媒体项目的方法及显示设备
WO2021212667A1 (zh) 一种多媒资数据显示方法及显示设备
WO2021237921A1 (zh) 一种账号登录状态的更新方法及显示设备
WO2021109450A1 (zh) Epg界面的展示方法及显示设备
CN111526401B (zh) 一种视频播放控制方法及显示设备
CN113115088B (zh) 显示设备用户界面的控制方法及显示设备
CN112004125A (zh) 媒体资源播放方法及显示设备
WO2021253592A1 (zh) 一种启动体育模式的方法及显示设备
WO2021232398A1 (zh) 媒体文件的播放方法及显示设备
CN111897641B (zh) 微服务监控调度方法及显示设备
CN113691852B (zh) 显示设备及媒资播放方法
WO2021159658A1 (zh) 一种界面显示方法及显示设备
WO2020147507A1 (zh) 显示设备和显示方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20932172

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20932172

Country of ref document: EP

Kind code of ref document: A1