WO2022152203A1 - 显示设备及用户界面主题更新方法 - Google Patents

显示设备及用户界面主题更新方法 Download PDF

Info

Publication number
WO2022152203A1
WO2022152203A1 PCT/CN2022/071780 CN2022071780W WO2022152203A1 WO 2022152203 A1 WO2022152203 A1 WO 2022152203A1 CN 2022071780 W CN2022071780 W CN 2022071780W WO 2022152203 A1 WO2022152203 A1 WO 2022152203A1
Authority
WO
WIPO (PCT)
Prior art keywords
display device
external device
theme
information
game
Prior art date
Application number
PCT/CN2022/071780
Other languages
English (en)
French (fr)
Inventor
卢平光
陈俊宁
何营昊
张瑞吉
解廷福
王昊
刘芳
吴燕丽
Original Assignee
海信视像科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 海信视像科技股份有限公司 filed Critical 海信视像科技股份有限公司
Priority to CN202280010311.9A priority Critical patent/CN117397245A/zh
Publication of WO2022152203A1 publication Critical patent/WO2022152203A1/zh
Priority to US18/340,512 priority patent/US20230336806A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/74—Browsing; Visualisation therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43632—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wired protocol, e.g. IEEE 1394
    • H04N21/43635—HDMI
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44227—Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data
    • H04N21/4518—Management of client data or end-user data involving characteristics of one or more peripherals, e.g. peripheral type, software version, amount of memory available or display capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Definitions

  • the present application relates to display technology, and in particular, to a display device and a method for updating the theme of a user interface.
  • the smart TV can be connected to a game device through an HDMI interface, and the game device can output video data and audio data by running a game-related program during the user's use of the game device.
  • Video data and audio data can be sent to the smart TV through the HDMI protocol, and output through the screen and speakers of the smart TV to play the video and audio of the game device.
  • the user can also control the smart TV through a control device such as a remote control.
  • a control device such as a remote control.
  • the user can call up the control menu of the smart TV through the menu key on the remote control, so as to control the display brightness, contrast, and image quality processing program of the smart TV through the control menu.
  • Some embodiments of the present application provide a display apparatus including a display, an external device interface, and a controller.
  • the external device interface is used to connect an external device
  • the display is used to display a user interface and a screen of media asset data sent by the external device.
  • the controller is configured to: receive a data stream sent by an external device; extract device information from the data stream, where the device information includes the device type of the external device and the current usage scenario; according to the device type and/or the current usage scenario , query the theme image in the theme library; update the user interface theme according to the theme image.
  • Some embodiments of the present application further provide a method for updating a user interface theme of a display device, wherein the display device is connected to an external device through an external device interface, and the method for updating the user interface theme includes: receiving a data stream sent by an external device; Extracting device information from the data stream, the device information includes the device type of the external device and the current usage scenario; according to the device type and/or the current usage scenario, query the theme image in the theme library; update the theme image according to the theme image User interface theme.
  • FIG. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to one or more embodiments of the present application;
  • FIG. 2 is a block diagram of a hardware configuration of a display device 200 according to one or more embodiments of the present application;
  • FIG. 3 is a block diagram of the hardware configuration of the control device 100 according to one or more embodiments of the present application;
  • FIG. 4 is a schematic diagram of software configuration in a display device 200 according to one or more embodiments of the present application.
  • FIG. 5 is a schematic diagram of a connection state between a display device and an external device according to one or more embodiments of the present application
  • FIG. 6 is a schematic flowchart of a display device adjusting a playback mode according to one or more embodiments of the present application
  • FIG. 7 is a schematic diagram of switching a playback mode according to an ALLM state parameter according to one or more embodiments of the present application.
  • 8-9 are schematic diagrams of switching playback modes according to usage scene information according to one or more embodiments of the present application.
  • FIG. 10 is a schematic diagram of image quality processing in adjusting playback mode according to one or more embodiments of the present application.
  • 11 is a schematic diagram of switching playback modes according to device types according to one or more embodiments of the present application.
  • FIG. 12 is a schematic diagram of acquiring a device type according to a type comparison table according to one or more embodiments of the present application.
  • FIG. 13 is a schematic diagram of detecting a usage scenario according to a recognition model according to one or more embodiments of the present application.
  • FIG. 14 is a schematic flowchart of determining a maintaining playback mode according to one or more embodiments of the present application.
  • 15 is a schematic flowchart of maintaining a device information table according to one or more embodiments of the present application.
  • 16-17 are schematic diagrams of a playback control flow of an external device according to one or more embodiments of the present application.
  • FIG. 18 is a schematic diagram of a control menu according to one or more embodiments of the present application.
  • 19 is a schematic flowchart of a method for updating a user interface theme according to one or more embodiments of the present application.
  • 20 is a schematic flowchart of extracting a device type from a data stream according to one or more embodiments of the present application
  • 21 is a schematic flowchart of detecting the type of an external device according to one or more embodiments of the present application.
  • 22 is a schematic flowchart of extracting usage scenarios from a data stream according to one or more embodiments of the present application.
  • 23 is a schematic flowchart of detecting a control protocol supported by an external device according to one or more embodiments of the present application.
  • 24 is a schematic flowchart of querying a subject image according to a current usage scenario according to one or more embodiments of the present application;
  • 25 is a schematic flowchart of extracting a subject image with a target foreground color according to one or more embodiments of the present application;
  • 26 is a schematic flowchart of updating a user interface theme according to a theme image according to one or more embodiments of the present application;
  • 27 is a comparison diagram of the effect after the main setting interface is updated according to one or more embodiments of the present application.
  • FIG. 28 is a comparison diagram of the effect after updating the theme of the menu interface according to one or more embodiments of the present application.
  • FIG. 29 is a comparison diagram of the effect after updating the theme of the occlusion interface according to one or more embodiments of the present application.
  • a user can operate the display apparatus 200 through the mobile terminal 300 and the control apparatus 100 .
  • the control apparatus 100 may be a remote control, and the communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and wireless or other wired ways to control the display device 200 .
  • the user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, and the like.
  • mobile terminals, tablet computers, computers, notebook computers, and other smart devices may also be used to control the display device 200 .
  • the mobile terminal 300 may install a software application with the display device 200 to implement connection communication through a network communication protocol, so as to achieve the purpose of one-to-one control operation and data communication.
  • the audio and video content displayed on the mobile terminal 300 may also be transmitted to the display device 200 to realize a synchronous display function.
  • the display device 200 also performs data communication with the server 400 through various communication methods.
  • the display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks.
  • the server 400 may provide various contents and interactions to the display device 200 .
  • the display device 200 may be a liquid crystal display, an OLED display, or a projection display device.
  • the display device 200 may additionally provide an intelligent network television function that provides a computer-supported function in addition to the function of broadcasting and receiving television.
  • the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory, and a power supply.
  • the control device 100 can receive the user's input operation instruction, and convert the operation instruction into an instruction that the display device 200 can recognize and respond to, and play an intermediary role between the user and the display device 200 .
  • the communication interface 130 is used for external communication, and includes at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module.
  • the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, a key or an alternative module.
  • the display device 200 includes a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user input interface 280. at least one of.
  • the controller includes a central processing unit, a video processing unit, an audio processing unit, a graphics processing unit, a RAM, a ROM, and a first interface to an nth interface for input/output.
  • the display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen.
  • the tuner-demodulator 210 receives broadcast television signals through wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.
  • the detector 230 is used to collect external environment or external interaction signals.
  • the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
  • the controller 250 controls the operation of the display device and responds to user operations.
  • the controller 250 controls the overall operation of the display apparatus 200 .
  • a user may input a user command on a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.
  • a "user interface” is a medium interface for interaction and information exchange between an application program or an operating system and a user, which enables conversion between an internal form of information and a form acceptable to the user.
  • the commonly used form of user interface is Graphical User Interface (GUI), which refers to a user interface related to computer operations displayed in a graphical manner. It can be an icon, window, control and other interface elements displayed on the display screen of the electronic device, wherein the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, etc. at least one of the visual interface elements.
  • GUI Graphical User Interface
  • the system is divided into four layers, from top to bottom are the applications layer (referred to as “application layer”), the application framework (Application Framework) layer (referred to as “framework layer”), Android Runtime (Android runtime) and system library layer (referred to as “system runtime layer”), and the kernel layer.
  • the kernel layer contains at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive etc.
  • connecting the display device 200 to the external device 500 refers to establishing a communication connection, and the display device 200 and the external device 500 that establish the communication connection are used as a receiving end (sink end) and a transmitting end (source end), respectively.
  • the external device 500 may be a game device.
  • the user uses the game device, it can output video data and audio data in real time for the game process, and send the video data and audio data to the display device 200 so as to display the video data through the display device 200. Data and audio data are output as video picture and sound.
  • the game device acts as a transmitting end
  • the display device 200 acts as a receiving end.
  • both the sending end and the receiving end should have a data interface with the same interface specification and function.
  • both the display device 200 and the external device 500 are provided with a high definition multimedia interface (High Definition Multimedia Interface, HDMI).
  • HDMI High Definition Multimedia Interface
  • the user can insert the two ends of the HDMI interface data cable into the display device 200 and the external device 500 respectively, and after starting the external device 500 and the display device 200, set the signal source of the display device 200 to the HDMI interface , so as to realize data transmission between the display device 200 and the external device 500 .
  • connection modes may also be used between the display device 200 and the external device 500 .
  • the specific connection method can be a wired connection method, such as DVI (Digital Visual Interface), VGA (Video Graphics Array), USB (Universal Serial Bus), etc.; it can also be a wireless connection method, such as wireless local area network, Bluetooth connection, infrared connection etc.
  • Different communication connection methods can adopt different information transmission protocols. For example, when using HDMI interface to realize connection, HDMI protocol can be used for data transmission.
  • the external device 500 can output video data and/or audio data in real time according to usage conditions.
  • the output video signals and audio signals need to be adapted to the corresponding scenarios, so as to obtain better picture quality effects and sound quality effects.
  • the display device 200 may have multiple built-in playback modes, and under different playback modes, different image and sound quality effects may be obtained.
  • the play modes supported by the display device 200 for switching may include a low-latency mode (LLM) and a high image quality mode (HIQM).
  • LLM low-latency mode
  • HIQM high image quality mode
  • the display device 200 can be controlled to switch to a low-latency mode.
  • the display device 200 can disable some image quality processing programs, such as closing frame insertion algorithm, noise reduction processing, super-division algorithm, etc., to reduce image processing time and reduce image display delay.
  • the display device 200 can be controlled. Switch to high-quality mode to enable all image-quality processing programs such as frame insertion algorithm, noise reduction processing, and super-resolution algorithm to obtain better picture effects.
  • the external device 500 does not have a subordinate relationship with the display device 200 , the external device 500 usually cannot directly control the display device 200 , so in practical applications, the user needs to manually switch the playback mode of the display device 200 .
  • the manual switching process not only requires the user to perform an interactive action, but also some users do not know the play mode applicable to the external device 500 , resulting in the problem of wrong play mode switching.
  • they may be in various usage scenarios according to different usage requirements during use. Such as game scenes, film and television scenes, instant messaging scenes, etc., these scenes can show better effects in a specific playback mode.
  • the play mode of the display device 200 needs to be manually switched, when the user changes the usage scene on the external device 500, the user needs to change the play mode of the display device 200 again, which brings inconvenience to the user.
  • the display device 200 and the external device 500 usually belong to different types of devices, the user usually cannot directly control the display device 200 through the external device 500 .
  • the game device is responsible for running the game application and forms video data and audio data according to user interaction, while the smart TV can only passively obtain the audio data output by the game device
  • the game device cannot directly adjust the playback mode of the smart TV, resulting in the playback mode being inconsistent with the usage scene and affecting the video and audio effects.
  • the external device 500 may support Auto Low-latency Mode (ALLM).
  • ALLM Auto Low-latency Mode
  • the automatic low-latency mode can be automatically enabled or disabled by the source according to preset rules without the need for manual settings by the sink user. For example, when a user receives a video call while watching a movie, the external device 500 serving as the source end will automatically stop the movie playback and notify the sink end display device 200 to switch to the low-latency mode to ensure the real-time interactive performance of the video call. After the user answers the video call, the source-side external device 500 can resume the movie playing process, and notify the sink-side display device 200 to exit the low-latency mode.
  • ALLM Auto Low-latency Mode
  • the Xbox series game consoles support the ALLM protocol, while some other types of game consoles do not support the ALLM protocol, so that it is impossible to automatically send a control command for switching the play mode to the display device 200 when the game console enters the state of running the game. .
  • the display device 200 can detect whether the external device 500 supports automatic control protocols such as the ALLM protocol by detecting the data stream sent by the external device 500 , and detect whether the external device 500 supports automatic control protocols such as the ALLM protocol.
  • the control protocol supported by the device 500 switches the play mode.
  • the display device 200 may include a display 260, an external device interface 240 and a controller 250, and the external device 500 may include a data interface and a processor.
  • the external device 500 is connected to the display device 200 .
  • the external device 500 may send a data stream to the display device 200 .
  • the data stream includes video data and audio data to be played.
  • the transmitted video data and audio data are collectively referred to as media asset data.
  • the media asset data may be video data or audio data, or may be a set of video data and audio data.
  • the sent media asset data forms a data stream, in addition to video data and audio data, the formed data stream may also include auxiliary information such as control instructions, device information, etc., for realizing the connection between the display device 200 and the external device 500 linkage control.
  • the external device 500 can edit the auxiliary information into auxiliary information frames and send them to the display device 200 together with the data stream through the supported interface protocol.
  • the auxiliary information frame may be presented in different forms according to different protocols supported by the external device 500 .
  • auxiliary information such as control instructions can be edited into the protocol frame;
  • the auxiliary information such as device information can be edited to the basic The device information frame (Source Product Description, SPD) of the transmission protocol (such as the HDMI protocol).
  • the Xbox series game console is an external device 500 that supports automatic control protocols such as ALLM, so the external device 500 can be directly controlled by the automatic control protocol
  • the display device 200 switches the play mode, that is, the display device 200 can extract the usage scene information from the data stream, and implement the play mode switch according to the usage scene information.
  • the game console can add usage scene information to the data stream, that is, when the game program is running, the usage scene information is added to the data stream as the game scene, and when the game program is exited, the usage scene information is added to the data stream as non-game scenarios.
  • the display device 200 may switch to a low-latency mode when detecting that the usage scene information is a game scene; and switch to a high image quality mode when detecting that the usage scene information is a non-game scene.
  • the external device 500 supporting the automatic control protocol can send device parameter frame data (or protocol frame data) to the display device 200 according to the control strategy in the application.
  • the display device 200 may read the status parameter at a specific position in the protocol frame data, so as to determine the control mode according to the status parameter.
  • the ALLM protocol frame can be extracted from the data stream.
  • auxiliary information such as control instructions can be represented by a plurality of bytes at specific positions in the data frame.
  • the protocol frame is formulated and generated according to the agreed ALLM control protocol, and can be used to describe the device information of the external device 500 and other information related to the data transmission process.
  • the display device 200 can read the automatic low-latency mode ALLM state value; if the ALLM state value is equal to 1, it means that the current external device 500 is in the game scene, so the display device 200 can be controlled to switch the playback mode to the low-latency mode; if the ALLM state value is equal to 0, it means that the external device 500 is currently in a non-game scene, so the display device 200 can be controlled to switch the playback mode to the high image quality mode.
  • some bytes are reserved in the protocol frame, and these bytes can be assigned a specific value, that is, a status value, by the source device. Therefore, in this embodiment, a specific state value can be configured in each byte bit for transmitting usage scene information to the display device 200 .
  • a specific state value can be configured in each byte bit for transmitting usage scene information to the display device 200 .
  • a protocol frame can also be added to the data stream, and the display device 200 can extract the protocol frame and traverse the The combination of the state values on the multiple byte bits is used to determine the usage scene information where the external device 500 is located, and finally the playback parameters are adjusted according to the usage scene information according to the set playback parameter adjustment mode.
  • the display device 200 obtains that the external device 500 is in the game During the scene, you can turn off the unnecessary and time-consuming image quality processing program to reduce the display delay in the game scene.
  • the display device 200 can continuously monitor the protocol frames in the data stream, so that the play mode can follow the usage scene of the external device 500 to switch the play mode in real time.
  • the sink-side display device 200 may periodically detect the data stream, and parse the ALLM flag in the protocol frame in real time, so as to determine whether the current needs to be switched to the low-latency mode (LLM) through the ALLM flag.
  • LLM low-latency mode
  • the display device 200 needs to maintain this mode until the external device 500 on the source side notifies the display device 200 on the sink side to exit the LLM.
  • the Sink side display device 200 needs to restore the image mode before entering the LLM.
  • the display device 200 on the sink side needs to temporarily limit the video signal and audio signal, and does not directly play the signal transmitted by the external device 500 on the source side, so that the controller 250 can During this period, it is judged whether it is necessary to perform handover.
  • the sink-side display device 200 can display a blocking screen, such as a black screen, a blurry screen, or OSD blocking, etc., during the switching period, but the display time satisfies the premise of switching running time. Below, as short as possible, such as the display time does not exceed 1s. At the same time, the sound shall not appear any irrelevant prompts, including percussion, click or system prompts.
  • the usage scenarios corresponding to different external devices 500 are different.
  • Some external devices 500 can support various usage scenarios, for example, computer devices, smart terminals, etc., which can be in game scenarios, instant messaging scenarios, etc. in use, these external devices 500 can be in different usage scenarios in use, so called for multimode devices.
  • Some external devices 500 only support a single usage scenario, such as game consoles, set-top boxes, multimedia players, etc. These external devices 500 generally do not switch or rarely switch usage scenarios during use, so they are called single-mode devices.
  • the display device 200 can extract the device type of the external device 500 from the data stream.
  • the device type detection method can be obtained by reading the content in the device information frame carried in the data stream.
  • the device type of the external device 500 can be determined by reading data such as device name, device mac address, and device interface information.
  • the device type is a single-mode device
  • the playback mode can be controlled to be switched to a high image quality mode corresponding to the multimedia player.
  • an extended protocol can be configured, so that the external device 500 connected to the display device 200 can use the protocol
  • the use scene information is sent in the frame data, so that the current use scene information is sent to the display device 200, so that the display device 200 switches the play mode according to the extended protocol.
  • the extended protocol is used to transmit usage scene information of the external device 500 .
  • an extended protocol can be configured so that the computer device can carry usage scene information in the sent data stream.
  • the extension protocol can additionally define some data fields according to the data transmission characteristics of the automatic control protocol.
  • the usage scene information of the external device 500 can be represented by a plurality of bits reserved in the HDMI specification.
  • the display device 200 may periodically acquire the protocol frame data, and traverse the parameter values on multiple bits in the protocol frame data. Therefore, according to the combination of parameter values on multiple bits, the current usage scene information is read, and finally the playback mode is set to a mode suitable for the current usage scene information.
  • the display device 200 can extract the protocol frame data from the data stream every 1s, and read the parameter values from the two bits specified by the extended protocol.
  • various usage scenarios can also be represented by the reserved flag bits of the protocol frame.
  • the running games are distinguished by the combination of the state values of the flag bits Rsvd1 and Rsvd0, so as to facilitate the control and modification of the playing parameters.
  • the modes adapted to the current usage scene information include a full low-latency mode and a non-full low-latency mode. If the mode adapted to the current usage scenario information is the full low-latency mode, disable the mode. All image quality processing items, super-resolution algorithms, and noise reduction algorithms for data streams. Among them, the low-latency mode in which only part of the image quality processing is turned off means that one or more of the above-mentioned image quality processing algorithms are turned off, and the other one or more image quality processing algorithms are reserved to adapt to different usage scenarios; The mode that currently uses the scene information is not completely low-latency mode, and all image quality processing items except the image quality processing items specified for the data stream are disabled.
  • the computer device can have various usage scenarios, including watching movies, playing games, watching football games, video calls, and office work.
  • the movie-watching scene corresponds to the full high-quality mode
  • the game-playing scene corresponds to the full low-latency mode.
  • the MEMC function that improves the smoothness of the picture quality cannot be turned off to reduce the delay.
  • Another example is a video call. Due to the low definition of the picture during a video call, the super-resolution algorithm (NR) and the noise reduction algorithm (SR) need to be used to improve the clarity. Therefore, the video call scene needs to reduce the delay but the super-resolution algorithm cannot be turned off. with noise reduction algorithm.
  • the sink-side display device 200 can adjust its own working parameters in more detail according to the information, so as to adapt to the low-latency requirements in different scenarios.
  • the device type can be extracted from the data stream , and switch the playback mode according to the device type.
  • the HDMI protocol specifies a source device description SPD data frame that describes the information of the device itself.
  • the SPD data frame is generated based on the basic HDMI protocol, and can be generated without additional configuration of the external device 500.
  • the auxiliary information including the device information is transmitted to the display device 200 .
  • the external device 500 may send SPD data frames at preset time intervals while transmitting the media asset information data.
  • the display device 200 After receiving the SPD data frame, the display device 200 reads the device classification at a specific byte position from the SPD data frame, and controls the display device 200 to switch to the low-latency mode if it is determined that the device is classified as a game machine by reading.
  • the display device 200 may extract the device information frame from the data stream; and obtain the external device type according to the data of the specified byte in the device information frame.
  • the display device 200 may extract the device information frame from the data stream; and obtain the external device type according to the data of the specified byte in the device information frame.
  • the SPD Data Frame
  • mainstream external devices 500 can send SPD protocol frame data. Therefore, when the external device 500 does not support the ALLM function, the type information of the external device 500 can be obtained through the SPD protocol frame.
  • other auxiliary information can also be extracted from the SPD data frame to judge the device type, such as manufacturer information, model information, and so on.
  • the main usage scenario of game devices is the game scenario
  • the main usage scenario of smart terminal devices is screen projection.
  • Both of the above two scenarios require a lower image transmission delay effect, that is, a low-latency mode is required. ; and other types of equipment such as set-top boxes, DVDs, etc. are mainly used for movie viewing scenes, and high-quality mode is required at this time.
  • a device that conventionally requires lower picture transmission delay is referred to as a first-type device; a device that requires higher picture quality is referred to as a second-type device. Therefore, after obtaining the device type of the external device 500, the device type can be judged. If the device type is the first type of device, set the playback mode to low-latency mode; if the device type is the second type of device, set the playback mode to high quality mode.
  • the play modes under different device types can be set according to usage habits or custom policies. For example, for a webcam device, it is often used for network communication according to the user's usage habits. Therefore, when it is detected that the device type of the external device 500 is a webcam, the playback mode of the display device 200 can be switched to low latency without turning off the super score. Algorithm and Noise Reduction Algorithm mode. Through more detailed classification and more custom play modes, it can be realized that when the external device 500 does not support the automatic control protocol, it can also be automatically adjusted to a suitable play scene.
  • a type comparison table may also be pre-stored in the display device 200 .
  • the type comparison table the corresponding relationship between the state value on the specified byte in the device information frame and the device type can be stored.
  • the 25th byte (data byte 25) in the SPD data frame represents the device classification, and its corresponding state value "8" represents "game device”, “9” represents “host device”, and "10” represents "DVD device” "Wait.
  • the type comparison table After obtaining the status value on the specified byte, you can call the type comparison table first, and then use the status value as the index value to match the target entry in the type comparison table. For example, when the device classification value of a specific byte is read as "8", it is determined through the type comparison table that the external device 500 connected to the display device 200 is a game machine, and the game machine is usually used to play games, so it can be Playback mode switches to low latency mode.
  • the type comparison table may also directly record the playback modes suitable for each device type, that is, in the type comparison table, a table including "status value-device type-adaptive mode" items, such as "8-Game Console-Low Latency Mode", etc. Therefore, after matching the target entry corresponding to the state value, the image quality parameter and/or the sound quality parameter corresponding to the playback mode in the target entry can be parsed.
  • the image quality parameter is used to perform image quality processing, and may include the image quality processing method to be performed and the parameters referenced when performing image quality processing, for example, whether to execute the super-resolution algorithm and the target resolution of the super-resolution algorithm.
  • the sound quality parameter is used to perform sound quality processing.
  • the display device 200 may further perform picture quality processing and/or sound quality processing on the data stream according to the picture quality parameter and/or the sound quality parameter, so as to output the data stream as a video signal and/or or audio signal.
  • a state value of 10 matches that the device type is a DVD device, and the corresponding playback mode is a high-definition mode. Therefore, the corresponding image quality parameters in the high image quality mode can be analyzed, such as executing the super-resolution algorithm to increase the image resolution to 4096 ⁇ 2160, so as to obtain ultra-high-definition image quality.
  • the external device 500 since the device information frame can only transmit the device type of the external device 500, the external device 500 is not limited to one usage scenario during part of the use process, so the external device 500 is not in the main usage scenario.
  • the corresponding playback mode is different from that recorded in the type comparison table, a better data stream output effect cannot be obtained.
  • the external device 500 connected to the display device 200 is a host device (computer host)
  • the host device may be in various scenes such as game scenes and video scenes.
  • the playback mode recorded in the type comparison table is the high-quality mode of the host device when the main usage scene is a movie scene, the switched playback mode will not match the game scene, which will affect the output effect.
  • the display device 200 can also determine the current usage scene of the external device 500 by means of image recognition, so as to dynamically adjust the play mode according to the change of the usage scene. That is, the display device 200 may periodically extract image frame data from the data stream sent by the external device 500 . For example, the image frame data is extracted from the data stream every 30s to obtain the current picture to be displayed.
  • the extracted image frame data is input into the recognition model, and the image frame data is classified by the recognition model.
  • the recognition model can be obtained through sample training through an artificial intelligence machine learning algorithm. That is, in practical applications, the initial model can be input through an image with a classification label, and the model parameters can be adjusted according to the classification result output by the model and the back-propagation of the classification label. In this way, through a large number of sample images, a recognition model suitable for the usage scenario of the display device 200 and having a high classification accuracy can be obtained.
  • the recognition model can classify and calculate the image frame data, and output the corresponding classification result, that is, obtain the usage scene information.
  • the display device 200 then switches the play mode according to the acquired usage scene information. For example, by acquiring the image frame data and inputting it to the recognition model, it is recognized that the corresponding picture in the image frame data is a game picture, so it can be determined that the current usage scene of the host device is a game scene, and the play mode of the display device 200 is switched to low Delay mode.
  • the display device 200 periodically extracts image frame data to monitor the usage scene of the external device 500 in real time, so that when the usage scene changes, the display device 200 switches to the corresponding playback mode, so that the playback mode can maintain the same Adapt to usage scenarios to improve the output quality of data streams.
  • the device type of the external device 500 connected to the display device 200 will change. For example, when the display device 200 is connected to multiple external devices 500 at the same time, different external devices 500 can wake up from each other. After an external device 500 is connected, the type of the device connected to the display device 200 will change.
  • the display device 200 may periodically extract data from the data stream. Device information frame, and compare the device type in the current device information frame and the previous device information frame in turn. If the device type in the current device information frame is different from the device type in the previous device information frame, the play mode needs to be switched, that is, the play mode is switched according to the device type in the current device information frame.
  • the display device 200 can be connected to a computer device and a smart camera device at the same time, and when the user needs, the computer can be used to wake up the smart camera. Since the user uses the display device 200 to display the game screen on the computer, the play mode of the display device 200 is the low-latency mode. After the computer device wakes up the smart camera device, since the device type is changed to the smart camera device, and the smart camera is suitable for the high image quality mode, the playback mode needs to be switched to the high image quality mode.
  • the data stream will be output in the playback mode, that is, for the device information frame originating from the same external device 500, the display device 200 does not need to execute the switching procedure multiple times, directly Just keep it in steady playback mode.
  • the type comparison table can store the play mode suitable for each device type, while comparing the device type in the current device information frame and the previous device information frame, it can also compare the suitable play mode. , so that the playback mode of the display device 200 is switched to the mode corresponding to the device type in the current device information frame when the corresponding playback mode is changed, and the current playback mode is maintained when the corresponding playback mode is not changed.
  • the playback mode is still not switched.
  • the type of the external device 500 connected to the display device 200 is switched from a webcam device to a smart terminal device, since the two are applicable to different playback modes, it is necessary to switch the playback mode of the display device 200 from the low-latency mode to the high-definition mode model.
  • the display device 200 when the display device 200 cannot obtain the device information frame in the data stream, it means that the connection between the external device 500 and the display device 200 is currently disconnected, so the playback mode can be restored, that is, switch back to the original playback mode .
  • the display device 200 can detect the extraction process of the device information frame in a plurality of consecutive cycles, so that the device information frame cannot be extracted from the data stream within a continuous preset number of cycles, and the playback device information frame cannot be extracted from the data stream. The mode is restored to the original mode.
  • the display device 200 can determine whether the external device 500 supports the automatic control protocol by analyzing the data stream, so as to set the playback mode according to the automatic control protocol support capability of the external device 500 .
  • the support status of the external device 500 connected to the display device 200 may also be saved by storing device information, and then the external device 500 can access the When the device 200 is displayed, the protocol support status of the external device 500 is determined by matching the stored information.
  • the display device 200 further includes a memory, and the device information table of the external device 500 can be stored in the memory.
  • the device information table In the device information table, the device name and protocol support status of each external device 500 are stored as table items.
  • the display device 200 can automatically extract the device information table, and match the current protocol support under the device name of the external device 500 in the device information table.
  • the playback mode is switched according to the ALLM protocol; when it is determined from the device information table that the current external device 500 does not support the ALLM protocol, the device of the external device 500 can be obtained through the SPD protocol frame. type to switch the playback mode by the device type.
  • the display device 200 may further determine whether the external device 500 is connected for the first time.
  • whether the external device 500 is accessed for the first time can be determined by traversing the stored device information table.
  • the current external device 500 is determined. It is the first access; when the traversal result is that the device name of the current external device 500 exists in the device information table, it is determined that the current external device 500 is not the first access.
  • the display device 200 can directly execute the corresponding play mode switching mode through the protocol support status stored in the device information table.
  • the display device 200 For the external device 500 accessed for the first time, the display device 200 needs to start a protocol detection program to detect the protocol supported by the external device 500 .
  • the display device 200 can extract the device information data frame carried in the data stream, and extract the state value on the specified flag bit in the device information data frame.
  • the ALLM protocol support status can always exist in the HDMI data frame as a reserved bit, that is, the display device 200 can read the state value of the corresponding position of ALLM in the data frame.
  • the status value at the position corresponding to ALLM is 0, it is determined that the current external device 500 does not support the ALLM protocol; and when the status value at the position corresponding to the ALLM is 1, it is determined that the current external device 500 supports the ALLM protocol.
  • the display device 200 can also store the device name of the current external device 500 and the corresponding protocol support as table items in the device information table, so that the external device 500 can use it again in the future. During access, the protocol support status of the external device 500 can be directly determined through the device information table.
  • the display device 200 can determine the protocol support status of the external device 500 by reading the state value of the specified flag bit in the data frame. In part of the judgment process, even if the external device 500 does not support the automatic control protocol, it will also send data with a flag of 0 to the display device 200, which conflicts with the 0/1 state when the automatic control protocol is in effect, so that the display device 200 cannot It is directly judged whether the external device 500 really supports the automatic control protocol.
  • the display device 200 can acquire the scene switching information of the external device 500 in the detection period, and the parameter change information of the automatic control protocol flag bit in the data stream. If the scene switching information matches the parameter change information, it is determined that the current external device 500 supports the automatic control protocol, so control protocol support information indicating that the external device supports the automatic control protocol can be generated and stored.
  • the display device 200 can automatically enable the ALLM protocol parsing thread when the external device 500 is connected for the first time, and at the same time, through image recognition, AI scene recognition, etc., to determine whether the current usage scene is playing a game or playing a game Video resources, and record the state value changes of ALLM at the same time. If the scene switching information matches the parameter change information, it means that the current external device 500 can maintain the flag correctly, which means that the current external device 500 supports the ALLM protocol, otherwise it does not support the ALLM protocol.
  • the display device 200 can record the protocol support of the external device 500 in real time by maintaining the device information table, so as to determine whether the external device 500 supports the automatic control protocol by analyzing the data stream sent by the external device 500. For example, the above process needs to be performed for all external devices connected to the display device 200 for the first time, and the ALLM support of each external device 500 is recorded separately, so that the display device 200 can be distinguished by the SPD data frame sent by the external device 500 .
  • the judgment result of the protocol support of the external device 500 determined by the display device 200 by analyzing the data stream can be used to indicate that the external device 500 does not support the automatic control protocol at all, or can be used to indicate that the external device 500 does not support the automatic control protocol at the current moment.
  • Automatic control protocol is supported. For example, due to user settings, the ALLM switch of the external device 500 is currently off, but when the display device 200 is subsequently accessed, the user may set the ALLM switch to on, even if the ALLM function is enabled.
  • the display device 200 can also perform periodic detection to update the storage device information sheet.
  • the switch state of the external device 500 also needs to be considered, so as to avoid the switch state from affecting the judgment process. For example, when detecting whether the external device 500 supports the ALLM protocol, the read state value of the corresponding position of the ALLM is 1, indicating that the external device 500 currently supports the ALLM protocol, but the external device 500 is set by the user to disable the ALLM protocol in subsequent use. That is, although the device information table records that the external device 500 supports the ALLM protocol, in the subsequent access process, since the ALLM protocol switch is turned off, the playback process cannot be controlled to switch the playback mode according to the ALLM protocol, and SPD still needs to be used.
  • the data frame determines the device type to switch playback modes.
  • the display device 200 can obtain the game screen of the external device 500 at this time, and perform image analysis processing on the game screen to determine the game type classification to which the current game screen belongs, and set different picture quality, sound quality parameters. For example, for shooting, sports, and action game types, it is necessary to reduce the delay of the game screen to make the game experience smoother. If the ALLM status changes to 0, you can stop the processing of the above picture quality and sound quality, and restore the picture quality and sound quality parameters to the user-defined values, so as to ensure the normal viewing experience of the user.
  • the display device 200 can acquire the SPD information of the external device 500 . That is, if the data stream sent by the external device 500 contains SPD information, the SPD information can be parsed, the device type of the external device 500 can be obtained first, and then different picture quality and sound quality adjustment methods can be selected according to the different types of the external device 500 . For example, by parsing the SPD information, the display device 200 can judge whether the external device 500 is a game device, and if the external device 500 is a game device, it can judge the currently running game type according to the game screen, and according to different games Type sets different picture quality and sound quality parameters. However, if the external device 500 is not a game device, the picture quality and sound quality parameters can be restored to user-defined values, so as to ensure the normal viewing experience of the user.
  • the corresponding playback mode switching mode can be executed according to different switch states, so that the display device 200 can automatically judge the usage scene of the external device 500, and according to Depending on the usage scenario of the external device 500, the working mode of the display device 200 is adjusted so that the picture quality effect and sound quality effect of the display device 200 can be linked with the usage scenario of the external device 500 to achieve a better user experience.
  • the corresponding image quality parameters may also be obtained by calling history record information.
  • the display device 200 may record the image mode set by the user before automatically entering the game mode, and set corresponding image mode parameters after entering the automatic game mode. If the user manually changes the image mode parameters under the condition of automatically entering the game mode, the display device 200 also needs to memorize the image mode set by the user. Wherein, for different game modes, the display device 200 may also record the corresponding image mode parameters in the game mode. For example, the display device 200 may automatically set to a mode such as an SDR game, an HDR game, or a Dolby game by recognizing the game image type.
  • the display device 200 can also identify the game screen information in real time to distinguish the game type, so as to change the basic image quality parameters in the game mode to achieve a better game experience.
  • the user unplugs the game console, it will not actively switch out of the game mode, but wait for the next device to be connected. Then determine the type of the newly connected device. If it is a game console, it does not need to be switched out. If it is a set-top box and other types of devices, it will switch to the image mode set by the last user.
  • the image type is the same as the current mode, save the game mode. Then complete the picture mode setting by setting the picture mode (picmode) of the hardware abstraction layer (Hardware Abstraction Layer, HAL), and updating the backlight, picture parameters and dynamic contrast curve.
  • the display device 200 can also judge whether the current image is in the variable refresh rate mode (VRR), and if it is in the VRR mode, judge whether it was in the VRR mode during the last game process by using the memorized data, and Whether the game mode has changed, thereby setting the output mode to PC and setting the playback mode to low latency mode, and updating the mode ID for subsequent calls in the game.
  • VRR variable refresh rate mode
  • the switching mode of the play mode can be actively controlled by manual or automatic means, that is, after the display device 200 switches the play mode, it can also monitor the use scene of the external device 500 in real time, and according to the change of the use scene, Switch play mode again.
  • the automatic switching of the playback mode can be stopped under the following four conditions, that is, the user manually switches the image mode; the signal source is switched; 200 is pulled out; the ALLM/SPD drive control of the external device 200.
  • the display device 200 When it is detected that the display device 200 is in the setting state, it can control to return to the initial play mode, and complete the corresponding control flow. For example, in the process of using the display device 200, after the display device 200 is in the above four scenarios, it can be judged whether it has entered the game mode, if so, exit the SOC/FRC game mode first, and clear the game mode flag, Then execute the corresponding exit process, such as the image mode switching process, the signal source switching process, the device unplugging process, and the restoring image parameter process.
  • the corresponding exit process such as the image mode switching process, the signal source switching process, the device unplugging process, and the restoring image parameter process.
  • the display device 200 can automatically adapt to the usage scene of the external device 500 through configuration, so as to switch the play mode.
  • the control program on the controller 250 of the display device 200 After acquiring the data stream sent by the external device 500, it analyzes the control protocol currently supported by the external device 500 from the data stream. If the external device 500 supports the automatic control protocol, the play mode is switched according to the data stream specification; if the external device 500 does not support the automatic control protocol, the play mode is switched according to the device type of the external device.
  • an external device 500 is further provided, including: a data interface 510 and a processor 520 , wherein the data interface 510 is configured to connect The display device 200; the processor 520 is configured with a control program to acquire the data stream to be played and the type of the external device 500, and generate a device information frame according to the device type. The device information frame is then added to the data stream to be sent to the display device, so that the display device switches the playback mode to a mode suitable for the device type.
  • the external device 500 provided in the above embodiment can generate a device information frame including the device type by detecting its own device type after establishing a connection relationship with the display device 200, and add the device information frame to the data stream, so as to be connected with the data stream. They are sent to the display device 200 together, so that the display device 200 can switch the play mode according to the device type of the external device 500 .
  • the external device 500 can configure a simple control program so that the display device 200 can obtain the device type, so as to automatically switch the playback mode and improve the output effect of the data stream.
  • an external device 500 is further provided, including: a data interface 510 and a processor 520 , wherein the data interface 510 is configured to connect Display device 200; the processor 520 is configured with a control program to implement sending a data stream to the display device 200, and append data information to the data stream according to its own support for the automatic control protocol. If the external device 500 supports the automatic control protocol, add usage scene information to the data stream to control the display device 200 to switch the playback mode according to the usage scene information; if the external device 500 does not support the automatic control protocol, add the device type to the data stream to The display device 200 is controlled to switch the play mode according to the device type.
  • the external device 500 provided in the above embodiment can be connected to the display device 200 through the data interface 510, and send a data stream to the display device 200.
  • the external device 500 can also add a description device to the data stream according to its own support for the control protocol.
  • a data frame of information When the external device 500 supports the automatic control protocol, add usage scenario information to the data stream; when the external device 500 does not support the automatic control protocol, add device type information to the data stream to control the display device 200 according to the usage scenario or device type Switch play mode to get better audio and video output effect.
  • the display device 200 can be used as a sink to output the data stream of the external device 500 on the one hand, and can also follow the rules of its own operating system on the other hand.
  • Perform interactive operations For example, the user can control the device 100 through a remote control, mobile phone, etc. to perform interactive operations, and the display device 200 can receive various instructions sent by the control device 100 in real time during the process of outputting the data stream.
  • the display device 200 When the user presses the "Menu" button in the control apparatus 100, the display device 200 will display a control menu.
  • control options such as “image mode”, “sound mode”, “display range”, “zoom mode”, “HDMI version” can be set, and the user can perform further operations through the control device 100, select any one Control options.
  • the display device 200 may further display a corresponding user interface to complete the control of the output mode of the display device 200 .
  • content such as the control menu displayed during the interaction process may follow the user interface theme of the operating system and be presented in a specific interface style.
  • the control menu may be presented in the form of a light blue gradient background.
  • the user interface theme is usually set by the user through the operating system of the display device 200 . Therefore, after the display device 200 establishes the connection relationship with the external device 500, the user interface theme is still displayed in the form set in the operating system. This will result in a single theme form of the user interface, and when the data stream of the external device 500 is output, the theme style of the control menu may not match the video picture style, which is inconvenient for the user to distinguish and reduces the interactive experience.
  • the game screen may also be in the form of a blue gradient background, so that the control menu cannot be clearly distinguished from the background color, which is inconvenient for the user to operate.
  • the game screen may also be inconsistent with the style of the control menu, making the overall display effect inconsistent.
  • a display device 200 is provided in some embodiments of the present application, where the display device 200 includes a display 275 , an external device interface 240 and a controller 250 .
  • the external device interface 240 is used to connect the external device 500
  • the display 275 is used to display the user interface and display the media asset data screen sent by the external device 500 .
  • the controller 250 can be further configured to execute a user interface theme updating method, so that the user interface theme of the display device 200 can be updated following the content sent by the external device 200, so as to obtain a more convenient and/or coordinated user interface style .
  • the display device 200 may receive the data stream sent by the external device 500 after the external device 500 is connected to the external device interface 240 .
  • the data stream received by the display device 200 includes video data, audio data, and auxiliary information data related to data output.
  • the external device 500 can form a data stream through multiple consecutive frames.
  • the display device 200 can analyze and obtain media data such as video data and audio data from the data stream on the one hand, and form specific video images and audio data.
  • auxiliary information related to the data output process can be extracted from the data stream, so as to control the media output process in real time.
  • the display device 200 can extract information related to the current external device 500 from the device information frame in the media asset data, including information such as device name, device type, etc., and adjust the playback mode according to the extracted information to suit the usage scenario of the external device 500 Or send some control commands to the external device 500 .
  • the display device 200 may also extract relevant control instructions based on the automatic control protocol from the data stream, so as to switch the play mode according to the control instructions.
  • the display device 200 may further extract device information from the data stream.
  • the device information includes the device type of the external device 500 and the current usage scenario.
  • the device types can be classified according to the actual functions of the external device 500 , such as game devices, multimedia devices, and the like. Since some of the external devices 500 have multiple functions, the device types may also include multi-function devices, intelligent terminal devices, and the like.
  • the device type can be obtained by reading the device information frame in the data stream, or by analyzing the video data and audio data content in the data stream, as well as related interface data, device name and other information through comprehensive identification.
  • the display device 200 can extract contents such as device name, manufacturer information, mac address, interface specification, and audio and video data format from the received data stream, and comprehensively determine the device type.
  • the type of the external device 500 is "game device”.
  • relevant information can also be extracted, including: device name "Game Console 360", manufacturer information "Microsoft”, mac address "XX-XX-XX-XX-XX-XXX",
  • the interface specification is "HDMI”. Therefore, by querying, it can be determined that the game device that can meet the above-mentioned relevant information is "x-box 360", so as to obtain more device information of the external device 500.
  • the display device 200 can also monitor the current usage scenario of the external device 500 in real time through the data stream.
  • the usage scene can be obtained by reading the protocol frame in the data stream, or by performing scene recognition on the displayed image in the data stream.
  • some external devices 500 can support multiple usage scenarios. For example, computer equipment, smart terminals, etc., can provide game scenarios, instant messaging scenarios, and the like during use. These external devices 500 can also switch between different usage scenarios during use, so they are called multi-mode devices.
  • Some external devices 500 only support a single usage scenario, such as game consoles, set-top boxes, multimedia players, etc. These external devices 500 generally do not switch or rarely switch usage scenarios during use, so they are called single-mode devices.
  • the corresponding usage scene is usually a game scene.
  • the corresponding usage scene is usually a video scene.
  • the corresponding usage scene is usually a movie scene.
  • the display device 200 can switch the playback mode according to the usage scenario in the device information, for example, when it is determined that the current usage scenario of the external device 500 is a game scenario, the playback mode is switched to the low-latency mode; When the current usage scene of the external device 500 is a video scene, the playback mode is switched to the high-definition mode.
  • the display device 200 may extract the theme picture according to the device information. Among them, the theme picture can be pre-made by the display device 200 according to the menu size, the mainstream device, the picture screen under the main usage scenario, for different external devices 500 and different usage scenarios, the display device 200 can set a variety of matching with it. Theme images and stored in local database or cloud database.
  • the display device 200 may successively query the local database and the cloud database according to the device information, so as to obtain the subject image that matches the device information.
  • the display device 200 can generate a query instruction according to the device information, and call the local database in response to the query instruction, and query the local database for a theme picture that matches the device information; and when no matching theme picture is found in the local database,
  • the display device 200 may also send a query instruction to the cloud server, so as to request the cloud server to match a theme image suitable for the current device information in the cloud database.
  • the display device 200 can extract the device information of the current external device 500 from the data stream, including that the device type is a game device, and the usage scenario is to run the game "Game X”, and then a query instruction can be generated according to the device information to make the display device 200 can query the local database for subject pictures related to "Game X", such as game posters, game screenshots, or other war-like pictures similar to the main color or style of the game.
  • subject pictures related to “Game X” such as game posters, game screenshots, or other war-like pictures similar to the main color or style of the game.
  • the display device 200 may send a query instruction to the cloud server to request the cloud server to query the relevant theme image. That is, after receiving the query command, the cloud server can match game posters, game screenshots or other war game pictures similar to Game X games in the cloud server according to the game scene "Game X" specified in the query command. Finally, the matched theme picture is sent to the display device 200, so that the display device 200 can extract the theme picture.
  • the theme picture may include a background pattern and a foreground graphic used to form a control menu.
  • the display device 200 may render the control menu according to the background pattern and foreground graphics corresponding to the theme picture.
  • Different theme images can render different theme styles.
  • the display device 200 can query the game theme picture according to the device information.
  • the game theme picture can be a background pattern generated based on the cover pattern of a certain game, and a plurality of foreground graphics that are the same or similar to the main color of the game cover.
  • the display device 200 can query the theme picture that is suitable for the current usage scene of the external device 500 by extracting the device information in the data stream, so as to render the control menu according to the theme picture, so that the user interface style and the The styles of the displayed images in the data stream are consistent, which facilitates the user to perform interactive operations and improves the user experience.
  • the device 200 may display the device information frame obtained from the data stream.
  • the device information frame is frame data sent by the external device according to the basic transmission protocol.
  • the HDMI protocol specifies a source device description (Source Product Description, SPD) data frame that describes the information of the device itself, and the external device 500 can transmit the SPD data frame at preset time intervals while transmitting the media resource information data.
  • SPD Source Product Description
  • the display device 200 then reads the device type by traversing the state value of the specified flag bit in the device information frame, for example, after receiving the SPD data frame, reads the device at a specific byte position (flag bit) from the SPD data frame Classification, for example, the 25th byte (data byte 25) in the SPD data frame is the device classification, and its corresponding state value "8" represents "game device", "9” represents “host device”, and "10” represents "DVD” equipment” etc.
  • the device classification value at a specific byte position is read as "8" it means that the external device 500 connected to the display device 200 is a game machine, and the game machine is usually used to play games, so the playback mode can be switched to low latency model.
  • the display device 200 In order to be able to determine the device type of the external device 500 according to the status value on the flag bit, when the display device 200 obtains the status value of the flag bit by traversing, it can call the type comparison table, so as to query the current external device in the type comparison table according to the status value obtained by traversing The device type of the device.
  • the type comparison table may be maintained by the display device 200 or a cloud service provider of the display device 200 , and the type comparison table may include multiple status values and a device type that each status value refers to.
  • the device type extracted from the device information frame can be used for the display device 200 to switch the play mode.
  • the main usage scenario of game devices is game scenarios
  • the main usage scenario of smart terminal devices is screen projection. Both of the above two scenarios require lower image transmission delay effects, that is, switching to Low-latency mode; other types of devices such as set-top boxes, DVDs, etc. are mainly used for movie viewing scenes, and you need to switch to high-quality mode at this time.
  • the device type can also be used for the display device 200 to make a preliminary judgment on the user interface theme update process, so that the display device 200 only performs user interface theme update for some types of external devices 500 . Since there are many types of external devices 500 that can be connected to the display device 200 , the data streams sent by some types of external devices 500 include specific interactive interfaces.
  • the display device 200 detects that the device type of the external device 500 is a game device, since the game device will present interactive interfaces such as a game list and an in-game operation list when running the game, and these interactive interfaces have a unique interface style, Therefore, when outputting through the display device 200 , the display device 200 needs to update the theme of the user interface, so that the user interface of the display device 200 is consistent with the style of the current interactive interface of the external device 500 .
  • the data stream sent by the external device 500 does not include an interactive interface.
  • the device type of the external device 500 is a camera device, and the camera device only sends its recorded video data to the display device 200 during use, and usually does not have its unique interactive interface style, so the display device 200 does not need to update the user interface. theme, you can display it directly according to the initial theme.
  • the display device 200 can also determine the device type. If the device type is the first device type that needs to update the user interface theme Class devices, you can perform subsequent steps to extract the current usage scenario from the data stream to obtain device information. If the device type is the second type of device that does not need to update the user interface theme, the updating of the user interface theme can be stopped, and the user interface theme format set in the operating system of the display device 200 can be maintained for display.
  • the display device 200 may further extract the current usage scenario of the external device 500 from the data stream. That is, as shown in FIG. 22 , in some embodiments, the display device 200 can acquire the protocol frame in the data stream, and detect the current usage scene information of the external device according to the status value by traversing the status value of the flag bit in the protocol frame.
  • the protocol frame is frame data sent by the external device according to the automatic control protocol.
  • the protocol frame may be a frame of data sent by the external device 500 based on the ALLM protocol. In the ALLM protocol frame, the current usage scenario of the external device 500 can be represented by the status value on the specified flag bit.
  • the display device 200 can determine the current usage scenario of the external device 500 by traversing the state values of the flag bits in the protocol frame. For example, the display device 200 can extract the ALLM protocol frame from the data stream, and read the ALLM state parameter of the automatic low-latency mode in the protocol frame; if the ALLM state parameter is equal to 1, it means that the current external device 500 is in the game scene; If it is equal to 0, it means that the external device 500 is currently in a non-game scene.
  • the current usage scenario information may also be delivered to the display device 200 by setting the state value of the reserved flag bit on the protocol frame.
  • the display device 200 can also periodically acquire the protocol frame data, and traverse the state values on multiple bits in the protocol frame data. Therefore, the current usage scene information is read according to the combination of state values on multiple bits. For example, the display device 200 may extract the protocol frame data from the data stream every 1s, and read the status value on the two bits specified by the extended protocol.
  • the display device 200 may extract the protocol frame data from the data stream every 1s, and read the status value on the two bits specified by the extended protocol.
  • the usage scenarios of the multi-mode external device 500 can be obtained, so as to query different theme pictures according to different usage scenarios and update the user interface theme.
  • the display device 200 cannot obtain the protocol frame from the data stream, or the protocol frame obtained from the data stream does not contain valid device information, that is, cannot be extracted from the data stream. Device Information. To this end, as shown in FIG.
  • the display device 200 may first detect the control protocol supported by the external device 500 in the process of extracting the usage scene, and if the external device 500 supports the automatic control protocol, then The protocol frame is extracted from the data stream, and the current usage scenario of the external device 500 is determined by traversing the state value of the flag bit in the protocol frame.
  • a multi-frame display image can be extracted from the data stream, and scene recognition is performed on the multi-frame display image to obtain current usage scene information of the external device 500 .
  • the display device 200 may extract the display image from the data stream, and input the extracted display image into the scene recognition model to obtain the scene information output by the scene recognition model.
  • the scene recognition model is a neural network model obtained by training on sample images.
  • the sample image is an image used for training, including display images in multiple usage scenarios supported by the external device 500 and usage scenario labels corresponding to each display image.
  • the scene recognition model can calculate the classification probability of the displayed image through the neural network algorithm inside the model after inputting the displayed image, that is, the usage scene corresponding to the displayed image.
  • a scene recognition model can be constructed in the display device 200 before performing the detection of the automatic control protocol.
  • the scene recognition model can be obtained by performing neural network model training, that is, an initial model can be constructed first, and then the sample images can be input into the initial model one by one to obtain the model output result. Then compare the model output with the label information, determine the classification error, and use the classification-incapable back-propagation to adjust the model parameters. Based on this, by inputting a certain number of sample images multiple times, the model parameters can be gradually adjusted to finally obtain a scene recognition model with higher accuracy.
  • the display device 200 may input the display image extracted from the data stream to the scene recognition model to obtain the scene recognition result.
  • the types of recognition results that can be output by the scene recognition model are also different.
  • the usage scene information that the scene recognition model can output includes game scenes and non-game scenes; while for computer devices, the usage scenarios that the scene recognition model can output include game scenes, instant messaging scenes, office scenes, and sports scenes, etc. . Therefore, when performing scene recognition, different scene recognition models may also be invoked for different types of external devices 500 to obtain a suitable scene classification.
  • the display device 200 can determine whether the current external device 500 supports automatic control by detecting whether the external device 500 can maintain the status value of the flag bit in the protocol frame when the external device 500 is connected for the first time.
  • control protocol That is, when accessing for the first time, the ALLM protocol parsing thread is automatically enabled, and at the same time, the current usage scene is judged through image recognition, AI scene recognition, etc., and the change of the ALLM_Mode flag bit is recorded at the same time. If the scene switching information matches the parameter change information, it means that the current external device 500 can maintain the flag correctly, that is, the current external device 500 supports the ALLM function, otherwise it does not support the ALLM function.
  • the display device 200 may also update different user interface themes for the same external device 500 under different usage scenarios, so that the user interface theme is adapted to the picture input by the external device 500 to the display device 200 .
  • the user interface theme of the display device 200 can be updated to suit the game interface; and when the game is not running, the user interface of the display device 200 can be updated.
  • the theme is updated to fit the main interface.
  • the display device 200 can extract theme pictures according to different device information, that is, as shown in FIG. 24 , in some embodiments, two types of usage scenarios, namely the first scenario and the second scenario, can be defined in the display device 200 .
  • the first scenario is a usage scenario in which the external device 500 has an unfixed interface style
  • the second scenario is a usage scenario in which the external device 500 has a fixed interface style. If the currently used scene is the first scene, the display device 200 intercepts the current video picture from the data stream, and generates a theme tag according to the scene name characters by extracting the scene name characters of the current video picture, and finally according to the theme label, from the theme library Query the subject image in .
  • the controller 250 of the display device 200 or an independent video processor can capture the current video image from the data stream to generate a screenshot image. Then, by enabling a text recognition program such as Optical Character Recognition (OCR), the game name or characters related to the game name, such as the game developer name, game keywords, version number and other characters, are read in the screenshot image, so as to Get the game name.
  • OCR Optical Character Recognition
  • the display device 200 then generates a hashtag containing the game name "A" according to the game name and related characters.
  • the display device 200 may search the theme library for a corresponding theme picture, that is, a cartoon-style theme picture, according to the theme tag.
  • the manufacturer information of the external device is extracted from the data stream, and then a topic tag is generated according to the manufacturer information, and according to the topic tag, from the topic database Query the subject image in .
  • the main interface style of the external device 500 is set by the manufacturer when it leaves the factory, and the main interface styles set by the same manufacturer tend to be consistent. Therefore, for a usage scenario with a fixed style, the display device 200 can generate a theme based on the manufacturer's information. Tag, and query the theme image similar to the main interface style according to the generated tag, which is used to update the theme of the user interface.
  • the display device 200 may extract the manufacturer information of the game device from the device information frame or the protocol frame. If the manufacturer of the xbox is "Microsoft", the theme tag will be generated and matched based on "Microsoft”, so as to extract the theme image suitable for the main interface style of the xbox in the theme library, so as to update the user interface theme to the corresponding theme.
  • the main interface of the external device 500 may include a light mode and a dark mode to adapt to two usage periods of day and night, respectively.
  • the display device 200 may obtain a plurality of theme pictures matching the theme tags in the step of querying theme pictures from the theme library, and each theme picture may render a corresponding scene corresponding to the current usage scene.
  • Adaptive UI theme may be obtained from the theme library, and each theme picture may render a corresponding scene corresponding to the current usage scene.
  • the display device 200 can also extract multiple frames of display images at the same time from the data stream, and traverse the color layouts of multiple theme pictures and display images respectively to obtain foreground colors based on the theme pictures and background colors based on the display images. Then, by comparing the foreground color and the background color, the subject image with the target foreground color is extracted from the multiple subject images. Obviously, the target foreground color is one of multiple foreground colors matched in the theme library.
  • the target foreground color can be determined by judging whether the foreground color is compatible with the background color.
  • the adaptation of the foreground color to the background color refers to a state in which the foreground color and the background color are similar in tone style, but the specific colors are different. For example, when the background color is a cool color formed by green, blue, purple and their combination, the foreground color is also cool, but it can be distinguished from the main color in the background pattern, so that the user can easily distinguish the control menu. Easy to perform interactive operations.
  • the display device 200 can determine the interface style under the current usage scene by comparing the display image and the theme picture, so as to match the theme picture that is consistent with the style of the display picture and is easy to distinguish, which is used to update the user Interface theme.
  • the display device 20 may first obtain the menu size of the current user interface, and then cut the theme according to the menu size. Picture to generate a background picture, so as to add the background picture to the user interface, so that the background style of the user interface is suitable for the current usage scene.
  • the color of the text and/or icons in the user interface can also be modified according to the background image, so that the text and icons in the user interface can be changed.
  • the contrast with the background is more obvious for the user to distinguish.
  • the display device 200 can extract the device type and usage scenario from the data stream, and update the user interface theme according to the extracted content, so as to obtain a theme style suitable for the usage scenario of the external device 500 .
  • the display device 200 can continuously detect the usage scenarios of the external device 500 according to the set frequency, so that the theme of the user interface changes with the changes of the usage scenarios and improves the user experience.
  • the display device 200 may implement the theme following changes through the work of the middleware layer, the system framework layer and the rendering layer. That is, the middleware layer is responsible for collecting the type description and working status parameters of the source device, and actively reporting it; the system framework (Android framework) layer intercepts the current video screen of the source device, extracts the game name characters in the game screen, and generates a theme tag; rendering; The layer (LiveTV) pre-produces the theme pictures of mainstream devices and games according to the menu size, and stores them in the local theme library. By detecting the tag information notified by the framework layer in real time, query the theme image of the corresponding tag in the local theme library, and update the user interface theme.
  • the middleware layer is responsible for collecting the type description and working status parameters of the source device, and actively reporting it
  • the system framework (Android framework) layer intercepts the current video screen of the source device, extracts the game name characters in the game screen, and generates a theme tag
  • rendering rendering
  • LiveTV pre-produces the theme pictures of mainstream devices
  • the display device 200 may update the entire user interface of the display device 200, and may also update only part of the control menu.
  • the menus that can change themes mainly include the following items: menu, quick setting interface, main setting interface, "no signal” blocking interface, signal source selection interface, etc.
  • the above-mentioned interface is a common interface that can be called up when the display device 200 is connected to the external device 500.
  • a method for updating a user interface theme including: receiving a data stream sent by an external device; extracting device information from the data stream, wherein the device information includes the device type of the external device and the current usage scene; query the theme image in the theme library according to the device information; update the user interface theme according to the theme image.
  • the user interface theme updating method provided in this embodiment can acquire the data stream sent by the external device 500 in real time after the display device 200 is connected to the external device 500 . Then extract the device type and the current usage scene from the data stream, and extract the theme image based on this, so as to update the user interface theme according to the theme image.
  • the method for updating the user interface theme can update the user interface theme through the display content in the external device 500, so that the display device 200 can be updated to an interface style that matches the content of the data stream in the process of outputting the data stream, which is convenient for the user to perform interaction. operate.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Health & Medical Sciences (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请一些实施方式公开显示设备及用户界面主题更新方法，所述方法可以在显示设备连接外接设备后，实时获取外接设备发送的数据流。再从数据流中提取设备类型和当前使用场景，并以此提取主题图片，从而按照主题图片更新用户界面主题。

Description

显示设备及用户界面主题更新方法
本申请要求于2021年1月14日提交的、申请号为202110046140.2；于2021年3月18日提交的、申请号为202110292422.0；于2021年3月18日提交的、申请号为202110292449.X；于2021年3月18日提交的、申请号为202110291958.0的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及显示技术，具体而言，涉及一种显示设备及用户界面主题更新方法。
背景技术
智能电视可以通过HDMI接口连接游戏设备，用户在使用游戏设备的过程中，游戏设备可以通过运行游戏相关程序，输出视频数据和音频数据。视频数据和音频数据可以通过HDMI协议发送给智能电视，并通过智能电视的屏幕和扬声器进行输出，播放游戏设备的视频和音频。
在智能电视播放视频数据和音频数据的过程中，用户还可以通过遥控器等控制装置对智能电视执行控制。例如，用户可以通过遥控器上的菜单键调出智能电视的控制菜单，从而通过控制菜单对智能电视的显示亮度、对比度、画质处理程序执行控制。
发明内容
本申请一些实施例提供一种显示设备，包括显示器、外部装置接口以及控制器。其中，外部装置接口用于连接外接设备，显示器用于显示用户界面以及显示外接设备发送的媒资数据画面。控制器被配置为：接收外接设备发送的数据流；从所述数据流中提取设备信息，所述设备信息包括外接设备的设备类型以及当前使用场景；根据所述设备类型和/或当前使用场景，在主题库中查询主题图片；按照所述主题图片更新所述用户界面主题。
本申请一些实施例还提供一种显示设备的用户界面主题更新方法，所述显示设备通过外部装置接口连接外接设备，所述用户界面主题更新方法包括：接收外接设备发送的数据流；从所述数据流中提取设备信息，所述设备信息包括外接设备的设备类型以及当前使用场景；根据所述设备类型和/或当前使用场景，在主题库中查询主题图片；按照所述主题图片更新所述用户界面主题。
附图说明
图1为根据本申请一个或多个实施例的显示设备与控制装置之间操作场景的示意图；
图2为根据本申请一个或多个实施例的显示设备200的硬件配置框图；
图3为根据本申请一个或多个实施例的控制设备100的硬件配置框图；
图4为根据本申请一个或多个实施例的显示设备200中软件配置示意图；
图5为根据本申请一个或多个实施例的显示设备与外接设备连接状态示意图；
图6为根据本申请一个或多个实施例的显示设备调整播放模式的流程示意图；
图7为根据本申请一个或多个实施例的根据ALLM状态参数切换播放模式示意图；
图8-图9为根据本申请一个或多个实施例的根据使用场景信息切换播放模式示意图；
图10为根据本申请一个或多个实施例的调整播放模式中画质处理示意图；
图11为根据本申请一个或多个实施例的根据设备类型切换播放模式示意图；
图12为根据本申请一个或多个实施例的根据类型对照表获取设备类型示意图；
图13为根据本申请一个或多个实施例的根据识别模型检测使用场景示意图；
图14为根据本申请一个或多个实施例的维持播放模式判断的流程示意图；
图15为根据本申请一个或多个实施例的维护设备信息表的流程示意图；
图16-图17为根据本申请一个或多个实施例的外接设备播放控制流程示意图；
图18为根据本申请一个或多个实施例的控制菜单示意图；
图19为根据本申请一个或多个实施例的用户界面主题更新方法的流程示意图；
图20为根据本申请一个或多个实施例的从数据流中提取设备类型的流程示意图；
图21为根据本申请一个或多个实施例的检测外接设备类型的流程示意图；
图22为根据本申请一个或多个实施例的从数据流中提取使用场景的流程示意图；
图23为根据本申请一个或多个实施例的检测外接设备所支持的控制协议的流程示意图；
图24为根据本申请一个或多个实施例的根据当前使用场景查询主题图片的流程示意图；
图25为根据本申请一个或多个实施例的提取带有目标前景色主题图片的流程示意图；
图26为根据本申请一个或多个实施例的按照主题图片更新用户界面主题的流程示意图；
图27为根据本申请一个或多个实施例的主设置界面更新主题后效果对比图；
图28为根据本申请一个或多个实施例的菜单界面更新主题后效果对比图；
图29为根据本申请一个或多个实施例的遮挡界面更新主题后效果对比图。
具体实施方式
如图1所示，用户可通过移动终端300和控制装置100操作显示设备200。控制装置100可以是遥控器，遥控器和显示设备的通信包括红外协议通信、蓝牙协议通信，无线或其他有线方式来控制显示设备200。用户可以通过遥控器上按键，语音输入、控制面板输入等输入用户指令，来控制显示设备200。在一些实施例中，也可以使用移动终端、平板电脑、计算机、笔记本电脑、和其他智能设备以控制显示设备200。
在一些实施例中，移动终端300可与显示设备200安装软件应用，通过网络通信协议实现连接通信，实现一对一控制操作的和数据通信的目的。也可以将移动终端300上显示音视频内容传输到显示设备200上，实现同步显示功能显示设备200还与服务器400通过多种通信方式进行数据通信。可允许显示设备200通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。服务器400可以向显示设备200提供各种内容和互动。显示设备200，可以液晶显示器、OLED显示器、投影显示设备。显示设备200除了提供广播接收电视功能之外，还可以附加提供计算机支持功能的智能网络电视功能。
如图2所示，控制装置100包括控制器110、通信接口130、用户输入/输出接口140、存储器、供电电源。控制装置100可接收用户的输入操作指令，且将操作指令转换为显示设备200可识别和响应的指令，起用用户与显示设备200之间交互中介作用。通信接口130用于和外部通信，包含WIFI芯片，蓝牙模块，NFC或可替代模块中的至少一种。用户输入/输出接口140包含麦克风，触摸板，传感器，按键或可替代模块中的至少一种。
如图3所示显示设备200包括调谐解调器210、通信器220、检测器230、外部装置接口240、控制器250、显示器260、音频输出接口270、存储器、供电电源、用户输入接口280中的至少一种。控制器包括中央处理器，视频处理器，音频处理器，图形处理器，RAM，ROM，用于输入/输出的第一接口至第n接口。显示器260可为液晶显示器、OLED显示器、触控显示器以及投影显示器中的至少一种，还可以为一种投影装置和投影屏幕。调谐解调器210通过有线或无线接收方式接收广播电视信号，以及从多个无线或有线广播电视信号中解调出音视频信号，如以及EPG数据信号。检测器230用于采集外部环境或与外部交互的信号。控制器250和调谐解调器210可以位于不同的分体设备中，即调谐解调器210也可在控制器250所在的主体设备的外置设备中，如外置机顶盒等。
在一些实施例中，控制器250，通过存储在存储器上中各种软件控制程序，来控制显示设备的工作和响应用户的操作。控制器250控制显示设备200的整体操作。用户可在显示器260上显示的图形用户界面(GUI)输入用户命令，则用户输入接口通过图形用户界面(GUI)接收用户输入命令。或者，用户可通过输入特定的声音或手势进行输入用户命令，则用户输入接口通过传感器识别出声音或手势，来接收用户输入命令。
在一些实施例中，“用户界面”，是应用程序或操作系统与用户之间进行交互和信息交换的介质接口，它实现信息的内部形式与用户可以接受形式之间的转换。用户界面常用的表现形式是图形用户界面(Graphic User Interface，GUI)，是指采用图形方式显示的与计算机操作相关的用户界面。它可以是在电子设备的显示屏中显示的一个图标、窗口、控件等界面元素，其中控件可以包括图标、按钮、菜单、选项卡、文本框、对话框、状态栏、导航栏、Widget等可视的界面元素中的至少一种。
如图4所示，将系统分为四层，从上至下分别为应用程序(Applications)层(简称“应用层”)，应用程序框架(Application Framework)层(简称“框架层”)，安卓运行时(Android runtime)和系统库层(简称“系统运行库层”)，以及内核层。内核层至少包含以下驱动中的至少一种：音频驱动、显示驱动、蓝牙驱动、摄像头驱动、WIFI驱动、USB驱动、HDMI驱动、传感器驱动(如指纹传感器，温度传感器，压力传感器等)、以及电源驱动等。
在本申请实施例中，显示设备200连接外接设备500是指建立通信连接，而建立通信连接的显示设备200和外接设备500分别作为接收端(Sink端)和发送端(source端)。例如，外接设备500可以是游戏设备，在用户使用游戏设备过程中，能够针对游戏过程实时输出视频数据和音频数据，并将视频数据和音频数据发送给显示设备200，以通过显示设备200将视频数据和音频数据输出为视频画面和声音。此时，游戏设备作为发送端，而显示设备200作为接收端。
发送端与接收端之间，可以通过特定接口实现通信连接，从而传递数据。为此，在发送端和接收端上都应设有同一种接口规范和功能的数据接口。例如，如图5所示，在显示设备200和外接设备500上都均设有高清多媒体接口(High Definition  Multimedia Interface，HDMI)。在使用过程中，用户可以将HDMI接口数据线的两端分别插在显示设备200和外接设备500上，并在启动外接设备500和显示设备200后，设定显示设备200的信号源为HDMI接口，从而实现显示设备200与外接设备500之间的数据传输。
需要说明的是，为了实现显示设备200与外接设备500之间的通信连接，显示设备200与外接设备500之间还可以采用其他的连接方式。具体的连接方式可以是有线的连接方式，如DVI(Digital Visual Interface)、VGA(Video Graphics Array)、USB(Universal Serial Bus)等；也可以是无线的连接方式，如无线局域网、蓝牙连接、红外连接等。不同的通信连接方式可以采用不同的信息传递协议，例如采用HDMI接口实现连接时，可以采用HDMI协议进行数据传输。
外接设备500在运行过程中，可以根据使用情况实时输出视频数据和/或音频数据。外接设备500在不同的使用场景下，所输出的视频信号和音频信号需要与对应场景相适应，从而获得更好的画质效果和音质效果。为此，显示设备200可以内置多种播放模式，不同的播放模式下，可以获得不同画质和音质效果。
例如，显示设备200支持切换的播放模式可以包括低延迟模式(Low-latency Mode，LLM)和高画质模式(High Image Quality Mode，HIQM)。对于游戏机等外接设备500，由于游戏画面需要保持良好的流畅性和响应速度，因此在使用显示设备200输出游戏画面时，可以控制显示设备200切换至低延迟模式。在低延迟模式下，显示设备200可以关闭部分画质处理程序，如关闭插帧算法、降噪处理、超分算法等，减少画面处理的时间，降低画面显示延迟。而对于机顶盒等外接设备500，由于相对于游戏画面，影视画面更注重画面质量，并不需要过快的显示响应速度，因此在使用显示设备200播放机顶盒传输的影视画面时，可以控制显示设备200切换至高画质模式，以开启插帧算法、降噪处理、超分算法等全部画质处理程序，获得更好的画面效果。
但是，由于外接设备500与显示设备200之间不具有从属关系，因此外接设备500通常无法对显示设备200进行直接控制，导致在实际应用中，需要用户手动切换显示设备200的播放模式。手动切换过程不仅需要用户执行交互动作，而且部分用户并不清楚适用于外接设备500的播放模式，导致出现播放模式切换错误的问题。而对于部分外接设备500，其可以在使用中根据不同的使用需求，处于多种不同的使用场景。如游戏场景、影视场景、即时通讯场景等，这些场景可以在特定的播放模式下表现出更好的效果。但由于需要手动切换显示设备200的播放模式，使得当用户在外接设备500上变更使用场景时，用户需要再更改显示设备200的播放模式，因此为用户带来了不便。
并且，由于显示设备200和外接设备500通常属于不同种类的设备，用户通常无法通过外接设备500直接对显示设备200进行控制。例如，用户在智能电视与游戏设备之间通过HDMI接口实现连接时，游戏设备负责运行游戏应用，并根据用户交互操作形成视频数据和音频数据，而智能电视只能被动获取游戏设备输出的音频数据和视频数据，游戏设备无法直接调整智能电视的播放模式，造成播放模式与使用场景不相符，影响视频、音频效果。
<自动低延迟模式>
为了适应不同的使用场景，在一些实施例中，外接设备500可以支持自动低延迟 模式(Auto Low-latency Mode，ALLM)。自动低延迟模式可以在Sink端用户无需手动设置的情况下，由source端根据预设规则自动启动或禁止Sink端运行低延时模式。例如，用户在观看电影时接到视频电话，则此时作为source端的外接设备500会自动停止电影播放，并通知Sink端显示设备200切换至低延时模式，以保证视频电话的实时互动性能。而在用户接听完视频电话后，source端外接设备500可以恢复电影播放过程，并通知Sink端显示设备200退出低延时模式的状态。
但目前市面上支持ALLM协议的外接设备500较少，限制了依赖ALLM协议的参数自适应功能的应用范围。例如，Xbox系列游戏机支持ALLM协议，而部分其他类型的游戏机并不支持ALLM协议，导致无法实现在游戏机进入运行游戏的状态时，自动向显示设备200发送用于切换播放模式的控制指令。
基于此，在本申请的部分实施例中，如图6所示，显示设备200可以通过检测外接设备500发送的数据流，对外接设备500是否支持ALLM协议等自动控制协议进行检测，并针对外接设备500所支持的控制协议，切换播放模式。为了实现自动切换播放模式，显示设备200可以包括显示器260、外部装置接口240以及控制器250，外接设备500则包括数据接口和处理器。通过在外部装置接口240与数据接口之间连接HDMI数据线，使外接设备500接入显示设备200。在接入显示设备500后，外接设备500可以向显示设备200发送数据流。其中，数据流包括待播放的视频数据和音频数据。
为了便于描述，在本申请实施例中发送端和接收端建立连接关系以后，所传输的视频数据和音频数据统称为媒资数据。显然，针对不同的外接设备500，媒资数据可以是视频数据也可以是音频数据，还可以是视频数据和音频数据的集合。并且在发送的媒资数据形成数据流后，所形成的数据流中除视频数据和音频数据以外，还可以包括控制指令、设备信息等辅助信息，用于实现显示设备200和外接设备500之间的联动控制。
为了将这些辅助信息发送给显示设备200，外接设备500可以通过所支持的接口协议将这些辅助信息编辑为辅助信息帧随着数据流一同发送给显示设备200。其中，辅助信息帧可以根据外接设备500所支持的协议不同，呈现为不同的形式。对于支持自动控制协议(如ALLM协议)的外接设备500，可以将控制指令等辅助信息编辑至协议帧；而对于不支持自动控制协议的外接设备500，可以将设备信息等辅助信息编辑至基于基础传输协议(如HDMI协议)的设备信息帧(Source Product Description，SPD)。
例如，当接入显示设备200外部装置接口240的外接设备500为Xbox系列游戏机时，Xbox系列游戏机是支持ALLM等自动控制协议的外接设备500，因此外接设备500可以直接通过自动控制协议控制显示设备200切换播放模式，即显示设备200可以从数据流中提取使用场景信息，并根据使用场景信息实施播放模式切换。随着用户使用过程，游戏机可以在数据流中添加使用场景信息，即在运行游戏程序时在数据流中添加使用场景信息为游戏场景，在退出游戏程序时在数据流中添加使用场景信息为非游戏场景。显示设备200可以在检测到使用场景信息为游戏场景时，切换至低延迟模式；而在检测到使用场景信息为非游戏场景时，切换至高画质模式。
对于支持自动控制协议的外接设备500，其在应用中可以根据控制策略向显示设 备200发送设备参数帧数据(或协议帧数据)。显示设备200可以在协议帧数据中的特定位置读取状态参数，从而根据状态参数确定控制方式。例如，如图7所示，在外接设备500连接显示设备200后，可以从数据流中提取ALLM协议帧。在ALLM协议帧中，可以通过多个在数据帧中特定位置上的字节位对控制指令等辅助信息进行表示。协议帧是按照约定的ALLM控制协议所制定生成，可以用于描述外接设备500的设备信息和与数据传输过程相关的其他信息。显示设备200可以读取自动低延迟模式ALLM状态值；如果ALLM状态值等于1，则代表当前外接设备500处于游戏场景，因此可以控制显示设备200切换播放模式为低延迟模式；如果ALLM状态值等于0，则代表当前外接设备500处于非游戏场景，因此可以控制显示设备200切换播放模式为高画质模式。
<扩展协议>
在协议帧中除基本信息外，还会预留一些字节位(bit位)，这些字节位可以被source端设备赋予特定的数值，即状态值。因此在本实施例中可以在每个字节位中配置特定的状态值，用于传输使用场景信息至显示设备200。例如，对于计算机设备，可以利用HDMI规范中预留的两个bit位，表示使用场景，包括：Rsvd1＝0且Rsvd0＝0表示游戏场景；Rsvd1＝0且Rsvd0＝1表示即时通信场景；Rsvd1＝1且Rsvd0＝0表示办公场景，Rsvd1＝1且Rsvd0＝1表示运动场景等。
为此，在一些实施例中，参考图8，在外接设备500向显示设备200发送媒资数据的同时，还可以在数据流中添加协议帧，显示设备200则可以通过提取协议帧，并遍历多个字节位上状态值的组合，以确定外接设备500所处的使用场景信息，最后按照设定的播放参数调整方式，根据使用场景信息调整播放参数。例如，当读取到Rsvd1＝0且Rsvd0＝0时，则确定当前外接设备500处于游戏场景，而游戏场景需要保持良好的同步性和画面响应速度，因此显示设备200在获得外接设备500处于游戏场景时，可以关闭非必要且消耗时间的画质处理程序，以降低在游戏场景时的显示延迟。在使用过程中，显示设备200可以通过持续监测数据流中的协议帧，使播放模式跟随外接设备500的使用场景实时切换播放模式。例如，Sink端显示设备200可周期性检测数据流，实时解析协议帧中的ALLM标志位，以通过ALLM标志位确定当前是否需切换至低延迟模式(Low-latency Mode，LLM)。当外接设备500通过ALLM触发Sink端显示设备200进入LLM后，显示设备200需保持该模式直到Source端外接设备500通知Sink端显示设备200退出LLM。而当Source端通知Sink端显示设备200退出LLM后，Sink端显示设备200需恢复进入LLM之前的图像模式。
需要说明的是，当外接设备500通过ALLM触发LLM切换时，Sink端显示设备200需临时限制视频信号和音频信号，不直接播放source端外接设备500传递过来的信号，以使控制器250能够在此期间内判断是否需要执行切换。并且，为了实现无感知交互，以获得更好的用户体验，Sink端显示设备200若在切换期间可以显示遮挡画面，如黑屏、花屏或者OSD遮挡等，但显示的时间在满足切换运行时间的前提下，尽可能的短，如显示时间不超过1s。同时，声音则不得出现任何无关提示音，包括敲击声、点击声或者系统提示音等。
对于支持自动控制协议的外接设备500，不同外接设备500对应的使用场景不同。部分外接设备500可以支持多种使用场景，例如，计算机设备、智能终端等，其在使 用中能够处于游戏场景、即时通信场景等，这些外接设备500可在使用中处于不同的使用场景，因此称为多模式设备。部分外接设备500仅支持单一使用场景，例如，游戏机、机顶盒、多媒体播放器等，这些外接设备500一般在使用中不切换或极少切换使用场景，因此称为单模式设备。
因此，在一些实施例中，在检测到外接设备500连接显示设备200以后，显示设备200可以从数据流中提取外接设备500的设备类型。其中设备类型的检测方式可以通过读取数据流中携带的设备信息帧中的内容获得，例如，可以通过读取设备名称、设备mac地址、设备接口信息等数据，确定外接设备500的设备类型。
如果设备类型为单模式设备，将播放模式切换为单模式设备所支持的模式。例如，当检测到外接设备500为多媒体播放器，即单模式设备时，则可以控制将播放模式切换为多媒体播放器对应需要的高画质模式。
由于支持多模式的外接设备500可以在使用中，随用户操作切换到不同的使用场景，因此如果设备类型为多模式设备，可以配置扩展协议，使接入显示设备200的外接设备500能够在协议帧数据中发送使用场景信息，从而将当前的使用场景信息发送给显示设备200，从而使显示设备200根据扩展协议切换播放模式。其中，所述扩展协议用于传递外接设备500的使用场景信息。例如，当检测到外接设备500为计算机设备，即多模式设备时，可以通过配置扩展协议，使计算机设备可以在发送的数据流中携带使用场景信息。
扩展协议可以根据自动控制协议的数据传输特点，附加定义部分数据字段。例如，可利用HDMI规范中预留的多个bit位表示外接设备500的使用场景信息。对于计算机设备，可以利用HDMI规范中预留的两个bit位，表示使用场景，包括：Rsvd1＝0且Rsvd0＝0表示游戏场景；Rsvd1＝0且Rsvd0＝1表示即时通信场景；Rsvd1＝1且Rsvd0＝0表示办公场景，Rsvd1＝1且Rsvd0＝1表示运动场景等。
相应的，如图9所示，显示设备200可以通过周期性获取协议帧数据，并遍历协议帧数据中多个bit位上的参数值。从而根据多个bit位上的参数值组合，读取当前使用场景信息，最后设置播放模式为与当前使用场景信息相适应的模式。
例如，显示设备200可以每个1s在数据流中提取协议帧数据，并在扩展协议指定的两个bit位上读取参数值，当读取到Rsvd1＝0且Rsvd0＝0时，则确定当前计算机设备处于游戏场景，而与游戏场景适应的播放模式为低延迟模式，因此可以将显示设备200的播放模式切换至低延迟模式。当读取到Rsvd1＝1且Rsvd0＝1时，则确定当前计算机设备处于观看球赛等运动场景，与运动场景适应的播放模式为运动补偿模式，因此可以将显示设备200的播放模式切换至运动补偿模式，即开启运动补偿(Motion Estimation and Motion Compensation，MEMC)功能，对传输的媒资画面进行画质处理。
显然，也可以通过协议帧的预留标志位对各种使用场景进行表示。例如，通过标志位Rsvd1和Rsvd0的状态值组合对所运行的游戏进行区分，以便于控制修改播放参数。需要说明的是，上述实施例中以两个bit位上的状态值组合对四种使用场景进行描述，但对于支持更多使用场景的外接设备500，还可以增加预留标志位的数量，例如，通过Rsvd0＝0、Rsvd1＝0、Rsvd2＝0表示竞速类游戏场景；通过Rsvd0＝0、Rsvd1＝0、Rsvd2＝1表示射击类游戏场景等。本领域技术人员在基于上述预留标志位所表示不同使用场景的方案，所想到的诸如增加或减少标志位数量，以及赋予更多状态值形式的 表示方式，均属于本申请的保护范围。
如图10所示，在一些实施例中，与当前使用场景信息相适应的模式包括完全低延迟模式和非完全低延迟模式，如果与当前使用场景信息相适应的模式为完全低延迟模式，关闭对数据流的所有画质处理项、超分算法以及降噪算法等。其中，仅关闭部分画质处理的低延迟模式则是指将上述画质处理算法中的一个或多个关闭，保留其他的一个或多个画质处理算法，以适应不同的使用场景；如果与当前使用场景信息相适应的模式为非完全低延迟模式，关闭对数据流指定画质处理项以外的所有画质处理项。
例如，在将计算机设备通过HDMI接入智能电视后，计算机设备端可以有多种使用场景，包括看电影、玩游戏、看球赛、视频通话、办公等。其中，看电影场景对应完全高画质模式，玩游戏场景则为完全低延时模式。但看球赛时，在追求低延时效果时用户也会在意画面的流畅度，此时并不能关闭提升画质流畅度的MEMC功能来降低延时。再比如视频通话时，由于视频通话时的画面清晰度较低，需要通过超分算法(NR)和降噪算法(SR)提升清晰度，因此视频通话场景需要降低延时但不能关闭超分算法与降噪算法。
可见，本实施例可以根据不同的模式，采用不同的数据流播放方法，利用ALLM协议帧的预留标志位，使source端外接设备500在要求低延时场景时可以提供更加详细的画质处理方式，相应的使用场景信息在送达sink端显示设备200后，sink端显示设备200可根据该信息更加细致的调整自身工作参数，以此适应不同场景下的低延时需求。
<SPD数据帧判断设备类型>
对于不支持自动控制协议的外接设备500，由于这类外接设备500不能通过ALLM等自动控制协议传输控制指令，因此为了适应不同的使用场景，如图11所示，可以在数据流中提取设备类型，并根据设备类型切换播放模式。例如，HDMI协议中规定了一种描述设备自身信息的源设备描述SPD数据帧，与ALLM协议帧不同，SPD数据帧基于基础的HDMI协议生成，可以无需对外接设备500进行额外配置的情况下，向显示设备200发送包括用于描述设备信息的辅助信息。外接设备500可以在传输媒资信息数据的同时，按照预设时间间隔发送SPD数据帧。显示设备200则在接收到SPD数据帧以后，从SPD数据帧中读取特定字节位置上的设备分类，如通过读取确定设备分类为游戏机，则控制显示设备200切换至低延迟模式。
为了识别出设备类型，在一些实施例中，显示设备200可以从数据流中提取设备信息帧；并根据设备信息帧中指定字节位的数据，获取外接设备类型。例如，支持SPD(数据帧)协议的产品较为普及，主流外接设备500均可以送出SPD协议帧数据，因此当外接设备500不支持ALLM功能时，可以通过SPD协议帧来获取外接设备500的类型信息。为实现更精确的判断，还可以从SPD数据帧中提取其他辅助信息用于判断设备类型，例如制造商信息、型号信息等。再按照用户的使用习惯，游戏类设备主要的使用场景是游戏场景，智能终端设备的主要使用场景则是画面投屏，以上两种场景均要求更低的画面传输延迟效果，即需要低延迟模式；而其他类设备例如机顶盒、DVD等则主要用于观影场景，此时需要高画质模式。
需要说明的是，在本实施例中，为了便于描述，将使用习惯上要求更低的画面传输延迟的设备称为第一类设备；将要求更高画面质量的设备称为第二类设备。因此， 在获取外接设备500的设备类型后，可以对设备类型进行判断，如果设备类型为第一类设备，设置播放模式为低延迟模式；如果设备类型为第二类设备，设置播放模式为高画质模式。
同理，对于其他类型的外接设备500，可以根据使用习惯或自定义策略设定不同设备类型下的播放模式。例如，对于网络摄像头设备，根据用户的使用习惯常用于进行网络通信，因此当检测到外接设备500的设备类型为网络摄像头时，可以将显示设备200的播放模式切换为低延迟且不关闭超分算法与降噪算法的模式下。通过更细致的归类和更多的自定义播放模式，可以实现在外接设备500不支持自动控制协议时，也可以自动调整到相适应的播放场景。
如图12所示，在一些实施例中，为了能够确定外接设备500的设备类型，还可以在显示设备200中预先存储一个类型对照表。在类型对照表中，可以保存有设备信息帧中指定字节位上的状态数值与设备类型之间的对应关系。例如，SPD数据帧中的第25个字节(data byte 25)代表设备分类，其对应状态值“8”代表“游戏设备”、“9”代表“主机设备”、“10”代表“DVD设备”等。
在获得指定字节位上的状态数值以后，可以先调用类型对照表，再以状态数值为索引值，在类型对照表中匹配目标表项。例如，当读取到特定字节位上的设备分类数值为“8”，通过类型对照表确定接入显示设备200的外接设备500为游戏机，而游戏机通常用于进行游戏，因此可以将播放模式切换至低延迟模式。
为了便于切换播放模式，在一些实施例中，类型对照表内还可以直接记载与各设备类型相适应的播放模式，即在类型对照表中，包括“状态值-设备类型-适应模式”的表项，例如“8-游戏机-低延迟模式”等。因此，在匹配到状态值对应的目标表项后，可以解析目标表项中播放模式对应的画质参数和/或音质参数。其中，画质参数用于执行画质处理，可包括执行的画质处理方式以及具体执行画质处理时所参照的参数等，例如，是否执行超分算法以及超分算法的目标分辨率等。同理，音质参数用于执行音质处理。
在解析获得画质参数和/或音质参数后，显示设备200还可以按照画质参数和/或音质参数对数据流执行画质处理和/或音质处理，以将数据流输出为视频信号和/或音频信号。例如，通过状态值10匹配到设备类型为DVD设备，且对应的播放模式为高画质模式。因此可以解析高画质模式下对应的画质参数，如执行超分算法将画面分辨率提高至4096×2160，以获得超高清的画面质量。
在上述实施例中，由于设备信息帧只能够传递外接设备500的设备类型，但外接设备500在部分使用过程中，并不局限于一种使用场景，因此会造成外接设备500不处于主要使用场景时，相适应的播放模式与类型对照表中记载的不同，无法获得较好的数据流输出效果。例如，连接显示设备200的外接设备500为主机设备(计算机主机)时，主机设备可处于游戏场景和影视场景等多种场景。当主机设备运行游戏，但类型对照表中记载的播放模式为主机设备在主要使用场景为影视场景时的高画质模式，则会造成切换的播放模式与游戏场景不匹配，影响输出效果。
对此，如图13所示，在一些实施例中，显示设备200还可以通过图像识别的方式，确定当前外接设备500所处的使用场景，从而根据使用场景变化动态调整播放模式。即显示设备200可以从外接设备500发送的数据流中周期性的提取图像帧数据。例如， 每隔30s从数据流中提取一次图像帧数据，获取当前待显示的画面。
再将提取的图像帧数据输入到识别模型中，通过识别模型对图像帧数据进行分类。其中，识别模型可以通过人工智能机器学习算法，经过样本训练获得。即在实际应用中可以通过带有分类标签的图像输入初始模型，并根据模型输出的分类结果以及分类标签反向传播，调整模型参数。如此，通过大量的样本图像，可获得适用于显示设备200使用场景，并具有较高分类准确率的识别模型。
图像帧数据输入识别模型后，识别模型可以对图像帧数据进行分类计算，输出对应的分类结果，即获取使用场景信息。显示设备200再根据获取的使用场景信息切换播放模式。例如，通过获取图像帧数据并输入至识别模型，识别出图像帧数据中对应的画面为游戏画面，因此可以确定主机设备的当前使用场景为游戏场景，则将显示设备200的播放模式切换至低延迟模式。
可见，在本实施例中显示设备200通过周期性提取图像帧数据，实现对外接设备500使用场景进行实时监控，从而在使用场景发生变化时，切换至相应的播放模式，使播放模式能够保持与使用场景相适应，提高数据流的输出质量。
由于在部分情况下，连接显示设备200的外接设备500的设备类型会发生变化，例如，在显示设备200同时接入多个外接设备500时，不同外接设备500之间可以相互唤醒，则在唤醒一个外接设备500后，连接显示设备200的设备类型会发生改变。
而不同的设备类型对应不同的播放模式，因此在设备类型改变时，需要对播放模式进行切换，即如图14所示，在一些实施例中，显示设备200可以周期性的从数据流中提取设备信息帧，并依次对比当前设备信息帧与前一个设备信息帧中的设备类型。如果当前设备信息帧与前一个设备信息帧中的设备类型不同，则需要切换播放模式，即按照当前设备信息帧中的设备类型切换播放模式。
例如，显示设备200可同时接入计算机设备和智能相机设备，并且在用户需要时，可以使用计算机唤醒智能相机。由于用户使用显示设备200显示计算机上的游戏画面，因此显示设备200的播放模式为低延迟模式。而当计算机设备唤醒智能相机设备以后，由于设备类型变更为智能相机设备，而智能相机适合的播放模式为高画质模式，因此需要将播放模式切换至高画质模式。
如果当前设备信息帧与前一个设备信息帧中的设备类型相同，则保持播放模式输出数据流，即对于来源于同一个外接设备500的设备信息帧，显示设备200无需多次执行切换程序，直接保持稳定的播放模式即可。
需要说明的是，由于类型对照表中可以存储与各设备类型相适应的播放模式，因此在对比当前设备信息帧与前一个设备信息帧中的设备类型的同时，还可以对比相适应的播放模式，从而在相适应的播放模式发生改变时将显示设备200的播放模式切换至当前设备信息帧中的设备类型对应的模式，而在相适应的播放模式未发生改变时，保持当前播放模式。
例如，当接入显示设备200的外接设备500类型从DVD设备切换至智能终端设备时，由于两者都适应高画质模式，因此即使设备类型发生变化，依然不切换播放模式。而当接入显示设备200的外接设备500类型从网络摄像头设备切换至智能终端设备时，由于两者适用于不同的播放模式，因此需要将显示设备200的播放模式从低延迟模式切换至高画质模式。
此外，当显示设备200无法获取到数据流中的设备信息帧时，说明当前已断开外接设备500与显示设备200之间的连接，因此可以对播放模式进行还原，即切换回初始的播放模式。在此过程中，显示设备200可以通过在连续多个周期内对设备信息帧的提取过程进行检测，从而在连续预设次数周期内，无法从数据流中提取到设备信息帧，将所述播放模式还原至初始模式。
在上述实施例中，显示设备200可以通过解析数据流确定外接设备500是否支持自动控制协议，从而根据外接设备500的自动控制协议支持能力，设定播放方式。在一些实施例中，为了快速获得外接设备500的自动控制协议支持能力，还可以通过存储设备信息的方式，对接入显示设备200的外接设备500支持情况进行保存，并在外接设备500接入显示设备200时，通过匹配存储的信息，确定外接设备500的协议支持情况。
例如，显示设备200还包括存储器，存储器中可以存储外接设备500的设备信息表。在设备信息表中，每个外接设备500的设备名称和协议支持情况作为表项进行保存。当检测到外接设备500接入显示设备200时，显示设备200可以自动提取设备信息表，并在设备信息表中匹配当前外接设备500设备名称下的协议支持情况。当通过设备信息表获取当前外接设备500支持ALLM协议时，按照ALLM协议切换播放模式；当通过设备信息表确定当前外接设备500不支持ALLM协议时，则可以通过SPD协议帧获取外接设备500的设备类型，从而通过设备类型切换播放模式。
<首次设备接入判断>
对于首次接入显示设备200的外接设备500，由于设备首次接入，在设备信息表中并没有存储当前外接设备500的信息，因此显示设备200无法在设备信息表中匹配到当前外接设备500的设备名称，即无法通过存储的设备信息获取首次接入的外接设备500信息。为此，在一些实施例中，在外接设备500连接显示设备200时，显示设备200还可以对外接设备500是否为首次接入进行判断。
如图15所示，外接设备500是否为首次接入的判断，可以通过遍历存储的设备信息表，当遍历结果为设备信息表中不存在当前外接设备500的设备名称，则确定当前外接设备500为首次接入；当遍历结果为设备信息表中存在当前外接设备500的设备名称，则确定当前外接设备500不是首次接入。对于不是首次接入的外接设备500，显示设备200可以直接通过设备信息表中存储的协议支持情况，执行相应的播放模式切换方式。
而对于首次接入的外接设备500，显示设备200需要启动协议检测程序，对外接设备500所支持的协议进行检测。显示设备200可以通过提取数据流中携带的设备信息数据帧，并在设备信息数据帧中提取指定标志位上的状态值。例如，ALLM协议支持情况可作为保留位一直存在于HDMI数据帧中，即显示设备200可读取数据帧中ALLM对应位置的状态值。当ALLM对应位置上的状态值为0时，确定当前外接设备500不支持ALLM协议；而通过读取指定标志位置上的状态值为1时，确定当前外接设备500支持ALLM协议。
在确定外接设备500所支持的ALLM协议后，显示设备200还可以将当前外接设备500的设备名称以及对应的协议支持情况作为表项，存储在设备信息表中，以便此外接设备500在后续再次接入时，可以直接通过设备信息表确定此外接设备500的协 议支持情况。
在上述实施例中，显示设备200可以通过读取数据帧中的指定标志位状态值，确定外接设备500的协议支持情况。而在部分判断过程中，即使外接设备500不支持自动控制协议，同样会向显示设备200发送标志位为0的数据，这与自动控制协议生效时的0/1状态冲突，导致显示设备200无法直接判断外接设备500是否真正支持自动控制协议。
为此，在一些实施例中，还可以通过分析一段时间内的状态值维持情况，确定当前外接设备500是否支持自动控制协议。即显示设备200可以获取检测周期内的外接设备500的场景切换信息，以及数据流中自动控制协议标志位的参数变化信息。如果场景切换信息与参数变化信息相匹配，则确定当前外接设备500支持自动控制协议，因此可以生成表示外接设备支持自动控制协议的控制协议支持信息，并存储该信息。
例如，当source端外接设备500在播放视频资源或者停留在主页时，不会通知sink端显示设备200进入低延时模式，因此ALLM的状态值为0，而当source端外接设备500在运行游戏时，需要通知sink端显示设备200进入低延时模式，因此的状态值需要设置为1。基于以上原则，显示设备200可以在外接设备500第一次接入时，自动使能ALLM协议解析线程，同时通过图像识别、AI场景识别等方式，判断当前的使用场景是在玩游戏还是在播放视频资源，同时记录ALLM的状态值变化情况。若场景切换信息与参数变化信息相匹配，表示当前外接设备500可以正确维护该标志位，即说明当前外接设备500支持ALLM协议，否则不支持ALLM协议。
可见，在上述实施例中，显示设备200可以通过维护设备信息表，实时记录外接设备500的协议支持情况，从而可以通过解析外接设备500发送的数据流，确定外接设备500是否支持自动控制协议。例如，对于所有首次接入显示设备200的外接设备需进行上述过程，并对各个外接设备500的ALLM支持情况分别记录，使显示设备200可通过外接设备500发送的SPD数据帧来区分。
需要说明的是，显示设备200通过分析数据流所确定的外接设备500协议支持情况的判断结果可以用于指示外接设备500完全不支持自动控制协议，也可以用于指示外接设备500在当前时刻不支持自动控制协议。例如，由于用户设置原因，导致当前外接设备500的ALLM开关处于关闭状态，而在后续接入显示设备200时，用户可能设置ALLM开关处于开启状态，即使能ALLM功能。因此，为了使支持自动控制协议的外接设备500尽可能通过自动控制协议控制切换显示设备200的播放模式，对于非首次接入的外接设备500，显示设备200还可以通过周期性检测，以更新存储的设备信息表。
在使用设备信息表作为设备协议支持情况判断依据时，还需要考虑外接设备500的开关状态，以避免开关状态影响判断过程。例如，在检测外接设备500是否支持ALLM协议时，读取到ALLM对应位置的状态值为1，表示当前外接设备500支持ALLM协议，但在后续使用中外接设备500被用户设置关闭了ALLM协议。即虽然设备信息表中记载该外接设备500支持ALLM协议，但在后续这次接入过程中，由于ALLM协议开关被关闭，因此此次播放过程无法按照ALLM协议控制切换播放模式，仍需要使用SPD数据帧确定设备类型以切换播放模式。
因此，在一些实施例中，当外接设备500与显示设备200进行连接时，如果判断 当前外接设备500不是第一次接入显示设备200，还可以根据ALLM的开关状态执行不同的画质、音质调整程序。
例如，当ALLM开关为开启状态时，显示设备200可以通过线程循环体实时对外接设备500的ALLM状态变化进行检测，如果ALLM状态变化为ALLM＝1，则进一步获取外接设备500发送的视频数据和/或音频数据，从而根据该数据检测外接设备500的使用场景。检测过程中，显示设备200可以获取外接设备500此时的游戏画面，并对游戏画面执行图像分析处理，以确定当前游戏画面所属的游戏类型分类，并根据不同的游戏类型设置不同的画质、音质参数。如对于射击类、运动类、动作类游戏类型，需要降低游戏画面的延迟，以使游戏体验更加流畅。如果ALLM状态变化为0，则可以停止上述画质、音质的处理，将画质、音质参数恢复为用户自定义值，以保证用户的正常观影体验。
当ALLM开关为关闭状态时，由于显示设备200不能直接通过ALLM协议获取外接设备500的使用场景，因此可以获取外接设备500的SPD信息。即如果外接设备500发送的数据流中带有SPD信息，则可以解析SPD信息，先获取外接设备500的设备类型，再根据外接设备500的类型不同，选择不同的画质、音质调整方式。例如，通过解析SPD信息，显示设备200可以对外接设备500是否为游戏设备进行判断，如果外接设备500是游戏设备，则可以根据游戏画面对当前所运行的游戏类型进行判断，并根据不同的游戏类型设置不同的画质、音质参数。而如果外接设备500不是游戏设备，则可以将画质、音质参数恢复为用户自定义值，以保证用户的正常观影体验。
可见，在本实施例中，对于支持自动控制协议的外接设备500，可以根据不同的开关状态执行对应的播放模式切换方式，使显示设备200能够自动对外接设备500的使用场景进行判断，并根据外接设备500的使用场景，调整显示设备200的工作模式，以实现显示设备200的画质效果、音质效果可以与外接设备500的使用场景联动，实现更佳的用户体验。
<画质参数设置>
在一些实施例中，设置画质参数时，还可以通过调用历史记录信息获取相应的画质参数。例如，显示设备200可以记录自动进入游戏模式之前用户设置的图像模式，并在进入自动游戏模式之后，设置相应的图像模式参数。如果用户在自动进入游戏模式的情况下对图像模式参数进行手动更改，显示设备200还需要记忆用户设置的图像模式。其中，针对不同的游戏模式，显示设备200还可以记录其游戏模式下对应的图像模式参数。例如，显示设备200可以通过识别游戏图像类型，自动设置为SDR游戏、HDR游戏、杜比游戏等模式。
另外，在游戏过程中，显示设备200还可以通过实时识别游戏的画面信息，区分游戏的类型，从而在游戏模式下更改基本画质参数，以达到更好的游戏体验。为了获得更好的用户体验，当用户拔掉游戏机时，不会主动切出游戏模式，而是等待下一个设备的接入。再判断新接入的设备类型，如果是游戏机则不需切出，若是机顶盒等其他类型设备，则切到上一次用户设置的图像模式。
为了获得上述效果，在一些实施例中，显示设备200可以在进入游戏模式后，设置游戏模式标签，即设置“setGameModeFlag＝true”，再根据图像模式类型确定要设置的游戏图像类型，如果要设置的图像类型与当前的模式相同，则保存游戏模式。再通 过设置硬件抽象层(Hardware Abstraction Layer，HAL)的图像模式(picmode)，以及更新背光、图像参数以及动态对比度曲线等，完成图像模式设置。
此外，在游戏过程中，显示设备200还可以对当前图像是否为可变刷新率模式(VRR)进行判断，如果是VRR模式，则通过记忆的数据判断上次游戏过程中是否为VRR模式，以及游戏模式是否发生变化，从而设置输出模式为PC以及并将播放模式设置为低延迟模式，并更新模式标识，以供在后续游戏中调用。在进行图像模式设置的过程中，还可以按照游戏模式设置相应的画质处理算法，例如根据是否为图像模式设置游戏过程中是否执行插黑、运动补偿、降噪处理以及SDR与HDR模式的转化等处理。
在一些实施例中，播放模式的切换方式可以通过手动或自动的方式进行主动控制，即显示设备200在切换播放模式后，还可以实时监控外接设备500的使用场景，并根据使用场景的改变，再次切换播放模式。例如，在显示设备200通过ALLM协议帧或者SPD设备信息帧自动切换播放模式时，可以在以下4种条件停止自动切换播放模式，即用户手动切换图像模式；信号源切换；外接设备500从显示设备200中拔出；外接设备200的ALLM/SPD驱动控制。
在检测到显示设备200处于的设定状态时，可以控制返回初始的播放模式，并完成相应的控制流程。例如，在使用显示设备200过程中，可以在显示设备200处于上述4种场景后，判断是否已经进入游戏模式，如果是，则先退出SOC/FRC的游戏模式，并且将游戏模式标志清零，再执行对应的退出流程，如图像模式切换流程、信号源切换流程、设备拔出流程以及恢复图像参数流程等。
上述实施例中显示设备200可以通过配置自动适应外接设备500的使用场景，以切换播放模式。通过对显示设备200的控制器250配置控制程序，使其在获取外接设备500发送的数据流后，从数据流中解析当前外接设备500所支持的控制协议。如果外接设备500支持自动控制协议，根据数据流指定的切换播放模式；如果外接设备500不支持自动控制协议，根据外接设备的设备类型切换播放模式。
为了使显示设备能够实现上述功能，如图16所示，在本申请的部分实施例中，还提供一种外接设备500包括：数据接口510和处理器520，其中，数据接口510被配置为连接显示设备200；处理器520被配置控制程序，以获取待播放数据流和外接设备500类型，并根据设备类型，生成设备信息帧。再将设备信息帧添加到数据流中，以发送给显示设备，使所述显示设备将播放模式切换至与所述设备类型相适应的模式。
上述实施例中提供的外接设备500可以在与显示设备200建立连接关系后，通过检测自身设备类型，生成包含设备类型的设备信息帧，并将设备信息帧添加到数据流中，从而与数据流一同发送给显示设备200，以便显示设备200可以按照外接设备500的设备类型切换播放模式。外接设备500可以通过配置简单的控制程序，使显示设备200能够获得设备类型，以自动切换播放模式，提高数据流的输出效果。
为了使显示设备能够实现上述功能，如图17所示，在本申请的部分实施例中，还提供一种外接设备500包括：数据接口510和处理器520，其中，数据接口510被配置为连接显示设备200；处理器520被配置控制程序，以实现向显示设备200发送数据流，并根据自身对自动控制协议的支持情况，在数据流中附加数据信息。如果外接设备500支持自动控制协议，在数据流中添加使用场景信息，以控制显示设备200根 据使用场景信息切换播放模式；如果外接设备500不支持自动控制协议，在数据流中添加设备类型，以控制显示设备200根据设备类型切换播放模式。
上述实施例中提供的外接设备500可以通过数据接口510与显示设备200连接，并向显示设备200发送数据流，同时外接设备500还可以针对自身对控制协议的支持情况在数据流中添加描述设备信息的数据帧。当外接设备500支持自动控制协议时，在数据流中添加使用场景信息；当外接设备500不支持自动控制协议时，在数据流中添加设备类型信息，以控制显示设备200按照使用场景或者设备类型切换播放模式，获得更好的音视频输出效果。
<游戏主题>
由于显示设备200和外接设备500都具有各自独立的操作系统，因此在建立连接关系后，显示设备200一方面可以作为sink端输出外接设备500的数据流，另一方面还可以按照自身操作系统规则执行交互操作。例如，用户可以通过遥控器、手机等控制装置100实施交互操作，显示设备200则可以在输出数据流的过程中，实时接收控制装置100所发送的各种指令。当用户按下控制装置100中的“菜单”按钮时，显示设备200会显示控制菜单。在控制菜单中可以设置有“图像模式”、“声音模式”、“显示范围”、“缩放模式”、“HDMI版本”等多个控制选项，用户可以通过控制装置100执行进一步操作，选中任一控制选项。此时，显示设备200可以进一步显示对应的用户界面，以完成对显示设备200输出方式的控制。
对于显示设备200，其在交互过程中所显示的控制菜单等内容，可以跟随操作系统的用户界面主题，呈现为特定的界面风格。例如，如图18所示，对于智能电视等显示设备200，控制菜单可以呈现为淡蓝色渐变背景形式。
由于用户界面主题通常是由用户通过显示设备200的操作系统进行设定。因此在显示设备200与外接设备500建立连接关系以后，用户界面主题仍然按照操作系统中设定的形式进行显示。这将导致用户界面的主题形式单一，并且在输出外接设备500的数据流时，容易使控制菜单的主题风格与视频画面风格不匹配，不便于用户区分，降低交互体验。例如，当用户使用游戏机接入显示设备200时，游戏画面可能也是蓝色渐变背景形式，使控制菜单与背景颜色无法明显区分，不便于用户操作。在部分情况下，游戏画面还可能与控制菜单风格不一致，使整体显示效果不协调。
为了便于用户执行操作，提高用户体验，在本申请的部分实施例中提供一种显示设备200，所述显示设备200包括显示器275、外部装置接口240以及控制器250。其中，外部装置接口240用于连接外接设备500，显示器275用于显示用户界面以及显示外接设备500发送的媒资数据画面。控制器250则可以被进一步配置为执行用户界面主题更新方法，以实现显示设备200的用户界面主题可以跟随外接设备200发送的内容进行更新，以获得更便于操作和/或更协调的用户界面风格。
具体的，如图19所示，显示设备200可以在外接设备500连接至外部装置接口240以后，接收外接设备500发送的数据流。其中，显示设备200所接收到的数据流包括视频数据、音频数据以及与数据输出相关的辅助信息数据。外接设备500可以通过多个连续帧形成数据流，显示设备200在接收到数据流后，一方面可以解析从数据流中解析获得视频数据和音频数据等媒资数据，并形成具体的视频图像和声音信号；另一方面还可以从数据流中提取与数据输出过程相关的辅助信息，以便实时控制媒资 输出过程。
例如，显示设备200可以从媒资数据中的设备信息帧中提取当前外接设备500相关的信息，包括设备名称、设备类型等信息，通过提取的信息调整播放模式，以适应外接设备500的使用场景或者向外接设备500发送一些控制指令。对于支持自动控制协议的外接设备500，显示设备200还可以在数据流中提取基于自动控制协议的相关控制指令，以便根据控制指令切换播放模式。
在接收到外接设备500发送的数据流后，显示设备200还可以从数据流中提取设备信息。其中，所述设备信息包括外接设备500的设备类型以及当前使用场景。设备类型可以通过外接设备500的实际功能进行分类，如可以分为游戏设备、多媒体设备等。由于部分外接设备500具有多种功能，因此设备类型还可以包括多功能设备、智能终端设备等。
设备类型可以通过读取数据流中的设备信息帧获得，也可以通过分析数据流中的视频数据和音频数据内容，以及相关接口数据、设备名称等信息综合识别获得。显示设备200可以在接收到的数据流中提取设备名称、制造商信息、mac地址、接口规范以及音视频数据格式等内容，综合判断设备类型。例如，通过读取外接设备500的设备信息帧可以获得外接设备500的类型为“游戏设备”。而在需要确定具体游戏设备的时，还可以提取相关信息，包括：设备名称“游戏机360”、制造商信息“Microsoft”、mac地址为“XX-XX-XX-XX-XX-XX”、接口规范为“HDMI”。因此，通过查询可以确定能够符合上述相关信息的游戏设备是“x-box 360”，从而获得外接设备500更多的设备信息。
显示设备200还可以通过数据流实时监测外接设备500的当前使用场景。使用场景可以通过读取数据流中的协议帧获得，也可以通过对数据流中显示图像执行场景识别的方式获得。由于不同的外接设备500，所对应能够支持的使用场景不同，部分外接设备500可以支持多种使用场景。例如，计算机设备、智能终端等，其在使用中能提供游戏场景、即时通信场景等。这些外接设备500还可在使用中切换不同的使用场景，因此称为多模式设备。部分外接设备500仅支持单一使用场景，例如，游戏机、机顶盒、多媒体播放器等，这些外接设备500一般在使用中不切换或极少切换使用场景，因此称为单模式设备。
对于单模式设备，当确定设备类型后，其对应的使用场景则可以直接确定。例如，对于设备类型为游戏设备的外接设备500，其对应的使用场景通常为游戏场景。对于设备类型为多媒体设备的外接设备500，其对应的使用场景通常为影视场景。而对于多模式设备，则可以在不同的使用时间或使用条件下处于不同的使用场景。例如，对于设备类型为智能终端设备的外接设备500，其在运行游戏应用时，对应的使用场景为游戏场景；其在播放视频资源时，对应的使用场景为影视场景。
一方面，显示设备200在获取设备信息后，可以根据设备信息中的使用场景切换播放模式，例如在确定外接设备500的当前使用场景为游戏场景时，将播放模式切换至低延迟模式；在确定外接设备500的当前使用场景为影视场景时，将播放模式切换至高画质模式。另一方面，显示设备200在获取设备信息后，可以根据设备信息提取主题图片。其中，主题图片可以由显示设备200根据菜单尺寸，预先制作的主流设备、主要使用场景下的图片画面，对于不同的外接设备500以及不同的使用场景，显示设 备200可以设置与之匹配的多种主题图片，并存储于本地数据库或者云端数据库中。
基于此，显示设备200在提取主题图片的过程中，可以根据设备信息先后在本地数据库和云端数据库中进行查询，以获得符合设备信息的主题图片。显示设备200可以根据设备信息生成查询指令，并响应于查询指令调用本地数据库，并且在本地数据库中查询与设备信息相匹配的主题图片；而当本地数据库中没有查询到相匹配的主题图片时，显示设备200还可以将查询指令发送给云端服务器，以请求云端服务器在云端数据库中匹配与当前设备信息相适应的主题图片。
例如，显示设备200可以从数据流中提取出当前外接设备500的设备信息，包括设备类型为游戏设备，使用场景为运行游戏“游戏X”，则可以根据设备信息生成查询指令，以使显示设备200可以在本地数据库中查询与“游戏X”相关的主题图片，如游戏海报、游戏截图或者与游戏主色调或风格类似的其他战争类图片。当本地数据库中匹配到与“游戏X”相关的主题图片，则直接提取相关图片用于渲染显示设备200的用户界面主题。
而当本地数据库中没有匹配到与“游戏X”相关的主题图片时，显示设备200可以将查询指令发送给云端服务器，请求云端服务器查询相关的主题图片。即云端服务器在接收到查询指令后，可以根据查询指令中指定的游戏场景“游戏X”，在云端服务器中匹配游戏海报、游戏截图或者与游戏X游戏类似的其他战争类游戏图片。最后，将匹配得到的主题图片再发送给显示设备200，以使显示设备200能够提取主题图片。
主题图片可以包括用于构成控制菜单的背景图案和前景图形，当查询获得主题图片后，显示设备200可以根据主题图片对应的背景图案和前景图形渲染控制菜单。不同的主题图片可以渲染出不同的主题风格。例如，当外接设备500为游戏设备时，显示设备200可以根据设备信息查询到游戏主题图片。游戏主题图片可以由基于某一游戏的封面图案生成的背景图案，以及与游戏封面主色调相同或相近的多个前景图形。通过将前景图形和背景图案相结合，可以渲染出符合游戏场景的用户界面，实现按照主题图片更新用户界面主题。
可见，在上述实施例中，显示设备200可以通过对数据流中设备信息的提取，查询与当前外接设备500使用场景相适应的主题图片，从而根据主题图片渲染出控制菜单，使用户界面风格与数据流中的显示画面风格相一致，便于用户执行交互操作，提高用户的使用体验。
为了能够从数据流中提取设备信息，如图20所示，在一些实施例中，显示设备200可以在数据流中获取的设备信息帧。其中，所述设备信息帧为外接设备根据基础传输协议发送的帧数据。例如，HDMI协议中规定了一种描述设备自身信息的源设备描述(Source Product Description，SPD)数据帧，外接设备500可以在传输媒资信息数据的同时，按照预设时间间隔发送SPD数据帧。
显示设备200再通过遍历设备信息帧中指定标志位的状态值，读取设备类型，例如，在接收到SPD数据帧以后，从SPD数据帧中读取特定字节位置(标志位)上的设备分类，如SPD数据帧中的第25个字节(data byte 25)为设备分类，其对应状态值“8”代表“游戏设备”、“9”代表“主机设备”、“10”代表“DVD设备”等。当读取到特定字节位置上的设备分类数值为“8”，代表接入显示设备200的外接设备500为游戏机，而游戏机通常用于进行游戏，因此可以将播放模式切换至低延迟模式。
为了能够根据标志位上的状态值确定外接设备500的设备类型，显示设备200通过遍历获得标志位状态值时，可以调用类型对照表，从而根据遍历获得的状态值在类型对照表中查询当前外接设备的设备类型。其中，类型对照表可以由显示设备200或者显示设备200的云端服务商进行维护，在所述类型对照表中可以包括多个状态值以及每个状态值所指代的设备类型。
由于支持SPD数据帧协议的产品较为普及，主流外接设备500均可以送出SPD数据帧，因此可以通过SPD数据帧来获取外接设备500的设备类型信息。为实现更精确的判断，还可以从SPD数据帧中提取其他辅助信息用于判断设备类型，例如制造商信息、型号信息等。
从设备信息帧中提取的设备类型，可以用于显示设备200切换播放模式。例如，按照用户的使用习惯，游戏类设备主要的使用场景是游戏场景，智能终端设备的主要使用场景则是画面投屏，以上两种场景均要求更低的画面传输延迟效果，即需要切换至低延迟模式；而其他类设备例如机顶盒、DVD等则主要用于观影场景，此时需要切换至高画质模式。
设备类型还可以用于显示设备200对用户界面主题更新过程进行初步判断，以便显示设备200仅针对于部分类型的外接设备500执行用户界面主题更新。由于显示设备200能够连接的外接设备500类型众多，其中部分类型外接设备500所发送的数据流中包含特定的交互界面。例如，显示设备200在检测到外接设备500的设备类型为游戏设备时，由于游戏设备在运行游戏时会呈现游戏列表、游戏内的操作列表等交互界面，并且这些交互界面具有独特的界面风格，因此在通过显示设备200进行输出时，需要显示设备200更新用户界面的主题，以使显示设备200的用户界面与外接设备500的当前交互界面的风格保持一致。
而对于部分外接设备500，其发送的数据流中并不包含交互界面。例如，外接设备500的设备类型为摄像机设备，摄像机设备在使用中仅向显示设备200发送其录制的视频数据，通常不会有其独特的交互界面风格，因此并不需要显示设备200更新用户界面主题，直接按照初始主题进行显示即可。
因此，如图21所示，在一些实施例中，当显示设备200获得外接设备500的设备类型以后，显示设备200还可以对设备类型进行判断，如果设备类型为需要更新用户界面主题的第一类设备，则可以执行后续步骤，从数据流中提取当前使用场景，以获得设备信息。如果设备类型为不需要更新用户界面主题的第二类设备，则可以停止对用户界面主题的更新，维持显示设备200操作系统中设定的用户界面主题形式进行显示。
对于需要更新用户界面主题的第一类设备，显示设备200还可以从数据流进一步提取当前外接设备500的使用场景。即如图22所示，在一些实施例中，显示设备200可以获取数据流中的协议帧，并通过遍历协议帧中标志位的状态值，以根据状态值检测外接设备的当前使用场景信息。所述协议帧为外接设备根据自动控制协议发送的帧数据，例如，协议帧可以是外接设备500基于ALLM协议发送的一帧数据。在ALLM协议帧中，可以在指定标志位上通过状态值表示当前外接设备500的使用场景。
显示设备200可以通过遍历协议帧中标志位的状态值，确定当前外接设备500的使用场景。例如，显示设备200可以从数据流中提取ALLM协议帧，并读取协议帧中 自动低延迟模式ALLM状态参数；如果ALLM状态参数等于1，则代表当前外接设备500处于游戏场景；如果ALLM状态参数等于0，则代表当前外接设备500处于非游戏场景。
对于支持多种使用场景的外接设备500，还可以通过设置协议帧上的预留标志位的状态值，向显示设备200传递当前使用场景信息。例如，对于计算机设备，可以利用HDMI规范中预留的两个bit位，表示使用场景，包括：Rsvd1＝0且Rsvd0＝0表示游戏场景；Rsvd1＝0且Rsvd0＝1表示即时通信场景；Rsvd1＝1且Rsvd0＝0表示办公场景，Rsvd1＝1且Rsvd0＝1表示运动场景等。
因此，显示设备200还可以通过周期性获取协议帧数据，并遍历协议帧数据中多个bit位上的状态值。从而根据多个bit位上的状态值组合，读取当前使用场景信息。例如，显示设备200可以每间隔1s，在数据流中提取协议帧数据，并在扩展协议指定的两个bit位上读取状态值。当读取到Rsvd1＝0且Rsvd0＝0时，则确定当前计算机设备处于游戏场景。当读取到Rsvd1＝1且Rsvd0＝1时，则确定当前计算机设备处于观看球赛等运动场景。
可见，通过读取协议帧中标志位上的状态值，可以获取多模式外接设备500的使用场景，从而按照不同的使用场景查询不同的主题图片，更新用户界面主题。但是对于部分不支持自动控制协议的外接设备500，显示设备200无法从数据流中获取协议帧，或者从数据流中获取的协议帧中不包含有效的设备信息，即无法从数据流中提取出设备信息。为此，如图23所示，在一些实施例中，显示设备200还可以在提取使用场景的过程中，先检测外接设备500所支持的控制协议，如果外接设备500支持自动控制协议，则从数据流中提取协议帧，并通过遍历协议帧中标志位状态值，确定外接设备500的当前使用场景。
如果外接设备500不支持自动控制协议，则可以从数据流中提取多帧显示图像，再对多帧显示图像执行场景识别，获得外接设备500的当前使用场景信息。为了实现场景识别，显示设备200可以从数据流中提取显示图像，并将提取的显示图像输入场景识别模型，以获取场景识别模型输出的场景信息。其中，所述场景识别模型为根据样本图像训练获得的神经网络模型。样本图像则是一种用于训练的图像，包括外接设备500所支持的多个使用场景下的显示图像以及每个显示图像对应的使用场景标签。场景识别模型作为一种分类模型，可以在输入显示图像后，通过模型内部的神经网络算法，计算出该显示图像的分类概率，即该显示图像对应所属的使用场景。
显然，在执行自动控制协议的检测前，可以在显示设备200中构建一个场景识别模型。例如，场景识别模型可以通过执行神经网络模型训练获得，即可以先构建初始模型，再将样本图像逐一输入至该初始模型，以获得模型输出结果。再将模型输出结果与标签信息进行对比，确定分类误差，并使用分类无法反向传播调整模型参数。基于此，通过多次输入一定数量的样本图像，可以逐步对模型参数进行调整，以最终获得较高准确率的场景识别模型。
在构建场景识别模型后，显示设备200可以将从数据流中提取的显示图像输入到场景识别模型，以获得场景识别结果。根据与显示设备200连接的外接设备500类型不同，场景识别模型可以输出的识别结果种类也不同。例如，对于游戏设备，场景识别模型可以输出的使用场景信息包括游戏场景和非游戏场景；而对于计算机设备，场 景识别模型可以输出的使用场景包括游戏场景、即时通信场景、办公场景以及运动场景等。因此，在执行场景识别时，还可以针对不同类型的外接设备500调用不同的场景识别模型，以获得相适应的场景分类。
为了检测外接设备500所支持的控制协议，显示设备200可以在外接设备500第一次接入时，通过检测外接设备500能否维护协议帧中标志位状态值，确定当前外接设备500是否支持自动控制协议。即在第一次接入时，自动使能ALLM协议解析线程，同时通过图像识别、AI场景识别等方式，判断当前的使用场景，同时记录ALLM_Mode标志位的变化情况。若场景切换信息与参数变化信息相匹配，表示当前外接设备500可以正确维护该标志位，即当前外接设备500支持ALLM功能，否则不支持ALLM功能。
显示设备200还可以针对同一个外接设备500，在不同的使用场景下更新不同的用户界面主题，使用户界面主题与外接设备500输入给显示设备200的画面相适应。例如，对于接入显示设备200的游戏设备，可以在其运行游戏时，将显示设备200的用户界面主题更新为与游戏界面相适应；而在其不运行游戏时，将显示设备200的用户界面主题更新为与主界面相适应。
为此，显示设备200可以依据不同的设备信息提取主题图片，即如图24所示，在一些实施例中，可以在显示设备200中定义两类使用场景，即第一场景和第二场景。其中，第一场景为外接设备500具有不固定界面风格的使用场景；第二场景为外接设备500具有固定界面风格的使用场景。如果当前使用场景为第一场景，显示设备200则从数据流中截取当前视频画面，并通过提取当前视频画面的场景名称字符，以根据场景名称字符生成主题标签，最后按照主题标签，从主题库中查询主题图片。
例如，游戏设备在运行游戏A时，其对应的游戏界面风格为卡通风格；在运行游戏B时，其对应的游戏界面风格为写实风格。由于卡通风格和写实风格相差较大，因此在游戏设备处于游戏模式时，显示设备200的控制器250或者独立的视频处理器可以从数据流中截取当前视频画面，以生成截屏图像。再通过启用光学字符识别(Optical Character Recognition,OCR)等文字识别程序，在截屏图像中读取游戏名称或者与游戏名称相关的字符，如游戏开发商名称、游戏关键词、版本号等字符，从而获取游戏名称。显示设备200再根据游戏名称及相关的字符，生成包含游戏名称“A”的主题标签。最后显示设备200可以根据该主题标签，在主题库中查询相适应的主题图片，即卡通风格的主题图片。
在获取外接设备500的当前使用场景后，如果当前使用场景为第二场景，则从数据流中提取外接设备的制造商信息，再根据制造商信息生成主题标签，以及按照主题标签，从主题库中查询主题图片。通常，外接设备500的主界面风格是由制造商在出厂时设定，同一制造商所设置主界面风格往往趋于一致，因此对于固定风格的使用场景，显示设备200可以通过制造商信息生成主题标签，并按照生成的标签查询与主界面风格相似的主题图片，用于更新用户界面主题。
例如，在游戏设备未运行游戏时，一般处于主界面中，而主界面的风格由游戏设备的制造商通过游戏设备的操作系统UI风格确定。因此，当检测到游戏设备处于非游戏场景时，显示设备200可以从设备信息帧或协议帧中提取游戏设备的制造商信息。如xbox的制造商为“Microsoft”，则以“Microsoft”为准生成主题标签并进行匹配， 从而在主题库中提取与xbox主界面风格相适应的主题图片，以将用户界面主题更新为相应的主题。
由于同一设备或者同一使用场景可以对应包括多种界面风格，例如，对于外接设备500的主界面，可以包括浅色模式和深色模式，以分别适应白天和黑夜两个使用时间段。对此，如图25所示，显示设备200可以在从主题库中查询主题图片的步骤中，获取与主题标签相匹配的多个主题图片，每个主题图片可以对应渲染出一个与当前使用场景相适应的用户界面主题。
同时，显示设备200还可以从数据流中提取同样时刻的多帧显示图像，并分别遍历多个主题图片和显示图像的色彩布局，以基于主题图片获得前景色彩，基于显示图像获得背景色彩。再通过对比前景色彩和背景色彩，从多个主题图片中提取具有目标前景色的主题图片。显然，目标前景色为在主题库中匹配到的多个前景色彩中的一个。
可以通过判断前景色彩与背景色彩是否相适应确定目标前景色。其中，前景色彩与背景色彩相适应是指，前景色彩与背景色彩的色调风格相近，但具体颜色存在差异的状态。例如，当背景色彩为绿、蓝、紫及其组合所形成的偏冷色调时，前景色彩也采用偏冷色调，但要与背景图案中的主要颜色能够区分，以使用户容易分辨控制菜单，便于执行交互操作。
可见，在上述实施例中，显示设备200可以通过对比显示图像和主题图片，确定当前使用场景下的界面风格，从而匹配出既与显示画面风格一致，又便于分辨的主题图片，用于更新用户界面主题。
为了更新用户界面主题，如图26所示，在一些实施例中，显示设备20在按照主题图片更新用户界面主题的过程中，可以先获取当前用户界面的菜单尺寸，再根据菜单尺寸裁切主题图片，以生成背景图片，从而将背景图片添加至用户界面中，使用户界面的背景风格与当前使用场景相适应。
同时，为了使用户界面中选项内容清晰可辨，在将背景图片添加至用户界面的同时，还可以根据背景图片修改用户界面中文字和/或图标的颜色，以使用户界面中的文字和图标与背景对比更加明显，以便于用户分辨。
基于上述实施例，显示设备200可以通过在数据流中提取设备类型和使用场景，并根据提取的内容对用户界面主题进行更新，以获得与外接设备500使用场景相适应的主题风格。显然，显示设备200可以按照设定的频率持续对外接设备500的使用场景进行检测，从而实现用户界面主题跟随使用场景的变化而变化，提高用户体验。
例如，显示设备200可以通过中间件层、系统框架层以及渲染层三个部分的工作实现主题跟随变化。即中间件层部分负责收集source设备的类型描述、工作状态参数，并主动上报；系统框架(Android framework)层截取source设备当前视频画面、提取游戏画面中的游戏名称字符，并生成主题标签；渲染层(LiveTV)根据菜单尺寸，预先制作主流设备、游戏的主题图片，存储于本地主题库。通过实时检测framework层通知的标签信息，在本地主题库中查询对应标签的主题图片，并更新用户界面主题。
需要说明的是，显示设备200在更新用户界面主题的过程中，可以对显示设备200的全部用户界面进行更新，也可以仅对部分控制菜单执行更新。例如，如图27、图28、图29所示，可更换主题的菜单主要包含如下几项：菜单、快捷设置界面、主设置界面、“无信号”遮挡界面、信号源选择界面等。上述界面为显示设备200与外接设备500 连接时所能够调出的常用界面，通过对这些常用界面主题的更新，不仅能够获得更协调的主题风格，而且能够减少显示设备200在配置主题过程中的数据处理量，节省运算资源。
在本申请的部分实施例中，还提供一种用户界面主题更新方法，包括：接收外接设备发送的数据流；从数据流中提取设备信息，其中，设备信息包括外接设备的设备类型以及当前使用场景；根据设备信息，在主题库中查询主题图片；按照主题图片更新用户界面主题。
本实施例提供的用户界面主题更新方法可以在显示设备200连接外接设备500后，实时获取外接设备500发送的数据流。再从数据流中提取设备类型和当前使用场景，并以此提取主题图片，从而按照主题图片更新用户界面主题。所述用户界面主题更新方法可通过外接设备500中的显示内容更新用户界面主题，使显示设备200在输出数据流的过程中，能够更新为与数据流内容相匹配的界面风格，便于用户执行交互操作。
为了方便解释，已经结合具体的实施方式进行了上述说明。但是，上述在一些实施例中讨论不是意图穷尽或者将实施方式限定到上述公开的具体形式。根据上述的教导，可以得到多种修改和变形。上述实施方式的选择和描述是为了更好的解释原理以及实际的应用，从而使得本领域技术人员更好的使用实施方式以及适于具体使用考虑的各种不同的变形的实施方式。

Claims (10)

  1. 一种显示设备，包括：
    显示器，被配置为显示用户界面；
    外部装置接口，被配置为连接外接设备；
    控制器，被配置为：
    接收外接设备发送的数据流；
    从所述数据流中提取设备信息，所述设备信息包括外接设备的设备类型以及当前使用场景；
    根据所述设备类型和/或当前使用场景，在主题库中查询主题图片；
    按照所述主题图片更新所述用户界面主题。
  2. 根据权利要求1所述的显示设备，所述控制器被进一步配置为通过下述从所述数据流中提取设备信息：
    获取所述数据流中的设备信息帧，所述设备信息帧为外接设备根据基础传输协议发送的数据帧；
    遍历所述设备信息帧中标志位的状态值；
    调用类型对照表，所述类型对照表中包括多个状态值以及每个所述状态值所指代的设备类型；
    根据所述状态值在所述类型对照表中查询当前外接设备的设备类型。
  3. 根据权利要求1所述的显示设备，所述控制器被进一步配置为通过下述从所述数据流中提取设备信息：
    获取所述数据流中的协议帧，所述协议帧为外接设备根据自动控制协议发送的数据帧；
    遍历所述协议帧中标志位的状态值；
    根据所述状态值检测所述外接设备的当前使用场景。
  4. 根据权利要求3所述的显示设备，所述控制器被进一步配置为：
    检测当前外接设备的设备类型；
    如果所述设备类型为第一类设备，执行获取所述数据流中的协议帧的步骤；
    如果所述设备类型为第二类设备，按照操作系统指定的初始主题显示控制菜单。
  5. 根据权利要求4所述的显示设备，所述控制器被进一步配置为：
    如果所述设备类型为第一类设备，检测所述外接设备所支持的控制协议；
    如果所述外接设备支持自动控制协议，执行从所述数据流中提取协议帧的步骤；
    如果所述外接设备不支持自动控制协议，从所述数据流中提取多帧显示图像；
    对多帧显示图像执行场景识别，以获得所述外接设备的当前使用场景信息。
  6. 根据权利要求1所述的显示设备，所述控制器被进一步配置为通过下述执行根据所述设备信息，在主题库中查询主题图片：
    如果当前使用场景为第一场景，从所述数据流中截取当前视频画面；
    提取所述当前视频画面的场景名称字符；
    根据所述场景名称字符生成主题标签，以及按照所述主题标签，从主题库中查询主题图片。
  7. 根据权利要求6所述的显示设备，所述控制器被进一步配置为通过下述执行根据 所述设备类型和/或当前使用场景，在主题库中查询主题图片：
    如果当前使用场景为第二场景，从所述数据流中提取外接设备的制造商信息；
    根据所述制造商信息生成主题标签，以及按照所述主题标签，从主题库中查询主题图片。
  8. 根据权利要求6或7所述的显示设备，所述控制器被进一步配置为通过下述执行从主题库中查询主题图片：
    获取所述主题标签下的多个主题图片，以及从数据流中提取多帧显示图像；
    遍历多个主题图片的前景色彩和多帧显示图像的背景色彩；
    根据所述背景色彩，从多个主题图片中提取具有目标前景色的主题图片，所述目标前景色为多个前景色彩中的一个。
  9. 根据权利要求1所述的显示设备，所述控制器被进一步配置为通过下述执行按照所述主题图片更新用户界面主题：
    获取当前用户界面的菜单尺寸；
    根据所述菜单尺寸裁切所述主题图片，以生成背景图片；
    将所述背景图片添加至所述用户界面，以及根据所述背景图片修改所述用户界面中文字和/或图标的颜色。
  10. 一种显示设备的用户界面主题更新方法，所述显示设备配置为能够连接外接设备，所述方法包括：
    接收外接设备发送的数据流；
    从所述数据流中提取设备信息，所述设备信息包括外接设备的设备类型以及当前使用场景；
    根据所述设备类型和/或当前使用场景，在主题库中查询主题图片；
    按照所述主题图片更新所述用户界面主题。
PCT/CN2022/071780 2021-01-14 2022-01-13 显示设备及用户界面主题更新方法 WO2022152203A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202280010311.9A CN117397245A (zh) 2021-01-14 2022-01-13 显示设备及用户界面主题更新方法
US18/340,512 US20230336806A1 (en) 2021-01-14 2023-06-23 Display apparatus and processing method

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
CN202110046140.2 2021-01-14
CN202110046140 2021-01-14
CN202110291958.0 2021-03-18
CN202110292449.XA CN114302195B (zh) 2021-01-14 2021-03-18 一种显示设备、外接设备以及播放控制方法
CN202110291958.0A CN114297436A (zh) 2021-01-14 2021-03-18 一种显示设备及用户界面主题更新方法
CN202110292422.0 2021-03-18
CN202110292422.0A CN114339339B (zh) 2021-01-14 2021-03-18 一种显示设备、外接设备及播放模式切换方法
CN202110292449.X 2021-03-18

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/340,512 Continuation US20230336806A1 (en) 2021-01-14 2023-06-23 Display apparatus and processing method

Publications (1)

Publication Number Publication Date
WO2022152203A1 true WO2022152203A1 (zh) 2022-07-21

Family

ID=80868330

Family Applications (3)

Application Number Title Priority Date Filing Date
PCT/CN2022/071778 WO2022152201A1 (zh) 2021-01-14 2022-01-13 显示设备及多设备切换时的播放方法
PCT/CN2022/071780 WO2022152203A1 (zh) 2021-01-14 2022-01-13 显示设备及用户界面主题更新方法
PCT/CN2022/071779 WO2022152202A1 (zh) 2021-01-14 2022-01-13 显示设备、外接设备及播放模式切换方法

Family Applications Before (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/071778 WO2022152201A1 (zh) 2021-01-14 2022-01-13 显示设备及多设备切换时的播放方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/071779 WO2022152202A1 (zh) 2021-01-14 2022-01-13 显示设备、外接设备及播放模式切换方法

Country Status (3)

Country Link
US (1) US20230336806A1 (zh)
CN (14) CN114302194B (zh)
WO (3) WO2022152201A1 (zh)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114816641B (zh) * 2022-05-09 2023-05-02 海信视像科技股份有限公司 显示设备、多媒体内容显示方法和存储介质
CN114968387A (zh) * 2022-06-07 2022-08-30 三星电子（中国）研发中心 外接设备切换方法和装置
CN114915833B (zh) * 2022-06-24 2023-11-10 Vidaa国际控股(荷兰)公司 一种显示器控制方法及显示设备、终端设备
CN115174973B (zh) * 2022-06-28 2024-05-28 海信视像科技股份有限公司 显示设备及显示设备控制方法
WO2024009919A1 (ja) * 2022-07-06 2024-01-11 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置、情報処理装置の制御方法、及びプログラム
CN115408552B (zh) * 2022-07-28 2023-05-26 深圳市磐鼎科技有限公司 显示调整方法、装置、设备及存储介质
CN115334351B (zh) * 2022-08-02 2023-10-31 Vidaa国际控股(荷兰)公司 一种显示设备及自适应画质调节方法
WO2024071730A1 (ko) * 2022-09-28 2024-04-04 삼성전자주식회사 디바이스간 데이터 동기화 방법 및 그 전자 장치
WO2024139366A1 (zh) * 2022-12-28 2024-07-04 海信视像科技股份有限公司 显示设备、终端设备及显示处理方法
CN116366764A (zh) * 2023-03-27 2023-06-30 联想(北京)有限公司 一种控制方法、装置及电子设备
CN117156088B (zh) * 2023-04-21 2024-06-11 荣耀终端有限公司 图像处理方法及相关装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103577175A (zh) * 2012-08-01 2014-02-12 腾讯科技（深圳）有限公司 移动终端软件界面更换的方法及装置
CN104378688A (zh) * 2014-10-27 2015-02-25 小米科技有限责任公司 模式切换方法和装置
CN105302518A (zh) * 2015-12-01 2016-02-03 合肥联宝信息技术有限公司 一种计算机设备及其控制方法
CN105430519A (zh) * 2015-11-20 2016-03-23 小米科技有限责任公司 模式确定方法和装置、多模式设备
CN106851169A (zh) * 2017-03-14 2017-06-13 微鲸科技有限公司 显示模式切换方法、装置及显示设备
US20200092594A1 (en) * 2016-12-28 2020-03-19 Sony Network Communications Inc. Information processing device, information processing method, program, and information processing system

Family Cites Families (106)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7103008B2 (en) * 2001-07-02 2006-09-05 Conexant, Inc. Communications system using rings architecture
JP4153462B2 (ja) * 2004-05-31 2008-09-24 インターナショナル・ビジネス・マシーンズ・コーポレーション 表示方式切替装置、表示方式切替方法、表示方式切替プログラム、及びそのプログラムを記憶したコンピュータ読み取り可能な記憶媒体
CN1716415B (zh) * 2004-06-30 2010-05-26 深圳市朗科科技股份有限公司 数字视频播放装置及其节目回退的方法
EP1675343A1 (en) * 2004-12-23 2006-06-28 Siemens S.p.A. Method and system to minimize the switching delay between two RTP multimedia streaming sessions
JP4557878B2 (ja) * 2005-12-07 2010-10-06 シャープ株式会社 Ｈｄｍｉ出力時の解像度切換え手段
JP2007251543A (ja) * 2006-03-15 2007-09-27 Seiko Epson Corp 表示制御装置、その制御方法、情報再生装置及び電子機器
JP4274198B2 (ja) * 2006-05-19 2009-06-03 ソニー株式会社 映像表示装置および映像表示制御方法
JP2008011367A (ja) * 2006-06-30 2008-01-17 Sharp Corp 映像信号切換装置
CN100470315C (zh) * 2006-07-04 2009-03-18 晨星半导体股份有限公司 自动切换显示模式的液晶显示器以及其方法
US8698812B2 (en) * 2006-08-04 2014-04-15 Ati Technologies Ulc Video display mode control
US20080051642A1 (en) * 2006-08-24 2008-02-28 Hagai Krupnik Device, system and method of displaying in -vivo images at variable rate
US20080055318A1 (en) * 2006-08-31 2008-03-06 Glen David I J Dynamic frame rate adjustment
JP5228305B2 (ja) * 2006-09-08 2013-07-03 ソニー株式会社 表示装置、表示方法
US20150052253A1 (en) * 2014-09-22 2015-02-19 Weaved, Inc. Multi-server fractional subdomain dns protocol
CN101627625A (zh) * 2007-03-13 2010-01-13 索尼株式会社 通信系统、发送装置、发送方法、接收装置以及接收方法
US9137497B2 (en) * 2007-04-11 2015-09-15 At&T Intellectual Property I, Lp Method and system for video stream personalization
CN101247491A (zh) * 2008-03-07 2008-08-20 深圳创维－Rgb电子有限公司 通讯协议转换装置、电视机软件的在线升级系统及其方法
JP5338166B2 (ja) * 2008-07-16 2013-11-13 ソニー株式会社 送信装置、立体画像データ送信方法、受信装置および立体画像データ受信方法
CN101568028B (zh) * 2009-05-15 2011-11-30 中兴通讯股份有限公司 一种移动终端及移动终端间协同播放移动广播电视的方法
US20110302318A1 (en) * 2010-06-04 2011-12-08 Ari Birger Anonymous re-streaming of media item of content
JP5587089B2 (ja) * 2010-07-29 2014-09-10 キヤノン株式会社 通信装置及び制御方法
KR101852812B1 (ko) * 2010-08-23 2018-04-27 엘지전자 주식회사 게임 애플리케이션 제공 방법 및 그 방법을 채용한 영상표시기기
CN102447856A (zh) * 2010-10-13 2012-05-09 瑞昱半导体股份有限公司 频道切换提醒系统、信号源切换提醒系统及相关方法
CN103503430B (zh) * 2011-04-15 2017-05-24 海尔集团公司 播放控制系统和方法
US20150142991A1 (en) * 2011-04-21 2015-05-21 Efficiency3 Corp. Electronic hub appliances used for collecting, storing, and processing potentially massive periodic data streams indicative of real-time or other measuring parameters
CN102223581B (zh) * 2011-06-28 2013-06-12 宇龙计算机通信科技(深圳)有限公司 搜索视频节目的方法及视频播放终端
CN102510541B (zh) * 2011-12-30 2014-12-17 Tcl数码科技（深圳）有限责任公司 多屏互动的音视频内容切换方法及媒体播放器
WO2013129158A1 (ja) * 2012-03-01 2013-09-06 ソニー株式会社 送信装置、送信方法および受信装置
CN102663448B (zh) * 2012-03-07 2016-08-10 北京理工大学 一种基于网络的增强现实物体识别分析方法
WO2014004914A1 (en) * 2012-06-28 2014-01-03 Google Inc. Generating a sequence of audio fingerprints at a set top box
US8990446B2 (en) * 2012-10-04 2015-03-24 Sony Computer Entertainment America, LLC Method and apparatus for decreasing presentation latency
KR101533064B1 (ko) * 2012-11-01 2015-07-01 주식회사 케이티 콘텐츠 맞춤형 인터페이스를 표시하는 모바일 디바이스 및 모바일 디바이스 사용 방법
JP5306550B2 (ja) * 2013-01-25 2013-10-02 株式会社東芝 映像解析情報送信装置、映像解析情報配信システム及び配信方法、映像視聴システム及び映像視聴方法
JPWO2014141425A1 (ja) * 2013-03-14 2017-02-16 株式会社東芝 映像表示システム、ソース機器、シンク機器及び映像表示方法
CN103297852A (zh) * 2013-06-07 2013-09-11 华为终端有限公司 一种提高换台速度的方法、装置及系统
CN103442294A (zh) * 2013-08-15 2013-12-11 安徽科大讯飞信息科技股份有限公司 基于视频终端及服务器端的实时节目监测方法及系统
CN105025382B (zh) * 2014-04-23 2018-09-04 深圳Tcl新技术有限公司 游戏模式自动开关的方法和装置
KR102262086B1 (ko) * 2014-05-28 2021-06-09 삼성전자 주식회사 이미지 처리 방법 및 장치
CN106464968A (zh) * 2014-06-12 2017-02-22 Lg电子株式会社 用于发送和接收数据的设备和方法
US9812056B2 (en) * 2014-06-24 2017-11-07 Google Inc. Display resolution negotiation
CN104333800B (zh) * 2014-07-21 2018-02-06 北京京东方视讯科技有限公司 一种显示系统、显示系统的蓝牙音频播放方法及装置
CN104363496A (zh) * 2014-10-28 2015-02-18 深圳市嘉乐派科技有限公司 网络机顶盒中声音系统多场景应用的实现方法
WO2016080233A1 (ja) * 2014-11-17 2016-05-26 ソニー株式会社 送信装置、ハイダイナミックレンジ画像データ送信方法、受信装置、ハイダイナミックレンジ画像データ受信方法およびプログラム
CN105007395B (zh) * 2015-07-22 2018-02-16 深圳市万姓宗祠网络科技股份有限公司 一种连续记录视频、影像的隐私处理方法
KR20170044868A (ko) * 2015-10-16 2017-04-26 삼성전자주식회사 디스플레이 장치 및 그 제어 방법
CN105892963A (zh) * 2015-11-26 2016-08-24 乐视致新电子科技（天津）有限公司 用于生成扩展显示标识数据edid的方法和显示设备
CN105323386A (zh) * 2015-12-03 2016-02-10 上海卓易科技股份有限公司 自动切换手机情景模式的方法及系统
CN105578105B (zh) * 2015-12-22 2019-03-12 深圳Tcl数字技术有限公司 Hdmi版本切换方法及显示设备
US11115700B2 (en) * 2016-02-12 2021-09-07 Nagravision S.A. Method and device for identifying a peripheral device from a digital content
CN108702466A (zh) * 2016-03-02 2018-10-23 美国莱迪思半导体公司 多媒体接口中的链路训练
US9892020B1 (en) * 2016-03-11 2018-02-13 Signalfx, Inc. User interface for specifying data stream processing language programs for analyzing instrumented software
CN105828012A (zh) * 2016-03-31 2016-08-03 乐视控股（北京）有限公司 Hdmi接口自动配置方法及相关装置
CN105847728A (zh) * 2016-04-13 2016-08-10 腾讯科技（深圳）有限公司 一种信息处理方法及终端
CN105979370B (zh) * 2016-07-01 2019-03-12 深圳创维－Rgb电子有限公司 一种配置图像模式的方法及装置
CN106101836B (zh) * 2016-07-07 2019-04-16 深圳创维－Rgb电子有限公司 智能电视的播放方法及装置
CN106250837B (zh) * 2016-07-27 2019-06-18 腾讯科技（深圳）有限公司 一种视频的识别方法、装置和系统
KR102575230B1 (ko) * 2016-07-29 2023-09-06 엘지전자 주식회사 원격제어장치 및 그 동작방법
CN106100904B (zh) * 2016-08-09 2019-06-18 深圳中兴网信科技有限公司 设备连接方法和设备连接系统
US10929752B2 (en) * 2016-09-21 2021-02-23 GumGum, Inc. Automated control of display devices
CN107959889A (zh) * 2016-10-17 2018-04-24 中兴通讯股份有限公司 数据流播放方法和装置，数据流类型配置方法和装置
WO2018076376A1 (zh) * 2016-10-31 2018-05-03 华为技术有限公司 一种语音数据传输方法、用户设备以及存储介质
CN106686332B (zh) * 2016-11-17 2020-07-14 西安诺瓦星云科技股份有限公司 视频显示控制方法以及edid管理方法
CN106604121A (zh) * 2016-12-26 2017-04-26 深圳Tcl数字技术有限公司 Hdmi接口兼容方法及显示装置
CN108696732B (zh) * 2017-02-17 2023-04-18 北京三星通信技术研究有限公司 头戴显示设备的分辨率调整方法及设备
EP3637225B1 (en) * 2017-06-05 2022-06-08 Huawei Technologies Co., Ltd. Display processing method and apparatus
CN107197370A (zh) * 2017-06-22 2017-09-22 北京密境和风科技有限公司 一种直播视频的场景检测方法和装置
CN110462581B (zh) * 2017-07-07 2023-12-01 惠普发展公司，有限责任合伙企业 扩展显示识别数据标准的选择
CN109495761A (zh) * 2017-09-13 2019-03-19 杭州海康威视系统技术有限公司 视频切换方法及装置
US10448109B1 (en) * 2017-09-26 2019-10-15 Amazon Technologies, Inc. Supplemental content determinations for varied media playback
CN108055584A (zh) * 2017-10-12 2018-05-18 Tcl海外电子（惠州）有限公司 电视机的信号自适应显示方法、电视机及存储介质
WO2019093734A1 (ko) * 2017-11-08 2019-05-16 엘지전자 주식회사 미디어 데이터를 송수신하는 방법 및 그 장치
CN108063978B (zh) * 2017-12-04 2020-10-20 康佳集团股份有限公司 一种电视性能参数自适应的方法、电视及存储介质
CN109977731B (zh) * 2017-12-27 2021-10-29 深圳市优必选科技有限公司 一种场景的识别方法、识别设备及终端设备
KR102549888B1 (ko) * 2018-02-08 2023-07-03 삼성디스플레이 주식회사 일반 모드 및 가변 프레임 모드를 지원하는 표시 장치의 구동 방법, 및 표시 장치
CN108322817A (zh) * 2018-02-12 2018-07-24 深圳创维－Rgb电子有限公司 一种音效模式切换方法、装置及电子设备
AU2019222503B2 (en) * 2018-02-15 2023-08-17 Vitec, Inc. Distribution and playback of media content
CN108762707A (zh) * 2018-05-29 2018-11-06 西安万像电子科技有限公司 多媒体信息采集的自适应方法、装置和系统
CN108924573B (zh) * 2018-06-21 2021-08-31 深圳市网心科技有限公司 数据流处理、播放方法、服务器、播放装置、系统及介质
CN108924592A (zh) * 2018-08-06 2018-11-30 青岛海信传媒网络技术有限公司 一种视频处理的方法及设备
CN109068169A (zh) * 2018-08-06 2018-12-21 青岛海信传媒网络技术有限公司 一种视频播放方法及装置
US10826243B2 (en) * 2018-08-28 2020-11-03 Sure-Fire Electrical Corporation Electric connector terminal configuration structure
CN109168062B (zh) * 2018-08-28 2020-11-24 北京达佳互联信息技术有限公司 视频播放的展示方法、装置、终端设备及存储介质
CN109040739A (zh) * 2018-09-14 2018-12-18 杭州行开科技有限公司 一种2d/3d自动切换的裸眼3d播放系统及播放方法
WO2020056734A1 (en) * 2018-09-21 2020-03-26 Volkswagen (China) Investment Co., Ltd. Vehicle-mounted entertainment device, as well as switching method and switching system thereof
CN109450851B (zh) * 2018-09-30 2020-09-22 Oppo广东移动通信有限公司 设备连接方法、电子设备及计算机可读介质
CN109300431B (zh) * 2018-10-22 2020-06-19 五邑大学 一种基于无线传输的全彩动态led显示屏
KR102695688B1 (ko) * 2018-12-06 2024-08-19 삼성전자주식회사 디스플레이 장치 및 그 제어 방법
CN111462711A (zh) * 2019-01-18 2020-07-28 中强光电股份有限公司 用于优化显示模式的显示装置及方法
CN109901901A (zh) * 2019-01-29 2019-06-18 上海华章信息科技有限公司 可变帧率开机动画实现方法
CN109754762B (zh) * 2019-03-21 2020-11-13 明基智能科技（上海）有限公司 影像显示方法及影像显示系统
CN109999494A (zh) * 2019-04-24 2019-07-12 努比亚技术有限公司 游戏操控方法、装置及计算机可读存储介质
KR102599365B1 (ko) * 2019-05-17 2023-11-08 삼성전자주식회사 전자장치 및 그 제어방법
CN110087006B (zh) * 2019-05-17 2022-04-15 京东方科技集团股份有限公司 显示控制系统、方法及装置
US11342323B2 (en) * 2019-05-30 2022-05-24 Analog Devices, Inc. High voltage tolerant circuit architecture for applications subject to electrical overstress fault conditions
BR112021024551A2 (pt) * 2019-06-28 2022-01-18 Dolby Laboratories Licensing Corp Metadados de tipo de conteúdo de vídeo para alta faixa dinâmica
CN110457694B (zh) * 2019-07-29 2023-09-22 腾讯科技（上海）有限公司 消息提醒方法及装置、场景类型识别提醒方法及装置
CN112533021B (zh) * 2019-09-19 2023-04-11 Vidaa(荷兰)国际控股有限公司 一种显示方法及显示设备
CN110933490B (zh) * 2019-11-20 2021-07-27 深圳创维－Rgb电子有限公司 一种画质和音质的自动调整方法、智能电视机及存储介质
CN111064972A (zh) * 2019-11-28 2020-04-24 湖北工业大学 一种基于ipv9的视频直播控制方法
CN111131889B (zh) * 2019-12-31 2022-11-25 深圳创维－Rgb电子有限公司 场景自适应调整图像及声音的方法、系统及可读存储介质
CN111405338B (zh) * 2020-02-27 2022-09-09 海信视像科技股份有限公司 一种智能画质的切换方法及显示设备
CN111526415B (zh) * 2020-04-15 2022-08-19 海信视像科技股份有限公司 一种双屏显示设备及其hdmi的切换方法
CN111586409B (zh) * 2020-05-14 2022-06-10 Oppo广东移动通信有限公司 插值帧的生成方法、装置、电子设备和存储介质
CN111918132B (zh) * 2020-07-27 2022-09-23 海信视像科技股份有限公司 一种显示设备及多接口设备判断方法
CN112040305A (zh) * 2020-08-31 2020-12-04 深圳创维－Rgb电子有限公司 Vrr智能切换方法、装置、智能电视和可读存储介质
CN112203154A (zh) * 2020-10-10 2021-01-08 Vidaa美国公司 一种显示设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103577175A (zh) * 2012-08-01 2014-02-12 腾讯科技（深圳）有限公司 移动终端软件界面更换的方法及装置
CN104378688A (zh) * 2014-10-27 2015-02-25 小米科技有限责任公司 模式切换方法和装置
CN105430519A (zh) * 2015-11-20 2016-03-23 小米科技有限责任公司 模式确定方法和装置、多模式设备
CN105302518A (zh) * 2015-12-01 2016-02-03 合肥联宝信息技术有限公司 一种计算机设备及其控制方法
US20200092594A1 (en) * 2016-12-28 2020-03-19 Sony Network Communications Inc. Information processing device, information processing method, program, and information processing system
CN106851169A (zh) * 2017-03-14 2017-06-13 微鲸科技有限公司 显示模式切换方法、装置及显示设备

Also Published As

Publication number Publication date
CN114297436A (zh) 2022-04-08
CN114286143A (zh) 2022-04-05
CN117397245A (zh) 2024-01-12
CN114302196A (zh) 2022-04-08
CN114286173A (zh) 2022-04-05
CN114302194B (zh) 2023-05-05
WO2022152202A1 (zh) 2022-07-21
CN114302196B (zh) 2023-05-05
CN114302193B (zh) 2022-09-30
CN114302193A (zh) 2022-04-08
CN114286138A (zh) 2022-04-05
CN114302219B (zh) 2023-03-24
CN114302220A (zh) 2022-04-08
CN114302195A (zh) 2022-04-08
CN114302132A (zh) 2022-04-08
CN114302219A (zh) 2022-04-08
CN114302190B (zh) 2023-07-14
CN114302190A (zh) 2022-04-08
CN114339339B (zh) 2024-02-23
CN114286138B (zh) 2023-08-18
CN114339339A (zh) 2022-04-12
CN114286143B (zh) 2023-02-21
CN114302195B (zh) 2023-04-14
CN114286173B (zh) 2023-07-18
US20230336806A1 (en) 2023-10-19
CN114302194A (zh) 2022-04-08
WO2022152201A1 (zh) 2022-07-21
CN114302220B (zh) 2023-04-14

Similar Documents

Publication Publication Date Title
WO2022152203A1 (zh) 显示设备及用户界面主题更新方法
CN114283753B (zh) 一种显示设备及屏幕背光亮度的控制方法
CN112422365A (zh) 显示设备及自动监测网络状态的方法
WO2022152320A1 (zh) 显示设备、音画参数调节方法
US20240205498A1 (en) Display device and display method
CN115641824A (zh) 画面调整设备、显示设备及画面调整方法
CN114615536B (zh) 显示设备及音效处理方法
CN114615529A (zh) 显示设备、外接设备及音频播放方法
CN112367550A (zh) 一种媒资列表多标题动态展示的实现方法及显示设备
US20240338166A1 (en) Display device, external device, and audio playing and sound effect processing method
WO2024169421A1 (zh) 显示设备和显示处理方法
WO2023185954A9 (zh) 一种显示设备及用于显示设备的处理方法
CN116803089A (zh) 显示设备、音画参数调节方法
CN116301525A (zh) 显示设备和图像模式设置方法
CN117834983A (zh) 一种播放缓冲确定方法和显示设备
CN117014667A (zh) 一种信号源显示方法及显示设备
CN115914766A (zh) 一种显示设备及在游戏画面上显示菜单的方法
CN117289839A (zh) 一种音画设置方法及显示设备
CN117615187A (zh) 一种信号源显示方法及显示设备
CN113965791A (zh) 悬浮窗口的返回方法和显示设备
CN115955588A (zh) 一种显示设备及音画同步方法
CN117896570A (zh) 显示设备和视频播放方法
CN115119035A (zh) 显示设备、图像处理方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22739079

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202280010311.9

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22739079

Country of ref document: EP

Kind code of ref document: A1