WO2022152201A1 - 显示设备及多设备切换时的播放方法 - Google Patents

显示设备及多设备切换时的播放方法 Download PDF

Info

Publication number
WO2022152201A1
WO2022152201A1 PCT/CN2022/071778 CN2022071778W WO2022152201A1 WO 2022152201 A1 WO2022152201 A1 WO 2022152201A1 CN 2022071778 W CN2022071778 W CN 2022071778W WO 2022152201 A1 WO2022152201 A1 WO 2022152201A1
Authority
WO
WIPO (PCT)
Prior art keywords
display device
mode
protocol
frame
switching
Prior art date
Application number
PCT/CN2022/071778
Other languages
English (en)
French (fr)
Inventor
何营昊
于新磊
田德利
卢平光
张瑞吉
解廷福
王昊
刘芳
吴燕丽
Original Assignee
海信视像科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 海信视像科技股份有限公司 filed Critical 海信视像科技股份有限公司
Publication of WO2022152201A1 publication Critical patent/WO2022152201A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/74—Browsing; Visualisation therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43632—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wired protocol, e.g. IEEE 1394
    • H04N21/43635—HDMI
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44227—Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data
    • H04N21/4518—Management of client data or end-user data involving characteristics of one or more peripherals, e.g. peripheral type, software version, amount of memory available or display capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Definitions

  • the present application relates to display device technology, and in particular, to a display device and a playback method when multiple devices are switched.
  • the smart TV can be connected to a game device through an HDMI interface, and the game device can output video data and audio data by running a game-related program during the user's use of the game device.
  • Video data and audio data can be sent to the smart TV through the HDMI protocol, and output through the screen and speakers of the smart TV to play the video and audio of the game device.
  • the user can switch the audio and video data input to the smart TV by switching the signal source.
  • Some embodiments of the present application provide a display device and a playback method when multiple devices are switched, wherein a display device includes a display, a controller, and multiple external device interfaces.
  • the multiple external device interfaces are respectively configured to connect to external devices, and the display is used for displaying a user interface and displaying a screen of media asset data sent by the external device.
  • the controller is configured to execute the following program steps: acquiring a control instruction input by a user for switching signal sources; in response to the control instruction, receiving a data stream sent by an external device connected after switching the signal source, the data stream includes at least one of a protocol frame and a device information frame; extracting the flag bit state value in the protocol frame and/or the device information frame; switching the play mode according to the flag bit state value.
  • Some embodiments of the present application also provide a playback method during multi-device switching, and the playback method during multi-device switching includes the following steps: acquiring a control instruction input by a user for switching signal sources; and responding to the control instruction, Receive the data stream sent by the connected external device after switching the signal source, the data stream includes at least one of a protocol frame and a device information frame; extract the flag bit status in the protocol frame and/or the device information frame value; switch the play mode according to the state value of the flag bit.
  • Some embodiments of the present application provide a display device including a display and a controller.
  • the display is used for displaying the user interface and displaying the data flow picture.
  • the controller is configured to perform the following program steps: receiving a control instruction for playing a data stream input by a user; acquiring a data stream to be played in response to the control instruction; detecting a play mode flag to obtain that the play mode flag is in A target play mode in an activated state, the target play mode includes image parameters for image quality processing; image quality processing is performed on the data stream according to the target play mode.
  • Some embodiments of the present application provide a display apparatus including a display, an external device interface, and a controller.
  • the external device interface is used to connect the external device
  • the display is used to display the user interface and the data stream screen sent by the external device.
  • the controller is configured to execute the following program steps: acquiring a data stream sent by the external device, the data stream including a device information frame for describing the type of the external device; extracting the data of the external device from the device information frame Device type; switch the play mode to a mode suitable for the device type, so as to output the data stream according to the switched play mode.
  • FIG. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to one or more embodiments of the present application;
  • FIG. 2 is a block diagram of a hardware configuration of a display device 200 according to one or more embodiments of the present application;
  • FIG. 3 is a block diagram of the hardware configuration of the control device 100 according to one or more embodiments of the present application;
  • FIG. 4 is a schematic diagram of software configuration in a display device 200 according to one or more embodiments of the present application.
  • FIG. 5 is a schematic diagram of a connection state between a display device and an external device according to one or more embodiments of the present application
  • FIG. 6 is a schematic flowchart of a display device adjusting a playback mode according to one or more embodiments of the present application
  • FIG. 7 is a schematic diagram of switching a playback mode according to an ALLM state parameter according to one or more embodiments of the present application.
  • 8-9 are schematic diagrams of switching playback modes according to usage scene information according to one or more embodiments of the present application.
  • FIG. 10 is a schematic diagram of image quality processing in adjusting playback mode according to one or more embodiments of the present application.
  • 11 is a schematic diagram of switching playback modes according to device types according to one or more embodiments of the present application.
  • FIG. 12 is a schematic diagram of acquiring a device type according to a type comparison table according to one or more embodiments of the present application.
  • FIG. 13 is a schematic diagram of detecting a usage scenario according to a recognition model according to one or more embodiments of the present application.
  • FIG. 14 is a schematic flowchart of determining a maintaining playback mode according to one or more embodiments of the present application.
  • 15 is a schematic flowchart of maintaining a device information table according to one or more embodiments of the present application.
  • 16 is a schematic diagram of a playback control flow of an external device according to one or more embodiments of the present application.
  • 17 is a schematic flowchart of an image quality adjustment method according to one or more embodiments of the present application.
  • FIG. 18 is a schematic flowchart of setting a playback mode flag according to one or more embodiments of the present application.
  • 19 is a schematic flowchart of identifying a usage scenario according to a protocol frame according to one or more embodiments of the present application.
  • 20 is a schematic flowchart of identifying a usage scenario according to a displayed image according to one or more embodiments of the present application;
  • 21 is a schematic flowchart of comparing a current play mode and a target play mode according to one or more embodiments of the present application;
  • 22 is a flowchart of exiting the target play mode according to one or more embodiments of the present application.
  • FIG. 23 is a schematic diagram illustrating a connection state between a display device and multiple external devices according to one or more embodiments of the present application.
  • 24 is a schematic diagram of a connection state of a display device according to one or more embodiments of the present application.
  • 25 is a schematic flowchart of a playback method when multiple devices are switched according to one or more embodiments of the present application.
  • 26 is a schematic diagram of extracting a flag bit state value according to one or more embodiments of the present application.
  • FIG. 27 is a schematic flowchart of a display device switching playback modes according to one or more embodiments of the present application.
  • Figure 28 is a data relationship diagram when the ALLM protocol device and the common HDMI device are switched according to one or more embodiments of the present application;
  • Figure 29 is a schematic flow diagram when the ALLM protocol equipment and common HDMI equipment are switched according to one or more embodiments of the present application;
  • FIG. 30 is a data relationship diagram when switching between an SPD protocol device and a common HDMI device according to one or more embodiments of the present application;
  • FIG. 31 is a schematic flowchart of switching between an SPD protocol device and a common HDMI device according to one or more embodiments of the present application;
  • Figure 32 is a data relationship diagram when the ALLM protocol device and the SPD protocol device are switched according to one or more embodiments of the present application;
  • FIG. 33 is a schematic flowchart of switching between an ALLM protocol device and an SPD protocol device according to one or more embodiments of the present application.
  • a user can operate the display apparatus 200 through the mobile terminal 300 and the control apparatus 100 .
  • the control apparatus 100 may be a remote control, and the communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and wireless or other wired ways to control the display device 200 .
  • the user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, and the like.
  • mobile terminals, tablet computers, computers, notebook computers, and other smart devices may also be used to control the display device 200 .
  • the mobile terminal 300 may install a software application with the display device 200 to implement connection communication through a network communication protocol, so as to achieve the purpose of one-to-one control operation and data communication.
  • the audio and video content displayed on the mobile terminal 300 may also be transmitted to the display device 200 to realize a synchronous display function.
  • the display device 200 also performs data communication with the server 400 through various communication methods.
  • the display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks.
  • the server 400 may provide various contents and interactions to the display device 200 .
  • the display device 200 may be a liquid crystal display, an OLED display, or a projection display device.
  • the display device 200 may additionally provide an intelligent network television function that provides a computer-supported function in addition to the function of broadcasting and receiving television.
  • the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory, and a power supply.
  • the control device 100 can receive the user's input operation instruction, and convert the operation instruction into an instruction that the display device 200 can recognize and respond to, and play an intermediary role between the user and the display device 200 .
  • the communication interface 130 is used for external communication, and includes at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module.
  • the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, a key or an alternative module.
  • the display device 200 includes a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user input interface 280. at least one of.
  • the controller includes a central processing unit, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and the first to nth interfaces for input/output.
  • the display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen.
  • the tuner-demodulator 210 receives broadcast television signals through wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.
  • the detector 230 is used to collect external environment or external interaction signals.
  • the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
  • the controller 250 controls the operation of the display device and responds to user operations.
  • the controller 250 controls the overall operation of the display apparatus 200 .
  • a user may input a user command on a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.
  • a "user interface” is a medium interface for interaction and information exchange between an application program or an operating system and a user, which enables conversion between an internal form of information and a form acceptable to the user.
  • the commonly used form of user interface is Graphical User Interface (GUI), which refers to a user interface related to computer operations displayed in a graphical manner. It can be an icon, window, control and other interface elements displayed on the display screen of the electronic device, wherein the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, etc. at least one of the visual interface elements.
  • GUI Graphical User Interface
  • the system is divided into four layers, from top to bottom are the applications layer (referred to as “application layer”), the application framework (Application Framework) layer (referred to as “framework layer”), Android Runtime (Android runtime) and system library layer (referred to as “system runtime layer”), and the kernel layer.
  • the kernel layer contains at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive etc.
  • connecting the display device 200 to the external device 500 refers to establishing a communication connection, and the display device 200 and the external device 500 that establish the communication connection are used as a receiving end (sink end) and a transmitting end (source end), respectively.
  • the external device 500 may be a game device.
  • the user uses the game device, it can output video data and audio data in real time for the game process, and send the video data and audio data to the display device 200 so as to display the video data through the display device 200. Data and audio data are output as video picture and sound.
  • the game device acts as a transmitting end
  • the display device 200 acts as a receiving end.
  • both the sending end and the receiving end should have a data interface with the same interface specification and function.
  • both the display device 200 and the external device 500 are provided with a high definition multimedia interface (High Definition Multimedia Interface, HDMI).
  • HDMI High Definition Multimedia Interface
  • the user can insert the two ends of the HDMI interface data cable into the display device 200 and the external device 500 respectively, and after starting the external device 500 and the display device 200, set the signal source of the display device 200 to the HDMI interface , so as to realize data transmission between the display device 200 and the external device 500 .
  • connection modes may also be used between the display device 200 and the external device 500 .
  • the specific connection method can be a wired connection method, such as DVI (Digital Visual Interface), VGA (Video Graphics Array), USB (Universal Serial Bus), etc.; it can also be a wireless connection method, such as wireless local area network, Bluetooth connection, infrared connection etc.
  • Different communication connection methods can adopt different information transmission protocols. For example, when using HDMI interface to realize connection, HDMI protocol can be used for data transmission.
  • the external device 500 can output video data and/or audio data in real time according to usage conditions.
  • the output video signals and audio signals need to be adapted to the corresponding scenarios, so as to obtain better picture quality effects and sound quality effects.
  • the display device 200 may have multiple built-in playback modes, and under different playback modes, different image and sound quality effects may be obtained.
  • the play modes supported by the display device 200 for switching may include a low-latency mode (LLM) and a high image quality mode (HIQM).
  • LLM low-latency mode
  • HIQM high image quality mode
  • the display device 200 can be controlled to switch to a low-latency mode.
  • the display device 200 can disable some image quality processing programs, such as closing frame insertion algorithm, noise reduction processing, super-division algorithm, etc., to reduce image processing time and reduce image display delay.
  • the display device 200 can be controlled. Switch to high-quality mode to enable all image-quality processing programs such as frame insertion algorithm, noise reduction processing, and super-resolution algorithm to obtain better picture effects.
  • the external device 500 does not have a subordinate relationship with the display device 200 , the external device 500 usually cannot directly control the display device 200 , so in practical applications, the user needs to manually switch the playback mode of the display device 200 .
  • the manual switching process not only requires the user to perform an interactive action, but also some users do not know the play mode applicable to the external device 500 , resulting in the problem of wrong play mode switching.
  • they may be in various usage scenarios according to different usage requirements during use. Such as game scenes, film and television scenes, instant messaging scenes, etc., these scenes can show better effects in a specific playback mode.
  • the play mode of the display device 200 needs to be manually switched, when the user changes the usage scene on the external device 500, the user needs to change the play mode of the display device 200 again, which brings inconvenience to the user.
  • the display device 200 and the external device 500 usually belong to different types of devices, the user usually cannot directly control the display device 200 through the external device 500 .
  • the game device is responsible for running the game application and forms video data and audio data according to user interaction, while the smart TV can only passively obtain the audio data output by the game device
  • the game device cannot directly adjust the playback mode of the smart TV, resulting in the playback mode being inconsistent with the usage scene and affecting the video and audio effects.
  • the external device 500 may support an automatic low-latency mode (Auto Low-latency Mode, ALLM).
  • the automatic low-latency mode can be automatically enabled or disabled by the source according to preset rules without the need for manual settings by the sink user. For example, when a user receives a video call while watching a movie, the external device 500 serving as the source end will automatically stop the movie playback and notify the sink end display device 200 to switch to the low-latency mode to ensure the real-time interactive performance of the video call. After the user answers the video call, the source-side external device 500 can resume the movie playing process, and notify the sink-side display device 200 to exit the low-latency mode.
  • ALLM Automatic Low-latency Mode
  • the Xbox series game consoles support the ALLM protocol, while some other types of game consoles do not support the ALLM protocol, so that it is impossible to automatically send a control command for switching the play mode to the display device 200 when the game console enters the state of running the game. .
  • the display device 200 can detect whether the external device 500 supports automatic control protocols such as the ALLM protocol by detecting the data stream sent by the external device 500 , and detect whether the external device 500 supports automatic control protocols such as the ALLM protocol.
  • the control protocol supported by the device 500 switches the play mode.
  • the display device 200 may include a display 260, an external device interface 240 and a controller 250, and the external device 500 may include a data interface and a processor.
  • the external device 500 is connected to the display device 200 .
  • the external device 500 may send a data stream to the display device 200 .
  • the data stream includes video data and audio data to be played.
  • the transmitted video data and audio data are collectively referred to as media asset data.
  • the media asset data may be video data or audio data, or may be a set of video data and audio data.
  • the sent media asset data forms a data stream, in addition to video data and audio data, the formed data stream may also include auxiliary information such as control instructions, device information, etc., for realizing the connection between the display device 200 and the external device 500 linkage control.
  • the external device 500 can edit the auxiliary information into auxiliary information frames and send them to the display device 200 together with the data stream through the supported interface protocol.
  • the auxiliary information frame may be presented in different forms according to different protocols supported by the external device 500 .
  • auxiliary information such as control instructions can be edited into the protocol frame;
  • the auxiliary information such as device information can be edited to the basic The device information frame (Source Product Description, SPD) of the transmission protocol (such as the HDMI protocol).
  • the Xbox series game console is an external device 500 that supports automatic control protocols such as ALLM, so the external device 500 can be directly controlled by the automatic control protocol
  • the display device 200 switches the play mode, that is, the display device 200 can extract the usage scene information from the data stream, and implement the play mode switch according to the usage scene information.
  • the game console can add usage scene information to the data stream, that is, when the game program is running, the usage scene information is added to the data stream as the game scene, and when the game program is exited, the usage scene information is added to the data stream as non-game scenarios.
  • the display device 200 may switch to a low-latency mode when detecting that the usage scene information is a game scene; and switch to a high image quality mode when detecting that the usage scene information is a non-game scene.
  • the external device 500 can send device parameter frame data (or protocol frame data) to the display device 200 according to the control policy in the application.
  • the display device 200 may read the status parameter at a specific position in the protocol frame data, so as to determine the control mode according to the status parameter.
  • the ALLM protocol frame can be extracted from the data stream.
  • auxiliary information such as control instructions can be represented by a plurality of bytes at specific positions in the data frame.
  • the protocol frame is formulated and generated according to the agreed ALLM control protocol, and can be used to describe the device information of the external device 500 and other information related to the data transmission process.
  • the display device 200 can read the automatic low-latency mode ALLM state value; if the ALLM state value is equal to 1, it means that the current external device 500 is in the game scene, so the display device 200 can be controlled to switch the playback mode to the low-latency mode; if the ALLM state value is equal to 0, it means that the external device 500 is currently in a non-game scene, so the display device 200 can be controlled to switch the playback mode to the high image quality mode.
  • some bytes are reserved in the protocol frame, and these bytes can be assigned a specific value, that is, a status value, by the source device. Therefore, in this embodiment, a specific state value can be configured in each byte bit for transmitting usage scene information to the display device 200 .
  • a specific state value can be configured in each byte bit for transmitting usage scene information to the display device 200 .
  • a protocol frame can also be added to the data stream, and the display device 200 can extract the protocol frame and traverse the The combination of the state values on the multiple byte bits is used to determine the usage scene information where the external device 500 is located, and finally the playback parameters are adjusted according to the usage scene information according to the set playback parameter adjustment mode.
  • the display device 200 obtains that the external device 500 is in the game During the scene, you can turn off the unnecessary and time-consuming image quality processing program to reduce the display delay in the game scene.
  • the display device 200 can continuously monitor the protocol frames in the data stream, so that the play mode can follow the usage scene of the external device 500 to switch the play mode in real time.
  • the sink-side display device 200 may periodically detect the data stream, and parse the ALLM flag in the protocol frame in real time, so as to determine whether the current needs to be switched to the low-latency mode (LLM) through the ALLM flag.
  • LLM low-latency mode
  • the display device 200 needs to maintain this mode until the external device 500 on the source side notifies the display device 200 on the sink side to exit the LLM.
  • the Sink side display device 200 needs to restore the image mode before entering the LLM.
  • the display device 200 on the sink side needs to temporarily limit the video signal and audio signal, and does not directly play the signal transmitted by the external device 500 on the source side, so that the controller 250 can During this period, it is judged whether it is necessary to perform handover.
  • the sink-side display device 200 can display a blocking screen, such as a black screen, a blurry screen, or OSD blocking, etc., during the switching period, but the display time satisfies the premise of switching running time. Below, as short as possible, such as the display time does not exceed 1s. At the same time, the sound shall not appear any irrelevant prompts, including percussion, click or system prompts.
  • the usage scenarios corresponding to different external devices 500 are different.
  • Some external devices 500 can support various usage scenarios, for example, computer devices, smart terminals, etc., which can be in game scenarios, instant messaging scenarios, etc. in use, these external devices 500 can be in different usage scenarios in use, so called for multimode devices.
  • Some external devices 500 only support a single usage scenario, such as game consoles, set-top boxes, multimedia players, etc. These external devices 500 generally do not switch or rarely switch usage scenarios during use, so they are called single-mode devices.
  • the display device 200 can extract the device type of the external device 500 from the data stream.
  • the device type detection method can be obtained by reading the content in the device information frame carried in the data stream.
  • the device type of the external device 500 can be determined by reading data such as device name, device mac address, and device interface information.
  • the device type is a single-mode device
  • the playback mode can be controlled to be switched to a high image quality mode corresponding to the multimedia player.
  • an extended protocol can be configured, so that the external device 500 connected to the display device 200 can use the protocol
  • the use scene information is sent in the frame data, so that the current use scene information is sent to the display device 200, so that the display device 200 switches the play mode according to the extended protocol.
  • the extended protocol is used to transmit usage scene information of the external device 500 .
  • an extended protocol can be configured so that the computer device can carry usage scene information in the sent data stream.
  • the extension protocol can additionally define some data fields according to the data transmission characteristics of the automatic control protocol.
  • the usage scene information of the external device 500 can be represented by a plurality of bits reserved in the HDMI specification.
  • the display device 200 may periodically acquire the protocol frame data, and traverse the parameter values on multiple bits in the protocol frame data. Therefore, according to the combination of parameter values on multiple bits, the current usage scene information is read, and finally the playback mode is set to a mode suitable for the current usage scene information.
  • the display device 200 can extract the protocol frame data from the data stream every 1s, and read the parameter values from the two bits specified by the extended protocol.
  • various usage scenarios can also be represented by the reserved flag bits of the protocol frame.
  • the running games are distinguished by the combination of the state values of the flag bits Rsvd1 and Rsvd0, so as to facilitate the control and modification of the playing parameters.
  • Those skilled in the art think of solutions based on the above-mentioned reserved flag bits for different usage scenarios, such as increasing or decreasing the number of flag bits, and giving more representations in the form of state values, all within the protection scope of the present application.
  • the modes adapted to the current usage scene information include a full low-latency mode and a non-full low-latency mode. If the mode adapted to the current usage scenario information is the full low-latency mode, disable the mode. All image quality processing items, super-resolution algorithms, and noise reduction algorithms for data streams. Among them, the low-latency mode in which only part of the image quality processing is turned off means that one or more of the above-mentioned image quality processing algorithms are turned off, and the other one or more image quality processing algorithms are reserved to adapt to different usage scenarios; The mode that currently uses the scene information is not completely low-latency mode, and all image quality processing items except the image quality processing items specified for the data stream are disabled.
  • the computer device side can have various usage scenarios, including watching movies, playing games, watching football games, video calls, and office work.
  • the movie-watching scene corresponds to the full high-quality mode
  • the game-playing scene corresponds to the full low-latency mode.
  • the MEMC function that improves the smoothness of the picture quality cannot be turned off to reduce the delay.
  • Another example is a video call. Due to the low definition of the picture during a video call, the super-resolution algorithm (NR) and the noise reduction algorithm (SR) need to be used to improve the clarity. Therefore, the video call scene needs to reduce the delay but the super-resolution algorithm cannot be turned off. with noise reduction algorithms.
  • the sink-side display device 200 can adjust its own working parameters in more detail according to the information, so as to adapt to the low-latency requirements in different scenarios.
  • the device type can be extracted from the data stream , and switch the playback mode according to the device type.
  • the HDMI protocol specifies a source device description SPD data frame that describes the information of the device itself.
  • the SPD data frame is generated based on the basic HDMI protocol, and can be generated without additional configuration of the external device 500.
  • the auxiliary information including the device information is transmitted to the display device 200 .
  • the external device 500 may send SPD data frames at preset time intervals while transmitting the media asset information data.
  • the display device 200 After receiving the SPD data frame, the display device 200 reads the device classification at a specific byte position from the SPD data frame, and controls the display device 200 to switch to the low-latency mode if it is determined that the device is classified as a game machine by reading.
  • the display device 200 may extract the device information frame from the data stream; and obtain the external device type according to the data of the specified byte in the device information frame.
  • the display device 200 may extract the device information frame from the data stream; and obtain the external device type according to the data of the specified byte in the device information frame.
  • the SPD Data Frame
  • mainstream external devices 500 can send SPD protocol frame data. Therefore, when the external device 500 does not support the ALLM function, the type information of the external device 500 can be obtained through the SPD protocol frame.
  • other auxiliary information can also be extracted from the SPD data frame to judge the device type, such as manufacturer information, model information, and so on.
  • the main usage scenario of game devices is the game scenario
  • the main usage scenario of smart terminal devices is screen projection.
  • Both of the above two scenarios require a lower image transmission delay effect, that is, a low-latency mode is required. ; and other types of equipment such as set-top boxes, DVDs, etc. are mainly used for movie viewing scenes, and high-quality mode is required at this time.
  • a device that conventionally requires lower picture transmission delay is referred to as a first-type device; a device that requires higher picture quality is referred to as a second-type device. Therefore, after obtaining the device type of the external device 500, the device type can be judged. If the device type is the first type of device, set the playback mode to low-latency mode; if the device type is the second type of device, set the playback mode to high quality mode.
  • the play modes under different device types can be set according to usage habits or custom policies. For example, for a webcam device, it is often used for network communication according to the user's usage habits. Therefore, when it is detected that the device type of the external device 500 is a webcam, the playback mode of the display device 200 can be switched to low latency without turning off the super score. Algorithm and Noise Reduction Algorithm mode. Through more detailed classification and more custom play modes, it can be realized that when the external device 500 does not support the automatic control protocol, it can also be automatically adjusted to a suitable play scene.
  • a type comparison table may also be pre-stored in the display device 200 .
  • the type comparison table the corresponding relationship between the state value on the specified byte in the device information frame and the device type can be stored.
  • the 25th byte (data byte 25) in the SPD data frame represents the device classification, and its corresponding state value "8" represents "game device”, “9” represents “host device”, and "10” represents "DVD device” "Wait.
  • the type comparison table After obtaining the status value on the specified byte, you can call the type comparison table first, and then use the status value as the index value to match the target entry in the type comparison table. For example, when the device classification value of a specific byte is read as "8", it is determined through the type comparison table that the external device 500 connected to the display device 200 is a game machine, and the game machine is usually used to play games, so you can use Playback mode switches to low latency mode.
  • the type comparison table may also directly record the playback modes suitable for each device type, that is, in the type comparison table, a table including "status value-device type-adaptive mode" items, such as "8-Game Console-Low Latency Mode", etc. Therefore, after matching the target entry corresponding to the state value, the image quality parameter and/or the sound quality parameter corresponding to the playback mode in the target entry can be parsed.
  • the image quality parameter is used to perform image quality processing, and may include the image quality processing method to be performed and the parameters referenced when performing image quality processing, for example, whether to execute the super-resolution algorithm and the target resolution of the super-resolution algorithm.
  • the sound quality parameter is used to perform sound quality processing.
  • the display device 200 may further perform picture quality processing and/or sound quality processing on the data stream according to the picture quality parameter and/or the sound quality parameter, so as to output the data stream as a video signal and/or or audio signal.
  • a state value of 10 matches that the device type is a DVD device, and the corresponding playback mode is a high-definition mode. Therefore, the corresponding image quality parameters in the high image quality mode can be analyzed, such as executing the super-resolution algorithm to increase the image resolution to 4096 ⁇ 2160, so as to obtain ultra-high-definition image quality.
  • the external device 500 since the device information frame can only transmit the device type of the external device 500, the external device 500 is not limited to one usage scenario during part of the use process, so the external device 500 is not in the main usage scenario.
  • the corresponding playback mode is different from that recorded in the type comparison table, a better data stream output effect cannot be obtained.
  • the external device 500 connected to the display device 200 is a host device (computer host)
  • the host device may be in various scenes such as game scenes and video scenes.
  • the playback mode recorded in the type comparison table is the high-definition mode of the host device when the main usage scene is a film and television scene, the switched playback mode will not match the game scene, affecting the output effect.
  • the display device 200 can also determine the current usage scene of the external device 500 by means of image recognition, so as to dynamically adjust the play mode according to the change of the usage scene. That is, the display device 200 may periodically extract image frame data from the data stream sent by the external device 500 . For example, image frame data is extracted from the data stream every 30s to obtain the current picture to be displayed.
  • the extracted image frame data is input into the recognition model, and the image frame data is classified by the recognition model.
  • the recognition model can be obtained through sample training through an artificial intelligence machine learning algorithm. That is, in practical applications, the initial model can be input through an image with a classification label, and the model parameters can be adjusted according to the classification result output by the model and the back-propagation of the classification label. In this way, through a large number of sample images, a recognition model suitable for the usage scenario of the display device 200 and having a high classification accuracy can be obtained.
  • the recognition model can classify and calculate the image frame data, and output the corresponding classification result, that is, obtain the usage scene information.
  • the display device 200 then switches the play mode according to the acquired usage scene information. For example, by acquiring the image frame data and inputting it to the recognition model, it is recognized that the corresponding picture in the image frame data is a game picture, so it can be determined that the current usage scene of the host device is a game scene, and the play mode of the display device 200 is switched to low Delay mode.
  • the display device 200 periodically extracts image frame data to monitor the usage scene of the external device 500 in real time, so that when the usage scene changes, the display device 200 switches to the corresponding playback mode, so that the playback mode can maintain the same Adapt to usage scenarios to improve the output quality of data streams.
  • the device type of the external device 500 connected to the display device 200 will change. For example, when the display device 200 is connected to multiple external devices 500 at the same time, different external devices 500 can wake up from each other. After an external device 500 is connected, the type of the device connected to the display device 200 will change.
  • the display device 200 may periodically extract data from the data stream. Device information frame, and compare the device type in the current device information frame and the previous device information frame in turn. If the device type in the current device information frame is different from the device type in the previous device information frame, the play mode needs to be switched, that is, the play mode is switched according to the device type in the current device information frame.
  • the display device 200 can be connected to a computer device and a smart camera device at the same time, and when the user needs, the computer can be used to wake up the smart camera. Since the user uses the display device 200 to display the game screen on the computer, the play mode of the display device 200 is the low-latency mode. After the computer device wakes up the smart camera device, since the device type is changed to the smart camera device, and the smart camera is suitable for the high image quality mode, the playback mode needs to be switched to the high image quality mode.
  • the data stream will be output in the playback mode, that is, for the device information frame originating from the same external device 500, the display device 200 does not need to execute the switching procedure multiple times, directly Just keep it in steady playback mode.
  • the type comparison table can store the play mode suitable for each device type, while comparing the device type in the current device information frame and the previous device information frame, it can also compare the suitable play mode. , so that the playback mode of the display device 200 is switched to the mode corresponding to the device type in the current device information frame when the corresponding playback mode is changed, and the current playback mode is maintained when the corresponding playback mode is not changed.
  • the playback mode is still not switched.
  • the type of the external device 500 connected to the display device 200 is switched from a webcam device to a smart terminal device, since the two are applicable to different playback modes, it is necessary to switch the playback mode of the display device 200 from the low-latency mode to the high-definition mode model.
  • the display device 200 when the display device 200 cannot obtain the device information frame in the data stream, it means that the connection between the external device 500 and the display device 200 is currently disconnected, so the playback mode can be restored, that is, switch back to the original playback mode .
  • the display device 200 can detect the extraction process of the device information frame in a plurality of consecutive cycles, so that the device information frame cannot be extracted from the data stream within a continuous preset number of cycles, and the playback device information frame cannot be extracted from the data stream. The mode is restored to the original mode.
  • the display device 200 can determine whether the external device 500 supports the automatic control protocol by analyzing the data stream, so as to set the playback mode according to the automatic control protocol support capability of the external device 500 .
  • the support status of the external device 500 connected to the display device 200 may also be saved by storing device information, and then the external device 500 can access the When the device 200 is displayed, the protocol support status of the external device 500 is determined by matching the stored information.
  • the display device 200 further includes a memory, and the device information table of the external device 500 can be stored in the memory.
  • the device information table In the device information table, the device name and protocol support status of each external device 500 are stored as table items.
  • the display device 200 can automatically extract the device information table, and match the current protocol support under the device name of the external device 500 in the device information table.
  • the playback mode is switched according to the ALLM protocol; when it is determined from the device information table that the current external device 500 does not support the ALLM protocol, the device of the external device 500 can be obtained through the SPD protocol frame. type to switch the playback mode by the device type.
  • the display device 200 may further determine whether the external device 500 is connected for the first time.
  • whether the external device 500 is accessed for the first time can be determined by traversing the stored device information table.
  • the current external device 500 is determined. It is the first access; when the traversal result is that the device name of the current external device 500 exists in the device information table, it is determined that the current external device 500 is not the first access.
  • the display device 200 can directly execute the corresponding play mode switching mode through the protocol support status stored in the device information table.
  • the display device 200 For the external device 500 accessed for the first time, the display device 200 needs to start a protocol detection program to detect the protocol supported by the external device 500 .
  • the display device 200 can extract the device information data frame carried in the data stream, and extract the state value on the specified flag bit in the device information data frame.
  • the ALLM protocol support status can always exist in the HDMI data frame as a reserved bit, that is, the display device 200 can read the state value of the corresponding position of ALLM in the data frame.
  • the status value at the position corresponding to ALLM is 0, it is determined that the current external device 500 does not support the ALLM protocol; and when the status value at the position corresponding to the ALLM is 1, it is determined that the current external device 500 supports the ALLM protocol.
  • the display device 200 can also store the device name of the current external device 500 and the corresponding protocol support as table items in the device information table, so that the external device 500 can use it again in the future. During access, the protocol support status of the external device 500 can be directly determined through the device information table.
  • the display device 200 can determine the protocol support status of the external device 500 by reading the state value of the specified flag bit in the data frame. In part of the judgment process, even if the external device 500 does not support the automatic control protocol, it will also send data with a flag of 0 to the display device 200, which conflicts with the 0/1 state when the automatic control protocol is in effect, so that the display device 200 cannot It is directly judged whether the external device 500 really supports the automatic control protocol.
  • the display device 200 can acquire the scene switching information of the external device 500 in the detection period, and the parameter change information of the automatic control protocol flag bit in the data stream. If the scene switching information matches the parameter change information, it is determined that the current external device 500 supports the automatic control protocol, so control protocol support information indicating that the external device supports the automatic control protocol can be generated and stored.
  • the display device 200 can automatically enable the ALLM protocol parsing thread when the external device 500 is connected for the first time, and at the same time, through image recognition, AI scene recognition, etc., to determine whether the current usage scene is playing a game or playing a game Video resources, and record the state value changes of ALLM at the same time. If the scene switching information matches the parameter change information, it means that the current external device 500 can maintain the flag correctly, which means that the current external device 500 supports the ALLM protocol, otherwise it does not support the ALLM protocol.
  • the display device 200 can record the protocol support of the external device 500 in real time by maintaining the device information table, so as to determine whether the external device 500 supports the automatic control protocol by analyzing the data stream sent by the external device 500. For example, the above process needs to be performed for all external devices connected to the display device 200 for the first time, and the ALLM support of each external device 500 is recorded separately, so that the display device 200 can be distinguished by the SPD data frame sent by the external device 500 .
  • the judgment result of the protocol support of the external device 500 determined by the display device 200 by analyzing the data stream can be used to indicate that the external device 500 does not support the automatic control protocol at all, or can be used to indicate that the external device 500 does not support the automatic control protocol at the current moment.
  • Automatic control protocol is supported. For example, due to user settings, the ALLM switch of the external device 500 is currently off, but when the display device 200 is subsequently accessed, the user may set the ALLM switch to on, even if the ALLM function is enabled.
  • the display device 200 can also perform periodic detection to update the storage device information sheet.
  • the switch state of the external device 500 also needs to be considered, so as to avoid the switch state from affecting the judgment process. For example, when detecting whether the external device 500 supports the ALLM protocol, the read state value of the corresponding position of the ALLM is 1, indicating that the external device 500 currently supports the ALLM protocol, but the external device 500 is set by the user to disable the ALLM protocol in subsequent use. That is, although the device information table records that the external device 500 supports the ALLM protocol, in the subsequent access process, since the ALLM protocol switch is turned off, the playback process cannot be controlled to switch the playback mode according to the ALLM protocol, and SPD still needs to be used.
  • the data frame determines the device type to switch playback modes.
  • the display device 200 can obtain the game screen of the external device 500 at this time, and perform image analysis processing on the game screen to determine the game type classification to which the current game screen belongs, and set different picture quality, sound quality parameters. For example, for shooting, sports, and action game types, it is necessary to reduce the delay of the game screen to make the game experience smoother. If the ALLM status changes to 0, you can stop the processing of the above picture quality and sound quality, and restore the picture quality and sound quality parameters to the user-defined values, so as to ensure the normal viewing experience of the user.
  • the display device 200 can acquire the SPD information of the external device 500 . That is, if the data stream sent by the external device 500 contains SPD information, the SPD information can be parsed, the device type of the external device 500 can be obtained first, and then different picture quality and sound quality adjustment methods can be selected according to the different types of the external device 500 . For example, by parsing the SPD information, the display device 200 can judge whether the external device 500 is a game device, and if the external device 500 is a game device, it can judge the currently running game type according to the game screen, and according to different games Type sets different picture quality and sound quality parameters. However, if the external device 500 is not a game device, the picture quality and sound quality parameters can be restored to user-defined values, so as to ensure the normal viewing experience of the user.
  • the corresponding playback mode switching mode can be executed according to different switch states, so that the display device 200 can automatically judge the usage scene of the external device 500, and according to Depending on the usage scenario of the external device 500, the working mode of the display device 200 is adjusted so that the picture quality effect and sound quality effect of the display device 200 can be linked with the usage scenario of the external device 500 to achieve a better user experience.
  • the corresponding image quality parameters may also be obtained by calling history record information.
  • the display device 200 may record the image mode set by the user before automatically entering the game mode, and set corresponding image mode parameters after entering the automatic game mode. If the user manually changes the image mode parameters under the condition of automatically entering the game mode, the display device 200 also needs to memorize the image mode set by the user. Wherein, for different game modes, the display device 200 may also record the corresponding image mode parameters in the game mode. For example, the display device 200 may automatically set to a mode such as an SDR game, an HDR game, or a Dolby game by recognizing the game image type.
  • the display device 200 can also identify the game screen information in real time to distinguish the game type, so as to change the basic image quality parameters in the game mode to achieve a better game experience.
  • the user unplugs the game console, it will not actively switch out of the game mode, but wait for the next device to be connected. Then determine the type of the newly connected device. If it is a game console, it does not need to be switched out. If it is a set-top box and other types of devices, it will switch to the image mode set by the last user.
  • the image type is the same as the current mode, save the game mode. Then, complete the picture mode setting by setting the picture mode (picmode) of the Hardware Abstraction Layer (HAL), and updating the backlight, picture parameters, and dynamic contrast curve.
  • picmode picture mode of the Hardware Abstraction Layer
  • HAL Hardware Abstraction Layer
  • the display device 200 can also judge whether the current image is in the variable refresh rate mode (VRR), and if it is in the VRR mode, judge whether it was in the VRR mode during the last game process by using the memorized data, and Whether the game mode has changed, thereby setting the output mode to PC and setting the playback mode to low latency mode, and updating the mode ID for subsequent calls in the game.
  • VRR variable refresh rate mode
  • the switching mode of the play mode can be actively controlled by manual or automatic means, that is, after the display device 200 switches the play mode, it can also monitor the use scene of the external device 500 in real time, and according to the change of the use scene, Switch play mode again.
  • the automatic switching of the playback mode can be stopped under the following four conditions, that is, the user manually switches the image mode; the signal source is switched; 200 is pulled out; the ALLM/SPD drive control of the external device 200.
  • the display device 200 When it is detected that the display device 200 is in the setting state, it can control to return to the initial play mode, and complete the corresponding control flow. For example, in the process of using the display device 200, after the display device 200 is in the above four scenarios, it can be judged whether it has entered the game mode, if so, exit the SOC/FRC game mode first, and clear the game mode flag, Then execute the corresponding exit process, such as the image mode switching process, the signal source switching process, the device unplugging process, and the restoring image parameter process.
  • the corresponding exit process such as the image mode switching process, the signal source switching process, the device unplugging process, and the restoring image parameter process.
  • the display device 200 can automatically adapt to the usage scene of the external device 500 through configuration, so as to switch the play mode.
  • the control program on the controller 250 of the display device 200 After acquiring the data stream sent by the external device 500, it analyzes the control protocol currently supported by the external device 500 from the data stream. If the external device 500 supports the automatic control protocol, the play mode is switched according to the data stream specification; if the external device 500 does not support the automatic control protocol, the play mode is switched according to the device type of the external device.
  • an external device 500 is further provided, including: a data interface 510 and a processor 520 , wherein the data interface 510 is configured to connect The display device 200; the processor 520 is configured with a control program to acquire the data stream to be played and the type of the external device 500, and generate a device information frame according to the device type. The device information frame is then added to the data stream to be sent to the display device, so that the display device switches the playback mode to a mode suitable for the device type.
  • the external device 500 provided in the above embodiment can generate a device information frame including the device type by detecting its own device type after establishing a connection relationship with the display device 200, and add the device information frame to the data stream, so as to be connected with the data stream. They are sent to the display device 200 together, so that the display device 200 can switch the play mode according to the device type of the external device 500 .
  • the external device 500 can configure a simple control program so that the display device 200 can obtain the device type, so as to automatically switch the playback mode and improve the output effect of the data stream.
  • the display device 200 in order to realize the above-mentioned automatic adaptation to the usage scenario and switch the playback mode, can build a playback mode flag in the playback process, so that the display device 200 can switch between different playback modes by detecting the playback mode flag. model.
  • the play mode flag may be set to different states by the display device 200 by judging the content of the data stream.
  • the play mode flag may include two states of "active (true)" and "inactive (false)".
  • the display device 200 can switch to different play modes when detecting different play mode flags.
  • the display device 200 may first receive a control instruction for playing the data stream input by the user.
  • the display device 200 may receive the control instructions input by the user in real time during the running process, and different control instructions may have different functions and correspond to different interaction modes.
  • the control instruction for playing the data stream refers to a control instruction that can trigger the display device 200 to parse, process and convert the data stream into a video or audio signal.
  • the control instructions for playing the data stream are also different.
  • the control instruction for playing the data stream can be completed through the action of selecting the signal source.
  • the user can click the "Signal Source” option on the control homepage of the display device 200, and select the HDMI interface in the pop-up list of external devices 500, and the data stream can be obtained through the game device. to play. That is, the playback control instruction is the above-mentioned signal source selection process.
  • the control instruction for playing the data stream can also be automatically triggered by the display device 200 to complete the input by judging the working condition. For example, when an external device 500 such as a smart terminal sends a data stream to the display device 200 through a screen projection protocol, the display device 200 may automatically play the data stream after receiving the data stream. That is, the display device 200 automatically generates a control instruction for playing the data stream when judging that the screen projection data stream is input.
  • an external device 500 such as a smart terminal sends a data stream to the display device 200 through a screen projection protocol
  • the data stream may or may not originate from the external device 500, such as local media assets of the display device 200, for the playback process of this part of the data stream, corresponding playback control instructions also need to be input.
  • the user can select any media asset file through the media asset list interface of the display device 200 and open it for playback.
  • the control instruction for playing the data stream is the above operation of opening a media asset file.
  • the display device 200 may, in response to the control instruction, acquire the data stream to be played.
  • the manner in which the display device 200 obtains the data streams is also different.
  • the data stream can be sent by the external device 500 to the display device 200, or can be acquired by the display device 200 by calling a built-in memory, or acquired by the display device 200 by accessing a specific media asset link.
  • the data stream acquired by the display device 200 may be a data stream composed of multiple consecutive frames, and the data stream form may also be expressed in different forms according to different sources.
  • the data stream may be composed of multiple display image frames and data frames related to data stream transmission, such as device information frames and protocol frames.
  • the locally stored data stream it may only include multiple display image frames.
  • the display device 200 may detect the play mode flag before playing the data stream, so as to obtain the target play mode in which the play mode flag is activated.
  • the target playback mode includes image parameters for image quality processing, that is, a specific playback mode may correspondingly include a series of image parameters, and these image parameters may be used to perform image quality processing.
  • the image parameters may include whether to enable HDR (High Dynamic Range, high dynamic range) and HDR function parameters, and the like.
  • the display device 200 may traverse the state of the play mode flag, and if the play mode flag corresponding to the target play mode is in the active state, extract the image parameters of the target play mode, so as to modify the processing of the image quality processing process according to the image parameters parameter to switch the playback mode.
  • a low-latency mode flag suitable for a game playing scenario can be set during the playback process of the display device 200, and by detecting whether the low-latency mode flag is true, the display device 200 can be controlled to enter or exit the low-latency mode.
  • multiple play mode flags can be preset in the play process of the display device 200 .
  • the states of multiple playback mode flags can be detected respectively, so that when any playback mode flag is detected to be in an activated state, the playback mode of the display device 200 is switched to the corresponding mode, that is, the target playback mode. model.
  • a low-latency mode flag and a high-definition mode flag may be built-in in the playback process of the display device 200.
  • the low-latency mode flag is true and the high-definition mode flag is true. If it is false, it means that the target playback mode is low-latency mode.
  • the low-latency mode flag is false and the high-quality mode flag is true. , that is, the target playback mode is obtained as the high-definition mode.
  • the display device 200 may further perform image quality processing on the data stream according to the target play mode, so as to output the final media asset image. For example, when it is found that the target playback mode is the low-latency mode by detecting the playback mode flag, the display device 200 may disable unnecessary image quality processing items, such as motion compensation, super-resolution algorithm, and noise reduction processing, according to the low-latency mode. .
  • the display device 200 can determine the target play mode by detecting the play mode flag. And according to the target switching mode, the image quality processing is carried out, and different playback modes are used for different forms of data streams to obtain better output effects.
  • the above-mentioned embodiments take a video-type data stream as an example to describe a specific manner of automatically switching the playback mode when image quality processing is performed on a video picture.
  • the above method of automatically switching the play mode can also be applied to an audio data stream, or a video and audio composite data stream.
  • each play mode flag can be maintained by the display device 200 or the external device 500, that is, as shown in FIG. 18, in some embodiments, the display device 200 can obtain the data to be played when After streaming, the usage scene information is extracted from the data stream, the playback mode comparison table is called, and the playback mode code is matched from the playback mode comparison table according to the usage scene information, so as to set the playback mode flag according to the matched playback mode code.
  • the play mode comparison table includes multiple usage scenarios and play mode codes suitable for each usage scenario.
  • the display device 200 may use the scene information as an index value to perform matching in the play mode comparison table. If the same entry as the current usage scene information exists in the play mode comparison table, the play mode code corresponding to the usage scene may be extracted from the play mode comparison table. That is, when a match hits, the hit entry is extracted.
  • the play mode code is not only used to identify different play modes, but also can be used to set the state of the play mode flag. That is, in some embodiments, when the play mode flag is in an activated state, a specific value may be further included to indicate the target play mode.
  • the play mode flag can be set to "A/LLM" according to the play mode code. When the play mode flag is detected, "A” can be detected first, that is, the play mode flag is activated, and then "LLM" is detected to indicate the target play mode. in low latency mode. Therefore, based on the play mode look-up table, the target play mode can be indicated by setting the play mode flag, thereby reducing the number of preset play mode flag items.
  • the display device 200 may acquire usage scene information in different ways.
  • the sources of the data stream that can be played by the display device 200 generally include two sources, one is the local data stream of the display device 200 , and the other is the data stream sent by the external device 500 to the display device 200 .
  • the display device 200 can directly obtain the current usage scene through its own scene detection program, for example, when it is detected that the display device 200 opens the local movie resource file for playback, it can be determined that the current usage scene is When it is detected that the display device 200 is running a game application, it can be determined that the current usage scene is a game scene, so the display device 200 can easily obtain the usage scene corresponding to the data stream.
  • the display device 200 For the data stream sent by the external device 500, the display device 200 needs to read the usage scene information from the data stream. To enable the display device 200 to extract usage scene information from the data stream, the display device 200 may further analyze the data stream, such as extracting protocol frame data from the data stream or performing scene recognition on display images in the data stream.
  • the display device 200 may adopt different analysis methods according to different types of external devices 500 . That is, as shown in FIG. 19 , in some embodiments, for the external device 500 supporting the automatic control protocol, the display device 200 may first extract the protocol frame from the acquired data stream.
  • the protocol frame is a data frame generated by the external device 500 based on the automatic control protocol. For example, for a game device that supports the ALLM protocol, when running the game application, the game device will add ALLM-based data to the data stream sent to the display device 200.
  • the current usage scenario information may also be delivered to the display device 200 by setting the state value of the reserved flag bit on the protocol frame.
  • the display device 200 may perform scene analysis on the display screen corresponding to the data stream by means of image processing, AI recognition, etc., to obtain the current usage scene, that is, as shown in FIG. 20 , in some embodiments, the display device 200 may first Extract the multi-frame display images from the data stream, and then input the multi-frame display images into the scene recognition model to perform scene recognition on the multi-frame display images through the scene recognition model, thereby obtaining the usage scene information output by the scene recognition mode.
  • the scene recognition model is a neural network model obtained by training on sample images.
  • the sample image is an image used for training, including display images in multiple usage scenarios supported by the external device 500 and usage scenario labels corresponding to each display image.
  • the scene recognition model can calculate the classification probability of the displayed image through the neural network algorithm inside the model after inputting the displayed image, that is, the usage scene corresponding to the displayed image.
  • a scene recognition model can be constructed in the display device 200 before performing the detection of the automatic control protocol.
  • the scene recognition model can be obtained by performing neural network model training, that is, an initial model can be constructed first, and then the sample images can be input into the initial model one by one to obtain the model output result. Then compare the model output with the label information, determine the classification error, and use the classification-incapable back-propagation to adjust the model parameters. Based on this, by inputting a certain number of sample images multiple times, the model parameters can be gradually adjusted to finally obtain a scene recognition model with higher accuracy.
  • the display device 200 may input the display image extracted from the data stream to the scene recognition model to obtain the scene recognition result.
  • the types of recognition results that can be output by the scene recognition model are also different.
  • the usage scene information that the scene recognition model can output includes game scenes and non-game scenes; while for computer equipment, the usage scenarios that the scene recognition model can output include game scenes, instant messaging scenes, office scenes, and sports scenes, etc. . Therefore, when performing scene recognition, different scene recognition models may also be invoked for different types of external devices 500 to obtain a suitable scene classification.
  • the usage scenario information extracted by the display device 200 may refer to the usage scenario of the display device 200 or the usage scenario of the external device 500 .
  • the usage scenario is the current usage scenario of the display device 200
  • the usage scenario is the usage of the external device 500 Scenes.
  • the display device 200 can use different playback modes when playing the data stream.
  • the display device 200 performs the switching of the play scene by detecting the state of the play mode flag, and the play mode flag will be in different states with the change of the usage scene. Therefore, in order to be able to follow the change of the usage scene
  • the display device 200 can continuously detect the play mode flag.
  • the state of the play mode flag changes, the play mode needs to be switched, and when the play mode flag does not change, there is no need to perform the play mode switch. switch.
  • the display device 200 may first obtain the current play mode, and extract the image parameters of the current play mode. If the image parameters of the target play mode are different from the image parameters of the current play mode, the play mode flag is set to the active state, so that the display device 200 switches the play mode when detecting that the play mode flag is active.
  • the data stream sent to the display device 200 will be converted from game screen data to homepage interface data, that is, the usage scene is converted from a game scene to a non-game scene.
  • the display device 200 After the display device 200 detects the change of the usage scene through the data stream, it can acquire the current playback mode, that is, the low-latency mode; and then extract the target playback mode, that is, the high-image-quality mode.
  • the image parameters corresponding to the two playback modes are different, so the display device 200 can set the playback mode flag to "true", so that the playback program of the display device 200 can switch the playback mode to the high image quality mode according to the playback mode flag.
  • the play mode flag is set to an inactive state, so that the display device 200 maintains the current play mode.
  • the data stream sent to the display device 200 is always the game screen data, so the current play mode and the target play mode obtained by the display device 200 are both low-latency modes, that is, the corresponding image parameters are the same , so the display device 200 can set the playback mode flag to "false", so that the playback program of the display device 200 can maintain the playback mode as the low-latency mode according to the playback mode flag.
  • the display device 200 may also record the image parameters of the current playback mode, and periodically detect the playback mode Mode flag, when it is detected that the play mode flag is changed to an inactive state, the playback mode is restored according to the image parameters of the current mode.
  • the display device 200 may restore the playback mode to the image parameter mode set by the user according to the exit instruction, that is, as shown in FIG. 22 , in some embodiments, the display device 200 may receive the exit instruction. Then, in response to the exit instruction, the play mode flag is detected. If the play mode flag is in an active state, stop performing image quality processing on the data stream according to the target play mode, and perform image quality processing through image parameters set by the user, while setting the play mode flag in an inactive state.
  • the exit instruction can be manually input by the user, for example, the exit instruction is generated when the user manually inputs an interactive instruction for switching the play mode and input to the display device 200; or when the display device 200 detects that the usage condition satisfies a specific condition Automatic input, for example, when the controller 250 detects that the data stream to be played is changed; or, when the controller 250 detects that the external device 500 is disconnected from the external device interface 240, generates the exit command; The device 500 is generated according to the automatic control protocol.
  • the display device 200 After the display device 200 enters the low-latency mode, there are four scenarios for exiting the low-latency mode, namely: the user manually switches the image mode; the data stream is changed to data other than game data; the game device pulls out the display device 200; the game The device controls the display device 200 to exit the low-latency mode through the automatic control protocol.
  • These four scenarios can be added to the original process to determine whether the low-latency mode has been entered, that is, the detection process of detecting the playback mode flag. If it is detected that it is in the low-latency mode, it is necessary to exit the low-latency mode of the SOC/FRC first, and clear the corresponding flag of the low-latency mode to restore the playback mode.
  • the image quality adjustment method includes: first receiving a control instruction for playing a data stream input by a user, and then responding to the control instruction to obtain the data stream to be played. By detecting the play mode flag, a target play mode in which the play mode flag is activated is obtained, so as to perform image quality processing on the data stream according to the target play mode.
  • the above image quality adjustment method can obtain the data stream to be played after receiving the playback control instruction, and before executing the playback, automatically detect the playback mode flag to determine the target playback mode in an activated state, so as to play according to the target.
  • the mode performs image quality processing on the data stream to be played.
  • the image quality adjustment method can set the playback mode flag in the playback program of the display device 200, and switch the playback mode in real time according to the playback mode flag, so that the display device 200 can automatically adapt to different data stream forms and improve the playback effect.
  • a plurality of external device interfaces 240 may be provided on the display device 200 , and the plurality of external device interfaces 240 may be respectively connected to different external devices 500 .
  • the display device 200 may be provided with two HDMI interfaces, namely HDMI1 and HDMI2.
  • the HDMI1 interface is connected to the game device
  • the HDMI2 interface is connected to the set-top box.
  • both the game device and the set-top box can send data streams to the display device 200, but the display device 200 can only play the data stream sent by one of the devices at the same time.
  • the display device 200 when the display device 200 is connected to multiple external devices 500 through multiple external device interfaces 240 , the user needs to perform a signal source switching operation to control the display device 200 to select and output the data stream of any one of the external devices 500 .
  • the display device 200 when the display device 200 outputs the data stream of the HDMI1 interface game device, the display device 200 can be controlled to output the data stream of the HDMI2 interface set-top box by switching the signal source operation.
  • the display device 200 when the display device 200 outputs the data stream of the HDMI2 interface set-top box, the display device 200 can be controlled to output the data stream of the HDMI1 interface game device by switching the signal source operation.
  • Different external devices 500 have different playback modes. For example, when playing data streams of game devices, the display device 200 needs to use low-latency mode, and when playing data streams from set-top boxes, the display device 200 needs to use high-quality mode. It can be seen that when the display device 200 performs the signal source switching function, the playback mode of the display device 200 after switching may not match the playback mode required by the external device 500, which affects the output quality of the data stream after switching. For example, after the signal source of the display device 200 is switched from HDMI1 to HDMI2, the display device 200 outputs the data stream corresponding to the set-top box, but at this time, the playback mode of the display device 200 is still the low-latency mode suitable for the game device, resulting in the data sent by the set-top box. The stream does not pass through the image quality processing of the display device 200, degrading the image quality.
  • the display device 200 can also switch the play mode according to the switching process. That is, as shown in FIG. 24 , a display device 200 is also provided in some embodiments of the present application.
  • the display device 200 includes a display 275 , a controller 250 and a plurality of external device interfaces 240 .
  • the multiple external device interfaces 240 are respectively connected to different external devices 500 , and the display 275 is used for displaying a user interface and displaying a screen of media asset data sent by the external device 500 .
  • the controller 250 is configured to execute the playback method when switching between multiple devices in the present application, so that the switched playback mode matches the external device 500 and improves the output quality of the media asset data.
  • the display device 200 may first obtain a control instruction input by the user for switching signal sources.
  • the user can input an interactive action through the control device 100 such as a remote control, a mobile phone, etc., to control the display device 200 to switch signal sources.
  • a user can cause the display device 200 to perform switching between multiple signal sources by pressing a "source" button on the remote control. Since each signal source may correspond to one external device 500 , the process of switching the signal source, that is, the process of switching the external device 500 connected to the display device 200 , is performed.
  • the display device 200 may also provide an option to switch signal sources in the operating system control interface.
  • the display device 200 can jump to the signal source list, and then click the signal source list. If one of the options is selected, the display device 200 is switched to output the audio and video data corresponding to the option. For example, if the user clicks the signal source switching option through the main control interface or the status bar, the signal source list will pop up, and the signal source list may include options such as "HDMI1" and "HDMI2". After clicking the HDMI2 option, the signal source of the display device 200 can be switched to the external device 500 connected to the HDMI2 interface.
  • a control instruction for switching the signal source may also be input through the supported input mode.
  • the display device 200 can be controlled to switch the signal source by inputting content such as "switch signal source” and "connect HDMI2".
  • the display device 200 can only output media asset data for one external device 500 , in order to save energy, among the multiple external devices 500 connected to the display device 200 , the external devices that output media asset data are not output through the display device 200 .
  • the device 500 is usually in an off or standby state, and will not send media asset data to the display device 200 at this time, but when it wants to output media asset data through the display device 200, it is usually activated to send a data stream to the display device 200, Therefore, in practical applications, the display device 200 can also detect the data input status of each external device interface 240 in real time, and automatically switch the signal source to the external device interface 240 when it detects that any external device interface 240 has a data stream input. .
  • the display device 200 may receive the data stream sent by the external device 500 through the external device interface 240 in response to the control instruction.
  • the display device 200 can output the data stream of the HDMI1 interface by default, that is, the display device 200 can receive the data stream sent by the game device through the HDMI1 interface, such as game screen data
  • the display device 200 switches to output the data stream of the HDMI2 interface, that is, the data stream sent by the set-top box is received through the HDMI2 interface, such as live TV image data.
  • the data stream may be sent from the external device 500 to the display device 200 in a plurality of consecutive frames to form the data stream.
  • the display device 200 forms a specific display screen by continuously parsing and rendering the data stream. Since some interactive control can be performed between the display device 200 and the external device 500, the data stream received by the display device 200 not only includes content frame data for providing video or audio images, but also includes device information frames, protocol frames, etc. and data transmission.
  • Process-related frame data that is, the data stream includes at least one of a protocol frame and a device information frame.
  • the device information frame is a data frame sent by the external device 500 according to the basic transmission protocol and contains device type information; the protocol frame is sent by the external device 500 according to the automatic control protocol and contains the data frame of usage scene information.
  • the frame data related to the transmission process included in the data stream sent by the external device 500 are also different.
  • the device information frame may be a source device description (Source Product Description, SPD) data frame specified in the HDMI protocol that describes the information of the device itself. Therefore, the external device 500 connected to the display device 200 through the HDMI interface can carry the SPD data frame in the data stream.
  • the device information frame may include relevant information for describing the current external device 500, such as device name, device type, etc., and the display device 200 may identify the connected external device 500 by reading the device information frame.
  • the protocol frame when sending the device information frame to the display device 200, the protocol frame can also be sent.
  • the external device 500 supporting the ALLM protocol may generate protocol frame data based on the ALLM protocol, and send the data to the display device 200 together with the content frame and the SPD frame.
  • the protocol frame data may include content related to automatic control, such as control instructions.
  • the display device 200 can switch the play mode according to the control instruction in the protocol frame.
  • the protocol frame may also include current usage scenario information of the external device 500, such as game scenarios and non-game scenarios.
  • the display device 200 may further extract the protocol frame and/or the device information frame in the data stream, and read the flag bit status value in the protocol frame and/or the device information frame.
  • the flag bit refers to a specific data position in the device information frame and/or the protocol frame. According to the data arrangement mode specified by the transmission protocol, in the data frame received by the display device 200, each data representing a specific meaning is set in a specific position, and its specific state is represented by different state values.
  • the 25th byte (data byte 25) is the device classification, and the corresponding state value on the 25th byte represents the device type of the external device 500, as shown in the following table, different states Values can represent different device types:
  • the display device 200 can obtain the state value of the flag bit from which it is read to obtain the type of the external device 500 connected to the display device 200 after switching the signal source. For example, when the device classification value at a specific byte position is read as "08", it means that the external device 500 connected to the display device 200 is a game device.
  • the display device 200 can further extract the current usage scene of the external device 500 .
  • the ALLM value in the protocol frame when it is detected that the ALLM value in the protocol frame is equal to 1, it indicates that the external device 500 is in a game scene; when the ALLM value is equal to 0, it indicates that the external device 500 is in a non-game scene.
  • each usage scenario can also be represented by additionally defining some data fields.
  • the usage scene information of the external device 500 can be represented by a plurality of bits reserved in the HDMI specification.
  • the display device 200 can acquire the protocol frame data and traverse the parameter values (status values) on multiple bits in the protocol frame data. Therefore, according to the combination of parameter values on multiple bits, the current usage scene information is read. For example, the display device 200 can read the parameter value from the two bits specified in the protocol frame.
  • the display device 200 After receiving the data stream, the display device 200 can detect the device type or usage scene of the external device 500 after switching the signal source by extracting the flag bit status value in the protocol frame and/or the device information frame. Thus, the play mode is switched according to the state value of the flag bit.
  • the display device 200 can switch the play mode according to the external device 500 after the switch.
  • the playback mode of the display device 200 needs to be switched from the low latency mode to the high image quality mode.
  • the display device 200 provided in the above-mentioned embodiment can receive the data stream sent by the external device 500 after the switch after the user inputs the control instruction for switching the signal source, and extract the flag bit status of the protocol frame and/or the device information frame therefrom. value, detect whether the device type or usage scene of the external device 500 has changed before and after the switch, and switch the playback mode according to the status value of the flag bit, so that the display device 200 can automatically adapt to the data stream playback mode of the external device 500 after the switch, and ease the multi-device switching When the playback mode does not match the audio and video data.
  • the display device 200 can identify the device type of the external device 500, that is, can extract the device information frame from the data stream, and traverse the flag bit status in the device information frame value, and then detect the device type of the external device 500 before and after switching the signal source according to the flag state value, so as to extract the flag state value in the protocol frame and/or device information frame according to the device type.
  • the external device 500 can be divided into three categories, namely, automatic control protocol device, general protocol device and common interface device.
  • the automatic control protocol device refers to a device that supports automatic control protocols such as the ALLM protocol, for example, an xbox game console, a computer, and the like.
  • the automatic control protocol device can directly send a control instruction to the display device 200 through the automatic control protocol, so that it switches the play mode.
  • Common protocol devices refer to devices that do not support automatic control protocols but support basic transmission protocols, such as ps game consoles, set-top boxes, etc.
  • the general protocol device cannot directly send a control instruction to the display device 200, so the playback mode can be switched by classifying the device or recognizing the scene.
  • Ordinary interface devices refer to devices that neither support automatic control protocols nor general transmission protocols, and are usually output devices with single function and simple data form, such as cameras and microphones. Ordinary interface devices usually do not need a specific playback mode, and the output mode of the user-defined setting can meet the output requirements of the data stream.
  • the display device 200 can extract the flag bit state value from the data stream according to the device type.
  • the external device 500 connected to the display device 200 is an automatic control protocol device, and a protocol frame needs to be extracted from the data stream, so as to determine the current usage scenario of the external device 500 through the protocol frame, and according to The current play mode is switched using the scene.
  • the switching signal is detected, and the external device 500 connected to the display device 200 is a general protocol device, the device classification is extracted from the device information frame, so as to switch the play mode according to the device classification.
  • the playback mode can be directly restored to a user-defined mode.
  • a playback mode switching program may be set in the display device 200, and the mode switching program may include a parsing thread and an image middleware, wherein the parsing thread may It is a loop body used to detect the status value of the flag bit in the device information frame and the protocol frame in the data stream in real time. Therefore, the parsing thread includes a protocol frame parsing thread and a device information frame parsing thread.
  • the image middleware is used to switch the playback mode for the state value based on the flag detected by the parsing thread.
  • the parsing thread and the image middleware can be two independent program modules, which can be called each other through the software interface to complete the switching of the playing scene.
  • the display device 200 may first call the parsing thread to monitor the flag bit status value of the protocol frame and/or the device information frame by using the parsing thread.
  • the interface label value can be set according to the change of the state value of the flag bit, so that the image middleware can obtain the interface label value and switch the playback mode according to the interface label value.
  • the interface label value may include the automatic control protocol label value and the general protocol label value, and the values of the two label values are both 1 or 0.
  • the middleware needs to switch the playback mode to a specific mode; when the tag value is equal to 0, it means that the image middleware does not need to switch the playback mode to a specific state and restores the user settings.
  • the following describes the method of switching the playback mode according to the status value of the flag bit in the present application in conjunction with several switching scenarios of the external device 500, mainly including:
  • the display device 200 may extract the first state value from the flag bit of the protocol frame. That is, the display device 200 can identify from the protocol frame whether the external device 500 supports the automatic control protocol before and after switching. If the first state value is 1, it means that the external device 500 connected to the display device 200 after switching supports the automatic control protocol, so the playback mode can be switched to the automatic control mode. Similarly, if the acquired first state value is 0, it means that the external device 500 connected to the display device 200 after switching the signal source is a common interface device that does not support the automatic control protocol, so the playback mode can be switched to the user setting mode.
  • If switching from an ALLM protocol device to an ordinary HDMI device, first detect the ALLM state parsing thread loop body and read that the ALLM state changes to ALLM 0; then call the image middleware ALLM interface label value, and set the ALLM label value to 0, so that After the image middleware obtains the value of the ALLM tag as 0, it adjusts the display device 200 to exit the low-latency mode and restores the user settings.
  • the display device 200 may periodically acquire a plurality of protocol frames from the data stream, and extract a combination of state values from reserved flag bits in the protocol frames.
  • the state value combination is the state value combination of multiple reserved flag bits in the protocol frame, and can be used to represent the usage scenario of the external device 500 . Therefore, the display device 200 can query the usage scenario of the external device 500 through the combination of state values, and control to switch the playback mode to a mode suitable for the usage scenario.
  • the display device 200 can adjust the playback mode when switching between the common interface device and the automatic control protocol device by detecting the status value of the flag in the protocol frame, so that the display device 200 after switching
  • the playback mode can be adapted to the external device 500 immediately, ensuring that the display device 200 can output the data stream normally after switching.
  • the display device 200 may extract the second state value from the flag bit of the device information frame, and obtain the current state value according to the second state value.
  • the device type that the status value refers to so that the playback mode can be switched according to the device type.
  • the SPD state analysis thread loop body may first detect the change of the SPD frame information read to determine whether the switched device type is a game device or a PC device.
  • the image middleware SPD interface is then called, and the value of the SPD tag is set to 1, so that the image middleware adjusts the display device 200 to enter the low-latency mode after acquiring the flag bit 1.
  • the display device 200 If switching from an SPD protocol device to a common HDMI device, the display device 200 reads the SPD state change by detecting the SPD state analysis thread loop body, and determines that the switched device type is not a game device or a PC device. Then call the image middleware SPD interface, and set the SPD label value to 0, so that the image middleware adjusts the display device 200 to exit the low-latency mode after obtaining the label value of 0, and restores the user settings.
  • the display device 200 can automatically detect the device type of the external device 500 by reading the flag status value in the device information frame, thereby switching the playback mode according to the device type.
  • the general protocol devices can be further classified, that is, the general protocol devices can include a first type of device adapted to one play mode and a second type of device adapted to multiple play modes. Therefore, after detecting the switch to the general protocol device, the display device 200 can further detect the device classification it refers to according to the second state value, and if the device is classified as the first type of device, then switch the playback mode to the same as the first type of device. appropriate playback mode.
  • the display device 200 can be controlled to switch the playback mode to the user setting mode. That is, after switching the signal source to the second type of device that adapts to multiple playback modes, the data stream can be output through the user-defined playback mode, so that the external device 500 can output the data stream according to the user's preference in any usage scenario. .
  • the display device 200 can also identify the usage scene of the external device 500 by means of image recognition, AI algorithm, etc., for the second type of device that adapts to multiple playback modes, so as to switch playback according to the scene recognition result. model. That is, if the device is classified as the second type of device, the display device 200 can extract multiple frames of display images from the data stream, and perform scene recognition on the multiple frames of display images to obtain the usage scenarios of the external device 500, and finally, according to the identified usage scenarios Switch the play mode to adapt the play mode to the usage scene.
  • the display device 200 may extract the display image from the data stream, and input the extracted display image into the scene recognition model to obtain the scene information output by the scene recognition model.
  • the scene recognition model is a neural network model obtained by training on sample images.
  • the sample image is an image used for training, including display images in multiple usage scenarios supported by the external device 500 and usage scenario labels corresponding to each display image.
  • the scene recognition model can calculate the classification probability of the displayed image through the neural network algorithm inside the model after inputting the displayed image, that is, the usage scene corresponding to the displayed image.
  • a scene recognition model can be constructed in the display device 200 before performing the detection of the automatic control protocol.
  • the scene recognition model can be obtained by performing neural network model training, that is, an initial model can be constructed first, and then the sample images can be input into the initial model one by one to obtain the model output result. Then compare the model output with the label information, determine the classification error, and use the classification-incapable back-propagation to adjust the model parameters. Based on this, by inputting a certain number of sample images multiple times, the model parameters can be gradually adjusted to finally obtain a scene recognition model with higher accuracy.
  • the display device 200 may input the display image extracted from the data stream to the scene recognition model to obtain the scene recognition result.
  • the types of recognition results that can be output by the scene recognition model are also different.
  • the usage scene information that the scene recognition model can output includes game scenes and non-game scenes; while for computer equipment, the usage scenarios that the scene recognition model can output include game scenes, instant messaging scenes, office scenes, and sports scenes, etc. . Therefore, when performing scene recognition, different scene recognition models may also be invoked for different types of external devices 500 to obtain a suitable scene classification.
  • the use scene of the external device 500 can also be detected, so that when the signal source is switched to a general protocol device, the playback can also be switched according to the use scene of the external device 500. mode, so that the display device 200 can adjust the playback mode in real time according to the usage of the external device 500, so as to output a better playback effect of the data stream.
  • the display device 200 can extract the first state value from the flag bit of the protocol frame, and extract the first state value from the flag bit of the device information frame.
  • the first state value is 1 and the device referred to by the second state value is classified as the first type of device, the playback mode is switched to the automatic control mode.
  • the display device 200 can first detect the SPD parsing status thread loop body read When the SPD frame information changes, determine whether it is a game device or a PC device, then call the image middleware SPD interface, and set the SPD interface tag value to 1, so that the image middleware obtains the SPD tag value of 1 and judges that the ALLM tag value is also After being 1, keep the display device 200 into low latency mode.
  • the display device 200 can extract the protocol frame from the data stream after switching the signal source. If the protocol frame contains the usage scene information, the playback mode can be controlled and switched according to the automatic control protocol; if the protocol frame is not extracted or the extracted protocol frame does not carry the usage scene information, the device information frame can be extracted, and according to the The device information frame extracts the device type of the external device 200 to switch the playback mode according to the device type.
  • the playback mode can be switched to the user-defined mode, so that the display device 200 can automatically adapt to the signal source switching process. Equipped with playback mode to ensure the output quality of media data.
  • some embodiments of the present application also provide a playback method when switching between multiple devices.
  • the playback method can be applied to the above-mentioned display device 200, and includes the following steps: the display device 200 first obtains the user-input Control command for switching signal sources.
  • the data stream sent by the external device is received, wherein the data stream includes at least one of a protocol frame and a device information frame.
  • the flag bit state value is extracted from the protocol frame and/or the device information frame, so as to switch the play mode according to the flag bit state value.
  • the playback method during the multi-device switching can extract the specified flag bit state value in the protocol frame and the device information frame in the data stream after acquiring the signal source switching control command input by the user, thereby according to the flag bit state value.
  • the play mode required by the external device before and after the switch is detected, so that when the required play mode changes, the play mode switch is performed.
  • the method can automatically adapt to the data stream playback mode of the external device 500 after switching, and can alleviate the problem that the playback mode does not match the audio and video data when multiple devices are switched.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请一些实施方式公开一种显示设备及多设备切换时的播放方法，所述方法可以在获取用户输入的信号源切换控制指令以后，在数据流中提取协议帧和设备信息帧中指定标志位状态值，从而按照标志位状态值分别检测切换前后外接设备需求的播放模式，以便在所需求的播放模式发生改变时，执行播放模式的切换。所述方法可以自动适应切换后外接设备的数据流播放方式，能够缓解多设备切换时播放模式与音视频数据不匹配的问题。

Description

显示设备及多设备切换时的播放方法
本申请要求于2021年1月14日提交的、申请号为202110046140.2；于2021年3月18日提交的、申请号为202110292422.0；于2021年3月18日提交的、申请号为202110292875.3；于2021年3月18日提交的、申请号为202110291950.4的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及显示设备技术，具体而言，涉及一种显示设备及多设备切换时的播放方法。
背景技术
智能电视可以通过HDMI接口连接游戏设备，用户在使用游戏设备的过程中，游戏设备可以通过运行游戏相关程序，输出视频数据和音频数据。视频数据和音频数据可以通过HDMI协议发送给智能电视，并通过智能电视的屏幕和扬声器进行输出，播放游戏设备的视频和音频。在智能电视上接入多个外接设备时，用户可以通过切换信号源的方式，切换输入智能电视的音视频数据。
发明内容
本申请一些实施例提供了一种显示设备及多设备切换时的播放方法，其中，一种显示设备，包括显示器、控制器和多个外部装置接口。其中，多个外部装置接口分别被配置为连接外接设备，显示器用于显示用户界面以及显示外接设备发送的媒资数据画面。控制器被配置为执行以下程序步骤：获取用户输入的用于切换信号源的控制指令；响应于所述控制指令，接收切换信号源后连接的外接设备发送的数据流，所述数据流中包括协议帧和设备信息帧中的至少一种；提取所述协议帧和/或所述设备信息帧中的标志位状态值；按照所述标志位状态值切换播放模式。
本申请一些实施例还提供一种多设备切换时的播放方法，所述多设备切换时的播放方法包括以下步骤：获取用户输入的用于切换信号源的控制指令；响应于所述控制指令，接收切换信号源后连接的外接设备发送的数据流，所述数据流中包括协议帧和设备信息帧中的至少一种；提取所述协议帧和/或所述设备信息帧中的标志位状态值；按照所述标志位状态值切换播放模式。
本申请一些实施例提供一种显示设备，包括显示器以及控制器。其中，显示器用于显示用户界面以及显示数据流画面。控制器被配置为执行以下程序步骤：接收用户输入的用于播放数据流的控制指令；响应于所述控制指令，获取待播放的数据流；检测播放模式标志，以获得所述播放模式标志处于激活状态的目标播放模式，所述目标播放模式包括用于画质处理的图像参数；按照所述目标播放模式对所述数据流执行画质处理。
本申请一些实施例提供一种显示设备，包括显示器、外部装置接口以及控制器。其中，外部装置接口用于连接外接设备，显示器用于显示用户界面以及显示外接设备 发送的数据流画面。控制器被配置为执行以下程序步骤：获取所述外接设备发送的数据流，所述数据流中包括用于描述外接设备类型的设备信息帧；从所述设备信息帧中提取所述外接设备的设备类型；将播放模式切换至与所述设备类型相适应的模式，以按照切换后的播放模式输出所述数据流。
附图说明
图1为根据本申请一个或多个实施例的显示设备与控制装置之间操作场景的示意图；
图2为根据本申请一个或多个实施例的显示设备200的硬件配置框图；
图3为根据本申请一个或多个实施例的控制设备100的硬件配置框图；
图4为根据本申请一个或多个实施例的显示设备200中软件配置示意图；
图5为根据本申请一个或多个实施例的显示设备与外接设备连接状态示意图；
图6为根据本申请一个或多个实施例的显示设备调整播放模式的流程示意图；
图7为根据本申请一个或多个实施例的根据ALLM状态参数切换播放模式示意图；
图8-图9为根据本申请一个或多个实施例的根据使用场景信息切换播放模式示意图；
图10为根据本申请一个或多个实施例的调整播放模式中画质处理示意图；
图11为根据本申请一个或多个实施例的根据设备类型切换播放模式示意图；
图12为根据本申请一个或多个实施例的根据类型对照表获取设备类型示意图；
图13为根据本申请一个或多个实施例的根据识别模型检测使用场景示意图；
图14为根据本申请一个或多个实施例的维持播放模式判断的流程示意图；
图15为根据本申请一个或多个实施例的维护设备信息表的流程示意图；
图16为根据本申请一个或多个实施例的外接设备播放控制流程示意图；
图17为根据本申请一个或多个实施例的画质调整方法流程示意图；
图18为根据本申请一个或多个实施例的设置播放模式标志的流程示意图；
图19为根据本申请一个或多个实施例的根据协议帧识别使用场景的流程示意图；
图20为根据本申请一个或多个实施例的根据显示图像识别使用场景的流程示意图；
图21为根据本申请一个或多个实施例的对比当前播放模式和目标播放模式的流程示意图；
图22为根据本申请一个或多个实施例的退出目标播放模式流程图；
图23为根据本申请一个或多个实施例的显示设备与多个外接设备连接状态示意图；
图24为根据本申请一个或多个实施例的显示设备连接状态示意图；
图25为根据本申请一个或多个实施例的多设备切换时的播放方法流程示意图；
图26为根据本申请一个或多个实施例的提取标志位状态值示意图；
图27为根据本申请一个或多个实施例的显示设备切换播放模式的流程示意图；
图28为根据本申请一个或多个实施例的ALLM协议设备与普通HDMI设备切换时的数据关系图；
图29为根据本申请一个或多个实施例的ALLM协议设备与普通HDMI设备切换 时流程示意图；
图30为根据本申请一个或多个实施例的SPD协议设备与普通HDMI设备切换时的数据关系图；
图31为根据本申请一个或多个实施例的SPD协议设备与普通HDMI设备切换时流程示意图；
图32为根据本申请一个或多个实施例的ALLM协议设备与SPD协议设备切换时的数据关系图；
图33为根据本申请一个或多个实施例的ALLM协议设备与SPD协议设备切换时流程示意图。
具体实施方式
为使本申请的目的、实施方式和优点更加清楚，下面将结合本申请示例性实施例中的附图，对本申请示例性实施方式进行清楚、完整地描述，显然，所描述的示例性实施例仅是本申请一部分实施例，而不是全部的实施例。
基于本申请描述的示例性实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本申请所附权利要求保护的范围。此外，虽然本申请中公开内容按照示范性一个或几个实例来介绍，但应理解，可以就这些公开内容的各个方面也可以单独构成一个完整实施方式。需要说明的是，本申请中对于术语的简要说明，仅是为了方便理解接下来描述的实施方式，而不是意图限定本申请的实施方式。除非另有说明，这些术语应当按照其普通和通常的含义理解。
如图1所示，用户可通过移动终端300和控制装置100操作显示设备200。控制装置100可以是遥控器，遥控器和显示设备的通信包括红外协议通信、蓝牙协议通信，无线或其他有线方式来控制显示设备200。用户可以通过遥控器上按键，语音输入、控制面板输入等输入用户指令，来控制显示设备200。在一些实施例中，也可以使用移动终端、平板电脑、计算机、笔记本电脑、和其他智能设备以控制显示设备200。
在一些实施例中，移动终端300可与显示设备200安装软件应用，通过网络通信协议实现连接通信，实现一对一控制操作的和数据通信的目的。也可以将移动终端300上显示音视频内容传输到显示设备200上，实现同步显示功能显示设备200还与服务器400通过多种通信方式进行数据通信。可允许显示设备200通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。服务器400可以向显示设备200提供各种内容和互动。显示设备200，可以液晶显示器、OLED显示器、投影显示设备。显示设备200除了提供广播接收电视功能之外，还可以附加提供计算机支持功能的智能网络电视功能。
如图2所示，控制装置100包括控制器110、通信接口130、用户输入/输出接口140、存储器、供电电源。控制装置100可接收用户的输入操作指令，且将操作指令转换为显示设备200可识别和响应的指令，起用用户与显示设备200之间交互中介作用。通信接口130用于和外部通信，包含WIFI芯片，蓝牙模块，NFC或可替代模块中的至少一种。用户输入/输出接口140包含麦克风，触摸板，传感器，按键或可替代模块中的至少一种。
如图3所示显示设备200包括调谐解调器210、通信器220、检测器230、外部装置接口240、控制器250、显示器260、音频输出接口270、存储器、供电电源、用户输入接口280中的至少一种。控制器包括中央处理器，视频处理器，音频处理器，图形处理器，RAM， ROM，用于输入/输出的第一接口至第n接口。显示器260可为液晶显示器、OLED显示器、触控显示器以及投影显示器中的至少一种，还可以为一种投影装置和投影屏幕。调谐解调器210通过有线或无线接收方式接收广播电视信号，以及从多个无线或有线广播电视信号中解调出音视频信号，如以及EPG数据信号。检测器230用于采集外部环境或与外部交互的信号。控制器250和调谐解调器210可以位于不同的分体设备中，即调谐解调器210也可在控制器250所在的主体设备的外置设备中，如外置机顶盒等。
在一些实施例中，控制器250，通过存储在存储器上中各种软件控制程序，来控制显示设备的工作和响应用户的操作。控制器250控制显示设备200的整体操作。用户可在显示器260上显示的图形用户界面(GUI)输入用户命令，则用户输入接口通过图形用户界面(GUI)接收用户输入命令。或者，用户可通过输入特定的声音或手势进行输入用户命令，则用户输入接口通过传感器识别出声音或手势，来接收用户输入命令。
在一些实施例中，“用户界面”，是应用程序或操作系统与用户之间进行交互和信息交换的介质接口，它实现信息的内部形式与用户可以接受形式之间的转换。用户界面常用的表现形式是图形用户界面(Graphic User Interface，GUI)，是指采用图形方式显示的与计算机操作相关的用户界面。它可以是在电子设备的显示屏中显示的一个图标、窗口、控件等界面元素，其中控件可以包括图标、按钮、菜单、选项卡、文本框、对话框、状态栏、导航栏、Widget等可视的界面元素中的至少一种。
如图4所示，将系统分为四层，从上至下分别为应用程序(Applications)层(简称“应用层”)，应用程序框架(Application Framework)层(简称“框架层”)，安卓运行时(Android runtime)和系统库层(简称“系统运行库层”)，以及内核层。内核层至少包含以下驱动中的至少一种：音频驱动、显示驱动、蓝牙驱动、摄像头驱动、WIFI驱动、USB驱动、HDMI驱动、传感器驱动(如指纹传感器，温度传感器，压力传感器等)、以及电源驱动等。
在本申请实施例中，显示设备200连接外接设备500是指建立通信连接，而建立通信连接的显示设备200和外接设备500分别作为接收端(Sink端)和发送端(source端)。例如，外接设备500可以是游戏设备，在用户使用游戏设备过程中，能够针对游戏过程实时输出视频数据和音频数据，并将视频数据和音频数据发送给显示设备200，以通过显示设备200将视频数据和音频数据输出为视频画面和声音。此时，游戏设备作为发送端，而显示设备200作为接收端。
发送端与接收端之间，可以通过特定接口实现通信连接，从而传递数据。为此，在发送端和接收端上都应设有同一种接口规范和功能的数据接口。例如，如图5所示，在显示设备200和外接设备500上都均设有高清多媒体接口(High Definition Multimedia Interface，HDMI)。在使用过程中，用户可以将HDMI接口数据线的两端分别插在显示设备200和外接设备500上，并在启动外接设备500和显示设备200后，设定显示设备200的信号源为HDMI接口，从而实现显示设备200与外接设备500之间的数据传输。
需要说明的是，为了实现显示设备200与外接设备500之间的通信连接，显示设备200与外接设备500之间还可以采用其他的连接方式。具体的连接方式可以是有线的连接方式，如DVI(Digital Visual Interface)、VGA(Video Graphics Array)、USB(Universal Serial Bus)等；也可以是无线的连接方式，如无线局域网、蓝牙连接、红 外连接等。不同的通信连接方式可以采用不同的信息传递协议，例如采用HDMI接口实现连接时，可以采用HDMI协议进行数据传输。
外接设备500在运行过程中，可以根据使用情况实时输出视频数据和/或音频数据。外接设备500在不同的使用场景下，所输出的视频信号和音频信号需要与对应场景相适应，从而获得更好的画质效果和音质效果。为此，显示设备200可以内置多种播放模式，不同的播放模式下，可以获得不同画质和音质效果。
例如，显示设备200支持切换的播放模式可以包括低延迟模式(Low-latency Mode，LLM)和高画质模式(High Image Quality Mode，HIQM)。对于游戏机等外接设备500，由于游戏画面需要保持良好的流畅性和响应速度，因此在使用显示设备200输出游戏画面时，可以控制显示设备200切换至低延迟模式。在低延迟模式下，显示设备200可以关闭部分画质处理程序，如关闭插帧算法、降噪处理、超分算法等，减少画面处理的时间，降低画面显示延迟。而对于机顶盒等外接设备500，由于相对于游戏画面，影视画面更注重画面质量，并不需要过快的显示响应速度，因此在使用显示设备200播放机顶盒传输的影视画面时，可以控制显示设备200切换至高画质模式，以开启插帧算法、降噪处理、超分算法等全部画质处理程序，获得更好的画面效果。
但是，由于外接设备500与显示设备200之间不具有从属关系，因此外接设备500通常无法对显示设备200进行直接控制，导致在实际应用中，需要用户手动切换显示设备200的播放模式。手动切换过程不仅需要用户执行交互动作，而且部分用户并不清楚适用于外接设备500的播放模式，导致出现播放模式切换错误的问题。而对于部分外接设备500，其可以在使用中根据不同的使用需求，处于多种不同的使用场景。如游戏场景、影视场景、即时通讯场景等，这些场景可以在特定的播放模式下表现出更好的效果。但由于需要手动切换显示设备200的播放模式，使得当用户在外接设备500上变更使用场景时，用户需要再更改显示设备200的播放模式，因此为用户带来了不便。
并且，由于显示设备200和外接设备500通常属于不同种类的设备，用户通常无法通过外接设备500直接对显示设备200进行控制。例如，用户在智能电视与游戏设备之间通过HDMI接口实现连接时，游戏设备负责运行游戏应用，并根据用户交互操作形成视频数据和音频数据，而智能电视只能被动获取游戏设备输出的音频数据和视频数据，游戏设备无法直接调整智能电视的播放模式，造成播放模式与使用场景不相符，影响视频、音频效果。
<自动低延迟模式>
为了适应不同的使用场景，在一些实施例中，外接设备500可以支持自动低延迟模式(Auto Low-latency Mode，ALLM)。自动低延迟模式可以在Sink端用户无需手动设置的情况下，由source端根据预设规则自动启动或禁止Sink端运行低延时模式。例如，用户在观看电影时接到视频电话，则此时作为source端的外接设备500会自动停止电影播放，并通知Sink端显示设备200切换至低延时模式，以保证视频电话的实时互动性能。而在用户接听完视频电话后，source端外接设备500可以恢复电影播放过程，并通知Sink端显示设备200退出低延时模式的状态。
但目前市面上支持ALLM协议的外接设备500较少，限制了依赖ALLM协议的参数自适应功能的应用范围。例如，Xbox系列游戏机支持ALLM协议，而部分其他类 型的游戏机并不支持ALLM协议，导致无法实现在游戏机进入运行游戏的状态时，自动向显示设备200发送用于切换播放模式的控制指令。
基于此，在本申请的部分实施例中，如图6所示，显示设备200可以通过检测外接设备500发送的数据流，对外接设备500是否支持ALLM协议等自动控制协议进行检测，并针对外接设备500所支持的控制协议，切换播放模式。为了实现自动切换播放模式，显示设备200可以包括显示器260、外部装置接口240以及控制器250，外接设备500则包括数据接口和处理器。通过在外部装置接口240与数据接口之间连接HDMI数据线，使外接设备500接入显示设备200。在接入显示设备500后，外接设备500可以向显示设备200发送数据流。其中，数据流包括待播放的视频数据和音频数据。
为了便于描述，在本申请实施例中发送端和接收端建立连接关系以后，所传输的视频数据和音频数据统称为媒资数据。显然，针对不同的外接设备500，媒资数据可以是视频数据也可以是音频数据，还可以是视频数据和音频数据的集合。并且在发送的媒资数据形成数据流后，所形成的数据流中除视频数据和音频数据以外，还可以包括控制指令、设备信息等辅助信息，用于实现显示设备200和外接设备500之间的联动控制。
为了将这些辅助信息发送给显示设备200，外接设备500可以通过所支持的接口协议将这些辅助信息编辑为辅助信息帧随着数据流一同发送给显示设备200。其中，辅助信息帧可以根据外接设备500所支持的协议不同，呈现为不同的形式。对于支持自动控制协议(如ALLM协议)的外接设备500，可以将控制指令等辅助信息编辑至协议帧；而对于不支持自动控制协议的外接设备500，可以将设备信息等辅助信息编辑至基于基础传输协议(如HDMI协议)的设备信息帧(Source Product Description，SPD)。
例如，当接入显示设备200外部装置接口240的外接设备500为Xbox系列游戏机时，Xbox系列游戏机是支持ALLM等自动控制协议的外接设备500，因此外接设备500可以直接通过自动控制协议控制显示设备200切换播放模式，即显示设备200可以从数据流中提取使用场景信息，并根据使用场景信息实施播放模式切换。随着用户使用过程，游戏机可以在数据流中添加使用场景信息，即在运行游戏程序时在数据流中添加使用场景信息为游戏场景，在退出游戏程序时在数据流中添加使用场景信息为非游戏场景。显示设备200可以在检测到使用场景信息为游戏场景时，切换至低延迟模式；而在检测到使用场景信息为非游戏场景时，切换至高画质模式。
对于支持自动控制协议的外接设备500，其在应用中可以根据控制策略向显示设备200发送设备参数帧数据(或协议帧数据)。显示设备200可以在协议帧数据中的特定位置读取状态参数，从而根据状态参数确定控制方式。例如，如图7所示，在外接设备500连接显示设备200后，可以从数据流中提取ALLM协议帧。在ALLM协议帧中，可以通过多个在数据帧中特定位置上的字节位对控制指令等辅助信息进行表示。协议帧是按照约定的ALLM控制协议所制定生成，可以用于描述外接设备500的设备信息和与数据传输过程相关的其他信息。显示设备200可以读取自动低延迟模式ALLM状态值；如果ALLM状态值等于1，则代表当前外接设备500处于游戏场景，因此可以控制显示设备200切换播放模式为低延迟模式；如果ALLM状态值等于0， 则代表当前外接设备500处于非游戏场景，因此可以控制显示设备200切换播放模式为高画质模式。
<扩展协议>
在协议帧中除基本信息外，还会预留一些字节位(bit位)，这些字节位可以被source端设备赋予特定的数值，即状态值。因此在本实施例中可以在每个字节位中配置特定的状态值，用于传输使用场景信息至显示设备200。例如，对于计算机设备，可以利用HDMI规范中预留的两个bit位，表示使用场景，包括：Rsvd1＝0且Rsvd0＝0表示游戏场景；Rsvd1＝0且Rsvd0＝1表示即时通信场景；Rsvd1＝1且Rsvd0＝0表示办公场景，Rsvd1＝1且Rsvd0＝1表示运动场景等。
为此，在一些实施例中，参考图8，在外接设备500向显示设备200发送媒资数据的同时，还可以在数据流中添加协议帧，显示设备200则可以通过提取协议帧，并遍历多个字节位上状态值的组合，以确定外接设备500所处的使用场景信息，最后按照设定的播放参数调整方式，根据使用场景信息调整播放参数。例如，当读取到Rsvd1＝0且Rsvd0＝0时，则确定当前外接设备500处于游戏场景，而游戏场景需要保持良好的同步性和画面响应速度，因此显示设备200在获得外接设备500处于游戏场景时，可以关闭非必要且消耗时间的画质处理程序，以降低在游戏场景时的显示延迟。在使用过程中，显示设备200可以通过持续监测数据流中的协议帧，使播放模式跟随外接设备500的使用场景实时切换播放模式。例如，Sink端显示设备200可周期性检测数据流，实时解析协议帧中的ALLM标志位，以通过ALLM标志位确定当前是否需切换至低延迟模式(Low-latency Mode，LLM)。当外接设备500通过ALLM触发Sink端显示设备200进入LLM后，显示设备200需保持该模式直到Source端外接设备500通知Sink端显示设备200退出LLM。而当Source端通知Sink端显示设备200退出LLM后，Sink端显示设备200需恢复进入LLM之前的图像模式。
需要说明的是，当外接设备500通过ALLM触发LLM切换时，Sink端显示设备200需临时限制视频信号和音频信号，不直接播放source端外接设备500传递过来的信号，以使控制器250能够在此期间内判断是否需要执行切换。并且，为了实现无感知交互，以获得更好的用户体验，Sink端显示设备200若在切换期间可以显示遮挡画面，如黑屏、花屏或者OSD遮挡等，但显示的时间在满足切换运行时间的前提下，尽可能的短，如显示时间不超过1s。同时，声音则不得出现任何无关提示音，包括敲击声、点击声或者系统提示音等。
对于支持自动控制协议的外接设备500，不同外接设备500对应的使用场景不同。部分外接设备500可以支持多种使用场景，例如，计算机设备、智能终端等，其在使用中能够处于游戏场景、即时通信场景等，这些外接设备500可在使用中处于不同的使用场景，因此称为多模式设备。部分外接设备500仅支持单一使用场景，例如，游戏机、机顶盒、多媒体播放器等，这些外接设备500一般在使用中不切换或极少切换使用场景，因此称为单模式设备。
因此，在一些实施例中，在检测到外接设备500连接显示设备200以后，显示设备200可以从数据流中提取外接设备500的设备类型。其中设备类型的检测方式可以通过读取数据流中携带的设备信息帧中的内容获得，例如，可以通过读取设备名称、设备mac地址、设备接口信息等数据，确定外接设备500的设备类型。
如果设备类型为单模式设备，将播放模式切换为单模式设备所支持的模式。例如，当检测到外接设备500为多媒体播放器，即单模式设备时，则可以控制将播放模式切换为多媒体播放器对应需要的高画质模式。
由于支持多模式的外接设备500可以在使用中，随用户操作切换到不同的使用场景，因此如果设备类型为多模式设备，可以配置扩展协议，使接入显示设备200的外接设备500能够在协议帧数据中发送使用场景信息，从而将当前的使用场景信息发送给显示设备200，从而使显示设备200根据扩展协议切换播放模式。其中，所述扩展协议用于传递外接设备500的使用场景信息。例如，当检测到外接设备500为计算机设备，即多模式设备时，可以通过配置扩展协议，使计算机设备可以在发送的数据流中携带使用场景信息。
扩展协议可以根据自动控制协议的数据传输特点，附加定义部分数据字段。例如，可利用HDMI规范中预留的多个bit位表示外接设备500的使用场景信息。对于计算机设备，可以利用HDMI规范中预留的两个bit位，表示使用场景，包括：Rsvd1＝0且Rsvd0＝0表示游戏场景；Rsvd1＝0且Rsvd0＝1表示即时通信场景；Rsvd1＝1且Rsvd0＝0表示办公场景，Rsvd1＝1且Rsvd0＝1表示运动场景等。
相应的，如图9所示，显示设备200可以通过周期性获取协议帧数据，并遍历协议帧数据中多个bit位上的参数值。从而根据多个bit位上的参数值组合，读取当前使用场景信息，最后设置播放模式为与当前使用场景信息相适应的模式。
例如，显示设备200可以每个1s在数据流中提取协议帧数据，并在扩展协议指定的两个bit位上读取参数值，当读取到Rsvd1＝0且Rsvd0＝0时，则确定当前计算机设备处于游戏场景，而与游戏场景适应的播放模式为低延迟模式，因此可以将显示设备200的播放模式切换至低延迟模式。当读取到Rsvd1＝1且Rsvd0＝1时，则确定当前计算机设备处于观看球赛等运动场景，与运动场景适应的播放模式为运动补偿模式，因此可以将显示设备200的播放模式切换至运动补偿模式，即开启运动补偿(Motion Estimation and Motion Compensation，MEMC)功能，对传输的媒资画面进行画质处理。
显然，也可以通过协议帧的预留标志位对各种使用场景进行表示。例如，通过标志位Rsvd1和Rsvd0的状态值组合对所运行的游戏进行区分，以便于控制修改播放参数。需要说明的是，上述实施例中以两个bit位上的状态值组合对四种使用场景进行描述，但对于支持更多使用场景的外接设备500，还可以增加预留标志位的数量，例如，通过Rsvd0＝0、Rsvd1＝0、Rsvd2＝0表示竞速类游戏场景；通过Rsvd0＝0、Rsvd1＝0、Rsvd2＝1表示射击类游戏场景等。本领域技术人员在基于上述预留标志位所表示不同使用场景的方案，所想到的诸如增加或减少标志位数量，以及赋予更多状态值形式的表示方式，均属于本申请的保护范围。
如图10所示，在一些实施例中，与当前使用场景信息相适应的模式包括完全低延迟模式和非完全低延迟模式，如果与当前使用场景信息相适应的模式为完全低延迟模式，关闭对数据流的所有画质处理项、超分算法以及降噪算法等。其中，仅关闭部分画质处理的低延迟模式则是指将上述画质处理算法中的一个或多个关闭，保留其他的一个或多个画质处理算法，以适应不同的使用场景；如果与当前使用场景信息相适应的模式为非完全低延迟模式，关闭对数据流指定画质处理项以外的所有画质处理项。
例如，在将计算机设备通过HDMI接入智能电视后，计算机设备端可以有多种使 用场景，包括看电影、玩游戏、看球赛、视频通话、办公等。其中，看电影场景对应完全高画质模式，玩游戏场景则为完全低延时模式。但看球赛时，在追求低延时效果时用户也会在意画面的流畅度，此时并不能关闭提升画质流畅度的MEMC功能来降低延时。再比如视频通话时，由于视频通话时的画面清晰度较低，需要通过超分算法(NR)和降噪算法(SR)提升清晰度，因此视频通话场景需要降低延时但不能关闭超分算法与降噪算法。
可见，本实施例可以根据不同的模式，采用不同的数据流播放方法，利用ALLM协议帧的预留标志位，使source端外接设备500在要求低延时场景时可以提供更加详细的画质处理方式，相应的使用场景信息在送达sink端显示设备200后，sink端显示设备200可根据该信息更加细致的调整自身工作参数，以此适应不同场景下的低延时需求。
<SPD数据帧判断设备类型>
对于不支持自动控制协议的外接设备500，由于这类外接设备500不能通过ALLM等自动控制协议传输控制指令，因此为了适应不同的使用场景，如图11所示，可以在数据流中提取设备类型，并根据设备类型切换播放模式。例如，HDMI协议中规定了一种描述设备自身信息的源设备描述SPD数据帧，与ALLM协议帧不同，SPD数据帧基于基础的HDMI协议生成，可以无需对外接设备500进行额外配置的情况下，向显示设备200发送包括用于描述设备信息的辅助信息。外接设备500可以在传输媒资信息数据的同时，按照预设时间间隔发送SPD数据帧。显示设备200则在接收到SPD数据帧以后，从SPD数据帧中读取特定字节位置上的设备分类，如通过读取确定设备分类为游戏机，则控制显示设备200切换至低延迟模式。
为了识别出设备类型，在一些实施例中，显示设备200可以从数据流中提取设备信息帧；并根据设备信息帧中指定字节位的数据，获取外接设备类型。例如，支持SPD(数据帧)协议的产品较为普及，主流外接设备500均可以送出SPD协议帧数据，因此当外接设备500不支持ALLM功能时，可以通过SPD协议帧来获取外接设备500的类型信息。为实现更精确的判断，还可以从SPD数据帧中提取其他辅助信息用于判断设备类型，例如制造商信息、型号信息等。再按照用户的使用习惯，游戏类设备主要的使用场景是游戏场景，智能终端设备的主要使用场景则是画面投屏，以上两种场景均要求更低的画面传输延迟效果，即需要低延迟模式；而其他类设备例如机顶盒、DVD等则主要用于观影场景，此时需要高画质模式。
需要说明的是，在本实施例中，为了便于描述，将使用习惯上要求更低的画面传输延迟的设备称为第一类设备；将要求更高画面质量的设备称为第二类设备。因此，在获取外接设备500的设备类型后，可以对设备类型进行判断，如果设备类型为第一类设备，设置播放模式为低延迟模式；如果设备类型为第二类设备，设置播放模式为高画质模式。
同理，对于其他类型的外接设备500，可以根据使用习惯或自定义策略设定不同设备类型下的播放模式。例如，对于网络摄像头设备，根据用户的使用习惯常用于进行网络通信，因此当检测到外接设备500的设备类型为网络摄像头时，可以将显示设备200的播放模式切换为低延迟且不关闭超分算法与降噪算法的模式下。通过更细致的归类和更多的自定义播放模式，可以实现在外接设备500不支持自动控制协议时， 也可以自动调整到相适应的播放场景。
如图12所示，在一些实施例中，为了能够确定外接设备500的设备类型，还可以在显示设备200中预先存储一个类型对照表。在类型对照表中，可以保存有设备信息帧中指定字节位上的状态数值与设备类型之间的对应关系。例如，SPD数据帧中的第25个字节(data byte 25)代表设备分类，其对应状态值“8”代表“游戏设备”、“9”代表“主机设备”、“10”代表“DVD设备”等。
在获得指定字节位上的状态数值以后，可以先调用类型对照表，再以状态数值为索引值，在类型对照表中匹配目标表项。例如，当读取到特定字节位上的设备分类数值为“8”，通过类型对照表确定接入显示设备200的外接设备500为游戏机，而游戏机通常用于进行游戏，因此可以将播放模式切换至低延迟模式。
为了便于切换播放模式，在一些实施例中，类型对照表内还可以直接记载与各设备类型相适应的播放模式，即在类型对照表中，包括“状态值-设备类型-适应模式”的表项，例如“8-游戏机-低延迟模式”等。因此，在匹配到状态值对应的目标表项后，可以解析目标表项中播放模式对应的画质参数和/或音质参数。其中，画质参数用于执行画质处理，可包括执行的画质处理方式以及具体执行画质处理时所参照的参数等，例如，是否执行超分算法以及超分算法的目标分辨率等。同理，音质参数用于执行音质处理。
在解析获得画质参数和/或音质参数后，显示设备200还可以按照画质参数和/或音质参数对数据流执行画质处理和/或音质处理，以将数据流输出为视频信号和/或音频信号。例如，通过状态值10匹配到设备类型为DVD设备，且对应的播放模式为高画质模式。因此可以解析高画质模式下对应的画质参数，如执行超分算法将画面分辨率提高至4096×2160，以获得超高清的画面质量。
在上述实施例中，由于设备信息帧只能够传递外接设备500的设备类型，但外接设备500在部分使用过程中，并不局限于一种使用场景，因此会造成外接设备500不处于主要使用场景时，相适应的播放模式与类型对照表中记载的不同，无法获得较好的数据流输出效果。例如，连接显示设备200的外接设备500为主机设备(计算机主机)时，主机设备可处于游戏场景和影视场景等多种场景。当主机设备运行游戏，但类型对照表中记载的播放模式为主机设备在主要使用场景为影视场景时的高画质模式，则会造成切换的播放模式与游戏场景不匹配，影响输出效果。
对此，如图13所示，在一些实施例中，显示设备200还可以通过图像识别的方式，确定当前外接设备500所处的使用场景，从而根据使用场景变化动态调整播放模式。即显示设备200可以从外接设备500发送的数据流中周期性的提取图像帧数据。例如，每隔30s从数据流中提取一次图像帧数据，获取当前待显示的画面。
再将提取的图像帧数据输入到识别模型中，通过识别模型对图像帧数据进行分类。其中，识别模型可以通过人工智能机器学习算法，经过样本训练获得。即在实际应用中可以通过带有分类标签的图像输入初始模型，并根据模型输出的分类结果以及分类标签反向传播，调整模型参数。如此，通过大量的样本图像，可获得适用于显示设备200使用场景，并具有较高分类准确率的识别模型。
图像帧数据输入识别模型后，识别模型可以对图像帧数据进行分类计算，输出对应的分类结果，即获取使用场景信息。显示设备200再根据获取的使用场景信息切换 播放模式。例如，通过获取图像帧数据并输入至识别模型，识别出图像帧数据中对应的画面为游戏画面，因此可以确定主机设备的当前使用场景为游戏场景，则将显示设备200的播放模式切换至低延迟模式。
可见，在本实施例中显示设备200通过周期性提取图像帧数据，实现对外接设备500使用场景进行实时监控，从而在使用场景发生变化时，切换至相应的播放模式，使播放模式能够保持与使用场景相适应，提高数据流的输出质量。
由于在部分情况下，连接显示设备200的外接设备500的设备类型会发生变化，例如，在显示设备200同时接入多个外接设备500时，不同外接设备500之间可以相互唤醒，则在唤醒一个外接设备500后，连接显示设备200的设备类型会发生改变。
而不同的设备类型对应不同的播放模式，因此在设备类型改变时，需要对播放模式进行切换，即如图14所示，在一些实施例中，显示设备200可以周期性的从数据流中提取设备信息帧，并依次对比当前设备信息帧与前一个设备信息帧中的设备类型。如果当前设备信息帧与前一个设备信息帧中的设备类型不同，则需要切换播放模式，即按照当前设备信息帧中的设备类型切换播放模式。
例如，显示设备200可同时接入计算机设备和智能相机设备，并且在用户需要时，可以使用计算机唤醒智能相机。由于用户使用显示设备200显示计算机上的游戏画面，因此显示设备200的播放模式为低延迟模式。而当计算机设备唤醒智能相机设备以后，由于设备类型变更为智能相机设备，而智能相机适合的播放模式为高画质模式，因此需要将播放模式切换至高画质模式。
如果当前设备信息帧与前一个设备信息帧中的设备类型相同，则保持播放模式输出数据流，即对于来源于同一个外接设备500的设备信息帧，显示设备200无需多次执行切换程序，直接保持稳定的播放模式即可。
需要说明的是，由于类型对照表中可以存储与各设备类型相适应的播放模式，因此在对比当前设备信息帧与前一个设备信息帧中的设备类型的同时，还可以对比相适应的播放模式，从而在相适应的播放模式发生改变时将显示设备200的播放模式切换至当前设备信息帧中的设备类型对应的模式，而在相适应的播放模式未发生改变时，保持当前播放模式。
例如，当接入显示设备200的外接设备500类型从DVD设备切换至智能终端设备时，由于两者都适应高画质模式，因此即使设备类型发生变化，依然不切换播放模式。而当接入显示设备200的外接设备500类型从网络摄像头设备切换至智能终端设备时，由于两者适用于不同的播放模式，因此需要将显示设备200的播放模式从低延迟模式切换至高画质模式。
此外，当显示设备200无法获取到数据流中的设备信息帧时，说明当前已断开外接设备500与显示设备200之间的连接，因此可以对播放模式进行还原，即切换回初始的播放模式。在此过程中，显示设备200可以通过在连续多个周期内对设备信息帧的提取过程进行检测，从而在连续预设次数周期内，无法从数据流中提取到设备信息帧，将所述播放模式还原至初始模式。
在上述实施例中，显示设备200可以通过解析数据流确定外接设备500是否支持自动控制协议，从而根据外接设备500的自动控制协议支持能力，设定播放方式。在一些实施例中，为了快速获得外接设备500的自动控制协议支持能力，还可以通过存 储设备信息的方式，对接入显示设备200的外接设备500支持情况进行保存，并在外接设备500接入显示设备200时，通过匹配存储的信息，确定外接设备500的协议支持情况。
例如，显示设备200还包括存储器，存储器中可以存储外接设备500的设备信息表。在设备信息表中，每个外接设备500的设备名称和协议支持情况作为表项进行保存。当检测到外接设备500接入显示设备200时，显示设备200可以自动提取设备信息表，并在设备信息表中匹配当前外接设备500设备名称下的协议支持情况。当通过设备信息表获取当前外接设备500支持ALLM协议时，按照ALLM协议切换播放模式；当通过设备信息表确定当前外接设备500不支持ALLM协议时，则可以通过SPD协议帧获取外接设备500的设备类型，从而通过设备类型切换播放模式。
<首次设备接入判断>
对于首次接入显示设备200的外接设备500，由于设备首次接入，在设备信息表中并没有存储当前外接设备500的信息，因此显示设备200无法在设备信息表中匹配到当前外接设备500的设备名称，即无法通过存储的设备信息获取首次接入的外接设备500信息。为此，在一些实施例中，在外接设备500连接显示设备200时，显示设备200还可以对外接设备500是否为首次接入进行判断。
如图15所示，外接设备500是否为首次接入的判断，可以通过遍历存储的设备信息表，当遍历结果为设备信息表中不存在当前外接设备500的设备名称，则确定当前外接设备500为首次接入；当遍历结果为设备信息表中存在当前外接设备500的设备名称，则确定当前外接设备500不是首次接入。对于不是首次接入的外接设备500，显示设备200可以直接通过设备信息表中存储的协议支持情况，执行相应的播放模式切换方式。
而对于首次接入的外接设备500，显示设备200需要启动协议检测程序，对外接设备500所支持的协议进行检测。显示设备200可以通过提取数据流中携带的设备信息数据帧，并在设备信息数据帧中提取指定标志位上的状态值。例如，ALLM协议支持情况可作为保留位一直存在于HDMI数据帧中，即显示设备200可读取数据帧中ALLM对应位置的状态值。当ALLM对应位置上的状态值为0时，确定当前外接设备500不支持ALLM协议；而通过读取指定标志位置上的状态值为1时，确定当前外接设备500支持ALLM协议。
在确定外接设备500所支持的ALLM协议后，显示设备200还可以将当前外接设备500的设备名称以及对应的协议支持情况作为表项，存储在设备信息表中，以便此外接设备500在后续再次接入时，可以直接通过设备信息表确定此外接设备500的协议支持情况。
在上述实施例中，显示设备200可以通过读取数据帧中的指定标志位状态值，确定外接设备500的协议支持情况。而在部分判断过程中，即使外接设备500不支持自动控制协议，同样会向显示设备200发送标志位为0的数据，这与自动控制协议生效时的0/1状态冲突，导致显示设备200无法直接判断外接设备500是否真正支持自动控制协议。
为此，在一些实施例中，还可以通过分析一段时间内的状态值维持情况，确定当前外接设备500是否支持自动控制协议。即显示设备200可以获取检测周期内的外接 设备500的场景切换信息，以及数据流中自动控制协议标志位的参数变化信息。如果场景切换信息与参数变化信息相匹配，则确定当前外接设备500支持自动控制协议，因此可以生成表示外接设备支持自动控制协议的控制协议支持信息，并存储该信息。
例如，当source端外接设备500在播放视频资源或者停留在主页时，不会通知sink端显示设备200进入低延时模式，因此ALLM的状态值为0，而当source端外接设备500在运行游戏时，需要通知sink端显示设备200进入低延时模式，因此的状态值需要设置为1。基于以上原则，显示设备200可以在外接设备500第一次接入时，自动使能ALLM协议解析线程，同时通过图像识别、AI场景识别等方式，判断当前的使用场景是在玩游戏还是在播放视频资源，同时记录ALLM的状态值变化情况。若场景切换信息与参数变化信息相匹配，表示当前外接设备500可以正确维护该标志位，即说明当前外接设备500支持ALLM协议，否则不支持ALLM协议。
可见，在上述实施例中，显示设备200可以通过维护设备信息表，实时记录外接设备500的协议支持情况，从而可以通过解析外接设备500发送的数据流，确定外接设备500是否支持自动控制协议。例如，对于所有首次接入显示设备200的外接设备需进行上述过程，并对各个外接设备500的ALLM支持情况分别记录，使显示设备200可通过外接设备500发送的SPD数据帧来区分。
需要说明的是，显示设备200通过分析数据流所确定的外接设备500协议支持情况的判断结果可以用于指示外接设备500完全不支持自动控制协议，也可以用于指示外接设备500在当前时刻不支持自动控制协议。例如，由于用户设置原因，导致当前外接设备500的ALLM开关处于关闭状态，而在后续接入显示设备200时，用户可能设置ALLM开关处于开启状态，即使能ALLM功能。因此，为了使支持自动控制协议的外接设备500尽可能通过自动控制协议控制切换显示设备200的播放模式，对于非首次接入的外接设备500，显示设备200还可以通过周期性检测，以更新存储的设备信息表。
在使用设备信息表作为设备协议支持情况判断依据时，还需要考虑外接设备500的开关状态，以避免开关状态影响判断过程。例如，在检测外接设备500是否支持ALLM协议时，读取到ALLM对应位置的状态值为1，表示当前外接设备500支持ALLM协议，但在后续使用中外接设备500被用户设置关闭了ALLM协议。即虽然设备信息表中记载该外接设备500支持ALLM协议，但在后续这次接入过程中，由于ALLM协议开关被关闭，因此此次播放过程无法按照ALLM协议控制切换播放模式，仍需要使用SPD数据帧确定设备类型以切换播放模式。
因此，在一些实施例中，当外接设备500与显示设备200进行连接时，如果判断当前外接设备500不是第一次接入显示设备200，还可以根据ALLM的开关状态执行不同的画质、音质调整程序。
例如，当ALLM开关为开启状态时，显示设备200可以通过线程循环体实时对外接设备500的ALLM状态变化进行检测，如果ALLM状态变化为ALLM＝1，则进一步获取外接设备500发送的视频数据和/或音频数据，从而根据该数据检测外接设备500的使用场景。检测过程中，显示设备200可以获取外接设备500此时的游戏画面，并对游戏画面执行图像分析处理，以确定当前游戏画面所属的游戏类型分类，并根据不同的游戏类型设置不同的画质、音质参数。如对于射击类、运动类、动作类游戏类 型，需要降低游戏画面的延迟，以使游戏体验更加流畅。如果ALLM状态变化为0，则可以停止上述画质、音质的处理，将画质、音质参数恢复为用户自定义值，以保证用户的正常观影体验。
当ALLM开关为关闭状态时，由于显示设备200不能直接通过ALLM协议获取外接设备500的使用场景，因此可以获取外接设备500的SPD信息。即如果外接设备500发送的数据流中带有SPD信息，则可以解析SPD信息，先获取外接设备500的设备类型，再根据外接设备500的类型不同，选择不同的画质、音质调整方式。例如，通过解析SPD信息，显示设备200可以对外接设备500是否为游戏设备进行判断，如果外接设备500是游戏设备，则可以根据游戏画面对当前所运行的游戏类型进行判断，并根据不同的游戏类型设置不同的画质、音质参数。而如果外接设备500不是游戏设备，则可以将画质、音质参数恢复为用户自定义值，以保证用户的正常观影体验。
可见，在本实施例中，对于支持自动控制协议的外接设备500，可以根据不同的开关状态执行对应的播放模式切换方式，使显示设备200能够自动对外接设备500的使用场景进行判断，并根据外接设备500的使用场景，调整显示设备200的工作模式，以实现显示设备200的画质效果、音质效果可以与外接设备500的使用场景联动，实现更佳的用户体验。
<画质参数设置>
在一些实施例中，设置画质参数时，还可以通过调用历史记录信息获取相应的画质参数。例如，显示设备200可以记录自动进入游戏模式之前用户设置的图像模式，并在进入自动游戏模式之后，设置相应的图像模式参数。如果用户在自动进入游戏模式的情况下对图像模式参数进行手动更改，显示设备200还需要记忆用户设置的图像模式。其中，针对不同的游戏模式，显示设备200还可以记录其游戏模式下对应的图像模式参数。例如，显示设备200可以通过识别游戏图像类型，自动设置为SDR游戏、HDR游戏、杜比游戏等模式。
另外，在游戏过程中，显示设备200还可以通过实时识别游戏的画面信息，区分游戏的类型，从而在游戏模式下更改基本画质参数，以达到更好的游戏体验。为了获得更好的用户体验，当用户拔掉游戏机时，不会主动切出游戏模式，而是等待下一个设备的接入。再判断新接入的设备类型，如果是游戏机则不需切出，若是机顶盒等其他类型设备，则切到上一次用户设置的图像模式。
为了获得上述效果，在一些实施例中，显示设备200可以在进入游戏模式后，设置游戏模式标签，即设置“setGameModeFlag＝true”，再根据图像模式类型确定要设置的游戏图像类型，如果要设置的图像类型与当前的模式相同，则保存游戏模式。再通过设置硬件抽象层(Hardware Abstraction Layer，HAL)的图像模式(picmode)，以及更新背光、图像参数以及动态对比度曲线等，完成图像模式设置。
此外，在游戏过程中，显示设备200还可以对当前图像是否为可变刷新率模式(VRR)进行判断，如果是VRR模式，则通过记忆的数据判断上次游戏过程中是否为VRR模式，以及游戏模式是否发生变化，从而设置输出模式为PC以及并将播放模式设置为低延迟模式，并更新模式标识，以供在后续游戏中调用。在进行图像模式设置的过程中，还可以按照游戏模式设置相应的画质处理算法，例如根据是否为图像模式设置游戏过程中是否执行插黑、运动补偿、降噪处理以及SDR与HDR模式的转化等 处理。
在一些实施例中，播放模式的切换方式可以通过手动或自动的方式进行主动控制，即显示设备200在切换播放模式后，还可以实时监控外接设备500的使用场景，并根据使用场景的改变，再次切换播放模式。例如，在显示设备200通过ALLM协议帧或者SPD设备信息帧自动切换播放模式时，可以在以下4种条件停止自动切换播放模式，即用户手动切换图像模式；信号源切换；外接设备500从显示设备200中拔出；外接设备200的ALLM/SPD驱动控制。
在检测到显示设备200处于的设定状态时，可以控制返回初始的播放模式，并完成相应的控制流程。例如，在使用显示设备200过程中，可以在显示设备200处于上述4种场景后，判断是否已经进入游戏模式，如果是，则先退出SOC/FRC的游戏模式，并且将游戏模式标志清零，再执行对应的退出流程，如图像模式切换流程、信号源切换流程、设备拔出流程以及恢复图像参数流程等。
上述实施例中显示设备200可以通过配置自动适应外接设备500的使用场景，以切换播放模式。通过对显示设备200的控制器250配置控制程序，使其在获取外接设备500发送的数据流后，从数据流中解析当前外接设备500所支持的控制协议。如果外接设备500支持自动控制协议，根据数据流指定的切换播放模式；如果外接设备500不支持自动控制协议，根据外接设备的设备类型切换播放模式。
为了使显示设备能够实现上述功能，如图16所示，在本申请的部分实施例中，还提供一种外接设备500包括：数据接口510和处理器520，其中，数据接口510被配置为连接显示设备200；处理器520被配置控制程序，以获取待播放数据流和外接设备500类型，并根据设备类型，生成设备信息帧。再将设备信息帧添加到数据流中，以发送给显示设备，使所述显示设备将播放模式切换至与所述设备类型相适应的模式。
上述实施例中提供的外接设备500可以在与显示设备200建立连接关系后，通过检测自身设备类型，生成包含设备类型的设备信息帧，并将设备信息帧添加到数据流中，从而与数据流一同发送给显示设备200，以便显示设备200可以按照外接设备500的设备类型切换播放模式。外接设备500可以通过配置简单的控制程序，使显示设备200能够获得设备类型，以自动切换播放模式，提高数据流的输出效果。
<播放模式标志>
在本申请的部分实施例中，显示设备200为了实现上述自动适应使用场景，并切换播放模式，可以在播放进程中内置播放模式标志，使显示设备200可以通过检测播放模式标志，切换不同的播放模式。其中，播放模式标志可以由显示设备200通过判断数据流的内容设置为不同的状态。例如，播放模式标志可以包括“激活(true)”和“未激活(false)”两个状态。显示设备200在检测到不同的播放模式标志时，可以切换至不同的播放模式。
具体的，如图17所示，显示设备200可以先接收用户输入的用于播放数据流的控制指令。显示设备200可以在运行过程中，实时接收用户输入的控制指令，不同的控制指令可以具有不同的功能，且对应不同的交互方式。用于播放数据流的控制指令是指能够触发显示设备200对数据流进行解析、处理并转化为视频或音频信号的控制指令。根据实际数据流来源的不同，用于播放数据流的控制指令也不同。
当显示设备200播放外接设备500发送的数据流时，用播放数据流的控制指令可 以通过选择信号源的动作完成。例如，游戏设备通过HDMI接口连接显示设备200以后，用户可以通过显示设备200的控制主页点击“信号源”选项，并在弹出的外接设备500列表中选择HDMI接口，即可通过游戏设备获取数据流以进行播放。即播放控制指令是上述信号源选择过程。
用于播放数据流的控制指令还可以由显示设备200通过判断工作状况自动触发完成输入。例如，在智能终端等外接设备500通过投屏协议向显示设备200发送数据流时，显示设备200可以在接收到数据流后，自动播放数据流。即显示设备200在判断到有投屏数据流输入时，自动生成用于播放数据流的控制指令。
需要说明的是，由于数据流可以来源于外接设备500也可以不来源于外接设备500，如显示设备200本地媒资等，对于这部分数据流的播放过程，也需要对应输入播放控制指令。例如在播放本地媒资时，用户可以通过显示设备200的媒资列表界面，选中任一媒资文件，并打开播放，此时用于播放数据流的控制指令为上述打开媒资文件操作。
在接收到用于播放数据流的控制指令后，显示设备200可以再响应于该控制指令，获取待播放的数据流。显然，当数据流具有不同的来源时，显示设备200获取数据流的方式也不同。例如，数据流可以由外接设备500发送给显示设备200，也可以由显示设备200调用内置的存储器获取，还可以由显示设备200通过访问特定的媒资链接获取。
显示设备200获取的数据流可以由多个连续帧构成的数据流，数据流形式也可以根据不同的来源表现为不同的形式。以视频数据流为例，对于外接设备500发送给显示设备200的数据流，数据流可以由多个显示图像帧以及与数据流传输相关的数据帧构成，如设备信息帧、协议帧等。而对于本地存储的数据流，其中可以仅包括多个显示图像帧。
在获取数据流后，显示设备200可以在对数据流进行播放前，检测播放模式标志，以获得播放模式标志处于激活状态的目标播放模式。其中，所述目标播放模式包括用于画质处理的图像参数，即在特定的播放模式中可以对应包含有一些列图像参数，这些图像参数可以用来执行画质处理。例如，图像参数可以包括是否启用HDR(High Dynamic Range，高动态范围)以及HDR功能参数等。
在一些实施例中，显示设备200可以遍历播放模式标志的状态，如果目标播放模式对应的播放模式标志为激活状态，则提取目标播放模式的图像参数，以便按照图像参数修改画质处理进程的处理参数，实现切换播放模式。
通过对播放模式标志的检测，当检测到播放模式标志为激活状态时，则代表播放当前数据流需要切换播放模式。例如，可以在显示设备200的播放进程中设置适用于游戏播放场景的低延迟模式标志，通过检测低延迟模式标志是否为true，可以控制显示设备200进入或退出低延迟模式。
由于显示设备200可以支持多种播放模式，因此显示设备200的播放进程中可以预置多个播放模式标志。在检测播放模式标志时，可以分别对多个播放模式标志的状态进行检测，从而在检测到任一播放模式标志处于激活状态时，将显示设备200的播放模式切换至对应的模式，即目标播放模式。
例如，在显示设备200的播放进程中可以内置低延迟模式标志和高画质模式标志， 当检测到待播放数据流是游戏数据时，可以检测到低延迟模式标志为true，高画质模式标志为false，即获得目标播放模式为低延迟模式；同理，当检测到待播放数据流是机顶盒发送的电视直播画面数据，则可以检测到低延迟模式标志为false，高画质模式标志为true，即获得目标播放模式为高画质模式。
在获得目标播放模式以后，显示设备200还可以按照目标播放模式对数据流执行画质处理，以输出最终的媒资画面。例如，通过检测播放模式标志位，得到目标播放模式为低延迟模式时，显示设备200可以按照低延迟模式，关闭非必要的画质处理项目，如运动补偿、超分算法以及降噪处理等项目。
可见，在上述实施例中，显示设备200可以通过检测播放模式标志，确定目标播放模式。并按照目标切换模式进行画质处理，实现针对不同形式的数据流，采用不同的播放模式，以获得更好的输出效果。
需要说明的是，上述实施例以视频类型的数据流为例，描述了针对视频画面进行画质处理时自动切换播放模式的具体方式。显然，上述自动切换播放模式的方式也可以应用于音频类型的数据流，或者视频与音频复合型的数据流。相应的，只需要在显示设备200的播放进程中预置相应的多个播放模式标志即可实现对数据流的音质处理和/或画质处理。
由于显示设备200需要通过检测播放模式标志确定目标播放模式，因此播放模式标志的状态将直接影响播放模式的切换方式。为了能够通过播放模式标志检测到对应的状态，可以通过显示设备200或者外接设备500维护各播放模式标志，即如图18所示，在一些实施例中，显示设备200可以在获取待播放的数据流后，从数据流中提取使用场景信息，再调用播放模式对照表，并按照使用场景信息，从播放模式对照表中匹配播放模式代码，以便根据匹配命中的播放模式代码设置播放模式标志。
其中，所述播放模式对照表中包括多个使用场景以及与每个使用场景相适应的播放模式代码。在数据流中提取出使用场景信息后，显示设备200可以使用场景信息为索引值，在播放模式对照表中进行匹配。如果播放模式对照表中存在与当前使用场景信息相同的表项，则可以在播放模式对照表中提取该使用场景对应的播放模式代码。即匹配命中时，提取命中的表项。
在本实施例中，播放模式代码不仅用于识别不同的播放模式，而且可以用于设定播放模式标志的状态。即在一些实施例中，当播放模式标志处于激活状态时，还可以进一步包括特定的数值用于表示目标播放模式。例如，可以根据播放模式代码设置播放模式标志为“A/LLM”，在检测播放模式标志，可以先检测到“A”，即播放模式标志处于激活状态，再检测到“LLM”表示目标播放模式为低延迟模式。因此，基于播放模式对照表可以通过设置播放模式标志指示目标播放模式，从而减少预置的播放模式标志项目数量。
<场景信息>
针对不同来源的数据流，显示设备200可以采用不同的方式获取使用场景信息。通常，显示设备200所能够播放数据流的来源一般包括两个方面，一种为显示设备200本地的数据流，另一种为外接设备500发送给显示设备200的数据流。对于显示设备200本地的数据流，由于显示设备200可以通过自身的场景检测程序直接获得当前的使用场景，例如，当检测到显示设备200打开本地电影资源文件进行播放时，可以确 定当前使用场景为影视场景，而当检测到显示设备200运行游戏应用时，可以确定当前使用场景为游戏场景，因此显示设备200可以很容易的获取到数据流对应的使用场景。
对于外接设备500发送的数据流，则需要显示设备200从数据流中读取出使用场景信息。为了使显示设备200能够从数据流中提取到使用场景信息，显示设备200还可以针对数据流进行进一步分析，例如在数据流中提取协议帧数据或者对数据流中的显示图像执行场景识别等。
为了能够快速提取出使用场景信息，在对数据流进行分析的过程中，显示设备200可以按照不同的外接设备500类型采用不同的分析方式。即如图19所示，在一些实施例中，对于支持自动控制协议的外接设备500，显示设备200可以先从获取的数据流中提取协议帧。其中，所述协议帧为外接设备500基于自动控制协议生成的数据帧，例如对于支持ALLM协议的游戏设备，在运行游戏应用时，游戏设备会在发送给显示设备200的数据流中添加基于ALLM协议的协议帧，在协议帧中，可以通过特定位置的标志位状态值ALLM＝1，表示对当前使用场景为游戏场景。
因此，在提取到协议帧后，显示设备200可以通过遍历协议帧中的标志位状态值，查询当前使用场景信息。例如，对于游戏机，当遍历获得标志位状态值ALLM＝1时，查询到当前使用场景为游戏场景；当遍历获得标志位状态值ALLM＝0时，查询到当前使用场景为非游戏场景。
对于支持多种使用场景的外接设备500，还可以通过设置协议帧上的预留标志位的状态值，向显示设备200传递当前使用场景信息。例如，对于计算机设备，可以利用HDMI规范中预留的两个bit位，表示使用场景，包括：Rsvd1＝0且Rsvd0＝0表示游戏场景；Rsvd1＝0且Rsvd0＝1表示即时通信场景；Rsvd1＝1且Rsvd0＝0表示办公场景，Rsvd1＝1且Rsvd0＝1表示运动场景等。
因此，显示设备200还可以通过遍历协议帧数据中多个bit位上的状态值。从而根据多个bit位上的状态值组合，读取当前使用场景信息。例如，显示设备200可以每间隔1s，在数据流中提取协议帧数据，并在扩展协议指定的两个bit位上读取状态值。当读取到Rsvd1＝0且Rsvd0＝0时，则确定当前计算机设备处于游戏场景。当读取到Rsvd1＝1且Rsvd0＝1时，则确定当前计算机设备处于观看球赛等运动场景。再根据不同的使用场景，切换不同的播放模式。
对于不支持自动控制协议的外接设备500，由于其不能按照自动控制协议生成协议帧，因此无法在数据流中提取到基于自动控制协议的协议帧。对此，显示设备200可以通过图像处理、AI识别等方式对数据流对应的显示画面执行场景分析，以获得当前使用场景，即如图20所示，在一些实施例中，显示设备200可以先从数据流中提取多帧显示图像，再将多帧显示图像输入场景识别模型，以通过场景识别模型对多帧显示图像执行场景识别，从而获取场景识别模式输出的使用场景信息。
其中，所述场景识别模型为根据样本图像训练获得的神经网络模型。样本图像则是一种用于训练的图像，包括外接设备500所支持的多个使用场景下的显示图像以及每个显示图像对应的使用场景标签。场景识别模型作为一种分类模型，可以在输入显示图像后，通过模型内部的神经网络算法，计算出该显示图像的分类概率，即该显示图像对应所属的使用场景。
显然，在执行自动控制协议的检测前，可以在显示设备200中构建一个场景识别模型。例如，场景识别模型可以通过执行神经网络模型训练获得，即可以先构建初始模型，再将样本图像逐一输入至该初始模型，以获得模型输出结果。再将模型输出结果与标签信息进行对比，确定分类误差，并使用分类无法反向传播调整模型参数。基于此，通过多次输入一定数量的样本图像，可以逐步对模型参数进行调整，以最终获得较高准确率的场景识别模型。
在构建场景识别模型后，显示设备200可以将从数据流中提取的显示图像输入到场景识别模型，以获得场景识别结果。根据与显示设备200连接的外接设备500类型不同，场景识别模型可以输出的识别结果种类也不同。例如，对于游戏设备，场景识别模型可以输出的使用场景信息包括游戏场景和非游戏场景；而对于计算机设备，场景识别模型可以输出的使用场景包括游戏场景、即时通信场景、办公场景以及运动场景等。因此，在执行场景识别时，还可以针对不同类型的外接设备500调用不同的场景识别模型，以获得相适应的场景分类。
需要说明的是，显示设备200提取的使用场景信息，可以是指显示设备200的使用场景也可以是指外接设备500的使用场景。例如，数据流为显示设备200本地媒资对应产生的数据时，使用场景是显示设备200的当前使用场景，而当数据流是由外接设备500发送的数据时，使用场景是外接设备500的使用场景。但无论数据流对应的使用场景是显示设备200的使用场景还是外接设备500的使用场景，针对不同的使用场景，显示设备200都可以在播放数据流时使用不同的播放模式。
由于在本申请实施例中，显示设备200是通过检测播放模式标志的状态来执行播放场景切换，而播放模式标志会随着使用场景的改变而处于不同的状态，因此，为了能够跟随使用场景改变而切换不同的播放模式，显示设备200可以持续对播放模式标志进行检测，当播放模式标志的状态改变时，需要对播放模式执行切换，而当播放模式标志未改变时，则无需对播放模式进行切换。
即如图21所示，在一些实施例中，在检测播放模式标志时，显示设备200可以先获取当前播放模式，并提取当前播放模式的图像参数。如果目标播放模式的图像参数与当前播放模式的图像参数不同，设置播放模式标志为激活状态，以使显示设备200在检测到播放模式标志为激活状态时，切换播放模式。
例如，当游戏设备退出运行游戏的过程中，发送给显示设备200的数据流将从游戏画面数据转变为主页界面数据，即使用场景从游戏场景转化为非游戏场景。显示设备200通过数据流检测到使用场景改变后，可以获取当前播放模式，即低延迟模式；再提取目标播放模式，即高画质模式。显然，两种播放模式对应的图像参数不同，因此显示设备200可以设置播放模式标志为“true”，以便显示设备200的播放程序可以根据播放模式标志将播放模式切换为高画质模式。
如果目标播放模式的图像参数与当前播放模式的图像参数相同，设置播放模式标志为未激活状态，以使显示设备200维持当前播放模式。例如，在持续使用游戏机进行游戏时，发送给显示设备200的数据流一直是游戏画面数据，因此显示设备200获得的当前播放模式与目标播放模式均为低延迟模式，即对应的图像参数相同，因此显示设备200可以设置播放模式标志为“false”，以便显示设备200的播放程序可以根据播放模式标志，维持播放模式为低延迟模式。
在一些实施例中，为了使显示设备200在切换多个播放模式后，可以还原回用户设置的画质处理方式，显示设备200还可以记录当前播放模式的图像参数，并周期性检测所述播放模式标志，当检测到播放模式标志更改为未激活状态后，按照当前模式的图像参数还原播放模式。
显示设备200可以在接收到退出指令后，根据退出指令，将播放模式还原至用户设定的图像参数模式，即如图22所示，在一些实施例中，显示设备200可以在接收到退出指令后，响应于退出指令，检测播放模式标志。如果播放模式标志为激活状态，则停止按照目标播放模式对数据流执行画质处理，而通过用户设置的图像参数执行画质处理，同时将播放模式标志设置为未激活状态。
其中，所述退出指令可以由用户手动输入，例如，在用户手动输入切换播放模式的交互指令时生成退出指令，并输入给显示设备200；也可以在显示设备200检测到使用状况满足特定条件时自动输入，例如，在控制器250检测到待播放的数据流更改时生成退出指令；或者，在控制器250检测到外接设备500与外部装置接口240断开连接时生成退出指令；或者，由外接设备500按照自动控制协议生成。
例如，在显示设备200进入低延迟模式后，可以有4种退出低延迟模式的场景，即：用户手动切换图像模式；数据流更改为游戏数据以外的数据；游戏设备拔出显示设备200；游戏设备通过自动控制协议控制显示设备200退出低延迟模式。这4种场景可以在原来的流程增加判断是否已经进入低延迟模式，即检测播放模式标志的检测过程。如果检测到处于低延迟模式，是需要先退出SOC/FRC的低延迟模式，并将低延迟模式对应标志清零，从而实现播放模式的还原。
基于上述显示设备200，在本申请的部分实施例中还提供一种画质调整方法，所述画质调整方法包括：先接收用户输入的用于播放数据流的控制指令，再响应于控制指令，获取待播放的数据流。通过检测播放模式标志，以获得播放模式标志处于激活状态的目标播放模式，从而按照目标播放模式对数据流执行画质处理。
可见，上述画质调整方法可以在接收到播放控制指令后，获取待播放的数据流，并在执行播放前，自动对播放模式标志进行检测，确定处于激活状态的目标播放模式，从而按照目标播放模式对待播放的数据流执行画质处理。所述画质调整方法可以通过在显示设备200的播放程序中设置播放模式标志，并根据播放模式标志实时切换播放模式，使显示设备200能够自动适应不同的数据流形式，提高播放效果。
<多个外部装置连接>
在一些实施例中，如图23所示，在显示设备200上可以设置有多个外部装置接口240，多个外部装置接口240可以分别连接不同的外接设备500。例如，显示设备200上可以设有两个HDMI接口，即HDMI1和HDMI2。其中，HDMI1接口连接游戏设备，HDMI2接口连接机顶盒。在使用过程中，游戏设备和机顶盒都可以向显示设备200发送数据流，但同一时刻显示设备200只能够对其中一个设备发送的数据流进行播放。
对此，在显示设备200通过多个外部装置接口240与多个外接设备500连接时，需要用户执行信号源切换操作，以控制显示设备200选择输出任一外接设备500的数据流。例如，在显示设备200输出HDMI1接口游戏设备的数据流时，可以通过切换信号源操作，控制显示设备200输出HDMI2接口机顶盒的数据流。同理，在显示设备200输出HDMI2接口机顶盒的数据流时，可以通过切换信号源操作，控制显示设 备200输出HDMI1接口游戏设备的数据流。
不同外接设备500对应需要的播放模式不同，如播放游戏设备的数据流时，需要显示设备200采用低延迟模式，而播放机顶盒的数据流时，需要显示设备200采用高画质模式。可见，当显示设备200执行信号源切换功能时，切换后显示设备200的播放模式可能与外接设备500所需要的播放模式不匹配，影响切换后数据流的输出质量。例如，显示设备200的信号源从HDMI1切换至HDMI2后，显示设备200输出机顶盒对应的数据流，但此时显示设备200的播放模式仍旧是游戏设备相适应的低延迟模式，导致机顶盒发送的数据流不会通过显示设备200的画质处理，降低画面质量。
因此，在切换信号源的过程中，显示设备200也可以根据切换过程对播放模式也进行切换。即如图24所示，在本申请的部分实施例中还提供一种显示设备200，显示设备200包括显示器275、控制器250和多个外部装置接口240。其中，多个外部装置接口240分别连接不同外接设备500，显示器275用于显示用户界面以及显示外接设备500发送的媒资数据画面。控制器250则被配置为执行本申请中多设备切换时的播放方法，以使切换后的播放模式与外接设备500相匹配，提高媒资数据的输出质量。
具体的，如图25所示，显示设备200可以先获取用户输入的用于切换信号源的控制指令。用户可以通过遥控器、手机等控制装置100输入交互动作，控制显示设备200切换信号源。例如，用户可以通过按下遥控器上的“信号源”按键，使显示设备200在多个信号源之间执行切换。由于每个信号源可以对应一个外接设备500，因此执行信号源切换的过程，即切换接入显示设备200的外接设备500的过程。
显示设备200还可以在操作系统控制界面中提供切换信号源的选项，当用户通过手机或遥控器输入交互动作点击该选项后，显示设备200可以跳转至信号源列表，再通过点击信号源列表中的某一选项，将显示设备200切换至输出对应选项的音视频数据。例如，用户通过主控制界面或状态栏点击信号源切换选项，则弹出信号源列表，在信号源列表中可以包括“HDMI1”、“HDMI2”等选项。当用于点击HDMI2选项后，即可将显示设备200的信号源切换至HDMI2接口所连接的外接设备500。
而对于支持其他交互方式的显示设备200，还可以通过所支持的输入方式输入用于切换信号源的控制指令。例如，对于支持智能语音系统的显示设备200，可以通过语音输入诸如“切换信号源”、“连接HDMI2”的内容，控制显示设备200切换信号源。
此外，由于在实际应用中，显示设备200只能够针对一个外接设备500输出媒资数据，为了节约能源，连接显示设备200的多个外接设备500中，未通过显示设备200输出媒资数据的外接设备500通常处于关闭或待机状态，此时将不会向显示设备200发送媒资数据，而在其想要通过显示设备200输出媒资数据时，通常被激活而向显示设备200发送数据流，因此，在实际应用中，还可以显示设备200实时检测各外部装置接口240的数据输入情况，当检测到任一外部装置接口240有数据流输入时，自动将信号源切换至该外部装置接口240。
在接收到切换信号源的控制指令后，显示设备200可以响应于该控制指令，通过外部装置接口240接收外接设备500发送的数据流。例如，在显示设备200的HDMI1接口连接游戏设备，HDMI2接口连接机顶盒时，显示设备200可以默认输出HDMI1接口的数据流，即显示设备200可以通过HDMI1接口接收游戏设备发送数据流，如游戏画面数据等；在接收到用户输入的信号源切换控制指令后，显示设备200切换至 输出HDMI2接口的数据流，即通过HDMI2接口接收机顶盒发送的数据流，如电视直播画面数据等。
数据流可以通过多个连续帧从外接设备500发送到显示设备200，以形成数据流。显示设备200则通过对数据流的持续解析、渲染，形成具体的显示画面。由于显示设备200和外接设备500之间可以进行部分交互控制，因此显示设备200接收到的数据流中不仅包括提供视频或音频画面的内容帧数据，而且包括设备信息帧、协议帧等与数据传输过程相关的帧数据，即所述数据流包括协议帧和设备信息帧中的至少一种。
其中，设备信息帧是由外接设备500按照基础传输协议发送的，包含设备类型信息的数据帧；协议帧是由外接设备500按照自动控制协议发送的，包含使用场景信息的数据帧。对于不同的外接设备500，其发送的数据流中所包含的与传输过程相关的帧数据也不同。例如，对于大多数外接设备500，设备信息帧可以是HDMI协议中规定的一种描述设备自身信息的源设备描述(Source Product Description，SPD)数据帧。因此，通过HDMI接口接入显示设备200的外接设备500均可以在数据流中携带SPD数据帧。设备信息帧中可以包括用于描述当前外接设备500的相关信息，如设备名称、设备类型等，显示设备200可以通过读取设备信息帧识别接入的外接设备500。
而对于部分支持自动控制协议的外接设备500，在向显示设备200发送设备信息帧的同时，还可以发送协议帧。例如，支持ALLM协议的外接设备500，可以基于ALLM协议生成协议帧数据，并与内容帧和SPD帧一起发送给显示设备200。协议帧数据中可以包括与自动控制相关的内容，如控制指令等。显示设备200可以根据协议帧中的控制指令，切换播放模式。协议帧中还可以包括外接设备500的当前使用场景信息，例如游戏场景和非游戏场景等。
在接收到外接设备500发送数据流后，显示设备200还可以提取数据流中的协议帧和/或设备信息帧，并读取协议帧和/或设备信息帧中的标志位状态值。其中，标志位是指在设备信息帧和/或协议帧中的一个特定数据位置。按照传输协议所规定的数据排布方式，显示设备200接收到的数据帧中，每一个用于表示具体含义的数据都设置在一个特定的位置上，并通过不同的状态值表示其具体状态。
例如，对于SPD数据帧，其中的第25个字节(data byte 25)为设备分类，在第25个字节位上对应状态值代表外接设备500的设备类型，如下表所示，不同的状态值可以代表不同的设备类型：
data byte 25 设备类型 data byte 25 设备类型
00 未知设备 07 VCD
01 机顶盒 08 游戏设备
02 DVD播放器 09 计算机
03 录像机 0A 蓝光影碟机
04 HDD录像机 0B 数字唱片机
05 DVC摄像机 0C 高清DVD
06 工控机 0D 多媒体播放器
基于上表，显示设备200可以从其中读取标志位状态值获取以获取切换信号源后接入显示设备200的外接设备500类型。例如，当读取到特定字节位置上的设备分类数值为“08”，代表接入显示设备200的外接设备500为游戏设备。
而对于协议帧，显示设备200可以进一步提取出外接设备500的当前使用场景。例如，对于支持ALLM协议的游戏设备，当检测到协议帧中ALLM值等于1时，表示外接设备500处于游戏场景；当ALLM值等于0时，表示该外接设备500处于非游戏场景。
<多场景切换>
对于支持多种使用场景的外接设备500，还可以通过附加定义部分数据字段，表示各使用场景。例如，可利用HDMI规范中预留的多个bit位表示外接设备500的使用场景信息。对于计算机设备，可以利用HDMI规范中预留的两个bit位，表示使用场景，包括：Rsvd1＝0且Rsvd0＝0表示游戏场景；Rsvd1＝0且Rsvd0＝1表示即时通信场景；Rsvd1＝1且Rsvd0＝0表示办公场景，Rsvd1＝1且Rsvd0＝1表示运动场景等。
相应的，显示设备200可以通过获取协议帧数据，并遍历协议帧数据中多个bit位上的参数值(状态值)。从而根据多个bit位上的参数值组合，读取当前使用场景信息。例如，显示设备200可以在协议帧中指定的两个bit位上读取参数值，当读取到Rsvd1＝0且Rsvd0＝0时，则确定当前计算机设备处于游戏场景，当读取到Rsvd1＝1且Rsvd0＝1时，则确定当前计算机设备处于观看球赛等运动场景。
显示设备200在接收到数据流后，可以通过提取协议帧和/或设备信息帧中的标志位状态值，实现对切换信号源后外接设备500的设备类型或使用场景进行检测。从而按照标志位状态值切换播放模式。当切换前后外接设备500的设备类型或使用场景发送改变时，显示设备200可以按照切换后外接设备500切换播放模式。
例如，当用户输入控制指令以使显示设备200对应输出的数据流从HDMI1的游戏设备切换至HDMI2的机顶盒后，由于游戏设备适用低延迟模式，而机顶盒适应高画质模式，因此，通过设备信息帧读取到“data byte 25”的状态值从“08”切换至“01”后，需要将显示设备200的播放模式从低延迟模式切换至高画质模式。
可见，上述实施例中提供的显示设备200可以在用户输入切换信号源的控制指令后，通过接收切换后外接设备500所发送数据流，并从中提取协议帧和/或设备信息帧的标志位状态值，检测切换前后外接设备500的设备类型或者使用场景是否发生变化，并按照标志位状态值切换播放模式，使显示设备200可以自动适应切换后外接设备500的数据流播放方式，缓解多设备切换时播放模式与音视频数据不匹配的问题。
由于不同类型的外接设备500所发送的数据流中携带的帧数据不同，因此在提取协议帧和/或设备信息帧中的标志位状态值时，需要采用不同的数据提取方式。为此，如图26所示，在一些实施例中，显示设备200可以对外接设备500的设备类型进行识别，即可以从数据流中提取设备信息帧，并遍历设备信息帧中的标志位状态值，再根据所述标志位状态值检测切换信号源前后外接设备500的设备类型，以实现按照设备类型，提取协议帧和/或设备信息帧中的标志位状态值。
其中，按照外接设备500所支持的传输协议的不同，可以将外接设备500划分为三类，即自动控制协议设备、通用协议设备和普通接口设备。其中，自动控制协议设备是指支持ALLM协议等自动控制协议的设备，例如，xbox游戏机、计算机等。自动控制协议设备可以通过自动控制协议直接向显示设备200发送控制指令，以使其切换播放模式。
通用协议设备是指不支持自动控制协议但支持基础传输协议的设备，例如ps游戏 机、机顶盒等。通用协议设备一般不能直接向显示设备200发送控制指令，因此可以通过对设备分类或者场景识别，切换播放模式。
普通接口设备则是指既不支持自动控制协议，也不支持通用传输协议的设备，通常为功能单一、数据形式简单的输出设备，如摄像头、麦克风等。普通接口设备通常不需要特定的播放模式，通过用户自定义设置的输出模式即可满足数据流的输出要求。
基于上述设备类型，显示设备200可以在检测出切换后的设备类型后，按照设备类型从数据流中提取标志位状态值。例如，当检测到切换信号源后，接入显示设备200的外接设备500为自动控制协议设备，则需要从数据流中提取协议帧，从而通过协议帧确定外接设备500的当前使用场景，并根据当前使用场景切换播放模式。当检测到切换信号后，接入显示设备200的外接设备500为通用协议设备，则从设备信息帧中提取设备分类，从而按照设备分类切换播放模式。当检测到切换信号源后，接入显示设备200的外接设备500为普通接口设备时，可以直接将播放模式还原为用户自定义的模式。
如图27所示，在一些实施例中，为了便于显示设备200切换播放场景，可以在显示设备200中设置播放模式切换程序，模式切换程序可以包括解析线程和图像中间件，其中，解析线程可以是一种循环体，用于实时检测数据流中设备信息帧和协议帧中的标志位状态值。因此，所述解析线程包括协议帧解析线程和设备信息帧解析线程。图像中间件用于根据解析线程检测的标志为状态值切换播放模式。解析线程与图像中间件之间可以是相互独立的两个程序模块，可通过软件接口相互调用，完成播放场景切换。
因此，在按照标志位状态值切换播放模式的过程中，显示设备200可以先调用解析线程，以利用解析线程监测协议帧和/或设备信息帧的标志位状态值，当解析线程检测到标志位状态值发生变化，则可以根据标志位状态值变化情况设置接口标签值，从而使图像中间件能够获取接口标签值，并根据接口标签值切换播放模式。其中，为了便于图像中间件进行判断，接口标签值可以包括自动控制协议标签值以及通用协议标签值，两种标签值的取值均为1或0，其中，当标签值等于1时，表示图像中间件需要将播放模式切换至特定的模式；当标签值等于0时，表示图像中间件不需要将播放模式切换至特定的状态，还原回用户设置。
下面将结合几种外接设备500切换场景对本申请中根据标志位状态值切换播放模式的方式进行阐述，主要包括：
在一些实施例中，如果切换信号源前后的设备类型为普通接口设备和自动控制协议设备，则显示设备200可以在协议帧的标志位上提取第一状态值。即显示设备200可以从协议帧中识别切换前后外接设备500是否支持自动控制协议。如果第一状态值为1，则代表切换后接入显示设备200的外接设备500支持自动控制协议，因此可以切换播放模式为自动控制模式。同理，如果获取到的第一状态值为0，表示切换信号源后接入显示设备200的外接设备500是不支持自动控制协议的普通接口设备，因此可以切换播放模式为用户设置模式。
例如，如图28、图29所示，在ALLM协议设备和普通HDMI设备互相切换的过程中，如果从普通HDMI设备切换到ALLM协议设备，则先检测ALLM状态解析线程循环体读取到ALLM状态变化至ALLM＝1，再调用图像中间件ALLM接口标签值， 设置ALLM标签值为1，使得图像中间件获取到ALLM标签值为1，进而调整显示设备200进入低延迟模式。如果从ALLM协议设备切换到普通HDMI设备，则先检测ALLM状态解析线程循环体读取到ALLM状态变化为ALLM＝0；再调用图像中间件ALLM接口标签值，并设置ALLM标签值为0，使图像中间件获取到ALLM标签值为0后，调整显示设备200退出低延迟模式，还原用户设置。
由于部分支持自动控制协议的外接设备500可以处于多个使用场景，因此为了实现更细致的控制，在控制显示设备200进入自动控制模式以后，还可以按照自动控制协议进一步根据使用场景切换更多的播放模式。即如果第一状态值为1，显示设备200可以周期性地从数据流中获取多个协议帧，并从协议帧中预留标志位提取状态值组合。状态值组合即协议帧中多个预留标志位的状态值组合，可以用于表示外接设备500的使用场景。因此，显示设备200可以通过状态值组合查询外接设备500的使用场景，并控制切换播放模式至与使用场景相适应的模式。
例如，显示设备200通过读取协议帧中指定的两个bit位上的状态值，当读取到Rsvd1＝0且Rsvd0＝0时，则确定当前外接设备500处于游戏场景，因此可以将播放模式调整到低延迟模式。
可见，在上述实施例中，显示设备200可以通过检测协议帧中的标志位状态值，实现在普通接口设备和自动控制协议设备之间切换时的调整播放模式，从而使切换后显示设备200的播放模式能够立即与外接设备500相适应，保证切换后显示设备200可以正常输出数据流。
在一些实施例中，如果切换信号源前后的设备类型为通用协议设备和普通接口设备，则显示设备200可以在设备信息帧的标志位上提取第二状态值，并根据第二状态值获取当前状态值所指代的设备类型，以便按照设备类型切换播放模式。
例如，如图30、图31所示，接入显示设备200的外接设备500在SPD协议设备和普通HDMI设备之间互相切换时，如果是从普通HDMI设备切换到SPD协议设备，显示设备200则可以先检测SPD状态解析线程循环体读取到SPD帧信息变化，以确定切换后的设备类型是否为游戏设备或者PC设备。再调用图像中间件SPD接口，并设置SPD标签值为1，从而使图像中间件在获取到标志位1后，调整显示设备200进入低延迟模式。
如果是从SPD协议设备切换到普通HDMI设备，则显示设备200通过检测SPD状态解析线程循环体读取到SPD状态变化，确定切换后的设备类型不是游戏设备或者PC设备。再调用图像中间件SPD接口，并设置SPD标签值为0，使图像中间件在获取到标签值为0以后，调整显示设备200退出低延迟模式，还原用户设置。
可见，在通用协议设备和普通接口设备切换时，可以通过读取设备信息帧中标志位状态值，使显示设备200能够自动检测出外接设备500的设备类型，从而按照设备类型切换播放模式。显然，还可以对通用协议设备进行进一步分类，即通用协议设备可以包括适应一种播放模式的第一类设备和适应多种播放模式的第二类设备。因此，在检测到切换至通用协议设备后，显示设备200还可以根据第二状态值进一步检测其指代的设备分类，如果设备分类为第一类设备，则切换播放模式为与第一类设备相适应的播放模式。
而如果设备分类为第二类设备，为了均衡播放效果，可以控制显示设备200切换 播放模式为用户设置模式。即切换信号源为适应多种播放模式的第二类设备后，可以通过用户自定义的播放模式输出数据流，以使外接设备500在处于任何使用场景时，都能够按照用户的喜好输出数据流。
在一些实施例中，针对适应多种播放模式的第二类设备，显示设备200也可以通过图像识别、AI算法等方式，对外接设备500的使用场景进行识别，从而根据场景识别结果，切换播放模式。即如果设备分类为第二类设备，显示设备200可以从数据流中提取多帧显示图像，并对多帧显示图像执行场景识别，以获得外接设备500的使用场景，最后按照识别出的使用场景切换播放模式，使播放模式与使用场景相适应。
为了实现场景识别，显示设备200可以从数据流中提取显示图像，并将提取的显示图像输入场景识别模型，以获取场景识别模型输出的场景信息。其中，所述场景识别模型为根据样本图像训练获得的神经网络模型。样本图像则是一种用于训练的图像，包括外接设备500所支持的多个使用场景下的显示图像以及每个显示图像对应的使用场景标签。场景识别模型作为一种分类模型，可以在输入显示图像后，通过模型内部的神经网络算法，计算出该显示图像的分类概率，即该显示图像对应所属的使用场景。
显然，在执行自动控制协议的检测前，可以在显示设备200中构建一个场景识别模型。例如，场景识别模型可以通过执行神经网络模型训练获得，即可以先构建初始模型，再将样本图像逐一输入至该初始模型，以获得模型输出结果。再将模型输出结果与标签信息进行对比，确定分类误差，并使用分类无法反向传播调整模型参数。基于此，通过多次输入一定数量的样本图像，可以逐步对模型参数进行调整，以最终获得较高准确率的场景识别模型。
在构建场景识别模型后，显示设备200可以将从数据流中提取的显示图像输入到场景识别模型，以获得场景识别结果。根据与显示设备200连接的外接设备500类型不同，场景识别模型可以输出的识别结果种类也不同。例如，对于游戏设备，场景识别模型可以输出的使用场景信息包括游戏场景和非游戏场景；而对于计算机设备，场景识别模型可以输出的使用场景包括游戏场景、即时通信场景、办公场景以及运动场景等。因此，在执行场景识别时，还可以针对不同类型的外接设备500调用不同的场景识别模型，以获得相适应的场景分类。
可见在本实施例中，通过对多帧显示图像进行场景识别，同样可以检测出外接设备500的使用场景，从而在切换信号源为通用协议设备时，也可以根据外接设备500的使用场景切换播放模式，使显示设备200能够跟随外接设备500的使用情况实时调整播放模式，以输出更好的数据流播放效果。
在一些实施例中，如果切换信号源前后的设备类型为通用协议设备和自动控制协议设备，显示设备200则可以分别从协议帧的标志位提取第一状态值，从设备信息帧的标志位提取第二状态值，当第一状态值为1且第二状态值所指代的设备分类为第一类设备时，切换播放模式为自动控制模式。
例如，如图32、图33所示，在ALLM协议设备和SPD协议设备互相切换时，如果是从ALLM协议设备切换到SPD协议设备时，显示设备200可以先检测SPD解析状态线程循环体读取到SPD帧信息变化，确定其是否为游戏设备或者PC设备，再调用图像中间件SPD接口，并设置SPD接口标签值为1，使得图像中间件获取到SPD标签值为1并判断ALLM标签值也为1后，保持显示设备200进入低延迟模式。
如果是从SPD协议设备切换到ALLM协议设备，显示设备200则先检测ALLM状态解析线程循环体读取到ALLM状态变化，即ALLM＝1，再调用图像中间件ALLM接口，并设置ALLM标签值为1，使图像中间件在获取到ALLM标签值为1，且判断SPD标签值也为1后，保持显示设备200进入低延迟模式。
需要说明的是，在信号源是通用协议设备与自动控制协议设备之间进行切换的过程中，显示设备200可以在切换信号源后的数据流中提取协议帧，如果提取到协议帧并且提取到的协议帧中带有使用场景信息，则可以按照自动控制协议控制切换播放模式；如果未提取到协议帧或者提取到的协议帧中不带有使用场景信息，则可以提取设备信息帧，并根据设备信息帧提取外接设备200的设备类型，以根据设备类型切换播放模式。如果在数据流中也未提取到设备信息帧，可以确定切换后的外接设备500为普通接口设备，因此可以将播放模式切换至用户自定义模式，使得显示设备200可以针对信号源切换过程自动适配播放模式，保证媒资数据的输出质量。
基于上述显示设备200，在本申请的部分实施例中还提供一种多设备切换时的播放方法，该播放方法可以应用于上述显示设备200，并包括以下步骤：显示设备200先获取用户输入的用于切换信号源的控制指令。再响应于控制指令，接收外接设备发送的数据流，其中，数据流包括协议帧和设备信息帧中的至少一种。再从协议帧和/或所述设备信息帧中提取标志位状态值，以按照标志位状态值切换播放模式。
上述实施例提供的多设备切换时的播放方法可以在获取用户输入的信号源切换控制指令以后，在数据流中提取协议帧和设备信息帧中指定标志位状态值，从而按照标志位状态值分别检测切换前后外接设备需求的播放模式，以便在所需求的播放模式发生改变时，执行播放模式的切换。所述方法可以自动适应切换后外接设备500的数据流播放方式，能够缓解多设备切换时播放模式与音视频数据不匹配的问题。
为了方便解释，已经结合具体的实施方式进行了上述说明。但是，上述在一些实施例中讨论不是意图穷尽或者将实施方式限定到上述公开的具体形式。根据上述的教导，可以得到多种修改和变形。上述实施方式的选择和描述是为了更好的解释原理以及实际的应用，从而使得本领域技术人员更好的使用实施方式以及适于具体使用考虑的各种不同的变形的实施方式。

Claims (14)

  1. 一种显示设备，包括：
    显示器；
    多个外部装置接口，分别被配置为连接外接设备；
    控制器，被配置为：
    获取用户输入的用于切换信号源的控制指令；
    响应于所述控制指令，接收切换信号源后连接的外接设备发送的数据流，所述数据流中包括协议帧和设备信息帧中的至少一种；
    提取所述协议帧和/或所述设备信息帧中的标志位状态值；
    按照所述标志位状态值切换播放模式。
  2. 根据权利要求1所述的显示设备，所述控制器被进一步配置为通过下述提取所述协议帧和/或所述设备信息帧中的标志位状态值：
    从所述数据流中提取设备信息帧；
    遍历所述设备信息帧中的标志位状态值；
    根据所述标志位状态值检测切换信号源前后外接设备的设备类型，所述设备类型包括自动控制协议设备、通用协议设备和普通接口设备；
    按照所述设备类型，提取所述协议帧和/或所述设备信息帧中的标志位状态值。
  3. 根据权利要求2所述的显示设备，所述控制器被进一步配置为：
    如果切换信号源前后的设备类型为普通接口设备和自动控制协议设备，在所述协议帧的标志位上提取第一状态值；
    如果所述第一状态值为第一数值，切换播放模式为自动控制模式；
    如果所述第一状态值为与第一数值不同的第二数值，切换播放模式为用户设置模式。
  4. 根据权利要求3所述的显示设备，所述控制器被进一步配置为；
    如果所述第一状态值为第一数值，周期性地从所述协议帧中预留标志位提取状态值组合；
    使用所述状态值组合查询外接设备的使用场景；
    切换播放模式至与所述使用场景相适应的模式。
  5. 根据权利要求2所述的显示设备，所述控制器被进一步配置为：
    如果切换信号源前后的设备类型为通用协议设备和普通接口设备，在所述设备信息帧的标志位上提取第二状态值；
    获取所述第二状态值所指代的设备类型；
    按照所述设备类型切换播放模式。
  6. 根据权利要求5所述的显示设备，所述控制器被进一步配置为通过下述按照所述设备类型切换播放模式：
    检测所述第二状态值所指代的设备分类，所述设备分类包括适应一种播放模式的第一类设备和适应多种播放模式的第二类设备；
    如果所述设备分类为第一类设备，切换播放模式为与第一类设备相适应的播放模式；
    如果所述设备分类为第二类设备，切换播放模式为用户设置模式。
  7. 根据权利要求6所述的显示设备，所述控制器被进一步配置为：
    如果所述设备分类为第二类设备，从所述数据流中提取多帧显示图像；
    对多帧显示图像执行场景识别，以获得外接设备的使用场景；
    切换播放模式至与所述使用场景相适应的模式。
  8. 根据权利要求2所述的显示设备，所述控制器被进一步配置为：
    如果切换信号源前后的设备类型为通用协议设备和自动控制协议设备，从所述协议帧的标志位提取第一状态值，以及从所述设备信息帧的标志位提取第二状态值；
    如果所述第一状态值为第一数值，且第二状态值所指代的设备分类为第一类设备，切换播放模式为自动控制模式。
  9. 根据权利要求1所述的显示设备，所述控制器被进一步配置为按照所述标志位状态值切换播放模式：
    调用解析线程，所述解析线程包括协议帧解析线程和设备信息帧解析线程；
    利用所述解析线程监测协议帧和/或设备信息帧的标志位状态值；
    如果所述标志位状态值发生变化，设置接口标签值；
    利用所述图像中间件获取所述接口标签值，以根据所述接口标签值切换播放模式。
  10. 一种用于显示设备的多外接设备切换的播放方法，所述显示设备配置为能够连接至少两个外接设备，所述方法包括：
    获取用户输入的用于切换信号源的控制指令；
    响应于所述控制指令，接收切换信号源后连接的外接设备发送的数据流，所述数据流中包括协议帧和设备信息帧中的至少一种；
    提取所述协议帧和/或所述设备信息帧中的标志位状态值；
    按照所述标志位状态值切换播放模式。
  11. 根据权利要求10所述的方法，所述提取所述协议帧和/或所述设备信息帧中的标志位状态值包括，
    从所述数据流中提取设备信息帧；
    遍历所述设备信息帧中的标志位状态值；
    根据所述标志位状态值检测切换信号源前后外接设备的设备类型，所述设备类型包括自动控制协议设备、通用协议设备和普通接口设备；
    按照所述设备类型，提取所述协议帧和/或所述设备信息帧中的标志位状态值。
  12. 根据权利要求11所述的方法，还包括：
    如果切换信号源前后的设备类型为普通接口设备和自动控制协议设备，在所述协议帧的标志位上提取第一状态值；
    如果所述第一状态值为第一数值，切换播放模式为自动控制模式；
    如果所述第一状态值为与第一数值不同的第二数值，切换播放模式为用户设置模式。
  13. 根据权利要求12所述的方法，还包括：
    如果所述第一状态值为所述第一数值，周期性地从所述协议帧中预留标志位提取状态值组合；
    使用所述状态值组合查询外接设备的使用场景；
    切换播放模式至与所述使用场景相适应的模式。
  14. 根据权利要求12所述的方法，如果切换信号源前后的设备类型为通用协议设备和普通接口设备，还包括：
    在所述设备信息帧的标志位上提取第二状态值；获取所述第二状态值所指代的设备类型；
    按照所述设备类型切换播放模式。
PCT/CN2022/071778 2021-01-14 2022-01-13 显示设备及多设备切换时的播放方法 WO2022152201A1 (zh)

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
CN202110046140 2021-01-14
CN202110046140.2 2021-01-14
CN202110292875.3A CN114302190B (zh) 2021-01-14 2021-03-18 一种显示设备及画质调整方法
CN202110292422.0 2021-03-18
CN202110292875.3 2021-03-18
CN202110291950.4A CN114302194B (zh) 2021-01-14 2021-03-18 一种显示设备及多设备切换时的播放方法
CN202110292422.0A CN114339339B (zh) 2021-01-14 2021-03-18 一种显示设备、外接设备及播放模式切换方法
CN202110291950.4 2021-03-18

Publications (1)

Publication Number Publication Date
WO2022152201A1 true WO2022152201A1 (zh) 2022-07-21

Family

ID=80868330

Family Applications (3)

Application Number Title Priority Date Filing Date
PCT/CN2022/071778 WO2022152201A1 (zh) 2021-01-14 2022-01-13 显示设备及多设备切换时的播放方法
PCT/CN2022/071780 WO2022152203A1 (zh) 2021-01-14 2022-01-13 显示设备及用户界面主题更新方法
PCT/CN2022/071779 WO2022152202A1 (zh) 2021-01-14 2022-01-13 显示设备、外接设备及播放模式切换方法

Family Applications After (2)

Application Number Title Priority Date Filing Date
PCT/CN2022/071780 WO2022152203A1 (zh) 2021-01-14 2022-01-13 显示设备及用户界面主题更新方法
PCT/CN2022/071779 WO2022152202A1 (zh) 2021-01-14 2022-01-13 显示设备、外接设备及播放模式切换方法

Country Status (3)

Country Link
US (1) US20230336806A1 (zh)
CN (14) CN114297436A (zh)
WO (3) WO2022152201A1 (zh)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114816641B (zh) * 2022-05-09 2023-05-02 海信视像科技股份有限公司 显示设备、多媒体内容显示方法和存储介质
CN114968387A (zh) * 2022-06-07 2022-08-30 三星电子（中国）研发中心 外接设备切换方法和装置
CN114915833B (zh) * 2022-06-24 2023-11-10 Vidaa国际控股(荷兰)公司 一种显示器控制方法及显示设备、终端设备
CN115174973B (zh) * 2022-06-28 2024-05-28 海信视像科技股份有限公司 显示设备及显示设备控制方法
WO2024009919A1 (ja) * 2022-07-06 2024-01-11 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置、情報処理装置の制御方法、及びプログラム
CN115408552B (zh) * 2022-07-28 2023-05-26 深圳市磐鼎科技有限公司 显示调整方法、装置、设备及存储介质
CN115334351B (zh) * 2022-08-02 2023-10-31 Vidaa国际控股(荷兰)公司 一种显示设备及自适应画质调节方法
WO2024071730A1 (ko) * 2022-09-28 2024-04-04 삼성전자주식회사 디바이스간 데이터 동기화 방법 및 그 전자 장치
CN116366764A (zh) * 2023-03-27 2023-06-30 联想(北京)有限公司 一种控制方法、装置及电子设备
CN117156088B (zh) * 2023-04-21 2024-06-11 荣耀终端有限公司 图像处理方法及相关装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101627625A (zh) * 2007-03-13 2010-01-13 索尼株式会社 通信系统、发送装置、发送方法、接收装置以及接收方法
CN105828213A (zh) * 2012-10-04 2016-08-03 索尼互动娱乐美国有限责任公司 用于减少呈现等待时间的分配器、输出设备和方法
US10448109B1 (en) * 2017-09-26 2019-10-15 Amazon Technologies, Inc. Supplemental content determinations for varied media playback
CN111292115A (zh) * 2018-12-06 2020-06-16 三星电子株式会社 显示设备及其控制方法
CN111405338A (zh) * 2020-02-27 2020-07-10 海信视像科技股份有限公司 一种智能画质的切换方法及显示设备
CN112203154A (zh) * 2020-10-10 2021-01-08 Vidaa美国公司 一种显示设备

Family Cites Families (106)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030200342A1 (en) * 2001-07-02 2003-10-23 Globespan Virata Incorporated Communications system using rings architecture
JP4153462B2 (ja) * 2004-05-31 2008-09-24 インターナショナル・ビジネス・マシーンズ・コーポレーション 表示方式切替装置、表示方式切替方法、表示方式切替プログラム、及びそのプログラムを記憶したコンピュータ読み取り可能な記憶媒体
CN1716415B (zh) * 2004-06-30 2010-05-26 深圳市朗科科技股份有限公司 数字视频播放装置及其节目回退的方法
EP1675343A1 (en) * 2004-12-23 2006-06-28 Siemens S.p.A. Method and system to minimize the switching delay between two RTP multimedia streaming sessions
JP4557878B2 (ja) * 2005-12-07 2010-10-06 シャープ株式会社 Ｈｄｍｉ出力時の解像度切換え手段
JP2007251543A (ja) * 2006-03-15 2007-09-27 Seiko Epson Corp 表示制御装置、その制御方法、情報再生装置及び電子機器
JP4274198B2 (ja) * 2006-05-19 2009-06-03 ソニー株式会社 映像表示装置および映像表示制御方法
JP2008011367A (ja) * 2006-06-30 2008-01-17 Sharp Corp 映像信号切換装置
CN100470315C (zh) * 2006-07-04 2009-03-18 晨星半导体股份有限公司 自动切换显示模式的液晶显示器以及其方法
US8698812B2 (en) * 2006-08-04 2014-04-15 Ati Technologies Ulc Video display mode control
US20080051642A1 (en) * 2006-08-24 2008-02-28 Hagai Krupnik Device, system and method of displaying in -vivo images at variable rate
US20080055318A1 (en) * 2006-08-31 2008-03-06 Glen David I J Dynamic frame rate adjustment
JP5228305B2 (ja) * 2006-09-08 2013-07-03 ソニー株式会社 表示装置、表示方法
US20150052253A1 (en) * 2014-09-22 2015-02-19 Weaved, Inc. Multi-server fractional subdomain dns protocol
US9137497B2 (en) * 2007-04-11 2015-09-15 At&T Intellectual Property I, Lp Method and system for video stream personalization
CN101247491A (zh) * 2008-03-07 2008-08-20 深圳创维－Rgb电子有限公司 通讯协议转换装置、电视机软件的在线升级系统及其方法
JP5338166B2 (ja) * 2008-07-16 2013-11-13 ソニー株式会社 送信装置、立体画像データ送信方法、受信装置および立体画像データ受信方法
CN101568028B (zh) * 2009-05-15 2011-11-30 中兴通讯股份有限公司 一种移动终端及移动终端间协同播放移动广播电视的方法
US20110302318A1 (en) * 2010-06-04 2011-12-08 Ari Birger Anonymous re-streaming of media item of content
JP5587089B2 (ja) * 2010-07-29 2014-09-10 キヤノン株式会社 通信装置及び制御方法
KR101852812B1 (ko) * 2010-08-23 2018-04-27 엘지전자 주식회사 게임 애플리케이션 제공 방법 및 그 방법을 채용한 영상표시기기
CN102447856A (zh) * 2010-10-13 2012-05-09 瑞昱半导体股份有限公司 频道切换提醒系统、信号源切换提醒系统及相关方法
US8917356B2 (en) * 2011-04-15 2014-12-23 Haier Group Corporation Play control system and method
US20150142991A1 (en) * 2011-04-21 2015-05-21 Efficiency3 Corp. Electronic hub appliances used for collecting, storing, and processing potentially massive periodic data streams indicative of real-time or other measuring parameters
CN102223581B (zh) * 2011-06-28 2013-06-12 宇龙计算机通信科技(深圳)有限公司 搜索视频节目的方法及视频播放终端
CN102510541B (zh) * 2011-12-30 2014-12-17 Tcl数码科技（深圳）有限责任公司 多屏互动的音视频内容切换方法及媒体播放器
JP6003901B2 (ja) * 2012-03-01 2016-10-05 ソニー株式会社 送信装置、送信方法および受信装置
CN102663448B (zh) * 2012-03-07 2016-08-10 北京理工大学 一种基于网络的增强现实物体识别分析方法
EP2868109B1 (en) * 2012-06-28 2016-08-17 Google, Inc. Generating a sequence of audio fingerprints at a set top box
CN103577175A (zh) * 2012-08-01 2014-02-12 腾讯科技（深圳）有限公司 移动终端软件界面更换的方法及装置
KR101533064B1 (ko) * 2012-11-01 2015-07-01 주식회사 케이티 콘텐츠 맞춤형 인터페이스를 표시하는 모바일 디바이스 및 모바일 디바이스 사용 방법
JP5306550B2 (ja) * 2013-01-25 2013-10-02 株式会社東芝 映像解析情報送信装置、映像解析情報配信システム及び配信方法、映像視聴システム及び映像視聴方法
JPWO2014141425A1 (ja) * 2013-03-14 2017-02-16 株式会社東芝 映像表示システム、ソース機器、シンク機器及び映像表示方法
CN103297852A (zh) * 2013-06-07 2013-09-11 华为终端有限公司 一种提高换台速度的方法、装置及系统
CN103442294A (zh) * 2013-08-15 2013-12-11 安徽科大讯飞信息科技股份有限公司 基于视频终端及服务器端的实时节目监测方法及系统
CN105025382B (zh) * 2014-04-23 2018-09-04 深圳Tcl新技术有限公司 游戏模式自动开关的方法和装置
KR102262086B1 (ko) * 2014-05-28 2021-06-09 삼성전자 주식회사 이미지 처리 방법 및 장치
US20170132749A1 (en) * 2014-06-12 2017-05-11 Lg Electronics Inc. Device and method for transmitting and receiving data
US9812056B2 (en) * 2014-06-24 2017-11-07 Google Inc. Display resolution negotiation
CN104333800B (zh) * 2014-07-21 2018-02-06 北京京东方视讯科技有限公司 一种显示系统、显示系统的蓝牙音频播放方法及装置
CN104378688B (zh) * 2014-10-27 2018-04-06 小米科技有限责任公司 模式切换方法和装置
CN104363496A (zh) * 2014-10-28 2015-02-18 深圳市嘉乐派科技有限公司 网络机顶盒中声音系统多场景应用的实现方法
JP6724788B2 (ja) * 2014-11-17 2020-07-15 ソニー株式会社 送信装置、送信方法、受信装置、受信方法およびプログラム
CN105007395B (zh) * 2015-07-22 2018-02-16 深圳市万姓宗祠网络科技股份有限公司 一种连续记录视频、影像的隐私处理方法
KR20170044868A (ko) * 2015-10-16 2017-04-26 삼성전자주식회사 디스플레이 장치 및 그 제어 방법
CN105430519B (zh) * 2015-11-20 2019-04-16 小米科技有限责任公司 模式确定方法和装置、多模式设备
CN105892963A (zh) * 2015-11-26 2016-08-24 乐视致新电子科技（天津）有限公司 用于生成扩展显示标识数据edid的方法和显示设备
CN105302518A (zh) * 2015-12-01 2016-02-03 合肥联宝信息技术有限公司 一种计算机设备及其控制方法
CN105323386A (zh) * 2015-12-03 2016-02-10 上海卓易科技股份有限公司 自动切换手机情景模式的方法及系统
CN105578105B (zh) * 2015-12-22 2019-03-12 深圳Tcl数字技术有限公司 Hdmi版本切换方法及显示设备
SG11201806768QA (en) * 2016-02-12 2018-09-27 Nagravision Sa Method and device for identifying a peripheral device from a digital content
CN108702466A (zh) * 2016-03-02 2018-10-23 美国莱迪思半导体公司 多媒体接口中的链路训练
US9892020B1 (en) * 2016-03-11 2018-02-13 Signalfx, Inc. User interface for specifying data stream processing language programs for analyzing instrumented software
CN105828012A (zh) * 2016-03-31 2016-08-03 乐视控股（北京）有限公司 Hdmi接口自动配置方法及相关装置
CN105847728A (zh) * 2016-04-13 2016-08-10 腾讯科技（深圳）有限公司 一种信息处理方法及终端
CN105979370B (zh) * 2016-07-01 2019-03-12 深圳创维－Rgb电子有限公司 一种配置图像模式的方法及装置
CN106101836B (zh) * 2016-07-07 2019-04-16 深圳创维－Rgb电子有限公司 智能电视的播放方法及装置
CN106250837B (zh) * 2016-07-27 2019-06-18 腾讯科技（深圳）有限公司 一种视频的识别方法、装置和系统
KR102575230B1 (ko) * 2016-07-29 2023-09-06 엘지전자 주식회사 원격제어장치 및 그 동작방법
CN106100904B (zh) * 2016-08-09 2019-06-18 深圳中兴网信科技有限公司 设备连接方法和设备连接系统
US10089533B2 (en) * 2016-09-21 2018-10-02 GumGum, Inc. Identifying visual objects depicted in video data using video fingerprinting
CN107959889A (zh) * 2016-10-17 2018-04-24 中兴通讯股份有限公司 数据流播放方法和装置，数据流类型配置方法和装置
WO2018076376A1 (zh) * 2016-10-31 2018-05-03 华为技术有限公司 一种语音数据传输方法、用户设备以及存储介质
CN106686332B (zh) * 2016-11-17 2020-07-14 西安诺瓦星云科技股份有限公司 视频显示控制方法以及edid管理方法
CN106604121A (zh) * 2016-12-26 2017-04-26 深圳Tcl数字技术有限公司 Hdmi接口兼容方法及显示装置
JP7129913B2 (ja) * 2016-12-28 2022-09-02 ソニーネットワークコミュニケーションズ株式会社 情報処理装置、情報処理方法およびプログラム
CN108696732B (zh) * 2017-02-17 2023-04-18 北京三星通信技术研究有限公司 头戴显示设备的分辨率调整方法及设备
CN106851169A (zh) * 2017-03-14 2017-06-13 微鲸科技有限公司 显示模式切换方法、装置及显示设备
US11868604B2 (en) * 2017-06-05 2024-01-09 Huawei Technologies Co., Ltd. Display processing method and apparatus
CN107197370A (zh) * 2017-06-22 2017-09-22 北京密境和风科技有限公司 一种直播视频的场景检测方法和装置
CN110462581B (zh) * 2017-07-07 2023-12-01 惠普发展公司，有限责任合伙企业 扩展显示识别数据标准的选择
CN109495761A (zh) * 2017-09-13 2019-03-19 杭州海康威视系统技术有限公司 视频切换方法及装置
CN108055584A (zh) * 2017-10-12 2018-05-18 Tcl海外电子（惠州）有限公司 电视机的信号自适应显示方法、电视机及存储介质
US20200234499A1 (en) * 2017-11-08 2020-07-23 Lg Electronics Inc. Method for transmitting/receiving media data and device therefor
CN108063978B (zh) * 2017-12-04 2020-10-20 康佳集团股份有限公司 一种电视性能参数自适应的方法、电视及存储介质
CN109977731B (zh) * 2017-12-27 2021-10-29 深圳市优必选科技有限公司 一种场景的识别方法、识别设备及终端设备
KR102549888B1 (ko) * 2018-02-08 2023-07-03 삼성디스플레이 주식회사 일반 모드 및 가변 프레임 모드를 지원하는 표시 장치의 구동 방법, 및 표시 장치
CN108322817A (zh) * 2018-02-12 2018-07-24 深圳创维－Rgb电子有限公司 一种音效模式切换方法、装置及电子设备
IL276064B2 (en) * 2018-02-15 2024-04-01 Vitec Inc Distribution and playback of media content
CN108762707A (zh) * 2018-05-29 2018-11-06 西安万像电子科技有限公司 多媒体信息采集的自适应方法、装置和系统
CN108924573B (zh) * 2018-06-21 2021-08-31 深圳市网心科技有限公司 数据流处理、播放方法、服务器、播放装置、系统及介质
CN109068169A (zh) * 2018-08-06 2018-12-21 青岛海信传媒网络技术有限公司 一种视频播放方法及装置
CN108924592A (zh) * 2018-08-06 2018-11-30 青岛海信传媒网络技术有限公司 一种视频处理的方法及设备
US10826243B2 (en) * 2018-08-28 2020-11-03 Sure-Fire Electrical Corporation Electric connector terminal configuration structure
CN109168062B (zh) * 2018-08-28 2020-11-24 北京达佳互联信息技术有限公司 视频播放的展示方法、装置、终端设备及存储介质
CN109040739A (zh) * 2018-09-14 2018-12-18 杭州行开科技有限公司 一种2d/3d自动切换的裸眼3d播放系统及播放方法
CN112740296A (zh) * 2018-09-21 2021-04-30 大众汽车（中国）投资有限公司 车载娱乐装置及其切换方法和切换系统
CN109450851B (zh) * 2018-09-30 2020-09-22 Oppo广东移动通信有限公司 设备连接方法、电子设备及计算机可读介质
CN109300431B (zh) * 2018-10-22 2020-06-19 五邑大学 一种基于无线传输的全彩动态led显示屏
CN111462711A (zh) * 2019-01-18 2020-07-28 中强光电股份有限公司 用于优化显示模式的显示装置及方法
CN109901901A (zh) * 2019-01-29 2019-06-18 上海华章信息科技有限公司 可变帧率开机动画实现方法
CN109754762B (zh) * 2019-03-21 2020-11-13 明基智能科技（上海）有限公司 影像显示方法及影像显示系统
CN109999494A (zh) * 2019-04-24 2019-07-12 努比亚技术有限公司 游戏操控方法、装置及计算机可读存储介质
CN110087006B (zh) * 2019-05-17 2022-04-15 京东方科技集团股份有限公司 显示控制系统、方法及装置
KR102599365B1 (ko) * 2019-05-17 2023-11-08 삼성전자주식회사 전자장치 및 그 제어방법
US11342323B2 (en) * 2019-05-30 2022-05-24 Analog Devices, Inc. High voltage tolerant circuit architecture for applications subject to electrical overstress fault conditions
CN114073089B (zh) * 2019-06-28 2024-02-09 杜比实验室特许公司 生成数字视频比特流和回放视频内容的方法和介质
CN110457694B (zh) * 2019-07-29 2023-09-22 腾讯科技（上海）有限公司 消息提醒方法及装置、场景类型识别提醒方法及装置
CN112533021B (zh) * 2019-09-19 2023-04-11 Vidaa(荷兰)国际控股有限公司 一种显示方法及显示设备
CN110933490B (zh) * 2019-11-20 2021-07-27 深圳创维－Rgb电子有限公司 一种画质和音质的自动调整方法、智能电视机及存储介质
CN111064972A (zh) * 2019-11-28 2020-04-24 湖北工业大学 一种基于ipv9的视频直播控制方法
CN111131889B (zh) * 2019-12-31 2022-11-25 深圳创维－Rgb电子有限公司 场景自适应调整图像及声音的方法、系统及可读存储介质
CN111526415B (zh) * 2020-04-15 2022-08-19 海信视像科技股份有限公司 一种双屏显示设备及其hdmi的切换方法
CN111586409B (zh) * 2020-05-14 2022-06-10 Oppo广东移动通信有限公司 插值帧的生成方法、装置、电子设备和存储介质
CN111918132B (zh) * 2020-07-27 2022-09-23 海信视像科技股份有限公司 一种显示设备及多接口设备判断方法
CN112040305A (zh) * 2020-08-31 2020-12-04 深圳创维－Rgb电子有限公司 Vrr智能切换方法、装置、智能电视和可读存储介质

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101627625A (zh) * 2007-03-13 2010-01-13 索尼株式会社 通信系统、发送装置、发送方法、接收装置以及接收方法
CN105828213A (zh) * 2012-10-04 2016-08-03 索尼互动娱乐美国有限责任公司 用于减少呈现等待时间的分配器、输出设备和方法
US10448109B1 (en) * 2017-09-26 2019-10-15 Amazon Technologies, Inc. Supplemental content determinations for varied media playback
CN111292115A (zh) * 2018-12-06 2020-06-16 三星电子株式会社 显示设备及其控制方法
CN111405338A (zh) * 2020-02-27 2020-07-10 海信视像科技股份有限公司 一种智能画质的切换方法及显示设备
CN112203154A (zh) * 2020-10-10 2021-01-08 Vidaa美国公司 一种显示设备

Also Published As

Publication number Publication date
CN114302219A (zh) 2022-04-08
CN114302220A (zh) 2022-04-08
CN114302194B (zh) 2023-05-05
CN114302194A (zh) 2022-04-08
CN114302195A (zh) 2022-04-08
CN114302196B (zh) 2023-05-05
CN114286138A (zh) 2022-04-05
CN114302220B (zh) 2023-04-14
CN114302190A (zh) 2022-04-08
US20230336806A1 (en) 2023-10-19
CN114302190B (zh) 2023-07-14
CN114302196A (zh) 2022-04-08
CN114339339B (zh) 2024-02-23
CN114286143B (zh) 2023-02-21
CN117397245A (zh) 2024-01-12
CN114302195B (zh) 2023-04-14
CN114286173A (zh) 2022-04-05
CN114302193B (zh) 2022-09-30
CN114286143A (zh) 2022-04-05
CN114302219B (zh) 2023-03-24
CN114286173B (zh) 2023-07-18
CN114297436A (zh) 2022-04-08
WO2022152202A1 (zh) 2022-07-21
CN114302193A (zh) 2022-04-08
WO2022152203A1 (zh) 2022-07-21
CN114302132A (zh) 2022-04-08
CN114339339A (zh) 2022-04-12
CN114286138B (zh) 2023-08-18

Similar Documents

Publication Publication Date Title
WO2022152201A1 (zh) 显示设备及多设备切换时的播放方法
WO2021253895A1 (zh) 媒资播放方法及显示设备
CN112422365A (zh) 显示设备及自动监测网络状态的方法
CN114327199A (zh) 一种显示设备及多窗口参数设置方法
US20240205498A1 (en) Display device and display method
WO2022152320A1 (zh) 显示设备、音画参数调节方法
CN114257857B (zh) 显示设备及视频倍速播放方法
WO2024098974A1 (zh) 一种显示设备及外接设备的控制方法
US20230298539A1 (en) Display apparatus and method for display apparatus
CN114615536B (zh) 显示设备及音效处理方法
CN114615529A (zh) 显示设备、外接设备及音频播放方法
CN115150648A (zh) 显示设备及消息传输方法
WO2023160100A1 (zh) 显示设备、外接设备、音频播放及音效处理方法
US20230262286A1 (en) Display device and audio data processing method
WO2023185954A9 (zh) 一种显示设备及用于显示设备的处理方法
CN117834983A (zh) 一种播放缓冲确定方法和显示设备
CN116803089A (zh) 显示设备、音画参数调节方法
CN116301525A (zh) 显示设备和图像模式设置方法
CN113965791A (zh) 悬浮窗口的返回方法和显示设备
CN114827715A (zh) 显示设备和媒资播放方法
CN117971086A (zh) 显示设备和悬浮窗口显示方法
CN115209196A (zh) 显示设备、交互控制方法
CN117289839A (zh) 一种音画设置方法及显示设备
CN113115085A (zh) 一种视频播放方法及显示设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22739077

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22739077

Country of ref document: EP

Kind code of ref document: A1