WO2023035805A1 - 一种显示设备及显示方法 - Google Patents

一种显示设备及显示方法 Download PDF

Info

Publication number
WO2023035805A1
WO2023035805A1 PCT/CN2022/109199 CN2022109199W WO2023035805A1 WO 2023035805 A1 WO2023035805 A1 WO 2023035805A1 CN 2022109199 W CN2022109199 W CN 2022109199W WO 2023035805 A1 WO2023035805 A1 WO 2023035805A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
multimedia content
ratio
display device
screen
Prior art date
Application number
PCT/CN2022/109199
Other languages
English (en)
French (fr)
Inventor
卢平光
何营昊
祖荫鹏
刘晋
Original Assignee
海信视像科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202111042636.9A external-priority patent/CN114286138B/zh
Application filed by 海信视像科技股份有限公司 filed Critical 海信视像科技股份有限公司
Priority to CN202280057422.5A priority Critical patent/CN118077208A/zh
Publication of WO2023035805A1 publication Critical patent/WO2023035805A1/zh
Priority to US18/588,414 priority patent/US20240205498A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H04N21/440272—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA for performing aspect ratio conversion
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows

Definitions

  • the present application relates to the technical field of intelligent display devices, in particular to a display device and a display method.
  • the display device refers to a terminal device capable of outputting specific display images, and may be a terminal device such as a smart TV, a mobile terminal, a smart advertising screen, or a projector.
  • a terminal device such as a smart TV, a mobile terminal, a smart advertising screen, or a projector.
  • smart TV is based on Internet application technology, has an open operating system and chip, has an open application platform, can realize two-way human-computer interaction, and integrates multiple functions such as audio-visual, entertainment, and data. Products are used to meet the diverse and individual needs of users.
  • a current display device displays multimedia content
  • An embodiment of the present application provides a display device, including: a display; a controller configured to: determine a target display mode of multimedia content to be displayed based on user control, and the target display mode is used to describe the multimedia content A target screen display ratio and/or a target screen display position of the multimedia content; controlling the display to display the multimedia content based on the target display mode.
  • An embodiment of the present application provides a display method for a display device, including: determining a target display mode of the multimedia content to be displayed based on user control, and the target display mode is used to describe a target screen display ratio of the multimedia content And/or a target screen display position of the multimedia content; displaying the multimedia content based on the target display mode.
  • FIG. 1A is a schematic structural diagram of a display device according to some embodiments.
  • FIG. 1B is a schematic diagram of a usage scenario of a display device according to some embodiments.
  • FIG. 2 is a block diagram of a hardware configuration of a control device according to some embodiments.
  • Fig. 3 is a hardware configuration diagram of a display device according to some embodiments.
  • FIG. 4 is a software configuration diagram of a display device according to some embodiments.
  • Fig. 5 is a schematic diagram of a connection relationship between a display device and an external device according to some embodiments
  • Fig. 6 is a schematic diagram of a data transfer relationship between a display device and an external device according to some embodiments
  • Fig. 7 is a schematic diagram of a multi-view ratio display process according to some embodiments.
  • Fig. 8 is a schematic diagram of a setting interface according to some embodiments.
  • Fig. 9 is a schematic flowchart of detecting the type of an external device according to some embodiments.
  • Fig. 10 is a schematic diagram of audio and video meta information according to some embodiments.
  • Fig. 11 is a schematic flow diagram of generating declaration information according to some embodiments.
  • FIG. 12 is a schematic diagram of a flow chart of switching protocol versions according to some embodiments.
  • Figure 13 is a schematic diagram of a display process according to some embodiments.
  • Fig. 14 is a schematic flow diagram of displaying a wide viewing angle picture through a virtual screen according to some embodiments.
  • Fig. 15 is a schematic diagram showing the effect of stretching and displaying an actual picture by a display device according to some embodiments.
  • Fig. 16 is a schematic diagram showing the effect of a display device displaying an actual picture through a virtual screen according to some embodiments
  • Fig. 17 is a timing diagram of a display process on a display device side according to some embodiments.
  • Fig. 18 is a sequence diagram of a data feedback process at the external device side according to some embodiments.
  • Fig. 19 is a schematic diagram of an operation scenario between a display device and a control device according to some embodiments.
  • FIG. 20 is a schematic diagram of displaying an icon control interface of an application program in a display device 200 according to some embodiments.
  • Figure 21A is a system block diagram of multimedia content display according to some embodiments.
  • Figure 21B is an architectural diagram of multimedia content display according to some embodiments.
  • FIG. 22A is a schematic flowchart of a display method according to some embodiments.
  • Fig. 22B is an overall frame diagram of the system corresponding to the display method according to some embodiments.
  • Fig. 22C is a schematic diagram of an interface of different screen display ratios of multimedia content according to some embodiments.
  • Fig. 22D is a schematic diagram of an interface of different screen display positions of multimedia content according to some embodiments.
  • Fig. 23A is a schematic diagram of the included angle between the face area and the center point of the environment image according to some embodiments.
  • Fig. 23B is a graph showing the relationship between viewing angle and sharpness of human eyes according to some embodiments.
  • Fig. 23C is a schematic diagram of the display ratio of the first screen of the multimedia content according to some embodiments.
  • Fig. 23D is a schematic diagram of a second screen display ratio of multimedia content according to some embodiments.
  • Fig. 23E is a schematic diagram of a third screen display ratio of multimedia content according to some embodiments.
  • Figure 24A is a schematic diagram of displaying multimedia content according to some embodiments.
  • Fig. 24B is a schematic interface diagram of the display position of the first frame of the multimedia content according to some embodiments.
  • Fig. 24C is a schematic diagram of the interface of the display position of the second screen of the multimedia content according to some embodiments.
  • Fig. 24D is a schematic diagram of an interface showing the display position of the third screen of the multimedia content according to some embodiments.
  • FIG. 1A is a schematic structural diagram of a display device according to some embodiments.
  • the display device may include a display 11 and a controller 12 .
  • the controller 12 may determine a target display mode of the multimedia content to be displayed based on user control, and the target display mode may be used to describe a target screen display ratio of the multimedia content to be displayed and/or a target screen display position of the multimedia content, or That is to say, the target display mode may only describe the target screen display ratio of the multimedia content, or only describe the target screen display position of the multimedia content, or describe the target screen display ratio and target screen display position of the multimedia content.
  • the controller 12 may control the display 11 to display multimedia content based on the target display mode.
  • the display device is also provided with an external device interface, and the display device can be connected to an external device through the external device interface to receive audio and video data sent by the external device, that is, multimedia content, and play the multimedia content.
  • a typical smart TV is equipped with a high-definition multimedia interface (High Definition Multimedia Interface, HDMI).
  • External devices such as hosts can connect to the smart TV through the HDMI interface and output game images to the smart TV, so as to utilize the large screen of the smart TV to interact with the smart TV. The game screen is displayed to obtain a better gaming experience.
  • the display device since the video data sent by the external device to the display device has a specific viewing angle ratio, and the screen of the display device also has a specific physical size ratio, the display device has a specific screen display ratio and other display modes.
  • the viewing angle ratio of multimedia content When it does not match the physical size ratio of the screen (screen display ratio), it may cause the display device to fail to receive the appropriate video signal in some viewing angle ratio modes, resulting in the display device being unable to display the multimedia content sent by the external device, reducing user experience .
  • Fig. 1B is a schematic diagram of a usage scenario of a display device according to some embodiments. As shown in FIG. 1B , the display device 200 also performs data communication with the server 400 , and the user can operate the display device 200 through the smart device 300 or the control device 100 .
  • control device 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication, Bluetooth protocol communication, and other short-distance communication methods, and the display device is controlled wirelessly or wiredly.
  • Device 200 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication, Bluetooth protocol communication, and other short-distance communication methods, and the display device is controlled wirelessly or wiredly.
  • the smart device 300 may include any one of a mobile terminal, a tablet computer, a computer, a notebook computer, an AR/VR device, and the like.
  • the smart device 300 can also be used to control the display device 200 .
  • the display device 200 is controlled using an application program running on the smart device.
  • the smart device 300 and the display device may also be used for data communication.
  • the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300.
  • the module for obtaining voice commands configured inside the display device 200 can directly receive the user's voice command control
  • the user's voice command control can also be received through the voice control device provided outside the display device 200 .
  • the display device 200 also performs data communication with the server 400 .
  • the display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.
  • the server 400 may provide various contents and interactions to the display device 200 .
  • Fig. 2 is a block diagram of hardware configuration of the control device 100 according to some embodiments.
  • the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory, and a power supply.
  • the control device 100 can receive the user's input operation instruction, and convert the operation instruction into an instruction that the display device 200 can recognize and respond to, and play an intermediary role between the user and the display device 200 .
  • the communication interface 130 is used for communicating with the outside, and includes at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module.
  • the user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, a button or an alternative module.
  • FIG. 3 is a block diagram of a hardware configuration of a display device 200 according to some embodiments.
  • the display device 200 includes a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface. at least one.
  • the controller includes a CPU, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.
  • the display 260 includes a display screen component for presenting images, and a drive component for driving image display, for receiving image signals output from the controller, and displaying video content, image content, and menu manipulation interface. Components and user manipulation of the UI interface, etc.
  • the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.
  • the tuner-demodulator 210 receives broadcast TV signals through wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or cable broadcast TV signals.
  • the communicator 220 is a component for communicating with external devices or servers according to various communication protocol types.
  • the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module and other network communication protocol chips or near field communication protocol chips, and an infrared receiver.
  • the display device 200 can establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220 .
  • the detector 230 is used to collect signals of the external environment or interaction with the outside.
  • the detector 230 includes a light receiver, which is a sensor for collecting ambient light intensity; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes or user interaction gestures, or , the detector 230 includes a sound collector, such as a microphone, for receiving external sound.
  • the external device interface 240 may include, but is not limited to, the following: high-definition multimedia interface (HDMI), analog or data high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), Any one or more interfaces such as RGB ports. It may also be a composite input/output interface formed by the above-mentioned multiple interfaces.
  • HDMI high-definition multimedia interface
  • component analog or data high-definition component input interface
  • CVBS composite video input interface
  • USB input interface USB
  • Any one or more interfaces such as RGB ports. It may also be a composite input/output interface formed by the above-mentioned multiple interfaces.
  • the controller 250 and the tuner-demodulator 210 may be located in different split devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box wait.
  • the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory.
  • the controller 250 controls the overall operations of the display device 200 . For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.
  • the controller includes a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processing unit (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read- Only Memory, ROM), at least one of the first interface to the nth interface for input/output, a communication bus (Bus), and the like.
  • CPU Central Processing Unit
  • video processor video processor
  • audio processor audio processor
  • graphics processing unit Graphics Processing Unit, GPU
  • RAM Random Access Memory
  • ROM Read- Only Memory
  • CPU processor It is used to execute the operating system and application program instructions stored in the memory, and to execute various application programs, data and content according to various interactive instructions received from the outside, so as to finally display and play various audio and video content.
  • a CPU processor may include multiple processors. For example, including a main processor and one or more sub-processors.
  • the user can input user commands through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives user input commands through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user can input a user command by inputting a specific sound or gesture, and then the user input interface recognizes the sound or gesture through a sensor to receive the user input command.
  • the user input interface 280 is an interface that can be used to receive control input (such as: physical buttons on the display device body, or others).
  • the system is divided into four layers, from top to bottom are respectively the application (Applications) layer (abbreviated as “application layer”), application framework (Application Framework) layer (abbreviated as “framework layer”) "), Android runtime (Android runtime) and system library layer (referred to as “system runtime layer”), and the kernel layer.
  • application layer application layer
  • application framework Application Framework
  • Android runtime Android runtime
  • system library layer system library layer
  • connecting the display device 200 to the external device 500 refers to establishing a communication connection, and the display device 200 and the external device 500 that establish the communication connection serve as the receiving end (sink end) and the sending end (source end) respectively.
  • the external device 500 may be a game device.
  • the user uses the game device, it can output multimedia content such as video data and audio data in real time for the game process, and send multimedia content such as video data and audio data.
  • multimedia content such as video data and audio data can be output as video images and sounds through the display device 200.
  • the game device acts as the sending end
  • the display device 200 acts as the receiving end.
  • both the display device 200 and the external device 500 are provided with a high-definition multimedia interface (High Definition Multimedia Interface, HDMI).
  • HDMI High Definition Multimedia Interface
  • the user can respectively insert the two ends of the HDMI interface data cable into the display device 200 and the external device 500, and after starting the external device 500 and the display device 200, set the signal source of the display device 200 to be the HDMI interface. , so as to realize data transmission between the display device 200 and the external device 500 .
  • connection method can be a wired connection method, such as DVI (Digital Visual Interface), VGA (Video Graphics Array), USB (Universal Serial Bus), etc.; it can also be a wireless connection method, such as wireless LAN, Bluetooth connection, infrared connection etc.
  • Different communication connection methods may adopt different information transfer protocols, for example, when an HDMI interface is used for connection, an HDMI protocol may be used for data transmission.
  • the display device 200 can be connected to a game device through an HDMI interface.
  • the game device can output multimedia content such as video data and audio data by running game-related programs. Multimedia content such as video data and audio data can be sent to the smart TV through the HDMI protocol, and output through the screen and speakers of the smart TV to play the video and audio of the game device.
  • the external device 500 can transmit data based on a specific standard, so that the display device and the external device can establish mutual identification and establish a data transmission channel.
  • the display device 200 can establish a connection with the external device 500 based on the extended display identification data (Extended Display Identification Data, EDID), and realize mutual identification and control.
  • extended display identification data Extended Display Identification Data, EDID
  • the display device 200 and the external device 500 are two independent functional units, after the connection between the external device 500 and the display device 200 is established, the display device 200 can display the screen content according to the display ratio corresponding to the screen resolution, and in order to obtain a more For a good display effect, the external device 500 needs to send multimedia content to the display device 200 in accordance with the viewing angle ratio of the display device 200 .
  • the screen resolution of the display device 200 is 3840 ⁇ 2160, which is suitable for a viewing angle ratio of 16:9.
  • the external device 500 also needs to provide The device 200 sends video images with a viewing angle ratio of 16:9.
  • the screen resolution of the display device 200 may also be expressed in other forms.
  • its screen resolution can reach 21:9 or 32:9.
  • the optimal viewing angle ratio it can support is fixed.
  • the screen of the display device 200 will be The viewing angle ratio determined by the resolution is called the physical ratio.
  • the display device 200 when displaying the video picture sent by the external device 500 , may also scale and/or directional stretch the picture so as to adapt to the aspect ratio of the widescreen. For example, when the screen resolution of the display device 200 is 3840 ⁇ 2160 and the corresponding physical ratio is 16:9, but the displayed game screen resolution is 3840 ⁇ 1080 and the corresponding viewing angle ratio is 32:9, the display device 200 can still The game screen is displayed. During the display process, the display device 200 may stretch the game screen along the height direction of the screen based on the game screen height of 1080 pixels, so that the game screen fills the entire display device 200 in the height direction.
  • the display device 200 can also use partial display based on the game screen height of 1080 pixels, so that the game screen is presented in the middle of the screen of the display device 200, and the upper and lower parts of the game screen are filled with a solid color background to complete the display.
  • the display device 200 For the display device 200 supporting widescreen display, after the external device 500 is connected, the display device 200 needs to declare the support status of the widescreen viewing angle. When receiving the statement information, the external device 500 develops relevant functions for the user so that the user can choose to switch. For example, currently, the host graphics card supports HDMI wide viewing angle image output. After the display device EDID declares that it supports wide viewing angle, the host can obtain this information and develop relevant functions for users to select and switch. However, since resolutions like 21:9 or 32:9 are not clearly specified in the HDMI protocol, the display device 200 needs to generate corresponding EDID content based on its own device characteristics.
  • the display device 200 with a physical size of 21:9 or 32:9 will make such a statement, and usually the display device 200 with 16:9 is compatible with other input signal sources, and the optimal resolution must still be fixed at 16: 9. Therefore, in the process of displaying images, professional e-sports displays have better compatibility with wide viewing angle signals, but poor compatibility with ordinary 16:9 signals, and there may be no signal. Similarly, the general-purpose display device 200 cannot send wide-viewing-angle signals normally, which degrades user experience.
  • the standard timing (standard timing) data will be affected by the bandwidth, resulting in the wide viewing angle data cannot be transmitted to the display device 200, resulting in the problem of no signal.
  • some embodiments of the present application provide a display method, which can be applied to the display device 200, and the display device 200 can determine the location of the multimedia content to be displayed based on the user's control.
  • a target display mode, the target display mode is used to describe the target screen display ratio of the multimedia content and/or describe the target screen display position of the multimedia content, and the multimedia content can be displayed based on the target display mode.
  • the display device 200 may acquire the first control instruction input by the user for switching the viewing angle ratio; in response to the first control instruction, send statement information to the external device, the statement information includes the interface protocol version of the external device and the switched The identification data of the viewing angle ratio; the display device 200 can receive the multimedia content fed back by the external device for the declaration information, and the target screen display ratio of the multimedia content is equal to the viewing angle ratio after switching, that is, the display device 200 can declare to the external device 500 that its The supportable viewing angle ratio enables the external device 500 to send multimedia content with an appropriate viewing angle ratio to the display device 200 according to the statement of the display device 200 .
  • the display device 200 should at least include: a display 260 , an external device interface 240 and a controller 250 .
  • the display 260 may be configured to display a user interface, and the user may control the display mode and specific display content of the display device 200 through the user interface displayed on the display 260 .
  • an option for switching display ratios may be provided in the user interface, through which the user can change the display 260 to display in ratios of 16:9, 21:9, 32:9, etc.
  • a signal source option can also be provided in the user interface, through which the user can set the input signal source of the display device 200 as the network, set-top box or external device 500 to display multimedia content sent by different signal sources.
  • the external device interface 240 is configured to connect with the external device 500 to realize a communication relationship with the external device 500 .
  • the display apparatus 200 may include a plurality of external device interfaces 240, and the plurality of external device interfaces 240 may be based on different connection forms. Different external device interfaces 240 may perform data transmission through different interface protocols, and the same interface protocol may also include different protocol versions.
  • the external device interface 240 can be an HDMI interface on the display device 200, and the external device 500 can be connected to the HDMI interface through an HDMI data cable to realize connection with the display device 200, so that HDMI 1.4, HDMI 2.0, HDMI 2.1, etc.
  • the version of the HDMI protocol receives multimedia content such as audio data and video data sent by the external device 500 .
  • the controller 250 is configured to execute the application program corresponding to the display method, so as to control the display process of the display device 200 through this method.
  • the application program corresponding to the display method can be directly configured in the controller 250 , or can be stored in the built-in memory of the display device 200 , so that the controller 250 can call and run it.
  • the display method specifically includes the following contents:
  • a first control instruction input by the user for switching the viewing angle ratio is acquired.
  • the display device 200 can detect the control commands input by the user in real time, and some of the control commands can be used to switch the viewing angle ratio, so that the display device 200 can display the screen according to the new viewing angle ratio .
  • the control instruction for switching the viewing angle ratio is referred to as a first control instruction.
  • the first control instruction may be input through different interactive actions according to the interaction modes supported by the display device 200 and the specific type of the display device 200 . That is, in some embodiments, the first control instruction can be input based on a specific user interface. For example, a function button may be provided on the display device 200, and the user may trigger the display device 200 to display a setting interface by pressing the "menu" function button.
  • the setting interface may include multiple viewing angle ratio options, and the user controls the focus cursor to select any viewing angle ratio option in the setting interface through the direction keys to trigger the setting function corresponding to the viewing angle ratio option.
  • the user can control the movement of the focus cursor, select the 21:9 option among the 16:9 option, the 21:9 option, and the 32:9 option in the column of viewing angle ratio in the setting interface, and control the display device 200 to follow the ratio of 21:9 Display the contents of the screen.
  • the viewing angle ratio options provided in the setting interface may be presented as content of different viewing angle ratios according to the specific form of the display device 200 .
  • the viewing angle ratio provided in the setting interface can also be a horizontal screen format, that is, 16:9 option, 21:9 options and 32:9 options, etc.
  • the vertical screen display device 200 that is, the display device 200 whose width is smaller than the height of the screen
  • the viewing angle ratios provided in the setting interface are also in the vertical screen form, that is, the 9:16 option, 10 : 16 options and 5:3 options, etc.
  • the setting interface can also provide other setting items for the display device 200 .
  • the display device 200 may control the display 260 to display a setting interface in response to a user's interaction action, and the setting interface includes multiple screen movement options and multiple viewing angle ratio switching options.
  • the display device 200 can monitor the selection action performed by the user based on the setting interface, and when the user performs a selection action on the screen movement option, adjust the display position of the multimedia content on the display according to the screen movement option;
  • a control instruction for switching the viewing angle scale is generated according to the viewing angle scale switching option implemented by the selected action.
  • the user may input the first control instruction through the fixed button provided on the display device 200 , or may input the first control instruction through the control device 100 matched with the display device 200 .
  • the control device 100 may be provided with a button for switching the viewing angle ratio, and when the user clicks the button, the display device 200 may be triggered to switch the viewing angle ratio, thereby inputting the first control instruction.
  • the control device 100 with a partially simplified design there is usually no separate button for switching the viewing angle ratio, but the setting interface displayed by the display device 200 is controlled by using buttons such as menu keys and direction keys to control the focus cursor to move and select the setting. The option for switching the viewing angle scale in the interface, so as to input the first control instruction.
  • the user may also input the first control instruction through the corresponding interaction method.
  • the user may select an option for switching the viewing angle ratio through a touch operation, so as to trigger the display device 200 to switch the viewing angle ratio, that is, input a first control command.
  • the user can also trigger the display device 200 to switch the viewing angle ratio through specific gestures, such as sliding down from the top of the screen with two fingers and sliding up from the bottom of the screen with two fingers to control the display device 200 is displayed according to the widescreen ratio, so as to input the first control command.
  • the user can control the display device 200 to switch the viewing angle ratio by inputting voice content such as "switch the viewing angle ratio” and "display at a ratio of 32:9", thereby inputting the first Control instruction.
  • the display device 200 may respond to the first control command and send a statement message to the external device 500 to inform the external device 500 of the viewing angle ratio currently supported by the display device 200 .
  • the statement information includes identification data conforming to the interface protocol version corresponding to the external device interface 240 and the viewing angle ratio after switching.
  • the statement information is extended display identification data EDID information;
  • the identification data is standard timing data in the EDID information, that is, standard timing data in the EDID statement.
  • the display device 200 can parse the first control command from the first control command after receiving the user input. After switching, the viewing angle ratio is 21:9, and then determine the multimedia content format that meets these two conditions according to the current protocol version HDMI1.4 and the switching ratio viewing angle 21:9, that is, the resolution is 3840 ⁇ 1600, and the frame rate is 30 multimedia content. Then generate standard timing data according to the multimedia content form, so as to send EDID information including the standard timing data to the external device 500 .
  • the display device 200 can declare to the external device 500 the viewing angle ratio format it supports through declaration information containing different identification data, so that the external device 500 The corresponding multimedia content may be fed back to the display device 200 according to the declared viewing angle ratio.
  • the video formats corresponding to different interface protocol versions are also different. For example, based on the limitation of the maximum transmission rate of the HDMI 1.4 version, the highest quality picture quality transmitted by the HDMI 1.4 version is 4K, 30Hz (ie 3840 ⁇ 2160, 30Hz) multimedia content. Therefore, the wide viewing angle video quality in HDMI1.4 version should not be higher than the above extreme value.
  • the current HDMI1.4 version can support up to 3840 ⁇ 1600, 30Hz multimedia content transmission; and when the switching viewing angle ratio is 32:9, the current HDMI1.4 version It can support up to 3840 ⁇ 1080, 60Hz multimedia content delivery.
  • the external device 500 may send multimedia content to the display device 200 according to the identification data in the statement information.
  • the display ratio of the target screen of the multimedia content is equal to the ratio of the viewing angle after switching.
  • the external device 500 can report to the display device 200 that the resolution is 3840 according to the identification data. ⁇ 1600, multimedia content with a frame rate of 30Hz.
  • the multimedia content sent by the external device 500 to the display device 200 may be presented in different forms according to different types of the external device 500 .
  • the external device 500 when the external device 500 is a device capable of generating video images in real time, such as a personal computer (PC) host or a game console, the external device 500 can render a video image of a corresponding specification in real time according to the video image specification recorded in the identification data.
  • the external device 500 when the external device 500 is a device such as a media asset database, the external device 500 can match the media asset data of the video frame specification in the media asset database according to the video frame specification recorded in the identification data, and feed back to the display device 200 .
  • the display device 200 may, after sending the statement information to the external device 500, receive the multimedia content fed back by the external device 500 for the statement information, and play the received multimedia content, that is, control
  • the display 260 displays multimedia content.
  • the display device 200 may send the display device 200 to the external device 500 according to the switched viewing angle ratio and the current interface protocol version included in the first control instruction. Declare information so that the external device 500 can feed back to the display device 200 multimedia content that conforms to the current interface protocol version and the viewing angle ratio after switching, so that the external device 500 can correctly feed back multimedia content to the display device 200, and alleviate the lack of signal in some viewing angle ratios The problem.
  • the display device 200 Since most devices with graphics processing units other than PCs and game consoles do not support multi-view signal output, when the display device 200 sets the standard timing data of the EDID information to timing related to widescreen viewing angles, the external device 500 cannot parse the EDID information. And turn off the signal output, at this time, the display device 200 also has the problem of no signal.
  • FIG. 9 is a schematic flowchart of detecting the type of an external device according to some embodiments, and the process includes the following steps:
  • S901 Obtain audio and video metadata of an external device.
  • the display device 200 can perform the device type of the external device 500 Detection, that is, the display device 200 can obtain the audio and video metadata of the external device 500 when the external device 500 is connected to the external device interface 240 .
  • the field value of the corresponding flag can be determined by parsing the flag field in the audio and video metadata.
  • S903 Determine whether the flag bit field is the same as the judgment field; if yes, perform S904; if not, perform S906.
  • S904 Mark the external device as the first type of device.
  • S905 Send declaration information to the first type of device.
  • S906 Mark the external device as the second type of device.
  • the display device 200 can acquire audio and video meta information (Audio and Video Information, AVinfo) from the external device 500 when it detects that a signal is connected to the HDMI interface. Therefore, the audio and video metadata acquired by the display device 200 is also called AVinfo frame information.
  • the AVinfo frame information may include a plurality of fields, and each field is in a different position to represent the audio and video features of the external device 500 . That is, in the AVinfo information segment shown in Fig. 10, the data entry is formed by rows 0-7 and rows PB0-PB5. According to the uncompressed digital video standard formulated by the Consumer Electronics Association (Consumer Electronics Association, CEA), the entry Each cell position in can be defined as a specific value.
  • CEA Consumer Electronics Association
  • the external device 500 may define field values at multiple positions according to the content of the information sent to the display device 200 . That is, when the external device 500 is the host device, the field of ITC located in row PB3 and column 7 is set to 1, the field of CN1 located in row PB5 and column 6 is set to 0, and the field of CN0 located in row PB5 and column 5 is set to a value of 0.
  • the display device 200 can determine the type of the external device 500 by detecting the field value in the AVinfo frame information, that is, by detecting the AVinfo frame.
  • the field values at the positions of ITC, CN1, and CN0 in the information determine whether the fields on the corresponding flag bits in the AVinfo frame information conform to the above values, and determine whether the external device 500 is a PC host device.
  • the first type of device refers to a device capable of feeding back multimedia content conforming to the corresponding viewing angle ratio to the display device 200 , for example, a PC device that can feed back a 21:9 viewing angle ratio video picture to the display device 200 .
  • the display device 200 may send a statement message to the external device 500 in the manner provided in the above-mentioned embodiment, so as to trigger the external device 500 to feed back the multimedia content of the switched viewing angle ratio.
  • the second type of device refers to a device that cannot feed back multimedia content conforming to the corresponding viewing angle ratio to the display device 200 .
  • the external device 500 is a terminal device that can only provide the display device 200 with a viewing angle ratio of 16:9.
  • the display device 200 needs to update the EDID information according to the original viewing angle ratio, so that the display device 200 maintains a 16:9 ratio for screen display. show.
  • the display device 200 may, according to the first control instruction and the current Interface protocol, to query the specific content of the identification data, that is, as shown in Figure 11, when sending the statement information to the external device 500, the display device 200 can extract the angle of view ratio after switching in the first control command, and at the same time detect the current state of the external device interface 240 The interface protocol version used. Then use the angle of view ratio after switching and the protocol version to query the standard timing data in the preset comparison table, so as to add the standard timing data to the EDID information to generate declaration information.
  • the preset comparison table includes multiple protocol versions and standard timing data determined according to the maximum transmission rate supported by each protocol version.
  • the corresponding HDMI protocols that can be used include three versions: 1.4, 2.0, and 2.1.
  • the current display device 200 supports switching display viewing angle ratios including 16:9, 21 :9 and 32:9
  • the display device 200 may include the following comparison table:
  • the viewing angle ratio of 32:9 is selected in the setting interface, and when the display device 200 and the external device 500 are connected through the HDMI1.4 protocol, the display device 200 can be switched according to
  • the rear viewing angle ratio is 32:9 and the current interface protocol version HDMI1.4 finds the corresponding timing data in the above comparison table, that is, the current display device 200 supports a maximum resolution of 3840 ⁇ 1080 corresponding to a viewing angle ratio of 32:9, and a maximum refresh rate 60Hz. Therefore, EDID information is generated according to the corresponding timing data and sent to the external device 500, so that the external device 500 can feed back multimedia content with a resolution not higher than 3840 ⁇ 1080 and a frame rate not higher than 60 Hz.
  • the above comparison table can be uniformly configured by the operation service provider of the display device 200, that is, the operation service provider can generate a corresponding comparison table according to the interface protocol version supported by each display device 200, and save it in the factory or after online activation.
  • the comparison table may be called from the memory or downloaded from the server of the operator service provider.
  • the comparison table can also be generated by the display device 200 by executing a detection program, that is, after the external device 500 is connected to the display device 200, the display device 200 can traverse the currently supported external device interface protocol versions, and obtain each The maximum transmission rate of each version of the external device interface protocol, so as to calculate the maximum resolution and maximum frame rate of the external device interface protocol transmission according to the maximum transmission rate. Finally, generate standard timing data according to the calculated maximum resolution and maximum frame rate, and store the standard timing data to generate a comparison table.
  • the HDMI versions supported by the display device 200 are divided into 1.4, 2.0 and 2.1, it is determined that there are three types of EDID information sent by the display device 200, because the maximum transmission rate of each HDMI version is limited.
  • the maximum resolution of version 1.4 is 4K and the maximum frame rate is 30Hz
  • the maximum resolution of version 2.0 is 4K and the maximum frame rate is 60Hz
  • the maximum resolution of version 2.1 is 4K and the maximum frame rate is 120Hz.
  • the wide viewing angle resolution under the HDMI version shall not be greater than the above maximum.
  • the content of the standard timing data under each highest image quality can be automatically determined.
  • the user can switch the interface protocol version during use, so when the display device 200 and external device 500 When the version of the interface protocol used by the device 500 changes, the corresponding identification data may also change.
  • the display device 200 can also update the declaration information when the user switches the interface protocol version, so that the external device 500 can report the declaration information to the display device 200 according to the updated declaration information.
  • Feedback multimedia content that conforms to the current interface protocol version and viewing angle ratio. That is, the display device 200 may acquire the second control command input by the user for switching the protocol version of the external device interface, and in response to the second control command, query the identification data according to the switched protocol version of the external device interface. Then, the queried identification data is used to update the statement information, so as to send the updated statement information to the external device 500 .
  • the display device 200 when the display device 200 displays a video image with a viewing angle ratio of 21:9, if the user replaces the HDMI cable or changes the HDMI protocol version from 1.4 to 2.0, the display device 200 can be compared according to the interface protocol version 2.0 after switching. Query in the table to obtain the timing data content of the HDMI2.0 version with a viewing angle ratio of 21:9, that is, the maximum display resolution is 3840 ⁇ 1600, and the maximum frame rate is 60Hz. Based on this, the display device 200 can use the timing data to update the EDID information, and send the EDID information to the external device 500 .
  • the external device 500 may feed back the multimedia content to the display device 200 according to the new timing data. For example, if the timing data contained in the received EDID information is that the maximum display resolution supported by the current display device 200 is 3840 ⁇ 1600 and the highest frame rate is 60 Hz, then the display device 200 can be fed back that the resolution is 3840 ⁇ 1600 and the frame rate is 3840 ⁇ 1600. for 60Hz multimedia content.
  • the external device 500 can maintain the update
  • the multimedia content may be fed back in the form of the former multimedia content, or the multimedia content may be fed back in the updated multimedia content form.
  • the external device 500 must feed back the multimedia content in the form of the updated multimedia content.
  • the external device 500 can still feed back multimedia content with a frame rate of 30 Hz, or change it to feed back multimedia content with a frame rate of 60 Hz. content.
  • the external device 500 must change the multimedia content with a frame rate of 60Hz to the multimedia content with a frame rate of 30Hz to use The transmission capability of the lower version protocol.
  • the display device 200 can make the external device 500 perform a corresponding feedback action by changing a hotplug voltage. That is, in the step of receiving the multimedia content fed back by the external device 500 for the statement information, the display device 200 can control the hot-swap voltage to be pulled down according to the statement information, so as to notify the external device 500 to read the statement information, and after a preset delay time, again The hot plug voltage is controlled to be pulled down, so as to notify the external device 500 to switch the viewing angle ratio and feed back the multimedia content according to the switched viewing angle ratio.
  • FIG. 13 is a schematic display flow chart according to some embodiments, and the process includes the following steps:
  • S1301 The user switches the viewing angle ratio/HDMI version.
  • S1302 The display device judges the current HDMI version, wherein, if the current HDMI version is version 1.4, perform S1303; if the current HDMI version is 2.0, perform S1304; if the current HDMI version is 2.1, perform S1305.
  • S1304 Read the standard timing of version 2.0, and then execute S1306.
  • S1306 The display device pulls down the hotplug voltage (hotplug voltage) to notify the external device to read the EDID information.
  • the display device 200 can first determine the current HDMI version, and combine it with the switched viewing angle ratio included in the first control command, Update the corresponding standard timing data to EDID information. At this point, the display device 200 can automatically pull down the hotplug voltage to notify the external device 500 to read the EDID information. Then send the EDID information to the external device 500 for the external device 500 to read.
  • the display device setting delay is 800ms.
  • S1308 The display device pulls down the hot-swap voltage to notify the external device to feed back the multimedia content.
  • the display device 200 can set a delay time of 800 ms, and then pull down the hot plug voltage (hotplug voltage) again to notify the external device 500 to switch the type of multimedia content fed back, that is, to switch
  • the video signal corresponds to the resolution or frame rate of the picture, and a new video signal is sent, so that the display device 200 can perform subsequent display work according to the switched video signal.
  • these external devices 500 may still maintain the original form of multimedia content for feedback after the display device 200 sends EDID information, and after the display device 200 switches the viewing angle ratio, The display device 200 will display the screen with the new viewing angle ratio. At this time, the multimedia content fed back by the external device 500 will not adapt to the display mode of the display device 200 , and problems such as failure to display or abnormal display will occur.
  • the display device 200 can detect the image corresponding to the multimedia content after the external device 500 feeds back the multimedia content, so as to determine whether the multimedia content is suitable for the scale of the viewing angle after switching . That is, in the step of controlling the display 260 to display the multimedia content, the display device 200 may extract the identification frame image from the multimedia content, and detect the resolution of the identification frame image.
  • the identified frame image may be a frame image in a multi-frame display image obtained after the display device 200 decodes the multimedia content.
  • the display device 200 may determine the resolution corresponding to the multimedia content according to the number of pixels included in the width and height directions of this frame of image.
  • the display device 200 may extract multiple frames of images at intervals from the decoding result of the multimedia content, and perform resolution detection on each frame of image, Therefore, the resolution corresponding to the multimedia content is determined.
  • the display device 200 may compare the resolution of the recognized frame image with the ratio of the viewing angle after switching. If the resolution of the identified frame image is equal to the switched viewing angle ratio, that is, the multimedia content fed back from the external device 500 to the display device 200 conforms to the switched viewing angle ratio, the multimedia content can be displayed according to the switched viewing angle ratio. If the resolution of the identification frame image is not equal to the viewing angle ratio after switching, that is, the multimedia content fed back by the external device 500 to the display device 200 does not conform to the viewing angle ratio after switching, the display device 200 can modify the identification data in the declaration information to be the viewing angle ratio before switching. Identify data to display multimedia content in proportion to the viewing angle before switching.
  • an algorithm can also be designed to set the output size of the display device 200 and dynamically adjust the size of the display window according to the aspect ratio of the input signal. That is, in the step of controlling the display 260 to display multimedia content, the display device 200 can first detect the physical size of the display 260, including the screen width and screen height; meanwhile, acquire the screen size of the multimedia content, including the screen width and screen height. Then build a virtual screen according to the physical size and screen size, and display multimedia content according to the virtual screen.
  • the aspect ratio of the constructed virtual screen is equal to the display ratio of the target screen of the multimedia content; the width of the virtual screen is equal to the screen width of the monitor, and the height of the virtual screen is equal to the zoom ratio times of the screen height, and the zoom ratio is equal to the screen height and the screen height ratio.
  • the physical size of the display device 200 is 16:9 (3840 ⁇ 2160), and when the signal is input to the display device 200 with a 32:9 (3840 ⁇ 1080) wide viewing angle ratio picture, the display The device 200 can construct a virtual screen and dynamically calculate its size according to the aspect ratio of the input signal, and finally center the virtual screen on the display 260 to ensure that the picture is displayed normally according to the original ratio.
  • the display device 200 since the physical size of the display device 200 is 16:9, when the wide viewing angle (21:9 ⁇ 32:9) picture is sent to the display device 200, the display device 200 will follow the original video output mode, and the input picture will be displayed in the vertical direction. Stretch to fill the entire display area, as shown in Figure 15, such a display method will result in distortion of the screen content.
  • the display device 200 introduces the virtual screen and dynamically calculates its size according to the aspect ratio of the input signal, and finally displays the virtual screen centered on the physical screen, as shown in FIG. Displayed normally with original scale.
  • some embodiments of the present application further provide a display device 200 , including: a display 260 , an external device interface 240 and a controller 250 .
  • the display 260 is used to display the user interface;
  • the external device interface 240 is configured to connect the external device 500; as shown in FIG. 17 ,
  • the controller 250 is configured to execute the following program steps:
  • S1701 Acquire a first control instruction input by a user for switching a viewing angle ratio.
  • S1702 In response to the first control instruction, send declaration information to the external device, where the declaration information includes identification data conforming to the protocol version of the external device interface and the scale of the viewing angle after switching.
  • S1703 Receive multimedia content fed back by the external device for the statement information, where a target screen display ratio of the multimedia content is equal to the switched viewing angle ratio.
  • an external device 500 is also provided in some embodiments of the present application, including: a video interface and a processor.
  • the video interface is configured to connect a display device; as shown in Figure 18, the processor is configured to perform the following program steps:
  • the display device acquires a first control instruction input by a user for switching a viewing angle ratio.
  • S1802 The display device sends declaration information to the external device in response to the first control instruction.
  • the external device acquires the declaration information sent by the display device, and generates multimedia content.
  • the statement information includes identification data conforming to the version of the interface protocol of the external device of the display device and the ratio of the viewing angle after switching.
  • S1804 The external device feeds back the multimedia content to the display device according to the identification data.
  • S1805 The display device displays the multimedia content according to the switched viewing angle ratio.
  • the display device 200 and the external device 500 provided in the above-mentioned embodiments can send announcement information to the external device 500 according to the control command input by the user when the user switches the viewing angle ratio, so as to inform the external device 500 of the viewing angle ratio currently supported by the display device 200 . Then receive the multimedia content fed back by the external device 500 for the statement information, and display the received multimedia content according to the switched viewing angle ratio.
  • the display device 200 sends the currently supported viewing angle ratio to the external device 500 through declaration information, and the declaration information includes identification data conforming to the protocol version of the external device interface 240 and the viewing ratio after switching, so that the external device 500 can feedback that the multimedia content can adapt to the The protocol version and the viewing angle ratios supported by the display device 200 alleviate the problem of no signal input in some viewing angle ratios.
  • the above-mentioned embodiment uses ratios of 16:9, 21:9, and 32:9 as examples to describe the viewing angle ratio and screen size to the multi-view display method.
  • the scope of application is limited, and according to the different types of the display device 200 and the external device 500 , other specific display ratios of the target screen may also be applied in the actual display process.
  • the EDID information of HDMI2.1 version is also used to describe the declaration information and identification data, which is also only used as an example, and will not be used for the data transfer process between the display device 200 and the external device 500 cause limitation.
  • the protocol version and connection mode specifically adopted by the display device 200 and the external device 500 can also be selected and determined according to specific situations.
  • Different multimedia content can be played on the display device, among which, the multimedia content played on the display device can include: teaching video, singing video, dancing video, game video, etc. Users can interact with the display device to perform multimedia content on the display device. Watch content, or perform immersive experience of other data content (such as game experience), thereby enriching the user's spare time life.
  • the user when the user interacts with the display device, he will interact with the display device in different postures. For example, when the user experiences the game scene on the display device, he usually uses a sitting or standing posture to watch the display device.
  • the viewing angle will affect the viewing effect of the user watching the multimedia content.
  • the user's viewing angle may form a certain angle with the display device, which is not within the optimal viewing angle range of the display device, or the user's face position is not in the central area of the display device, which will make it difficult for the user to view the display device at an optimal viewing angle.
  • the viewing angle or the best position to experience the game scene when the user interacts with the display device, he will interact with the display device in different postures. For example, when the user experiences the game scene on the display device, he usually uses a sitting or standing posture to watch the display device.
  • the viewing angle will affect the viewing effect of the user watching the multimedia content.
  • the user's viewing angle may form a certain angle with the display device, which is not within the
  • the user when the user adjusts the posture viewing angle, he can adjust the display ratio of different images by triggering the control function on the display device, which leads to the need for the user to repeatedly adjust the ratio according to different viewing angles when watching multimedia content, thereby affecting The user's viewing effect.
  • the user can manually adjust the display mode of the display device through the adjustment button on the controller/display device to select a screen display ratio/screen display position that suits him. Therefore, the manual adjustment method will affect the user's viewing of content. Especially in the game scene, it will directly affect the user's game experience and further reduce the user's device experience.
  • the display device collects its corresponding environmental image, determines the image area corresponding to the human face included in the environmental image based on the environmental image, and based on the initial display mode of the multimedia content, the image area corresponding to the human face and The positional relationship of the environmental image determines the target display mode of the multimedia content, wherein the target display mode is used to describe the target screen display ratio of the multimedia content and/or the target screen display position of the multimedia content, so that the multimedia content is displayed based on the target display mode, by
  • the above method can determine the display mode of the adapted multimedia content based on different gestures of the user when the user is watching the multimedia content, and always maintain the best match between the display screen of the multimedia content and the viewing angle of the user's eyes, and improve the user's viewing satisfaction and viewing angle. perspective effect.
  • Fig. 19 is a schematic diagram of an operation scenario between a display device and a control device according to some embodiments.
  • the user can operate the display device 200 through a smart device 300 (such as a mobile phone) or a control device 100 (such as a handle/mouse/keyboard/remote controller), so that the display device 200 can play corresponding multimedia content, wherein the display device 200 can adjust the screen display ratio and screen display position of playing multimedia content on the display device 200 based on the posture of the user, so that multimedia content with different screen display ratios can be played on the display device 200, or, in different playback areas on the display device 200 Play multimedia content corresponding to the screen display ratio, wherein, the display device 200 can divide the display area into multiple screen display positions to play the multimedia content, and the screen display ratio played on the display device 200 can be the width of the playback screen of the display device.
  • Aspect ratios, specifically, the display ratios of images that can be played on the display device 200 may include: 32:9, 21:9, and 16:9
  • the user can turn on the display device through a remote control, and control the multimedia content played on the display device, and the display device can adjust the screen display ratio and screen display position of the multimedia content according to the gesture of the user.
  • the display area of the display screen of the display device may include: a first area, a second area, and a third area, wherein the first area is above the second area, the second area is above the third area, and When it is detected that the user's eyes are in the first area, the screen display position of the multimedia content is adjusted to be displayed in the first area; when the user's eyes are detected in the second area, the screen display position of the multimedia content is adjusted to be displayed in the second area.
  • the screen display position of the multimedia content When it is detected that the user's eyes are in the third area, adjust the screen display position of the multimedia content to the third area display; in addition, when it is detected that the vertical angle between the user's eyes and the display device is less than or equal to 30°, adjust the multimedia content
  • the screen display ratio of the multimedia content is 32:9.
  • the screen display ratio of the multimedia content is adjusted to 21:9.
  • the vertical angle between the display devices is greater than 45°
  • the screen display ratio of the multimedia content is adjusted to 16:9, thereby solving the problems in the prior art, and it is possible to determine based on different postures of the user when the user watches the multimedia content.
  • the display mode of the adapted multimedia content always maintains the best match between the display screen of the multimedia content and the viewing angle of the user's eyes, improving the user's viewing satisfaction and viewing angle effect.
  • control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication, Bluetooth protocol communication, wireless or other wired methods to control the display device 200 .
  • the user can control the display device 200 by inputting user commands through buttons on the remote control, voice input, and control panel input.
  • the display device 200 can also be controlled using mobile terminals, tablet computers, computers, notebook computers and other smart devices.
  • control device 100 may also be a mouse/keyboard/handle, and the communication between the mouse/keyboard/handle and the display device may include infrared protocol communication, Bluetooth protocol communication, wireless or other wired methods to control the display device 200 .
  • the user can control the display device 200 by inputting user instructions through buttons on the mouse/keyboard/handle, voice input, and control panel input.
  • the display device 200 may not use the aforementioned smart device or control device to receive instructions, but may receive user control through touch or gesture.
  • the display device 200 can also be controlled in a manner other than the control apparatus 100 and the smart device 300, for example, controlled by voice commands.
  • the smart device 300 can communicate with the software application installed in the display device 200 through a network communication protocol, so as to realize the purpose of one-to-one control operation and data communication.
  • FIG. 20 is a schematic diagram showing an icon control interface of an application program in a display device 200 according to some embodiments.
  • the application program layer includes at least one application program that can display a corresponding icon control on the display, such as: live TV App Icon Control, VOD App Icon Control, Media Center App Icon Control, App Center Icon Control, Gaming App Icon Control, etc.
  • Live TV app that provides live TV from different sources.
  • a video-on-demand application that can provide videos from different storage sources. Unlike live TV applications, video on demand provides video displays from some stored source.
  • the media center application program can provide an application program for playing various multimedia contents.
  • the application program center can provide and store various application programs.
  • the above-mentioned display device is a terminal device with a display function, such as a television or a flat-panel television.
  • a display function such as a television or a flat-panel television.
  • the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory.
  • the controller 250 controls the overall operations of the display device 200 .
  • the user can input a user command through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.
  • an output interface (display 260, and/or, audio output interface 270), configured to output user interaction information
  • a communicator 220 configured to communicate with the server 400;
  • the image collection interface 290 is configured to: collect an environmental image corresponding to the display device;
  • the controller 250 is configured to: determine a target display mode of the multimedia content to be displayed based on the user's control, the target display mode is used to describe the target screen display ratio of the multimedia content and/or the target of the multimedia content A picture display position; controlling the display to display the multimedia content based on the target display mode.
  • controller 250 is further configured to: determine the image area corresponding to the face based on the environment image;
  • the target display mode is used to describe the target of the multimedia content The screen display ratio and/or the target screen display position of the multimedia content;
  • the display 260 is configured to: display the multimedia content based on the target display mode.
  • the positional relationship between the image area corresponding to the human face and the environment image includes: a relative angle relationship, wherein the relative angle relationship is that the center point of the image area and the environment image is on the first side upward angle information; the controller 250 is further configured to: acquire the initial screen display ratio included in the initial display mode; based on the initial screen display ratio and the angle information included in the positional relationship, determine the The target aspect ratio of the multimedia content.
  • the controller 250 is further configured to: determine that the initial screen display ratio is a preset screen display ratio, and determine that the angle information included in the position relationship changes; the preset The screen display ratio is the corresponding screen display ratio when the display device is in a full-screen display state; based on the angle information included in the position relationship, the target screen display ratio of the multimedia content is determined.
  • the controller 250 is further configured to: if the angle information is within a preset first angle range, determine that the target screen display ratio of the multimedia content is the first display ratio; or, if the If the angle information is in the preset second angle range, then determine that the target screen display ratio of the multimedia content is the second display ratio; or, if the relative angle is in the preset third angle range, then determine that the multimedia content
  • the target screen aspect ratio of is the third aspect ratio.
  • the positional relationship between the image area corresponding to the human face and the environmental image includes: a relative vertical relationship, the relative vertical relationship being the distance between the image area and the environmental image in the second direction difference; the controller 250 is further configured to: obtain the initial screen display ratio included in the initial display mode; determine the multimedia content according to the initial screen display ratio and the distance difference included in the positional relationship Target screen display position.
  • the controller 250 is further configured to: determine that the initial screen display ratio is not a preset screen display ratio, and determine that the distance difference included in the position relationship changes, the preset The screen display ratio is the corresponding screen display ratio when the display device is in a full-screen display state; according to the distance difference included in the position relationship, determine the target screen display position of the multimedia content.
  • the controller 250 is further configured to: if the distance difference is within a preset first distance range, determine that the target screen display position of the multimedia content is the first display position; or, if the If the distance difference is within the preset second distance range, then determine that the target screen display position of the multimedia content is the second display position; or, if the distance difference is within the preset third distance range, then determine the multimedia content’s target screen display position The target screen display position is the third display position.
  • the controller 250 is further configured to: check the target screen display ratio based on a preset screen display ratio, the preset screen display ratio is when the display device is in full-screen display The corresponding screen display ratio in the state; determining the target screen display ratio as the preset screen display ratio.
  • the display device collects the corresponding environmental image, determines the image area corresponding to the face included in it based on the environmental image, and based on the initial display mode of the multimedia content, the position of the image area corresponding to the human face and the environmental image relationship, determine the target display mode of the multimedia content, wherein the target display mode is used to describe the target screen display ratio of the multimedia content and/or the target screen display position of the multimedia content, so that the multimedia content is displayed based on the target display mode, and the above method can be used in
  • the display mode of the adapted multimedia content is determined based on the user's different postures, and the best match between the display screen of the multimedia content and the viewing angle of the user's eyes is always maintained, and the user's viewing satisfaction and viewing angle effect are improved.
  • Figure 21A is a system frame diagram of multimedia content display according to some embodiments, as shown in Figure 21A, the system may include an environment image acquisition module 601, an image area determination module 602, a display mode determination module 603 and a multimedia content display module 604 .
  • the system collects the environment image corresponding to the display device through the environment image acquisition module 601, and finds the image area corresponding to the human face from the environment image by the image area determination module 602, and then uses the display mode determination module 603 based on the initial display mode of the multimedia content And, the positional relationship between the image area corresponding to the face and the environment image determines the target display mode of the multimedia content, wherein the target display mode is used to describe the target screen display ratio of the multimedia content and/or the target screen display position of the multimedia content, and also That is, the target display mode may include: a target screen display ratio and/or a target screen display position of the multimedia content, the target screen display ratio is the aspect ratio of the display screen of the multimedia content displayed on the display device, and the target screen display position is
  • Figure 21B is an architecture diagram for displaying multimedia content according to some embodiments. Based on the above system framework, the implementation of the present disclosure in the Android system is shown in Figure 21B.
  • the Android system mainly includes an application layer, a framework layer, a system runtime layer, and In the core layer, the implementation logic is mainly embodied in the application layer, including the environment image acquisition module, the image area determination module, the display mode determination module and the multimedia content display module.
  • the display method provided in the embodiment of the present disclosure can collect the environment image corresponding to the display device, find the image area of the human face included in the environment image, and use the initial display mode of the multimedia content and the face image area and data image position correspondence, determine the final screen display ratio of the displayed multimedia content and/or the final screen display position in the display device, and display the multimedia content on the display device with the final screen display ratio and/or final screen display position, through
  • the above method can determine the display mode of the adapted multimedia content based on different gestures of the user when the user is watching the multimedia content, and always maintain the best match between the display screen of the multimedia content and the viewing angle of the user's eyes, and improve the user's viewing satisfaction and viewing angle. perspective effect.
  • FIG. 22A The following will be described in conjunction with FIG. 22A. It can be understood that the steps involved in FIG. 22A may include more steps or fewer steps in actual implementation, and the order of these steps may also be different, so as to realize The display method provided in the embodiments of the present disclosure shall prevail, and the embodiments of the present disclosure shall not limit it.
  • FIG. 22A is a schematic flowchart of a display method according to some embodiments, and the display method specifically includes the following steps:
  • the scene area of the display device can be collected based on the camera device through the image collection interface to obtain the environment image, and the collected environment image can be sent to the display device through the communication connection between the camera device and the display device through the image collection interface, so that the display device Get an image of the environment.
  • the camera device can be an image acquisition unit built into the display device, which is connected to the inside of the display device through an image acquisition interface, and captures the scene image of the display device in real time while the display device is playing the display screen, or the camera device It can be an external camera of the display device, which can be connected to the display device through the image acquisition interface, and can collect the scene image of the display device while the display device is playing the display screen through a wired connection or a wireless connection with the display device.
  • the display device can start the working thread after checking that the camera device is available, and instruct the camera device to capture the scene image of the display device in real time at a collection speed of one frame per second, and the camera device can send the acquired scene image to the display device
  • the controller of the model is processed to mark the area corresponding to the face image.
  • the TV (display device) can be equipped with an external camera (external camera), which is connected to the camera through a Universal Serial Bus (USB) to shoot the scene in front of the TV in real time, and will obtain The obtained picture is converted into jpeg file->bitmap data->bytebuffer data in turn, and sent to the machine learning model in tflite format stored in the controller.
  • the machine learning model matches the facial features. If there are facial features in the picture image, Then the face features can be framed into the rectangular area and the coordinates of the corresponding four vertices of the rectangle can be determined.
  • the initial display mode of the multimedia content can be used to describe the current screen display ratio corresponding to the multimedia content and/or the current screen display position of the multimedia content, that is, the initial display mode corresponding to the multimedia content can include: the current screen display ratio, or, the current The screen display position, or, the current screen display ratio and the current screen display position.
  • the current picture display ratio corresponding to the multimedia content is the aspect ratio of the corresponding area of the current display picture, which may include: a first display ratio, a second display ratio and a third display ratio.
  • the first display ratio may be 16: 9.
  • the second display ratio can be 21:9
  • the third display ratio can be 32:9
  • 16:9 corresponds to the full-screen display of the current display screen as the display device
  • 21:9 and 32:9 correspond to the current display screen as the display device non-full-screen display.
  • the display area of the first display scale corresponds to the display area 1 of the display device
  • the display area of the second display scale corresponds to the display area 2 of the display device
  • the display area of the third display area corresponds to the display area 3 of the display device .
  • the display position of the current screen corresponding to the multimedia content is the display position of the corresponding area of the current display screen in the display device.
  • the display device can split the display screen into multiple display positions, and each display position can correspond to a display area, such as , the display device splits the display screen into three display positions, which may respectively include: a first display position, a second display position, and a third display position.
  • the first display position may correspond to display area 4, which may correspond to the upper display area of the display device
  • the second display position may correspond to display area 5, which may correspond to the middle display area of the display device
  • the third display position may correspond to The display area 6 may correspond to the lower display area of the display device.
  • the positional relationship between the image area corresponding to the face and the environment image can be the angle value and the vertical distance difference between the image area corresponding to the face and the environment image
  • the angle value can be used to reflect the viewing angle of the user viewing the display device
  • the vertical distance difference can be To reflect the correspondence between the user viewing the display device and the vertical displacement of the display device.
  • the target display mode can be used to describe the target screen display ratio of the multimedia content and/or the target screen display position of the multimedia content, that is, the target display mode corresponding to the multimedia content can include: the target screen display ratio, or the target screen display position , or, the target screen display ratio and target screen display position.
  • the target display mode may include the first display ratio referred to above, or the second display ratio (/third display ratio) and the first display position, or the second display ratio (/third display ratio) and the second display position, or, the second display scale (/third display scale) and the third display position, etc.
  • the target display mode is the first display ratio, which means that the multimedia content is displayed in a full-screen state on the display device, and the target display mode is the second display ratio (/third display ratio) and the first display position, which means that the multimedia content is displayed in full screen
  • the screen size corresponding to display area 2 (or the screen size corresponding to display area 3) is displayed on the full screen on the device.
  • the target display mode is the second display ratio (/third display ratio) and the second display position, which means that the multimedia content is displayed on the display device at the screen size corresponding to display area 2 (or the screen size corresponding to display area 3) in display area 5
  • the center of the display is displayed, and the size of the display screen is the screen size corresponding to display area 2 (or the screen size corresponding to display area 3).
  • the target display mode is the second display ratio (/third display ratio) and the third display position, which means that the multimedia content is displayed on the display device at the screen size corresponding to display area 2 (or the screen size corresponding to display area 3) in display area 6
  • the center of the screen is displayed, and the size of the display screen is the screen size corresponding to display area 2 (or the screen size corresponding to display area 3).
  • the display device may display the multimedia content based on the target screen display ratio of the multimedia content and/or the target screen display position of the multimedia content.
  • the target display mode may include: a target display ratio, a target display image, and a target display ratio and a target display image.
  • the multimedia content displays the picture corresponding to the display area 2 in a full screen state on the display device; when the target display mode is the third display ratio, the multimedia content is displayed on the display device in a The screen corresponding to the display area 3 is displayed in the full screen state.
  • the target display mode is the first display position
  • the multimedia content is displayed on the display area 4 of the display device, and the screen display size of the multimedia content is the same as the screen size of the display area 4.
  • the target display mode is the second display position
  • the multimedia content is displayed on the display area 5 of the display device, and the screen display size of the multimedia content is the same as the screen size of the display area 5.
  • the target display mode is the third display position
  • the multimedia content is displayed on the display area 6 of the display device.
  • the screen display size of the content is the same as the screen size of the display area 6 .
  • the positional relationship between the image area corresponding to the face and the environment image may include: the angle between the image area corresponding to the face and the center point of the environment image in the vertical direction, where the vertical The direction may be the direction of the vertical side corresponding to the horizontal direction with the ground on which the user stands.
  • the environment image can be divided into four display areas by horizontal lines (horizontal lines) and vertical lines (vertical lines), which are respectively: upper left area, lower left area, upper right area and lower right area,
  • horizontal lines horizontal lines
  • vertical lines vertical lines
  • the initial screen display included in the initial display mode may be The ratio is judged, and combined with the angle between the image area corresponding to the face and the center point of the environment image in the vertical direction, thereby effectively determining the target display ratio of the multimedia content.
  • the angle between the image area corresponding to the face and the center point of the environment image in the vertical direction Change detection is performed to effectively determine the target screen display ratio of the multimedia content.
  • a preset screen display ratio can be used to describe the current screen display status of the display device, for example, the preset screen display ratio can be set to 16:9, indicating that the current screen display status of the display device is full screen display, As a prerequisite for determining that the angle information included in the positional relationship has changed.
  • multiple angle ranges can be set in advance, and when the image area corresponding to the face and the environment are determined When the included angle of the center point of the image in the vertical direction changes to another included angle range, it is determined that the included angle of the image region corresponding to the face and the center point of the environment image changes in the vertical direction.
  • three included angle ranges can be preset to reflect the included angle between the image area corresponding to the user's face and the center point of the environment image.
  • the three included angle ranges are: the first included angle range, the second included angle range Angle range and the third included angle range, wherein, the first included angle range is: [0, 30°], the second included angle range: (30°, 45°], the third included angle range: (45°, 60 °], assuming that the initial angle between the image area corresponding to the face and the center point of the environment image in the vertical direction is 25°, and the initial angle between the image area corresponding to the face and the center point of the environment image in the vertical direction changes is 50°, it is determined that the included angle between the image area corresponding to the face and the center point of the environment image changes.
  • the included angle between the image area corresponding to the human face and the center point of the environment image may be compared with a preset angle range, thereby effectively determining a target display ratio of the multimedia content adapted to the user's face.
  • the specific range of the included angle between the image area corresponding to the face and the center point of the environment image can be set based on the relationship between the angle of view of the face and the sharpness.
  • the first target screen display ratio for multimedia content adaptation to the user's face can be determined, As shown in Figure 23C, combined with Figure 23A, when it is detected that the angle ⁇ between the human face and the central point O is less than or equal to 30°, it can be determined that the target screen display ratio of the multimedia content adaptation and the user's face is 32 :9.
  • the second target screen display ratio for multimedia content adaptation and the user's face can be determined, as shown in Figure 23D As shown in FIG. 23A, when it is detected that the angle ⁇ between the human face and the central point O is greater than 30° or less than or equal to 45°, it can be determined that the target screen display ratio of the multimedia content adaptation and the user's face is 21: 9.
  • the third target screen display ratio for multimedia content adaptation and the user's face can be determined, as shown in Figure 23E
  • the ratio is 16:9.
  • the preset image display ratio may be a display ratio for full-screen display in a display device, such as 16:9.
  • the target screen display ratio when the target screen display ratio is checked, if the adjusted target screen display ratio of the multimedia content is 16:9, it is determined that the vertical position of the user's observation is consistent with the vertical position of the TV screen display. Consistent, if the adjusted target screen display ratio of the multimedia content is not 16:9, the vertical display position of the TV screen needs to be adjusted again.
  • the adjustment method of the screen display position has been explained above, and will not be repeated here.
  • the positional relationship between the image area corresponding to the face and the environment image may also include: the horizontal direction between the face and the environment image (such as the uppermost position, the lowermost position, or one of the positions)
  • the relative vertical distance difference, or the proportion of the area of the face area (the image area corresponding to the face) in multiple areas in the environment image can effectively represent the proportion of the area of the human face area in multiple areas in the environment image.
  • the environment image can be divided into three display areas, namely: an upper area, a middle area and a lower area.
  • the human face area is in the lower area.
  • the initial screen display ratio when determining the target display mode of the multimedia content based on the initial display mode of the multimedia content and the positional relationship between the image area corresponding to the face and the environmental image, the initial screen display ratio can also be judged, Therefore, based on the initial screen display ratio and the proportion of the area of the human face area in multiple areas in the environment image, the target screen display position of the multimedia content is determined.
  • the change detection is performed on the relative vertical distance difference between the human face and the display device in the horizontal direction, so as to Effectively determine the display position of the target screen of the multimedia content.
  • a preset screen display ratio can be used to describe the current screen display status of the display device, for example, the preset screen display ratio can be set to 16:9, indicating that the current screen display status of the display device is full screen display, As a prerequisite for determining the change in the distance difference included in the positional relationship.
  • the proportion of the human face area in the environmental image can be determined through the distance difference, and the change occurs in the proportion area.
  • the relative vertical distance difference between the human face and the display device in the horizontal direction can be determined.
  • a maximum proportion of the human face area in the environment image can be determined to determine the target screen display position of the multimedia content, as shown in Figure 24B
  • the target screen display position of the multimedia content can be determined. Display area 6 of the device.
  • another maximum proportion area of the human face area in the environment image can be determined to determine the target screen display position of the multimedia content, as shown in FIG. 24C .
  • the target screen display position of the multimedia content can be determined Display device display area 5.
  • Another maximum proportion area of the human face area in the environment image can be determined to determine the target screen display position of the multimedia content, as shown in Figure 24D.
  • the target screen display position of the multimedia content can be determined Display device display area 4.
  • the present disclosure executes the above display method on the display device, collects the corresponding environment image, determines the image area corresponding to the human face included in the environment image based on the environment image, and based on the initial display mode of the multimedia content and the person
  • the positional relationship between the image area corresponding to the face and the environment image determines the target display mode of the multimedia content, wherein the target display mode is used to describe the target screen display ratio of the multimedia content and/or the target screen display position of the multimedia content, so that based on the target display Mode display multimedia content, through the above method, when the user is watching the multimedia content, the display mode of the adapted multimedia content can be determined based on the user's different postures, and the best match between the display screen of the multimedia content and the viewing angle of the user's eyes can be maintained at all times, and the user can be improved. Viewing satisfaction and viewing angle effects.
  • the controller in the display device in the embodiment of the present application can determine the target display mode of the multimedia content to be displayed based on the user's control, the target display mode can be used to describe the target screen of the multimedia content
  • the display ratio and/or the target screen display position of the multimedia content is controlled, and the display is controlled to display the multimedia content based on the target display mode. Based on this, the purpose of quickly and accurately displaying the multimedia content can be realized.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Databases & Information Systems (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Engineering & Computer Science (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本申请公开了一种显示设备及显示方法。本申请实施例的显示设备包括显示器和控制器，控制器，被配置为：基于用户的控制，确定待显示的多媒体内容的目标显示模式，并控制显示器基于该目标显示模式显示多媒体内容，其中，目标显示模式用于描述多媒体内容的目标画面显示比例和/或多媒体内容的目标画面显示位置。

Description

一种显示设备及显示方法
相关申请的交叉引用
本申请要求在2021年09月07日提交、申请号为202111042636.9；在2022年05月09日提交、申请号为202210503314.8的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及智能显示设备技术领域，尤其涉及一种显示设备及显示方法。
背景技术
随着科技的发展和进步，显示设备的功能越来越多样化，为人们的工作和生活带来了极大的便利。其中，显示设备是指能够输出具体显示画面的终端设备，可以是智能电视、移动终端、智能广告屏、投影仪等终端设备。以智能电视为例，智能电视是基于Internet应用技术，具备开放式操作系统与芯片，拥有开放式应用平台，可实现双向人机交互功能，集影音、娱乐、数据等多种功能于一体的电视产品，用于满足用户多样化和个性化需求。
然而，当前显示设备在显示多媒体内容时，通常只能以固定的画面显示比例等对多媒体内容进行显示，影响用户的观看效果。
发明内容
本申请实施例提供一种显示设备，包括：显示器；控制器，被配置为：基于用户的控制，确定待显示的多媒体内容的目标显示模式，所述目标显示模式用于描述所述多媒体内容的目标画面显示比例和/或所述多媒体内容的目标画面显示位置；控制所述显示器基于所述目标显示模式显示所述多媒体内容。
本申请实施例提供一种用于显示设备的显示方法，包括：基于用户的控制，确定待显示的多媒体内容的目标显示模式，所述目标显示模式用于描述所述多媒体内容的目标画面显示比例和/或所述多媒体内容的目标画面显示位置；基于所述目标显示模式显示所述多媒体内容。
附图说明
图1A为根据一些实施例的显示设备结构示意图；
图1B为根据一些实施例的显示设备的使用场景示意图；
图2为根据一些实施例的控制装置的硬件配置框图；
图3为根据一些实施例的显示设备的硬件配置图；
图4为根据一些实施例的显示设备的软件配置图；
图5为根据一些实施例的显示设备与外接设备连接关系示意图；
图6为根据一些实施例的显示设备与外接设备数据传递关系示意图；
图7为根据一些实施例的多视角比例显示流程示意图；
图8为根据一些实施例的设置界面示意图；
图9为根据一些实施例的检测外接设备类型的流程示意图；
图10为根据一些实施例的音视频元信息示意图；
图11为根据一些实施例的生成声明信息的流程示意图；
图12为根据一些实施例的切换协议版本流程示意图；
图13为根据一些实施例的显示流程示意图；
图14为根据一些实施例的通过虚拟屏幕显示宽视角画面的流程示意图；
图15为根据一些实施例的显示设备拉伸显示实际画面的效果示意图；
图16为根据一些实施例的显示设备通过虚拟屏幕显示实际画面的效果示意图；
图17为根据一些实施例的显示设备侧显示过程时序图；
图18为根据一些实施例的外接设备侧数据反馈过程时序图；
图19为根据一些实施例的显示设备与控制装置之间操作场景的示意图；
图20为根据一些实施例的显示设备200中应用程序的图标控件界面显示示意图；
图21A为根据一些实施例的多媒体内容显示的系统框架图；
图21B为根据一些实施例的多媒体内容显示的架构图；
图22A为根据一些实施例的显示方法的流程示意图；
图22B为根据一些实施例的显示方法对应的系统整体框架图；
图22C为根据一些实施例的多媒体内容的不同画面显示比例的界面示意图；
图22D为根据一些实施例的多媒体内容的不同画面显示位置的界面示意图；
图23A为根据一些实施例的人脸区域与环境图像中心点的夹角示意图；
图23B为根据一些实施例的人眼视角与清晰度关系图；
图23C为根据一些实施例的多媒体内容的第一画面显示比例的示意图；
图23D为根据一些实施例的多媒体内容的第二画面显示比例的示意图；
图23E为根据一些实施例的多媒体内容的第三画面显示比例的示意图；
图24A为根据一些实施例的多媒体内容的显示示意图；
图24B为根据一些实施例的多媒体内容的第一画面显示位置的界面示意图；
图24C为根据一些实施例的多媒体内容的第二画面显示位置的界面示意图；
图24D为根据一些实施例的多媒体内容的第三画面显示位置的界面示意图。
具体实施方式
下面将详细地对实施例进行说明，其示例表示在附图中。下面的描述涉及附图时，除非另有表示，不同附图中的相同数字表示相同或相似的要素。需要说明的是，本申请中对于术语的简要说明，仅是为了方便理解接下来描述的实施方式，而不是意图限定本申请的实施方式。除非另有说明，这些术语应当按照其普通和通常的含义理解。
图1A为根据一些实施例的显示设备结构示意图，如图1A所示，该显示设备可以包括显示器11和控制器12。控制器12可以基于用户的控制，确定待显示的多媒体内容的目标显示模式，该目标显示模式可以用于描述待显示的多媒体内容的目标画面显示比例和/或多媒体内容的目标画面显示位置，也就是说，该目标显示模式可以只描述多媒体内容的目标画面显示比例，也可以只描述多媒体内容的目标画面显示位置，也可以描述多媒体内容的目标画面显示比例以及目标画面显示位置。另外，控制器12可以控制显示器11基于目标显示模式显示多媒体内容。
下面通过具体实施例对本申请的显示设备进行详细介绍。
在一种实施方式中，显示设备上还设有外部装置接口，显示设备可以通过外部装置接口连接外接设备，以接收外接设备发送的音视频数据，即多媒体内容，并对多媒体内容进行播放。例如，典型的智能电视上均设有高清多媒体接口(High Definition Multimedia Interface，HDMI)，主机等外接设备可以通过HDMI接口连接智能电视，并向智能电视输出游戏画面，以利用智能电视的大屏幕对游戏画面进行展示，获得更好的游戏体验。然而，由于外接设备向显示设备发送的视频数据具有特定的视角比例，而显示设备的屏幕也具有特定的物理尺寸比例，使得显示设备具有特定的画面显示比例等显示模式，当多媒体内容的视角比例与屏幕物理尺寸比例(画面显示比例)不相符时，将有可能导致显示设备在部分视角比例模式下无法接收到相适应的视频信号，导致显示设备无法显示外接设备发送的多媒体内容，降低用户体验。
图1B为根据一些实施例的显示设备的使用场景示意图。如图1B所示，显示设备200还与服务器400进行数据通信，用户可通过智能设备300或控制装置100操作显示设备200。
在一些实施例中，控制装置100可以是遥控器，遥控器和显示设备的通信包括红外协议通信或蓝牙协议通信，及其他短距离通信方式中的至少一种，通过无线或有线方式来控制显示设备200。
在一些实施例中，智能设备300可以包括移动终端、平板电脑、计算机、笔记本电脑，AR/VR设备等中的任意一种。
在一些实施例中，也可以使用智能设备300以控制显示设备200。例如，使用在智能设备上运行的应用程序控制显示设备200。
在一些实施例中，也可以使用智能设备300和显示设备进行数据的通信。
在一些实施例中，显示设备200还可以采用除了控制装置100和智能设备300之外的方式进行控制，例如，可以通过显示设备200设备内部配置的获取语音指令的模块直接接收用户的语音指令控制，也可以通过显示设备200设备外部设置的语音控制装置来接收用户的语音指令控制。
在一些实施例中，显示设备200还与服务器400进行数据通信。可允许显示设备200通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。服务器400可以向显示设备200提供各种内容和互动。
图2为根据一些实施例的控制装置100的硬件配置框图。如图2所示，控制装置100包括控制器110、通信接口130、用户输入/输出接口140、存储器、供电电源。控制装置100可接收用户的输入操作指令，且将操作指令转换为显示设备200可识别和响应的指令，起用用户与显示设备200之间交互中介作用。
在一些实施例中，通信接口130用于和外部通信，包含WIFI芯片，蓝牙模块，NFC或可替代模块中的至少一种。
在一些实施例中，用户输入/输出接口140包含麦克风，触摸板，传感器，按键或可替代模块中的至少一种。
图3为根据一些实施例的显示设备200的硬件配置框图。
在一些实施例中，显示设备200包括调谐解调器210、通信器220、检测器230、外部装置接口240、控制器250、显示器260、音频输出接口270、存储器、供电电源、 用户接口中的至少一种。
在一些实施例中控制器包括中央处理器，视频处理器，音频处理器，图形处理器，RAM，ROM，用于输入/输出的第一接口至第n接口。
在一些实施例中，显示器260包括用于呈现画面的显示屏组件，以及驱动图像显示的驱动组件，用于接收源自控制器输出的图像信号，进行显示视频内容、图像内容以及菜单操控界面的组件以及用户操控UI界面等。
在一些实施例中，显示器260可为液晶显示器、OLED显示器、以及投影显示器中的至少一种，还可以为一种投影装置和投影屏幕。
在一些实施例中，调谐解调器210通过有线或无线接收方式接收广播电视信号，以及从多个无线或有线广播电视信号中解调出音视频信号，如以及EPG数据信号。
在一些实施例中，通信器220是用于根据各种通信协议类型与外部设备或服务器进行通信的组件。例如：通信器可以包括Wifi模块，蓝牙模块，有线以太网模块等其他网络通信协议芯片或近场通信协议芯片，以及红外接收器中的至少一种。显示设备200可以通过通信器220与控制装置100或服务器400建立控制信号和数据信号的发送和接收。
在一些实施例中，检测器230用于采集外部环境或与外部交互的信号。例如，检测器230包括光接收器，用于采集环境光线强度的传感器；或者，检测器230包括图像采集器，如摄像头，可以用于采集外部环境场景、用户的属性或用户交互手势，再或者，检测器230包括声音采集器，如麦克风等，用于接收外部声音。
在一些实施例中，外部装置接口240可以包括但不限于如下：高清多媒体接口(HDMI)、模拟或数据高清分量输入接口(分量)、复合视频输入接口(CVBS)、USB输入接口(USB)、RGB端口等任一个或多个接口。也可以是上述多个接口形成的复合性的输入/输出接口。
在一些实施例中，控制器250和调谐解调器210可以位于不同的分体设备中，即调谐解调器210也可在控制器250所在的主体设备的外置设备中，如外置机顶盒等。
在一些实施例中，控制器250，通过存储在存储器上中各种软件控制程序，来控制显示设备的工作和响应用户的操作。控制器250控制显示设备200的整体操作。例如：响应于接收到用于选择在显示器260上显示UI对象的用户命令，控制器250便可以执行与由用户命令选择的对象有关的操作。
在一些实施例中控制器包括中央处理器(Central Processing Unit，CPU)，视频处理器，音频处理器，图形处理器(Graphics Processing Unit，GPU)，RAM Random Access Memory，RAM)，ROM(Read-Only Memory，ROM)，用于输入/输出的第一接口至第n接口，通信总线(Bus)等中的至少一种。
CPU处理器。用于执行存储在存储器中操作系统和应用程序指令，以及根据接收外部输入的各种交互指令，来执行各种应用程序、数据和内容，以便最终显示和播放各种音视频内容。CPU处理器，可以包括多个处理器。如，包括一个主处理器以及一个或多个子处理器。
在一些实施例中，用户可在显示器260上显示的图形用户界面(GUI)输入用户命令，则用户输入接口通过图形用户界面(GUI)接收用户输入命令。或者，用户可通过输入特定的声音或手势进行输入用户命令，则用户输入接口通过传感器识别出声 音或手势，来接收用户输入命令。
在一些实施例中，用户输入接口280，为可用于接收控制输入的接口(如：显示设备本体上的实体按键，或其他等)。
参见图4，在一些实施例中，将系统分为四层，从上至下分别为应用程序(Applications)层(简称“应用层”)，应用程序框架(Application Framework)层(简称“框架层”)，安卓运行时(Android runtime)和系统库层(简称“系统运行库层”)，以及内核层。
在本申请实施例中，显示设备200连接外接设备500是指建立通信连接，而建立通信连接的显示设备200和外接设备500分别作为接收端(Sink端)和发送端(source端)。例如，如图5所示，外接设备500可以是游戏设备，在用户使用游戏设备过程中，能够针对游戏过程实时输出视频数据和音频数据等多媒体内容，并将视频数据和音频数据等多媒体内容发送给显示设备200，以通过显示设备200将视频数据和音频数据等多媒体内容输出为视频画面和声音。此时，游戏设备作为发送端，而显示设备200作为接收端。
发送端与接收端之间，可以通过特定接口实现通信连接，从而传递数据。为此，在发送端和接收端上都应设有同一种接口规范和功能的数据接口。例如，如图5所示，在显示设备200和外接设备500上都均设有高清多媒体接口(High Definition Multimedia Interface，HDMI)。在使用过程中，用户可以将HDMI接口数据线的两端分别插在显示设备200和外接设备500上，并在启动外接设备500和显示设备200后，设定显示设备200的信号源为HDMI接口，从而实现显示设备200与外接设备500之间的数据传输。
需要说明的是，为了实现显示设备200与外接设备500之间的通信连接，显示设备200与外接设备500之间还可以采用其他的连接方式。具体的连接方式可以是有线的连接方式，如DVI(Digital Visual Interface)、VGA(Video Graphics Array)、USB(Universal Serial Bus)等；也可以是无线的连接方式，如无线局域网、蓝牙连接、红外连接等。不同的通信连接方式可以采用不同的信息传递协议，例如采用HDMI接口实现连接时，可以采用HDMI协议进行数据传输。
例如，显示设备200可以通过HDMI接口连接游戏设备。用户在使用游戏设备的过程中，游戏设备可以通过运行游戏相关程序，输出视频数据和音频数据等多媒体内容。视频数据和音频数据等多媒体内容可以通过HDMI协议发送给智能电视，并通过智能电视的屏幕和扬声器进行输出，播放游戏设备的视频和音频。外接设备500可以在连接显示设备200以后，基于特定的标准进行数据传递，以使显示设备可以与外接设备之间建立进行相互识别并建立数据传输通道。例如，如图6所示，显示设备200可以基于扩展显示器识别数据(Extended Display Identification Data，EDID)与外接设备500建立连接，并实现相互识别和控制。
由于显示设备200和外接设备500为两个相互独立的功能单元，因此在外接设备500与显示设备200建立连接后，显示设备200可以按照屏幕分辨率对应的显示比例显示画面内容，而为了获得更好的显示效果，外接设备500需要按照符合显示设备200的视角比例向显示设备200发送多媒体内容。例如，显示设备200的屏幕分辨率为3840×2160，适应16:9的视角比例，则在将显示设备200连接外接设备500用以显示外接设备500输出的画面时，外接设备500也需要向显示设备200发送视角比例为16:9 的视频画面。
需要说明的是，根据显示设备200的不同用途，显示设备200的屏幕分辨率还可以表现为其他形式。例如，为适应宽屏游戏画面的专业电竞显示器，其屏幕分辨率可以达到21:9或32:9。显然，由于显示设备200的屏幕分辨率是由硬件特点决定的，因此在显示设备200显示过程中，其所能够支持的最佳视角比例是固定不变的，为了便于描述，将显示设备200屏幕分辨率决定的视角比例称为物理比例。
在一些实施例中，显示设备200在显示外接设备500发送的视频画面时，还可以通过对画面进行缩放和/或定向拉伸，以适应宽屏视角比例。例如，当显示设备200的屏幕分辨率为3840×2160，对应物理比例为16:9，但显示的游戏画面分辨率为3840×1080，对应视角比例为32：9时，显示设备200仍然可以对该游戏画面进行显示。在显示过程中，显示设备200可以基于游戏画面高度1080像素，沿画面高度方向对游戏画面进行拉伸，使游戏画面在高度方向上充满整个显示设备200。
但是这种拉伸以充满整个屏幕的显示方式会改变画面的原有比例，使呈现的画面内容出现变形、比例异常等问题，因此，为了保持画面原有比例，在一些实施例中，显示设备200还可以基于游戏画面高度1080像素，采用局部显示，使游戏画面呈现在显示设备200的屏幕中间位置，并在游戏画面的上部和下部通过填充纯色背景的方式完成显示。
对于支持宽屏显示的显示设备200，在连接外接设备500后，需要显示设备200声明宽屏视角的支持状况。外接设备500则在接收到该声明信息时，开发给用户相关功能，以便用户选择切换。例如，目前主机显卡支持HDMI宽视角画面输出，则在显示设备EDID声明支持宽视角后，主机便可以获取该信息后开发给用户相关功能去选择切换。但是，由于类似21:9或者32：9的分辨率并未在HDMI协议中明确规定，因此需要显示设备200基于自身设备特性生成对应的EDID内容。
但是，目前只有物理尺寸为21:9或者32：9的显示设备200才会如此声明，而通常16：9的显示设备200为兼容其它输入信号源，仍必须将最佳分辨率固定为16：9。因此，在进行画面显示的过程中，专业电竞类显示器对宽视角信号兼容性较好，但对于普通16:9信号兼容性较差，有可能出现无信号情况。同理，通用的显示设备200无法使宽视角信号正常送入，降低用户体验。
并且，由于采用宽屏视角进行显示，会造成外接设备500向显示设备200发送的多媒体内容对应画面形式的改变，因此在进行宽屏显示时，外接设备500向显示设备200发送的数据量也会改变，而不同的连接方式以及通信协议对应支持的数据传输速率存在差异，导致因传输协议版本与数据形式不相符而导致部分宽屏视角的多媒体内容无法通过当前版本的传输协议完成发送，出现无信号的问题。例如，当显示设备200支持HDMI1.4、HDMI2.0以及HDMI2.1三个版本的HDMI协议标准时，受不同HDMI版本的最大传输速率限制，各HDMI版本下用于声明宽视角比例的标准定时(standard timing)数据会受到带宽影响，导致宽视角数据无法传输到显示设备200，从而出现无信号的问题。
为了改善上述情况下无信号的问题，在本申请的一些实施例中提供一种显示方法，所述方法可以应用于显示设备200，显示设备200可以基于用户的控制，确定待显示的多媒体内容的目标显示模式，该目标显示模式用于描述多媒体内容的目标画面显示 比例和/或描述多媒体内容的目标画面显示位置,可以基于目标显示模式显示多媒体内容。具体的，显示设备200可以获取用户输入的用于切换视角比例的第一控制指令；响应于该第一控制指令，向外接设备发送声明信息，该声明信息包括符合外部装置接口协议版本和切换后视角比例的识别数据；显示设备200可以接收外接设备针对该声明信息反馈的多媒体内容，该多媒体内容的目标画面显示比例等于切换后视角比例，也就是说，显示设备200可以向外接设备500声明其可支持的视角比例，使外接设备500可以按照显示设备200的声明向显示设备200发送相适应视角比例的多媒体内容。
显然，为了能够实施该多视角比例显示方法，所述显示设备200应至少包括：显示器260、外部装置接口240以及控制器250。其中，显示器260可以被配置为显示用户界面，用户可以通过显示器260显示的用户界面，控制显示设备200的显示方式和具体显示内容。例如，在用户界面中可以设有用于切换显示比例的选项，用户可以通过该选项更改显示器260以16:9、21:9、32：9等比例进行显示。在用户界面中还可以设有信号源选项，用户可以通过信号源选项设置显示设备200的输入信号源为网络、机顶盒或者外接设备500，以显示不同信号源发送的多媒体内容。
外部装置接口240被配置为连接外接设备500，以实现与外接设备500之间的通信连接关系。显示设备200可以包括多个外部装置接口240，并且多个外部装置接口240可以基于不同的连接形式。不同的外部装置接口240可以通过不同的接口协议进行数据传输，且同一种接口协议还可以包括不同的协议版本。例如，外部装置接口240可以是显示设备200上的HDMI接口，外接设备500可以通过HDMI数据线连接HDMI接口，实现与显示设备200的连接，从而通过HDMI1.4、HDMI2.0以及HDMI2.1等版本的HDMI协议接收外接设备500发送的音频数据和视频数据等多媒体内容。
控制器250则被配置为执行所述显示方法对应的应用程序，以通过该方法控制显示设备200的显示过程。其中，显示方法对应的应用程序可以直接配置在控制器250中，也可以存储在显示设备200内置的存储器中，以便控制器250调用及运行。如图7所示，显示方法具体包括以下内容：
获取用户输入的用于切换视角比例的第一控制指令。在显示设备200与外接设备500建立连接关系后，显示设备200可以实时检测用户输入的控制指令，其中，部分控制指令可以用于切换视角比例，使显示设备200按照新的视角比例对画面进行显示。为了便于描述，在本申请实施例中，将用于切换视角比例的控制指令称为第一控制指令。
第一控制指令可以根据显示设备200所支持的交互方式以及显示设备200的具体类型通过不同的交互动作完成输入。即在一些实施例中，所述第一控制指令可以基于特定的用户界面完成输入。例如，在显示设备200上可以设有功能按键，用户可以通过按压“菜单”功能按键触发显示设备200显示设置界面。在设置界面中可以包括多个视角比例选项，用户再通过方向键控制焦点光标选中设置界面中的任一视角比例选项，以触发该视角比例选项对应的设置功能。即，用户可以控制焦点光标移动，在设置界面中视角比例一栏中的16:9选项、21:9选项以及32:9选项中选中21:9选项，控制显示设备200按照21:9的比例对画面内容进行显示。
需要说明的是，设置界面中所提供的视角比例选项可以根据显示设备200的具体形式呈现为不同的视角比例内容。例如，如图8所示，对于横屏显示设备200，即屏 幕的宽度大于高度的显示设备200，在设置界面中提供的视角比例也可以为横屏形式，即16:9选项、21:9选项以及32:9选项等；而对于竖屏显示设备200，即屏幕的宽度小于高度的显示设备200，则在设置界面中提供的视角比例也均为竖屏形式，即9:16选项、10：16选项以及5:3选项等。
设置界面还可以为显示设备200提供其他设置项目。例如，在设置界面中还可以设有：“实时帧率”选项，用于实时显示当前的画面刷新帧率；“延时模式”选项，用于开启或关闭显示设备200的延时模式，包括低延迟模式、实时游戏响应模式以及自动低延迟模式；“VRR类型”选项，用于开启或关闭自适应帧率模式；“设备类型”选项，用于显示当前外接设备500的设备类型；“画面移动”选项，用于调整画面的显示位置。
可见，在一些实施例中，显示设备200可以响应于用户的交互动作，控制显示器260显示设置界面，所述设置界面中包括多个画面移动选项和多个视角比例切换选项。在显示设置界面后，显示设备200可以监听用户基于设置界面执行的选中动作，在用户对画面移动选项执行选中动作时，根据画面移动选项调整多媒体内容在显示器上的显示位置；在用户对视角比例切换选项执行选中动作时，根据选中动作实施的视角比例切换选项生成用于切换视角比例的控制指令。
用户可以通过显示设备200上设置的固定按键输入第一控制指令，也可以通过显示设备200配套的控制装置100，输入第一控制指令。例如，控制装置100上可以设有用于切换视角比例的按键，当用户点击该按键时，可以触发显示设备200进行视角比例切换，从而输入第一控制指令。显然，对于部分简约化设计的控制装置100，通常不会单独设有用于切换视角比例的按键，而是通过菜单键、方向键等按键配合显示设备200显示的设置界面，控制焦点光标移动选中设置界面中的用于切换视角比例的选项，从而输入第一控制指令。
对于部分支持其他交互方式的显示设备200，用户还可以通过对应的交互方式输入第一控制指令。例如，当显示设备200支持触控交互时，用户可以通过触摸操作选中用于切换视角比例的选项，以触发显示设备200切换视角比例，即输入第一控制指令。对于支持触控交互操作的显示设备200，用户还可以通过特定的手势动作触发显示设备200切换视角比例，如通过两指从屏幕顶部下滑同时通过两指从屏幕底部上滑的手势，控制显示设备200按照宽屏比例进行显示，从而输入第一控制指令。又例如，对于内置智能语音交互系统的显示设备200，用户可以通过输入语音“切换视角比例”、“以32:9的比例显示”等语音内容，控制显示设备200切换视角比例，从而输入第一控制指令。
在用户通过上述任一种方式输入第一控制指令后，显示设备200可以响应于该第一控制指令，向外接设备500发送声明信息，以告知外接设备500当前显示设备200所支持的视角比例形式。其中，所述声明信息包括符合所述外部装置接口240对应接口协议版本和切换后视角比例的识别数据。
例如，所述声明信息为扩展显示识别数据EDID信息；所述识别数据为所述EDID信息中的标准定时数据，即EDID声明中的标准定时(standard timing)数据。当显示设备200通过HDMI接口连接外接设备500，并通过HDMI1.4协议与外接设备500进行数据交互时，显示设备200可以在接收到用户输入的第一控制指令后，从第一控制指令中解析出切换后的视角比例为21：9，再根据当前协议版本HDMI1.4和切换后比 例视角21:9确定符合这两项条件的多媒体内容形式，即分辨率为3840×1600，帧率为30的多媒体内容。再根据该多媒体内容形式生成standard timing数据，从而向外接设备500发送包含standard timing数据的EDID信息。
需要说明的是，对于不同显示设备200，以及不同接口方式和传输协议版本，显示设备200可以通过包含不同识别数据的声明信息，向外接设备500声明其支持的视角比例形式，以使外接设备500可以按照声明的视角比例形式，向显示设备200反馈对应的多媒体内容。显然，由于接口协议版本所支持的传输方式不同，因此对于同一个视角比例，不同接口协议版本对应的视频形式也不同。例如，基于HDMI1.4版本最大传输速率的限制，HDMI1.4版本传输的最高质量画质为4K、30Hz(即3840×2160,30Hz)的多媒体内容。因此，在HDMI1.4版本的宽视角视频画质不宜高于上述极值。因此，在切换后的视角比例为21:9时，当前HDMI1.4版本最高可以支持3840×1600，30Hz的多媒体内容传递；而在切换后的视角比例为32:9时，当前HDMI1.4版本最高可以支持3840×1080，60Hz的多媒体内容传递。
显示设备200在将声明信息发送给外接设备500后，外接设备500可以按照声明信息中的识别数据向显示设备200发送多媒体内容。显然，多媒体内容的目标画面显示比例等于切换后视角比例。例如，当显示设备200向外接设备500发送的EDID信息中包含分辨率为3840×1600，帧率为30Hz的standard timing数据时，外接设备500可以按照该识别数据向显示设备200反馈分辨率为3840×1600，帧率为30Hz的多媒体内容。
外接设备500向显示设备200发送的多媒体内容可以根据外接设备500的类型不同，呈现为不同的形式。例如，当外接设备500为个人电脑(personal computer，PC)主机、游戏机等可以实时生成视频画面的设备时，外接设备500可以按照识别数据中记载的视频画面规格实时渲染对应规格的视频画面。而当外接设备500为媒资数据库等设备时，外接设备500可以按照识别数据中记载的视频画面规格在媒资数据库中匹配该视频画面规格的媒资数据，并反馈给显示设备200。
与外接设备500反馈多媒体内容相对应的，显示设备200可以在将声明信息发送给外接设备500后，接收外接设备500针对声明信息反馈的多媒体内容，并对接收到的多媒体内容进行播放，即控制显示器260显示多媒体内容。
可见，在上述实施例中，显示设备200可以在用户输入用于切换视角比例的第一控制指令以后，根据第一控制指令中包含的切换后视角比例以及当前接口协议版本，向外接设备500发送声明信息，以使外接设备500可以向显示设备200反馈符合当前接口协议版本和切换后视角比例的多媒体内容，使外接设备500可以正确向显示设备200反馈多媒体内容，缓解在部分视角比例下无信号的问题。
由于非PC、游戏机等具有图形处理单元的设备大多不支持多视角信号输出，因此当显示设备200设置EDID信息的standard timing数据为宽屏视角相关timing时，会导致外接设备500无法解析EDID信息，并关闭信号输出，此时显示设备200也出现无信号的问题。
为此，如图9所示，图9为根据一些实施例的检测外接设备类型的流程示意图，该过程包括以下步骤：
S901：获取外接设备的音视频元信息。
在一些实施例中，为了使外接设备500能够配合显示设备200发送相适应的多媒体内容，在外接设备500连接显示设备200的外部装置接口240后，显示设备200可以对外接设备500的设备类型进行检测，即显示设备200可以在外接设备500连接外部装置接口240时，获取外接设备500的音视频元信息。
S902：解析音视频元信息中的标志位字段。
在一些实施例中，可以通过解析音视频元信息中的标志位字段，确定对应标志位上的字段值。
S903：判断标志位字段与判断字段是否相同；若是，则执行S904；若否，则执行S906。
S904：标记外接设备为第一类设备。
S905：向第一类设备发送声明信息。
S906：标记外接设备为第二类设备。
例如，如图10所示，显示设备200可以在监测到HDMI接口上有信号接入时，从外接设备500获取音视频元信息(Audio and Video Information，AVinfo)，由于音视频元信息通常采用独立的一帧数据进行传递，因此显示设备200获取的音视频元信息也称为AVinfo帧信息。在AVinfo帧信息中，可以包括多个字段，每个字段通过处在不同的位置，用于表征外接设备500的音视频特征。即在图10示出的AVinfo信息片段中，由0-7行、PB0-PB5行构成数据表项，根据电子消费品制造商协会(Consumer Electronics Association，CEA)制定的未压缩数字视频标准，表项中的每一个单元格位置可以定义为特定数值。其中，外接设备500可以根据向显示设备200发送的信息内容，定义多个位置上的字段值。即当外接设备500为主机设备时，位于PB3行、7列的ITC被设置字段为1，位于PB5行、6列的CN1设置字段为0，位于PB5行、5列的CN0被设置字段值为0。
由于主流显卡类型的主机均会强制设置ITC＝1，CN1＝CN0＝0。并且该设置信息无论外接设备500是否在EDID声明支持解析均会向显示设备200发送，因此，显示设备200可以通过检测AVinfo帧信息中的字段值，确定外接设备500的类型，即通过检测AVinfo帧信息中ITC、CN1、CN0位置上的字段值确定AVinfo帧信息中对应标志位上的字段是否符合上述数值，确定外接设备500是否为PC主机设备。
如果标志位字段与判断字段相同，则标记外接设备500为第一类设备。其中，第一类设备是指能够向显示设备200反馈符合对应视角比例的多媒体内容的设备，例如，可以向显示设备200反馈21:9视角比例视频画面的PC设备等。所述判断字段则是由外接设备500的图形处理器在音视频元信息帧中固定位置上设置的识别数值。例如，当检测到AVinfo帧信息中的ITC＝1，CN1＝CN0＝0时，可以确定当前外接设备500为第一类设备。并在确定当前外接设备500为第一类设备后，显示设备200可以按照上述实施例中提供的方式向外接设备500发送声明信息，以触发外接设备500反馈切换后视角比例的多媒体内容。
如果标志位字段与判断字段不同，标记外接设备500为第二类设备。其中，第二类设备是指不能够向显示设备200反馈符合对应视角比例多媒体内容的设备。例如，外接设备500为仅能够向显示设备200提供16:9视角比例的终端设备。当确定外接设备500为第二类设备时，由于外接设备500不支持切换后的视角比例，因此显示设备 200需要按照原始视角比例更新EDID信息，从而使显示设备200保持16:9的比例进行画面显示。
为了使显示设备200向外接设备500发送的声明信息可以包含符合当前接口协议版本的识别数据，在一些实施例中，显示设备200可以在接收到第一控制指令后，根据第一控制指令和当前接口协议，查询识别数据的具体内容，即如图11所示，在向外接设备500发送声明信息时，显示设备200可以在第一控制指令中提取切换后视角比例，同时检测外部装置接口240当前使用的接口协议版本。再使用切换后视角比例和协议版本在预设对照表中查询标准定时数据，从而将标准定时数据添加至EDID信息内，以生成声明信息。
其中，所述预设对照表中包括多个协议版本以及根据每个协议版本支持的最大传输速率确定的标准定时数据。例如，显示设备200和外接设备500采用HDMI接口实现连接后，对应可以采用的HDMI协议可以包括1.4、2.0、2.1三个版本，同时当前显示设备200支持切换的显示视角比例包括16:9、21:9、32:9三个比例规格，则显示设备200中可以包含以下对照表：
timing对照表 视角比例16:9 视角比例21:9 视角比例32:9
HDMI1.4 3840×2160,30Hz 3840×1600,30Hz 3840×1080,60Hz
HDMI2.0 3840×2160,60Hz 3840×1600,60Hz 3840×1080,60Hz
HDMI2.1 3840×2160,120Hz 3840×1600,120Hz 3840×1080,120Hz
当用户在输入第一控制指令时，是通过在设置界面中选中32:9的视角比例，并且显示设备200与外接设备500之间通过HDMI1.4协议进行连接时，显示设备200可以通过根据切换后视角比例32:9和当前接口协议版本HDMI1.4在上述对照表中查找到相应的timing数据，即当前显示设备200支持对应32:9视角比例的最大分辨率为3840×1080,最大刷新率为60Hz。从而根据对应的timing数据生成EDID信息，并发送给外接设备500，以使外接设备500可以反馈分辨率不高于3840×1080且帧率不高于60Hz的多媒体内容。
上述对照表可以由显示设备200的运营服务商统一配置，即运行服务商可以根据每个显示设备200所支持的接口协议版本，生成相适应的对照表，并在出厂时或在线激活后保存在显示设备200中，当显示设备200需要生成声明信息时，可以从存储器中调用该对照表或者从运营服务商的服务器中下载该对照表。
在一些实施例中，对照表还可以由显示设备200通过执行检测程序自行生成，即在外接设备500接入显示设备200后，显示设备200可以遍历当前支持的外部装置接口协议版本，并获取每个版本的外部装置接口协议的最大传输速率，从而根据最大传输速率计算外部装置接口协议传输的最大分辨率和最大帧率。最后根据计算获得的最大分辨率和最大帧率生成标准定时数据，并存储标准定时数据，以生成对照表。
例如，显示设备200支持的HDMI版本分为1.4、2.0与2.1时，对应的确定显示设备200发送的EDID信息有三种，由于各HDMI版本下最大传输速率限制。其中1.4版本的最大分辨率为4K，最大帧率为30Hz，2.0版本的最大分辨率为4K，最大帧率为60Hz，2.1版本的最大分辨率为4K，最大帧率为120Hz，因此需要确保各HDMI版本下的宽视角分辨率不得大于上述最大值。结合显示设备200的屏幕特性(包括屏幕分辨率和屏幕刷新率等)可以自动确定每种最高画质下standard timing数据的内容。
由于不同接口协议版本将会影响声明信息中对应的识别数据，并且对于支持多个版本接口协议的显示设备200或外接设备500，用户可以在使用中切换接口协议版本，因此当显示设备200和外接设备500所使用的接口协议版本发生改变时，对应的识别数据也有可能发生改变。
为此，如图12所示，在一些实施例中，显示设备200还可以在用户切换接口协议版本时，对声明信息进行更新，以使外接设备500可以按照更新后的声明信息向显示设备200反馈符合当前接口协议版本和视角比例的多媒体内容。即显示设备200可以获取用户输入的用于切换外部装置接口协议版本的第二控制指令，并响应于第二控制指令，根据切换后的外部装置接口协议版本查询识别数据。再使用查询到的识别数据更新声明信息，以向外接设备500发送更新后的声明信息。
例如，在显示设备200以21:9的视角比例显示视频画面时，如果用户更换HDMI连接线或将HDMI协议版本从1.4更改至2.0，则显示设备200可以根据切换后的接口协议版本2.0在对照表中进行查询，以获得HDMI2.0版本下视角比例为21:9的timing数据内容，即最大显示分辨率为3840×1600,最高帧率为60Hz。基于此，显示设备200可以使用该timing数据更新EDID信息，并将EDID信息发送给外接设备500。
外接设备500在接收到更新后的声明信息后，可以按照新的timing数据向显示设备200反馈多媒体内容。例如，在接收到EDID信息中包含的timing数据为当前显示设备200支持的最大显示分辨率为3840×1600,最高帧率为60Hz，则可以向显示设备200反馈分辨率为3840×1600,帧率为60Hz的多媒体内容。
显然，由于新版本接口协议对应的数据传输能力要高于旧版本接口协议对应的数据传输能力，因此在用户的切换接口协议版本过程为从旧版本切换至新版本时，外接设备500可以维持更新前多媒体内容形式反馈多媒体内容，也可以更新后的多媒体内容形式反馈多媒体内容。而在用户的切换接口协议版本过程为从新版本切换至旧版本时，外接设备500则必须按照更新后的多媒体内容形式反馈多媒体内容。
例如，当用户控制将HDMI协议版本从1.4切换至2.0时，对于视角比例为21:9的多媒体内容，外接设备500可以仍然反馈30Hz帧率的多媒体内容，也可以更改为反馈60Hz帧率的多媒体内容。而当用户控制将HDMI协议版本从2.0切换至1.4时，对于视角比例为21:9的多媒体内容，外接设备500则必须将60Hz帧率的多媒体内容更改为反馈30Hz帧率的多媒体内容，以使用低版本协议的传输能力。
为了触发外接设备500反馈多媒体内容，在一些实施中，显示设备200可以通过改变热插拔电压(hotplug voltage)的方式，使外接设备500执行相应的反馈动作。即在接收外接设备500针对声明信息反馈的多媒体内容的步骤中，显示设备200可以根据声明信息控制拉低热插拔电压，以通知外接设备500读取声明信息，并且在预设延迟时间后，再次控制拉低热插拔电压，以通知外接设备500切换视角比例并按照切换后的视角比例反馈多媒体内容。
例如，如图13所示，图13为根据一些实施例的显示流程示意图，该过程包括以下步骤：
S1301：用户切换视角比例/HDMI版本。
S1302：显示设备判断当前HDMI版本，其中，如果当前HDMI版本为1.4版本，则进行S1303；如果当前HDMI版本为2.0版本，则进行S1304；如果当前HDMI版 本为2.1版本，则进行S1305。
S1303：读取1.4版本的标准定时(standard timing)，然后执行S1306。
S1304：读取2.0版本的standard timing，然后执行S1306。
S1305：读取2.1版本的standard timing，然后执行S1306。
S1306：显示设备拉低热插拔电压(hotplug voltage)通知外接设备读取EDID信息。
其中，在用户通过第一控制指令控制切换视角比例或通过第二控制指令切换接口协议版本后，显示设备200可以先判断当前HDMI版本，并与第一控制指令中包含的切换后视角比例结合，更新对应standard timing数据到成EDID信息。此时，显示设备200可以自动拉低hotplug voltage以通知外接设备500准备读取EDID信息。再将EDID信息发送给外接设备500，以供外接设备500读取。
S1307：显示设备设置延迟800ms。
S1308：显示设备拉低热插拔电压通知外接设备反馈多媒体内容。
其中，外接设备500读取EDID信息通常会消耗一定的时间，因此显示设备200可以设置延迟时间800ms后，再次拉低热插拔电压(hotplug voltage)通知外接设备500切换反馈的多媒体内容类型，即切换视频信号对应画面的分辨率或帧率，并送出新的视频信号，以使显示设备200可以按照切换后的视频信号执行后续显示工作。
S1309：判断分辨率是否为期望值；若是，则执行S1310；若否，则执行S1311。
S1310：执行后续的画面显示工作。
S1311：还原标准定时(standard timing)数据。
其中，由于部分外接设备500不支持多视角比例信号输出，因此这些外接设备500在显示设备200发送EDID信息后，仍可能保持原多媒体内容的形式进行反馈，而在显示设备200切换视角比例后，显示设备200将以新的视角比例对画面进行显示，此时，将造成外接设备500反馈的多媒体内容与显示设备200的显示模式不适应，出现无法显示或显示异常的问题。
为了改善无法显示或显示异常的问题，在一些实施例中，显示设备200可以在外接设备500反馈多媒体内容后，对多媒体内容对应的图像进行检测，以确定多媒体内容是否与切换后视角比例相适应。即在控制显示器260显示多媒体内容的步骤中，显示设备200可以在多媒体内容中提取识别帧图像，并检测识别帧图像的分辨率。
其中，识别帧图像可以是显示设备200对多媒体内容进行解码后获得的多帧显示画面中的一帧图像。显示设备200可以根据这一帧图像在宽度和高度方向上包含的像素点数量确定多媒体内容对应的分辨率。为了减少显示内容对分辨率检测结果的影响，在提取识别帧图像的过程中，显示设备200可以从多媒体内容的解码结果中间隔提取多帧图像，并对每一帧图像均进行分辨率检测，从而确定多媒体内容对应的分辨率。
在检测识别帧图像的分辨率后，显示设备200可以对比识别帧图像的分辨率与切换后视角比例。如果识别帧图像的分辨率等于切换后视角比例，即外接设备500向显示设备200反馈的多媒体内容符合切换后视角比例，则可以按照切换后视角比例显示多媒体内容。如果识别帧图像的分辨率不等于切换后视角比例，即外接设备500向显示设备200反馈的多媒体内容不符合切换后视角比例，此时显示设备200可以修改声明信息中的识别数据为切换前的识别数据，以按照切换前视角比例显示多媒体内容。
由于部分通用16：9显示器无法显示宽视角画面，例如，当送入显示设备200宽视角比例(21:9或32:9)的画面时，显示设备200的物理尺寸为16：9，会对输入画面在垂直方向进行拉伸以填满整个显示区域，此做法会导致画面内容失真。
因此，在一些实施例中，还可以设计算法用以设置显示设备200的output输出尺寸，并根据输入信号的宽高比动态调整显示窗体的大小。即在控制显示器260显示多媒体内容的步骤中，显示设备200可以先检测显示器260的物理尺寸，包括屏幕宽度和屏幕高度；同时获取多媒体内容的画面尺寸，包括画面宽度和画面高度。再根据物理尺寸和画面尺寸构建虚拟屏幕，并按照虚拟屏幕显示多媒体内容。
其中，所构建的虚拟屏幕的宽高比等于多媒体内容的目标画面显示比例；虚拟屏幕的宽度等于显示器的屏幕宽度，虚拟屏幕的高度等于屏幕高度的缩放比例倍，缩放比例等于画面高度与屏幕高度的比值。
例如，如图14所示，显示设备200的物理尺寸为16：9(3840×2160)，而在送入显示设备200以32:9(3840×1080)宽视角比例画面进行信号输入时，显示设备200可以通过构建虚拟屏幕并按照输入信号宽高比动态计算其大小，最终将虚拟屏幕居中显示于显示器260上，从而确保画面按照原始比例正常显示。其中，虚拟屏幕的宽度(Uu32Width)等于显示器260物理屏幕的实际宽度；虚拟屏幕的高度(Uu32Height)等于物理屏幕的1080/2160倍；虚拟屏幕的左上角x轴坐标(Uu32X)等于0表示位于屏幕最左边；虚拟屏幕的左上角y轴坐标(Uu32Y)则已知虚拟屏幕宽度沿屏幕水平居中位置显示计算得到，即Uu32Y＝(2160-1080)/2。
可见，由于显示设备200的物理尺寸为16：9，当送入显示设备200宽视角(21:9\32:9)画面时，显示设备200按照原视频输出方式，会对输入画面在垂直方向进行拉伸以填满整个显示区域，如图15所示，这样的显示方式会导致画面内容失真。而按照上述实施例中提供的显示方式，显示设备200通过引入虚拟屏幕并按照输入信号宽高比动态计算其大小，最终将虚拟屏幕居中显示于物理屏幕上，如图16所示，从而确保画面按照原始比例正常显示。
基于上述显示方法，在本申请的部分实施例中还提供一种显示设备200，包括：显示器260、外部装置接口240以及控制器250。其中，显示器260用于显示用户界面；外部装置接口240被配置为连接外接设备500；如图17所示，控制器250被配置为执行以下程序步骤：
S1701：获取用户输入的用于切换视角比例的第一控制指令。
S1702：响应于所述第一控制指令，向所述外接设备发送声明信息，所述声明信息包括符合所述外部装置接口协议版本和切换后视角比例的识别数据。
S1703：接收所述外接设备针对所述声明信息反馈的多媒体内容，所述多媒体内容的目标画面显示比例等于所述切换后视角比例。
S1704：控制所述显示器显示所述多媒体内容。
与所述显示设备200相适应的，在本申请的部分实施例中还提供一种外接设备500，包括：视频接口和处理器。其中，视频接口被配置为连接显示设备；如图18所示，处理器被配置为执行以下程序步骤：
S1801：显示设备获取用户输入的用于切换视角比例的第一控制指令。
S1802：显示设备响应于所述第一控制指令，向所述外接设备发送声明信息。
S1803：外接设备获取所述显示设备发送的声明信息，生成多媒体内容。其中，所述声明信息包括符合所述显示设备外部装置接口协议版本和切换后视角比例的识别数据。
S1804：外接设备根据所述识别数据向所述显示设备反馈多媒体内容。
S1805：显示设备按照所述切换后视角比例显示所述多媒体内容。
上述实施例提供的显示设备200和外接设备500，可以在用户切换视角比例时，根据用户输入的控制指令向外接设备500发送声明信息，以告知外接设备500当前显示设备200所支持的视角比例。再接收外接设备500针对声明信息反馈的多媒体内容，并按照切换后的视角比例显示接收的多媒体内容。显示设备200通过声明信息向外接设备500发送当前支持的视角比例，并且所述声明信息包括符合外部装置接口240协议版本和切换后视角比例的识别数据，使外接设备500可以反馈多媒体内容可以同时适应协议版本和显示设备200支持的视角比例，缓解在部分视角比例下无信号输入的问题。
需要说明的是，上述实施例以16:9、21:9以及32:9等比例作为示例对视角比例和屏幕尺寸对多视角显示方法进行描述，上述比例仅仅作为示例，并不会对方案的应用范围造成限制，根据显示设备200与外接设备500的类型不同，实际显示过程中还可以应用其他具体的目标画面显示比例。同理，上述实施例中还以HDMI2.1版本的EDID信息对声明信息和识别数据进行描述，也同样仅仅作为一种示例，不会对，显示设备200和外接设备500之间的数据传递过程造成限定。实际应用中，显示设备200和外接设备500所具体采用的协议版本和连接方式，也可以根据具体情况选择确定。
为方便理解，下面再通过一个具体应用场景，对本申请提供的显示设备及显示方法进行举例说明。
显示设备上可播放不同的多媒体内容，其中，显示设备上播放的多媒体内容可包括：教学视频、歌唱视频、跳舞视频、游戏视频等，用户可通过与显示设备进行交互，在显示设备上进行多媒体内容的观看，或者，进行其他数据内容的沉浸式体验(如游戏体验)，从而，丰富用户的业余生活。
其中，用户在与显示设备进行交互时，通过会以不同姿态来进行与显示设备的交互，如，用户在显示设备上体验游戏场景时，通常会采用坐姿或者站姿来观看显示设备，不同的观看视角会影响用户观看多媒体内容的观看效果。具体的，用户的观看视角可能会与显示设备形成一定角度，不在显示设备的最佳观看视角范围内，或者，用户的脸部位置不在显示设备的正中区域内，这会导致用户难以以最佳视角或最佳位置进行游戏场景的体验。
相关技术中，用户在进行姿态视角调整时，可通过触发显示设备上的控制功能来实现对不同画面显示比例的调节，导致用户在观看多媒体内容时需要反复根据不同视角进行比例调节，从而，影响用户的观看效果。具体的，用户可通过控制器/显示设备的上的调节按钮，手动调节显示设备的显示模式，来选取适应自己的画面显示比例/画面显示位置，从而，手动调节方式会影响用户的内容观看，尤其是在游戏场景中，会直接影响到用户的游戏体验，进一步降低用户的设备体验感。
考虑上述问题，本公开实施例中显示设备通过采集其对应的环境图像，基于环境图像确定其中包括的人脸对应的图像区域，并基于多媒体内容的初始显示模式和，人脸对应的图像区域与环境图像的位置关系，确定多媒体内容的目标显示模式，其中，目标显示模式 用于描述多媒体内容的目标画面显示比例和/或多媒体内容的目标画面显示位置，从而基于目标显示模式显示多媒体内容，通过上述方法能够在用户观看多媒体内容时，基于用户不同姿态确定出适配的多媒体内容的显示模式，始终保持多媒体内容的显示画面与用户眼睛观看角度的最佳匹配，提升用户的观看满意度和观看视角效果。
图19为根据一些实施例的显示设备与控制装置之间操作场景的示意图。如图19所示，用户可通过智能设备300(如手机)或控制装置100(如手柄/鼠标/键盘/遥控器)操作显示设备200，使得显示设备200播放相应的多媒体内容，其中，显示设备200可基于用户的姿态调整显示设备200上播放多媒体内容的画面显示比例和画面显示位置，使得在显示设备200上播放不同画面显示比例的多媒体内容，或者，在显示设备200上的不同播放区域中播放相应的画面显示比例的多媒体内容，其中，显示设备200可将显示区域划分为多个画面显示位置进行多媒体内容的播放，显示设备200上播放的画面显示比例可为显示设备的播放画面的宽高比，具体的，显示设备200上能够播放的画面显示比例可包括：32：9、21：9和16：9(全屏播放)。
在一些实施例中，用户可通过遥控器打开显示设备，并控制显示设备上播放的多媒体内容，显示设备可根据用户的姿态对多媒体内容的画面显示比例和画面显示位置进行相应调整。
示例性的，显示设备的显示画面的显示区域可包括：第一区域、第二区域和第三区域，其中，第一区域在第二区域的上方，第二区域在第三区域的上方，在检测到用户眼睛处于第一区域时，将多媒体内容的画面显示位置调整至第一区域显示，在检测到用户眼睛处于第二区域时，将多媒体内容的画面显示位置调整至第二区域显示，在检测到用户眼睛处于第三区域时，将多媒体内容的画面显示位置调整至第三区域显示；另外，在检测到用户眼睛与显示设备之间的垂直夹角小于或等于30°时，调整多媒体内容的画面显示比例为32：9，在检测到用户眼睛与显示设备之间的垂直夹角大于30°且小于45°时，调整多媒体内容的画面显示比例为21：9，在检测到用户眼睛与显示设备之间的垂直夹角大于45°时，调整多媒体内容的画面显示比例为16：9，从而，解决了现有技术中的问题，能够在用户观看多媒体内容时，基于用户不同姿态确定出适配的多媒体内容的显示模式，始终保持多媒体内容的显示画面与用户眼睛观看角度的最佳匹配，提升用户的观看满意度和观看视角效果。
在一些实施例中，控制装置100可以是遥控器，遥控器和显示设备的通信包括红外协议通信、蓝牙协议通信、无线或其他有线方式来控制显示设备200。用户可以通过遥控器上按键、语音输入以及控制面板输入等输入用户指令，来控制显示设备200。在一些实施例中，如上所述，也可以使用移动终端、平板电脑、计算机、笔记本电脑和其他智能设备来控制显示设备200。
在另一些实施例中，控制装置100还可以是鼠标/键盘/手柄，鼠标/键盘/手柄和显示设备的通信可包括红外协议通信、蓝牙协议通信、无线或其他有线方式来控制显示设备200。用户可以通过鼠标/键盘/手柄上的按键、语音输入以及控制面板输入等输入用户指令，来控制显示设备200。
在一些实施例中，显示设备200可以不使用上述的智能设备或控制设备接收指令，而是通过触摸或者手势等接收用户的控制。
在一些实施例中，显示设备200还可以采用除了控制装置100和智能设备300之外的方式进行控制，例如，通过语音指令控制。
在一些实施例中，智能设备300可与显示设备200中安装的软件应用，通过网络通信协议实现连接通信，实现一对一控制操作的和数据通信的目的。
图20为根据一些实施例的显示设备200中应用程序的图标控件界面显示示意图，如图20中所示，应用程序层包含至少一个应用程序可以在显示器中显示对应的图标控件，如：直播电视应用程序图标控件、视频点播应用程序图标控件、媒体中心应用程序图标控件、应用程序中心图标控件、游戏应用图标控件等。直播电视应用程序，可以通过不同的信号源提供直播电视。视频点播应用程序，可以提供来自不同存储源的视频。不同于直播电视应用程序，视频点播提供来自某些存储源的视频显示。媒体中心应用程序，可以提供各种多媒体内容播放的应用程序。应用程序中心，可以提供储存各种应用程序。
在一些实施例中，上述显示设备是具有显示功能的终端设备，例如电视机或者平板电视等。该显示设备中：
在一些实施例中，控制器250，通过存储在存储器上中各种软件控制程序，来控制显示设备的工作和响应用户的操作。控制器250控制显示设备200的整体操作。用户可在显示器260上显示的图形用户界面(GUI)输入用户命令，则用户输入接口通过图形用户界面(GUI)接收用户输入命令。或者，用户可通过输入特定的声音或手势进行输入用户命令，则用户输入接口通过传感器识别出声音或手势，来接收用户输入命令。
输出接口(显示器260，和/或，音频输出接口270)，被配置为输出用户交互信息；
通信器220，用于与服务器400进行通信；
图像采集接口290，被配置为：采集所述显示设备对应的环境图像；
控制器250，被配置为：基于用户的控制，确定待显示的多媒体内容的目标显示模式，所述目标显示模式用于描述所述多媒体内容的目标画面显示比例和/或所述多媒体内容的目标画面显示位置；控制所述显示器基于所述目标显示模式显示所述多媒体内容。
可选的，控制器250，进一步配置为：基于所述环境图像，确定人脸对应的图像区域；
基于多媒体内容的初始显示模式和，所述人脸对应的图像区域与所述环境图像的位置关系，确定所述多媒体内容的目标显示模式，所述目标显示模式用于描述所述多媒体内容的目标画面显示比例和/或所述多媒体内容的目标画面显示位置；
显示器260，被配置为：基于所述目标显示模式显示所述多媒体内容。
在一些实施例中，所述人脸对应的图像区域与所述环境图像的位置关系包括：相对角度关系，所述相对角度关系为所述图像区域与所述环境图像的中心点在第一方向上的角度信息；控制器250，进一步配置为：获取所述初始显示模式中包括的初始画面显示比例；基于所述初始画面显示比例和所述位置关系中包括的所述角度信息，确定所述多媒体内容的目标画面显示比例。
在一些实施例中，控制器250，进一步配置为：确定所述初始画面显示比例为预设的画面显示比例，且确定所述位置关系中包括的所述角度信息发生变化；所述预设的画面显示比例为所述显示设备处于全屏显示状态时对应的画面显示比例；基于所述位置关系中包括的所述角度信息，确定所述多媒体内容的目标画面显示比例。
在一些实施例中，控制器250，进一步配置为：若所述角度信息处于预设的第一角度范围，则确定所述多媒体内容的目标画面显示比例为第一显示比例；或者，若所述角度信息处于预设的第二角度范围，则确定所述多媒体内容的目标画面显示比例为第二显示比例；或者，若所述相对角度处于预设的第三角度范围，则确定所述多媒体内容的目标画面显示 比例为第三显示比例。
在一些实施例中，所述人脸对应的图像区域与所述环境图像的位置关系包括：相对垂直关系，所述相对垂直关系为所述图像区域与所述环境图像在第二方向上的距离差；控制器250，进一步配置为：获取所述初始显示模式中包括的初始画面显示比例；根据所述初始画面显示比例和所述位置关系中包括的所述距离差，确定所述多媒体内容的目标画面显示位置。
在一些实施例中，控制器250，进一步配置为：确定所述初始画面显示比例不为预设的画面显示比例，且确定所述位置关系中包括的所述距离差发生变化，所述预设的画面显示比例为所述显示设备处于全屏显示状态时对应的画面显示比例；根据所述位置关系中包括的所述距离差，确定所述多媒体内容的目标画面显示位置。
在一些实施例中，控制器250，进一步配置为：若所述距离差处于预设的第一距离范围，则确定所述多媒体内容的目标画面显示位置为第一显示位置；或者，若所述距离差处于预设的第二距离范围，则确定所述多媒体内容的目标画面显示位置为第二显示位置；或者，所述距离差处于预设的第三距离范围，则确定所述多媒体内容的目标画面显示位置为第三显示位置。
在一些实施例中，控制器250，还被配置为：基于预设的画面显示比例对所述目标画面显示比例进行画面比例检查，所述预设的画面显示比例为所述显示设备处于全屏显示状态时对应的画面显示比例；确定所述目标画面显示比例为所述预设的画面显示比例。
本公开实施例中显示设备通过采集其对应的环境图像，基于环境图像确定其中包括的人脸对应的图像区域，并基于多媒体内容的初始显示模式和，人脸对应的图像区域与环境图像的位置关系，确定多媒体内容的目标显示模式，其中，目标显示模式用于描述多媒体内容的目标画面显示比例和/或多媒体内容的目标画面显示位置，从而基于目标显示模式显示多媒体内容，通过上述方法能够在用户观看多媒体内容时，基于用户不同姿态确定出适配的多媒体内容的显示模式，始终保持多媒体内容的显示画面与用户眼睛观看角度的最佳匹配，提升用户的观看满意度和观看视角效果。
图21A为根据一些实施例的多媒体内容显示的系统框架图，如图21A所示，该系统中可以包括环境图像采集模块601、图像区域确定模块602、显示模式确定模块603以及多媒体内容显示模块604。该系统在通过环境图像采集模块601采集显示设备对应的环境图像，由图像区域确定模块602从环境图像中查找出人脸对应的图像区域，再由显示模式确定模块603基于多媒体内容的初始显示模式和，人脸对应的图像区域与环境图像的位置关系，确定多媒体内容的目标显示模式，其中，目标显示模式用于描述多媒体内容的目标画面显示比例和/或多媒体内容的目标画面显示位置，也就是，目标显示模式可包括：目标画面显示比例和/或多媒体内容的目标画面显示位置，目标画面显示比例为显示设备上显示的多媒体内容的显示画面的宽高比，目标画面显示位置为显示设备上显示的多媒体内容的显示画面在显示设备的播放画面上的一个显示区域，来基于用户人脸的不同姿态确定出与其适配的多媒体内容的目标画面显示比例和目标画面显示位置，并通过多媒体内容显示模块604基于目标显示模式显示多媒体内容，从而，能够根据用户的不同姿态来确定出适配的多媒体内容的显示模式，保证用户不同姿态下能够浏览到效果统一的多媒体内容，始终保持显示画面与人眼观看角度的最佳匹配，提升用户的浏览体验性。
图21B为根据一些实施例进行多媒体内容显示的架构图，基于上述系统框架，本公开 在安卓系统中的实现如图21B所示，安卓系统中主要包括应用层、框架层、系统运行库层以及内核层，实现逻辑主要在应用层体现，其中包括环境图像采集模块、图像区域确定模块、显示模式确定模块以及多媒体内容显示模块。
本公开实施例中提供的显示方法，可以采集到显示设备对应的环境图像，从环境图像中查找出其中包括的人脸的图像区域，通过多媒体内容的初始显示模式和人脸图像区域与数据图像的位置对应关系，确定显示的多媒体内容的最终画面显示比例和/或在显示设备中的最终画面显示位置，并在显示设备上以最终画面显示比例和/或最终画面显示位置显示多媒体内容，通过上述方法能够在用户观看多媒体内容时，基于用户不同姿态确定出适配的多媒体内容的显示模式，始终保持多媒体内容的显示画面与用户眼睛观看角度的最佳匹配，提升用户的观看满意度和观看视角效果。
以下结合图22A进行说明，可以理解的是，图22A中所涉及的步骤在实际实现时可以包括更多的步骤，或者更少的步骤，并且这些步骤之间的顺序也可以不同，以能够实现本公开实施例中提供的显示方法为准，本公开实施例不做限定。
如图22A所示，图22A为根据一些实施例的显示方法的流程示意图，显示方法具体包括如下步骤：
S2210、采集显示设备对应的环境图像，基于环境图像，确定人脸对应的图像区域。
其中，可基于摄像装置通过图像采集接口采集显示设备的场景区域，得到环境图像，并通过摄像装置通过图像采集接口与显示设备的通信连接，将采集到的环境图像发送给显示设备，使得显示设备得到环境图像。
需要说明的是，摄像装置可为显示设备内置的一个图像采集单元，通过图像采集接口连接在显示设备的内部，在显示设备播放显示画面的同时，实时采集显示设备的场景图像，或者，摄像装置可为显示设备外置的一个摄像头，通过图像采集接口与显示设备进行连接，可通过与显示设备之间进行有线连接或无线连接，在显示设备播放显示画面的同时，采集显示设备的场景图像。
其中，显示设备可通过在检查摄像装置可用之后，启动工作线程，并指示摄像装置以每秒一帧的采集速度实时拍摄显示设备的场景图像，摄像装置可将获取到的场景图像发送给显示设备的控制器经过模型处理，标记出人脸图像对应的区域。
如图22B所示，电视(显示设备)可外置一个摄像装置(外置摄像头)，并通过通用串行总线(Universal Serial Bus，USB)与摄像连接，实时拍摄电视前方的场景，并将获取得到的画面依次转换为jpeg文件->bitmap数据->bytebuffer数据，送入控制器中存储的tflite格式的机器学习模型，由机器学习模型匹配人脸特征，若发现画面图像内存在人脸特征，则可将人脸特征框选到矩形区域内并确定对应的矩形四顶点坐标。
S2220、基于多媒体内容的初始显示模式和，人脸对应的图像区域与环境图像的位置关系，确定多媒体内容的目标显示模式。
其中，多媒体内容的初始显示模式可用于描述多媒体内容对应的当前画面显示比例和/多媒体内容的当前画面显示位置，也就是，多媒体内容对应的初始显示模式可包括：当前画面显示比例，或者，当前画面显示位置，或者，当前画面显示比例和当前画面显示位置。
其中，多媒体内容对应的当前画面显示比例为当前显示画面对应区域的宽高比，可包括：第一显示比例、第二显示比例和第三显示比例，具体的，第一显示比例可为16:9，第二显示比例可为21:9，第三显示比例可为32:9，16:9对应当前显示画面为显示设备的全屏 显示，21:9和32:9对应当前显示画面为显示设备的非全屏显示。
如图22C所示，第一显示比例的显示区域对应显示设备的显示区域1，第二显示比例的显示区域对应显示设备的显示区域2，第三显示区域的显示区域对应显示设备的显示区域3。
多媒体内容对应的当前画面显示位置为当前显示画面对应区域在显示设备中的显示位置，具体的，显示设备可将显示画面拆分为多个显示位置，每个显示位置可对应一个显示区域，如，显示设备将显示画面拆分为三个显示位置，可分别包括：第一显示位置、第二显示位置和第三显示位置。
如图22D所示，第一显示位置可对应显示区域4，可对应显示设备的上方显示区域，第二显示位置可对应显示区域5，可对应显示设备的中间显示区域，第三显示位置可对应显示区域6，可对应显示设备的下方显示区域。
其中，人脸对应的图像区域与环境图像的位置关系，可为人脸对应的图像区域与环境图像的角度值和垂直距离差，角度值可用来反映用户观看显示设备的观看视角，垂直距离差可用来反映用户观看显示设备时与显示设备的垂直位移对应性。
其中，目标显示模式可用于描述多媒体内容的目标画面显示比例和/或多媒体内容的目标画面显示位置，也就是，多媒体内容对应的目标显示模式可包括：目标画面显示比例，或者，目标画面显示位置，或者，目标画面显示比例和目标画面显示位置。
结合上述举例，目标显示模式可包括上述所指的第一显示比例，或者，第二显示比例(/第三显示比例)和第一显示位置，或者，第二显示比例(/第三显示比例)和第二显示位置，或者，第二显示比例(/第三显示比例)和第三显示位置等。
其中，目标显示模式为第一显示比例，指多媒体内容在显示设备上以全屏状态进行显示，目标显示模式为第二显示比例(/第三显示比例)和第一显示位置，指多媒体内容在显示设备上以显示区域2对应的画面大小(或显示区域3对应的画面大小)在全屏上显示。
目标显示模式为第二显示比例(/第三显示比例)和第二显示位置，指多媒体内容在显示设备上以显示区域2对应的画面大小(或显示区域3对应的画面大小)在显示区域5的中心进行显示，显示画面的大小为显示区域2对应的画面大小(或显示区域3对应的画面大小)。
目标显示模式为第二显示比例(/第三显示比例)和第三显示位置，指多媒体内容在显示设备上以显示区域2对应的画面大小(或显示区域3对应的画面大小)在显示区域6的中心进行显示，显示画面的大小为显示区域2对应的画面大小(或显示区域3对应的画面大小)。
S2230、基于目标显示模式显示多媒体内容。
其中，显示设备可基于多媒体内容的目标画面显示比例和/或多媒体内容的目标画面显示位置显示多媒体内容。
其中，目标显示模式可包括：目标显示比例、目标显示画面以及目标显示比例和目标显示画面。
结合上述举例，在目标显示模式为第二显示比例时，多媒体内容在显示设备上以全屏状态显示显示区域2对应的画面，在目标显示模式为第三显示比例时，多媒体内容在显示设备上以全屏状态显示显示区域3对应的画面。
在目标显示模式为第一显示位置时，多媒体内容显示在显示设备的显示区域4上，多 媒体内容的画面显示大小与显示区域4的画面大小相同，在目标显示模式为第二显示位置时，多媒体内容显示在显示设备的显示区域5上，多媒体内容的画面显示大小与显示区域5的画面大小相同，在目标显示模式为第三显示位置时，多媒体内容显示在显示设备的显示区域6上，多媒体内容的画面显示大小与显示区域6的画面大小相同。
基于上述实施例的描述，在本公开中，人脸对应的图像区域与环境图像的位置关系可以包括：人脸对应的图像区域与环境图像的中心点在垂直方向上的夹角，其中，垂直方向可为以用户站立的地面为水平方向对应的垂直侧的方向。
如图23A所示，其中，环境图像可被水平方向线(横线)和垂直方向线(竖线)划分为四个显示区域，分别为：左上区域、左下区域、右上区域和右下区域，在图23A中，人脸对应的图像区域为人脸区域，环境图像的中心点为点O，人脸区域与点O在垂直方向上的夹角为α。
在一些实施例中，在基于多媒体内容的初始显示模式和，人脸对应的图像区域与环境图像的位置关系，确定多媒体内容的目标显示模式时，可通过对初始显示模式中包括的初始画面显示比例进行判断，并结合人脸对应的图像区域与环境图像的中心点在垂直方向上的夹角，从而，有效确定出多媒体内容的目标显示目标画面显示比例。
其中，可通过预先设定的一个画面显示比例，来对初始显示模式中包括的初始画面显示比例进行判断之后，再对人脸对应的图像区域与环境图像的中心点在垂直方向上的夹角进行变化检测，以对多媒体内容的目标画面显示比例进行有效确定。
其中，预先设定的一个画面显示比例，可用来描述显示设备的当前屏幕显示状态，如，可将画面显示比例预设设定为16:9，表示显示设备的当前屏幕显示状态为全屏显示，作为确定位置关系中包括的角度信息发生变化的一个前提条件。
需要说明的是，对人脸对应的图像区域与环境图像的中心点在垂直方向上的夹角进行变化检测时，可预先设置多个夹角范围，在确定出人脸对应的图像区域与环境图像的中心点在垂直方向上的夹角变化为另一个夹角范围时，则确定出人脸对应的图像区域与环境图像的中心点在垂直方向上的夹角发生变化。
举例说明，可预先设置出三个夹角范围，用来反映用户人脸对应的图像区域与环境图像的中心点的夹角，如三个夹角范围为：第一夹角范围、第二夹角范围和第三夹角范围，其中，第一夹角范围为：[0，30°]，第二夹角范围：(30°，45°]，第三夹角范围：(45°，60°]，假设人脸对应的图像区域与环境图像的中心点在垂直方向上的初始夹角为25°，且人脸对应的图像区域与环境图像的中心点在垂直方向上的初始夹角变化为50°，则确定人脸对应的图像区域与环境图像的中心点的夹角发生变化。
其中，在基于位置关系中包括的角度信息，对多媒体内容的目标画面显示比例进行确定时，具体的，可将人脸对应的图像区域与环境图像的中心点的夹角与预先设定的角度范围进行匹配，从而，有效确定出多媒体内容适应于用户人脸的一个目标画面显示比例。
其中，在设定角度范围时，可基于人脸视角与清晰度关系来对人脸对应的图像区域与环境图像的中心点的夹角的具体范围进行设置。
如图23B所示，在人脸视角为第一区域对应的角度范围(α≤30°)时，表示清晰度越好，人脸视角为第二区域对应的角度范围(30°＜α≤45°)时，表示清晰度一般，人脸视角为第三区域对应的角度范围(45°＜α≤60°)时，表示清晰度不好。
举例而言，在检测到人脸对应的图像区域与环境图像的中心点的夹角在第一个范围内 时，可确定出多媒体内容适配与用户人脸的第一个目标画面显示比例，如图23C所示，结合图23A，在检测到人脸与中心点O之间的夹角α小于或等于30°时，可确定出多媒体内容适配与用户人脸的目标画面显示比例为32:9。
在检测到人脸对应的图像区域与环境图像的中心点的夹角在第二个范围内时，可确定出多媒体内容适配与用户人脸的第二个目标画面显示比例，如图23D所示，结合图23A，在检测到人脸与中心点O之间的夹角α大于30°或小于等于45°时，可确定出多媒体内容适配与用户人脸的目标画面显示比例为21:9。
在检测到人脸对应的图像区域与环境图像的中心点的夹角在第三个范围内时，可确定出多媒体内容适配与用户人脸的第三个目标画面显示比例，如图23E所示，结合图23A，在检测到人脸对应的图像区域与环境图像的中心点的夹角α大于45°或小于等于60°时，可确定出多媒体内容适配与用户人脸的目标画面显示比例为16:9。
从而，满足用户以不同视角观看电视时，均能够得到较为满意的观看体验。
另外，在基于用户的观看角度调整多媒体内容的目标画面显示比例之后，还需要基于预设的画面显示比例，对目标画面显示比例进行比例检查，有效保证用户观察位置与电视画面显示垂直位置保持一致。
其中，预设的画面显示比例可为显示设备中进行全屏显示的显示比例，如16:9。
其中，在基于预设的画面显示比例，对目标画面显示比例进行比例检查时，若调整后的多媒体内容的目标画面显示比例为16:9，则确定用户观察垂直位置与电视画面显示垂直位置保持一致，若调整后的多媒体内容的目标画面显示比例不为16:9，则需要再次调整电视画面的垂直显示位置，对画面显示位置的调节方式上述已做说明，此处不再赘述。
基于上述实施例的描述，在本公开中，人脸对应的图像区域与环境图像的位置关系还可以包括：人脸与环境图像(如最上方位置、最下方位置、其中一个位置)在水平方向上相对的垂直距离差，或者，人脸区域(人脸对应的图像区域)的面积在环境图像中多个区域的占比。需要说明的是，人脸与环境图像在水平方向上相对的垂直距离差能够有效表示出人脸区域的面积在环境图像中多个区域的占比。
如图24A所示，其中，环境图像可被划分为三个显示区域，分别为：上方区域、中间区域和下方区域，在图24A中，人脸区域处于下方区域。
在另一些实施例中，在基于多媒体内容的初始显示模式和，人脸对应的图像区域与环境图像的位置关系，确定多媒体内容的目标显示模式时，还可通过对初始画面显示比例进行判断，从而，基于初始画面显示比例和人脸区域的面积在环境图像中多个区域的占比，确定多媒体内容的目标画面显示位置。
其中，可通过预先设定的一个画面显示比例，来对初始显示模式中包括的初始画面显示比例进行判断之后，再对人脸与显示设备在水平方向上相对的垂直距离差进行变化检测，以对多媒体内容的目标画面显示位置进行有效确定。
其中，预先设定的一个画面显示比例，可用来描述显示设备的当前屏幕显示状态，如，可将画面显示比例预设设定为16:9，表示显示设备的当前屏幕显示状态为全屏显示，作为确定位置关系中包括的距离差发生变化的一个前提条件。
需要说明的是，对人脸与环境图像在水平方向上相对的垂直距离差进行变化检测时，可先通过距离差确定出人脸区域在环境图像中的占比区域，在占比区域发生变化时，可确定出人脸与显示设备在水平方向上相对的垂直距离差发送变化。
举例而言，在检测到距离差处于预设的第一个距离范围，可确定出人脸区域在环境图像中的一个最大占比区域，来确定出多媒体内容的目标画面显示位置，如图24B所示，在检测到人脸区域距离环境图像的底部距离差小于1cm时，可确定出人脸区域在环境图像中的最大占比区域为下方区域，则确定出多媒体内容的目标画面显示位置显示设备的显示区域6。
在检测到距离差处于预设的第二个距离范围，可确定出人脸区域在环境图像中的另一个最大占比区域，来确定出多媒体内容的目标画面显示位置，如图24C所示，在检测到人脸区域距离环境图像的底部距离差在20-25cm时，可确定出人脸区域在环境图像中的最大占比区域为中间区域，则确定出多媒体内容的目标画面显示位置显示设备的显示区域5。
在检测到距离差处于预设的第三个距离范围，可确定出人脸区域在环境图像中的又一个最大占比区域，来确定出多媒体内容的目标画面显示位置，如图24D所示，在检测到人脸区域距离环境图像的底部距离差在35-40cm时，可确定出人脸区域在环境图像中的最大占比区域为中间区域，则确定出多媒体内容的目标画面显示位置显示设备的显示区域4。
综上所述，本公开通过在显示设备上执行上述显示方法，通过采集其对应的环境图像，基于环境图像确定其中包括的人脸对应的图像区域，并基于多媒体内容的初始显示模式和，人脸对应的图像区域与环境图像的位置关系，确定多媒体内容的目标显示模式，其中，目标显示模式用于描述多媒体内容的目标画面显示比例和/或多媒体内容的目标画面显示位置，从而基于目标显示模式显示多媒体内容，通过上述方法能够在用户观看多媒体内容时，基于用户不同姿态确定出适配的多媒体内容的显示模式，始终保持多媒体内容的显示画面与用户眼睛观看角度的最佳匹配，提升用户的观看满意度和观看视角效果。
由上述各实施例可以看出，由于本申请实施例显示设备中的控制器可以基于用户的控制，确定待显示的多媒体内容的目标显示模式，该目标显示模式可以用于描述多媒体内容的目标画面显示比例和/或多媒体内容的目标画面显示位置，并控制显示器基于该目标显示模式显示多媒体内容，基于此，可以实现快捷准确的对多媒体内容进行显示的目的。
为了方便解释，已经结合具体的实施方式进行了上述说明。但是，上述在一些实施例中讨论不是意图穷尽或者将实施方式限定到上述公开的具体形式。根据上述的教导，可以得到多种修改和变形。上述实施方式的选择和描述是为了更好的解释原理以及实际的应用，从而使得本领域技术人员更好的使用实施方式以及适于具体使用考虑的各种不同的变形的实施方式。

Claims (20)

  1. 一种显示设备，包括：
    显示器；
    控制器，被配置为：
    基于用户的控制，确定待显示的多媒体内容的目标显示模式，所述目标显示模式用于描述所述多媒体内容的目标画面显示比例和/或所述多媒体内容的目标画面显示位置；
    控制所述显示器基于所述目标显示模式显示所述多媒体内容。
  2. 根据权利要求1所述的显示设备，所述显示设备还包括：
    外部装置接口，被配置为连接外接设备；
    所述控制器，被配置为：
    获取用户输入的用于切换视角比例的第一控制指令；
    响应于所述第一控制指令，向所述外接设备发送声明信息，所述声明信息包括符合所述外部装置接口协议版本和切换后视角比例的识别数据；
    接收所述外接设备针对所述声明信息反馈的多媒体内容，所述多媒体内容的目标画面显示比例等于所述切换后视角比例。
  3. 根据权利要求2所述的显示设备，所述控制器被进一步配置为：
    在所述外接设备连接所述外部装置接口时，获取所述外接设备的音视频元信息；
    解析所述音视频元信息中的标志位字段；
    如果所述标志位字段与判断字段相同，标记所述外接设备为第一类设备，所述判断字段是由所述外接设备的图形处理器在所述音视频元信息帧中固定位置上设置的识别数值；
    向所述第一类设备发送所述声明信息；
    如果所述标志位字段与判断字段不同，标记所述外接设备为第二类设备。
  4. 根据权利要求2所述的显示设备，所述声明信息为扩展显示识别数据EDID信息；所述识别数据为所述EDID信息中的标准定时数据；所述控制器被进一步配置为：
    在向所述外接设备发送声明信息的步骤中，在所述第一控制指令中提取切换后视角比例；
    检测所述外部装置接口协议版本；
    使用所述切换后视角比例和所述协议版本在预设对照表中查询标准定时数据，所述预设对照表中包括多个协议版本以及根据每个协议版本支持的最大传输速率确定的标准定时数据；
    将所述标准定时数据添加至所述EDID信息，以生成所述声明信息。
  5. 根据权利要求2所述的显示设备，其特征在于，所述控制器被进一步配置为：
    获取用户输入的用于切换外部装置接口协议版本的第二控制指令；
    响应于所述第二控制指令，根据切换后的外部装置接口协议版本查询识别数据；
    使用所述识别数据更新所述声明信息；
    向所述外接设备发送更新后的所述声明信息。
  6. 根据权利要求2所述的显示设备，其特征在于，所述控制器被进一步配置为：
    在接收所述外接设备针对所述声明信息反馈的多媒体内容的步骤中，控制拉低热 插拔电压，以通知所述外接设备读取所述声明信息；
    在预设延迟时间后，再次控制拉低热插拔电压，以通知所述外接设备切换视角比例并按照切换后的视角比例反馈所述多媒体内容。
  7. 根据权利要求2所述的显示设备，所述控制器被进一步配置为：
    在控制所述显示器显示所述多媒体内容的步骤中，在所述多媒体内容中提取识别帧图像；
    检测所述识别帧图像的分辨率；
    如果所述识别帧图像的分辨率等于所述切换后视角比例，按照所述切换后视角比例显示所述多媒体内容；
    如果所述识别帧图像的分辨率不等于所述切换后视角比例，修改所述声明信息中的识别数据为切换前的识别数据，以按照切换前视角比例显示所述多媒体内容。
  8. 根据权利要求2所述的显示设备，所述控制器被进一步配置为：
    在控制所述显示器显示所述多媒体内容的步骤中，检测所述显示器的屏幕宽度和屏幕高度；
    获取所述多媒体内容的画面宽度和画面高度；
    构建虚拟屏幕，所述虚拟屏幕的宽高比等于所述多媒体内容的目标画面显示比例；所述虚拟屏幕的宽度等于所述显示器的屏幕宽度，所述虚拟屏幕的高度等于所述屏幕高度的缩放比例倍，所述缩放比例等于所述画面高度与所述屏幕高度的比值；
    按照所述虚拟屏幕显示所述多媒体内容。
  9. 根据权利要求2所述的显示设备，所述控制器被进一步配置为：
    响应于用户的交互动作，控制所述显示器显示设置界面，所述设置界面中包括多个画面移动选项和多个视角比例切换选项；
    监听用户基于所述设置界面执行的选中动作；
    在用户对所述画面移动选项执行所述选中动作时，根据所述画面移动选项调整所述多媒体内容在所述显示器上的显示位置；
    在用户对所述视角比例切换选项执行所述选中动作时，根据所述选中动作实施的视角比例切换选项生成用于切换视角比例的控制指令。
  10. 根据权利要求1所述的显示设备，所述显示设备还包括：
    图像采集接口，被配置为：采集所述显示设备对应的环境图像；
    所述控制器，被配置为：
    基于所述环境图像，确定人脸对应的图像区域；
    基于多媒体内容的初始显示模式和，所述人脸对应的图像区域与所述环境图像的位置关系，确定所述多媒体内容的目标显示模式。
  11. 根据权利要求10所述的显示设备，所述人脸对应的图像区域与所述环境图像的位置关系包括：相对角度关系，所述相对角度关系为所述图像区域与所述环境图像的中心点在第一方向上的角度信息；
    所述控制器，进一步配置为：
    获取所述初始显示模式中包括的初始画面显示比例；
    基于所述初始画面显示比例和所述位置关系中包括的所述角度信息，确定所述多媒体内容的目标画面显示比例。
  12. 根据权利要求11所述的显示设备，所述控制器，进一步配置为：
    确定所述初始画面显示比例为预设的画面显示比例，且确定所述位置关系中包括的所述角度信息发生变化；所述预设的画面显示比例为所述显示设备处于全屏显示状态时对应的画面显示比例；
    基于所述位置关系中包括的所述角度信息，确定所述多媒体内容的目标画面显示比例。
  13. 根据权利要求12所述的显示设备，所述控制器，进一步配置为：
    若所述角度信息处于预设的第一角度范围，则确定所述多媒体内容的目标画面显示比例为第一显示比例；
    或者，若所述角度信息处于预设的第二角度范围，则确定所述多媒体内容的目标画面显示比例为第二显示比例；
    或者，若所述相对角度处于预设的第三角度范围，则确定所述多媒体内容的目标画面显示比例为第三显示比例。
  14. 根据权利要求11所述的显示设备，所述人脸对应的图像区域与所述环境图像的位置关系包括：相对垂直关系，所述相对垂直关系为所述图像区域与所述环境图像在第二方向上的距离差；
    所述控制器，进一步配置为：
    获取所述初始显示模式中包括的初始画面显示比例；
    根据所述初始画面显示比例和所述位置关系中包括的所述距离差，确定所述多媒体内容的目标画面显示位置。
  15. 根据权利要求14所述的显示设备，所述控制器，进一步配置为：
    确定所述初始画面显示比例不为预设的画面显示比例，且确定所述位置关系中包括的所述距离差发生变化，所述预设的画面显示比例为所述显示设备处于全屏显示状态时对应的画面显示比例；
    根据所述位置关系中包括的所述距离差，确定所述多媒体内容的目标画面显示位置。
  16. 根据权利要求15所述的显示设备，所述控制器，进一步配置为：
    若所述距离差处于预设的第一距离范围，则确定所述多媒体内容的目标画面显示位置为第一显示位置；
    或者，若所述距离差处于预设的第二距离范围，则确定所述多媒体内容的目标画面显示位置为第二显示位置；
    或者，所述距离差处于预设的第三距离范围，则确定所述多媒体内容的目标画面显示位置为第三显示位置。
  17. 根据权利要求10所述的显示设备，所述控制器，还被配置为：
    基于预设的画面显示比例对所述目标画面显示比例进行画面比例检查，所述预设的画面显示比例为所述显示设备处于全屏显示状态时对应的画面显示比例；
    确定所述目标画面显示比例为所述预设的画面显示比例。
  18. 一种用于显示设备的显示方法，所述方法包括：
    基于用户的控制，确定待显示的多媒体内容的目标显示模式，所述目标显示模式用于描述所述多媒体内容的目标画面显示比例和/或所述多媒体内容的目标画面显示 位置；
    基于所述目标显示模式显示所述多媒体内容。
  19. 根据权利要求18所述的方法，所述显示设备包括显示器、外部装置接口和控制器，所述显示设备通过所述外部装置接口连接外接设备，所述基于用户的控制，确定待显示的多媒体内容的目标显示模式包括：
    获取用户输入的用于切换视角比例的第一控制指令；
    响应于所述第一控制指令，向所述外接设备发送声明信息，所述声明信息包括符合所述外部装置接口协议版本和切换后视角比例的识别数据；
    接收所述外接设备针对所述声明信息反馈的多媒体内容，所述多媒体内容的目标画面显示比例等于所述切换后视角比例。
  20. 根据权利要求18所述的方法，所述基于用户的控制，确定待显示的多媒体内容的目标显示模式包括：
    采集所述显示设备对应的环境图像；
    基于所述环境图像，确定人脸对应的图像区域；
    基于多媒体内容的初始显示模式和，所述人脸对应的图像区域与所述环境图像的位置关系，确定所述多媒体内容的目标显示模式，所述目标显示模式用于描述所述多媒体内容的目标画面显示比例和/或所述多媒体内容的目标画面显示位置。
PCT/CN2022/109199 2021-09-07 2022-07-29 一种显示设备及显示方法 WO2023035805A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202280057422.5A CN118077208A (zh) 2021-09-07 2022-07-29 一种显示设备及显示方法
US18/588,414 US20240205498A1 (en) 2021-09-07 2024-02-27 Display device and display method

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202111042636.9A CN114286138B (zh) 2021-01-14 2021-09-07 显示设备、外接设备及多视角比例显示方法
CN202111042636.9 2021-09-07
CN202210503314.8 2022-05-09
CN202210503314.8A CN114816641B (zh) 2022-05-09 2022-05-09 显示设备、多媒体内容显示方法和存储介质

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/588,414 Continuation US20240205498A1 (en) 2021-09-07 2024-02-27 Display device and display method

Publications (1)

Publication Number Publication Date
WO2023035805A1 true WO2023035805A1 (zh) 2023-03-16

Family

ID=82514012

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/109199 WO2023035805A1 (zh) 2021-09-07 2022-07-29 一种显示设备及显示方法

Country Status (3)

Country Link
US (1) US20240205498A1 (zh)
CN (2) CN114816641B (zh)
WO (1) WO2023035805A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115373548A (zh) * 2022-08-25 2022-11-22 汉桑(南京)科技股份有限公司 一种显示内容调整方法和系统

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106155606A (zh) * 2015-04-07 2016-11-23 中国移动通信集团公司 一种多屏互动方法及装置
CN106572389A (zh) * 2015-10-08 2017-04-19 小米科技有限责任公司 调节显示图像方法及装置
CN108762707A (zh) * 2018-05-29 2018-11-06 西安万像电子科技有限公司 多媒体信息采集的自适应方法、装置和系统
JP2019113647A (ja) * 2017-12-22 2019-07-11 キヤノン株式会社 表示装置およびその制御方法
CN111885418A (zh) * 2020-07-30 2020-11-03 深圳创维－Rgb电子有限公司 Edid自适应方法、装置、显示设备和可读存储介质
CN112533021A (zh) * 2019-09-19 2021-03-19 青岛海信传媒网络技术有限公司 一种显示方法及显示设备
CN114286138A (zh) * 2021-01-14 2022-04-05 海信视像科技股份有限公司 显示设备、外接设备及多视角比例显示方法

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5423183B2 (ja) * 2009-07-03 2014-02-19 ソニー株式会社 表示制御装置および表示制御方法
CN102281452A (zh) * 2010-06-13 2011-12-14 深圳Tcl新技术有限公司 一种3d电视上改变菜单会聚位置的方法
US8988512B2 (en) * 2011-04-14 2015-03-24 Mediatek Inc. Method for adjusting playback of multimedia content according to detection result of user status and related apparatus thereof
JP2013246761A (ja) * 2012-05-29 2013-12-09 Nec Casio Mobile Communications Ltd 情報処理装置、情報処理装置の制御方法およびプログラム
CN102917232B (zh) * 2012-10-23 2014-12-24 深圳创维－Rgb电子有限公司 基于人脸识别的3d显示自适应调节方法和装置
JP2017134657A (ja) * 2016-01-28 2017-08-03 富士通株式会社 虹彩認証制御装置、虹彩認証制御方法、及び、虹彩認証制御プログラム
CN106529449A (zh) * 2016-11-03 2017-03-22 英华达（上海）科技有限公司 自动调整显示画面比例的方法及其显示装置
CN107169447A (zh) * 2017-05-12 2017-09-15 贵州中信云联科技有限公司 基于人脸识别的医院自助系统
CN108388849B (zh) * 2018-02-07 2021-02-02 Oppo广东移动通信有限公司 调整终端的显示图像的方法和装置、电子设备、存储介质
WO2022226983A1 (zh) * 2021-04-30 2022-11-03 华为技术有限公司 一种显示屏调整方法及装置

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106155606A (zh) * 2015-04-07 2016-11-23 中国移动通信集团公司 一种多屏互动方法及装置
CN106572389A (zh) * 2015-10-08 2017-04-19 小米科技有限责任公司 调节显示图像方法及装置
JP2019113647A (ja) * 2017-12-22 2019-07-11 キヤノン株式会社 表示装置およびその制御方法
CN108762707A (zh) * 2018-05-29 2018-11-06 西安万像电子科技有限公司 多媒体信息采集的自适应方法、装置和系统
CN112533021A (zh) * 2019-09-19 2021-03-19 青岛海信传媒网络技术有限公司 一种显示方法及显示设备
CN111885418A (zh) * 2020-07-30 2020-11-03 深圳创维－Rgb电子有限公司 Edid自适应方法、装置、显示设备和可读存储介质
CN114286138A (zh) * 2021-01-14 2022-04-05 海信视像科技股份有限公司 显示设备、外接设备及多视角比例显示方法

Also Published As

Publication number Publication date
CN114816641B (zh) 2023-05-02
CN118077208A (zh) 2024-05-24
CN114816641A (zh) 2022-07-29
US20240205498A1 (en) 2024-06-20

Similar Documents

Publication Publication Date Title
CN114286138B (zh) 显示设备、外接设备及多视角比例显示方法
US11856322B2 (en) Display apparatus for image processing and image processing method
US7283104B2 (en) PIP processing system and a method of controlling the same
WO2020248680A1 (zh) 视频数据处理方法、装置及显示设备
CN106803984B (zh) 一种兼容vr和电视功能的方法和装置
US20240205498A1 (en) Display device and display method
EP3079050A2 (en) Display apparatus and control method thereof
TW201104561A (en) Projection system and method thereof
CN112788422A (zh) 显示设备
WO2020248697A1 (zh) 显示设备及视频通讯数据处理方法
WO2016065514A1 (zh) 图像显示方法、用户终端和视频接收设备
CN112783380A (zh) 显示设备和方法
KR102518295B1 (ko) 이동 단말기
WO2021031608A1 (zh) 一种摄像头物理开关锁定状态显示方法及显示设备
CN111078926A (zh) 一种人像缩略图像的确定方法及显示设备
WO2021218473A1 (zh) 一种显示方法及显示设备
US9197844B2 (en) User interface
WO2021180223A1 (zh) 一种显示方法及显示设备
KR20220120303A (ko) 디스플레이 장치 및 그 동작방법
CN112399245A (zh) 一种播放方法及显示设备
CN113645502B (zh) 一种动态调整控件的方法及显示设备
CN113825001B (zh) 全景图片浏览方法及显示设备
WO2023010968A1 (zh) 一种图像处理方法及显示设备
CN117793424A (zh) 显示设备和分辨率设置方法
CN115914766A (zh) 一种显示设备及在游戏画面上显示菜单的方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22866279

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE