WO2022105345A1 - 一种显示设备 - Google Patents

一种显示设备 Download PDF

Info

Publication number
WO2022105345A1
WO2022105345A1 PCT/CN2021/114957 CN2021114957W WO2022105345A1 WO 2022105345 A1 WO2022105345 A1 WO 2022105345A1 CN 2021114957 W CN2021114957 W CN 2021114957W WO 2022105345 A1 WO2022105345 A1 WO 2022105345A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
aspect ratio
image
height
width
Prior art date
Application number
PCT/CN2021/114957
Other languages
English (en)
French (fr)
Inventor
张敬坤
朱雪生
庞秀娟
刘儒茜
Original Assignee
青岛海信传媒网络技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202011319998.3A external-priority patent/CN112565839B/zh
Priority claimed from CN202011319699.XA external-priority patent/CN112565861A/zh
Application filed by 青岛海信传媒网络技术有限公司 filed Critical 青岛海信传媒网络技术有限公司
Publication of WO2022105345A1 publication Critical patent/WO2022105345A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display

Definitions

  • the present application relates to the technical field of televisions, and in particular, to a display device.
  • Smart TVs have independent operating systems and support function expansion.
  • Various applications can be installed in the smart TV according to user needs, for example, traditional video applications, social applications such as short videos, and reading applications such as comics and books. These applications can use the screen of the smart TV to display the application screen and provide rich media resources for the smart TV.
  • the smart TV can also perform data interaction and resource sharing with different terminals.
  • a smart TV can be connected to a mobile phone through a wireless communication method such as a local area network or Bluetooth, so as to play the resources in the mobile phone or directly perform screen projection to display the picture on the mobile phone.
  • the embodiment of the present application shows a display device.
  • a first aspect of the embodiments of the present application shows a display device, including:
  • a controller configured to execute:
  • the first width and height are the width and height of the display image
  • the second width and height are the width and height of the display
  • the display is controlled to present the scaled presentation image.
  • FIG. 1A is an application scenario diagram of a display device according to an embodiment of the present application.
  • FIG. 1B is a rear view of a display device according to an embodiment of the present application.
  • FIG. 2 is a block diagram of a hardware configuration of a control device according to an embodiment of the present application.
  • FIG. 3 is a block diagram of a hardware configuration of a display device according to an embodiment of the present application.
  • FIG. 4 is a block diagram of an architecture configuration of an operating system in a memory of a display device according to an embodiment of the present application
  • 5A is a schematic diagram of displaying directional media assets on a horizontal screen according to an embodiment of the present application
  • 5B is a schematic diagram of displaying directional media assets on a vertical screen according to an embodiment of the present application.
  • FIG. 6 is a schematic diagram of an interface displayed by a display according to an embodiment of the present disclosure.
  • FIG. 7 is a schematic diagram of an interface displayed by a display according to an embodiment of the present disclosure.
  • FIG. 8 is a flowchart illustrating the interaction between a mobile terminal and a display device according to an embodiment of the present disclosure
  • FIG. 9 is a schematic diagram of a change in a display interface during a screen projection process according to an embodiment of the present disclosure.
  • FIG. 10 is a schematic diagram of a change in a display interface during a screen projection process according to an embodiment of the present disclosure
  • FIG. 11 is a schematic diagram illustrating a change of a display interface on a display during a screen projection process according to an embodiment of the present disclosure
  • FIG. 12 is a schematic diagram illustrating a change of a display interface during a screen projection process according to an embodiment of the present disclosure
  • FIG. 13 is a schematic diagram of a change in a display interface during a screen projection process according to an embodiment of the present disclosure
  • FIG. 14 is a schematic diagram illustrating a change of a display interface during a screen projection process according to an embodiment of the present disclosure
  • 15 is a schematic diagram illustrating a change of a display interface during a screen projection process according to an embodiment of the present disclosure
  • 16 is a schematic diagram illustrating a change of a display interface during a screen projection process according to an embodiment of the present disclosure
  • FIG. 17 is a schematic diagram illustrating a change of a display interface on a display during a screen projection process according to an embodiment of the present disclosure
  • FIG. 18 is a flowchart illustrating the interaction between a mobile terminal and a display device according to an embodiment of the present disclosure
  • 19A is a schematic diagram of a change in a display interface during a screen projection process according to an embodiment of the present disclosure
  • 19B is a schematic diagram of a change in a display interface during a screen projection process according to an embodiment of the present disclosure
  • 20 is a schematic diagram of a change in a display interface during a screen projection process according to an embodiment of the present disclosure
  • 21 is a schematic diagram of a change in a display interface during a screen projection process according to an embodiment of the present disclosure
  • FIG. 22 is a schematic diagram of a change in a display interface during a screen projection process according to an embodiment of the present disclosure
  • FIG. 23 is a schematic diagram of a change in a display interface during a screen projection process according to an embodiment of the present disclosure
  • FIG. 24 is a schematic diagram illustrating a change of a display interface during a screen projection process according to an embodiment of the present disclosure
  • 25 is a flowchart illustrating the interaction between a mobile terminal and a display device according to an embodiment of the present disclosure
  • 26 is a schematic diagram of screen projection on a display device when the mobile terminal is vertically screened according to the present application
  • FIG. 27 is a schematic diagram of screen projection on a display device when the mobile terminal is horizontally screened according to the present application.
  • FIG. 28 is a schematic diagram of a screen projection data stream displayed on a vertical screen display device when the mobile terminal is vertically screened according to the present application;
  • FIG. 29 is a schematic diagram of displaying a screen projection image of a vertical screen after size adjustment shown in the application on a vertical screen display device;
  • 30A is a schematic diagram of a screen projection image shown in this application.
  • 30B is a schematic diagram of another screen projection image shown in this application.
  • FIG. 31 is a schematic diagram of a display device shown in this application.
  • FIG. 33 is a schematic diagram of a processing process of a controller in a display device shown in this application.
  • 34 is a schematic diagram of a processing process of a controller in another display device shown in this application.
  • FIG. 35 is a schematic diagram of the processing process of the controller in the third display device shown in this application.
  • Rotary TV is a new type of smart TV, which mainly includes a display and rotating components.
  • the display is connected to the bracket or the wall through the rotating component, and the display angle can be adjusted through the rotating component to achieve the purpose of rotation.
  • Different display placement angles can adapt to animation pages with different aspect ratios.
  • the display is placed horizontally to display video pages such as movies and TV series with an aspect ratio of 16:9.
  • the aspect ratio of the video page is 9:16 for short videos, comics and other pages
  • the horizontally placed monitor needs to scale the page, and black areas are displayed on both sides of the monitor. Therefore, the display can be placed in portrait orientation by rotating the assembly to accommodate 9:16 video pages.
  • the start-up signal source of the TV can be set as a live signal, so that the TV directly enters the live state after power-on.
  • the user can set the power-on source to any application through the setup program. Since different applications support different display postures, the posture of the TV when it is turned on must be adapted to the application used as the start-up signal source, so that the page corresponding to the application of the start-up signal source can be displayed normally.
  • the posture of the display of the rotating TV will be adjusted as required, and the posture will still be maintained when the device is turned off. For example, when a user is watching a short video or a comic on a TV, he or she will switch the screen to a state of being placed vertically, and turn off the device in the state of being placed vertically. Then when the user turns on the next time, the posture of the screen is in the vertical position. If the power-on signal source is set as an application that only supports the horizontal position, the screen posture does not match the power-on signal source application and cannot be displayed correctly. Therefore, the present application provides a display device and a display method for an application interface.
  • the embodiments of the present application provide a display device, a method for displaying details page, and a computer storage device.
  • media display devices such as rotating TVs. It should be noted that the method provided in this embodiment is not only applicable to rotating a TV, but also applicable to other display devices, such as a computer, a tablet computer, and the like.
  • remote control used in various embodiments of the present application refers to a component of an electronic device (such as the display device disclosed in the present application), which can usually wirelessly control the electronic device within a short distance range.
  • the component can generally use infrared and/or radio frequency (RF) signals and/or Bluetooth to connect with electronic devices, and may also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors.
  • RF radio frequency
  • a hand-held touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.
  • gesture used in various embodiments of the present application refers to a user behavior that is used by a user to express an expected idea, action, purpose/or result through an action such as a change of hand shape or hand movement.
  • FIG. 1A it is an application scenario diagram of a display device provided by some embodiments of the present application. As shown in FIG. 1A , communication between the control apparatus 100 and the display device 200 may be performed in a wired or wireless manner.
  • the control device 100 is configured to control the display device 200 , which can receive operation instructions input by the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, acting as an intermediary for the interaction between the user and the display device 200 . effect.
  • the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the channel addition and subtraction operation.
  • the control apparatus 100 may be a remote controller 100A, including infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc., and controls the display device 200 by wireless or other wired methods.
  • the user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, and the like.
  • the control apparatus 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, and the like.
  • the display device 200 is controlled using an application running on the smart device.
  • the application can be configured to provide users with various controls through an intuitive user interface (UI) on the screen associated with the smart device.
  • UI intuitive user interface
  • the mobile terminal 100B can install a software application with the display device 200, and realize connection communication through a network communication protocol, so as to realize the purpose of one-to-one control operation and data communication.
  • the mobile terminal 100B and the display device 200 can be made to establish a control instruction protocol, and by operating various function keys or virtual controls of the user interface provided on the mobile terminal 100B, the functions of the physical keys arranged by the remote control 100A can be realized.
  • the audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200 to implement a synchronous display function.
  • the display device 200 also performs data communication with the server 300 through various communication methods.
  • the display device 200 may be allowed to be communicatively connected through a local area network (LAN), a wireless local area network (WLAN), and other networks.
  • LAN local area network
  • WLAN wireless local area network
  • the display device 200 includes a rotating assembly, a controller 250 , a display 275 , a terminal interface protruding from a space on the backplane, and a rotating assembly 276 connected to the backplane, the rotating assembly 276
  • the display 275 can be rotated.
  • the rotating component 276 can rotate the display screen to the vertical display orientation, that is, the state where the vertical side length of the screen is greater than the horizontal side length, or rotate the screen to the horizontal display orientation, that is, the screen can be rotated to the horizontal display orientation. A state where the horizontal side length is greater than the vertical side length.
  • FIG. 2 A block diagram of the configuration of the control device 100 is exemplarily provided in FIG. 2 .
  • the control device 100 includes a controller 110 , a memory 120 , a communicator 130 , a user input interface 140 , a user output interface 150 , and a power supply 160 .
  • the controller 110 includes a random access memory (RAM) 111, a read only memory (ROM) 112, a processor 113, a power-up interface, and a communication bus.
  • RAM random access memory
  • ROM read only memory
  • the controller 110 is used to control the operation and operation of the apparatus 100, as well as the communication cooperation among the internal components, and the external and internal data processing functions.
  • the controller 110 may control to generate a signal corresponding to the detected interaction and transmit the signal to the display device 200.
  • the memory 120 is used to store various operating programs, data and applications of the driving and controlling apparatus 100 under the control of the controller 110 .
  • the memory 120 can store various control signal instructions input by the user.
  • the communicator 130 implements communication of control signals and data signals with the display device 200 under the control of the controller 110 .
  • the control apparatus 100 sends a control signal (eg, a touch signal or a control signal) to the display apparatus 200 via the communicator 130 , and the control apparatus 100 can receive the signal sent by the display apparatus 200 via the communicator 130 .
  • the communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132 .
  • the user input interface 140 may include at least one of the microphone 141, the touch pad 142, the sensor 143, the key 144, etc., so that the user can input user instructions for controlling the display device 200 to the control device through voice, touch, gesture, pressing, etc. 100.
  • the user output interface 150 outputs the user instruction received by the user input interface 140 to the display device 200 , or outputs the image or voice signal received by the display device 200 .
  • the user output interface 150 may include an LED interface 151, a vibration interface 152 that generates vibration, a sound output interface 153 that outputs sound, a display 154 that outputs images, and the like.
  • the remote control 100A may receive output signals such as audio, video, or data from the user output interface 150, and display the output signals on the display 154 as images, on the sound output interface 153 as audio, or on the vibration interface 152 as Vibration form.
  • the power supply 160 is used to provide operating power support for each element of the control device 100 under the control of the controller 110 . It can be in the form of a battery and related control circuits.
  • the display device 200 may include a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, Audio processor 280 , audio output interface 285 , power supply 290 .
  • the rotating assembly 276 may include components such as a drive motor, a rotating shaft, and the like.
  • the drive motor can be connected to the controller 250, and is controlled by the controller 250 to output a rotation angle; one end of the rotating shaft is connected to the power output shaft of the drive motor, and the other end is connected to the display 275, so that the display 275 can be fixedly installed on the rotating assembly 276. on a wall or stand.
  • the rotating assembly 276 may also include other components, such as transmission components, detection components, and the like.
  • the transmission component can adjust the rotational speed and torque output by the rotating component 276 through a specific transmission ratio, which can be a gear transmission mode;
  • the detection component can be composed of sensors arranged on the rotating shaft, such as an angle sensor, an attitude sensor, and the like. These sensors can detect parameters such as the rotation angle of the rotating component 276, and send the detected parameters to the controller 250, so that the controller 250 can judge or adjust the state of the display device 200 according to the detected parameters.
  • the rotating assembly 276 may include, but is not limited to, one or more of the above components.
  • the tuner and demodulator 210 receives broadcast television signals through wired or wireless means, and can perform modulation and demodulation processing such as amplification, frequency mixing, and resonance, so as to demodulate the television selected by the user from multiple wireless or wired broadcast television signals
  • modulation and demodulation processing such as amplification, frequency mixing, and resonance
  • the audio and video signals carried in the frequency of the channel, as well as additional information (eg EPG data).
  • the tuner 210 may also be in an external device, such as an external set-top box or the like.
  • the set-top box outputs the TV signal after modulation and demodulation, and then inputs the TV signal to the display device 200 through the external device interface 240 .
  • the communicator 220 is a component for communicating with external devices or external servers according to various communication protocol types.
  • the display device 200 may transmit content data to an external device connected via the communicator 220 , or browse and download content data from an external device connected via the communicator 220 .
  • the communicator 220 may include a network communication protocol module such as a WIFI module 221 , a Bluetooth module 222 , a wired Ethernet module 223 or a near field communication protocol module, so that the communicator 220 can receive the control signal of the control device 100 according to the control of the controller 250 , and
  • the control signal is realized as a WIFI signal, a Bluetooth signal, a radio frequency signal, etc.
  • the detector 230 is a component of the display device 200 for collecting external environment or external interaction signals.
  • the detector 230 can include a sound collector 231, such as a microphone, which can be used to receive the user's voice, such as the voice signal of the user's control instruction to control the display device 200;
  • Device 200 can adapt to ambient noise.
  • the detector 230 can also include an image collector 232, such as a camera, a camera, etc., which can be used to collect external environmental scenes to adaptively change the display parameters of the display device 200; and used to collect user attributes or interact with the user gestures, In order to realize the function of interaction between the display device and the user.
  • an image collector 232 such as a camera, a camera, etc., which can be used to collect external environmental scenes to adaptively change the display parameters of the display device 200; and used to collect user attributes or interact with the user gestures, In order to realize the function of interaction between the display device and the user.
  • the detector 230 may further include a temperature sensor. For example, by sensing the ambient temperature, the display device 200 can adaptively adjust the display color temperature of the image.
  • the external device interface 240 is a component that provides the controller 250 to control data transmission between the display device 200 and the external device.
  • the external device interface 240 can be connected with external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), additional information (such as EPG) ) and other data.
  • the external device interface 240 may include: a high-definition multimedia interface (HDMI) terminal 241, a composite video blanking synchronization (CVBS) terminal 242, an analog or digital component terminal 243, a universal serial bus (USB) terminal 244, a component (Component) Any one or more of terminals (not provided in the figure), red, green and blue (RGB) terminals (not provided in the figure).
  • HDMI high-definition multimedia interface
  • CVBS composite video blanking synchronization
  • USB universal serial bus
  • Component Any one or more of terminals (not provided in the figure), red, green and blue (RGB) terminals (not provided in the figure).
  • the controller 250 controls the operation of the display device 200 and responds to user operations by running various software control programs (such as an operating system and various application programs) stored in the memory 260 .
  • various software control programs such as an operating system and various application programs
  • the controller 250 includes a random access memory (RAM) 251 , a read only memory (ROM) 252 , a graphics processor 253 , a processor 254 , a power-up interface 255 , and a communication bus 256 .
  • RAM random access memory
  • ROM read only memory
  • the RAM 251 , the ROM 252 , the graphics processor 253 , and the power-on interface 255 of the processor 254 are connected through a communication bus 256 .
  • the graphics processor 253 is used to generate various graphic objects, such as icons, operation menus, and user input instructions to display graphics and so on.
  • Processor 254 for executing operating system and application program instructions stored in memory 260 . And according to the received user input instructions, various application programs, data and content processing are performed, so as to finally display and play various audio and video content.
  • the power-on interface 255 may include a first interface to an nth interface. These interfaces may be network interfaces connected to external devices via a network.
  • the controller 250 may control the overall operation of the display apparatus 200 . For example, in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform operations related to the object selected by the user input command.
  • the memory 260 is used to store various types of data, software programs or application programs that drive and control the operation of the display device 200 .
  • Memory 260 may include volatile and/or nonvolatile memory.
  • the term “memory” includes the memory 260 , the RAM 251 and ROM 252 of the controller 250 , or a memory card in the display device 200 .
  • the memory 260 is specifically used to store the running programs that drive the controller 250 in the display device 200; store various application programs built in the display device 200 and downloaded from external devices by the user; Various GUI-related objects and data such as visual effect images of selectors used to select GUI objects.
  • the memory 260 specifically stores software and/or programs representing an operating system (OS).
  • OS operating system
  • FIG. 4 exemplarily provides a block diagram of the architecture configuration of the operating system in the memory of the display device 200 .
  • the operating system architecture is, from top to bottom, the application layer, the middleware layer and the kernel layer.
  • user interface 265 receives various user interactions. Specifically, it is used to send the user's input signal to the controller 250, or to transmit the output signal from the controller 250 to the user.
  • the user may input user commands on a graphical user interface (GUI) displayed on the display 275, and the user interface 265 receives the user input commands through the GUI.
  • GUI graphical user interface
  • user interface 265 may receive user input commands for controlling the position of selectors in the GUI to select different objects or items.
  • the user can input a user command by inputting a specific sound or gesture, and the user interface 265 recognizes the sound or gesture through a sensor to receive the user input command.
  • the video processor 270 is used to receive an external video signal, process the video data according to the standard codec protocol of the input signal, and obtain a video signal that is directly displayed or played on the display 275 .
  • the display formatting module is used to change the signal output by the frame rate conversion module into a signal conforming to a display format such as a display, such as converting the format of the signal output by the frame rate conversion module to output an RGB data signal.
  • the display 275 is used for receiving the image signal input from the video processor 270 to display the video content, the image and the menu manipulation interface.
  • Display 275 may be a projection display and may also include a projection device and projection screen.
  • the controller 250 may issue a control signal to cause the rotating assembly 276 to rotate the display 275 .
  • the audio processor 280 is configured to receive an external audio signal, perform audio data processing according to the standard codec protocol of the input signal, and obtain an audio signal that can be played in the microphone 286 .
  • the audio output interface 285 is used to receive the audio signal output by the audio processor 280 under the control of the controller 250.
  • the audio output interface 285 may include a microphone 286, or an external audio output terminal 287 output to a generating device of an external device, such as an earphone output terminal.
  • the video processor 270 may comprise one or more chips.
  • the audio processor 280 may also include one or more chips.
  • the power supply 290 is used to provide power supply support for the display device 200 with the power input from the external power supply under the control of the controller 250 .
  • the power supply 290 may be a built-in power supply circuit installed inside the display device 200 , or may be a power supply installed outside the display device 200 .
  • the display direction may include a horizontal screen display direction and a portrait screen display direction.
  • the horizontal display direction refers to the display direction in which the horizontal length (width) of the display 275 is greater than the vertical length (height) when viewed from the front of the display 275;
  • the vertical display direction refers to the display direction from the display 275 When viewed from the front, the length (width) in the horizontal direction of the display 275 is smaller than the length (height) in the vertical direction in the display direction.
  • the vertical direction in this application refers to approximately vertical
  • the horizontal direction also refers to approximately horizontal
  • the horizontal screen display direction is mainly used to display horizontal media resources such as TV dramas and movies, as shown in FIG. 5A .
  • the operation mode when the display 275 is in the landscape orientation may be referred to as the landscape media viewing mode
  • the operation mode when the display 275 is in the portrait orientation may be referred to as the portrait media viewing mode.
  • the controller 250 in the display device 200 is further connected in communication with the server 300 for invoking an interface of the server 300 to obtain corresponding data.
  • the display 275 in the display device 200 can be driven to rotate by the rotating assembly 276 and is used to display the user interface.
  • the user can control the playback mode, playback content, etc. of the display device 200 through the control device 100 , wherein the playback modes include a horizontal screen media asset viewing mode and a vertical screen media asset viewing mode.
  • the vertical screen display direction is mainly used to display vertical media resources such as short videos and comics, as shown in Figure 5B.
  • the display 275 can display a user interface corresponding to the vertical screen display direction, and has an interface layout and interaction mode corresponding to the vertical screen display direction.
  • the vertical screen media asset viewing mode users can watch vertical screen media assets such as short videos and comics.
  • the controller 250 in the display device 200 is further connected in communication with the server 300, the media asset data corresponding to the vertical screen can be obtained by calling the interface of the server 300 when the orientation is displayed in the vertical screen.
  • the vertical display orientation is more suitable for playing media assets with a page ratio of 9:16 in a vertical screen format, for example, short videos shot through terminals such as mobile phones. Since terminal devices such as mobile phones mostly use vertical screen ratios such as 9:16 and 9:18, when the terminal is connected to the display device 200 and the terminal page is displayed through the display device 200, the vertical screen display direction can avoid the transitional scaling of the page. , make full use of the application page of the display 275, and have a better user experience.
  • horizontal screen display direction and vertical screen display direction are only two different display directions of the display 275, and do not limit the displayed content.
  • short videos, comics, etc. can still be displayed in the horizontal screen display direction.
  • Vertical media assets; horizontal media assets such as TV shows and movies can still be displayed in the vertical screen display direction, but the display windows that do not match need to be compressed and adjusted in the display direction.
  • the display direction of the display 275 is adjusted according to the user's needs for watching movies. For example, after the rotation key on the control device 100 is used, or the rotation option is selected on the UI interface, or the rotation instruction is issued by inputting a "rotation" related voice through the voice system, the controller 250 will control the rotation component 276 to rotate according to the rotation instruction. to drive the display 275 to rotate. For example, when a user wants to watch a short video through the display device 200, he can input a rotation instruction through one of the above methods, so that the display 275 in the horizontal display orientation is rotated 90 degrees counterclockwise to the vertical display orientation, so as to adapt to the short video, etc. The image scale applied vertically.
  • the display device can perform data interaction and resource sharing with different terminals.
  • the display device can be connected to the mobile terminal through wireless communication methods such as local area network and Bluetooth, so as to play resources in the mobile terminal or directly perform screen projection to display the picture on the mobile phone.
  • a system commonly used in a mobile terminal on the market is an IOS system or an Android system.
  • the mobile terminal using the IOS system communicates with the display device through the Airplay protocol
  • the mobile terminal using the Android system communicates with the display device through the Miracast protocol.
  • This application is mainly aimed at the mobile terminal of the Android system.
  • the content displayed on the display screen of the mobile device can be mirrored on the display device of the display device through the screen projection function.
  • the specific implementation process can be as follows: the mobile terminal sends the displayed content to the display device in the form of a data stream, and the display device Whether the data stream is a horizontal screen data stream or a vertical screen data stream determines the zoom factor of the image rendered by the data stream.
  • a display device receives a horizontal screen data stream, and the display device displays an image rendered based on the data stream as large as possible.
  • the interface displayed by the display device can refer to FIG. 6 .
  • a display device receives a horizontal screen data stream (the image rendered by the data stream is a vertical image)
  • the interface displayed by the display can refer to FIG. 7, from FIG. 7 It can be seen that the area A, area B, area C, and area D on the display are not properly utilized.
  • FIG. 8 is a flowchart illustrating the interaction between the mobile terminal and the display device according to an embodiment of the present disclosure. As can be seen from the figure:
  • the mobile terminal performs step S101 to send a screen projection request
  • the user can trigger the screen projection function through the mobile terminal.
  • the specific implementation may be as follows: the user triggers the screen projection control on the mobile terminal.
  • the mobile terminal sends a screen-casting request.
  • other methods may be used to trigger the mobile terminal to send the screen projection request, and the applicant does not make too many restrictions here.
  • the screen projection request carries the data stream of the image currently displayed by the mobile terminal.
  • the currently displayed image may be, but not limited to, a frame of a video, an interface of an application, a picture in an album, and the like.
  • the controller is configured to perform steps S102-S107:
  • S102 receives the data stream output by the mobile terminal
  • the implementation manner of receiving the data stream output by the mobile terminal may adopt a data receiving manner commonly used in the art, and the applicant does not limit it too much here.
  • S103 renders the data stream to obtain a display image
  • the implementation manner of rendering the data stream to obtain the display image may adopt the conventional image rendering manner in the art, and the applicant does not make too many limitations here.
  • S104 reads a first width and height and a second width and height, where the first width and height are the width and height of the display image, and the second width and height are the width and height of the display;
  • the specific implementation process may be that the controller determines the aspect ratio of the displayed image by reading the pixels of the displayed image.
  • the controller may generate the zoom factor by performing steps S11-S12.
  • S11 calculates a first aspect ratio and a second aspect ratio, the first aspect ratio is equal to the width of the display image/the height of the display image, and the second aspect ratio is equal to the width of the display device/height of the display device;
  • the controller may read the width of the display and the height of the display, respectively, and then calculate the second aspect ratio based on the width of the display and the height of the display. For example, in the embodiment of the present disclosure, the controller reads that the width of the display is 1024, the height of the display is 576, and the controller calculates the second aspect ratio to be 16/9.
  • the controller may directly store the width and height of the display.
  • the controller can directly call the width and height of the display.
  • This embodiment is only an example to introduce two ways of reading the aspect ratio. In the process of practical application, other ways can be used to read the second aspect ratio, and the applicant does not make too many restrictions here.
  • S12 calculates the zoom factor of the displayed image according to the relationship between the first aspect ratio and the second aspect ratio.
  • the zoom factor is equal to the height of the display/the size of the displayed image high.
  • the display images involved in this implementation manner are all horizontal screen display images.
  • FIG. 9 is a schematic diagram of a change of a display interface during screen projection according to an embodiment of the present disclosure.
  • the mobile terminal transmits the data stream 1 of the image 1 to the controller of the display device.
  • the controller renders stream 1 to get image 1.
  • the controller controls the display to display the image 1.
  • the display interface of the display can refer to interface 1-1.
  • the controller reads that the first aspect ratio is 4/3, and the pixels of image 1 are 480*360; the second aspect ratio is 16:9, and the pixels of the display are 1024*576.
  • the display interface of the display can refer to interface 1 -2.
  • FIG. 10 is a schematic diagram of a change of a display interface during screen projection according to an embodiment of the present disclosure
  • the mobile terminal transmits the data stream 2 of the image 2 to the controller of the display device.
  • the controller renders stream 2 to get image 2.
  • the controller controls the display to display the image 2.
  • the display interface of the display can refer to interface 2-1.
  • the controller reads that the first aspect ratio is 16/9, and the pixels of image 2 are 864*486; the second aspect ratio is 16:9, and the pixels of the display are 1024*576.
  • the display interface of the display can refer to interface 2 -2.
  • FIG. 11 is a schematic diagram illustrating a change of a display interface during a screen projection process according to an embodiment of the present disclosure
  • the mobile terminal transmits the data stream 3 of the image 3 to the controller of the display device.
  • the controller renders data stream 3 to get image 3.
  • the controller controls the display to display the image 3.
  • the display interface of the display can refer to interface 3-1.
  • the controller reads that the first aspect ratio is 1/1, and the pixels of image 3 are 360*360; the second aspect ratio is 16:9, and the pixels of the display are 1024*576.
  • the display interface of the display can refer to interface 3 -2.
  • the zoom factor is equal to the width of the display/display image width
  • the display images involved in this implementation manner are all horizontal screen display images.
  • FIG. 12 is a schematic diagram of a change of a display interface during screen projection according to an embodiment of the present disclosure
  • the mobile terminal transmits the data stream 4 of the images 4 to the controller of the display device.
  • the controller renders data stream 4 to get image 4.
  • the controller controls the display to display the image 4.
  • the display interface of the display can refer to interface 4-1.
  • the controller reads that the first aspect ratio is 4/3, and the pixels of image 4 are 480*360; the second aspect ratio is 9/16, and the pixels of the display are 576*1024.
  • the display interface of the display can refer to interface 4 -2.
  • FIG. 13 is a schematic diagram of a change of a display interface during screen projection according to an embodiment of the present disclosure
  • the mobile terminal transmits the data stream 5 of the images 5 to the controller of the display device.
  • the controller renders data stream 5 to get image 5.
  • the controller controls the display to display the image 5.
  • the display interface of the display can refer to interface 5-1.
  • the controller reads that the first aspect ratio is 8/3, and the pixels of image 4 are 960*360; the second aspect ratio is 16/9, and the pixels of the display are 1024*576.
  • the display interface of the display can refer to interface 5 -2.
  • the zoom factor is equal to the height of the display/height of the displayed image.
  • the display images involved in this implementation mode are all vertical screen display images.
  • FIG. 14 is a schematic diagram of a change of a display interface during a screen projection process according to an embodiment of the present disclosure
  • the mobile terminal transmits the data stream 6 of images 6 to the controller of the display device.
  • the controller renders the data stream 6 to obtain the image 6 .
  • the controller controls the display to display the image 6.
  • the display interface of the display can refer to interface 6-1.
  • the controller reads that the first aspect ratio is 3/4, and the pixels of image 6 are 360*480; the second aspect ratio is 16/9, and the pixels of the display are 1024*576.
  • the display interface of the display can refer to interface 6 -2.
  • FIG. 15 is a schematic diagram of a change in the display interface of the display during the screen projection process according to an embodiment of the present disclosure
  • the mobile terminal transmits a data stream 6 of images 7 to the controller of the display device.
  • the controller renders the data stream 7 to get the image 7 .
  • the controller controls the display to display the image 7.
  • the display interface of the display can refer to interface 7-1.
  • the controller reads that the first aspect ratio is 9/16, and the pixels of image 7 are 486*864; the second aspect ratio is 9/16, and the pixels of the display are 576*1024.
  • the display interface of the display can refer to interface 7 -2.
  • the zoom factor is equal to the width of the display/the width of the displayed image
  • the display images involved in this implementation mode are all vertical screen display images.
  • FIG. 16 is a schematic diagram of a change in the display interface of the display during the screen projection process according to an embodiment of the present disclosure
  • the mobile terminal transmits the data stream 8 of images 8 to the controller of the display device.
  • the controller renders the data stream 8 to obtain the image 8 .
  • the controller controls the display to display the image 8.
  • the display interface of the display can refer to interface 8-1.
  • the controller reads that the first aspect ratio is 3/4, and the pixels of image 8 are 360*480; the second aspect ratio is 9/16, and the pixels of the display are 576*1024.
  • the display interface of the display can refer to interface 8 -2.
  • the zoom factor is equal to the height of the display/the height of the displayed image.
  • the display images involved in this implementation mode are all vertical screen display images.
  • FIG. 17 is a schematic diagram of a change of a display interface during a screen projection process according to an embodiment of the present disclosure
  • the mobile terminal transmits the data stream 9 of images 9 to the controller of the display device.
  • the controller renders the data stream 9 to get the image 8 .
  • the controller controls the display to display the image 8.
  • the display interface of the display can refer to interface 9-1.
  • the controller reads that the first aspect ratio is 3/8, and the pixels of image 9 are 360*960; the second aspect ratio is 9/16, and the pixels of the display are 576*1024.
  • the display interface of the display can refer to interface 9 -2.
  • the zoom factor is equal to the width of the display/the width of the displayed image
  • Embodiment 8 For a specific example, refer to Embodiment 8, which is not repeated here.
  • S106 zooms the display image based on the zoom factor
  • S107 controls the display to display the scaled display image.
  • the display device shown in the embodiment of the present application includes: a display and a controller; wherein, after completing the rendering of the display image, the controller reads the first width and height and the second width and height, and based on the first width and height and the second width and height
  • the zoom factor of the display image is calculated; then the display image is scaled based on the zoom factor; finally, the display image is controlled to display the zoomed display image.
  • the embodiment of the present application shows a display device.
  • the controller of the display device can calculate the zoom factor of the displayed image based on the actual aspect ratio of the displayed image; and display the image based on the zoom factor. image, so that the scaled display image matches the display space of the display, and the user experience is better.
  • FIG. 18 is a flowchart illustrating the interaction between the mobile terminal and the display device according to an embodiment of the present disclosure. It can be seen from the figure that:
  • the mobile terminal performs step S201 to send a screen projection request
  • the controller is configured to perform steps S202-S209:
  • S202 receives the data stream output by the mobile terminal
  • the implementation manner of receiving the data stream may refer to the foregoing embodiments, which will not be repeated here.
  • S203 renders the data stream to obtain a display image
  • the implementation manner of rendering the display image may adopt a rendering manner commonly used in the art, and the applicant does not limit it too much here.
  • S204 reads a first width and height and a second width and height, where the first width and height are the width and height of the display image; the second width and height are the width and height of the display when receiving the data stream output by the mobile terminal width and height;
  • S205 calculates a first aspect ratio and a second aspect ratio; the first aspect ratio is equal to the width of the displayed image/the height of the displayed image, and the second aspect ratio is equal to the data stream output by the mobile terminal when receiving When , the width of the display device/the height of the display device;
  • the first aspect ratio is the aspect ratio of the displayed image
  • the second aspect ratio is the aspect ratio of the display when receiving the data stream output by the mobile terminal (that is, the aspect ratio of the display before it is not rotated);
  • the second aspect ratio is less than 1; or if the first aspect ratio is less than 1, and the second aspect ratio is greater than 1, S206 controls the rotation component to drive the display to rotate 90 degrees;
  • the specific implementation can be: if the first aspect ratio is greater than 1, the second aspect ratio is less than 1; or if the first aspect ratio is less than 1, the second aspect ratio is greater than 1; the controller can send a rotation command to the rotation component .
  • the rotating component drives the display to rotate in response to the rotating instruction. When the display rotates to 90 degrees, the rotating component stops rotating, and the corresponding display stops rotating.
  • S207 reads a third aspect ratio, where the third aspect ratio is the width and height of the display after the rotation;
  • the third width and height can be read before the display is rotated to 90 degrees.
  • the third width and height may be obtained based on the second width and height. For example, if the second width and height are 1024 and 576 respectively, then the third width and height may be 576 and 1024.
  • the controller In response to the display terminating the rotation, the controller reads a third aspect ratio, which in this application is the aspect ratio of the display after rotation.
  • the controller calculates a third aspect ratio, and the third aspect ratio is equal to the width of the display after the rotation/the height of the display;
  • the zoom factor is equal to the width of the rotated display/the width of the displayed image
  • the display images involved in this implementation are all horizontal display images or squares.
  • the display orientation of the display is the vertical display orientation.
  • FIG. 19A is a schematic diagram of a change in a display interface during screen projection according to an embodiment of the present disclosure
  • the mobile terminal transmits the data stream 10 of images 10 to the controller of the display device.
  • the controller renders the data stream 10 to obtain the image 10 .
  • the controller controls the display to display the image 10.
  • the display interface of the display can refer to interface 10-1.
  • the controller reads that the first aspect ratio is 8/3, the pixels of image 10 are 960*360; the second aspect ratio is 9/16.
  • the controller controls the rotating component to drive the display to rotate by 90.
  • the display interface of the display can refer to Interface 10-3.
  • FIG. 19B is a schematic diagram of a change in a display interface during a screen projection process according to an embodiment of the present disclosure
  • the mobile terminal transmits the data stream 10 of images 10 to the controller of the display device.
  • the controller renders the data stream 10 to obtain the image 10 .
  • the controller controls the display to display the image 10.
  • the display interface of the display can refer to interface 10-1.
  • the controller reads that the first aspect ratio is 8/3, the pixels of image 10 are 960*360; the second aspect ratio is 9/16.
  • the controller controls the rotation component to drive the display to rotate.
  • the display of the display The interface can refer to interface 10-2B; the controller controls the display to rotate to 90 degrees, and the display interface of the display can refer to interface 10-3.
  • FIG. 20 is a schematic diagram of a change of a display interface during a screen projection process according to an embodiment of the present disclosure
  • the mobile terminal transmits a data stream 11 of images 11 to the controller of the display device.
  • the controller renders the data stream 11 to obtain the image 11 .
  • the controller controls the display to display the image 11.
  • the display interface of the display can refer to interface 11-1.
  • the controller reads that the first aspect ratio is 16/9, and the pixels of image 11 are 864*486; the second aspect ratio is 9/16.
  • the controller controls the rotation component to drive the display to rotate.
  • the interface displayed by the display Please refer to interface 11-2; the controller controls the display to rotate to 90 degrees, and the display interface of the display can refer to interface 11-3.
  • the zoom factor is equal to the height of the rotated display/the height of the displayed image.
  • the display images involved in this implementation manner are all horizontal screen display images.
  • the display orientation of the display is the vertical display orientation.
  • FIG. 21 is a schematic diagram illustrating a change of a display interface during screen projection according to an embodiment of the present disclosure
  • the mobile terminal transmits the data stream 12 of images 12 to the controller of the display device.
  • the controller renders the data stream 12 to obtain the image 12 .
  • the controller controls the display to display the image 12.
  • the display interface of the display can refer to the interface 12-1.
  • the controller reads that the first aspect ratio is 4/3, and the pixels of image 12 are 480*360; the second aspect ratio is 9/16.
  • the controller controls the rotation component to drive the display to rotate.
  • the interface displayed by the display Please refer to interface 12-2; the controller controls the display to rotate to 90 degrees, and the display interface of the display can refer to interface 12-3.
  • the zoom factor is equal to the width of the rotated display/the width of the displayed image
  • the display images involved in this implementation mode are all vertical screen display images.
  • the display direction of the display is the landscape display direction.
  • FIG. 22 is a schematic diagram of a change in the display interface of the display during the screen projection process according to an embodiment of the present disclosure
  • the mobile terminal transmits a data stream 13 of images 13 to the controller of the display device.
  • the controller renders the data stream 13 to obtain the image 13 .
  • the controller controls the display to display the image 13.
  • the display interface of the display can refer to interface 13-1.
  • the controller reads that the first aspect ratio is 3/4, and the pixels of the image 13 are 360*480; the second aspect ratio is 16/9.
  • the controller controls the rotation component to drive the display to rotate.
  • FIG. 23 is a schematic diagram of a change in a display interface during a screen projection process according to an embodiment of the present disclosure
  • the mobile terminal transmits the data stream 14 of images 14 to the controller of the display device.
  • the controller renders the data stream 14 resulting in the image 14 .
  • the controller controls the display to display the image 14.
  • the display interface of the display can refer to the interface 14-1.
  • the controller reads that the first aspect ratio is 9/16, and the pixels of image 14 are 486*864; the second aspect ratio is 16/9.
  • the controller controls the rotation component to drive the display to rotate.
  • the zoom factor is equal to the height of the rotated display/the height of the displayed image.
  • the display images involved in this implementation mode are all vertical screen display images.
  • the display direction of the display is the landscape display direction.
  • FIG. 22 is a schematic diagram of a change in the display interface of the display during the screen projection process according to an embodiment of the present disclosure
  • the mobile terminal transmits a data stream 15 of images 15 to the controller of the display device.
  • the controller renders the data stream 15 to obtain the image 15 .
  • the controller controls the display to display the image 15.
  • the display interface of the display can refer to the interface 15-1.
  • the controller reads that the first aspect ratio is 3/8, the pixels of image 15 are 360*960; the second aspect ratio is 16/9.
  • the controller controls the rotation component to drive the display to rotate.
  • the interface displayed by the display Refer to interface 15-2; the controller controls the display to rotate to 90 degrees, and the display interface of the display can refer to interface 15-3.
  • S209 zooms the display image based on the zoom factor
  • the S210 controller display displays the scaled display image.
  • the display device shown in the embodiment of the present application includes: a display, a rotation component, and a controller; when the display direction of the displayed image does not match the display direction of the display, the rotation component can drive the display to rotate based on the control of the controller, so that the display of the display can be displayed.
  • the direction matches the display direction of the display image; the controller can read the third width and height after completing the rendering of the display image, and calculate the zoom factor of the display image based on the third width and height and the second width and height; and then based on the zoom factor Zoom the display image; finally, control the display to display the zoomed display image.
  • the embodiment of the present application shows a display device.
  • the controller of the display device can calculate the zoom factor of the displayed image based on the actual aspect ratio of the displayed image; and display the image based on the zoom factor. image, so that the scaled display image matches the display space of the display, and the user experience is better.
  • FIG. 25 is a flowchart showing the interaction between the mobile terminal and the display device according to an embodiment of the present disclosure. As can be seen from the figure:
  • the mobile terminal performs step S301 to send a screen projection request
  • the controller is configured to perform steps S302-S306:
  • S302 receives the data stream output by the mobile terminal
  • S303 renders the data stream to obtain a display image
  • S304 reads a first width and height and a second width and height, where the first width and height are the width and height of the display image; the second aspect ratio is when the display width and height;
  • S305 calculates a first aspect ratio and a second aspect ratio; the first aspect ratio is equal to the width of the display image/the height of the displayed image, and the second aspect ratio is equal to the width of the display device/height of the display device;
  • the second aspect ratio is greater than 1; or if the first aspect ratio is greater than or equal to 1, the second aspect ratio is greater than 1;
  • the zoom factor is equal to the width of the display/the width of the displayed image
  • the zoom factor is equal to the height/display of the display high image.
  • the zoom factor is equal to the width of the display/the width of the displayed image
  • the zoom factor is equal to the height of the display/the height of the displayed image
  • S307 zooms the display image based on the zoom factor
  • the display device shown in the embodiment of the present application includes: a display, a rotating component, and a controller; when the display direction of the display image matches the display direction of the display, the controller can read the first width and height and The second width and height are calculated based on the first width and height and the second width and height, and the zoom factor of the display image is calculated; then the display image is scaled based on the zoom factor; finally, the display image is controlled to display the zoomed display image.
  • the embodiment of the present application shows a display device. When the mobile terminal establishes contact with the display device through the screen projection function, the controller of the display device can calculate the zoom factor of the displayed image based on the actual aspect ratio of the displayed image; and display the image based on the zoom factor. image, so that the scaled display image matches the display space of the display, and the user experience is better.
  • the screen projection protocol is a data transmission protocol used between the mobile terminal 100B and the display device 200 to transmit image information, such as the Miracast protocol.
  • these protocols belong to the native protocols of the mobile terminal 100B. Due to the limitations of these native protocols, the screen projection data stream sent by the mobile terminal 100B and the screen projection data stream received by the display device 200 are both in landscape orientation, that is, the projected screen image is displayed by the display device.
  • the state when 200 is received is the state displayed on the landscape display device 200 , as shown in FIG. 26 and FIG. 27 .
  • the above-mentioned screen projection method is generally applicable to the display device 200 with a horizontal screen.
  • the content displayed on the portrait display device 200 is the reduced content of all the content displayed on the landscape display device 200, and the portrait projection image is in the
  • the projection data stream of the landscape screen has been scaled down, and it is scaled down again when displayed on the portrait screen display device again.
  • the portrait screen projection image is displayed on the portrait display device, there will be a space around the projection image.
  • the problem of black, as shown in Figure 28, leaving a large amount of black will lead to poor image display effect, thereby affecting the user's viewing experience.
  • the embodiment of the present application provides a rotatable display device 200 , which specifically includes a display 275 , a rotation component 276 and a controller 250 .
  • the display 275 can display the screen projection image sent by the mobile terminal 100B, and the rotation component 276 can be controlled by the controller 250 to drive the display 275 to rotate so that the display 275 is in a landscape display state or a portrait display state.
  • the controller 250 can detect the real image size of the screen projection image sent by the mobile terminal 100B and the current display state of the display 275; according to the real image size of the screen projection image and the current display state of the display 275, drive the display 275 to rotate to the corresponding display state , to match the picture format of the projected image; then calculate the zoom factor of the projected image according to the real image size and the display state of the display 275 ; finally, adjust the display size of the projected image on the display 275 according to the zoom factor.
  • the picture format is used to indicate whether the projected image is a portrait image or a landscape image; the controller 250 drives the display 275 to switch to a landscape display state or a portrait display state to match the display of the landscape image or the portrait image.
  • the projected image may not fully adapt to the screen size of the display 275 when displayed on the display 275 due to the different aspect ratio from the aspect ratio of the display 275. Or the problem of incomplete content displayed on the display 275.
  • the controller 250 can also calculate the actual image size of the projected image and the display state of the display 275 by calculating The zoom factor of the projected image on the display 275 in its matching display state, so that the projected image is displayed on the full screen on the display 275 according to this zoom factor, reducing the problem that the screen remains black when the projected image is displayed on the display 275.
  • the aspect ratio mentioned in the above embodiment refers to the ratio of the image width to the image height of the projected image, or the ratio of the screen width to the screen height of the display 275 .
  • the above-mentioned vertical screen projection image shown in FIG. 28 is resized and displayed on the vertical screen display 275, as shown in FIG. 29. It can be seen that the embodiment of the present application may The projected screen image displayed on the screen is scaled to an appropriate size to adapt to the display state and screen size of the display 275 to provide a better viewing experience for the user.
  • the SurfaceView display solution in order to ensure that the projected image still has good image quality after scaling processing, can also be used.
  • SurfaceView is a rendering image technology that can perform image quality processing. Compared with the TextureView display solution, using The images displayed by SurfaceView have significantly higher quality, clarity and detail.
  • the structure that can implement SurfaceView processing can be called the rendering layer. Since the processed image cannot be displayed in the rendering layer, it is also necessary to copy the projected screen image processed by the rendering layer and copy it to the displayable image.
  • the image layer can be an OSD layer, and the image displayed on the OSD layer can be adjusted in size and angle, so that when the screen aspect ratio of the projected image is different from that of the display 275, the size of the projected image can be adjusted on the OSD layer.
  • each frame of the image can be copied to the image layer in turn to detect the real image size of the image, which can ensure accurate size adjustment for each frame of image.
  • each frame of image requires a certain processing time when detecting and resizing. If the projected image is from a continuously playing video image, the sequential processing of each frame of image will inevitably lead to each frame of image. Stuttering while playing on display 275. In order to avoid this situation, in some embodiments, an interval time can also be set, so that the controller 250 obtains and copies a frame of the projected image to the image layer every few seconds, which can ensure the smoothness of playing the projected image.
  • the current display state of the display 275 may be a landscape display state or a portrait display state, but since the display device 200 is a rotatable display device at this time, even if the projected image is different from the current display state of the display device 200 Matching, it is also possible to rotate the display 275 to make the display 275 displayed in the portrait screen display the projected screen image of the portrait screen, or to make the display 275 displayed in the horizontal screen display the projected screen image of the horizontal screen.
  • the controller 250 also needs to first determine the picture format of the projected image according to the real image size of the projected image. For example, when the width of the projected image is greater than the height, it can be determined that the projected image is For a landscape image, when the width of the projected image is smaller than the height, it can be determined that the projected image is a portrait image. Then, when the projected image is a portrait image and the current display state of the display 275 is a landscape display state, drive the display 275 to rotate to a portrait display state; when the projected image is a landscape image and the current display state of the display 275 is In the case of the portrait display state, the drive display 275 is rotated to the landscape display state.
  • the display state of the display device 200 includes the following situations: the projected image is a portrait image, and the current display state of the display 275 is a landscape display state, but it becomes a portrait screen after being rotated Display state; the projected image is a landscape image, and the current display state of the display 275 is a portrait display state, but it becomes a landscape display state after being rotated; the projected image is a portrait image, and the current display state of the display 275 is a portrait display state ; The projected image is a landscape image, and the current display state of the display 275 is a landscape display state.
  • the image width and image height are Tw and Th respectively. Since the display 275 can be rotated, its screen height and screen width are different in different display states, wherein, as shown in FIG. 31 , in the horizontal screen display state of the display 275, the screen height is B h , and the screen width is B w ; As shown in FIG. 32 , in the portrait display state of the display 275 , the screen height becomes the screen width B w in the landscape display state, and the screen width becomes the screen height B h in the landscape display state.
  • the controller 250 needs to calculate the portrait projection image after the display 275 is rotated to the portrait display state.
  • the zoom factor for full screen display on display 275 can calculate the zoom factor F of the projected image according to the following formula:
  • the controller 250 needs to calculate the horizontal projection image after the display 275 is rotated to the landscape display state.
  • the zoom factor for full screen display on display 275 the controller 250 needs to detect whether the image aspect ratio T w /T h of the projected image is greater than or equal to the screen aspect ratio B w /B h in the landscape display state of the display 275 , which is used to determine when zooming , scaling is based on the width of the projected image or based on the height of the projected image;
  • the controller 250 needs to calculate the scaling factor F of the current projected image according to the following formula:
  • the controller 250 needs to calculate the zoom factor F of the current projected image according to the following formula:
  • the controller 250 does not need to control the display 275 to rotate, and directly detects the image width and height of the projected image for the above-mentioned situation that the projected image is a portrait image and the current display state of the display 275 is a portrait display state.
  • the ratio T w /T h is greater than or equal to the screen aspect ratio B w /B h in the horizontal display state of the monitor 275 is used to determine whether to zoom in or out based on the width of the projected image or the projected image when zooming
  • the height shall be scaled according to the height;
  • the vertical screen image can be understood as reducing the image displayed on the horizontal screen display 275 when it is acquired, as shown in FIG.
  • the vertical screen display 275 it can be understood that the entire display content of the horizontal screen display 275 is reduced and displayed on the vertical screen display 275, as shown in FIG. 28 .
  • the reduction factor of the portrait projection image can be regarded as the reduction factor of the display content of the landscape display 275 on the portrait display 275, that is, the height B w of the display 275 in the portrait display state /The height B h of the display 275 in the landscape display state, therefore, if it is necessary to enlarge the portrait projection image on the portrait display 275 to full screen display, it is necessary to calculate the scaling of the projection image in the portrait display 275 After the multiple, it is also multiplied by the reduction multiple of the above-mentioned projected image, the details are as follows:
  • the controller 250 needs to calculate the zoom factor F of the current screen projection image according to the following formula:
  • the controller 250 needs to calculate the scaling factor F of the current projected image according to the following formula:
  • the controller 250 does not need to control the display 275 to rotate, and directly detects the image width and height of the projected image for the above-mentioned situation that the projected image is a landscape image and the current display state of the display 275 is a landscape display state.
  • the ratio T w /T h is greater than or equal to the screen aspect ratio B w /B h in the horizontal display state of the monitor 275 is used to determine whether to zoom in or out based on the width of the projected image or the projected image when zooming
  • the height shall be scaled according to the height;
  • the zoom factor is calculated based on the width of the image, and the controller 250 needs to calculate the zoom factor F of the current projected image according to the following formula:
  • the controller 250 needs to calculate the zoom factor F of the current projected screen image according to the following formula:
  • zoom factor F the actual data result of the above-mentioned zoom factor F is greater than 1, it means that the projected image needs to be enlarged when displayed. If the data result is less than 1, it means that the projected image needs to be reduced when displayed. When zooming, the width and height of the projected image need to be manipulated at the same time.
  • the operation of calculating the zoom factor is usually performed after the controller 250 drives the display 275 to rotate, and the size adjustment of the projected image according to the zoom factor is performed when the display 275 rotates to a certain level. For example, when the display 275 is rotated 45 degrees from the landscape display state, the projected image starts to adjust the size, or when the display 275 is rotated 45 degrees from the portrait display state, the projected image starts to adjust size.
  • the rotatable display device 200 of the embodiment of the present application when it is detected for the first time that the display 275 needs to be rotated, several more detections are required.
  • the results of the multiple detections are that the display device 275 needs to be rotated to the vertical screen
  • the result of multiple detections is that the display 275 needs to be rotated to the landscape orientation before performing the rotation operation of the display 275 . If the rotation is performed only according to one detection result, but the detection result is not accurate this time, the operation of rotating the display 275 this time is also inaccurate, and multiple detections can avoid such inaccuracy and improve the fault tolerance rate. In this way, the accuracy of the rotation operation is ensured.
  • the content executable by the controller 250 may also be as shown in FIG. 33 .
  • the controller 250 detects the content of the screencast image sent by the mobile terminal 100B.
  • the display 275 determines whether the projected image is a landscape image, if so, continue to determine whether the display 275 is in a landscape display state, if the display 275 is not in a landscape display state, then drive the display 274 is rotated to the landscape display state; if the projected image is a portrait image, it is determined whether the display 275 is in the portrait display state, and if the display 275 is not in the portrait display state, the display 175 is driven to rotate to the portrait display state.
  • the controller 250 also calculates the zoom factor of the projected image when the display 275 is in different display states. and adjust the size of the projected image on the rotated display 275 according to the zoom factor, or, when the picture format of the projected image is consistent with the display state of the display 275, directly adjust the size of the projected image on the display 275 according to the zoom factor .
  • the embodiment of the present application also provides a non-rotatable display device 200, the display device 200 may include a display 275 and a controller 250; wherein, the display 275 may display a screen projection image sent by the mobile terminal 100B.
  • the controller 250 can detect the real image size of the projected screen image sent by the mobile terminal 100B and the current display state of the display 275; calculate the zoom factor of the projected screen image according to the real image size and the current display state of the display 275; finally, according to the zoom factor Adjust the display size of the projected image on the display 275 .
  • the display state is used to indicate that the display 275 is in a landscape display state or a portrait display state; the real image size of the projected image is used to determine whether the projected image is a portrait image or a landscape image.
  • the SurfaceView display scheme may also be used, and further, in some embodiments, the controller 250 may also copy the projected screen image after processing on the rendering layer to the image layer; Then detect the real image size of the projected screen image on the image layer.
  • the display state of the display device 200 includes the following situations: the projected image is a portrait image, the current display state of the display 275 is a landscape display state; the projected image is a landscape image , the current display state of the display 275 is a portrait display state; the projected image is a portrait image, and the current display state of the display 275 is a portrait display state; the projected image is a landscape image, and the current display state of the display 275 is a landscape display state.
  • the controller 250 needs to calculate the scaling factor F of the current projected image according to the following formula:
  • the controller 250 needs to detect whether the image aspect ratio T w /T h of the projected image is a vertical screen image and the current display state of the display 275 is a vertical screen display state. Greater than or equal to the screen aspect ratio B w /B h in the horizontal display state of the monitor 275 , which is used to determine whether to zoom based on the width of the projected image or the height of the projected image when scaling;
  • the vertical screen image can be understood as reducing the image displayed on the horizontal screen display 275 when it is acquired, as shown in FIG.
  • the entire display content of the horizontal screen display 275 is reduced and displayed on the vertical screen display 275 , as shown in FIG. 28 .
  • the reduction factor of the portrait projection image can be regarded as the reduction factor of the display content of the landscape display 275 on the portrait display 275, that is, the height B w of the display 275 in the portrait display state /The height B h of the display 275 in the landscape display state, therefore, if it is necessary to enlarge the portrait projection image on the portrait display 275 to full screen display, it is necessary to calculate the scaling of the projection image in the portrait display 275 After the multiple, it is also multiplied by the reduction multiple of the above-mentioned projected image, the details are as follows:
  • the controller 250 needs to calculate the zoom factor F of the current screen projection image according to the following formula:
  • the controller 250 needs to calculate the scaling factor F of the current projected image according to the following formula:
  • the controller 250 needs to detect whether the image aspect ratio T w /T h of the projected image is a landscape image and the current display state of the display 275 is a landscape display state. Greater than or equal to the screen aspect ratio B w /B h in the horizontal display state of the monitor 275 , which is used to determine whether to zoom based on the width of the projected image or the height of the projected image when scaling;
  • the controller 250 needs to calculate the scaling factor F of the current projected image according to the following formula:
  • the controller 250 needs to calculate the zoom factor F of the current projected image according to the following formula:
  • the controller 250 can calculate the zoom factor of the current projected image according to the following formula:
  • the non-rotatable display device 200 in the embodiment of the present application cannot control the display 275 to rotate according to the picture format of the projected image, and the calculation methods of the above-mentioned zoom factors are different.
  • the content is the same as the content of the embodiment of the rotatable display device 200 in the foregoing embodiment, and the foregoing content may be referred to for details, which will not be repeated here.
  • the content executable by the controller 250 may also be as shown in FIG. 34.
  • the controller 250 detects the content of the screencast image sent by the mobile terminal 100B. After the real image size and the current display state of the display 275, determine whether the projected image is a landscape image, and if so, continue to determine whether the display 275 is in a landscape display state, and calculate the projected images under different display states of the display 275 If the screen projection image is a portrait screen image, determine whether the display 275 is in a portrait screen display state, and calculate the zoom factor of the screen projection image when the display screen 275 is in a different display state.
  • the size of the projected image on the display 275 can also be directly adjusted according to the zoom factor.
  • a third display device 200 may also be provided in this embodiment of the present application.
  • different processing processes and image scaling factor calculation processes may be performed by detecting whether the display 275 is rotatable.
  • the display device 200 may include a display 275 , a rotation assembly 276 and a controller 250 .
  • the controller 250 can detect the real image size of the screen projection image sent by the mobile terminal 100B, the current display state of the display 275 and whether the display 275 can be rotated;
  • the display 275 When the display 275 is rotatable, according to the real image size of the projected image and the current display state of the display 275, the display 275 is driven to rotate to a corresponding display state to match the picture format of the projected image, and according to the real image size With the display state of the display 275, calculate the zoom factor of the projected image;
  • the display size of the projected image on the display 275 is adjusted according to the zoom factor.
  • the display device 200 is a rotatable display device, and the specific processing procedure and the calculation of the zoom factor can refer to the content of the foregoing embodiments of the rotatable display device.
  • the display device 200 can be regarded as a non-rotatable display device, and the specific processing process and the calculation of the zoom factor can refer to the content of the foregoing embodiments of the non-rotatable display device.
  • the content executable by the controller 250 may also be as shown in FIG. 35 .
  • the controller 250 detects the screen projection sent by the mobile terminal 100B. After the real image size of the image and the current display state of the display 275, it is first determined whether the display device 200 can be rotated.
  • the embodiment of the present application can calculate the zoom factor of the projected image according to the real image size and the display state of the display 275; finally, the display size of the projected image on the display 275 is adjusted according to the zoom factor.
  • the screen projection image displayed on the display device 200 can be scaled to an appropriate size to adapt to the display state and screen size of the display device 200 and provide users with better viewing experience.
  • the embodiment of the present application also provides a method for displaying a screen projection image, which is applied to the aforementioned rotatable display device 200, and the method specifically includes:
  • Step S401 detecting the real image size of the screen projection image sent by the mobile terminal 100B and the current display state of the display 275;
  • Step S402 according to the real image size of the projected image and the current display state of the display 275, drive the display 275 to rotate to a corresponding display state to match the picture format of the projected image;
  • Step S403 according to the real image size and the display state of the display 275, calculate the zoom factor of the projected image
  • Step S404 Adjust the display size of the projected image on the display 275 according to the zoom factor.
  • the method can also implement other contents that can be executed by the controller 250 in the aforementioned rotatable display device 200 .
  • the embodiment of the present application also provides another method for displaying a projected screen image, which is applied to the aforementioned non-rotatable display device 200, and the method specifically includes:
  • Step S501 detecting the real image size of the screen projection image sent by the mobile terminal 100B and the current display state of the display 275;
  • Step S502 according to the real image size and the current display state of the display 275, calculate the zoom factor of the projected image
  • Step S503 Adjust the display size of the projected image on the display 275 according to the zoom factor.
  • the method can also implement other contents that can be executed by the controller 250 in the aforementioned non-rotatable display device 200 .
  • Embodiments of the present application also provide a third method for displaying a projected screen image, which is applied to the aforementioned third display device 200, and the method specifically includes:
  • Step S601 detecting the real image size of the projected image sent by the mobile terminal 100B, the current display state of the display 275, and whether the display 275 can be rotated;
  • Step S602 when the display 275 is rotatable, according to the real image size of the projected image and the current display state of the display 275, drive the display 275 to rotate to a corresponding display state to match the image format of the projected image, and, according to The real image size and the display state of the display 275, and the scaling factor of the projected image is calculated;
  • Step S603 in the case that the display 275 cannot be rotated, according to the real image size and the current display state of the display 275, calculate the zoom factor of the projected image;
  • Step S604 Adjust the display size of the projected image on the display 275 according to the zoom factor.
  • the method can also implement other contents that can be executed by the controller 250 in the aforementioned third display device 200 .
  • the present invention also provides a computer-readable non-volatile storage medium, wherein the computer storage medium can store a program, and when the program is executed, it can include all the steps of the method for adjusting the shooting angle of the camera provided by the present invention. some or all of the steps in the examples.
  • the storage medium can be a magnetic disk, an optical disc, a read-only memory (English: read-only memory, abbreviated: ROM) or a random access memory (English: random access memory, abbreviated: RAM), etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

本申请实施例提供的显示设备包括:显示器和控制器;其中,控制器在完成展示图像的渲染后,读取第一宽高和第二宽高,并基于第一宽高和第二宽高计算出展示图像的缩放倍数;而后基于缩放倍数缩放展示图像;最后,控制显示器展示缩放后的展示图像。

Description

一种显示设备
本申请要求在2020年11月23日提交、申请号为202011319998.3、名称为“投屏图像的显示方法及显示设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中;要求在2020年11月23日提交、申请号为202011319699.X、名称为“一种显示设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中
技术领域
本申请涉及电视技术领域,尤其涉及一种显示设备。
背景技术
智能电视拥有独立的操作系统,并支持功能扩展。可以根据用户需要在智能电视中安装各种应用程序,例如,传统视频应用、短视频等社交应用以及漫画、看书等阅读应用。这些应用可利用智能电视的屏幕展示应用画面,为智能电视提供丰富的媒体资源。同时,智能电视还可以与不同的终端进行数据交互和资源共享。例如,智能电视可以通过局域网、蓝牙等无线通信方式与手机连接,从而播放手机中的资源或者直接进行投屏显示手机上的画面。
发明内容
本申请实施例示出一种显示设备。
本申请实施例第一方面示出一种显示设备,包括:
显示器;
控制器,被配置为执行:
响应于所述移动端发送的投屏请求,接收所述移动端输出的数据流;
渲染所述数据流得到展示图像;
读取第一宽高和第二宽高,所述第一宽高为所述展示图像的宽和高,所述第二宽高为所述显示器的宽和高;
根据第一宽高与第二宽高的关系,计算所述展示图像的缩放倍数;
基于所述缩放倍数缩放所述展示图像;
控制所述显示器展示缩放后的展示图像。
附图说明
图1A为根据本申请实施方式的显示设备的应用场景图;
图1B为根据本申请实施方式的显示设备的后视图;
图2为根据本申请实施方式的控制装置的硬件配置框图;
图3为根据本申请实施方式的显示设备的硬件配置框图;
图4为根据本申请实施方式的显示设备存储器中操作系统的架构配置框图;
图5A为根据本申请实施方式的横屏展示方向媒资的示意图;
图5B为根据本申请实施方式的竖屏展示方向媒资的示意图;
图6为根据本公开实施方式示出的显示器展示出的界面的示意图;
图7为根据本公开实施方式示出的显示器展示出的界面的示意图;
图8为根据本公开实施方式示出移动终端与显示设备的交互流程图;
图9为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
图10为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
图11为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
图12为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
图13为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
图14为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
图15为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
图16为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
图17为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
图18为根据本公开实施方式示出移动终端与显示设备的交互流程图;
图19A为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
图19B为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
图20为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
图21为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
图22为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
图23为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
图24为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
图25为根据本公开实施方式示出移动终端与显示设备的交互流程图;
图26为本申请示出的移动终端竖屏时投屏在显示设备上的投屏示意图;
图27为本申请示出的移动终端横屏时投屏在显示设备上的投屏示意图;
图28为本申请示出的移动终端竖屏时的投屏数据流在竖屏显示设备上显示的示意图;
图29为本申请示出的一种尺寸调整后竖屏的投屏图像在竖屏显示设备上显示的示意图;
图30A为本申请示出的一种投屏图像的示意图;
图30B为本申请示出的另一种投屏图像的示意图;
图31为本申请示出的一种显示设备的示意图;
图32为本申请示出的另一种显示设备的示意图;
图33为本申请示出的一种显示设备中控制器的处理过程示意图;
图34为本申请示出的另一种显示设备中控制器的处理过程示意图;
图35为本申请示出的第三种显示设备中控制器的处理过程示意图。
具体实施方式
为了使本技术领域的人员更好地理解本申请中的实施方式,下面将结合本申请实施例中的附图,对本申请实施例进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本申请保护的范围。
旋转电视是一种新型智能电视,主要包括显示器和旋转组件。其中,显示器通过 旋转组件连接在支架或墙壁上,可通过旋转组件调节显示器放置角度,达到旋转的目的。不同的显示器放置角度可以适应不同宽高比的动画页面,例如,多数情况下显示器横向放置,以显示宽高比为16:9的电影、电视剧等视频页面。当视频页面的宽高比为9:16的短视频、漫画等页面时,横向放置的显示器需要对页面进行缩放,且在显示器的两侧显示黑色区域。因此,可以通过旋转组件将显示器竖向放置,以适应9:16比例的视频页面。
旋转电视所支持的应用众多,为了方便用户观看,可以通过设置启动方式,指定电视的开机信号源。例如,为了获得传统电视的观影体验,可以设置电视的开机信号源为直播信号,使电视开机后直接进入直播状态。用户可以通过设置程序将开机信号源设置为任一应用程序。由于不同的应用所支持的显示器姿态不同,因此电视在开机时的姿态要与作为开机信号源的应用相适应,才能正常显示开机信号源应用对应的页面。
但用户在观看电视时,会根据需要对旋转电视的显示器姿态进行调整,并在关机时仍然保持在调整后的姿态。例如,用户在通过电视观看短视频或漫画时,会通过切换屏幕至竖向放置的状态,并在竖向放置的状态下关机。则在用户下一次开机时,屏幕的姿态为竖向放置状态,如果设定开机信号源为仅支持横向放置状态的应用,则出现屏幕姿态与开机信号源应用不匹配,无法正确显示。因此,本申请提供一种显示设备及应用界面的显示方法。
为方便用户在显示器不同的横竖屏展示方向展示目标媒资详情页,便于提升显示设备在不同观看状态时的用户观看体验,本申请实施例提供了一种显示设备、详情页展示方法及计算机存储介质,显示设备如旋转电视。需要说明的是,本实施例提供的方法不仅适用于旋转电视,还适用于其它显示设备,如计算机、平板电脑等。
本申请各实施例中使用的术语“遥控器”,是指电子设备(如本申请中公开的显示设备)的一个组件,该组件通常可在较短的距离范围内无线控制电子设备。该组件一般可以使用红外线和/或射频(RF)信号和/或蓝牙与电子设备连接,也可以包括WiFi、无线USB、蓝牙、动作传感器等功能模块。例如:手持式触摸遥控器,是以触摸屏中用户界面取代一般遥控装置中的大部分物理内置硬键。
本申请各实施例中使用的术语“手势”,是指用户通过一种手型的变化或手部运动等动作,用于表达预期想法、动作、目的/或结果的用户行为。
参见图1A,为本申请一些实施例提供的一种显示设备的应用场景图。如图1A所示,控制装置100和显示设备200之间可以有线或无线方式进行通信。
其中,控制装置100被配置为控制显示设备200,其可接收用户输入的操作指令,且将操作指令转换为显示设备200可识别和响应的指令,起着用户与显示设备200之间交互的中介作用。如:用户通过操作控制装置100上频道加减键,显示设备200响应频道加减的操作。
控制装置100可以是遥控器100A,包括红外协议通信或蓝牙协议通信,及其他短距离通信方式等,通过无线或其他有线方式来控制显示设备200。用户可以通过遥控器上按键、语音输入、控制面板输入等输入用户指令,来控制显示设备200。
控制装置100也可以是智能设备,如移动终端100B、平板电脑、计算机、笔记本电脑等。例如,使用在智能设备上运行的应用程序控制显示设备200。该应用程序通 过配置可以在与智能设备关联的屏幕上,通过直观的用户界面(UI)为用户提供各种控制。
移动终端100B可与显示设备200安装软件应用,通过网络通信协议实现连接通信,实现一对一控制操作的和数据通信的目的。如:可以使移动终端100B与显示设备200建立控制指令协议,通过操作移动终端100B上提供的用户界面的各种功能键或虚拟控件,来实现如遥控器100A布置的实体按键的功能。也可以将移动终端100B上显示的音视频内容传输到显示设备200上,实现同步显示功能。
显示设备200还与服务器300通过多种通信方式进行数据通信。这里可允许显示设备200通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。
在一些实施例中,如图1B所示,显示设备200包括旋转组件,控制器250,显示器275,从背板上空隙处伸出的端子接口以及和背板连接的旋转组件276,旋转组件276可以使显示器275进行旋转。从显示设备正面观看的角度,旋转组件276可以将显示屏旋转到竖屏展示方向,即屏幕竖向的边长大于横向的边长的状态,也可以将屏幕旋转至横屏展示方向,即屏幕横向的边长大于竖向的边长的状态。
图2中示例性提供了控制装置100的配置框图。如图2所示,控制装置100包括控制器110、存储器120、通信器130、用户输入接口140、用户输出接口150、供电电源160。
控制器110包括随机存取存储器(RAM)111、只读存储器(ROM)112、处理器113、上电接口以及通信总线。控制器110用于控制装置100的运行和操作,以及内部各部件之间的通信协作、外部和内部的数据处理功能。
当检测到用户按压在遥控器100A上布置的按键的交互或触摸在遥控器100A上布置的触摸面板的交互时,控制器110可控制产生与检测到的交互相应的信号,并将该信号发送到显示设备200。
存储器120,用于在控制器110的控制下存储驱动和控制装置100的各种运行程序、数据和应用。存储器120,可以存储用户输入的各类控制信号指令。
通信器130在控制器110的控制下,实现与显示设备200之间控制信号和数据信号的通信。如:控制装置100经由通信器130将控制信号(例如触摸信号或控件信号)发送至显示设备200上,控制装置100可经由通信器130接收由显示设备200发送的信号。通信器130可以包括红外信号接口131和射频信号接口132。
用户输入接口140,可包括麦克风141、触摸板142、传感器143、按键144等中至少一者,从而用户可以通过语音、触摸、手势、按压等将关于控制显示设备200的用户指令输入到控制装置100。
用户输出接口150,通过将用户输入接口140接收的用户指令输出至显示设备200,或者,输出由显示设备200接收的图像或语音信号。这里,用户输出接口150可以包括LED接口151、产生振动的振动接口152、输出声音的声音输出接口153和输出图像的显示器154等。例如,遥控器100A可从用户输出接口150接收音频、视频或数据等输出信号,并且将输出信号在显示器154上显示为图像形式、在声音输出接口153输出为音频形式或在振动接口152输出为振动形式。
供电电源160,用于在控制器110的控制下为控制装置100各元件提供运行电力支持。形式可以为电池及相关控制电路。
图3中示例性提供了显示设备200的硬件配置框图。如图3所示,显示设备200中可以包括调谐解调器210、通信器220、检测器230、外部装置接口240、控制器250、存储器260、用户接口265、视频处理器270、显示器275、音频处理器280、音频输出接口285、供电电源290。
图1B中,示例性提供了旋转组件276可以包括驱动电机、旋转轴等部件。其中,驱动电机可以连接控制器250,受控制器250的控制输出旋转角度;旋转轴的一端连接驱动电机的动力输出轴,另一端连接显示器275,以使显示器275可以通过旋转组件276固定安装在墙壁或支架上。
旋转组件276还可以包括其他部件,如传动部件、检测部件等。其中,传动部件可以通过特定传动比,调整旋转组件276输出的转速和力矩,可以为齿轮传动方式;检测部件可以由设置在旋转轴上的传感器组成,例如角度传感器、姿态传感器等。这些传感器可以对旋转组件276旋转的角度等参数进行检测,并将检测的参数发送给控制器250,以使控制器250能够根据检测的参数判断或调整显示设备200的状态。实际应用中,旋转组件276可以包括但不限于上述部件中的一种或多种。
调谐解调器210,通过有线或无线方式接收广播电视信号,可以进行放大、混频和谐振等调制解调处理,用于从多个无线或有线广播电视信号中解调出用户所选择的电视频道的频率中所携带的音视频信号,以及附加信息(例如EPG数据)。
在其他一些示例性实施例中,调谐解调器210也可在外部设备中,如外部机顶盒等。这样,机顶盒通过调制解调后输出电视信号,经过外部装置接口240输入至显示设备200中。
通信器220,是用于根据各种通信协议类型与外部设备或外部服务器进行通信的组件。例如显示设备200可将内容数据发送至经由通信器220连接的外部设备,或者,从经由通信器220连接的外部设备浏览和下载内容数据。通信器220可以包括WIFI模块221、蓝牙模块222、有线以太网模块223等网络通信协议模块或近场通信协议模块,从而通信器220可根据控制器250的控制接收控制装置100的控制信号,并将控制信号实现为WIFI信号、蓝牙信号、射频信号等。
检测器230,是显示设备200用于采集外部环境或与外部交互的信号的组件。检测器230可以包括声音采集器231,如麦克风,可以用于接收用户的声音,如用户控制显示设备200的控制指令的语音信号;或者,可以采集用于识别环境场景类型的环境声音,实现显示设备200可以自适应环境噪声。
检测器230,还可以包括图像采集器232,如相机、摄像头等,可以用于采集外部环境场景,以自适应变化显示设备200的显示参数;以及用于采集用户的属性或与用户交互手势,以实现显示设备与用户之间互动的功能。
检测器230,还可以包括温度传感器,如通过感测环境温度,显示设备200可自适应调整图像的显示色温。
外部装置接口240,是提供控制器250控制显示设备200与外部设备间数据传输的组件。外部装置接口240可按照有线/无线方式与诸如机顶盒、游戏装置、笔记本电脑等外部设备连接,可接收外部设备的诸如视频信号(例如运动图像)、音频信号(例如音乐)、附加信息(例如EPG)等数据。
其中,外部装置接口240可以包括:高清多媒体接口(HDMI)端子241、复合视 频消隐同步(CVBS)端子242、模拟或数字分量端子243、通用串行总线(USB)端子244、组件(Component)端子(图中未提供)、红绿蓝(RGB)端子(图中未提供)等任一个或多个。
控制器250,通过运行存储在存储器260上的各种软件控制程序(如操作系统和各种应用程序),来控制显示设备200的工作和响应用户的操作。
如图3所示,控制器250包括随机存取存储器(RAM)251、只读存储器(ROM)252、图形处理器253、处理器254、上电接口255、以及通信总线256。其中,RAM251、ROM252以及图形处理器253、处理器254上电接口255通过通信总线256相连接。
图形处理器253,用于产生各种图形对象,如图标、操作菜单、以及用户输入指令显示图形等。
处理器254,用于执行存储在存储器260中的操作系统和应用程序指令。以及根据接收的用户输入指令,来执行各种应用程序、数据和内容的处理,以便最终显示和播放各种音视频内容。
上电接口255,可包括第一接口到第n接口。这些接口可以是经由网络被连接到外部设备的网络接口。
控制器250可以控制显示设备200的整体操作。例如:响应于接收到用于选择在显示器275上显示的GUI对象的用户输入命令,控制器250便可以执行与由用户输入命令选择的对象有关的操作。
存储器260,用于存储驱动和控制显示设备200运行的各种类型的数据、软件程序或应用程序。存储器260可以包括易失性和/或非易失性存储器。而术语“存储器”包括存储器260、控制器250的RAM251和ROM252、或显示设备200中的存储卡。
存储器260具体用于存储驱动显示设备200中控制器250的运行程序;存储显示设备200内置的和用户从外部设备下载的各种应用程序;存储用于配置由显示器275提供的各种GUI、与GUI相关的各种对象及用于选择GUI对象的选择器的视觉效果图像等数据。存储器260具体存储用于表示操作系统(OS)的软件和/或程序。
图4中示例性提供了显示设备200存储器中操作系统的架构配置框图。该操作系统架构从上到下依次是应用层、中间件层和内核层。
图3中,用户接口265,接收各种用户交互。具体的,用于将用户的输入信号发送给控制器250,或者,将从控制器250的输出信号传送给用户。
用户可在显示器275上显示的图形用户界面(GUI)输入用户命令,则用户接口265通过GUI接收用户输入命令。确切的说,用户接口265可接收用于控制选择器在GUI中的位置以选择不同的对象或项目的用户输入命令。
或者,用户可通过输入特定的声音或手势进行输入用户命令,则用户接口265通过传感器识别出声音或手势,来接收用户输入命令。
视频处理器270,用于接收外部的视频信号,根据输入信号的标准编解码协议,进行视频数据处理,可得到直接在显示器275上显示或播放的视频信号。
显示格式化模块,用于将帧率转换模块输出的信号,改变为符合诸如显示器显示格式的信号,如将帧率转换模块输出的信号进行格式转换以输出RGB数据信号。
显示器275,用于接收源自视频处理器270输入的图像信号,进行显示视频内容、图像以及菜单操控界面。显示器275可以是一种投影显示器,还可以包括一种投影装 置和投影屏幕。
旋转组件276,控制器250可以发出控制信号使旋转组件276旋转显示器275。
音频处理器280,用于接收外部的音频信号,根据输入信号的标准编解码协议,进行音频数据处理,得到可以在麦克风286中播放的音频信号。
音频输出接口285,用于在控制器250的控制下接收音频处理器280输出的音频信号,音频输出接口285可包括麦克风286,或输出至外接设备的发生装置的外接音响输出端子287,如耳机输出端子。
视频处理器270可以包括一个或多个芯片组成。音频处理器280,也可以包括一个或多个芯片组成。
供电电源290,用于在控制器250的控制下,将外部电源输入的电力为显示设备200提供电源供电支持。供电电源290可以是安装在显示设备200内部的内置电源电路,也可以是安装在显示设备200外部的电源。
由于本申请提供的显示设备200,包括显示器275和旋转组件276,旋转组件276可以带动显示器275进行旋转,以使显示器275为不同的展示方向。因此,在一种实现方式中,展示方向可以包括横屏展示方向和竖屏展示方向。其中,横屏展示方向是指,从显示器275正面观看时,显示器275水平方向上的长度(宽)大于竖直方向上的长度(高)的展示方向;竖屏展示方向是指,从显示器275正面观看时,显示器275水平方向上的长度(宽)小于竖直方向上的长度(高)的展示方向。
显然,受显示设备200安装/放置位置的影响,竖直方向在本申请中是指大致竖直,水平方向也是指大致水平即可。横屏展示方向主要用于显示电视剧、电影等横向媒资如图5A所示。显示器275为横屏展示方向时的操作模式可以称为横屏媒资观看模式,显示器275为竖屏展示方向时的操作模式可以称为竖屏媒资观看模式。显示设备200中的控制器250进一步与服务器300通信连接,用于调用服务器300的接口,获取相应数据。该显示设备200中的显示器275能够被旋转组件276驱动旋转,并用于显示用户界面。在实际应用中,用户可通过控制装置100来控制显示设备200的播放模式、播放内容等,其中,播放模式包括横屏媒资观看模式和竖屏媒资观看模式。
竖屏展示方向主要用于显示短视频、漫画等竖向媒资,如图5B所示。在竖屏展示方向下,显示器275可以显示竖屏展示方向对应的用户界面,并拥有竖屏展示方向相对应的界面布局和交互方式。在竖屏媒资观看模式下,用户可以观看短视频、漫画等竖屏媒资。同理,由于显示设备200中的控制器250进一步与服务器300通信连接,因此可以在竖屏展示方向时,通过调用服务器300的接口,获取竖屏相应的媒资数据。
竖屏展示方向更适合播放页面比例为9:16等竖屏形式的媒资,例如,通过手机等终端拍摄的短视频等。由于手机等终端设备多采用9:16,9:18等竖向屏幕比例,因此在终端接入显示设备200,并通过显示设备200显示终端页面时,竖屏展示方向能够避免对页面进行过渡缩放,充分利用显示器275的应用页面,拥有更好的用户体验。
需要说明的是,上述横屏展示方向和竖屏展示方向只是两种不相同的显示器275展示方向,并不对显示的内容构成限制,例如,在横屏展示方向下依然可以显示短视频、漫画等竖向媒资;在竖屏展示方向下也依然可以显示电视剧、电影等横向媒资,只是在该展示方向需要对不相符的显示窗口进行压缩、调整。
用户在使用显示设备200时,会根据用户的观影需要,调整显示器275的展示方向。例如可以通过控制装置100上的旋转键、或者在UI界面上选中旋转选项、或者通过语音系统输入“旋转”相关语音发出旋转指令后,控制器250则会根据旋转指令控制旋转组件276进行转动,以驱动显示器275进行旋转。例如,用户想通过显示设备200观看短视频时,可以通过上述方式中的一种输入旋转指令,使横屏展示方向下的显示器275逆时针旋转90度至竖屏展示方向,从而适应短视频等竖向应用的图像比例。
显示设备可以与不同的终端进行数据交互和资源共享。例如,显示设备可以通过局域网、蓝牙等无线通信方式与移动终端连接,从而播放移动终端中的资源或者直接进行投屏显示手机上的画面。
市面上常用的移动终端采用的系统为IOS系统或Android系统。采用IOS系统的移动终端与显示设备通过Airplay协议通信,采用Android系统的移动终端与显示设备通过Miracast协议通信,本申请主要针对Android系统的移动终端。移动设备显示屏上展示的内容可以通过投屏的功能镜像到显示设备的显示器上,具体的实现过程可以为,移动终端将展示的内容以数据流的形式发送给显示设备,显示设备通过识别该数据流为横屏数据流还是竖屏数据流,来确对数据流渲染出的图片的缩放倍数。举例说明,显示设备(竖屏展示的显示设备)接收到一横屏数据流,显示设备尽可能大的展示基于数据流渲染出的图像,最终,显示器展示出的界面可以参阅图6。对于采用Android系统的移动终端而言,如果移动终端将相册内的图像投屏到显示设备时,无论图像是横向图像还是纵向图像,移动终端均以横屏数据流的形式传输至显示设备。举例说明,显示设备(竖屏展示的显示设备)接收到一横屏数据流(该数据流渲染出的图像为竖向图像),最终,显示器展示出的界面可以参阅图7,从图7中可以看出,显示器上的区域A,区域B、区域C、以及区域D没有得到合理的利用。
考虑上述技术问题,本申请实施例第一方面示出一种显示设备,显示设备至少包括显示器和控制器。显示设备与移动终端的交互过程可以参阅图8,图8为根据本公开实施方式示出移动终端与显示设备的交互流程图,从图中可以看出:
移动终端执行步骤S101发送投屏请求;
当用户需要将移动终端上的内容投屏到显示器上时,用户可通过移动终端触发投屏功能。具体的实现方式可以为:用户通过触发移动终端上投屏控件。响应于用户对投屏控件的触控,移动终端发送投屏请求。在实际应用的过程中,可以采用其他方式触发移动终端发送投屏请求,在此申请人不做过多的限定。
本实施例中,投屏请求中携带有移动终端当前展示图像的数据流。其中,当前展示图像可以是但不限于视频的帧画面、应用的界面、相册内的图片等。控制器,被配置为执行步骤S102~S107:
S102接收移动端输出的数据流;
其中,接收移动端输出的数据流的实现方式可以采用本领域惯用的数据接收方式,在此申请人不做过多的限定。
S103渲染数据流得到展示图像;
其中,渲染数据流得到展示图像的实现方式可以采用本领域惯用的图像渲染方式,在此申请人不做过多的限定。
S104读取第一宽高和第二宽高,所述第一宽高为所述展示图像的宽和高,所述第二宽高为所述显示器的宽和高;
具体的实现过程可以是,控制器通过读取展示图像的像素来确定展示图像的宽高比。举例说明,在本公开实施方式中,展示图像的像素为1024*576,该图像的宽高比为1024/576=16/9。
S105根据第一宽高与第二宽高的关系,计算所述展示图像的缩放倍数;
在本公开实施方式中,控制器可以通过执行步骤S11-S12来生成缩放倍数。
S11计算第一宽高和第二宽高比,所述第一宽高比等于展示图像的宽/展示图像的高,所述第二宽高比等于显示设备的宽/显示设备的高;
在本公开实施方式中,控制器可以分别读取显示器的宽以及显示器的高,然后,基于显示器的宽和显示器的高来计算第二宽高比。举例说明,在本公开实施方式中,控制器读取到显示的宽为1024,显示器的高为576,控制器计算第二宽高比为16/9。
由于显示器的宽高是一个定值,因此,在一些可行性实施例中,控制器可以直接将显示器的宽高存储。当控制器需要读取第二宽高比时,控制器可以直接调取显示器的宽高。
本实施例仅是实例性的介绍两种宽高比的读取方式,在实际应用的过程中,可以采用其他的方式读取第二宽高比,在此申请人不做过多的限定。
S12根据第一宽高比与第二宽高比的关系,计算展示图像的缩放倍数。
根据第一宽高比与第二宽高比的关系,计算展示图像的缩放倍数的实现方式有多种。
例如:在数据流为横屏数据流,第一宽高比大于或等于1的情况下;如果第一宽高比小于或等于第二宽高比,则缩放倍数等于显示器的高/展示图像的高。
下面结合具体的实施例对实现方式作以详细的说明:本实现方式中涉及的展示图像均为横屏展示图像。
实施例1:
请参阅图9,图9为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
移动终端将图像1的数据流1传输至显示设备的控制器。控制器渲染数据流1得到图像1。控制器控制显示器展示图像1,此时显示器的展示界面可以参阅界面1-1。控制器读取第一宽高比为4/3,图像1的像素为480*360;第二宽高比为16:9,显示器的像素为1024*576。控制器计算出缩放倍数等于显示器的高/展示图像的高=576/360;控制器将图像1放大576/360倍,控制显示器展示放大后的图像1,此时显示器的展示界面可以参阅界面1-2。
实施例2:
请参阅图10,图10为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
移动终端将图像2的数据流2传输至显示设备的控制器。控制器渲染数据流2得到图像2。控制器控制显示器展示图像2,此时显示器的展示界面可以参阅界面2-1。控制器读取第一宽高比为16/9,图像2的像素为864*486;第二宽高比为16:9,显示器的像素为1024*576。控制器计算出缩放倍数等于显示器的高/展示图像的高=576/486;控制器将图像2放大576/486倍,控制显示器展示放大后的图像2,此时显示器的展示界面可以参阅界面2-2。
实施例3:
请参阅图11,图11为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
移动终端将图像3的数据流3传输至显示设备的控制器。控制器渲染数据流3得到图像3。控制器控制显示器展示图像3,此时显示器的展示界面可以参阅界面3-1。控制器读取第一宽高比为1/1,图像3的像素为360*360;第二宽高比为16:9,显示器的像素为1024*576。控制器计算出缩放倍数等于显示器的高/展示图像的高=576/360;控制器将图像3放大576/360倍,控制显示器展示放大后的图像3,此时显示器的展示界面可以参阅界面3-2。
再例如:在数据流为横屏数据流,第一宽高比大于或等于1的情况下;如果第一宽高比大于或等于第二宽高比,则缩放倍数等于显示器的宽/展示图像的宽;
下面结合具体的实施例对实现方式作以详细的说明:本实现方式中涉及的展示图像均为横屏展示图像。
实施例4:
请参阅图12,图12为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
移动终端将图像4的数据流4传输至显示设备的控制器。控制器渲染数据流4得到图像4。控制器控制显示器展示图像4,此时显示器的展示界面可以参阅界面4-1。控制器读取第一宽高比为4/3,图像4的像素为480*360;第二宽高比为9/16,显示器的像素为576*1024。控制器计算出缩放倍数等于显示器的宽/展示图像的宽=576/360;控制器将图像4放大576/360倍,控制显示器展示放大后的图像4,此时显示器的展示界面可以参阅界面4-2。
实施例5:
请参阅图13,图13为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
移动终端将图像5的数据流5传输至显示设备的控制器。控制器渲染数据流5得到图像5。控制器控制显示器展示图像5,此时显示器的展示界面可以参阅界面5-1。控制器读取第一宽高比为8/3,图像4的像素为960*360;第二宽高比为16/9,显示器的像素为1024*576。控制器计算出缩放倍数等于显示器的宽/展示图像的宽=576/360;控制器将图像6放大576/360倍,控制显示器展示放大后的图像5,此时显示器的展示界面可以参阅界面5-2。
再例如,当数据流为横屏数据流,第一宽高比小于1时;如果第一宽高比小于或等于第二宽高比,则缩放倍数等于显示器的高/展示图像的高。
下面结合具体的实施例对实现方式作以详细的说明:本实现方式中涉及的展示图像均为竖屏展示图像。
实施例6:
请参阅图14,图14为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
移动终端将图像6的数据流6传输至显示设备的控制器。控制器渲染数据流6得到图像6。控制器控制显示器展示图像6,此时显示器的展示界面可以参阅界面6-1。控制器读 取第一宽高比为3/4,图像6的像素为360*480;第二宽高比为16/9,显示器的像素为1024*576。控制器计算出缩放倍数等于显示器的高/展示图像的高=576/480;控制器将图像6放大576/480倍,控制显示器展示放大后的图像6,此时显示器的展示界面可以参阅界面6-2。
实施例7:
请参阅图15,图15为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
移动终端将图像7的数据流6传输至显示设备的控制器。控制器渲染数据流7得到图像7。控制器控制显示器展示图像7,此时显示器的展示界面可以参阅界面7-1。控制器读取第一宽高比为9/16,图像7的像素为486*864;第二宽高比为9/16,显示器的像素为576*1024。控制器计算出缩放倍数等于显示器的高/展示图像的高=1024/864;控制器将图像7放大1024/864倍,控制显示器展示放大后的图像7,此时显示器的展示界面可以参阅界面7-2。
再例如,在数据流为横屏数据流,第一宽高比小于1情况下;如果第一宽高比大于或等于第二宽高比,则缩放倍数等于显示器的宽/展示图像的宽;
下面结合具体的实施例对实现方式作以详细的说明:本实现方式中涉及的展示图像均为竖屏展示图像。
实施例8:
请参阅图16,图16为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
移动终端将图像8的数据流8传输至显示设备的控制器。控制器渲染数据流8得到图像8。控制器控制显示器展示图像8,此时显示器的展示界面可以参阅界面8-1。控制器读取第一宽高比为3/4,图像8的像素为360*480;第二宽高比为9/16,显示器的像素为576*1024。控制器计算出缩放倍数等于显示器的宽/展示图像的宽=576/360;控制器将图像8放大576/360倍,控制显示器展示放大后的图像8,此时显示器的展示界面可以参阅界面8-2。
再例如,在数据流为竖屏数据流的情况下,如果第一宽高比小于第二宽高比,则缩放倍数等于显示器的高/展示图像的高。
下面结合具体的实施例对实现方式作以详细的说明:本实现方式中涉及的展示图像均为竖屏展示图像。
实施例9:
请参阅图17,图17为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
移动终端将图像9的数据流9传输至显示设备的控制器。控制器渲染数据流9得到图像8。控制器控制显示器展示图像8,此时显示器的展示界面可以参阅界面9-1。控制器读取第一宽高比为3/8,图像9的像素为360*960;第二宽高比为9/16,显示器的像素为576*1024。控制器计算出缩放倍数等于显示器的高/展示图像的高=1024/960;控制器将图像9放大1024/960倍,控制显示器展示放大后的图像9,此时显示器的展示界面可以参阅界面9-2。
再例如,在数据流为竖屏数据流的情况下,如果第一宽高比大于或等于第二宽高比, 则缩放倍数等于显示器的宽/展示图像的宽;
具体的示例可以参阅实施例8,在此便不赘述。
S106基于缩放倍数缩放展示图像;
如果要实现自适应镜像画面的放缩效果,首先需要确认要使用哪种方式进行视频显示,我们在此选用的是TextureView的显示方案,使用此方案的优点是,获取图像数据帧方便并且放缩更加容易,方便我们对视频画面进行放缩处理,已达到更好的显示效果。
S107控制显示器展示缩放后的展示图像。
本申请实施例示出的显示设备包括:显示器和控制器;其中,控制器在完成展示图像的渲染后,读取第一宽高和第二宽高,并基于第一宽高和第二宽高计算出展示图像的缩放倍数;而后基于缩放倍数缩放展示图像;最后,控制显示器展示缩放后的展示图像。本申请实施例示出显示设备,当移动终端通过投屏功能与显示设备建立联系时,显示设备的控制器可以基于展示图像实际的宽高比,计算出该图像的缩放倍数;并基于缩放倍数展示图像,以使缩放后的展示图像与显示器的展示空间匹配,用户体验感较好。
为了解决上述技术问题,本申请实施例第二方面示出一种显示设备,显示设备至少包括显示器、旋转组件和控制器。显示设备与移动终端的交互过程可以参阅图18,图18为根据本公开实施方式示出移动终端与显示设备的交互流程图,从图中可以看出:
移动终端执行步骤S201发送投屏请求;
发送投屏请求的实现方式可以参阅上述实例,在此便不赘述。
控制器,被配置为执行步骤S202~S209:
响应于移动端发送的投屏请求,S202接收移动端输出的数据流;
其中,接收数据流的实现方式可以参阅上述实施例,在此便不赘述。
S203渲染数据流得到展示图像;
其中渲染展示图像的实现方式可以采用本领域惯用的渲染方式,在此申请人不做过多的限定。
S204读取第一宽高和第二宽高,所述第一宽高为所述展示图像的宽和高;所述第二宽高为当接收所述移动端输出的数据流时,显示器的宽和高;
S205计算第一宽高比和第二宽高比;所述第一宽高比等于展示图像的宽/展示图像的高,所述第二宽高比等于当接收所述移动端输出的数据流时,显示设备的宽/显示设备的高;
本申请中第一宽高比为展示图像的宽高比;第二宽高比为当接收移动端输出的数据流时,显示器的宽高比(即未旋转之前显示器的宽高比);
如果第一宽比高大于1,第二宽高比小于1;或如果第一宽高小于1,第二宽高比大于1,S206控制旋转组件带动显示器旋转90度;
具体的实现方式可以为:如果第一宽比高大于1,第二宽高比小于1;或如果第一宽高小于1,第二宽高比大于1;控制器可以发送旋转指令至旋转组件。旋转组件响应于旋转指令,带动显示器旋转,当显示器旋转至90度时,旋转组件停止旋转,相应的显示终止旋转。
S207读取第三宽高,所述第三宽高比为旋转后所述显示器的宽和高;
其中,读取第三宽高可以在显示器旋转到90度之前。具体的,可以基于第二宽高获得第三宽高。举例说明,第二宽高分别为1024和576,那么第三宽高可以为576和1024。
响应于显示器终止旋转,控制器读取第三宽高比,本申请中第三宽高比为旋转后显示器的宽高比。
S208根据第一宽高与第三宽高的关系,计算所述展示图像的缩放倍数;
控制器计算第三宽高,所述第三宽高比等于旋转后所述显示器的宽/显示器的高;
根据第一宽高与第三宽高的关系,计算展示图像的缩放倍数的实现方式有多种。
例如:在第一宽高比大于1的情况下,如果第一宽高比大于或等于第三宽高比,则缩放倍数等于旋转后显示器的宽/展示图像的宽;
下面结合具体的实施例对实现方式作以详细的说明:本实现方式中涉及的展示图像均为横屏展示图像或正方形。在接收到数据流时,显示器的展示方向为竖屏展示方向。
实施例10:
请参阅图19A,图19A为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
移动终端将图像10的数据流10传输至显示设备的控制器。控制器渲染数据流10得到图像10。控制器控制显示器展示图像10,此时显示器的展示界面可以参阅界面10-1。控制器读取第一宽高比为8/3,图像10的像素为960*360;第二宽高比为9/16。控制器控制旋转组件带动显示器旋转90,此时显示器展示的界面可以参阅界面10-2A;控制器读取旋转后显示器的宽高比为16/9,旋转后显示器的像素为1024*576;控制器计算出缩放倍数等于旋转后显示器的宽/展示图像的宽;=1024/960;控制器将图像10放大1024/960倍,控制显示器展示放大后的图像10,此时显示器的展示界面可以参阅界面10-3。
请参阅图19B,图19B为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
移动终端将图像10的数据流10传输至显示设备的控制器。控制器渲染数据流10得到图像10。控制器控制显示器展示图像10,此时显示器的展示界面可以参阅界面10-1。控制器读取第一宽高比为8/3,图像10的像素为960*360;第二宽高比为9/16。控制器控制旋转组件带动显示器旋转,当显示器旋转到预置角度时(预置角度可以但不限于45),控制器读取第三宽高比为16/9,旋转后显示器的像素为1024*576;控制器计算出缩放倍数等于旋转后显示器的宽/展示图像的宽;=1024/960;控制器将图像10放大1024/960倍,控制显示器展示放大后的图像10,此时显示器的展示界面可以参阅界面10-2B;控制器控制显示器旋转至90度,此时显示器的展示界面可以参阅界面10-3。采用本申请实施例示出方案,在显示器旋转过程中展示图像共经历一次刷新,用户体验感较好。
实施例11:
请参阅图20,图20为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
移动终端将图像11的数据流11传输至显示设备的控制器。控制器渲染数据流11得到图像11。控制器控制显示器展示图像11,此时显示器的展示界面可以参阅界面11-1。控制器读取第一宽高比为16/9,图像11的像素为864*486;第二宽高比为9/16。控制器控制旋转组件带动显示器旋转,当显示器旋转到预置角度时(预置角度可以但不限于45),控制器读取第三宽高比为16/9,旋转后显示器的像素为1024*576;控制器计算出缩放倍数等于旋转后显示器的宽/展示图像的宽=1024/864;控制器将图像11放大1024/864倍,控制显示器展示放大后的图像11,此时显示器展示的界面可以参阅界面11-2;控制器控制显示器旋 转至90度,此时显示器的展示界面可以参阅界面11-3。
例如,在第一宽高比大于1的情况下,如果第一宽高比小于第三宽高比,则缩放倍数等于旋转后显示器的高/展示图像的高。
下面结合具体的实施例对实现方式作以详细的说明:本实现方式中涉及的展示图像均为横屏展示图像。在接收到数据流时,显示器的展示方向为竖屏展示方向。
实施例12:
请参阅图21,图21为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
移动终端将图像12的数据流12传输至显示设备的控制器。控制器渲染数据流12得到图像12。控制器控制显示器展示图像12,此时显示器的展示界面可以参阅界面12-1。控制器读取第一宽高比为4/3,图像12的像素为480*360;第二宽高比为9/16。控制器控制旋转组件带动显示器旋转,当显示器旋转到预置角度时(预置角度可以但不限于45),控制器读取第三宽高比为16/9,旋转后显示器的像素为1024*576;控制器计算出缩放倍数等于旋转后显示器的高/展示图像的高=576/360;控制器将图像12放大576/360倍,控制显示器展示放大后的图像12,此时显示器展示的界面可以参阅界面12-2;控制器控制显示器旋转至90度,此时显示器的展示界面可以参阅界面12-3。
再例如,在第一宽高比小于1的情况下,如果第一宽高比大于或等于第三宽高比,则缩放倍数等于旋转后显示器的宽/展示图像的宽;
下面结合具体的实施例对实现方式作以详细的说明:本实现方式中涉及的展示图像均为竖屏展示图像。在接收到数据流时,显示器的展示方向为横屏展示方向。
实施例13:
请参阅图22,图22为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
移动终端将图像13的数据流13传输至显示设备的控制器。控制器渲染数据流13得到图像13。控制器控制显示器展示图像13,此时显示器的展示界面可以参阅界面13-1。控制器读取第一宽高比为3/4,图像13的像素为360*480;第二宽高比为16/9。控制器控制旋转组件带动显示器旋转,当显示器旋转到预置角度时(预置角度可以但不限于45),控制器读取第三宽高比为9/16,旋转后显示器的像素为576*1024;控制器计算出缩放倍数等于旋转后显示器的宽/展示图像的宽=576/360;控制器将图像13放大576/360倍,控制显示器展示放大后的图像13,此时显示器展示的界面可以参阅界面13-2;控制器控制显示器旋转至90度,此时显示器的展示界面可以参阅界面13-3。
实施例14:
请参阅图23,图23为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
移动终端将图像14的数据流14传输至显示设备的控制器。控制器渲染数据流14得到图像14。控制器控制显示器展示图像14,此时显示器的展示界面可以参阅界面14-1。控制器读取第一宽高比为9/16,图像14的像素为486*864;第二宽高比为16/9。控制器控制旋转组件带动显示器旋转,当显示器旋转到预置角度时(预置角度可以但不限于45),控制器读取第三宽高比为9/16,旋转后显示器的像素为576*1024;控制器计算出缩放倍数等于旋转后显示器的宽/展示图像的宽=576/486;控制器将图像14放大576/486倍,控制显 示器展示放大后的图像14,此时显示器展示的界面可以参阅界面14-2;控制器控制显示器旋转至90度,控制显示器展示放大后的图像14,此时显示器的展示界面可以参阅界面14-3。
再例如,在第一宽高比小于1的情况下,如果第一宽高比小于第三宽高比,则缩放倍数等于旋转后显示器的高/展示图像的高。
下面结合具体的实施例对实现方式作以详细的说明:本实现方式中涉及的展示图像均为竖屏展示图像。在接收到数据流时,显示器的展示方向为横屏展示方向。
实施例15:
请参阅图22,图22为根据本公开实施方式示出的投屏过程中,显示器展示界面的变化示意图;
移动终端将图像15的数据流15传输至显示设备的控制器。控制器渲染数据流15得到图像15。控制器控制显示器展示图像15,此时显示器的展示界面可以参阅界面15-1。控制器读取第一宽高比为3/8,图像15的像素为360*960;第二宽高比为16/9。控制器控制旋转组件带动显示器旋转,当显示器旋转到预置角度时(预置角度可以但不限于45),控制器读取第三宽高比为9/16,旋转后显示器的像素为576*1024;控制器计算出缩放倍数等于旋转后显示器的高/展示图像的高=1024/960;控制器将图像15放大1024/960倍,控制显示器展示放大后的图像15,此时显示器展示的界面可以参阅界面15-2;控制器控制显示器旋转至90度,此时显示器的展示界面可以参阅界面15-3。
S209基于缩放倍数缩放展示图像;
S210控制器显示器展示缩放后的展示图像。
本申请实施例示出的显示设备包括:显示器、旋转组件和控制器;当展示图像的展示方向与显示器的展示方向不匹配时,旋转组件可以基于控制器的控制带动显示器旋转,以使显示器的展示方向与展示图像的展示方向匹配;控制器可以在完成展示图像的渲染后,读取第三宽高,并基于第三宽高和第二宽高计算出展示图像的缩放倍数;而后基于缩放倍数缩放展示图像;最后,控制显示器展示缩放后的展示图像。本申请实施例示出显示设备,当移动终端通过投屏功能与显示设备建立联系时,显示设备的控制器可以基于展示图像实际的宽高比,计算出该图像的缩放倍数;并基于缩放倍数展示图像,以使缩放后的展示图像与显示器的展示空间匹配,用户体验感较好。
考虑上述技术问题,本申请实施例第三方面示出一种显示设备,显示设备至少包括显示器、旋转组件和控制器。显示设备与移动终端的交互过程可以参阅图25,图25为根据本公开实施方式示出移动终端与显示设备的交互流程图,从图中可以看出:
移动终端执行步骤S301发送投屏请求;
发送投屏请求的实现方式可以参阅上述实例,在此便不赘述。
控制器,被配置为执行步骤S302~S306:
响应于移动端发送的投屏请求,S302接收移动端输出的数据流;
S303渲染数据流得到展示图像;
S304读取第一宽高和第二宽高,所述第一宽高为所述展示图像的宽和高;所述第二宽高比为当接收所述移动端输出的数据流时,显示器的宽和高;
S305计算第一宽高比和第二宽高比;所述第一宽高比等于展示图像的宽/展示图像的高,所述第二宽高比等于显示设备的宽/显示设备的高;
如果第一宽高大于或等于1,第二宽高比大于1;或如果第一宽高大于或等于1,第二 宽高比大于1;
S306根据第一宽高与第二宽高的关系,计算展示图像的缩放倍数;
根据第一宽高与第二宽高的关系,计算展示图像的缩放倍数的实现方式有多种;
例如:在第一宽高比大于或等于1的情况下,如果第一宽高比大于或等于第二宽高比,则缩放倍数等于显示器的宽/展示图像的宽;
再例如:在第一宽高比大于或等于1的情况下,如果第一宽高比大于或等于1,如果第一宽高比小于第二宽高比,则缩放倍数等于显示器的高/展示图像的高。
再例如:在第一宽高比小于1的情况下,如果第一宽高比大于或等于第二宽高比,则缩放倍数等于显示器的宽/展示图像的宽;
再例如:在第一宽高比小于1的情况下,如果第一宽高比小于第二宽高比,则缩放倍数等于显示器的高/展示图像的高;
S307基于缩放倍数缩放展示图像;
S308控制器显示器展示缩放后的展示图像。
本申请实施例示出的显示设备包括:显示器、旋转组件和控制器;当展示图像的展示方向与显示器的展示方向匹配时,控制器可以在完成展示图像的渲染后,读取第一宽高和第二宽高,并基于第一宽高和第二宽高计算出展示图像的缩放倍数;而后基于缩放倍数缩放展示图像;最后,控制显示器展示缩放后的展示图像。本申请实施例示出显示设备,当移动终端通过投屏功能与显示设备建立联系时,显示设备的控制器可以基于展示图像实际的宽高比,计算出该图像的缩放倍数;并基于缩放倍数展示图像,以使缩放后的展示图像与显示器的展示空间匹配,用户体验感较好。
实际应用中,投屏协议是一种用于移动终端100B与显示设备200之间的数据传输协议,用于传递图像信息,例如Miracast协议等。但是这些协议属于移动终端100B的原生协议,受到这些原生协议的限制,移动终端100B发送的投屏数据流和显示设备200接收的投屏数据流都是横屏的,即投屏图像被显示设备200接收时的状态均是其在横屏显示设备200上显示的状态,如图26、图27所示。
上述这种投屏方式普遍适用于横屏的显示设备200。而当显示设备200为竖屏、投屏图像为竖屏时,此时竖屏显示设备200上显示的内容为横屏显示设备200上显示的全部内容的缩小内容,并且竖屏投屏图像在横屏的投屏数据流中已经被缩小,再次显示在竖屏显示设备上时又被再一次地缩小,进而在竖屏显示设备上显示竖屏投屏图像时,会出现投屏图像周围留黑的问题,如图28所示,大量留黑会导致图像显示效果差,进而影响用户的观看体验。
本申请实施例提供了一种可旋转的显示设备200,具体包括显示器275、旋转组件276和控制器250。其中,显示器275可以显示移动终端100B发送的投屏图像,旋转组件276可以被控制器250所控制,进而带动显示器275旋转以使显示器275处于横屏显示状态或竖屏显示状态。
控制器250可以检测移动终端100B发送的投屏图像的真实图像尺寸以及显示器275当前的显示状态;根据投屏图像的真实图像尺寸以及显示器275当前的显示状态,驱动显示器275旋转至对应的显示状态,以匹配投屏图像的图片格式;再根据真实图像尺寸与显示器275的显示状态,计算投屏图像的缩放倍数;最后,根据缩放倍数调 整投屏图像在显示器275上的显示尺寸。
其中,图片格式用于表示投屏图像是竖屏图像或者横屏图像;控制器250驱动显示器275转为横屏显示状态或者竖屏显示状态,以匹配横屏图像或者竖屏图像的显示。
但是在实际投屏时,投屏图像由于宽高比与显示器275屏幕宽高比不同等原因,其在显示器275上显示时可能不会完全适应显示器275的屏幕尺寸,进而出现图像周围留黑、或者显示器275上显示内容不全的问题。
对于上述所说的投屏图像在显示器275出现的问题,在本申请实施例的可旋转显示设备200中,控制器250还可以通过投屏图像的真实图像尺寸与显示器275的显示状态,计算出投屏图像在与其匹配显示状态下的显示器275上的缩放倍数,进而使投屏图像按照这个缩放倍数在显示器275上满屏显示,减少显示器275上显示投屏图像时屏幕留黑的问题。
上述实施例中所说的宽高比是指投屏图像的图像宽度与图像高度的比值,或者显示器275屏幕宽度与屏幕高度的比值。
经过本申请上述实施例处理后,上述如图28所示的竖屏投屏图像在竖屏显示器275上调整尺寸后显示的情况可以如图29所示,可见,本申请实施例可以将显示器275上显示的投屏图像缩放至合适的大小,以适配显示器275的显示状态和屏幕尺寸,为用户提供更好的观看体验。
在一些实施例中,为了保证投屏图像缩放处理后仍具有很好的图像质量,还可以采用SurfaceView显示方案,SurfaceView是一种可以进行画质处理的渲染图像技术,相比TextureView显示方案,使用SurfaceView进行显示的图像,画质、清晰度以及细腻程度明显更高。
在显示器275中,可以实现SurfaceView处理的结构可称为渲染层,由于渲染层中无法将处理后的图像显示出来,因此,还需要将渲染层处理后的投屏图像复制出来,复制到可显示图像的图像层。其中,图像层可以是OSD层,OSD层上显示的图像可被调整尺寸和角度,这样当投屏图像与显示器275的屏幕宽高比不相同时,可在OSD层调整投屏图像的尺寸。
值得说明的是,从渲染层复制投屏图像时,可以是将每一帧图像依次复制到图像层检测图像的真实图像尺寸,这样可以保证针对每一帧图像都可以做到准确的尺寸调整。但是,每一帧图像在检测和调整尺寸时都需要一定的处理时间,如果投屏图像是来自于一个连续播放的视频图像中,那么每一帧图像依次处理使不可避免会导致每一帧图像在显示器275上播放时的卡顿现象。为了避免这种情况,在一些实施例中,还可以设置间隔时间,以使控制器250每隔几秒获取复制一帧投屏图像到图像层,这样可以保证投屏图像播放的流畅性。
显示器275当前的显示状态可能是横屏显示状态,也可能是竖屏显示状态,但由于显示设备200此时是可旋转的显示设备,因此,即使投屏图像与显示设备200当前的显示状态不匹配,也可以通过旋转显示器275进而使竖屏显示的显示器275显示竖屏的投屏图像,或者使横屏显示的显示器275显示横屏的投屏图像。
进而,在一些实施例中,控制器250还需要首先根据投屏图像的真实图像尺寸,用以确定投屏图像的图片格式,例如,投屏图像的宽度大于高度时,可以确定投屏图像为横屏图像,投屏图像的宽度小于高度时,可以确定投屏图像为竖屏图像。然后, 在投屏图像为竖屏图像并且显示器275当前显示状态为横屏显示状态的情况下,驱动显示器275旋转至竖屏显示状态;在投屏图像为横屏图像并且显示器275当前显示状态为竖屏显示状态的情况下,驱动显示器275旋转至横屏显示状态。
当显示设备200为可旋转的显示设备时,显示设备200的显示状态包括以下几种情况,投屏图像为竖屏图像,显示器275当前显示状态为横屏显示状态,但旋转后变为竖屏显示状态;投屏图像为横屏图像,显示器275当前显示状态为竖屏显示状态,但旋转后变为横屏显示状态;投屏图像为竖屏图像,显示器275当前显示状态为竖屏显示状态;投屏图像为横屏图像,显示器275当前显示状态为横屏显示状态。
如图30A和图30B所示,投屏图像不论为竖屏图像还是横屏图像,其图像宽度和图像高度均分别为T w和T h。显示器275由于可以旋转,因此,其屏幕高度和屏幕宽度在不同的显示状态下不同,其中,如图31所示,显示器275横屏显示状态下,屏幕高度为B h,屏幕宽度为B w;如图32所示,显示器275竖屏显示状态下,屏幕高度变为横屏显示状态下的屏幕宽度B w,屏幕宽度变为横屏显示状态下的屏幕高度B h
在一些实施例中,针对于上述投屏图像为竖屏图像并且显示器275当前显示状态为横屏显示状态的情况,控制器250需要计算显示器275旋转为竖屏显示状态后,竖屏投屏图像在显示器275上满屏显示的缩放倍数。进而,控制器250可以根据如下公式计算投屏图像的缩放倍数F:
Figure PCTCN2021114957-appb-000001
在一些实施例中,针对于上述投屏图像为横屏图像并且显示器275当前显示状态为竖屏显示状态的情况,控制器250需要计算显示器275旋转为横屏显示状态后,横屏投屏图像在显示器275上满屏显示的缩放倍数。在此情况下,控制器250需要检测投屏图像的图像宽高比T w/T h是否大于或者等于显示器275横屏显示状态下的屏幕宽高比B w/B h,用于确定缩放时,是以投屏图像的宽度为准进行缩放还是以投屏图像的高度为准进行缩放;
如果投屏图像的图像宽高比T w/T h大于或者等于显示器275横屏显示状态下的屏幕宽高比B w/B h,说明此时投屏图像的宽度较大,应以投屏图像的宽度为准进行缩放倍数的计算,控制器250需要根据如下公式计算当前的投屏图像的缩放倍数F:
Figure PCTCN2021114957-appb-000002
以及,如果投屏图像的图像宽高比T w/T h小于显示器275横屏显示状态下的屏幕宽高比B w/B h,说明此时投屏图像的高度较长,应以投屏图像的高度为准进行缩放倍数的计算,控制器250需要根据如下公式计算当前的投屏图像的缩放倍数F:
Figure PCTCN2021114957-appb-000003
在一些实施例中,针对于上述投屏图像为竖屏图像以及显示器275当前的显示状态为竖屏显示状态的情况,控制器250无需再控制显示器275旋转,直接检测投屏图像的图像宽高比T w/T h是否大于或者等于显示器275横屏显示状态下的屏幕宽高比B w/B h,用于确定缩放时,是以投屏图像的宽度为准进行缩放还是以投屏图像的高度为准进行缩放;
此种情况,由于首先获取的投屏数据流为横屏的,那么竖屏图像在获取时可以理解为 是缩小显示在横屏显示器275上的图像,如图26所示,然后在竖屏显示器275上显示时,可以理解为将横屏显示器275的全部显示内容缩小显示在竖屏显示器275上,如图28所示。在竖屏显示器275上显示时,竖屏投屏图像的缩小倍数可以看作是横屏显示器275的显示内容在竖屏显示器275上的缩小倍数,即显示器275竖屏显示状态下的高度B w/显示器275横屏显示状态下的高度B h,因此,如果需要在将竖屏显示器275上的竖屏投屏图像放大到满屏显示,需要在计算出竖屏显示器275中投屏图像的缩放倍数后,还要再乘以上述投屏图像的缩小倍数,具体内容如下:
如果投屏图像的图像宽高比T w/T h小于显示器275横屏显示状态下的屏幕宽高比B w/B h,说明此时投屏图像的高度较长,应以投屏图像的高度为准进行缩放倍数的计算,控制器250需要根据如下公式计算当前的投屏图像的缩放倍数F:
Figure PCTCN2021114957-appb-000004
以及,如果投屏图像的图像宽高比T w/T h大于或者等于显示器275横屏显示状态下的屏幕宽高比B w/B h,说明此时投屏图像的宽度较大,应以投屏图像的宽度为准进行缩放倍数的计算,控制器250需要根据如下公式计算当前的投屏图像的缩放倍数F:
Figure PCTCN2021114957-appb-000005
在一些实施例中,针对于上述投屏图像为横屏图像以及显示器275当前的显示状态为横屏显示状态的情况,控制器250无需再控制显示器275旋转,直接检测投屏图像的图像宽高比T w/T h是否大于或者等于显示器275横屏显示状态下的屏幕宽高比B w/B h,用于确定缩放时,是以投屏图像的宽度为准进行缩放还是以投屏图像的高度为准进行缩放;
如果投屏图像的图像宽高比T w/T h大于或者等于显示器275横屏显示状态下的屏幕宽高比B w/B h,说明此时投屏图像的宽度较大,应以投屏图像的宽度为准进行缩放倍数的计算,控制器250需根据如下公式计算当前的投屏图像的缩放倍数F:
Figure PCTCN2021114957-appb-000006
如果投屏图像的图像宽高比T w/T h小于显示器275横屏显示状态下的屏幕宽高比B w/B h,说明此时投屏图像的高度较长,应以投屏图像的高度为进行缩放倍数的计算,控制器250需要根据如下公式计算当前的投屏图像的缩放倍数F:
Figure PCTCN2021114957-appb-000007
值得说明的是,上述缩放倍数F如果真实的数据结果大于1,说明投屏图像显示时需要放大,如果数据结果小于1,说明投屏图像显示时需要缩小。缩放时,需要投屏图像的宽度和高度同时进行操作。
并且,在本申请实施例的可旋转显示设备200中,计算缩放倍数的操作通常在控制器250驱动显示器275旋转之后进行,而投屏图像真正按照缩放倍数进行尺寸调整是在显示器275转动到一定角度时进行的,例如,当显示器275从横屏显示状态转动了45度以后,投屏图像才开始调整尺寸,或者当显示器275从竖屏显示状态转动了45度以后,投屏图像才开始调整尺寸。
另外,在本申请实施例的可旋转显示设备200中,在首次检测显示器275需要旋转的情况下,还要再进行几次检测,当多次检测的结果均为显示设备275需要旋转至竖屏或者 多次检测的结果均为显示器275需要旋转至横屏时,才能执行显示器275的旋转操作。如果仅依据一次检测结果进行旋转,而这次的检测结果却不准确,那么本次旋转显示器275的操作也是不准确的,而多次检测,可以避免这种不准确的情况,提高容错率,进而保证旋转操作的准确性。
结合上述内容,在一些实施例中,可旋转显示设备200中,控制器250可执行的内容还可以如图33所示,在图33中,控制器250检测移动终端100B发送的投屏图像的真实图像尺寸以及显示器275当前的显示状态之后,判断投屏图像是否为横屏图像,如果是,则继续判断显示器275是否处于横屏显示状态,如果显示器275未处于横屏显示状态,则驱动显示器274旋转至横屏显示状态;如果投屏图像是竖屏图像,则判断显示器275是否处于竖屏显示状态,如果显示器275未处于竖屏显示状态,则驱动显示器175旋转至竖屏显示状态。
以及,如图33所示,控制器250还计算显示器275处于不同显示状态时,投屏图像的缩放倍数。并根据缩放倍数在旋转后的显示器275上调整投屏图像的尺寸,或者,当投屏图像的图片格式与显示器275的显示状态一致时,直接根据缩放倍数在显示器275上调整投屏图像的尺寸。
本申请实施例还提供了一种不可旋转的显示设备200,该显示设备200可以包括显示器275和控制器250;其中,显示器275可以显示移动终端100B发送的投屏图像。
控制器250可以检测移动终端100B发送的投屏图像的真实图像尺寸及显示器275的当前显示状态;根据真实图像尺寸与显示器275当前的显示状态,计算投屏图像的缩放倍数;最后,根据缩放倍数调整投屏图像在显示器275上的显示尺寸。
其中,显示状态用于表示显示器275处于横屏显示状态或者竖屏显示状态;投屏图像的真实图像尺寸用于确定投屏图像是竖屏图像或者横屏图像。
同样的,本申请实施例中不可旋转的显示设备200中,也可以采用SurfaceView显示方案,进而,在一些实施例中,控制器250也可以将渲染层上处理后投屏图像复制到图像层;再检测图像层上的投屏图像的真实图像尺寸。
当显示设备200为不可旋转的显示设备时,显示设备200的显示状态包括以下几种情况,投屏图像为竖屏图像,显示器275当前显示状态为横屏显示状态;投屏图像为横屏图像,显示器275当前显示状态为竖屏显示状态;投屏图像为竖屏图像,显示器275当前显示状态为竖屏显示状态;投屏图像为横屏图像,显示器275当前显示状态为横屏显示状态。
在一些实施例中,针对于上述投屏图像为竖屏图像以及显示器275当前的显示状态为横屏显示状态的情况,控制器250需要根据如下公式计算当前投屏图像的缩放倍数F:
Figure PCTCN2021114957-appb-000008
在一些实施例中,针对于上述投屏图像为竖屏图像以及显示器275当前的显示状态为竖屏显示状态的情况,控制器250需要检测投屏图像的图像宽高比T w/T h是否大于或者等于显示器275横屏显示状态下的屏幕宽高比B w/B h,用于确定缩放时,是以投屏图像的宽度为准进行缩放还是以投屏图像的高度为准进行缩放;
此种情况,由于首先获取的投屏数据流为横屏的,那么竖屏图像在获取时可以理解为是缩小显示在横屏显示器275上的图像,如图26所示,然后在竖屏显示器275上显示时, 可以理解为将横屏显示器275的全部显示内容缩小显示在竖屏显示器275上,如图28所示。在竖屏显示器275上显示时,竖屏投屏图像的缩小倍数可以看作是横屏显示器275的显示内容在竖屏显示器275上的缩小倍数,即显示器275竖屏显示状态下的高度B w/显示器275横屏显示状态下的高度B h,因此,如果需要在将竖屏显示器275上的竖屏投屏图像放大到满屏显示,需要在计算出竖屏显示器275中投屏图像的缩放倍数后,还要再乘以上述投屏图像的缩小倍数,具体内容如下:
如果投屏图像的图像宽高比T w/T h小于显示器275横屏显示状态下的屏幕宽高比B w/B h,说明此时投屏图像的高度较长,应以投屏图像的高度为准进行缩放倍数的计算,控制器250需要根据如下公式计算当前的投屏图像的缩放倍数F:
Figure PCTCN2021114957-appb-000009
以及,如果投屏图像的图像宽高比T w/T h大于或者等于显示器275横屏显示状态下的屏幕宽高比B w/B h,说明此时投屏图像的宽度较大,应以投屏图像的宽度为准进行缩放倍数的计算,控制器250需要根据如下公式计算当前的投屏图像的缩放倍数F:
Figure PCTCN2021114957-appb-000010
在一些实施例中,针对于上述投屏图像为横屏图像以及显示器275当前的显示状态为横屏显示状态的情况,控制器250需要检测投屏图像的图像宽高比T w/T h是否大于或者等于显示器275横屏显示状态下的屏幕宽高比B w/B h,用于确定缩放时,是以投屏图像的宽度为准进行缩放还是以投屏图像的高度为准进行缩放;
如果投屏图像的图像宽高比T w/T h大于或者等于显示器275横屏显示状态下的屏幕宽高比B w/B h,说明此时投屏图像的宽度较大,应以投屏图像的宽度为准进行缩放倍数的计算,控制器250需要根据如下公式计算当前的投屏图像的缩放倍数F:
Figure PCTCN2021114957-appb-000011
以及,如果投屏图像的图像宽高比T w/T h小于显示器275横屏显示状态下的屏幕宽高比B w/B h,说明此时投屏图像的高度较长,应以投屏图像的高度为准进行缩放倍数的计算,控制器250需要根据如下公式计算当前的投屏图像的缩放倍数F:
Figure PCTCN2021114957-appb-000012
在一些实施例中,针对于上述投屏图像为横屏图像以及显示器275当前的显示状态为竖屏显示状态的情况,控制器250可以根据如下公式计算当前投屏图像的缩放倍数:
Figure PCTCN2021114957-appb-000013
本申请实施例中的可不旋转的显示设备200与可旋转的显示设备200相比,除了不能控制显示器275根据投屏图像的图片格式旋转,以及上述一些缩放倍数的计算方式不同之外,其他的内容与前述实施例中可旋转的显示设备200的实施例内容相同,具体可参照前述内容,在此不再赘述。
结合上述内容,在一些实施例中,不可旋转显示设备200中,控制器250可执行的内容还可以如图34所示,在图34中,控制器250检测移动终端100B发送的投屏图像的真实图像尺寸以及显示器275当前的显示状态之后,判断投屏图像是否为横屏图像,如果 是,则继续判断显示器275是否处于横屏显示状态,并计算显示器275处于不同显示状态下的投屏图像的缩放倍数;如果投屏图像是竖屏图像,则判断显示器275是否处于竖屏显示状态,并计算显示器275处于不同显示状态下的投屏图像的缩放倍数。
以及,控制器250进行了如图34中所示的处理后,还可以直接根据缩放倍数在显示器275上调整投屏图像的尺寸。
另外,本申请实施例中还可以提供第三种显示设备200,在使用该显示设备200时,可以通过检测显示器275是否可旋转,而进行不同的处理过程和图像缩放倍数的计算过程。该显示设备200可以包括显示器275、旋转组件276和控制器250。
其中,控制器250可以检测移动终端100B发送的投屏图像的真实图像尺寸、显示器275当前的显示状态以及显示器275是否可旋转;
在显示器275可旋转的情况下,根据投屏图像的真实图像尺寸以及显示器275当前的显示状态,驱动显示器275旋转至对应的显示状态,以匹配投屏图像的图片格式,并且,根据真实图像尺寸与显示器275的显示状态,计算投屏图像的缩放倍数;
在显示器275不可旋转的情况下,根据真实图像尺寸与显示器275当前的显示状态,计算投屏图像的缩放倍数;
最后,根据缩放倍数调整投屏图像在显示器275上的显示尺寸。
在显示器275可旋转的情况下,显示设备200为可旋转的显示设备,具体的处理过程和缩放倍数的计算可以参照前述可旋转显示设备的实施例的内容。
在显示器275不可旋转的情况下,可将显示设备200看作是不可旋转的显示设备,具体的处理过程和缩放倍数的计算可以参照前述不可旋转显示设备的实施例的内容。
结合上述内容,在一些实施例中,上述第三种显示设备200中,控制器250可执行的内容还可以如图35所示,在图35中,控制器250检测移动终端100B发送的投屏图像的真实图像尺寸以及显示器275当前的显示状态之后,首先判断显示设备200是否可旋转。
如图35所示,在显示设备200可旋转时,进行如图33所示的处理,在显示设备200不可旋转时,进行如图34所示的处理。
可见,通过上述全部内容可知,本申请实施例可以根据真实图像尺寸与显示器275的显示状态,计算投屏图像的缩放倍数;最后,根据缩放倍数调整投屏图像在显示器275上的显示尺寸。无论显示设备200是否可旋转,采用本申请实施方式,都可以将显示设备200上显示的投屏图像缩放至合适的大小,以适配显示设备200的显示状态和屏幕尺寸,为用户提供更好的观看体验。
本申请实施例还提供了一种投屏图像的显示方法,应用于前述可旋转的显示设备200中,该方法具体包括:
步骤S401,检测移动终端100B发送的投屏图像的真实图像尺寸以及显示器275当前的显示状态;
步骤S402,根据投屏图像的真实图像尺寸以及显示器275当前的显示状态,驱动显示器275旋转至对应的显示状态,以匹配投屏图像的图片格式;
步骤S403,根据真实图像尺寸与显示器275的显示状态,计算投屏图像的缩放倍数;
步骤S404,根据缩放倍数调整投屏图像在显示器275上的显示尺寸。
在其他一些实施例中,该方法还可以实现前述可旋转的显示设备200中控制器250所能执行的其他内容。
本申请实施例还提供了另一种投屏图像的显示方法,应用于前述不可旋转的显示设备200中,该方法具体包括:
步骤S501,检测移动终端100B发送的投屏图像的真实图像尺寸及显示器275的当前显示状态;
步骤S502,根据真实图像尺寸与显示器275当前的显示状态,计算投屏图像的缩放倍数;
步骤S503,根据缩放倍数调整投屏图像在显示器275上的显示尺寸。
在其他一些实施例中,该方法还可以实现前述不可旋转的显示设备200中控制器250所能执行的其他内容。
本申请实施例还提供了第三种投屏图像的显示方法,应用于前述第三种显示设备200,该方法具体包括:
步骤S601,检测移动终端100B发送的投屏图像的真实图像尺寸、显示器275当前的显示状态以及显示器275是否可旋转;
步骤S602,在显示器275可旋转的情况下,根据投屏图像的真实图像尺寸以及显示器275当前的显示状态,驱动显示器275旋转至对应的显示状态,以匹配投屏图像的图片格式,并且,根据真实图像尺寸与显示器275的显示状态,计算投屏图像的缩放倍数;
步骤S603,在显示器275不可旋转的情况下,根据真实图像尺寸与显示器275当前的显示状态,计算投屏图像的缩放倍数;
步骤S604,根据缩放倍数调整投屏图像在显示器275上的显示尺寸。
在其他一些实施例中,该方法还可以实现前述第三种显示设备200中控制器250所能执行的其他内容。
具体实现中,本发明还提供一种计算机可读的非易失性存储介质,其中,该计算机存储介质可存储有程序,该程序执行时可包括本发明提供的摄像头拍摄角度的调整方法的各实施例中的部分或全部步骤。的存储介质可为磁碟、光盘、只读存储记忆体(英文:read-only memory,简称:ROM)或随机存储记忆体(英文:random access memory,简称:RAM)等。
为了方便解释,已经结合具体的实施方式进行了上述说明。但是,上述示例性的讨论不是意图穷尽或者将实施方式限定到上述公开的具体形式。根据上述的教导,可以得到多种修改和变形。上述实施方式的选择和描述是为了更好的解释原理以及实际的应用,从而使得本领域技术人员更好的使用实施方式以及适于具体使用考虑的各种不同的变形的实施方式。

Claims (10)

  1. 一种显示设备,包括:
    显示器;
    控制器,被配置为执行:
    响应于所述移动端发送的投屏请求,接收所述移动端输出的数据流;
    渲染所述数据流得到展示图像;
    读取第一宽高和第二宽高,所述第一宽高为所述展示图像的宽和高,所述第二宽高为所述显示器的宽和高;
    根据第一宽高与第二宽高的关系,计算所述展示图像的缩放倍数;
    基于所述缩放倍数缩放所述展示图像;
    控制所述显示器展示缩放后的展示图像。
  2. 根据权利要求1所述的显示设备,当所述数据流为横屏数据流,第一宽高比大于或等于1;所述控制器被进一步配置为:
    计算第一宽高和第二宽高比,所述第一宽高比等于展示图像的宽/展示图像的高,所述第二宽高比等于显示设备的宽/显示设备的高;
    如果所述第一宽高比小于或等于所述第二宽高比,则所述缩放倍数等于所述显示器的高/所述展示图像的高;
    如果所述第一宽高比大于所述第二宽高比,则所述缩放倍数等于所述显示器的宽/所述展示图像的宽。
  3. 根据权利要求1或2所述的显示设备,当所述数据流为横屏数据流,第一宽高比小于1时;所述控制器被进一步配置为:
    计算第一宽高和第二宽高比,所述第一宽高比等于展示图像的宽/展示图像的高,所述第二宽高比等于显示设备的宽/显示设备的高;
    如果所述第一宽高比大于或等于所述第二宽高比,则所述缩放倍数等于所述显示器的宽/所述展示图片的宽;
    如果所述第一宽高比小于所述第二宽高比,则所述缩放倍数等于所述显示器的高/所述展示图片的高。
  4. 根据权利要求1所述的显示设备,如果所述数据流为竖屏数据流,所述控制器还被配置为:
    计算第一宽高和第二宽高比,所述第一宽高比等于展示图像的宽/展示图像的高,所述第二宽高比等于显示设备的宽/显示设备的高;
    如果所述第一宽高比大于或等于所述第二宽高比,则所述缩放倍数等于所述显示器的宽/所述展示图片的宽;
    如果所述第一宽高比小于所述第二宽高比,则所述缩放倍数等于所述显示器的高/所述展示图片的高。
  5. 一种显示设备,包括:
    显示器;
    旋转组件,连接所述显示器,用于基于所述控制器的控制带动所述显示器旋转;
    控制器,被配置为执行:
    响应于所述移动端发送的投屏请求,接收所述移动端输出的数据流;
    渲染所述数据流得到展示图像;
    读取第一宽高和第二宽高,所述第一宽高为所述展示图像的宽和高;所述第二宽高为当接收所述移动端输出的数据流时,显示器的宽和高;
    计算第一宽高比和第二宽高比;所述第一宽高比等于展示图像的宽/展示图像的高,所述第二宽高比等于当接收所述移动端输出的数据流时,显示设备的宽/显示设备的高;
    如果所述第一宽比高大于1,所述第二宽高比小于1;或如果所述第一宽高小于1,所述第二宽高比大于1,控制所述旋转组件带动所述显示器旋转90度;
    读取第三宽高,所述第三宽高比为旋转后所述显示器的宽和高;
    根据第一宽高与第三宽高的关系,计算所述展示图像的缩放倍数;
    基于所述缩放倍数缩放所述展示图像;
    控制器所述显示器展示缩放后的展示图像。
  6. 根据权利要求5所述的显示设备,如果所述第一宽高比大于1,所述控制器被进一步配置为:
    计算第三宽高,所述第三宽高比等于旋转后所述显示器的宽/显示器的高;
    如果所述第一宽高比大于或等于所述第三宽高比,则所述缩放倍数等于旋转后所述显示器的宽/所述展示图像的宽;
    如果所述第一宽高比小于所述第三宽高比,则所述缩放倍数等于旋转后所述显示器的高/所述展示图像的高。
  7. 根据权利要求6所述的显示设备,如果所述第一宽高比小于1,所述控制器被进一步配置为:
    如果所述第一宽高比大于或等于所述第三宽高比,则所述缩放倍数等于旋转后所述显示器的宽/所述展示图片的宽;
    如果所述第一宽高比小于所述第三宽高比,则所述缩放倍数等于旋转后所述显示器的高/所述展示图像的高。
  8. 一种显示设备,包括:
    显示器;
    旋转组件,连接所述显示器,用于基于所述控制器的控制带动所述显示器旋转;
    控制器,被配置为执行:
    响应于所述移动端发送的投屏请求,接收所述移动端输出的数据流;
    渲染所述数据流得到展示图像;
    读取第一宽高和第二宽高,所述第一宽高为所述展示图像的宽和高;所述第二宽高比为当接收所述移动端输出的数据流时,显示器的宽和高;
    计算第一宽高比和第二宽高比;所述第一宽高比等于展示图像的宽/展示图像的高,所述第二宽高比等于显示设备的宽/显示设备的高;
    如果所述第一宽比高大于1,所述第二宽高比大于1;或如果所述第一宽比高大于1,所述第二宽高比大于1;
    根据第一宽高与第二宽高的关系,计算所述展示图像的缩放倍数;
    基于所述缩放倍数缩放所述展示图像;
    控制器所述显示器展示缩放后的展示图像。
  9. 根据权利要求8所述的显示设备,如果所述第一宽高比大于1,所述控制器被进一步配置为:
    如果所述第一宽高比大于或等于所述第二宽高比,则所述缩放倍数等于所述显示器的宽/所述展示图片的宽;
    如果所述第一宽高比小于所述第二宽高比,则所述缩放倍数等于所述显示器的高/所述展示图片的高。
  10. 根据权利要求8或9所述的显示设备,如果所述第一宽高比小于1,所述控制器被进一步配置为:
    如果所述第一宽高比大于或等于所述第二宽高比,则所述缩放倍数等于所述显示器的宽/所述展示图像的宽;
    如果所述第一宽高比小于所述第二宽高比,则所述缩放倍数等于所述显示器的高/所述展示图像的高。
PCT/CN2021/114957 2020-11-23 2021-08-27 一种显示设备 WO2022105345A1 (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202011319998.3A CN112565839B (zh) 2020-11-23 2020-11-23 投屏图像的显示方法及显示设备
CN202011319699.XA CN112565861A (zh) 2020-11-23 2020-11-23 一种显示设备
CN202011319998.3 2020-11-23
CN202011319699.X 2020-11-23

Publications (1)

Publication Number Publication Date
WO2022105345A1 true WO2022105345A1 (zh) 2022-05-27

Family

ID=81707927

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/114957 WO2022105345A1 (zh) 2020-11-23 2021-08-27 一种显示设备

Country Status (1)

Country Link
WO (1) WO2022105345A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115484484A (zh) * 2022-08-30 2022-12-16 深圳市思为软件技术有限公司 一种智能设备投屏控制方法、装置、电子设备及存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013057851A (ja) * 2011-09-09 2013-03-28 Seiko Epson Corp 投写光学系及びこれを備えるプロジェクター
CN107371062A (zh) * 2017-08-25 2017-11-21 四川长虹电器股份有限公司 视频画面自动缩放的方法
CN108737882A (zh) * 2018-05-09 2018-11-02 腾讯科技(深圳)有限公司 图像的显示方法、装置、存储介质及电子装置
CN111372126A (zh) * 2019-06-27 2020-07-03 杭州海康威视系统技术有限公司 视频播放方法、装置及存储介质
CN111694533A (zh) * 2020-06-12 2020-09-22 深圳新智联软件有限公司 一种应用于横竖屏的投屏显示方法、装置、计算机设备及存储介质
CN112565861A (zh) * 2020-11-23 2021-03-26 青岛海信传媒网络技术有限公司 一种显示设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013057851A (ja) * 2011-09-09 2013-03-28 Seiko Epson Corp 投写光学系及びこれを備えるプロジェクター
CN107371062A (zh) * 2017-08-25 2017-11-21 四川长虹电器股份有限公司 视频画面自动缩放的方法
CN108737882A (zh) * 2018-05-09 2018-11-02 腾讯科技(深圳)有限公司 图像的显示方法、装置、存储介质及电子装置
CN111372126A (zh) * 2019-06-27 2020-07-03 杭州海康威视系统技术有限公司 视频播放方法、装置及存储介质
CN111694533A (zh) * 2020-06-12 2020-09-22 深圳新智联软件有限公司 一种应用于横竖屏的投屏显示方法、装置、计算机设备及存储介质
CN112565861A (zh) * 2020-11-23 2021-03-26 青岛海信传媒网络技术有限公司 一种显示设备

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115484484A (zh) * 2022-08-30 2022-12-16 深圳市思为软件技术有限公司 一种智能设备投屏控制方法、装置、电子设备及存储介质
CN115484484B (zh) * 2022-08-30 2024-05-14 深圳市思为软件技术有限公司 一种智能设备投屏控制方法、装置、电子设备及存储介质

Similar Documents

Publication Publication Date Title
WO2021179359A1 (zh) 一种显示设备及显示画面旋转适配方法
WO2021179363A1 (zh) 一种显示设备及开机动画显示方法
WO2021212470A1 (zh) 一种显示设备及投屏画面显示方法
CN111866590B (zh) 一种显示设备
WO2021212463A1 (zh) 一种显示设备及投屏方法
WO2016065514A1 (zh) 图像显示方法、用户终端和视频接收设备
CN112565861A (zh) 一种显示设备
CN114285986B (zh) 一种摄像头拍摄图像的方法及显示设备
WO2022105345A1 (zh) 一种显示设备
CN113556591A (zh) 一种显示设备及投屏画面旋转显示方法
WO2021213097A1 (zh) 一种显示设备及投屏方法
CN114285985A (zh) 一种摄像头预览方向的确定方法及显示设备
WO2024139130A1 (zh) 显示设备和数据显示方法
WO2021179361A1 (zh) 一种显示设备
CN111078926A (zh) 一种人像缩略图像的确定方法及显示设备
WO2022193475A1 (zh) 显示设备、接收投屏内容的方法及投屏方法
WO2021180223A1 (zh) 一种显示方法及显示设备
WO2021218473A1 (zh) 一种显示方法及显示设备
WO2023010968A1 (zh) 一种图像处理方法及显示设备
WO2021180216A1 (zh) 一种显示设备及开机方法
WO2018026152A1 (ko) 랜드스케이프 동영상 컨텐츠의 적응적 재생 시스템 및 재생방법
WO2021195919A1 (zh) 一种显示设备及开机信号源显示适配方法
WO2022111000A1 (zh) 显示设备以及显示方法
CN113825001B (zh) 全景图片浏览方法及显示设备
WO2021195918A1 (zh) 一种显示设备及堵转状态恢复方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21893497

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 13/09/2023)

122 Ep: pct application non-entry in european phase

Ref document number: 21893497

Country of ref document: EP

Kind code of ref document: A1