CN113556591A

CN113556591A - Display equipment and projection screen image rotation display method

Info

Publication number: CN113556591A
Application number: CN202010331804.5A
Authority: CN
Inventors: 张敬坤
Original assignee: Qingdao Hisense Media Network Technology Co Ltd
Current assignee: Qingdao Hisense Media Network Technology Co Ltd
Priority date: 2020-04-24
Filing date: 2020-04-24
Publication date: 2021-10-26

Abstract

The application provides a display device and a screen projection picture rotating display method, wherein a controller of the display device can receive image information sent by a terminal to control the display of a screen projection picture and detect the current rotating state of a display. And if the display direction of the screen projection picture is not matched with the rotation state of the display, controlling the rotation assembly to rotate the display into a rotation state matched with the display direction of the screen projection picture. The display device can automatically adjust the rotation state of the display according to the display direction of the screen projection picture, so that the screen projection picture is displayed in a larger display space, and the problem that the screen projection picture cannot be normally displayed by a traditional intelligent television is solved.

Description

Display equipment and projection screen image rotation display method

Technical Field

The application relates to the technical field of intelligent televisions, in particular to a display device and a screen projection picture rotating display method.

Background

The smart television has an independent operating system and supports function expansion. Various application programs can be installed in the smart television according to the needs of the user, for example, social applications such as traditional video applications and short videos, and reading applications such as cartoons and books. The applications can display application pictures by utilizing a screen of the intelligent television, and rich media resources are provided for the intelligent television. Meanwhile, the intelligent television can also perform data interaction and resource sharing with different terminals. For example, the smart television can be connected with a mobile phone through a wireless communication mode such as a local area network and bluetooth, so as to play resources in the mobile phone or directly project a screen to display a picture on the mobile phone.

However, since the scales of pictures corresponding to media assets are different, the smart television is often used to display pictures with different scales from the traditional video. For example, when a screen is projected to display a screen on a terminal such as a mobile phone, if the terminal is in a vertically-placed state, the aspect ratio of the screen on the terminal is 9:16, 9:18, 3:4, and the like; and if the terminal is in a laterally placed state, the aspect ratio of the picture on the terminal is 16:9, 18:9, 4:3, etc. Therefore, when the screen of the terminal is projected and displayed through the intelligent television, if the terminal is in a vertically placed state, the screen projection picture can not be normally displayed easily because the aspect ratio of the terminal picture is not matched with the aspect ratio of the display.

In order to display the screen projection picture, the smart television is generally required to zoom the screen projection picture or adjust the terminal to a horizontally placed state. When the screen projection picture is zoomed, the difference of picture proportion causes that two sides of the picture displayed by the intelligent television have larger black filling areas, and the display space on the screen is wasted. The terminal is manually rotated by a user when the placement direction of the terminal is adjusted, the adjusted picture is aligned to the transverse placement direction, partial pictures such as a vertically-arranged UI (user interface), short videos and the like cannot be normally displayed, and user experience is reduced.

Disclosure of Invention

The application provides a display device and a screen projection picture rotating display method, and aims to solve the problem that a traditional intelligent television cannot normally display a screen projection picture of a terminal.

A first aspect of the present application provides a display device, comprising: a display, a rotating assembly, and a controller. The display is used for displaying a screen projection picture; the rotating component is configured to drive the display to rotate so that the display is in one rotating state of a horizontal screen state or a vertical screen state;

the controller is configured to execute the following program:

receiving image information sent by a terminal to control the display of a screen projection picture and detecting the current rotation state of the display;

and if the display direction of the screen projection picture is vertical and the current rotation state of the display is a horizontal screen state, controlling the rotation assembly to rotate the display into a vertical screen state.

Based on the display device, the first aspect of the present application further provides a screen projection image rotation display method, including:

and if the display direction of the screen projection picture is vertical and the current rotation state is a horizontal screen state, controlling a rotation assembly to rotate the display to be a vertical screen state.

A second aspect of the present application provides a display device comprising: a display, a rotating assembly, and a controller. The display is used for displaying a screen projection picture; the rotating component is configured to drive the display to rotate so that the display is in one rotating state of a horizontal screen state or a vertical screen state;

the controller is configured to execute the following program:

and if the display direction of the screen projection picture is horizontal and the current rotation state is a vertical screen state, controlling a rotation assembly to rotate the display into a horizontal screen state.

Based on the display device, a second aspect of the present application further provides a projection screen rotating display method, including:

According to the technical scheme, the display device and the screen projection picture rotating display method are provided, and the controller of the display device can receive the image information sent by the terminal to control the screen projection picture to be displayed and detect the current rotating state of the display. And if the display direction of the screen projection picture is not matched with the rotation state of the display, controlling the rotation assembly to rotate the display into a rotation state matched with the display direction of the screen projection picture. The display device can automatically adjust the rotation state of the display according to the display direction of the screen projection picture, so that the screen projection picture is displayed in a larger display space, and the problem that the screen projection picture cannot be normally displayed by a traditional intelligent television is solved.

A third aspect of the present application provides a display device comprising: a display, a rotating assembly, and a controller. The display is used for displaying a screen projection picture; the rotating component is configured to drive the display to rotate so that the display is in one rotating state of a horizontal screen state or a vertical screen state;

the controller is configured to execute the following program:

if the display direction of the screen projection picture is horizontal, the current rotation state of the display is a horizontal screen state, or the display direction of the screen projection picture is vertical, and the current rotation state of the display is a vertical screen state, acquiring an instruction input by a user and used for controlling the rotation assembly to rotate;

and controlling the display to display a prompt picture, and controlling the rotating assembly to rotate the display to a rotating state corresponding to the instruction.

Based on the display device, the third aspect of the present application further provides a projection screen rotating display method, including:

According to the technical scheme, the display device and the screen projection picture rotating display method are further provided, and the controller of the display device can receive the image information sent by the terminal to control the screen projection picture to be displayed and detect the current rotating state of the display. If the display direction of the screen projection picture is matched with the rotation state of the display, a rotation instruction input by a user can be acquired to drive the rotation assembly to rotate. And after the user inputs the rotation instruction, a prompt picture can be displayed to remind the user of operating, and then the rotation assembly is controlled to rotate the display to a rotation state corresponding to the instruction. The display equipment can prompt a user to operate through a prompt picture when the display direction is matched with the rotation state, so that misoperation of the user is reduced, and the problem that a screen projection picture cannot be normally displayed by a traditional intelligent television is solved.

Drawings

In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.

Fig. 1A is an application scenario diagram of a display device according to the present application;

FIG. 1B is a rear view of a display device of the present application;

fig. 2 is a block diagram of a hardware configuration of a control apparatus according to the present application;

FIG. 3 is a block diagram of a hardware configuration of a display device according to the present application;

FIG. 4 is a block diagram of an architectural configuration of an operating system in a memory of a display device according to the present application;

FIG. 5A is a schematic view of a horizontal screen display of the present application;

FIG. 5B is a schematic view of a display screen in a vertical screen state according to the present application;

FIG. 6A is a schematic diagram of a lateral attitude of a mobile terminal according to the present application;

fig. 6B is a schematic view of a vertical posture of the mobile terminal according to the present application;

FIG. 7A is a schematic view of a screen shot in the present application;

FIG. 7B is a schematic view of a rotated display of a projection screen according to the present application;

FIG. 8 is a schematic flow chart of a screen projection image rotation display method according to the present application;

FIG. 9 is a schematic view illustrating a process of determining a display direction of a projection screen according to the present application;

FIG. 10 is a schematic view of a process for adjusting a display screen projection screen according to the present application;

FIG. 11A is a schematic view illustrating a process of zooming a screen according to a unit angle zoom amount;

FIG. 11B is a schematic diagram of the display device according to the present application showing a vertical projection screen kept in a forward direction during rotation;

FIG. 11C is a schematic diagram of the present application showing the horizontal projection screen kept in the forward direction during the rotation of the display;

FIG. 12 is a schematic flow chart illustrating zooming of a screen shot according to a zoom step size according to the present application;

FIG. 13 is a schematic flow chart illustrating the detection of the switching state of the rotating assembly according to the present application;

fig. 14 is a schematic flow chart of the present application when the display direction is changed.

Detailed Description

In order to make those skilled in the art better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

In order to facilitate presentation of a screen projection picture and implementation of a screen projection picture rotation display method, embodiments of the present application provide a display device and a screen projection picture rotation display method. Herein, the display device generally refers to a device having a display function, such as a rotary television. It should be noted that the method provided in this embodiment is not only applicable to the rotating television, but also applicable to other display devices, such as a computer, a tablet computer, and the like.

The term "module," as used in various embodiments of the present application, may refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

The term "remote control" as used in the embodiments of the present application refers to a component of an electronic device (such as the display device disclosed in the present application) that is capable of wirelessly controlling the electronic device, typically over a short distance. The component may typically be connected to the electronic device using infrared and/or Radio Frequency (RF) signals and/or bluetooth, and may also include functional modules such as WiFi, wireless USB, bluetooth, motion sensors, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.

The term "gesture" as used in the embodiments of the present application refers to a user behavior used to express an intended idea, action, purpose, or result through a change in hand shape or an action such as hand movement.

The term "hardware system" used in the embodiments of the present application may refer to a physical component having computing, controlling, storing, inputting and outputting functions, which is formed by a mechanical, optical, electrical and magnetic device such as an Integrated Circuit (IC), a Printed Circuit Board (PCB) and the like. In various embodiments of the present application, a hardware system may also be generally referred to as a motherboard (motherboard) or a host chip or controller.

Referring to fig. 1A, an application scenario diagram of a display device according to some embodiments of the present application is provided. As shown in fig. 1A, the control apparatus 100 and the display device 200 may communicate with each other in a wired or wireless manner.

Among them, the control apparatus 100 is configured to control the display device 200, which may receive an operation instruction input by a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an intermediary for interaction between the user and the display device 200. Such as: the user operates the channel up/down key on the control device 100, and the display device 200 responds to the channel up/down operation.

The control device 100 may be a remote controller 100A, which includes infrared protocol communication or bluetooth protocol communication, and other short-distance communication methods, etc. to control the display apparatus 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.

The control device 100 may also be an intelligent device, such as a mobile terminal 100B, a tablet computer, a notebook computer, and the like. For example, the display device 200 is controlled using an application program running on the smart device. The application program may provide various controls to a user through an intuitive User Interface (UI) on a screen associated with the smart device through configuration.

For example, the mobile terminal 100B may install a software application with the display device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 100B may be caused to establish a control instruction protocol with the display device 200, and the functions of the physical keys as arranged by the remote control 100A may be implemented by operating various function keys or virtual controls of the user interface provided on the mobile terminal 100B. The audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.

The display apparatus 200 may provide a network television function of a broadcast receiving function and a computer support function. The display device may be implemented as a digital television, a web television, an Internet Protocol Television (IPTV), or the like.

The display apparatus 200 also performs data communication with the server 300 through various communication means. Here, the display apparatus 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 300 may provide various contents and interactions to the display apparatus 200. By way of example, the display device 200 may send and receive information such as: receiving Electronic Program Guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library. The servers 300 may be a group or groups of servers, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through the server 300.

In some embodiments, as shown in FIG. 1B, display device 200 includes a base, a display 275, a terminal interface 278 extending from a gap in the backplane, and a rotating assembly 276 coupled to the backplane. The display 275 may be a liquid crystal display, an organic light emitting display, a projection device, etc., among others. The rotation assembly 276 may rotate the display 275 without limitation to the particular display device type, size, resolution, etc. From the perspective of the front view of the display device, the rotating component 276 can rotate the display screen to a vertical screen state, that is, a state where the vertical side length of the screen is greater than the horizontal side length, or to a horizontal screen state, that is, a state where the horizontal side length of the screen is greater than the vertical side length.

In some exemplary embodiments, the controller 250 is a control chip, and is contained inside the base.

Fig. 2 is a block diagram illustrating the configuration of the control device 100. As shown in fig. 2, the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, a user output interface 150, and a power supply 160.

The controller 110 includes a Random Access Memory (RAM)111, a Read Only Memory (ROM)112, a processor 113, a communication interface, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components of the communication cooperation, external and internal data processing functions.

Illustratively, when an interaction of a user pressing a key disposed on the remote controller 100A or an interaction of touching a touch panel disposed on the remote controller 100A is detected, the controller 110 may control to generate a signal corresponding to the detected interaction and transmit the signal to the display device 200.

And a memory 120 for storing various operation programs, data and applications for driving and controlling the control apparatus 100 under the control of the controller 110. The memory 120 may store various control signal commands input by a user.

The communicator 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the control apparatus 100 transmits a control signal (e.g., a touch signal or a control signal) to the display device 200 via the communicator 130, and the control apparatus 100 may receive the signal transmitted by the display device 200 via the communicator 130. The communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132. For example: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.

The user input interface 140 may include at least one of a microphone 141, a touch pad 142, a sensor 143, a key 144, and the like, so that a user can input a user instruction regarding controlling the display apparatus 200 to the control apparatus 100 through voice, touch, gesture, press, and the like.

The user output interface 150 outputs a user instruction received by the user input interface 140 to the display apparatus 200, or outputs an image or voice signal received by the display apparatus 200. Here, the user output interface 150 may include an LED interface 151, a vibration interface 152 generating vibration, a sound output interface 153 outputting sound, a display 154 outputting images, and the like. For example, the remote controller 100A may receive an output signal such as audio, video, or data from the user output interface 150 and display the output signal in the form of an image on the display 154, an audio on the sound output interface 153, or a vibration on the vibration interface 152.

And a power supply 160 for providing operation power support for each element of the control device 100 under the control of the controller 110. In the form of a battery and associated control circuitry.

A hardware configuration block diagram of the display device 200 is exemplarily shown in fig. 3. As shown in fig. 3, one or more of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, a rotating assembly 276, an audio processor 280, an audio output interface 285, and a power supply 290 may be included in the display apparatus 200.

The rotating assembly 276 may include a driving motor, a rotating shaft, and the like. Wherein, the driving motor can be connected to the controller 250 and output the rotation angle under the control of the controller 250; one end of the rotation shaft is connected to a power output shaft of the driving motor, and the other end is connected to the display 275, so that the display 275 can be fixedly mounted on a wall or a bracket through the rotation member 276.

The rotating assembly 276 may also include other components, such as a transmission component, a detection component, and the like. Wherein, the transmission component can adjust the rotating speed and the torque output by the rotating component 276 through a specific transmission ratio, and can be in a gear transmission mode; the detection means may be composed of a sensor, such as an angle sensor, an attitude sensor, or the like, provided on the rotation shaft. These sensors may detect parameters such as the angle at which the rotating assembly 276 is rotated and transmit the detected parameters to the controller 250, so that the controller 250 can determine or adjust the state of the display apparatus 200 according to the detected parameters. In practice, rotating assembly 276 may include, but is not limited to, one or more of the components described above.

The tuner demodulator 210 receives the broadcast television signal in a wired or wireless manner, may perform modulation and demodulation processing such as amplification, mixing, and resonance, and is configured to demodulate, from a plurality of wireless or wired broadcast television signals, an audio/video signal carried in a frequency of a television channel selected by a user, and additional information (e.g., EPG data).

The tuner demodulator 210 is responsive to the user selected frequency of the television channel and the television signal carried by the frequency, as selected by the user and controlled by the controller 250.

The tuner demodulator 210 can receive a television signal in various ways according to the broadcasting system of the television signal, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, or the like; and according to different modulation types, a digital modulation mode or an analog modulation mode can be adopted; and can demodulate the analog signal and the digital signal according to the different kinds of the received television signals.

In other exemplary embodiments, the tuning demodulator 210 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs a television signal after modulation and demodulation, and inputs the television signal into the display apparatus 200 through the external device interface 240.

The communicator 220 is a component for communicating with an external device or an external server according to various communication protocol types. For example, the display apparatus 200 may transmit content data to an external apparatus connected via the communicator 220, or browse and download content data from an external apparatus connected via the communicator 220. The communicator 220 may include a network communication protocol module or a near field communication protocol module, such as a WIFI module 221, a bluetooth communication protocol module 222, and a wired ethernet communication protocol module 223, so that the communicator 220 may receive a control signal of the control device 100 according to the control of the controller 250 and implement the control signal as a WIFI signal, a bluetooth signal, a radio frequency signal, and the like.

The detector 230 is a component of the display apparatus 200 for collecting signals of an external environment or interaction with the outside. The detector 230 may include a sound collector 231, such as a microphone, which may be used to receive a user's sound, such as a voice signal of a control instruction of the user to control the display device 200; alternatively, ambient sounds may be collected that identify the type of ambient scene, enabling the display device 200 to adapt to ambient noise.

In some other exemplary embodiments, the detector 230, which may further include an image collector 232, such as a camera, a video camera, etc., may be configured to collect external environment scenes to adaptively change the display parameters of the display device 200; and the function of acquiring the attribute of the user or interacting gestures with the user so as to realize the interaction between the display equipment and the user.

In some other exemplary embodiments, the detector 230 may further include a light receiver for collecting the intensity of the ambient light to adapt to the display parameter variation of the display device 200.

In some other exemplary embodiments, the detector 230 may further include a temperature sensor, such as by sensing an ambient temperature, and the display device 200 may adaptively adjust a display color temperature of the image. For example, when the temperature is higher, the display apparatus 200 may be adjusted to display a color temperature of an image that is cooler; when the temperature is lower, the display device 200 may be adjusted to display a warmer color temperature of the image.

The external device interface 240 is a component for providing the controller 250 to control data transmission between the display apparatus 200 and an external apparatus. The external device interface 240 may be connected to an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.

The external device interface 240 may include: a High Definition Multimedia Interface (HDMI) terminal 241, a Composite Video Blanking Sync (CVBS) terminal 242, an analog or digital Component terminal 243, a Universal Serial Bus (USB) terminal 244, a Component terminal (not shown), a red, green, blue (RGB) terminal (not shown), and the like.

The controller 250 controls the operation of the display device 200 and responds to the operation of the user by running various software control programs (such as an operating system and various application programs) stored on the memory 260.

As shown in fig. 3, the controller 250 includes a Random Access Memory (RAM)251, a Read Only Memory (ROM)252, a graphics processor 253, a CPU processor 254, a communication interface 255, and a communication bus 256. The RAM251, the ROM252, the graphic processor 253, and the CPU processor 254 are connected to each other through a communication bus 256 through a communication interface 255.

The ROM252 stores various system boot instructions. When the display apparatus 200 starts power-on upon receiving the power-on signal, the CPU processor 254 executes a system boot instruction in the ROM252, copies the operating system stored in the memory 260 to the RAM251, and starts running the boot operating system. After the start of the operating system is completed, the CPU processor 254 copies the various application programs in the memory 260 to the RAM251 and then starts running and starting the various application programs.

And a graphic processor 253 for generating various graphic objects such as icons, operation menus, and user input instruction display graphics, etc. The graphic processor 253 may include an operator for performing an operation by receiving various interactive instructions input by a user, and further displaying various objects according to display attributes; and a renderer for generating various objects based on the operator and displaying the rendered result on the display 275.

A CPU processor 254 for executing operating system and application program instructions stored in memory 260. And according to the received user input instruction, processing of various application programs, data and contents is executed so as to finally display and play various audio-video contents.

In some example embodiments, the CPU processor 254 may comprise a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some initialization operations of the display apparatus 200 in the display apparatus preload mode and/or operations of displaying a screen in the normal mode. A plurality of or one sub-processor for performing an operation in a state of a standby mode or the like of the display apparatus.

The communication interface 255 may include a first interface to an nth interface. These interfaces may be network interfaces that are connected to external devices via a network.

The controller 250 may control the overall operation of the display apparatus 200. For example: in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.

Where the object may be any one of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object is, for example, an operation of displaying a link to a hyperlink page, document, image, or the like, or an operation of executing a program corresponding to the object. The user input command for selecting the GUI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch panel, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.

A memory 260 for storing various types of data, software programs, or applications for driving and controlling the operation of the display device 200. The memory 260 may include volatile and/or nonvolatile memory. And the term "memory" includes the memory 260, the RAM251 and the ROM252 of the controller 250, or a memory card in the display device 200.

In some embodiments, the memory 260 is specifically used for storing an operating program for driving the controller 250 of the display device 200; storing various application programs built in the display apparatus 200 and downloaded by a user from an external apparatus; data such as visual effect images for configuring various GUIs provided by the display 275, various objects related to the GUIs, and selectors for selecting GUI objects are stored.

In some embodiments, memory 260 is specifically configured to store drivers for tuner demodulator 210, communicator 220, detector 230, external device interface 240, video processor 270, display 275, audio processor 280, etc., and related data, such as external data (e.g., audio-visual data) received from the external device interface or user data (e.g., key information, voice information, touch information, etc.) received by the user interface.

In some embodiments, memory 260 specifically stores software and/or programs representing an Operating System (OS), which may include, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. Illustratively, the kernel may control or manage system resources, as well as functions implemented by other programs (e.g., the middleware, APIs, or applications); at the same time, the kernel may provide an interface to allow middleware, APIs, or applications to access the controller to enable control or management of system resources.

A block diagram of the architectural configuration of the operating system in the memory of the display device 200 is illustrated in fig. 4. The operating system architecture comprises an application layer, a middleware layer and a kernel layer from top to bottom.

The application layer, the application programs built in the system and the non-system-level application programs belong to the application layer. Is responsible for direct interaction with the user. The application layer may include a plurality of applications such as a setup application, a post application, a media center application, and the like. These applications may be implemented as Web applications that execute based on a WebKit engine, and in particular may be developed and executed based on HTML5, Cascading Style Sheets (CSS), and JavaScript.

Here, HTML, which is called hypertext Markup Language (hypertext Markup Language), is a standard Markup Language for creating web pages, and describes the web pages by Markup tags, where the HTML tags are used to describe characters, graphics, animation, sound, tables, links, etc., and a browser reads an HTML document, interprets the content of the tags in the document, and displays the content in the form of web pages.

CSS (Cascading Style Sheets), a computer language used to represent the Style of HTML documents, may be used to define Style structures, such as fonts, colors, locations, etc. The CSS style can be directly stored in the HTML webpage or a separate style file, so that the style in the webpage can be controlled.

JavaScript, a language applied to Web page programming, can be inserted into an HTML page and interpreted and executed by a browser. The interaction logic of the Web application is realized by JavaScript. The JavaScript can package a JavaScript extension interface through the browser to realize communication with the kernel layer.

The middleware layer may provide some standardized interfaces to support the operation of various environments and systems. For example, the middleware layer may be implemented as multimedia and hypermedia information coding experts group (MHEG) middleware related to data broadcasting, DLNA middleware which is middleware related to communication with an external device, middleware which provides a browser environment in which each application program in the display device operates, and the like.

The kernel layer provides core system services, such as: file management, memory management, process management, network management, system security authority management and the like. The kernel layer may be implemented as a kernel based on various operating systems, for example, a kernel based on the Linux operating system.

The kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: provide display driver for the display, provide camera driver for the camera, provide button driver for the remote controller, provide wiFi driver for the WIFI module, provide audio driver for audio output interface, provide power management drive for Power Management (PM) module etc..

In FIG. 3, user interface 265, receives various user interactions. Specifically, it is used to transmit an input signal of a user to the controller 250 or transmit an output signal from the controller 250 to the user. For example, the remote controller 100A may transmit an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by the user to the user interface 265, and then the input signal is transferred to the controller 250 through the user interface 265; alternatively, the remote controller 100A may receive an output signal such as audio, video, or data output from the user interface 265 via the controller 250, and display the received output signal or output the received output signal in audio or vibration form.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on the display 275, and the user interface 265 receives the user input commands through the GUI. Specifically, the user interface 265 may receive user input commands for controlling the position of a selector in the GUI to select different objects or items. Among these, "user interfaces" are media interfaces for interaction and information exchange between an application or operating system and a user, which enable the conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the user interface is a Graphical User Interface (GUI), which refers to a user interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include a visual interface element such as an icon, a control, a menu, a tab, a text box, a dialog box, a status bar, a channel bar, a Widget, etc.

Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user interface 265 receives the user input command by recognizing the sound or gesture through the sensor.

The video processor 270 is configured to receive an external video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a video signal that is directly displayed or played on the display 275.

Illustratively, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is configured to demultiplex an input audio/video data stream, where, for example, an input MPEG-2 stream (based on a compression standard of a digital storage media moving image and voice), the demultiplexing module demultiplexes the input audio/video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert a frame rate of an input video, for example, convert a frame rate of an input 60Hz video into a frame rate of 120Hz or 240Hz, where a common format is implemented by using, for example, an interpolation frame method.

And a display formatting module for converting the signal output by the frame rate conversion module into a signal conforming to a display format of a display, such as converting the format of the signal output by the frame rate conversion module to output an RGB data signal.

A display 275 for receiving the image signal from the video processor 270 and displaying the video content, the image and the menu manipulation interface. The display video content may be from the video content in the broadcast signal received by the tuner-demodulator 210, or from the video content input by the communicator 220 or the external device interface 240. The display 275, while displaying a user manipulation interface UI generated in the display apparatus 200 and used to control the display apparatus 200.

And, the display 275 may include a display screen assembly for presenting a picture and a driving assembly for driving the display of an image. Alternatively, a projection device and projection screen may be included, provided display 275 is a projection display.

The audio processor 280 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played by the speaker 286.

Illustratively, audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), high efficiency AAC (HE-AAC), and the like.

The audio output interface 285 is used for receiving an audio signal output by the audio processor 280 under the control of the controller 250, and the audio output interface 285 may include a speaker 286 or an external sound output terminal 287, such as an earphone output terminal, for outputting to a generating device of an external device.

In other exemplary embodiments, video processor 270 may comprise one or more chips. Audio processor 280 may also comprise one or more chips.

And, in other exemplary embodiments, the video processor 270 and the audio processor 280 may be separate chips or may be integrated with the controller 250 in one or more chips.

And a power supply 290 for supplying power supply support to the display apparatus 200 from the power input from the external power source under the control of the controller 250. The power supply 290 may be a built-in power supply circuit installed inside the display apparatus 200 or may be a power supply installed outside the display apparatus 200.

In the technical scheme provided by the application, the technology for transmitting the picture displayed on the mobile terminal to the display device for displaying is a mirror image technology (or a screen projection technology). The screen-projected picture, also called a mirror picture, is a picture displayed by the display device 200 corresponding to the presentation on the mobile terminal 100B. Generally, the mobile terminal 100B transmits specific display contents on the mobile terminal 100B to the display device 200 in the form of image information through a mirroring protocol. The display device 200 controls the presentation of the screen shot based on the received image information. Wherein the screen-projected picture corresponds to a picture of a current screen display displayed on the mobile terminal 100B.

In practical applications, the mirroring protocol is a data transmission protocol used between the mobile terminal 100B and the display device 200 for transmitting image information, and an airplane protocol or other mirroring protocols may be used. The mobile terminal 100B may mirror all display content to the display device 200, i.e., the mobile terminal 100B and the display device 200 maintain synchronous display; the mobile terminal 100B may also transmit a portion of the display content to the display device 200. For example, only image information corresponding to a video playing screen in a video application may be sent to the display device 200, so that the video playing screen is displayed on the display device 200, and at this time, the user may also keep the video application running in the background while performing other operations on the mobile terminal 100B, but without affecting the video content on the display device 200.

In other embodiments, the mobile terminal 100B may transmit the image information to the display device 200 by way of a wireless connection. For example, the mobile terminal 100B and the display device 200 are connected in the same wireless local area network (WiFi), and after the screen projection program is executed on the mobile terminal 100B, the mobile terminal 100B may transmit the mobile terminal screen to the display device 200 in the form of an h.264 encoded video stream through the WiFi connection. The display apparatus 200, upon receiving the video stream data transmitted by the mobile terminal 100B, may display the content in the video stream through the display 275, i.e., display a screen shot corresponding to the content displayed on the mobile terminal 100.

In order to display a screen projection screen, the present application provides a display device 200 including: a display 275, a rotating assembly 276, and a controller 250. The display 275 may directly present a display screen for the user to view. The controller 250 may control the display content of the display 275 and may control the rotation assembly 276 to operate to rotate the display 275, such that the display 275 may be in any rotational state.

The rotation state may further include a landscape state and a portrait state. The landscape state is a state in which the length (width) of the display 275 in the horizontal direction is greater than the length (height) of the display 275 in the vertical direction when viewed from the front surface (the surface on which the screen is displayed) of the display 275; the vertical screen state is a state in which the length (width) of the display 275 in the horizontal direction is smaller than the length (height) of the display 275 in the vertical direction when viewed from the front of the display 275.

Obviously, the vertical direction is substantially vertical in the present application, and the horizontal direction is also substantially horizontal, depending on the installation/placement position of the display device 200. The landscape state is mainly used for displaying the landscape media assets such as tv dramas and movies, as shown in fig. 5A. The mode of operation when the display 275 is in the landscape state may be referred to as the landscape viewing mode and the mode of operation when the display 275 is in the portrait state may be referred to as the portrait viewing mode. The controller 250 in the display device 200 is further communicatively connected to the server 300 for invoking an interface of the server 300 to obtain corresponding data. In practical applications, a user may control a play mode, play contents, and the like of the display apparatus 200 through the control device 100, wherein the play mode includes a landscape viewing mode and a portrait viewing mode.

The vertical screen state is mainly used for displaying vertical media such as short videos and cartoons, as shown in fig. 5B. In the vertical screen state, the display 275 may display the user interface corresponding to the vertical screen state and have the interface layout and the interaction mode corresponding to the vertical screen state. In the vertical screen media asset watching mode, a user can watch vertical screen media assets such as short videos and cartoons. Similarly, since the controller 250 in the display device 200 is further in communication connection with the server 300, the media asset data corresponding to the vertical screen can be acquired by calling the interface of the server 300 in the vertical screen state.

The vertical screen state is more suitable for playing pictures with the ratio of 9:16, etc., such as short videos shot by a terminal such as a mobile phone, etc. Because terminal equipment such as cell-phones adopts 9 more: 16,9: 18, and the like, when the terminal accesses the display device 200 and displays the terminal screen through the display device 200, the vertical screen state can avoid excessively zooming the screen, the display screen of the display 275 is fully utilized, and better user experience is achieved.

It should be noted that the horizontal screen state and the vertical screen state are only two different display states, and do not limit the displayed content, for example, vertical media such as short videos and cartoons can still be displayed in the horizontal screen state; horizontal media assets such as TV dramas and movies can still be displayed in the vertical screen state, and only the incompatible display windows need to be compressed and adjusted in the vertical screen state.

The user may adjust the rotational state of the display 275 as desired for the user's viewing while using the display device 200. For example, after a rotation command is issued by controlling a rotation key on the apparatus 100, or selecting a rotation option on a UI interface, or inputting a "rotation" related voice through a voice system, the controller 250 controls the rotation component 276 to rotate according to the rotation command to drive the display 275 to rotate. For example, when the user wants to watch a short video through the display device 200, the user can input a rotation instruction in one of the above manners to rotate the display 275 in the landscape screen state counterclockwise by 90 degrees to the portrait screen state, so as to adapt to the picture scale of the vertical application such as the short video.

Since the mobile terminal 100B has at least two display modes, when the mobile terminal 100B is placed in a landscape mode, i.e., the long side of the mobile terminal 100B is in a horizontal state and the short side is in a vertical state, the screen displayed by the mobile terminal 100B is also maintained in a landscape state. When the picture is viewed in the forward direction, the width of the picture is greater than the height of the picture, as shown in fig. 6A. When the mobile terminal 100B is vertically placed, the long side of the mobile terminal 100B is in a vertical state, the short side is in a horizontal state, the picture displayed by the mobile terminal 100B is also kept in a vertical state, and when the picture is viewed in the front direction, the width of the picture is smaller than the height of the picture, as shown in fig. 6B.

For the mobile terminal 100B, the screen displayed thereon may be derived from an operating system interface of the mobile terminal 100B or may be an application interface installed on the mobile terminal 100B. Different interfaces may be suitable for different poses. For example, when playing video media such as movies or television shows, and running some game applications, the horizontal posture is mostly suitable; and for application scenes such as social software and short videos, the method is mostly suitable for vertical postures. However, most applications have both landscape and portrait modes of operation to accommodate the landscape and portrait orientations of the mobile terminal 100B. Accordingly, the image information transmitted by the mobile terminal 100B to the display device 200 may have both horizontal and vertical display directions depending on the posture of the mobile terminal 100B, mainly depending on the posture of the mobile terminal 100B.

After receiving the image information, the display device 200 may display a screen shot corresponding to the image information in real time. Along with the interaction process of the user on the mobile terminal 100B, the mobile terminal 100B displays a dynamic picture, and the picture displayed on the display device 200 is also dynamically changed along with the interaction process of the user.

When the display device 200 displays the screen projection screen, since the image information sent by the mobile terminal 100B to the display device 200 may be different, either horizontally or vertically, according to the posture of the mobile terminal 100B, the screen projection screen on the display device 200 may be directly affected. For example, the resolution of the display screen of the mobile terminal 100B is 1792 × 828 in the landscape orientation, and the image information transmitted to the display device 200 is 828:1792 in the portrait orientation of the mobile terminal 100B, i.e., the aspect ratio corresponding to the presented screen projection is 828:1792 and the display direction is in the portrait orientation. If the display device 200 is in the landscape state, the screen projection image needs to be displayed in a manner that the height of the screen projection image is adapted to the current height of the display 275 in order to completely display the vertical screen projection image. At this time, as shown in fig. 7A, since there is no content displayed on both sides of the displayed screen, the display device 200 needs to add a large black margin area, waste display space, and bring a poor viewing experience to the user.

In order to fully utilize the display space, the controller 250 of the display apparatus 200 may control the rotating component 276 to rotate the rotating state of the display 275, i.e., from the landscape state to the portrait state to adapt to the portrait screen. Therefore, as shown in fig. 8, in the solution provided in the present application, the controller 250 is configured to execute the following program:

s1: and receiving image information sent by a terminal to control the display of a screen projection picture and detecting the current rotation state of the display.

After the user performs the screen-projection operation through the mobile terminal 100B, the mobile terminal 100B transmits image information to the display device 200 through the mirror protocol. The controller 250 may receive image information transmitted from the mobile terminal 100B and control the presentation of a screen projection, determine a display direction of the screen projection, and detect a current rotation state of the display 275. Among them, the detection of the rotation state of the display 275 may be accomplished by a sensor built in the display device 200.

For example, a sensor device such as a gyroscope or a gravitational acceleration sensor may be provided on the display 275 of the display device 200, and attitude data of the display 275 with respect to the direction of gravity may be determined by measuring angular acceleration or the direction of gravity. The detected attitude data is then compared with the attitude data in the landscape state and the portrait state, respectively, to determine the current rotational state of the display 275.

For another example, a grating angle sensor, a magnetic field angle sensor, a sliding resistance angle sensor, or the like may be provided on the rotating member 276, and the rotating member 276 may measure the rotating angle and compare the rotating angle with the angle in the landscape state and the portrait state, respectively, to determine the current rotating state of the display 275.

S2: and if the display direction of the screen projection picture is vertical and the current rotation state of the display is a horizontal screen state, controlling the rotation assembly to rotate the display into a vertical screen state.

In some exemplary embodiments, after determining the display direction of the screen-projected picture and detecting the current rotation state of the display 275, a determination may be made as to the display direction and the rotation state to determine whether the current screen-projected picture matches the current rotation state.

It should be noted that, in the technical solution provided in the present application, whether the current screen projection screen is matched with the current rotation state means: whether the aspect ratio of the projected picture is the same as or has a similar proportional relationship to the aspect ratio of the screen of the display 275. For example, the mobile terminal 100B is horizontally disposed, and the width of the screen is larger than the height, i.e. the aspect ratio of the corresponding projected screen is usually larger than 1. When the display 275 is in the landscape state, the long side is in the horizontal state as wide, the short side is in the vertical state as high, and the aspect ratio of the display 275 is also greater than 1 in the landscape state; similarly, the mobile terminal 100B is vertically disposed, the width of the screen is smaller than the height, that is, the width-to-height ratio of the corresponding screen projection screen is smaller than 1, when the display 275 is in the landscape screen state, the long side is in the vertical state as the height, the short side is in the horizontal state as the width, and the width-to-height ratio of the display 275 is smaller than 1 in the portrait screen state.

In the present application, if the aspect ratio of the projected screen is greater than 1 or less than 1 at the same time as the aspect ratio of the display 275, it is determined that the projected screen matches the current rotation state. Similarly, if the projected screen aspect ratio is not greater than 1 at the same time or less than 1 at the same time as the aspect ratio of the display 275, it is determined that the projected screen does not match the current rotation state. For example, as shown in fig. 7B, if the display direction of the current screen-projected picture is horizontal and the rotation state of the display 275 is horizontal, it is determined that the current screen-projected picture matches the current rotation state; similarly, if the display direction of the current screen projection picture is vertical and the rotation state of the display 275 is vertical, it is also determined that the current screen projection picture matches the current rotation state.

In practical application, whether the screen projection picture is matched with the rotation state or not can be judged by respectively analyzing the aspect ratio corresponding to the screen projection picture and the rotation state. In the projection screen, the aspect ratio is the ratio of the width to the height of the screen when the display screen is in the forward direction. For example, the aspect ratio of the landscape screen output by the mobile terminal 100B is 1792: 828 is more than 1; the aspect ratio of the vertical screen projection picture output by the mobile terminal 100B is 828:1792 < 1.

For display 275, the aspect ratio is the ratio of the horizontal width to the vertical height of the display area of display 275. For example, when the display 275 is in the landscape state, the aspect ratio of the display area is 3840: 2160 is greater than 1; when the display 275 is in the portrait state, the aspect ratio of the display area is 2160: 3840 < 1. Therefore, in practical applications, if the aspect ratio of the currently projected screen is simultaneously greater than 1 or simultaneously less than 1 with the aspect ratio of the display 275 in the current rotation state, it is determined that the currently projected screen matches the rotation state.

If the display direction of the projected screen is vertical and the current rotation state of the display 275 is landscape, it is determined that the current projected screen does not match the current rotation state, and therefore, the controller 250 may control the rotation assembly 276 to rotate the display 275 to be portrait. For example, the aspect ratio of the projection screen output by the mobile terminal 100B is 828:1792, that is, the display direction is vertical; and the aspect ratio of the display area of display 275 is 3840: 2160, namely in the horizontal screen state, determining that the current screen projection picture is not matched with the current rotation state. At this point, the controller 250 may send a control command to the rotating assembly 276 to drive the rotating assembly 276 to initiate a rotation to rotate the display 275 clockwise (or counterclockwise) 90 degrees to an aspect ratio of 2160: 3840 vertical screen state.

In practical applications, the driving manner of the controller 250 driving the rotating component 276 to rotate may be: controller 250 sends a turn command to the drive motor of rotating assembly 276 and specifies the angle that the drive motor needs to rotate. For example, the driving motor is a servo motor or a stepping motor that can be directly controlled by the controller 250, the command sent by the controller 250 includes a command indicating that the driving motor rotates 90 degrees clockwise (or counterclockwise), and the driving motor may rotate by a corresponding angle after receiving the command.

The controller 250 may also send a command for the rotational direction only to the drive motor, controlled by a stop feature on the rotating assembly 276 to achieve a specified rotational state. For example, the controller 250 may send a clockwise (or counterclockwise) rotation command to the drive motor of the rotating assembly 276. The driving motor may rotate clockwise (or counterclockwise) upon receiving a clockwise (or counterclockwise) rotation command, thereby driving the display 275 to rotate. When the display 275 rotates 90 degrees clockwise (or counterclockwise) to reach the vertical screen state, the limiting component on the rotating assembly 276 is touched, the limiting component prevents the display 275 from continuing to rotate on the one hand, and on the other hand, a contact signal is fed back to the controller 250 (or directly to the driving motor), and after receiving the contact signal, the controller 250 can send a stop command to the driving motor again to stop the driving motor from rotating.

In other exemplary embodiments, the mobile terminal 100B may transmit a notification of its horizontal and vertical states to the display device 200 when the mobile terminal 100B and the display device 200 are projected. The display device 200 may determine whether the display 275 needs to be rotated directly from the notification received from the mobile terminal 100B.

For example, when the mobile terminal 100B is in the horizontal state, a notification with a horizontal state flag is sent to the display device 200, and after receiving the notification, the display device 200 detects the current rotation state of the display 275, thereby determining whether the horizontal and vertical states of the mobile terminal 100B match the current rotation state. When the current rotation state of the display 275 is vertical, the rotation assembly 276 is triggered to rotate the display 275.

In one implementation, as shown in fig. 9, the controller 250 is further configured to:

s211: acquiring rotation angle callback information;

s212: and extracting the current posture of the terminal in the rotation angle callback information, and determining the display direction of the screen projection picture.

In this embodiment, the rotation angle callback information is a kind of posture information that the mobile terminal 100B can provide outside uniformly. Because the intelligent equipment with the attitude sensors such as the gyroscope, the gravity acceleration and the like can provide data detected by the attitude sensors through the angle callback interface, the rotation angle callback information is formed and used for determining the current attitude of the equipment. Therefore, the controller 250 may determine the current posture of the mobile terminal 100B after receiving the rotation angle callback information sent by the mobile terminal 100B, and further determine the display direction of the screen projection screen.

Specifically, the step of determining the display direction of the screen projection image specifically includes:

s2121: if the current posture of the terminal is vertical, determining that the display direction of the screen projection picture is vertical;

s2122: and if the current posture of the terminal is transverse, determining that the display direction of the screen projection picture is transverse.

For example, when the user vertically holds the mobile terminal 100B, the controller 250 may determine the current posture of the mobile terminal 100B as a vertical direction through the rotation angle callback information. At this time, the mobile terminal 100B may transmit a screen projection screen having an aspect ratio of 828:1792 to the display apparatus 200, that is, the display direction of the screen projection screen is a vertical direction. Similarly, when the user holds the mobile terminal 100B horizontally, the controller 250 may determine the current posture of the mobile terminal 100B as the horizontal direction through the rotation angle callback information. At this time, the mobile terminal 100B may transmit to the display apparatus 200 an aspect ratio of 1792: the projected screen of 828 is displayed in the horizontal direction.

Because the display 275 is bulky and heavy, the speed at which the rotating assembly 276 rotates the display 275 is slow, e.g., the display 275 typically takes 10-15 seconds or more to rotate from the landscape to the portrait position. Therefore, during the rotation of the display 275, the user may view the tilted screen-projected image for a long time, reducing the user experience. To improve the user experience, as shown in fig. 10, in controlling the rotation assembly 276 to rotate the display 275 to the portrait screen state, the controller 250 is further configured to:

s31: and rotating the screen projection picture in real time to enable the screen projection picture to keep forward display.

In practical applications, when the display 275 is rotated, the controller 250 may also rotate the projection screen in the opposite direction, so that the projection screen presented by the display 275 is always in the forward display state in the viewing direction of the user. For example, the display 275 needs to rotate clockwise from the landscape state to the portrait state, and during the rotation process, the projected screen needs to rotate 90 degrees counterclockwise, and the rotation processes of the display 275 and the projected screen are performed synchronously, so that the projected screen keeps displaying in the forward direction.

In one implementation, to rotate the projected screen, the controller 250 is further configured to execute the following program:

s311: calculating the rotation direction and the rotation angle of the screen projection picture;

s312: and rotating the screen projection picture according to the rotating direction and the rotating angle.

The controller 250 may register a current angle listening service in the operating system after receiving the image information, and call back the current angle information data of the display 275 in real time. And then the rotation direction and the rotation angle of the current display 275 are obtained through calculation, so that the rotation direction and the rotation angle of the screen projection picture are calculated. The rotation direction of the screen projection picture is opposite to the rotation direction of the display; the rotation angle of the screen projection picture is equal to the rotation angle of the display. For example, by using the angle callback data acquired in real time, if it is determined that the rotation angle of the display 275 within a certain unit time period is clockwise (or counterclockwise) by 1 degree, it is determined that the rotation direction of the projected screen is counterclockwise (or clockwise) and the rotation angle is 1 degree.

After the rotation direction and the rotation angle of the screen projection picture are determined, the screen projection picture can be rotated according to the rotation direction and the rotation angle obtained through calculation, so that the screen projection picture is approximately in a forward display state. For example, when the rotation direction of the screen projection screen is determined to be counterclockwise and the rotation angle is determined to be 1 degree, the controller 250 rotates the screen projection screen by controlling the color change displayed on each pixel point on the display 275.

In one implementation, in controlling the rotation component to rotate the display to the portrait state, the controller 250 is further configured to:

s32: and zooming the screen projection picture in real time to enable the screen projection picture to adapt to the display area range of the display in real time.

In practical applications, in order to display the screen completely, when displaying the screen projection, the screen projection is generally zoomed according to the longest edge of the screen projection that can be displayed on the display 275. For example, when the display 275 displays a vertical projection screen in a landscape state, the projection screen is zoomed based on the fact that the height of the display 275 can be adapted to the height of the vertical projection screen, and therefore black areas are filled on two sides of the vertical projection screen. As the display 275 rotates, the area that can display the longest edge of the screen can change, so that the screen can be zoomed during the rotation process to adapt to the display range.

To zoom the projected screen, in one implementation, as shown in fig. 11A, the controller 250 is further configured to:

s3211: acquiring the screen size of the display and the picture size of the screen projection picture;

s3212: calculating the unit angle scaling amount;

s3213: zooming the screen-projected picture according to the unit angle zooming amount to keep the picture in a vertical state all the time

As shown in fig. 11B and 11C, in this embodiment, the screen shot can be enlarged or reduced by monitoring the rotation angle of the display 275 in real time and calculating the unit angle scaling amount in real time. The unit angle scaling amount is calculated according to the screen size and the screen size, and the width and height of the projected screen change amount when the display rotates by a unit angle, that is, the width and height scaling amount of the projected screen when the display 276 rotates by 1 degree (or other unit angles).

For example, the rotation direction and the rotation angle data of the display 275 are obtained through the rotation angle callback, the zoom amount of the screen projection screen is calculated in real time according to the rotation data of the display 275, and when the display 275 rotates from the landscape screen state to the portrait screen state, the calculated unit angle zoom amount is: when the display 275 rotates by 1 degree, the amount of wide screen projection (the height of the screen projection displayed by the display-the width of the screen projection) displayed on the display 275 is 90, and the amount of high screen projection (the width of the display-the height of the display) is 90.

To zoom the projected screen, in one implementation, as shown in fig. 12, the controller 250 is further configured to:

s3221: acquiring the screen size of the display, the picture size of the screen projection picture and the rotation time of the display rotating to a vertical screen state;

s3222: calculating a scaling step length;

s3223: and zooming the screen projection picture according to the zooming step length.

In this embodiment, the scaling step can be calculated by counting the time consumed by the rotation component 276 in the horizontal and vertical screen switching process, and combining the screen size of the display and the screen size of the screen-projected picture. Wherein the zoom step is a variation of the width of the projected screen per unit time calculated from the screen size, and the rotation time, i.e., a variation of the width of the projected screen displayed per unit time. And simultaneously zooms the displayed screen shots while the display 275 is rotated, according to the zoom step.

For example, if the display 275 needs to consume 10s when switching from the landscape state to the portrait state, the variation of the width of the displayed screen projection is (the width of the short edge of the display-the width of the displayed screen projection)/10; the height variation of the displayed screen projection picture is (the width of the long side of the display device-the width of the short side of the display device)/10. And zooming the screen-projecting picture within 10s according to the zooming step length, so that the displayed screen-projecting picture can be synchronously zoomed while rotating, and the screen-projecting picture is ensured to adapt to the display area range of the display in real time.

In one implementation, as shown in fig. 13, if the display direction of the screen projection screen is vertical, the current rotation state of the display 275 is a landscape state, and the controller 250 is further configured to:

s201: detecting a switching state of the rotating assembly;

s202: if the switch state is on, controlling a rotating assembly to rotate the display;

s203: and if the switch state is closed, controlling the display to display a prompt picture.

In this embodiment, if the display direction of the screen projection screen is vertical and the current rotation state of the display 275 is horizontal, it is determined that the display direction of the current screen projection screen is not matched with the rotation state of the display 275, and the display 275 needs to be rotated. In practical application, a setting item for controlling whether the rotating component 276 automatically rotates, that is, the on-off state of the rotating component 276 may be set in the operating system, and when the user selects the setting item allowing automatic rotation, the on-off state of the rotating component 276 is on; when the user does not select the setting item allowing the automatic rotation, the switching state of the rotating member 276 is off.

Therefore, when the display 275 needs to be rotated, if the switch state of the rotating component 276 is on, the rotating component 276 can be directly controlled to rotate the display 275 to a matching state. For example, if the display direction of the screen projection screen is vertical, and the current rotation state of the display 275 is a landscape screen state, the display 275 is directly rotated to a portrait screen state.

If the switch state of the rotating assembly 276 is off, a prompt screen needs to be presented on the display 275 to prompt the user whether to rotate the display 275 to a matching state. For example, the display direction of the screen projection screen is vertical, the current rotation state of the display 275 is horizontal, and when the switch state of the rotation component 276 is detected to be off, the "whether the current resource is more suitable for the vertical screen mode or not, and whether the current resource is switched to the vertical screen mode" may be displayed on the display 275. Accordingly, some interactive controls may be included in the prompt, and the user may click on the interactive controls to set the switch state of the rotation component 276 to on to implement the rotation.

Since the mobile terminal 100B may be a handheld terminal such as a mobile phone and a tablet computer, and the use flexibility of the mobile terminal is high, when the screen projection function is used, a user may adjust the posture of the mobile terminal 100B, so that the display interface on the mobile terminal 100B changes. For example, when the mobile terminal 100B is placed horizontally, image information in the horizontal direction is sent to the display device 200, a screen projection screen is presented corresponding to the display device 200, but as the user uses the mobile terminal 100B, the mobile terminal 100B may be adjusted to a vertical posture, and at this time, the screen on the mobile terminal 100B is converted into a vertical screen, but since the rotation speed of the display device 200 is slow, frequent switching is likely to cause display errors, so in one implementation, as shown in fig. 14, after controlling the rotating assembly to rotate the display to a vertical screen state, the controller is further configured to:

s331: monitoring rotation angle callback information to detect the display direction of the screen projection picture;

s332: and if the display direction of the screen projection picture is changed into the transverse direction and the duration time exceeds the preset delay time, controlling a rotating assembly to rotate the display into a transverse screen state.

In this embodiment, the posture of the mobile terminal 100B may be determined by monitoring the rotation angle callback information of the mobile terminal 100B, so as to detect the display direction of the screen projection screen. For example, when the user rotates the mobile terminal 100B from the portrait orientation back to the landscape orientation, the display screen of the mobile terminal 100B is changed from the portrait orientation to the landscape orientation, and the display direction of the corresponding screen projection screen is also changed from the portrait orientation to the landscape orientation. At this time, the controller 250 may detect a time during which the mobile terminal 100B is maintained in the landscape state. For example, if the delay time is preset at 8s, and the duration for which the mobile terminal 100B is maintained in the landscape state exceeds 8s, the rotation member 276 is controlled to rotate the display 275 to the landscape state.

Similarly, as shown in fig. 8, in the embodiment of the present application, there is further provided a display device 200, where the controller 250 of the display device 200 is configured to:

s1: receiving image information sent by a terminal to control the display of a screen projection picture and detecting the current rotation state of the display;

s4: and if the display direction of the screen projection picture is horizontal and the current rotation state of the display is a vertical screen state, controlling the rotation assembly to rotate the display into a horizontal screen state.

In the same manner as the rotation of the display device 200, in this embodiment, after the controller 250 controls the display of the screen projection screen according to the image information sent by the receiving terminal and detects the current rotation state of the display 275, if the display direction of the screen projection screen is horizontal and the current rotation state of the display 275 is vertical, the controller 276 controls the rotation component 276 to rotate the display 275 to the horizontal screen state to adapt to the screen projection screen with the display direction being horizontal.

Based on the display device 200 described above, in one implementation, in controlling the rotation assembly 276 to rotate the display 275 to the landscape state, the controller 250 is further configured to: and rotating the screen projection picture in real time to enable the screen projection picture to keep forward display.

For example, by the angle callback data acquired in real time, it is determined that the rotation angle of the display 275 in a certain unit time period is counterclockwise rotated by 1 degree, and it is determined that the rotation direction of the screen projection screen is clockwise and the rotation angle is 1 degree.

In controlling the rotation assembly 276 to rotate the display 275 to the landscape state, the controller 250 is further configured to: and zooming the screen projection picture in real time to enable the screen projection picture to adapt to the display area range of the display in real time.

For example, when the display 275 is rotated from the portrait to the landscape state, the calculated amount of unit angle scaling is: when the display 275 rotates by 1 degree, the screen projection image displayed on the display 275 is zoomed according to the unit angle zoom amount, namely, the displayed screen projection image can be zoomed synchronously while rotating, and the screen projection image is ensured to adapt to the display area range of the display in real time.

As can be seen from the above technical solutions, the present application provides a display device 200 and a screen projection rotation display method, where the controller 250 of the display device can receive a screen projection sent by the mobile terminal 100B and detect a current rotation state of the display 275. If the display orientation of the screen projection does not match the rotated state of the display 275, the rotation component 276 is controlled to rotate the display 275 to a rotated state matching the display orientation of the screen projection. The application provides a display device 200 can be according to the rotation state of throwing the direction of display automatic adjustment display 275 of screen picture to use bigger display space to show and throw the screen picture, alleviate the unable normal problem that shows and throw the screen picture of traditional smart television.

In some embodiments of the present application, there is also provided a display device 200 including: a display 275, a rotating assembly 276, and a controller 250. Wherein, the display 275 is used for displaying a screen projection picture; a rotation assembly 276 configured to rotate the display 275 to cause the display to be in one of a landscape state or a portrait state;

the controller 250 is configured to execute the following procedures:

s51: if the display direction of the screen projection picture is horizontal, the current rotation state of the display is a horizontal screen state, or the display direction of the screen projection picture is vertical, and the current rotation state of the display is a vertical screen state, acquiring an instruction input by a user and used for controlling the rotation assembly to rotate;

s52: and controlling the display to display a prompt picture, and controlling the rotating assembly to rotate the display to a rotating state corresponding to the instruction.

As can be seen from the above technical solutions, in the present embodiment, a controller 250 of the display device 200 can receive image information sent by a terminal to control the display of a screen projection screen, and detect a current rotation state of the display 275. If the display direction of the screen projection matches the rotation state of the display 275, a rotation instruction input by the user may be obtained to drive the rotation component 276 to rotate. And after the user inputs the rotation instruction, the user can be reminded of the operation through the display prompting picture, and then the rotation component 276 is controlled to rotate the display 275 to the rotation state corresponding to the instruction. The display equipment can prompt a user to operate through a prompt picture when the display direction is matched with the rotation state, so that misoperation of the user is reduced, and the problem that a screen projection picture cannot be normally displayed by a traditional intelligent television is solved.

The embodiments provided in the present application are only a few examples of the general concept of the present application, and do not limit the scope of the present application. Any other embodiments extended according to the scheme of the present application without inventive efforts will be within the scope of protection of the present application for a person skilled in the art.

Claims

1. A display device, comprising:

a display;

a rotation component configured to drive the display to rotate so that the display is in one rotation state of a horizontal screen state or a vertical screen state;

a controller configured to:

2. The display device of claim 1, wherein the controller is further configured to:

acquiring rotation angle callback information;

extracting the current posture of the terminal in the rotation angle callback information, and determining the display direction of the screen projection picture, wherein the steps comprise:

if the current posture of the terminal is vertical, determining that the display direction of the screen projection picture is vertical;

and if the current posture of the terminal is transverse, determining that the display direction of the screen projection picture is transverse.

3. The display device of claim 1, wherein in controlling the rotation assembly to rotate the display to a portrait state, the controller is further configured to:

and rotating the screen projection picture in real time to enable the screen projection picture to keep forward display.

4. The display device of claim 3, wherein the controller is further configured to:

calculating the rotation direction and the rotation angle of the screen projection picture; the rotation direction of the screen projection picture is opposite to the rotation direction of the display; the rotation angle of the screen projection picture is equal to the rotation angle of the display;

and rotating the screen projection picture according to the rotating direction and the rotating angle.

5. The display device of claim 3, wherein in controlling the rotation assembly to rotate the display to a portrait state, the controller is further configured to:

and zooming the screen projection picture in real time to enable the screen projection picture to adapt to the display area range of the display in real time.

6. The display device of claim 5, wherein the controller is further configured to:

acquiring the screen size of the display and the picture size of the screen projection picture;

calculating the unit angle scaling amount; the unit angle scaling amount is calculated according to the screen size and the picture size, and the width and height of the projected picture change amount when the display rotates by a unit angle;

and zooming the screen projection picture according to the unit angle zooming amount.

7. The display device of claim 5, wherein the controller is further configured to:

acquiring the screen size of the display, the picture size of the screen projection picture and the rotation time of the display rotating to a vertical screen state;

calculating a scaling step length; the zooming step is the width and height variation of the screen projection in unit time calculated according to the screen size, the picture size and the rotation time;

and zooming the screen projection picture according to the zooming step length.

8. The display device according to claim 1, wherein if the display direction of the screen projection screen is a portrait direction and the current rotation state of the display is a landscape state, the controller is further configured to:

detecting a switching state of the rotating assembly;

if the switch state is on, controlling a rotating assembly to rotate the display;

and if the switch state is closed, controlling the display to display a prompt picture.

9. The display device of claim 1, wherein after controlling the rotation assembly to rotate the display to a portrait state, the controller is further configured to:

monitoring rotation angle callback information to detect the display direction of the screen projection picture;

and if the display direction of the screen projection picture is changed into the transverse direction and the duration time exceeds the preset delay time, controlling a rotating assembly to rotate the display into a transverse screen state.

10. A display device, comprising:

a display;

a controller configured to:

and if the display direction of the screen projection picture is horizontal and the current rotation state of the display is a vertical screen state, controlling the rotation assembly to rotate the display into a horizontal screen state.

11. The display device of claim 10, wherein in controlling the rotation assembly to rotate the display to the landscape state, the controller is further configured to:

12. The display device of claim 11, wherein in controlling the rotation assembly to rotate the display to the landscape state, the controller is further configured to:

13. A display device, comprising:

a display;

a controller configured to:

14. A projection screen image rotation display method is characterized by comprising the following steps:

15. A projection screen image rotation display method is characterized by comprising the following steps:

16. A projection screen image rotation display method is characterized by comprising the following steps: