WO2021180223A1

WO2021180223A1 - Display method and display device

Info

Publication number: WO2021180223A1
Application number: PCT/CN2021/080552
Authority: WO
Inventors: 李斌; 刘儒茜; 刘丽英; 于颜梅; 朱铄; 王大勇; 孙梅艳
Original assignee: 海信视像科技股份有限公司
Priority date: 2020-03-13
Filing date: 2021-03-12
Publication date: 2021-09-16
Also published as: WO2021180224A1

Abstract

The present application provides a display method and a display device. The method comprises: obtaining video images to be displayed, and performing image quality processing on a video layer; then, obtaining intermediate images by capturing output images after the image quality processing; rotating the intermediate images by means of an OSD layer to generate rotated images; finally, displaying the rotated images frame by frame to display the video images.

Description

Display method and display device

This application claims the priority of the Chinese patent filed with the Chinese Patent Office on March 13, 2020 with the application number 202010176794.2 and the application titled "A display device and display screen rotation adaptation method"; this application claims in April 2020 The priority of the Chinese patent filed with the Chinese Patent Office on the 28th with the application number 202010350580.2 and the application titled "A method and display device for rotating video images"; this application requires that it be filed with the Chinese Patent Office on September 27, 2020. The application number is 202011036180.0 is the priority of the Chinese patent application titled "A display device and video playback method in portrait mode"; the application is required to be submitted to the Chinese Patent Office on July 17, 2020, and the application number is 202010693749.4. The application title is "A display The priority of “equipment”; its entire contents are incorporated in this application by reference.

Technical field

This application relates to the technical field of smart TVs, and in particular to a display method and display device.

Background technique

Smart TV equipment has an independent operating system and supports function expansion. Various applications can be installed in the smart TV according to user needs, for example, traditional video applications, social applications such as short videos, and reading applications such as comics and books. These applications can use the screen of the smart TV to display application images, and provide rich media resources for the smart TV. At the same time, smart TVs can also exchange data and share resources with different terminals. For example, a smart TV can be connected to a mobile phone through wireless communication methods such as local area network, Bluetooth, etc., so as to play resources in the mobile phone or directly cast a screen to display the screen on the mobile phone.

Summary of the invention

This application provides a display method and display device,

On the one hand, this application provides a display method, including:

Obtain the to-be-displayed video screen;

Performing image quality processing on the to-be-displayed video picture through the video layer;

Generating an intermediate image; the intermediate image is the video frame data obtained by intercepting the output image after the image to be displayed is output through image quality processing;

Rotate the intermediate image through the OSD layer to generate a rotated image;

The rotated image is displayed frame by frame.

On the other hand, the present application also provides a display device, including: a display, a rotating component, and a controller. Wherein, the rotation component is configured to drive the display to rotate, so that the display is in one of a variety of rotation states; the controller is configured to execute the following program steps:

Obtain the to-be-displayed video screen;

Controlling the display to display the rotated image frame by frame.

Description of the drawings

In order to explain the technical solution of the present application more clearly, the following will briefly introduce the drawings needed in the embodiments. Obviously, for those of ordinary skill in the art, without creative work, Other drawings can be obtained from these drawings.

FIG. 1A is an application scenario diagram of a display device of this application;

FIG. 1B is a rear view of a display device of this application;

Figure 2 is a block diagram of the hardware configuration of the control device of the application;

Figure 3 is a block diagram of the hardware configuration of the display device of this application;

FIG. 4 is a block diagram of the architecture configuration of the operating system in the storage device of the display device of the present application;

Figure 5A is a schematic diagram of the horizontal screen state of the display device of this application;

Figure 5B is a schematic diagram of the vertical screen state of the display device of the application;

FIG. 6 is a schematic diagram of a scene of a method for rotating a video picture according to this application;

FIG. 7 is a schematic flowchart of a method for rotating a video picture according to this application;

FIG. 8 is a schematic diagram of the process of obtaining a to-be-displayed video image by the application;

FIG. 9 is a schematic diagram of the process of generating an intermediate image in this application;

FIG. 10 is a schematic diagram of the process of generating a rotating image in this application;

FIG. 11 is a schematic diagram of a flow of calling a rotation service to obtain display rotation information in this application;

Figure 12 is a schematic diagram of the flow of the monitoring angle callback interface;

Figure 13 is a schematic diagram of a rotating display screen of the application;

FIG. 14 is a schematic flow chart of the application for scaling a rotated image according to the current boundary position;

15A is a schematic diagram of the horizontal screen state of the display device in FIG. 1 according to some embodiments of the application;

15B is a schematic diagram of the vertical screen state of the display device in FIG. 1 provided by some embodiments of the application;

16 is a schematic flowchart of a display screen rotation adaptation method provided by some embodiments of the application;

FIG. 17 is a schematic diagram of a flow of detecting a switch state according to some embodiments of the application;

FIG. 18 is a schematic diagram of a flow of inputting a rotation instruction provided by some embodiments of the application;

FIG. 19 is a schematic flowchart of a display screen zoom operation provided by some embodiments of the application;

FIG. 20 is a schematic flowchart of a display screen rotation operation provided by some embodiments of the application;

FIG. 21 is a schematic flow chart of calculating rotation parameters provided by some embodiments of the application;

22 is a schematic diagram of a display screen rotation adaptation method provided by some embodiments of the application;

FIG. 23 is a schematic diagram of a display screen provided by some embodiments of the application;

FIG. 24 is a schematic flowchart of a method for rotating and adapting a display screen provided by some embodiments of the application.

Detailed ways

The embodiments will be described in detail below, and examples thereof are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following examples do not represent all implementation manners consistent with this application. It is only an example of a system and method consistent with some aspects of the present application as detailed in the claims.

In order to facilitate users to display video images in different horizontal and vertical screen states of the display, embodiments of the present application provide a video image rotating display method and a display device suitable for the video image rotating display method, wherein the display device is a rotating TV. It should be noted that the method provided in this embodiment is not only applicable to rotating TVs, but also applicable to other display devices, such as computers and tablet computers.

The term "module" used in the various embodiments of this application can refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that can execute related components Function.

The term "remote control" used in the various embodiments of this application refers to a component of an electronic device (such as the display device disclosed in this application), which can generally control the electronic device wirelessly within a short distance. The component can generally use infrared and/or radio frequency (RF) signals and/or Bluetooth to connect with electronic devices, and can also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example, a handheld touch remote control uses a user interface in a touch screen to replace most of the physical built-in hard keys in general remote control devices.

The term "gesture" used in the embodiments of the present application refers to a user's behavior through a change of hand shape or hand movement to express expected ideas, actions, goals, and/or results.

The term "hardware system" used in the various embodiments of this application may refer to an integrated circuit (IC), printed circuit board (Printed circuit board, PCB) and other mechanical, optical, electrical, and magnetic devices with computing , Control, storage, input and output functions of the physical components. In the various embodiments of the present application, the hardware system is also usually referred to as a motherboard or a main chip or a controller.

Refer to FIG. 1A, which is an application scenario diagram of a display device provided by some embodiments of this application. As shown in FIG. 1A, the control device 100 and the display device 200 can communicate in a wired or wireless manner.

Among them, the control device 100 is configured to control the display device 200, which can receive operation instructions input by the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, and act as an intermediary for the interaction between the user and the display device 200 effect. For example, the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the channel addition and subtraction operations.

The control device 100 may be a remote controller 100A, including infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc., to control the display device 200 in a wireless or other wired manner. The user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, etc. For example, the user can control the display device 200 by inputting corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, and power on/off keys on the remote control. Function.

The control device 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, and the like. For example, an application program running on a smart device is used to control the display device 200. The application can be configured to provide users with various controls through an intuitive user interface (UI) on the screen associated with the smart device.

Exemplarily, the mobile terminal 100B may install a software application with the display device 200, realize connection communication through a network communication protocol, and realize the purpose of one-to-one control operation and data communication. For example, the mobile terminal 100B can establish a control instruction protocol with the display device 200, and the functions of the physical keys arranged on the remote control 100A can be realized by operating various function keys or virtual controls of the user interface provided on the mobile terminal 100B. The audio and video content displayed on the mobile terminal 100B can also be transmitted to the display device 200 to realize the synchronous display function.

The display device 200 may provide a broadcast receiving function and a network TV function of a computer support function. The display device can be implemented as digital TV, Internet TV, Internet Protocol TV (IPTV), and so on.

The display device 200 may be a liquid crystal display, an organic light emitting display, or a projection device. The specific display device type, size and resolution are not limited.

The display device 200 also performs data communication with the server 300 through a variety of communication methods. Here, the display device 200 may be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 300 may provide various contents and interactions to the display device 200. For example, the display device 200 can send and receive information, such as receiving electronic program guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library. The server 300 can be one group or multiple groups, and can be one type or multiple types of servers. The server 300 provides other network service content such as video-on-demand and advertising services.

In some embodiments, as shown in FIG. 1B, the display device 200 includes a rotating assembly 276, a controller 250, a display 275, a terminal interface 278 protruding from a gap on the backplane, and a rotating assembly 276 connected to the backplane. The component 276 can cause the display 275 to rotate. Viewed from the front of the display device, the rotating component 276 can rotate the display screen to the vertical screen state, that is, the state where the vertical side length of the screen is greater than the horizontal side length, or it can rotate the screen to the horizontal screen state, that is, the screen horizontally. The state where the side length is greater than the vertical side length.

The configuration block diagram of the control device 100 is exemplarily shown in FIG. 2. As shown in FIG. 2, the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, a user output interface 150, and a power supply 160.

The controller 110 includes a random access memory (RAM) 111, a read only memory (ROM) 112, a processor 113, a communication interface, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components, and external and internal data processing functions.

Exemplarily, when an interaction of a user pressing a button arranged on the remote control 100A or an interaction of touching a touch panel arranged on the remote control 100A is detected, the controller 110 may control to generate a signal corresponding to the detected interaction, and This signal is sent to the display device 200.

The memory 120 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller 110. The memory 120 can store various control signal instructions input by the user.

The communicator 130 realizes the communication of control signals and data signals with the display device 200 under the control of the controller 110. For example, the control device 100 sends a control signal (such as a touch signal or a control signal) to the display device 200 via the communicator 130, and the control device 100 can receive the signal sent by the display device 200 via the communicator 130. The communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132. For example, in the case of an infrared signal interface, the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and sent to the display device 200 via the infrared sending module. For another example, in the case of a radio frequency signal interface, a user input instruction needs to be converted into a digital signal, which is then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency sending terminal.

The user input interface 140 may include at least one of a microphone 141, a touch panel 142, a sensor 143, a button 144, etc., so that the user can input user instructions for controlling the display device 200 to the control device through voice, touch, gesture, pressing, etc. 100.

The user output interface 150 outputs a user instruction received by the user input interface 140 to the display device 200, or outputs an image or voice signal received by the display device 200. Here, the user output interface 150 may include an LED interface 151, a vibration interface 152 that generates vibration, a sound output interface 153 that outputs a sound, a display 154 that outputs an image, and the like. For example, the remote controller 100A can receive output signals such as audio, video, or data from the user output interface 150, and display the output signals as images on the display 154, as audio on the sound output interface 153, or as output on the vibration interface 152. Vibration form.

The power supply 160 is used to provide operating power support for each element of the control device 100 under the control of the controller 110. The form can be battery and related control circuit.

FIG. 3 exemplarily shows a block diagram of the hardware configuration of the display device 200. As shown in FIG. 3, the display device 200 may include a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, Rotating component 276, audio processor 280, audio output interface 285, power supply 290.

Among them, the rotating assembly 276 may include components such as a drive motor and a rotating shaft. Among them, the driving motor can be connected to the controller 250 and output the rotation angle under the control of the controller 250; one end of the rotating shaft is connected to the power output shaft of the driving motor, and the other end is connected to the display 275, so that the display 275 can be fixedly installed on the rotating assembly 276. On the wall or bracket.

The rotating assembly 276 may also include other components, such as transmission components, detection components, and so on. Among them, the transmission component can adjust the rotation speed and torque output by the rotating assembly 276 through a specific transmission ratio, and can be a gear transmission mode; the detection component can be composed of sensors arranged on the rotating shaft, such as an angle sensor, an attitude sensor, and the like. These sensors can detect parameters such as the angle of rotation of the rotating component 276 and send the detected parameters to the controller 250 so that the controller 250 can determine or adjust the state of the display device 200 according to the detected parameters. In practical applications, the rotating assembly 276 may include, but is not limited to, one or more of the aforementioned components.

The tuner and demodulator 210, which receives broadcast television signals through wired or wireless means, can perform modulation and demodulation processing such as amplification, mixing and resonance, and is used to demodulate the television selected by the user from multiple wireless or cable broadcast television signals The audio and video signals carried in the frequency of the channel, as well as additional information (such as EPG data).

The tuner and demodulator 210 can be selected by the user and controlled by the controller 250 to respond to the frequency of the television channel selected by the user and the television signal carried by the frequency.

The tuner and demodulator 210 can receive signals in many ways according to different broadcasting formats of TV signals, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting; and according to different modulation types, it can be digital modulation or analog Modulation method; and according to different types of received TV signals, analog signals and digital signals can be demodulated.

In some other exemplary embodiments, the tuner demodulator 210 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs a TV signal after modulation and demodulation, and is input to the display device 200 through the external device interface 240.

The communicator 220 is a component used to communicate with external devices or external servers according to various types of communication protocols. For example, the display device 200 may transmit content data to an external device connected via the communicator 220, or browse and download content data from an external device connected via the communicator 220. The communicator 220 may include a network communication protocol module such as a WIFI module 221, a Bluetooth communication protocol module 222, and a wired Ethernet communication protocol module 223 or a near field communication protocol module, so that the communicator 220 can receive the control device 100 according to the control of the controller 250 Control signals, and implement the control signals as WIFI signals, Bluetooth signals, radio frequency signals, etc.

The detector 230 is a component of the display device 200 for collecting signals from the external environment or interacting with the outside. The detector 230 may include a sound collector 231, such as a microphone, which may be used to receive a user's voice, such as a voice signal of a control instruction for the user to control the display device 200; or, it may collect environmental sounds used to identify the type of environmental scene to realize display The device 200 can adapt to environmental noise.

In some other exemplary embodiments, the detector 230 may also include an image collector 232, such as a camera, a camera, etc., which may be used to collect external environment scenes to adaptively change the display parameters of the display device 200; and to collect The attributes of the user or interactive gestures with the user to achieve the function of interaction between the display device and the user.

In some other exemplary embodiments, the detector 230 may also include a light receiver, which is used to collect the ambient light intensity to adapt to changes in display parameters of the display device 200 and so on.

In some other exemplary embodiments, the detector 230 may also include a temperature sensor. For example, by sensing the ambient temperature, the display device 200 may adaptively adjust the display color temperature of the image. Exemplarily, when the temperature is relatively high, the color temperature of the display device 200 can be adjusted to be colder; when the temperature is relatively low, the color temperature of the display device 200 can be adjusted to be warmer.

The external device interface 240 is a component that provides the controller 250 to control data transmission between the display device 200 and external devices. The external device interface 240 can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), and additional information (such as EPG). ) And other data.

Among them, the external device interface 240 may include: a high-definition multimedia interface (HDMI) terminal 241, a composite video blanking synchronization (CVBS) terminal 242, an analog or digital component terminal 243, a universal serial bus (USB) terminal 244, and a component (Component) Any one or more of terminals (not shown in the figure), red, green and blue (RGB) terminals (not shown in the figure), etc.

The controller 250 controls the work of the display device 200 and responds to user operations by running various software control programs (such as an operating system and various application programs) stored on the memory 260.

As shown in FIG. 3, the controller 250 includes a random access memory (RAM) 251, a read only memory (ROM) 252, a graphics processor 253, a CPU processor 254, a communication interface 255, and a communication bus 256. Among them, the RAM 251, the ROM 252, the graphics processor 253, and the CPU processor 254 communication interface 255 are connected via a communication bus 256.

ROM252, used to store various system startup instructions. For example, when the power-on signal is received, the power of the display device 200 starts to start, and the CPU processor 254 runs the system start-up instruction in the ROM 252 to copy the operating system stored in the memory 260 to the RAM 251 to start running the start-up operating system. After the operating system is started up, the CPU processor 254 copies various application programs in the memory 260 to the RAM 251, and then starts to run and start various application programs.

The graphics processor 253 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics. The graphics processor 253 may include an arithmetic unit, which is used to perform operations by receiving various interactive instructions input by the user, and then display various objects according to the display attributes; and a renderer, which is used to generate various objects obtained based on the arithmetic unit, and perform The rendered result is displayed on the display 275.

The CPU processor 254 is configured to execute operating system and application program instructions stored in the memory 260. And according to the received user input instructions, to execute various applications, data and content processing, so as to finally display and play various audio and video content.

In some exemplary embodiments, the CPU processor 254 may include multiple processors. The multiple processors may include a main processor and multiple or one sub-processors. The main processor is configured to perform some initialization operations of the display device 200 in the display device preloading mode, and/or, to display screen operations in the normal mode. Multiple or one sub-processor, used to perform an operation in the standby mode of the display device.

The communication interface 255 may include the first interface to the nth interface. These interfaces may be network interfaces connected to external devices via a network.

The controller 250 may control the overall operation of the display device 200. For example, in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.

Among them, the object can be any one of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object, for example, the operation of displaying the page, document, image, etc. connected to the hyperlink, or the operation of executing the program corresponding to the object. The user input command for selecting the GUI object may be a command input through various input devices (for example, a mouse, a keyboard, a touch pad, etc.) connected to the display device 200 or a voice command corresponding to a voice spoken by the user.

The memory 260 is used to store various types of data, software programs or application programs for driving and controlling the operation of the display device 200. The memory 260 may include volatile and/or non-volatile memory. The term “memory” includes the memory 260, the RAM 251 and ROM 252 of the controller 250, or the memory card in the display device 200.

In some embodiments, the memory 260 is specifically used to store the operating program that drives the controller 250 in the display device 200; to store various application programs built in the display device 200 and downloaded from external devices by the user; and to store the configuration provided by the display 275 Data such as various GUIs, various objects related to the GUI, and visual effect images of the selector used to select GUI objects.

In some embodiments, the memory 260 is specifically used to store drivers and related data of the tuner and demodulator 210, the communicator 220, the detector 230, the external device interface 240, the video processor 270, the display 275, the audio processor 280, etc. For example, external data (such as audio and video data) received from an external device interface or user data (such as key information, voice information, touch information, etc.) received from a user interface.

In some embodiments, the memory 260 specifically stores software and/or programs for representing an operating system (OS). These software and/or programs may include, for example, a kernel, middleware, application programming interface (API), and/or application. Exemplarily, the kernel can control or manage system resources and functions implemented by other programs (such as the middleware, API, or application program); at the same time, the kernel can provide interfaces to allow middleware, API, or application program access control To control or manage system resources.

FIG. 4 exemplarily shows a block diagram of the architecture configuration of the operating system in the memory of the display device 200. The operating system architecture consists of the application layer, the middleware layer, and the kernel layer from top to bottom.

Application layer, system built-in applications and non-system-level applications belong to the application layer. Responsible for direct interaction with users. The application layer can include multiple applications, such as settings applications, e-post applications, media center applications, and so on. These applications can be implemented as web applications, which are executed based on the WebKit engine, and specifically can be developed and executed based on HTML5, Cascading Style Sheets (CSS) and JavaScript.

Here, HTML, the full name of HyperText Markup Language (Hyper Text Markup Language), is a standard markup language used to create web pages. Web pages are described through markup tags. HTML tags are used to describe text, graphics, animation, sounds, and tables. , Links, etc., the browser will read the HTML document, explain the content of the tags in the document, and display it in the form of a web page.

CSS, the full name of Cascading Style Sheets (Cascading Style Sheets), is a computer language used to express the style of HTML files, and can be used to define style structures, such as fonts, colors, and positions. CSS styles can be directly stored in HTML web pages or in separate style files to achieve control over styles in web pages.

JavaScript is a language used in web page programming, which can be inserted into HTML pages and interpreted and executed by the browser. The interaction logic of the web application is implemented through JavaScript. JavaScript can encapsulate the JavaScript extension interface through the browser to realize the communication with the kernel layer,

The middleware layer can provide some standardized interfaces to support the operation of various environments and systems. For example, the middleware layer can be implemented as the Multimedia and Hypermedia Information Coding Expert Group (MHEG) of the middleware related to data broadcasting, and can also be implemented as the DLNA middleware of the middleware related to external device communication, and can also be implemented as providing Display the middleware of the browser environment in which each application in the device runs.

The kernel layer provides core system services, such as file management, memory management, process management, network management, system security authority management and other services. The kernel layer can be implemented as a kernel based on various operating systems, for example, a kernel based on the Linux operating system.

The kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: providing display drivers for displays, camera drivers for cameras, button drivers for remote controls, and WIFI modules Provide WiFi driver, audio driver for audio output interface, power management driver for power management (PM) module, etc.

In Fig. 3, the user interface 265 receives various user interactions. Specifically, it is used to send the input signal of the user to the controller 250, or to transmit the output signal from the controller 250 to the user. Exemplarily, the remote control 100A may send input signals input by the user, such as a power switch signal, a channel selection signal, and a volume adjustment signal, to the user interface 265, and then the user interface 265 transfers to the controller 250; or the remote control 100A may Receive output signals such as audio, video, or data output from the user interface 265 after the controller 250 processes, and display the received output signal or output the received output signal as audio or vibration.

In some embodiments, the user may input a user command on a graphical user interface (GUI) displayed on the display 275, and the user interface 265 receives the user input command through the GUI. Specifically, the user interface 265 may receive user input commands for controlling the position of the selector in the GUI to select different objects or items. Among them, "user interface" is a medium interface for interaction and information exchange between application programs or operating systems and users, and it realizes the conversion between the internal form of information and the form acceptable to users. The commonly used form of the user interface is a graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It can be an icon, window, control and other interface elements displayed on the display screen of an electronic device. The control can include icons, controls, menus, tabs, text boxes, dialog boxes, status bars, channel bars, Widgets, etc. Visual interface elements.

Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user interface 265 recognizes the sound or gesture through the sensor to receive the user input command.

The video processor 270 is used to receive external video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal. The video signal displayed or played directly on the display 275.

For example, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.

Among them, the demultiplexing module is used to demultiplex the input audio and video data stream, such as the input MPEG-2 stream (based on the compression standard of digital storage media moving images and voice), then the demultiplexing module will demultiplex it Multiplexed into video signals and audio signals, etc.

The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

An image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator with the zoomed video image according to user input or itself to generate an image signal for display.

The frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of the input 60Hz video to a frame rate of 120Hz or 240Hz, and the usual format is realized by such as frame interpolation.

The display formatting module is used to change the signal output by the frame rate conversion module to a signal conforming to the display format such as a display, for example, format the signal output by the frame rate conversion module to output RGB data signals.

The display 275 is used to receive the image signal input from the video processor 270 to display video content, images, and a menu control interface. The displayed video content can be from the video content in the broadcast signal received by the tuner and demodulator 210, or from the video content input by the communicator 220 or the external device interface 240. The display 275 simultaneously displays a user manipulation interface UI generated in the display device 200 and used to control the display device 200.

And, the display 275 may include a display screen component for presenting a picture and a driving component for driving image display. Alternatively, if the display 275 is a projection display, it may also include a projection device and a projection screen.

Rotating the component 276, the controller can send a control signal to make the rotating component 276 rotate the display 255.

The audio processor 280 is used to receive external audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing, so that it can be stored in the speaker 286 The audio signal to be played.

Exemplarily, the audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), High Efficiency AAC (HE-AAC) and other formats.

The audio output interface 285 is used to receive the audio signal output by the audio processor 280 under the control of the controller 250. The audio output interface 285 may include a speaker 286, or output to an external audio output terminal 287 of a generator of an external device, such as a headset Output terminal.

In some other exemplary embodiments, the video processor 270 may include one or more chips. The audio processor 280 may also include one or more chips.

And, in some other exemplary embodiments, the video processor 270 and the audio processor 280 may be separate chips, or may be integrated with the controller 250 in one or more chips.

The power supply 290 is used to provide power supply support for the display device 200 with power input from an external power supply under the control of the controller 250. The power supply 290 may be a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200.

For the display device 200, an instruction can be issued by the controller 250 to control the driving motor of the rotating assembly 276 to rotate a preset angle according to the direction indicated by the instruction, so as to drive the display 275 to rotate to the preset angle. Generally, in order to adapt to different viewing needs, multiple rotation angles can be preset to make the display 275 in different rotation states. For example, the rotation state may include a horizontal screen state and a vertical screen state, wherein the horizontal screen state means that the long side of the screen of the display 275 is parallel to the ground (or horizontal plane), and the short side is perpendicular to the ground (or horizontal plane), as shown in FIG. 5A As shown; the vertical screen state means that the short side of the screen of the display 275 is parallel to the ground (or horizontal plane), and the long side is perpendicular to the ground (or horizontal plane) as shown in FIG. 5B.

Obviously, the horizontal screen state is more suitable for playing media assets with a horizontal screen ratio of 16:9, 4:3, etc., such as regular video resources such as movies and TV shows. The vertical screen state is more suitable for playing media assets with a vertical screen ratio of 9:16, 3:4, etc., for example, short videos, comics, etc. shot through terminals such as mobile phones.

It should be noted that although the horizontal screen state is mainly used to display horizontal media assets such as TV series and movies, and the vertical screen state is mainly used to display vertical media assets such as short videos and comics, the above-mentioned horizontal screen state and vertical screen state are only two types. Different display states do not limit the displayed content. For example, vertical media assets such as short videos and comics can still be displayed in the horizontal screen state; horizontal media assets such as TV series and movies can still be displayed in the vertical screen state, but the inconsistent display window needs to be zoomed in this state. Adjustment.

Different rotation states correspond to different rotation angles of the rotating assembly 276. In practical applications, if the rotation angle of the rotating component 276 is defined as 0 degrees in the horizontal screen state of the display 275, the rotating angle of the rotating component 276 in the vertical screen state of the display 275 is 90 degrees (or -90 degrees). In addition to the above-mentioned horizontal screen state and vertical screen state, the rotating component 276 can also drive the display 275 to rotate at any angle, for example, a 180-degree inverted screen state.

When the display device 200 plays certain videos, the display 275 needs to be automatically rotated to adapt to different forms of video resources. For example, when the display 275 is in the horizontal screen state, the user chooses to play vertical screen media assets such as short videos. The operating system of the display device 200 can detect that the aspect ratio of the video resource is less than 1, and the current screen aspect ratio of the display 275 is greater than 1, that is, it is determined that the current rotation state does not match the video resource, thereby automatically sending control to the rotation component 276 Instruct it to drive the display 275 to rotate 90 degrees clockwise (or counterclockwise) to adjust the display 275 to the vertical screen state.

When the display device 200 displays a video image, it may also perform image quality processing on the video image through an image quality adjustment algorithm. The image quality processing may include processing the image on each frame of the video picture, such as color correction, color adjustment, etc., and may also include processing the multi-frame data of the video picture, such as frame interpolation algorithm, motion compensation, etc. Through image quality processing, the image display quality can be further improved, so as to have a better viewing experience under the same equipment configuration and without increasing the size of the video source resource.

Generally, in order to display a video screen on the display 275, multiple display processing levels are configured in the system framework of the display device 200, such as a video layer (Video layer), an OSD layer (On-Screen Display layer), and so on. Wherein, the video layer refers to the display level used to present the play screen on the display device 200 after the user plays the media assets, and may also be referred to as the image quality layer of the display device 200. The playback screen corresponding to the media assets can be displayed in the image quality layer. The OSD layer refers to a display level used to provide interactive operations for users, and may also be referred to as a UI (User Interface) layer of the display device 200. Among them, the video layer can perform image quality processing on the displayed image, and the OSD layer can perform post-adjustment of the displayed image, such as rotation and zooming. In addition, the OSD layer as the UI layer can also add various interactive controls to the display screen, such as controlling the homepage, so as to manually adjust the screen.

For the rotatable display device 200, due to the large size and weight of the display 275, the rotating assembly 276 cannot quickly rotate the display 275 to a preset angle. Therefore, the user needs to wait for a certain period of time to be normal during the rotation of the display 275. Watch video resources. For example, it takes 10-30 seconds for the display 275 to rotate from the horizontal screen state to the vertical screen state. During this time, as the display 275 rotates, the image originally presented on the display 275 will be tilted until the display 275 is completely rotated to After the vertical screen state (or after rotating to a preset angle), the display screen can be adjusted to rotate and fill the screen. It can be seen that during this period, the user needs to watch the tilted picture for a long time, which seriously affects the user experience.

In view of this, the present application can rotate the display screen while rotating the display 275, so that the display screen is in a positive state, so that the user can view the display screen normally during the process of rotating the display 275. Moreover, in practical applications, it is more desirable to adjust the display picture while rotating the display 275, so as to improve the picture quality of the picture displayed during the rotation process as much as possible. Usually, the adjustment of the picture includes the rotation of the display picture and the adjustment of the picture quality of the display picture. However, in practical applications, the image quality processing and the rotation adjustment for the rotation process cannot be performed at the same time, so that the rotating TV has to abandon the image quality processing of the display screen during the rotation process and only performs the rotation adjustment.

Taking the display device 200 based on the Android system as an example, when playing a video, if you want to achieve dynamic arbitrary angle rotation of the video, you can use the setRotation API of the view to set the angle information in real time to achieve the rotation effect. However, due to hardware specifications, the display device 200 can only perform image rotation when the video is output using the OSD layer, and cannot perform image rotation when the video is output using the video layer. At the same time, for the display device 200, in order to perform image quality processing on the video to improve the display effect, the video should be output using the video layer and processed for image quality. It can be seen that the existing display device 200 of the Android system cannot realize a video display mode that can perform image quality processing and can rotate at any angle.

In order to achieve simultaneous image quality processing and rotation adjustment on the display screen during the rotation process, this application provides a video screen rotation method, as shown in Figures 6 and 7. The video screen rotation method provided by this application includes the following steps :

S1: Obtain the video image to be displayed.

The video picture to be displayed refers to the picture being played by the display device 200 when the user manipulates the display 275 to rotate. For example, the current display 275 is in a horizontal screen state, and the user performs an interactive operation by controlling the device 100 to open a short video application and play any short video in a vertical screen state. After the controller 250 detects that the currently played short video picture is in the vertical state, it automatically controls the rotation component 276 to rotate, thereby rotating the display 275 to the vertical state. Since it takes 10-30s to adjust the display 275 from the horizontal screen state to the vertical screen state, the short video content corresponding to the 10-30s time is the video image to be displayed.

Obviously, the video screen to be displayed is not limited to the played video screen itself, but also includes the UI interface provided by the operating system at this time, such as the operation homepage, the playback interface with operation controls, and so on. In practical applications, the controller 250 may extract the currently displayed picture by executing the operating program, that is, obtain each frame of the video one by one to obtain the to-be-displayed video picture. The display device 200 can also select a normal frame rate or a high frame rate acquisition frequency mode according to its own hardware configuration level. For example, for the display device 200 with a higher computing performance of the controller 250, the acquisition frequency can be obtained at a frame rate of 60 Hz or higher. However, for the display device 200 with low computing performance of the controller 250, an acquisition frequency of 30 Hz or lower can be used, but it is necessary to ensure that the display screen can still meet the basic fluency requirements after subsequent processing.

S2: Perform image quality processing on the to-be-displayed video picture through the video layer.

After the controller 250 acquires the to-be-displayed video image, it needs to first perform image quality processing on the to-be-displayed video image in the video layer, so as to improve the display effect of the image. The image quality processing may include processing for multi-frame images and processing for single-frame images. Among them, processing for multi-frame images can improve the dynamic effect of the video picture. For example, for video content that requires motion compensation, after acquiring the video image to be displayed, the built-in motion compensation algorithm program in the operating system can be run, and the built-in motion compensation hardware of the display device 200 can be invoked, which can be used between multiple frames of the motion video. Insert motion compensation frames to increase the display frame rate of the motion video screen and achieve the effect of motion compensation.

The processing of a single frame image can provide the image quality of the video image to be displayed, such as color, clarity, and resolution. For example, after acquiring the video image to be displayed, each frame of the image can be extracted separately, and then by reading the color value of each pixel on each frame of The color value of the frame image is adjusted to optimize the color according to the use scene of the screen.

S3: Generate an intermediate image.

After the to-be-displayed video screen undergoes image quality processing, the controller 250 may call related services to perform image interception on the output image after the image quality processing, thereby generating an intermediate image. Therefore, the intermediate image is video frame data obtained by intercepting the output image after the image quality processing of the to-be-displayed video image is output. The effect of adjusting the image quality of the display screen can be retained through the interception method, and the image display quality can be improved.

In practical applications, if the controller 250 has sufficient computing power, it can capture the output image frame by frame after the image quality processing, that is, the frame rate of the video image after the image quality processing is equal to the image capture frequency, and it is specific to each output image. Take screenshots for every frame. For example, after processing by the motion compensation algorithm, the frame rate of the video image to be displayed is 60 Hz, and the intercepting frequency of the controller 250 is also 60 Hz, that is, 60 frames of images are intercepted per second. Such an image interception method can not only maintain the image quality of the output image of the video layer, but also maintain the smoothness of the video image to be displayed after the image quality processing.

When the processing performance of the controller 250 is weak, the output image after the image quality processing can be intercepted at intervals, but in order to ensure the dynamic effect of the video, the intercepting frequency should not be too low. For example, the frame rate of the original video to be displayed is 60 Hz, but the current processing performance of the controller 250 cannot meet the interception requirement of 60 frames per second. Therefore, the interception frequency can be reduced to 30Hz, that is, an interception is performed every frame, 30 frames of images are intercepted per second, and the corresponding video frame rate of the intermediate image output after interception becomes 30Hz.

It should be noted that the frequency of intercepting the display screen can also be adjusted according to actual application scenarios. For example, when the display device 200 plays media assets that require motion compensation such as action movies, live sports events, etc., the interception frequency of the video screen can be increased, so that the video to be displayed will not have obvious frame drop or freeze; and when When the display device 200 performs static image presentations or plays ordinary short videos and other media assets that do not require motion compensation, the frequency of capturing video images can be appropriately reduced to reduce the load on the controller 250.

S4: Rotate the intermediate image through the OSD layer to generate a rotated image.

In order to ensure that the rotation of the TV does not affect the user's viewing, the displayed picture can be rotated at the same time during the rotation of the display 275. For example, the display 275 needs to rotate counterclockwise from the horizontal screen state to the vertical screen state within 15s; the display screen can be rotated clockwise through the OSD layer service within 15s to keep the screen displayed on the display 275 always positive Towards.

Wherein, the process of rotating the intermediate image can be determined according to the rotation instruction input by the user, or according to the current angle of the display 275. The rotation instruction refers to an instruction used to control the rotation of the rotating component, and may include a trigger signal and a designated rotation angle. After obtaining the rotation instruction, the controller can calculate the rotation angle of the display 275 per unit time according to the time it takes for the display 275 to rotate to the specified state, so as to synchronize the rotation service set to the OSD layer, so that the service can rotate according to the rotation angle per unit time And the current time to determine the amount of angle that needs to be rotated on the display screen.

As the display 275 rotates, as the rotation progresses, the display 275 will be at a different angle, so the display screen during the rotation process needs to be rotated by an angle corresponding to the rotation angle of the display 275 to ensure that the screen stays in Positive. For example, when the display 275 rotates clockwise to 30 degrees, the display 275 is in a tilted state, and the display screen needs to be rotated 30 degrees counterclockwise to ensure that the display screen is positive.

S5: Display the rotated image frame by frame.

After the display screen is rotated, a video stream can be formed according to the generated rotated image. At this time, the formed video stream can be displayed on the display 275. Since the displayed image is rotated, it can adapt to the rotation process of the display 275 during display, so that during the rotation of the display 275, the display screen is always displayed in the forward direction to avoid affecting the user's viewing effect. In addition, the rotated image is the image after the image quality processing is intercepted by the screen, so the displayed video image also obtains the effect after the image quality processing, that is, it is realized that the display image is rotated and adjusted during the rotation of the display 275. The image quality of the display screen has been processed.

In an implementation manner, as shown in FIG. 8, the step of obtaining a to-be-displayed video picture, the method further includes:

S101: Create a video layer service and player;

S102: Deliver the handle of the video layer service to the player;

S103: Invoke the player to decode the to-be-displayed video image, and send the decoded, to-be-displayed video image to the video layer service.

In actual applications, a service that implements the video screen rotation method of this application can be created as the system starts up. The created service will be kept in the memory after the system is started up to monitor the video playback status. When the user issues an instruction to control the display device 200 to rotate, or when the system realizes rotation through automatic judgment, the created service can be called to execute the corresponding video screen rotation method.

Among them, in order to realize image processing at different layers, a video layer service (surface view) and a player can be created upon startup, and the handle of the video layer service can be sent to the player so that it can be called when the video is played. The player first performs operations such as demultiplexing and decoding of the video image to be displayed, and sends the decoded video image to the video layer service by calling the handle of the video layer service.

In an implementation manner, as shown in FIG. 9, the step of generating an intermediate image includes:

S301: Create an interception service;

S302: Obtain an output image;

S303: Invoke the interception service to intercept the output image, and obtain the intermediate image.

Wherein, the interception service is used to intercept the video frame data. The interception service can also be created when the system is started and initialized, and when the display screen needs to be rotated, the service is called to intercept the video layer data in real time and send it to the OSD layer for display . In this application, the to-be-displayed video screen that has undergone image quality processing may form an output image, that is, the output image is image data obtained after the image-quality processing of the to-be-displayed video screen is processed. Obviously, the output image may have a different frame rate and/or different image effects from the original image to be displayed.

For example, after the video layer completes (or partially completes) the image quality processing of the to-be-displayed video image, the created interception service can be invoked, and the image quality processed output image can be obtained in the video layer. For the output image, the interception service can intercept frame by frame or interval frame interception to obtain intermediate images.

In an implementation manner, as shown in FIG. 10, the step of rotating the intermediate image through the OSD layer to generate a rotated image further includes:

S41: Obtain display rotation information;

S42: Set the screen rotation direction and screen rotation angle;

S43: Rotate the intermediate image according to the screen rotation direction and the screen rotation angle.

After acquiring the intermediate image, the controller 250 can determine the current display rotation information by reading the angle sensor provided on the rotation component 276 or the gravity acceleration sensor built in the display 275. Obviously, the display rotation information includes the display rotation direction and the display rotation angle. The rotation direction of the display can be obtained from the rotation instruction. For example, the rotation instruction specifies that the display 275 rotates from the horizontal screen state to the vertical screen state, and the display rotation direction in the display rotation information is counterclockwise. The rotation angle of the display can be obtained from a value detected by an angle sensor or a gravity acceleration sensor. In practical applications, the rotation angle of the display refers to an angle value relative to the horizontal screen state (0 degree state).

After obtaining the display rotation information, the controller 250 may set the rotation mode of the screen according to the display rotation information, that is, set the screen rotation direction and the screen rotation angle. Wherein, the screen rotation direction is opposite to the display rotation direction, and the screen rotation angle is equal to the display rotation angle. For example, if it is determined by the display rotation information that the current display 275 is rotated counterclockwise by 35 degrees, then the screen rotation direction is set to clockwise and the screen rotation angle is set to 35 degrees. Finally, the controller 250 rotates the intermediate image according to the screen rotation direction and the screen rotation angle. For example, keep the intermediate image rotated by 35 degrees clockwise.

In an implementation manner, as shown in FIG. 11, in order to perform a screen rotation operation, the method further includes:

S401: Create a rotation service;

S402: Obtain the rotation instruction input by the user;

S403: If the rotation instruction is obtained, call the rotation service to obtain display rotation information.

Wherein, the rotation service is used to rotate the display screen. Obviously, the rotation service is based on the OSD layer, and it can also be automatically created when the display device 200 is turned on, and called and executed after the rotation instruction is obtained. The rotation instruction is used to drive the rotation assembly 276 to drive the display 275 to rotate, so that the display 275 is in one of a variety of rotation states.

Therefore, in this embodiment, after the rotation service is created, the rotation instruction input by the user may be obtained, and after the rotation instruction input by the user is obtained, the rotation service may be invoked to obtain display rotation information. When the rotation instruction is not obtained, the rotation service can be kept in an inactive state to avoid occupying the memory space of the display device 200.

In an implementation manner, as shown in FIG. 12, in order to rotate the intermediate image, the step of obtaining display rotation information includes:

S411: Monitor the angle callback interface of the rotating component;

S412: Obtain the current rotation angle of the display through the angle callback interface, and generate the display rotation information.

The rotation component 276 is provided with an angle callback interface. The angle callback interface is a unified standard interface set by the operating system to adapt to the display rotation process, and is used to obtain the rotation angle of the rotating component 276 in real time. The angle callback interface can detect the angle rotated by the rotating component 276 in real time through an angle sensor, so as to determine the corresponding posture at any time during the rotation of the display 275.

Therefore, by monitoring the angle callback interface of the rotation component 276, the current rotation angle of the display 275 can be determined, and combined with the display rotation direction specified in the rotation instruction, the display rotation information can be generated.

In one implementation, after the step of rotating the intermediate image through the OSD layer to generate the rotated image, the method further includes: locating the current boundary position of the display 275 according to the display rotation information; The rotated image is cropped; or, the rotated image is scaled according to the current boundary position.

In practical applications, after the display 275 is rotated to the tilted state, the boundary position of the display 275 will also change, and if the display screen is in the forward display state, the tilted display 275 will not be able to display the forward screen normally. For example, as shown in Figure 13, areas that cannot be displayed appear in the upper right and lower left corners of the screen, while blank areas appear in other edge positions. For this reason, after acquiring the display rotation information at any time, the position of the border of the display 275 at the current time can be determined according to the display rotation information, and then the rotated image is cropped according to the current border position and the blank area is filled, for example, according to the display 275 screen border position, cut the upper right corner and lower left corner of the screen to be able to maintain the current state to complete the display of the screen; and also fill the other edge positions of the screen with a solid color background to improve the display quality.

After the step of generating the rotated image, the rotated image can also be scaled according to the current boundary position, that is, the rotated image can be scaled according to the maximum forward image display area that the screen of the display 275 in the current tilt state can accommodate. Since the tilt state of the screen of the display 275 is constantly changing during the rotation process, the maximum positive image area that can be accommodated is also constantly changing. Therefore, the rotated image can be gradually scaled according to the rotation process to achieve a smooth transition display effect.

That is, in an implementation manner, as shown in FIG. 14, the step of scaling the rotated image according to the current boundary position includes:

S441: According to the display rotation information, locate the current display window position and the target display window position;

S442: Compare the position of the target display window with the position of the current display window to generate a width and height deformation amount;

S443: Generate zoom step size;

S444: Adjust the width and height values of the rotated image according to the zoom step.

Wherein, the current display window position and the target display window position refer to the position of the screen display window before and after the rotation of the display 275 corresponding to the rotation state of the display 275. For example, when the display 275 needs to be rotated from the horizontal screen state to the vertical screen state, the screen position corresponding to the displayed video in the horizontal screen state is the current display window position; and the display 275 correspondingly displays the played video in the vertical screen state after rotation The screen position of is the target window position.

In the same way, when the display 275 needs to be rotated from the vertical screen state to the horizontal screen state, the screen position corresponding to the displayed video in the vertical screen state is the current display window position; and the display 275 corresponds to the horizontal screen state after rotation. The screen position of the playing video is the target window position.

In this embodiment, in order to ensure that the display screen is always able to fill the display area of the display 275 during the rotation of the display 275, and to ensure the quality of the display screen, the display screen can be rotated at the same time. Perform equal scaling.

Specifically, after the media asset screen is played, the target display window position can be determined according to the rotation angle and the screen size characteristics of the display 275. For example, if it is necessary to switch from the horizontal screen state to the vertical screen state, the extracted rotation angle is 90 degrees counterclockwise, so as to determine that the predetermined target window position is the position corresponding to the playback area in the vertical screen state.

After the target display window position is determined, the width and height deformation amount of the display window can be determined by comparing the target display window position with the current display window position. For example, the size of a 65-inch monitor is 1440×810 (mm), and when the media is displayed vertically in the landscape mode, the height of the display screen is less than or equal to the height of the monitor 275, that is, less than or equal to 810mm, while in the portrait mode The vertical media information displayed in the bottom can be less than or equal to 1440mm in height (the width of the display in the horizontal screen state), so it can be determined that the display screen height deformation is 1440-810=630mm. In the same way, the amount of width deformation can be calculated according to the aspect ratio of the vertical media assets.

After the width and height deformation amount is determined, the width and height zoom amount per unit time can be calculated according to the width and height deformation amount and the rotation speed of the rotating component 276, that is, the zoom step size is generated. The zoom step size is the width and height zoom amount per unit time calculated according to the width and height deformation amount and the rotation speed of the rotating component. For example, if the display 275 is to be rotated from the horizontal screen state to the vertical screen state in 15s, the height zoom step is 630/15=42mm/s. Similarly, according to the amount of deformation of the width, the zoom step of the width can also be calculated.

After determining the zoom step for the height and width of the display screen respectively, the width and height values of the display screen window can be adjusted at the same time according to the zoom step. Therefore, when the display 275 rotates to the target state, the display screen just fills the display area of the display 275, which improves the user experience.

In order to obtain a better display effect, in the step of simultaneously adjusting the width and height values of the display window according to the zoom step, the controller 250 may also be configured as the following program steps: locate the zoom base point coordinates in the current display window; and The zoom base point coordinates are used as a reference, and the width and height values of the display screen window are synchronously adjusted according to the zoom step length.

The zoom base point can be positioned according to the shape and adjustment mode of the display window. For example, the center point of the display window can be selected as the zoom base point, so that the position of the base point is fixed before and after the display screen is rotated. One of the four vertices of the window boundary can also be used as the zoom base point, such as the upper left vertex.

It can be seen from the above technical solutions that the present application provides a method for rotating a video image, which can perform image quality processing on the video layer after acquiring the video image to be displayed. The intermediate image is obtained by intercepting the output image after the image quality processing, and the intermediate image is rotated through the OSD layer to generate the rotated image. Finally, the rotating image is displayed frame by frame to realize the dynamic rotation of the video image at any angle during the video playback process, and at the same time, the corresponding image quality processing is performed on the video image to improve the image display effect.

Based on the above video image rotation method, the present application also provides a display device, including: a display 275, a rotation component 276, and a controller 250. Wherein, the display 275 and the rotating component 276 both establish a data connection relationship with the controller 250, so as to control the display process of the display 275 and the rotating process of the rotating component 276 through the controller 250, respectively. The rotating component 276 is also configured to drive the display 275 to rotate, so that the display 275 is in one of a variety of rotating states.

As shown in FIG. 6, the controller 250 is configured to execute the following program steps:

S1: Obtain the video image to be displayed;

S2: Perform image quality processing on the to-be-displayed video picture through the video layer;

S3: generating an intermediate image; the intermediate image is the video frame data obtained by intercepting the output image after the image to be displayed is output through image quality processing;

S4: Rotate the intermediate image through the OSD layer to generate a rotated image;

S5: Control the display to display the rotated image frame by frame.

In practical applications, the controller 250 can be configured to: the application creates an interception service, which is used to intercept frame data from the video layer in real time and transmit the data to the OSD layer; and then the application creates a surfaceview (video layer) service and plays And send the handle of the surfaceview to the player; and create a surface service for OSD layer output. The controller 250 is also called by the application player to perform demultiplexing, decoding, and other operations, and the decoded data is sent to the video layer; the data is processed through the video layer for image quality; and the interception service is executed to intercept the video layer data in real time. And send it to the OSD layer for display; and the application sets the rotation angle information to the OSD layer through the service to realize the video rotation and display.

It can be seen from the above technical solutions that the present application also provides a display device 200, which includes a display 275, a rotating component 276, and a controller 250. The controller 250 can control the rotation of the rotating assembly 276 to drive the display 275 to rotate by a preset angle. In addition, in the process of controlling the rotation of the display 275, it is also possible to perform rotation and image quality processing on the displayed video screen simultaneously. The controller 250 can intercept the frame data that has completed the image quality processing from the video layer to the OSD layer for rotation processing, so that it can perform image quality processing on the to-be-displayed video image and rotate the video at any angle.

Refer to FIG. 15A, which is a schematic diagram of the horizontal screen state of the display device in FIG. 1 provided by some embodiments of this application. The operation mode when the display 275 is in the horizontal screen state may be referred to as the horizontal screen media viewing mode, and the operation mode when the display 275 is in the vertical screen state may be referred to as the vertical screen media viewing mode. In FIG. 15, what can be visually seen is the display 275 in the display device 200, and the controller 250 in the display device 200 is further communicatively connected with the server 300 for calling the interface of the server 300 to obtain corresponding data. The display 275 in the display device 200 can be driven to rotate by the rotating component 276 and used to display a user interface. In practical applications, the user can control the play mode, play content, etc. of the display device 200 through the control device 100, where the play mode includes a horizontal screen media viewing mode and a vertical screen media viewing mode.

In one implementation, the display device 200 includes a rotating component 276 that can fix the display device 200, and can control the rotation of the display 275 under the control of the controller 250 so that the display 275 is in a landscape state or Portrait state. The rotating component 276 can be fixed on the back of the display 275. The rotating component 276 is used for fixing to the wall, and the rotating component 276 receives the control command of the controller 250 to rotate the display 275 in a vertical plane, so that the display 275 is in the vertical plane. Horizontal screen state or vertical screen state.

Wherein, the horizontal screen state refers to a state in which the length (width) in the horizontal direction of the display 275 is greater than the length (height) in the vertical direction when viewed from the front of the display 275; the vertical screen state refers to, When viewed from the front of the display 275, the length (width) of the display 275 in the horizontal direction is smaller than the length (height) in the vertical direction. Obviously, the vertical direction in this application refers to substantially vertical, and the horizontal direction also refers to substantially horizontal.

Driven by the rotating component 276, the display 275 can be rotated 90 degrees clockwise or counterclockwise, so that the display 275 is in a vertical screen state, as shown in FIG. 15B. In the vertical screen state, the display can display the user interface corresponding to the vertical screen state, and has the interface layout and interaction mode corresponding to the vertical screen state. In the vertical screen media asset viewing mode, users can watch short videos, comics and other vertical screen media assets. In the same way, since the controller 250 in the display device 200 is further in communication with the server 300, it is possible to obtain the media asset data corresponding to the vertical screen by calling the interface of the server 300 in the vertical screen state.

The vertical screen state is more suitable for playing media assets with a vertical screen ratio of 9:16, for example, short videos shot through terminals such as mobile phones. Since terminal devices such as mobile phones mostly adopt vertical screen ratios such as 9:16 and 9:18, when the terminal is connected to the display device 200 and the terminal screen is displayed through the display device 200, the vertical screen state can avoid the transitional scaling of the screen. Make full use of the display screen of the display 275 to have a better user experience.

It should be noted that the horizontal screen state is mainly used to display horizontal media assets such as TV series and movies, and the vertical screen state is mainly used to display vertical media assets such as short videos and comics. The above-mentioned horizontal screen state and vertical screen state are just two different display states, and do not limit the displayed content. For example, vertical media assets such as short videos and comics can still be displayed in the horizontal screen state; in the vertical screen state Horizontal media assets such as TV series and movies can still be displayed, but the inconsistent display windows need to be compressed and adjusted in this state.

The display device 200 can provide the user with a display screen through the display 275, and can provide multiple display levels, such as an image quality layer, a UI layer, and so on. Wherein, the image quality layer refers to the display level used to present the play screen on the display device 200 after the user plays the media assets, and may also be referred to as the Video layer of the display device 200. The playback screen corresponding to the media assets can be displayed in the image quality layer. The UI layer (User Interface) refers to a display level for providing interactive operations for users, and may also be referred to as an OSD (On-Screen Display) layer of the display device 200. The UI layer can display various interactive controls, such as controlling the homepage.

According to different rotation states of the display 275, the home page mode presented on the display 275 is also different. For example, in an implementation manner, the display device 200 detects that the current display 275 is in a landscape state when the display device 200 is started. Then the controller 250 requests to call the interface of the server 300, and sends a request for acquiring the horizontal screen homepage data to the server 300. The server 300 responds to the acquisition request, and delivers the horizontal screen homepage data to the controller 250. The controller 250 recognizes the horizontal homepage data, and controls the display 275 to display the horizontal homepage based on the horizontal homepage data.

In another implementation manner, when the display 275 is in the vertical screen state, in response to the operation instruction, the rotating component 276 is controlled to rotate so that the display 275 is converted from the current vertical screen state to the horizontal screen state, and the interface of the server 300 is requested to be called , To send a request for acquiring the horizontal screen homepage data to the server 300. The server 300 responds to the acquisition request, and delivers the horizontal screen homepage data to the controller 250. The controller 250 recognizes the horizontal homepage data, and controls the display 275 to display the horizontal homepage based on the horizontal homepage data.

In order to obtain a better viewing experience, when different media assets are displayed, the horizontal screen state and the vertical screen state of the display 275 can be adjusted by rotating the component 276. That is, the display 275 can be rotated according to user needs, and the user can send an operation instruction to trigger rotation to the controller 250 according to viewing needs, and the controller 250 receives and responds to the operation instruction sent by the user to trigger rotation to switch the rotation state of the display 275 , The rotation state can include the horizontal screen state or the vertical screen state, the horizontal screen state corresponds to the horizontal screen media asset viewing mode, and the vertical screen state corresponds to the vertical screen media asset viewing mode.

In an implementation manner, the controller 250 of the display device 200 can determine whether the display 275 needs to be rotated by detecting the aspect ratio displayed in the display 275. For example, if the user plays a short video, comics and other vertical media assets in the horizontal screen state, the controller 250 can detect that the vertical media assets do not match the current horizontal screen state, and automatically control the rotating component 276 to Rotate the display 275 by 90 degrees to adjust to the portrait state.

Since the rotating process of the rotating component 276 is relatively slow, the user needs to watch the tilted picture for a long time during the rotating process. For example, the display 275 needs to be rotated 90 degrees clockwise from the horizontal screen state to the vertical screen state, and the rotation process takes 15s in total. In 15s, the picture in the display 275 will continue to tilt with the rotation of the display 275 until the display 275 rotates to After the vertical screen state, turn the screen 90 degrees counterclockwise to display the vertical screen.

In order to reduce the tilting time and improve the user experience, the present application can synchronize the rotation of the display screen at the image quality layer, so that the screen displayed on the display 275 is always positive during the rotation process. The image quality layer is a display level in the operating system corresponding to the display device 200. Different from the UI layer, the image quality layer can easily adjust the image quality, zoom ratio, and direction of the screen. Generally, the playback screen corresponding to the media assets is displayed in the image quality layer. Therefore, synchronous rotation at the image quality layer can adjust all media assets without considering the source of the video resources.

When the user plays a media asset that does not match the current rotation state, the display 276 needs to be rotated to adapt to the inconsistent media asset image. The specific processing is as follows:

First, select the video to play. Users can perform video playback through a series of operations on the UI interface according to their own needs. For example, the user can perform operations on the control device 100, and select "Featured"-"My Application"-"Short Video" on the homepage to enter the short video application interface. And in the application interface corresponding to the short video, select any video to play. Obviously, in this application, video resources include local, DLNA (Digital Living Network Alliance, Digital Living Network Alliance) push, DMS (Database Management System, database management system) sharing and other sources of video resources.

In order to adapt to different displays, the homepage for the user to operate can also include two forms of horizontal screen homepage and vertical screen homepage, and in different homepage modes, the content that can be presented can also be different. For example, in the horizontal homepage mode, the homepage can present more types of horizontal media assets or links such as movies and TV series for users to directly select and play. Vertical media assets can be classified into one or more controls, such as the "short video" application icon. Users need to click on the corresponding controls before they can select vertical media assets or links to play.

Secondly, detect the played video. After the user determines the video resource to be opened, the controller 250 decodes the video resource and converts it into a video image for display on the display 275. While controlling the display 275 to display the video picture, the controller 250 can also detect the display aspect ratio of the picture and the rotation state of the display 275 to determine whether the currently displayed picture aspect ratio is compatible with the current rotation state of the display 275.

For example, if the currently displayed screen is vertical media assets and the display 275 is in the vertical screen state, the aspect ratio of the currently displayed screen is adapted to the current rotation state of the display 275, and no rotation adjustment is required; if the currently displayed screen is Vertical media resources, but the display 275 is in a landscape state, the aspect ratio of the currently displayed picture is not suitable for the current rotation state of the display 275, and rotation adjustment is required.

Finally, make rotation adjustments. In the case that rotation adjustment is required, the controller 250 triggers the rotation of the rotation component 276 to adjust the rotation state of the display 275; at the same time, the displayed image can be rotated in the opposite direction in the image quality layer, so that the displayed image can be displayed on the display. During the rotation of the 275, it always maintains the status of positive display.

For example, if the currently playing screen is a vertical media resource, and the current display 275 is in a landscape state, the controller 250 sends an instruction to control the rotation of the rotation component 276 on the one hand, so that the rotation component 276 can drive the display 275 to rotate clockwise. 90 degrees, adjust the rotation state of the display 275 to the vertical screen state. The current display screen can be adjusted in the image quality layer, and the current display screen can be rotated and/or zoomed so that the current display screen can be smoothly rotated 90 degrees counterclockwise. Since the clockwise rotation of the display screen during the rotation process can offset the tilt caused by the counterclockwise rotation of the display 275, the display screen always remains in the state of positive display.

As shown in FIG. 16, it is a schematic flowchart of a method for adapting a display screen rotation according to this application. For the actual control process, the controller 250 described in this application is further configured to execute the following program steps:

S161: In response to the video media resource playing action of the display device, detect the current rotation state of the display.

The user selects a media asset on the control homepage and plays it, that is, a video media asset playing action is generated in the display device 200. For example, after a user opens a short video application through "Featured-My Application-Short Video", he selects one of multiple short video resource icons to play.

After the controller 250 monitors the playback action of the video media resource, it can determine the current rotation state of the display 275 through the angle sensor on the rotation component 276 or the gravity acceleration sensor on the display 275. For example, by analyzing the data measured by the gravity acceleration sensor, it can be determined that the current gravity direction of the display 275 is perpendicular to the long side, and then it is determined that the display 275 is currently in a landscape state.

S162: If the screen ratio of the video media resource matches the current rotation state, control the display to display the screen corresponding to the video media resource.

The controller 250 may determine the display aspect ratio corresponding to the video media resource in the file description information of the video media resource. For example, if the played video media resource is a short video, and its display screen ratio is 9:16, it is determined that the current short video is a vertical media resource. If the rotation state of the display 275 at this time is also the vertical screen state, that is, the screen ratio of the video media resource matches the current rotation state, at this time, it is sufficient to directly control the display to display the screen corresponding to the video media resource.

S163: If the aspect ratio of the video media resource does not match the current rotation state, control the rotation component to rotate the display so that the display adapts to the aspect ratio of the video media resource and plays the video media The screen corresponding to the resource.

For example, if the current rotation state of the display 275 is a horizontal screen state, and the video media resource being played is a vertical media resource such as a short video, it is determined that the aspect ratio of the video media resource does not match the current rotation state. At this time, the rotation can be controlled. The component 276 rotates the display 275 to the portrait state to adapt to the display aspect ratio corresponding to the short video being played.

It should be noted that in the technical solution provided in this application, whether the aspect ratio and the rotation state match between the aspect ratio of the video media resource being played is the same as or similar to the aspect ratio of the display 275 screen. ratio. For example, for traditional movies, TV series and other horizontal media assets, the width of the screen is larger than the height, that is, the aspect ratio of horizontal media assets is usually greater than 1. When the display 275 is in the horizontal screen state, the long side is in the horizontal state as the width, and the short side is in the vertical state as the height. The aspect ratio of the display 275 in the horizontal screen state is also greater than 1. The same applies to short videos and cartoons. For vertical media, the width of the screen is less than the height, that is, the aspect ratio of the vertical media is less than 1. When the display 275 is in the horizontal screen state, the long side is in the vertical state as high, and the short side is in the horizontal state as Wide, the aspect ratio of the display 275 in the portrait mode is also less than 1.

In this application, if the aspect ratio of the video media resource and the aspect ratio of the display 275 are both greater than 1 or less than 1, it is determined that the aspect ratio of the video media resource matches the current rotation state. That is, the screen ratio of the horizontal media asset matches the horizontal screen state; the screen ratio of the vertical media asset matches the vertical screen state. Similarly, if the aspect ratio of the video media resource and the aspect ratio of the display 275 are not both greater than 1 or less than 1 at the same time, it is determined that the aspect ratio of the video media resource does not match the current rotation state. For example, the screen ratio of the vertical media asset does not match the horizontal screen state; the screen ratio of the horizontal media asset does not match the vertical screen state.

In order to obtain the aspect ratio of the display screen, the controller 250 may obtain it from the description information of the resource after the user selects to play a certain resource. For most resources, the aspect ratio is specified in the file description. For example, if the file description information is 4096×2160, the aspect ratio is determined to be 4096:2160>1. It is also possible to determine the aspect ratio of the display screen by querying the effective pixels occupied by the width and height of the displayed image. For example, outside of the pixels occupied by the black insertion area, the effective pixels occupied by the display screen are 720 and 1280 pixels in width and height, respectively, and the aspect ratio is 720:1280<1.

In an implementation manner, as shown in FIG. 17, the controller 250 is further configured to execute the following program steps:

S171: Detect the on-off state of the rotating component.

After the video resource to be played is selected, the controller 250 may display the rotary switch of the device 200 for detection, and determine whether the rotary component 276 is in an on state. Obviously, the on-off state of the rotating component 276 can refer to the on-off state of the hardware, that is, whether the control circuit of the rotating component 276 is powered on; it can also refer to the on-off state of the software, that is, the corresponding control of the rotating component 276 in the operating system. The program is active.

S172: If the switch state is on, detect the aspect ratio of the display screen corresponding to the video media resource and the current rotation state of the display.

If the switch state of the rotating component 276 is on, that is, the current rotating component 276 can be controlled by the system at any time to start operation. At this time, the controller 250 may further detect the aspect ratio of the display screen corresponding to the current video media resource and the rotation state of the current display, so as to determine whether the display 275 and the display screen need to be rotated according to the detection result.

The aspect ratio of the display screen refers to the ratio between the width and the height of the edge of the display screen. It should be noted that the edge of the displayed picture here refers to the edge of the effective display picture, such as the edge of a video or an image, and does not include the black area filled in to adapt to the picture. For example, if the current display screen is a vertical media resource, the screen width is 360 pixels, and the screen height is 640 pixels, the corresponding aspect ratio is 360: 640; while the current display 275 is in landscape mode, and the display resolution is 3840× 2160, that is, the aspect ratio of the screen display area is 3840:2160, it is determined that the aspect ratio of the currently displayed picture is inconsistent with the rotation state of the current display.

Due to the large difference in video resource picture ratio, in order to adapt to multiple resource types, the aspect ratio of the display picture can be classified according to the specific ratio. If the aspect ratio of the displayed screen is greater than 1, that is, the width of the screen is greater than the height, then the video resource is horizontal media; similarly, if the aspect ratio of the displayed screen is less than 1, that is, the width of the screen is less than the height, then the video resource is vertical. To media resources.

Correspondingly, the determination of whether the aspect ratio of the current display screen is compatible with the rotation state of the current display can be determined by the aspect ratio of the display screen. If the aspect ratio is greater than 1, it means that the video is a wider video. At this time, if the display 275 is in a landscape state, it is not necessary to drive the display 275 to rotate. If the display 275 is in a portrait state, it is necessary to rotate the display 275 to landscape; if The aspect ratio is less than 1, indicating that the video is a higher video. If the display 275 is in a landscape state, the display 275 needs to be rotated, and if the display 275 is in a portrait state, it is not necessary to drive the display 275 to rotate.

Further, after the step of detecting the on-off state of the rotating component, the controller 250 is further configured to:

S173: If the switch state is off, control the display to present a setting screen.

When it is detected that the switch state of the rotating component 276 is closed, the rotating component 276 cannot be directly controlled to complete the rotating operation, so the user needs to be notified to turn on the switch of the rotating component 276. For example, a setting screen, that is, a UI interface corresponding to “settings”, is displayed on the display 275 for the user to turn on the rotating component 276.

It is also possible to determine whether the scale of the display screen matches the rotation state by judging the application launched on the display device 200. Generally, the applications installed on the display device 200 can include three types. One is the applications that only support the horizontal screen state, such as cloud audio-visual, small TV, iQiyi and other movies and TV apps. If you open this type of application in the vertical screen state , Then control the display 275 to rotate to the horizontal screen state; secondly, only support the applications in the vertical screen state, such as short video apps such as Kuaishou, Douyin, etc., if you open such applications in the horizontal screen state, control the display 275 to rotate to the vertical screen Status; third, applications that support both horizontal and vertical screen states, such as app stores, video calls, games and other apps, can be opened without rotating the display 275, but need to be adjusted according to the rotation state of the display 275 The application interface display layout.

In an implementation manner, as shown in FIG. 18, the controller 250 is further configured to execute the following program steps:

S181: Receive a rotation instruction input by the user for rotating the display.

The rotation instruction refers to an instruction used to trigger a rotation operation, which may be initiated by the user actively, or may be automatically initiated by the controller 250 by judging the current display state. It should be noted that the rotation command is intended to trigger a rotation operation, and there may not be a corresponding command in actual applications. For example, the controller 250 judges that the currently playing screen is a vertical media resource, and the current display 275 is in a horizontal screen state. When, the rotation operation can be triggered automatically without generating an additional rotation instruction. Therefore, for those skilled in the art, whether or not to trigger the rotation operation is within the protection scope of the present application.

Through the control device 100, the user can perform different operations to generate a control instruction that triggers the rotation component 276 to rotate. The operation performed by the user can be displayed directly on the UI interface in the form of a control, or it can be displayed dynamically on the UI interface. That is, the controller 250 can adjust the display of the controls on the UI interface in real time by detecting the aspect ratio of the played video and the current rotation state of the display 275.

For example, when the user selects a video resource in the "short video" application to play, the controller 250 detects that the aspect ratio of the played video is a vertical media resource, which is inconsistent with the current horizontal screen state of the display 275, and then it is displayed in the UI interface The following prompt text and controls are displayed such as "It is detected that the current video resource is more suitable for viewing in portrait mode, whether to automatically switch to portrait mode", "Yes/No". When the user selects “Yes”, the corresponding user input is generated and sent to the controller 250.

S182: Send the rotation instruction to the rotation component to control the rotation component to start rotation.

For the rotation instruction actively sent by the user, the controller 250 needs to analyze the user's input to determine the rotation strategy of the display 275. For example, when the user wants to adjust the display 275 from the landscape state to the portrait state, the rotation instruction can control the rotation component 276 to rotate 90 degrees clockwise; when the user wants to adjust the display 275 from the portrait state to the landscape state , The rotation command can control the rotation component 276 to rotate 90 degrees counterclockwise.

In an implementation manner, if the aspect ratio of the video media resource does not match the current rotation state, the controller 250 is further configured to:

Calculate the rotation parameter according to the current rotation state and the aspect ratio of the video media resource.

The controller 250 may determine and control the rotation of the display 275 according to the current rotation state and the aspect ratio of the video media resource. For example, when the current rotation state of the display 275 is the horizontal screen state and the aspect ratio of the video media resource is vertical, it can be specified that the display 275 needs to be rotated to the vertical screen state, that is, an instruction to rotate the display 275 clockwise by 90 degrees.

Adjust and display the screen corresponding to the video media resource according to the rotation parameter.

In order to obtain a better viewing experience when rotating the display 275. The controller 250 can rotate the displayed picture and the display 275 at the same time, so that the display picture is always maintained in a forward state, so the rotation parameters include the display picture zoom ratio and/or the rotation angle. The controller 250 needs to adjust the display image. For example, when the display 275 rotates 90 degrees clockwise, it controls the display image to rotate 90 degrees counterclockwise, and keeps the display 275 running in synchronization with the rotation process of the display image, so as to achieve a positive display at all times. The purpose of the screen.

In this application, the display screen is adjusted at the image quality layer, that is, only the video playback screen is adjusted, so the flexibility and efficiency of adjustment will be greatly increased. The adjustment on the image quality layer The adjustment of the display screen is not restricted by the source of the video resource file being played. It can adjust the video file in the local disk, and can also adjust the video file pushed to the display device 200 by DLNA, and share it with DMS Adjust the output video file. In addition, the adjustment on the image quality layer can also further adjust the display screen without affecting the UI layer screen.

For example, the controller 250 can also perform more detailed adjustments to the display screen, including rotation operations, zoom operations, and so on. Among them, the rotation operation is an adjustment made to adapt to the rotation of the display 275, and the zoom operation is an adjustment made to adapt to the change in width and height of the display 275 during the rotation. In practical applications, the rotation operation and the zoom operation can be performed at the same time, or the rotation operation can be performed first, and then the zoom operation can be performed.

In an implementation manner, as shown in FIG. 19, for the zooming operation of the display screen, the controller 250 is further configured to perform the following steps:

S191: Acquire the current display window position corresponding to the video media resource.

S192: Determine the position of the target display window in combination with the current rotation state;

S193: Compare the position of the target display window with the position of the current display window to generate a width and height deformation amount;

S194: Generate a zoom step length, where the zoom step length is a width and height zoom amount per unit time calculated according to the width and height deformation amount and the rotation speed of the rotating component;

S195: Adjust the width and height values of the display screen window according to the zoom step.

In the technical solution provided in this application, the current display window position and the target display window position refer to the position of the screen display window before and after the rotation of the display 275 corresponding to the rotation state of the display 275. For example, when the display 275 needs to be rotated from the horizontal screen state to the vertical screen state, in the horizontal screen state, the corresponding image quality layer displays the picture position of the playing video is the current display window position; and the display 275 corresponds to the vertical screen state after rotation The image quality layer shows the screen position of the playing video as the target window position. In the same way, when the display 275 needs to be rotated from the vertical screen state to the horizontal screen state, in the vertical screen state, the corresponding image quality layer displays the picture position of the playing video is the current display window position; and the display 275 is in the horizontal screen state after rotation The corresponding image quality layer below shows the screen position of the playing video is the target window position.

Specifically, after the media asset screen is played, the target display window position can be determined according to the rotation angle and the screen size characteristics of the display 275. For example, if it is necessary to switch from the horizontal screen state to the vertical screen state, the extracted rotation angle is 90 degrees clockwise, so as to determine that the predetermined target window position is the position corresponding to the playback area in the vertical screen state.

After the target display window position is determined, the width and height deformation amount of the display window can be determined by comparing the target display window position with the current display window position. For example, the size of a 65-inch monitor is 1440:810, and the vertical media is displayed in the landscape mode, the height of the display screen is less than or equal to the height of the monitor 275, that is, less than or equal to 810mm, and the vertical screen is displayed in the portrait mode. Xiangmedia resources can be less than or equal to 1440mm in height (the width of the display in the landscape mode), so it can be determined that the display screen height deformation is 1440-810=630mm. In the same way, the amount of width deformation can be calculated according to the aspect ratio of the vertical media assets.

After the width and height deformation amount is determined, the width and height zoom amount per unit time can be calculated according to the width and height deformation amount and the rotation speed of the rotating component 276, that is, the zoom step size is generated. For example, if the display 275 is to be rotated from the horizontal screen state to the vertical screen state in 15s, the height zoom step is 630/15=42mm/s. Similarly, according to the amount of deformation of the width, the zoom step of the width can also be calculated.

In an implementation manner, as shown in FIG. 20, for the rotation operation of the display screen, the controller 250 is further configured to perform the following steps:

S201: Generate the screen rotation direction;

The rotation direction of the display screen can be determined according to the rotation direction of the display 275, wherein the screen rotation direction is opposite to the rotation direction of the display. For example, the display 275 needs to be rotated 90 degrees clockwise to switch from the horizontal screen state to the vertical screen state. The corresponding screen rotation direction is counterclockwise.

S202: Compare the position of the target display window with the position of the current display window to generate an angular deformation amount.

After determining the rotation direction, the angular deformation can be generated according to the target display window position and the current display window position. For example, the target display window position is the display position in the portrait state; the current display window position is the display position in the landscape state, and the angular deformation is 90 degrees.

S203: Generate a rotation step size.

After the angular deformation is generated, the rotation speed of the display 275 is also combined to calculate the rotation step length. The rotation step length is an angular rotation amount per unit time calculated according to the angular deformation amount and the rotation speed of the rotating component. For example, it takes 15s for the rotation process to switch from the horizontal screen state to the vertical screen state, and the rotation step is 90/15=6 degrees/s, that is, during the rotation process, the display screen rotates 6 degrees per second to make the display 275 Rotate synchronously with the display screen.

S204: Adjust the display direction of the display screen window according to the rotation step size and the screen rotation direction.

After calculating the rotation step length, the display direction of the display screen window can be adjusted according to the rotation step length and the screen rotation direction. For example, the display 275 rotates 6 degrees clockwise every second, while the display screen rotates 6 degrees counterclockwise, so that the display screen always maintains a positive state.

It should be noted that, in order to adapt to a variety of different video resources, the state of the display 275 may not be limited to the horizontal screen state and the vertical screen state, and may also be maintained in a variety of inclined states according to playback needs. Therefore, the current display window position and the target display window position are not limited to the above two situations, and may also be a rotation process at any two tilt angles. Therefore, the horizontal and vertical screen rotation, horizontal and vertical screen rotation, vertical and inclined screen rotation, and inclined screen rotation that can be thought of according to the above-mentioned rotation method all fall within the scope of protection of the present application.

In the above embodiment, the rotation operation of the display screen can be controlled according to the rotation speed of the rotation component 276 driving the display 275. After the initial commissioning of a display device 200, the rotation speed of the rotating assembly 276 is determined by the drive motor and may remain unchanged. Therefore, for all rotation processes, the rotation parameters can be determined by a fixed rotation speed. Therefore, the above process of calculating the rotation parameters is the simplest and the most convenient to control the rotation operation.

However, in individual cases, for example, when the rotating assembly 276 has a cumulative error with the extension of use time, the rotating speed of the rotating assembly 276 will change. In order to adapt to the change of the rotating speed, in one implementation, the rotating assembly 276 An angle callback interface is provided on the interface, and the angle callback interface can detect the rotation angle of the rotation component 276 in real time through an angle sensor, so as to determine the corresponding posture at any time during the rotation of the display 275. It is also possible to set a gravity acceleration sensor on the display 275. During the rotation of the display 275, by detecting the information of the gravity sensor in the three directions of the spatial coordinate system (x, y, z), the posture corresponding to the display 275 at any time can be obtained. Then adjust the display screen in real time according to the detected data, that is, as shown in FIG. 21, the controller is further configured to:

S211: Monitor the angle sensor of the rotating component and/or the gravity acceleration sensor, and obtain the angle data of the display in real time;

S212: Calculate the rotation parameter of the display screen synchronously according to the angle data.

In actual applications, as shown in FIG. 22, the controller 250 can monitor the Android standard angle callback interface during the rotation of the display 275, and start the Orientation Event Listener program to obtain the rotation angle of the display 275, so as to calculate the rotation angle of the target window in real time. The position and the required rotation angle achieve the effect of following the display 275 to rotate.

In the above embodiment, the monitoring angle callback interface is not limited to the Android standard angle callback interface, and other corresponding angle callback interfaces can be called according to the operating system of the display device 200 in actual applications. It may also be an angle callback interface generated by the controller 250 according to the x, y, and z direction information of sensors such as a gravity acceleration sensor according to a set rule.

For example, the steps to calculate the position of the target window and the required rotation angle in real time are as follows:

As shown in Figure 23, the video display area Rect is a rectangular area composed of 4 points, and the coordinates of each point are the coordinates of the point on the screen. Taking the upper left corner of the screen as the origin, Rect can specify point 1 and point 4 to determine the position. Point 1 is (left, top) (left, top), and point 4 is (right, bottom) (right, bottom).

The parameters set to the image quality layer Surface View include the zoom ratio scale X and scale Y and the rotation angle rotate. Among them, scale X and scale Y can use the right and bottom positions of Rect to record the width and height of the video window, calculate the current position of the video window oldRect and the target position newRect respectively, and gradually increase the width and height of the display area according to the principle of equal steps. Until the target location. The specific algorithm is as follows:

Rect oldRect=new Rect(0,0,oldWidth,oldHeight);

Rect newRect=new Rect(0,0,newWidth,newHeight);

float defWidth=(newWidth-oldWidth)/90;

float tempWidth=oldWidth+defWidth×rotate;

float tempHeight=ildHeight+defHeight×rotate;

flocat scaleX=tempWidth/mBaseWidth;

flocat scaleY=tempHeight/mBaseHeight;

Among them, mBaseWidth and mBaseHeight are the base width and height, which are used to calculate scale X and scale Y.

It can be seen from the above technical solutions that the display device provided by the present application can adjust the video playback screen at the image quality layer, thereby realizing automatic rotation of the display 275, and during the rotation of the display 275, the display screen is also rotated in real time, so The display picture always maintains a positive state, reducing the influence of the TV rotation process on the viewing experience.

Based on the above-mentioned display device 200, the present application also provides a display screen rotation adaptation method. The display screen rotation adaptation method is configured in the controller 250 for controlling the rotation process, which specifically includes:

S161: In response to the video media resource playing action of the display device, detect the current rotation state of the display;

S162: If the screen ratio of the video media resource matches the current rotation state, control the display to display the screen corresponding to the video media resource;

It can be seen from the above technical solutions that the present application provides a display device and a display screen rotation adaptation method. In actual applications, the current rotation state of the display can be detected by responding to the video media resource playback action of the display device. If the aspect ratio of the video media resource does not match the current rotation state, control the rotation component to rotate the display so that the display adapts to the aspect ratio of the video media resource and the corresponding video media resource is played Picture. The display device automatically drives the motor of the TV to rotate when it detects that the width and height of the currently played video does not match the current rotation state of the display, and synchronously zooms and rotates the picture on the display during the rotation, so as to prevent the user from needing to watch the direction tilt for a long time The video screen improves the user experience.

In an implementation manner, as shown in FIG. 24, the present application also provides a display device 200, which includes a display, a rotating component, and a controller.

Wherein, the rotating component is connected to the display, and is configured to drive the display to rotate so that the display is in one of a horizontal screen state or a vertical screen state;

The controller is connected to the rotating assembly and the display, and is configured to:

In response to the video media resource playing action of the display device, detecting the current rotation state of the display;

If the video media resource is a vertical media resource, the current rotation state of the display is a horizontal screen state, and the rotation component is controlled to rotate the display to a vertical screen state.

If the video media resource is a horizontal media resource, the current rotation state of the display is a vertical screen state, and the rotation component is controlled to rotate the display to a horizontal screen state.

It can be seen from the above technical solutions that the present application provides a display device 200 and a display screen rotation adaptation method. In actual applications, the current rotation state of the display 275 can be detected by responding to the video media resource playback action of the display device 200. If the video media resource is a vertical media resource and the current rotation state of the display 275 is a horizontal screen state, the rotation component 276 can be controlled to rotate the display 275 to a horizontal screen state; or, if the video media resource is a horizontal media resource The current rotation state of the display 275 is the vertical screen state, and the rotation component 276 can be controlled to rotate the display 275 to the vertical screen state, and the display 275 is automatically rotated to adapt to the aspect ratio corresponding to the video media resource.

The similar parts between the embodiments provided in this application can be referred to each other. The specific implementations provided above are only a few examples under the general concept of this application, and do not constitute a limitation of the protection scope of this application. For those skilled in the art, any other implementation manners expanded according to the scheme of this application without creative work shall fall within the protection scope of this application.

Claims

A display method, characterized in that it comprises:

Obtain the to-be-displayed video screen;

Performing image quality processing on the to-be-displayed video picture through the video layer;

Generating an intermediate image; the intermediate image is the video frame data obtained by intercepting the output image after the image to be displayed is output through image quality processing;

Rotate the intermediate image through the OSD layer to generate a rotated image;

The rotated image is displayed frame by frame.
The display method according to claim 1, wherein the step of obtaining a video image to be displayed, the method further comprises:

Create video layer services and players;

Deliver the handle of the video layer service to the player;

Invoke the player to decode the to-be-displayed video image, and send the decoded, to-be-displayed video image to the video layer service.
The display method according to claim 1, wherein the step of generating an intermediate image comprises:

Creating an interception service, where the interception service is used to intercept video frame data;

Acquiring an output image, where the output image is image data obtained after the image quality processing of the to-be-displayed video screen is performed;

Invoke the interception service to intercept the output image to obtain the intermediate image.
The display method according to claim 1, wherein the step of rotating the intermediate image through the OSD layer to generate a rotated image further comprises:

Acquiring display rotation information; the display rotation information includes the display rotation direction and the display rotation angle;

Setting the screen rotation direction and the screen rotation angle; the screen rotation direction is opposite to the display rotation direction, and the screen rotation angle is equal to the display rotation angle;

Rotate the intermediate image according to the screen rotation direction and the screen rotation angle.
The display method according to claim 4, wherein the method further comprises:

Creating a rotation service, where the rotation service is used to rotate the display screen;

Acquire a rotation instruction input by the user; the rotation instruction is used to drive the rotation component to drive the display to rotate, so that the display is in one of a variety of rotation states;

If the rotation instruction is obtained, call the rotation service to obtain display rotation information.
The display method according to claim 4, wherein the step of obtaining display rotation information comprises:

Monitor the angle callback interface of the rotating component;

Obtain the current rotation angle of the display through the angle callback interface, and generate the display rotation information.
The display method according to claim 4, wherein after the step of rotating the intermediate image through the OSD layer to generate the rotated image, the method further comprises:

Locate the current boundary position of the display according to the rotation information of the display;

Crop the rotated image according to the current boundary position;

Or, scaling the rotated image according to the current boundary position.
8. The display method according to claim 7, wherein the step of scaling the rotated image according to the current boundary position comprises:

According to the monitor rotation information, locate the current display window position and the target display window position;

Comparing the position of the target display window with the position of the current display window to generate a width and height deformation amount;

Generating a zoom step length, where the zoom step length is a width and height zoom amount per unit time calculated according to the width and height deformation amount and the rotation speed of the rotating component;

Adjust the width and height values of the rotated image according to the zoom step.
8. The display method according to claim 8, wherein the step of adjusting the width and height values of the rotated image according to the zoom step size comprises:

Position the zoom base point coordinates in the current display window;

Using the zoom base point coordinates as a reference, synchronously adjust the width and height values of the display screen window according to the zoom step length.
A display device, characterized in that it comprises:

monitor;

The rotating component is configured to drive the display to rotate, so that the display is in one of a variety of rotating states;

The controller is configured as:

Obtain the to-be-displayed video screen;

Performing image quality processing on the to-be-displayed video picture through the video layer;

Generating an intermediate image; the intermediate image is the video frame data obtained by intercepting the output image after the image to be displayed is output through image quality processing;

Rotate the intermediate image through the OSD layer to generate a rotated image;

Controlling the display to display the rotated image frame by frame.