CN115550701A

CN115550701A - Display device and method for receiving screen projection content

Info

Publication number: CN115550701A
Application number: CN202110736694.5A
Authority: CN
Inventors: 张敬坤; 于颜梅
Original assignee: Qingdao Hisense Media Network Technology Co Ltd
Current assignee: Qingdao Hisense Media Network Technology Co Ltd
Priority date: 2021-06-30
Filing date: 2021-06-30
Publication date: 2022-12-30

Abstract

The application provides a display device, a controller configured to: receiving screen projection media resources and determining the attributes of the media resources; if the media resource attribute is a video, detecting the horizontal and vertical screen states of the display, acquiring the video width height ratio, and judging whether the video width height ratio is matched with the horizontal and vertical screen states of the display; and if the media resource attribute is a picture, filling a screen for displaying according to the original ratio of the aspect ratio of the current picture. The display equipment provided by the application can process the image and the video respectively according to the received screen-projecting content attribute, directly displays the image, and determines whether the rotation is needed or not according to the video width height ratio and the horizontal and vertical screen states of the display, so that the proportion of the display is more adapted in video playing, and the user experience is improved.

Description

Display device and method for receiving screen projection content

Technical Field

The application relates to the technical field of intelligent televisions, in particular to a display device and a method for receiving screen projection content.

Background

Screen sharing is an interactive operation of a plurality of display devices. Media assets are typically delivered using a wireless network so that content displayed on one display device can be synchronized to a second display device for viewing by a user. Taking the screen projection of a mobile phone as an example, for a mobile phone and a smart television connected in the same WiFi network, a screen projection operation instruction can be executed through a mobile phone end, so that a picture displayed by the mobile phone end is sent to the smart television in a video streaming manner, and a large screen of the smart television is utilized to obtain better user experience.

Since media assets can be vertical assets and can be horizontal assets, when a media asset stream is synchronized on one device to a second display device, there is a possibility that the aspect ratio of the media asset appears different from the presentation of the display device, such as a display size of 4:3 for media asset and 3:4 for display device.

In order to display the picture on the mobile phone completely and to maximize the display scale, the display device needs to be more adaptive than the media resources.

Disclosure of Invention

The application provides a display device and a method for receiving screen projection content, so that the display presentation state is adaptive to the screen projection content.

In one aspect, the present application provides a display device, comprising: a display;

the rotating component is configured to drive the display to rotate so that the display is in one rotating state of a horizontal screen state or a vertical screen state;

a user interface configured to connect to a terminal;

a controller configured to:

receiving screen-casting media resources and determining the attributes of the media resources;

if the media resource attribute is a video, detecting the horizontal and vertical screen states of the display, acquiring the video width height ratio, judging the matching condition of the video width height ratio and the horizontal and vertical screen states of the display, and determining whether the display needs to be rotated according to the matching condition;

and if the media resource attribute is a picture, filling a screen for displaying according to the original ratio of the aspect ratio of the current picture.

In a second aspect, the present application provides a method for receiving screen-projected content, including:

and if the media resource attribute is a picture, filling a screen for displaying according to the original ratio of the aspect ratio of the current picture. As can be seen from the above technical solutions, the display device provided in the present application, the controller, is configured to: receiving screen projection media resources and determining the attributes of the media resources; if the media resource attribute is a video, detecting the horizontal and vertical screen states of the display, acquiring the video width height ratio, and judging whether the video width height ratio is matched with the horizontal and vertical screen states of the display; and if the media resource attribute is a picture, filling a screen for displaying according to the original ratio of the aspect ratio of the current picture. The display equipment provided by the application can process the image and the video respectively according to the received screen-projecting content attribute, directly displays the image, and determines whether the rotation is needed or not according to the video width height ratio and the horizontal and vertical screen states of the display, so that the proportion of the display is more adapted in video playing, and the user experience is improved.

Drawings

In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is an application scenario diagram of a display device according to the present application;

fig. 2 is a block diagram of a hardware configuration of a control apparatus according to the present application;

FIG. 3A is a schematic diagram of a mobile terminal in a landscape mode according to the present application;

fig. 3B is a schematic diagram of a vertical mode of the mobile terminal according to the present application;

FIG. 4 is a schematic diagram illustrating an embodiment of the present application in which a display device is positioned on a landscape screen to receive landscape media assets;

FIG. 5 is a schematic diagram illustrating a receiving landscape media asset rotated to a landscape screen when a display device is in a portrait screen according to an embodiment of the present application;

fig. 6 is a schematic diagram illustrating the reception of vertical media resources when the display device is in a vertical screen in an embodiment of the present application;

FIG. 7 is a schematic diagram illustrating a receiving vertical media asset rotating to a vertical screen when a display device is in a landscape screen according to an embodiment of the present application;

FIG. 8 is a flowchart illustrating a processing method for receiving screen projection data according to the present application;

fig. 9 is a schematic flow chart of comparing the sampling resolution with the initial resolution according to the present application.

Detailed Description

Reference will now be made in detail to embodiments, examples of which are illustrated in the accompanying drawings. The following description refers to the accompanying drawings in which the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following examples do not represent all embodiments consistent with the present application. But merely as exemplifications of systems and methods consistent with certain aspects of the application, as recited in the claims.

In the technical scheme provided by the application, the display equipment can be electrical equipment such as an intelligent television and the like which has a large screen and presents video and audio signals for a user. The display device may have a separate operating system and support function expansion. Various application programs can be installed in the display device according to the needs of the user, such as a traditional video application, a short video and other social applications, and a cartoon, book reading and other reading applications. The applications can utilize the screen of the display device to display application pictures, and richer media resources are provided for users. Meanwhile, the display equipment can also perform data interaction and resource sharing with different terminals. For example, the smart television can be connected with a mobile phone through a wireless communication mode such as a local area network and bluetooth, so as to play resources in the mobile phone or directly project a screen to display a picture on the mobile phone.

The embodiment of the application provides a display device and a computer storage medium, wherein the display device can be a television capable of supporting rotation of a horizontal screen and a vertical screen, and is called a rotatable television for short. It should be noted that the method provided in this embodiment is not only applicable to the rotatable television, but also applicable to other display devices, such as a computer and a tablet computer, so as to facilitate the user to display the target media asset detail page in different horizontal and vertical screen states of the display, and improve the viewing experience of the user when the display device is in different viewing states.

The term "module," as used in various embodiments of the present application, may refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

The term "remote control" as used in the various embodiments of the present application refers to a component of an electronic device, such as the display device disclosed in the present application, that is capable of wirelessly controlling the electronic device, typically over a short distance. The component may typically be connected to the electronic device using infrared and/or Radio Frequency (RF) signals and/or bluetooth, and may also include functional modules such as WiFi, wireless USB, bluetooth, motion sensors, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.

The term "gesture" as used in the embodiments of the present application refers to a user behavior used to express an intended idea, action, purpose, or result through a change in hand shape or an action such as hand movement.

The term "hardware system" used in the embodiments of the present application may refer to a physical component having computing, controlling, storing, inputting and outputting functions, which is formed by a mechanical, optical, electrical and magnetic device such as an Integrated Circuit (IC), a Printed Circuit Board (PCB) and the like. In various embodiments of the present application, a hardware system may also be generally referred to as a motherboard (motherboard) or a host chip or controller.

Referring to fig. 1, an application scenario diagram of a display device according to some embodiments of the present application is provided. As shown in fig. 1, the control apparatus 100 and the display device 200 may communicate with each other in a wired or wireless manner.

Among them, the control apparatus 100 is configured to control the display device 200, which may receive an operation instruction input by a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an intermediary for interaction between the user and the display device 200. Such as: the user operates the channel up/down key on the control device 100, and the display device 200 responds to the channel up/down operation.

The control device 100 may be a remote controller 100A, which includes infrared protocol communication or bluetooth protocol communication, and other short-distance communication methods, etc. to control the display device 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.

The control device 100 may also be an intelligent device, such as a mobile terminal 100B, a tablet computer, a notebook computer, and the like. For example, the display device 200 is controlled using an application program running on the smart device. The application program may provide various controls to a user through an intuitive User Interface (UI) on a screen associated with the smart device through configuration.

For example, the mobile terminal 100B may install a software application with the display device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 100B may be caused to establish a control instruction protocol with the display device 200, and implement functions of physical keys as arranged in the remote control 100A by operating various function keys or virtual controls of a user interface provided on the mobile terminal 100B. The audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.

The display apparatus 200 may provide a network television function of a broadcast receiving function and a computer support function. The display device may be implemented as a digital television, a web television, an Internet Protocol Television (IPTV), or the like.

The display device 200 may be a liquid crystal display, an organic light emitting display, a projection device. The specific display device type, size, resolution, etc. are not limited.

The display apparatus 200 also performs data communication with the server 300 through various communication means. Here, the display apparatus 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 300 may provide various contents and interactions to the display apparatus 200. By way of example, the display device 200 may send and receive information such as: receiving Electronic Program Guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library. The servers 300 may be a group or groups of servers, and may be one or more types of servers. Other web service contents such as video-on-demand and advertisement services are provided through the server 300.

A hardware configuration block diagram of the display device 200 is exemplarily shown in fig. 2. As shown in fig. 2, the display apparatus 200 may include a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, a rotating assembly 276, an audio processor 280, an audio output interface 285, and a power supply 290.

The rotating assembly 276 may include a driving motor, a rotating shaft, and the like. Wherein, the driving motor can be connected to the controller 250 and output the rotation angle under the control of the controller 250; one end of the rotation shaft is connected to a power output shaft of the driving motor, and the other end is connected to the display 275, so that the display 275 can be fixedly mounted on a wall or a bracket through the rotation member 276.

The rotating assembly 276 may also include other components, such as a transmission component, a detection component, and the like. Wherein, the transmission component can adjust the rotating speed and the torque output by the rotating component 276 through a specific transmission ratio, and can be in a gear transmission mode; the detection means may be composed of a sensor, such as an angle sensor, an attitude sensor, or the like, provided on the rotation shaft. These sensors may detect parameters such as the angle at which the rotating assembly 276 is rotated and transmit the detected parameters to the controller 250, so that the controller 250 can determine or adjust the state of the display apparatus 200 according to the detected parameters. In practice, rotating assembly 276 may include, but is not limited to, one or more of the components described above.

The tuner demodulator 210 receives the broadcast television signal in a wired or wireless manner, may perform modulation and demodulation processing such as amplification, mixing, and resonance, and is configured to demodulate, from a plurality of wireless or wired broadcast television signals, an audio/video signal carried in a frequency of a television channel selected by a user, and additional information (e.g., EPG data).

In other exemplary embodiments, the tuning demodulator 210 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs a television signal after modulation and demodulation, and inputs the television signal into the display apparatus 200 through the external device interface 240.

The communicator 220 is a component for communicating with an external device or an external server according to various communication protocol types. For example, the display apparatus 200 may transmit content data to an external apparatus connected via the communicator 220, or browse and download content data from an external apparatus connected via the communicator 220. The communicator 220 may include a network communication protocol module or a near field communication protocol module, such as a WIFI module 221, a bluetooth communication protocol module 222, and a wired ethernet communication protocol module 223, so that the communicator 220 may receive a control signal of the control device 100 according to the control of the controller 250, and implement the control signal as a WIFI signal, a bluetooth signal, a radio frequency signal, and the like.

The detector 230 is a component of the display apparatus 200 for collecting signals of an external environment or interaction with the outside. The detector 230 may include a sound collector 231, such as a microphone, which may be used to receive a user's sound, such as a voice signal of a control instruction of the user to control the display device 200; alternatively, ambient sounds may be collected that identify the type of ambient scene, enabling the display device 200 to adapt to ambient noise.

The external device interface 240 is a component for providing the controller 250 to control data transmission between the display apparatus 200 and an external apparatus. The external device interface 240 may be connected with an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.

The controller 250 controls the operation of the display device 200 and responds to the operation of the user by running various software control programs (such as an operating system and various application programs) stored on the memory 260.

In some example embodiments, the controller 250 includes a Random Access Memory (RAM), a Read Only Memory (ROM), a graphics processor, a CPU processor, a communication interface, and a communication bus. The RAM, the ROM, the graphic processor and the CPU processor are connected through a communication bus.

And the ROM is used for storing various system starting instructions. When the display apparatus 200 starts power-on upon receiving the power-on signal, the CPU processor 254 executes a system boot instruction in the ROM252, copies the operating system stored in the memory 260 to the RAM251, and starts running the boot operating system. After the start of the operating system is completed, the CPU processor 254 copies the various application programs in the memory 260 to the RAM251 and then starts running and starting the various application programs.

The communication interface 255 may include a first interface to an nth interface. These interfaces may be network interfaces that are connected to external devices via a network.

The controller 250 may control the overall operation of the display apparatus 200. For example: in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.

Where the object may be any one of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object is, for example, an operation of displaying a link to a hyperlink page, document, image, or the like, or an operation of executing a program corresponding to the object. The user input command for selecting the GUI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch panel, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.

A memory 260 for storing various types of data, software programs, or applications for driving and controlling the operation of the display device 200. The memory 260 may include volatile and/or nonvolatile memory. And the term "memory" includes the memory 260, the RAM and ROM of the controller 250, or the memory card in the display device 200.

In some embodiments, the memory 260 is specifically used for storing an operating program for driving the controller 250 of the display device 200; storing various application programs built in the display apparatus 200 and downloaded by a user from an external apparatus; data such as visual effect images for configuring various GUIs provided by the display 275, various objects related to the GUIs, and selectors for selecting GUI objects are stored.

In some embodiments, memory 260 is specifically configured to store drivers for tuner demodulator 210, communicator 220, detector 230, external device interface 240, video processor 270, display 275, audio processor 280, etc., and related data, such as external data (e.g., audio-visual data) received from the external device interface or user data (e.g., key information, voice information, touch information, etc.) received by the user interface.

In FIG. 2, user interface 265 receives various user interactions. Specifically, it is used to transmit an input signal of a user to the controller 250 or transmit an output signal from the controller 250 to the user. For example, the remote controller 100A may transmit an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by the user to the user interface 265, and then the input signal is transferred to the controller 250 through the user interface 265; alternatively, the remote controller 100A may receive an output signal such as audio, video, or data output from the user interface 265 via the controller 250, and display the received output signal or output the received output signal in audio or vibration form.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on the display 275, and the user interface 265 receives the user input commands through the GUI. Specifically, the user interface 265 may receive user input commands for controlling the position of a selector in the GUI to select different objects or items. Among these, "user interfaces" are media interfaces for interaction and information exchange between an application or operating system and a user, which enable the conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the user interface is a Graphical User Interface (GUI), which refers to a user interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include a visual interface element such as an icon, a control, a menu, a tab, a text box, a dialog box, a status bar, a channel bar, a Widget, etc.

Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user interface 265 receives the user input command by recognizing the sound or gesture through the sensor.

The video processor 270 is configured to receive an external video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a video signal that is directly displayed or played on the display 275.

A display 275 for receiving the image signal from the video processor 270 and displaying the video content, the image and the menu manipulation interface. The display video content may be from the video content in the broadcast signal received by the tuner-demodulator 210, or from the video content input by the communicator 220 or the external device interface 240. The display 275, while displaying a user manipulation interface UI generated in the display apparatus 200 and used to control the display apparatus 200.

And, the display 275 may include a display screen component for presenting a picture and a driving component for driving the display of an image. Alternatively, a projection device and projection screen may be included, provided that display 275 is a projection display.

Rotating assembly 276, the controller may issue a control signal to cause rotating assembly 276 to rotate display 255.

The audio processor 280 is configured to receive an external audio signal, and perform decompression and decoding, and audio data processing such as noise reduction, digital-to-analog conversion, and amplification according to a standard codec protocol of the input signal, so as to obtain an audio signal that can be played in the speaker 286.

And a power supply 290 for supplying power supply support to the display apparatus 200 from the power input from the external power source under the control of the controller 250. The power supply 290 may be a built-in power supply circuit installed inside the display apparatus 200 or may be a power supply installed outside the display apparatus 200.

In the screen projecting process, the mobile terminal 100B may send display image data to the display device 200 in a wireless connection manner, for example, through Miracast protocol or DLNA protocol, so as to form a screen projecting video stream. After the display device 200 receives the screen-projected video stream, the controller 250 may decode the screen-projected video stream, analyze the frame pictures, process the frame pictures to form screen-projected pictures, and send the screen-projected pictures to the display 275 for display.

The following description will take the mobile terminal as an example to project a screen to a television. The mobile terminal 100B may be an intelligent terminal device with display and human-computer interaction functions, such as a mobile phone, a tablet computer, and the like. The video or picture on the mobile terminal can be content in a positive direction in a transverse mode, such as a television play when the mobile phone is transversely placed. When the mobile phone is placed horizontally, the aspect ratio of the screen is larger than 1. The video or the picture on the mobile terminal can also be the content with the positive direction in the vertical mode, such as a picture shot when the mobile phone of the user is vertically placed. When the mobile phone is vertically placed, the aspect ratio of the screen is less than 1.

In some embodiments, the television may be supported for rotation in a landscape orientation driven by a rotation assembly. As in the case of playing a television series or live video, since these media assets are typically landscape assets, the television is panned to present the landscape media assets. When the body-building or vertical media resources are played, the television is turned to be vertically placed, and the vertical resources are presented.

In some embodiments, the television is positioned horizontally, and when the rotation instruction is not triggered, the television can also be used for receiving a screen projection and displaying a vertical resource. And the vertical placement of the television can also present and receive the screen projection to present the horizontal resources when a rotation instruction is triggered.

In some embodiments, when screen sharing is performed through the DLNA protocol, the display device may obtain a horizontal and vertical presentation state of an image, and since media resources in a horizontal or vertical layout may be presented on the mobile terminal 100B, the screen projection screen also has different layout modes. For example, when a user presents a landscape media asset on a cell phone, the width of the frame is greater than the height of the frame, as shown in FIG. 3A. When the user presents the vertical media assets on the cell phone, the width of the frame is less than the height of the frame, as shown in fig. 3B.

In order to enable the display device 200 to automatically rotate the screen according to the horizontal and vertical states of the picture when the mobile terminal 100B performs screen projection, so as to achieve better user experience, a screen projection protocol may be configured between the display device 200 and the mobile terminal 100B, for example, a screen projection protocol based on the DLNA standard, a screen projection protocol based on the airlay standard, and the like, and the transmission of the picture video stream is implemented through the screen projection protocol, so that the picture on the mobile terminal 100B can be projected to the display device 200.

In some embodiments, the screen-shot content may be video or pictures. Typically, the user has a longer time to browse through the video and a relatively shorter time to browse through the picture.

When the screen projection content received by the display device is a video, the horizontal and vertical screen relation of the video content can be detected, whether rotation is needed or not is judged by combining the current display mode of the display, if the horizontal video is received in the horizontal screen state, full-screen playing can be realized, and the original state is maintained to directly play the video, as shown in fig. 4. If the horizontal video is received in the vertical screen state and intelligently presented on part of the display interface due to the inconsistent aspect ratio, the display 275 of the display device is controlled to rotate to the horizontal screen state by the rotating component while the video is played on the vertical screen first, so that full-screen playing is realized, as shown in fig. 5.

If the vertical video is received in the vertical screen state, full-screen playing can be realized, and the video can be directly played in the original state, as shown in fig. 6. If the vertical video is received in the landscape screen state and intelligently presented on part of the display interface due to the inconsistent aspect ratio, the display 275 of the display device is controlled to rotate to the portrait screen state while the landscape screen plays the video first, and full-screen playing is achieved, as shown in fig. 7.

When the shot content is a picture, the user may be browsing the application related to the photo album, at this time, the user has a limited time to stay on a single picture, and the user may select whether the last picture shot on the screen is horizontal, and the next picture becomes vertical and horizontal. Moreover, the change of the presentation state of the display device, that is, the rotating assembly drives the display device to rotate, requires a certain time, the display device placed on the horizontal screen just receives the indication that the vertical resource starts to rotate to the vertical direction, and the user may trigger the indication of browsing the next sheet and needs to change back to the horizontal direction. Therefore, the display equipment rotates frequently, so that the experience of a user is influenced, and the service life of the display equipment is also reduced.

In some embodiments, in a display device of the present application, it is determined whether the display needs to be rotated according to the received media resource information, the horizontal and vertical states of the media resources, and the presentation state of the display itself. For video playing, when the mobile phone end pushes, the television end rotates, amplifies and reduces the television and the video playing interface according to the video picture, always keeps the vertical state of the video, and finally adapts to the display effect of the whole screen. For picture playing, the transverse screen, namely the transverse screen, is displayed maximally according to the original proportion, the vertical screen, namely the vertical screen, is displayed maximally according to the original proportion, the rotation angle is reset during rotation, and finally the picture is displayed in a maximum proportion in a matched mode.

In some embodiments, for video playback: the method comprises the steps that after a television receives video link of a mobile phone end, video resources are accessed, the transverse and vertical screens of the television are judged, angle monitoring is registered, the whole screen is matched with the television end according to the original proportion to display and play after the video width is obtained, when the video width is inconsistent with the transverse and vertical screens of the television, a rotation instruction is sent, the angle information of current television rotation is obtained through the angle monitoring, the scaling multiple of the video image obtained through calculation needs to be carried out, the current angle information and the scaling multiple are set to a fishing frame interface, the angle and the scaling setting are carried out on the current video playing image when the fishing frame interface obtains the angle information and the scaling multiple, the vertical display of the image is guaranteed all the time until the rotation is finished.

In some embodiments, for picture playback: after receiving a picture pushing request from a mobile phone end, the television end judges whether the horizontal screen or the vertical screen of the current television end is full of the original ratio of the width to the height of the current image to be displayed, and when a user remote controller manually rotates the television, the user remote controller sets an angle and sets a scaling multiple when monitoring configuration change, so that the picture is ensured to be fully paved on the whole screen to be displayed according to the original ratio.

The application provides a display device including:

a display;

a rotating component configured to drive the display to rotate so that the display is in one rotating state of a horizontal screen state or a vertical screen state;

a user interface configured to connect to a terminal;

and a controller, see fig. 8, configured to perform:

s01: receiving screen projection media resources and determining the attributes of the media resources;

in practical applications, the user may first perform a screen-projection display operation on the mobile terminal 100B to transmit the display screen of the mobile terminal 100B to the display device 200. For example, the user performs the screen-casting operation by successively selecting "setup-connect and share-screen-casting" on the mobile phone, and selecting one display device in the current network as the screen-casting object in the device list of the screen-casting operation.

After performing the screen projection operation, the mobile terminal 100B transmits the displayed screen to the display device 200 through a screen projection protocol, for example, a DLNA protocol or other mirror image protocol. As new interactive pictures are continuously generated during the screen projection process, the mobile terminal 100B sends the pictures to the display device 200 frame by frame to form a screen projection data stream (hereinafter, a screen projection video stream).

It should be noted that, the user may also perform the screen projection operation according to the application program of the third party. For example, a user opens a video application, and a screen-casting icon is set on a video playing interface of the video application. The user can click the icon to perform a screen-casting operation. Generally, the screen projection screen of the screen projection operation executed by the third-party application program is subject to the played video resource. For example, when the played video resource is a horizontal media asset such as a movie, a tv show, etc., the width of the effective picture in the screen projection picture is greater than the height; and when the played video resources are vertical media resources such as short videos, cartoons and the like, the width of the effective picture in the screen projection picture is smaller than the height.

The television receives the media resources and judges whether the received video or image is the video or the image according to the attributes of the media resources.

S02: if the media resource attribute is a video, detecting the horizontal and vertical screen states of the display, acquiring the video width height ratio, judging the matching condition of the video width height ratio and the horizontal and vertical screen states of the display, and determining whether the display needs to be rotated according to the matching condition.

After receiving the screen-casting video stream, the display device 200 starts to register monitoring of the rotation angle, call back the current real-time rotation angle data of the machine, obtain the rotation direction and angle information of the current television, and at this time, judge the horizontal and vertical screen states of the television. And acquiring width and height data of a video, firstly displaying a video picture at a television end according to an original proportion, comparing the width and the height of the video through a transverse screen and a vertical screen of the television end, and driving the television to automatically rotate if the television end is vertical at the moment, or the television end is transverse and the video is transverse.

S03: and if the media resource attribute is a picture, filling a screen for displaying according to the original ratio of the aspect ratio of the current picture.

In one implementation, to achieve that the aspect ratio of the video is not matched with the horizontal and vertical screen states of the display, the display is driven to rotate, and simultaneously, the video can be synchronously amplified. And acquiring the current rotation angle in real time, calculating the scaling factor, simultaneously rotating the UI in the opposite direction through the rotation direction and the angle data, and synchronously amplifying or reducing the display effect.

In some embodiments, the display is driven to rotate if the aspect ratio does not match the landscape state of the display. And when the video width height ratio is matched with the horizontal and vertical screen states of the display, the video content is directly displayed on the display according to the screen adapted to the original proportion, and the video content is presented.

In some exemplary embodiments, not all videos may trigger rotation, and it is further necessary to determine whether to rotate according to the video duration, so that when the screen-projected content is a longer video, the aspect ratio of the video matches the display state, so that the user experience is better.

For example, the controller may start playing on the user interface after receiving the screen-casting content, and acquire the video for a time period greater than or equal to a certain time value T _min And then detecting the aspect ratio of the video and the presentation state of the display, and controlling the rotating component to drive the display to rotate when the aspect ratio is not matched with the presentation state of the display. When the video duration is less than the time value T _min And if so, determining that the video time is too short without rotating the television.

As shown in fig. 9, when the aspect ratio does not match with the horizontal and vertical screen states of the display, the method further comprises:

s021: acquiring the original resolution of the video before rotation, which is matched with the display;

s022: determining the zoom multiple of the video picture according to the original resolution and the full-screen resolution of the display;

s023: monitoring the rotation angle information of the display, and gradually zooming the video picture according to the rotation angle information to ensure that the video picture is finally displayed in a full screen mode.

In some embodiments, the initial resolution is F1, the full screen resolution is F2, and the video frame needs to be enlarged by F2/F1 times during the rotation process. Monitoring the rotation angle of the display from the horizontal screen to the vertical screen, dividing the whole rotation process into 90 parts according to the rotation angle, and amplifying (F2/F1)/90 when the display rotates for one degree. Thus rotating to full screen display at a constant speed.

For example, when the display device is in the landscape state, receiving a portrait video asset, the display presents a user interface as shown in fig. 7 (b): the vertical side length of the video picture is consistent with the long side length of the display and is displayed in the display. At the moment, the display equipment is in a transverse screen state, the video interface is in a vertical screen state, and the transverse screen and the vertical screen of the television end and the video picture are not matched, so that the rotary interface of the display equipment is called, and the rotary component is controlled to drive the rotary display. The controller obtains rotation direction and angle information through rotation angle callback, video playing picture change is calculated in real time according to the rotation angle information of the television, when the television end rotates from a horizontal screen to a vertical screen, the default rotation starting multiple is F2/F1, current angle data and the scaling multiple are set for a frame fishing interface, video picture rotation and scaling are carried out in real time, the video playing picture is always kept in a vertical state relative to a user, and at the moment, the television picture and the video picture are displayed in a superposition mode, and the video playing picture is as shown in the following figure 7 (c).

In some embodiments, the magnification may also be calculated in terms of the length of the long side of the display versus the height of the video picture, and the length of the short side of the display versus the width of the video picture. For example, the default rotation is at the beginning of a multiple of 1, and each rotation of 1 degree is the video playing picture with high magnification (the length of the long side of the television picture-the height of the video picture)/90 and wide magnification (the width of the short side of the television picture-the width of the video picture)/90.

In some embodiments, before the rotation process begins, the display may be driven to rotate by popping up an associated prompt or rotating on the user interface.

In some embodiments, when the display device is in a portrait display and the video asset is in a landscape state, the display presents a user interface as shown in fig. 5 (b): the video picture has a transverse side length which is identical to the short side length of the display and is displayed therein. At the moment, the display equipment is not matched with the horizontal screen and the vertical screen of the video picture, so that a rotating interface of the television end is called to inform the television end of rotating, rotating direction and angle information are obtained through rotation angle callback, and video playing picture change is calculated in real time according to the rotating angle information of the television. As an optional mode, when the television end rotates from the horizontal screen to the vertical screen, the default multiple at the start of rotation is 1, when the television end rotates 1 degree, the video playing picture is high amplified (the short side length of the television picture-the height of the video picture)/90, wide amplified (the long side length of the television picture-the width of the video picture)/90, the current angle data and the scaling multiple are set to a frame fishing interface, the video picture is rotated and scaled in real time, the video playing picture is always kept in a vertical state relative to a user, and finally the television picture and the video playing picture are displayed in a superposition manner, as shown in a diagram (c).

In some embodiments, after the display device receives a picture pushing request from a mobile phone, the current picture is displayed in the maximum original proportion, and the display is not a rotating display according to whether the picture is matched with the display of the display.

Of course, the above-mentioned projection of pictures is merely an exemplary illustration, and in some embodiments, whether the projection medium is video or pictures, the rotation component may be triggered to rotate the display when the projection medium does not match the display state of the display.

In some embodiments, the display device is not only rotated according to the screen projection data, and the user can still actively send a rotation instruction to rotate the display device to a different state from the previous state regardless of whether the display device is in the landscape state or the portrait state. From the perspective of the front view of the display device, the rotating component 276 can rotate the display screen to a vertical screen state, that is, a state where the vertical side length of the screen is greater than the horizontal side length, or to a horizontal screen state, that is, a state where the horizontal side length of the screen is greater than the vertical side length. For example, it is possible to realize that the user manually triggers the display rotation, and when an instruction with subjective awareness is input, the level of preferential execution may be set high. If the rotation instruction input by the user is received whether the presentation of the video picture and the display is matched or not, even if the presentation of the video picture and the display is matched, a triggering instruction can be received to rotate the display.

In specific implementation, the present application further provides a computer storage medium, where the computer storage medium may store a program, and when the program is executed, the program may include some or all of the steps in the embodiments of the method provided in the present application, and when the controller of the display device provided in the present application runs the computer program instructions, the controller executes the steps where the controller is configured. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), a Random Access Memory (RAM), or the like.

Those skilled in the art will clearly understand that the techniques in the embodiments of the present application may be implemented by way of software plus a required general hardware platform. Based on such understanding, the technical solutions in the embodiments of the present application may be substantially or partially embodied in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, or the like, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the method according to the embodiments or some parts of the embodiments of the present application.

The same and similar parts in the various embodiments in this specification may be referred to each other. In particular, for the embodiments, since they are substantially similar to the method embodiments, the description is simple, and the relevant points can be referred to the description in the method embodiments.

The above-described embodiments of the present application do not limit the scope of the present application.

Claims

1. A display device, comprising:

a display;

a user interface configured to connect to a terminal;

a controller configured to:

receiving screen projection media resources and determining the attributes of the media resources;

2. The display device of claim 1, wherein the controller is further configured to:

when the video width height ratio is not matched with the horizontal and vertical screen states of the display, driving the display to rotate; and when the video width height ratio is matched with the horizontal and vertical screen states of the display, the video content is directly displayed on the display according to the screen adaptation of the original proportion, and the video content is presented.

3. The display device of claim 2, wherein the controller performs driving the display to rotate if the aspect ratio does not match the landscape state of the display, and is further configured to:

acquiring the video width height ratio, and adapting the whole screen to display and play on a display according to the original proportion;

and when the display rotates to the video width-to-height ratio for adaptation, displaying the video picture in a full screen mode.

4. The display device of claim 2, wherein the controller performs driving the display to rotate if the aspect ratio does not match the landscape state of the display, and is further configured to:

acquiring the original resolution of the video before rotation, which is matched with the display;

determining the zoom multiple of the video picture according to the original resolution and the full-screen resolution of the display;

monitoring the rotation angle information of the display, and gradually zooming the video picture according to the rotation angle information to ensure that the video picture is finally displayed in a full screen mode.

5. The display device of claim 4, wherein the controller is further configured to:

the initial resolution is F1, the full-screen resolution is F2, and the video picture needs to be amplified by F2/F1 times in the rotation process; monitoring the rotation angle of the display from the horizontal screen to the vertical screen, dividing the whole rotation process into 90 parts according to the rotation angle, and amplifying (F2/F1)/90 every time the display rotates one degree.

6. A method for receiving screen projection content, which is applied to a display device, is characterized by comprising the following steps:

if the media resource attribute is a video, detecting the horizontal and vertical screen states of the display, acquiring the video width height ratio, and judging whether the video width height ratio is matched with the horizontal and vertical screen states of the display;

7. The method of receiving screen-shot content of claim 6, comprising:

when the video width height ratio is not matched with the horizontal and vertical screen states of the display, driving the display to rotate; and when the video width height ratio is matched with the horizontal and vertical screen states of the display, the video content is directly displayed on the display according to the screen adapted to the original proportion, and the video content is presented.

8. The method of claim 7, wherein the driving the display to rotate when the aspect ratio does not match the landscape mode of the display further comprises:

and when the display rotates to the state that the video width ratio is adaptive, displaying the video picture in a full screen mode.

9. The method of claim 7, wherein when the aspect ratio does not match the landscape state of the display, driving the display to rotate further comprises:

10. A non-volatile storage medium, characterized in that it performs the method for performing the method of claim 6~9.