CN112165644A - Display device and video playing method in vertical screen state - Google Patents

Display device and video playing method in vertical screen state Download PDF

Info

Publication number
CN112165644A
CN112165644A CN202011036180.0A CN202011036180A CN112165644A CN 112165644 A CN112165644 A CN 112165644A CN 202011036180 A CN202011036180 A CN 202011036180A CN 112165644 A CN112165644 A CN 112165644A
Authority
CN
China
Prior art keywords
layer
video
display
picture
image picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011036180.0A
Other languages
Chinese (zh)
Other versions
CN112165644B (en
Inventor
刘儒茜
于颜梅
李斌
刘丽英
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hisense Visual Technology Co Ltd
Original Assignee
Hisense Visual Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hisense Visual Technology Co Ltd filed Critical Hisense Visual Technology Co Ltd
Priority to CN202011036180.0A priority Critical patent/CN112165644B/en
Publication of CN112165644A publication Critical patent/CN112165644A/en
Priority to PCT/CN2021/080552 priority patent/WO2021180223A1/en
Priority to PCT/CN2021/080553 priority patent/WO2021180224A1/en
Application granted granted Critical
Publication of CN112165644B publication Critical patent/CN112165644B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The method can play video data through a video layer after a play starting instruction input by a user is obtained, an image picture is intercepted from the video layer, the intercepted image picture is sent to a graphic layer, when the video play is started, the graphic layer is controlled to display a black screen firstly, and the image picture is continuously displayed on the graphic layer after the graphic layer receives the image picture. The method can display the black screen picture through the control graphic layer before playing the video, and the problem of screen flashing caused by different playing speeds of the video layer and the graphic layer is solved.

Description

Display device and video playing method in vertical screen state
Technical Field
The application relates to the technical field of smart televisions, in particular to a display device and a video playing method in a vertical screen state.
Background
The intelligent television equipment has an independent operating system and supports function expansion. Various application programs can be installed in the smart television according to the needs of the user, for example, social applications such as traditional video applications and short videos, and reading applications such as cartoons and books. The applications can display application pictures by utilizing a screen of the intelligent television, and rich media resources are provided for the intelligent television. Meanwhile, the intelligent television can also perform data interaction and resource sharing with different terminals. For example, the smart television can be connected with a mobile phone through a wireless communication mode such as a local area network and bluetooth, so as to play resources in the mobile phone or directly project a screen to display a picture on the mobile phone.
However, since the picture scales corresponding to different applications or media assets from different sources are different, the smart tv is often used to display pictures with different scales from the traditional video. For example, video resources shot by a terminal such as a mobile phone are generally vertical media resources with aspect ratios of 9:16, 9:18, 3:4 and the like; and the pictures provided by the reading application are vertical resources similar to the aspect ratio of the book. The aspect ratio of the display screen of the intelligent television is generally in a transverse state of 16:9, 16:10 and the like, so when vertical media such as short videos, cartoons and the like are displayed through the intelligent television, vertical media pictures cannot be normally displayed due to the fact that the picture ratio is not matched with the display screen ratio. Generally, the vertical media asset images need to be zoomed to be displayed completely, which not only wastes the display space on the screen, but also brings bad user experience.
Disclosure of Invention
The application provides a display device and a video playing method in a vertical screen state, and aims to solve the problem that a screen is easy to flicker when a traditional display device starts playing a video and finishes playing the video.
In a first aspect, the present application provides a display device comprising: a display, a rotating assembly, and a controller. Wherein the display is configured to present a user interface; the rotating component is configured to drive the display to rotate so that the display is in one of a landscape screen state or a portrait screen state; the controller is configured to perform the following program steps:
acquiring a play starting instruction input by a user;
responding to the starting playing instruction, and playing video data through a video layer;
intercepting an image picture from the video layer, and sending the intercepted image picture to a graphic layer, wherein the graphic layer is displayed on the upper layer of the video layer;
and controlling the graphic layer to display a black screen until the graphic layer receives the image picture, and continuing to display the image picture on the graphic layer.
Based on the display device, the first aspect of the present application further provides a video playing method in a vertical screen state, which is applied to a display device, where the display device includes a display, a rotating assembly, and a controller, and the method includes:
acquiring a play starting instruction input by a user;
responding to the starting playing instruction, and playing video data through a video layer;
intercepting an image picture from the video layer, and sending the intercepted image picture to a graphic layer, wherein the graphic layer is displayed on the upper layer of the video layer;
and controlling the graphic layer to display a black screen until the graphic layer receives the image picture, and continuing to display the image picture on the graphic layer.
According to the technical scheme, the display device and the video playing method in the vertical screen state provided by the first aspect of the application can play video data through the video layer after a playing start instruction input by a user is obtained, intercept an image picture from the video layer, and send the intercepted image picture to the graphics layer, when the video playing is started, the graphics layer is controlled to display a black screen firstly, and the image picture is continuously displayed on the graphics layer after the graphics layer receives the image picture. The method can display the black screen picture through the control graphic layer before playing the video, and the problem of screen flashing caused by different playing speeds of the video layer and the graphic layer is solved.
In a second aspect, the present application also provides a display device, comprising: a display, a rotating assembly, and a controller. Wherein the display is configured to present a user interface; the rotating component is configured to drive the display to rotate so that the display is in one of a landscape screen state or a portrait screen state; the controller is configured to perform the following program steps:
acquiring a play closing instruction input by a user;
closing the video layer in response to the play closing instruction;
and intercepting the image picture from the video layer, and stopping sending the intercepted image picture to the graphics layer after detecting the call-back of the video layer after closing is completed, wherein the graphics layer is displayed on the upper layer of the video layer.
Based on the display device, a second aspect of the present application further provides a video playing method in a vertical screen state, where the method is applicable to a display device, the display device includes a display, a rotating assembly, and a controller, and the method includes:
acquiring a play closing instruction input by a user;
closing the video layer in response to the play closing instruction;
and intercepting the image picture from the video layer, and stopping sending the intercepted image picture to the graphics layer after detecting the call-back of the video layer after closing is completed, wherein the graphics layer is displayed on the upper layer of the video layer.
According to the technical scheme, the display device and the video playing method in the vertical screen state provided by the second aspect of the application can execute the closing of the video layer after the closing playing instruction input by the user is obtained, and continuously intercept the image picture from the video layer during the execution of the closing of the video layer until the callback of the completion of the closing of the video layer is detected, and then stop sending the intercepted image picture to the graphics layer. According to the method, when the user executes the action of closing the video playing, the graphic layer and the video layer are kept closed synchronously by delaying the closing of the graphic layer, so that the problem that the screen flashing easily occurs when the video is closed is solved.
Drawings
In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1A is an application scenario diagram of a display device according to the present application;
FIG. 1B is a rear view of a display device of the present application;
fig. 2 is a block diagram of a hardware configuration of a control apparatus according to the present application;
FIG. 3 is a block diagram of a hardware configuration of a display device according to the present application;
FIG. 4 is a block diagram of an architectural configuration of an operating system in a memory of a display device according to the present application;
FIG. 5A is a schematic view of a horizontal screen of a display device according to the present application;
FIG. 5B is a schematic diagram of a vertical screen state of the display device of the present application;
FIG. 6 is a schematic flow chart illustrating a method for starting video playback in a portrait screen state according to the present application;
FIG. 7 is a schematic diagram illustrating a display method when video playback is started according to the present application;
FIG. 8 is a flowchart illustrating a process of controlling a video layer to display video data according to the present application;
FIG. 9 is a schematic view of a flow chart for controlling a graphic layer to display a black screen according to the present application;
fig. 10 is a schematic flow chart illustrating a method for closing a video playback in a portrait screen state according to the present application.
Detailed Description
Reference will now be made in detail to embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following examples do not represent all embodiments consistent with the present application. But merely as exemplifications of systems and methods consistent with certain aspects of the application, as recited in the claims.
In order to facilitate a user to display a video picture in different horizontal and vertical screen states of a display, embodiments of the present application provide a video picture rotation display method and a display device suitable for the video picture rotation display method, where the display device is, for example, a rotating television. It should be noted that the method provided in this embodiment is not only applicable to the rotating television, but also applicable to other display devices, such as a computer, a tablet computer, and the like.
The term "module," as used in various embodiments of the present application, may refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.
The term "remote control" as used in the embodiments of the present application refers to a component of an electronic device (such as the display device disclosed in the present application) that is capable of wirelessly controlling the electronic device, typically over a short distance. The component may typically be connected to the electronic device using infrared and/or Radio Frequency (RF) signals and/or bluetooth, and may also include functional modules such as WiFi, wireless USB, bluetooth, motion sensors, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.
The term "gesture" as used in the embodiments of the present application refers to a user behavior used to express an intended idea, action, purpose, or result through a change in hand shape or an action such as hand movement.
The term "hardware system" used in the embodiments of the present application may refer to a physical component having computing, controlling, storing, inputting and outputting functions, which is formed by a mechanical, optical, electrical and magnetic device such as an Integrated Circuit (IC), a Printed Circuit Board (PCB) and the like. In various embodiments of the present application, a hardware system may also be generally referred to as a motherboard (motherboard) or a host chip or controller.
Referring to fig. 1A, an application scenario diagram of a display device according to some embodiments of the present application is provided. As shown in fig. 1A, the control apparatus 100 and the display device 200 may communicate with each other in a wired or wireless manner.
Among them, the control apparatus 100 is configured to control the display device 200, which may receive an operation instruction input by a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an intermediary for interaction between the user and the display device 200. Such as: the user operates the channel up/down key on the control device 100, and the display device 200 responds to the channel up/down operation.
The control device 100 may be a remote controller 100A, which includes infrared protocol communication or bluetooth protocol communication, and other short-distance communication methods, etc. to control the display apparatus 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.
The control device 100 may also be an intelligent device, such as a mobile terminal 100B, a tablet computer, a notebook computer, and the like. For example, the display device 200 is controlled using an application program running on the smart device. The application program may provide various controls to a user through an intuitive User Interface (UI) on a screen associated with the smart device through configuration.
For example, the mobile terminal 100B may install a software application with the display device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 100B may be caused to establish a control instruction protocol with the display device 200, and the functions of the physical keys as arranged by the remote control 100A may be implemented by operating various function keys or virtual controls of the user interface provided on the mobile terminal 100B. The audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.
The display apparatus 200 may provide a network television function of a broadcast receiving function and a computer support function. The display device may be implemented as a digital television, a web television, an Internet Protocol Television (IPTV), or the like.
The display device 200 may be a liquid crystal display, an organic light emitting display, a projection device. The specific display device type, size, resolution, etc. are not limited.
The display apparatus 200 also performs data communication with the server 300 through various communication means. Here, the display apparatus 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 300 may provide various contents and interactions to the display apparatus 200. By way of example, the display device 200 may send and receive information such as: receiving Electronic Program Guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library. The servers 300 may be a group or groups of servers, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through the server 300.
In some embodiments, as shown in FIG. 1B, display device 200 includes a rotation assembly 276, a controller 250, a display 275, a terminal interface 278 extending from the gap in the backplane, and a rotation assembly 276 coupled to the backplane, the rotation assembly 276 configured to rotate the display 275. From the perspective of the front view of the display device, the rotating component 276 can rotate the display screen to a vertical screen state, that is, a state where the vertical side length of the screen is greater than the horizontal side length, or to a horizontal screen state, that is, a state where the horizontal side length of the screen is greater than the vertical side length.
Fig. 2 is a block diagram illustrating the configuration of the control device 100. As shown in fig. 2, the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, a user output interface 150, and a power supply 160.
The controller 110 includes a Random Access Memory (RAM)111, a Read Only Memory (ROM)112, a processor 113, a communication interface, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components of the communication cooperation, external and internal data processing functions.
Illustratively, when an interaction of a user pressing a key disposed on the remote controller 100A or an interaction of touching a touch panel disposed on the remote controller 100A is detected, the controller 110 may control to generate a signal corresponding to the detected interaction and transmit the signal to the display device 200.
And a memory 120 for storing various operation programs, data and applications for driving and controlling the control apparatus 100 under the control of the controller 110. The memory 120 may store various control signal commands input by a user.
The communicator 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the control apparatus 100 transmits a control signal (e.g., a touch signal or a control signal) to the display device 200 via the communicator 130, and the control apparatus 100 may receive the signal transmitted by the display device 200 via the communicator 130. The communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132. For example: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.
The user input interface 140 may include at least one of a microphone 141, a touch pad 142, a sensor 143, a key 144, and the like, so that a user can input a user instruction regarding controlling the display apparatus 200 to the control apparatus 100 through voice, touch, gesture, press, and the like.
The user output interface 150 outputs a user instruction received by the user input interface 140 to the display apparatus 200, or outputs an image or voice signal received by the display apparatus 200. Here, the user output interface 150 may include an LED interface 151, a vibration interface 152 generating vibration, a sound output interface 153 outputting sound, a display 154 outputting images, and the like. For example, the remote controller 100A may receive an output signal such as audio, video, or data from the user output interface 150 and display the output signal in the form of an image on the display 154, an audio on the sound output interface 153, or a vibration on the vibration interface 152.
And a power supply 160 for providing operation power support for each element of the control device 100 under the control of the controller 110. In the form of a battery and associated control circuitry.
A hardware configuration block diagram of the display device 200 is exemplarily shown in fig. 3. As shown in fig. 3, the display apparatus 200 may include a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, a rotating assembly 276, an audio processor 280, an audio output interface 285, and a power supply 290.
The rotating assembly 276 may include a driving motor, a rotating shaft, and the like. Wherein, the driving motor can be connected to the controller 250 and output the rotation angle under the control of the controller 250; one end of the rotation shaft is connected to a power output shaft of the driving motor, and the other end is connected to the display 275, so that the display 275 can be fixedly mounted on a wall or a bracket through the rotation member 276.
The rotating assembly 276 may also include other components, such as a transmission component, a detection component, and the like. Wherein, the transmission component can adjust the rotating speed and the torque output by the rotating component 276 through a specific transmission ratio, and can be in a gear transmission mode; the detection means may be composed of a sensor, such as an angle sensor, an attitude sensor, or the like, provided on the rotation shaft. These sensors may detect parameters such as the angle at which the rotating assembly 276 is rotated and transmit the detected parameters to the controller 250, so that the controller 250 can determine or adjust the state of the display apparatus 200 according to the detected parameters. In practice, rotating assembly 276 may include, but is not limited to, one or more of the components described above.
The tuner demodulator 210 receives the broadcast television signal in a wired or wireless manner, may perform modulation and demodulation processing such as amplification, mixing, and resonance, and is configured to demodulate, from a plurality of wireless or wired broadcast television signals, an audio/video signal carried in a frequency of a television channel selected by a user, and additional information (e.g., EPG data).
The tuner demodulator 210 is responsive to the user selected frequency of the television channel and the television signal carried by the frequency, as selected by the user and controlled by the controller 250.
The tuner demodulator 210 can receive a television signal in various ways according to the broadcasting system of the television signal, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, or the like; and according to different modulation types, a digital modulation mode or an analog modulation mode can be adopted; and can demodulate the analog signal and the digital signal according to the different kinds of the received television signals.
In other exemplary embodiments, the tuning demodulator 210 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs a television signal after modulation and demodulation, and inputs the television signal into the display apparatus 200 through the external device interface 240.
The communicator 220 is a component for communicating with an external device or an external server according to various communication protocol types. For example, the display apparatus 200 may transmit content data to an external apparatus connected via the communicator 220, or browse and download content data from an external apparatus connected via the communicator 220. The communicator 220 may include a network communication protocol module or a near field communication protocol module, such as a WIFI module 221, a bluetooth communication protocol module 222, and a wired ethernet communication protocol module 223, so that the communicator 220 may receive a control signal of the control device 100 according to the control of the controller 250 and implement the control signal as a WIFI signal, a bluetooth signal, a radio frequency signal, and the like.
The detector 230 is a component of the display apparatus 200 for collecting signals of an external environment or interaction with the outside. The detector 230 may include a sound collector 231, such as a microphone, which may be used to receive a user's sound, such as a voice signal of a control instruction of the user to control the display device 200; alternatively, ambient sounds may be collected that identify the type of ambient scene, enabling the display device 200 to adapt to ambient noise.
In some other exemplary embodiments, the detector 230, which may further include an image collector 232, such as a camera, a video camera, etc., may be configured to collect external environment scenes to adaptively change the display parameters of the display device 200; and the function of acquiring the attribute of the user or interacting gestures with the user so as to realize the interaction between the display equipment and the user.
In some other exemplary embodiments, the detector 230 may further include a light receiver for collecting the intensity of the ambient light to adapt to the display parameter variation of the display device 200.
In some other exemplary embodiments, the detector 230 may further include a temperature sensor, such as by sensing an ambient temperature, and the display device 200 may adaptively adjust a display color temperature of the image. For example, when the temperature is higher, the display apparatus 200 may be adjusted to display a color temperature of an image that is cooler; when the temperature is lower, the display device 200 may be adjusted to display a warmer color temperature of the image.
The external device interface 240 is a component for providing the controller 250 to control data transmission between the display apparatus 200 and an external apparatus. The external device interface 240 may be connected to an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.
The external device interface 240 may include: a High Definition Multimedia Interface (HDMI) terminal 241, a Composite Video Blanking Sync (CVBS) terminal 242, an analog or digital Component terminal 243, a Universal Serial Bus (USB) terminal 244, a Component terminal (not shown), a red, green, blue (RGB) terminal (not shown), and the like.
The controller 250 controls the operation of the display device 200 and responds to the operation of the user by running various software control programs (such as an operating system and various application programs) stored on the memory 260.
As shown in fig. 3, the controller 250 includes a Random Access Memory (RAM)251, a Read Only Memory (ROM)252, a graphics processor 253, a CPU processor 254, a communication interface 255, and a communication bus 256. The RAM251, the ROM252, the graphic processor 253, and the CPU processor 254 are connected to each other through a communication bus 256 through a communication interface 255.
The ROM252 stores various system boot instructions. When the display apparatus 200 starts power-on upon receiving the power-on signal, the CPU processor 254 executes a system boot instruction in the ROM252, copies the operating system stored in the memory 260 to the RAM251, and starts running the boot operating system. After the start of the operating system is completed, the CPU processor 254 copies the various application programs in the memory 260 to the RAM251 and then starts running and starting the various application programs.
And a graphic processor 253 for generating various graphic objects such as icons, operation menus, and user input instruction display graphics, etc. The graphic processor 253 may include an operator for performing an operation by receiving various interactive instructions input by a user, and further displaying various objects according to display attributes; and a renderer for generating various objects based on the operator and displaying the rendered result on the display 275.
A CPU processor 254 for executing operating system and application program instructions stored in memory 260. And according to the received user input instruction, processing of various application programs, data and contents is executed so as to finally display and play various audio-video contents.
In some example embodiments, the CPU processor 254 may comprise a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some initialization operations of the display apparatus 200 in the display apparatus preload mode and/or operations of displaying a screen in the normal mode. A plurality of or one sub-processor for performing an operation in a state of a standby mode or the like of the display apparatus.
The communication interface 255 may include a first interface to an nth interface. These interfaces may be network interfaces that are connected to external devices via a network.
The controller 250 may control the overall operation of the display apparatus 200. For example: in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.
Where the object may be any one of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object is, for example, an operation of displaying a link to a hyperlink page, document, image, or the like, or an operation of executing a program corresponding to the object. The user input command for selecting the GUI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch panel, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.
A memory 260 for storing various types of data, software programs, or applications for driving and controlling the operation of the display device 200. The memory 260 may include volatile and/or nonvolatile memory. And the term "memory" includes the memory 260, the RAM251 and the ROM252 of the controller 250, or a memory card in the display device 200.
In some embodiments, the memory 260 is specifically used for storing an operating program for driving the controller 250 of the display device 200; storing various application programs built in the display apparatus 200 and downloaded by a user from an external apparatus; data such as visual effect images for configuring various GUIs provided by the display 275, various objects related to the GUIs, and selectors for selecting GUI objects are stored.
In some embodiments, memory 260 is specifically configured to store drivers for tuner demodulator 210, communicator 220, detector 230, external device interface 240, video processor 270, display 275, audio processor 280, etc., and related data, such as external data (e.g., audio-visual data) received from the external device interface or user data (e.g., key information, voice information, touch information, etc.) received by the user interface.
In some embodiments, memory 260 specifically stores software and/or programs representing an Operating System (OS), which may include, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. Illustratively, the kernel may control or manage system resources, as well as functions implemented by other programs (e.g., the middleware, APIs, or applications); at the same time, the kernel may provide an interface to allow middleware, APIs, or applications to access the controller to enable control or management of system resources.
A block diagram of the architectural configuration of the operating system in the memory of the display device 200 is illustrated in fig. 4. The operating system architecture comprises an application layer, a middleware layer and a kernel layer from top to bottom.
The application layer, the application programs built in the system and the non-system-level application programs belong to the application layer. Is responsible for direct interaction with the user. The application layer may include a plurality of applications such as a setup application, a post application, a media center application, and the like. These applications may be implemented as Web applications that execute based on a WebKit engine, and in particular may be developed and executed based on HTML5, Cascading Style Sheets (CSS), and JavaScript.
Here, HTML, which is called hypertext Markup Language (hypertext Markup Language), is a standard Markup Language for creating web pages, and describes the web pages by Markup tags, where the HTML tags are used to describe characters, graphics, animation, sound, tables, links, etc., and a browser reads an HTML document, interprets the content of the tags in the document, and displays the content in the form of web pages.
CSS, known as Cascading Style Sheets (Cascading Style Sheets), is a computer language used to represent the Style of HTML documents, and may be used to define Style structures, such as fonts, colors, locations, etc. The CSS style can be directly stored in the HTML webpage or a separate style file, so that the style in the webpage can be controlled.
JavaScript, a language applied to Web page programming, can be inserted into an HTML page and interpreted and executed by a browser. The interaction logic of the Web application is realized by JavaScript. The JavaScript can package a JavaScript extension interface through a browser, realize the communication with the kernel layer,
the middleware layer may provide some standardized interfaces to support the operation of various environments and systems. For example, the middleware layer may be implemented as multimedia and hypermedia information coding experts group (MHEG) middleware related to data broadcasting, DLNA middleware which is middleware related to communication with an external device, middleware which provides a browser environment in which each application program in the display device operates, and the like.
The kernel layer provides core system services, such as: file management, memory management, process management, network management, system security authority management and the like. The kernel layer may be implemented as a kernel based on various operating systems, for example, a kernel based on the Linux operating system.
The kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: provide display driver for the display, provide camera driver for the camera, provide button driver for the remote controller, provide wiFi driver for the WIFI module, provide audio driver for audio output interface, provide power management drive for Power Management (PM) module etc..
In FIG. 3, user interface 265, receives various user interactions. Specifically, it is used to transmit an input signal of a user to the controller 250 or transmit an output signal from the controller 250 to the user. For example, the remote controller 100A may transmit an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by the user to the user interface 265, and then the input signal is transferred to the controller 250 through the user interface 265; alternatively, the remote controller 100A may receive an output signal such as audio, video, or data output from the user interface 265 via the controller 250, and display the received output signal or output the received output signal in audio or vibration form.
In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on the display 275, and the user interface 265 receives the user input commands through the GUI. Specifically, the user interface 265 may receive user input commands for controlling the position of a selector in the GUI to select different objects or items. Among these, "user interfaces" are media interfaces for interaction and information exchange between an application or operating system and a user, which enable the conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the user interface is a Graphical User Interface (GUI), which refers to a user interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include a visual interface element such as an icon, a control, a menu, a tab, a text box, a dialog box, a status bar, a channel bar, a Widget, etc.
Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user interface 265 receives the user input command by recognizing the sound or gesture through the sensor.
The video processor 270 is configured to receive an external video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a video signal that is directly displayed or played on the display 275.
Illustratively, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.
The demultiplexing module is configured to demultiplex an input audio/video data stream, where, for example, an input MPEG-2 stream (based on a compression standard of a digital storage media moving image and voice), the demultiplexing module demultiplexes the input audio/video data stream into a video signal and an audio signal.
And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.
And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.
The frame rate conversion module is configured to convert a frame rate of an input video, for example, convert a frame rate of an input 60Hz video into a frame rate of 120Hz or 240Hz, where a common format is implemented by using, for example, an interpolation frame method.
And a display formatting module for converting the signal output by the frame rate conversion module into a signal conforming to a display format of a display, such as converting the format of the signal output by the frame rate conversion module to output an RGB data signal.
A display 275 for receiving the image signal from the video processor 270 and displaying the video content, the image and the menu manipulation interface. The display video content may be from the video content in the broadcast signal received by the tuner-demodulator 210, or from the video content input by the communicator 220 or the external device interface 240. The display 275, while displaying a user manipulation interface UI generated in the display apparatus 200 and used to control the display apparatus 200.
And, the display 275 may include a display screen assembly for presenting a picture and a driving assembly for driving the display of an image. Alternatively, a projection device and projection screen may be included, provided display 275 is a projection display.
Rotating assembly 276, the controller may issue a control signal to cause rotating assembly 276 to rotate display 255.
The audio processor 280 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played by the speaker 286.
Illustratively, audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), high efficiency AAC (HE-AAC), and the like.
The audio output interface 285 is used for receiving an audio signal output by the audio processor 280 under the control of the controller 250, and the audio output interface 285 may include a speaker 286 or an external sound output terminal 287, such as an earphone output terminal, for outputting to a generating device of an external device.
In other exemplary embodiments, video processor 270 may comprise one or more chips. Audio processor 280 may also comprise one or more chips.
And, in other exemplary embodiments, the video processor 270 and the audio processor 280 may be separate chips or may be integrated with the controller 250 in one or more chips.
And a power supply 290 for supplying power supply support to the display apparatus 200 from the power input from the external power source under the control of the controller 250. The power supply 290 may be a built-in power supply circuit installed inside the display apparatus 200 or may be a power supply installed outside the display apparatus 200.
For the display device 200, the controller 250 may issue a command to control the driving motor of the rotating assembly 276 to rotate by a preset angle according to the direction indicated by the command, so as to rotate the display 275 to different rotation states. In general, to accommodate different viewing needs, multiple rotation angles may be preset to place the display 275 in different rotation states. For example, the rotation state may include a landscape state and a portrait state, wherein the landscape state means that the long side of the screen of the display 275 is parallel to the ground (or horizontal plane) and the short side is perpendicular to the ground (or horizontal plane), as shown in fig. 5A; the portrait screen state refers to the situation where the short side of the screen of the display 275 is parallel to the ground (or horizontal plane) and the long side is perpendicular to the ground (or horizontal plane) as shown in fig. 5B.
Obviously, the landscape mode is suitable for playing the media resources in the landscape mode with 16:9, 4:3 and other picture proportions, such as conventional video resources of movies, television series and the like. The vertical screen state is more suitable for playing pictures with the ratio of 9: and (3) media assets in vertical screen forms such as 16, 3:4 and the like, such as short videos, cartoons and the like shot by a terminal such as a mobile phone and the like.
It should be noted that, although the landscape state is mainly used for displaying horizontal media such as dramas and movies, and the portrait state is mainly used for displaying vertical media such as short videos and cartoons, the landscape state and the portrait state are only two different display states, and do not limit the displayed content. For example, vertical media such as short videos and cartoons can still be displayed in the horizontal screen state; in the vertical screen state, the horizontal media assets such as TV series and movies can still be displayed, and only in the state, the non-conforming display windows need to be zoomed and adjusted.
Different rotational states correspond to rotating assembly 276 being at different rotational angles. In practice, if the rotation angle of the rotating assembly 276 is 0 degrees when the horizontal screen state of the display 275 is defined, the rotation angle of the rotating assembly 276 is 90 degrees (or-90 degrees) when the vertical screen state of the display 275 is defined. In addition to the landscape and portrait orientations described above, the rotation assembly 276 may rotate the display 275 through any angle, such as a 180 degree inverted screen orientation, for example.
As the display device 200 plays certain videos, the display 275 needs to be automatically rotated to accommodate different forms of video assets. For example, when the display 275 is in a landscape state, the user selects to play a portrait media such as a short video. The operating system of the display device 200 may detect that the aspect ratio of the video resource is smaller than 1 and the aspect ratio of the current display 275 is larger than 1, i.e., determine that the current rotation status does not match the video resource, and automatically send a control command to the rotation component 276 to rotate the display 275 clockwise (or counterclockwise) by 90 degrees, and adjust the display 275 to the vertical screen status.
When the display device 200 displays the video image, the image quality of the video image may be further processed by an image quality adjustment algorithm. The image quality processing may include processing of an image on each frame of a video picture, such as color correction, color adjustment, and the like, and may also include processing of multi-frame data of the video picture, such as frame interpolation algorithm, motion compensation, and the like. Through image quality processing, the image display quality can be further improved, and therefore better film viewing experience is achieved under the condition that the configuration of the same equipment is the same and the size of video source resources is not increased.
In general, in order to perform Video screen display on the display 275, a plurality of display hierarchies, such as a Video layer (Video layer), a graphics layer (surface layer), and the like, are arranged in the system framework of the display device 200. The video layer refers to a display level for presenting a playing picture on the display device 200 after the user plays the media asset, and may also be referred to as a picture layer of the display device 200. The playing picture corresponding to the media assets can be displayed on the image quality layer. The graphics layer is used for providing a display hierarchy of interactive operations for a User, and may also be referred to as a UI (User Interface) layer of the display apparatus 200. The video layer can perform image quality processing on a displayed picture, and the graphics layer can perform post-adjustment, such as rotation and scaling, on the displayed picture. And the graphic layer as a UI layer can also add various interactive controls for the display picture, such as a control homepage and the like, so as to manually adjust the picture.
With the rotatable display device 200, since the rotating assembly 276 cannot rotate the display 275 to a preset angle quickly due to the large volume and weight of the display 275, a user needs to wait for a certain time to view a video asset normally during the rotation of the display 275. For example, the rotation of the display 275 from the landscape state to the portrait state consumes 10-30s, and during this period, the original frame on the display 275 will tilt along with the rotation of the display 275 until the display 275 is completely rotated to the portrait state (or rotated to a predetermined angle), and the display can not be adjusted to rotate and to cover the screen. Therefore, during the period, the user needs to watch the inclined picture for a long time, and the user experience is seriously influenced.
In view of this, in some embodiments, it may be implemented that the display 275 is rotated, and the display screen is rotated, so that the display screen is always in a forward state, and the user can normally view the display screen during the rotation of the display 275. In order to achieve the above effect, after the video layer plays the video data, the picture in the video layer is captured, the captured picture is processed by rotating, zooming and the like, and then is sent to the graphic layer for displaying, and the processed display picture can be always displayed to the user in the forward direction.
For example, in a state where the display 275 is rotated clockwise by 30 degrees, the angle through which the display 275 rotates may be offset by intercepting the image in the video layer and rotating counterclockwise by 30 degrees to display the picture tilted counterclockwise by 30 degrees in the graphics layer. At the viewing angle of the user, the display state is forward.
Similarly, for some media asset pictures which do not support the vertical screen state, the display in the vertical screen state can be completed by adopting the mode. For example, for a part of application programs, the playing interface only supports the landscape screen state, when the display 275 is in the portrait screen state, the image may be captured by the video layer, and then the image may be zoomed, cropped, filled, etc. to form a picture conforming to the display scale of the portrait screen, so as to display the processed picture on the graphic layer.
In general, video data played by the display apparatus 200 includes video data for presenting a display screen and audio data for presenting sound. Since only the video data in the video layer can be intercepted to the graphics layer for display, the audio data still needs to be output by the original path, i.e. the video data still needs to be played at the video layer to output the audio data.
Based on this, when the display device 200 is in the vertical screen state or in the rotation process, starting video playing is affected by factors such as hardware performance, application decoding efficiency and the like, and picture time delay occurs, so that video data which is sent to the graphic layer for display for the first time cannot be acquired in time, and the video layer already displays picture content. In this case, when the video starts to be played in the vertical screen state, the picture in the video layer may be flashed first, and then the picture in the graphics layer is displayed.
Similarly, when the video playing quits, because the picture of the graphic layer is quitted faster than the video layer, the video layer still outputs the picture corresponding to the video data after the graphic layer quits, so that the problem that the picture of the video layer is flashed when the video playing quits in a vertical screen state is also caused. That is, for the rotatable display device 200, the problem of screen flashing occurs both when the video starts to be played and when the video exits from being played, which seriously affects the user experience.
In order to improve the user experience, some embodiments of the present application provide a video playing method in the portrait screen state, which is applicable to the display device 200, wherein the display device 200 may include a display 275, a rotating assembly 276 and a controller 250. The method may be configured in the controller 250 in the form of a control program for controlling display control when video playback is started. As shown in fig. 6, the method comprises the steps of:
s11: and acquiring a play starting instruction input by a user.
The display device 200 may obtain the video data through the server 300 or the local resource and the third-party resource platform, and decode the video data through a player in the display device 200, so as to present specific picture content corresponding to the video data on the display 275.
Depending on how the display device 200 interacts with the user, the user may input an instruction to start playing the video through different interaction actions. For example, the user may enter the application list interface or the asset selection interface by interacting with keys on the control device 100 (e.g., a remote control), and adjust the focus cursor position in the application list interface or the asset selection interface through the "up, down, left, and right" keys. After the focus cursor is positioned on an application icon such as "xx video" or any media icon, pressing the "OK/OK" key inputs a play start instruction to start playing video data.
The user may also enter control instructions for starting playing the video data in other ways. For example, for the display device 200 supporting touch operation, the user may directly click a touch on the position of the icon corresponding to the video data in the application list interface or the media asset selection interface to play the corresponding video data. For the display device 200 with the built-in intelligent voice system, the user can control the display device 200 to start playing video data by inputting voice instructions such as "play any book", "i want to see any book", and so on.
S12: and responding to the starting playing instruction, and playing the video data through the video layer.
After acquiring the user input start play instruction, the display apparatus 200 may acquire video data from the corresponding video source. For example, the display device 200 may extract local video data stored therein by calling the memory 260 after receiving a play start instruction; the display device 200 may further form a data obtaining instruction after receiving the play starting instruction, and send the data obtaining instruction to the server 300 or the third-party resource platform, and the server 300 or the third-party resource platform may feed back the video data to the display device 200 according to the data obtaining instruction.
After obtaining the video data, the display device 200 may decode the video data through a player to form a specific video picture, so as to play the specific video picture through the video layer. It is clear that for video data, which after decoding can generally obtain video data and audio data, wherein the video data can form specific pictures through the video layer for presentation in the display 275. The audio data may output corresponding sound through an audio output device built in or externally connected to the display apparatus 200 to play the audio data. And in order to realize sound and picture synchronization, the display process of the video data and the audio data is kept synchronous.
It should be noted that, in this embodiment, the playing of the video data through the video layer refers to a process of displaying the video on the video layer after decoding the video, and does not include a process of presenting a final picture on the display 275. The final picture presented on the display 275 is a superposition of multiple display levels, whereas the video layer is only one of the multiple display levels.
S13: capturing an image picture from the video layer, and transmitting the captured image picture to the graphics layer.
When the display 275 is in the vertical screen state or in the process of rotating, in order to present a forward displayed picture which is convenient for the user to view, the picture of the video layer needs to be captured, and displayed in the graphics layer after being processed by rotating, zooming, etc. Because the graphic layer is displayed on the upper layer of the video layer, the picture in the graphic layer can shield the picture in the video layer, so that the display content watched by the user is the content in the converted graphic layer.
For example, the portrait state is a state rotated by 90 ° clockwise with respect to the landscape state, and when the display 275 is in the portrait state, it is necessary to intercept each frame of image in the video layer, rotate the intercepted image by 90 ° counterclockwise, and simultaneously zoom to adapt to the display window form in the portrait state.
Obviously, in order to enable the display apparatus 200 to normally output the audio data and to intercept the image picture in the video layer, the video layer should continuously present the video picture during the video playback. In addition, in order to make the graphics layer block the picture in the video layer, the process of processing the intercepted image picture may further include adding a filling area on the image picture. For example, the filling area may be an edge area outside the effective content in the image picture to which a pure color picture is added to shield picture content in the video layer by the pure color picture.
S14: and controlling the graphic layer to display a black screen until the graphic layer receives the image picture, and continuing to display the image picture on the graphic layer.
After sending the captured image to the graphics layer, the graphics layer may present the processed captured image. Since the image frames in the video layer need to be processed by rotation, scaling, filling, etc. after being captured, the processes of capturing, processing, and sending to the graphics layer consume a certain amount of time to be displayed in the graphics layer, that is, a specific frame is not displayed in the graphics layer but a corresponding frame is displayed in the video layer within a period of time after the start of playing, so that the frame in the video layer is displayed in the display 275 within the period of time, and the problem of screen flashing occurs.
Therefore, as shown in fig. 7, after the picture captured in the video layer is controlled to be sent to the graphics layer, the graphics layer may be controlled to display a black screen picture, so that the picture content in the video layer can be blocked in the graphics layer until the captured picture is received in the graphics layer, and then the picture corresponding to the captured video data is continuously displayed in the graphics layer.
Therefore, in this embodiment, the problem that the video picture in the video layer is flashed when the video content is not available due to slow acquisition of the video frame by the graphics layer is avoided by controlling the graphics layer to display the black screen at the video starting stage to display the played video content.
To enable playing video data in the video layer, in some embodiments, the step of playing video data through the video layer further comprises:
s201: starting an application program appointed in the playing starting instruction;
s202: creating a player and the video layer by the application;
s203: and decoding the video data through the player so as to play the picture corresponding to the video data on the video layer.
Since the display device 200 may play the video data through the application program, after the user inputs the play start instruction, the controller 250 may parse the play start instruction, obtain the specified application package name information therein, and start to run the application program capable of playing the video data according to the specified application package name information. The application program refers to a system application or a third-party application that can be installed in the display device 200, and may be presented in different forms according to an operating system platform of the display device 200, for example, an APK based on an android system.
After the application is started, the player and video layers may be created by the application. For example, the APK creates a player and the APK creates a video window, i.e., a video layer (surfaceview), so that the video data to be played is decoded by the player so as to play a picture corresponding to the video data on the video layer.
For example, the user selects the "gather-look" application in the application program interface, starts to run the gather-look application APK after pressing the "confirm/OK" key on the remote controller, and starts playing the video data by selecting any one of the media asset icons in the application interface. And the APK respectively creates a player and a video layer according to the video playing program, so that the selected media asset data is decoded by the player, and the picture formed after decoding is displayed on the video layer.
For the rotatable display device 200, due to its built-in playback mode, when it is detected that the state of the display 275 is changed, the orientation of the picture in the video layer is automatically adjusted to adapt to the rotation state of the display 275. Wherein the rotation state comprises a landscape state and a portrait state. For example, when the display device 200 is in the landscape state, the video layer may be displayed in the original direction of the video data, and when the display device is in the portrait state, the picture formed by playing in the video layer may be rotated clockwise by 90 ° to fit the portrait state.
However, in the embodiment of the present application, the frame rotation operation in the vertical screen setting state is completed in the process of processing after the frame of the video layer is cut, so that the frame is rotated by 90 ° more to prevent the final frame from being presented. As shown in fig. 8, in some embodiments of the present application, the step of creating a player and the video layer by the application further includes:
s221: setting first mark information for the video layer;
s222: detecting a rotation state of the display through the rotation assembly;
s223: and if the display is in a vertical screen state, controlling the picture of the video layer not to rotate by an angle according to the first mark information.
In order to indicate that the current video playing process needs to adapt to the rotation state, the created video layer can be indicated by setting the mark information after the player and the video layer are created. For example, after the video window creation is completed, the APK sets flag information flags1 and passes it to the video layer (faceview).
The APK detects the rotation state of the display 275, and when the display 275 is judged to be in the vertical screen state at this time, the surfview controls the picture in the corresponding video layer according to the flag information flag 1 set by the application, and the picture does not rotate along with the rotation angle (vertical screen 90 degrees) of the display 275 any more, so that the problem of abnormal display of 90 degrees more than the display direction of the video content is avoided.
The detection of the rotation state may be performed by a gravitational acceleration sensor built in the display device 200, an angle sensor provided on the rotating member 276, and the like. For example, the rotation angle of the display 275 in the landscape state may be preset to 0, and the rotation angle of the rotating assembly 276 detected by the angle sensor may be 90 °, so that it may be determined that the display 275 is currently in the portrait state.
It should be noted that, during the rotation of the display 275, a mode of capturing an image frame from a video layer and performing adjustment processing to display the image frame on a graphics layer is also adopted, and during the video layer frame rotation control, generally, after the rotation component 276 rotates by a certain angle, the rotation of the image frame is automatically completed, so that during the whole rotation of the display 275, the control of the video layer frame to rotate along with the rotation angle of the display 275 should be stopped. That is, in some embodiments, the controlling the non-rotation angle of the frame of the video layer according to the first mark information may be performed when the rotation angle of the rotating component 276 is detected.
As shown in fig. 9, in some embodiments of the present application, the step of controlling the graphics layer to display a black screen further includes:
s401: creating a graphic layer and setting second marking information for the graphic layer;
s402: detecting whether the graphic layer receives the image picture;
s403: and if the graphic layer does not receive the image picture, controlling the graphic layer to display a black screen according to the second mark information.
Through the started running application program, a graphics layer can be created, and second tag information, namely APK set tag information flags2, is set for the graphics layer, and is passed to the surface (graphics layer). After the graphics layer is created, the received image picture, that is, whether the image picture intercepted from the video layer and completed the image processing is received or not, can be detected through the graphics layer. If the graphic layer receives the image picture, the received picture can be directly displayed; if the graphic layer does not receive the image picture, a black screen can be displayed before the image picture is displayed so as to shield the picture in the video layer.
For example, the apk opens the interception service by sending an instruction a to the interception service to create a surface (graphics layer) by the interception service. The interception service also intercepts the decoded video data in real time and sends the video data to a graphic layer for display. When the surfefinger detects that the video data of the corresponding graphic layer is not sent, the surfefinger controls the graphic layer to display a black screen according to the flag information flags2 set by the application and received before. Therefore, the problem that the video frame of the video layer is flashed when the video content is displayed by the video layer and the video content does not exist due to the fact that the video frame is acquired by the graphic layer slowly is avoided.
It should be noted that, in the above display process, the player has a life cycle state, so it is also possible to set the first mark information for the video layer and create the graphics layer according to the state of the player by detecting the state of the player in the life cycle. For example, when the APK detects that the life cycle of the player is before the prepared state, the APK sets flag information tags 2 and passes it to the surface (graphics layer); and when the APK detects that the life cycle of the player is in a prepared state, the APK sends an instruction a to an interception service to create a surface (a graphic layer).
Since in the above embodiments, it is necessary to intercept an image frame in a video layer and perform adjustment processing on the intercepted image so as to be displayed in a graphics layer, in some embodiments, the image may be intercepted in such a manner that the step of intercepting the image frame from the video layer further includes:
s311: creating an interception service;
s312: performing image quality processing on the video data to acquire an image picture;
s313: and calling the interception service to intercept the image picture.
The intercepting service is used for intercepting video frame data, the intercepting service can be created when the system is started up and initialized to run, and when the display picture needs to be rotated, the real-time intercepting video layer data of the service is called and transmitted to the graphic layer to be displayed. Before the interception, the image quality of the video data can be processed through the video layer to obtain an image picture.
In order to obtain a better display effect or adapt to the hardware configuration of the display device 200, the image picture may have a higher frame rate and/or a different image picture effect from the original image to be displayed. Obviously, in order to be able to form a video picture in the graphics layer, the truncation frequency of the truncation service may be set to be greater than 25 frames/second. While for better display effect the interception frequency may be increased appropriately, e.g. the interception frequency of the interception service is set equal to the screen refresh rate 60Hz of said display 275.
For example, after the video layer completes (or partially completes) the image quality processing of the video picture to be displayed, the created interception service may be invoked, and the image picture after the image quality processing is acquired at the video layer. For the image picture, the capturing service may capture the same number of frames as the original picture frame by frame, and the capturing service may also capture frames at intervals, so as to reduce the number of capturing and image processing times and alleviate the processing load of the display device 200 on the premise of satisfying the video smoothness.
To accommodate the effect of maintaining a forward display of the picture during rotation, in some embodiments, the step of sending the truncated image picture to the graphics layer further comprises:
s321: acquiring display rotation information through the rotation assembly;
s322: rotating and/or scaling the captured image frame according to the display rotation information to obtain an intermediate image;
s323: sending the intermediate image to a graphics layer.
In this embodiment, the intermediate image refers to an image frame presented to the user during rotation of the display 275. The intermediate image may be displayed in the graphics layer, so to form the intermediate image, the controller 250 may acquire the display rotation information in real time through the rotation component 276, i.e., the rotation angle status of the display 275 at any one time. And then adjusting the captured image picture by rotating and/or zooming according to the rotation information of the display so as to adjust the image picture to a form suitable for the turning angle state of the current display 275, and finally sending the intermediate image after adjustment to the graphic layer for display so as to maintain the forward display.
Based on the video playing method in the vertical screen state, some embodiments of the present application further provide a display device 200, which includes: a display 275, a rotating assembly 276, and a controller 250. Wherein the display 275 is configured to present a user interface; the rotation assembly 276 is configured to rotate the display 275 such that the display 275 is in one of a landscape state or a portrait state; the controller 250 is configured to perform the following program steps:
s11: acquiring a play starting instruction input by a user;
s12: responding to the starting playing instruction, and playing video data through a video layer;
s13: intercepting an image picture from the video layer, and sending the intercepted image picture to a graphic layer, wherein the graphic layer is displayed on the upper layer of the video layer;
s14: and controlling the graphic layer to display a black screen until the graphic layer receives the image picture, and continuing to display the image picture on the graphic layer.
As can be seen from the foregoing technical solutions, the display device 200 and the video playing method in the vertical screen state provided in the foregoing embodiments may play video data through the video layer after obtaining a play start instruction input by a user, intercept an image picture from the video layer, and send the intercepted image picture to the graphics layer, when starting video playing, control the graphics layer to display a black screen first, and continue to display the image picture on the graphics layer after receiving the image picture. The method can display the black screen picture through the control graphic layer before playing the video, and the problem of screen flashing caused by different playing speeds of the video layer and the graphic layer is solved.
The embodiment provides that when the video starts to play, the black screen state is displayed through the control graphic layer, so as to alleviate the problem of screen flashing at the starting time caused by different starting speeds. In the case corresponding to the above-described embodiment, when the video stops playing, since the closing speeds of the graphics layer and the video layer are also different, the display device 200 may close the graphics layer first and then close the video layer, and thus the problem of screen flashing may occur again in the display 275 after the graphics layer is closed.
Based on this, in some embodiments of the present application, a video playing method in a vertical screen state is further provided, which is applied to display control when the display device 200 closes playing a video. As shown in fig. 10, the method comprises the steps of:
s21: acquiring a play closing instruction input by a user;
s22: closing the video layer in response to the play closing instruction;
s23: and intercepting the image picture from the video layer, and stopping sending the intercepted image picture to the graphics layer after detecting the call-back of the video layer which is closed.
Similarly, when the video playing process is closed, the user may input a playing closing instruction through the control device 100, touch operation, voice input, or the like. Since the closing speed of the video layer is slower than that of the graphics layer, after receiving the play closing instruction, the controller 250 may first execute the program for closing the video layer, and in the process of executing the program, continuously intercept the image frame from the video layer and send the image frame to the graphics layer for display, so as to maintain the presence of the image frame in the graphics layer. And stopping intercepting the image picture and sending the intercepted image picture to the graphics layer until callback information of closing completion of the video layer is detected.
And after the intercepted image pictures are stopped being sent to the graphics layer, closing the graphics layer to close the video playing. Therefore, in the process of closing the playing function, the picture of the video layer can be shielded by the picture of the graphic layer all the time, so that the problem of screen flashing caused by displaying the picture of the video layer in the closing process is solved through shielding of the picture of the graphic layer.
Further, in order to shut down the playing process, the method further comprises:
s501: detecting a callback of the completion of the closing of the video layer;
s502: releasing the player after detecting the callback of the video layer closing completion;
s503: and stopping acquiring the decoded video data after detecting the callback completed by the player release.
After stopping sending the captured image to the graphics layer, the controller 250 may further release the player after detecting the callback completed by closing the video layer by detecting the callback information completed by closing the video layer, and then stop acquiring the decoded video data after detecting the callback completed by releasing the player by detecting the callback information completed by releasing the player.
That is, in the whole process of closing the video playing function, if the display 275 is in the vertical screen state, the apk will receive the message of the remote control return key first, so as to input the playing closing instruction. According to the playing closing instruction, the apk destroys the surfview of the current video playing window; after receiving the call-back of the surfview destruction completion, the apk releases the player; and after receiving the call-back completed by the player, the apk sends an instruction d to the service, and the instruction d is used for controlling the interception service to stop intercepting the decoded video data. Therefore, after the player is released, the acquisition of the decoded video data is stopped, so that the video is ensured not to flash the picture of the video layer after the video exits from playing.
Based on the video playing method in the vertical screen state, some embodiments of the present application further provide a display device 200, which includes: a display 275, a rotating assembly 276, and a controller 250. Wherein the display 275 is configured to present a user interface; the rotation assembly 276 is configured to rotate the display 275 such that the display 275 is in one of a landscape state or a portrait state; the controller 250 is configured to perform the following program steps:
s21: acquiring a play closing instruction input by a user;
s22: closing the video layer in response to the play closing instruction;
s23: and intercepting the image picture from the video layer, and stopping sending the intercepted image picture to the graphics layer after detecting the call-back of the video layer after closing is completed, wherein the graphics layer is displayed on the upper layer of the video layer.
As can be seen from the foregoing technical solutions, the display device 200 and the video playing method in the vertical screen state provided in the foregoing embodiments may execute closing of the video layer first after obtaining the play closing instruction input by the user, and continue to intercept the image picture from the video layer during the execution of closing of the video layer until detecting a call back that the closing of the video layer is completed, and stop sending the intercepted image picture to the graphics layer. According to the method, when the user executes the action of closing the video playing, the graphic layer and the video layer are kept closed synchronously by delaying the closing of the graphic layer, so that the problem that the screen flashing easily occurs when the video is closed is solved.
The embodiments provided in the present application are only a few examples of the general concept of the present application, and do not limit the scope of the present application. Any other embodiments extended according to the scheme of the present application without inventive efforts will be within the scope of protection of the present application for a person skilled in the art.

Claims (10)

1. A display device, comprising:
a display;
a rotation component configured to rotate the display to enable the display to be in one of a landscape screen state or a portrait screen state;
a controller configured to:
acquiring a play starting instruction input by a user;
responding to the starting playing instruction, and playing video data through a video layer;
intercepting an image picture from the video layer, and sending the intercepted image picture to a graphic layer, wherein the graphic layer is displayed on the upper layer of the video layer;
and controlling the graphic layer to display a black screen until the graphic layer receives the image picture, and continuing to display the image picture on the graphic layer.
2. The display device according to claim 1, wherein in the step of playing the video data through the video layer, the controller is further configured to:
starting an application program appointed in the playing starting instruction;
creating a player and the video layer by the application;
and decoding the video data through the player so as to play the picture corresponding to the video data on the video layer.
3. The display device of claim 2, wherein after the step of creating a player and the video layer by the application, the controller is further configured to:
setting first mark information for the video layer;
detecting a rotation state of the display through the rotation assembly, wherein the rotation state comprises a horizontal screen state and a vertical screen state;
and if the display is in a vertical screen state, controlling the picture of the video layer not to rotate by an angle according to the first mark information.
4. The display device according to claim 2, wherein in the step of controlling the graphics layer to display a black screen, the controller is further configured to:
creating a graphic layer and setting second marking information for the graphic layer;
detecting whether the graphic layer receives the image picture;
and if the graphic layer does not receive the image picture, controlling the graphic layer to display a black screen according to the second mark information.
5. The display device according to claim 1, wherein in the step of intercepting an image picture from the video layer, the controller is further configured to:
creating an interception service, wherein the interception service is used for intercepting video frame data;
performing image quality processing on the video data to acquire an image picture;
and calling the interception service to intercept the image picture.
6. The display device according to claim 1, wherein in the step of sending the truncated image picture to the graphics layer, the controller is further configured to:
acquiring display rotation information through the rotation assembly;
rotating and/or scaling the captured image frame according to the display rotation information to obtain an intermediate image;
sending the intermediate image to a graphics layer.
7. A display device, comprising:
a display;
a rotation component configured to rotate the display to enable the display to be in one of a landscape screen state or a portrait screen state;
a controller configured to:
acquiring a play closing instruction input by a user;
closing the video layer in response to the play closing instruction;
and intercepting the image picture from the video layer, and stopping sending the intercepted image picture to the graphics layer after detecting the call-back of the video layer after closing is completed, wherein the graphics layer is displayed on the upper layer of the video layer.
8. The display device of claim 7, wherein the controller is further configured to:
detecting a callback of the completion of the closing of the video layer;
releasing the player after detecting the callback of the video layer closing completion;
and stopping acquiring the decoded video data after detecting the callback completed by the player release.
9. A video playing method in a vertical screen state is applied to display equipment, the display equipment comprises a display, a rotating assembly and a controller, and the method comprises the following steps:
acquiring a play starting instruction input by a user;
responding to the starting playing instruction, and playing video data through a video layer;
intercepting an image picture from the video layer, and sending the intercepted image picture to a graphic layer, wherein the graphic layer is displayed on the upper layer of the video layer;
and controlling the graphic layer to display a black screen until the graphic layer receives the image picture, and continuing to display the image picture on the graphic layer.
10. A video playing method in a vertical screen state is applied to display equipment, the display equipment comprises a display, a rotating assembly and a controller, and the method comprises the following steps:
acquiring a play closing instruction input by a user;
closing the video layer in response to the play closing instruction;
and intercepting the image picture from the video layer, and stopping sending the intercepted image picture to the graphics layer after detecting the call-back of the video layer after closing is completed, wherein the graphics layer is displayed on the upper layer of the video layer.
CN202011036180.0A 2020-03-13 2020-09-27 Display device and video playing method in vertical screen state Active CN112165644B (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202011036180.0A CN112165644B (en) 2020-09-27 2020-09-27 Display device and video playing method in vertical screen state
PCT/CN2021/080552 WO2021180223A1 (en) 2020-03-13 2021-03-12 Display method and display device
PCT/CN2021/080553 WO2021180224A1 (en) 2020-03-13 2021-03-12 Display device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011036180.0A CN112165644B (en) 2020-09-27 2020-09-27 Display device and video playing method in vertical screen state

Publications (2)

Publication Number Publication Date
CN112165644A true CN112165644A (en) 2021-01-01
CN112165644B CN112165644B (en) 2022-06-28

Family

ID=73862180

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011036180.0A Active CN112165644B (en) 2020-03-13 2020-09-27 Display device and video playing method in vertical screen state

Country Status (1)

Country Link
CN (1) CN112165644B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021180223A1 (en) * 2020-03-13 2021-09-16 海信视像科技股份有限公司 Display method and display device
CN113596584A (en) * 2021-08-11 2021-11-02 北京字节跳动网络技术有限公司 Video playing method, video playing device, storage medium and computer program product
CN114339174A (en) * 2021-12-20 2022-04-12 青岛海信激光显示股份有限公司 Projection equipment and control method thereof
WO2023000937A1 (en) * 2021-07-21 2023-01-26 青岛海信激光显示股份有限公司 Projection device, and projected image correction method
WO2024002164A1 (en) * 2022-06-30 2024-01-04 华为技术有限公司 Display method and related apparatus

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6388700B1 (en) * 1999-07-19 2002-05-14 Thomson Licensing S.A. Video processing apparatus and method
US20100060789A1 (en) * 2007-08-24 2010-03-11 Panasonic Corporation Reception device and reception method
CN102724452A (en) * 2012-06-27 2012-10-10 深圳Tcl新技术有限公司 Picture processing method and device for video playing
CN102724457A (en) * 2012-06-08 2012-10-10 深圳Tcl新技术有限公司 Method, device and television set for concealing flash in video zooming process
CN104065999A (en) * 2014-06-11 2014-09-24 四川政企网络信息服务有限公司 Image processing assembly and method capable of achieving image rotation
CN104581405A (en) * 2013-10-21 2015-04-29 中国移动通信集团公司 Display content processing method and equipment
CN105230005A (en) * 2013-05-10 2016-01-06 三星电子株式会社 Display unit and control method thereof
CN105812933A (en) * 2014-12-30 2016-07-27 Tcl集团股份有限公司 Television starting method and device
CN106658175A (en) * 2016-11-15 2017-05-10 Tcl集团股份有限公司 Video display method and system for television terminal
CN107566902A (en) * 2017-09-19 2018-01-09 青岛海信电器股份有限公司 The method and display device of a kind of display device starting-up
CN111327934A (en) * 2020-02-28 2020-06-23 海信集团有限公司 Communication terminal, control equipment and video multi-equipment synchronous playing method
US20200301469A1 (en) * 2019-03-19 2020-09-24 Samsung Electronics Co., Ltd. Display apparatus and method for controlling the display apparatus

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6388700B1 (en) * 1999-07-19 2002-05-14 Thomson Licensing S.A. Video processing apparatus and method
US20100060789A1 (en) * 2007-08-24 2010-03-11 Panasonic Corporation Reception device and reception method
CN102724457A (en) * 2012-06-08 2012-10-10 深圳Tcl新技术有限公司 Method, device and television set for concealing flash in video zooming process
CN102724452A (en) * 2012-06-27 2012-10-10 深圳Tcl新技术有限公司 Picture processing method and device for video playing
CN105230005A (en) * 2013-05-10 2016-01-06 三星电子株式会社 Display unit and control method thereof
CN104581405A (en) * 2013-10-21 2015-04-29 中国移动通信集团公司 Display content processing method and equipment
CN104065999A (en) * 2014-06-11 2014-09-24 四川政企网络信息服务有限公司 Image processing assembly and method capable of achieving image rotation
CN105812933A (en) * 2014-12-30 2016-07-27 Tcl集团股份有限公司 Television starting method and device
CN106658175A (en) * 2016-11-15 2017-05-10 Tcl集团股份有限公司 Video display method and system for television terminal
CN107566902A (en) * 2017-09-19 2018-01-09 青岛海信电器股份有限公司 The method and display device of a kind of display device starting-up
US20200301469A1 (en) * 2019-03-19 2020-09-24 Samsung Electronics Co., Ltd. Display apparatus and method for controlling the display apparatus
CN111327934A (en) * 2020-02-28 2020-06-23 海信集团有限公司 Communication terminal, control equipment and video multi-equipment synchronous playing method

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021180223A1 (en) * 2020-03-13 2021-09-16 海信视像科技股份有限公司 Display method and display device
WO2021180224A1 (en) * 2020-03-13 2021-09-16 海信视像科技股份有限公司 Display device
WO2023000937A1 (en) * 2021-07-21 2023-01-26 青岛海信激光显示股份有限公司 Projection device, and projected image correction method
CN113596584A (en) * 2021-08-11 2021-11-02 北京字节跳动网络技术有限公司 Video playing method, video playing device, storage medium and computer program product
CN114339174A (en) * 2021-12-20 2022-04-12 青岛海信激光显示股份有限公司 Projection equipment and control method thereof
CN114339174B (en) * 2021-12-20 2024-05-31 青岛海信激光显示股份有限公司 Projection equipment and control method thereof
WO2024002164A1 (en) * 2022-06-30 2024-01-04 华为技术有限公司 Display method and related apparatus

Also Published As

Publication number Publication date
CN112165644B (en) 2022-06-28

Similar Documents

Publication Publication Date Title
CN114827694A (en) Display equipment and UI (user interface) display method during rotation
CN112165644B (en) Display device and video playing method in vertical screen state
CN113395558B (en) Display equipment and display picture rotation adaptation method
CN112565839B (en) Display method and display device of screen projection image
CN111787388B (en) Display device
CN114827707B (en) Display equipment and startup animation display method
CN111970550B (en) Display device
CN111866593B (en) Display device and startup interface display method
CN111866569B (en) Display device
CN111866590B (en) Display device
CN112565861A (en) Display device
CN115665455A (en) Display device and screen projection method
CN113395554B (en) Display device
CN113395600B (en) Interface switching method of display equipment and display equipment
CN113556591A (en) Display equipment and projection screen image rotation display method
CN113573118B (en) Video picture rotating method and display equipment
CN114501087B (en) Display equipment
CN113630639B (en) Display device
CN113542824B (en) Display equipment and display method of application interface
CN115396704B (en) Display equipment and power-on signal source display adaptation method
CN113497962B (en) Configuration method of rotary animation and display device
CN113497965B (en) Configuration method of rotary animation and display device
CN113542823B (en) Display equipment and application page display method
CN115697771A (en) Display device and display method of application interface

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant