CN114979773A

CN114979773A - Display device, video processing method, and storage medium

Info

Publication number: CN114979773A
Application number: CN202210410985.XA
Authority: CN
Inventors: 崔文华; 周维栋; 陈春晓
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2022-04-19
Filing date: 2022-04-19
Publication date: 2022-08-30

Abstract

The disclosure relates to a display device, a video processing method and a storage medium, and relates to the technical field of display. The display device includes: a controller configured to: stretching frame pictures of a video to be played in an equal proportion to obtain intermediate frame pictures, wherein the length of the intermediate frame pictures in a first direction is equal to that of a display, the length of the intermediate frame pictures in a second direction is greater than that of the display, and the first direction is vertical to the second direction; cutting the target edge of the intermediate frame picture along the first direction to obtain a target frame picture, wherein the length of the target frame picture along the second direction is equal to the length of the display, and the target edge is an edge along the second direction; a display configured to: and displaying the target frame picture. The disclosed embodiment can avoid deformation and black edges of the display picture when the full screen display is performed, can improve the quality of the display picture, and improves the experience of a user.

Description

Display device, video processing method, and storage medium

Technical Field

The present disclosure relates to the field of display technologies, and in particular, to a display device, a video processing method, and a storage medium.

Background

With the development of the diversification of the size of the display screen, the resolution of the display screen is not limited to 1920 x 1080P, and the size of the display screen breaks the 16:9 limit, and a 21:9 irregular display screen appears. Most videos on the market today are designed for a 16:9 display screen, and displaying these 16:9 videos on a 21:9 display screen is obviously not suitable.

In the prior art, when a 21:9 display screen displays a 16:9 video in a full screen mode, black borders may exist on the left side and the right side of a display picture, or the display picture may deform, so that the quality of the display picture of a display device is low, and the user experience is affected.

Disclosure of Invention

The present disclosure provides a display device, a video processing method, and a storage medium, which can prevent a display screen from being deformed and blackened, improve the quality of the display screen, and improve the user experience.

In a first aspect, the present disclosure provides a display device comprising:

a controller configured to: stretching frame pictures of a video to be played in an equal proportion to obtain intermediate frame pictures, wherein the length of the intermediate frame pictures in a first direction is equal to that of a display, the length of the intermediate frame pictures in a second direction is greater than that of the display, and the first direction is vertical to the second direction;

cutting the target edge of the intermediate frame picture along the first direction to obtain a target frame picture, wherein the length of the target frame picture along the second direction is equal to the length of the display, and the target edge is an edge along the second direction;

the display configured to: and displaying the target frame picture.

In some embodiments of the present disclosure, the controller is further configured to:

before stretching the frame picture of the video to be played in equal proportion to obtain an intermediate frame picture, enlarging an original frame picture of the video to be played in equal proportion until the length of the original frame picture in the first direction is smaller than the length of the display, the length of the original frame picture in the second direction is equal to the length of the display, or the length of the original frame picture in the second direction is smaller than the length of the display, and the length of the original frame picture in the first direction is equal to the length of the display to obtain the frame picture.

In some embodiments of the present disclosure, the controller is further configured to: acquiring the length-width ratio of the original frame picture;

the controller is specifically configured to:

if the aspect ratio of the original frame picture is smaller than the aspect ratio of the display, the original frame picture is enlarged in equal proportion until the length of the original frame picture is equal to the length of the display along the second direction, wherein the second direction is the width direction of the original frame picture.

the controller is specifically configured to:

if the aspect ratio of the original frame picture is greater than or equal to the aspect ratio of the display, the original frame picture is enlarged in equal proportion until the length of the original frame picture along the first direction is equal to the length of the display, and the first direction is the width direction of the original frame picture.

In some embodiments of the present disclosure, the display device further includes:

a user interface configured to: receiving a control instruction for starting a black edge removing function triggered by a user;

the controller further configured to: detecting whether a black edge exists in the original frame picture according to the control instruction;

when detecting that a black edge exists in the original frame picture, acquiring a black edge parameter of the original frame picture;

and cutting the original frame picture according to the black edge parameter of the original frame picture.

In some embodiments of the present disclosure, the controller is specifically configured to: determining a clipping point on the target edge, wherein the distance between the clipping point and the middle point of the target edge is half of the length of the display along the second direction;

and cutting the intermediate frame picture along the first direction by taking the cutting point as a starting point to obtain the target frame picture.

the controller further configured to: starting a delay display mode according to the control instruction;

and controlling the display not to display the picture before the display receives the first frame of the target frame picture according to the delay display mode.

In a second aspect, the present disclosure provides a video processing method, including:

stretching frame pictures of a video to be played in an equal proportion to obtain intermediate frame pictures, wherein the length of the intermediate frame pictures in a first direction is equal to that of a display, the length of the intermediate frame pictures in a second direction is greater than that of the display, and the first direction is vertical to the second direction;

and sending the target frame picture to the display.

In some embodiments of the present disclosure, before the stretching the frame picture of the video to be played in equal proportion to obtain the intermediate frame picture, the method further includes:

and enlarging an original frame picture of the video to be played in equal proportion until the length of the original frame picture in the first direction is smaller than that of the display, the length of the original frame picture in the second direction is equal to that of the display, or the length of the original frame picture in the second direction is smaller than that of the display, and the length of the original frame picture in the first direction is equal to that of the display, so as to obtain the frame picture.

In some embodiments of the present disclosure, before the scaling up the original frame of the video to be played, the method further includes:

acquiring the length-width ratio of the original frame picture;

the method for amplifying the original frame picture of the video to be played in equal proportion comprises the following steps:

acquiring the length-width ratio of the original frame picture;

receiving a control instruction for starting a black edge removing function triggered by a user;

detecting whether a black edge exists in the original frame picture according to the control instruction;

In some embodiments of the present disclosure, the clipping along the first direction at the target edge of the intermediate frame picture to obtain a target frame picture includes:

determining a cutting point on the target edge, wherein the distance between the cutting point and the middle point of the target edge is half of the length of the display along the second direction;

the method further comprises the following steps:

starting a delay display mode according to the control instruction;

In a third aspect, the present disclosure provides a computer-readable storage medium comprising: the computer-readable storage medium has stored thereon a computer program which, when executed by a processor, implements the video processing method as shown in the second aspect.

In a fourth aspect, the present disclosure provides a computer program product comprising: the computer program product, when run on a computer, causes the computer to implement a video processing method as shown in the second aspect.

In the technical scheme provided by the embodiment of the disclosure, the frame pictures of the video to be played are stretched in equal proportion until the length of the frame pictures along the first direction is equal to the length of the display along the first direction, the length along the second direction is greater than the length of the display along the second direction, and the first direction is perpendicular to the second direction, so that the intermediate frame pictures can be obtained. And then, the edge of the intermediate frame picture along the second direction is taken as a target edge, the intermediate frame picture is cut along the first direction of the target edge, and the target frame picture is obtained, so that the length of the target frame picture along the second direction is equal to the length of the display along the second direction, and the display displays the target frame picture.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present disclosure, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.

FIG. 1A is a schematic diagram of a display screen with black borders on the top and bottom sides in the related art;

FIG. 1B is a diagram illustrating a display screen with black borders on left and right sides according to the related art;

FIG. 2A is a diagram illustrating a display screen with a deformed length direction according to the related art;

FIG. 2B is a diagram illustrating a display screen with a width direction distortion in the related art;

FIG. 3 is a schematic diagram of an operational scenario between a display device and a control apparatus according to one or more embodiments of the present disclosure;

fig. 4 is a block diagram of a hardware configuration of a display apparatus 200 according to one or more embodiments of the present disclosure;

fig. 5 is a block diagram of a hardware configuration of the control apparatus 100 according to one or more embodiments of the present disclosure;

fig. 6 is a schematic diagram of a software configuration in a display device 200 according to one or more embodiments of the present disclosure;

FIG. 7 is a schematic illustration of an icon control interface display of an application in a display device 200 according to one or more embodiments of the present disclosure;

FIG. 8 is a system framework diagram for implementing video processing in accordance with one or more embodiments of the present disclosure;

FIG. 9 is an architecture diagram for implementing video processing in accordance with one or more embodiments of the present disclosure;

FIG. 10 is a system framework diagram for implementing video processing in accordance with one or more embodiments of the present disclosure;

FIG. 11 is an architecture diagram for implementing video processing in accordance with one or more embodiments of the present disclosure;

fig. 12 is a schematic flow diagram of a method of implementing video processing in accordance with one or more embodiments of the present disclosure;

fig. 13 is a schematic view of a scene implementing a video processing method according to one or more embodiments of the present disclosure;

FIG. 14A is a diagram illustrating cropping of an inter-frame picture according to one or more embodiments of the present disclosure;

FIG. 14B is a diagram illustrating cropping of an inter-frame picture according to one or more embodiments of the present disclosure;

fig. 15 is a schematic view of a scene implementing a video processing method according to one or more embodiments of the present disclosure;

fig. 16 is a schematic diagram of cropping an original frame picture according to one or more embodiments of the present disclosure.

Detailed Description

In order that the above objects, features and advantages of the present disclosure may be more clearly understood, aspects of the present disclosure will be further described below. It should be noted that the embodiments and features of the embodiments of the present disclosure may be combined with each other without conflict.

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced in other ways than those described herein; it is to be understood that the embodiments disclosed in the specification are only a few embodiments of the present disclosure, and not all embodiments.

The controller can decode the received video file, and can obtain the video to be played after decoding, and the aspect ratio of the picture of the video to be played can be 16:9, 4:3, 21:9, or the like. The aspect ratio of the display in the present disclosure may be 21:9, 16:9, or 4:3, and the aspect ratio of the picture of the video to be played may be the same as or different from the aspect ratio of the display.

When the aspect ratio of the picture of the video to be played is different from that of the display, the frame picture to be played in the video to be played can be stretched in equal proportion, and the obtained frame picture to be played after stretching in equal proportion may be full-screen along the length direction but not full-screen along the width direction. Or, the obtained stretched frame picture to be played may be full screen in the width direction, but not full screen in the length direction. The processing for a full screen area where the display does not display the video to be played, that is, the processing for a non-full screen area, may be displaying a black border in the non-full screen area. For example, when the screen is full along the length direction and is not full along the width direction, black edges are filled at the upper and lower sides of the display screen, as shown in fig. 1A; when the full screen is not full along the length direction along the width direction, black borders are filled on the left side and the right side of the display picture, as shown in fig. 1B, so that full screen display is realized. For the processing of the non-full-screen area, the frame picture to be played after stretching in equal proportion may also be stretched in the direction of the position of the non-full-screen area, for example, when the full screen is not full screen along the length direction and the width direction, the non-full-screen area is located at the upper and lower sides of the display picture, and the frame picture to be played is stretched upward and downward until the frame picture to be played covers the original non-full-screen area, as shown in fig. 2A; when the screen is full along the width direction and is not full along the length direction, the non-full screen areas are positioned at the left side and the right side of the display picture, and the frame picture to be played is stretched leftwards and rightwards as shown in fig. 2B, so that full screen display is realized.

If a frame to be played displayed by the display has a black border, as shown in fig. 1A and 1B, the display area of the display is not fully utilized, and the display image is not beautiful enough, which affects the display quality of the image and thus affects the user experience. If the frame to be played is displayed on the display, as shown in fig. 2A and fig. 2B, the display image of the display is deformed, which affects the display quality of the image, and thus affects the user experience.

In order to solve the above problem, the present disclosure stretches the frame pictures of the video to be played in equal proportion until the length of the frame pictures along the first direction is equal to the length of the display area of the display device along the first direction, and the length along the second direction is greater than the length of the display area along the second direction, at this time, an intermediate frame picture is obtained, then cutting the intermediate frame picture along the first direction at the edge of the intermediate frame picture along the second direction to obtain a target frame picture, so that the length of the target frame picture along the second direction is equal to the length of the display area along the second direction, the display displays the target frame picture, thus, the size of the target frame picture is the same as that of the display, the display can display the target frame picture on the full screen, and the problems of black edges and deformation do not exist, deformation and black edges can be avoided from occurring in the display picture of the display device, the quality of the display picture can be improved, and the experience of a user is improved.

Fig. 3 schematically shows an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 3, the user may operate the display apparatus 200 through the smart device 300 or the control device 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes an infrared protocol communication, a bluetooth protocol communication, a wireless or other wired method to control the display device 200. The user may input a user command through a key on a remote controller, voice input, control panel input, etc. to control the display apparatus 200. In some embodiments, mobile terminals, tablets, computers, laptops, and other smart devices 300 may be used to control the display device 200. In some embodiments, the display device may receive the user's control through touch or gesture, etc., instead of receiving the instruction using the smart device 300 or the control apparatus 200 described above. In some embodiments, the display device 200 may also be controlled in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received by a module configured inside the display device 200 to obtain a voice command, or may be received by a voice control device provided outside the display device 200.

In some embodiments, the mobile terminal 300 may install a software application with the display device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. The audio and video contents displayed on the mobile terminal 300 can also be transmitted to the display device 200, so that the display device 200 with the synchronous display function can also perform data communication with the server 400 through multiple communication modes. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various content and interactions to the display device 200, and the server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers. The display device 200 may be a liquid crystal display, an OLED display, a projection display device. The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function.

Fig. 4 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 4, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200 to mediate interaction between the user and the display device 200. The communication interface 130 is used for communicating with the outside, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module. The user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, a key, or an alternative module.

Fig. 5 shows a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment. The display apparatus 200 as shown in fig. 5 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280. The controller includes at least one of a central processor, a video processor, an audio processor, a graphic processor, a RAM, a ROM, first to nth interfaces for input/output, a communication Bus (Bus), and the like. .

The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The display 260 includes a display screen component for presenting a picture, and a driving component for driving image display, a component for receiving an image signal from the controller output, performing display of video content, image content, and a menu manipulation interface, and a user manipulation UI interface.

The communicator 220 is a component for communicating with an external device or a server according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the external control apparatus 100 or the server 400 through the communicator 220.

The user interface 280 may be used to receive control signals for controlling the apparatus 100, such as an infrared remote control or the like.

The detector 230 is used to collect signals of an external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which may be used to collect external environment scenes, attributes of the user, or user interaction gestures, or the detector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.

The external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.

The tuner demodulator 210 receives a broadcast television signal through wired or wireless reception and demodulates an audio/video signal, such as an EPG data signal, from a plurality of wireless or wired broadcast television signals.

The controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display apparatus 200. A user may input a user command on a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

A "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables the conversion of the internal form of information to a form acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface elements.

Fig. 6 is a schematic diagram of a software configuration in a display device 200 according to one or more embodiments of the present disclosure, and as shown in fig. 6, the system is divided into four layers, which are, from top to bottom, an Application (Applications) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) and system library layer (abbreviated as "system runtime library layer"), and a kernel layer. The inner core layer comprises at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc.. The application layer comprises: an image collector (Camera), etc. for collecting video data, a graphics number processor (GPUFlinger) for processing video data, an audio data processor (Audio effect) for denoising audio processing, a wrapper (MUX) for wrapping elementary stream data, and a data output module for pushing data.

Fig. 7 is a schematic diagram illustrating an icon control interface display of an application program in the display device 200 according to one or more embodiments of the present disclosure, as shown in fig. 7, an application layer includes at least one application program that can display a corresponding icon control in a display, for example: the system comprises a live television application icon control, a video on demand application icon control, a media center application icon control, an application center icon control, a game application icon control and the like. The live television application program can provide live television through different signal sources. A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. The media center application program can provide various applications for playing multimedia contents. The application program center can provide and store various application programs.

In some embodiments, the display device is a terminal device with a display function, such as a television, a mobile phone, a computer, a learning machine, and the like. In the display device:

the controller 250 may decode the received video file to obtain a video to be played, and may process the video to be played to obtain a frame picture of the video to be played. The controller 250 stretches the frame images of the video to be played until the length of the frame images of the video to be played along the first direction is equal to the length of the display along the first direction, the length of the frame images of the video to be played along the second direction is greater than the length of the display along the second direction, and the first direction is perpendicular to the second direction, so that the intermediate frame images can be obtained. Then, the controller 250 cuts the inter frame picture along the first direction at the target edge with the edge of the inter frame picture along the second direction as a target edge, so that the length of the cut inter frame picture along the second direction is equal to the length of the display along the second direction, thus obtaining the target frame picture. The display 260 may receive the target frame image sent by the controller 250, and display the received target frame image, so as to implement full-screen display of the video to be played.

In some embodiments, after obtaining the video to be played, the controller 250 acquires all original frame pictures in the video to be played. The controller 250 enlarges the original frame picture, wherein the aspect ratio of the original frame picture is fixed during the enlargement process until the length of the original frame picture along the first direction is equal to the length of the display along the first direction, and the length of the original frame picture along the second direction is smaller than the length of the display along the second direction; or until the length of the original frame picture along the second direction is equal to the length of the display along the second direction, and the length of the original frame picture along the first direction is smaller than the length of the display along the first direction. At this time, the amplified original frame picture is the frame picture of the video to be played, so that the frame picture of the video to be played is obtained.

In some embodiments, after obtaining the video to be played, the controller 250 may determine the resolution of the video to be played, and may determine the aspect ratio of the original frame picture based on the resolution of the video to be played. The controller 250 may compare the aspect ratio of the display with the original frame picture aspect ratio and, in case the original frame picture aspect ratio is smaller than the aspect ratio of the display, scale up the original frame picture until the width of the original frame picture is equal to the width of the display.

In some embodiments, after obtaining the video to be played, the controller 250 may determine the resolution of the video to be played, and may determine the aspect ratio of the original frame picture based on the resolution of the video to be played. The controller 250 may compare the aspect ratio of the display with the original frame picture aspect ratio and, in case the original frame picture aspect ratio is equal to or greater than the aspect ratio of the display, scale up the original frame picture until the length of the original frame picture is equal to the length of the display.

In some embodiments, the user may generate a control instruction to turn on the black border removal function based on the control apparatus 100 selecting an option to turn on the black border removal function in a menu displayed on the display 260. The user interface 280 may receive a control command to turn on the black border removal function and transmit the control command to turn on the black border removal function to the controller 250. The controller 250 may turn on the black border removal function based on the received control instruction for turning on the black border removal function, detect whether a black border is included in the original frame picture after turning on the black border removal function, and acquire a parameter of the black border in the original frame picture in a case where it is detected that the black border is included in the original frame picture. The controller 250 may clip the original frame picture based on the parameters of the black border in the original frame picture, and update the original frame picture to the clipped original frame picture.

In some embodiments, the controller 250 may determine a point on the destination edge that is a distance S from a midpoint of the destination edge as the clipping point, where S is half a length of the display along the second direction. And cutting the intermediate frame picture along the first direction by taking the cutting point as a starting point, and cutting to another cutting point, so that the target frame picture can be obtained by cutting twice.

In some embodiments, the user may generate a control instruction to turn on the black border removal function based on the control apparatus 100 selecting an option to turn on the black border removal function in a menu displayed on the display 260. The controller 250 may receive a control instruction for turning on the black border removal function based on the user interface 280, may turn on the black border removal function according to the control instruction for turning on the black border removal function, and simultaneously turn on the delayed display mode, and in the delayed display mode, the controller controls the display not to perform the image display until the first frame target frame image is received, and the displayed first frame image is the first frame target frame image.

In summary, the present disclosure stretches the frame images of the video to be played in equal proportion until the length of the frame images along the first direction is equal to the length of the display along the first direction, the length of the frame images along the second direction is greater than the length of the display along the second direction, and the first direction is perpendicular to the second direction, at this time, an intermediate frame image can be obtained. And then, the edge of the intermediate frame picture along the second direction is taken as a target edge, the intermediate frame picture is cut along the first direction of the target edge, and the target frame picture is obtained, so that the length of the target frame picture along the second direction is equal to the length of the display along the second direction, therefore, the size of the target frame picture is the same as that of the display, the display can display the target frame picture in a full screen manner, the problems of black edges and deformation do not exist, deformation and black edges in the display picture of the display equipment can be avoided, the quality of the display picture can be improved, and the experience of a user is improved.

Fig. 8 is a frame diagram of a system for performing video processing according to one or more embodiments of the present disclosure, and as shown in fig. 8, the system may include a video processor 310, a display 260, and a communicator 220, where the communicator 220 may receive a video file sent by a server and send the received video file to the video processor 310, and the video processor 310 decodes the received video file to obtain a video to be played, stretches a frame picture of the video to be played in an equal proportion to obtain an intermediate frame picture, and then crops the intermediate frame picture to obtain a target frame picture. The video processor 310 may send the target frame picture to the display 260, and the display 260 displays based on the received target frame picture. Based on the system framework shown in fig. 6, the implementation of the present disclosure in the android system is shown in fig. 9, and the application layer in the android system includes a video decoder 310.

Fig. 10 is a system framework diagram of video processing according to one or more embodiments of the present disclosure, and based on the system framework shown in fig. 8, the video processor 310 may further include a video decoder 311, an equal-scale stretching module 312, a cropping module 313, and a video output module 314, as shown in fig. 10. The communicator 220 may receive the video file transmitted by the server and transmit the received video file to the video decoder 311. The video decoder 311 decodes the received video file to obtain a video to be played, and sends a frame picture of the video to be played to the equal-scale stretching module 312. The equal-scale stretching module 312 performs equal-scale stretching on the frame picture of the video to be played to obtain an intermediate frame picture, and sends the intermediate frame picture to the clipping module 313. The cropping module 313 crops the intermediate frame picture to obtain a target frame picture, and sends the target frame picture to the video output module 314. The video output module 314 may transmit the target frame picture to the display 260, and the display 260 displays based on the received target frame picture. Based on the system framework shown in fig. 6, the implementation of the present disclosure in the android system is as shown in fig. 11, and the application layer in the android system includes a video decoder, an equal-scale stretching module, a cropping module, and a video output module.

The video processing method provided in the embodiment of the present disclosure is implemented in conjunction with the equal-scale stretching module 312, the cropping module 313, and the video output module 314 in fig. 10. The video processing method provided in the embodiment of the present disclosure first decodes a video file by a video decoder to obtain a video to be played, and stretches frame pictures of the video to be played in an equal proportion to obtain intermediate frame pictures, wherein the length of the intermediate frame pictures along a first direction is equal to the length of a display along the first direction, the length of the intermediate frame pictures along a second direction is greater than the length of the display along the second direction, and the first direction is perpendicular to the second direction. And cutting the edge of the intermediate frame image along the second direction as a target edge in the first direction of the target edge to obtain a target frame image, wherein the length of the target frame image along the second direction is equal to the length of the display along the second direction, and sending the target frame image to the display, so that the display can display the target frame image, and full-screen display of the video to be played is realized.

The video processing method provided in the embodiment of the disclosure stretches the frame pictures of the video to be played in equal proportion until the length of the frame pictures along the first direction is equal to the length of the display area of the display device along the first direction, and the length of the frame pictures along the second direction is greater than the length of the display area along the second direction, at this time, an intermediate frame picture is obtained, then the intermediate frame picture is cut along the first direction on the side of the intermediate frame picture along the second direction, so as to obtain a target frame picture, and the length of the target frame picture along the second direction is equal to the length of the display area along the second direction, and the display displays the target frame picture, so that the size of the target frame picture is the same as that of the display, the display can display the target frame picture on full screen, and the problems of black edges and deformation do not exist, deformation and black edges in the display picture of the display device can be avoided, and the quality of the display picture can be improved, and the experience degree of the user is improved.

For describing the present solution in more detail, the following description is given with reference to fig. 12 in an exemplary manner, and it is understood that the steps involved in fig. 12 may include more steps or fewer steps in actual implementation, and the order between the steps may also be different, so that the subtitle processing method provided in the embodiment of the present disclosure can be implemented, and the embodiment of the present disclosure is not limited.

As shown in fig. 12, fig. 12 is a flowchart of a video processing method implemented according to one or more embodiments of the present disclosure:

s101, stretching the frame picture of the video to be played in equal proportion to obtain an intermediate frame picture.

The length of the intermediate frame picture along the first direction is equal to the length of the display, the length of the intermediate frame picture along the second direction is larger than the length of the display, and the first direction is perpendicular to the second direction.

For example, the received video file is decoded to obtain a video to be played, and the video to be played is processed to obtain a plurality of frame pictures, where the frame pictures may be original frame pictures forming the video to be played or frame pictures obtained by preprocessing the original frame pictures, and this embodiment is not particularly limited to this.

In some embodiments, the user may control the display device to display a menu based on the control apparatus 100 or the smart device 300, wherein the menu may include an on/off option of the smart display mode. For example, as shown in fig. 13, the menu displayed on the display device may be selected by the user to turn on the smart display mode and control the display device to be in the smart display mode, or may be selected to turn off the smart display mode and control the display device to be in the normal display mode, based on the operation of the control apparatus 100 or the smart device 300.

In some embodiments, the display device defaults to the smart display mode, without setting the on/off option of the smart display mode in the menu.

The display device is in an intelligent display mode, and for the frame pictures of the video to be played, the frame pictures are stretched under the condition that the length-width ratio of the frame pictures is fixed and unchanged until the length of the frame pictures along the first direction is equal to the length of the display along the first direction, and the length of the frame pictures along the second direction is equal to the length of the display along the second direction. The first direction is a length direction, and the corresponding second direction is a width direction, or the first direction is a width direction, and the corresponding second direction is a length direction.

In some embodiments, the aspect ratio of the frame picture is less than the aspect ratio of the display, the frame picture is stretched until the length of the frame picture (shown in dashed box) is equal to the length of the display (shown in solid box), and the width of the frame picture is greater than the width of the display, as shown in fig. 14A. At this time, an inter frame picture can be obtained, i.e. the length of the inter frame picture is equal to the length of the display, and the width of the inter frame picture is greater than the width of the display.

In some embodiments, the aspect ratio of the frame picture is greater than the aspect ratio of the display, the frame picture is stretched until the width of the frame picture (shown by the dashed box in the figure) is equal to the width of the display (shown by the solid box in the figure), and the length of the frame picture is greater than the length of the display, as shown in fig. 14B. At this time, an inter frame picture can be obtained, i.e. the width of the inter frame picture is equal to the width of the display, and the length of the inter frame picture is greater than the length of the display.

And S102, cutting the target edge of the intermediate frame image in the first direction to obtain a target frame image.

The length of the target frame picture along the second direction is equal to the length of the display, and the target edge is an edge along the second direction.

In some embodiments, the length of the inter frame picture is equal to the length of the display, the width of the inter frame picture is greater than the width of the display, and an edge where the width of the inter frame picture is located is taken as a target edge, that is, a short edge is taken as a target edge. The intermediate frame is cut along the long side direction at the short side of the intermediate frame, for example, the intermediate frame is cut along the axis XX' shown in fig. 14A, and after the intermediate frame is cut, a target frame is obtained, and the width of the target frame is equal to the width of the display. Since the length of the target frame picture is the same as the length of the display, the size of the target frame picture is the same as the size of the display.

In some embodiments, the width of the inter frame is equal to the width of the display, the length of the inter frame is greater than the length of the display, and an edge where the length of the inter frame is located is taken as a target edge, that is, a long edge is taken as a target edge. The intermediate frame is cut along the short side direction at the long side of the intermediate frame, for example, the intermediate frame is cut along the axis YY' as shown in fig. 14B, and after the intermediate frame is cut, a target frame is obtained, and the length of the target frame is equal to the length of the display. Since the width of the target frame picture is the same as the width of the display, the size of the target frame picture is the same as the size of the display.

S103, sending the target frame picture to the display.

And sending the target frame picture to a display, wherein the display can display the received target frame picture, and the display can display the target frame picture in a full screen mode because the size of the display is the same as that of the target frame picture. The display device has the advantages that the black edge and the stretching deformation do not exist in the picture displayed by the display device, so that the deformation and the black edge in the display picture of the display device can be avoided, the quality of the display picture can be improved, and the experience of a user is improved.

In some embodiments, before stretching the frame pictures in equal proportion, an original frame picture is extracted from the video to be played, and the original frame picture is preprocessed to obtain the frame picture. A detailed description of one possible implementation of the preprocessing of the original frame picture to obtain the frame picture is as follows:

step a, amplifying an original frame picture in a video to be played, and keeping the length-width ratio of the original frame picture unchanged in the amplification process until the length of the original frame picture of the video to be played along a first direction is equal to the length of a display along the first direction, and the length of the original frame picture along a second direction is smaller than the length of the display along the second direction; or, until the length of the original frame picture of the video to be played along the second direction is equal to the length of the display along the second direction, the length of the original frame picture along the first direction is less than the length of the display along the first direction, and a frame picture is obtained.

In some embodiments, the aspect ratio of the original frame picture is compared with the aspect ratio of the display, and if the aspect ratio of the original frame picture is smaller than the aspect ratio of the display, the original frame picture is enlarged until the width of the original frame picture is equal to the width of the display without changing the aspect ratio of the original frame picture, so as to obtain a frame picture of the video to be played, that is, the width of the frame picture is equal to the width of the display, as shown in fig. 1B. Since the aspect ratio of the original frame picture is smaller than that of the display, in the process of scaling up, the width of the original frame picture is the same as that of the display in the first time, and therefore, the width of the original frame picture is the same as that of the display, and the length of the original frame picture is smaller than that of the display.

Based on the above-described embodiment, in the case where the display device is in the smart display mode, S101-S103 are executed. Under the condition that the display device is in the full-screen display mode, the intermediate frame picture can be stretched along the length direction of the intermediate frame picture until the length of the intermediate frame picture is equal to the length of the display, and the target frame picture is obtained. Under the condition that the display device is in a non-full screen display mode, black edges can be filled on the left side and the right side of the intermediate frame picture to obtain a target frame picture.

In some embodiments, the aspect ratio of the original frame picture is compared with the aspect ratio of the display, and if the aspect ratio of the original frame picture is greater than or equal to the aspect ratio of the display, the original frame picture is enlarged until the length of the original frame picture is equal to the length of the display without changing the aspect ratio of the original frame picture, so as to obtain a frame picture of the video to be played, that is, the length of the frame picture is equal to the length of the display, as shown in fig. 1A. Since the aspect ratio of the original frame picture is greater than that of the display, in the process of scaling up, the length of the original frame picture is the same as that of the display at first in the width and length of the original frame picture, and thus the length of the original frame picture is the same as that of the display, and the width of the original frame picture is smaller than that of the display.

Based on the above-described embodiment, in the case where the display device is in the smart display mode, S101-S103 are executed. In the case that the display device is in the full-screen display mode, the intermediate frame picture may be stretched in the width direction of the intermediate frame picture until the width of the intermediate frame picture is equal to the width of the display, resulting in the target frame picture. Under the condition that the display device is in a non-full screen display mode, black edges can be filled on the upper side and the lower side of the intermediate frame picture to obtain a target frame picture.

In some embodiments, the aspect ratio of the original frame picture of the video to be played may be obtained based on the resolution of the video to be played. For example, the resolution of the video to be played is 1920 × 1080P, and the aspect ratio of the original frame picture is 16: 9.

In some embodiments, the resolution of the display may be derived based on parameters of the display device and the aspect ratio of the display may be derived based on the resolution of the display, for example, if the resolution of the display is 3840 × 2160P, the aspect ratio of the display may be 16:9, and if the resolution of the display is 2560 × 1080P, the aspect ratio of the display may be 21: 9.

In some embodiments, in the case that the original frame picture of the video to be played includes a black border, before stretching the frame picture in equal proportion, the original frame picture is extracted from the video to be played, and the black border in the original frame picture is processed to obtain a new original frame picture. As a specific description of a possible implementation manner of processing the black edge in the original frame picture to obtain a new original frame picture, the following is:

and b, receiving a control instruction for starting the black edge removing function triggered by a user based on the user interface, and starting the black edge removing function in response to the control instruction for starting the black edge removing function. And then detecting whether the original frame picture comprises a black edge or not, acquiring parameters of the black edge in the original frame picture under the condition of detecting that the original frame picture comprises the black edge, cutting the original frame picture based on the parameters of the black edge in the original frame picture, and updating the original frame picture into the cut original frame picture.

In some embodiments, the user may control the display device to display a menu based on the control apparatus 100 or the smart device 300, where the menu may include an on/off option for removing the black border, for example, as shown in fig. 15, the user generates a control instruction for turning on the black border removing function based on the control apparatus 100 or the smart device 300 selecting the option for turning on the black border removing function in the menu.

The control instruction for starting the black edge removing function triggered by the user can be received based on the user interface, and the black edge removing function is started in response to the received control instruction for starting the black edge removing function. Then, whether a black edge exists in the edge area of the original frame picture is detected, and in the case that the black edge exists in the edge area of the original frame picture, a parameter of the black edge is acquired, for example, the black edge parameter may be a pixel coordinate of the black edge. And cutting the original frame picture based on the black edge parameter of the original frame picture so as to obtain a new original frame picture.

For example, as shown in fig. 16, black edges exist on the upper and lower sides of the original frame picture, the black edge parameters are pixel coordinates (0, y1), (0, y2), (x1, y1) and (x1, y2), and the black edge on the lower side of the original frame picture can be cut off by cutting along the length direction with the point (0, y1) as a starting point until the cutting length reaches x 1. The black border on the upper side of the original frame screen can be cut off by cutting in the longitudinal direction from the point (0, y2) until the length of the cut reaches x 1. Therefore, black edges on the upper side and the lower side of the original frame picture can be cut to obtain a new original frame picture, the step a is executed based on the new original frame picture, the black edges in the video to be played can be removed, the black edges in the picture displayed by the final display device caused by the black edges in the original video are avoided, the display quality of the display picture is further improved, and the user experience is improved.

In this embodiment, a control instruction for starting the black border removal function triggered by a user may be received based on the user interface, and the black border removal function is started in response to the received control instruction for starting the black border removal function. And then, detecting whether a black edge exists in the edge area of the original frame picture, acquiring parameters of the black edge under the condition that the black edge exists in the edge area of the original frame picture, and cutting the original frame picture based on the parameters of the black edge of the original frame picture to obtain a new original frame picture, so that the black edge in the video to be played can be removed, the phenomenon that the black edge exists in the picture displayed by the final display device due to the black edge in the original video is avoided, the display quality of the displayed picture is further improved, and the experience of a user is improved.

In some embodiments, in the process of cropping the intermediate frame video to obtain the target frame video, a point on the target edge at a distance S from a midpoint of the target edge may be determined as a cropping point, where S is half of a length of the display along the second direction. And cutting the intermediate frame picture along the first direction by taking the cutting point as a starting point, and cutting to another cutting point, so that the target frame picture can be obtained by cutting twice. The cutting parts are distributed at two sides of the target frame picture, so that the cutting parts are ensured to contain less important information, namely important areas in the middle frame picture are prevented from being cut, and the influence of cutting on the picture integrity is reduced.

Illustratively, as shown in fig. 14A, the short side of the intermediate frame picture is the target side, the point at the midpoint S from the target side is set as the clipping point, and S is half the width of the display, so that four clipping points can be determined, which are M1, M2, M3, and M4, respectively. The inter frame screen is cut in the longitudinal direction with M1 as the start point and M2 as the end point, and partial screens on the lower side of the inter frame screen can be cut. The intermediate frame picture is cut in the longitudinal direction with the M3 as the starting point and the M4 as the ending point, so that the partial picture on the upper side of the intermediate frame picture can be cut, and the target frame picture can be obtained.

Illustratively, as shown in fig. 14B, the long side of the intermediate frame screen is the target side, the point at S from the midpoint of the target side is set as the clipping point, and S is half the length of the display, so four clipping points, N1, N2, N3, and N4, respectively, can be determined. The inter frame screen is cut in the short side direction with N1 as the start point and N2 as the end point, and the partial screen on the left side of the inter frame screen can be cut. The intermediate frame picture is cut in the short side direction with N3 as the starting point and N4 as the ending point, so that the partial picture on the right side of the intermediate frame picture can be cut, and the target frame picture can be obtained.

In this embodiment, in the process of obtaining the target frame video by cropping the intermediate frame video, a point, where a distance between the target edge and a midpoint of the target edge is S, may be determined as a cropping point, where S is half of a length of the display along the second direction. And cutting the intermediate frame picture along the first direction by taking the cutting point as a starting point to another cutting point, and thus obtaining the target frame picture by cutting twice. The cutting parts are distributed at two sides of the target frame picture, so that the cutting parts are ensured to contain less important information, namely important areas in the middle frame picture are prevented from being cut, and the influence of cutting on the picture integrity is reduced.

In some embodiments, when the black edge removal function is started, it is only possible to detect whether a black edge exists in an original frame picture by acquiring a previous multi-frame original frame picture of a video to be played, and at this time, a delayed display mode may be started according to a control instruction for starting the black edge removal function triggered by a user. In the delayed display mode, the display is controlled not to display the picture until the first frame target frame picture is received.

Illustratively, under the condition that the black edge removing function is started, a former multi-frame original frame picture of a video to be played needs to be acquired first, whether a black edge exists in the original frame picture can be detected based on the former multi-frame original frame picture, if the original frame picture is received to be displayed, a certain delay exists between the display of the original frame picture and the display of a target frame picture, and a user can jump obviously when watching, so that the watching experience of the user is influenced. Therefore, according to a control instruction for starting the black edge removing function triggered by a user, the black edge removing function is started and the delayed display mode is entered. In the delayed display mode, before the display receives the first frame target frame picture, the display is controlled to be in a state of not displaying the picture until the first frame target frame picture is received, and the display starts to display the picture and displays the first frame target frame picture. Therefore, the first frame picture displayed by the display is ensured to be the target frame picture and not to display the original frame picture, the display picture is prevented from jumping, and the user experience degree can be improved.

In this embodiment, the delayed display mode is started according to a control instruction for starting the black border removal function triggered by a user, when the black border removal function is started. In the delayed display mode, the display is controlled not to display the first frame of target frame before the first frame of target frame is received, the first frame of frame displayed by the display is ensured to be the target frame and not to display the original frame of frame, the display frame is prevented from jumping, and therefore the experience of a user can be improved.

In the embodiments related to the embodiments of the present disclosure, when there is no logical conflict, the embodiments may be combined.

The disclosed embodiments provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements each process executed by the foregoing subtitle data processing method, and can achieve the same technical effect, and in order to avoid repetition, the details are not repeated here.

Any combination of one or more computer-readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

The present disclosure also provides a computer program product which, when run on a computer, causes the computer to perform the steps of implementing the above-described method embodiments.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the foregoing discussion in some embodiments is not intended to be exhaustive or to limit the implementations to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, comprising:

a controller configured to: stretching frame pictures of a video to be played in an equal proportion to obtain intermediate frame pictures, wherein the length of the intermediate frame pictures is equal to that of a display along a first direction, the length of the intermediate frame pictures is greater than that of the display along a second direction, and the first direction is vertical to the second direction;

the display configured to: and displaying the target frame picture.

2. The display device of claim 1, wherein the controller is further configured to:

3. The display device of claim 2, wherein the controller is further configured to: acquiring the length-width ratio of the original frame picture;

the controller is specifically configured to:

4. The display device according to claim 2, wherein the controller is further configured to: acquiring the length-width ratio of the original frame picture;

the controller is specifically configured to:

5. The display device according to claim 2, further comprising:

6. The display device according to any of claims 1-5, wherein the controller is specifically configured to: determining a cutting point on the target edge, wherein the distance between the cutting point and the middle point of the target edge is half of the length of the display along the second direction;

7. The display device according to any one of claims 1 to 4, characterized by further comprising:

8. A video processing method, comprising:

stretching frame pictures of a video to be played in an equal proportion to obtain intermediate frame pictures, wherein the length of the intermediate frame pictures is equal to that of a display along a first direction, the length of the intermediate frame pictures is greater than that of the display along a second direction, and the first direction is vertical to the second direction;

and sending the target frame picture to the display.

9. A computer-readable storage medium, comprising: the computer-readable storage medium has stored thereon a computer program which, when executed by a processor, implements the video processing method of claim 8.

10. A computer program product, comprising: when the computer program product is run on a computer, causing the computer to implement the video processing method of claim 8.