CN112910875B

CN112910875B - Display method and device

Info

Publication number: CN112910875B
Application number: CN202110113902.6A
Authority: CN
Inventors: 张俪馨
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2021-01-27
Filing date: 2021-01-27
Publication date: 2023-06-30
Anticipated expiration: 2041-01-27
Also published as: WO2022161310A1; CN112910875A

Abstract

The application discloses a display method and device, and belongs to the technical field of video processing. The method comprises the following steps: under the condition that the network state of the electronic equipment is abnormal and the code rate of the target video played by the electronic equipment is reduced to a first code rate, determining a target vertical superdivision model of the target video in N vertical superdivision models preset in the electronic equipment, wherein N is an integer larger than 1; and displaying the target image frame under the condition that the image frame of the target video is transmitted at the first code rate, wherein the target image frame is the image frame after the image frame of the target video is processed based on the target vertical super-division model. The display method provided by the application can improve the image quality when the electronic equipment plays the video with a low code rate due to abnormal network conditions.

Description

Display method and device

Technical Field

The application belongs to the technical field of video processing, and particularly relates to a display method and device.

Background

With the development of communication technology, electronic devices such as mobile phones and tablet computers have become an indispensable tool in daily life. A user may play videos, such as movies and short videos, etc., using an electronic device via a video application installed in the electronic device.

However, in the process of playing video by the electronic device, when an abnormal network condition of the electronic device connection may occur, for example, the electronic device enters a tunnel or moves at a high speed, so that the network speed is poor, at this time, in order to ensure that the video is played continuously, the electronic device generally reduces the code rate of the video played currently, for example, the high-definition code rate (such as 1080 p) is reduced to the low-definition code rate (such as 480 p), and the code rate of the video played is reduced, which may result in a reduction in the image quality of the video played.

Therefore, under the condition that the network condition is abnormal in the video playing process of the current electronic equipment, the problem that the image quality of the played video is low due to the fact that the video playing code rate is reduced exists.

Disclosure of Invention

The embodiment of the application aims to provide a display method and a display device, which can solve the problem that the image quality of a video to be played is low due to the reduction of the video playing code rate under the condition that the network condition is abnormal in the video playing process of the current electronic equipment.

In order to solve the technical problems, the application is realized as follows:

in a first aspect, an embodiment of the present application provides a display method, including:

Determining a target vertical superdivision model of the target video in N vertical superdivision models preset in the electronic equipment under the condition that the network state of the electronic equipment is abnormal and the code rate of the target video played by the electronic equipment is reduced to a first code rate, wherein N is an integer greater than 1;

and displaying a target image frame under the condition that the image frame of the target video is transmitted at the first code rate, wherein the target image frame is an image frame obtained by processing the image frame of the target video based on the target vertical super-division model.

In a second aspect, embodiments of the present application provide a display device, including:

the system comprises a superdivision model determining module, a target video processing module and a target video processing module, wherein the superdivision model determining module is used for determining a target vertical superdivision model of a target video in N vertical superdivision models preset in electronic equipment under the conditions that network state abnormality of the electronic equipment is detected and the code rate of the target video played by the electronic equipment is reduced to a first code rate, wherein N is an integer larger than 1;

and the display module is used for displaying the target image frame under the condition that the image frame of the target video is transmitted at the first code rate.

In a third aspect, embodiments of the present application provide an electronic device comprising a processor, a memory and a program or instruction stored on the memory and executable on the processor, the program or instruction implementing the steps of the method according to the first aspect when executed by the processor.

In a fourth aspect, embodiments of the present application provide a readable storage medium having stored thereon a program or instructions which when executed by a processor implement the steps of the method according to the first aspect.

In a fifth aspect, embodiments of the present application provide a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and where the processor is configured to execute a program or instructions to implement a method according to the first aspect.

In the embodiment of the application, under the condition that the code rate of a video (namely, a target video) played by the electronic equipment is reduced due to abnormal network state, the electronic equipment can select a vertical superdivision model (namely, a target vertical superdivision model) corresponding to the target video from a plurality of preset vertical superdivision models, process image frames of the video played by the selected vertical superdivision model, and play the video after image frame processing, so that the electronic equipment can process the image frames of the video played under low code rate by the selected vertical superdivision model, improve the image quality of the video played under low code rate, and further improve the image quality of the video played under low code rate when the network state is abnormal by the electronic equipment; in addition, the selected vertical superdivision model corresponds to the played video, so that the selected vertical superdivision model is more suitable for processing the played video, the processing efficiency can be improved, and the energy consumption in the processing process can be reduced.

Drawings

Fig. 1 is a schematic flow chart of a display method according to an embodiment of the present application;

fig. 2 is a schematic structural diagram of a display device according to an embodiment of the present application;

fig. 3 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application;

fig. 4 is a second schematic diagram of a hardware structure of the electronic device according to the embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.

The terms first, second and the like in the description and in the claims, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged where appropriate so that embodiments of the present application may be practiced in sequences other than those illustrated and described herein, and that the objects identified by "first", "second", etc. are generally of a type and do not limit the number of objects, e.g., the first shot object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.

The display method provided by the embodiment of the application is described in detail below through specific embodiments and application scenes thereof with reference to the accompanying drawings.

Referring to fig. 1, an embodiment of the present application provides a display method, which is applied to an electronic device, as shown in fig. 1, and includes the following steps:

step 101, determining a target vertical superdivision model of a target video in N vertical superdivision models preset in electronic equipment under the condition that network state abnormality of the electronic equipment is detected and the code rate of playing the target video by the electronic equipment is reduced to a first code rate, wherein the target vertical superdivision model is one vertical superdivision model in the N vertical superdivision models preset in the electronic equipment, and N is an integer larger than 1;

and 102, displaying a target image frame under the condition that the image frame of the target video is transmitted at the first code rate, wherein the target image frame is an image frame obtained by processing the image frame of the target video based on the target vertical super-division model.

Here, under the condition that the code rate of the video (i.e., the target video) played by the electronic device is reduced due to abnormal network state, the electronic device can select a vertical superdivision model (i.e., the target vertical superdivision model) corresponding to the target video from a plurality of preset vertical superdivision models, process the image frames of the video played by the selected vertical superdivision model, and play the video after the image frame processing, so that the electronic device can process the image frames of the video played under low code rate by the selected vertical superdivision model, thereby improving the image quality of the video played under low code rate, and further improving the image quality of the video played under low code rate when the network state is abnormal by the electronic device; in addition, the selected vertical superdivision model corresponds to the played video, so that the selected vertical superdivision model is more suitable for processing the played video, the processing efficiency can be improved, and the energy consumption in the processing process can be reduced.

In the above step 101, in the process of running the video playing application and playing the target video, the server may detect whether the current network state of the electronic device is abnormal, and in the case that the network state of the electronic device is detected to be abnormal, may reduce the currently adopted code rate (for convenience of description, referred to as "second code rate" in the embodiment of the present application) of the video playing by the electronic device (i.e. the server transmits the image frame of the played video to the electronic device) to the first code rate.

The server detects whether the current network state of the electronic device is abnormal, that is, the electronic device reports the network speed or the network signal strength of the network currently connected with the electronic device to the server, and the server determines that the network state of the electronic device is abnormal according to whether the network speed or the network signal strength reported by the electronic device is lower than a corresponding preset threshold value or not and under the condition that the network speed or the network signal strength is lower than the corresponding preset threshold value, and the like.

In addition, the above-mentioned reducing the code rate of playing the target video by the electronic device to the first code rate may be that the server determines the corresponding first code rate according to the network state after the abnormality occurs in the electronic device, and adjusts the code rate of the image frame of the transmission target video to the first code rate, where the first code rate is lower than the second code rate of playing the target video by the electronic device before the abnormality occurs in the network state.

For example, in the case where the electronic device plays video (i.e., the target video) at a rate of 5Mb/s (i.e., the second rate), if the electronic device detects that its network speed is reduced and the reduced network speed can only meet the requirement of playing video at a rate of 2Mb/s, the electronic device reduces the rate of playing video from 5Mb/s to 2Mb/s.

In this embodiment of the present application, after the code rate of playing the target video by the electronic device is reduced to the first code rate, the electronic device may determine, among N preset vertical superdivision models, a vertical superdivision model corresponding to the target video as the target vertical superdivision model.

Each of the N vertical superdivision models is an arbitrary deep learning model capable of improving image quality, each vertical superdivision model is obtained in advance through a large amount of data learning, and different vertical superdivision models in the N vertical superdivision models are different in at least one of network parameters, network structures, processing precision, processing speed and the like, so that the different vertical superdivision models are suitable for processing videos of different video information.

In addition, the N vertical superdivision models may be learned in a server and sent to the electronic device by the server for storage, or may be directly learned in the electronic device, and the learning process of the vertical superdivision models is well known to those skilled in the art and will not be described herein.

In this embodiment of the present application, the determining a target vertical superdivision model based on the target video may be determining, according to a preset rule, a target vertical superdivision model corresponding to the target video from N vertical superdivision models.

The determining the target vertical superdivision model based on the correspondence between the video information and the vertical superdivision model, that is, determining the target vertical superdivision model of the target video includes: and determining a vertical superdivision model with a corresponding relation with video information of the target video in the preset N vertical superdivision models as a target vertical superdivision model.

The video information of the target video may be any information used as an index for selecting the vertical super-resolution model, and may be image quality (including resolution, etc.) of the target video played at the first code rate, a code rate (i.e., the first code rate) of the target video played after the network state is abnormal, video type information, and so on.

Then, in the case where the video information includes an image quality of a target video played at the first code rate, the determining the target vertical super-resolution model may include: and determining the vertical superdivision model corresponding to the image quality of the target video played at the first code rate as a target vertical superdivision waveform in the N vertical superdivision models.

For example, assuming that the electronic device is preset with a vertical super-division model 1 and a vertical super-division model 2, and the vertical super-division model 1 is suitable for improving the image quality of the video frame of the video with the definition of FULL D1 (i.e., the resolution of 720×576), the vertical super-division model 2 is suitable for improving the image quality of the video frame of the video with the definition of HALF D1 (i.e., the resolution of 720×288), if the definition of the target video played by the electronic device at the first code rate is FULL D1, the electronic device determines the vertical super-division model 1 as the target vertical super-division model; if the definition of the target video played by the electronic equipment under the first code rate is HALF D1, the electronic equipment determines that the vertical superdivision model 2 is the target vertical superdivision model.

Alternatively, in a case where the video information includes the first code rate, the determining the target vertical super-division model may include: and determining the vertical superdivision model with a corresponding relation with the first code rate as a target vertical superdivision model in the N vertical superdivision models.

Alternatively, in the case where the video information includes a video type of the target video, the step 102 may include:

acquiring the video type of the target video;

and determining a vertical superdivision model corresponding to the video type of the target video from the N vertical superdivision models as the target vertical superdivision model.

Here, the electronic device may determine the corresponding target vertical superdivision model from the preset N vertical superdivision models according to the video type of the target video, so that the selected vertical superdivision model is more suitable for processing the video frame of the target video played at the first code rate, and further improves the image quality of the video played at the low code rate.

In this embodiment of the present invention, the video types of the target video may include any one of a person, an animal, a plant, a building, a landscape, an animation, and the like, and the electronic device may preset a vertical superscore model corresponding to each video type, that is, the target vertical superscore model is a vertical superscore model having a preset corresponding relationship with the video type of the target video in the N vertical superscore models.

For example, the electronic device is preset with the vertical superscore model 3 and the vertical superscore model 4, and the vertical superscore model 3 has a correspondence with the video type being a person, and the vertical superscore model 4 has a correspondence with the video type scenery, so if the target video is a video of a shot person (i.e. the video type of the target video is a person), the electronic device determines that the vertical superscore model 3 is the target vertical superscore model.

The video information of the target video may be video information obtained by detecting the target video by the electronic device, or may be video information sent by the server received by the electronic device.

Specifically, in the case where the video information is the video type, the acquiring the video type of the target video may include:

under the condition that video type information of the target video is received, acquiring the video type indicated by the video type information, wherein the video type information is information sent by a server under the condition of transmitting video data of the target video; or alternatively, the process may be performed,

determining a video type of the target video based on an image of a target image frame, wherein the target image frame is: and the electronic equipment plays the image frames of the target video within a preset time period before the code rate of playing the target video is reduced to the first code rate.

Here, the electronic device may determine the video type of the target video according to the video type information transmitted by the server, so that the efficiency of video processing may be improved; the video type of the target video can be determined according to the video frame of the target video, so that the mode of acquiring the video type of the target video is flexible, and different requirements can be met.

The electronic device can receive video type information sent by the server in the process of transmitting video data of the target video in the process of playing the target video, and the electronic device can acquire the video type indicated by the video type information.

In addition, the electronic device may acquire a part of the image frames of the target video, and determine the video type of the target video according to the image information in the part of the image frames.

For example, in the process of playing the target video, the electronic device may acquire an image frame within a preset duration (such as 1 s) before the code rate of playing the target video is reduced to the first code rate, and determine the video type of the target video according to the acquired image frame, specifically, if more than 60 image frames in the acquired 100 image frames include animals, determine that the video type of the target video is animals, and so on.

Of course, the above electronic device determines the target vertical superscore model corresponding to the target video from the N vertical superscore models, and is not limited to determining the corresponding target vertical superscore model based on the video information of the target video, but may determine the target vertical superscore model of the target video based on other rules.

Specifically, before determining the target vertical superdivision model of the target video in the N vertical superdivision models preset in the electronic device, the method further includes:

receiving a first video clip sent by a server, wherein the first video clip is a part of the video clip of the target video;

the determining the target vertical superdivision model of the target video in the N preset vertical superdivision models in the electronic equipment comprises the following steps:

under the condition that the electronic equipment plays the target video at a first code rate, acquiring a second video clip, wherein the second video clip is a video clip with the same content as the first video clip, and the image quality of the first video clip is higher than that of the second video clip;

a target vertical superdivision model is determined among the N vertical superdivision models based on the first video segment and the second video segment.

Here, the electronic device may determine the target vertical superdivision model in the N vertical superdivision models according to the first video segment of the target video sent by the server and the second video segment playing at the first code rate, where the second video segment is the same as the first video segment, so that the determined target vertical superdivision model for processing the target video playing at the first code rate is more suitable, and further improves the image quality of the target video playing at the first code rate.

In this embodiment of the present application, the first video segment is a portion of a video segment of a target video sent by a server before an electronic device reduces a code rate of a target video to a first code rate; the second video clip is a video clip which is played by the electronic device under the first code rate and has the same content as the first video clip, and the image quality (including resolution and the like) of the first video clip is higher than that of the second video clip.

The obtaining the first video segment may be that, when the server receives a request from the electronic device to play the target video, the server may transmit video data of the target video to the electronic device, and meanwhile, obtain data sent by at least one video segment of the target video, where the image quality of the at least one video segment is the first image quality, and when the electronic device reduces the code rate of playing the target video to the first code rate, the electronic device may obtain, as the first video segment, a video segment, in which a playing period is located after and closest to the current time, in the at least one video segment.

For example, in the process of transmitting video data of the target video, the server may send m video clips of the target video to the electronic device, where two adjacent video clips in the m video clips are spaced by a first preset duration (for example, 5s or 10s, etc.), and each video clip has a duration of a second preset duration (for example, 0.5s or 1s, etc.) and an image quality of a first image quality (for example, 1080P, etc.), and if the electronic device reduces the code rate when playing the target video 20s, the electronic device determines a video clip with a playing period after 20s in the m video clips as the first video clip, where m is an integer greater than 1.

It should be noted that, when the code rate of the played video is reduced, the reduced first code rate is no longer adapted to the image quality of the original video, so as to ensure the smoothness of video playing, the electronic device may reduce the image quality of the played video to the image quality adapted to the first code rate.

For example, in the case where the electronic device plays a video with a resolution of 1080P (i.e., resolution 1920×1080) at a rate of 5Mb/s, if the electronic device decreases the rate of playing the video to 2Mb/s, the electronic device decreases the image quality of the played video to a resolution FUUL D1 (i.e., resolution 720×576) when playing the video at 2 Mb/s.

The first image quality of the first video clip is higher than the image quality of the second video clip, that is, the first image quality may be the image quality of the target video before the code rate of the playing target video is reduced to the first code rate; alternatively, the image quality may be preset, and the preset image quality is at least higher than the image quality of the target video played at the first code rate.

For example, in the process of playing the target video at the code rate of 5Mb/s, the electronic device may receive m video clips with the video definition of 1080P sent by the server, and in the case that the electronic device reduces the code rate of playing the target video to 2Mb/s, the electronic device determines a first video clip, that is, the definition of the first video clip is 1080P, from the m video clips, and acquires a second video clip with the same content as the first video clip, that is, the definition of the second video clip is FUUL D1.

In this embodiment of the present application, after the electronic device obtains the first video segment and the second video segment, the electronic device may compare the first video segment and the second video segment, and determine the target vertical superdivision model from the N vertical superdivision models according to a comparison result.

Specifically, determining, based on the first video segment and the second video segment, a target vertical superdivision model from the N vertical superdivision models includes:

processing the image frames of the second video segments based on the N vertical superdivision models respectively to obtain N video segments to be compared corresponding to the N vertical superdivision models;

determining a target video segment to be compared, the image quality of which is closest to that of the first video segment, from the N video segments to be compared;

and determining the vertical superdivision model corresponding to the target to-be-compared video fragment as a target vertical superdivision model.

The electronic device may process the second video segment through the preset N vertical superdivision models, compare the second video segment processed by each vertical superdivision model (i.e. the video segment to be compared) with the first video segment, and determine the vertical superdivision model with the image quality closest to that of the first video segment after processing as the target vertical superdivision model, so that the vertical superdivision model with the best image quality processing effect on the video played at the low code rate may be selected as the target vertical superdivision model, and further improve the image quality of the video played at the low code rate.

For example, assuming that the vertical superdivision model 5, the vertical superdivision model 6 and the vertical superdivision model 7 are preset in the electronic device, in the case that the image definition of the first video segment is 1080P and the image definition of the second video segment is Hafl D1, if the image definition of the video segment processed by the vertical superdivision model 5 on the second video segment is Full D1, the image definition of the video segment processed by the vertical superdivision model 6 on the second video segment is 960P, and the image definition of the video segment processed by the vertical superdivision model 7 on the second video segment is 720P, the electronic device determines that 960P is closest to 1080P, and determines the vertical superdivision model 6 as the target vertical superdivision model.

It should be noted that, since the process of processing the video frames of the video by the vertical super-division model is well known to those skilled in the art, details are not described herein.

Alternatively, determining the target vertical superdivision model from the N vertical superdivision models based on the first video segment and the second video segment may include:

acquiring the difference degree between the image quality of the second video segment and the image quality of the first video segment;

and determining a vertical superdivision model corresponding to the acquired difference degree as the target vertical superdivision model in the N vertical superdivision models.

Here, the electronic device may determine, according to the difference between the image quality of the second video segment and the image quality of the first video segment, a target vertical superdivision model corresponding to the difference among the N vertical superdivision models, so that a manner of determining the target vertical superdivision model is simpler, efficiency of determining the target vertical superdivision model is improved, and efficiency of video processing is further improved.

Among the N vertical superdivision models, the vertical superdivision model corresponding to the acquired difference degree is determined as the target vertical superdivision model, which may be a correspondence between the preset difference degree and the vertical superdivision model in the electronic device, and the electronic device may determine the vertical superdivision model having a correspondence with the acquired difference degree as the target vertical superdivision model.

For example, assuming that the vertical superdivision model 8 and the vertical superdivision model 9 are preset in the electronic device, and the preset vertical superdivision model 8 corresponds to a difference of 1 to 2 preset levels (including 1080P, 960P, 720P, full D1, half D1, etc. which are sequentially reduced), and the vertical superdivision model 9 corresponds to a difference of 3 to 5 preset levels of image quality, if the sharpness of the first video clip is 1080P and the sharpness of the second video clip is 720P, the image quality of the second video clip differs from the image quality of the first video clip by two preset levels, the electronic device determines that the vertical superdivision model 8 is the target vertical superdivision model.

In the step 102, after the electronic device determines the target vertical super-division model, the electronic device may process the video frame of the target video played at the first code rate through the target vertical super-division model, so as to improve the image quality of the target video played at the first code rate.

It should be noted that, in the process that the electronic device plays the target video at the first code rate, a situation that the network state is restored may occur, for example, the electronic device moves from the area with poor signal to the area with good signal, and then the electronic device may adjust its code rate to the second code rate, where the second code rate is adapted to the restored network state.

At this time, after the step 102, the method may further include:

and under the condition that the network state of the electronic equipment is detected to be recovered to be normal, recovering the code rate of the target video played by the electronic equipment to a second code rate, and stopping the target vertical super-division model from processing the image frames of the target video.

Under the condition that the network state of the electronic equipment is recovered to be normal and the code rate of the target video played by the electronic equipment is recovered to the second code rate, the image quality of the target video played by the electronic equipment can be recovered along with the recovery of the code rate, at the moment, the electronic equipment stops the processing of the image frames of the target video played by the target vertical super-resolution model under the second code rate in time, the electric quantity loss caused by unnecessary image processing performed by the target vertical super-resolution model can be saved, and the electric quantity of the electronic equipment is saved.

Referring to fig. 2, an embodiment of the present application provides a display device, as shown in fig. 2, the display device 200 includes:

the superdivision model determining module 201 is configured to determine, in N vertical superdivision models preset in an electronic device, a target vertical superdivision model of a target video when detecting that a network state of the electronic device is abnormal and a code rate of playing the target video by the electronic device is reduced to a first code rate, where N is an integer greater than 1;

a display module 202, configured to display a target image frame in a case of transmitting the image frame of the target video at the first code rate.

Here, the display device 200 may process the image frames of the video played at the low code rate through the selected vertical super-division model, so as to improve the image quality of the video played at the low code rate, and further improve the image quality of the electronic device when the network condition is abnormal and the video is played at the low code rate; in addition, the selected vertical superdivision model corresponds to the played video, so that the selected vertical superdivision model is more suitable for processing the played video, the processing efficiency can be improved, and the energy consumption in the processing process can be reduced.

Optionally, the superdivision model determining module 201 includes:

a video type obtaining unit, configured to obtain a video type of the target video;

and the first superdivision model determining unit is used for determining a vertical superdivision model corresponding to the video type of the target video from the N vertical superdivision models as the target vertical superdivision model.

Here, the display device 200 may determine a corresponding target vertical superdivision model from the preset N vertical superdivision models according to the video type of the target video, so that the selected vertical superdivision model is more suitable for processing the video frame of the target video played at the first code rate, and further improves the image quality of the video played at the low code rate.

Optionally, the video type obtaining unit is specifically configured to:

determining a video type of the target video based on an image of a target image frame, wherein the target image frame is: a portion of the image frames of the target video.

Here, the display apparatus 200 may determine the video type of the target video according to the video type information transmitted from the server, so that the efficiency of video processing may be improved; the video type of the target video can be determined according to the video frame of the target video, so that the mode of acquiring the video type of the target video is flexible, and different requirements can be met.

Optionally, the apparatus 200 further includes:

the video segment receiving module is used for receiving a first video segment sent by the server, wherein the first video segment is a part of the video segment of the target video;

the superdivision model determining module 201 includes:

a video clip obtaining unit, configured to obtain a second video clip when the electronic device plays the target video at a first code rate, where the second video clip is a video clip having the same content as the first video clip, and an image quality of the first video clip is higher than an image quality of the second video clip;

and the second superdivision model determining unit is used for determining a target vertical superdivision model in the N vertical superdivision models based on the first video segment and the second video segment.

Here, the display device 200 may determine the above-mentioned target vertical super-division model among the N vertical super-division models according to the first video clip of the target video sent by the server and the second video clip having the same content as the first video clip and played at the first code rate, so that the determined target vertical super-division model for processing the target video played at the first code rate is more suitable, and further, the image quality of the target video played at the first code rate is improved.

Optionally, the second superdivision model determining unit includes:

the video segment processing subunit is used for respectively processing the image frames of the second video segment based on the N vertical super-division models to obtain N video segments to be compared corresponding to the N vertical super-division models;

the comparison subunit is used for determining a target video fragment to be compared, the image quality of which is closest to that of the first video fragment, in the N video fragments to be compared;

and the first superdivision model determining subunit is used for determining the vertical superdivision model corresponding to the target video fragment to be compared as a target vertical superdivision model.

Here, the display device 200 may process the second video clip through the preset N vertical superdivision models, compare the second video clip processed by each vertical superdivision model (i.e. the video clip to be compared) with the second video clip, and determine the vertical superdivision model with the image quality closest to that of the first video clip as the target vertical superdivision model, so that the vertical superdivision model with the best image quality processing effect on the video played at the low code rate may be selected as the target vertical superdivision model, and further improve the image quality of the video played at the low code rate.

Optionally, the second superdivision model determining unit includes:

a difference degree obtaining subunit, configured to obtain a difference degree between an image quality of the second video segment and an image quality of the first video segment;

and the second superdivision model determining subunit is used for determining a vertical superdivision model corresponding to the acquired difference degree as the target vertical superdivision model in the N vertical superdivision models.

Here, the display device 200 may determine the target vertical superdivision model corresponding to the difference degree in the N vertical superdivision models according to the difference degree between the image quality of the second video segment and the image quality of the first video segment, so that the manner of determining the target vertical superdivision model is simpler, the efficiency of determining the target vertical superdivision model is improved, and the efficiency of video processing is further improved.

Optionally, the apparatus 200 further includes:

the code rate recovery module is used for recovering the code rate of the target video played by the electronic equipment to the second code rate under the condition that the network state of the electronic equipment is detected to be recovered to be normal, and stopping the target vertical super-division model from processing the image frames of the target video

Here, the display device 200 may stop the processing of the image frame of the target video played at the second code rate by the target vertical super-division model in time, so that the loss of the electric quantity caused by the unnecessary image processing performed by the target vertical super-division model may be saved, and the electric quantity of the electronic device is saved.

The display device in the embodiment of the application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device may be a mobile electronic device or a non-mobile electronic device. By way of example, the mobile electronic device may be a cell phone, tablet computer, notebook computer, palm computer, vehicle-mounted electronic device, wearable device, ultra-mobile personal computer (ultra-mobile personal computer, UMPC), netbook or personal digital assistant (personal digital assistant, PDA), etc., and the non-mobile electronic device may be a server, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (TV), teller machine or self-service machine, etc., and the embodiments of the present application are not limited in particular.

The display device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an ios operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.

The display device provided in this embodiment of the present application can implement each process implemented by the method embodiment of fig. 1, and in order to avoid repetition, a description is omitted here.

Optionally, as shown in fig. 3, the embodiment of the present application further provides an electronic device 300, including a processor 301, a memory 302, and a program or an instruction stored in the memory 302 and capable of running on the processor 301, where the program or the instruction implements each process of the embodiment of the display method when executed by the processor 301, and the process can achieve the same technical effect, and for avoiding repetition, a description is omitted herein.

The electronic device in the embodiment of the application includes the mobile electronic device and the non-mobile electronic device described above.

Fig. 4 is a schematic hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 400 includes, but is not limited to: radio frequency unit 401, network module 402, audio output unit 403, input unit 404, sensor 405, display unit 406, user input unit 407, interface unit 408, memory 409, and processor 410.

Those skilled in the art will appreciate that the electronic device 400 may also include a power source (e.g., a battery) for powering the various components, which may be logically connected to the processor 410 by a power management system to perform functions such as managing charge, discharge, and power consumption by the power management system. The electronic device structure shown in fig. 4 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than shown, or may combine certain components, or may be arranged in different components, which are not described in detail herein.

Wherein the processor 410 is configured to:

a display unit 406 for:

Here, the electronic device 400 may process the image frames of the video played at the low code rate through the selected vertical super-division model, so as to improve the image quality of the video played at the low code rate, thereby improving the image quality of the electronic device when the network condition is abnormal and the video is played at the low code rate; in addition, the selected vertical superdivision model corresponds to the played video, so that the selected vertical superdivision model is more suitable for processing the played video, the processing efficiency can be improved, and the energy consumption in the processing process can be reduced.

Optionally, the processor 410 is further configured to:

acquiring the video type of the target video;

Here, the electronic device 400 may determine, according to the video type of the target video, a corresponding target vertical superdivision model from the preset N vertical superdivision models, so that the selected vertical superdivision model is more suitable for processing the video frame of the target video played at the first code rate, and further improves the image quality of the video played at the low code rate.

Optionally, the processor 410 is further configured to:

Here, the electronic device 400 may determine the video type of the target video according to the video type information transmitted by the server, so that the efficiency of video processing may be improved; the video type of the target video can be determined according to the video frame of the target video, so that the mode of acquiring the video type of the target video is flexible, and different requirements can be met.

Optionally, the processor 410 is further configured to:

Here, the electronic device 400 may determine the above-mentioned target vertical superdivision model in the N vertical superdivision models according to the first video clip of the target video sent by the server and the second video clip having the same content as the first video clip and played at the first code rate, so that the determined target vertical superdivision model for processing the target video played at the first code rate is more suitable, and further, the image quality of the target video played at the first code rate is improved.

Optionally, the processor 410 is further configured to:

Here, the electronic device 400 may process the second video clip through the preset N vertical superdivision models, compare the second video clip processed by each vertical superdivision model (i.e. the video clip to be compared) with the second video clip, and determine the vertical superdivision model with the image quality closest to that of the first video clip as the target vertical superdivision model, so that the vertical superdivision model with the best image quality processing effect on the video played at the low code rate may be selected as the target vertical superdivision model, and further improve the image quality of the video played at the low code rate.

Optionally, the processor 410 is further configured to:

Here, the electronic device 400 may determine, according to the difference between the image quality of the second video segment and the image quality of the first video segment, a target vertical superdivision model corresponding to the difference among the N vertical superdivision models, so that a manner of determining the target vertical superdivision model is simpler, efficiency of determining the target vertical superdivision model is improved, and efficiency of video processing is further improved.

Optionally, the processor 410 is further configured to:

Here, the electronic device 400 may stop processing the image frame of the target video played under the second code rate by the target vertical super-division model in time, so that loss of electric quantity caused by unnecessary image processing performed by the target vertical super-division model may be saved, and electric quantity of the electronic device is saved.

It should be appreciated that in embodiments of the present application, the input unit 404 may include a graphics processor (Graphics Processing Unit, GPU) 4041 and a microphone 4042, with the graphics processor 4041 processing image data of still pictures or video obtained by an image capture device (e.g., a camera) in a video capture mode or an image capture mode. The display unit 406 may include a display panel 4061, and the display panel 4061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 407 includes a touch panel 4071 and other input devices 4072. The touch panel 4071 is also referred to as a touch screen. The touch panel 4071 may include two parts, a touch detection device and a touch controller. Other input devices 4072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and so forth, which are not described in detail herein. Memory 409 may be used to store software programs as well as various data including, but not limited to, application programs and an operating system. The processor 410 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 410.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored, and when the program or the instruction is executed by a processor, the processes of the foregoing display method embodiment are implemented, and the same technical effects can be achieved, so that repetition is avoided, and no further description is given here.

Wherein the processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium such as a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.

The embodiment of the application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled with the processor, and the processor is used for running a program or an instruction, so as to implement each process of the embodiment of the display method, and achieve the same technical effect, so that repetition is avoided, and no redundant description is provided here.

It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), including several instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method described in the embodiments of the present application.

The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those of ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are also within the protection of the present application.

Claims

1. A display method, comprising:

displaying a target image frame under the condition that the image frame of the target video is transmitted at the first code rate, wherein the target image frame is an image frame obtained by processing the image frame of the target video based on the target vertical super-division model;

determining a vertical superdivision model with a corresponding relation with video information of the target video in N preset vertical superdivision models in the electronic equipment as a target vertical superdivision model, wherein the video information comprises the image quality of the target video played under the first code rate, the first code rate and the video type of the target video;

before determining the target vertical superdivision model of the target video in N vertical superdivision models preset in the electronic equipment, the method further comprises:

determining a target vertical superdivision model from the N vertical superdivision models based on the first video segment and the second video segment;

the determining, based on the first video segment and the second video segment, a target vertical superdivision model from the N vertical superdivision models includes:

2. The method of claim 1, wherein the determining a target vertical superdivision model among the N vertical superdivision models based on the first video segment and the second video segment comprises:

3. The method of claim 1, wherein, in the case of transmitting the image frames of the target video at the first code rate, after displaying the target image frames, further comprising:

4. A display device, comprising:

a display module for displaying a target image frame in the case of transmitting the image frame of the target video at the first code rate;

the superdivision model determining module is specifically configured to:

the device further comprises:

the superdivision model determining module comprises:

a second super-division model determining unit configured to determine a target vertical super-division model among the N vertical super-division models based on the first video clip and the second video clip;

the second superdivision model determining unit includes: