CN112910875A - Display method and device - Google Patents

Display method and device Download PDF

Info

Publication number
CN112910875A
CN112910875A CN202110113902.6A CN202110113902A CN112910875A CN 112910875 A CN112910875 A CN 112910875A CN 202110113902 A CN202110113902 A CN 202110113902A CN 112910875 A CN112910875 A CN 112910875A
Authority
CN
China
Prior art keywords
video
hyper
target
vertical
model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110113902.6A
Other languages
Chinese (zh)
Other versions
CN112910875B (en
Inventor
张俪馨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN202110113902.6A priority Critical patent/CN112910875B/en
Publication of CN112910875A publication Critical patent/CN112910875A/en
Priority to PCT/CN2022/073465 priority patent/WO2022161310A1/en
Application granted granted Critical
Publication of CN112910875B publication Critical patent/CN112910875B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80Responding to QoS
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440281Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64723Monitoring of network processes or resources, e.g. monitoring of network load
    • H04N21/64738Monitoring network characteristics, e.g. bandwidth, congestion level
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64746Control signals issued by the network directed to the server or the client
    • H04N21/64761Control signals issued by the network directed to the server or the client directed to the server
    • H04N21/64769Control signals issued by the network directed to the server or the client directed to the server for rate control
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application discloses a display method and a display device, and belongs to the technical field of video processing. The method comprises the following steps: under the condition that the network state of the electronic equipment is detected to be abnormal and the code rate of the target video played by the electronic equipment is reduced to a first code rate, determining a target vertical hyper-division model of the target video in N vertical hyper-division models preset in the electronic equipment, wherein N is an integer greater than 1; and under the condition that the image frames of the target video are transmitted at the first code rate, displaying the target image frames, wherein the target image frames are the image frames obtained by processing the image frames of the target video based on the target vertical hyper-resolution model. The display method provided by the application can improve the image quality when the electronic equipment plays the video at a low code rate due to abnormal network conditions.

Description

Display method and device
Technical Field
The application belongs to the technical field of video processing, and particularly relates to a display method and device.
Background
With the development of communication technology, electronic devices such as mobile phones and tablet computers have become indispensable tools in daily life. The user can play videos such as movies and short videos using the electronic device through a video application installed in the electronic device.
However, in the process of playing a video by an electronic device, when a network condition of the electronic device connected to the electronic device is abnormal, for example, the electronic device enters a tunnel or moves at a high speed, which may cause a network speed to be deteriorated, at this time, in order to ensure that the video is continuously played, the electronic device usually reduces a bitrate of the currently played video, for example, from a high definition bitrate (e.g., 1080p) to a low definition bitrate (e.g., 480p), and the decrease of the bitrate of the video playing may cause an image quality of the video playing to be decreased.
Therefore, under the condition that the network condition is abnormal in the process of playing the video, the problem that the image quality of the played video is low due to the fact that the video playing code rate is reduced exists in the conventional electronic equipment.
Disclosure of Invention
The embodiment of the application aims to provide a display method and a display device, which can solve the problem that the image quality of a played video is low due to the fact that the video playing code rate is reduced under the condition that the network condition is abnormal in the process of playing the video by the conventional electronic equipment.
In order to solve the technical problem, the present application is implemented as follows:
in a first aspect, an embodiment of the present application provides a display method, including:
under the conditions that the network state of electronic equipment is detected to be abnormal and the code rate of a target video played by the electronic equipment is reduced to a first code rate, determining a target vertical hyper-division model of the target video in N vertical hyper-division models preset in the electronic equipment, wherein N is an integer greater than 1;
and under the condition that the image frames of the target video are transmitted at the first code rate, displaying the target image frames, wherein the target image frames are the image frames after the image frames of the target video are processed on the basis of the target vertical hyper-resolution model.
In a second aspect, an embodiment of the present application provides a display device, including:
the system comprises a hyper-division model determining module, a hyper-division model determining module and a hyper-division model determining module, wherein the hyper-division model determining module is used for determining a target vertical hyper-division model of a target video in N vertical hyper-division models preset in electronic equipment under the conditions that the network state of the electronic equipment is detected to be abnormal and the code rate of the target video played by the electronic equipment is reduced to a first code rate, and N is an integer greater than 1;
and the display module is used for displaying the target image frame under the condition of transmitting the image frame of the target video at the first code rate.
In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, the program or instructions implement the steps of the method according to the first aspect.
In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first aspect.
In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.
In the embodiment of the application, under the condition that the code rate of the played video (namely, the target video) is reduced due to abnormal network state of the electronic equipment, the electronic equipment can select a vertical hyper-division model (namely, the target vertical hyper-division model) corresponding to the target video from a plurality of preset vertical hyper-division models, process the image frame of the played video through the selected vertical hyper-division model and play the video after image frame processing, so that through the embodiment of the application, the electronic equipment can process the image frame of the video played at low code rate through the selected vertical hyper-division model, improve the image quality of the video played at low code rate and further improve the image quality of the electronic equipment when the video is played at low code rate due to abnormal network state; in addition, the selected vertical hyper-resolution model corresponds to the played video, so that the selected vertical hyper-resolution model is more suitable for processing the played video, the processing efficiency can be improved, and the energy consumption in the processing process can be reduced.
Drawings
Fig. 1 is a schematic flowchart of a display method provided in an embodiment of the present application;
fig. 2 is a schematic structural diagram of a display device provided in an embodiment of the present application;
fig. 3 is one of the hardware structure diagrams of the electronic device provided in the embodiment of the present application;
fig. 4 is a second schematic diagram of a hardware structure of an electronic device according to an embodiment of the present disclosure.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It should be understood that the data so used may be interchanged where appropriate so that embodiments of the present application can be implemented in sequences other than those illustrated or described herein, and the objects identified as "first", "second", etc. are generally in one category and do not limit the number of objects, e.g., the first photographic object may be one or more. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
The display method provided by the embodiment of the present application is described in detail below with reference to the accompanying drawings by specific embodiments and application scenarios thereof.
Referring to fig. 1, an embodiment of the present application provides a display method applied to an electronic device, and as shown in fig. 1, the method includes the following steps:
step 101, under the condition that the network state of the electronic equipment is detected to be abnormal and the code rate of the electronic equipment for playing the target video is reduced to a first code rate, determining a target vertical hyper-division model of the target video in N vertical hyper-division models preset in the electronic equipment, wherein the target vertical hyper-division model is one of the N vertical hyper-division models preset in the electronic equipment, and N is an integer greater than 1;
and 102, displaying a target image frame under the condition that the image frame of the target video is transmitted at the first code rate, wherein the target image frame is the image frame which is processed on the basis of the target vertical hyper-resolution model.
Here, under the condition that the electronic device reduces the code rate of playing a video (i.e., a target video) due to an abnormal network state, the electronic device may select a vertical hyper-separation model (i.e., a target vertical hyper-separation model) corresponding to the target video from a plurality of preset vertical hyper-separation models, process image frames of the played video through the selected vertical hyper-separation model, and play the video after the image frames are processed, so that, according to the embodiment of the present application, the electronic device may process the image frames of the video played at a low code rate through the selected vertical hyper-separation model, improve the image quality of the video played at the low code rate, and further improve the image quality of the electronic device when the network state is abnormal and the video is played at the low code rate; in addition, the selected vertical hyper-resolution model corresponds to the played video, so that the selected vertical hyper-resolution model is more suitable for processing the played video, the processing efficiency can be improved, and the energy consumption in the processing process can be reduced.
In step 101, during the process that the electronic device runs the video playing application and plays the target video, the server may detect whether a current network state of the electronic device is abnormal, and may reduce a currently used bitrate (for convenience of description, referred to as a "second bitrate" in this embodiment of the present application) for playing the video by the electronic device (i.e., an image frame of the video played by the server is transmitted to the electronic device) to the first bitrate when the network state of the electronic device is detected to be abnormal.
The server detects whether the current network state of the electronic device is abnormal, which may be that the electronic device reports the network speed or the network signal strength of the network to which the electronic device is currently connected to the server, and the server determines that the network state of the electronic device is abnormal according to whether the network speed or the network signal strength reported by the electronic device is lower than a corresponding preset threshold value, and under the condition that the network speed or the network signal strength reported by the electronic device is lower than the corresponding preset threshold value, and the like.
In addition, the above-mentioned reducing the code rate of the target video played by the electronic device to the first code rate may be that the server determines the corresponding first code rate according to the network state after the abnormality occurs in the electronic device, and adjusts the code rate of the image frame for transmitting the target video to the first code rate, where the first code rate is lower than the second code rate for playing the target video by the electronic device before the abnormality occurs in the network state.
For example, in the case that the electronic device plays a video (i.e., the target video) at a bitrate of 5Mb/s (i.e., the second bitrate), if the electronic device detects that the network speed is reduced and the reduced network speed can only satisfy the bitrate of 2Mb/s, the electronic device reduces the bitrate of playing the video from 5Mb/s to 2 Mb/s.
In this embodiment of the application, after the code rate of the target video played by the electronic device is reduced to the first code rate, the electronic device may determine, from the preset N vertical hyper-separation models, one vertical hyper-separation model corresponding to the target video as the target vertical hyper-separation model.
Each of the N vertical hyper-segmentation models is an arbitrary deep learning model capable of improving image quality, each vertical hyper-segmentation model is obtained by learning a large amount of data in advance, and different vertical hyper-segmentation models in the N vertical hyper-segmentation models are different in at least one of network parameters, network structures, processing accuracy, processing speed and the like, so that different vertical hyper-segmentation models are suitable for processing videos of different video information.
In addition, the N vertical hyper-separation models may be obtained by learning in a server and sent to the electronic device by the server for storage, or may be obtained by directly learning in the electronic device, and the learning process of the vertical hyper-separation model is well known to those skilled in the art and is not described herein again.
In this embodiment of the application, the target vertical hyper-resolution model based on the determined target video may be a target vertical hyper-resolution model corresponding to the target video determined in N vertical hyper-resolution models according to a preset rule.
The preset rule may be that a target vertical hyper-resolution model is determined based on a corresponding relationship between video information and the vertical hyper-resolution model, that is, the target vertical hyper-resolution model for determining the target video includes: and determining a vertical hyper-resolution model which has a corresponding relation with the video information of the target video in the preset N vertical hyper-resolution models as a target vertical hyper-resolution model.
It should be noted that the video information of the target video may be any information used as an index for selecting the vertical hyper-resolution model, and may be image quality (including resolution) of the target video played at the first bitrate, bitrate (i.e., the first bitrate) for playing the target video after the network state is abnormal, and video type information.
Then, in a case that the video information includes an image quality of a target video played at the first bitrate, the determining the target vertical hyper-resolution model may include: and determining a vertical hyper-resolution model corresponding to the image quality of the target video played at the first code rate as a target vertical hyper-resolution waveform in the N vertical hyper-resolution models.
For example, assuming that the electronic device is preset with a vertical hyper-parting model 1 and a vertical hyper-parting model 2, and the vertical hyper-parting model 1 is adapted to improve the image quality of a video frame of a video with a definition of FULL D1 (i.e., a resolution of 720 × 576), the vertical hyper-parting model 2 is adapted to improve the image quality of a video frame of a video with a definition of HALF D1 (i.e., a resolution of 720 × 288), and if the definition of a target video played by the electronic device at a first code rate is FULL D1, the electronic device determines that the vertical hyper-parting model 1 is a target vertical hyper-parting model; if the definition of the target video played by the electronic equipment at the first code rate is HALF D1, the electronic equipment determines that the vertical hyper-resolution model 2 is the target vertical hyper-resolution model.
Or, in a case that the video information includes the first bitrate, the determining the target vertical hyper-resolution model may include: and determining the vertical hyper-resolution model corresponding to the first code rate as a target vertical hyper-resolution model in the N vertical hyper-resolution models.
Still alternatively, in the case that the video information includes a video type of the target video, the step 102 may include:
acquiring the video type of the target video;
and determining a vertical hyper-resolution model corresponding to the video type of the target video in the N vertical hyper-resolution models as the target vertical hyper-resolution model.
Here, the electronic device may determine, according to the video type of the target video, a corresponding target vertical hyper-separation model from the preset N vertical hyper-separation models, so that the selected vertical hyper-separation model is more suitable for processing a video frame of the target video played at the first bitrate, and further improve the image quality of the video played at the low bitrate.
In this embodiment of the application, the video type of the target video may include any one of a character, an animal, a plant, a building, a landscape, an animation, and the like, and the electronic device may preset a vertical hyper-parting model corresponding to each video type, that is, the target vertical hyper-parting model is a vertical hyper-parting model having a preset corresponding relationship with the video type of the target video in the N vertical hyper-parting models.
For example, a vertical hyper-resolution model 3 and a vertical hyper-resolution model 4 are preset in the electronic device, and the vertical hyper-resolution model 3 and the video type are corresponding to a person, and the vertical hyper-resolution model 4 and the video type landscape are corresponding to each other, then if the target video is a video for shooting a person (that is, the video type of the target video is a person), the electronic device determines that the vertical hyper-resolution model 3 is the target vertical hyper-resolution model.
The video information of the target video may be video information obtained by detecting the target video by the electronic device, or may be video information sent by the server and received by the electronic device.
Specifically, in a case that the video information is the video type, the acquiring the video type of the target video may include:
under the condition that video type information of the target video is received, acquiring a video type indicated by the video type information, wherein the video type information is information sent by a server under the condition that video data of the target video is transmitted; alternatively, the first and second electrodes may be,
determining a video type of a target video based on images of target image frames, wherein the target image frames are: and the electronic equipment plays the image frames of the target video within a preset time length before the code rate for playing the target video is reduced to the first code rate.
Here, the electronic device may determine the video type of the target video according to the video type information transmitted by the server, so that the efficiency of video processing may be improved; the video type of the target video can also be determined according to the video frame of the target video, so that the mode of acquiring the video type of the target video is flexible, and different requirements can be met.
The electronic device may receive video type information sent by the server in the process of transmitting the video data of the target video in the process of playing the target video, and the electronic device may obtain the video type indicated by the video type information.
In addition, the electronic device may also acquire a partial image frame of the target video, and determine the video type of the target video according to image information in the partial image frame.
For example, in the process of playing the target video, the electronic device may acquire image frames within a preset time (e.g., 1 s) before reducing the code rate of playing the target video to the first code rate, and determine the video type of the target video according to the acquired image frames, specifically, if more than 60 image frames in the acquired 100 image frames include an animal, determine that the video type of the target video is an animal, and so on.
Of course, the electronic device determines the target vertical hyper-score model corresponding to the target video in the N vertical hyper-score models, and is not limited to determining the corresponding target vertical hyper-score model based on the video information of the target video, and may also determine the target vertical hyper-score model of the target video based on other rules.
Specifically, before determining the target vertical hyper-resolution model of the target video in the N vertical hyper-resolution models preset in the electronic device, the method further includes:
receiving a first video clip sent by a server, wherein the first video clip is a partial video clip of the target video;
the determining a target vertical hyper-resolution model of the target video in the N vertical hyper-resolution models preset in the electronic device includes:
under the condition that the electronic equipment plays the target video at a first code rate, acquiring a second video clip, wherein the second video clip is a video clip with the same content as the first video clip, and the image quality of the first video clip is higher than that of the second video clip;
determining a target vertical hyper-resolution model among the N vertical hyper-resolution models based on the first video segment and the second video segment.
Here, the electronic device may determine the target vertical hyper-separation model from the N vertical hyper-separation models according to a first video segment of the target video sent by the server and a second video segment played at the first bitrate and having the same content as the first video segment, so that the determined target vertical hyper-separation model for processing the target video played at the first bitrate is more suitable, and the image quality of the target video played at the first bitrate is further improved.
In this embodiment of the application, the first video clip is a partial video clip of the target video sent by the server before the electronic device reduces the code rate of playing the target video to the first code rate; the second video clip is a video clip which is played by the electronic equipment at the first code rate and has the same content as the first video clip, and the image quality (including resolution and the like) of the first video clip is higher than that of the second video clip.
The obtaining of the first video clip may be that, when the server receives a request for playing a target video from the electronic device, the server may transmit video data of the target video to the electronic device, and simultaneously, data sent by at least one video clip of the target video is also obtained and sent to the electronic device, where the image quality of the at least one video clip is the first image quality, and when the electronic device reduces a code rate for playing the target video to the first code rate, the electronic device may obtain, as the first video clip, a video clip of which a playing time period is located after a current time and is closest to the current time in the at least one video clip.
For example, in the process of transmitting the video data of the target video, the server may send m video segments of the target video to the electronic device, where two adjacent video segments of the m video segments are separated by a first preset time length (e.g., 5s or 10 s), the time length of each video segment is a second preset time length (e.g., 0.5s or 1 s), and the image quality is a first image quality (e.g., 1080P), and if the electronic device decreases the bitrate in the case of playing the target video for 20s, the electronic device determines, as the first video segment, a video segment of the m video segments whose playing period is after 20s, where m is an integer greater than 1.
It should be noted that, when the code rate of the played video is reduced, the reduced first code rate is no longer adapted to the image quality of the original video, and in order to ensure the smoothness of video playing, the electronic device reduces the image quality of the played video to the image quality adapted to the first code rate.
For example, when the electronic device plays a video with a resolution of 1080P (i.e. a resolution of 1920 × 1080) at a bitrate of 5Mb/s, if the electronic device reduces the bitrate of playing the video to 2Mb/s, the electronic device will reduce the image quality of the played video to the resolution FUUL D1 (i.e. a resolution of 720 × 576) when playing the video at 2 Mb/s.
The first image quality of the first video segment is higher than that of the second video segment, that is, the first image quality may be the image quality of the target video before the bitrate of playing the target video is reduced to the first bitrate; or, the preset image quality may be at least higher than the image quality of the target video played at the first bitrate.
For example, the electronic device may receive m video clips with a video definition of 1080P sent by the server during playing of the target video at a bitrate of 5Mb/s, and in a case that the electronic device reduces the bitrate of playing the target video to 2Mb/s, the electronic device determines, among the m video clips, that the definition of the first video clip is 1080P, and obtains a second video clip with the same content as the first video clip, that is, the definition of the second video clip is FUUL D1.
In the embodiment of the application, after the electronic device acquires the first video clip and the second video clip, the electronic device may compare the first video clip and the second video clip, and determine the target vertical hyper-separation model from the N vertical hyper-separation models according to a comparison result.
Specifically, the determining a target vertical hyper-segmentation model in the N vertical hyper-segmentation models based on the first video segment and the second video segment includes:
respectively processing the image frames of the second video clip based on the N vertical hyper-resolution models to obtain N video clips to be compared corresponding to the N vertical hyper-resolution models;
determining a target video clip to be compared, of the N video clips to be compared, wherein the image quality of the target video clip is closest to that of the first video clip;
and determining the vertical hyper-resolution model corresponding to the target video clip to be compared as a target vertical hyper-resolution model.
Here, the electronic device may process the second video segment through N preset vertical hyper-separation models, compare the second video segment (i.e., the video segment to be compared) processed by each vertical hyper-separation model with the first video segment, and determine the vertical hyper-separation model with the closest image quality of the processed second video segment to the image quality of the first video segment as the target vertical hyper-separation model, so that the vertical hyper-separation model with the best image quality processing effect on the video played at a low bit rate may be selected as the target vertical hyper-separation model, thereby further improving the image quality of the target video played at the low bit rate.
For example, if the vertical hyper-segmentation model 5, the vertical hyper-segmentation model 6 and the vertical hyper-segmentation model 7 are preset in the electronic device, and when the image definition of the first video segment is 1080P and the image definition of the second video segment is Hafl D1, if the image definition of the video segment processed by the vertical hyper-segmentation model 5 on the second video segment is Full D1, the image definition of the video segment processed by the vertical hyper-segmentation model 6 on the second video segment is 960P, and the image definition of the video segment processed by the vertical hyper-segmentation model 7 on the second video segment is 720P, the electronic device determines that 960P is closest to 1080P, and determines the vertical hyper-segmentation model 6 as the target vertical hyper-segmentation model.
It should be noted that, since the process of processing the video frame of the video by the vertical hyper-separation model is well known to those skilled in the art, no further description is given here.
Alternatively, the determining a target vertical hyper-segmentation model in the N vertical hyper-segmentation models based on the first video segment and the second video segment may include:
acquiring the difference degree of the image quality of the second video clip and the image quality of the first video clip;
and determining the vertical hyper-resolution model corresponding to the acquired difference degree as the target vertical hyper-resolution model in the N vertical hyper-resolution models.
Here, the electronic device may also determine, according to the difference between the image quality of the second video segment and the image quality of the first video segment, a target vertical hyper-segmentation model corresponding to the difference among the N vertical hyper-segmentation models, so that the method for determining the target vertical hyper-segmentation model is simpler, the efficiency for determining the target vertical hyper-segmentation model is improved, and the efficiency for video processing is further improved.
It should be noted that, in the N vertical hyper-segmentation models, the vertical hyper-segmentation model corresponding to the obtained difference is determined as the target vertical hyper-segmentation model, which may be a corresponding relationship between the difference and the vertical hyper-segmentation model preset in the electronic device, and the electronic device may determine the vertical hyper-segmentation model corresponding to the obtained difference as the target vertical hyper-segmentation model.
For example, if a vertical hyper-segmentation model 8 and a vertical hyper-segmentation model 9 are preset in the electronic device, the preset vertical hyper-segmentation model 8 corresponds to the difference of image quality of 1-2 preset levels (including 1080P, 960P, 720P, Full D1, Half D1, and the like which are sequentially reduced), and the vertical hyper-segmentation model 9 corresponds to the difference of image quality of 3-5 preset levels, if the definition of the first video segment is 1080P and the definition of the second video segment is 720P, the image quality of the second video segment differs from the image quality of the first video segment by two preset levels, the electronic device determines that the vertical hyper-segmentation model 8 is the target vertical hyper-segmentation model.
In step 102, after the electronic device determines the target vertical hyper-resolution model, the electronic device may process the video frame of the target video played at the first code rate through the target vertical hyper-resolution model, so as to improve the image quality of the target video played at the first code rate.
It should be noted that, in the process of playing the target video at the first code rate, the electronic device may recover the network state, for example, the electronic device moves from a poor signal area to a good signal area, and then the electronic device may adjust the code rate to a second code rate, where the second code rate is adapted to the recovered network state.
In this case, after the step 102, the method may further include:
and under the condition that the network state of the electronic equipment is detected to be recovered to be normal, the code rate of the target video played by the electronic equipment is recovered to a second code rate, and the target vertical hyper-resolution model is stopped from processing the image frames of the target video.
Here, under the condition that the network state of the electronic device is recovered to be normal and the bit rate of the target video played by the electronic device is recovered to the second bit rate, the image quality of the target video played by the electronic device can be recovered along with the recovery of the bit rate, and at this time, the electronic device stops the processing of the target vertical hyper-separation model on the image frame of the target video played at the second bit rate in time, so that the electric quantity loss caused by unnecessary image processing performed by the target vertical hyper-separation model can be saved, and the electric quantity of the electronic device is saved.
Referring to fig. 2, an embodiment of the present application provides a display device, as shown in fig. 2, the display device 200 includes:
a hyper-resolution model determining module 201, configured to determine, in N vertical hyper-resolution models preset in an electronic device, a target vertical hyper-resolution model of a target video when a network state of the electronic device is detected to be abnormal and a code rate of the target video played by the electronic device is reduced to a first code rate, where N is an integer greater than 1;
a display module 202, configured to display a target image frame when the image frame of the target video is transmitted at the first code rate.
Here, the display device 200 may process the image frames of the video played at the low bit rate through the selected vertical hyper-separation model, so as to improve the image quality of the video played at the low bit rate, and further improve the image quality of the electronic device when the video is played at the low bit rate due to the abnormal network condition; in addition, the selected vertical hyper-resolution model corresponds to the played video, so that the selected vertical hyper-resolution model is more suitable for processing the played video, the processing efficiency can be improved, and the energy consumption in the processing process can be reduced.
Optionally, the hyper-score model determining module 201 includes:
a video type obtaining unit, configured to obtain a video type of the target video;
and the first hyper-resolution model determining unit is used for determining a vertical hyper-resolution model corresponding to the video type of the target video in the N vertical hyper-resolution models as the target vertical hyper-resolution model.
Here, the display device 200 may determine a corresponding target vertical hyper-resolution model from the preset N vertical hyper-resolution models according to the video type of the target video, so that the selected vertical hyper-resolution model is more suitable for processing the video frame of the target video played at the first bitrate, and further improves the image quality of the video played at the low bitrate.
Optionally, the video type obtaining unit is specifically configured to:
under the condition that video type information of the target video is received, acquiring a video type indicated by the video type information, wherein the video type information is information sent by a server under the condition that video data of the target video is transmitted; alternatively, the first and second electrodes may be,
determining a video type of a target video based on images of target image frames, wherein the target image frames are: a partial image frame of the target video.
Here, the display apparatus 200 may determine the video type of the target video according to the video type information transmitted by the server, so that the efficiency of video processing may be improved; the video type of the target video can also be determined according to the video frame of the target video, so that the mode of acquiring the video type of the target video is flexible, and different requirements can be met.
Optionally, the apparatus 200 further includes:
the video clip receiving module is used for receiving a first video clip sent by a server, wherein the first video clip is a partial video clip of the target video;
the hyper-resolution model determination module 201 includes:
the video clip acquiring unit is used for acquiring a second video clip under the condition that the electronic equipment plays the target video at a first code rate, wherein the second video clip is a video clip with the same content as the first video clip, and the image quality of the first video clip is higher than that of the second video clip;
a second hyper-segmentation model determination unit, configured to determine a target vertical hyper-segmentation model among the N vertical hyper-segmentation models based on the first video segment and the second video segment.
Here, the display apparatus 200 may determine the target vertical hyper-separation model from the N vertical hyper-separation models according to a first video segment of the target video transmitted by the server and a second video segment which is played at the first bitrate and has the same content as the first video segment, so that the determined target vertical hyper-separation model for processing the target video played at the first bitrate is more suitable, and the image quality of the target video played at the first bitrate is further improved.
Optionally, the second hyper-resolution model determining unit includes:
a video clip processing subunit, configured to process the image frames of the second video clip based on the N vertical hyper-parting models, respectively, to obtain N video clips to be compared, where the N video clips correspond to the N vertical hyper-parting models;
a comparison subunit, configured to determine, in the N video segments to be compared, a target video segment to be compared whose image quality is closest to the image quality of the first video segment;
and the first hyper-resolution model determining subunit is used for determining the vertical hyper-resolution model corresponding to the target video clip to be compared as the target vertical hyper-resolution model.
Here, the display apparatus 200 may process the second video segment through N preset vertical hyper-separation models, compare the second video segment (i.e., the video segment to be compared) processed by each vertical hyper-separation model with the second video segment, and determine the vertical hyper-separation model with the image quality of the processed second video segment closest to the image quality of the first video segment as the target vertical hyper-separation model, so that the vertical hyper-separation model with the best image quality processing effect on the video played at a low bit rate may be selected as the target vertical hyper-separation model, thereby further improving the image quality of the target video played at the low bit rate.
Optionally, the second hyper-resolution model determining unit includes:
a difference degree obtaining subunit, configured to obtain a difference degree between the image quality of the second video segment and the image quality of the first video segment;
and the second hyper-segmentation model determining subunit is used for determining the vertical hyper-segmentation model corresponding to the acquired difference degree in the N vertical hyper-segmentation models as the target vertical hyper-segmentation model.
Here, the display device 200 may determine, according to a difference between the image quality of the second video segment and the image quality of the first video segment, a target vertical hyper-segmentation model corresponding to the difference among the N vertical hyper-segmentation models, thereby simplifying a manner of determining the target vertical hyper-segmentation model, improving efficiency of determining the target vertical hyper-segmentation model, and further improving efficiency of video processing.
Optionally, the apparatus 200 further includes:
a code rate recovery module, configured to recover, when it is detected that the network state of the electronic device is recovered to normal, the code rate of the target video played by the electronic device to a second code rate, and stop the target vertical hyper-resolution model from processing the image frames of the target video
Here, the display device 200 may stop the processing of the target vertical hyper-resolution model on the image frame of the target video played at the second code rate in time, and may save the power consumption caused by performing unnecessary image processing on the target vertical hyper-resolution model, thereby saving the power consumption of the electronic device.
The display device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The display device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.
The display device provided in the embodiment of the present application can implement each process implemented in the method embodiment of fig. 1, and is not described here again to avoid repetition.
Optionally, as shown in fig. 3, an electronic device 300 is further provided in this embodiment of the present application, and includes a processor 301, a memory 302, and a program or an instruction stored in the memory 302 and capable of running on the processor 301, where the program or the instruction is executed by the processor 301 to implement each process of the display method embodiment, and can achieve the same technical effect, and no further description is provided here to avoid repetition.
It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 4 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
The electronic device 400 includes, but is not limited to: radio unit 401, network module 402, audio output unit 403, input unit 404, sensor 405, display unit 406, user input unit 407, interface unit 408, memory 409, and processor 410.
Those skilled in the art will appreciate that the electronic device 400 may further include a power source (e.g., a battery) for supplying power to various components, and the power source may be logically connected to the processor 410 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in fig. 4 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.
Wherein, the processor 410 is configured to:
under the conditions that the network state of electronic equipment is detected to be abnormal and the code rate of a target video played by the electronic equipment is reduced to a first code rate, determining a target vertical hyper-division model of the target video in N vertical hyper-division models preset in the electronic equipment, wherein N is an integer greater than 1;
a display unit 406 for:
and under the condition that the image frames of the target video are transmitted at the first code rate, displaying the target image frames, wherein the target image frames are the image frames after the image frames of the target video are processed on the basis of the target vertical hyper-resolution model.
Here, the electronic device 400 may process the image frames of the video played at the low bit rate through the selected vertical hyper-separation model, so as to improve the image quality of the video played at the low bit rate, and further improve the image quality of the electronic device when the video is played at the low bit rate due to the abnormal network condition; in addition, the selected vertical hyper-resolution model corresponds to the played video, so that the selected vertical hyper-resolution model is more suitable for processing the played video, the processing efficiency can be improved, and the energy consumption in the processing process can be reduced.
Optionally, the processor 410 is further configured to:
acquiring the video type of the target video;
and determining a vertical hyper-resolution model corresponding to the video type of the target video in the N vertical hyper-resolution models as the target vertical hyper-resolution model.
Here, the electronic device 400 may determine, according to the video type of the target video, a corresponding target vertical hyper-separation model from the preset N vertical hyper-separation models, so that the selected vertical hyper-separation model is more suitable for processing a video frame of the target video played at the first bitrate, and further improves the image quality of the video played at the low bitrate.
Optionally, the processor 410 is further configured to:
under the condition that video type information of the target video is received, acquiring a video type indicated by the video type information, wherein the video type information is information sent by a server under the condition that video data of the target video is transmitted; alternatively, the first and second electrodes may be,
determining a video type of a target video based on images of target image frames, wherein the target image frames are: a partial image frame of the target video.
Here, the electronic device 400 may determine the video type of the target video according to the video type information transmitted by the server, so that the efficiency of video processing may be improved; the video type of the target video can also be determined according to the video frame of the target video, so that the mode of acquiring the video type of the target video is flexible, and different requirements can be met.
Optionally, the processor 410 is further configured to:
receiving a first video clip sent by a server, wherein the first video clip is a partial video clip of the target video;
under the condition that the electronic equipment plays the target video at a first code rate, acquiring a second video clip, wherein the second video clip is a video clip with the same content as the first video clip, and the image quality of the first video clip is higher than that of the second video clip;
determining a target vertical hyper-resolution model among the N vertical hyper-resolution models based on the first video segment and the second video segment.
Here, the electronic device 400 may determine the target vertical hyper-separation model from the N vertical hyper-separation models according to the first video segment of the target video sent by the server and the second video segment played at the first bitrate and having the same content as the first video segment, so that the determined target vertical hyper-separation model for processing the target video played at the first bitrate is more suitable, and the image quality of the target video played at the first bitrate is further improved.
Optionally, the processor 410 is further configured to:
respectively processing the image frames of the second video clip based on the N vertical hyper-resolution models to obtain N video clips to be compared corresponding to the N vertical hyper-resolution models;
determining a target video clip to be compared, of the N video clips to be compared, wherein the image quality of the target video clip is closest to that of the first video clip;
and determining the vertical hyper-resolution model corresponding to the target video clip to be compared as a target vertical hyper-resolution model.
Here, the electronic device 400 may process the second video segment through N preset vertical hyper-separation models, compare the second video segment (i.e., the video segment to be compared) processed by each vertical hyper-separation model with the second video segment, and determine the vertical hyper-separation model with the closest image quality of the processed second video segment to the image quality of the first video segment as the target vertical hyper-separation model, so that the vertical hyper-separation model with the best image quality processing effect on the video played at a low bit rate may be selected as the target vertical hyper-separation model, thereby further improving the image quality of the target video played at the low bit rate.
Optionally, the processor 410 is further configured to:
acquiring the difference degree of the image quality of the second video clip and the image quality of the first video clip;
and determining the vertical hyper-resolution model corresponding to the acquired difference degree as the target vertical hyper-resolution model in the N vertical hyper-resolution models.
Here, the electronic device 400 may determine, according to the difference between the image quality of the second video segment and the image quality of the first video segment, the target vertical hyper-segmentation model corresponding to the difference among the N vertical hyper-segmentation models, so that the method for determining the target vertical hyper-segmentation model is simpler, the efficiency of determining the target vertical hyper-segmentation model is improved, and the efficiency of video processing is further improved.
Optionally, the processor 410 is further configured to:
and under the condition that the network state of the electronic equipment is detected to be recovered to be normal, the code rate of the target video played by the electronic equipment is recovered to a second code rate, and the target vertical hyper-resolution model is stopped from processing the image frames of the target video.
Here, the electronic device 400 may stop the processing of the target vertical hyper-resolution model on the image frame of the target video played at the second code rate in time, and may save the power consumption caused by performing unnecessary image processing on the target vertical hyper-resolution model, thereby saving the power consumption of the electronic device.
It should be understood that in the embodiment of the present application, the input Unit 404 may include a Graphics Processing Unit (GPU) 4041 and a microphone 4042, and the Graphics processor 4041 processes image data of a still picture or a video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 406 may include a display panel 4061, and the display panel 4061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 407 includes a touch panel 4071 and other input devices 4072. A touch panel 4071, also referred to as a touch screen. The touch panel 4071 may include two parts, a touch detection device and a touch controller. Other input devices 4072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 409 may be used to store software programs as well as various data including, but not limited to, application programs and an operating system. The processor 410 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 410.
The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements the processes of the display method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.
The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the display method embodiment, and can achieve the same technical effect, and the details are not repeated here to avoid repetition.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (10)

1. A display method, comprising:
under the conditions that the network state of electronic equipment is detected to be abnormal and the code rate of a target video played by the electronic equipment is reduced to a first code rate, determining a target vertical hyper-division model of the target video in N vertical hyper-division models preset in the electronic equipment, wherein N is an integer greater than 1;
and under the condition that the image frames of the target video are transmitted at the first code rate, displaying the target image frames, wherein the target image frames are the image frames after the image frames of the target video are processed on the basis of the target vertical hyper-resolution model.
2. The method according to claim 1, wherein the determining a target vertical hyper-resolution model of the target video from among N vertical hyper-resolution models preset in the electronic device comprises:
acquiring the video type of the target video;
and determining a vertical hyper-resolution model corresponding to the video type of the target video in the N vertical hyper-resolution models as the target vertical hyper-resolution model.
3. The method of claim 2, wherein the obtaining the video type of the target video comprises:
under the condition that video type information of the target video is received, acquiring a video type indicated by the video type information, wherein the video type information is information sent by a server under the condition that video data of the target video is transmitted; alternatively, the first and second electrodes may be,
determining a video type of the target video based on images of partial image frames of the target video.
4. The method according to claim 1, wherein before determining the target vertical hyper-resolution model of the target video in the N vertical hyper-resolution models preset in the electronic device, the method further comprises:
receiving a first video clip sent by a server, wherein the first video clip is a partial video clip of the target video;
the determining a target vertical hyper-resolution model of the target video in the N vertical hyper-resolution models preset in the electronic device includes:
under the condition that the electronic equipment plays the target video at a first code rate, acquiring a second video clip, wherein the second video clip is a video clip with the same content as the first video clip, and the image quality of the first video clip is higher than that of the second video clip;
determining a target vertical hyper-resolution model among the N vertical hyper-resolution models based on the first video segment and the second video segment.
5. The method of claim 4, wherein determining a target vertical hyper-score model among the N vertical hyper-score models based on the first video segment and the second video segment comprises:
respectively processing the image frames of the second video clip based on the N vertical hyper-resolution models to obtain N video clips to be compared corresponding to the N vertical hyper-resolution models;
determining a target video clip to be compared, of the N video clips to be compared, wherein the image quality of the target video clip is closest to that of the first video clip;
and determining the vertical hyper-resolution model corresponding to the target video clip to be compared as a target vertical hyper-resolution model.
6. The method of claim 4, wherein determining a target vertical hyper-score model among the N vertical hyper-score models based on the first video segment and the second video segment comprises:
acquiring the difference degree of the image quality of the second video clip and the image quality of the first video clip;
and determining the vertical hyper-resolution model corresponding to the acquired difference degree as the target vertical hyper-resolution model in the N vertical hyper-resolution models.
7. The method of claim 1, wherein after displaying the target image frame if the image frame of the target video is transmitted at the first bitrate, further comprising:
and under the condition that the network state of the electronic equipment is detected to be recovered to be normal, the code rate of the target video played by the electronic equipment is recovered to a second code rate, and the target vertical hyper-resolution model is stopped from processing the image frames of the target video.
8. A display device, comprising:
the system comprises a hyper-division model determining module, a hyper-division model determining module and a hyper-division model determining module, wherein the hyper-division model determining module is used for determining a target vertical hyper-division model of a target video in N vertical hyper-division models preset in electronic equipment under the conditions that the network state of the electronic equipment is detected to be abnormal and the code rate of the target video played by the electronic equipment is reduced to a first code rate, and N is an integer greater than 1;
and the display module is used for displaying the target image frame under the condition of transmitting the image frame of the target video at the first code rate.
9. The apparatus of claim 8, wherein the hyper-resolution model determination module comprises:
a video type obtaining unit, configured to obtain a video type of the target video;
and the first hyper-resolution model determining unit is used for determining a vertical hyper-resolution model corresponding to the video type of the target video in the N vertical hyper-resolution models as the target vertical hyper-resolution model.
10. The apparatus of claim 8, further comprising:
the video clip receiving module is used for receiving a first video clip sent by a server, wherein the first video clip is a partial video clip of the target video;
the hyper-resolution model determination module comprises:
the video clip acquiring unit is used for acquiring a second video clip under the condition that the electronic equipment plays the target video at a first code rate, wherein the second video clip is a video clip with the same content as the first video clip, and the image quality of the first video clip is higher than that of the second video clip;
a second hyper-segmentation model determination unit, configured to determine a target vertical hyper-segmentation model among the N vertical hyper-segmentation models based on the first video segment and the second video segment.
CN202110113902.6A 2021-01-27 2021-01-27 Display method and device Active CN112910875B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202110113902.6A CN112910875B (en) 2021-01-27 2021-01-27 Display method and device
PCT/CN2022/073465 WO2022161310A1 (en) 2021-01-27 2022-01-24 Display method and apparatus, and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110113902.6A CN112910875B (en) 2021-01-27 2021-01-27 Display method and device

Publications (2)

Publication Number Publication Date
CN112910875A true CN112910875A (en) 2021-06-04
CN112910875B CN112910875B (en) 2023-06-30

Family

ID=76119195

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110113902.6A Active CN112910875B (en) 2021-01-27 2021-01-27 Display method and device

Country Status (2)

Country Link
CN (1) CN112910875B (en)
WO (1) WO2022161310A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022161310A1 (en) * 2021-01-27 2022-08-04 维沃移动通信有限公司 Display method and apparatus, and electronic device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100027914A1 (en) * 2008-08-04 2010-02-04 Kabushiki Kaisha Toshiba Image Processor and Image Processing Method
CN107305684A (en) * 2016-04-18 2017-10-31 瑞萨电子株式会社 Image processing system, image processing method and picture transmitter device
CN109862370A (en) * 2017-11-30 2019-06-07 北京大学 Video super-resolution processing method and processing device
CN110958469A (en) * 2019-12-13 2020-04-03 联想(北京)有限公司 Video processing method and device, electronic equipment and storage medium
CN111667406A (en) * 2020-04-24 2020-09-15 东北大学 Video image super-resolution reconstruction method based on time domain correlation
CN111784624A (en) * 2019-04-02 2020-10-16 北京沃东天骏信息技术有限公司 Target detection method, device, equipment and computer readable storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190045248A1 (en) * 2018-05-31 2019-02-07 Intel Corporation Super resolution identifier mechanism
CN109688465B (en) * 2018-11-27 2020-12-29 Oppo广东移动通信有限公司 Video enhancement control method and device and electronic equipment
KR20190117416A (en) * 2019-09-26 2019-10-16 엘지전자 주식회사 Method and apparatus for enhancing video frame resolution
CN112910875B (en) * 2021-01-27 2023-06-30 维沃移动通信有限公司 Display method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100027914A1 (en) * 2008-08-04 2010-02-04 Kabushiki Kaisha Toshiba Image Processor and Image Processing Method
CN107305684A (en) * 2016-04-18 2017-10-31 瑞萨电子株式会社 Image processing system, image processing method and picture transmitter device
CN109862370A (en) * 2017-11-30 2019-06-07 北京大学 Video super-resolution processing method and processing device
CN111784624A (en) * 2019-04-02 2020-10-16 北京沃东天骏信息技术有限公司 Target detection method, device, equipment and computer readable storage medium
CN110958469A (en) * 2019-12-13 2020-04-03 联想(北京)有限公司 Video processing method and device, electronic equipment and storage medium
CN111667406A (en) * 2020-04-24 2020-09-15 东北大学 Video image super-resolution reconstruction method based on time domain correlation

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022161310A1 (en) * 2021-01-27 2022-08-04 维沃移动通信有限公司 Display method and apparatus, and electronic device

Also Published As

Publication number Publication date
WO2022161310A1 (en) 2022-08-04
CN112910875B (en) 2023-06-30

Similar Documents

Publication Publication Date Title
CN113360238A (en) Message processing method and device, electronic equipment and storage medium
CN108710458B (en) Split screen control method and terminal equipment
CN112004117B (en) Video playing method and device
CN111816139B (en) Screen refresh rate switching method and electronic equipment
CN107728877B (en) Application recommendation method and mobile terminal
CN111212316B (en) Video generation method and electronic equipment
CN111988654A (en) Video data alignment method and device and electronic equipment
CN112565909B (en) Video playing method and device, electronic equipment and readable storage medium
CN112910875B (en) Display method and device
CN112291480B (en) Tracking focusing method, tracking focusing device, electronic device and readable storage medium
CN102737383A (en) Camera movement analyzing method and device in video
CN112367486B (en) Video processing method and device
WO2023125553A1 (en) Frame interpolation method and apparatus and electronic device
CN112199149A (en) Interface rendering method and device and electronic equipment
CN111050223A (en) Bullet screen information processing method and electronic equipment
WO2020124454A1 (en) Font switching method and related product
CN113271494B (en) Video frame processing method and device and electronic equipment
CN114356568A (en) Information processing method, information processing device, electronic equipment and storage medium
CN115543137A (en) Video playing method and device
CN111858395B (en) Data management method and device
CN112347982A (en) Video-based unsupervised difficult case data mining method, device, medium and equipment
CN112887781A (en) Subtitle processing method and device
CN112511890A (en) Video image processing method and device and electronic equipment
CN114337872B (en) Network signal measurement method and device
CN115103054B (en) Information processing method, device, electronic equipment and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant