WO2020108092A1 - 视频处理方法、装置、电子设备及存储介质 - Google Patents

视频处理方法、装置、电子设备及存储介质 Download PDF

Info

Publication number
WO2020108092A1
WO2020108092A1 PCT/CN2019/109856 CN2019109856W WO2020108092A1 WO 2020108092 A1 WO2020108092 A1 WO 2020108092A1 CN 2019109856 W CN2019109856 W CN 2019109856W WO 2020108092 A1 WO2020108092 A1 WO 2020108092A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
enhancement processing
enhancement
processing method
frames
Prior art date
Application number
PCT/CN2019/109856
Other languages
English (en)
French (fr)
Inventor
胡小朋
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Publication of WO2020108092A1 publication Critical patent/WO2020108092A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration

Definitions

  • the present application relates to the technical field of electronic equipment, and more specifically, to a video processing method, device, electronic equipment, and storage medium.
  • the present application proposes a video processing method, device, electronic device, and storage medium to improve the above problems.
  • an embodiment of the present application provides a video processing method, which is applied to an electronic device.
  • the method includes: receiving an enhanced instruction for enhancing low power consumption of a video; and selecting power consumption for at least a part of video frames of the video A second enhancement processing method that is lower than the first enhancement processing method, where the first enhancement processing method is an enhancement processing method corresponding to non-low-power enhancement of the video; the video frame of the video passes the corresponding enhancement processing method Display enhancement processing is performed, which improves the quality of the video frame by adjusting the image parameters of the video frame.
  • an embodiment of the present application provides a video processing apparatus, which is applied to an electronic device.
  • the apparatus includes: an instruction receiving module for receiving an enhanced instruction for enhancing low power consumption of a video; a selection module for Selecting at least part of the video frames of the video a second enhancement processing mode with lower power consumption than the first enhancement processing mode, wherein the first enhancement processing mode is an enhancement processing mode corresponding to the non-low power enhancement of the video;
  • the processing module is configured to perform display enhancement processing on the video frame of the video through a corresponding enhancement processing method, and the display enhancement processing improves the image quality of the video frame by adjusting image parameters of the video frame.
  • an embodiment of the present application provides an electronic device, including: one or more processors; a memory; and one or more programs. Wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs are configured to perform the above method.
  • an embodiment of the present application provides a computer-readable storage medium, in which a program code is stored, and the program code can be called by a processor to execute the above method.
  • FIG. 1 shows a schematic flowchart of video playback provided by an embodiment of the present application.
  • FIG. 2 shows a flowchart of a video processing method provided by an embodiment of the present application.
  • FIG. 3 shows a display schematic diagram of a video enhancement switch in a video processing method provided by an embodiment of the present application.
  • FIG. 4 shows another display schematic diagram of the video enhancement switch in the video processing method provided by an embodiment of the present application.
  • FIG. 5 shows another schematic diagram of the video enhancement switch in the video processing method provided by an embodiment of the present application.
  • FIG. 6 shows a flowchart of a video processing method provided by another embodiment of the present application.
  • FIG. 7 shows a functional block diagram of a video processing device provided by an embodiment of the present application.
  • FIG. 8 shows a structural block diagram of an electronic device provided by an embodiment of the present application.
  • 9 is a storage unit for storing or carrying program code for implementing a video processing method according to an embodiment of the present application.
  • FIG. 1 shows a video playback process.
  • the next job is to analyze the audio and video data.
  • General video files are composed of video stream and audio stream. Different video formats have different audio and video packaging formats.
  • the process of synthesizing audio and video streams into files is called muxer, while the process of separating audio and video streams from media files is called demuxer.
  • muxer the process of synthesizing audio and video streams into files
  • demuxer To play a video file, you need to separate the audio stream and the video stream from the file stream and decode them separately.
  • the decoded video frame can be directly rendered, and the corresponding audio can be sent to the buffer of the audio output device for playback.
  • the video Rendering and audio playback timestamps need to be controlled for synchronization.
  • each video frame is each frame image corresponding to the video.
  • video decoding may include hard decoding and soft decoding.
  • hard decoding a part of the video data that is originally handed over to the Central Processing Unit (CPU) for processing is handed over to the graphics processor (Graphics Processing Unit, GPU) To do it, and the GPU's parallel computing capability is much higher than that of the CPU, which can greatly reduce the load on the CPU. After the CPU usage is reduced, you can run some other programs at the same time.
  • GPU Graphics Processing Unit
  • i5 2320 or any quad-core processor of AMD, it can perform both hard decoding and soft decoding.
  • the multimedia framework obtains the video file to be played by the client through an API interface with the client, and hands it to the video codec (Video Decode).
  • Media is the multimedia framework in the Android system
  • MediaPlayer, MediaPlayerService and Stagefrightplayer constitute the basic framework of Android multimedia.
  • the multimedia framework part adopts the C/S structure.
  • MediaPlayer serves as the client terminal of the C/S structure.
  • MediaPlayerService and Stagefrightplayer serve as the server terminal of the C/S structure. They assume the responsibility of playing multimedia files.
  • Video decoder Video Decode is a super decoder that integrates the most commonly used audio and video decoding and playback for decoding video data.
  • soft decoding that is, let the CPU decode the video through software.
  • Hard decoding means that the video decoding task can be completed independently through a dedicated daughter card device without resorting to the CPU.
  • the decoded video data will be sent to the layer transfer module (SurfaceFlinger), as shown in Figure 1, the hard decoded video data is sent to the video driver SurfaceFlinger.
  • SurfaceFlinger renders and synthesizes the decoded video data and displays it on the display.
  • SurfaceFlinger is an independent Service, which receives all Window’s Surface as input, calculates the position of each Surface in the final composite image according to ZOrder, transparency, size, position and other parameters, and then hands it to HWComposer or OpenGL to generate the final The display buffer is then displayed on a specific display device.
  • the CPU decodes the video data to SurfaceFlinger for rendering and synthesis
  • hard decoding is decoded by the GPU and then rendered and synthesized by SurfaceFlinger.
  • the SurfaceFlinger will call the GPU to render and synthesize the image and display it on the display.
  • display enhancement processing may be performed on the video augmentation.
  • the display enhancement processing may be performed after decoding, and then rendered and synthesized after the display enhancement processing and displayed on the display screen.
  • the display enhancement process improves the image quality of the video frame by adjusting the image parameters of the video frame, improves the display effect of the video, and obtains a better viewing experience.
  • the image quality of the video frame can include parameters such as sharpness, sharpness, saturation, detail, lens distortion, color, resolution, color gamut range, and purity.
  • each enhancement processing method includes a corresponding image processing algorithm for performing image processing on the video frame to adjust the image of the video frame Parameters to improve the quality of the video frame.
  • the display enhancement needs to occupy more operating resources of the electronic device. After the display enhancement process is turned on, the energy consumption of the electronic device is too high, which reduces the life time of the electronic device, and may also cause the electronic device temperature to be too high. Therefore, in some cases, such as low battery power, users want to make the electronic device have a longer use time before the next charge, etc., it is necessary to enable the electronic device to have lower power consumption while enhancing the video processing . Therefore, the inventor proposes a video processing method, device, electronic device, and storage medium according to an embodiment of the present application, and selects an enhanced processing method with lower power consumption for at least part of video frames of a video to reduce processing power consumption during video enhancement .
  • the video processing method, device, electronic device, and storage medium provided in the embodiments of the present application will be described in detail below through specific embodiments.
  • FIG. 2 shows a video processing method provided by an embodiment of the present application.
  • the video processing method is used to adopt an enhanced processing mode corresponding to low power consumption for at least a part of video frames to reduce power consumption during video processing.
  • the video processing method is applied to the video processing device 300 shown in FIG. 7 and the electronic device 400 (FIG. 8) configured with the video processing device 300.
  • the specific process of this embodiment will be described below using an electronic device as an example.
  • the electronic device applied in this embodiment may be a smartphone, tablet computer, computer, wearable electronic device, vehicle-mounted device, gateway, etc. Devices with video processing capabilities are not specifically limited here.
  • the method includes:
  • Step S110 Receive an enhanced instruction for enhancing low power consumption of the video.
  • the electronic device can display the acquired video data after decoding, enhancement processing, and rendering synthesis.
  • the electronic device may obtain video data from the server, may obtain video data locally, or may obtain video data from other electronic devices.
  • the video data when the video data is acquired from the server by the electronic device, then the video data may be downloaded by the electronic device from the server, or the electronic device is acquired online from the server.
  • the video data may be video data downloaded by the electronic device through the installed video playback software or obtained online in the video playback software.
  • the server may be a cloud server.
  • the video data When the video data is acquired locally from the electronic device, the video data may be pre-downloaded by the electronic device and stored in the local storage.
  • the video data when the video data is acquired by the electronic device from other electronic devices, the video data can be transmitted from the other electronic devices to the electronic device through a wireless communication protocol, for example, through the WLAN protocol, Bluetooth protocol, ZigBee protocol, or WiFi protocol, etc. It is transmitted from other electronic devices to the electronic device through a data network, for example, a 2G network, a 3G network, or a 4G network, etc., which is not limited herein.
  • the electronic device obtains the video data, and then decodes, renders and synthesizes the video data, and then plays it through the display.
  • the video When playing a video, if an enhanced instruction for low-power consumption enhancement of the video is received, the video can be enhanced with lower power consumption to improve the display quality of the video while maintaining the lowest possible power consumption.
  • the enhanced instruction with low power consumption enhancement may be generated by the electronic device when the video is turned on as the received enhanced instruction with low power consumption enhancement.
  • the default setting of an application that plays a video is to enable low power consumption enhancement, and then when the video is turned on, an enhanced instruction for low power consumption enhancement is generated.
  • the application program that plays the video was started with the enhanced low-power-consumption enhanced instruction when it was previously closed, the enhanced low-power-consumption enhanced instruction is started when the application program is opened again.
  • the video was turned on when the video was closed the last time it is an enhanced instruction for enhancing low power consumption, and when the video is turned on again, an enhanced instruction for enhancing the power consumption of the video is generated.
  • the enhanced instruction with enhanced low power consumption may also be a user trigger received during video playback.
  • corresponding video settings have different levels of video enhancement, and different levels of video enhancement correspond to different power consumption.
  • the highest level of video enhancement has the highest power consumption.
  • the lower the level of video enhancement the lower the power consumption.
  • the video enhancement processing with higher power consumption usually has better enhancement effect. Therefore, the enhancement effects corresponding to different levels of video enhancement are different. If the user turns on video enhancement other than the highest level of video enhancement, the enhancement instruction received for low power consumption enhancement is received.
  • setting a high-level video enhancement switch and a low-level video enhancement switch correspond to high-level video enhancement and low-level video enhancement, respectively.
  • the power consumption of high-level video enhancement is higher than that of low-level video enhancement Power consumption.
  • a trigger confirmation for a low-level enhancement switch is received, as shown in FIG. 4, an enhanced instruction with low power consumption enhancement is received.
  • a video enhancement switch that can switch between high level and low level is set. If the user switches the video enhancement switch to low level enhancement as shown in FIG. 5, an enhancement instruction for low power consumption enhancement is received.
  • the video enhancement switch can be hidden. When a touch such as clicking on the video is received, the video enhancement switch is displayed, and the video enhancement switch is placed in a controllable state. When the video does not receive the user's touch operation for a certain period of time, hide the video enhancement switch again.
  • the enhancement processing is non-low power enhancement processing, that is, the enhancement processing is high power consumption enhancement processing. If it is determined that the power of the electronic device is less than the target power, it is determined that an enhanced instruction to enhance low power consumption of the video is received.
  • the specific power value of the target power is not limited in the embodiments of the present application, and may be 30%, 20%, etc. of the total power of the electronic device.
  • the target power can also be stored in the electronic device after being set by the user.
  • Step S120 Select at least part of the video frames of the video a second enhancement processing mode with lower power consumption than the first enhancement processing mode, where the first enhancement processing mode is corresponding to the non-low power enhancement of the video Enhanced processing.
  • an enhanced processing method with low power consumption is selected for at least part of the video frames of the video.
  • the corresponding enhancement processing method is the first enhancement processing method, and then a second enhancement processing method is selected for at least part of the video frames, and the power consumption of the second enhancement processing method is lower than that of the first Enhanced processing.
  • At least part of the video frames may be all video frames, that is to say, a second enhancement processing mode with lower power consumption than the first enhancement processing mode may be selected for all video frames of the video frames.
  • the at least part of the video frame may also be a part of the video frame of the video.
  • the at least part of the video frames may be at least part of the video frames of the video frames that have not yet been played.
  • Step S130 Display enhancement processing is performed on the video frame of the video through the corresponding enhancement processing method.
  • the display enhancement process improves the image quality of the video frame by adjusting the image parameters of the video frame.
  • the corresponding enhancement processing method is adopted.
  • the video frame of the second enhancement processing mode is selected, and the enhancement processing is performed by the second enhancement processing mode, and the image parameters of the video frame are adjusted by the image processing algorithm included in the second enhancement processing mode, thereby adjusting the quality of the video frame.
  • Related parameters to improve video quality are adopted.
  • the enhanced processing method is an enhanced processing method corresponding to the non-low power consumption enhancement of the video, so that the enhanced power consumption of the video is reduced compared to the non-low power consumption enhancement.
  • the present application also provides an embodiment. Compared with the foregoing embodiment, the embodiment specifically describes a part of implementation manners in which at least a part of video frames are selected for an enhanced processing manner. Specifically, please refer to FIG. 6, the method includes:
  • Step S210 Receive an enhanced instruction for enhancing low power consumption of the video.
  • step S210 For the specific implementation of step S210, reference may be made to step S110, which will not be repeated here.
  • Step S220 Select a first enhancement processing method for a part of video frames of the video, and select a second enhancement processing method for the remaining part of video frames.
  • video enhancement if some video frames use an enhanced processing method with higher power consumption but better enhancement effects, and some video frames use an enhanced processing method with lower power consumption but less enhanced effects, due to the switching speed of the video frames Soon, the user's perception of the slightly worse enhancement method is not obvious. Therefore, a first enhancement processing method may be selected for part of the video frames of the video to obtain a better processing effect, and a second enhancement processing method may be selected for the remaining part of the video frames to reduce the power consumption of the enhancement processing.
  • the second enhancement processing method may be selected for video frames with a preset number of frames every interval, and the first enhancement processing method may be selected for the remaining video frames.
  • the second enhancement processing method is selected for each video frame with one video frame interval; for another example, the second enhancement processing method is selected for the video frame with two video frame intervals.
  • the spaced video frames adopt the first enhancement processing method.
  • the specific value of the preset number of frames is not limited in the embodiment of the present application.
  • the determination may be made according to the level of video enhancement.
  • the higher the level of video enhancement of the second enhancement processor the larger the number of preset frames.
  • the level of video enhancement includes a high level, a medium level, and a low level.
  • the high level is an enhancement process for non-low power consumption enhancement.
  • the preset frame number corresponding to the medium-level video enhancement is greater than the preset frame number corresponding to the low-level video enhancement.
  • the medium-level video frame selects the second enhancement processing method for every three video frames, the video frames taken by the interval The first enhancement processing mode; the video frames of every low-level video frame select the second enhancement processing mode, and the spaced video frames adopt the first enhancement processing mode.
  • the second enhanced processing method may be a processing method
  • the first enhanced processing method may be a processing method.
  • the enhancement processing may start from the first frame of the video frame that has not been played and has not been enhanced when the enhanced instruction for low power consumption enhancement is received, and the selection of subsequent video frame enhancement processing methods is in turn Yes, the second enhancement processing method is selected for one video frame, the first enhancement processing method is selected for the next preset video frame, and the second enhancement processing method is selected for the next video frame, and then the next pre-processing
  • the first enhancement processing method is selected for the video frame with a set number of frames, and so on.
  • this embodiment uses the preset frame number as one for description.
  • the video video frame selection enhancement processing method is that the first enhancement processing method and the second enhancement processing method alternately correspond to the sequentially arranged video frames, that is, the sequentially arranged video of the video
  • the enhancement processing method for frame selection is that one frame selects the first enhancement processing method, the next frame selects the second enhancement processing method, the next frame selects the first enhancement processing method, and the next frame selects the second enhancement processing method. And so on.
  • the video frames of a video are sequentially numbered 1, 2, 3, and 4 up to n, where n is a positive integer. It may be that the odd-numbered video frames select the first enhancement processing method and the even-numbered video frames select the second processing method; or the even-numbered video frames select the first enhancement processing method and the odd-numbered video frames select the second processing method.
  • the second enhancement processing method may further include multiple processing methods, and each processing method may be defined as a sub-enhancement processing method, and different sub-enhancement processing methods are used to perform enhancement processing on different video frames. Specifically, when the enhancement processing method is selected, for each video frame in which the video is sequentially arranged, the sub-enhancement processing methods of the first enhancement processing method and the second enhancement processing method may be cross-selected.
  • the sub-enhancement processing method of the second enhancement processing method is k
  • the video frames are divided into a group of n frames, that is, the video frames from the first frame to the nth frame are a group, and the n+1 to the nth 2n is a group, 2n+1 to 3n are a group, and so on, n is greater than or equal to k+1.
  • each video frame can select the corresponding enhancement processing method from the k-seed enhancement processing method of the first enhancement processing method and the second enhancement processing method, and the first enhancement processing method and the second enhancement processing method
  • the k-seed enhancement methods of the method are all selected.
  • the selection rule of each group of video frames can be consistent, and the selection rule of the enhanced processing method of each group of video frames can be consistent; it can also be inconsistent.
  • the first and second frames in a group of video frames can select the first enhancement processing method, the third and For the fourth video frame, two sub-enhanced processing modes of the second enhanced processing mode can be selected respectively.
  • the sub-enhancement processing methods of the second enhancement processing method are k types, and the enhancement processing method may be selected as: the first frame video frame selects the first enhancement processing mode, and the second to k+1th frames select the second enhancement processing respectively Sub-enhancement processing modes of the mode; the k+2 frame video frame selects the first enhancement processing mode, and the k+3 to k+3+k-1 frames select the sub-enhancement processing modes of the second enhancement processing mode, And so on.
  • the present application also provides an implementation manner.
  • the second enhancement processing manner may also include a processing manner that does not perform enhancement processing on the video frame.
  • the processing method for the video frame includes the non-low power consumption enhancement corresponding to the first enhancement processing method and Not enhanced.
  • a video frame with a preset number of frames per interval selects the second enhancement processing method. If the preset frame number is 1, then one frame of video frames per interval is not subject to enhancement processing, and the interval between video frames passes the first enhancement
  • the processing method performs enhancement processing, that is to say, the enhancement processing of video frames is performed at intervals, one frame of video frames is enhanced, and one frame of video frames is not enhanced, which is performed sequentially. If the preset number of frames is not 1, then one of the video frames in sequence is not enhanced, the adjacent preset number of video frames are enhanced, and the next video frame is not enhanced. Next Enhancement processing is performed on adjacent preset frames, and so on.
  • the second enhancement processing method includes multiple sub-enhancement processing methods, one of the multiple sub-enhancement processing methods may not be enhanced.
  • the image processing algorithm specifically included in the first processing enhancement processing mode and the second enhancement processing mode is not limited.
  • the algorithm complexity of the first enhanced processing method is higher than that of the second enhanced processing method.
  • the processing effect of the first enhanced processing method is better than the processing effect of the second enhanced processing method, the first enhanced The power consumption of the processing method is also higher than that of the second enhanced processing method.
  • the first enhancement processing method includes more image processing algorithms to better improve the video quality
  • the second enhancement processing method includes fewer image processing algorithms than the first enhancement processing method.
  • the enhancement processing of the first enhancement processing method includes three or two of the denoising algorithm, saturation enhancement, and contrast enhancement algorithm
  • the enhancement processing value of the second enhancement processing method includes the denoising algorithm, saturation enhancement, and contrast.
  • One of the enhanced algorithms such as the denoising algorithm.
  • the enhancement processing of the first enhancement processing method includes three of the denoising algorithm, saturation enhancement and contrast enhancement algorithm
  • the enhancement processing value of the second enhancement processing method includes the denoising algorithm, saturation enhancement and contrast enhancement algorithm Of the two.
  • the denoising algorithm can be an image processing algorithm that preserves the details of the image edge and other details, such as a guided filtering algorithm based on the principle of local spatial continuity, and the bilateral filter of the filter that takes into account the difference in pixel space and intensity is fully utilized.
  • NLM Non-Local Means
  • the contrast enhancement algorithm may be an adaptive contrast enhancement algorithm (ACE, Adaptive Contrast Enhancement), histogram equalization (Histogram Equalization) and histogram matching (Histogram Matching), etc.
  • the saturation enhancement algorithm can be to increase the color components in the video frame.
  • the video frame when the video frame is represented by RGB, increase the RGB color channels separately; or adjust the brightness and saturation in the RGB color space is not very intuitive, and HSL color
  • the mode can intuitively express the saturation of each pixel.
  • the RGB value of the pixel of the image can then be converted to the HSL color mode to obtain the saturation S (Saturation), and the saturation can be increased by adjusting the value of S.
  • the adjusted video frame is switched from HSL color mode to RGB color mode for display.
  • the number of iterations of the algorithm in the first enhanced processing mode may be greater than the number of iterations of the enhanced processing algorithm in the second enhanced processing mode.
  • the corresponding first enhancement processing method has better processing effect on the image quality of the video frame than the second enhancement processing method, such as higher definition, higher saturation, and stronger contrast.
  • the power consumption of the corresponding first enhancement processing method is also higher.
  • a more complex algorithm is used in the first enhancement processing mode.
  • the denoising image processing algorithm in the second enhancement processing method, a guided filtering algorithm based on the principle of local space continuity, NLM (Non-Local Means) image denoising algorithm and other conventional denoising algorithms can be used.
  • NLM Non-Local Means
  • the conventional denoising algorithm may still cause some details to be lost in the image.
  • the first enhancement processing method may be a more complex denoising algorithm with better denoising effect. For example, only the parts other than the edge detail features in the video frame are denoised by the denoising algorithm, but not the edge features in the video frame. Processing to preserve the good edge detail features of the image.
  • the image processing algorithm for denoising in the first enhancement processing mode may be that the edge part in the video frame is first obtained through an edge detection algorithm.
  • the specific edge detection algorithm is not limited in the embodiment of the present application, for example, it may be differential edge detection, Reborts operator, Sobel operator, Prewitt operator, Roberts cross-edge detection (Roberts Cross operator), Kirsch operator and Laplace operator, etc.
  • the video frame can be cropped into a first part and a second part through a cropping algorithm, the first part is the edge part, and the second part is other than the edge part section.
  • the specific cropping algorithm is not limited in the embodiment of the present application. Any cropping algorithm that can crop the edge detected by the edge from the video frame so that the video frame is cropped into the first part and the second part, such as Cohen- Sutherland cropping algorithm. Or directly extract the pixels represented as edges in the edge detection from the video frame according to the edge detection result, so that the video frame is divided into the first part and the second part.
  • the specific denoising algorithm is not limited in the embodiment of the present application, and may be any image processing algorithm that satisfies the denoising process of the video frame, such as the above-mentioned guided filtering algorithm, bilateral filtering algorithm, NLM algorithm, etc., or other De-noising algorithms, such as neighborhood-domain averaging, median filtering, low-pass filtering and other spatial domain filtering denoising algorithms, Fourier transform, Walsh-Hadamard transform, cosine transform, KL transform and wavelet transform and other transform domain filtering denoising Algorithms, etc.
  • the first part and the denoised second part are combined into an image, which is used as the video frame after the video frame enhancement processing.
  • the first part and the second part are combined into a frame image, so that the first part in the combined image corresponds to the position of the first part in the cropped video frame; the second part in the combined image corresponds to Is the position of the second part of the clipped video frame.
  • the first part is the edge feature in the image
  • the second part is the part other than the edge feature.
  • the complexity of the denoising algorithm is higher than that of the conventional denoising algorithm, and the power consumption is greater.
  • the non-edge details Partial denoising so as to avoid the denoising algorithm to remove the edge details of the image, the denoising effect is better.
  • the edge detail part and the denoised non-edge detail part are combined into a video frame to form an enhanced video frame, so that the edge noise in the video enhanced video frame will not be amplified and removed Noise in video frames.
  • a conventional sharpening processing method may be used in the second enhancement processing method, such as gradient sharpening or Laplace operator. Sharpening the video frame can improve the clarity of the video frame, but sharpening increases the noise, amplifies the edge noise, and makes the non-video information at the edge more and the edge details more blurred.
  • the first enhancement processing method can process the video frame by a processing algorithm with better sharpening effect and less noise.
  • the sharpening algorithm in the first enhancement processing method may be: first obtain an edge part in the video frame through an edge detection algorithm. Then, the video frame is cropped into a first part and a second part, the first part is the edge part, and the second part is a part other than the edge part. The second part is sharpened by an image sharpening algorithm.
  • the specific sharpening algorithm is not limited in the embodiment of the present application. For example, it may be gradient sharpening, Laplacian, and so on. The first part and the sharpened second part are combined into an image as the enhanced video frame of the video frame.
  • the first enhancement processing method uses a processing algorithm that generates less noise than the second enhancement processing method for sharpening processing. However, correspondingly, the power consumption during the processing of the first enhancement processing method is higher than that of the second enhancement processing method.
  • the image processing algorithm with a higher algorithm complexity adopted in the specific first enhancement processing method to enhance the video frame is not enumerated in the embodiments of the present application.
  • the first enhanced processing method obtains better video processing effects through a higher complexity algorithm, but has higher power consumption than the second enhanced processing algorithm.
  • Step S230 Perform display enhancement processing on the video frame of the video through the corresponding enhancement processing method.
  • the specifically selected enhancement processing method is a video frame of the first enhancement processing method, and the enhancement processing is performed in the first enhancement processing method.
  • the enhancement processing is performed in the second enhancement processing method. It can be understood that if the second enhancement processing method includes multiple sub-enhancement processing methods, the video frame corresponding to the sub-enhancement processing method is selected and processed in the selected sub-enhancement processing method. If the second enhancement processing method includes a processing method that does not perform enhancement processing on the video frame, the video frame that does not perform the enhancement processing method is selected, and the enhancement processing is not performed.
  • the selection of the enhancement processing method of the video frame may be performed in synchronization with the display enhancement processing of the video frame. That is to say, the enhancement processing of the video frame may be the enhancement processing while selecting the enhancement processing method. For example, after selecting a corresponding enhancement processing method for a frame of video frame, you can start to perform enhancement processing on the video frame through the selected enhancement processing method.
  • the second enhancement processing method includes a processing method that does not perform enhancement processing on the video frame
  • the frame to be enhanced in video quality may be placed in the GPU for off-screen rendering Processing, non-enhanced video frames are processed on-screen rendering on the CPU side to ensure enhanced video quality while reducing power consumption. After the rendering is completed, the video frame is displayed through the display screen.
  • a first enhancement processing mode is selected for some video frames, and a second enhancement processing mode is selected for the remaining part of video frames.
  • the first enhancement processing method is an enhancement processing method under non-low power consumption enhancement, and may be the enhancement processing method with the best enhancement effect that can be achieved by the electronic device.
  • the power consumption of the second enhancement processing mode is lower than that of the first enhancement processing mode, so that the power consumption of the enhancement processing of the video is lower, and because some video frames are still processed by the first enhancement processing mode, the overall enhancement effect of the video is still good.
  • the power consumption during video enhancement processing is reduced while maintaining a good video enhancement effect.
  • the selection of the second enhancement processing mode may refer to the Selection of two processing methods.
  • the second enhanced processing The method may not include a processing method that does not perform enhancement processing.
  • the embodiment of the present application also provides a video enhancement processing device 300, which is applied to an electronic device.
  • the device includes an instruction receiving module 310 for receiving an enhanced instruction for enhancing low power consumption of the video.
  • the selection module 320 is configured to select a second enhancement processing mode that consumes less power than the first enhancement processing mode for at least part of the video frames of the video, where the first enhancement processing mode is to perform non-low power enhancement on the video Corresponding to the enhanced processing method.
  • the processing module 330 is configured to perform display enhancement processing on the video frame of the video through a corresponding enhancement processing method, and the display enhancement processing improves the image quality of the video frame by adjusting image parameters of the video frame.
  • the instruction receiving module 310 may be used to determine whether the power of the electronic device is less than the target power when the video is enhanced. If the power of the electronic device is less than the target power, it is determined that the enhanced instruction to enhance the low power consumption of the video is received.
  • the selection module 320 may be used to select a first enhancement processing mode for part of the video frames of the video, and select a second enhancement processing mode for the remaining part of the video frames.
  • the selection module 320 may be used to select the second enhancement processing mode for video frames with a preset number of frames per interval, and select the first enhancement processing mode for the remaining video frames.
  • the second enhancement processing method may include one or more sub-enhancement processing methods, and different sub-enhancement processing methods are used to perform enhancement processing on different video frames.
  • the second enhancement processing method includes a processing method that does not perform enhancement processing on the video frame.
  • the selection module 320 may be used to select a second enhanced processing mode with lower power consumption than the first enhanced processing mode for all video frames of the video frames.
  • the coupling between the modules may be electrical, mechanical, or other forms of coupling.
  • each functional module in each embodiment of the present application may be integrated into one processing module, or each module may exist alone physically, or two or more modules may be integrated into one module.
  • the above integrated modules may be implemented in the form of hardware or software function modules.
  • FIG. 8 shows a structural block diagram of an electronic device 400 provided by an embodiment of the present application.
  • the electronic device 400 may be a smart phone, a tablet computer, a music playback device, a computer, and other electronic devices capable of video processing.
  • the electronic device has one or more processors 410 (only one shown in the figure), a memory 420, and one or more programs. Wherein, the one or more programs are stored in the memory 420, and are configured to be executed by the one or more processors 410.
  • the one or more programs are configured to perform the method described in the foregoing embodiments.
  • the processor 410 may include one or more processing cores.
  • the processor 410 uses various interfaces and lines to connect various parts of the entire electronic device 400, and executes by executing or executing instructions, programs, code sets or instruction sets stored in the memory 420, and calling data stored in the memory 420 to execute Various functions and processing data of the electronic device 400.
  • the processor 410 may adopt at least one of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), programmable logic array (Programmable Logic Array, PLA)
  • DSP Digital Signal Processing
  • FPGA field programmable gate array
  • PROM programmable logic array
  • PLA programmable logic array
  • the processor 410 may integrate one or a combination of one of a central processing unit (Central Processing Unit, CPU), an image processing unit (Graphics Processing Unit, GPU), and a modem.
  • CPU Central Processing Unit
  • GPU Graphics Processing Unit
  • modem modem
  • CPU mainly deals with operating system, user interface and application program, etc.
  • GPU is used for rendering and rendering of display content
  • modem is used for handling wireless communication. It can be understood that the above-mentioned modem may not be integrated into the processor 410, and may be implemented by a communication chip alone.
  • the memory 420 may include random access memory (Random Access Memory, RAM), and may also include read-only memory (Read-Only Memory).
  • the memory 420 may be used to store instructions, programs, codes, code sets, or instruction sets.
  • the memory 420 may include a storage program area and a storage data area, where the storage program area may store instructions for implementing an operating system, instructions for implementing at least one function, instructions for implementing various method embodiments described above, and the like.
  • the storage data area can also be data created by the electronic device in use (such as phonebook, audio and video data, chat history data), etc.
  • the electronic device 400 may further include a display screen for displaying video.
  • FIG. 9 shows a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application.
  • the computer readable storage medium 500 stores program code, and the program code can be called by a processor to execute the method described in the above method embodiments.
  • the computer-readable storage medium 500 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM.
  • the computer-readable storage medium 500 includes a non-transitory computer-readable storage medium.
  • the computer-readable storage medium 500 has a storage space for the program code 510 to perform any of the method steps described above. These program codes can be read from or written into one or more computer program products.
  • the program code 510 may be compressed in an appropriate form, for example.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

本申请公开了一种视频处理方法、装置、电子设备及存储介质，涉及电子设备技术领域。其中，该方法包括：接收对视频进行低功耗增强的增强指令；对所述视频的至少部分视频帧选取功耗低于第一增强处理方式的第二增强处理方式，其中，所述第一增强处理方式为对视频进行非低功耗增强时对应的增强处理方式；对视频的视频帧通过对应的增强处理方式进行显示增强处理，所述显示增强处理通过调节视频帧的图像参数提高视频帧的画质。该方案使至少部分视频帧的增强功耗更低，降低视频处理的整体功耗。

Description

视频处理方法、装置、电子设备及存储介质
本申请要求于2018年11月27日提交的申请号为CN201811427974.2的中国专利申请的优先权，在此通过引用将其全部内容并入本文。
技术领域
本申请涉及电子设备技术领域，更具体地，涉及一种视频处理方法、装置、电子设备及存储介质。
背景技术
随着科学技术的发展，电子设备已经成为人们日常生活中最常用的电子产品之一。并且，用户经常会通过电子设备看视频或玩游戏等，为了获得良好的视频观看体验，可能对视频进行处理，但是对视频的处理可能导致电子设备运行功耗过高。
发明内容
鉴于上述问题，本申请提出了一种视频处理方法、装置、电子设备及存储介质，以改善上述问题。
第一方面，本申请实施例提供了一种视频处理方法，应用于电子设备，所述方法包括：接收对视频进行低功耗增强的增强指令；对所述视频的至少部分视频帧选取功耗低于第一增强处理方式的第二增强处理方式，其中，所述第一增强处理方式为对视频进行非低功耗增强时对应的增强处理方式；对视频的视频帧通过对应的增强处理方式进行显示增强处理，所述显示增强处理通过调节视频帧的图像参数提高视频帧的画质。
第二方面，本申请实施例提供了一种视频处理装置，应用于电子设备，所述装置包括：指令接收模块，用于接收对视频进行低功耗增强的增强指令；选取模块，用于对所述视频的至少部分视频帧选取功耗低于第一增强处理方式的第二增强处理方式，其中，所述第一增强处理方式为对视频进行非低功耗增强时对应的增强处理方式；处理模块，用于对视频的视频帧通过对应的增强处理方式进行显示增强处理，所述显示增强处理通过调节视频帧的图像参数提高视 频帧的画质。
第三方面，本申请实施例提供了一种电子设备，包括：一个或多个处理器；存储器；一个或多个程序。其中所述一个或多个程序被存储在所述存储器中并被配置为由所述一个或多个处理器执行，所述一个或多个程序配置用于执行上述的方法。
第四方面，本申请实施例提供了一种计算机可读存储介质，所述计算机可读存储介质中存储有程序代码，所述程序代码可被处理器调用执行上述的方法。
附图说明
为了更清楚地说明本申请实施例中的技术方案，下面将对实施例描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1示出了本申请实施例提供的视频播放的流程示意图。
图2示出了本申请一实施例提供的视频处理方法的流程图。
图3示出了本申请一实施例提供的视频处理方法中视频增强开关的一种显示示意图。
图4示出了本申请一实施例提供的视频处理方法中视频增强开关的另一种显示示意图。
图5示出了本申请一实施例提供的视频处理方法中视频增强开关的又一种显示示意图。
图6示出了本申请另一实施例提供的视频处理方法的流程图。
图7示出了本申请实施例提供的视频处理装置的功能模块图。
图8示出了本申请实施例提供的电子设备的结构框图。
图9是本申请实施例的用于保存或者携带实现根据本申请实施例的视频处理方法的程序代码的存储单元。
具体实施方式
为了使本技术领域的人员更好地理解本申请方案，下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述。
请参阅图1，图1示出了视频播放的流程。具体地，操作系统在获取到待播放的数据的时候，接下来的工作就是解析音视频数据。一般的视频文件都由视频流和音频流两部分组成，不同的视频格式音视频的封装格式不一样。将音频流和视频流合成文件的过程称为muxer，反之从媒体文件中分离音频流和视频流的过程称为demuxer。播放视频文件就需要从文件流中分离出音频流和视频流，分别对其进行解码，解码后的视频帧可以直接渲染，相应的音频可以送到音频输出设备的缓冲区进行播放，当然，视频渲染和音频播放的时间戳需要控制同步。其中，每个视频帧为视频对应的每一帧图像。
具体地，视频解码可以包括硬解码和软解码，硬件解码是将原来全部交由中央处理器(Central Processing Unit，CPU)来处理的视频数据的一部分交由图形处理器(Graphics Processing Unit，GPU)来做，而GPU的并行运算能力要远远高于CPU，这样可以大大的降低对CPU的负载，CPU的占用率降低了之后就可以同时运行一些其他的程序了，当然，对于较好的处理器来说，比如i5 2320，或者AMD任何一款四核心处理器来说，既可以进行硬解码，也可以进行软解码。
具体地，如图1所示，多媒体框架(Media Framework)通过与客户端的API接口获取客户端待播放的视频文件，并交由视频编解码器(Video Decode)。其中，Media Framework为Android系统中多媒体框架，MediaPlayer、MediaPlayerService和Stagefrightplayer三个部分构成了Android多媒体的基本框架。多媒体框架部分采用了C/S的结构，MediaPlayer作为C/S结构的Client端，MediaPlayerService和Stagefrightplayer作为C/S结构Server端，承担着播放多媒体文件的责任，通过Stagefrightplayer，Server端完成Client端的请求并作出响应。视频解码器Video Decode是一款集成了最常用的音频和视频解码与播放的超级解码器，用于将视频数据解码。
其中，软解码，即通过软件让CPU来对视频进行解码处理。而硬解码，指不借助于CPU，而通过专用的子卡设备来独立完成视频解码任务。
不论是硬解码还是软解码，在将视频数据解码之后，会将解码后的视频数据发送至图层传递模块(SurfaceFlinger)，如图1所示，硬解码后的视频数据通过视频驱动程序发送至SurfaceFlinger。SurfaceFlinger将解码后的视频数据渲染和合成之后，在显示屏上显示。其中，SurfaceFlinger是一个独立的Service，它接收所有Window的Surface作为输入，根据ZOrder、透明度、大小、位置 等参数，计算出每个Surface在最终合成图像中的位置，然后交由HWComposer或OpenGL生成最终的显示Buffer,然后显示到特定的显示设备上。
如图1所示，软解码中，CPU将视频数据解码之后交给SurfaceFlinger渲染和合成，而硬解码由GPU解码之后，交由SurfaceFlinger渲染和合成。而SurfaceFlinger会调用GPU实现图像的渲染和合成，并在显示屏上显示。
为了获得良好的显示效果，可以对视频增进行显示增强处理，该显示增强处理可以在解码后进行，在显示增强处理后再进行渲染合成后在显示屏显示。其中，显示增强处理通过调节视频帧的图像参数提高视频帧的画质，提高视频的显示效果，获得更良好的观看体验。其中，视频帧的画质可以包括清晰度、锐度、饱和度、细节、镜头畸变、色彩、解析度、色域范围以及纯度等参数，通过调节画质相关的各种参数使图像更符合人眼的观看偏好，用户观看体验更好。如使视频的清晰度越高、噪声越小、细节越清晰、饱和度越高等，表示视频画质越好，用户观看体验更好，显示增强处理的效果越好。其中，对画质中不同组合的参数进行调整，代表了对视频的不同增强处理方式，每种增强处理方式中包括相应的图像处理算法，用于对视频帧进行图像处理以调节视频帧的图像参数，提高视频帧的画质。
但是，显示增强需要占用电子设备较多的运行资源，使开启显示增强处理后，电子设备的能耗过高，降低电子设备的续航时间，并且也可能使电子设备温度过高。因此，在某些情况下，如电量过低、用户想要使电子设备在下次充电之前具有更长的使用时间等，需要使电子设备在对视频的增强处理的同时能具有更低的功耗。因此，发明人提出了本申请实施例的视频处理方法、装置、电子设备及存储介质，对视频的至少部分视频帧选取功耗较低的增强处理方式，以降低在视频增强时的处理功耗。下面将通过具体实施例对本申请实施例提供的视频处理方法、装置、电子设备及存储介质进行详细说明。
请参阅图2，示出了本申请实施例提供的视频处理方法。所述视频处理方法用于对至少部分视频帧采取低功耗对应的增强处理方式，降低视频处理时的功耗。在具体的实施例中，所述视频处理方法应用于如图7所示的视频处理装置300以及配置有所述视频处理装置300的电子设备400(图8)。下面将以电子设备为例，说明本实施例的具体流程，当然，可以理解的，本实施例所应用的电子设备可以为智能手机、平板电脑、计算机、穿戴式电子设备、车载设备、网关等具有视频处理能力的设备，在此不做具体的 限定。具体的，该方法包括：
步骤S110：接收对视频进行低功耗增强的增强指令。
电子设备可以对获取到视频数据通过解码、增强处理以及渲染合成后进行显示。其中，电子设备可以从服务器获取视频数据、可以从本地获取视频数据，也可以从其他电子设备获取视频数据。
具体地，当视频数据由电子设备从服务器获取时，那么该视频数据可以是电子设备从服务器下载，或者电子设备从服务器在线获取。例如，视频数据可以是电子设备通过安装的视频播放软件下载，或者在该视频播放软件在线获取的视频数据。其中，该服务器可以为云服务器。当视频数据从电子设备的本地获取时，该视频数据可以是电子设备预先下载并存储在本地存储器中的。当视频数据由电子设备从其他电子设备获取时，该视频数据可以由其他电子设备通过无线通信协议传输至所述电子设备，例如，通过WLAN协议、蓝牙协议、ZigBee协议或者WiFi协议等，也可以由其他电子设备通过数据网络传输至所述电子设备，例如，2G网络、3G网络或者4G网络等，在此不做限定。
电子设备获取到视频数据，再对该视频数据进行解码以及渲染合成等处理后，通过显示器进行播放。
在播放视频时，若接收到对视频进行低功耗增强的增强指令，可以对视频进行功耗较低的增强处理，在提升视频的显示画质的同时保持尽可能低的功耗。
作为一种实施方式，低功耗增强的增强指令，可以是由电子设备在视频开启时生成，作为接收到的低功耗增强的增强指令。例如，播放视频的应用程序的默认设置为开启低功耗增强，则在开启视频时，生成低功耗增强的增强指令。又如，播放视频的应用程序在前一次关闭时开启的为低功耗增强的增强指令，则再次打开该应用程序的同时开启低功耗增强的增强指令。或者是该视频在前一次关闭时开启的为低功耗增强的增强指令，则再次打开该视频时，生成对视频进行低功耗增强的增强指令。
作为一种实施方式，该低功耗增强的增强指令也可以是在视频播放过程中接收到的用户触发。例如，对应视频设置有不同等级的视频增强，不同等级的视频增强对应的功耗不同，最高等级的视频增强，功耗最高，等级越低的视频 增强，功耗越低。当然，通常功耗越高的视频增强处理，其增强效果越好，因此，各个不同等级的视频增强对应的增强效果不同。若用户开启最高等级的视频增强以外的视频增强，则接收到的为低功耗增强的增强指令。
例如图3所示，设置高等级的视频增强开关以及低等级的视频增强开关，分别对应高等级的视频增强以及低等级的视频增强，高等级的视频增强的功耗高于低等级的视频增强的功耗。在图3所示的视频增强开关中，若接收到对低等级的增强开关的触发确认，如图4所示，则接收到低功耗增强的增强指令。又如图5所示，设置可以进行高等级以及低等级互相切换的视频增强开关，若用户将视频增强开关切换到如图5所示低等级增强，则接收到低功耗增强的增强指令。其中，在视频播放过程中，设置的视频增强开关可以处于隐藏状态。当接收到对视频的点击等触控，显示该视频增强开关，并且使该视频增强开关处于可控制状态。当视频超过一段时间未接收到用户的触控操作，再次将该视频增强开关隐藏。
作为一种实施方式，若视频增强处理时选用高功耗的增强，而此时电子设备电量过低，则可能加快电子设备低电量关机。因此，该低功耗增强的增强指令可以是在视频进行增强处理时电子设备的电量过低的情况下生成，以增加电子设备的续航时间。具体的，可以在对视频进行增强处理的情况下，判断电子设备的电量是否小于目标电量。其中，该增强处理为非低功耗的增强处理，即该增强处理为高功耗的增强处理。若判定电子设备的电量小于目标电量，则判定接收到对视频进行低功耗增强的增强指令。其中，该目标电量的具体电量值在本申请实施例中并不限定，可以是电子设备总电量的百分之三十、百分之二十等。另外，该目标电量也可以由用户设置后存储于电子设备。
步骤S120：对所述视频的至少部分视频帧选取功耗低于第一增强处理方式的第二增强处理方式，其中，所述第一增强处理方式为对视频进行非低功耗增强时对应的增强处理方式。
在接收到低功耗增强的增强指令的情况下，对视频的至少部分视频帧选取功耗低的增强处理方式。具体的，对视频进行非低功耗增强时对应的增强处理方式为第一增强处理方式，则对至少部分视频帧选取第二增强处理方式，该第二增强处理方式的功耗低于第一增强处理方式。
其中，至少部分视频帧可以是所有的视频帧，也就是说，可以对视频帧的所有视频帧选取功耗低于第一增强处理方式的第二增强处理方式。另外，该至少部分视频帧也可以是视频的一部分视频帧。
另外，该至少部分视频帧可以为该视频还未进行播放的视频帧中的至少部分视频帧。
步骤S130：对视频的视频帧通过对应的增强处理方式进行显示增强处理。所述显示增强处理通过调节视频帧的图像参数提高视频帧的画质。
对视频帧进行增强处理时通过相应的增强处理方式。也就是说，选取第二增强处理方式的视频帧，通过第二增强处理方式进行增强处理，以通过第二增强处理方式包括的图像处理算法调整视频帧的图像参数，从而调整视频帧画质的相关参数，提高视频画质。
本申请实施例中，在接收到低功耗增强的增强指令的情况下，对视频的至少部分视频帧通过功耗低于第一增强处理方式的第二增强处理方式进行增强处理，该第一增强处理方式为对视频进行非低功耗增强时对应的增强处理方式，从而使对视频的增强的功耗相对于非低功耗增强时降低。
本申请还提供了一种实施例，相对于前述实施例，该实施例具体描述了对至少部分视频帧选取增强处理方式的部分实施方式。具体的，请参见图6，该方法包括：
步骤S210：接收对视频进行低功耗增强的增强指令。
步骤S210的具体实施可以参见步骤S110，在此不再赘述。
步骤S220：对所述视频的部分视频帧选取第一增强处理方式，其余部分视频帧选取第二增强处理方式。
发明人经过研究发现，视频为多个视频帧，并且连续的视频帧之间时间间隔极短，播放速度很快。在视频增强时，若部分视频帧采用功耗较高但是增强效果较好的增强处理方式，另外部分视频帧采用功耗较低但是增强效果略差一些的增强处理方式，由于视频帧的切换速度很快，用户对增强方式略差的感知不明显。因此，可以对视频的部分视频帧选取第一增强处理方式，以获得更好的处理效果，对其余部分视频帧选取第二增强处理方式，以降低增强处理的功耗。
作为一种实施方式，可以每间隔预设帧数的视频帧选取所述第二增强处理 方式，其余视频帧选取所述第一增强处理方式。如，每间隔一帧视频帧的视频帧选取第二增强处理方式；又如，每间隔两帧视频帧的视频帧选取第二增强处理方式等等。被间隔的视频帧采取第一增强处理方式。
预设帧数的具体值在本申请实施例中并不限定。可选的，可以根据视频增强的等级进行确定，第二增强处理方的视频增强的等级越高，预设帧数可以越大。例如，视频增强的等级包括高等级，中等级以及低等级，高等级为非低功耗增强的增强处理。则中等级的视频增强对应的预设帧数大于低等级的视频增强对应的预设帧数，如中等级每隔三帧视频帧的视频帧选取第二增强处理方式，被间隔的视频帧采取第一增强处理方式；低等级的每隔一帧视频帧的视频帧选取第二增强处理方式，被间隔的视频帧采取第一增强处理方式。
可选的，在本申请实例中，第二增强处理方式可以为一种处理方式，第一增强处理方式可以为一种处理方式。在该实施方式中，可以是，增强处理可以从接收到低功耗增强的增强指令时还未播放也还未进行增强处理的第一帧视频帧开始，后续的视频帧增强处理方式的选取依次是，一帧视频帧选取第二增强处理方式，接下来的预设帧数的视频帧选取第一增强处理方式，再接下来的一帧视频帧选取第二增强处理方式，再接下来的预设帧数的视频帧选取第一增强处理方式，以此类推。
为了清楚每间隔预设帧数的视频帧选取所述第二增强处理方式，其余视频帧选取所述第一增强处理方式的具体选取方式，本实施方式以预设帧数为一进行说明。当预设帧数为一时，视频的视频帧选取增强处理方式为，第一增强处理方式与第二增强处理方式间隔排列地对应到依次排列的视频帧，也就是说，视频的依次排列的视频帧选取的增强处理方式为，一帧选取第一增强处理方式，下一帧选取第二增强处理方式，再下一帧选取第一增强处理方式，接下来一帧选取第二增强处理方式，以此类推。如视频的视频帧依次编号为1，2，3，4直至n，n为正整数。则可以是奇数编号的视频帧选取第一增强处理方式，偶数编号的视频帧选取第二处理方式；或者偶数编号的视频帧选取第一增强处理方式，奇数编号的视频帧选取第二处理方式。
本申请实施例还提供了一种实施方式。在该实施方式中，第二增强处理方式还可以包括多种处理方式，每种处理方式可以定义为一种子增强处理方式，不同子增强处理方式用于对不同的视频帧进行增强处理。具体的，在选取增强处理方式时，对于视频依次排列的各个视频帧，可以交叉选取第一增强处理方 式以及第二增强处理方式的各子增强处理方式。
例如，第二增强处理方式的子增强处理方式为k种，将视频帧分为n帧为一组，也就是说，第1帧视频帧至第n帧为一组，第n+1至第2n为一组，第2n+1至第3n为一组，以此类推，n大于等于k+1。则对于每一组视频帧，各帧视频帧可以从第一增强处理方式以及第二增强处理方式的k种子增强处理方式中选取相应的增强处理方式，且第一增强处理方式以及第二增强处理方式的k种子增强处理方式全部被选取。各组视频帧的选取规律可以一致，各组视频帧的增强处理方式选取规律可以一致；也可以不一致。以第二增强处理方式的子增强处理方式为2种，4帧视频帧分为一组为例，则一组视频帧中的第一以及第二帧可以选取第一增强处理方式，第三以及第四帧视频帧可以分别选取第二增强处理方式的两种子增强处理方式。
又如，第二增强处理方式的子增强处理方式为k种，选取增强处理方式可以是，第一帧视频帧选取第一增强处理方式，第2至第k+1帧分别选取第二增强处理方式的各个子增强处理方式；第k+2帧视频帧选取第一增强处理方式，第k+3至第k+3+k-1帧分别选取第二增强处理方式的各个子增强处理方式，以此类推。
本申请还提供了一种实施方式，在该实施方式中，第二增强处理方式也可以包括对视频帧不进行增强处理的处理方式。
在该实施方式中，若第二增强处理方式为一种处理方式，第一增强处理方式为一种处理方式，则对视频帧的处理方式包括第一增强处理方式对应的非低功耗增强以及不增强。例如，每间隔预设帧数的视频帧选取所述第二增强处理方式，若预设帧数为1，则是每间隔一帧视频帧不进行增强处理，被间隔的视频帧通过第一增强处理方式进行增强处理，也就是说，视频帧的增强处理间隔进行，一帧视频帧增强，一帧视频帧不增强，依次进行。若预设帧数不为1，则依次排列的视频帧中，一帧视频帧不进行增强，相邻的预设帧数视频帧进行增强处理，再下一帧视频帧不进行增强，接下来相邻的预设帧数的进行增强处理，依次类推。
在该实施方式中，若第二增强处理方式包括多种子增强处理方式，则多种子增强处理方式中的一种子增强处理方式可以是不进行增强。
在本申请实施例中，第一处理增强处理方式以及第二增强处理方式具体包括的图像处理算法并不限定。具体的，第一增强处理方式的算法复杂度比第二 增强处理方式的算法复杂度高，对应的，第一增强处理方式的处理效果比第二增强处理方式的处理效果更好，第一增强处理方式的功耗也比第二增强处理方式高。
可选的，可以是，第一增强处理方式包括更多的图像处理算法以更好地改善视频画质，而第二增强处理方式包括的图像处理算法比第一增强处理方式少。如，第一增强处理方式的增强处理包括去噪算法、饱和度增强以及对比度增强算法中的三种或两种，而第二增强处理方式的增强处理值包括去噪算法、饱和度增强以及对比度增强算法中的一种，如去噪算法。或者是第一增强处理方式的增强处理包括去噪算法、饱和度增强以及对比度增强算法中的三种，而第二增强处理方式的增强处理值包括去噪算法、饱和度增强以及对比度增强算法中的两种。
其中，每种算法具体对应的图像处理算法在本申请实施例中并不限定。例如去噪算法可以是对图像边缘等细节信息保存完好的图像处理算法，如，基于局部空间连续性原则的引导滤波算法，同时考虑了像素空间差异与强度差异的滤波器双边滤波，充分利用了整个图像的自相似性和冗余信息的NLM(Non-Local Means，非局部均值)图像去噪算法。例如对比度增强的算法可以是自适应对比度增强算法(ACE，Adaptive Contrast Enhancement)，直方图均衡化(Histogram Equalization)以及直方图匹配(Histogram Matching)等。例如饱和度增强的算法可以是增加视频帧中的色彩成分，如，视频帧通过RGB表示时，分别调高RGB各个颜色通道；或者在RGB色彩空间调整亮度与饱和度不是很直观，而HSL色彩模式可以很直观表示出每个像素的饱和度，可以将图像的像素RGB值然后再转换到HSL色彩模式得到饱和度S(Saturation)，通过调整S的值调高饱和度。再将调整后的视频帧从HSL色彩模式转换到RGB色彩模式用于显示。
可选的，也可以是，第一增强处理方式中算法的迭代次数大于所述第二增强处理方式中增强处理算法的迭代次数。对应的第一增强处理方式对视频帧画质的处理效果好于第二增强处理方式，例如清晰度更高，饱和度更高，对比度更强等，相应的第一增强处理方式的功耗也更高。
可选的，对于同样目的的图像处理，第一增强处理方式中采用复杂度更高的算法。
例如，对于去噪的图像处理算法，第二增强处理方式中可以采用基于局部空间连续性原则的引导滤波算法，NLM(Non-Local Means，非局部均值)图像去噪算法等常规的去噪算，但是，常规的去噪算法还是可能会使图像损失部分细节。
第一增强处理方式可以是更复杂但是去噪效果更好的去噪算法，例如，只对视频帧中边缘细节特征以外的部分通过去噪算法进行去噪，而不对视频帧中的边缘特征进行处理，以保留图像良好的边缘细节特征。
具体的，第一增强处理方式中去噪的图像处理算法可以是，先通过边缘检测算法获取视频帧中的边缘部分。其中，具体的边缘检测算法在本申请实施例中并不限定，例如可以是差分边缘检测、Reborts算子、Sobel算子、Prewitt算子、罗伯茨交叉边缘检测(Roberts Cross operator)、Kirsch算子以及Laplace算子等中的任意一种。
再从视频帧中将检测获得的边缘提取出来，即将视频帧分为边缘部分以及边缘以外的部分。具体的，可以根据边缘检测的结果，通过裁剪算法，将所述视频帧裁剪为第一部分以及第二部分，所述第一部分为所述边缘部分，所述第二部分为所述边缘部分以外的部分。具体的裁剪算法在本申请实施例中并不限定，凡是可以将边缘检测到的边缘从视频帧中裁剪出来，使视频帧被裁剪为第一部分以及第二部分的裁剪算法都可以，如Cohen-Sutherland裁剪算法。或者直接根据边缘检测结果，将边缘检测中表示为边缘的像素点从视频帧中提取出来，使视频帧分为第一部分以及第二部分。
再通过去噪算法对第二部分进行去噪处理。具体的去噪算法在本申请实施例中并不限定，可以是任意满足对视频帧进行去噪处理的图像处理算法，如上述的引导滤波算法、双边滤波算法以及NLM算法等，也可以是其他去噪算法，如邻域平均法、中值滤波、低通滤波等空间域滤波去噪算法、傅立叶变换、沃尔什-哈达玛变换、余弦变换、K-L变换以及小波变换等变换域滤波去噪算法等等。
再将所述第一部分以及去噪后的第二部分组合成图像，作为所述视频帧增强处理后的视频帧。具体的，将第一部分以及第二部分组合成一帧图像，使第一部分在组合后的图像中，对应的位置为被裁剪视频帧中第一部分所在位置； 第二部分在组合后的图像中，对应的位置为被裁剪视频帧中第二部分所在位置。也就是说，组合后的图像中，第一部分为该图像中的边缘特征，第二部分为边缘特征以外的部分。将组合后的图像作为视频增强后的视频帧。
在该第一增强处理方式中，去噪处理算法的复杂度相对常规的去噪处理算法复杂度更高，功耗更大，但是将视频帧中的边缘细节部分裁剪后，对非边缘细节的部分进行去噪，从而避免了去噪算法将图像的边缘细节信息也去除，去噪效果更好。在去噪后，再将边缘细节部分与被去噪后的非边缘细节的部分组合成视频帧，形成增强后的视频帧，使视频增强后的视频帧中边缘噪声不会放大，且去除了视频帧中的噪声。
又如，对于对视频帧进行锐化的图像处理算法，第二增强处理方式中可以采用常规的锐化处理方式，如梯度锐化或拉普拉斯算子等。由于对视频帧进行锐化可以提升视频帧的清晰度，但是锐化使噪声受到增强，放大边缘噪声，使边缘处非视频本身的信息更多，边缘细节更模糊。
因此，第一增强处理方式可以通过锐化效果更好且更少拉起噪声的处理算法对视频帧进行处理。具体的，第一增强处理方式中锐化的算法可以是：先通过边缘检测算法获取视频帧中的边缘部分。再将所述视频帧裁剪为第一部分以及第二部分，所述第一部分为所述边缘部分，所述第二部分为所述边缘部分以外的部分。通过图像锐化算法对所述第二部分进行锐化处理，具体的锐化处理算法在本申请实施例中并不限定，例如，可以是，梯度锐化、拉普拉斯算子等。将第一部分以及锐化后的第二部分组合成图像，作为所述视频帧增强后的视频帧。
第一增强处理方式采用比第二增强处理方式更少拉起噪声的处理算法进行锐化处理，但是，对应的，第一增强处理方式处理过程中的功耗比第二增强处理方式更高。
具体第一增强处理方式中采用的算法复杂度更高的图像处理算法对视频帧进行增强在本申请实施例中并不一一列举。第一增强处理方式通过复杂度更高的算法获得更好的视频处理效果，但是相对于第二增强处理算法具有更高的功耗。
步骤S230：对视频的视频帧通过对应的增强处理方式进行显示增强处理。
对视频的各视频帧通过选取的对应的增强处理方式进行增强处理。具体 的，具体选择的增强处理方式为第一增强处理方式的视频帧，以第一增强处理方式进行增强处理。对于选取第二增强处理方式的视频帧，以第二增强处理方式进行增强处理。可以理解的，若第二增强处理方式包括多种子增强处理方式，则选取到相应子增强处理方式的视频帧，以选取的子增强处理方式进行处理。若第二增强处理方式包括对视频帧不进行增强处理的处理方式，则选取到不进行增强的处理方式的视频帧，不进行增强处理。
在本申请实施例中，视频帧的增强处理方式的选取可以与对视频帧进行显示增强处理同步进行。也就是说，视频帧的增强处理可以是一边选取增强处理方式一边进行增强处理。例如，为一帧视频帧选取对应的增强处理方式后，则可以开始对该视频帧通过选取的增强处理方式进行增强处理。
在本申请实施例中，若第二增强处理方式包括对视频帧不进行增强处理的处理方式，为了加快对视频帧的处理速度，可以将要视频画质增强的帧放在GPU里面进行离屏渲染处理，不增强的视频帧在CPU端通过在屏渲染处理，从而保证视频画质增强的同时，功耗得到降低。在渲染完成后，将视频帧通过显示屏进行显示。
本申请实施例中，对部分视频帧选取第一增强处理方式，其余部分视频帧选取第二增强处理方式。第一增强处理方式为非低功耗增强下的增强处理方式，可以是电子设备可以达到的增强效果最好的增强处理方式。第二增强处理方式的功耗低于第一增强处理方式，从而使视频的增强处理功耗更低，同时由于部分视频帧仍然通过第一增强处理方式处理，视频的总体增强效果仍然较好。在该实施例中，保持视频良好增强效果的同时降低了视频增强处理时的功耗。
可以理解的，在本申请实施例中，若对视频帧的所有视频帧选取功耗低于第一增强处理方式的第二增强处理方式，第二增强处理方式的选取可以参照上述实施例中第二处理方式的选取。其中，若低功耗增强的增强指令并非对视频帧不进行增强，则当对视频帧的所有视频帧选取功耗低于第一增强处理方式的第二增强处理方式时，该第二增强处理方式中可以不包括不进行增强处理的处理方式。
本申请实施例还提供了一种视频增强处理装置300，应用于电子设备。具体的，请参见图7，该装置包括指令接收模块310，用于接收对视频进行低功 耗增强的增强指令。选取模块320，用于对所述视频的至少部分视频帧选取功耗低于第一增强处理方式的第二增强处理方式，其中，所述第一增强处理方式为对视频进行非低功耗增强时对应的增强处理方式。处理模块330，用于对视频的视频帧通过对应的增强处理方式进行显示增强处理，所述显示增强处理通过调节视频帧的图像参数提高视频帧的画质。
可选的，指令接收模块310可以用于在对视频进行增强处理的情况下，判断电子设备的电量是否小于目标电量。若电子设备的电量小于目标电量，判定接收到对视频进行低功耗增强的增强指令。
可选的，选取模块320可以用于对所述视频的部分视频帧选取第一增强处理方式，其余部分视频帧选取第二增强处理方式。
可选的，选取模块320可以用于每间隔预设帧数的视频帧选取所述第二增强处理方式，其余视频帧选取所述第一增强处理方式。
可选的，所述第二增强处理方式可以包括一种或多种子增强处理方式，不同子增强处理方式用于对不同的视频帧进行增强处理。
可选的，所述第二增强处理方式包括对视频帧不进行增强处理的处理方式。
可选的，选取模块320可以用于对所述视频帧的所有视频帧选取功耗低于第一增强处理方式的第二增强处理方式。
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述的各个方法实施例之间可以相互参照；上述描述装置和模块的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本申请所提供的几个实施例中，模块相互之间的耦合可以是电性，机械或其它形式的耦合。
另外，在本申请各个实施例中的各功能模块可以集成在一个处理模块中，也可以是各个模块单独物理存在，也可以两个或两个以上模块集成在一个模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。
请参考图8，其示出了本申请实施例提供的一种电子设备400的结构框图。该电子设备400可以是智能手机、平板电脑、音乐播放设备、计算机等能够进行视频处理的电子设备。该电子设备一个或多个处理器410(图 中仅示出一个)，存储器420以及一个或多个程序。其中，所述一个或多个程序被存储在所述存储器420中，并被配置为由所述一个或多个处理器410执行。所述一个或多个程序配置用于执行前述实施例所描述的方法。
处理器410可以包括一个或者多个处理核。处理器410利用各种接口和线路连接整个电子设备400内的各个部分，通过运行或执行存储在存储器420内的指令、程序、代码集或指令集，以及调用存储在存储器420内的数据，执行电子设备400的各种功能和处理数据。可选地，处理器410可以采用数字信号处理(Digital Signal Processing，DSP)、现场可编程门阵列(Field－Programmable Gate Array，FPGA)、可编程逻辑阵列(Programmable Logic Array，PLA)中的至少一种硬件形式来实现。处理器410可集成中央处理器(Central Processing Unit，CPU)、图像处理器(Graphics Processing Unit，GPU)和调制解调器等中的一种或几种的组合。其中，CPU主要处理操作系统、用户界面和应用程序等；GPU用于负责显示内容的渲染和绘制；调制解调器用于处理无线通信。可以理解的是，上述调制解调器也可以不集成到处理器410中，单独通过一块通信芯片进行实现。
存储器420可以包括随机存储器(Random Access Memory，RAM)，也可以包括只读存储器(Read-Only Memory)。存储器420可用于存储指令、程序、代码、代码集或指令集。存储器420可包括存储程序区和存储数据区，其中，存储程序区可存储用于实现操作系统的指令、用于实现至少一个功能的指令、用于实现上述各个方法实施例的指令等。存储数据区还可以电子设备在使用中所创建的数据(比如电话本、音视频数据、聊天记录数据)等。
另外，该电子设备400还可以包括显示屏，用于对视频进行显示。
请参考图9，其示出了本申请实施例提供的一种计算机可读存储介质的结构框图。该计算机可读存储介质500中存储有程序代码，所述程序代码可被处理器调用执行上述方法实施例中所描述的方法。
计算机可读存储介质500可以是诸如闪存、EEPROM(电可擦除可编程只读存储器)、EPROM、硬盘或者ROM之类的电子存储器。可选地， 计算机可读存储介质500包括非易失性计算机可读介质(non-transitory computer-readable storage medium)。计算机可读存储介质500具有执行上述方法中的任何方法步骤的程序代码510的存储空间。这些程序代码可以从一个或者多个计算机程序产品中读出或者写入到这一个或者多个计算机程序产品中。程序代码510可以例如以适当形式进行压缩。
最后应说明的是：以上实施例仅用以说明本申请的技术方案，而非对其限制；尽管参照前述实施例对本申请进行了详细的说明，本领域的普通技术人员当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不驱使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。

Claims (20)

  1. 一种视频处理方法，其特征在于，应用于电子设备，所述方法包括：
    接收对视频进行低功耗增强的增强指令；
    对所述视频的至少部分视频帧选取功耗低于第一增强处理方式的第二增强处理方式，其中，所述第一增强处理方式为对视频进行非低功耗增强时对应的增强处理方式；
    对视频的视频帧通过对应的增强处理方式进行显示增强处理，所述显示增强处理通过调节视频帧的图像参数提高视频帧的画质。
  2. 根据权利要求1所述的方法，其特征在于，所述接收对视频进行低功耗增强的增强指令，包括：
    在对视频进行增强处理的情况下，判断电子设备的电量是否小于目标电量；
    若是，判定接收到对视频进行低功耗增强的增强指令。
  3. 根据权利要求1所述的方法，其特征在于，所述视频的至少部分视频帧为所述视频的所有视频帧；和/或
    所述视频的至少部分视频帧为所述视频的一部分视频帧。
  4. 根据权利要求1-3任一项所述的方法，其特征在于，所述对所述视频的至少部分视频帧选取功耗低于第一增强处理方式的第二增强处理方式，包括：
    对所述视频的部分视频帧选取第一增强处理方式，其余部分视频帧选取第二增强处理方式。
  5. 根据权利要求4所述的方法，其特征在于，所述对所述视频的部分视频帧选取第一增强处理方式，其余部分视频帧先去第二增强处理方式，包括：
    每间隔预设帧数的视频帧选取所述第二增强处理方式，其余视频帧选取所述第一增强处理方式。
  6. 根据权利要求5所述的方法，其特征在于，所述每间隔预设帧数的视 频帧选取所述第二增强处理方式，其余视频帧选取所述第一增强处理方式，包括：
    每间隔一帧视频帧的视频帧选取第二增强处理方式，被间隔的视频帧采取第一增强处理方式。
  7. 根据权利要求5所述的方法，其特征在于，对应视频设置有不同等级的视频增强，不同等级的视频增强对应的功耗不同，等级越低的视频增强，功耗越低，功耗越高的视频增强，增强效果越好，其中，第二增强处理方式的视频增强的等级越高，所述预设帧数越大。
  8. 根据权利要求4-7任一项所述的方法，其特征在于，所述第二增强处理方式包括一种或多种子增强处理方式，不同子增强处理方式用于对不同的视频帧进行增强处理。
  9. 根据权利要求8所述的方法，其特征在于，所述第二增强处理方式的子增强处理方式为k种，将所述视频的视频帧分为n帧为一组，n大于等于k+1，
    所述对所述视频的部分视频帧选取第一增强处理方式，其余部分视频帧选取第二增强处理方式，包括：
    对于每一组视频帧，各帧视频帧从第一增强处理方式以及第二增强处理方式的k种子增强处理方式中选取相应的增强处理方式，且第一增强处理方式以及第二增强处理方式的k种子增强处理方式全部被选取。
  10. 根据权利要求9所述的方法，其特征在于，各组视频帧的增强处理方式选取规律可以一致。
  11. 根据权利要求4-6任一项所述的方法，其特征在于，所述第二增强处理方式包括对视频帧不进行增强处理的处理方式。
  12. 根据权利要求11所述的方法，其特征在于，将需要增强处理的视频帧放在GPU里面进行离屏渲染处理，不增强的视频帧在CPU端通过在屏渲染处理。
  13. 根据权利要求1-3任一项所述的方法，其特征在于，所述对所述视频 的至少部分视频帧选取功耗低于第一增强处理方式的第二增强处理方式，包括：
    对所述视频帧的所有视频帧选取功耗低于第一增强处理方式的第二增强处理方式。
  14. 根据权利要求1-10任一项或13所述的方法，其特征在于，所述对视频的视频帧通过对应的增强处理方式进行显示增强处理的步骤中，从接收到低功耗增强的增强指令时，还未播放也还未进行增强处理的第一帧视频帧开始，进行增强处理。
  15. 根据权利要求1-10任一项所述的方法，其特征在于，第二增强处理方式包括的图像处理算法比第一增强处理方式少。
  16. 根据权利要求1-10任一项所述的方法，其特征在于，第一增强处理方式中算法的迭代次数大于所述第二增强处理方式中增强处理算法的迭代次数。
  17. 根据权利要求1-10任一项所述的方法，其特征在于，第二增强处理方式中采用基于局部空间连续性原则的引导滤波算法对视频帧进行去噪；
    第一增强处理方式对视频帧进行去噪包括：通过边缘检测算法获取视频帧中的边缘部分；根据边缘检测的结果，通过裁剪算法，将所述视频帧裁剪为第一部分以及第二部分，所述第一部分为所述边缘部分，所述第二部分为所述边缘部分以外的部分；通过去噪算法对所述第二部分进行去噪处理；将所述第一部分以及去噪后的第二部分组合成图像，作为增强处理后的视频帧。
  18. 一种视频处理装置，其特征在于，应用于电子设备，所述装置包括：
    指令接收模块，用于接收对视频进行低功耗增强的增强指令；
    选取模块，用于对所述视频的至少部分视频帧选取功耗低于第一增强处理方式的第二增强处理方式，其中，所述第一增强处理方式为对视频进行非低功耗增强时对应的增强处理方式；
    处理模块，用于对视频的视频帧通过对应的增强处理方式进行显示增强处理，所述显示增强处理通过调节视频帧的图像参数提高视频帧的画质。
  19. 一种电子设备，其特征在于，包括：
    一个或多个处理器；
    存储器；
    一个或多个程序，其中所述一个或多个程序被存储在所述存储器中并被配置为由所述一个或多个处理器执行，所述一个或多个程序配置用于执行如权利要求1-17任一项所述的方法。
  20. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质中存储有程序代码，所述程序代码可被处理器调用执行如权利要求1-17任一项所述的方法。
PCT/CN2019/109856 2018-11-27 2019-10-08 视频处理方法、装置、电子设备及存储介质 WO2020108092A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811427974.2A CN109729405B (zh) 2018-11-27 2018-11-27 视频处理方法、装置、电子设备及存储介质
CN201811427974.2 2018-11-27

Publications (1)

Publication Number Publication Date
WO2020108092A1 true WO2020108092A1 (zh) 2020-06-04

Family

ID=66295190

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/109856 WO2020108092A1 (zh) 2018-11-27 2019-10-08 视频处理方法、装置、电子设备及存储介质

Country Status (2)

Country Link
CN (1) CN109729405B (zh)
WO (1) WO2020108092A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113075993A (zh) * 2021-04-09 2021-07-06 杭州华橙软件技术有限公司 视频显示方法、装置和存储介质及电子设备
CN115348478A (zh) * 2022-07-25 2022-11-15 深圳市九洲电器有限公司 设备交互显示方法、装置、电子设备及可读存储介质

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109729405B (zh) * 2018-11-27 2021-11-16 Oppo广东移动通信有限公司 视频处理方法、装置、电子设备及存储介质
CN110377391B (zh) * 2019-07-17 2022-10-28 Oppo广东移动通信有限公司 图片显示方法、装置、移动终端及存储介质
CN110413360A (zh) * 2019-07-17 2019-11-05 Oppo广东移动通信有限公司 图片显示方法、装置、移动终端及存储介质
CN112887758B (zh) * 2019-11-29 2023-04-14 北京百度网讯科技有限公司 视频处理方法和装置
CN113365101B (zh) * 2020-03-05 2023-06-30 腾讯科技（深圳）有限公司 对视频进行多任务处理的方法及相关设备
CN112181657B (zh) * 2020-09-30 2024-05-07 京东方科技集团股份有限公司 视频处理方法、装置、电子设备及存储介质
CN113194324B (zh) * 2021-04-27 2022-07-29 广州虎牙科技有限公司 一种视频帧画质增强方法、直播服务端及电子设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101640755A (zh) * 2008-08-01 2010-02-03 中兴通讯股份有限公司 一种延长影像媒体播放时间的方法及其终端
US20110169960A1 (en) * 2006-11-13 2011-07-14 Redshift Systems Corporation Video enhancement system
CN106060341A (zh) * 2016-08-12 2016-10-26 武汉华星光电技术有限公司 一种降低屏驱动板功耗的方法及低功耗屏驱动板
CN108848414A (zh) * 2018-06-26 2018-11-20 曜宇航空科技（上海）有限公司 一种视频的播放方法、清晰度的切换方法及播放器
CN109729405A (zh) * 2018-11-27 2019-05-07 Oppo广东移动通信有限公司 视频处理方法、装置、电子设备及存储介质

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101035209A (zh) * 2006-03-07 2007-09-12 深圳Tcl新技术有限公司 一种通过画面对比实现画质调节的装置及方法
JP2010183305A (ja) * 2009-02-05 2010-08-19 Sony Corp 信号処理装置及び信号処理方法
CN101527786B (zh) * 2009-03-31 2011-06-01 西安交通大学 一种增强网络视频中视觉重要区域清晰度的方法
WO2011010834A2 (ko) * 2009-07-21 2011-01-27 삼성전자 주식회사 디스플레이 장치 및 그 디스플레이 방법
CN102811354B (zh) * 2011-05-30 2015-04-29 深圳市快播科技有限公司 一种视频画质增强播放方法及点播终端
CN103310411B (zh) * 2012-09-25 2017-04-12 中兴通讯股份有限公司 一种图像局部增强方法和装置
CN103473748A (zh) * 2013-09-23 2013-12-25 中国矿业大学(北京) 一种煤矿井下图像增强的方法
CN103546714B (zh) * 2013-10-29 2018-03-30 深圳Tcl新技术有限公司 对hdmi信号处理的方法和装置
CN105791925A (zh) * 2016-02-26 2016-07-20 上海卓易科技股份有限公司 一种处理录制视频的方法及装置
CN108391139B (zh) * 2018-01-15 2023-06-16 上海掌门科技有限公司 一种用于视频直播中的视频增强方法、介质及设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110169960A1 (en) * 2006-11-13 2011-07-14 Redshift Systems Corporation Video enhancement system
CN101640755A (zh) * 2008-08-01 2010-02-03 中兴通讯股份有限公司 一种延长影像媒体播放时间的方法及其终端
CN106060341A (zh) * 2016-08-12 2016-10-26 武汉华星光电技术有限公司 一种降低屏驱动板功耗的方法及低功耗屏驱动板
CN108848414A (zh) * 2018-06-26 2018-11-20 曜宇航空科技（上海）有限公司 一种视频的播放方法、清晰度的切换方法及播放器
CN109729405A (zh) * 2018-11-27 2019-05-07 Oppo广东移动通信有限公司 视频处理方法、装置、电子设备及存储介质

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113075993A (zh) * 2021-04-09 2021-07-06 杭州华橙软件技术有限公司 视频显示方法、装置和存储介质及电子设备
CN113075993B (zh) * 2021-04-09 2024-02-13 杭州华橙软件技术有限公司 视频显示方法、装置和存储介质及电子设备
CN115348478A (zh) * 2022-07-25 2022-11-15 深圳市九洲电器有限公司 设备交互显示方法、装置、电子设备及可读存储介质
CN115348478B (zh) * 2022-07-25 2023-09-19 深圳市九洲电器有限公司 设备交互显示方法、装置、电子设备及可读存储介质

Also Published As

Publication number Publication date
CN109729405B (zh) 2021-11-16
CN109729405A (zh) 2019-05-07

Similar Documents

Publication Publication Date Title
WO2020108092A1 (zh) 视频处理方法、装置、电子设备及存储介质
US11706484B2 (en) Video processing method, electronic device and computer-readable medium
CN109685726B (zh) 游戏场景处理方法、装置、电子设备以及存储介质
WO2020107989A1 (zh) 视频处理方法、装置、电子设备以及存储介质
CN109379624B (zh) 视频处理方法、装置、电子设备及存储介质
US20210287631A1 (en) Video Processing Method, Electronic Device and Storage Medium
US20210281718A1 (en) Video Processing Method, Electronic Device and Storage Medium
WO2020108091A1 (zh) 视频处理方法、装置、电子设备及存储介质
WO2020038127A1 (zh) 解码方法、装置、电子设备以及存储介质
US11490157B2 (en) Method for controlling video enhancement, device, electronic device and storage medium
CN109168065B (zh) 视频增强方法、装置、电子设备及存储介质
CN109587558B (zh) 视频处理方法、装置、电子设备以及存储介质
US11153525B2 (en) Method and device for video enhancement, and electronic device using the same
US11562772B2 (en) Video processing method, electronic device, and storage medium
WO2020108010A1 (zh) 视频处理方法、装置、电子设备以及存储介质
CN109361950B (zh) 视频处理方法、装置、电子设备及存储介质
WO2020108060A1 (zh) 视频处理方法、装置、电子设备以及存储介质
CN109587561B (zh) 视频处理方法、装置、电子设备及存储介质
CN109587555B (zh) 视频处理方法、装置、电子设备及存储介质
WO2020038071A1 (zh) 视频增强控制方法、装置、电子设备及存储介质
CN109167946B (zh) 视频处理方法、装置、电子设备以及存储介质
CN113038276A (zh) 视频播放方法、装置、电子设备及存储介质
CN109257636B (zh) 视频增强的切换方法、装置、电子设备及存储介质
CN109712100B (zh) 视频增强控制方法、装置以及电子设备
JP2013251765A (ja) 映像処理装置及び映像処理方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19889483

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19889483

Country of ref document: EP

Kind code of ref document: A1