WO2020038071A1

WO2020038071A1 - Video enhancement control method, device, electronic apparatus, and storage medium

Info

Publication number: WO2020038071A1
Application number: PCT/CN2019/090440
Authority: WO
Inventors: 林进全; 杨海; 彭德良
Original assignee: Oppo广东移动通信有限公司
Priority date: 2018-08-23
Filing date: 2019-06-06
Publication date: 2020-02-27
Also published as: CN109120979B; CN109120979A

Abstract

Embodiments of the present application disclose a video enhancement control method, a device, an electronic apparatus, and a storage medium. The method comprises: detecting whether an electronic apparatus is in a video playback state; if so, detecting a state of a control for controlling activation or deactivation of video enhancement; and if the detected state of the control indicates activation of video enhancement, performing video enhancement on a video being played. The method enables a user to perform a touch operation on the control during video playback to activate or deactivate video enhancement of the video being played, thereby facilitating user control of activating or deactivating video enhancement, and improving user experience.

Description

Video enhanced control method, device, electronic equipment and storage medium

Cross-reference to related applications

This application claims priority from a Chinese application with an application number of CN201810968779.4, filed on August 23, 2018, which is hereby incorporated by reference herein in its entirety for all purposes.

Technical field

The present application relates to the field of image processing technology, and more particularly, to a video enhanced control method, device, electronic device, and storage medium.

Background technique

With the development of society, the application of electronic devices with screens continues to expand. For example, it helps to display images such as pictures and videos on the screen. And the display quality of most electronic devices will be severely affected by changes in the surrounding light source or the quality of the source of the displayed video.

Summary of the Invention

In view of the above problems, this application proposes a video enhancement control method, device, electronic device, and storage medium to improve the above problems.

In a first aspect, the present application provides a video enhanced control method for an electronic device. The method includes: detecting whether the electronic device is in a video playing state; and detecting and controlling if the electronic device is in the video playing state. The state of the control, which is used to control whether video enhancement is turned on or off; if the state of the control control is detected to indicate that video enhancement is turned on, video enhancement is performed on the played video.

In a second aspect, the present application provides a video enhancement control device, which is applied to an electronic device, and the device includes a playback state detection unit for detecting whether the electronic device is in a video playback state;

A control state detection unit is configured to detect a state of a control control if it is detected that the electronic device is in the video playing state, the control control is used to control turning on or off video enhancement; a video enhancement unit is used to detect The state of the control is described to enable video enhancement, and perform video enhancement on the played video.

In a third aspect, the present application provides an electronic device including one or more processors and a memory; one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by all The one or more processors execute, and the one or more programs are configured to perform the method described above.

In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores program code, and the method is executed when the program code is run.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to explain the technical solutions in the embodiments of the present application more clearly, the drawings used in the description of the embodiments are briefly introduced below. Obviously, the drawings in the following description are just some embodiments of the application. For those skilled in the art, other drawings can be obtained based on these drawings without paying creative labor.

FIG. 1 shows another flowchart of video decoding provided by the present application.

FIG. 2 shows a flowchart of a video enhancement control method proposed in the present application.

FIG. 3 is a schematic diagram of an interface in a video enhancement control method proposed in the present application.

FIG. 4 shows a schematic diagram of a playback interface in a video enhancement control method proposed in the present application.

FIG. 5 shows a flowchart of another video enhancement control method proposed in the present application.

FIG. 6 shows a schematic diagram of control controls in another video enhancement control method proposed in the present application.

FIG. 7 shows a schematic diagram of a control being hidden in another video enhancement control method proposed in the present application.

FIG. 8 is a schematic diagram of another control control being hidden in another video enhancement control method proposed in the present application.

FIG. 9 shows a schematic diagram of a definition switching control in another video enhancement control method proposed in the present application.

FIG. 10 shows a schematic diagram of a sharpness alternative control in another video enhancement control method proposed by the present application.

FIG. 11 shows a flowchart of another video enhancement control method proposed in the present application.

FIG. 12 shows a structural block diagram of a video enhancement control device proposed in the present application.

FIG. 13 shows a structural block diagram of another video enhancement control device proposed in the present application.

FIG. 14 shows a structural block diagram of still another video enhancement control device proposed by the present application.

FIG. 15 shows a structural block diagram of an electronic device for performing a video enhancement control method according to an embodiment of the present application.

FIG. 16 is a storage unit for saving or carrying a program code for implementing an image processing method according to an embodiment of the present application.

detailed description

In the following, the technical solutions in the embodiments of the present application will be clearly and completely described with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

As the hardware performance of electronic devices improves, more electronic devices can support video playback. For example, an electronic device can run a video playback client and then play the video requested from the network through the video playback client, or it can run a web browser and then play the video in a web browser, or electronically The device can play video files stored locally through video playback software.

Regardless of whether the video is transmitted on the network or stored locally, when the video is generated, the generated video will be compressed in order to reduce the storage space occupation and facilitate the transmission on the network. Correspondingly, when the electronic device obtains the video, it will also obtain the video after compression encoding. In this case, the electronic device first performs video decoding on the compression-encoded video.

Generally, as shown in FIG. 1, the electronic device can perform video decoding by using two methods: hard decoding and soft decoding. Among them, hard decoding refers to decoding using non-CPU, such as GPU (Graphics Processing Unit), dedicated DSP, FPGA, ASIC chip, etc. Soft decoding refers to decoding using the CPU.

Specifically, as shown in FIG. 1, MediaFramework (multimedia framework) obtains a video file to be played through an API interface with a client or a web browser, and delivers the video file to VideoDecode. Among them, MediaFramework (multimedia framework) ) Is a multimedia framework in the operating system.

Regardless of the hard decoding or soft decoding, after decoding the video data, the decoded video data will be sent to SurfaceFlinger (Layer Transfer Module), and the decoded video data will be rendered and synthesized by SurfaceFlinger and displayed on the screen. Among them, SurfaceFlinger is an independent service that receives all Surfaces as input, calculates the position of each Surface in the final composite image according to ZOrder, transparency, size, position and other parameters, and then sends it to HWComposer or OpenGL to generate the final Display the buffer, and then display it to a specific display device.

The inventors have discovered that the video enhancement process can be added to both the hard decoding and soft decoding processes, so that subsequent videos played have higher video effects. For example, HQV (hollywood quality video) technology can be used to de-dry the edges of the video, adjust the exposure, or improve the sharpness. In addition, there are other ways to improve the video experience of the video being played, for example, to enhance the color brilliance.

However, the inventors further found that the control method for whether to perform video enhancement on the played video still needs to be improved. Therefore, a method, a device, an electronic device, and a storage medium for improving the convenience of control and intelligentized video enhancement provided by the application are proposed.

The content of this application will be described below in conjunction with specific embodiments.

Please refer to FIG. 2, a video enhanced control method provided in this application is applied to an electronic device, and the method includes:

Step S110: detecting whether the electronic device is in a video playing state.

In this application, the electronic device can identify whether it is currently in a video playing state in various ways.

As a mode, the step of detecting whether the electronic device is in a video playing state includes:

It is detected whether a preset video playback application is running in the electronic device; if it is detected that a preset video playback application is running, it is determined that the electronic device is in the video playback state. The electronic device may establish a list of video playback applications in advance, so that the video playback applications are recorded in the list. The list can be freely configured by the user of the electronic device, or can be determined according to the usage of a video playback application.

For example, as shown in FIG. 3, a plurality of applications are displayed in the interface shown in FIG. 3, and a status corresponding to each application is displayed. It can be understood that if the corresponding state of the application is "off" as shown in the figure, it means that the application is removed or not added to the above list, and if the corresponding state of the application is "on" as shown in the figure, it means The application is added to the above list. For example, for an application named "TX Video", its corresponding status is "On", which means that the application "TX Video" will exist in the aforementioned list. For an application named "AQY Video", the corresponding status is "Off", which means that the application "AQY Video" does not exist in the aforementioned list.

Furthermore, the electronic device can detect the frequency of use of each video playback application. If it detects that the frequency of use of a video playback program exceeds a set frequency, it can add the video playback application to the aforementioned list and correspondingly The state corresponding to the name of the video playback application in FIG. 3 is “ON”.

Then in this case, the electronic device can first detect which application is currently running in the foreground, and then further detect whether the application currently running in the foreground is on the list. If it is, then it is determined that the video is currently playing. . Among them, if the electronic device is an Android operating system, the name of the application currently running in the foreground can be obtained by executing the getRunningTasks method of the ActivityManager. In addition, the electronic device can also obtain a list of programs used by the user through UsageStatsManager, and identify the most recently used application recorded in the list as the current foreground application. In addition, you can also use Android's built-in accessibility function to monitor the focus change of the window and get the package name corresponding to the focus window as the application currently running in the foreground.

As another way, the electronic device can also determine whether a video is playing by detecting the return value of the AudioManager class. In this case, the electronic device may first detect the return value of the AudioManager class to determine whether there is audio output. If an audio output is detected, then further determine whether the electronic device is based on the foregoing detection of whether a video playback application is running. Whether the device is in video playback state.

Furthermore, as another way, the electronic device may also detect whether it is in a video playing state by detecting a touch state of a video playing button. For example, as shown in FIG. 4, a playback button 98 is displayed in the video playback interface 99 shown in FIG. 4, and the interface shown in FIG. 4 is in a state in which video playback is paused. In this case, after detecting that the playback button 98 is touched, it can be determined that the electronic device is currently in a video playback state. Correspondingly, if it is detected that the play button 98 is touched again after the electronic device is in a video playing state, it can be determined that the electronic device is in a video pause state, thereby canceling video enhancement. In this way, in the process of performing video enhancement, it is possible to perform video enhancement only on the video being played, without having to perform video enhancement on the picture displayed when playback is paused, so as to improve the enhancement efficiency.

It should be noted that, as a way, the video enhanced control method provided in this application may be executed by the aforementioned video playback application program, or may be executed by an electronic device independently of a program other than the video playback application program. Wherein, if the provided video enhancement control method can be executed by the aforementioned video playback application program, then the execution of the video enhancement control method can be executed by the video playback application program corresponding to a child process included in the main process, in order to Avoid impacting other features of the video playback application during the video enhancement method. If the video enhanced control method is executed by a program other than the video playback application program in the electronic device, it may be executed by another application program independent of the video playback application program.

Step S120: if it is detected that the electronic device is in the video playing state, a state of a control control is detected, and the control control is used to control whether video enhancement is turned on or off.

It can be understood that the electronic device can establish a variable, and then use the value of the variable to identify the state of the control. For example, if the value of the variable is 0, it means that the control is in a state that indicates that video enhancement is turned off, and if the value of the variable is 1, it means that the control is in a state that indicates that video enhancement is turned on. Then in this case, after the electronic device detects that it is in a video playing state, it can detect the value of the variable to determine the state of the control.

Optionally, the value of the variable can be stored in a pre-established data table. In this case, after detecting that the video device is in a video playing state, the electronic device can obtain the aforementioned variable value by looking up a table, and then judge the state of the control.

In addition, when an application is installed on an electronic device, the storage location of its corresponding configuration file is relatively fixed. As another way, the variable value can also be stored in the corresponding configuration file of the video playback application. in. In this case, after detecting that the video playback application is installed, and after detecting that the installed video playback application is set as the set video playback application, the electronic device may configure the video playback application in the configuration. Find any file in txt format in the folder, then add a variable to the found file in txt format, and then use the value of the variable as the aforementioned variable value. In this way, you can use the configuration file of the video playback application to detect the state of the control without adding a new file, and because it is the configuration file of the video playback application itself, it can be very good. Distinguish the state of the control controls corresponding to a certain video playback application.

In this case, in order to avoid affecting the original function of the configuration file, as a way, variables can be added to the configuration file in a comment manner. For example, for a txt format file, the characters beginning with "//" or "/ *" comment the content. Then, in this case, when the variable configured by the electronic device is hqv, the content inserted into the txt file may be “// hqv = 1”, which means that video enhancement is turned on.

It should be noted that after some applications are updated or reinstalled, their corresponding configuration files will be modified or replaced by other files. Then in this case, if it is detected that the set video playback application is updated or reinstalled, you can first detect whether the previously selected txt file still exists. If it exists, then further detect the updated or re- Whether the previously inserted variable can still be read out in the previously selected txt corresponding to the installed video playback application, and if the reading fails, insert the variable again in the aforementioned manner. If it is detected that the previously selected txt file does not exist, reselect the txt file.

The following describes the above content through a specific application program.

If the electronic device detects that a video playback application named TX video is installed, it will further detect whether the TX video is configured as a set video playback application. If it is detected that the TX video is configured as a set video playback application, the electronic device further searches for a file in the txt format from the folder of the configuration file of the TX video. After any search for a name named tx.txt, a piece of data is inserted into the tx.txt, the data content is "// hqv = 1", to indicate that the control corresponding to the TX video is in the state of enabling video enhancement, Then, if it is detected that the control corresponding to the TX video is touched, the electronic device will correspondingly modify the originally inserted content to “// hqv = 0” to indicate that the control corresponding to the TX video is in the status of turning off video enhancement. status.

Then, after detecting that the TX video is updated or reinstalled, the electronic device will detect whether the tx.txt file still exists in the configuration file corresponding to the TX video. If it exists, it will be further tested whether it can be read from tx.txt The contents of "// hqv = 1" or "// hqv = 1", if it is, the previous configuration is still valid. If it cannot be read out, "// hqv = 1" is inserted into tx.txt by default . If the electronic device finds that it cannot find the tx.txt file, it can select another txt file.

It should be noted that, for the selected storage variable file corresponding to each video playback application, the file may be stored in the electronic device in a data table manner for the electronic device to find.

It should be noted that the aforementioned files in txt format and variable values are all exemplary, and are not specifically limited in this application. The electronic device can be set specifically according to the format file that can be found. For example, you can also use xml format files to store variable values.

As one way, the control control runs independently of the video playback application. Then, step S120 may include detecting a state of a control control independent of the preset video playback application.

Step S130: if it is detected that the state of the control control indicates that video enhancement is enabled, perform video enhancement on the played video.

In this application, the electronic device may perform video enhancement on the played video based on a variety of ways. For example, the electronic device may perform video enhancement on the played video according to the attributes of the played video. The attributes include sharpness and color information.

As a way, the electronic device can extract a frame of the target image from the played video as the basis for the attribute judgment. It can be understood that if an image is already blurred, then if it is blurred again, the high-frequency components in the image will not change much. However, if the image itself has a high definition, if it is blurred once, the high-frequency component will change very much. Then, as a method, the electronic device may obtain a degraded image of the target image by performing a blurring process (for example, Gaussian blurring process), and then compare the adjacent pixels of the image before the blurring process and the image after the blurring process. The change of the value determines the sharpness value according to the magnitude of the change. Then in this case, the larger the change, the higher the sharpness of the target image.

In addition, in addition to determining the sharpness of the target image by performing blur processing on the target image, other methods may be used to calculate the sharpness. Optionally, you can use the following calculation formula

D (f) = ∑ _y ∑ _x | f (x + 2, y) -f (x, y) | ²

To determine sharpness. Among them, f (x, y) represents the gray value of the pixel point (x, y) corresponding to image f, and D (f) is the result of calculating the image sharpness. Optionally, in this application, f (x, y) may select a high-frequency component region in the real-time preview image.

Then, in this case, if it is detected that the sharpness of the target image is lower than a set value, video enhancement in terms of sharpness may be performed on the played video.

Moreover, the color information can be defined by the degree of color cast in this application. As one way, the electronic device can determine the current degree of color cast by using the chromaticity distribution of the target image and the chromaticity average value. As a method, when the electronic device detects that the chromaticity distribution of the target image is basically a single peak, or the distribution is relatively concentrated, and the average chromaticity is greater than a set value, it is determined that the target image has a color shift. In addition, the color shift value can be determined as the color information according to the pre-established correspondence between the chromaticity average value and the color shift.

In addition, the electronic device can also determine which aspects of video and video enhancement are performed according to the environment in which the electronic device is located. For example, it can determine whether to perform brightness video on the played video according to the intensity of the ambient light in which the electronic device is located. Enhanced.

It should be noted that if two applications at the front of the electronic device have split screens for video playback at the same time, the electronic device may select one of the played videos for video enhancement, or simultaneously display two applications for split screen display. Each of the videos played is video enhanced. Among them, as a method, if the electronic device is provided with a camera on the same side of the screen, the current eyeball attention area of the user can be collected through the camera, so that when the electronic device displays the interface of the two applications on a separate screen, Video enhancement may be performed on a video displayed by an interface of an application program closer to the area of interest.

A video enhanced control method provided by the present application is to detect whether an electronic device is in a video playing state, and if the electronic device is detected to be in the video playing state, detect a state of a control that is used to respond to a touch. The control operation controls video enhancement on or off. If the state of the control control is detected to indicate that video enhancement is on, video enhancement is performed on the played video. Therefore, during the video playing process, the user can perform touch operations on the control controls to turn on or off the video enhancement of the played video, thereby providing convenience for the user to control whether or not the video enhancement is performed, and improving the user experience.

Please refer to FIG. 5, a video enhanced control method provided in this application is applied to an electronic device, and the method includes:

Step S210: Detect whether the electronic device is in a video playing state.

Step S220: If it is detected that the electronic device is in the video playback state, the control controls are displayed on the video playback interface of the electronic device in a stacked manner, and the control controls are used to control whether video enhancement is turned on or off.

As shown in FIG. 6, if the electronic device detects that the electronic device is in the video playing state, the control control 97 is suspended and displayed on the video playing interface 99 shown in the figure. Among them, by touching the control control 97, the user can cause the control control 97 to switch between the two states of whether video enhancement is on or off. As one way, after the electronic device displays the control control 97, the user can slide the control control to move the control control out of the video playback interface 99. For example, as shown in FIG. 7, if the control shown in FIG. 6 is slid upwards in FIG. 6, the control 97 is slid upwards, and it is converted into a logo 96 shown in FIG. 7 after the sliding ends. Then in this case, if the user slides the logo 96 toward the lower side shown in FIG. 7, the control control 97 may be triggered to be displayed again in the style shown in FIG. 6.

In addition, in addition to sliding the control 97 toward the upper direction shown in FIG. 6, the control 97 can also be slid toward other directions. For example, as shown in FIG. 8, if the control control 97 is swiped toward the left side shown in FIG. 6, the converted logo 96 will appear correspondingly on the left side of the video playback interface.

There are various ways for when the control control is displayed on the video playback interface of the electronic device in a stacked manner.

As a method, when a user uses an electronic device, he or she can log in through a user account so that the electronic device can distinguish different users. Then, in this case, the electronic device may determine whether to display the control control according to the level of the logged-in user account. For example, the user account level can be pre-divided into first, second, and third levels from low to high, and video enhancement can only be performed by setting user accounts above the second level. Then the electronic device can further detect the level of the currently logged-in user account after detecting that it is in the video playback state. If it is detected that the level of the currently logged-in user account is level two or higher, then the electronic device can The control controls are displayed in a cascade on a video playback interface. If the electronic device detects that the level of the currently logged-in user account is lower than the second level, the electronic device may display a prompt message so as to prompt the user to upgrade the account and then perform video enhancement.

It should be noted that the aforementioned account may be an account for logging in to an operating system of the electronic device, or may be an account for a video playback application program that specifically performs video playback.

As a method, the electronic device detects a change frequency of consecutive multi-frame images included in the video played on the video playback interface; if the change frequency is greater than a set frequency, the video is displayed on the video playback interface of the electronic device in a stacked manner. Controls.

It can be understood that the played video includes multiple frames of images. The content of the video that is played will have a different frequency of change. For example, in the case where the video being played is a TV series or a movie type video, because the frequency of the picture change in the TV series or a movie type video is relatively high, in this case, the user is more expected to have a better video experience. For other video scenes, for example, knowledge-based explanations or videos of a certain course type, because the pictures will remain in the same state for a long time, only the corresponding audio data will change differently. For example, in some course-type video scenes, the picture will freeze on a PPT page for a long time, and the audio corresponding to the presentation of the content of the PPT page will change continuously. Then in this case, users are more concerned about the content being explained, and the requirements for the video experience will not be too high.

Then based on the above situation, as a way, obtain consecutive multi-frame images included in the played video, obtain respective content characteristics of the consecutive multi-frame images, and obtain the characteristics represented by the played video based on the content characteristics. How often the content of the screen changes.

As a way, the content characteristics of the image can be determined by obtaining the average gray value. In this manner, the electronic device may obtain respective grayscale average values of the continuous multi-frame images, and obtain respective content characteristics of the continuous multiframe images based on the grayscale average values.

The following describes the content characteristics of each of the consecutive multi-frame images obtained based on the gray average value.

You can first reduce the image to an 8x8 size, for a total of 64 pixels. The purpose of this step is to remove the differences in various picture sizes and picture proportions, and only retain basic information such as structure, light and shade. The reduced picture is then converted into a 64-level grayscale picture. Calculate the average gray value of all pixels in the picture. Compare the gray level of each pixel with the average. If it is greater than or equal to the average, it is recorded as 1, and if it is less than the average, it is recorded as 0. The comparison result of the previous step is combined to form a 64-bit binary integer. This is the fingerprint of this image. After getting the fingerprints of the images, you can compare the fingerprints of different images and calculate how many of the 64 bits are different. If the number of different data bits does not exceed 5, it means that the two images are very similar, and if it is greater than 10, it means that they are two different images. Then if after continuous detection and acquisition of n images, after detecting that the adjacent two images are not similar, the non-similarity is increased by 1, then the non-similarity obtained after the comparison of the n images is divided by the aforementioned n, so The value obtained is the frequency of change.

Then in this case, in order to be able to more flexibly determine the actual needs of the current user, if it is detected that the change frequency is greater than the set frequency, that is, the video currently playing is a TV series or a movie video, it can be displayed in the The control controls are stacked and displayed on the video playback interface of the electronic device, so as to remind the user that the electronic device can further enhance the video, thereby improving the video experience of playing the video.

In addition, as another way, the electronic device can detect the resolution of the video played on the video playback interface; if the resolution of the video played on the video playback interface is a set resolution, the video playback on the electronic device is The control controls are displayed in layers on the interface.

It can be understood that when electronic devices play videos with different resolutions, the displayed sharpness will be different, and as the resolution increases, the videos played by electronic devices will become clearer. Then in one case, the set resolution is the highest resolution supported by the video played by the video playback interface.

It should be noted that when an electronic device plays a video, the resolution of the played video will be affected by the resolution that the played video itself can support and the resolution supported by the electronic device itself. For example, if the resolution of the video itself is from low to high, there may be standard definition, high definition, and ultra clear, and the resolution supported by the electronic device from low to high is also standard definition, high definition, and ultra clear. If it is detected that the highest resolution supported by the electronic device is high-definition, even if the resolution of the played video supports ultra-clear resolution, the highest resolution supported by the played video is still high-definition.

Furthermore, if the highest resolution supported by the video being played is lower than the resolution supported by the electronic device, in this case, even if the user uses the electronic device for video playback, the highest resolution of the video being played is still being played. The highest resolution supported by the video. Then, in order to remind the user that the video experience of the played video can be further improved, it can be detected that the highest resolution supported by the played video is lower than the highest resolution supported by the electronic device. The control controls are stacked and displayed on the video playback interface, so that it is convenient for the user to trigger the electronic device to perform video enhancement through the control controls, so that the played video can show a better playback effect than the highest resolution that it can support. Play effect.

For example, as shown in FIG. 9, in the figure shown in FIG. 9, a sharpness switching control 95 is shown. When the user clicks the sharpness switching control 95, as shown in FIG. 10, a sharpness alternative control may be displayed. 94. In the sharpness alternative control 94, a sharpness that can be selected is displayed. For example, as shown in FIG. 10, the highest resolution supported by the played video is super clear, so in this case, If the highest resolution supported by the electronic device is ultra-clear or even a 4K model with a higher resolution than ultra-clear, the control controls 97 can be displayed on the interface. Therefore, in the case that the played video has been played at the highest resolution that it can support, after the control is displayed, the user can trigger the control to be in the state of enabling video enhancement, so that the electronic device can The video is enhanced by video, so that the played video can show a better playback effect than the playback effect corresponding to the highest resolution it can support.

It can be understood that the video playing application may be a video playing online, and during the online video playing process, the data of the played video is obtained from the network in real time. The size of the storage space occupied by videos of different resolutions will be different. For example, for the same video content, video content in SD mode may occupy 200MB of storage space, while video content in HD mode may occupy 700MB of storage space. The same is true during the transmission process. For higher-resolution video content, the larger the network bandwidth occupied by the transmission.

In this case, optionally, the electronic device may detect that if the resolution of the video played by the video playback interface is a set resolution, and detect that the network quality of the network connected to the electronic device is lower than the set After the conditions are met, the resolution of the played video is reduced; the control controls are displayed on the video playback interface of the electronic device in a layered manner.

Among them, the electronic device can detect the current network quality in various ways. For example, an electronic device can evaluate the quality of a network through its retransmission rate.

It should be noted that if the electronic device is connected to the network based on the TCP protocol, the electronic device uses a sliding window to manage the sending and receiving process of basic data, and at the same time ensures the effective and reliable transmission of the data stream, so that the sending rate is not significantly faster. At the receiving rate. Among them, if the electronic device does not receive the confirmation information before the timer expires, it is determined that a retransmission timeout occurs, and the electronic device automatically retransmits the data sent before the timeout.

Furthermore, if the electronic device is stuck during playback of the video multiple times, it means that the electronic device is stuck during the decoding process of the video to be played, or it is receiving network data. Stuck, which in turn will cause a poor user experience. Then the electronic device can also evaluate the quality of the network by detecting the number of stalls during the video playback during a preset period of time.

For example, if an electronic device plays a video in an ultra-clear mode, and if the electronic device detects that the network quality is lower than a set condition through the above method, the resolution of the played video will be reduced to high-definition Mode, and in this case, the control controls may be displayed on the video playback interface of the electronic device, so that it is convenient for the user to trigger the video enhancement of the video played in the high-definition mode through the displayed control controls, and then Even though the electronic device plays video in high-definition mode, it can show better video effects than high-definition.

It should be noted that during the video enhancement process of the electronic device, the computing resource consumption of the CPU or GPU will be increased. If the electronic device detects that the network quality is not lower than the set condition, it can prompt the user whether to switch to a higher Resolution, and prompt the user whether to turn off video enhancement, so as to reduce the consumption of computing resources of the CPU or GPU after the network state is restored.

In this way, it is possible to ensure that the electronic device can not only play videos smoothly when the network status is poor, but also achieve better playback effects than the smooth playback resolution supported by the current network status. effect.

Step S230: In response to a touch operation acting on the control, the control is switched to a state indicating that video enhancement is enabled.

Step S240: if it is detected that the electronic device is in the video playing state, detect a state of a control control.

Step S250: If it is detected that the state of the control control indicates that video enhancement is enabled, perform video enhancement on the played video.

A video enhanced control method provided by the present application, by detecting whether an electronic device is in a video playing state, if it is detected that the electronic device is in the video playing state, it may be based on the resolution of the played video and the network of the electronic device. Status to determine whether to display control controls for turning video enhancement on or off in response to a touch operation control, and further detect the state of the control controls. If the state of the control controls is detected to indicate that video enhancement is on, Play the video for video enhancement. Therefore, during the video playing process, the user can perform touch operations on the control controls to turn on or off the video enhancement of the played video, thereby providing convenience for the user to control whether or not the video enhancement is performed, and improving the user experience.

Referring to FIG. 11, a video enhanced control method provided by this application is applied to an electronic device, and the method includes:

Step S310: It is detected whether the electronic device is in a video playing state.

Step S320: if it is detected that the electronic device is in the video playing state, a state of a control control is detected, and the control control is used to control whether video enhancement is turned on or off.

Step S330: if it is detected that the state of the control control indicates that video enhancement is enabled, perform video enhancement on the played video.

Step S340: In response to a touch operation acting on the control, the control is switched to a state indicating that video enhancement is turned off.

Step S350: if it is detected that the state of the control control indicates that video enhancement is on or off, cancel video enhancement on the played video.

A video enhanced control method provided by the present application is to detect whether an electronic device is in a video playing state, and if the electronic device is detected to be in the video playing state, detect a state of a control control used to respond to a touch The control operation controls video enhancement on or off. If the state of the control control is detected to indicate that video enhancement is on, video enhancement is performed on the played video. Therefore, during the video playing process, the user can perform touch operations on the control controls to turn on or off the video enhancement of the played video, thereby providing convenience for the user to control whether or not the video enhancement is performed, and improving the user experience.

Referring to FIG. 12, a video enhancement control apparatus 400 provided in the present application is applied to an electronic device. The apparatus 400 includes: a playback state detection unit 410, a control state detection unit 420, and a video enhancement unit 430.

The playback state detection unit 410 is configured to detect whether the electronic device is in a video playback state.

As a mode, the playback state detection unit 410 is configured to detect whether a preset video playback application is running in the electronic device; if it is detected that a preset video playback application is running, determine the electronic device In the video playing state.

A control state detection unit 420 is configured to detect a state of a control control if it is detected that the electronic device is in the video playback state, and the control control is used to control whether video enhancement is turned on or off.

As one way, the control control runs independently of the video playback application.

The video enhancement unit 430 is configured to perform video enhancement on the played video if the state of the control control is detected to enable video enhancement.

Please refer to FIG. 13, a video enhanced control device 500 provided in the present application is applied to an electronic device. The device 500 includes: a playback state detection unit 510, a control display unit 520, a control state switching unit 530, and a control state detection unit 540. And a video enhancement unit 550.

A playback state detection unit 510, configured to detect whether the electronic device is in a video playback state;

The control display unit 520 is configured to, if it is detected that the electronic device is in a video playing state, superimpose and display control controls on a video playing interface of the electronic device, and the control controls are used to control whether video enhancement is turned on or off.

The control state switching unit 530 is configured to switch the control control to a state indicating that video enhancement is enabled in response to a touch operation acting on the control control.

A control state detection unit 540 is configured to detect a state of a control control if it is detected that the electronic device is in the video playing state.

The video enhancement unit 550 is configured to perform video enhancement on the played video if the state of the control control is detected to enable video enhancement.

Referring to FIG. 14, a video enhancement control apparatus 600 provided in the present application is applied to an electronic device. The apparatus 600 includes a playback state detection unit 610, a control state detection unit 620, a video enhancement unit 630, and an enhancement cancellation unit 640.

The playback state detection unit 610 is configured to detect whether the electronic device is in a video playback state.

As a mode, the playback state detection unit 610 is configured to detect whether a preset video playback application is running in the electronic device; if it is detected that a preset video playback application is running, determine the electronic device In the video playing state.

A control state detection unit 620 is configured to detect a state of a control control if it is detected that the electronic device is in the video playback state, and the control control is used to control whether video enhancement is turned on or off.

A video enhancement unit 630 is configured to perform video enhancement on the played video if the state of the control control is detected to enable video enhancement.

The enhancement canceling unit 640 is configured to cancel the video enhancement of the played video if it is detected that the state of the control control indicates that video enhancement is on or off.

It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working processes of the devices and units described above can refer to the corresponding processes in the foregoing method embodiments, and are not repeated here. . In the several embodiments provided in this application, the coupling between the modules may be electrical, mechanical, or other forms of coupling. In addition, each functional module in each embodiment of the present application may be integrated into one processing module, or each module may exist separately physically, or two or more modules may be integrated into one module. The above integrated modules may be implemented in the form of hardware or software functional modules.

It should be noted that, in the present application, specifically how to encode audio data according to the type of audio encoding can use existing technology, which will not be described in detail in this application.

In summary, a video enhanced control method, device, electronic device, and storage medium provided by the present application detect whether the electronic device is in a video playing state, and if the electronic device is detected in the video playing state, control is detected. The state of the control, which is used to enable or disable the video enhancement in response to the touch operation control. If the state of the control control is detected to indicate that the video enhancement is enabled, the video enhancement is performed on the played video. Therefore, during the video playing process, the user can perform touch operations on the control controls to turn on or off the video enhancement of the played video, thereby providing convenience for the user to control whether or not the video enhancement is performed, and improving the user experience.

An electronic device provided in the present application will be described below with reference to FIG. 15.

Referring to FIG. 15, based on the above-mentioned image processing method and device, another electronic device 100 capable of executing the foregoing terminal control method is also provided in an embodiment of the present application. The electronic device 100 includes one or more processors (only one shown in the figure), a memory 104, a network module 106, a video codec 108, a camera 110, and a screen 112 coupled to each other. The memory 104 stores a program that can execute the content in the foregoing embodiment, and the processor 102 can execute the program stored in the memory 104.

The processor 102 may include one or more processing cores. The processor 102 uses various interfaces and lines to connect various parts of the entire electronic device 100, and executes or executes instructions, programs, code sets, or instruction sets stored in the memory 104 by calling or executing data stored in the memory 104 to execute Various functions and processing data of the electronic device 100. Optionally, the processor 102 may use at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). To implement a hardware form. The processor 102 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), and a modem. Among them, the CPU mainly handles the operating system, user interface, and application programs; the GPU is responsible for rendering and rendering of the displayed content; the modem is used for wireless communication. It can be understood that the modem may not be integrated into the processor 102, and may be implemented by a communication chip alone.

The memory 104 may include random access memory (Random Access Memory, RAM), and may also include read-only memory (Read-Only Memory). The memory 104 may be used to store instructions, programs, codes, code sets, or instruction sets. The memory 104 may include a storage program area and a storage data area. For example, the memory 104 may store a video enhancement control device. The video enhancement control device may be the foregoing device 400, device 500, or device 600. The storage program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), and instructions for implementing the following method embodiments. Wait. The storage data area may also store data (such as phonebook, audio and video data, and chat history data) created by the terminal 100 during use.

The network module 106 is used to receive and send electromagnetic waves, and realize the mutual conversion of electromagnetic waves and electrical signals, so as to communicate with a communication network or other equipment, such as communicating with a wireless access point. The network module 106 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption / decryption chip, a subscriber identity module (SIM) card, a memory, and the like . The network module 106 can communicate with various networks, such as the Internet, an intranet, and a wireless network, or communicate with other devices through a wireless network. The wireless network may include a cellular telephone network, a wireless local area network, or a metropolitan area network.

The video codec 108 can be used to encode the image collected by the camera 110 or decode the data requested by the network module 106 from the network for transmission to the screen 112 for display. Specifically, the video codec 108 may be a GPU, a dedicated DSP, an FPGA, an ASIC chip, or the like.

Please refer to FIG. 16, which shows a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application. The computer-readable medium 800 stores program code, and the program code can be called by a processor to execute the method described in the foregoing method embodiment.

The computer-readable storage medium 800 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read-Only Memory), an EPROM, a hard disk, or a ROM. Optionally, the computer-readable storage medium 800 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 800 has a storage space for program code 810 that performs any of the method steps in the above-described methods. These program codes can be read from or written into one or more computer program products. The program code 810 may be compressed, for example, in a suitable form.

Finally, it should be noted that the above embodiments are only used to describe the technical solution of the present application, rather than limiting it. Although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still Modifications to the technical solutions described in the foregoing embodiments, or equivalent replacements of some of the technical features thereof; and these modifications or replacements do not drive the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

A video enhanced control method, which is characterized in that it is applied to an electronic device, and the method includes:

Detecting whether the electronic device is in a video playing state;

If it is detected that the electronic device is in the video playing state, detecting a state of a control control for controlling whether video enhancement is turned on or off;

If the state of the control is detected to indicate that video enhancement is enabled, video enhancement is performed on the played video.
The method according to claim 1, wherein the step of detecting whether the electronic device is in a video playing state comprises:

Detecting whether a set video playback application is running in the electronic device;

If it is detected that a set video playback application is running, it is determined that the electronic device is in the video playback state.
The method according to claim 2, wherein the control control runs independently of the video playback application, and the step of detecting a state of the control control comprises:

Detecting a state of a control control independent of the preset video playback application.
The method according to claim 1, wherein the step of detecting whether the electronic device is in a video playing state comprises:

Detect the touch state of video playback buttons;

If it is detected that the playback button is touched, it is determined that the electronic device is in a video playback state;
The method according to claim 4, wherein, if the state of the control control is detected to indicate that video enhancement is enabled, the step of performing video enhancement on the played video comprises:

If the state of the control is detected to indicate that video enhancement is turned on, if the electronic device is in a video playing state, it is detected that the playback button is touched again, it is determined that the electronic device is in a video pause state, and video enhancement is cancelled.
The method according to claim 1, wherein the steps of detecting whether the electronic device is in a video playing state and the steps of detecting a state of a control control if the electronic device is detected in the video playing state It also includes:

The control controls are displayed in a layered manner on a video playback interface of the electronic device.

In response to a touch operation acting on the control control, the control control is switched to a state indicating that video enhancement is turned on.
The method according to claim 6, wherein the step of displaying the control controls in a layered manner on a video playback interface of the electronic device comprises:

Detecting a change frequency of consecutive multi-frame images included in a video played by the video playing interface;

If the change frequency is greater than a set frequency, the control controls are displayed in a layered manner on a video playback interface of the electronic device.
The method according to claim 7, wherein the step of detecting a change frequency of consecutive multi-frame images included in a video played on the video playback interface comprises:

Acquiring consecutive multi-frame images included in the played video;

Acquiring respective content characteristics of the consecutive multi-frame images;

Based on the content characteristics, a change frequency of picture content represented by the played video is obtained.
The method according to claim 8, wherein the step of obtaining respective content characteristics of the consecutive multi-frame images comprises:

Obtaining respective gray average values of the consecutive multi-frame images;

Content characteristics of each of the consecutive multi-frame images are acquired based on the gray average value.
The method according to claim 6, wherein the step of displaying the control controls in a layered manner on a video playback interface of the electronic device comprises:

Detecting a resolution of a video played on the video playback interface;

If the resolution of the video played on the video playback interface is a set resolution, the control controls are displayed in a stack on the video playback interface of the electronic device.
The method according to claim 6, wherein the set resolution is a highest resolution supported by a video played by the video playback interface.
The method according to claim 11, wherein the step of displaying the control controls in a layered manner on a video playback interface of the electronic device comprises:

If it is detected that the highest resolution supported by the played video is lower than the highest resolution supported by the electronic device, the control controls are displayed on the video playback interface of the electronic device in an overlay manner, so that it is convenient for users to trigger through the control controls The electronic device performs video enhancement, so that the played video can show a better playback effect than the playback effect corresponding to the highest resolution it can support.
The method according to claim 10, wherein if the resolution of the video played on the video playback interface is a set resolution, the control controls are displayed on the video playback interface of the electronic device in a stacked manner. The steps include:

If the resolution of the video played on the video playback interface is a set resolution, and after detecting that the network quality of the network to which the electronic device is connected is lower than a set condition, reducing the resolution of the played video;

The control controls are displayed in a layered manner on a video playback interface of the electronic device.
The method according to claim 6, wherein the step of displaying the control controls in a layered manner on a video playback interface of the electronic device comprises:

Detecting the level of the currently logged in user account of the video playback interface, and if it is detected that the level of the currently logged in user account meets a preset condition, the control controls are displayed on the video playback interface of the electronic device in a stacked manner.
The method according to claim 1, wherein if the state of the control control is detected to indicate that video enhancement is enabled, the step of performing video enhancement on the played video comprises:

If it is detected that the state of the control control indicates that video enhancement is enabled, video enhancement is performed on the played video according to the attributes of the played video, and the attribute information includes sharpness and color information.
The method according to claim 1, wherein if the state of the control control is detected to indicate that video enhancement is enabled, the step of performing video enhancement on the played video comprises:

If there are two applications on the front screen of the electronic device, split screens are used for video playback, select one of the videos to be played for video enhancement, or video for each of the two applications displayed in split screens Enhanced.
The method according to any one of claims 1 to 16, wherein after detecting that the state of the control control indicates that video enhancement is turned on, after the step of performing video enhancement on the played video further comprises:

If it is detected that the state of the control indicates that video enhancement is on or off, cancel video enhancement on the played video.
A video enhancement control device is characterized in that it is applied to electronic equipment, and the device includes:

A playback state detection unit, configured to detect whether the electronic device is in a video playback state;

A control state detection unit, configured to detect a state of a control control if it is detected that the electronic device is in the video playback state, the control control is used to control whether video enhancement is turned on or off;

A video enhancement unit is configured to perform video enhancement on the played video if the state of the control control is detected to enable video enhancement.
An electronic device, comprising one or more processors, a video codec and a memory;

One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs are configured to execute claim 1 -17 Any of the methods described.
A computer-readable storage medium, characterized in that the computer-readable storage medium stores program code, wherein the method according to any one of claims 1-17 is executed when the program code is run by a processor.