CN114584831B - Video optimization processing method, device, equipment and storage medium for improving video definition - Google Patents
Video optimization processing method, device, equipment and storage medium for improving video definition Download PDFInfo
- Publication number
- CN114584831B CN114584831B CN202210068277.2A CN202210068277A CN114584831B CN 114584831 B CN114584831 B CN 114584831B CN 202210068277 A CN202210068277 A CN 202210068277A CN 114584831 B CN114584831 B CN 114584831B
- Authority
- CN
- China
- Prior art keywords
- video
- processing
- information
- rendered
- sharpening
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000005457 optimization Methods 0.000 title claims abstract description 52
- 238000003672 processing method Methods 0.000 title claims abstract description 29
- 238000012545 processing Methods 0.000 claims abstract description 191
- 238000001914 filtration Methods 0.000 claims abstract description 72
- 238000009877 rendering Methods 0.000 claims abstract description 70
- 238000000034 method Methods 0.000 claims abstract description 36
- 238000004364 calculation method Methods 0.000 claims abstract description 29
- 238000012805 post-processing Methods 0.000 claims abstract description 25
- 230000002146 bilateral effect Effects 0.000 claims description 20
- 230000000694 effects Effects 0.000 claims description 15
- 238000010586 diagram Methods 0.000 description 12
- 230000003796 beauty Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
- H04N21/440272—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA for performing aspect ratio conversion
Abstract
The embodiment of the invention discloses a video optimization processing method, a device, equipment and a storage medium for improving video definition, wherein the method comprises the following steps: video acquisition is carried out through the camera module to obtain video information; the video information is obtained through a post-processing module, filtering processing and sharpening processing are carried out on the video information to obtain video data to be rendered, wherein the filtering processing and the sharpening processing adopt different calculation methods according to different equipment parameters; and acquiring the video data to be rendered through a rendering processing module, and rendering the video data to be rendered based on the screen size. In the scheme, less data calculation amount is adopted, high-definition video playing is guaranteed, the video player can be deployed in a scene of real-time video playing, noise information in video is reduced, viewing experience of a user is optimized, and video definition can be remarkably improved.
Description
Technical Field
The embodiment of the application relates to the technical field of video processing, in particular to a video optimization processing method, device, equipment and storage medium for improving video definition.
Background
With the popularization of Internet live broadcast and short video technology, more and more people can know the condition of thousands of foreign countries and interact and communicate with the anchor of other countries through video live broadcast. However, it is accompanied by that people are no longer satisfied with video content, and higher requirements are put on video image quality and subjective definition. Both the anchor and the viewer expect to see more detailed scenes, see finer textured hairlines, etc., which require further optimization of the subjective sharpness of the video in live scenes.
The prior method for improving the subjective definition of the video generally achieves the aim of improving the subjective definition through a post-processing video enhancement algorithm, and the used post-processing video enhancement algorithm is generally divided into two types, wherein the commonly used enhancement algorithm directly improves the resolution of video frames through means such as super resolution and the like, so that pictures seen by human eyes are finer and smoother and clearer in sense. In another type of algorithm, the characteristic that human eyes are more sensitive to high-frequency signals is utilized, video frame details can be enhanced through the algorithm, and the contrast of picture details is improved, so that the purpose of improving subjective definition is achieved. However, the above method has a drawback that the super-resolution video enhancement algorithm needs to improve the resolution of the video frame by manual interpolation, which has a large calculation amount, and the real-time deployment of the super-resolution video enhancement algorithm on the mobile terminal equipment is difficult. Meanwhile, the traditional sharpening algorithm is very sensitive to noise, and can amplify the noise at the same time, so that the noise in a flat area is intolerable to users. In addition, the above-mentioned resolution enhancement schemes are mostly based on the image itself, and lack more reasonable parameter introduction to enhance video resolution and user viewing experience, and need improvement.
Disclosure of Invention
The embodiment of the invention provides a video optimization processing method, a device, equipment and a storage medium for improving video definition, which solve the problems that in the prior art, when video playing with high definition is ensured, the calculated data amount is large, video optimization deployment in a real-time scene cannot be performed, and meanwhile, noise is amplified when the video definition is improved.
In a first aspect, an embodiment of the present invention provides a video optimization processing method for improving video definition, where the method includes:
video acquisition is carried out through the camera module to obtain video information;
the video information is obtained through a post-processing module, filtering processing and sharpening processing are carried out on the video information to obtain video data to be rendered, wherein the filtering processing and the sharpening processing adopt different calculation methods according to different equipment parameters;
and acquiring the video data to be rendered through a rendering processing module, and rendering the video data to be rendered based on the screen size.
In a second aspect, an embodiment of the present invention further provides another video optimization processing method for improving video definition, including:
decoding the received coded data through a decoding module to obtain video data to be rendered;
and acquiring the video data to be rendered through a rendering processing module, and rendering the video data to be rendered based on the screen size.
In a third aspect, an embodiment of the present invention further provides a video optimization processing apparatus for improving video definition, including:
the camera module is used for acquiring video to obtain video information;
the post-processing module is used for carrying out filtering processing and sharpening processing on the video information to obtain video data to be rendered, wherein the filtering processing and the sharpening processing adopt different calculation methods according to different equipment parameters;
the rendering processing module is used for acquiring the video data to be rendered and rendering the video data to be rendered based on the screen size.
In a fourth aspect, an embodiment of the present invention further provides another video optimization processing apparatus for improving video definition, including:
the decoding module is used for decoding the received coded data to obtain video data to be rendered;
the rendering processing module is used for acquiring the video data to be rendered and rendering the video data to be rendered based on the screen size.
In a fifth aspect, an embodiment of the present invention further provides a video optimization processing device for improving video definition, where the device includes:
one or more processors;
storage means for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the video optimization processing method for improving video definition according to the embodiment of the present invention.
In a sixth aspect, embodiments of the present invention further provide a storage medium storing computer executable instructions that, when executed by a computer processor, are configured to perform the video optimization processing method for improving video sharpness according to the embodiments of the present invention.
In the embodiment of the invention, video information is acquired through the camera module, then the video information is acquired through the post-processing module, and the video information is subjected to filtering processing and sharpening processing to obtain the video data to be rendered, wherein the filtering processing and the sharpening processing adopt different calculation methods according to different equipment parameters, and then the video data to be rendered is acquired through the rendering processing module, so that the video data to be rendered is rendered based on the screen size, the video playing with less data calculation amount is realized, the video playing with high definition is ensured, noise information in the video is reduced at the same time under the scene of deployment and real-time video playing, and the video definition can be remarkably improved.
Drawings
Fig. 1 is a flowchart of a video optimization processing method for improving video definition according to an embodiment of the present invention;
FIG. 2 is a flowchart of a method for processing video information to generate video data to be rendered according to an embodiment of the present invention;
FIG. 3 is a flowchart of a method for sharpening video information according to an embodiment of the present invention;
fig. 4 is a flowchart of a method for performing rendering processing on video data to be rendered based on a screen size according to an embodiment of the present invention;
fig. 5 is an interface schematic diagram of rendering video data to be rendered by adopting a width direction scaling manner according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of an interface generated by rendering video data to be rendered in a manner of height direction scaling according to an embodiment of the present invention;
fig. 7 is a schematic diagram of image comparison before and after video optimization processing according to an embodiment of the present invention;
FIG. 8 is a flowchart of a method for determining a size adjustment factor according to a screen size of a current device according to an embodiment of the present invention;
FIG. 9 is a flowchart of another video optimization processing method for improving video definition according to an embodiment of the present invention;
fig. 10 is a block diagram of a video optimization processing device for improving video definition according to an embodiment of the present invention;
fig. 11 is a block diagram of another video optimization processing device for improving video definition according to an embodiment of the present invention.
Fig. 12 is a schematic structural diagram of a video optimization processing device for improving video definition according to an embodiment of the present invention.
Detailed Description
Embodiments of the present invention will be described in further detail below with reference to the drawings and examples. It should be understood that the particular embodiments described herein are illustrative only and are not limiting of embodiments of the invention. It should be further noted that, for convenience of description, only some, but not all of the structures related to the embodiments of the present invention are shown in the drawings.
The terms first, second and the like in the description and in the claims, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type and not limited to the number of objects, e.g., the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.
Fig. 1 is a flowchart of a video optimization processing method for improving video definition, which is provided in an embodiment of the present invention, and can be applied to processing live video to improve video definition, where the method can be executed by a computing device, such as a host computer, an intelligent terminal, a notebook, a tablet computer, and the like, and specifically includes the following steps:
step S101, video acquisition is carried out through a camera module to obtain video information.
The camera module comprises a camera device and can collect video. Taking live video broadcast of a host as an example, the camera module can be used for collecting pictures containing the host, or when live video broadcast is carried out outdoors, the camera module can be used for shooting outdoors.
Optionally, different cameras or different setting parameters correspond to different resolutions of the acquired image. In one embodiment, the resolution at which the camera module captures images is set to the highest video recording resolution supported by the camera module to capture more video details from the video source.
In one embodiment, the process of video acquisition by the camera module to obtain video information includes: and scaling the acquired video based on the processing parameters of the equipment chip to obtain video information. In particular, considering that the acquired video information is subjected to complex special effects such as beauty treatment and make-up treatment, the time consumption of equipment with weaker computing capability is significantly increased. In the scheme, the collected video is scaled based on the processing parameters of the equipment chip. Specifically, the chip conditions used by each terminal device can be counted and ordered according to the computing power, and the collected video is scaled aiming at some chip devices with relatively poor computing power. Optionally, for the case that the zooming process is required, it may be first determined whether the resolution of the collected video is higher than a preset resolution (which may be set to 720P in an exemplary manner), if so, the collected video is zoomed, downsampled to 720P resolution, and then video information with low resolution is generated for the subsequent module to perform special effect processing. Therefore, the overall running speed of video optimization processing and the real-time performance of video playing are ensured.
Step S102, obtaining the video information through a post-processing module, and performing filtering processing and sharpening processing on the video information to obtain video data to be rendered.
The post-processing module is a module for performing image optimization processing on video information so as to obtain high-definition video. In one embodiment, the video data to be rendered is obtained by filtering and sharpening the video information. Unlike conventional sharpening, the scheme further combines sharpening with filtering to obtain video data to be rendered. The video data to be rendered can be data which is sent to a rendering module for rendering, such as data composed of pixel values of all pixel points in each frame of image.
Optionally, fig. 2 is a flowchart of a method for processing video information to generate video data to be rendered according to an embodiment of the present invention, and as shown in fig. 2, a process of performing filtering processing and sharpening processing on the video information to obtain the video data to be rendered may be:
step S1021, bilateral filtering processing is carried out on the video information to obtain filtering processing information, and sharpening processing is carried out on the video information to obtain sharpening processing information.
In which the problem of noise amplification due to sharpening is alleviated by performing bilateral filtering processing on video information. Specifically, the bilateral filtering processing is a blurring processing for edge protection of video frames, and aims to remove noise and simultaneously preserve edge information. When sharpening, the high-frequency edge information of the video frame is obtained by calculating the difference between the original pixel and the Gaussian blurred pixel in the video frame.
In one embodiment, both the bilateral filtering process and the sharpening process incorporate device parameters as reference and/or calculated parameters. The device parameters include the type of chip used by the device, the screen size of the device, and the like. I.e. different calculation methods are adopted according to different equipment parameters during the filtering process and the sharpening process.
Optionally, performing bilateral filtering processing on the video information to obtain filtering processing information includes: determination of the chip model of the current deviceAnd the filter radius is used for carrying out bilateral filtering processing on the video information based on the filter radius to obtain filtering processing information. For example, taking the device 1 with 1284x2778 screen resolution on an a14 chip and the device 2 with 750x1334 screen resolution on an A9 chip as an example, the devices with different chip types and resolutions need to adapt corresponding post-processing algorithms to achieve the optimal subjective definition effect. Alternatively, for the apparatus 1, a 5×5 filter is used when performing bilateral filtering processing; for the device 2, a 3×3 filter is used when performing bilateral filtering processing. When the radius of the filter is determined, the chip types of the devices can be sequentially ordered, for example, the chip types of the devices are sequentially ordered into A1, A2, the first-order and the first-order, wherein the higher the serial number is, the stronger the chip processing capability of the device is represented, the bilateral filtering processing is carried out by adopting a 5x5 filter for the devices with the chip types larger than A11, and the bilateral filtering processing is carried out by adopting a 3x3 filter for the devices with the chip types not larger than A11. Illustratively, the filtering information obtained by bilateral filtering can be recorded as a bilityal d(SoC),δ_space＝1,δ_color＝1/255 The pixel value of the video information after bilateral filtering processing with the space radius of d (SoC), the space kernel standard deviation of 1 and the value domain kernel standard deviation of 1/255 is represented. The value of d (SoC) is determined according to the type of the device chip (SoC), and the device having the SoC type greater than a11 uses a 5×5 filter to perform bilateral filtering processing, that is, the value of d (SoC) is 5, and the value of d (SoC) is 3 for the device having the SoC type not greater than a 11.
Optionally, fig. 3 is a flowchart of a method for sharpening video information according to an embodiment of the present invention, as shown in fig. 3, specifically including:
step S10211, blurring processing is carried out on the pixel points in the video information to obtain blurred pixel information.
The blurring processing may be gaussian blurring processing. Taking raw as the acquired video information as an example, blurring pixels in the video information to obtain blurred pixel information, and recording the blurred pixel information as a gaussian r＝3,δ＝0.8 In which gaussian r＝3,δ＝0.8 The pixel value after the gaussian blur processing with a blur radius of 3 and a standard deviation of 0.8 is shown.
Step S10212, the pixel information in the video information and the determined fuzzy pixel information are subjected to difference to obtain sharpening information to be processed.
Wherein the pixel information in the original video information is recorded as raw, and the sharpening information to be processed is the pixel information in the original video information and the gaussian determined in step S10211 r＝3,δ＝0.8 The difference is denoted as raw-gaussian r＝3,δ＝0.8 。
Step S10213, determining a size adjustment coefficient according to the screen size of the current equipment, and determining the product of the size adjustment coefficient and the sharpening information to be processed as sharpening information.
In the sharpening process, screen size is introduced as a reference quantity to calculate a size adjustment coefficient, and the product of the size adjustment coefficient and sharpening information to be processed is determined as sharpening information. Illustratively, the size adjustment coefficient is noted as beta width Where width represents the screen width in screen size. At this time, the calculated sharpening information is correspondingly marked as beta width (raw-gaussian r＝3,δ＝0.8 )。
Step S1022, calculating and generating video data to be rendered according to the filtering processing information and the sharpening processing information.
After the filtering processing information and the sharpening processing information are respectively obtained, the filtering processing information and the sharpening processing information are overlapped to calculate and generate video data to be rendered. The video data to be rendered is recorded as: sharp β_width,Soc Sharp is then β_width,Soc ＝biliteral d(SoC),δ_space＝1,δ_color＝1/255 +β width (raw-gaussian r＝3,δ＝0.8 )。
Step S103, the video data to be rendered is obtained through a rendering processing module, and the video data to be rendered is rendered based on the screen size.
After the video data to be rendered is obtained in step S102, the video data to be rendered is obtained through a rendering processing module and is rendered. In one embodiment, the rendering process is performed in different rendering manners based on the screen size.
Optionally, fig. 4 is a flowchart of a method for performing rendering processing on video data to be rendered based on a screen size according to an embodiment of the present invention, as shown in fig. 4, specifically including:
step S1031, determining the screen size of the current device.
In one embodiment, the screen size can be determined by reading the hardware information recorded by the device, or the screen size can be recorded and embedded into the rendering processing module according to the algorithm designer when adapting different devices.
Step S1032, judging whether the screen size is larger than the preset length-width ratio, if yes, executing step S1033, otherwise, executing step S1034.
The preset aspect ratio value may be, for example, 16:9.
and step S1033, rendering the video data to be rendered by adopting a width direction scaling mode.
Optionally, when the screen size is larger than the preset length-width ratio, the screen size is longer, and the video content is rendered in a width direction scaling mode, so that the video content is fully paved in the width direction, and further more subjective definition is achieved. Fig. 5 is a schematic diagram of an interface generated by rendering video data to be rendered by means of width direction scaling according to an embodiment of the present invention. Fig. 5 includes a region 01 and a region 02, wherein the region 01 is a region of video display content obtained when video content is rendered in the width direction so as to be full of the screen width direction, and the region 02 is a non-video display region such as an edge region composed of white or black.
Step S1034, rendering the video data to be rendered by adopting a height direction scaling mode.
Optionally, when the screen size is not greater than the preset aspect ratio, the screen size is more oblate, and at this time, the method of scaling in the height direction is adopted to render, so that the video content is fully paved in the height direction, and further more subjective definition is achieved. Fig. 6 is a schematic diagram of an interface generated by rendering video data to be rendered in a manner of height direction scaling according to an embodiment of the present invention, as shown in fig. 6. Fig. 6 includes a region 03 and a region 04, wherein the region 03 is a region of video display content obtained when video content is rendered in the height direction so as to be full of the screen width direction, and the region 04 is a non-video display region such as an edge region composed of white or black.
Fig. 7 is a schematic diagram of image comparison before and after video optimization processing, as shown in fig. 7, where the left side of fig. 7 is a video image generated by video optimization processing not provided by the present scheme, and the right side of fig. 7 is a video image generated by video optimization processing provided by the present scheme, and the sharpness is significantly due to the sharpness of the image when not processed.
According to the scheme, in the processing process of improving the definition of the video, the problem of large image noise caused by the original single sharpening processing mode is reduced by adopting a mode of combining bilateral filtering processing and sharpening processing, and meanwhile, when the camera module is used for video acquisition, the highest video recording resolution is adopted for recording so as to ensure that the definition of the source video is the highest, and meanwhile, the adaptive scaling processing is carried out based on the type of the equipment chip so as to ensure the video optimization processing speed. In the bilateral filtering processing and sharpening processing of video information, corresponding algorithm calculation is carried out by referring to equipment parameters, and the optimal subjective definition experience is obtained while equipment calculation load is excessively occupied. Meanwhile, when video rendering is carried out, different rendering strategies are adopted based on different screen sizes, so that the subjective definition of video display is further improved while the objective definition of the video is ensured. By the video optimization processing method, the processed video textures are clearer, and the characters are clearer.
In one embodiment, as shown in fig. 8, fig. 8 is a flowchart of a method for determining a size adjustment coefficient according to a screen size of a current device according to an embodiment of the present invention, which specifically includes:
step 201, obtaining the screen width of the current device, and calculating a width parameter value corresponding to the screen width according to a preset parameter calculation formula.
The screen width of the current device is illustratively denoted as width, and optionally, the preset parameter calculation formula may be:
and step S202, determining a width adjustment value according to the screen width and a preset threshold value, and determining the sum of the width parameter value and the width adjustment value as a size adjustment coefficient.
Illustratively, the width adjustment value is denoted as g (width), which is determined in accordance with a particular screen width. Alternatively, an exemplary arrangement obtained by the inventors performing a number of experimental verification is: when the screen width is greater than or equal to 828, the g (width) value is 0, and when the screen width is less than 828, the g (width) value is-0.1, the calculated size adjustment coefficient
Finally, the determined size adjustment coefficient beta width Multiplying the obtained sharpening information by the obtained sharpening information, and adding the obtained sharpening information with the filtering information to obtain a final pixel value of the pixel point processed by the post-processing module.
From the above, different size adjustment coefficients are determined based on the screen size and then used in the sharpening process, and the processed video data to be rendered is finally generated, so that the definition of the video obtained by final rendering is better.
Based on the technical scheme, before the video information is acquired by the post-processing module, the method further comprises the following steps: and carrying out special effect processing on the video information through a special effect processing module. The special effect processing is video information, and video special effect processing is preferably performed before the processing of the post-processing module, and the special effect processing can be, for example, performing beauty or filter processing on the acquired image by using an integrated beauty software module. After filtering and sharpening the video information to obtain video data to be rendered, the method further comprises the steps of: encoding video data to be rendered to obtain encoded data, sending the encoded data to a user terminal for decoding, and after the user terminal decodes, rendering the decoded data based on the screen size of the user terminal by a rendering processing module arranged at the user terminal to obtain finally displayed video information so as to ensure that the video definition of the anchor terminal and the user terminal are obviously improved.
Fig. 9 is a flowchart of another video optimization processing method for improving video definition, which is provided in an embodiment of the present invention, and can be applied to processing live video to improve video definition, where the method can be executed by a computing device, such as a client computer, an intelligent terminal, a notebook computer, a tablet computer, and the like, and specifically includes the following steps:
step S301, decoding the received encoded data through a decoding module to obtain video data to be rendered.
Optionally, the encoded data is encoded data obtained by encoding data after filtering processing and sharpening processing on video information in the embodiment of the present invention. And decoding the coded data to restore the video data to be rendered.
Step S302, the video data to be rendered is obtained through a rendering processing module, and the video data to be rendered is rendered based on the screen size.
Optionally, the processing manner of the rendering processing module for the video data to be rendered refers to the processing manner of the foregoing anchor side rendering processing module, that is, the screen size of the current device is determined, if the screen size is greater than a preset aspect ratio value, the video data to be rendered is rendered by adopting a width direction scaling manner, and if the screen size is not greater than the preset aspect ratio value, the video data to be rendered is rendered by adopting a height direction scaling manner, which is not repeated herein.
According to the scheme, the decoding module decodes the received coded data to obtain the video data to be rendered, the rendering processing module obtains the video data to be rendered, and the video data to be rendered is rendered based on the screen size, so that the video data to be rendered is rendered in a reasonable scaling size, the display effect of video content is optimized, and the viewing experience of a user is improved.
Fig. 10 is a block diagram of a video optimization processing device for improving video definition according to an embodiment of the present invention, where the device is configured to execute a video optimization processing method for improving video definition partially provided in the foregoing embodiment, and the device has functional modules and beneficial effects corresponding to the execution method. As shown in fig. 10, the apparatus specifically includes: a camera module 101, a post-processing module 102, and a rendering processing module 103, wherein,
the camera module 101 is used for acquiring video to obtain video information;
the post-processing module 102 is configured to perform filtering processing and sharpening processing on the video information to obtain video data to be rendered, where the filtering processing and the sharpening processing adopt different calculation methods according to different equipment parameters;
the rendering processing module 103 is configured to obtain the video data to be rendered, and render the video data to be rendered based on a screen size.
According to the scheme, video information is acquired through the camera module, then the video information is acquired through the post-processing module, filtering processing and sharpening processing are carried out on the video information to obtain video data to be rendered, wherein the filtering processing and the sharpening processing adopt different calculation methods according to different equipment parameters, the video data to be rendered is acquired through the rendering processing module, the video data to be rendered is rendered based on the screen size, the purpose of adopting less data calculation amount is achieved, high-definition video playing is ensured, noise information in video is reduced simultaneously under the scene of deployment and real-time video playing, and video definition can be remarkably improved.
In one possible embodiment, the camera module 101 is specifically configured to:
the camera module collects video based on the highest set resolution, and performs scaling processing on the collected video based on the processing parameters of the equipment chip to obtain video information.
In one possible embodiment, the post-processing module 102 is specifically configured to:
performing bilateral filtering processing on the video information to obtain filtering processing information, and performing sharpening processing on the video information to obtain sharpening processing information;
and calculating and generating video data to be rendered according to the filtering processing information and the sharpening processing information.
In one possible embodiment, the post-processing module 102 is specifically configured to:
and determining a filter radius according to the chip model of the current equipment, and carrying out bilateral filtering processing on the video information based on the filter radius to obtain filtering processing information.
In one possible embodiment, the post-processing module 102 is specifically configured to:
blurring processing is carried out on pixel points in the video information to obtain blurred pixel information;
the pixel information in the video information and the determined fuzzy pixel information are subjected to difference to obtain sharpening information to be processed;
and determining a size adjustment coefficient according to the screen size of the current equipment, and determining the product of the size adjustment coefficient and the sharpening information to be processed as sharpening information.
In one possible embodiment, the post-processing module 102 is specifically configured to:
acquiring the screen width of the current equipment, and calculating a width parameter value corresponding to the screen width according to a preset parameter calculation formula;
and determining a width adjustment value according to the screen width and a preset threshold value, and determining the sum of the width parameter value and the width adjustment value as a size adjustment coefficient.
In one possible embodiment, the post-processing module 102 is specifically configured to:
and superposing the pixel values of the corresponding pixel points in the filtering processing information and the sharpening processing information to obtain video data to be rendered.
In one possible embodiment, the rendering processing module 103 is specifically configured to:
and determining the screen size of the current equipment, if the screen size is larger than a preset length-width ratio value, rendering the video data to be rendered in a width direction scaling mode, and if the screen size is not larger than the preset length-width ratio value, rendering the video data to be rendered in a height direction scaling mode.
In a possible embodiment, the apparatus further includes a special effect processing module 104 and an encoding sending module 105, where the special effect processing module 104 is configured to perform special effect processing on the video information by using the special effect processing module before the video information is acquired by using the post-processing module;
the code transmitting module 105 is configured to: after filtering and sharpening the video information to obtain video data to be rendered, encoding the video data to be rendered to obtain encoded data, sending the encoded data to a user terminal for decoding, and then rendering the decoded data based on the screen size of the user terminal through a rendering processing module arranged at the user terminal.
Fig. 11 is a block diagram of another video optimization processing device for improving video definition according to an embodiment of the present invention, where the device is configured to execute a video optimization processing method for improving video definition partially provided in the foregoing embodiment, and the device has functional modules and beneficial effects corresponding to the execution method. As shown in fig. 11, the apparatus specifically includes: a decoding module 201 and a rendering processing module 202, wherein,
a decoding module 201, configured to decode the received encoded data to obtain video data to be rendered;
the rendering processing module 202 is configured to obtain the video data to be rendered, and render the video data to be rendered based on a screen size.
According to the scheme, in the video rendering process, the video data to be rendered is rendered based on the screen size, namely, the rendering strategies in different modes are performed according to different screen sizes, so that the definition of the video is obviously improved, and the visual experience of a user is ensured.
In one possible embodiment, the rendering processing module 202 is specifically configured to:
and determining the screen size of the current user terminal equipment, if the screen size is larger than a preset length-width ratio value, rendering the video data to be rendered in a width direction scaling mode, and if the screen size is not larger than the preset length-width ratio value, rendering the video data to be rendered in a height direction scaling mode.
Fig. 12 is a schematic structural diagram of a video optimization processing device for improving video definition according to an embodiment of the present invention, where, as shown in fig. 12, the device includes a processor 301, a memory 302, an input device 303, and an output device 304; the number of processors 301 in the device may be one or more, one processor 301 being taken as an example in fig. 12; the processor 301, memory 302, input device 303 and output device 304 in the apparatus may be connected by a bus or other means, in fig. 12 by way of example. The memory 202 is used as a computer readable storage medium for storing software programs, computer executable programs and modules, such as program instructions/modules corresponding to the video optimization processing method for improving video definition in the embodiment of the present invention. The processor 301 executes various functional applications of the device and data processing by running software programs, instructions and modules stored in the memory 302, i.e., implements the video optimization processing method for improving video definition described above. The input means 303 may be used to receive entered numeric or character information and to generate key signal inputs related to user settings and function control of the device. The output device 304 may include a display device such as a display screen.
The embodiment of the present invention also provides a storage medium containing computer executable instructions, which when executed by a computer processor, are used to perform a video optimization processing method for improving video definition described in the above embodiment, specifically including:
video acquisition is carried out through the camera module to obtain video information;
the video information is obtained through a post-processing module, filtering processing and sharpening processing are carried out on the video information to obtain video data to be rendered, wherein the filtering processing and the sharpening processing adopt different calculation methods according to different equipment parameters;
and acquiring the video data to be rendered through a rendering processing module, and rendering the video data to be rendered based on the screen size. Or,
decoding the received coded data through a decoding module to obtain video data to be rendered;
and acquiring the video data to be rendered through a rendering processing module, and rendering the video data to be rendered based on the screen size.
It should be noted that, in the embodiment of the video optimization processing apparatus for improving video definition, each unit and module included in the video optimization processing apparatus are only divided according to the functional logic, but not limited to the above division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the embodiments of the present invention.
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the embodiments of the present invention are not limited to the particular embodiments described herein, but are capable of numerous obvious changes, rearrangements and substitutions without departing from the scope of the embodiments of the present invention. Therefore, while the embodiments of the present invention have been described in connection with the above embodiments, the embodiments of the present invention are not limited to the above embodiments, but may include many other equivalent embodiments without departing from the spirit of the embodiments of the present invention, and the scope of the embodiments of the present invention is determined by the scope of the appended claims.
Claims (15)
1. The video optimization processing method for improving the video definition is characterized by comprising the following steps:
video acquisition is carried out through the camera module to obtain video information;
the video information is obtained through a post-processing module, filtering processing and sharpening processing are carried out on the video information to obtain video data to be rendered, wherein the filtering processing and the sharpening processing adopt different calculation methods according to different equipment parameters, the different equipment parameters correspond to different filter radiuses and size adjustment coefficients, the filter radiuses are used for carrying out filtering processing calculation, and the size adjustment coefficients are used for carrying out sharpening processing calculation;
and acquiring the video data to be rendered through a rendering processing module, and rendering the video data to be rendered based on the screen size.
2. The method for improving video definition according to claim 1, wherein the video acquisition by the camera module obtains video information, comprising:
the camera module collects video based on the highest set resolution, and performs scaling processing on the collected video based on the processing parameters of the equipment chip to obtain video information.
3. The method for improving video definition according to claim 1, wherein the filtering and sharpening the video information to obtain video data to be rendered comprises:
performing bilateral filtering processing on the video information to obtain filtering processing information, and performing sharpening processing on the video information to obtain sharpening processing information;
and calculating and generating video data to be rendered according to the filtering processing information and the sharpening processing information.
4. The video optimization processing method for improving video definition according to claim 3, wherein said performing bilateral filtering processing on said video information to obtain filtering processing information comprises:
and determining a filter radius according to the chip model of the current equipment, and carrying out bilateral filtering processing on the video information based on the filter radius to obtain filtering processing information.
5. The method for improving video definition according to claim 3, wherein said sharpening the video information to obtain sharpening information comprises:
blurring processing is carried out on pixel points in the video information to obtain blurred pixel information;
the pixel information in the video information and the determined fuzzy pixel information are subjected to difference to obtain sharpening information to be processed;
and determining a size adjustment coefficient according to the screen size of the current equipment, and determining the product of the size adjustment coefficient and the sharpening information to be processed as sharpening information.
6. The video optimization processing method for improving video definition according to claim 5, wherein said determining a size adjustment coefficient according to a screen size of a current device comprises:
acquiring the screen width of the current equipment, and calculating a width parameter value corresponding to the screen width according to a preset parameter calculation formula;
and determining a width adjustment value according to the screen width and a preset threshold value, and determining the sum of the width parameter value and the width adjustment value as a size adjustment coefficient.
7. The video optimization processing method for improving video definition according to claim 3, wherein said generating video data to be rendered according to said filtering processing information and said sharpening processing information calculation includes:
and superposing the pixel values of the corresponding pixel points in the filtering processing information and the sharpening processing information to obtain video data to be rendered.
8. The video optimization processing method for improving video definition according to claim 1, wherein the rendering the video data to be rendered based on the screen size comprises:
and determining the screen size of the current equipment, if the screen size is larger than a preset length-width ratio value, rendering the video data to be rendered in a width direction scaling mode, and if the screen size is not larger than the preset length-width ratio value, rendering the video data to be rendered in a height direction scaling mode.
9. The video optimization processing method for improving video definition according to claim 1, further comprising, before acquiring the video information by a post-processing module:
performing special effect processing on the video information through a special effect processing module;
after filtering and sharpening the video information to obtain video data to be rendered, the method further comprises the steps of:
and encoding the video data to be rendered to obtain encoded data, transmitting the encoded data to a user terminal for decoding, and then rendering the decoded data based on the screen size of the user terminal through a rendering processing module arranged at the user terminal.
10. The video optimization processing method for improving the video definition is characterized by comprising the following steps:
the method comprises the steps of decoding received coded data through a decoding module to obtain video data to be rendered, wherein the coded data are obtained by coding data obtained by carrying out filtering treatment and sharpening treatment on video information, different equipment parameters correspond to different filter radiuses and size adjustment coefficients, the filter radiuses are used for carrying out filtering treatment calculation, and the size adjustment coefficients are used for carrying out sharpening treatment calculation;
and acquiring the video data to be rendered through a rendering processing module, and rendering the video data to be rendered based on the screen size.
11. The video optimization processing method for improving video definition according to claim 10, wherein the rendering the video data to be rendered based on the screen size comprises:
and determining the screen size of the current user terminal equipment, if the screen size is larger than a preset length-width ratio value, rendering the video data to be rendered in a width direction scaling mode, and if the screen size is not larger than the preset length-width ratio value, rendering the video data to be rendered in a height direction scaling mode.
12. Video optimization processing device for improving video definition, which is characterized by comprising:
the camera module is used for acquiring video to obtain video information;
the post-processing module is used for carrying out filtering processing and sharpening processing on the video information to obtain video data to be rendered, wherein the filtering processing and the sharpening processing adopt different calculation methods according to different equipment parameters, the different equipment parameters correspond to different filter radiuses and size adjustment coefficients, the filter radiuses are used for carrying out filtering processing calculation, and the size adjustment coefficients are used for carrying out sharpening processing calculation;
the rendering processing module is used for acquiring the video data to be rendered and rendering the video data to be rendered based on the screen size.
13. Video optimization processing device for improving video definition, which is characterized by comprising:
the decoding module is used for decoding the received coded data to obtain video data to be rendered, the coded data is obtained by coding the data subjected to filtering processing and sharpening processing on the video information, different equipment parameters correspond to different filter radiuses and size adjustment coefficients, the filter radiuses are used for performing filtering processing calculation, and the size adjustment coefficients are used for performing sharpening processing calculation;
the rendering processing module is used for acquiring the video data to be rendered and rendering the video data to be rendered based on the screen size.
14. A video optimization processing apparatus that improves video sharpness, the apparatus comprising: one or more processors; storage means for storing one or more programs that, when executed by the one or more processors, cause the one or more processors to implement the video optimization processing method of improving video sharpness as claimed in any of claims 1-12.
15. A storage medium storing computer executable instructions which, when executed by a computer processor, are for performing the video optimization processing method of improving video sharpness of any of claims 1-12.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210068277.2A CN114584831B (en) | 2022-01-20 | 2022-01-20 | Video optimization processing method, device, equipment and storage medium for improving video definition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210068277.2A CN114584831B (en) | 2022-01-20 | 2022-01-20 | Video optimization processing method, device, equipment and storage medium for improving video definition |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114584831A CN114584831A (en) | 2022-06-03 |
| CN114584831B true CN114584831B (en) | 2024-04-02 |
Family
ID=81769307
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210068277.2A Active CN114584831B (en) | 2022-01-20 | 2022-01-20 | Video optimization processing method, device, equipment and storage medium for improving video definition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114584831B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116385308A (en) * | 2023-04-15 | 2023-07-04 | 杨利容 | Combined image processing optimization strategy selection system |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006349934A (en) * | 2005-06-15 | 2006-12-28 | Nec Viewtechnology Ltd | Video adjustment system and video adjustment method |
| CN101630502A (en) * | 2009-08-03 | 2010-01-20 | 深圳创维－Rgb电子有限公司 | Image display method |
| CN104572042A (en) * | 2013-10-15 | 2015-04-29 | 航天信息股份有限公司 | Cross-platform middleware device of mobile terminal equipment and implementation method of cross-platform middleware device of mobile terminal equipment |
| KR101552302B1 (en) * | 2014-04-28 | 2015-09-10 | 김진영 | System and method for searching image applied sharpening based on mobile communication terminal |
| CN106406794A (en) * | 2016-09-14 | 2017-02-15 | 乐视控股（北京）有限公司 | Screen adapting method and device |
| CN109783181A (en) * | 2019-01-31 | 2019-05-21 | 掌阅科技股份有限公司 | Screen is adapted to display methods, electronic equipment and computer storage medium |
| KR20190070134A (en) * | 2017-12-12 | 2019-06-20 | 인천대학교 산학협력단 | Image Resizing apparatus for Large Displays and method thereof |
| CN113038147A (en) * | 2019-12-09 | 2021-06-25 | 高秀丽 | Intelligent video parameter adjusting system |
| CN113727185A (en) * | 2021-08-20 | 2021-11-30 | 百果园技术(新加坡)有限公司 | Video frame playing method and system |
| CN113852860A (en) * | 2021-09-26 | 2021-12-28 | 北京金山云网络技术有限公司 | Video processing method, device, system and storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030231321A1 (en) * | 2002-03-25 | 2003-12-18 | Tatsuya Aoyama | Method of and system for image processing, method of and apparatus for image generation, and computer program |
-
2022
- 2022-01-20 CN CN202210068277.2A patent/CN114584831B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006349934A (en) * | 2005-06-15 | 2006-12-28 | Nec Viewtechnology Ltd | Video adjustment system and video adjustment method |
| CN101630502A (en) * | 2009-08-03 | 2010-01-20 | 深圳创维－Rgb电子有限公司 | Image display method |
| CN104572042A (en) * | 2013-10-15 | 2015-04-29 | 航天信息股份有限公司 | Cross-platform middleware device of mobile terminal equipment and implementation method of cross-platform middleware device of mobile terminal equipment |
| KR101552302B1 (en) * | 2014-04-28 | 2015-09-10 | 김진영 | System and method for searching image applied sharpening based on mobile communication terminal |
| CN106406794A (en) * | 2016-09-14 | 2017-02-15 | 乐视控股（北京）有限公司 | Screen adapting method and device |
| KR20190070134A (en) * | 2017-12-12 | 2019-06-20 | 인천대학교 산학협력단 | Image Resizing apparatus for Large Displays and method thereof |
| CN109783181A (en) * | 2019-01-31 | 2019-05-21 | 掌阅科技股份有限公司 | Screen is adapted to display methods, electronic equipment and computer storage medium |
| CN113038147A (en) * | 2019-12-09 | 2021-06-25 | 高秀丽 | Intelligent video parameter adjusting system |
| CN113727185A (en) * | 2021-08-20 | 2021-11-30 | 百果园技术(新加坡)有限公司 | Video frame playing method and system |
| CN113852860A (en) * | 2021-09-26 | 2021-12-28 | 北京金山云网络技术有限公司 | Video processing method, device, system and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| Joint edge-directed interpolation and adaptive sharpening filter;R. Vanam et al.;《2013 IEEE Global Conference on Signal and Information Processing》;767-770 * |
| 拼接式高清全景显示系统设计及超分辨率算法研究;龚志鹏;《中国优秀硕士学位论文全文数据库信息科技辑(月刊)》(2022年第01期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114584831A (en) | 2022-06-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Rao et al. | A Survey of Video Enhancement Techniques. | |
| CN109729405B (en) | Video processing method and device, electronic equipment and storage medium | |
| US10257449B2 (en) | Pre-processing for video noise reduction | |
| AU2006252195B2 (en) | MPEG noise reduction | |
| EP2791897B1 (en) | Control of video processing algorithms based on measured perceptual quality characteristics | |
| CN111429357B (en) | Training data determining method, video processing method, device, equipment and medium | |
| CN109345490B (en) | Method and system for enhancing real-time video image quality of mobile playing terminal | |
| CN112889069B (en) | Methods, systems, and computer readable media for improving low light image quality | |
| CN113034384A (en) | Video processing method, video processing device, electronic equipment and storage medium | |
| CN109168065B (en) | Video enhancement method and device, electronic equipment and storage medium | |
| CN112150400B (en) | Image enhancement method and device and electronic equipment | |
| CN111242860B (en) | Super night scene image generation method and device, electronic equipment and storage medium | |
| Mangiat et al. | Spatially adaptive filtering for registration artifact removal in HDR video | |
| CN111353955A (en) | Image processing method, device, equipment and storage medium | |
| CN104869323A (en) | Modularized real-time video and image processing method base on GPU | |
| CN114584831B (en) | Video optimization processing method, device, equipment and storage medium for improving video definition | |
| CN110766637A (en) | Video processing method, processing device, electronic equipment and storage medium | |
| CN110378860B (en) | Method, device, computer equipment and storage medium for repairing video | |
| CN111429371A (en) | Image processing method and device and terminal equipment | |
| CN112565603B (en) | Image processing method and device and electronic equipment | |
| US20210327026A1 (en) | Methods and apparatus for blending unknown pixels in overlapping images | |
| US20220351701A1 (en) | Method and device for adjusting image quality, and readable storage medium | |
| WO2022261849A1 (en) | Method and system of automatic content-dependent image processing algorithm selection | |
| CN113613024B (en) | Video preprocessing method and device | |
| CN111179158A (en) | Image processing method, image processing apparatus, electronic device, and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |