CN106899820A - For the method for real-time de-noising, device and terminal device in video call process - Google Patents
For the method for real-time de-noising, device and terminal device in video call process Download PDFInfo
- Publication number
- CN106899820A CN106899820A CN201510947209.3A CN201510947209A CN106899820A CN 106899820 A CN106899820 A CN 106899820A CN 201510947209 A CN201510947209 A CN 201510947209A CN 106899820 A CN106899820 A CN 106899820A
- Authority
- CN
- China
- Prior art keywords
- denoising
- scope
- terminal device
- acquisition module
- noise strength
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/21—Circuitry for suppressing or minimising disturbance, e.g. moiré or halo
- H04N5/213—Circuitry for suppressing or minimising impulsive noise
Abstract
The present invention discloses a kind of for the method for real-time de-noising, device and terminal device in video call process.The method includes：In video call process, the current code check of terminal device is obtained；The removing-noise strength factor of terminal device is determined according to the current code check；Removing-noise strength is determined according to the removing-noise strength factor；Denoising is carried out to vision signal according to the removing-noise strength.The present invention uses different denoising parameters for different code checks, to have reached and instruct video denoising by Rate Control to improve the purpose of video quality；The characteristics of present invention is for video calling, with reference to the method for video calling Rate Control, the scope and intensity of video denoising are controlled by the size of code check in Rate Control, while background noise is reduced, face part clean mark is kept as far as possible, and edge contour is completely undistorted.
Description
Technical field
It is more particularly to a kind of in video call process the present invention relates to Internet service field
The method of real-time de-noising, device and terminal device.
Background technology
In audio/video communication, Rate Control and video quality are that video calling smoothness is clearly closed
Key, how to combine Rate Control and video quality is a technical barrier, and video sequence
The reasons such as the deficiency due to illumination are often disturbed by noise, decline image quality, so video
Denoising is the key for improving video quality.
As described above, the video transmitted in the network of limited bandwidth need to compress by compressed encoding
Algorithm removes the redundancy of video information by motion compensation, and the presence of noise causes estimation
Accuracy rate reduction, therefore code efficiency reduction, code stream increase, it is higher for bandwidth requirement, and
And reduce anti-dropout ability, it is easier to cause network congestion.Therefore, in removal video sequence
Noise be necessary.
How low-light (level) noise is eliminated, and it is that a difficult point is asked to improve video image quality and reduce code stream
Topic.The method of video sequence denoising, substantially can be by time domain, and frequency domain is divided.Time domain passes through
Motion compensation technique, tracks in time domain and removes noise, is often realized in decoder internal, with
The association of encoder is larger.Frequency domain as by Fourier transformation for frequency domain is filtered, based on low pass
The method of filtering can remove the noise being concentrated mainly in signal high frequency, but also result in high frequency
The loss of interior image detail, therefore result in the contradiction of noise reduction and protection details.
The content of the invention
In view of above technical problem, the invention provides one kind for being gone in real time in video call process
Method, device and the terminal device made an uproar, different denoising parameters is used for different code checks, is reached
Video denoising is instructed by Rate Control to improve the purpose of video quality.
According to an aspect of the present invention, there is provided one kind is for real-time de-noising in video call process
Method, including：
In video call process, the current code check of terminal device is obtained；
The removing-noise strength factor of terminal device is determined according to the current code check；
Removing-noise strength is determined according to the removing-noise strength factor；
Denoising is carried out to vision signal according to the removing-noise strength.
In one embodiment of the invention, removing-noise strength is determined according to the removing-noise strength factor
The step of after, methods described also includes：
First denoising scope is determined according to the removing-noise strength factor；
Denoising is carried out to vision signal according to the removing-noise strength in the range of the first denoising.
In one embodiment of the invention, it is described also to include in video call process：
Obtain the CPU information of terminal device；
CPU information according to terminal device determines denoising strategy, wherein the denoising strategy includes
The step of second denoising scope, current code check of the terminal device of execution acquisition afterwards；
The step of denoising is carried out to vision signal according to the removing-noise strength in the range of the first denoising
Including：
3rd denoising scope is determined according to the first denoising scope and the second denoising scope；
Denoising is carried out to vision signal according to the removing-noise strength in the range of the 3rd denoising.
In one embodiment of the invention, it is true according to the first denoising scope and the second denoising scope
The step of fixed 3rd denoising scope, includes：
A denoising scope for selecting the scope in the first denoising scope and the second denoising scope minimum
As the 3rd denoising scope.
In one embodiment of the invention, in video call process, methods described also includes：
Obtain the power supply information of terminal device；
Power supply information according to terminal device judges whether to denoising；
If the power supply information according to terminal device judges to carry out denoising, perform and obtain terminal device
CPU information the step of.
In one embodiment of the invention, it is described vision signal is entered according to the removing-noise strength
The step of row denoising, includes：
Wavelet Denoising Method is carried out to vision signal according to the removing-noise strength.
According to another aspect of the present invention, there is provided a kind of for real-time de-noising in video call process
Device, including code check acquisition module, parameter acquisition module, intensity acquisition module and denoising module,
Wherein：
Code check acquisition module, in video call process, obtain terminal device to work as former code
Rate；
Parameter acquisition module, the current code check for being gathered according to code check acquisition module determines terminal
The removing-noise strength factor of equipment；
Intensity acquisition module, the removing-noise strength factor for being obtained according to parameter acquisition module determines
Removing-noise strength；
Denoising module, for carrying out denoising to vision signal according to the removing-noise strength.
In one embodiment of the invention, described device also includes the first scope acquisition module,
Wherein：
First scope acquisition module, for the removing-noise strength factor obtained according to parameter acquisition module
Determine the first denoising scope；And indicate denoising module in the range of the first denoising according to the denoising
Intensity carries out denoising to vision signal.
In one embodiment of the invention, described device also include CPU information acquisition module,
Second scope acquisition module and the 3rd range determination module, wherein：
CPU information acquisition module, in video call process, obtaining terminal device
CPU information；
Second scope acquisition module, for determining denoising plan according to the CPU information of terminal device
Slightly, wherein the denoising strategy includes the second denoising scope, code check acquisition module is indicated to hold afterwards
Row obtains the operation of the current code check of terminal device；
3rd range determination module, for the first denoising obtained according to the first scope acquisition module
The second denoising scope that scope and the second scope acquisition module are obtained determines the 3rd denoising scope；And
Denoising module is indicated to be gone to vision signal according to the removing-noise strength in the range of the 3rd denoising
Make an uproar.
In one embodiment of the invention, the 3rd range determination module is used to select the first scope
The second denoising model that the first denoising scope and the second scope acquisition module that acquisition module is obtained are obtained
Minimum zone in enclosing, as the 3rd denoising scope.
In one embodiment of the invention, described device also include power supply data obtaining module and
Identification module, wherein：
Power supply data obtaining module, in video call process, obtaining the confession of terminal device
Power information；
Identification module, denoising is judged whether to for the power supply information according to terminal device；If
Power supply information according to terminal device judges to carry out denoising, it indicates that CPU information acquisition module is held
Row obtains the operation of the CPU information of terminal device.
In one embodiment of the invention, denoising module is used for according to the removing-noise strength to regarding
Frequency signal carries out Wavelet Denoising Method.
According to another aspect of the present invention, there is provided a kind of for real-time de-noising in video call process
Terminal device, including described in any of the above-described embodiment for real-time de-noising in video call process
Device.
The characteristics of present invention is for video calling, with reference to the method for video calling Rate Control, leads to
The size for crossing code check in Rate Control controls the scope and intensity of video denoising, for different code checks
Using different denoising parameters, more details can be so retained in the case where code check is high, and
When code check is low, removal noise as much as possible reduces code check.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will
The accompanying drawing to be used needed for embodiment or description of the prior art is briefly described, it is clear that
Ground, drawings in the following description are only some embodiments of the present invention, for the common skill in this area
For art personnel, without having to pay creative labor, can also be obtained according to these accompanying drawings
Obtain other accompanying drawings.
Fig. 1 is the method one embodiment of the present invention for real-time de-noising in video call process
Schematic diagram.
Fig. 2 is the present invention to be shown for another embodiment of method of real-time de-noising in video call process
It is intended to.
Fig. 3 is the device one embodiment of the present invention for real-time de-noising in video call process
Schematic diagram.
Fig. 4 is device another embodiment of the present invention for real-time de-noising in video call process
Schematic diagram.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, to the technical scheme in the embodiment of the present invention
It is clearly and completely described, it is clear that described embodiment is only a real part of the invention
Example is applied, rather than whole embodiments.Below to the description reality of at least one exemplary embodiment
On be merely illustrative, never as to the present invention and its application or any limitation for using.Base
Embodiment in the present invention, those of ordinary skill in the art are not making creative work premise
Lower obtained every other embodiment, belongs to the scope of protection of the invention.
Unless specifically stated otherwise, the part that otherwise illustrates in these embodiments and step it is relative
Arrangement, numerical expression and numerical value are not limited the scope of the invention.
Simultaneously, it should be appreciated that for the ease of description, the size of the various pieces shown in accompanying drawing
It is not to be drawn according to actual proportionate relationship.
May not make in detail for technology, method and apparatus known to person of ordinary skill in the relevant
Discuss, but in the appropriate case, the technology, method and apparatus should be considered as authorizing specification
A part.
In all examples shown here and discussion, any occurrence should be construed as merely and show
Example property, not as limitation.Therefore, the other examples of exemplary embodiment can have not
Same value.
It should be noted that：Similar label and letter represents similar terms in following accompanying drawing, therefore,
Once being defined in a certain Xiang Yi accompanying drawing, then need not it be entered to advance in subsequent accompanying drawing
One step discussion.
Fig. 1 is the method one embodiment of the present invention for real-time de-noising in video call process
Schematic diagram.Preferably, the present embodiment can be by the device for real-time de-noising in video call process
Perform.The method is comprised the following steps：
Step 101, in video call process, obtains the current code check r of terminal device.
Step 102, the removing-noise strength factor t of terminal device is determined according to the current code check.
In one embodiment of the invention, step 102 can include：According to formula (1) come
Obtain removing-noise strength factor t, wherein rmaxIt is maximal rate.
T=log (rmax/r) (1)
Step 103, removing-noise strength is determined according to the removing-noise strength factor.
When r gets over hour, removing-noise strength factor t is bigger, and removing-noise strength is bigger；Gone when r is bigger
Making an uproar, intensity factor t is smaller, and removing-noise strength is smaller；When r reaches maximum rmaxWhen removing-noise strength
Factor t is 0, and removing-noise strength is 0.
Step 104, is carried out according to the removing-noise strength to vision signal (YUV video data)
Denoising, wherein the removing-noise strength is used as the denoising parameter in Denoising Algorithm；Afterwards by denoising it
Data feeding video encoder afterwards.
In one embodiment of the invention, after step 103, methods described can also include：
First denoising scope is determined according to removing-noise strength factor t；According to described in the range of the first denoising
Removing-noise strength carries out denoising to vision signal.
In one embodiment of the invention, the first denoising model is determined according to removing-noise strength factor t
The step of enclosing can include：When t is less than 0.3 more than 0, the first denoising scope is Y plane,
Only carry out Y plane noise reduction；When t is more than 0.3, the first denoising scope is YUV planes,
Noise reduction is all then carried out to Y plane, U planes and V planes.
Based on the above embodiment of the present invention offer for real-time de-noising in video call process
Method, sets different denoising parameters to control the scope of denoising for different Rate Control values
And intensity.The Rate Control numerical value that the above embodiment of the present invention is obtained by terminal device, judges
Network bandwidth situation, when code check is relatively low, illustrates that the network bandwidth is smaller, now needs to increase
The scope and degree of video denoising, make video image smoothened, so as to preferably obtain as far as possible
Relatively low code check；When code check is higher, illustrate that bandwidth is preferable, it is possible to reduce the model of video denoising
Enclose and intensity, to keep more preferable details.
In one embodiment of the invention, it is described according to the removing-noise strength in step 104
The step of carrying out denoising to vision signal can include：According to the removing-noise strength, using small echo
Denoising Algorithm carries out denoising to vision signal, wherein the removing-noise strength is used as Wavelet Algorithm
In denoising parameter；The data after denoising are sent into video encoder afterwards.
In one embodiment of the invention, the method for Wavelet Denoising Method can specifically include：To small
Each series of strata digital-to-analogue after Wave Decomposition is respectively processed larger and smaller than the coefficient of certain threshold value, then
The image after de-noising is reconstructed using the wavelet coefficient after treatment.Noise is in the corresponding system of wavelet field
Number still meets the distribution of Gauss white noise, according to the characteristic of Gaussian Profile, most of noise coefficient all positions
In [- 3*sigma, 3*sigma] is interval.For the threshold value of wavelet coefficient, at hard threshold function
Reason is simple, and result produces local shake after causing denoising, and soft-threshold function method is considered
The demand of flatness, wavelet coefficient can be smoother after soft-threshold function treatment.Therefore originally
Invention carries out Wavelet Denoising Method using soft threshold method.
The above embodiment of the present invention uses Wavelet Denoising Method mode, is time-frequency domain by wavelet transformation,
It is filtered by time frequency analysis, small wave converting method can utilize the association of time-frequency domain, in filtering
While can preferably protect the details of video image, to be protected while denoising is realized as far as possible
Hold image detail.
The characteristics of the above embodiment of the present invention is directed to video calling, with reference to video calling Rate Control
Method, by Rate Control code check size control video denoising scope and intensity,
While reducing background noise, face part clean mark, edge contour are maintained as far as possible
It is complete undistorted.
Fig. 2 is method another embodiment of the present invention for real-time de-noising in video call process
Schematic diagram.Preferably, the present embodiment can be by the device for real-time de-noising in video call process
Perform.The method is comprised the following steps：
Step 201, in video call process, obtains the power supply information of terminal device.
In one embodiment of the invention, the power supply information includes the supplier of electricity of terminal device
The information such as formula, battery electric quantity, battery temperature situation.
Step 202, the power supply information according to terminal device judges whether to denoising.If according to
The power supply information of terminal device judges that denoising can be carried out, then perform step 203；Otherwise, if
Power supply information according to terminal device judges that denoising cannot be carried out, then perform step 210.
In one embodiment of the invention, step 202 can specifically include：When mobile phone is used
When USB charge modes are powered or cell-phone battery electric-charge quantity higher (mobile phone electricity is pre- more than one
Definite value) when, judgement should carry out video denoising, open video denoising, that is, perform step 203；
In non-USB charge modes and mobile phone electricity is less (mobile phone electricity be less than a predetermined value)
When, judgement should not carry out video denoising, perform step 210, close Denoising Algorithm, reduce hand
Machine CPU amounts of calculation, to improve the phone video call time.
In another embodiment of the invention, step 202 can specifically include：Work as battery temperature
During too high battery overheat (battery temperature is more than a predetermined value), then judge that video should not be carried out
Denoising, performs step 210, closes video denoising, it is ensured that video calling is normally carried out.
Step 203, obtains the CPU information of terminal device, and wherein CPU information can include
The CPU parameters such as CPU core number, cpu frequency.
Step 204, the CPU information according to terminal device determines denoising strategy, wherein described go
Strategy of making an uproar includes determining the second denoising scope.
In another embodiment of the invention, step 204 can specifically include：
1st, the CPU information according to terminal device judges whether the computing capability of terminal device is more than
Predetermined threshold.
If the 2, more than predetermined threshold, (i.e. terminal device possesses stronger meter to the computing capability of terminal device
Calculation ability), then the second denoising scope is Y plane, U planes and V planes, i.e., to figure
The Y plane of picture, U planes and V planes all carry out denoising.
If the 3, the computing capability of terminal device is not more than predetermined threshold (i.e. terminal device computing capability
Typically), then the second denoising scope is Y plane, i.e., only luminance block (Y plane) is entered
Row denoising, without being filtered to chrominance block, reaches the purpose for reducing amount of calculation.
Step 205, obtains the current code check r of terminal device.
Step 206, the denoising that formula (1) determines terminal device is based on according to the current code check
Intensity factor t.
Step 207, removing-noise strength and the first denoising scope are determined according to the removing-noise strength factor.
Step 208, the 3rd denoising scope is determined according to the first denoising scope and the second denoising scope.
In one embodiment of the invention, step 208 can include：Select the first denoising model
A denoising scope with the scope minimum in the second denoising scope is enclosed as the 3rd denoising scope.
For example：If the second denoising scope determined in step 204 is Y plane, U planes and V
Plane, and the second denoising scope determined in 204 is Y plane, then the 3rd of final determination goes
Scope of making an uproar is that is, the 3rd goes less one in both the first denoising scope and the second denoising scope
Scope of making an uproar is Y plane.
If the second denoising scope determined in step 204 is Y plane, and the determined in 204
Two denoising scopes are Y plane, U planes and V planes, then the 3rd denoising scope for finally determining
It is less one, i.e. the 3rd denoising scope in both the first denoising scope and the second denoising scope
It is Y plane.
Step 209, in the range of the 3rd denoising, according to the removing-noise strength, is gone using small echo
Algorithm of making an uproar carries out denoising to vision signal；The data after denoising are sent into video encoder afterwards.
Afterwards, other steps of the present embodiment are no longer performed.
Step 210, video denoising (closing video denoising) is not carried out.
The above embodiment of the present invention uses different denoising parameters for different code checks, so in code
More details can be retained in the case that rate is high, and in the case of low for code check, it is as many as possible
Removal noise, reduce code check；And the disposal ability according to terminal selects different YUV
Plane is processed to reduce the pressure to CPU；Always according to mobile phone power supply mode and battery electric quantity
Choose whether to open and close denoising, to improve the video calling time；And consider battery temperature
Situation, then closes video denoising, to ensure video calling when battery temperature battery higher is overheated
Be normally carried out.
In an embodiment of the invention, the step of obtaining the second denoising scope in Fig. 2 embodiments
(step 203 and step 204) and obtain the first denoising scope the step of (step 205- steps
207) tandem can be exchanged.I.e., in an embodiment of the invention, methods described
Can be first carried out in the case where according to the power supply information of terminal device judging that denoising can be carried out
The step of obtaining the first denoising scope, then perform the second denoising scope of acquisition.
The above embodiment of the present invention combination network transmission Rate Control and terminal equipment configuration, set
Standby state, to reach and instruct video denoising by Rate Control to improve the purpose of video quality.
The above embodiment of the present invention in audio/video communication, according to different terminals Rate Control parameter
With different power supply modes, battery electric quantity and temperature conditions, decide whether to open at video denoising
Reason, sets different denoising scopes and intensity, while the disposal ability selection according to mobile phone CPU
The YUV video plane of denoising, using Wavelet Denoising Method, realizes the noise remove of video data,
Obtain more preferable Rate Control effect simultaneously.
Fig. 3 is the device one embodiment of the present invention for real-time de-noising in video call process
Schematic diagram.Described device includes that code check acquisition module 301, parameter acquisition module 302, intensity are obtained
Modulus block 303 and denoising module 304, wherein：
Code check acquisition module 301, in video call process, obtaining working as terminal device
Preceding code check.
Parameter acquisition module 302, for the current code check gathered according to code check acquisition module 301
Determine the removing-noise strength factor of terminal device.
In one embodiment of the invention, parameter acquisition module 302 is specifically for according to formula
(1) the removing-noise strength factor is obtained.
Intensity acquisition module 303, for the removing-noise strength obtained according to parameter acquisition module 302
The factor determines removing-noise strength.
Denoising module 304, for carrying out denoising to vision signal according to the removing-noise strength, it
The data after denoising are sent into video encoder afterwards.
In one embodiment of the invention, denoising module 304 is specifically for according to the denoising
Intensity, Wavelet Denoising Method is carried out using Wavelet Algorithm to vision signal.
Based on the dress for real-time de-noising in video call process that the above embodiment of the present invention is provided
Put, the Rate Control numerical value obtained by terminal device judges network bandwidth situation, works as code check
When relatively low, illustrate that the network bandwidth is smaller, now need to increase the scope and degree of video denoising,
Make video image smoothened as far as possible, so as to preferably obtain relatively low code check；When code check is higher
When, illustrate that bandwidth is preferable, it is possible to reduce the scope and intensity of video denoising, to keep more preferable
Details.
The above embodiment of the present invention uses Wavelet Denoising Method mode, is time-frequency domain by wavelet transformation,
It is filtered by time frequency analysis, small wave converting method can utilize the association of time-frequency domain, in filtering
While can preferably protect the details of video image, to be protected while denoising is realized as far as possible
Hold image detail.
Fig. 4 is device another embodiment of the present invention for real-time de-noising in video call process
Schematic diagram.Compared with embodiment illustrated in fig. 3, in the embodiment shown in fig. 4, described device may be used also
With including the first scope acquisition module 305, wherein：
First scope acquisition module 305, for the denoising obtained according to parameter acquisition module 302
Intensity factor determines the first denoising scope；And indicate denoising module 304 in the range of the first denoising
Denoising is carried out to vision signal according to the removing-noise strength.
The characteristics of the above embodiment of the present invention is directed to video calling, with reference to video calling Rate Control
Method, by Rate Control code check size control video denoising scope and intensity,
While reducing background noise, face part clean mark is kept as far as possible, edge contour is complete
It is whole undistorted.
In one embodiment of the invention, as shown in figure 4, described device can also include CPU
Data obtaining module 306, the second scope acquisition module 307 and the 3rd range determination module 308,
Wherein：
CPU information acquisition module 306, in video call process, obtaining terminal device
CPU information, wherein CPU information includes CPU core number, the CPU such as cpu frequency ginsengs
Number.
Second scope acquisition module 307, denoising is determined for the CPU information according to terminal device
Strategy, wherein the denoising strategy includes the second denoising scope, indicates code check acquisition module afterwards
301 operations for performing the current code check for obtaining terminal device.
In another embodiment of the invention, the second scope acquisition module 307 specifically can be used for
Whether the CPU information according to terminal device judges the computing capability of terminal device more than predetermined threshold
Value；If the computing capability of terminal device is more than predetermined threshold, it is determined that the second denoising scope
It is Y plane, U planes and V planes；If the computing capability of terminal device is not more than predetermined threshold,
Then determine that the second denoising scope for Y plane, i.e., is only gone to luminance block (Y plane)
Make an uproar, without being filtered to chrominance block, reach the purpose for reducing amount of calculation.
3rd range determination module 308, for what is obtained according to the first scope acquisition module 305
The second denoising scope that first denoising scope and the second scope acquisition module 307 are obtained determines the 3rd
Denoising scope；And indicate denoising module 304 in the range of the 3rd denoising according to the removing-noise strength
Denoising is carried out to vision signal.
In one embodiment of the invention, the 3rd range determination module 308 is specifically for selection
The first denoising scope and the second scope acquisition module 307 that first scope acquisition module 305 is obtained
Minimum denoising scope in the second denoising scope for obtaining, as the 3rd denoising scope.
The current code check and CPU disposal abilities that the above embodiment of the present invention considers terminal come
It is determined that final denoising scope, can select different YUV to put down according to the disposal ability of terminal
Face is processed to reduce the pressure to CPU.
In one embodiment of the invention, as shown in figure 4, described device can also include supplying
Power information acquisition module 309 and identification module 310, wherein：
Power supply data obtaining module 309, in video call process, obtaining terminal device
Power supply information.
In one embodiment of the invention, the power supply information includes mobile phone power supply mode, electricity
The information such as pond electricity, battery temperature situation.
Identification module 310, denoising is judged whether to for the power supply information according to terminal device；
If the power supply information according to terminal device judges to carry out denoising, it indicates that CPU information acquisition module
306 operations for performing the CPU information for obtaining terminal device.
In one embodiment of the invention, identification module 310 specifically can be used for making when mobile phone
When being powered with USB charge modes or cell-phone battery electric-charge quantity higher (mobile phone electricity is pre- more than one
Definite value) when, judgement should carry out video denoising, indicate CPU information acquisition module 306 to perform and obtain
Take the operation of the CPU information of terminal device；Non- USB charge modes and mobile phone electricity compared with
When few (mobile phone electricity is less than a predetermined value), judgement should not carry out video denoising, and closing is gone
Make an uproar algorithm (not triggering CPU information acquisition module 306 to work), reduce mobile phone CPU meters
Calculation amount, to improve the phone video call time.
In another embodiment of the invention, identification module 310 specifically can be used for when battery temperature
When degree is less than a predetermined value, then judge that video denoising can be carried out, indicate CPU information to obtain
Module 306 performs the operation of the CPU information for obtaining terminal device；When the too high battery of battery temperature
During overheat (battery temperature is more than a predetermined value), then judge that video denoising should not be carried out, close
Close video denoising (not triggering CPU information acquisition module 306 to work), it is ensured that video calling
It is normally carried out.
The above embodiment of the present invention can also choose whether according to mobile phone power supply mode and battery electric quantity
Denoising is opened and closed, to improve the video calling time；And consider battery temperature situation, when
Battery temperature battery higher then closes video denoising when overheating, to ensure normally entering for video calling
OK.
According to another aspect of the present invention, there is provided a kind of for real-time de-noising in video call process
Terminal device, including described in any of the above-described embodiment (such as Fig. 3 or Fig. 4 embodiments)
For the device of real-time de-noising in video call process.
In one embodiment of the invention, the terminal device can possess video calling work(
The terminal device of energy, for example, possess the mobile terminal of video call function.
Based on the end for real-time de-noising in video call process that the above embodiment of the present invention is provided
End equipment, in audio/video communication, can be according to different terminals Rate Control parameter and different
Power supply mode, battery electric quantity and temperature conditions, decide whether to open video denoising treatment, setting
Different denoising scopes and intensity, while denoising can be selected according to the disposal ability of mobile phone CPU
YUV video plane, using Wavelet Denoising Method, realize the noise remove of video data, while
More preferable Rate Control effect can be obtained.
The above embodiment of the present invention can control video to go by the size of code check in Rate Control
The scope and intensity made an uproar, while background noise is reduced, keep face part line as far as possible
Clear clear, edge contour is completely undistorted.
Below by specific example, the present invention will be described：
In a specific embodiment of the invention, mobile terminal A (Samsung note3) and movement are eventually
End B (Huawei P7) include Fig. 3 or Fig. 4 embodiments of the present invention described in for video calling
During real-time de-noising device.
Mobile terminal A (Samsung note3) and mobile terminal B (Huawei P7) are in same office
In the net of domain, accessed both at WIFI, mobile terminal A connection WIFI router C are moved
The CPU hardware configuration information of dynamic terminal B connection WIFI router D, wherein note3 is
The core processors of 1.6GHz tetra-, the hardware configuration information of Huawei P7 is the core processors of 1.8GHz tetra-.
Camera collection YUV resolution ratio is 352*288.
As mobile terminal A video calls mobile terminal B, mobile terminal B clicks are answered foundation and are regarded
Frequency is conversed, and now mobile terminal A and mobile terminal B cameras start to gather YUV video number
According to.
First, mobile terminal A and mobile terminal B reads respective power supply mode, battery electric quantity
With battery temperature information.The battery information read by android.os.BatteryManager
Respectively:
Mobile terminal A is non-charged state：
BatteryManager.BATTERY_STATUS_NOT_CHARGING,
Mobile terminal B is charged state：
BatteryManager.BATTERY_STATUS_CHARGING,
The remaining battery power of mobile terminal A is 63%, the remaining power electricity of mobile terminal B
It is 49% to measure, and mobile terminal A battery temperatures are 35 degree, and mobile terminal B battery temperature is 34
Degree, by judging, opens video denoising function.
Afterwards, mobile terminal A and mobile terminal B read respective CPU parameters respectively.Move
The parameter that dynamic terminal A is obtained is the core processors of 1.6GHz tetra-, the parameter that mobile terminal B reads
It is the core processors of 1.8GHz tetra-, supports that three YUV planes carry out denoising simultaneously.
Then, mobile terminal A and mobile terminal B read current Rate Control parameter respectively.Depending on
The parameter is that the same initial bit rate is set when frequency call just starts, i.e. 50kbps.By several seconds
Real-time code check parameter is obtained afterwards, and mobile terminal A is 125kbps, and mobile terminal B is
The code check parameter of 219kbps, mobile terminal A is relatively low, so using larger removing-noise strength, moving
Dynamic terminal B code check parameters are higher, using smaller removing-noise strength.Wherein maximal rate rmaxSet
Be 400kbps, thus calculate removing-noise strength mobile terminal A for 0.5, YUV planes all
Carry out noise reduction；Mobile terminal B is 0.26, only carries out noise reduction to Y plane.
Afterwards, mobile terminal A and mobile terminal B are respectively using respective denoising parameter to YUV
Data carry out Wavelet Denoising Method, obtain the yuv data after denoising feeding encoder in.
By after 30 minutes, mobile terminal A battery temperatures are 44 degree, and battery electric quantity is 43%,
Battery electric quantity is 30% after 50 minutes video callings, and temperature is 45 degree；Battery electricity at 58 minutes
It is 20% to measure, and temperature is 45 degree, and now because electricity is relatively low, mobile terminal A closes video
Noise removal function.
Mobile terminal B converse 30 minutes afterwards battery temperature be 45 degree, be always maintained at afterwards
At 45 degree, because always in USB charged states, battery electric quantity is not changed in, so always
Open noise removal function.
Code check acquisition module 301 described above, parameter acquisition module 302, intensity are obtained
Modulus block 303, denoising module 304, the first scope acquisition module 305, CPU information are obtained
Module 306, the second scope acquisition module 307, the 3rd range determination module 308, power supply letter
The functional units such as breath acquisition module 309, identification module 310 can be implemented as performing this Shen
Please the general processor of described function, programmable logic controller (PLC) (PLC), at data signal
Reason device (DSP), application specific integrated circuit (ASIC), field programmable gate array (FPGA)
Or other PLDs, discrete gate or transistor logic, discrete hardware group
Part or it is any appropriately combined.
So far, the present invention is described in detail.In order to avoid covering design of the invention, do not have
Description some details known in the field.Those skilled in the art as described above, completely
It can be appreciated how implementing technical scheme disclosed herein.
One of ordinary skill in the art will appreciate that realizing all or part of step of above-described embodiment
Can be completed by hardware, it is also possible to instruct the hardware of correlation to complete by program, it is described
Program can be stored in a kind of computer-readable recording medium, and storage medium mentioned above can be with
It is read-only storage, disk or CD etc..
Description of the invention is given for the sake of example and description, and is not exhaustively
Or limit the invention to disclosed form.Common skill of many modifications and variations for this area
It is obvious for art personnel.Selection and description embodiment are to more preferably illustrate principle of the invention
And practical application, and make one of ordinary skill in the art it will be appreciated that the present invention is suitable so as to design
In the various embodiments with various modifications of special-purpose.
Claims (13)
1. a kind of method for real-time de-noising in video call process, it is characterised in that including：
In video call process, the current code check of terminal device is obtained；
The removing-noise strength factor of terminal device is determined according to the current code check；
Removing-noise strength is determined according to the removing-noise strength factor；
Denoising is carried out to vision signal according to the removing-noise strength.
2. method according to claim 1, it is characterised in that according to the removing-noise strength
After the step of factor determines removing-noise strength, also include：
First denoising scope is determined according to the removing-noise strength factor；
Denoising is carried out to vision signal according to the removing-noise strength in the range of the first denoising.
3. method according to claim 2, it is characterised in that in video call process,
Also include：
Obtain the CPU information of terminal device；
CPU information according to terminal device determines denoising strategy, wherein the denoising strategy includes
The step of second denoising scope, current code check of the terminal device of execution acquisition afterwards；
The step of denoising is carried out to vision signal according to the removing-noise strength in the range of the first denoising
Including：
3rd denoising scope is determined according to the first denoising scope and the second denoising scope；
Denoising is carried out to vision signal according to the removing-noise strength in the range of the 3rd denoising.
4. method according to claim 3, it is characterised in that according to the first denoising scope
The step of determining the 3rd denoising scope with the second denoising scope includes：
A denoising scope for selecting the scope in the first denoising scope and the second denoising scope minimum
As the 3rd denoising scope.
5. method according to claim 3, it is characterised in that in video call process,
Also include：
Obtain the power supply information of terminal device；
Power supply information according to terminal device judges whether to denoising；
If the power supply information according to terminal device judges to carry out denoising, perform and obtain terminal device
CPU information the step of.
6. the method according to any one of claim 1-5, it is characterised in that described to press
The step of carrying out denoising to vision signal according to the removing-noise strength includes：
Wavelet Denoising Method is carried out to vision signal according to the removing-noise strength.
7. a kind of device for real-time de-noising in video call process, it is characterised in that including
Code check acquisition module, parameter acquisition module, intensity acquisition module and denoising module, wherein：
Code check acquisition module, in video call process, obtain terminal device to work as former code
Rate；
Parameter acquisition module, the current code check for being gathered according to code check acquisition module determines terminal
The removing-noise strength factor of equipment；
Intensity acquisition module, the removing-noise strength factor for being obtained according to parameter acquisition module determines
Removing-noise strength；
Denoising module, for carrying out denoising to vision signal according to the removing-noise strength.
8. device according to claim 7, it is characterised in that also obtained including the first scope
Modulus block, wherein：
First scope acquisition module, for the removing-noise strength factor obtained according to parameter acquisition module
Determine the first denoising scope；And indicate denoising module in the range of the first denoising according to the denoising
Intensity carries out denoising to vision signal.
9. device according to claim 8, it is characterised in that also including CPU information
Acquisition module, the second scope acquisition module and the 3rd range determination module, wherein：
CPU information acquisition module, in video call process, obtaining terminal device
CPU information；
Second scope acquisition module, for determining denoising plan according to the CPU information of terminal device
Slightly, wherein the denoising strategy includes the second denoising scope, code check acquisition module is indicated to hold afterwards
Row obtains the operation of the current code check of terminal device；
3rd range determination module, for the first denoising obtained according to the first scope acquisition module
The second denoising scope that scope and the second scope acquisition module are obtained determines the 3rd denoising scope；And
Denoising module is indicated to be gone to vision signal according to the removing-noise strength in the range of the 3rd denoising
Make an uproar.
10. device according to claim 9, it is characterised in that
3rd range determination module is used for the first denoising model for selecting the first scope acquisition module to obtain
The minimum zone in the second denoising scope obtained with the second scope acquisition module is enclosed, as the 3rd
Denoising scope.
11. devices according to claim 9, it is characterised in that also including power supply information
Acquisition module and identification module, wherein：
Power supply data obtaining module, in video call process, obtaining the confession of terminal device
Power information；
Identification module, denoising is judged whether to for the power supply information according to terminal device；If
Power supply information according to terminal device judges to carry out denoising, it indicates that CPU information acquisition module is held
Row obtains the operation of the CPU information of terminal device.
12. device according to any one of claim 7-11, it is characterised in that
Denoising module is used to carry out Wavelet Denoising Method to vision signal according to the removing-noise strength.
A kind of 13. terminal devices for real-time de-noising in video call process, it is characterised in that
Including as according to any one of claim 7-12 for being gone in real time in video call process
The device made an uproar.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510947209.3A CN106899820A (en) | 2015-12-17 | 2015-12-17 | For the method for real-time de-noising, device and terminal device in video call process |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510947209.3A CN106899820A (en) | 2015-12-17 | 2015-12-17 | For the method for real-time de-noising, device and terminal device in video call process |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106899820A true CN106899820A (en) | 2017-06-27 |
Family
ID=59188280
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510947209.3A Pending CN106899820A (en) | 2015-12-17 | 2015-12-17 | For the method for real-time de-noising, device and terminal device in video call process |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106899820A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109166568A (en) * | 2018-11-19 | 2019-01-08 | 济南浪潮高新科技投资发展有限公司 | A kind of low-power consumption active active noise reduction system and method for fan |
| CN110958417A (en) * | 2019-12-16 | 2020-04-03 | 山东大学 | Method for removing compression noise of video call video based on voice clue |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101252642A (en) * | 2008-03-12 | 2008-08-27 | 四川长虹电器股份有限公司 | Television set imaging method |
| CN101567964A (en) * | 2009-05-15 | 2009-10-28 | 南通大学 | Method for preprocessing noise reduction and block effect removal in low bit-rate video application |
| CN102572120A (en) * | 2012-01-09 | 2012-07-11 | 苏州阔地网络科技有限公司 | Mobile terminal and encoding switching method thereof |
| CN102694964A (en) * | 2012-05-30 | 2012-09-26 | 四川长虹电器股份有限公司 | Dynamic debugging method for image noise reduction |
-
2015
- 2015-12-17 CN CN201510947209.3A patent/CN106899820A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101252642A (en) * | 2008-03-12 | 2008-08-27 | 四川长虹电器股份有限公司 | Television set imaging method |
| CN101567964A (en) * | 2009-05-15 | 2009-10-28 | 南通大学 | Method for preprocessing noise reduction and block effect removal in low bit-rate video application |
| CN102572120A (en) * | 2012-01-09 | 2012-07-11 | 苏州阔地网络科技有限公司 | Mobile terminal and encoding switching method thereof |
| CN102694964A (en) * | 2012-05-30 | 2012-09-26 | 四川长虹电器股份有限公司 | Dynamic debugging method for image noise reduction |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109166568A (en) * | 2018-11-19 | 2019-01-08 | 济南浪潮高新科技投资发展有限公司 | A kind of low-power consumption active active noise reduction system and method for fan |
| CN110958417A (en) * | 2019-12-16 | 2020-04-03 | 山东大学 | Method for removing compression noise of video call video based on voice clue |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102769722B (en) | Time-space domain hybrid video noise reduction device and method | |
| CN102819313B (en) | Operating method of terminal equipment and terminal equipment | |
| CN103916367A (en) | Method and apparatus for transmission of multimedia data | |
| CN104023241B (en) | The method for video coding and video coding apparatus of intraframe predictive coding | |
| CN104780338A (en) | Method and electronic equipment for loading expression effect animation in instant video | |
| CN106507445A (en) | A kind of Wireless Fidelity Wi Fi scan methods and mobile terminal | |
| CN107071272A (en) | Control method, device and the terminal of camera light compensating lamp brightness | |
| CN106303157A (en) | A kind of vedio noise reduction processing method and vedio noise reduction processing means | |
| CN108419025A (en) | A kind of exposure parameter method of adjustment, device and readable medium | |
| CN106899820A (en) | For the method for real-time de-noising, device and terminal device in video call process | |
| CN104899905A (en) | Face image processing method and apparatus | |
| US10911785B2 (en) | Intelligent compression of grainy video content | |
| CN105549399A (en) | Indoor environment monitoring method and internet-of-things terminal | |
| CN104869323A (en) | Modularized real-time video and image processing method base on GPU | |
| CN109348399A (en) | The control method of terminal and its stereo audio | |
| Kim et al. | Signal strength-aware adaptive offloading with local image preprocessing for energy efficient mobile devices | |
| CN104955139B (en) | A kind of intelligent power saving method and system of mobile terminal | |
| Zhang et al. | Enhanced video compression based on effective bit depth adaptation | |
| CN106034210A (en) | Image editing method and image editing device | |
| CN105338221B (en) | A kind of image processing method and electronic equipment | |
| CN106385716A (en) | Interface rate adjusting method and device of mobile industry processor | |
| CN105959304A (en) | Frame rate adjustment method and device | |
| CN105046660A (en) | Image beautifying method and device | |
| CN107911875A (en) | Intelligent base station based on personnel's detection | |
| CN107979729A (en) | A kind of method and apparatus for showing preview image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170627 |
|
| RJ01 | Rejection of invention patent application after publication |