GB2489233A - Image Noise Reduction Resulting in Higher Noise and/or Texture in Image Parts Representing Human Skin - Google Patents

Image Noise Reduction Resulting in Higher Noise and/or Texture in Image Parts Representing Human Skin Download PDF

Info

Publication number
GB2489233A
GB2489233A GB1104700.8A GB201104700A GB2489233A GB 2489233 A GB2489233 A GB 2489233A GB 201104700 A GB201104700 A GB 201104700A GB 2489233 A GB2489233 A GB 2489233A
Authority
GB
United Kingdom
Prior art keywords
image
noise reduction
human skin
noise
reduction process
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
GB1104700.8A
Other versions
GB201104700D0 (en
Inventor
Marc Paul Servais
Andrew Kay
Graham Jones
Matti Pentti Taavetti Juvonen
Allan Evans
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sharp Corp
Original Assignee
Sharp Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sharp Corp filed Critical Sharp Corp
Priority to GB1104700.8A priority Critical patent/GB2489233A/en
Publication of GB201104700D0 publication Critical patent/GB201104700D0/en
Priority to PCT/JP2012/057665 priority patent/WO2012128376A1/en
Publication of GB2489233A publication Critical patent/GB2489233A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70
    • G06K9/40
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/001Image restoration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/30Noise filtering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image

Abstract

A part of an image is analysed to determine whether it represents human skin. If it does, a first noise reduction process is applied to the part of the image. If not, a second noise reduction process is applied instead. The first noise reduction process gives an image with a higher noise and/or texture content than the second noise reduction process. The additional noise/texture present in the part of the image that is determined to represent human skin effectively acts as a substitute for natural skin texture which may have been lost during the image capture and transmission process, resulting in a less synthetic skin representation.

Description

A method of processing an image This invention relates to a method of image processing for improving the perceived quality of digital TV or video without changing what is broadcast or otherwise distributed. it also relates to a display system that uses the image processing method, and to devices such as, for example, a television, mobile phone, advertising hoarding, digital photograph display device, computer display, projector and other public or personal devices that include such a display system.
Television and video content is delivered to end users in a variety of different formats.
This includes analogue and digital terrestrial broadcasting, satellite broadcasting, and internet streaming. For most formats there is usually a significant loss in picture quality between the original captured video, and that which is eventually received and decoded by a TV, computer or other display device.
On analogue TV, noise appears as a time-varying random "snow" pattern or "grain" which is superimposed on the picture. The greater the noise power, the more prominent the snow or grain, and the less visible the picture. One of the main advantages of digital TV is that it allows video to be transmitted without being corrupted by channel noise in the way that that analogue TV is. (Note that very high noise levels can lead to loss in a digital signal).
However, digital video suffers from another type of noise: compression artefacts.
Because of limited bandwidth and storage, video is compressed prior to transmission.
Compression artefacts are different to analogue noise, and the most common characteristics are: blocking artefacts (due to block based compression), mosquito noise (visible around the edges of moving objects) and blurring (caused by a loss of high-frequency detail).
One known noise reduction technique is selective blurring, which is often used to reduce both analogue and digital noise. It is usually desirable to keep the edges of objects sharp, but blurring can be used in the interiors of objects or regions to reduce the visibility of blocking artefacts and unwanted grain. One popular example of selective blurring that operates in this way is the Bilateral Filter (Tomasi and Manduchi, "Bilateral Filtering for Gray and Colour Images", IEEE ICCV 1998), and many decoders or displays use this type of filtering as a post-processing step after decoding but prior to displaying an image.
While the use of blurring to reduce noise can be effective, it can have unwanted side-effects such as removing detail. Over-smoothing of a part of an image that depicts human skin can result in it appearing artificial or plastic. This can be particularly noticeable because viewers tend to focus a large amount of their attention on any faces present within a scene.
Various noise reduction techniques have been proposed, but these generally relate to the reduction of analogue noise -and do not discuss how to handle compression artefacts introduced by the coding process: is us 4 689 666 (1987) proposes how a variety of noise reduction methods (and parameters) based on spatial filtering can be used for differently-coloured objects (e.g. sky, skin, and background regions). The patent does not discuss temporal processing, but only spatial filtering.
us 6 856 704 (2005) suggests how different amounts of sharpening can be used within an image -based on the colour of the region being processed. The inventors give the example of boosting the existing texture in green grass (which may have a moderate amount of texture) while reducing the texture present in blue sky (which may have a low degree of texture).
EP 1 775 936 (2005) and EP 1 991 008 (2007) propose ways of enhancing image texture in an image capture device such as a camera. The texture that is added is a function of the difference between the original captured image and a low-pass filtered version of that image. The documents propose that the algorithm can be applied to the whole image or to parts of the image such as skin tones.
The prior art listed above describes colour-adaptive noise reduction and image enhancement algorithms designed for analogue camera noise, where the input image has not been compressed and therefore does not exhibit any coding artefacts.
In "Block-based Content-adaptive Sharpness Enhancement" (IEEE ISCE2009), Li et a! present a spatially-adaptive image enhancement method which adapts to local image characteristics. They postulate that noise in face/skin coloured areas is very annoying and that excessive sharpening in these areas should therefore be avoided. However, they do not address the issue of enhancing previously compressed data.
In "Visually Improved Image Compression by Combining a Conventional Wavelet-Codec With Texture Modeling" (IEEE Trans. Image Proc., 2002), Nadenau et a! emphasize the importance of skin texture in an image as follows: ". . .the small amplitude texture of the human skin is extremely well perceived by human observers.
The sensitivity for a possible loss due to blurring is very high, because everybody is "trained" on looking at faces." A first aspect of the invention provides a method of processing an image comprising: if a part of the image is or has been determined to represent human skin applying a first noise reduction process to the part of the image, or, if the part of the image is or has been determined not to represent human skin, applying a second noise reduction process to the part of the image, the first noise reduction process giving an image with a higher noise and/or texture content than the second noise reduction process.
According to the invention a part of the image that is determined to represent human skin is processed so that part has a higher noise/texture content than if the part is determined not to represent human skin. The additional noise/texture present, after processing, in a part of the image that is determined to represent human skin effectively acts as a effectively acts as a substitute for natural skin texture which may have been lost during the image capture and transmission process, and helps to prevent skin from looking flat or "plastic" and generally provides more visually pleasing results.
The method can be used on its own or in combination with any noise reduction method.
Furthermore, it can be applied to images with both analogue noise and digital compression artefacts.
The method is well-suited to use in TVs, mobile phones, computers and other display devices which often receive a low-quality noisy video from a variety of sources. It provides a simple and efficient way of improving the user experience, and can easily be added to an existing image processing pipeline.
The method may further comprise determining whether a part of an image represents human skin. In this embodiment, the determination of whether part of an image represents human skin and the processing of that part of the image using the first or second noise reduction process, as appropriate, may be carried out together, for example in a single device that receives and processes the image. Alternatively, the process of determining whether a part of an image represents human skin may be carried out separately.
Determining whether a part of an image represents human skin may comprise assigning a probability that the part of the image represents human skin.
The first noise reduction process and the second noise reduction process may be noise reduction processes of the same type.
The first noise reduction process may comprise adding random or pseudorandom noise to the part of the image.
Applying the first noise reduction process may comprise applying the second noise reduction process and adding random or pseudorandom noise.
The method may comprise processing a part of the image according to: Y = (p5.f0) X + (1 -p5.f0) XNR + (pS.fST.L(X)) t (1) where X is the input part, XNR is the input part after standard noise reduction processing (e.g. using a bilateral filter), L(X) is the brightness of the part X, p is the (estimated) probability that the part X represents human skin, f0 is the weighting factor of the original image, ST is the weighting factor for skin texture, t is a random I pseudo-random number used to add texture, and Y is the output part.
The determination whether a part of an image represents human skin may be performed on one or more first components of the image in a colour space.
The method may comprise applying the first or second noise reduction process on a second component of the image in the colour space.
The colour space may be the HSV colour space, the determination whether a part of an image represents human skin may be performed on the Hue or Saturation of the part of the image, and the first or second noise reduction process may be applied on a Value of the part of the image.
Alternatively the colour space may be a luminance-chrominance colour space, the determination whether a part of an image represents human skin may be performed on one or more chrominance components of the part of the image, and the first or second noise reduction process may be applied on a luminance component of the part of the image.
A second aspect of the invention provides a method of processing a video image comprising processing at least first and second frames of the video image according a method of the first aspect.
The method of the second aspect may comprise processing the first frame by adding first pseudorandom noise to a part of the first frame determined to represent human skin and processing the second frame by adding second pseudorandom noise different from the first pseudorandom noise to a part of the second frame determined to represent human skin.
The method of the second aspect may comprise processing the first frame by adding pseudorandom noise to a part of the first frame determined to represent human skin and processing the second frame by adding the same pseudorandom noise to a part of the second frame determined to represent human skin.
The method of the second aspect may comprise processing the first frame by adding motion-compensated pseudorandom noise to a part of the first frame determined to represent human skin and processing the second frame by adding motion-compensated pseudorandom to a part of the second frame determined to represent human skin.
A third aspect of the invention provides a noise reduction system having: a module for determining whether a part of an image represents human skin; and a module for, if the part of the image is determined to represent human skin, applying a first noise reduction process to the part of the image, or for applying, if the part of the image is determined not to represent human skin, a second noise reduction process to the part of the image, the first noise reduction process giving an image with a higher noise content than the first noise reduction process.
The noise reduction system may further comprise a module for determining whether a part of an image represents human skin.
The module for determining whether a part of an image represents human skin may be adapted to assign a probability that the part of the image represents human skin.
A fourth aspect of the invention provides a display system having a noise reduction system of the third aspect. A noise reduction system of the invention may be provided in any display device that is required to process an image including, as examples and without limitation, a television, a mobile phone, an advertising hoarding, a digital photograph display device, a computer display, a projector and other public or personal devices that include such a display system.
The invention helps to improve the quality of images by enhancing the appearance of human skin in a way that makes it look more natural. This is important because skin in general -and faces in particular -attract a substantial amount of viewer attention when they are present in a scene.
This observation of the importance of skin texture to human observers is significant when considering the picture quality of both digital and analogue video. The present invention comprises an algorithm which describes how noise reduction can be performed, while simultaneously preserving or enhancing texture in skin-coloured areas of an image.
This provides the motivation for the current invention, which is that it can be useful to perform skin-adaptive noise reduction and image enhancement on both analogue and digital video, in order to improve picture quality.
Because the characteristics of analogue and digital noise are different, we adopt a different strategy depending on the video format. In both cases the goal is to perform noise reduction in the image, while achieving a sufficient amount of texture human skin.
In the case of analogue video, any standard noise reduction method (such as a bilateral filter) can be used. Where skin is detected, different parameters should be used in order to perform less blurring of skin-coloured areas. This helps to preserve more detail in skin, even though some of this detail may be grain resulting from analogue noise. In this case the analogue noise present in the image effectively acts as a substitute for natural skin texture which may have been lost during the capture and transmission process.
In the case of digital video, any standard noise reduction method (such as a bilateral filter) can be used throughout the entire image. Where skin is detected, a small amount of random or pseudo-random noise is added to the image. Adding artificial texture amounts to adding noise, which seems counter-intuitive. However, doing so helps to prevent skin from looking flat or "plastic" and generally provides more visually pleasing results.
Brief Description of the drawings
Preferred embodiments of the present invention will be described with reference to accompanying figures, in which: Figure 1 is a schematic illustration of processing paths for analogue and digital video.
Figure 2 is a block diagram illustrating principal features of skin-adaptive picture quality improvement method of the invention.
Figure 3 shows the distribution of human skin tones in Hue -Saturation space, in polar coordinates.
Description of the embodiments
A method of processing an image according to the invention comprises, initially, determining whether a part of an image represents human skin. Alternatively, the determination whether a part of an image represents human skin may be performed separately (for example the image may be received together with overhead information indicating which parts of the image represents human skin.) If the part of the image is or has been determined to represent human skin a first noise reduction process is applied to the part of the image, and if the part of the image is or has been determined not to represent human skin, a second noise reduction process is applied to the part of the image. The second noise reduction process is a noise reduction process that leads to an image with a higher noise and/or texture content than the first noise reduction process. Thus, a part of the image that is determined to represent human skin is processed so that part has a higher noise and/or texture content than if the part is determined not to represent human skin. The additional noise and/or texture present, after processing, in a part of the image that is determined to represent human skin effectively acts as a effectively acts as a substitute for natural skin texture which may have been lost during the image capture and transmission process, and helps to prevent skin from looking flat or "plastic" and generally provides more visually pleasing results.
Embodiments of the invention will be described in which the part" of an image is a pixel, but in principle the image is not limited to this.
In one embodiment of the invention the above ideas for skin-adaptive noise reduction and image enhancement can be summarised for both analogue and digital video using the following equation: Y = X + (1 - XNR + (p$.f$T.L(X)) t (1) where: X is an input pixel, which will generally contain components of two or more colours (eg a full colour pixel may have red, green and blue components), XNR is pixel after standard noise reduction processing (e.g. using a bilateral filter), L(X) is the brightness of pixel X -any suitable measure of the pixel brightness may be used, depending on the colour space in which the invention is being implemented; for example in the YCbCr colour space the Y (luma)_component may be used as the brightness L(X) whereas in the HSV colour space the V (value)_component may be used as the brightness L(X), p5 is the (estimated) probability that pixel X represents human skin, f0 is the weighting factor of the original image, which represents how much of the original (unprocessed) image it is desired to keep, sT is the weighting factor for skin texture, t is a random I pseudo-random number used to add texture, and Y is the output pixel By "pseudorandom number" is meant a number in a sequence of numbers that, although the sequence is not truly random in so far as the sequence is determined by a set of initial values, approximates the properties of random numbers. The sequence may be generated using an available random number generator.
A wide range of values can be chosen for the weighting factors f0 and sT Based on experiments with standard definition analogue and digital TV content, according to one embodiment of the invention the following parameters are recommended: 0.5 and sT = 0 for analogue video; and = 0 and ST 0.02 for digital video.
In these embodiments equation (1) reduces to: Analogue: V = (0.5 p5) X + 0.5(1 -p5) XNR (2) Digital: V = XNR + 0.02 p5.L(X)) t (3) It should be understood that the invention is not limited to the values of f0 and which are given only by way of example. For example, in the analogue case f0 may in principle take any value between 0 and 1, and in the digital case sT may in principle, depending on the characteristics of the added texture, take any value between 0 and around 0.2.
It should be noted that the invention does not require that one of f0 and sT is equal to 0. Analogue content will have inherent grain-type noise whereas in digital content this noise is largely absent -so, in a typical case, texturing the skin is done by mixing in unprocessed content in the analogue case and by mixing in random noise in the digital case. In some cases, however, it may be desirable to use both unprocessed content and random noise at the same time -that is, both f0 and would be non-zero.
It will be seen that, in the case that Ps = 0, when the pixel definitely does not depict skin, equation (2) and equation (3) both reduce toY = XNR, that is the output pixel is the input pixel after standard noise reduction processing (e.g. using a bilateral filter).
Figure 1 summarises the recommended processing paths for analogue and digital video. Initially when an input image is received at a noise reduction processor (which may for example be provided in a decoder such as a video decoder), a determination is made whether the image is an analogue image or a digital image. (If it is already known whether the input image is an analogue image or a digital image, the determination may be omitted.) If the input image is an analogue image, the image is then processed according to a method of the invention for processing an analogue image. If a pixel of the image is determined to represent human skin, a first noise processing technique is applied to that pixel. If a pixel of the image is determined not to represent human skin, a second noise processing technique is applied to the pixel; the second noise reduction process is a weaker noise reduction process than the first noise reduction process, so that the method gives a noisier image in a pixel determined to represent human skin. For example, the image may be processed according to equation (2) above.
lf the input image is an digital image, the image is then processed according to a method of the invention for processing an digital image. If a pixel of the image is determined to represent human skin, a first noise processing technique is applied to that pixel. If a pixel of the image is determined not to represent human skin, a second noise processing technique is applied to the pixel of the image; the second noise reduction process is a weaker noise reduction process than the first noise reduction process, so that the method gives a noisier image in a pixel determined to represent human skin. For example, the second noise reduction process may be a combination of the first noise reduction process and the addition of random texture as in equation (3).
When adding a small quantity of synthetic texture to skin, the amount of texture added is preferably proportional to a measure of the brightness of the skin. The amount of texture should also be proportional to the probability that an area represents skin.
In principle, a method of the invention may be limited to assigning one of the two values Ps = 0 or Ps = I to a pixel in the step of determining whether a part of the image represents human skin. However, allowing the probability Ps of skin to adopt a range of values between 0 and 1 (for example Ps may take the values [0, 0.1, 0.2.. ..09, 1] or to be continuous in the range II0,1j helps to reduce the likelihood of sudden transitions between textured and non-textured regions in areas that might be skin.
The texture t to be added to an image in the term (p5.f5-1..L(Xfl t of equation (1) or (3) can conform to a variety of random distributions. One suitable distribution is additive pink Gaussian noise, since pink nose has a 1ff power spectrum which is typical of natural image content (where t' is a spatial frequency -the power spectrum of natural images decreases (at a rate of 1/f) as the spatial frequency increases so that there is not much power at high spatial frequencies).
The present invention may be applied to processing of a still image, or to processing of a sequence of image such as a video image. Where the invention is applied to a video image or other image sequence, equations (1) to (3) define how a frame is processed.
For video, there are a number of possibilities regarding the temporal characteristics of any pseudo-random noise, for example including: 1. The pseudo-random noise pattern can change from frame to frame. This can make the noise "twinkle", causing it to appear less like natural texture and more like noise.
2. A fixed pseudo-random noise pattern can be used -that is, the same pseudo-random noise pattern is used for each frame. This generally gives a better result, but can cause the noise to look like dirt on the screen when there is slow object motion.
3. A combination of the above is also possible -the pseudo-random noise pattern may have one component that is constant between frames and another component that changes from frame to frame, allowing the noise pattern to change more slowly over time. This is not perfect, but gives a more natural result.
4. A motion compensated texture pattern could be used -allowing texture to track a moving face. This would produce the most realistic result, but it is the most computationally expensive solution.
Skin detection can be performed in a variety of colour spaces. One of the most popular colour spaces is the HSV colour space, since human skin tones from a variety of races form a fairly tight cluster in Hue -Saturation space, as shown in Figure 3 (Skin Colour Analysis", Sherrah and Gong, 2001 -available at http://homepages.inf.ed.ac.u ktrbf/CVon line/LOCAL_COPI ES/GON Gi /cvOn line-skinColourAnalysis.html).
In embodiments of the invention the determination whether a pixel of an image may be based on one or more first components of colour space, and the noise reduction may be applied to a second component of colour space. This is illustrated in figure 2, which provides a more detailed block diagram to illustrate the operation of the algorithm.
Figure 2 shows the invention applied in the HSV colour space, where H denotes "hue", S denotes "saturation" and "V" denotes to the "value" component in the HSV colour space.) Initially an image is input at 1. In the case of a full colour image this is an RGB (red, green, blue) image, and at 2 the image (or a part thereof) is transformed into another colour space, in this example into the HSV colour space.
At 3, a determination of whether a pixel X of the colour-transformed image represents human skin is made. This determination is carried on one or more first components of the colour space, in this example on the H and S components. The determination comprises assigning a probability Ps to a pixel that represents the probability that the pixel represents human skin. As noted above, the invention may be implemented by assigning one of the two values Ps = 0 or Ps = I to a pixel of the image, but better results may be achieved by allowing the probability Ps of skin to adopt a range of values between 0 and 1 orto be continuous in the range [0,1].
It should be noted that the determination of whether a pixel X of the colour-transformed image represents human skin may be omitted, if it is already known whether the pixel X represents human skin. For example, where the method is being performed at a decoder such as a video decoder, the input data received at the decoder may contain overhead information indicating which pixels represent human skin.
At 4 a conventional noise reduction process is applied to the pixel X, for example by applying a bilateral filter, to produce a noise reduced pixel XNR. The noise reduction process may be performed on at least a second component of the colour space, preferably on a component of the colour space not used in the determination 3 of the probability Ps.
At 5 a pseudo-random skin texture t is generated, using any suitable pseudo-random number generator.
At 6, an output pixel Y is determined from the input pixel X and one or more of the probability Ps assigned to the pixel at 3, the noise reduced pixel XNR obtained at 4, the pseudo-random texture generated at 5, and the weighting factors f0, f--. For example, the output pixel may be determined at 6 according to equation (1), or according to n equation derived therefrom such as equation (2) or (3).
Each pixel of the colour-transformed image is processed according to operations 3-6, and the noise-reduced pixel are then assembled, and at 7 are transformed back to the RGB colour space, to give an output image 8, Figure 2 shows the process applied to a single image, for example a still image or one frame of a video image. When the invention is applied to a video image each frame is processed as shown in figure 2 (although, as noted, the texture t may vary from one frame to another).
As shown in Figure 2, the use of HSV space allows for the probability that a pixel represents skin to be estimated using the Hue (H) and Saturation (S) components.
Noise reduction and texture enhancement is then performed on the Value (V) component. Since the Value term closely correlates with brightness this allows for an efficient and effective implementation of the algorithm.
The method of the invention is not however limited to the HSV colour space but may be pertormed in other colour spaces. Another suitable colour space is the YCbCr colour space. In this case, the chrominance components Gb and Cr can be used to estimate the probability that a part of the image represents skin, while noise reduction and texture enhancement is performed on the Luminance (Y) component.
A method of the invention may be implemented in any suitable noise reduction system, for example a noise reduction system that can perform the operations 2-7 of figure 2.
A noise reduction method of the invention may be carried out in, and a noise reduction system for implementing a method of the invention may be provided in, any device that is required to process an image including, as examples and without limitation, a television, a mobile phone, an advertising hoarding, a digital photograph display device, a computer display, a projector and other public or personal devices that include such a display system.
A noise reduction system of the invention may comprise a module for, if a part of the image is determined to represent human skin, applying a first noise reduction process to the part of the image, or for applying, if the part of the image is determined not to represent human skin, a second noise reduction process to the part of the image, the first noise reduction process giving an image with a higher noise content than the second noise reduction process. It may optionally further comprise a module for determining whether a part of an image represents human skin, and may optionally further comprises other modules for performing other features of the method of the invention. The module or modules may be implemented as hardware, or they may be implemented on one or more processors. The module for determining whether a part of an image represents human skin may be adapted to assign a probability that the part of the image represents human skin.

Claims (19)

  1. CLAIMS: 1. A method of processing an image comprising: if the part of the image has been determined to represent human skin applying a first noise reduction process to the part of the image, or, if the part of the image has been determined not to represent human skin, applying a second noise reduction process to the part of the image, the first noise reduction process giving an image with a higher noise and/or texture content than the second noise reduction process.
  2. 2. A method as claimed in claim I and comprising determining whether the part of an image represent human skin.
  3. 3. A method as claimed in claim 2 wherein determining whether a part of an image represents human skin comprising assigning a probability that the part of the image represents human skin.
  4. 4 A method as claimed in claim 1, 2 or 3 wherein the first noise reduction process and the second noise reduction process are noise reduction processes of the same type.
  5. 5. A method as claimed in claim 1, 2 or 3 wherein the first noise reduction process comprises adding random or pseudorandom noise to the part of the image.
  6. 6. A method as claimed in claim 5 wherein applying the first noise reduction process comprises applying the second noise reduction process and adding random or pseudorandom noise.
  7. 7. A method as claimed in any preceding claim wherein the method comprises processing a part of the image according to: Y = (p5.f0) X + (1 -p5i0) XNR + (pS.fST.L(X)) t (1) where X is the input part, XNR is the input part after standard noise reduction processing (e.g. using a bilateral filter), L(X) is the brightness of the part X, p is the (estimated) probability that the part X represents human skin, f0 is the weighting factor of the original image, ST is the weighting factor for skin texture, t is a random / pseudo-random number used to add texture, and Y is the output part.
  8. 8. A method as claimed in claim wherein the determination whether a part of an image represents human skin is performed on one or more first components of the image in a colour space.
  9. 9. A method as claimed in claim 8 and comprising applying the first or second noise reduction process on a second component of the image in the colour space.
  10. 10. A method as claimed in claim 8 or 9 wherein the colour space is the HSV colour space, the determination whether a part of an image represents human skin is performed on the Hue or Saturation of the part of the image, and the first or second noise reduction process is applied on a Value of the part of the image.
  11. 11. A method as claimed in claim 8 or 9 wherein the colour space is a luminance-chrominance colour space, the determination whether a part of an image represents human skin is performed on one or more chrominance components of the part of the image, and the first or second noise reduction process is applied on a luminance component of the part of the image.
  12. 12. A method of processing a video image comprising processing at least first and second frames of the video image according a method as defined in any one of claims 1 to 11.
  13. 13. A method as claimed in claim 12, wherein the method comprises processing the first frame by adding first pseudorandom noise to a part of the first frame determined to represent human skin and processing the second frame by adding second pseudorandom noise different from the first pseudorandom noise to a part of the second frame determined to represent human skin.
  14. 14. A method as claimed in claim 12, wherein the method comprises processing the first frame by adding pseudorandom noise to a part of the first frame determined to represent human skin and processing the second frame by adding the same pseudorandom noise to a part of the second frame determined to represent human skin.
  15. 15. A method as claimed in claim 12, wherein the method comprises processing the first frame by adding motion-compensated pseudorandom noise to a part of the first frame determined to represent human skin and processing the second frame by adding motion-compensated pseudorandom to a part of the second frame determined to represent human skin.
  16. 16. A noise reduction system having: a module for, if a part of the image is determined to represent human skin, applying a first noise reduction process to the part of the image, or for applying, if the part of the image is determined not to represent human skin, a second noise reduction process to the part of the image, the first noise reduction process giving an image with a higher noise and/or texture content than the second noise reduction process.
  17. 17. A noise reduction system as claimed in claim 16 and further comprising a module for determining whether a part of an image represents human skin.
  18. 18. A noise reduction system as claimed in claim 17 wherein the module for determining whether a part of an image represents human skin is adapted to assign a probability that the part of the image represents human skin.
  19. 19. A display system having a noise reduction system as defined in claim 16, 17 or 18.
GB1104700.8A 2011-03-21 2011-03-21 Image Noise Reduction Resulting in Higher Noise and/or Texture in Image Parts Representing Human Skin Withdrawn GB2489233A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
GB1104700.8A GB2489233A (en) 2011-03-21 2011-03-21 Image Noise Reduction Resulting in Higher Noise and/or Texture in Image Parts Representing Human Skin
PCT/JP2012/057665 WO2012128376A1 (en) 2011-03-21 2012-03-16 A method of processing an image, a method of processing a video image, a noise reduction system and a display system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB1104700.8A GB2489233A (en) 2011-03-21 2011-03-21 Image Noise Reduction Resulting in Higher Noise and/or Texture in Image Parts Representing Human Skin

Publications (2)

Publication Number Publication Date
GB201104700D0 GB201104700D0 (en) 2011-05-04
GB2489233A true GB2489233A (en) 2012-09-26

Family

ID=44012875

Family Applications (1)

Application Number Title Priority Date Filing Date
GB1104700.8A Withdrawn GB2489233A (en) 2011-03-21 2011-03-21 Image Noise Reduction Resulting in Higher Noise and/or Texture in Image Parts Representing Human Skin

Country Status (2)

Country Link
GB (1) GB2489233A (en)
WO (1) WO2012128376A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3460747A1 (en) * 2017-09-25 2019-03-27 Vestel Elektronik Sanayi ve Ticaret A.S. Method, processing system and computer program for processing an image

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113450340B (en) * 2021-07-13 2024-03-19 北京美医医学技术研究院有限公司 Skin texture detecting system

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4689666A (en) * 1985-01-08 1987-08-25 Fuji Photo Film Co., Ltd. Method for eliminating noise in regions of a color image exhibiting a specific color

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4154847B2 (en) * 2000-09-26 2008-09-24 コニカミノルタビジネステクノロジーズ株式会社 Image processing apparatus, image processing method, and computer-readable recording medium storing image processing program
JP2005196270A (en) * 2003-12-26 2005-07-21 Konica Minolta Photo Imaging Inc Image processing method, image processing equipment, and image processing program
JP2006343989A (en) * 2005-06-08 2006-12-21 Fuji Xerox Co Ltd Image processing device, image processing method, and image processing program

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4689666A (en) * 1985-01-08 1987-08-25 Fuji Photo Film Co., Ltd. Method for eliminating noise in regions of a color image exhibiting a specific color

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3460747A1 (en) * 2017-09-25 2019-03-27 Vestel Elektronik Sanayi ve Ticaret A.S. Method, processing system and computer program for processing an image
WO2019057320A1 (en) * 2017-09-25 2019-03-28 Vestel Elektronik Sanayi Ve Ticaret A.S. Method, processing system and computer program for processing an image
US11605155B2 (en) 2017-09-25 2023-03-14 Vestel Elektronik Sanayi Ve Ticaret A.S. Method, processing system and computer program for processing an image

Also Published As

Publication number Publication date
GB201104700D0 (en) 2011-05-04
WO2012128376A1 (en) 2012-09-27

Similar Documents

Publication Publication Date Title
US8605083B2 (en) Method for converting input image data into output image data, image conversion unit for converting input image data into output image data, image processing apparatus, display device
US7894684B2 (en) Visual processing device, visual processing method, program, display device, and integrated circuit
EP1242975B1 (en) Digital imaging
US8639050B2 (en) Dynamic adjustment of noise filter strengths for use with dynamic range enhancement of images
KR20160102524A (en) Method for inverse tone mapping of an image
US20100080485A1 (en) Depth-Based Image Enhancement
US8218622B2 (en) System and method for processing videos and images to a determined quality level
US20110176058A1 (en) Use of film grain to mask compression artifacts
US8086067B2 (en) Noise cancellation
CN109345490B (en) Method and system for enhancing real-time video image quality of mobile playing terminal
EP1933556A2 (en) TV user interface and processing for personal video players
WO2006131866A2 (en) Method and system for image processing
GB2489233A (en) Image Noise Reduction Resulting in Higher Noise and/or Texture in Image Parts Representing Human Skin
CN109167892B (en) Video image detail enhancement method and system
Jung et al. Enhanced HDR Image Reproduction Using Gamma-Adaptation-Based Tone Compression and Detail-Preserved Blending
El Mezeni et al. Temporal adaptation control for local tone mapping operator
Madhura Experimental Study on the Digital Color Video Using Absolute Difference and Piecewise Mapping Techniques
Lim et al. A wavelet packet-based noise reduction algorithm of NTSC images using CVBS characteristics
Boitard et al. Video Tone Mapping
Filali et al. High dynamic range image tone mapping approach based on separable stationary wavelet transform decomposition using a coefficients weighted strategy
Huo et al. Evaluation of HDR tone mapped image and single exposure image
CN117649360A (en) Defogging method and device for foggy image and electronic equipment
Ploumis Tone mapping operator for high dynamic range video
Li et al. A luminance rendition method based on local visual adaption
Oberti et al. Evaluation of optimal sharpness enhancement for different image content and different display technologies

Legal Events

Date Code Title Description
WAP Application withdrawn, taken to be withdrawn or refused ** after publication under section 16(1)