EP1803303B1 - Technique de deblocage adaptatif de modeles de grains de films a base de blocs - Google Patents
Technique de deblocage adaptatif de modeles de grains de films a base de blocs Download PDFInfo
- Publication number
- EP1803303B1 EP1803303B1 EP05813106.1A EP05813106A EP1803303B1 EP 1803303 B1 EP1803303 B1 EP 1803303B1 EP 05813106 A EP05813106 A EP 05813106A EP 1803303 B1 EP1803303 B1 EP 1803303B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- block
- film grain
- film
- grain
- blockiness
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims description 57
- 230000003044 adaptive effect Effects 0.000 title description 13
- 238000001914 filtration Methods 0.000 claims description 19
- 238000004590 computer program Methods 0.000 claims 1
- 238000004088 simulation Methods 0.000 description 11
- 230000006835 compression Effects 0.000 description 10
- 238000007906 compression Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 7
- 238000013459 approach Methods 0.000 description 6
- BQCADISMDOOEFD-UHFFFAOYSA-N Silver Chemical compound [Ag] BQCADISMDOOEFD-UHFFFAOYSA-N 0.000 description 5
- 239000013078 crystal Substances 0.000 description 5
- 239000000523 sample Substances 0.000 description 5
- 229910052709 silver Inorganic materials 0.000 description 5
- 239000004332 silver Substances 0.000 description 5
- 230000000007 visual effect Effects 0.000 description 4
- 230000003467 diminishing effect Effects 0.000 description 3
- 239000000839 emulsion Substances 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 239000000047 product Substances 0.000 description 3
- 230000007704 transition Effects 0.000 description 3
- 238000010420 art technique Methods 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000000977 initiatory effect Effects 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 238000001356 surgical procedure Methods 0.000 description 2
- 238000011144 upstream manufacturing Methods 0.000 description 2
- 206010034960 Photophobia Diseases 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000002238 attenuated effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000013065 commercial product Substances 0.000 description 1
- 230000003292 diminished effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 208000013469 light sensitivity Diseases 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000002156 mixing Methods 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 230000002250 progressing effect Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 230000000153 supplemental effect Effects 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/84—Television signal recording using optical recording
- H04N5/87—Producing a motion picture film from a television signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/21—Circuitry for suppressing or minimising disturbance, e.g. moiré or halo
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20172—Image enhancement details
- G06T2207/20204—Removing film grain; Adding simulated film grain
Definitions
- This invention relates to a technique for filtering simulated film grain.
- Motion picture films comprise silver-halide crystals dispersed in an emulsion, coated in thin layers on a film base.
- the exposure and development of these crystals form the photographic image consisting of discrete tiny particles of silver.
- the silver undergoes chemical removal after development and tiny blobs of dye occur on the sites where the silver crystals form.
- These small specks of dye are commonly called 'grain' in color film. Grain appears randomly distributed on the resulting image because of the random formation of silver crystals on the original emulsion. Within a uniformly exposed area, some crystals develop after exposure while others do not.
- Grain varies in sizes and shapes. The faster the film (i.e., the greater the light sensitivity), the larger the clumps of silver formed and blobs of dye generated, and the more they tend to group together in random patterns.
- the grain pattern is typically known as 'granularity'.
- the naked eye cannot distinguish individual grains, which vary from 0.0002 mm to about 0.002 mm. Instead, the eye resolves groups of grains, referred to as blobs. A viewer identifies these groups of blobs as film grain. As the image resolution becomes larger, the perception of the film grain becomes higher. Film grain becomes clearly noticeable in cinema and high-definition images, whereas film grain progressively loses importance in SDTV and becomes imperceptible in smaller formats.
- Motion picture film typically contains image-dependent noise resulting either from the physical process of exposure and development of the photographic film or from the subsequent editing of the images.
- the photographic film possesses a characteristic quasi-random pattern, or texture, resulting from physical granularity of the photographic emulsion. Alternatively, a similar pattern can be simulated over computed-generated images in order to blend them with photographic film. In both cases, this image-dependent noise is referred to as grain.
- moderate grain texture presents a desirable feature in motion pictures.
- the film grain provides visual cues that facilitate the correct perception of two-dimensional pictures. Film grain is often varied within a single film to provide various clues as to time reference, point of view, etc. Many other technical and artistic uses exist for controlling grain texture in the motion picture industry. Therefore, preserving the grainy appearance of images throughout image processing and delivery chain has become a requirement in the motion picture industry.
- Grain Surgery TM Another commercial product that simulates film grain is Grain Surgery TM from Visual Infinity Inc., which is used as a plug-in of Adobe® After Effects®.
- the Grain Surgery TM product appears to generate synthetic grain by filtering a set of random numbers. This approach suffers from disadvantage of a high computational complexity.
- WIEGAND "Draft Text of H.264/AVC Professional Extensions Amendment",JOINT VIDEO TEAM (JVT) OF ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 AND ITU-T SG16 Q6), JVT-J047, 8 December 2003 (2003-12-08), pages I-IV,1-55, Waikoloa, Hawai, USA . While applying a deblocking filter has a lesser impact on the quality of the grain, implementing such a filter increases computational complexity.
- a method for deblocking the at least one film grain block commences by first establishing the at least one parameter associated with the grain size of the film grain in the block. Thereafter the film grain blockiness, that is the appearance of the film grain as separate blocks, rather than a seamless image, is reduced in accordance with the at least one parameter.
- FIGURE 1 depicts a block schematic diagram of a transmitter 10, which receives an input video signal and, in turn, generates a compressed video stream at its output.
- the transmitter 10 also generates information indicative of the film grain (if any) present in the sample.
- the transmitter 10 could comprises part of a head-end array of a cable television system, or other such system that distributes compressed video to one or more downstream receivers 11, only one of which is shown in FIG. 1 .
- the transmitter 10 could also take the form of encoder that presents media like DVDs.
- the receiver 11 decodes the coded video stream and simulates film grain in accordance with the film grain information and decoded video, both received from the transmitter 10 or directly from the media itself in the case of a DVD or the like, to yield an output video stream that has simulated film grain.
- the receiver 11 can take the form of a set-top box or other such mechanism that serves to decode compressed video and simulate film grain in that video.
- the overall management of film grain requires the transmitter 10 (i.e., the encoder) provide information with respect to the film grain in the incoming video. In other words, the transmitter 10 "models" the film grain. Further the receiver 11 (i.e., decoder) simulates the film grain according to the film grain information received from the transmitter 10. The transmitter 10 enhances the quality of the compressed video by enabling the receiver 11 to simulate film grain in the video signal when difficulty exists in retaining the film grain during the video coding process.
- the transmitter 10 i.e., the encoder
- the receiver 11 i.e., decoder
- the transmitter 10 includes a video encoder 12 which encodes the incoming video stream using any of the well known video compression techniques such as the ITU-T Rec. H.264
- a film grain remover 14 in the form of a filter or the like depicted in dashed lines in FIG. 1 , could exist upstream of the encoder 12 to remove any film grain in the incoming video stream prior to encoding. To the extent that the incoming video contains little if any film grain, no need would exist for the film grain remover 14.
- a film grain modeler 16 accepts the input video stream, as well as the output signal of the film grain remover 14 (when present). Using such input information, the film grain modeler 16 establishes the film grain in the incoming video signal.
- the film grain modeler 16 could comprise a look up table containing film grain models for different film stocks. Information in the incoming video signal would specify the particular film stock originally used to record the image prior to conversion into a video signal, thus allowing the film grain modeler 16 to select the appropriate film grain model for such film stock.
- the film grain modeler 16 could comprise a processor or dedicated logic circuit that would execute one or more algorithms to sample the incoming video and determine the film grain pattern that is present.
- the receiver 11 typically includes a video decoder 18 that serves to decode the compressed video stream received from the transmitter 10.
- the structure of the decoder 18 will depend on the type of compression performed by the encoder 12 within the transmitter 10. Thus, for example, the use within the transmitter 10 of an encoder 12 that employs the ITU-T Rec. H.264
- a film grain simulator 20 receives the film grain information from the film grain model 16.
- the film grain simulator 20 can take the form of a programmed processor, or dedicated logic circuit having the capability of simulating film grain for combination via a combiner 22 with the decoded video stream.
- Film grain simulation aims to synthesize film grain samples that simulate the look of the original film content.
- film grain modeling occurs at the transmitter 10 of FIG. 1
- film grain simulation occurs at the receiver 11.
- film grain simulation occurs in the receiver 11 along with the decoding the incoming video stream from the transmitter 10 upstream of the output of the decoded video stream.
- the decoding process that occurs in the receiver 11 makes no use of images with added film grain.
- film grain simulation constitutes a post-processing method for synthesizing simulated film grain in the decoded images for display. For that reason, the ITU-T Rec. H.264
- film grain simulation requires information concerning the grain pattern in the incoming video signal, which information typically undergoes transmission in a Supplemental Enhancement Information (SEI) message when using the ITU-T Rec. H.264
- SEI Supplemental Enhancement Information
- the film grain simulator 20 can simulate film grain in different ways.
- the film grain simulator 20 could simulate film grain by making use of a database (e.g. a look-up table or LUT) containing a plurality of pre-computed blocks of film grain for addition to the image.
- a database e.g. a look-up table or LUT
- a typical method for pre-computing the film grain blocks in the database would make use of a Gaussian pseudorandom number generator (not shown).
- the film grain simulator 20 could calculate each film block as needed, typically making use of a Gaussian pseudorandom number generator for this purpose.
- Film grain simulation by combining multiple individual film grain blocks in the manner just described can lead to artifacts, and in particular, a condition known as blockiness whereby the blocks of film grain appear separately, rather than merging in a seamless manner.
- One previous technique for reducing blockiness includes the step of diminishing the intensity of the simulated grain along the edges of each block.
- Another prior art technique applies a deblocking filter to each film grain block. Both of these prior approaches incur disadvantage as described below.
- FIGURE 2 illustrates in flow chart form the steps for accomplishing such film grain block edge downscaling.
- the size of the film grain within the block serves as the parameter that controls the intensity of the edge scaling,
- the intensity of the edge scaling will vary proportionally to the size of the grain within the block.
- One or more other characteristics of the film grain block could serve to influence the intensity of the edge scaling in addition to or in place of the film grain size.
- step 100 commences upon execution of the begin step (step 100) during which system initialization occurs although such initialization need not necessarily happen under all circumstances.
- step 102 occurs, initiating acquisition of the at least one characteristic of the film grain block that controls the edge scaling.
- the film grain size serves as the characteristic that controls edge scaling.
- film grain size serves as a good characteristic for controlling edge scaling because the blockiness resulting from mosaicing blocks of film grain to create a seamless image become less visible for smaller grain sizes as fewer shapes become affected by the edge.
- the film grain size constitutes one of the parameters regarding film grain carried in the SEI message received by the receiver 11 that undertakes both simulation, as well as blockiness reduction in the manner described hereinafter.
- step 104 begins, initiating selection of a scaling factor for downscaling the edges.
- s h (m) constitutes the parameter that represents the horizontal size of the grain for block m
- s v (m) constitutes the parameter that represents the vertical size of the grain for block m.
- the scaling of horizontal (top and bottom) edges can be formulated as: where scale_factor v [s] comes from a look-up table (LUT) (not shown) which provides the scaling factor for each vertical film grain size allowed by the film grain simulation process.
- the scaling of vertical block edges (left and right) can be formulated as: where scale_factor h [s] comes from a look-up table (LUT) which provides the scaling factor for each horizontal film grain size.
- the scale factor could be expressed as a function of the grain intensity.
- One possible extension of the above-described method would entail the use of different scaling factors for different rows or columns depending on the characteristics of the current film grain block.
- Another possible extension would entail taking into account the film grain characteristics for both the current block and the neighboring block (across the edge being scaled) to determine the scaling factors and the number of rows or columns being scaled. Observe that even when taking into account the film grain characteristics from the neighboring block, only the film grain samples of the current block undergo scaling. This helps to maintain a very low computational cost.
- the film grain simulator 20 of FIG. 1 will execute the steps 100 through 108 of FIG. 2 .
- the film grain simulator 20 typically takes the form of a programmed processor, a programmable gate array, dedicated logic circuitry or any combination capable or carrying out the method.
- FIGURES 3A and 3B depict an exemplary 8 x 8-pixel film grain block before and after downscaling the left edge of the block in accordance with the technique of the present principles.
- the film grain block of FIG. 3A has larger sized grain in the region bounded at its upper left and right vertices (0,2) and (4,2) and at its lower left and right vertices (0,4) and (4,4) than elsewhere in the block, with the origin (0,0) at the upper left-hand corner of the block.
- the pixels lying along the left-hand edge between the coordinates (0, 2) and (0, 4) will undergo scaling with a greater intensity than those elsewhere along that edge. Such greater intensity scaling occurs because such pixels lie in the larger size grain in the region within the block.
- FIGURE 4 illustrates in flow chart form the steps of a method in accordance with an illustrative embodiment of the present principles for accomplishing adaptive deblocking filtering.
- the method of FIG. 4 commences upon execution of step 200 during which initialization occurs, although initialization need not necessarily occur. Thereafter, steps 202 and 204 occur to initiate the acquisition of the at least one characteristic of the current film block m and acquisition of the same characteristic of the immediately prior film grain block n , respectively.
- the flow chart of FIG. 4 depicts steps 202 and 204 as occurring simultaneously, although the steps could occur in succession.
- Step 206 follows steps 202 and 204 during which selection of a filter type occurs.
- the selected filter comprises a 3-tap filter for deblocking of the vertical edges.
- the film grain simulator 20 of FIG. 1 will execute the steps 200 through 212 of FIG. 2 .
- the film grain simulator 20 typically takes the form of a programmed processor, a programmable gate array, dedicated logic circuitry or any combination capable or carrying out the method.
- FIGURES 5A and 5B depict an exemplary pair of adjacent 8 x 8-pixel film grain blocks before and after adaptive deblocking filtering in accordance with the technique of the present principles.
- Block n the left-hand most block in FIGS. 5A and 5B has a smaller grain size region bounded grain block at its upper left and right vertices (4,3) and (7,3) and at its lower left and right vertices (4,7) and (7,7), than elsewhere in the block, with the origin (0, 0) at the upper left-hand corner of the block.
- Block m the right-hand most block in FIGS. 5A and 5B has larger sized grain in the region bounded at its upper left and right vertices (0, 2) and (4, 2) and at its lower left and right vertices (0, 4) and (4,4) than elsewhere in the block.
- the pixels (5, 7), (6, 7) and (7, 7) lying in the right hand edge of Block n as well as the pixels (0, 5) (0, 6) and (0, 7) lying in the left hand edge of Block m all have a smaller intensity following adaptive deblocking filtering.
- the reduced intensity of these pixels following adaptive deblocking filtering stems from the adjacency of these pixels to the smaller grain size region in Block n .
- the adaptive deblocking method of the present principles can readily make use of any other type of deblocking filter where the strength of the filtering depends on one or more parameters in the filter equation.
- the increase in complexity that results from varying the filter strength remains low since the adaptation can occur using a LUT.
- Using an LUT obviates the need for extra calculations.
- the method of the present principles can vary the filter strength in accordance with characteristics of the film grain in the block other than, or in addition to, grain size.
- the adaptive downscaling and adaptive deblocking filtering techniques described with respect to FIGS. 2 and 4 respectively could make use of film grain intensity and/or texture in addition to, or in place of film grain size.
- both the filter type and strength could vary depending on film grain characteristics. Higher complexity will result from the increase in the number of operations associated with a more complex filter as well as the need for additional memory.
- deblocking filtering in accordance with the present principles can take into account both the characteristics of the film grain and the characteristics of the image that will receive the grain.
- the deblocking strength would vary proportionally to the image brightness, since the film grain (and thus, the transitions between film grain blocks) appear more visible in brighter areas of the image.
- the deblocking strength could vary proportionally to the characteristics of image texture such that the finer the texture, the weaker the deblocking.
- the adaptive deblocking filtering technique of FIG. 4 yields better performance since deblocking filtering performs attenuation taking into account pixel values and film grain characteristics at both sides of the block edge.
- Figures 3B and 5B illustrate the difference in performance between the two techniques.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Image Processing (AREA)
- Picture Signal Circuits (AREA)
Claims (15)
- Procédé pour réduire l'effet de bloc d'au moins un bloc de grain de film, comprenant : l'établissement d'au moins un paramètre indiquant la taille du grain de film dans le bloc ; et la réduction de l'effet de bloc de grain de film conformément à l'au moins un paramètre indiquant la taille du grain de film dans le bloc, la réduction étant effectuée à l'aide (1) de la réduction d'échelle du bloc de grain de film le long d'au moins une arête de bloc ou (2) du filtrage de déblocage du bloc de grain de film sur l'au moins une arête de bloc.
- Procédé selon la revendication 1, dans lequel la réduction d'échelle comprend la réduction d'échelle du bloc de grain de film le long de toutes les arêtes de bloc.
- Procédé selon la revendication 1, dans lequel le filtrage de déblocage comprend le filtrage de déblocage du bloc de grain de film sur toutes les arêtes de bloc.
- Procédé selon la revendication 1, comprenant en outre la réduction de l'effet de bloc de grain de film de manière différente dans différentes lignes du bloc.
- Procédé selon la revendication 1, comprenant en outre la réduction de l'effet de bloc de grain de film de manière différente dans différentes colonnes du bloc.
- Procédé selon la revendication 1, comprenant en outre la réduction de l'effet de bloc de grain de film au moins en partie conformément à au moins une caractéristique d'un bloc adjacent.
- Procédé selon la revendication 1, comprenant en outre la réduction de l'effet de bloc de grain de film au moins en partie conformément à au moins une caractéristique d'une image recevant le grain.
- Appareil pour réduire l'effet de bloc d'au moins un bloc de grain de film, comprenant :un moyen pour établir au moins un paramètre indiquant la taille du grain de film dans le bloc ; etun moyen pour réduire l'effet de bloc de grain de film conformément à l'au moins un paramètre indiquant la taille du grain de film dans le bloc, à l'aide (1) de la réduction d'échelle du bloc de grain de film le long d'au moins une arête de bloc ou (2) du filtrage de déblocage du bloc de grain de film sur l'au moins une arête de bloc.
- Procédé selon la revendication 1 ou appareil selon la revendication 8, dans lequel un facteur de réduction d'échelle utilisé dans la réduction d'échelle est proportionnel à la taille du grain de film.
- Appareil selon la revendication 8, dans lequel le moyen de réduction d'échelle du bloc de grain de film applique la réduction d'échelle le long de toutes les arêtes de bloc.
- Procédé selon la revendication 1 ou appareil selon la revendication 8, dans lequel la puissance du filtrage de déblocage dépend de la taille du grain de film.
- Appareil selon la revendication 8, dans lequel le moyen de filtrage de déblocage filtre le bloc de grain de film sur toutes les arêtes de bloc.
- Procédé selon la revendication 1 ou appareil selon la revendication 8, dans lequel l'au moins un paramètre indique en outre l'intensité du grain de film.
- Procédé selon la revendication 1 ou appareil selon la revendication 8, dans lequel l'au moins un paramètre indique en outre la texture du grain de film.
- Programme informatique comprenant des instructions lisibles sur ordinateur pouvant être chargées dans la mémoire d'un ordinateur et indiquant à l'ordinateur de mettre en œuvre les étapes selon l'une quelconque des revendications 1 à 7, 9, 11 et 13 à 14.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US62070204P | 2004-10-21 | 2004-10-21 | |
PCT/US2005/037404 WO2006047138A2 (fr) | 2004-10-21 | 2005-10-17 | Technique de deblocage adaptatif de modeles de grains de films a base de blocs |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1803303A2 EP1803303A2 (fr) | 2007-07-04 |
EP1803303B1 true EP1803303B1 (fr) | 2019-12-04 |
Family
ID=35874366
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP05813106.1A Expired - Fee Related EP1803303B1 (fr) | 2004-10-21 | 2005-10-17 | Technique de deblocage adaptatif de modeles de grains de films a base de blocs |
Country Status (7)
Country | Link |
---|---|
US (1) | US7738722B2 (fr) |
EP (1) | EP1803303B1 (fr) |
JP (1) | JP4920592B2 (fr) |
KR (1) | KR101174179B1 (fr) |
CN (1) | CN101095356B (fr) |
CA (1) | CA2584027C (fr) |
WO (1) | WO2006047138A2 (fr) |
Families Citing this family (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2004095829A1 (fr) * | 2003-04-10 | 2004-11-04 | Thomson Licensing S.A. | Technique de simulation de grain sur une video codee |
JP2005100100A (ja) * | 2003-09-25 | 2005-04-14 | Toyota Motor Corp | 車輪情報処理装置および車輪情報処理方法 |
BRPI0415404B1 (pt) * | 2003-10-14 | 2018-07-17 | Thomson Licensing | técnica para a adição de um ruído de conforto de bits exatos |
US8150206B2 (en) * | 2004-03-30 | 2012-04-03 | Thomson Licensing | Method and apparatus for representing image granularity by one or more parameters |
CN101044510B (zh) | 2004-10-18 | 2012-01-04 | 汤姆森特许公司 | 胶片颗粒模拟方法 |
GB0424339D0 (en) * | 2004-11-03 | 2004-12-08 | Astrazeneca Ab | Combination therapy |
MX2007005653A (es) | 2004-11-12 | 2007-06-05 | Thomson Licensing | Simulacion de grano para reproduccion normal y reproduccion de modo de truco para sistemas de reproduccion de video. |
CA2587201C (fr) | 2004-11-16 | 2015-10-13 | Cristina Gomila | Procede de simulation de grain de film base sur des coefficients de transformation precalcules |
KR101270755B1 (ko) | 2004-11-16 | 2013-06-03 | 톰슨 라이센싱 | 비디오 시스템에서 비트-정확한 시뮬레이션을 위한 필름 그레인 sei 메시지 삽입 |
PT1812905T (pt) * | 2004-11-17 | 2019-08-06 | Interdigital Vc Holdings Inc | Método de simulação de grãos de película com bits de precisão com base em coeficientes transformados pré-calculados |
CA2587437C (fr) * | 2004-11-22 | 2015-01-13 | Thomson Licensing | Procedes, appareil et systeme de repartition de cache de grain de film pour simulation de grain de film |
WO2006057994A2 (fr) * | 2004-11-24 | 2006-06-01 | Thomson Licensing | Technique de simulation de grain d'emulsion pour dispositifs de reproduction de medias |
KR100703744B1 (ko) * | 2005-01-19 | 2007-04-05 | 삼성전자주식회사 | 디블록을 제어하는 fgs 기반의 비디오 인코딩 및디코딩 방법 및 장치 |
US8254462B2 (en) * | 2005-01-28 | 2012-08-28 | Broadcom Corporation | Method and system for block noise reduction |
US8213500B2 (en) | 2006-12-21 | 2012-07-03 | Sharp Laboratories Of America, Inc. | Methods and systems for processing film grain noise |
US8189946B2 (en) * | 2007-01-24 | 2012-05-29 | Canon Kabushiki Kaisha | Image processing apparatus and method thereof for detecting and removing noise in decoded images |
JP2008219163A (ja) * | 2007-02-28 | 2008-09-18 | Toshiba Corp | 情報符号化方法、情報再生方法、及び情報記憶媒体 |
US10715834B2 (en) | 2007-05-10 | 2020-07-14 | Interdigital Vc Holdings, Inc. | Film grain simulation based on pre-computed transform coefficients |
US8204128B2 (en) * | 2007-08-01 | 2012-06-19 | Her Majesty The Queen In Right Of Canada, As Represented By The Minister Of Industry, Through The Communications Research Centre Canada | Learning filters for enhancing the quality of block coded still and video images |
KR101680915B1 (ko) * | 2008-11-25 | 2016-11-29 | 톰슨 라이센싱 | 비디오 인코딩 및 디코딩을 위한 희소성-기반 아티팩트 제거 필터링 방법 및 장치 |
JP5361524B2 (ja) | 2009-05-11 | 2013-12-04 | キヤノン株式会社 | パターン認識システム及びパターン認識方法 |
JP2011223302A (ja) | 2010-04-09 | 2011-11-04 | Sony Corp | 画像処理装置と画像処理方法 |
JP2012044535A (ja) * | 2010-08-20 | 2012-03-01 | Toshiba Corp | 動画像符号化装置及び動画像符号化方法 |
JP5484310B2 (ja) * | 2010-12-24 | 2014-05-07 | キヤノン株式会社 | 画像処理装置及び画像処理装置の制御方法 |
KR102497153B1 (ko) * | 2012-01-18 | 2023-02-07 | 브이-노바 인터내셔널 리미티드 | 안정성 정보 및 트랜션트/확률적 정보의 구별되는 인코딩 및 디코딩 |
JP6082304B2 (ja) * | 2012-04-17 | 2017-02-15 | キヤノン株式会社 | 画像処理装置及びその処理方法 |
EP3503555B1 (fr) | 2017-12-21 | 2020-07-22 | Axis AB | Procédé et dispositif de commande permettant d'ajouter un bruit de confort à une séquence vidéo |
CN111711825B (zh) * | 2020-06-23 | 2024-04-30 | 腾讯科技(深圳)有限公司 | 视频编解码中的去块效应滤波方法、装置、设备及介质 |
CN112381744B (zh) * | 2020-10-27 | 2022-10-11 | 杭州微帧信息科技有限公司 | 一种av1合成胶片颗粒自适应前处理的方法 |
CA3156314A1 (fr) * | 2021-04-19 | 2022-10-19 | Comcast Cable Communications, Llc | Methodes, systemes et appareils pour le traitement adaptatif de contenu video avec un grain d'emulsion |
Family Cites Families (42)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4935816A (en) | 1989-06-23 | 1990-06-19 | Robert A. Faber | Method and apparatus for video image film simulation |
US4998167A (en) * | 1989-11-14 | 1991-03-05 | Jaqua Douglas A | High resolution translation of images |
US5374954A (en) | 1990-10-11 | 1994-12-20 | Harry E. Mowry | Video system for producing video image simulating the appearance of motion picture or other photographic film |
US5687011A (en) | 1990-10-11 | 1997-11-11 | Mowry; Craig P. | System for originating film and video images simultaneously, for use in modification of video originated images toward simulating images originated on film |
US5457491A (en) | 1990-10-11 | 1995-10-10 | Mowry; Craig P. | System for producing image on first medium, such as video, simulating the appearance of image on second medium, such as motion picture or other photographic film |
US5140414A (en) | 1990-10-11 | 1992-08-18 | Mowry Craig P | Video system for producing video images simulating images derived from motion picture film |
US5335013A (en) | 1992-01-16 | 1994-08-02 | Faber Robert A | Method and apparatus for video camera image film simulation |
US5471572A (en) | 1993-07-09 | 1995-11-28 | Silicon Graphics, Inc. | System and method for adding detail to texture imagery in computer generated interactive graphics |
US5475425B1 (en) | 1994-01-25 | 2000-07-25 | Przyborski Production | Apparatus and method for creating video ouputs that emulate the look of motion picture film |
US5831673A (en) | 1994-01-25 | 1998-11-03 | Przyborski; Glenn B. | Method and apparatus for storing and displaying images provided by a video signal that emulates the look of motion picture film |
WO1996013006A1 (fr) | 1994-10-20 | 1996-05-02 | Mark Alan Zimmer | Procede graphique numerique |
US5629769A (en) | 1995-06-01 | 1997-05-13 | Eastman Kodak Company | Apparatus and method for the measurement of grain in images |
AU711488B2 (en) * | 1995-09-12 | 1999-10-14 | Koninklijke Philips Electronics N.V. | Hybrid waveform and model-based encoding and decoding of image signals |
US5641596A (en) | 1995-12-05 | 1997-06-24 | Eastman Kodak Company | Adjusting film grain properties in digital images |
US6957350B1 (en) * | 1996-01-30 | 2005-10-18 | Dolby Laboratories Licensing Corporation | Encrypted and watermarked temporal and resolution layering in advanced television |
GB9607633D0 (en) * | 1996-04-12 | 1996-06-12 | Discreet Logic Inc | Grain matching of composite image in image |
US6370192B1 (en) * | 1997-11-20 | 2002-04-09 | Hitachi America, Ltd. | Methods and apparatus for decoding different portions of a video image at different resolutions |
US6847737B1 (en) * | 1998-03-13 | 2005-01-25 | University Of Houston System | Methods for performing DAF data filtering and padding |
US6667815B1 (en) * | 1998-09-30 | 2003-12-23 | Fuji Photo Film Co., Ltd. | Method and apparatus for processing images |
US6724942B1 (en) * | 1999-05-24 | 2004-04-20 | Fuji Photo Film Co., Ltd. | Image processing method and system |
US6317216B1 (en) | 1999-12-13 | 2001-11-13 | Brown University Research Foundation | Optical method for the determination of grain orientation in films |
CA2406459C (fr) | 2000-04-07 | 2006-06-06 | Demografx | Organisation renforcee en couches temporelles et par resolution dans la television avancee |
CA2309002A1 (fr) | 2000-05-23 | 2001-11-23 | Jonathan Martin Shekter | Reduction du grain de films utilises en photographie numerique |
US6940993B2 (en) * | 2000-12-13 | 2005-09-06 | Eastman Kodak Company | System and method for embedding a watermark signal that contains message data in a digital image |
US7206459B2 (en) * | 2001-07-31 | 2007-04-17 | Ricoh Co., Ltd. | Enhancement of compressed images |
US7227901B2 (en) * | 2002-11-21 | 2007-06-05 | Ub Video Inc. | Low-complexity deblocking filter |
KR20050098251A (ko) | 2003-01-20 | 2005-10-11 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | 비디오 코딩 |
WO2004095829A1 (fr) * | 2003-04-10 | 2004-11-04 | Thomson Licensing S.A. | Technique de simulation de grain sur une video codee |
US20040208389A1 (en) * | 2003-04-15 | 2004-10-21 | Silicon Integrated Systems Corp. | Digital picture processing method |
ZA200509227B (en) | 2003-05-15 | 2007-05-30 | Thomson Licensing | Method and apparatus for representing image granularity by one or more parameters |
US7245783B2 (en) * | 2003-06-24 | 2007-07-17 | Eastman Kodak Company | System and method for estimating, synthesizing and matching noise in digital images and image sequences |
RU2342703C2 (ru) * | 2003-09-23 | 2008-12-27 | Томсон Лайсенсинг | Методика имитации зернистости пленки с помощью частотной фильтрации |
WO2005034518A1 (fr) * | 2003-09-23 | 2005-04-14 | Thomson Licensing S.A. | Procede de simulation de grain de film par assemblage mosaique d'echantillons pretraites |
BRPI0415404B1 (pt) * | 2003-10-14 | 2018-07-17 | Thomson Licensing | técnica para a adição de um ruído de conforto de bits exatos |
US8150206B2 (en) * | 2004-03-30 | 2012-04-03 | Thomson Licensing | Method and apparatus for representing image granularity by one or more parameters |
PT1812905T (pt) * | 2004-11-17 | 2019-08-06 | Interdigital Vc Holdings Inc | Método de simulação de grãos de película com bits de precisão com base em coeficientes transformados pré-calculados |
CA2587437C (fr) * | 2004-11-22 | 2015-01-13 | Thomson Licensing | Procedes, appareil et systeme de repartition de cache de grain de film pour simulation de grain de film |
US8472526B2 (en) * | 2004-11-23 | 2013-06-25 | Thomson Licensing | Low-complexity film grain simulation technique |
WO2006057994A2 (fr) * | 2004-11-24 | 2006-06-01 | Thomson Licensing | Technique de simulation de grain d'emulsion pour dispositifs de reproduction de medias |
JP4914026B2 (ja) * | 2005-05-17 | 2012-04-11 | キヤノン株式会社 | 画像処理装置及び画像処理方法 |
US7596239B2 (en) * | 2005-08-02 | 2009-09-29 | Lsi Corporation | Method and/or apparatus for video watermarking and steganography using simulated film grain |
US7664337B2 (en) * | 2005-12-20 | 2010-02-16 | Marvell International Ltd. | Film grain generation and addition |
-
2005
- 2005-10-17 KR KR1020077011418A patent/KR101174179B1/ko active IP Right Grant
- 2005-10-17 CA CA2584027A patent/CA2584027C/fr not_active Expired - Fee Related
- 2005-10-17 JP JP2007537972A patent/JP4920592B2/ja not_active Expired - Fee Related
- 2005-10-17 CN CN2005800352014A patent/CN101095356B/zh not_active Expired - Fee Related
- 2005-10-17 US US11/252,177 patent/US7738722B2/en not_active Expired - Fee Related
- 2005-10-17 EP EP05813106.1A patent/EP1803303B1/fr not_active Expired - Fee Related
- 2005-10-17 WO PCT/US2005/037404 patent/WO2006047138A2/fr active Application Filing
Non-Patent Citations (1)
Title |
---|
None * |
Also Published As
Publication number | Publication date |
---|---|
US20060140278A1 (en) | 2006-06-29 |
CN101095356B (zh) | 2013-06-19 |
US7738722B2 (en) | 2010-06-15 |
EP1803303A2 (fr) | 2007-07-04 |
CN101095356A (zh) | 2007-12-26 |
JP2008518510A (ja) | 2008-05-29 |
KR20070084390A (ko) | 2007-08-24 |
KR101174179B1 (ko) | 2012-08-16 |
WO2006047138A3 (fr) | 2006-08-03 |
CA2584027A1 (fr) | 2006-05-04 |
WO2006047138A2 (fr) | 2006-05-04 |
JP4920592B2 (ja) | 2012-04-18 |
CA2584027C (fr) | 2014-12-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1803303B1 (fr) | Technique de deblocage adaptatif de modeles de grains de films a base de blocs | |
EP1803094B1 (fr) | Procede de simulation de grain d'emulsion | |
EP3862973B1 (fr) | Procédé et appareil pour représenter la granularité d'une image par un ou plusieurs paramètres | |
AU2004306091B2 (en) | Technique for simulating film grain using frequency filtering | |
US8150206B2 (en) | Method and apparatus for representing image granularity by one or more parameters | |
EP1809043B1 (fr) | Procédé permettant de simuler le grain d'un film a l'aide d'une base de données de motifs de grains de films |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20070417 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): DE FR GB IT |
|
17Q | First examination report despatched |
Effective date: 20070928 |
|
DAX | Request for extension of the european patent (deleted) | ||
RBV | Designated contracting states (corrected) |
Designated state(s): DE FR GB IT |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: THOMSON LICENSING SA |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602005056465 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: H04N0007260000 Ipc: H04N0019850000 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04N 19/85 20070704AFI20181108BHEP Ipc: H04N 19/86 20070704ALI20181108BHEP |
|
INTG | Intention to grant announced |
Effective date: 20181130 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04N 19/86 20140101ALI20181108BHEP Ipc: H04N 19/85 20140101AFI20181108BHEP |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04N 19/86 20140101ALI20181108BHEP Ipc: H04N 19/85 20140101AFI20181108BHEP |
|
GRAJ | Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted |
Free format text: ORIGINAL CODE: EPIDOSDIGR1 |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: INTERDIGITAL VC HOLDINGS, INC. |
|
INTC | Intention to grant announced (deleted) | ||
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20190517 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): DE FR GB IT |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602005056465 Country of ref document: DE |
|
RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: INTERDIGITAL VC HOLDINGS, INC. |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602005056465 Country of ref document: DE |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20200907 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191204 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20201030 Year of fee payment: 16 Ref country code: GB Payment date: 20201027 Year of fee payment: 16 Ref country code: FR Payment date: 20201027 Year of fee payment: 16 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602005056465 Country of ref document: DE |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20211017 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211017 Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220503 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211031 |