EP2321768B1 - Einheitlichkeit und originaltreue in wasserzeichen - Google Patents
Einheitlichkeit und originaltreue in wasserzeichen Download PDFInfo
- Publication number
- EP2321768B1 EP2321768B1 EP09808511.1A EP09808511A EP2321768B1 EP 2321768 B1 EP2321768 B1 EP 2321768B1 EP 09808511 A EP09808511 A EP 09808511A EP 2321768 B1 EP2321768 B1 EP 2321768B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- blockiness
- proposed
- change
- block
- score
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000008859 change Effects 0.000 claims description 73
- 238000000034 method Methods 0.000 claims description 23
- 238000012545 processing Methods 0.000 claims description 8
- 239000013598 vector Substances 0.000 description 11
- 238000012986 modification Methods 0.000 description 9
- 230000004048 modification Effects 0.000 description 9
- 230000000903 blocking effect Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 238000005259 measurement Methods 0.000 description 6
- 238000013507 mapping Methods 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 230000000875 corresponding effect Effects 0.000 description 3
- 238000005192 partition Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000037361 pathway Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000012512 characterization method Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000001502 supplementing effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/0021—Image watermarking
- G06T1/0028—Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/154—Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
- H04N19/467—Embedding additional information in the video signal during the compression process characterised by the embedded information being invisible, e.g. watermarking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/48—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using compressed domain processing techniques other than decoding, e.g. modification of transform coefficients, variable length coding [VLC] data or run-length data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2201/00—General purpose image data processing
- G06T2201/005—Image watermarking
- G06T2201/0053—Embedding of the watermark in the coding stream, possibly without decoding; Embedding of the watermark in the compressed domain
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2201/00—General purpose image data processing
- G06T2201/005—Image watermarking
- G06T2201/0202—Image watermarking whereby the quality of watermarked images is measured; Measuring quality or performance of watermarking methods; Balancing between quality and robustness
Definitions
- the present invention relates to a process for predicting and characterizing visibility of artifacts associated watermarks using a baseline luminance fidelity model and a blockiness fidelity model.
- Watermark embedding in a video stream is often required to be not noticeable, but at times introduces visible artifacts.
- Dekun Zou and J.A. Bloom disclose, in "H.264/AVC Stream Replacement Technique for video Watermarking" (Proceedings of the IEEE International conference on Acoustics, Speech and Signal Processing (ICASSP) 2008, PP. 1749-1752 ), a watermarking technique that operates directly at the bitstream level and that, in essence, modifies selected macroblocks in the frames of the video. While it discusses the visibility/robustness trade-off inherent to watermarking technologies, it remains very vague on how to assess the visibility of such changes. They remain particularly silent on how to capture blocking artefacts that are prone to be introduced by such watermarking techniques and doing so in an efficient manner.
- the disclosure relates to a method for predicting the visibility of artifacts associated with proposed watermarks in a block-based encoded video according to claim 1.
- the disclosure pertains to a system for predicting the visibility of artifacts associated with proposed watermarks in a block-based encoded video according to claim 4.
- the system can be a video encoder, a decoder, a post-processor processing output from a decoder, a pre-processor providing input to an encoder, or the like, wherein the threshold luminance and blockiness values are levels below which the changes to luminance and the blockiness are not perceptible to a human viewer.
- the invention provides a means for predicting the visibility of artifacts associated with prospective watermarks.
- the means for predicting visibility are measurements based on luminance fidelity model and a blockiness fidelity model. With these measurements, prospective watermarks which would produce objectionable visible artifacts can be avoided and watermarks which do not produce objectionable or visible artifacts can be employed.
- the invention is particularly useful to H.264/AVC video watermarking or any video encoding in which many blocking artifacts can be introduced by the embedding due to the motion vector change in inter-prediction and reference pixel change in intra-prediction.
- a blockiness fidelity measure has been developed and is described in detail later in this specification.
- the invention is intended to include modifying a CABAC-encoded H.264/AVC stream and for generating a list of CABAC (Context-based Adaptive Binary Arithmetic Coding)/AVC (Advanced Video Coding) compliant changes.
- each entry in the resulting list identifies a specific syntax element, its original value, and a candidate alternative value.
- a syntax element that appears in this list is considered a changeable syntax element and can appear in the list more than once, each time with a different candidate alternative value.
- a subset of the entries in this list can be selected and used for watermarking.
- An embodiment of the invention distinguishes changes that will introduce visible artifacts and those that will not and accordingly label the changes as visible or invisible, respectively, such that the classification is similar to one preformed by a human observer. Hence, those changes that will introduce visible artifacts can be removed from consideration, thereby leaving a subset of candidate alternative values that can be used to implement an invisible watermark.
- the luminance fidelity model is herein referred to as the baseline fidelity model.
- a change will be classified visible if it results in a large absolute change of the luminance values in the block directly affected by the change.
- a visibility measure is compared with a threshold.
- AbsDiff j ⁇ i ⁇ macroblk j x marked i ⁇ x org i
- x org ( i ) is the luminance of pixel i in macroblock j of the original, unmarked picture
- x marked ( i ) is the luminance of the same pixel in the watermarked version of the macroblock.
- the changes in block j are classified visible if AbsDiff j ⁇ h, and they are classified invisible if AbsDiff j ⁇ h.
- the changes classified as visible can be removed from the embedding list to avoid visual artifacts in the watermarked content. It is important to point out that a lower threshold h will help filter out more visible artifacts. However, it may also filter out many invisible watermarks leading to fewer changeable blocks for embedding. On the other hand, higher threshold can provide more changeable blocks but at the risk of introducing visual artifacts.
- the threshold can be adjusted to achieve the desired tradeoff.
- a change of a block may propagate to other blocks due to intra-prediction and inter-prediction.
- blocks indirectly affected are collectively called propagation path or propagation map .
- a propagation path is described as how a single change propagates within the same frame.
- Propagation mapping capabilities can be integrated in H.264 decoders. As such, propagations maps can be generated which can describe how a single change will propagate through space. An algorithm builds a propagation map to track the affected blocks and their changes. Propagation mapping is useful in many aspects. It can be used to examine the visual distortion resulting from a change. It can be used to avoid (1) changes that may result in overlapping propagation maps, (2) changes that may fall in the propagation path of a previous change or (3) multiple changes that combine such that a third block is affected by both. Propagation maps can be used to improve the detection region when these changes are employed for watermarking.
- the result can be predicted, but one may not know a priori whether or not the first change will be employed. If a map were constructed indicating all of the areas to which a change will propagate, then one can avoid making other changes inside of that propagation path. A combination of these two problems can also occur. If a region of a picture is modified indirectly, because a change in a different region has propagated to the current region, the current region can be examined in an assessment of the fidelity impact of that change. However, it is possible that there are multiple changes, all of which can propagate into the current region. If maps of the propagation paths of all the changes are available, one can identify the regions of overlapping propagation and can consider all combinations of impacts.
- Figure 4(a) shows an example propagation map.
- This propagation map 400 is associated with one block 410 whose motion vector has been directly changed.
- the other blocks 420 in the figure are blocks that will be indirectly changed due to propagation.
- Figure 4(b) illustrates the four neighbors 440 whose luminance values might be modified due to this propagation, when only one block 430 was directly changed.
- the propagation map, P, of a changed block represents a collection of the blocks, p, whose luminance values are also changed due to propagation.
- the "head_node” uniquely identifies the changed block in terms of position and the alternative value of the motion vector that initiated the changes. All of the nodes in the propagation map P will have the same "head_node.”
- the element “mode” indicates the prediction mode of the current block, which can be either intra-prediction or inter-prediction.
- the element "cur_node” records the information about the current block.
- the "cur_node” contains the original and new motion vectors for inter-predicted blocks and intra-prediction mode and reference blocks for intra-prediction blocks.
- Figure 5 shows a method for constructing the propagation map.
- block ⁇ i is an inter-predicted block, then in the inter-prediction pathway 540, one can examine the motion vector predicted using the new motion vector of p and those of the other neighbor blocks. If it is different from the original motion vector, then the change will propagate to this neighbor and block ⁇ i is appended to the propagation map P in the propagation box 560. If ⁇ i is intra-predicted in the intra-predicted pathway 550 and block p is used as the reference in the prediction, then the change will propagate to this neighbor and block ⁇ i is appended to the propagation map P in the propagation box 560. After all the four neighbors have been examined, the next element in P is considered. This process repeats until there are no new elements in P to arrive at finish box 570.
- the invention is intended to include the feature of propagation mapping being integrated into an H.264 decoder in the context of watermarking system in which a previous step has created a list of potential modifications, wherein each potential modification consists of a block identifier, an indication of which motion vector can be modified, and the alternative value for that motion vector. Note that, at this point, there can be a number of potential modifications for a single block. In a later step, the list of potential modifications can preferably be pruned so that no block has more than one modification.
- the propagation map P can be represented as a linked list, which, as a whole, will identify the macroblocks/partitions affected by the potential modification. As the decoder processes the macroblocks of B slices (in raster scan order), one can keep adding affected macroblocks/partitions to the corresponding linked lists.
- a preferred detailed integrated algorithm is the integration of propagation mapping with an AVC decoder.
- I linked lists can be constructed and each list can be initialized to contain one node, the potential modification itself.
- the sample data structure of the node p is shown in Table 1, which contains the location information of the macroblock/partition, original and new motion vector information. Since the process of propagation map building can be integrated into the AVC decoder, most of this information can be directly obtained from the decoder. Other information can be added based on the application of the propagation map.
- the luminance visibility measure is easily extended to account for artifacts introduced into the propagation path of a proposed change. To do this, the visibility measure is calculated for every macroblock in the propagation path of a proposed change and a visible measure is derived from all of these.
- Figure 1 shows a block diagram of a luminance fidelity model in which proposed macroblock changes j are first made in box 110. This is followed by identifying the propagation path associated with the change in box 120 and considering each of the blocks in the propagation path in box 130. Next, this is followed by calculating or determining absolute luminance change for the blocks in box 140 and determining the worst case value for the macroblock in box 150 and recording or updating the data for each of the macroblocks until each of the macroblocks in block k have been calculated in box 150.
- the proposed macroblock changes will be accepted in box 170 and if the worst case value is not less than the luminance visibility threshold, then other proposed macroblock changes will be considered in box 110 and similarly run through the block diagram until acceptable changes are identified.
- the baseline fidelity model works well, but there are classes of changes that introduce visible artifacts without introducing large luminance changes.
- the baseline model is limited to finding only those artifacts that are due to large luminance changes.
- a second class of artifacts that can be seen by the H.264/AVC watermarking can be blocking artifacts.
- a blocking artifact is visible when the pixel values on the edges of a block are correlated with the adjacent pixel values on the corresponding edges of the adjacent blocks in the original picture, but become significantly uncorrelated with those adjacent pixels in the watermarked picture. In this case, a viewer can perceive the edges of the block.
- this artifact occurs on all four edges of a block, the artifact appears as an erroneous block of data and is thus called a blocking artifact.
- the blockiness fidelity model incorporates a blockiness measure in addition to the luminance measure. Changes that cause a high blockiness measurement value or blockiness score are labeled as visible. In other words, the blockiness measure is how blocky the content becomes after certain processing (e.g. compression, watermarking) compared with the original content.
- the blockiness score measures how much blocky artifacts introduced by the processing. By compare the blockiness score with a threshold, the blocks with visible artifacts can be indentified and can be removed, accordingly.
- the block size can be 16 ⁇ 8, 8 ⁇ 16, 8 ⁇ 8, and 4 ⁇ 4. If one uses a large n, e.g.16, as the block size, then the macroblocks where only one of the 8 ⁇ 8 or 4 ⁇ 4 sub-blocks is changed may end up having a low blockiness score even though the changed sub-block is quite blocky. Therefore, the smallest possible block size, 4 ⁇ 4 should be used to calculate the blockiness score and then to sum them to obtain the final score for each 16 ⁇ 16 macroblock. Note that using a smaller block size to calculate the blockiness score has the same computational complexity as the large block size.
- the blockiness score of 4 ⁇ 4 sub-blocks By summing the blockiness score of 4 ⁇ 4 sub-blocks to obtain the final score of the macroblock, one takes into account the area of the blocky artifacts. If, for example, all the 16 4 ⁇ 4 blocks have non-zero blockiness score, it means the entire 16 ⁇ 16 macroblock has s blocky artifact and may be more visible than the case where only one sub-block having non-zero score. Alternatively, the highest score from the 16 sub-blocks as the final score for the macroblock can be selected.
- This blockiness measure can be applied to any rectangular, or at least piecewise linear, closed region such as a typical block. There are many ways that this can be used in various implementations. Since the BD+/AVC watermark is embedded macroblock by macroblock, a reasonable way would be to calculate the blockiness score using 16 ⁇ 16 as the block size. However, the blocks on the propagation path of the change are not necessarily 16 ⁇ 16. Depending on the inter- and intra-prediction modes, the block size can be 16 ⁇ 8, 8 ⁇ 16, 8 ⁇ 8, or 4 ⁇ 4. If one uses a large block size, e.g.16, then the macroblocks where only one of the 8 ⁇ 8 or 4 ⁇ 4 sub-blocks is changed may end up having a low blockiness score even though the changed sub-block is quite blocky.
- At least one disclosed implementation uses the smallest possible block size, 4 ⁇ 4, to calculate the blockiness score, and then add up the scores from the 16 adjacent 4 ⁇ 4 blocks to obtain the final score for each 16 ⁇ 16 macroblock. Note that using a smaller block size to calculate the blockiness score has the same computational complexity as the large block size.
- each of the 16 4 ⁇ 4 blocks has a non-zero blockiness score, it means the entire 16 ⁇ 16 macroblock has blocking artifacts which may be more visible than the case where only one sub-block has a non-zero score.
- An alternative embodiment is to select the highest score from the 16 sub-blocks as the final score for the macroblock. By doing that, one focuses on the 4x4 block with the highest blockiness score, which most likely will cause visual artifact.
- Figure 2 is a block diagram of the blockiness fidelity model based on both absolute luminance difference and blockiness measure.
- this model one compares the luminance measure with a threshold.
- a change to macroblock j is considered in box 210 and the absolute luminance change associated with the change is calculated in box 220. Changes that result in a luminance measure that exceeds the threshold are classified as visible in decision box 230. If the absolute luminance change is visible, then in decision box 230, one considers another change in macroblock j in box 210. On the other hand, if the change is not visible by the luminance measure in 230, then a blockiness score is calculated. The blockiness score is then compared with a blockiness threshold in decision box 250.
- Figure 3 shows a detailed block diagram of an enhanced fidelity model in which a proposed macroblock change j is first made in box 310. This is followed by identifying the propagation path associated with the change in box 320 and considering each of the blocks in the propagation path in box 330. Next, this is followed by calculating the absolute luminance change for the blocks in 340 and determining the worst case value for the macroblock in box 350. This visibility measure for a propagation path is the worst case (maximum) value. If the worst case value is less than the luminance visibility threshold in decision box 360, then the proposed macroblock change will be accepted and the process is advanced to box 370 to consider the accepted proposed macroblock from box 360.
- the visibility measure is used to account for artifacts introduced along the propagation path of a proposed change.
- MaxBlk k is compared with the blockiness threshold to determine if the proposed change k could introduce visible artifacts.
- the embodiments described herein may be implemented in, for example, a method or process, an apparatus, a software program, a datastream, or a signal. Even if only discussed in the context of a single form of implementation such as a method, the implementation or features discussed may also be implemented in other forms such as an apparatus or program.
- An apparatus may be implemented in, for example, appropriate hardware, software, and firmware.
- the methods may be implemented in, for example, an apparatus such as, for example, a computer or other processing device. Additionally, the methods may be implemented by instructions being performed by a processing device or other apparatus, and such instructions may be stored on a computer readable medium such as, for example, a CD, or other computer readable storage device, or an integrated circuit. Further, a computer readable medium may store the data values produced by an implementation.
- implementations may also produce a signal formatted to carry information that may be, for example, stored or transmitted.
- the information may include, for example, instructions for performing a method, or data produced by one of the described implementations.
- a signal may be formatted to carry a watermarked stream, an unwatermarked stream, a fidelity measure, or other watermarking information.
- the metrics and methods disclosed herein can be used to keep or select watermarks or changes because they will be visible to a human observer.
- many embodiments may be implemented in one or more of an encoder, a decoder, a post-processor processing output from a decoder, or a pre-processor providing input to an encoder.
- other implementations are contemplated by this disclosure.
- additional implementations may be created by combining, deleting, modifying, or supplementing various features of the disclosed implementations. Such additional implementations are considered to belong to the invention only if they fall under the scope of the appended claims. Indeed, the scope of the invention is defined by the appended claims.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Editing Of Facsimile Originals (AREA)
- Image Processing (AREA)
Claims (9)
- Verfahren zur Vorhersage der Sichtbarkeit von Artefakten, die mit vorgeschlagenen Wasserzeichen in einem blockbasiert kodierten Video verbunden sind, umfassend:Bereitstellen mehrerer vorgeschlagener Makroblockänderungen, die mit den vorgeschlagenen Wasserzeichen verbunden sind;Bestimmen (220) einer absoluten Luminanzdifferenz für mindestens eine der vorgeschlagenen Makroblockänderungen;Bestimmen (230), ob die vorgeschlagene Makroblockänderung sichtbar ist, basierend auf der absoluten Luminanzdifferenz;wobei das Verfahren dadurch gekennzeichnet ist, dass es ferner umfasst:Bestimmen (240) einer Blockigkeitsbewertung der vorgeschlagenen Makroblockänderung, wenn die vorgeschlagene Makroblockänderung nicht sichtbar ist, basierend auf der absoluten Luminanzdifferenz;Bestimmen (250), ob die vorgeschlagene Makroblockänderung sichtbar ist, basierend auf der Blockigkeitsbewertung; undHinzufügen (260) der vorgeschlagenen Makroblockänderung zu einer Liste akzeptabler Änderungen, wenn die vorgeschlagene Makroblockänderung weiterhin nicht sichtbar ist, basierend auf der Blockigkeitsbewertung.
- Verfahren nach Anspruch 1:wobei das Bestimmen (220, 340) einer absoluten Luminanzdifferenz ferner umfasst:Erstellen (320, 330) einer Ausbreitungskarte, die jeden der Blöcke innerhalb desselben Einzelbildes des Videos bestimmt, die von der vorgeschlagenen Makroblockänderung betroffen sind;Sammeln einer absoluten Luminanzdifferenz für jeden Block in der Ausbreitungskarte;und wobei das Bestimmen (230, 360), ob die vorgeschlagene Makroblockänderung sichtbar ist, auf der Grundlage der absoluten Luminanzdifferenz ferner ein Vergleichen des Maximums der gesammelten absoluten Luminanzdifferenzen in der Ausbreitungskarte mit einem Luminanzschwellenwert für die Sichtbarkeit umfasst.
- Verfahren nach Anspruch 2, umfassend:wobei das Bestimmen (375) einer Blockigkeitsbewertung der vorgeschlagenen Makroblockänderung ferner ein Sammeln einer Blockigkeitsbewertung für jeden Block in der Ausbreitungskarte umfasst; undwobei das Bestimmen (390), ob die vorgeschlagene Makroblockänderung sichtbar ist, basierend auf der Blockigkeitsbewertung ferner ein Vergleichen des Maximums der Blockigkeitsbewertung in der Ausbreitungskarte mit einem Blockigkeitsschwellenwert für die Sichtbarkeit umfasst, wobei vorgeschlagene Makroblockänderungen, die den Sichtbarkeitsschwellenwert für den Luminanzschwellenwert für die Sichtbarkeit und den Blockigkeitsschwellenwert für die Sichtbarkeit nicht überschreiten, zu der Liste der akzeptablen Änderungen hinzugefügt werden.
- System zur Vorhersage der Sichtbarkeit von Artefakten, die mit vorgeschlagenen Wasserzeichen in einem blockbasiert kodierten Video verbunden sind, umfassend:einen Prozessor, der geeignet ist, mehrere vorgeschlagene Makroblockänderungen zu sammeln oder zu erzeugen, die mit den vorgeschlagenen Wasserzeichen verbunden sind;einen Luminanzrechner, der dazu ausgelegt ist, eine absolute Luminanzdifferenz für mindestens eine der vorgeschlagenen Makroblockänderungen zu berechnen;wobei das System dadurch gekennzeichnet ist, dass es ferner umfassteinen Blockigkeitsrechner, der angepasst ist, um eine Blockigkeitsbewertung der vorgeschlagenen Makroblockänderung zu berechnen, wenn die vorgeschlagene Makroblockänderung nicht sichtbar ist, basierend auf der absoluten Luminanzdifferenz; undeinen Listensammler, der angepasst ist, um vorgeschlagene Makroblockänderungen zu sammeln, die nicht sichtbar sind, basierend auf der absoluten Luminanzdifferenz und auf der Blockigkeitsbewertung.
- System nach Anspruch 4, wobei es sich bei dem System um einen Video-Kodierer, einen Dekodierer, einen Postprozessor, der die Ausgabe eines Dekodierers verarbeitet, oder einen Vorprozessor, der eine Eingabe für einen Kodierer bereitstellt, handelt.
- System nach Anspruch 4 oder Anspruch 5wobei der Prozessor dazu ausgelegt ist, eine Ausbreitungskarte zu erzeugen, die jeden der Blöcke innerhalb desselben Einzelbildes des Videos bestimmt, die von der vorgeschlagenen Makroblockänderung betroffen sind;wobei der Luminanzrechner dazu ausgelegt ist, die absolute Luminanzdifferenz für jeden Block in der Ausbreitungskarte zu sammeln und das Maximum der gesammelten absoluten Luminanzdifferenzen in der Ausbreitungskarte mit einem Luminanzschwellenwert für die Sichtbarkeit zu vergleichen;und wobei der Blockigkeitsrechner dazu ausgelegt ist, die Blockigkeitsbewertung für jeden Block in der Ausbreitungskarte zu sammeln und das Maximum der gesammelten Blockigkeitsbewertungen in der Ausbreitungskarte mit einem Blockigkeitsschwellenwert für die Sichtbarkeit zu vergleichen.
- System nach Anspruch 6, wobei der Luminanzschwellenwert und der Blockigkeitsschwellenwert Werte sind, unterhalb derer Änderungen der Luminanz und der Blockigkeit für einen menschlichen Betrachter nicht wahrnehmbar sind.
- System nach Anspruch 6, wobei der Listensammler oder Prozessor dazu ausgelegt ist, eine vorgeschlagene Makroblockänderung als ein spezifisches Syntaxelement, einen Originalwert und einen alternativen Kandidatenwert zu identifizieren.
- System nach Anspruch 6, wobei der Prozessor dazu ausgelegt ist, das Video mit einem Wasserzeichen zu versehen, indem er eine Liste von vorgeschlagenen Makroblockänderungen verwendet, die basierend auf der absoluten Luminanzdifferenz und der Blockigkeitsbewertung nicht sichtbar sind.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US18958608P | 2008-08-20 | 2008-08-20 | |
PCT/US2009/004752 WO2010021722A1 (en) | 2008-08-20 | 2009-08-20 | Blockiness and fidelity in watermarking |
Publications (3)
Publication Number | Publication Date |
---|---|
EP2321768A1 EP2321768A1 (de) | 2011-05-18 |
EP2321768A4 EP2321768A4 (de) | 2015-10-28 |
EP2321768B1 true EP2321768B1 (de) | 2023-10-04 |
Family
ID=41707390
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP09808511.1A Active EP2321768B1 (de) | 2008-08-20 | 2009-08-20 | Einheitlichkeit und originaltreue in wasserzeichen |
Country Status (7)
Country | Link |
---|---|
US (1) | US20110142418A1 (de) |
EP (1) | EP2321768B1 (de) |
JP (1) | JP5285159B2 (de) |
KR (1) | KR101650882B1 (de) |
CN (1) | CN102187351B (de) |
BR (1) | BRPI0917202B1 (de) |
WO (1) | WO2010021722A1 (de) |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8335401B2 (en) | 2010-04-09 | 2012-12-18 | Dialogic Corporation | Blind blocking artifact measurement approaches for digital imagery |
WO2013112744A2 (en) * | 2012-01-24 | 2013-08-01 | Futurewei Technologies, Inc. | Compressed domain watermarking with reduced error propagation |
EP2960854A1 (de) * | 2014-06-27 | 2015-12-30 | Thomson Licensing | Verfahren und Vorrichtung zur Bestimmung eines Satzes von modifizierbaren Elementen in einer Gruppe von Bildern |
ES2865376T3 (es) | 2014-11-07 | 2021-10-15 | Sony Group Corp | Dispositivo de transmisión, procedimiento de transmisión, dispositivo de recepción y procedimiento de recepción |
WO2016201092A1 (en) | 2015-06-10 | 2016-12-15 | Boston Scientific Scimed, Inc. | Bodily substance detection by evaluating photoluminescent response to excitation radiation |
EP3151189B1 (de) * | 2015-10-02 | 2021-12-15 | ContentArmor | Verfahren zur bestimmung eines modifizierbaren blocks |
KR102201872B1 (ko) * | 2018-12-04 | 2021-01-13 | 아주대학교 산학협력단 | 센서리스 제어가 적용된 발전시스템의 구동 재개 장치 및 방법 |
US11734784B2 (en) * | 2019-11-14 | 2023-08-22 | Sony Interactive Entertainment Inc. | Metadata watermarking for ‘nested spectating’ |
CN111711822B (zh) * | 2020-06-22 | 2022-04-01 | 中国人民武装警察部队工程大学 | 基于宏块复杂度的视频隐写方法、系统及装置 |
EP4217957A1 (de) * | 2020-09-23 | 2023-08-02 | Verance Corporation | Auf psychovisuellem modell basierende videowasserzeichenverstärkungsanpassung |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001119557A (ja) * | 1999-10-19 | 2001-04-27 | Nippon Hoso Kyokai <Nhk> | 電子透かし埋め込み装置および方法 |
US7113612B2 (en) * | 2001-03-22 | 2006-09-26 | Victor Company Of Japan, Ltd. | Apparatus for embedding and reproducing watermark into and from contents data |
JP4079620B2 (ja) * | 2001-10-30 | 2008-04-23 | ソニー株式会社 | 電子透かし埋め込み処理装置、および電子透かし埋め込み処理方法、並びにコンピュータ・プログラム |
JP3854502B2 (ja) * | 2001-12-12 | 2006-12-06 | 興和株式会社 | 電子透かしの埋め込み方法および抽出方法 |
JP4024153B2 (ja) * | 2003-01-10 | 2007-12-19 | 三洋電機株式会社 | 電子透かし埋め込み方法およびその方法を利用可能な符号化装置と復号装置 |
US7706663B2 (en) * | 2004-10-12 | 2010-04-27 | Cyberlink Corp. | Apparatus and method for embedding content information in a video bit stream |
US7630512B2 (en) * | 2005-05-26 | 2009-12-08 | Alcatel-Lucent Usa Inc. | Method for performing recoverable video and image watermarking which survives block-based video and image compression |
JP4580898B2 (ja) | 2006-06-05 | 2010-11-17 | 株式会社東芝 | 電子透かし埋め込み装置 |
US8588459B2 (en) * | 2007-06-14 | 2013-11-19 | Thomson Licensing | Modifying a coded bitstream |
-
2009
- 2009-08-20 US US12/737,783 patent/US20110142418A1/en not_active Abandoned
- 2009-08-20 WO PCT/US2009/004752 patent/WO2010021722A1/en active Application Filing
- 2009-08-20 EP EP09808511.1A patent/EP2321768B1/de active Active
- 2009-08-20 CN CN200980141540.9A patent/CN102187351B/zh active Active
- 2009-08-20 JP JP2011523818A patent/JP5285159B2/ja not_active Expired - Fee Related
- 2009-08-20 BR BRPI0917202-5A patent/BRPI0917202B1/pt not_active IP Right Cessation
- 2009-08-20 KR KR1020117006233A patent/KR101650882B1/ko active IP Right Grant
Also Published As
Publication number | Publication date |
---|---|
EP2321768A4 (de) | 2015-10-28 |
EP2321768A1 (de) | 2011-05-18 |
BRPI0917202A2 (pt) | 2015-11-10 |
CN102187351A (zh) | 2011-09-14 |
WO2010021722A1 (en) | 2010-02-25 |
US20110142418A1 (en) | 2011-06-16 |
KR20110055662A (ko) | 2011-05-25 |
BRPI0917202B1 (pt) | 2020-03-10 |
CN102187351B (zh) | 2015-06-17 |
KR101650882B1 (ko) | 2016-08-24 |
JP5285159B2 (ja) | 2013-09-11 |
JP2012500570A (ja) | 2012-01-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2321768B1 (de) | Einheitlichkeit und originaltreue in wasserzeichen | |
US9042455B2 (en) | Propagation map | |
RU2709158C1 (ru) | Кодирование и декодирование видео с повышенной устойчивостью к ошибкам | |
CN111819853B (zh) | 图像块编码装置和图像块编码方法 | |
CN103975587B (zh) | 针对图像的一组重建样本的补偿偏移的编码/解码的方法和装置 | |
EP3389276B1 (de) | Hash-basierte codiererentscheidungen zur videocodierung | |
US9113231B2 (en) | Changeable block list | |
US8948443B2 (en) | Luminance evaluation | |
US20160100186A1 (en) | Method and apparatus for vector encoding in video coding and decoding | |
US8824727B2 (en) | Selection of watermarks for the watermarking of compressed video | |
KR20110061551A (ko) | 상황-기반의 적응형 이진 산술 코딩(cabac)비디오 스트림 준수 | |
TW201515442A (zh) | 解碼器、編碼器、及相關聯方法和電腦程式 | |
TW201041406A (en) | Image predictive encoding device, image predictive encoding method, image predictive encoding program, image predictive decoding device, image predictive decoding method, and image predictive decoding program | |
EP2960854A1 (de) | Verfahren und Vorrichtung zur Bestimmung eines Satzes von modifizierbaren Elementen in einer Gruppe von Bildern | |
JP4931214B2 (ja) | 画像処理装置及びその方法 | |
TW202325024A (zh) | 影像處理裝置、及影像處理方法 | |
JP5178616B2 (ja) | シーンチェンジ検出装置および映像記録装置 | |
EP3151189A1 (de) | Verfahren zur bestimmung eines modifizierbaren blocks |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20110224 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA RS |
|
DAX | Request for extension of the european patent (deleted) | ||
RA4 | Supplementary search report drawn up and despatched (corrected) |
Effective date: 20150925 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04N 19/51 20140101ALI20150921BHEP Ipc: H04N 19/467 20140101ALI20150921BHEP Ipc: H04N 19/48 20140101ALI20150921BHEP Ipc: H04N 19/154 20140101ALI20150921BHEP Ipc: G06T 1/00 20060101ALI20150921BHEP Ipc: H04N 19/176 20140101ALI20150921BHEP Ipc: H04N 19/86 20140101ALI20150921BHEP Ipc: G06K 9/48 20060101AFI20150921BHEP |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: CONTENTARMOR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20191106 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602009065048 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G06K0009480000 Ipc: H04N0019467000 Ref country code: DE Ref legal event code: R079 Free format text: PREVIOUS MAIN CLASS: G06K0009480000 Ipc: H04N0019467000 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G06T 1/00 20060101ALI20230320BHEP Ipc: H04N 19/48 20140101ALI20230320BHEP Ipc: H04N 19/154 20140101ALI20230320BHEP Ipc: H04N 19/51 20140101ALI20230320BHEP Ipc: H04N 19/176 20140101ALI20230320BHEP Ipc: H04N 19/86 20140101ALI20230320BHEP Ipc: H04N 19/467 20140101AFI20230320BHEP |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20230502 |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: ZOU, DEKUN Inventor name: BLOOM, JEFFREY ADAM Inventor name: HE, SHAN |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230524 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602009065048 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 602009065048 Country of ref document: DE Representative=s name: EISENFUEHR SPEISER PATENTANWAELTE RECHTSANWAEL, DE |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20231004 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1619032 Country of ref document: AT Kind code of ref document: T Effective date: 20231004 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240105 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240204 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240204 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240105 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240104 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240205 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240104 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602009065048 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231004 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20240705 |