EP1716542A1 - Verfahren und vorrichtung zum ermitteln einer ziel-haarfarbe für eine ursprungs-haarfarbe eines haarbereichs in einem digitalen bild nach erfolgter haarfarbveränderung - Google Patents
Verfahren und vorrichtung zum ermitteln einer ziel-haarfarbe für eine ursprungs-haarfarbe eines haarbereichs in einem digitalen bild nach erfolgter haarfarbveränderungInfo
- Publication number
- EP1716542A1 EP1716542A1 EP05706768A EP05706768A EP1716542A1 EP 1716542 A1 EP1716542 A1 EP 1716542A1 EP 05706768 A EP05706768 A EP 05706768A EP 05706768 A EP05706768 A EP 05706768A EP 1716542 A1 EP1716542 A1 EP 1716542A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- hair
- hair color
- color
- coding information
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000037308 hair color Effects 0.000 title claims abstract description 435
- 210000004209 hair Anatomy 0.000 title claims abstract description 183
- 238000000034 method Methods 0.000 title claims description 37
- 206010019030 Hair colour changes Diseases 0.000 claims description 14
- 230000009466 transformation Effects 0.000 claims description 11
- 238000012795 verification Methods 0.000 abstract 1
- 239000003086 colorant Substances 0.000 description 63
- 239000000118 hair dye Substances 0.000 description 14
- 238000012545 processing Methods 0.000 description 10
- 238000004040 coloring Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 238000011161 development Methods 0.000 description 4
- 230000018109 developmental process Effects 0.000 description 4
- 239000003795 chemical substances by application Substances 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 239000013598 vector Substances 0.000 description 3
- 238000005282 brightening Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000003860 storage Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 238000004061 bleaching Methods 0.000 description 1
- 239000007844 bleaching agent Substances 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000004456 color vision Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000004042 decolorization Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000004043 dyeing Methods 0.000 description 1
- 239000003051 hair bleaching agent Substances 0.000 description 1
- 230000003760 hair shine Effects 0.000 description 1
- 230000009191 jumping Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000001454 recorded image Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000001131 transforming effect Effects 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A45—HAND OR TRAVELLING ARTICLES
- A45D—HAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
- A45D44/00—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
- A45D44/005—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms for selecting or displaying personal cosmetic colours or hairstyle
-
- A—HUMAN NECESSITIES
- A45—HAND OR TRAVELLING ARTICLES
- A45D—HAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
- A45D19/00—Devices for washing the hair or the scalp; Similar devices for colouring the hair
- A45D19/0041—Processes for treating the hair of the scalp
- A45D19/0066—Coloring or bleaching
Definitions
- Digital image processing represents an important area in the area of hair color consultation, because in this way the effects of a possible hair coloring on the person's hair color can be explained very quickly and clearly to a person. This is done, for example, by taking a digital image of a person, including the person's hair area, and determining the person's hair color. This is followed by a color transformation of the color information assigned to the pixels of the hair area to the target hair color in accordance with the desired hair coloring. The image of the person with the hair area, to which the color-transformed color information is now assigned, is shown to the person who now receives an idea of the coloring result without the hair coloring actually having to be carried out on the hair.
- color fastness is very important, in other words, the reliability that the result hair color shown to the person corresponds as exactly as possible to the actual result of hair coloring that would be carried out on the person's hair.
- RGB color space red, green, blue color space
- CMY color space cyan, magenta, yellow color space
- HLS - color space H: color angle in the color wheel
- L brightness of the color
- [2] also describes a method and a device for processing a digitized image stored in a first computer.
- data display unit parameters of a data display unit connected to a second computer are set manually by a user of the data display unit and transmitted from the second computer to the first computer via a telecommunications network.
- the data display unit parameters describe the data display unit.
- the first coding information in particular the color information, is changed from the first computer, depending on the data display unit parameters in the HLS color space, to second coding information and the second coding information is transmitted to the first computer.
- [2] also describes a transformation of coding information from the RGB color space into the HLS color space and vice versa from the HLS color space into the RGB color space.
- a hair color consultation system is known from [3], in which an original hair color of a person is virtually mapped to a target hair color in a recorded image by means of a computer.
- the captured image of the person with the original hair color and / or a simulated image of the person with the target hair color is shown to a user on a screen.
- [4] also describes a method for a hair color consultation, in which individual images of a customer are continuously recorded using a video camera and transmitted to the computer in real time. For each individual image, a customer's hair area is identified, the hair color in this hair area according to specified specifications changed and the changed individual images are displayed to a user in real time on a screen.
- [5] describes a color matching method, it being disclosed in [5] to form several color categories in an HLS color space depending on different Hue values, different luminance values and different saturation values.
- a method for changing colors in a digital image is known from [6].
- the color representation of the color range to be changed is mapped with the original color and the target color in an HLS color space representation. Furthermore, the difference between the luminance values of the original color and the target color is determined.
- the color change is then carried out for each pixel in accordance with this method, it being checked for the hue values of the original color whether they lie within a variation range of the hue values of the target color. If this is not the case, the original color is not changed. If this is the case, however, the respective hue value of the pixel of the original color is replaced by the hue value of the target color. Furthermore, in this case, the luminance value of the pixel of the original color is increased by the difference of the luminance values of the original color and the target color.
- the pixels are then transformed into the RGB color space representation.
- the invention is based on the problem of specifying a method and a device for determining a target hair color for a source hair color of a hair area in a digital image after the hair color change has taken place, which thus manage with reduced computer resource requirements compared to the prior art without the color fastness is reduced.
- the problem is solved by the method and the device for determining a target hair color for an original hair color of a hair area in a digital image after the hair color change has taken place, with the features according to the independent patent claims.
- Hair color changes are assigned to a large number of predefined hair color classes.
- the hair area in the digital image has pixels to which coding information, coded in accordance with the HLS color space (H: color angle in the so-called color circle, L: brightness of the color, S: saturation of the color), is assigned, with each pixel in the hair area having one Hair color class in the HLS color space is assigned at least, preferably exactly one, to a predetermined luminance value according to the hair color class. It is checked whether the original hair color and the target hair color are assigned to the same hair color class. In the event that the source hair color and the target hair color are assigned to different hair color classes, the source hair color coding information assigned to the source hair color is assigned to that of the target
- Target hair color coding information associated with hair color is transformed in the HLS color space, the at least one, preferably exactly one, luminance value (brightness value) of the hair color class of the original hair color being replaced by the at least one luminance value of the hair color class of the target hair color.
- a device for determining a target hair color for an original hair color of a hair area in a digital image after the hair color has been changed has one
- Processor unit which is set up such that the Process steps described above are carried out or can be carried out.
- Hair color class are essentially the same, in other words constant. According to the invention, this knowledge was used in a descriptive manner in order to separate the hair color classes into discrete planes in the HLS color space, hereinafter also referred to as hair color class planes, perpendicular to the luminance axis (L axis) of the luminance (L values), to subdivide the saturation (S values) and the color angle (H values) across the HLS color space.
- hair color class planes perpendicular to the luminance axis (L axis) of the luminance (L values), to subdivide the saturation (S values) and the color angle (H values) across the HLS color space.
- Image processing for describing hair colors can be clearly interpreted as a sphere, in which the hair color class levels are introduced, which are normally aligned with the L axis.
- the hair color class levels are introduced, which are normally aligned with the L axis.
- it is viewed as a cylinder, the longitudinal axis of which is parallel to the L axis or is formed by it.
- the replacement of the luminance value according to the invention thus clearly corresponds to a discrete shift of the L values along the L axis by one
- the invention makes it possible to change the hair color in the context of digital image processing with considerably reduced computing resources.
- An additional advantage of the invention can be seen in the fact that for the usual case that the manufacturer of a hair colorant (for example a hair lightener, a hair dye or a hair tinting agent) specifies so-called tolerance ranges in which the hair colorant still has the desired coloring results can achieve with sufficient reliability.
- a hair colorant for example a hair lightener, a hair dye or a hair tinting agent
- the luminance value or values are only replaced in a predetermined range of hair color level levels which are arranged adjacent to the hair color level level associated with the original hair color, preferably only in the area of the hair color level levels the tolerance range of the respective hair color coloring.
- reference origin hair color coding information and at least one reference target hair color coding information which is generated by applying the hair color change to hair of the reference origin hair color, are stored where the reference origin hair color coding information and the
- Reference target hair color coding information is coded according to the HLS color space.
- the storage is preferably done in a reference table.
- the source hair color coding information is transformed to the target hair color coding information in the HLS color space using the reference source corresponding to the source hair color coding information.
- Hair color coding information and the associated reference target hair color coding information as target hair color coding information preferably thus using the reference table in which the above-mentioned information is stored.
- Is a tolerance range for a hair colorant i.e. If an application area is provided across several hair color classes, the indication of the application area is also stored in the reference table.
- the target hair color does not have to be determined and stored for each original hair color in the area of application, but it is sufficient to determine and apply the corresponding target hair color only for the primary original hair color to save.
- the other original hair colors of the application area can be taken into account by simply "jumping" between the hair color class levels, i.e. by correspondingly replacing the luminance values of the original hair colors.
- Hair color changing agent hair coloring (with a hair coloring agent) and / or hair lightening (with a hair lightening agent) can be carried out.
- the original hair color coding information assigned to the original hair color is converted to the target hair color coding information assigned to the target hair color transformed, the at least one luminance value remains essentially unchanged.
- the natural hair colors are assigned to at least a part, preferably one of all, of the following hair color classes: extra light blonde; Light Blonde; Medium Blonde; Darkblond; Light Brown; Medium brown; Dark Brown; Black Brown; Black .
- the hair colors representing red hair are preferably not included in the above-mentioned scale as a separate hair color class.
- the reason lies in the difficult to predict effect of hair coloring on red hair. According to one embodiment of the invention, the following identities are used as an approximation:
- the transformation of the source hair color coding information to the target hair color coding information assigned to the target hair color in the HLS color space preferably has the following steps:
- the original hair color coding information is transformed to a first intermediate hair color coding information in the HLS color space, the at least one luminance value remaining unchanged,
- the at least one luminance value of the hair color class of the original hair color is replaced by the luminance value of the hair color class of the target hair color, so that a second intermediate hair color coding information is formed in the HLS color space,
- the second intermediate hair color coding information is transformed to the target hair color coding information in the HLS color space.
- Transformation of the original hair color coding information to an intermediate value namely to the first intermediate hair color coding information.
- the shift between the hair color class levels i.e. replacing the L value of the first intermediate hair color coding information with the corresponding L value of the second intermediate hair color coding information, which is preferably stored in the reference table.
- the first intermediate hair color coding information and the second intermediate hair color coding information both have the same predetermined saturation value in the HLS color space.
- the first intermediate hair color coding information and the second intermediate hair color coding information both have the predetermined saturation value zero in the HLS color space.
- FIG. 1 shows a representation of discrete hair color class levels according to an embodiment of the invention
- FIG. 2 shows the HLS color space
- FIG. 3 shows a digital image of a hair loop as a hair area
- FIG. 4 shows a plurality of digital images with hair loops in the RGB color space
- FIG. 5 shows a representation of hair colorants in a first hair color level n
- FIG. 6 shows a representation of hair colorants in a second hair color level n + 1;
- FIG. 7 shows hair colorants of the first hair color level from FIG. 5 and the second hair colorants from FIG. 6;
- FIG. 8 shows a flow chart of a digital color change according to a first exemplary embodiment of the invention
- FIG. 9 shows a flow chart of a digital color change according to a second exemplary embodiment of the invention.
- FIGS. 10A and 10B are a flowchart showing the removal of the saturation values according to an embodiment of the invention.
- FIG. 11 shows a representation of a different weighting of color values in different hair Sub-areas of the hair area according to an embodiment of the invention.
- HLS color space 200 H (Hue): color angle in the color wheel, L (luminance): brightness of the color, S: saturation of the color
- H Hue
- L luminance
- S saturation of the color
- the value ranges of the HLS color space 200 are as follows:
- H value assigned to H 0 °.
- the luminance of a respective pixel describes the "brightness" of a color and is plotted along a luminance axis 202 in the HLS color space 200.
- At the coordinate origin of the HLS color space 200 is the
- the luminance values are standardized according to the HLS color space 200 or the HLS color model to a value range between the value 0 and the value 1 ( 0 ⁇ L ⁇ 1).
- the saturation S plotted in the HLS color space 200 along a saturation axis 203, indicates the saturation of the respective color.
- the saturation values are in the HLS Color space 200 or the HLS color mode 11 normalizes to a value range between the value 0 and the value 1 (0 ⁇ S ⁇ 1).
- a color in the HLS color space 200 is defined by the trip ice defined by means of the three variables described above and thus represents a vector in the HLS color space 200 within the HLS color space 200.
- a digital image is recorded by means of a camera and fed to a computer for digital image processing.
- the camera can be an analog camera or a digital camera.
- the analog signals are converted into a digital signal, for example by means of scanning, by means of an analog / digital converter and the digital signal generated thereby is further processed in the context of digital image processing.
- digital image 300 contains at least one hair loop, generally one
- Hair area 301 i.e. an area in which elements are included in an intended hair color.
- the digital image to be processed has 300 pixels in the hair area 301, which encoding information, encoded according to the HLS color model described above.
- the hair area 301 is divided into sub-hair areas, for example the main hair area 302 (hereinafter also referred to as “normal” hair area), a shadow hair area 303 and a glossy hair area 304 (also below) referred to as the highlight hair area).
- the natural hair colors of people are divided into the following hair color classes: • light blonde, medium blonde, dark blonde, light brown, medium brown, • dark brown and black.
- additional hair color classes to be provided for additional natural hair colors, for example a hair color class for extra light blonde, one for black brown and one for gray.
- a numerical code is used which is assigned to the natural hair colors described above and to the extension natural hair colors as follows: 10.0 - extra light blonde 9.0 - light blonde 8.0 - medium blonde 7.0 - dark blonde 6.0 - light brown 5.0 - medium brown • 4.0 - dark brown 3.0 - black brown 2.0 - black.
- Red hair colors i.e. According to this exemplary embodiment, red hair is not included in the above-mentioned scale as a separate hair color class. The reason lies in the difficult to predict effect of hair coloring on red hair. According to this exemplary embodiment of the invention, the following approximations are provided as an assignment of the respective different red hair colors to the hair color classes described above:
- the coding information after being recorded by means of the digital camera or by means of the analog camera and, in the case of an analog camera, after the analog / digital conversion has been carried out is coded in accordance with the RGB color space.
- the natural hair colors in the digital image are initially shown in the RGB color space, that is, the pixels in the hair area 301 of the digital image 300 are assigned number triples, the components of which are the color components "red", "green” and Represent "blue”.
- the color information, coded in accordance with the RGB color space is converted, ie transformed into the HLS color space 200, for example in accordance with the transformation described in [2].
- FIG. 4 shows a plurality of digital images 401, 402, 403, 404, wherein in each digital image 401, 402, 403, 404 in a respective hair area 405, 406, 407, 408 hair in different natural hair color and thus provided with different coding information, which are assigned to the pixels in the hair area 405, 406, 407, 408.
- HLS triple Average value of the individual components of the HLS vectors (HLS triple) for each component of the HLS vector (ie for the color angle value, the luminance value and the saturation value) over all pixels of the respective hair area 405, 406, 407, 408 formed.
- the resulting arithmetic average value gives the position of the considered natural hair color of the respective hair area 405, 406, 407, 408 in the HLS color model, i.e. in the HLS color space 200.
- the saturation S is essentially the same for all natural hair colors.
- the hair color class levels 100, 101, 102, 103 of the hair color classes described above are essentially plane-parallel to the plane spanned by the color angle H 201 in the HLS color space 200. In other words, this means that each hair color class level 101, 101, 102 , 103 substantially perpendicular, ie is normal to the luminance axis 202 in the HLS color space 200.
- a hair color class cylinder is thus formed using the hair color class levels 100, 101, 102, 103 described above with the color angle H 201 and the saturation S 203 as the base area, the height of the hair color class cylinder being determined by the respective brightness, i.e. the luminance value of the hair color class.
- hair color class levels 100, 101, 102, 103 which is equivalent to the number of hair color classes provided and which are arranged at a corresponding distance along the luminance axis 202 in the HLS color space 200 from one another in accordance with the differing luminance values.
- the HLS color space 200 is thus broken down into discrete levels with respect to the hair color classes, each Hair color class level 100, 101, 102, 103 is clearly assigned to a hair color class of natural hair colors.
- FIG. 1 shows only four hair color class levels 100, 101, 102, 103, namely a first hair color class level 100 for the hair color class "black”, a second hair color class level 101 for the hair color class "dark brown”, one third hair color level 102 for the "medium brown” hair color class and a fourth hair color level 103 for the "light brown” hair color class.
- the other hair color class levels of the other hair color classes are also provided, but not shown in Fig.l.
- hair color change i.e.
- lightening, hair coloring or hair tinting so-called healers or hair colorants, for example hair dyes or hair tinting agents.
- Hair colorants for example hair dyes or hair tinting agents.
- Lighteners differ from bleaching, which also makes the hair appear lighter, but also adds color with the lightened hair.
- Lighteners on the other hand, only bleach the hair and thus achieve a brightening of the original hair color and in this way a hair color change in the sense of this description.
- a brightener is often used as a preparation before the actual hair coloring or hair tint, if the original hair for the desired shade, i.e. for the use of the desired hair dye or
- hair tint is too dark if the original hair color is too dark to achieve a desired target hair color using an appropriate desired hair dye or hair tint.
- Brighteners are classified according to their brightening performance.
- a brightener which is provided for Changing the lightening of the original hair color by one or two hair color shades, ie by one or two hair color classes, for example the original hair color "medium brown” to the hair color “light brown” or an original hair color “dark blonde” to the hair color “medium blonde”", etc. brightened.
- a brightener shifts a hair color located in a hair color class level by one or two hair color class levels along the luminance axis 202.
- the opacity describes the ability to use the hair colorant to restore the original color, i.e. to replace the original hair color with the target hair color of the hair colorant.
- the scope i.e. the range in which 100% replacement of the original hair color by means of the target hair color of the hair colorant is at all possible is usually limited for human hair.
- the individual hair color shades i.e. To assign the specified original hair colors to the individual original hair colors of a hair coloring series, i.e. a hair color for which the respective hair color shade, in other words the respective hair colorant, is intended or applicable.
- Hair color class "dark blonde” thus usually only applies to the hair color class "medium blonde”, the hair color class “Dark blonde” or the hair color class “light brown”, in other words for medium blonde, dark blonde or light brown hair.
- the original hair colors valid for the respective hair color shade are always connected within the HLS color model, i.e. there are immediately adjacent hair color class levels in the HLS color space 200 and form the so-called area of application of the hair colorant.
- a hair colorant has an application tolerance range of one to two, usually a maximum of three hair color shades (expressed in hair color classes) for which it is possible to achieve the target hair color when using the respective hair colorant ,
- the reason for this usually lies in the manufacture of the hair colorant, in particular in the manufacture of a hair dye or a hair tint, and the determination of the original hair colors.
- a hair colorant is developed for a specific original hair color.
- the specified color result ie the specified target hair color of the hair colorant.
- it is usually checked on which original hair colors in the lighter and darker area of the hair color classes the desired color result, ie the achievement of the target hair color while still maintaining a low, predetermined tolerance in terms of color, still corresponds to the desired color result of the hair coloration.
- the hair colors that meet this criterion for a hair colorant within the specified tolerance form the area of application of the hair colorant.
- each pixel of the digitized image in the hair area 301 is assigned coding information in accordance with the HLS color space 200.
- the target hair color in the form of a target tripeis with a clear H value, L value and S value, as well as the HLS color triple of the origin is stored in a table in a memory of a computer for each hair coloring agent taken into account.
- FIG 5 is a top view 500 of a hair color class level n of the HLS color space 200 for a first hair colorant 501, a second hair colorant 502, a third hair colorant 503 and a fourth hair colorant 504. If all hair colorants to be taken into account are recorded in the color cylinder described above, the following statements can be made:
- Each hair colorant can be represented in the color cylinder with the associated original hair color and the associated target hair color.
- the hair color level at which a hair colorant can be found is determined by the original hair color.
- a hair color class level shows all achievable color results based on the original hair color.
- the original hair color is raised to a higher hair color class level (for example from a hair color class level n to a hair color class level n + 1), thus broadening the spectrum of possible color results.
- FIG. 6 shows in a second plan view 600 for a fifth hair colorant 601, a sixth hair colorant 602, a seventh hair colorant 603, and an eighth hair colorant 604 the original hair colors in a hair color class level n + 1 which in the hair dyeing cylinder one by one compared to the hair color class level n shown in FIG
- FIG. 7 shows a top view 700 of the hair colorations using a respective
- Brightener by shifting within the respective hair color class levels for the hair colorants all achievable hair colors in the respective application area in other words a combination of the hair color class level n and the hair color class level n + 1 from FIGS. 5 and 6.
- the associated H values, L values and S values of a hair colorant are determined by means of a method known per se and entered or stored in the reference table.
- the coding information which is assigned to the pixels of the hair area 301 in the digital image 800 (cf. flow diagram 800 in FIG. 8), is stripped of the entire color.
- each individual HLS triple is analyzed and, as described above, for example according to the method described in [2], converted into the HLS color space 200.
- a digital image is thus determined which, at least in the hair area, consists exclusively of gray values.
- the mean i.e. the arithmetic average of all gray values of this digital image, preferably the arithmetic average of all gray values of the hair area, determines the brightness of the original hair color and thus the hair color class level in the color cylinder, which is for the hair color which is in the hair area 301 of the hair color digital image 300 is represented and thus the hair color class level that is valid for the digital image.
- the gray value image thus only contains contrasts and brightnesses and thus shows the structure of the original digital image 300.
- the L value of the HLS triple of the respective coding information of the pixels of hair area 301 is then changed, ie increased or possibly decreased, so that the changed average gray value corresponds to that hair color class level for the hair colorant was developed (step 803).
- the corresponding calculation also takes place here.
- the luminance values are increased in accordance with the degree of lightening, so that the average gray value corresponds to the hair color level level resulting from the use of the brightener.
- each HLS triple which now represents an average gray value, is assigned the respective H value, L value, S value of the hair coloration.
- the HLS triples for displaying the digital image for a user on a screen are then converted back into the RGB color space in a manner known per se, for example in accordance with the method described in [2], since conventional display units for displaying colors reflect the RGB Use color space.
- Hair coloring with a coverage of less than 100% does not completely replace the original hair color, but lets the original hair color shine through.
- Opacity is primarily viewed as the degree of coverage of naturally gray hair.
- a hair coloration with 70% gray coverage means that statistically, of 100 individual hairs, 70 hairs adopt the hair coloration and 30 hairs do not.
- the original hair color in this example thus contributes 30% to the result after using hair coloring with 70% coverage. This creates a mixed color from the color of the hair coloring and the original hair color.
- the result hair color i.e. the target hair color of a hair coloration only on natural hair colors, as described above, the following statements can be made for the color result: •
- the result color i.e. the target hair color is determined for the original hair color for which the hair colorant was developed.
- the result colors for the area of application of a respective hair colorant are lighter or darker in accordance with their hair color class levels in color cylinders, namely by exactly the 100% missing amount of opacity of the hair colorant under consideration.
- the original color values of the original hair color are taken into account in the case of a hair colorant with less than 100% coverage.
- Ratio of the opacity of the hair colorant to the respective original hair color is the Ratio of the opacity of the hair colorant to the respective original hair color.
- Resulting hair colors or the determined color values for the individual original hair colors are applied for each hair coloration used.
- the method in its individual method steps is shown in FIG. 9 in a flow chart 900.
- the pixels ie the coding information assigned to the pixels of a hair area 301 of the original digital image 901, are transformed from the RGB color space into the HLS color space in a manner known per se, for example according to the method described in [2], and the associated HLS Values are saved (step 902).
- the saturation value of the coding information of all the pixels of the hair region 301 is then set to the value 0 (step 903) and the L value is increased in a suitable manner, alternatively reduced, in order to achieve the target hair color and in particular the target luminance value according to the hair coloring used (step 904).
- the hair color class level of the color cylinder is determined and the target hair color is selected.
- the L value of the gray image is adjusted depending on the L value of the target hair color.
- the new HLS values for the respective coding information of the pixels of the hair area 301 are determined (step 905), the percentage of opacity and thus the stored HLS values of the original hair color being taken into account in accordance with this embodiment of the invention.
- step 905 the newly calculated HLS values in step 905 and in particular the newly calculated H values are added to the respective HLS triple (step 906), so that a colored image 907 is generated.
- step 905 the newly calculated HLS values in step 905 and in particular the newly calculated H values are added to the respective HLS triple (step 906), so that a colored image 907 is generated.
- a first data array P 1001 is created in accordance with the respective image format, the first data array P 1001 being dependent on the dimensions of the image, i.e. the number of pixels along a longitudinal direction of the image (Y direction) and one of the number of pixels along the width direction of the image (X direction), and the number of color depths intended for color representation, i.e. the bits intended to represent the color depth.
- the length or the width of the image is thus the number of pixels in a digital image in the X direction or the Y direction, generally along two mutually perpendicular directions within the digital image.
- the color depth is the number of possible values for the components red, green and blue. In the case of a 24-bit color depth, 8 bits are used for each of the three colors. Each of the three colors can have 256 different states. The maximum number of colors within such an image is thus 16.7 million.
- the RGB color format is also known as the true color color format.
- the first data array P 1001 is formed in accordance with the following regulation:
- X is a first pixel index for uniquely identifying a pixel along the x direction
- • y denotes a second pixel index for unambiguously identifying a pixel along the y direction
- n is a color depth index, which is used for uniquely identifying a color used.
- the digital image is thus broken down and the values of each pixel are stored in the first data array P 1001.
- a second data array Q 1003 is created, which for recording, i.e. serves to store the values of the coding information of the pixels in the HLS color space.
- the dimensions of the second data array Q 1003 are the same as those of the first data array P 1001, as described above.
- the second data array Q 1003 is formed in accordance with the following regulation:
- a data array R of dimension X * Y is created for the temporary storage of the H values, as described above in connection with the calculation of target H values for hair coloring with an opacity of less than 100%.
- FIG. 10A shows the first data array P 1001 and the method step of transforming each pixel - triplet from the RGB color space, ie each triplet in the first data array P 1001 to an associated value in the second data array Q. 1003, ie vividly the Transformation of the pixels from the RGB color space into the HLS color space 200 (step 1002).
- the converted, i.e. the transformed coding information is stored in the second data array Q 1003.
- the associated saturation values are set to the value 0 for all data triples in the second data array Q 1003.
- the associated H values are stored in the additional data array R, i.e. saved.
- the coding information stored in the second data array Q 1003 is transformed back into the RGB color space (Step 1004) as shown in Fig. 10B.
- the back-transformed values of the coding information are stored in the first data array P 1001.
- the coding information of the pixels of the hair area which is now again present in the RGB color space, is fed to the monitor, which is coupled to the computer and can represent the data in accordance with the RGB color space, and is displayed by a user.
- the elements of the second data array Q 1003 are processed as follows:
- the H value is arbitrary.
- Saturation value S is set to a value greater than 0 and at the same time the H value is set according to the desired target hair color.
- the correct values for color, luminance and saturation are taken from the reference table of the hair coloring used in each case, which was previously saved in the computer.
- Hnew D * H co ⁇ + (100 - D) * H (x, y)
- the values of each color can take the values between 0 and 255.
- a value of 0 means
- Black a value of 255 means full color.
- triples in the range from RGB (0, 0, 0) to RGB (65, 65, 65) represent shadow hair areas and triples with values in the range of RGB (200, 200, 200) are the highlight Hair areas, ie the gloss-under-hair areas of the hair area.
- the sub-hair areas described above are treated separately according to a further embodiment of the invention, since they show less the natural color of the hair and more in the highlight hair areas the color of the illuminating light source and in the shadows -Hair areas the color of the environment in which the picture was taken.
- the color change using the method described above is carried out for the data triples with RGB color values RGB (66, 66, 66) to RGB (199, 199, 199).
- Shadow hair areas i.e. the pixels with RGB color values from RGB (0, 0, 0) to RGB (65, 65, 65) as well as highlight hair areas, i.e. the areas with RGB color values from RGB (200, 200, 200) to RGB (255, 255, 255) are each 50% matched with the target hair color, i.e. of the new color, offset. This procedure corresponds to hair coloring with less than 100% coverage.
- Hair color change in a diagram 1100 with a first area 1101, i.e. the shadow hair area, the “normal hair area” as the second area 1102 and the highlight hair area as the third area 1103 are shown with the corresponding different weighting of the respective RGB values in the context of the color transformation, as described above.
- the system for representing the effect of hair coloring can be implemented on a portrait photo of a person, for example on the portrait photo of the user.
- a digital photo is processed with a suitable computer program in the manner described above in such a way that the hair area 301 can be changed digitally, all other areas, for example the face, body and background, remain unchangeable.
- the hair area is decolored and given the color of a hair coloration.
- the color values of a manufacturer's hair colorations can ideally be stored in a database. This means that they can be called up quickly.
- the effect of a new hair color can be assessed on the screen using, for example, a digital image, as shown in FIG. 3, with a reference hair loop.
- Hair color charts clearly depict a matrix, on the axes of which on the one hand the original hair colors or natural hair colors and on the other hand the hair colorations of a coloring series, i.e. shows the individual colors of the products in a color range. Hair loops or similar hair images are shown in the cells of the matrix, as shown in FIG. 3, which show the resulting color result.
- the templates for these hair images can be quickly created using a database with the stored values and a template of the hair loop to be imaged, ie a reference hair loop for all colors of a series of hair colorations. With an average application of four original hair colors and approx. 200 products, 800 images can be generated automatically. Furthermore, according to a consideration of FIGS. 4, 5 and 6, for example, it is possible to determine in a simple manner which hair colors are occupied in a coloring range. On the one hand it can be determined in this way which hair colorations deliver the same color result, on the other hand it can be determined which color areas are not yet occupied by the products. In line with trends, a new hair color can be developed in this way.
Landscapes
- Health & Medical Sciences (AREA)
- Dermatology (AREA)
- General Health & Medical Sciences (AREA)
- Image Processing (AREA)
- Color Image Communication Systems (AREA)
- Image Analysis (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Cosmetics (AREA)
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102004008223A DE102004008223A1 (de) | 2004-02-19 | 2004-02-19 | Verfahren und Vorrichtung zum Ermitteln einer Ziel-Haarfarbe für eine Ursprungs-Haarfarbe eines Haarbereichs in einem digitalen Bild nach erfolgter Haarfarbveränderung |
PCT/DE2005/000282 WO2005081190A1 (de) | 2004-02-19 | 2005-02-18 | Verfahren und vorrichtung zum ermitteln einer ziel-haarfarbe für eine ursprungs-haarfarbe eines haarbereichs in einem digitalen bild nach erfolgter haarfarbveränderung |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1716542A1 true EP1716542A1 (de) | 2006-11-02 |
EP1716542B1 EP1716542B1 (de) | 2010-08-11 |
Family
ID=34853543
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP05706768A Active EP1716542B1 (de) | 2004-02-19 | 2005-02-18 | Verfahren und vorrichtung zum ermitteln einer ziel-haarfarbe für eine ursprungs-haarfarbe eines haarbereichs in einem digitalen bild nach erfolgter haarfarbveränderung |
Country Status (4)
Country | Link |
---|---|
EP (1) | EP1716542B1 (de) |
AT (1) | ATE477560T1 (de) |
DE (2) | DE102004008223A1 (de) |
WO (1) | WO2005081190A1 (de) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3671556A1 (de) * | 2018-12-18 | 2020-06-24 | Henkel AG & Co. KGaA | Verfahren zur bestimmung einer ergrauungsstufe einer haarsträhne |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB9619119D0 (en) * | 1996-09-12 | 1996-10-23 | Discreet Logic Inc | Processing image |
US6259428B1 (en) * | 1998-05-01 | 2001-07-10 | National Instruments Corporation | System and method for dynamically substituting colors in a graphic image |
DE60012141T2 (de) * | 1999-10-29 | 2005-07-21 | Kao Corp. | Beratungssystem für haarfärbung |
KR100406508B1 (ko) * | 2000-06-23 | 2003-11-20 | 주식회사 코난테크놀로지 | 컬러영상 처리 시스템 및 그 방법 |
US7039229B2 (en) * | 2000-08-14 | 2006-05-02 | National Instruments Corporation | Locating regions in a target image using color match, luminance pattern match and hill-climbing techniques |
DE10103971A1 (de) * | 2001-01-30 | 2002-08-14 | Henkel Kgaa | Verfahren und Vorrichtung zum Bearbeiten eines in einem ersten Computer gespeicherten digitalisierten Bildes, Computerlesbares Speichermedium und Computerprogramm-Element |
DE10142526C5 (de) * | 2001-08-30 | 2006-02-16 | Wella Ag | Verfahren für eine Haarfarbberatung |
-
2004
- 2004-02-19 DE DE102004008223A patent/DE102004008223A1/de not_active Withdrawn
-
2005
- 2005-02-18 EP EP05706768A patent/EP1716542B1/de active Active
- 2005-02-18 AT AT05706768T patent/ATE477560T1/de active
- 2005-02-18 WO PCT/DE2005/000282 patent/WO2005081190A1/de active Application Filing
- 2005-02-18 DE DE502005010068T patent/DE502005010068D1/de active Active
Non-Patent Citations (1)
Title |
---|
See references of WO2005081190A1 * |
Also Published As
Publication number | Publication date |
---|---|
WO2005081190A1 (de) | 2005-09-01 |
DE102004008223A1 (de) | 2005-09-15 |
ATE477560T1 (de) | 2010-08-15 |
EP1716542B1 (de) | 2010-08-11 |
DE502005010068D1 (de) | 2010-09-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DE69633262T2 (de) | Farbumwandlungsverfahren und Vorrichtung zum Herstellen von Farbumwandlungstabellen | |
DE60101013T2 (de) | Farbtransformationsverfahren zum Abbilden von Farben in Bildern | |
EP0020494B1 (de) | Verfahren zur reproduktion von originalvorlagen welche bezüglich ihres farbgehaltes nach einem dreibereichtsverfahren abgetastet werden | |
DE69839277T2 (de) | Verfahren und anordnung zur ausführung von farbschlüsseln, transparenz und nebelfunktionen | |
DE19528596C2 (de) | Verfahren und Vorrichtung zur Kolorierunterstützung | |
DE69929238T2 (de) | Verfahren zur aufnahme und wiedergabe stereoskopischer farbbilder mit polychromatischen filtern | |
DE602005006251T2 (de) | Farbsimuliersystem zum haarfärben | |
DE69823593T2 (de) | Fehlerdiffusion für Farbhalbtonrasterung mit Verringerung der lokalen Helligkeitsänderung | |
DE69733456T2 (de) | Bildverarbeitungsvorrichtung und -verfahren | |
DE10321927A1 (de) | Projektionsebenen-Farbkorrektur, Verfahren und System für Projektionsebenen-Farbkorrektur für Projektoren | |
DE10053301A1 (de) | Verfahren zur farblichen Wiedergabe eines Graustufenbildes | |
DE10137211A1 (de) | Kantenverbesserungsprozessor und Verfahren mit einstellbarer Graustufenausgabe | |
DE69532025T2 (de) | Farbbildverarbeitungsverfahren und -Vorrichtung | |
DE69730268T2 (de) | Verfahren und System zur Bestimmung von Farbmittelmengen | |
DE60100537T2 (de) | Verfahren und anordnung zur wiederherstellung eines lichtsignals | |
DE10017551C2 (de) | Verfahren zur zyklischen, interaktiven Bildanalyse sowie Computersystem und Computerprogramm zur Ausführung des Verfahrens | |
EP1716542B1 (de) | Verfahren und vorrichtung zum ermitteln einer ziel-haarfarbe für eine ursprungs-haarfarbe eines haarbereichs in einem digitalen bild nach erfolgter haarfarbveränderung | |
DE69830583T2 (de) | Verfahren und Vorrichtung zur Verarbeitung von Bilddaten | |
DE102007010603B4 (de) | Verfahren für Fernübertragung von Anzeigedaten zwischen zwei Rechnern | |
WO2000013143A1 (de) | Verfahren und vorrichtung zur erfassung von objektfarben | |
DE10008286C1 (de) | Verfahren zum Drucken eines Bildes in zwei Farben | |
DE102019101777B4 (de) | Mikroskopieverfahren | |
EP1985107B1 (de) | Verfahren zur transformation von farbwerten | |
DE60104555T2 (de) | Verbesserungen auf dem gebiet der bildverarbeitung | |
DE102014011664B3 (de) | Verfahren zur dynamischen Druckprozesskalibrierung |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20060202 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU MC NL PL PT RO SE SI SK TR |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: FRAUNE, GERRIT Inventor name: HEINEMANN, MARKUS |
|
DAX | Request for extension of the european patent (deleted) | ||
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: HENKEL AG & CO. KGAA |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: HEINEMANN, MARKUS Inventor name: FRAUNE, GERRIT |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU MC NL PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
REF | Corresponds to: |
Ref document number: 502005010068 Country of ref document: DE Date of ref document: 20100923 Kind code of ref document: P |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20100811 |
|
LTIE | Lt: invalidation of european patent or patent extension |
Effective date: 20100811 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100811 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100811 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100811 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101213 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101111 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100811 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101211 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100811 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100811 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FD4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101112 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100811 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100811 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100811 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100811 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100811 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100811 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100811 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100811 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101122 |
|
26N | No opposition filed |
Effective date: 20110512 |
|
BERE | Be: lapsed |
Owner name: HENKEL A.G. & CO. KGAA Effective date: 20110228 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 502005010068 Country of ref document: DE Effective date: 20110512 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110218 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100811 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100811 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 12 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 13 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 14 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230220 Year of fee payment: 19 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230530 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: AT Payment date: 20240220 Year of fee payment: 20 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: MC Payment date: 20240226 Year of fee payment: 20 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240219 Year of fee payment: 20 Ref country code: GB Payment date: 20240219 Year of fee payment: 20 Ref country code: CH Payment date: 20240301 Year of fee payment: 20 |