EP3491615A1 - Verfahren, einrichtung und datenverarbeitungsvorrichtung zur computergestützten haarfarbberatung - Google Patents
Verfahren, einrichtung und datenverarbeitungsvorrichtung zur computergestützten haarfarbberatungInfo
- Publication number
- EP3491615A1 EP3491615A1 EP17739995.3A EP17739995A EP3491615A1 EP 3491615 A1 EP3491615 A1 EP 3491615A1 EP 17739995 A EP17739995 A EP 17739995A EP 3491615 A1 EP3491615 A1 EP 3491615A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- hair
- color
- area
- screen
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
- G06T19/006—Mixed reality
-
- A—HUMAN NECESSITIES
- A45—HAND OR TRAVELLING ARTICLES
- A45D—HAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
- A45D44/00—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
- A45D44/005—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms for selecting or displaying personal cosmetic colours or hairstyle
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
- G01J3/463—Colour matching
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
- G01J3/50—Measurement of colour; Colour measuring devices, e.g. colorimeters using electric radiation detectors
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B15/00—Special procedures for taking photographs; Apparatus therefor
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—Two-dimensional [2D] image generation
- G06T11/10—Texturing; Colouring; Generation of textures or colours
-
- A—HUMAN NECESSITIES
- A45—HAND OR TRAVELLING ARTICLES
- A45D—HAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
- A45D44/00—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
- A45D2044/007—Devices for determining the condition of hair or skin or for selecting the appropriate cosmetic or hair treatment
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
- G06T2207/10012—Stereo images
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
Definitions
- the invention relates to a computer-assisted hair color consultation.
- a user who wants to dye his hair usually wants to achieve a hair color that suits his taste and fits his hair type.
- a computerized hair color consultation can be used to give a user a visual impression of what he or she would like to look like with a chosen hair color. For example, in a digital image of the user, on which, inter alia, his hair can be seen, a region of the image in which hair is shown is determined. This hair area can be retouched in the desired hair color.
- a conventional computer-aided hair color consultation is typically a separate digital device, e.g. a mobile phone or tablet.
- the digital device can be used to run a hair color consultation app.
- a screen may be comparatively small, so that no display (for example, for evaluation of the staining result) is made sufficiently large.
- the user can not concentrate on a result of the app because he is busy with handling and holding the device.
- a reliability of the representation of the staining result may be questionable, because typically all the hair color retouched image is displayed on the screen so that a deviation from reality, such as uniform coloring of the whole image, may not be the whole image noticeable.
- the hair of the user both before and after dyeing, may typically not only have a hue and not just a brightness value, but a plurality of hues and / or brightness values.
- a lighting situation may be extremely heterogeneous at various locations on the user's hair.
- the hair may appear brighter on a light source side and appear darker on a side away from the light source (in the shadow).
- a light or a hue / brightness situation of the hair can be described approximately only on average by a colorimetric measurement with precisely controlled light irradiation. As a result, a realistic representation of the expected dyeing results on monitors, panels and / or printed products is difficult.
- a camera may be coupled to a reflective or transparent OLED screen by means of a software controlled computer connection.
- the at least one camera can accommodate a user, i. take one or more pictures of the user.
- a position of hair of the user also referred to as hair area area as part of the image
- hair dye also referred to as hair coloring
- at a location on the screen where the user's hair area is located reflected or shining through, also referred to as a hair transmittance / mirror area
- the user can view the expected result by means of the reflecting and projecting screen.
- the user may see a combination of reflected objects, such as his face, body, background objects, etc., and the projected re-inked hair dyeing area, which together illustrate how the user would look with the new hair color.
- one or more other persons may view the expected result by means of the translucent and projecting screen.
- the other persons may use a combination of translucent objects, such as a face and / or a body of the user, background objects, etc., and the projected re-inked hair dyeing area, which together illustrate how the user would look with the new hair color.
- a mirror in the translucent screen, as viewed by the user, a mirror may be located behind the screen, so that the user may view the result even in the case of the translucent screen, as a reflection of the combination of the translucent objects with the projection of the newly dyed hair dyeing area by means of the mirror.
- a (for example, conventional) screen in combination with a divider mirror can be used (see also the Wikipedia article "divider mirror” in the version of 25.07.2016 (URL: https: //de.wikipedia .org / wiki / splitter mirror).
- the hair area surface can be determined by means of the camera as described above and projected to the splitter mirror by means of the conventional screen, for example, so that the observer is superimposed with light transmitted through the splitter mirror with the projection of the (for example newly dyed) hair area surface.
- the representation (also referred to as projection or display) of the expected hair dye result can be optimized or be by means of a color and / or brightness reference.
- the device for computer-aided hair color consultation can have a sensor for a color and / or brightness reference.
- Software controlled, the color and / or brightness reference can be read out to calibrate the representation of the expected hair dye result.
- the color and / or brightness reference can, for example, have or be a reference card.
- the sensor may be the camera that receives the user in various embodiments. Alternatively, an additional camera can be used.
- a determination of the hair coloration can also be optimized by means of the color and / or brightness reference.
- the user can be displayed additional information on the screen.
- a user for a representation of a possible hair dye result may be independent of apps, ie he does not need his own device.
- a larger representation of the possible hair dye result may be possible (as would be the case, for example, on a smartphone or tablet).
- the method and apparatus for computer-assisted hair color consultation allow easy (or easier) handling.
- the method and apparatus for computerized hair color consulting provide a more realistic and much faster presentation of the potential hair color result since only the hair area surface is modified (and displayed) by computer and otherwise no computer intervention is made in the user perceived image.
- the possible hair coloring result can be observed live.
- the user can concentrate on looking at the result without having to control his own device.
- the expected hair color result when using a transparent screen may be well visible to third parties. Namely, the recorded person (the user) does not obscure the representation of the hair coloring result because the third persons can view the screen from a side of the screen facing away from the user.
- color values for representing the hair dyeing area in a new hair color may be determined by a method that uses predictive analytics to determine a plurality of initial parameters (eg, components of a colorant formulation, original hair color of the user, degree of damage to the hair of the user, etc.). ) and a training set with hair coloring results for a part of the plurality of initial parameters, a relationship between the initial parameters and a color difference (which is a difference, eg a difference vector, between an average of colors of the hair area before coloring and an average of colors of the hair area after coloring can be determined).
- a plurality of initial parameters eg, components of a colorant formulation, original hair color of the user, degree of damage to the hair of the user, etc.
- a training set with hair coloring results for a part of the plurality of initial parameters a relationship between the initial parameters and a color difference (which is a difference, eg a difference vector, between an average of colors of the hair area before coloring and an average of colors of the hair area after coloring can
- the determined color difference can be used according to various embodiments to colorize each pixel of a hair area by means of the color difference in a representation of a hairstyle, for example on a digital image.
- the color difference value can be added to the color value of each pixel of the hair area.
- correction factors can be used for very bright or very dark areas, because for example in the L, a, b color space, L, a and b can not assume any values, but for example be limited to areas L: 0-100, a: -170 to +100 and b: -100 to +150.
- the illustrated hair dyeing result may be appealing because of course, existing lighted and shaded areas may be maintained.
- the coloring result can be realistic, for example when using a parameterization of the colors to be displayed in a device-independent color space (eg L * a * b * ).
- the Lab color space can also stand for color spaces which may be better suited for additive light colors, eg CIELUV or / 1/2/3 /.
- a method for computer-aided hair color consultation may include taking a digital image of a user's hair and additional objects by means of a camera, determining a hair area area in which the hair is imaged, in the digital image, determining a new hair color, adjusting a hair projection area in which the hair is projected, a translucent or reflective screen such that results in a combination of the screen-transmitted or mirrored objects with the hair projection area for a viewer of the screen, wherein the hair projection area is adjusted so that it substantially with a Hair Transmissions / Mirroring Area covers where the viewer's hair would appear to be transmitted or mirrored and projecting the hair projection area into the new hair color.
- taking the digital image, determining the hair area area, and displaying the hair area colored in the new hair color may be repeatedly performed to give a quasi-real time representation.
- determining the new hair color may include selecting the new hair color from a database-provided plurality of selectable new hair colors.
- providing the plurality of selectable new hair colors may include presenting a selection menu on the screen.
- determining the new hair color may include detecting a hair dyeing product by means of a sensor.
- the user may also be the viewer.
- the method further comprises correcting the new hair color by means of the color and / or brightness reference.
- adjusting the hair projection area may include placing the user, the screen, the viewer, and the camera such that the coverage of the hair projection area with the hair transmission / reflection area results when the hair projection area of the hair projection area Hair area of a filling the screen filling mirror image arrangement of the entire digital image.
- adjusting the hair projection area may include adjusting a zoom factor of the camera.
- adjusting the hair projection area may include detecting a position reference.
- adjusting the hair projection area may include acquiring spatial information regarding the user and the additional objects.
- the method may further include projecting the hair projection area into an original hair color of the user.
- the method may further comprise correcting the projection of the hair projection area by a color correction value, a brightness correction value, or a color / brightness correction value based on an overall impression of the combination of the objects transmitted from the screen or mirrored objects with the hair projection area.
- projecting the new hair color may include a method of presenting a hair color result according to any of the embodiments described herein.
- the method may further comprise presenting at least one colorant associated with the selectable new hair color.
- an apparatus for performing computerized hair color consultation may include: at least one camera for capturing a digital image of a user's hair and additional objects, a processor, the processor being configured to include in the digital image of the user Determine a hair area area, an input device for selecting a new hair color by the user, and a translucent or reflective screen or a system of screen and splitter mirror for projecting a hair projection area in the new hair color, wherein the hair projection area is adapted to for a viewer of the screen results in a combination of the objects transmitted by the screen or mirrored with the hair projection area, in which the hair projection area substantially coincides with a hair transmission / reflection area in which the viewer's hair is transmitted or transmitted to the viewer would appear mirrored.
- the screen may be an OLED screen.
- the at least one camera may be arranged such that its at least one optical axis is perpendicular to a user-facing surface of the screen.
- the screen may be the translucent screen.
- the device can then also have a mirror which, viewed from the user, is arranged behind the screen in such a way that the combination of the objects transmitted by the screen or mirrored with the hair projection region is visible to the user in the mirror.
- the input device may include a touch-sensitive surface of the screen.
- the device may further include a sensor for acquiring spatial information regarding the user.
- a method for presenting a hair dye result may include: for each coloring operation of a plurality of dyeing operations: colorimetric measuring of undyed hair for a plurality of measurement points, obtaining a pre-color average from the colorimetric readings of the plurality of measurement spots of the undyed hair, colorimetric measuring dyed hair for a plurality of Measuring points, determining a post colorant value from the colorimetric readings of the plurality of colored hair spot measurement points, and determining a color difference value from the before colorant value and the after colorant value, including correction factors for very dark or very bright spots, determining a relationship between the plurality of before colorants and the plurality of color difference values by means of predictive analytics, providing a digital image having at least one hair area area of a user, determining color values of a plurality of image elements of the User's hair area, determining a user's prediction Color average of the determined color values of the plurality of pixels of the user hair area, selecting a new
- determining an expected staining result may comprise determining an assigned color difference value from the determined relationship, and wherein re-staining the hair area area may comprise recoloring the plurality of pixels of the user hair area area by adding the color difference value to the determined color value for each pixel of the plurality of picture elements of the user's hair area area.
- a device to represent the digital image, a device according to various embodiments described herein may be used.
- a data processing apparatus for performing computerized hair color consulting, wherein the data processing apparatus may be configured to perform the method of computerized hair color consultation according to various embodiments.
- a data processing apparatus for performing a method of displaying a hair dye result, wherein the data processing apparatus may be configured to perform the method of computerized hair color consultation according to various embodiments.
- Figure 1 is a schematic representation of a device for performing a computer-aided
- Hair color advice according to various embodiments.
- FIGS. 2A, 2B and 2C are graphs illustrating a method of computerized hair color consultation according to various embodiments
- FIG. 3 is a diagram illustrating a method of computer-assisted hair color consultation according to various embodiments
- Figure 4 is a diagram illustrating a method of computer-aided
- Hair color advice according to various embodiments.
- FIG. 5 is a flow chart illustrating a method of computer-assisted hair color consultation according to various embodiments
- FIG. 6 is a flowchart illustrating a method of displaying a hair coloring result according to various embodiments.
- Figure 7 is a diagram of a data processing apparatus for carrying out a
- a method of presenting a hair coloring result according to various embodiments.
- a digital image can be understood here to mean a data packet that can be represented by a data processing system as a two-dimensional (area) arrangement of pixels, for example in a coordinate system which has an x-axis and a y-axis, wherein each pixel is assigned at least one color information which is representable, for example, as the color of a pixel of a monitor or a printed dot of a printed image.
- the digital image can be, for example, a photograph taken with a digital camera or a single image of a video sequence recorded with a digital camera (the method according to various embodiments then for example, can be applied to a plurality of frames of the video sequence).
- the terms hair area and hair area area are used synonymously herein.
- the hair area may include a plurality of pixels of a digital image that depict hair and that may form a contiguous area or surface made up of a plurality of individual areas.
- a plane in which the hair region can be arranged can be determined, for example, by the x-axis and the y-axis of the digital image.
- a color herein is meant an interaction of a hue (ie, a spectral color impression, also referred to as a hue, which can be understood as what is considered to be the "true color”), a color intensity (ie, how intense the color appears). eg compared to a neutral gray, which is also referred to as saturation, color saturation, chroma, or color depth) and brightness (ie how light or dark the color appears).
- a hue ie, a spectral color impression, also referred to as a hue, which can be understood as what is considered to be the "true color”
- a color intensity ie, how intense the color appears
- a neutral gray which is also referred to as saturation, color saturation, chroma, or color depth
- brightness ie how light or dark the color appears).
- the color information may comprise a parameterization in a known color space, for example in a L * a * b * color space (where L * indicates the brightness of a color, a * the green and red portion and b * the blue and Yellow part of the color) in an RGB color space by color components in red, green and blue, in a CMYK color space by color components in cyan, magenta, yellow and black, or in any other color space, eg CIELUV or / 1/2/3 /.
- L * indicates the brightness of a color, a * the green and red portion and b * the blue and Yellow part of the color
- RGB color space by color components in red, green and blue
- CMYK color space by color components in cyan, magenta, yellow and black
- any other color space eg CIELUV or / 1/2/3 /.
- the term "hue” can be understood to mean the spectral color impression of a color, regardless of how it can be parameterized, for example as a point in a two-dimensional color space (eg a * b * of the L * a * b) * System) or a ratio of color components (such as the RGB color space or the CMYK color space).
- a color space from which the color information (hair color information and image color information) originates may be such that a detected or displayed color is independent of a medium by which the color is detected or displayed (eg, screen, printer, scanner, human Eye, etc.).
- the color space may be, for example, an L * a * b * color space, the color information a hue parameterized by means of a * and b *, for example.
- the uniform representation in the medium-independent color space makes it possible to present a realistic, expected dyeing result.
- FIG. FIG. 1 shows a schematic representation 100 of a device for carrying out a computer-assisted hair color consultation according to various exemplary embodiments
- FIG. 2A, FIG. 2B, FIG. 2C, FIG. 3 and FIG. 4 are graphs illustrating a method of computerized hair color consultation according to various embodiments.
- the apparatus for performing the computerized hair color consultation may include a display screen 102 according to various embodiments.
- the screen 102 may be a so-called OLED screen. This is understood to mean a screen which uses a plurality of organic light-emitting diodes (OLEDs, derived from the English term "Organic Light Emitting Device") for displaying a picture.
- OLEDs organic light-emitting diodes
- the screen 102 may have a response time of less than 1 second, e.g. less than 0, 1 second, e.g. less than 10 ms, e.g. less than 1 ms.
- the screen 102 may have a contrast value of at least 4000: 1 according to various embodiments, e.g. at least 10,000: 1, e.g. at least 50,000: 1, e.g. at least 100,000: 1.
- the screen 102 may, according to various embodiments, have a good screen resolution, for example a resolution of at least 1920 by 1080 pixels, which is also referred to as full HD resolution, or for example a so-called 4K resolution which has a resolution of 4096 * 2160 pixels (Pixels).
- a good screen resolution for example a resolution of at least 1920 by 1080 pixels, which is also referred to as full HD resolution, or for example a so-called 4K resolution which has a resolution of 4096 * 2160 pixels (Pixels).
- the screen 102 may be capable of representing at least 70% of the color space, eg, at least 80%, eg, at least 90%, for a given color parameterization in a color space, eg, NTSC, L * a * b * , CMYK, or the like, according to various embodiments. , eg about 100%.
- the screen 102 may be a reflective screen.
- the screen 102 is also referred to as a (reflective) screen 102R.
- a reflective screen 102R is meant herein a screen having a first surface 102S1 having a reflectance rate of at least 75%, i. reflects at least 75% of incident light in a wavelength range perceptible to the human eye.
- the first surface 102S1 may reflect at least 80% of the light, e.g. at least 85%.
- the screen 102 may be a translucent screen.
- the screen 102 is also referred to as the (translucent) screen 102T.
- the translucent screen 102T may also be referred to as a semi-transparent screen or, in short, as a transparent screen, even though the screen 102T may be a screen Has a transparency of less than 100%.
- the translucent screen 102T may, according to various embodiments, have a light transmission of more than 10%, eg more than 15%, eg more than 25%, eg more than 40%.
- the first surface 102S1 may be configured to reflect as little light as possible, eg, to have a reflection rate of at most 20%, eg, at most 15%, eg, at most 10%, eg, at most 5%.
- a splitter mirror in combination with a (eg conventional) camera can be used, wherein a projected from the camera on the splitter mirror (partial) image can be superimposed with an image transmitted by the splitter mirror image of a background ,
- the image projected onto the splitter mirror may have the hair area (e.g., retouched), and for the viewer, the transmitted image may be a user 220.
- the apparatus 100 for performing the computerized hair color consultation may include at least one camera 104.
- the camera 104 may be configured to capture a digital image of the hair of the user 220 and additional objects, in accordance with various embodiments.
- the additional objects may include, for example, a face and / or a body of the user 220, and / or other objects, persons, animals, or the like.
- An area of the digital image in which the hair of the user 220 is depicted may be referred to as a hair area area.
- the camera 104 may be configured to take a digital image of a user 220 and its surroundings, such that at least part of the hair of the user 220 is imaged in the digital image.
- the digital image may include object areas in which the additional objects are imaged, for example, an eyebrow area, a skin area, which may have, for example, a facial skin area and / or a neck skin area, and a background area, etc.
- the at least one camera 104 may comprise a video camera according to various embodiments, i. a camera 104, which may be configured to record a plurality of frames as a time series. According to various embodiments, the at least one camera 104 may include a still camera for capturing still images.
- the at least one camera may include an Intel Live Camera.
- the camera may be a so-called time-of-flight camera (TOF camera), which can determine a distance to a recorded object by means of a run time method (in the Wikipedia article "TOF camera”). in the version of 25.07.2016 (URL: https://de.wikipedia.org/wiki/TOF-Kamera) the functionality of a TOF camera is explained.
- TOF camera time-of-flight camera
- the TOF camera may be coupled to a common camera to capture a digital image while preserving the spatial information.
- the at least one camera 104 may be arranged such that its at least one optical axis is perpendicular or substantially perpendicular to the first surface 102S1 of the screen facing the user 220.
- the at least one camera 104 may, according to various embodiments, be arranged near a vertical central axis of the screen 102.
- the at least one camera 104 may, for example, be arranged at a distance of at most 30 cm from the central axis, for example at most 20 cm, e.g. with at most 10 cm, e.g. on the central axis.
- a substantially central positioning of the camera 104 with an optical axis of the camera 104 arranged substantially perpendicular to the first surface 102S1 of the screen 102 may allow a hair area surface 554 projected by the screen 102, also referred to as a hair projection area 554, with a hair transmission / reflection region 550 which is reflected by the screen 102R and transmitted by the translucent screen 102T (the screen area generally referred to as the hair transmission / reflection region 550 for both types of screens - translucent and reflective) can be used as a hair transmission area 550, when the screen is the translucent screen 102T, and as the hair mirror section 550 when the screen is the reflective screen 102R).
- the hair-transmission / reflection region 550 may be outshined by the hair projection region 554.
- the user 220 may be positioned such that the hair projection area 554 coincides with the hair transmission / reflection area 550, for example, from a user's 220 or from a viewer 330 viewpoint.
- the camera 104 may be integrated with the screen 102.
- the camera 104 may be arranged in a region of the surface 102S1 instead of picture elements of the screen 102.
- the camera 104 may be disposed behind the screen 102T as seen by the user 220, such that the camera 104 may take the picture of the user 220 through the screen 102T.
- a variation of the color and / or brightness information of light reaching the camera 104 through the screen 102T as a result of passing the screen 102T may be taken into account when the image is processed by a computer 106 (see below).
- the placement of the camera 104 in and / or behind the screen 102 may allow for substantially central positioning of the camera 104 in terms of both horizontal and vertical extension of the screen 102.
- the camera 104, the screen 102, and the user 220 may be arranged and oriented relative to each other to adjust the hair projection area 554 (in which the hair is projected) to the translucent or reflective screen 102T, 102S.
- the adaptation can take place in such a way that a combination of the screen (which can be the user 220, for example, as shown in FIGS. 2A and 2C, or the additional person as shown in FIG shows the objects transmitted or mirrored by the screen 102T or 102S to the hair projection area 554, in which the hair projection area 554 substantially coincides with a hair transmission / reflection area 550, in which the viewer 220, 330 the hair of the user 220 would appear transmitted or mirrored.
- the screen which can be the user 220, for example, as shown in FIGS. 2A and 2C, or the additional person as shown in FIG shows the objects transmitted or mirrored by the screen 102T or 102S to the hair projection area 554, in which the hair projection area 554 substantially coincides with a hair transmission /
- a method of computerized hair color consultation are performed, which provides the viewer (eg the user 220) a mirrored or translucent image of the user 220 with a projection of the newly dyed hair, the hair in place of Screen 102, at which the observer would appear without the projection, the mirrored or transmitted hair of the user 220.
- the at least one camera 104 may comprise an SD camera, which may be configured to provide three-dimensional information regarding the user (and possibly the additional objects), for example over a distance between the camera 104 and the user 220.
- the at least one camera 104 may include a time-of-flight camera (see above) or a stereo camera which has two Cameras or at least two camera lenses may have, so that two separate images can be recorded with a spatial distance between the cameras or the lenses.
- the at least one camera 104 may include, for example, in addition to the camera 104 for capturing the digital image of the user 220, a triangulation system in which a light source images a defined pattern, such as the user 220, which is from one camera to another View angle can be recorded so that a calculation of a distance based on a distortion of the defined pattern is possible.
- a triangulation system in which a light source images a defined pattern, such as the user 220, which is from one camera to another View angle can be recorded so that a calculation of a distance based on a distortion of the defined pattern is possible.
- other or further known systems for providing three-dimensional information can be used, for example cameras which utilize a transit time of the light for calculating distances.
- the two 3D cameras may be arranged in a suitable distance for taking 3D images, for example such that the camera 104, which is farther from the Central axis is removed, be arranged at a distance of at most 30 cm to the central axis, for example, at most 20 cm, eg with at most 10 cm.
- the two cameras 104 may, for example, be arranged symmetrically about the central axis.
- the spatial information provided by the 3D camera may be utilized to adjust a hair projection area of the translucent or specular screen.
- the adaptation can take place in such a way that for a viewer of the screen (which may be, for example, the user 220 or the additional person 330) a combination of the objects transmitted or mirrored by the screen 102T or 102S results with the hair projection area which of the hair projection area substantially coincides with a hair transmission / reflection area 550 in which the viewer's hair would appear to be transmitted or mirrored.
- the additional objects may have a position reference, for example at least one object, e.g. a plurality of objects which may be arranged at a predetermined known position.
- the position reference (s) may be capable of being automatically identified in the digital image, for example by means of software, for example objects having a prominent, e.g. high contrast, structure.
- four objects may be arranged as a position reference which mark corners of an area which may be scaled and arranged to fill the entire screen 102.
- the known position of the position reference and, for example, by means of a computer software determined image position of the position reference, on which the position reference is imaged in the digital image can be used to adjust the hair projection area 554 of the translucent or specular screen 102.
- the adaptation can take place in such a way that for a viewer of the screen (which can be, for example, the user 220, as shown for example in FIGS. 2A and 2C or an additional person, as shown in FIG results in the screen transmitted or mirrored objects with the hair projection area 554, in which the hair projection area 554 substantially coincides with the hair transmission / reflection area 550, in which the viewer 330 the hair of the user would appear to be transmitted or mirrored.
- a data processing device 106 may be used to determine a shape of the hair transmittance / reflection area 550 (eg, including known (space) coordinates and angular orientations of the user 220, the screen 102, the camera 104, the position reference, and possibly the viewer 330), and a Shape of the hair projection 554 computationally adapt.
- the adjustment of the hair projection area 554 may include, for example, shifting the hair projection area 554 on the screen 102, for example, in the horizontal and / or vertical direction with respect to the screen 102. Further, the adjustment may include, for example, upsetting the hair projection area 554 in FIG have horizontal and / or vertical direction, and / or turning the hair projection area 554 clockwise or counterclockwise. In various embodiments, several of the adaptation measures may be combined.
- the camera 104 may be configured to detect a hair dye, for example, based on a sales package.
- the camera 104 may include a 1-dimensional or 2-dimensional barcode, e.g. a QR code record, which may be associated with the hair dye.
- the device for carrying out the computer-aided hair color consultation may comprise a sensor for detecting the hair dye, such as another camera, a bar code scanner, a QR code scanner or an RFID chip sensor.
- a sensor for detecting the hair dye such as another camera, a bar code scanner, a QR code scanner or an RFID chip sensor.
- the means for performing the computerized hair color consultation may comprise the data processing device 106, such as a computer, a tablet, or any other data processing device is suitable to carry out the method for computer-aided hair color consultation according to various embodiments.
- the data processing device 106 will also be referred to herein as a computer 106.
- the device for carrying out the computer-assisted hair color consultation can have a first data connection 12 between the computer 106 and the camera 104 in various exemplary embodiments.
- data can be transmitted from the computer 106 to the camera 104, for example for a, e.g. conventional software control of the camera 104.
- data for example the digital image (s) taken by the camera 104, can be transmitted to the computer 106 by means of the first data connection 12.
- the computer 106 may be configured to process the image received from the camera 104 by means of image processing software, for example, to determine the hair area area in the received image in a known manner.
- the hair area area is shown as the area 552 only in the case that the hair area area as an illustrated hair projection area 554 coincides with the hair transmission / reflection area 550 without further manipulation.
- the hair area area (not shown) may have a different shape, size, and / or position and be modified by software provided to the data processing device 106 to provide hair projection / coverage area coverage as the hair projection area 554. This coverage area is shown as area 552 in FIG. 3 and FIG. 4 shown.
- the means for executing the computerized hair color rendering 100 may include a second data link 18 between the computer 106 and the screen 102 in various embodiments.
- control signals can be transmitted from the computer 106 to the screen 102, for example in a conventional manner.
- the computer 106 can provide the screen 102 with information about the location and color of the hair projection area 554 via the second data link 18.
- the means for executing computerized hair color consulting 100 may include a database 108 in various embodiments.
- the database 108 can Hair Coloring product data, with a plurality of hair coloring products, which may be assigned, for example, a hair color, a product name, a barcode, a QR code and other information such as a gray cover, a chemical composition, etc.
- the database may include, for example, customer data having hair coloring products already used and / or stored for a plurality of customers, such as hair coloring products, which may be stored in the hair dyeing product data.
- the computerized hair color rendering facility 100 may, in various embodiments, include a third data connection 16 between the computer 106 and the database 108.
- the database 108 may be part of the computer 106, for example, the database 108 may be stored in the data memory of the computing device 106.
- the second data connection 16 may be a connection between the data memory and, for example, a processor of the computer 106.
- database 108 may be an external database.
- the computer 106 can be provided in whole or in part with the stored data by the database 108, and / or, for example, a request can be transmitted to the database 108 by the computer 105.
- the device 100 for carrying out the computer-assisted hair color consultation may, in various embodiments, comprise a control unit 10 and a data connection 14 which the control panel 11 can connect to the computer 106.
- the data processing device 106 (eg start / stop of the method, setting process parameters) and / or at least one device connected to the data processing device 106 can be operated by means of the operating part, for example the camera 104 (eg zoom, focus, angular position (ie Optical axis angle and / or spatial position), the screen (eg, brightness, color), the database 108 (from which, for example, an entry 108 may be selected by means of the keypad 14, for example if a plurality of the selectable ones stored in the database 108 Hair colors are presented to the user 202, for example on the screen 102 or on an additional screen) and / or an optional additional sensor (not shown, eg a scanner for barcodes and / or QR codes and / or an RFID sensor using of the control unit 1 14 can be activated / deactivated, for example).
- the control panel 14 may include, for example, a special or conventional keyboard, a computer mouse, a joystick, a touch-sensitive keyboard, a touch-sensitive
- the device 100 may include more than one keypad, for example for directly controlling one of the components, e.g. the camera 104 or the screen 102.
- the user 220 once set a setting of the components of the device 100, e.g. the camera 104, the screen 102, etc. and selects a hair color (for example, a plurality of hair colors that can be sequentially displayed).
- a hair color for example, a plurality of hair colors that can be sequentially displayed.
- another person for example, staff of a store in which the device 100 is operated, may adjust, e.g. by means of the control panel.
- software can also be used to automatically select the new hair color, for example based on an original hair color, clothing color or skin color of the user 220, or for example on the basis of previous purchases by the user 220, for example also in online shops.
- the user 220 may thus, after a successful adjustment, e.g. by means of the control panel 1 14, focus on viewing the result.
- the screen 102 may also be used to project hair in the original hair color in the hair projection area 554, for example, prior to projecting the hair in the new hair color. This allows the user 220 to check color and brightness rendering by the hair projection area 554 and, if necessary, to perform color and / or brightness correction. The color and / or brightness correction made can also be made in the projection of the dyeing result in the hair projection area 554.
- a color and / or brightness reference may also be provided or may be provided.
- the color and / or brightness reference may be used to correct for color and / or brightness values for the plurality of picture elements provided to the computer 106 by the camera 104 in the form of the digital image, such that for the picture elements in FIG which the color and / or brightness reference is shown to provide the correct associated color and / or brightness values.
- FIG. 2A schematically illustrates in a view 200a device according to various embodiments in carrying out the method of computerized color consulting according to various embodiments.
- the reflective screen 102R is used.
- light 222 provided by the user 220 e.g. his face, his body and his hair, and possibly other objects, e.g. Objects and / or reference objects is radiated from the screen 102R to the user 220 mirrored.
- the mirrored light reaching the eyes of the user 220 is shown in FIG. 2A is labeled as mirrored light 224.
- the reflection of parts of his body and possibly of other surrounding objects forms a first component of a composite image for the user 220, who may also be the viewer here by way of example, which presents him with a new hair color. His hair is mirrored to the user 220. It appears to the user 220 in a hair mirror area 550
- the camera 104 is used, which receives light 226 from the user 220 (especially from his hair) and at least part of the body of the user 220, e.g. his face, his neck, etc., and possibly of other objects, receives and forms a digital image from which it transmits by means of the data connection 1 12 to the computer 106.
- the hair area area can be determined in a conventional manner by means of the computer 106. As described above, the hair area area may be adjusted, if necessary, to provide a region 552 in which the hair mirror area 550 coincides with the hair projection area 554. The shape, size, position and angular position of the region 552 may be the same or substantially the same as those of the hair mirroring region 550 and the hair projection region 554.
- the hair of the user 220 may be projected into a new hair color.
- the new hair color may, for example, be selected by the user, for example by means of the input device 110 or by means of a sensor, for example as described above, for example as a hair dyeing product and / or as a dyeing formulation.
- Colors which are to be displayed on the screen 102R in the hair projection region 554 for the selected hair color may be used in various embodiments according to the method described herein, eg in conjunction with FIG. 6, to determine a hair coloring result, and then to the screen 102R by way of the data link 118 and projected by means of the screen 102R in the hair projection area 554.
- the calculation of the color values to be displayed for each picture element and a color difference value that is the same for all picture elements according to the method makes it possible to quickly calculate the color values to be displayed by means of the computer 106, and thus a rapid sequence in a representation of a plurality of Images, for example, when performing the method of hair coloring consultation in a quasi-real-time mode, in which the camera 104 may be, for example, a video camera.
- the colors can be determined in a known manner.
- the hair projecting area 554 projected by the screen 102R shown in FIG. 2A, shown as light 228, which is emitted from the screen 102R and reaches the eyes of the user 220, may be the second component of the composite image in various embodiments.
- FIG. 3 illustrates.
- the reflective screen 102R In a top view, the reflective screen 102R, the camera 104, the user 220 (from behind), and its mirror image mirrored by the screen can be seen.
- the hair is mirrored in a hair mirror area 550.
- a median view is for illustrative purposes only and would not be seen during execution of the procedure.
- the area 552 is marked in which the hair mirror area 550 and the hair projection area 554 (which, when the camera 104 is arranged as shown clearly above the center of the screen 102R by means of the computer 106, has been adapted to catch the hair.
- Mirror area 550 overlap each other.
- the hair color projection area 554 projects the new hair color selected by the user 220.
- the hair projection area 554 may be newly colored by the method of presenting a hair dyeing result described herein, or by other known methods, for example, such that the hair projection area 554 is not uniformly colored in the new hair color but, for example, light lightened areas lighter and / or shaded areas, whereby a distribution of light and shade may correspond to the original distribution in the hair mirror area 550.
- FIG. 2B schematically illustrates in a view 200b a device according to various embodiments in carrying out the method of computerized color consulting according to various embodiments.
- the translucent screen 102T is used.
- light 222 provided by the user 220 e.g. his face, his body and his hair, and possibly other objects, e.g. Objects and / or reference objects, radiated from the screen 102R to the viewer 330 and at least partially transmitted by the screen 102T (transmitted).
- the transmission of parts of the body of the user 220 and possibly other objects surrounding the user 220 forms for the viewer 330 a first component of a composite image, which presents him with a representation of the user with a new hair color. Even light from the hair is transmitted to the viewer. It appears to the viewer in a hair transmission area 550
- the camera 104 is used in conjunction with the computer 106 as shown in FIG. 2B to project the hair projection area 554 with the new hair color, for example at least toward the viewer 330.
- the hair projecting area 554 projected by the screen 102R shown in FIG. 2B, shown as light 332, which is emitted from the screen 102R and reaches the eyes of the observer 3300, may be the second component of the composite image in various embodiments.
- the method is further described for the translucent screen 102T in FIG. 4 illustrates.
- the translucent screen 102T, the camera 104, the user 220 (front, e.g., hands, arms, and upper body) and its image transmitted from the screen (in the area framed by a frame of the screen) are seen.
- light is transmitted from the hair in a hair transmission region 550.
- a median view is for illustrative purposes only and would not be seen during execution of the procedure.
- the area 552 is marked in which the hair transmittance area 550 and the hair projection area 554 (which, in an arrangement of the camera 104 as shown, has been adjusted well above the center of the screen 102R by means of the computer 106 to engage with the hair. Cover transmission range 550) overlap each other.
- the new hair color selected by the user 220 as described above in connection with FIG. 2A, with the difference that the projection can take place at least in the direction of the observer 330.
- a transmission of the light from the hair in the hair transmission region 550 can be outshined so that the user in the hair projection region 554 essentially only perceives the projected light.
- FIG. 2C schematically illustrates in a view 200c a device according to various embodiments in carrying out the method of computerized color consulting according to various embodiments.
- FIG. 2C schematically illustrates in a view 200c a device according to various embodiments in carrying out the method of computerized color consulting according to various embodiments.
- the translucent screen 102T is used.
- the method of hair color consultation and the means for carrying out the method substantially correspond to what has been described above in connection with FIG. 2C and FIG. 4, with the exception that the device has an additional mirror 440 located behind the screen 102T as viewed by the user 220, that the user in the mirror 440 can view the combined image shown in FIG. 2B the viewer 330 can look at.
- FIG. 5 shows a flow chart 500 illustrating a method of computerized hair color consulting according to various embodiments.
- the method may include capturing a digital image of a user's hair and additional objects via a camera (in 510), determining a hair area area in which the hair is imaged, in the digital image (in 520), adjusting a hair projection area in which the hair is projected, a translucent or specular screen such that for a viewer of the screen results in a combination of the objects transmitted by the screen or mirrored with the hair projection area, wherein the hair projection area is adjusted so that he essentially coincides with a hair transmittance / mirroring area in which the viewer's hair would appear to be transmitted or mirrored (in 540), and projecting the hair projection area in the new hair color (in 550).
- FIG. 6 shows a flow chart 600 illustrating a method of computer-assisted hair color consulting according to various embodiments.
- the method may comprise a plurality of staining operations: colorimetric measurement of a plurality of pixels of an image of undyed hair at a defined light irradiation on the undyed hair, determining a pre-color average from the colorimetric readings of the plurality of image elements of the uncolored hair image ; colorimetric measurement of a plurality of pixels of a colored hair image at the defined light irradiation on the colored hair, determining a post colorant value from the colorimetric readings of the plurality of colored hair color image elements; and determining a color difference value from the before color average and the after color average including correction factors for very dark or very bright image areas (in 610), determining a relationship between the plurality of before color averages and the plurality of color difference values using predictive analytics ( 620), providing a digital image having at least one user's hair area (in 630),
- a precise calculation of a hair dye for example a color difference value based inter alia on a base hair color and a mean value of the base hair color determined therefrom (also called pre-color average value).
- a data set also called hair color data
- a plurality of staining criteria including at least the base hair color and the staining recipe used
- staining result parameters at least one after staining Hair color and a median determined therefrom (also referred to as post-color average).
- the data set may have further coloring presumption parameters, for example pre-damage to the hair, degree of graying of the hair, and / or other coloring presumption parameters.
- a color space from which the color information (eg, the hair color information of the dyed hair or the hair before dyeing, which is also referred to as a base hair color) is derived, or in which the color information is displayed (for example, when a hair color is displayed, see below ) are such that a detected or displayed color is independent of a medium by which the color is detected or displayed (eg, colorimeter, screen, printer, scanner, human eye, etc.).
- the color space may be, for example, an L * a * b * color space, the color information a hue parameterized by means of a * and b *, for example.
- the uniform representation in the medium-independent color space may, for example, make it possible to present a realistic dyeing result to be expected, for example by a color obtained by dyeing leaving the same color impression to the viewer of the dyed hair as in a representation of the expected result, for example as a packaging print Display on a computer screen, or similar
- the color space can have a CIELUV or a / 1/2/3 / color space, which can be better suited for an additive light color than, for example, the L * a * b * color space.
- the at least one dyeing result parameter may also have further properties of the colored hair color in various embodiments, for example a light fastness, a wash fastness or a gray coverage capability.
- the data set can be used according to various embodiments as the basis for an application of a predictive analytic method.
- the staining prerequisite parameters or a part of the staining prerequisite parameters and their associated staining result parameters or a part of the staining result parameters may be used to generate a model which describes the set as accurately as possible.
- the measured data of the data set may describe the properties of the hair color produced by dyeing (eg L * center after , a m * ine afterwards , b m * itte later than an average value a colorimetric measurement carried out, for example, on a dyed strand of hair, and optionally additional dyeing result parameters such as, for example, wash fastness, light fastness, gray coverage or similar) to act dependent variables.
- dyeing eg L * center after , a m * ine afterwards , b m * itte later than an average value a colorimetric measurement carried out, for example, on a dyed strand of hair, and optionally additional dyeing result parameters such as, for example, wash fastness, light fastness, gray coverage or similar
- a relationship between the independent and dependent variables in other words, between the coloring requirement parameters and the coloring result parameters
- the color difference value this can be expressed as: where ALab stands for the color difference value, l * medium, before , a m * ittelvorher , b m * ittelvorher for the color mean before coloring.
- the function may or may not be analytically known. If no analytic function is known, the values of the dependent variable (the coloring result parameter) can also be calculated using numerical algorithms.
- the independent variables may be properties that affect the coloring result, for example, in addition to the base hair color (e.g., mean), a dye formulation, a damaged state, and / or a degree of graying of the hair, or the like.
- a model can be generated by means of the predictive analytics, which predicts the coloring result parameters (dependent variables, examples see above) as accurately as possible given preset dyeing parameters (independent variables, see examples above).
- predictive analytics may be used to generate a continuous model of staining prerequisite parameters and staining result parameters such that it is possible to determine a value of staining requirement parameter or combination of values for a plurality of staining criteria not satisfying any of the corresponding experimental values Value combinations correspond to the determination of a value for a coloring result parameter with the help of the model.
- Predictive analytics can generally be described as a method to extract information from large amounts of data and to generate a model from that data it also allows predictions to be made for values that are not part of the record.
- a part of the data set can typically be used as a training record (also referred to as a training set or training data). Based on this training data set, one or more models can be generated, which can then be tested on the basis of the data which are not part of the training data set, on the whole data, or on a specially selected part of the data.
- a coefficient of determination R 2 a mean absolute error, a mean square error, a standard deviation and / or a mean deviation.
- the coefficient of determination R 2 may correspond to a squared correlation coefficient for a linear regression model. For another model (another relationship) it can be defined differently.
- various functions or methods can be used according to various embodiments.
- a multiple linear regression can be used.
- Better results can typically be achieved using polynomial regressions, neural networks, support vector machines, decision trees (eg tree ensembles) or the like.
- the described method for displaying a hair dye result may be performed by means of a data processing device, for example a data processing device as described in connection with FIG. 7 described.
- the color can also be parameterized for the output in a medium-independent color space, for example the L * a * b * color space.
- a medium-independent color space for example the L * a * b * color space.
- the method of presenting a hair color result may further comprise providing a digital image that is at least one of has a hair area area of a user.
- the hair area area can be, for example, a view of a complete hairstyle.
- a user's hair area can be determined by known methods, i. a surface in which the hair of the user is shown.
- the known method may, for example, comprise a release method, as e.g. can be used in Photoshop and other software packages.
- color values of a plurality of picture elements of the user's hair area area can be determined by means of the data processing device according to various exemplary embodiments.
- a user pre-color mean value e.g. calculated by means, e.g. arithmetic means, weighted means, median formation or the like.
- the user may select a new hair color, for example, as a product, a color formulation, a sample photograph, or the like.
- the user can enter his selection by means of an input device (see FIG. 7 and associated description).
- an expected staining result can be determined based on the user-before color average and the determined relationship. In other words, based on the determined relationship, based on the user before colorant value and the selected hair color, an expected user-after colorant value (and as the difference of user-after colorant value and user-before colorant value) can be averaged out.
- the expected color result can be determined according to various embodiments.
- the hair area area can be retouched with the new hair color by re-coloring the plurality of picture elements of the user hair area area by adding the color difference value to the determined color value for each picture element of the plurality of picture elements of the user hair area area.
- correction factors can be applied so that the allowable parameter space is not exceeded.
- the expected staining result may be represented by representing the digital image in which the hair area area is retouched based on the expected staining result, for example by means of a screen 740 as shown in FIG. 7 is shown.
- the method may be practiced as part of the method of computerized hair color consulting described above in connection with FIGS. 1-5.
- the newly dyed hair area i.e., only the newly dyed hair area
- FIG. 7 is a graphical representation 700 of a data processing device 710 for carrying out a method of displaying a hair coloring result according to various embodiments.
- the data processing device 700 can be or have, for example, a PC, a laptop or any other data processing device which is suitable for carrying out the method for displaying a hair dyeing result, that is, for example, has a sufficiently large memory and a sufficiently powerful processor.
- the data processing device 700 may include the data processing device 106 of FIG. 1, FIG. 2A, FIG. 2B and FIG. 2C.
- the data processing device 700 may include a processor 720 in various embodiments.
- processor 720 may be a microprocessor of data processing device 700 or may include such a microprocessor.
- the data processing device 700 may include a data storage device 730.
- the data storage device may be an internal or external data storage 730 of one of the data processing devices 700 or may have such a data storage 730.
- the data memory 730 may be configured to receive data stored and / or retrieved when performing the method for displaying a hair dye result, for example, the hair color data.
- the data storage device 730 may include the data storage 108 of FIG. Be 1.
- the data processing device 700 may include a display device 740.
- the display device 740 may include a screen of a personal computer, a laptop, or any other computing device 700.
- the display device may be used to present results of the method of displaying a hair coloring result, requesting input parameters for performing the method, or the like.
- the display device 740 may include the screen 102 of FIG. 1 to FIG. 4 be.
- the data processing device 700 may include an input device 750 for providing information to the data processing device 700, such as a keyboard, a mouse, a touch-sensitive surface of the display device 740, or the like.
- input device 750 may include keypad 10 of FIG. Be 1.
- a method for computer-aided hair color consultation can comprise:
- a hair projection area in which the hair is projected a translucent or reflective screen or a system of screen and splitter mirror such that results for a viewer of the screen, a combination of the screen-transmitted or mirrored objects with the hair projection area wherein the hair projection area is adapted to substantially coincide with a hair transmission / reflection area in which the viewer's hair would appear to be transmitted or mirrored;
- the method according to the 1. Embodiment be configured such that the recording of the digital image, the determination of the hair area area and representing the colored in the new hair color hair area surface repeatedly performed such that there is a quasi-real-time representation.
- the method according to the first or second embodiment may be configured such that the determination of the new hair color comprises selecting the new hair color from a database of a plurality of selectable new hair colors.
- the method according to one of the first to third exemplary embodiments may be configured such that the provision of the plurality of selectable new hair colors comprises displaying a selection menu on the screen.
- the method according to one of the first to fourth exemplary embodiments may be configured such that the determination of the new hair color comprises a detection of a hair dyeing product by means of a sensor.
- the method according to one of the first to fifth exemplary embodiments may be configured such that the user is also the viewer.
- the method according to one of the first to sixth exemplary embodiments may further comprise:
- the method according to one of the first to seventh exemplary embodiments can be configured in such a way that the adaptation of the hair projection region comprises arranging the user, the screen, the viewer and the camera, such that the covering of the hair Projection range with the hair transmission / reflection range,
- the method according to one of the first to eighth exemplary embodiments may be configured in such a way that the adaptation of the hair projection region has the effect of adjusting a zoom factor of the camera.
- the method according to one of the 1. to 9th Embodiments be configured such that the adjustment of the hair projection area comprises detecting a position reference.
- the method according to one of the 1 to 10 embodiments may be configured such that the adjustment of the hair projection area comprises acquiring spatial information regarding the user and the additional objects.
- the method according to one of the 1st to 10th embodiments may further comprise:
- the method according to embodiment 12 may further comprise:
- the method according to one of the 1st to 13th embodiments may be configured such that the determination of the new hair color has the method according to one of the embodiments 22 to 24.
- the method according to one of the 1st to 14th embodiments may further comprise:
- a device for carrying out a computer-assisted hair color consultation can have
- At least one camera for capturing a digital image of a user's hair and additional objects
- processor configured to determine the area of the hair area in the digital image of the user
- the device according to embodiment 16 may be configured such that the screen is an OLED screen.
- the device according to an exemplary embodiment 16 or 17 can be designed such that the at least one camera is arranged such that its at least one optical axis is perpendicular to a user-facing surface of the screen.
- the device according to one of the embodiments 16 to 18 may be configured such that the screen is the translucent screen, further comprising:
- a mirror which, viewed by the user, is arranged behind the screen in such a way that the combination of the objects transmitted by the screen or mirrored with the hair projection area is visible in the mirror for him.
- the device according to one of the embodiments 16 to 19 may be configured such that the input device has a touch-sensitive surface of the screen.
- the device according to one of the embodiments 16 to 20 may further comprise:
- a sensor for acquiring spatial information regarding the user.
- a method for displaying a hair coloring result may include:
- Providing a digital image having at least one hair area area of a user Determining color values for a plurality of pixels of the user hair area area; Determining a user-before color average from the color values of the plurality of pixels of the user hair area;
- the method according to embodiment 22 may be configured such that the determination of an expected coloring result comprises:
- Determining an associated color difference value based on the determined relationship; and wherein the re-coloring of the hair area area comprises re-coloring the plurality of picture elements of the user hair area area by adding the color difference value to the determined color value for each picture element of the plurality of picture elements of the user hair area area.
- the method according to embodiment 22 or 23 may be configured such that a device according to an exemplary embodiment 16 to 21 is used for representing the part of the digital image which has the newly colored hair area area.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Strategic Management (AREA)
- Economics (AREA)
- General Business, Economics & Management (AREA)
- Finance (AREA)
- Tourism & Hospitality (AREA)
- Development Economics (AREA)
- Accounting & Taxation (AREA)
- Marketing (AREA)
- Health & Medical Sciences (AREA)
- Game Theory and Decision Science (AREA)
- Entrepreneurship & Innovation (AREA)
- General Health & Medical Sciences (AREA)
- Human Resources & Organizations (AREA)
- Primary Health Care (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Image Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102016213754.9A DE102016213754A1 (de) | 2016-07-27 | 2016-07-27 | Verfahren, Einrichtung und Datenverarbeitungsvorrichtung zur computergestützten Haarfarbberatung |
| PCT/EP2017/067916 WO2018019623A1 (de) | 2016-07-27 | 2017-07-14 | Verfahren, einrichtung und datenverarbeitungsvorrichtung zur computergestützten haarfarbberatung |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP3491615A1 true EP3491615A1 (de) | 2019-06-05 |
Family
ID=59350948
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP17739995.3A Ceased EP3491615A1 (de) | 2016-07-27 | 2017-07-14 | Verfahren, einrichtung und datenverarbeitungsvorrichtung zur computergestützten haarfarbberatung |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US20200334868A1 (de) |
| EP (1) | EP3491615A1 (de) |
| DE (1) | DE102016213754A1 (de) |
| WO (1) | WO2018019623A1 (de) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US12042037B2 (en) | 2021-12-29 | 2024-07-23 | Ann Marie Benison | Virtual wig display assembly |
| KR20230134226A (ko) * | 2022-03-14 | 2023-09-21 | 한국과학기술원 | 염색된 모발 이미지 시각화 방법 및 시스템 |
| US20250191248A1 (en) * | 2023-12-07 | 2025-06-12 | L'oreal | Hair color simulation using a hair color classification guided network |
| US20250239026A1 (en) * | 2024-01-23 | 2025-07-24 | L'oreal | Method and system for 3d hair virtual try on |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040010333A1 (en) * | 2002-06-26 | 2004-01-15 | Baker Paul Edmund | Method and apparatus for predicting the result of a coloration |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6067504A (en) * | 1983-07-18 | 2000-05-23 | Chromatics Color Sciences International, Inc. | Method for correctly identifying hair color |
| US6719565B1 (en) * | 1999-10-29 | 2004-04-13 | Kao Corporation | Hair color advice system |
| DE10142526C5 (de) * | 2001-08-30 | 2006-02-16 | Wella Ag | Verfahren für eine Haarfarbberatung |
| US20090009628A1 (en) * | 2007-07-06 | 2009-01-08 | Michael Janicek | Capturing an image with a camera integrated in an electronic display |
| JP5210102B2 (ja) * | 2008-09-22 | 2013-06-12 | セーレン株式会社 | 仮想試着装置 |
| US8446514B2 (en) * | 2011-05-09 | 2013-05-21 | Intellectual Ventures Fund 83 Llc | Capturing images using a switchable imaging apparatus |
| US9325943B2 (en) * | 2013-02-20 | 2016-04-26 | Microsoft Technology Licensing, Llc | Providing a tele-immersive experience using a mirror metaphor |
| KR101464273B1 (ko) * | 2013-03-06 | 2014-11-24 | (주)피엑스디 | 투명 디스플레이를 이용한 인터랙티브 이미지 표시장치, 표시방법 및 그 기록매체 |
| BR112015026910A2 (pt) * | 2013-04-23 | 2017-07-25 | Procter & Gamble | arranjo de ferramenta para consulta de cabelo e método |
| DE102014220077A1 (de) * | 2014-10-02 | 2016-04-07 | Henkel Ag & Co. Kgaa | Verfahren und Datenverarbeitungsvorrichtung zur computergestützten Haarfarbberatung |
| CN204306499U (zh) * | 2014-12-25 | 2015-05-06 | 北京维信诺光电技术有限公司 | 有机发光二极管试衣镜 |
-
2016
- 2016-07-27 DE DE102016213754.9A patent/DE102016213754A1/de not_active Withdrawn
-
2017
- 2017-07-14 WO PCT/EP2017/067916 patent/WO2018019623A1/de not_active Ceased
- 2017-07-14 US US16/320,795 patent/US20200334868A1/en not_active Abandoned
- 2017-07-14 EP EP17739995.3A patent/EP3491615A1/de not_active Ceased
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040010333A1 (en) * | 2002-06-26 | 2004-01-15 | Baker Paul Edmund | Method and apparatus for predicting the result of a coloration |
Also Published As
| Publication number | Publication date |
|---|---|
| US20200334868A1 (en) | 2020-10-22 |
| DE102016213754A1 (de) | 2018-02-01 |
| WO2018019623A1 (de) | 2018-02-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10217244B2 (en) | Method and data processing device for computer-assisted hair coloring guidance | |
| EP3560185B1 (de) | System und verfahren zum erfassen von messbildern eines messobjekts | |
| US11861810B2 (en) | Image dehazing method, apparatus, and device, and computer storage medium | |
| KR101800102B1 (ko) | 피부 진단 및 화상 처리 방법 | |
| KR101799174B1 (ko) | 피부 진단 및 화상 처리 시스템, 장치 및 물품 | |
| EP3866454B1 (de) | Verwendung von infrarotbildgebung zur erstellung digitaler bilder zur verwendung bei der produktanpassung | |
| EP3649459B1 (de) | System zum verwalten von haarzustandsinformation und verfahren zum optimieren eines kosmetischen beratungssystems | |
| EP3491615A1 (de) | Verfahren, einrichtung und datenverarbeitungsvorrichtung zur computergestützten haarfarbberatung | |
| DE102015213832A1 (de) | Verfahren und Vorrichtung zum Erzeugen eines künstlichen Bildes | |
| DE19908211A1 (de) | Verfahren und Vorrichtung zum Bestimmen der Farbe einer Lichtart | |
| EP3538855B1 (de) | Verfahren und einrichtung zum ermitteln einer farbhomogenität von haaren | |
| CN109086297A (zh) | 用于颜色选择的系统和方法及计算机可读介质 | |
| US20200193503A1 (en) | Method and device for computer-supported hair treatment consultation | |
| Ong et al. | Comparative analysis of RGB and HSV color models in extracting color features of green dye solutions | |
| CA2651539C (en) | Method and apparatus for hair colour simulation | |
| US12243288B2 (en) | Chromatic undertone detection | |
| Kumar et al. | Colorization of gray image in Lαβ color space using texture mapping and luminance mapping | |
| WO2018114455A1 (de) | Verfahren und einrichtung zur computergestützten haarbehandlungsberatung | |
| JP6544004B2 (ja) | 色見本作成装置および色見本作成方法、並びに、色見本を用いる画像処理システム | |
| Ratnasingam et al. | The role of chromatic variance in modulating color appearance | |
| KR20250145047A (ko) | 가상 헤어 컬러링을 위한 방법 및 시스템 | |
| Sankar et al. | Understanding Blur and Model Learning in Projector Compensation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20181203 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| AX | Request for extension of the european patent |
Extension state: BA ME |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| 17Q | First examination report despatched |
Effective date: 20191206 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R003 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED |
|
| 18R | Application refused |
Effective date: 20210311 |