BRPI0518197B1 - APPARATUS AND METHOD FOR CATCHING AND VIEWING SKIN IMAGES - Google Patents

Abstract

apparatus and method for capturing and viewing skin images. a self-contained, portable apparatus and corresponding method for capturing, displaying and analyzing images of a person include a housing for holding a digital camera, a light source capable of providing at least two different light wavelengths, a monitor type touch screen and a computer to control the camera, light source and monitor. The apparatus selectively captures and displays a plurality of digital images using different wavelengths of illumination light.

Description

(54) Title: APPARATUS AND METHOD FOR CAPTURING AND VIEWING SKIN IMAGES (51) Int.CI .: A61B 5/103; G03B 29/00 (30) Unionist Priority: 10/29/2004 US 10 / 978,284 (73) Holder (s): JOHNSON & JOHNSON CONSUMER COMPANIES, INC.

(72) Inventor (s): KENNETH MEROLA; NIKIFOROS KOLLIAS; JEFFREY S. POTE; GREOGRY PAYONK

1/39

Invention Patent Descriptive Report for APPARATUS AND METHOD FOR CAPTURING AND VIEWING SKIN IMAGES. CROSS REFERENCES TO RELATED ORDERS [001] This is part of a continuation of order 10 / 008.753, entitled Method for Obtaining Skin Images Using Blue Light and Its Use; filed on November 8, 2001 and belongs to the assignee here.

FIELD OF THE INVENTION [002] The present invention relates to an apparatus for and method of capturing and viewing images of the skin, and more particularly to obtain multiple images using a plurality of different wavelengths of light, viewing and using the images.

BACKGROUND OF THE INVENTION [003] In order to promote skin care products, many cosmetic companies ask their potential customers questions regarding the perception of their skin. Based on the answers to these questions, cosmetic companies are able to better suggest cosmetic and therapeutic products to these people. Examples of such promotions can be found on the Neutrogena® web pages (www.neutroqena.com), LOreal® (www.lorealparisusa.com), and Lancome® (www.lancome.com). These questions, however, are based only on the patient's perception of their skin through visible light. Many skin problems, however, are not always visible under such conditions.

[004] Several types of photographs were developed to intensify the visualization of the skin. In visible light photography, or standard photography, the most common arrangement includes a camera and one or more flash units to distribute visible light to the skin by direct lighting, diffuse lighting, or a combination of them. Angled lighting was also used to generate a gradient of the field of

Petition 870180007592, of 01/29/2018, p. 5/56

2/39 lighting on the skin in order to intensify the visualization of wrinkles and fine lines. Depending on the direction of the gradient (vertical or horizontal), different sets of wrinkles and fine lines can be visually enhanced.

[005] A photograph with polarized light was also developed to selectively enhance any skin surface or subsurface characteristics. These results are achieved by placing a polarization filter (typically a linear polarization filter) both in front of the flash unit and in front of the camera. When the polarization filters are in the same orientation with each other, the characteristics of the skin surface, such as scales, wrinkles, fine lines, pores, and hair are visually enhanced. When the polarization filters are aligned perpendicular to each other, the characteristics of the skin's subsurface, such as erythema, pigmentation, blood vessels, and hair, are visually enhanced.

[006] Ultraviolet photography, where the flash unit is filtered to produce ultraviolet A light and the camera is filtered so that only visible light enters the lens, was used to visually intensify the pigmentation appearance, p. bacterial acnes, and horns. A variation of ultraviolet photography has been termed the sun camera where ultraviolet A light is used to illuminate the skin and an ultraviolet sensitive film A or a digital camera is used to record the ultraviolet light reflected from the skin. In this arrangement, both the pigment distribution and the surface characteristics of the skin are visually enhanced.

[007] The present invention provides people with access to one or more of these improved devices for viewing their skin in order to provide them with additional information on their skin condition. Such information allows them to make more informed decisions regarding the

Petition 870180007592, of 01/29/2018, p. 6/56

3/39 purchase of skin care products. In addition, skin care products can be suggested to such potential customers by retailers or professionals based on such heightened customer perception of their own skin.

SUMMARY OF THE INVENTION [008] The problems and disadvantages associated with conventional apparatus and techniques used to capture and review images are overcome by the present invention, which includes an apparatus for examining images of a person. The device has a housing, a camera mounted to capture images of the person and a lighting device mounted in the housing to provide light to capture images of the person. The lighting device is capable of providing at least two different wavelengths of light when capturing images. The wavelengths of light used to capture a first image differ from the wavelengths of light used to capture a subsequent image. The device includes a monitor mounted on the housing to show images captured by the camera; and a controller to control the camera, lighting device and monitor to selectively capture and display the images captured on the monitor.

[009] According to a method of the invention, an image formation station is provided having a housing, a camera, a light source, a monitor mounted on the housing to show images captured by the camera and a computer. The person whose image will be captured is positioned in relation to the camera and a plurality of images is automatically captured with the camera. The captured images are stored and selectively shown on the monitor by operator control.

[0010] Other aspects, characteristics, and advantages of the present invention will become apparent from the detailed description of the

Petition 870180007592, of 01/29/2018, p. 7/56

4/39 invention and claims.

BRIEF DESCRIPTION OF THE DRAWINGS [0011] FIGURE 1 is an aerial view of a device used to sequentially capture the following four types of portraits of a person: a standard photograph, a polarized photograph, an ultraviolet A photograph, and a blue fluorescent photograph.

[0012] FIGURE 2 is a perspective view of an alternative embodiment of the present invention.

[0013] FIGURE 3 is a diagrammatic top view of the present invention shown in FIGURE 2, in particular, showing an angular orientation of a pair of doors with respect to a central housing thereof.

[0014] FIGURE 4 is an elevation view of a touch screen monitor of the present invention shown in FIGURE 2.

[0015] FIGURES 5 to 8 are flowcharts showing exemplary processing flows associated with the operation and control of the present invention shown in Figures 2 to 4.

[0016] FIGURE 9 is an exploded view of the present invention as shown in Figures 2 to 4.

[0017] FIGURE 10 is a perspective view of the present invention shown in Figures 2 to 4 and 9 with the doors closed.

[0018] FIGURE 11 is a perspective view of the present invention shown in FIGURE 10, seen from the rear.

[0019] FIGURE 12 is a block diagram showing the system components of the present invention shown in Figures 2 to 11.

DETAILED DESCRIPTION OF THE INVENTION [0020] It is believed that someone skilled in the art can, based on the description here, use the present invention to its fullest extent. The following specific modalities are to be constituted 870180007592, from 01/29/2018, p. 8/56

5/39 as purely illustrative, and not limiting the rest of the description in any way.

[0021] Unless otherwise defined, all technical and scientific terms used here have the same meaning as commonly understood by someone versed in the technique to which the invention belongs. Also, all publications, patent applications, patents, and other references mentioned here are incorporated by reference.

THE CAMERA [0022] Various types of cameras can be used in the methods of the present invention. Examples of such cameras include, but are not limited to, standard 35 mm cameras, cameras using instant development film (such as those available from Polaroid Corporation, Cambridge, Massachusetts USA), and digital cameras. Preferably, a digital camera is used as it provides quick access to images taken from the patient. It also allows the image to be shown on a large monitor, allows the patient to easily enlarge areas of the skin that are of particular interest (for example, areas of the face), and allows the image to be printed on a report that can also include product suggestions related to patient concerns noted by examining the images. Examples of suitable digital cameras include, but are not limited to, those that capture images of at least 1 million pixels, preferably 4 million pixels. Examples of such digital cameras include, but are not limited to, the Nikon D1X (Nikon, Tokyo, Japan) and Fuji S1 (Fuji, Tokyo, Japan).

[0023] One or more cameras can also be used in the methods of the present invention, for example, separate cameras having a separate light filtering lens can be used for each type of photograph taken and / or separate cameras used to photograph diPetition 870180007592, from 01/29/2018, p. 9/56

6/39 ferent areas or angles of the patient. Preferably, only one camera is used since having more than one camera would require the cameras to be calibrated to have the same color and intensity response. When only one camera is used, a mechanical filter wheel or arm containing a filter (s) can be placed in front of the camera to selectively filter the light before or after entering the camera lens and / or the ( respective filter (s) can be placed on the light source (s) to filter the light as it leaves the light source (s). In the case where multiple light sources are used, the camera can communicate with each of the respective light sources via electrical installation or a radio transmitter.

[0024] In one embodiment, the camera (s) are mounted on the same level as the area of the skin that the patient wants to be photographed, for example, the patient's face. Preferably, the camera is adjusted so that that area of skin substantially fills the structure area of the photograph, for example, to ensure a greater amount of detail in the image.

[0025] In a mode where multiple images are acquired by a single camera, images are preferably acquired in less than 30 seconds, for example, less than about 10 seconds.

STANDARD PHOTOGRAPHY [0026] In one embodiment, the method includes the step of taking a standard photograph of the patient. What is meant by standard photography is a photograph that is taken of the patient using visible light (for example, light having a wavelength of about 400 to about 700 nm). In one embodiment, the patient is illuminated with one or more, preferably two, flash units that emit visible light. In one embodiment, the flash unit (s) is / are additionally equipped (s) with a diffusion filter that is placed in front of each

Petition 870180007592, of 01/29/2018, p. 10/56

7/39 flash unit. A diffusion filter is a filter, which helps to disperse light evenly (for example, to help eliminate hot spots). Examples of such diffusion filters include, but are not limited to, frozen glass filters such as a Broncolor diffuser (Sinar Bron, Allschwil, Switzerland), metal gratings that can be printed on glass substrates, or an umbrella from reflective diffusion for indirect lighting.

[0027] In one embodiment, the flash unit (s) is / are angled on the patient's skin to generate a gradient across the skin surface. In an additional modality, the flash units are mounted higher than the patient's skin area and are aimed at that area of the skin, in order to give a light gradient on the skin, from top to bottom. In one embodiment, the angle of the flash units is about 5 to about 30 degrees, such as about 10 degrees, from the horizontal. This gradient visually intensifies various skin characteristics such as fine lines and wrinkles in the patient, for example, crow's feet around the eye and wrinkles in the forehead or mouth area.

PHOTOGRAPHY WITH POLARIZED LIGHT [0028] In one embodiment, the method includes the step of taking a polarized photograph of the patient. What is meant by polarized photography is a photograph of the patient taken (i) with a light source that emits light through a polarizing filter and / or (ii) through a polarized filter that filters light before or after entering on the camera lens.

[0029] In one embodiment, the camera and one or more flash units, preferably two, are in about the same plane as the patient's skin to be photographed, and the flash units are placed so that the angle formed by each flash unit, the patient's skin, and the camera is about 35 to 55 degrees, such as 45

Petition 870180007592, of 01/29/2018, p. 11/56

8/39 degrees. In one embodiment, a polarization filter is placed in front of each flash unit. What is meant by a polarizing filter is a filter that filters out incoming light to emit substantially only polarized light. What is meant by the term substantially, as used herein, is at least 75 percent, preferably 90 percent, and more preferably at least 95 percent.

[0030] Examples of a polarization filter include, but are not limited to, polarization plates, such as those by Edmund Scientific (Barrington, HJ USA), polarization prisms, such as Glan Thonson polarization prisms, or a reflector polarization that reflects light around the Brewster angle. Polarization filters can be linear or circular polarization filters. In an additional embodiment, a light diffuser is placed between the flash unit and the polarization filter.

[0031] In one embodiment, a linear polarization filter is used in the light source and the linear polarization filter is arranged so that the electric field of the emitted light is more or less perpendicular to the plane formed by the light source, the skin of the person and the camera. In another embodiment, a linear polarization filter is used in the light source and the linear polarization filter is arranged so that the electric field of the emitted light is more or less parallel to the plane formed by the light source, the person's skin. , and the camera.

[0032] In an additional mode, the flash unit (s) is / are positioned in a horizontal plane with the camera and the patient's skin and the polarization filter is a linear polarization filter oriented so that the electric field of the transmitted light is in the vertical direction (for example, perpendicular to the plane). In this orientation, the critical angle for total internal reflection from inside the top corneocytes is 45 degrees, thus resulting in an image that is dominated by the light, therefore, reflected from the corneocytes. THE

Petition 870180007592, of 01/29/2018, p. 12/56

9/39 The resulting image has a high degree of glare, which is further enhanced when an optical coupling medium, such as tallow or oils, is present on the surface of the corneocytes. The polarized image, thus, allows an estimate to be made, for example, for the oiliness of the patient's skin. It also provides information on the number and severity of pores in the cheek and forehead areas of the facial skin. Other desired results of polarized photography include, but are not limited to, an enhanced image of surface features such as fine lines, skin texture, scales and down.

[0033] In another embodiment, the unit (s) is / are positioned in a vertical plane above the camera and the patient's skin so that the angle formed by the flash unit, the patient's skin , and the camera is about 35 to 55 degrees more or less about 45 degrees and the flash unit (s) is / are filtered with a linear polarization filter that is placed with the electric field transmitted in the vertical direction (for example, parallel to the plane). In this arrangement, the glare of the skin surface is minimized, thereby intensifying the subsurface characteristics of the skin, such as erythema (redness), blood vessels, and pigmentation.

[0034] Polarized light sources in both planes, horizontal and vertical, with the camera and the patient's skin, can be used to intensify specific aspects of the skin (for example, the face) that are partially shaded with the use of sources of polarized light only in the horizontal or vertical planes alone.

[0035] In one embodiment, the patient's photograph is taken either with a light source that emits light through a polarization filter or through a polarization filter that filters the light before or after entering the camera lens. When the polarization filters are in the same orientation with each other (for example, both

Petition 870180007592, of 01/29/2018, p. 13/56

10/39 horizontal or both vertical), the surface characteristics of the skin, such as scales, wrinkles, fine lines, pores, and hair are visually enhanced. When the polarization filters are aligned perpendicular to each other (for example, a horizontal and a vertical), the characteristics of the skin's subsurface, such as erythema, pigmentation, blood vessels, and hair, are visually enhanced.

ULTRAVIOLET PHOTOGRAPHY [0036] In one embodiment, the method includes the step of taking an ultraviolet photograph of the patient. What is meant by ultraviolet photography is a photograph of the patient taken (i) with a light source that either emits substantially only ultraviolet light (radiation) or emits light through an ultraviolet filter and / or (ii) through an ultraviolet filter which filters the light before or after entering the camera lens. What is meant by an ultraviolet filter is a filter that filters incoming light to emit substantially only ultraviolet light (for example, light that has a wavelength of about 200 to about 400 nm). Examples of light sources that can emit substantially only ultraviolet light are light-emitting diodes. Examples of ultraviolet photography include, but are not limited to, ultraviolet A photography or ultraviolet photography B. ULTRAVIOLET PHOTOGRAPHY A [0037] In one embodiment, the method includes the step of taking an ultraviolet photograph of the patient. What is meant by ultraviolet photography A is a photograph of the patient taken (i) with a light source that both emits substantially only ultraviolet light A and emits light through an ultraviolet filter A and / or (ii) through an ultraviolet filter which filters the light before or after entering the camera lens.

[0038] In one modality, one or more, preferably two,

Petition 870180007592, of 01/29/2018, p. 14/56

11/39 flash units are filtered with an ultraviolet A filter (UVA filter). What is meant by a UVA filter is a filter that filters out incoming light to emit substantially only light that has a wavelength of about 320 to about 400 nm. Examples of UVA filters include, but are not limited to, the UG-11 ultraviolet filter (Schott Glass Technologies, Duryea, Pennsylvania, USA). The resulting image may be rich in red because of the long wavelength pass of the UVA filter. In one mode, when using a digital camera, any blue or green channel, preferably the blue channel, of the RGB image is selected for viewing, resulting in a black and white image.

[0039] The benefits of an ultraviolet A photograph include, but are not limited to, enhanced appearance of pigmented macules on the skin and surface features such as bumps and wrinkles. An ultraviolet A photograph can be used to determine the uniformity of application of topical products, such as sunscreens and makeup, which contain materials that absorb ultraviolet radiation. In addition, since melanin pigmentation absorbs UVA radiation more intensely than visible light, illuminating the skin with UVA radiation gives an enhanced contrast between normal skin and hyperpigmented skin. Furthermore, pigmented macules are visualized as dark spots on a light background due to the dispersion and fluorescence of the dermal collagen matrix. The image recorded by the camera includes both the reflection of ultraviolet A radiation and the fluorescence of collagen. The resulting black and white image, obtained through the blue or green channel of a digital camera, provides an enhanced view of the distribution of pigmented macules on the skin (for example, on the face). For patients with deeply pigmented skin, the red channel can be selected.

[0040] In another mode, the flash units are additPetition 870180007592, from 29/01/2018, p. 15/56

12/39 onally filtered with a red block filter. Examples of such a red block filter include, but are not limited to, a KG-5 filter (Schott Glass Technologies). Such filters can assist in correcting the red appearance of the image.

BLUE FLUORESCENCE PHOTOGRAPHY [0041] In one embodiment, the method includes the step of taking a blue fluorescence photograph of the patient. What is meant by blue fluorescence photography is a photograph of the patient taken with a light source that emits substantially only blue light or emits light through a blue filter. What is meant by blue light is light that has a wavelength of about 380 to about 430 nm.

[0042] In one embodiment, one or more, preferably two, flash units are filtered with a blue filter. What is meant by a blue filter is a filter that filters out incoming light to emit substantially only blue light. Examples of such blue filters include, but are not limited to, interference filters such as those available from Melles Griot (Irvine, CA USA) or dielectric filters.

[0043] In one embodiment, the light that enters the camera is also filtered (for example, before or after entering the camera lens) with a long-pass filter to substantially eliminate light that has a wavelength below about 400 nm. Examples of long - pass filters include, but are not limited to, XL-420 or XL-440 filter (Schott Glass Technologies) and Kodak Wratten No. 8 (Eastman Kodak, Rochester, NY USA). In one embodiment, the flash units and filters are placed on either side of the camera in approximately the same horizontal plane as the patient's skin sample.

[0044] This type of photography produces clear images of the distribution of coproporphyrin produced by the bacterium of p. acnes and horns.

Petition 870180007592, of 01/29/2018, p. 16/56

13/39

What is meant by a horn is a mixture of sebaceous lipids, keratinocytes and possibly sebocytes impacted on open comedones and blackheads on the skin. By using substantially only blue light that is within the Soret porphyrin absorption band, the fluorescence emission of coproporphyrin is maximized. The excitation in this range also produces clear emission images of the horn distribution because the fluorescence production of the horns is greater when excited in the blue region of the spectrum.

[0045] In one embodiment, when using a digital camera, the color image can be seen showing the distribution of coproporphyrin and, therefore, the sites of maximum p concentration. acnes, which appear red in the image. The image also contains light white dots, which correspond to the blocked pores or open comedones. In another embodiment, the green channel of the RGB image is selected to enhance the fluorescence emission of the horn and the red channel can be selected to enhance the fluorescence emission of p porphyrins. acnes. The resulting black and white images therefore provide excellent imaging of small vessels because hemoglobin has its Soret band in the same wavelength range as porphyrins. In one embodiment, these vessels are viewed using both the blue and green channels of the RGB image.

PROMOTION OF SKIN CARE PRODUCTS [0046] Upon acquisition of photographs, these images are presented to the patient. The way of presenting the photographs depends in part on the type of photograph taken (for example, using standard film, instant development film, or a digital image). When using standard film or instant development film, prints of the images are provided to the patient. Impressions can also be scanned and presented to the patient

Petition 870180007592, of 01/29/2018, p. 17/56

14/39 on a computer monitor (for example, an LCD or CRT monitor). When using a digital camera, the image can also be displayed on such a monitor.

[0047] Following the presentation of the images to the patient, skin care products can be suggested to the person based on the examination of his / her images. In one embodiment, the method involves presenting the patient with one or more questions regarding the images presented. Based on the answers to such questions, one or more skin care products can be suggested to the patient. These products can be associated with responses to the questionnaire, made by a person examining the patient's responses, or made by a computer based on the patient's responses. Examination of the various images by the patient facilitates answers with more information to the questions.

[0048] In one embodiment, the suggestions for skin care products are made by a computer program that recommends products based on the answers provided by the patient. In one embodiment, a list of skin care products is maintained in a relational database. These products are associated with answers to the right questions. Therefore, based on the responses provided by the patient, the right products are selected by the computer program. For example, if the patient responds that he / she has wrinkles, the computer program will search, based on the data, for skin care products that are effective for treating wrinkles (for example, products containing retinol) and / or if the patient responds If he / she has acne, the computer program will search the database of effective skin care products to treat acne (for example, products containing benzoyl peroxide or salicylic acid).

[0049] In one embodiment, these suggestions are limited to one

Petition 870180007592, of 01/29/2018, p. 18/56

15/39 number of products, for example, the program will not recommend more than five products. In such a case, the computer program will prioritize suggestions for skin care products based both on the importance of the skin disorders identified by the patient and on the classification of the importance database of the skin disorder to be addressed. For example, if the patient replies that he / she has severe acne and moderate fine lines, the computer program will recommend acne product (s).

[0050] In one embodiment, the following application of a skin care product (for example, one suggested by the present method) for a period of time (for example, a week, a month, or a year), the patient is then photographed again. These new photographs are compared to the original photographs to determine the effectiveness of the skin care product.

[0051] In one mode, the recommended products may be available at the location where the photographs are taken, for example, the photographs are taken at a store or kiosk that sells skin care products.

SKIN CARE PRODUCT [0052] Following the patient's visual analysis of the images, the skin care product (s) can be suggested to the patient to address any perceived problems identified following such analysis.

[0053] What is meant by a skin care product is a topical composition comprising a cosmetically active agent. What is meant by a cosmetically active agent is a compound (for example, a synthetic compound or a compound isolated from a natural source) that has a cosmetic or therapeutic effect on the skin, including, but not limited to, anti-aging agents, lighting, darkening agents such as self-tanning agents Petition 870180007592, of 29/01/2018, p. 19/56

16/39 res, anti-acne agents, gloss control agents, antimicrobial agents, anti-inflammatory agents, antimycotic agents, antiparasitic agents, sunscreens, such as UVA / UVB blocking agents or absorption agents, photo-protectors, antioxidants, agents keratolytics, detergents / surfactants, astringents, moisturizers, nutrients, amino acids, amino acid derivatives, minerals, plant extracts, animal derived substances, vitamins, energy intensifiers, antiperspirant agents, deodorants, hair removers, hair growth stimulating agents , hair growth retarding agents, firming agents, anticalosity agents, and agents for nail and / or skin conditioning.

[0054] In one embodiment, the cosmetically active agent is selected from, but not limited to, the group consisting of hydroxy acids, benzoyl peroxide, resorcinol sulfur, ascorbic acid, Dpantenol, hydroquinone, octyl methoxycinnamate, titanium dioxide, salicylate octyl, homosalate, avobenzone, polyphenols, carotenoids, free radical scavengers, retinoids, such as retinoic acid, retinol, and retinyl palmitate, ceramides, polyunsaturated fatty acids, essential fatty acids, enzymes, enzyme inhibitors, minerals, hormones, such such as estrogens, steroids, such as hydrocortisone, 2-dimethylaminoethanol, copper salts, such as copper chloride, copper-containing peptides, such as Cu: Gly-His-Lys, coenzyme Q10, lipoic acid, amino acids such as proline and tyrosine, vitamins, lactobionic acid, acetyl coenzyme A, niacin, riboflavin, thiamine, ribose, electron transporters such as NADH and FADH2, and other botanical extracts, such as aloe vera, witch hazel, and vegetables, such as soy beans, and derivatives and mixtures thereof. The cosmetically active agent will typically be active in the composition of the invention in an amount of about 0.001% to about 20% by weight of the composition 870180007592, from 29/01/2018, pg. 20/56

17/39 tion, for example, about 0.01% to about 10%, for example, about 0.1% to about 5%.

[0055] Examples of vitamins include, but are not limited to, vitamin A, vitamin Bs such as vitamin B3, vitamin B5, and vitamin B12, vitamin C, vitamin K, and vitamin E and its derivatives.

[0056] Examples of hydroxy acids include, but are not limited to, glycolic acid, lactic acid, malic acid, salicylic acid, citric acid, and tartaric acid.

[0057] Examples of antioxidants include, but are not limited to, water-soluble antioxidants, such as sulfhydryl compounds and their derivatives (eg, sodium metabisulfite and N-acetylcysteine), lipoic acid and dihydrolipoic acid, resveratrol, lactoferrin, glutathione, and ascorbic acid and ascorbic acid derivatives (eg, ascorbyl palmitate and ascorbyl polypeptide). Oil-soluble antioxidants suitable for use in the compositions of this invention include, but are not limited to, butylated hydroxytoluene, retinoids (e.g., retinol and retinyl palmitate), tocopherols (e.g., tocopherol acetate), tocotrienols, and ubiquinone. Natural extracts containing antioxidants suitable for use in the compositions of this invention include, but are not limited to, extracts containing flavonoids and isoflavone in their derivatives (eg, genistein and diadzepine), extracts containing resveratrol and the like. Examples of such natural extracts include grape seed, green tea, pine bark, and propolis.

[0058] Various other cosmetically active agents can also be present in skin care products. These include, but are not limited to, skin protectors, humectants and emollients. Skin care products may also comprise chelating agents (for example, EDTA), preservatives (for example, parabens), pigments, dyes, opacifiers (for example,

Petition 870180007592, of 01/29/2018, p. 21/56

18/39 titanium), and fragrances.

[0059] The following is an example of a way to practice a method of the present invention. Other ways can be practiced by those skilled in the art.

EXAMPLE [0060] One embodiment of the present invention uses a kiosk which is intended to be an interactive tool from which patients (for example, potential customers) can evaluate their facial skin and decide on a course of action to improve the appearance of the skin. The kiosk is designed so that a patient has a series of images acquired from his face and the images will be presented to him one at a time along with the questions regarding the images shown.

[0061] In an example of the present invention, the kiosk comprises apparatus 100, as set out in Figure 1 (not to scale). Apparatus 100 is wrapped above and on all three sides (the side containing chin rest 6 open for the patient to insert his head) with a frozen plastic glass (not shown). The apparatus 100, which is capable of taking four types of photographs of the patient, is fitted on a frame 15 having dimensions of 76.2 cm (30) by 91.44 cm (36). Halfway down the long dimension of frame 15 (about 45.72 cm (18) from one end) and about 4.12 cm (15/8) from the front end of frame 15 there is a chin rest 6 to the patient's chin. The height of the chin rest 6 is about 30.48 cm (12) above frame 15. Through the chin rest 6 and exactly halfway along the opposite end of frame 15 is camera 11 (Nikon D1X ). Camera 11 is mounted so that the center of the camera 11 camera lens is about 43.18 cm (17) above the top of frame 15. The distance between the chin rest 6 and the extremity 870180007592, of 29 / 01/2018, p. 22/56

19/39 front lens of the camera lens 11 is adjusted so that the patient's face substantially fills the camera's camera structure

11.

[0062] On the side of the frame 15 away from the chin rest 6 are the flash units 30a, 30b, 40a, 40b, 50a, and 50b (Picolites Broncolor, Sinar Bron, Allschwil, Switzerland) which are energized, respectively, by power supplies 92, 92, 93, 93, 91, and 91. The standard flash units 50a and 50b, which are used to take a standard photograph, are mounted above camera 10 and angled down by 20 degrees. Flash units 50a and 50b are directed towards the center of the patient's face. The diffusion filters 51a and 51b (Diffuser Broncolor, Sinar Bron) are placed, respectively, in front of the flash units 50a and 50b.

[0063] UVA flash units 30a and 30b, which are used for ultraviolet photography A, are mounted on either side of the camera 11 at about 35.56 cm (14) from the edge of the frame 15 and at a height of about 50.80 cm (20) from the top of the frame 15. The UVA filters 31a and 31b (UG-11 filters, Schott Glass Technologies, Duryea, Pennsylvania USA) are placed, respectively, in front of the UVA flash units 30a and 30b. The blue flash units 40a and 40b, which are used for blue fluorescence photography, are also mounted on either side of the camera at about 35.56 cm (14) from the top edge of the frame at a height of around 33, 02 cm (13) from the top of the frame 15. The blue filters 41a and 41b (Melles Griot, Irvine, California USA) are placed, respectively, in front of the blue flash units 40a and 40b. UVA flash units 30a and 30b and blue flash units 40a and 40b are directed towards the center of the patient's face.

[0064] The polarized flash units 20a and 20b (Picolites Broncolor), which are used for polarized light photography, are energizedPetition 870180007592, of 29/01/2018, p. 23/56

20/39 by the power supply 90. The diffusion filters 21a and 21b (Diffuser Broncolor, Sinar Bron) are placed, respectively, in front of the polarized flash units 20a and 20b, respectively. The linear polarization filters 22a and 22b (Edmund Scientific, Barrington, New Jersey USA) are placed, respectively, in front of the diffusion filters 21a and 21b in a vertical orientation. The polarized flash unit 20a is positioned about 11.43 cm (4/1/2) from the left edge and about 35.56 cm (14) in front of the proximal edge of frame 15 and the polarized flash unit 20b is positioned about 11.43 cm (4/1/2) from the right edge and about 35.56 (14) in front of the proximal edge of frame 15. The angle between any of the flash units 20a or 20b, the chin rest 6 and camera 11 is about 45 degrees.

[0065] The method begins when the patient enters the image acquisition area of the kiosk and introduces basic demographic information into a facial skin assessment computer program (Microsoft Visual Basic, Microsoft Corporation, Redmond, WA USA) using a touch screen monitor 70 (SecurePoint, SecurePoint Technologies, Torrance, CA), which is mounted under frame 15 and connected to the same computer operating the computer program. The patient enters data into the computer program via monitor 70 (the computer program runs the MountFocus Runtime Keyboard and the keyboard present on monitor 70 was designed using programs from the MountFocus Keyboard planner (MountFocus Information Systems, Wilmington, DE USA)), at However, another input device, such as a keyboard, a sphere of travel, and a computer mouse can be used. Examples of such information include, but are not limited to, the patient's age and gender. Following the entry of such demographic information, the computer program then instructs the patient to place his chin on the

Petition 870180007592, of 01/29/2018, p. 24/56

21/39 chin 6 and tells the patient to close his eyes once the device 100 is ready to take pictures.

[0066] On the touch screen monitor 70, the software makes a function call for image acquisition and shows the software (IDL software; IDL, Research Systems, Inc., Boulder, CO) operating on the same computer. The IDL software then fires camera 11 to acquire a blue fluorescence photograph, a standard photograph, a polarized photograph, and an ultraviolet photograph A. The flash units 40a, 40b, 50a, 50b, 20a, 20b, 30a and 30b are fired sequentially using a radio transmitter (Pocket Wizard Multimax, LPA Design, South Burlington, VT USA) using transmitters 95 (attached to power supply 90 and operating in receiver mode), 96 (attached to power supply 96 and operating in receiver mode), 97 (attached to power supply 92 and operating in receiver mode), 98 (attached to power supply 93 and operating in receiver mode), and 99 (attached to camera shoe 11 and operating in transmitter mode ). A Topas A2 power supply (Sinar Bron) is used for power supplies 90 and 91 and a Primo 4 power supply (Sinar Bron) is used for power supplies 92 and 93. The radio transmitter causes the pairs of flash units in response to release the camera shutter 11.

[0067] Before taking the blue fluorescence photograph, the IDL software makes a call to servo motor 80, using a Mini SSC II circuit board (Scott Edwards Electronics, Sierra Vista, AZ USA), to move the filter. long passage 81 (Kodak Wratten No. 8, Eastman Kodak, Rochester, NY USA) in front of the camera lens 11. After this movement, the blue fluorescence photograph is taken. After taking this photograph, the IDL software then makes another call to the servo motor 80 to move the long-pass filter 81 away from the camera lens 11. The IDL software then instructs camera 870180007592, from 01/29 / 2018, p. 25/56

22/39 mere to take the remaining three images. The device 100 is able to acquire these four images in about 10 seconds camera.

[0068] At this point, just the four acquired images are stored in the memory of camera 11 as separate data files. The IDL software then performs the call function for these data files and requests that these files be transferred to the computer operating the computer's software and be saved on your hard drive with a file name that indicates the device used, the patient identifier, and the type of image.

[0069] The patient is then presented on monitor 70 with a registration form. Examples of such questions include email addresses, places where they buy skin care products, ethnic background, and the amount and type of skin care products they have purchased in the past (for example, last year).

[0070] The patient then begins to examine each of the four images on monitor 70 and answers the questions, presented on monitor 70, about each image. The computer program calls the IDL software and requests that a particular saved image be loaded from the hard drive and resized to fit the monitor area of the screen. Once the image is displayed, the IDL software then returns control to the computer's program. The monitor area of the facial image is about half of monitor 70. The other half of the screen of monitor 70 shows a series of questions related to the particular image shown. To assist the patient in examining his images, the computer program can also display 70 images of another person on the monitor as comparisons.

[0071] As the patient proceeds to the next page, the computer program calls the IDL program and requests that a particular saved image be loaded from the hard drive and resized to fit the screen area of the monitor 70 as discussed above.

Petition 870180007592, of 01/29/2018, p. 26/56

23/39

This procedure continues until all four images have been shown and all questions have been answered by the patient. [0072] Examining the standard photograph, the patient is then presented with questions regarding the surface of his skin. Examples of such questions include, but are not limited to, whether it has any fine lines, wrinkles, loss of elasticity or firmness, large visible pores, sensitive skin, rough or soft skin, as well as the severity and location of such conditions. Other questions include, but are not limited to, the frequency and severity of irritation of skin care products.

[0073] Examining the polarized photograph, the patient is asked questions regarding the oiliness of his skin. Examples of such issues include, but are not limited to, whether he has normal, dry, oily skin, or selective oily skin (for example, oily in certain areas, such as above the eyebrows and on the tip of the nose). [0074] Examining ultraviolet A photography, the patient is asked questions regarding the visualization of face pigmentation (for example, brown spots). Examples of such issues include, but are not limited to, the amount and location of such pigmented spots.

[0075] Examining the blue fluorescence photograph, the patient is asked questions regarding acne. Examples of such issues include, but are not limited to, the severity and frequency of their damage.

[0076] As described above, images from camera 11 are shown on computer monitor 70. However, because the number of available pixels on the screen is less than the number of actual pixels in the image taken by digital photography, only one small percentage of the original image can actually be shown if the image is to be shown on the screen in its entirety although manPetição 870180007592, from 29/01/2018, p. 27/56

24/39 having an aspect ratio. For the case of the Nikon D1X, which stores 6 million pixels per image, showing the digital image in a portrait orientation on a computer screen that has a resolution of 1024 x 768 results in showing only 1 of every 18 pixels. In such a downloaded image sample presentation, fine details of the skin taken by the camera 11 are not fully shown.

[0077] The solution to this problem is to use a technique whereby a 256 x 256 box (Kernel monitor) appears directly over the area of interest and shows all the pixels of the image actually acquired by camera 11 for that area. The effect is a magnification at the location of a small area of the image on monitor 70. The apparent magnification, shown as this Kernel monitor, can be passed through various areas of the image selected by the patient. Therefore, this is an example of a 1: 1 image monitor (where each pixel of the image is shown on the screen inside a small Kernel monitor). True image magnification can also be achieved by interpolating the data between pixels and creating additional pixels, thereby providing magnification of selected areas of the image. The patient selects the magnification of such an area by touching the area of interest shown on monitor 70.

[0078] Following the input of the patient's responses, the computer program then proceeds to suggest skin care products for the patient. Each question in the computer program is associated with a skin condition. For example, the question How many times has your skin been damaged? it is associated with acne. As the patient answers each question, the condition of the corresponding skin is designated a grade. For example, the acne question has four grades corresponding to the four answer choices: Always, Weekly, Monthly and Never.

[0079] After the patient has answered all the questions, the

Petition 870180007592, of 01/29/2018, p. 28/56

25/39 skin conditions questioned by the computer program are classified according to severity. This classification is obtained by passing all the degree values introduced by the patient to a procedure stored in the relational database contained within a relational database (Microsoft SQL, Microsoft Corporation, Redmond, WA USA) that is on the same computer.

[0080] A database table contained with the relational database contains a record of each type of skin problem and degree. A grade weight is assigned to each record, which facilitates the classification of skin conditions. For example, if the patient always answers the above question about acne, and Yes to the question Did you notice any loss of firmness on your face? the condition of the skin with acne may have a higher rating than the loss of firmness condition. However, if the patient answers Weekly to the above question about acne and Yes to the loss of firmness question, the loss of firmness condition can be rated higher.

[0081] After the conditions are classified, the top three conditions, along with the patient's skin type, for example, normal, dry, or oily, are passed on to another procedure stored in the relational database contained within the relational database. Using these values, this procedure queries a second database table that contains all possible combinations with the skin type. Each such record in the table contains a list of recommended products based on these values. This corresponding list of recommended products for that patient's condition is then passed back to the computer program.

[0082] Finally, the computer program creates a copy using Crystal Reports (Seagate Corporation, Scotts Valley, CA USA)

Petition 870180007592, of 01/29/2018, p. 29/56

26/39 for the patient including the suggested skin care products and photographs of the patient with information on the various skin conditions. Upon completion of the computer program, the patient will indicate whether or not the images should be maintained or deleted.

[0083] Figures 2 and 3 show an alternative embodiment of the present invention where the imaging station 200 is provided in the form of a cabinet unit with a central housing 202 flanked by a pair of hingedly connected door mounts 204a, 204b . Door mounts 204a, 204b can be opened and closed with respect to central housing 202. Figure 3 shows that the angle between door mounts 204a, 204b and central housing 202 can be adapted to adjust the light mold angle incident to patients via flash units mounted to door mounts 204a, 204b. The angular orientation α1, α2 of door mounts 204a, 204b with respect to central housing 202 results in light L1, L2 emanating from flash units 220a and 220b, respectively, having an incidence angle of β1 and β2, with respect to the patient S. As noted above, the angle of incidence of light illuminating a patient S, can be selected to assist in capturing images that are more evidence of the condition of the skin, for example, when capturing polarized light images.

[0084] Angles α1, α2 can be controlled by a conventional device, such as an adjustable pivot clamp, with threaded stop or provided with grooves cooperating with a limit pin, as they are commonly known to control the extent of opening of doors and covers articulated assembled. In this way, an optimum angle for one or both door assemblies 204a, 204b is repeatable.

[0085] The embodiment of the present invention shown in Figure 2

Petition 870180007592, of 01/29/2018, p. 30/56

27/39 shares many features of the kiosk modality previously described and includes a camera 211 (preferably digital) placed within a niche of camera 212 to capture images of a patient S. As noted above with respect to the kiosk mode, a number different lighting lights (flashes) are available to capture images. More particularly, the imaging station 200 has fluorescent lights 217a, 217b, polarized flashes 220a and 220b, a pair of UVA flashes 230a and 230b having a wavelength of, for example, 405 nanometers. A pair of flashes 240a, 240b having a wavelength of, for example, 385 nanometers is positioned below flashes 230a and 230b of 405 nanometers. Flashes 230a, 230b and 220a, 220b can optionally be operated in conjunction with filters 281a, 281b which can be rotated in front of the camera lens by solenoids 280a, 280b to additionally select the wavelengths of light received by the camera 211. For example, a yellow filter 281a can be rotated in front of the camera 211 through solenoid 280b when taking pictures with the 405 nanometer flashes 230a, 230b. A polarizing filter 281b can be used in conjunction with polarized flashes 220a, 220b.

[0086] Various combinations of light (s) for illumination and filter (s) can be used to capture the image. The present invention is not limited to the number and arrangement of the flashes and filters shown. More particularly, a greater or lesser number of filters and flashes can be employed, for example, see Figure 9. Although rotating filters 281a, 281b are described above, non-moving filters can be placed over one or more flashes to control the lengths of light that are used to capture an image. Multiple pattern flashes can be used in conjunction with a variety of filters to achieve illumination over a variety of lengths

Petition 870180007592, of 01/29/2018, p. 31/56

28/39 light wave. Combinations of flashes can be simultaneously activated to acquire a single image or sequentially to acquire multiple sequential images. It should be noted that the use of multiple flashes with different filter options may be preferable under certain circumstances rather than using a mobile filter. That is, by simplifying the imaging station 200 and reducing the number of moving parts, the imaging station 200 can be made cheaper and work with more confidence.

[0087] A monitor with a touch screen 270 is placed below the camera 211 and shows the photographic images recently obtained by the camera 211 and / or previously obtained images that reside in the memory or in a storage device, such as a computer disk or a memory stick. A speaker 218 is provided at the imaging station 200 to announce instructions to the user (patient S). The 218 loudspeaker is particularly useful for instructing patients when their eyes are closed, for example, just before, during and immediately after a photo shoot, when the flashes are activated to capture images of the patient's face.

[0088] Figure 4 shows an enlarged view of monitor 270 which is preferably a touch screen monitor allowing to simultaneously display information and the processing of control inputs from the operator / user / patient S, who touches the screen to select control options . In this way, the operator can control the images shown for examination and study for the purposes of diagnosing and assessing the condition of the skin. On the left side of monitor monitor 270 a plurality of thumbnail images from 224a to 224e can be shown. The first miniature image 224a can be used to display (both in miniature and enlarged format) a real-time moving image captured by the camera

Petition 870180007592, of 01/29/2018, p. 32/56

29/39

211 in video mode that allows the user to interactively examine and position their face in front of the camera to center and focus and optimally capture their facial image. The real-time image is therefore in some ways like a mirror. To initiate an imaging training session, a computer program can be used to inform the user, both through visually displayed instructions and audible instructions, to position his face so that it substantially fills the structure of the monitor and is centered there. .

[0089] The remaining thumbnail images from 224b to 224e can be used to show images that were captured during an image training session using different wavelengths of illumination light. As described above with respect to the kiosk mode, the imaging station 200 preferably takes a sequence of images using different wavelengths of light, via different flashes and filters, etc., in order to capture images that reveal different attributes of the patient's skin. Selecting one of the thumbnail images from 224b to 224 and touching it will cause the particular image to be displayed in the main monitor area 225 on a larger scale. Optionally, the 224a-224e thumbnail images can be labeled with text indicating the type of image that is, for example, Blue Light or White Light and / or the time and date when taken. Selecting a thumbnail image of a particular type can invoke instructions and observations from the computer at the imaging station 200 that reports for that particular type of image. For example, the computer program can announce that a particular type of image has been selected and provide hints of what is shown is shown by that type of image - You have selected a blue light image. This type of image is particularly useful for assessing the condition (s) X, Y, Z. FaPetição 870180007592, from 29/01/2018, p. 33/56

30/39 When evaluating this, look at A, B, C in the image, which are indicative of D, E, F .... This type of message can be distributed in text on the monitor and / or in audio form over the top - speaker 218. The distribution of this type of message is preferably made possible / made impossible by means of operator control, for example, by the touch of a control button, Instructional Message Enables / Impossits or an equivalent control device. In the aforementioned highlights, to efficiently employ the image formation station 200, the observer of the captured image is preferably versed in the technique of observing and interpreting apparent characteristics in the captured images. Information pertinent to efficiently using the imaging station 200 can be communicated to the user / patient S by the message perceived above, but also through the written and / or recorded materials provided with the imaging station 200 (for example, on CD ROM or video). In the event that the imaging station is connected to the Internet, information can be provided to the user / patient S interactively by retrieving information from a website and presenting it to the user / patient S at the appropriate times or presenting hypertexts that the user / patient can activate based on interest. By inspecting the main image area 225, the user can verify the presence or absence of certain skin conditions revealed by the particular light that was used to capture the image. Miniature images, therefore, provide an intuitive and transparent device for identifying and examining a plurality of images taken during an image training session. While the imaging method described above suggests that multiple images are captured through multiple sequential exposures of a static S patient with different wavelengths of light, the present invention 870180007592, of 29/01/2018, p. 34/56

31/39 tion can also be used to take one or more pictures after patient S has changed his position. For example, a series of polarized images can be captured with the patient being instructed to rotate his face from the left silhouette, to a forward facing position, to a right silhouette position, or in varying degrees of looking up, down and straight forward. While the present invention is very useful for examining the face, images of other surfaces on the body can also be captured, recorded and analyzed. For example, the state and progress of a burn, abrasion, rash, melanoma, sign or other condition of the skin on any part of the body can be observed and analyzed using the present invention.

[0090] In the upper right portion of the monitor of monitor 270, a plurality of virtual control buttons 228a-228c is shown and in the lower right portion, control buttons 228d-228f are shown. Control button 228a controls fluorescent lighting 217a, 217b (on / off and / or dim / light), which illuminates patient S in a darkened room and allows patient S to position his face before the camera (as shown in thumbnail 224a). (In order to control the wavelengths of light in the images that are taken, it is preferable to have the ambient lighting reduced, for example, due to the lighting of the room). By examining images taken at different times, a user can compare the progress of his skin's condition over time. Preferably, the imaging station 200 allows the selection of a plurality of images to be displayed, for example, two or three, on a large scale, juxtaposed next to each other. This allows side-by-side comparison to observe trends in the condition of the image over time or to compare images taken under different lighting conditions, for example, comparing an image with polarized light

Petition 870180007592, of 01/29/2018, p. 35/56

32/39 for an image with white light. The 228c control button can be used to start a photo shoot after the user has positioned himself correctly before the 211. camera. An access prompt can be provided by instructing the user / patient S to press the 228c control button after he has setted up.

[0091] An enlarged monitor area 227 (magnified kernel) shows a portion of the main image area 225 at a higher magnification level. The portion that is magnified is determined by the focus box 226, which is superimposed on the image shown in the main image area 225. The purpose of the enlarged monitor area 227 is to focus on a specific area of the image shown in the main image area 225 for closer examination, at a higher magnification. In this way, the user can position the focus box 226 over any area of the image shown in the monitor area 225, touch the monitor / screen 270 in the area bounded by the focus box 226 and drag the focus box 226 to the area of interest in the image in the main image area 225. The corresponding portion of the image limited by the focus box 226 is then shown in the enlarged monitor area 227. The image portion shown in the enlarged monitor area 227 can then be further enlarged or reduced (zoom in) zoom in and out) using the control buttons 228d and 228e (+ indicating zoom in for greater magnification and - indicating zoom out for lower magnification). The enlarged monitor area 227 can also be cleared by the touch control button 228f.

[0092] As noted above, the comparison of images side by side can sometimes be instructive. This comparison process using, for example, a pair of images side by side of a person's face taken under the same lighting conditions, but at different times or at the same time, but using different lighting 870180007592, from 29/01 / 2018, p. 36/56

33/39 mining, can be further enhanced by performing zoom and focus functions on one or both images. One mode involves coordinated or synchronized focusing and approximation. More particularly, when examining a pair of images, the graphical focus box that appears in each image may be located in the same place on each image (for example, at the tip of the nose). When the focus box is moved on one of the images, an equal shift of the focus box on the other image is performed. For example, if the focus box on both images is on the tip of the nose and the user / patient S moves the focus box on one of the images to the eye area, then the focus box on the other image moves to the eye area as well. The approximation can also be coordinated in the same way, so that when the images are compared side by side, the area of focus and magnification are the same, promoting comparison.

[0093] Figure 5 shows exemplary processing steps that an exemplary embodiment of the present invention would use in obtaining and examining images of a patient S. The processing flow begins 300 by the operator entering an access code or an I.D password. 302. This is an optional step in the event that the imaging station 200 is used by more than one person. For example, if the imaging station was a public facility, individuals who use it would prefer that their images remain private and accessible only to them by entering an appropriate password / access code. In the event that the imaging station 200 is a private facility, for example, located in the user's home, then it would not be necessary for a password to be used.

[0094] At the beginning of the session, 304 is determined whether the purpose of the section is to obtain new images or to examine old images. That

Petition 870180007592, of 01/29/2018, p. 37/56

34/39 can be implemented simply by detecting on the control buttons 228b and 228c that provides the user with these options. If the user chooses to take new images, for example, by touching the control button 228c, the imaging station 200 provides instructions for patient S to position and prepare to capture the 306 images. For example, the patient can be instructed to access the camera so that its face fills the field of view as shown in thumbnail 224a. Once positioned, the patient is instructed to turn off the fluorescent lights and / or close their eyes to prevent the flashes from being seen. Once patient S indicates a ready state, for example, by pressing a button, for example, 228c to take pictures or by the system to detect that patient S has turned off the fluorescent lights, the adjusted image can be captured 308 by taking pictures sequentially using different flashes and filters. The images are then prepared to be displayed and downloaded 310 to the computer of the imaging station 200. Once the images have been captured and downloaded to the system computer, the images can be displayed 312 on the monitor 270 and the operator is provided with various control options. When the operator has finished 314 examining the images, the operation is at the end 316, otherwise the user can additionally obtain new images or examine old images.

[0095] Figures 6 and 7 show the basic process shown in Figure 5, in greater detail, that is, the step of positioning and preparing 306 to capture images includes energizing 318 the fluorescent lights, energizing 320 the flash charger and display 322 the output of the video camera on monitor 270 in such a way that patient S can adjust his position in relation to camera 322. As described above, this image is shown in miniature 224a or elsewhere as determined by the programmer. The program announces and / or shows 324

Petition 870180007592, of 01/29/2018, p. 38/56

35/39 instructions to the user / patient to put themselves in the correct position with respect to the camera and close their eyes. A delay is provided 326, to give patient S sufficient time to obey commands to position and close his eyes and / or the computer program makes 326 a ready signal to the patient, for example, the patient presses the control button 228c to start taking pictures. The monitor of monitor 270 is left blank 328 to prevent interference with illumination light, and a control feedback 330 for the main processing flow is performed. In capture 308, the adjusted image, the fluorescent lights 217a, 217b are energized 332 and the camera 211 is fired 334. The fluorescent lights 217a, 217b are then deactivated 336 and the 385 nanometer UV flashes 240a, 240b are allowed 338. A The camera then fires 340 causing the 385 nanometer UV flashes 240a, 240b to flash. Polarized flashes 220a, 220b are allowed 342 and camera 211 is fired, firing 344 polarized flashes 220a, 220b. 405 nanometer flashes 230a, 230b are allowed 346 and camera filter solenoid 280b is energized 348, thereby moving filter 281a in front of camera 211. Camera 211 is then fired 350 along with flashes 230a, 230b. The filter 281a is then removed from a position in front of the camera 211 by deactivating 352 of the solenoid with filter 280b. The polarized flashes 220a, 220b are allowed 354 and the polarized solenoid of the camera 280a is energized 356 thereby moving the polarization filter 281b in front of the camera 211. The camera 211 is then fired, flashing the polarized flashes 220a, 220b 358. The camera polarizer solenoid 280a is disabled 360 to remove the polarization filter 281b away from the front of the camera 211. The monitor screen 270 is not left blank 362 and returns control 364 to the main processing stream.

Petition 870180007592, of 01/29/2018, p. 39/56

36/39 [0096] When preparing to display the images and download 310 the image data to computer 552 (Figure 9), the computer program announces 366 that the image capture is complete and then the image data is downloaded 368 from camera 211 to computer 552, where they are stored in memory or on a memory storage device. The control returns 370 to the main processing stream.

[0097] Figure 8 shows exemplary processing associated with showing 312 images and providing operation control options for the operator / patient S. As noted above, monitor 270 has a plurality of miniature images from 224a to 224e. Any number of thumbnail image can be shown 372, as indicated by the dotted lines and reference to show 374 image # 1, show 376 image # 2 and show 378 image #n. Because monitor monitor 270 is preferably a touch screen monitor, the thumbnail display areas 224a to 224e can be used to detect 380 operator input (by touching the particular thumbnail image 224a-224b that the operator wants to show in the main image area 225). Showing 382 the main image, a standard image 384 is shown which would typically be the first image taken, for example, an image taken in white light or fluorescent light. Based on operator input 386 (touching a particular thumbnail image), the image associated with that particular thumbnail from 224b to 224e is retrieved 388 from memory or a storage device and the image is shown in the main image area 225 As noted above, focus box 226 is shown 390 in main image area 225. A standard focus box 226 is first shown 392 and then the program detects 394 upon operator input to focus box 226 by changes. More particularly, if the operator / patient S touches the

Petition 870180007592, of 01/29/2018, p. 40/56

37/39 monitor 270 within the limits of focus box 226 and retains contact with it while moving the contact finger across screen 270, focus box 226 can be dragged to the image area of interest to the operator / patient S Operator inputs for the focus box location are monitored in step 396. If there has been a change, then the pixel set associated with focus box 226 is updated 398. The magnified image associated with focus box 226 400 is shown and a standard area associated with a standard position of the focus box 226 is shown first 402. The program continuously detects 404 on changes in focus or zoom or by clear signals that are generated by the operator by touching one of the 228d control buttons , 228e, 228f. Any of these entries causes the set of pixels associated with the focus box to be selected again 406 and displayed 408, in order to implement a change of focus or zoom and / or to clean the monitor. In step 410, the +, - and clear control buttons are shown and detected. As noted above, touching 412 + results in the enlargement of the image shown in the enlarged monitor area 227. Pressing 414 - results in a lower magnification and pressing 416 clear results in the enlarged monitor area 227 being left blank.

[0098] Figure 9 shows an exploded view of an embodiment of the present invention in which, the imaging station 500 has central housing 502 containing a plurality of power supplies 532, 533, 534 to energize the various elements of the system, including monitor 570 and system computer 552, as well as camera 511. Camera 511 is mounted on an intermediate panel 543 which also serves to provide a structure for mounting the monitor 570. The intermediate panel 543 is received inside and attached to the housing 502 via conventional fasteners, such as threaded fasteners or rivets. Front panel 542 is attached to the

Petition 870180007592, of 01/29/2018, p. 41/56

38/39 housing 502 and / or intermediate panel 543. Front panel 542 has openings for camera 511, speaker 518 and monitor 570. Only one set of port 504a is shown. Any of the single or multiple door configurations are within the scope of the present invention, as they are configurations where the door (s) open up or down.

[0099] Figure 10 shows the imaging station 500 of Figure 9 in a closed condition with door panels 504a and 504b closed, so that monitor 570 is not visible. This modality of the imaging station 500 has some similarities to a conventional medicine cabinet in that it can be mounted on a wall and doors 504a, 504b closed to protect the internal contents of housing 502. The front surfaces of the door sets 504a, 504b can be mirrored.

[00100] Figure 11 is a rear view of the imaging station 500 illustrating that door assemblies 504a, 504b are pivotally attached to housing 502 via hinges, for example, 505b.

[00101] Figure 12 is a block diagram illustrating the electrical components of the imaging station 600. As can be seen, AC input 637 is routed to a power distribution box 638 to spread the AC input to a plurality of power supplies 632, 633, 634, 635, power control board 655, computer 652, monitor 670 and camera 611, respectively. Camera 611 communicates with computer 652 via a U.S.B data input / output. 654 and thereby transfers images to the 655 control board. The 655 control board controls the filter solenoids 681a, 618b, the polarizers of the flash unit 620a, 620b, CCFLs and inverters 656a, 656b and flash units 630a, 630b, 640a and 640b.

Petition 870180007592, of 01/29/2018, p. 42/56

[00102] Although the present invention has been explained above in terms of an apparatus and method employing multiple images captured under different lighting conditions, for example, different wavelengths of light, the present invention could still be applicable to capture and analysis of even a single image taken under selected lighting conditions. For example, the imaging station 200 could be used to capture and analyze a single image taken with blue light.

[00103] It should be appreciated that the present invention 200 is intended to be operated by anyone and, therefore, can be used in a private assembly, such as the home, by patient S.

[00104] It is understood that although the invention has been described in conjunction with its detailed description, that the description already mentioned is intended to illustrate and not to limit the scope of the invention, which is defined by the scope of the appended claims. Other aspects, advantages, and modifications are within the scope of the claims.

Petition 870180007592, of 01/29/2018, p. 43/56

1/8

Claims (45)

1. Device for capturing images of a person comprising: an accommodation; a camera mounted on the housing to capture images of the person; lighting device mounted in the housing, the lighting device providing light to capture the person's images and being able to provide at least two different wavelengths of light used in capturing images, the light lengths used in capturing a first image differing from the lengths of light used to capture a subsequent image; a dial mounted on the housing to show images captured by the camera; control device to control the camera, the lighting device and the display to selectively capture and display the images captured on the display; where the display is a touch screen capable of receiving input from a device operator to control the review of images captured in conjunction with the control device and has an image display area to show a captured image and a detection of the control area at the operator's contact, characterized by the fact that the image display area is subdivided to show a plurality of different images allowing side-by-side comparison of the different images, which can each be enlarged and repositioned, enlargement and repositioning being synchronized so that each image is presented in the same position and scale. Petition 870180007592, of 01/29/2018, p. 44/56 2/8 2. Apparatus according to claim 1, characterized by the fact that the housing has a hollow portion receiving the camera and at least one door attached to it to cover the camera when in a closed position and to uncover the camera when in a position open. 3. Apparatus according to claim 2, characterized by the fact that the hollow receives the dial and at least one door covers the dial when in the closed position. 4. Apparatus according to claim 3, characterized by the fact that it also includes a pair of doors flanking a central portion of the housing, the pair of doors articulated to the central portion. 5. Apparatus according to claim 4, characterized by the fact that it also includes a reflective surface on an external surface of one of the doors, the reflective surface functioning as a mirror. 6. Apparatus according to claim 5, characterized by the fact that the reflective surface is arranged on the outer surface of the door when the door is in the closed position. 7. Apparatus according to claim 1, characterized by the fact that the lighting device includes a plurality of different light sources. Apparatus according to claim 7, characterized in that the lighting device includes a light filter to filter light from at least one of the plurality of light sources. 9. Apparatus according to claim 8, characterized by the fact that the light filter is positioned in front of the camera to filter light that enters the camera. 10. Apparatus according to claim 9, characterized by the fact that the filter is movable between a filtering position Petition 870180007592, of 01/29/2018, p. 45/56 3/8 in front of the camera and a non-filtering position away from the front of the camera. 11. Apparatus according to claim 8, characterized by the fact that the filter is positioned in front of at least a plurality of light sources to filter light emanating from there. Apparatus according to claim 8, characterized by the fact that the light source includes a plurality of light filters that affect the wavelength of the light. 13. Apparatus according to claim 7, characterized by the fact that the lighting device provides light selected from at least one of visible light, polarized light, ultraviolet light and blue light. 14. Apparatus, according to claim 1, characterized by the fact that the control area includes at least one thumbnail image corresponding to an image previously captured by the camera. 15. Apparatus, according to claim 14, characterized by the fact that the control area includes a plurality of miniature images corresponding to images previously captured by the camera, with which the operator's contact invokes the control device to show the corresponding image in the image display area. 16. Apparatus according to claim 1, characterized by the fact that the touch screen has an enlarged image area to show a portion of the image shown in the image display area at a different magnification than in the image display area. Image. 17. Apparatus according to claim 16, characterized by the fact that the portion of the image shown in the enlarged image area and the degree of magnification are selectable by the operator. Petition 870180007592, of 01/29/2018, p. 46/56 4/8 18. Device, according to claim 1, characterized by the fact that the touch screen shows, in real time, the restored image captured by the camera. 19. Apparatus, according to claim 1, characterized by the fact that the control area includes at least one of a button, a dial and a lever. 20. Device, according to claim 1, characterized by the fact that the operator is a person whose image is captured by the device. 21. Apparatus according to claim 1, characterized in that the control device includes a computer programmed to direct the camera and the lighting device to automatically capture a plurality of images in sequence using a plurality of different wavelengths of light. 22. Apparatus according to claim 21, characterized in that the light source includes a light attached to an internal portion of the at least one door so that when at least one door is opened, the light is able to illuminate the person, the incident angle of the illumination light being adjustable by adjusting the angle of at least one door with respect to the hollow portion. 23. Apparatus according to claim 22, characterized by the fact that it still comprises a device for positioning at least one door in a selected position. 24. Apparatus according to claim 22, characterized by the fact that it also includes a polarization filter juxtaposed next to the light attached to the door to provide polarized light for illuminating the object. 25. Apparatus, according to claim 1, characterized by the fact that it still includes a device to provide instruction 870180007592, from 29/01/2018, p. 47/56 5/8 tions of use to a user. 26. Apparatus according to claim 25, characterized by the fact that the instructions provided by the device to provide instructions for use enable a person to be untrained in using the apparatus when using it to capture and view images captured in this way. 27. Apparatus according to claim 25, characterized in that the device for providing instructions for use includes a loudspeaker mounted in the housing to audibly announce the instructions for use. 28. Apparatus according to claim 25, characterized by the fact that the device for providing instructions for use includes the display showing the instructions for use. 29. Apparatus, according to claim 1, characterized by the fact that the display is directed towards the person when the person is positioned to capture the image. 30. Apparatus according to claim 1, characterized by the fact that the light source includes at least one flash. 31. Method for capturing images of a person characterized by the fact that he / she understands the steps of: (A) provide an image forming station having a housing, a camera mounted on the housing, a light source mounted on the housing, a display mounted on the housing to show images captured by the camera, where the display is a touch screen having an image display area to display a captured image and a control area at the operator's contact, in which the image display area is subdivided; It's a computer; (B) position the person in relation to the camera; (C) automatically capture a plurality of images Petition 870180007592, of 01/29/2018, p. 48/56 6/8 with the camera; (D) store the captured images and; (E) selectively show the images captured on the display; (F) receiving input from a device operator to control the review of the images captured in conjunction with the control device; (G) display a plurality of different images in the subdivided image display area allowing for a side-by-side comparison of the different images, which can each be enlarged and repositioned, being synchronized so that each image is presented in the same position and scale. 32. The method of claim 31, characterized by the fact that the imaging station has a plurality of light sources of different frequencies and the plurality of different images includes images captured with different frequencies of light. 33. Method, according to claim 32, characterized by the fact that it still comprises the step of firing the light sources sequentially as the different images are captured. 34. Method, according to claim 33, characterized by the fact that at least one image is captured during the shooting of two different light sources. 35. Method, according to claim 31, characterized by the fact that it still comprises the step of providing instructions for self-use of the imaging station to the person whose image is captured by the imaging station. 36. Method according to claim 35, characterized by the fact that the instructions are in the form of at least Petition 870180007592, of 01/29/2018, p. 49/56 7/8 one among texts and graphics. 37. Method, according to claim 35, characterized by the fact that the instructions given continue to interpret the captured images. 38. Method, according to claim 31, characterized by the fact that the imaging station has at least one door covering the camera and further comprising the steps of loading the imaging station to a selected location, positioning the imaging station on a support surface and open at least one door before the positioning step. 39. Method according to claim 37, characterized by the fact that at least one door has a light source in it and further comprises the step of adjusting the angle of at least one door to adjust the angle of incidence of light emanating from the light source in the person. 40. Method according to claim 31, characterized by the fact that the positioning step includes positioning any selected portion of the body before the camera. 41. Method according to claim 31, characterized by the fact that the positioning step includes capturing a real-time image of the person, showing the image in real time on the display and allowing the person to interactively adjust their position based on the image real time shown. 42. Method according to claim 31, characterized by the fact that the imaging station is operable by the person whose image is captured. 43. Method according to claim 31, characterized by the fact that more than one of the plurality of images is shown as thumbnail images on the display, allowing the Petition 870180007592, of 01/29/2018, p. 50/56 8/8 person select one of the thumbnail images to show in a larger size. 44. Method, according to claim 31, characterized by the fact that it also includes the steps of selectively repositioning the image shown on the large format display and selectively zooming in and out of the image. 45. Method according to claim 31, characterized by the fact that the steps of positioning and storing are carried out by the person whose image is captured and the steps of capturing and storing are carried out by the image forming station. Petition 870180007592, of 01/29/2018, p. 51/56 2/10 ///