JP6597848B2 - Skin treatment device, skin treatment method and program - Google Patents

Description

  The present invention relates to a skin treatment device, a skin treatment method, and a program.

When a person applies makeup, cosmetics are applied to the skin using a cosmetic tool such as a sponge or brush.
In order to perform such an application work on behalf of a person, conventionally, an application system for applying skin-colored cosmetic ink to the skin by an ink jet method has been proposed (for example, see Patent Document 1). According to this application system, it is possible to optically detect a damaged part of the skin such as a stain and apply a medicine or the like.
In addition, a method of detecting a change in skin color due to a subcutaneous tissue such as a blood vessel or melanin by using a polarizing filter has been proposed (see, for example, Patent Document 2).

Special table 2011-527592 gazette JP 2009-11824 A

  However, since the coating system applies a single color cosmetic, skin color unevenness such as spots and redness cannot be effectively eliminated. In addition, in order to smooth the unevenness of the skin surface such as pores and wrinkles, it is necessary to adjust the amount of cosmetic applied, but there are many pores and it is cumbersome for the user to make adjustments one by one. . Therefore, conventionally, it has been difficult to finish the skin with uniform color, brightness, surface shape, and the like.

  The subject of this invention is performing the skin process according to the state of skin.

In order to achieve the above object, a skin treatment apparatus according to an aspect of the present invention is provided.
A light source for irradiating a living body with light;
Image acquisition means for acquiring a skin image of the living body;
Using the skin image obtained by the image acquisition means, detecting a specific part of the skin state of the living body, and determining a skin state type of the specific part,
Skin treatment means for executing skin treatment of the type or level corresponding to the skin condition determined by the skin condition determination means for the skin of the living body;
With
The skin condition determining means determines a dark first image part whose brightness is less than a threshold value in two skin images in a state in which the living body is irradiated with light from the light source and a state in which the light is not irradiated. and detecting as.

  According to the present invention, the type or level of the skin treatment can be switched according to the skin state, and the skin treatment according to the skin state can be performed.

It is a perspective view which shows the external appearance of the skin treatment apparatus which concerns on this Embodiment. (A) It is sectional drawing in the AA of FIG. (B) It is the top view which represented the area sensor and the inkjet head from the direction B in (a). It is a functional block diagram showing the structure of the skin treatment apparatus of FIG. 1 for every function. It is a figure which shows an example of a sample table. It is a figure which shows an example of a flag table. It is a flowchart which shows the process sequence which a skin treatment apparatus applies cosmetics to a user's skin. It is a flowchart which shows the process sequence which a skin treatment apparatus determines a skin state. It is a figure which shows an example of the skin image obtained by irradiating light, and the skin image obtained without irradiating light. It is a flowchart which shows the process sequence in which a skin treatment apparatus detects a peculiar part. It is a flowchart which shows the process sequence in which a skin treatment apparatus determines skin treatment conditions. It is a flowchart which shows the process sequence which a skin treatment apparatus performs a skin process. It is a flowchart which shows the process sequence which a skin treatment apparatus performs an inspection process. It is a figure which shows an example of the table of the image which can be formed on skin. It is a flowchart which shows the process sequence in the case of detecting a peculiar part using the several skin image from which the inclination angle of the skin processing apparatus with respect to skin differs. It is a side view which shows the skin treatment apparatus 10 in which the inclination angle with respect to skin was changed. (A) It is sectional drawing which shows the end of the skin treatment apparatus with which the polarizing cover was attached. (B) It is a perspective view which shows the external appearance of a polarizing cover. It is a flowchart which shows the process sequence in the case of detecting a specific part using the several skin image from which polarization conditions differ.

  Embodiments of a skin treatment apparatus, a skin treatment method, and a program according to the present invention will be described below with reference to the drawings.

FIG. 1 shows the appearance of a skin treatment apparatus 10 according to the present embodiment.
As shown in FIG. 1, the skin treatment apparatus 10 is formed in a stick shape that is easy for a user to grasp.
When using the skin treatment apparatus 10, the user moves the skin treatment apparatus 10 with one end of the skin treatment apparatus 10 facing the skin, and scans the surface of the skin with the skin treatment apparatus 10. On the side surface of the housing of the skin treatment device 10, an arrow indicating one end of the skin treatment device 10 opposed to the skin is described.
The skin treatment apparatus 10 is provided with selection switches 31 and 32, an execution switch 33, a display 41, and the like as user interfaces.

As shown in FIG. 1, the skin processing apparatus 10 includes an image acquisition unit 5 (image acquisition unit) that acquires an image of a user's skin (hereinafter referred to as a skin image), and a skin processing unit 6 that applies cosmetics to the skin. (Skin treatment means).
The image acquisition unit 5 is provided at one end of the skin treatment apparatus 10 facing the skin.
The skin treatment unit 6 includes four sets of cosmetic ink cartridges 61 and inkjet heads 62, and each inkjet head 62 is provided at one end of the skin treatment apparatus 10 facing the skin. FIG. 1 shows an example in which four sets of ink cartridges 61 and inkjet heads 62 are provided so that four cosmetics can be applied. Depending on the number of cosmetics, the ink cartridges 61 and the inkjet heads 62 are arranged. Can be provided.

FIG. 2A shows a cross-sectional view taken along line AA in FIG.
As illustrated in FIG. 2A, the image acquisition unit 5 includes a light source 51, a light guide 52, and an area sensor 53. The area sensor 53 includes a plurality of imaging elements arranged in the x and y directions.
The image acquisition unit 5 emits light by the light source 51 and guides the light to the surface of the skin 100 by the light guide 52. The image acquisition unit 5 photoelectrically converts the light reflected on the surface of the skin 100 and incident on the area sensor 53 by each image sensor of the area sensor 53, and R (red), G (green), and B (for each pixel). A skin image having a signal value of each color of blue) is acquired. The obtained skin image is output from the area sensor 53 to the control board 11.

FIG. 2B shows the area sensor 53 and the inkjet head 62 from the direction B in FIG.
As shown in FIG. 2B, the four inkjet heads 62 are located below the area sensor 53. The total width of the four inkjet heads 62 in the x direction corresponds to the total width of the area sensor 53 in the x direction.

FIG. 3 is a functional block diagram illustrating the configuration of the skin treatment apparatus 10 for each function.
As shown in FIG. 3, the skin treatment apparatus 10 includes a control unit 1, a storage unit 2, an operation unit 3, a display unit 4, an image acquisition unit 5, a skin treatment unit 6, and a motion detection unit 7. The control unit 1 and the storage unit 2 are provided on the control board 11 in FIG.

  The control unit 1 reads out the program from the storage unit 2 and executes it, thereby controlling the operation of each unit of the skin treatment apparatus 10. The control unit 1 can be configured by a CPU (Central Processing Unit), a RAM (Random Access Memory), and the like.

The control unit 1 (image control means) causes the image acquisition unit 5 to acquire a skin image when applying cosmetics to the user's skin. The control unit 1 (skin state determination means) determines the user's skin state using the skin image obtained by the image acquisition unit 5. Specifically, the control unit 1 uses the skin image obtained by the image acquisition unit 5 to detect a specific part of the skin state in the user's skin, and determines the skin part that is not the specific part as a normal part of the skin state. Determine as. The unique part of the skin state refers to a skin part in which the skin state such as skin color, surface shape, structure, etc. is unique compared to the surrounding skin. The peculiar part is classified into types such as a mole, a stain, a pore, a wrinkle, a subcutaneous blood vessel, and a raised hair, depending on the skin state. The control unit 1 (skin processing control means) causes the skin processing unit 6 to perform skin processing at a level corresponding to the determined skin state on the user's skin.
In order to perform skin processing at a level corresponding to the skin state, the control unit 1 (correction means), the signal value of the singular part in the skin image, so that the color and brightness of the singular part match the normal part, The signal value of the singular part can be corrected according to the difference from the signal value of the normal part in the skin image.

The storage unit 2 stores a program that can be read by the control unit 1. As the storage unit 2, for example, a medium such as a flash memory can be used.
The storage unit 2 stores data such as a table used by the control unit 1 when the program is executed.
For example, the storage unit 2 stores a sample table 2a of unique parts.
FIG. 4 shows a sample table 2a as an example.
In the sample table 2a, as shown in FIG. 4, the name of the specific part of the skin state is associated with the sample image.

The storage unit 2 stores a flag table 2b.
FIG. 5 shows a flag table 2b as an example.
In the flag table 2b, as shown in FIG. 5, the dark flag, the change flag, and the singular part flag are associated with the coordinates (x, y) of each pixel of the skin image obtained by the image acquisition unit 5. . The coordinates (x, y) indicate the position on the user's skin. Details of each flag will be described later.

  The operation unit 3 outputs an operation signal corresponding to the operation of the selection switches 31 and 32 and the execution switch 33 to the control unit 1. The selection switch 31 is used for selecting a skin care and makeup skin treatment type, and the selection switch 32 is used for selecting an option displayed on the display 41. The execution switch 33 is used for an instruction to start processing.

  The display unit 4 displays a display screen such as an operation screen or an alert screen on the display 41 in accordance with an instruction from the control unit 1.

  As described above, the image acquisition unit 5 includes the light source 51, the light guide 52, and the area sensor 53, and acquires a skin image according to an instruction from the control unit 1.

The skin treatment unit 6 discharges the cosmetics accommodated in the ink cartridges 61 by the ink jet heads 62 and applies them to the skin.
As cosmetics, cosmetics for makeup such as foundation, teak, eye shadow, and eyeline, cosmetics for skin care such as skin lotion, milky lotion, and cosmetic liquid can be used.
The four ink cartridges 61 can accommodate, for example, R, G, and B color foundations and cosmetic liquids, respectively.
Note that the user may replace the ink cartridge 61 and the inkjet head 62 so that the cosmetic applied by the skin treatment unit 6 can be replaced.

The motion detection unit 7 detects movements such as movement and rotation of the skin treatment device 10. Specifically, the motion detection unit 7 includes a triaxial acceleration sensor, a gyro sensor, and a magnetic sensor. Depending on the acceleration in the triaxial direction, the angular velocity, and the magnitude of geomagnetism detected by each sensor, the motion detection unit 7 The moving direction, moving amount, rotation angle, etc. are detected.
Further, the motion detection unit 7 (angle detection means) detects the inclination angle of the skin treatment apparatus 10 with respect to the surface of the user's skin from the acceleration in three axes, the angular velocity, and the magnitude of geomagnetism detected by each sensor. Can do.

FIG. 6 shows a processing procedure when the skin treatment apparatus 10 applies cosmetics to the user's skin.
As shown in FIG. 6, in the skin treatment apparatus 10, the control unit 1 determines whether the skin treatment type selected by the user is skin care or makeup based on the operation signal of the selection switch 31 ( Step S11).
When skin care is selected (step S11; A), an operation screen that allows the display unit 4 to select the type of cosmetic for skin care is displayed on the display 41. For example, when only one type of cosmetic liquid can be selected, an operation screen with only cosmetic liquid as an option is displayed. When three types of skin lotion, milky lotion, and cosmetic liquid can be selected, an operation screen with these as options is displayed. . Then, based on the operation signal of the selection switch 32, the control part 1 determines the kind of cosmetics for skin care (step S12).

When makeup is selected (step S11; B), the display unit 4 displays an operation screen for selecting the color and darkness of makeup cosmetics on the display. For example, when the cosmetic for makeup is a foundation, a normal skin color with strong yellowishness or a skin color with strong redness can be selected as a color, and oak 1 to 3 (oak 2 is normal darkness) as a darkness. An operation screen that can be selected from three levels can be displayed on the display unit 4.
Thereafter, based on the operation signal of the selection switch 32, the control unit 1 determines the color and darkness of the makeup cosmetic (steps S13 and S14).

  Next, the skin treatment apparatus 10 determines the skin condition of the user (step S2), and determines skin treatment conditions according to the determined skin condition (step S3). The skin processing apparatus 10 executes a skin processing according to the determined skin processing conditions (step S4), and then executes an inspection process (step S5).

FIG. 7 shows the processing procedure of step S2 for determining the skin state when makeup is selected and the color and darkness of the foundation are selected.
As shown in FIG. 7, in the skin treatment apparatus 10, the alert screen is displayed on the display 41 by the display unit 4 (step S21). In the alert screen, the user is prompted to scan the entire skin with the skin treatment device 10 after operating the execution switch 33 with one end of the skin treatment device 10 facing the user's skin. Thereafter, until the execution switch 33 is operated (step S22; N), the process returns to step S1 and the alert display by the display unit 4 is continued.

  When the execution switch 33 is operated by the user (step S22; Y), while the movement of the skin processing apparatus 10 is detected by the motion detection unit 7, the image acquisition unit 5 scans the surface of the user's skin at regular intervals. Scan to obtain multiple skin images. The predetermined interval for acquiring the skin image is determined by the control unit 1 so that the areas of the respective skin images obtained at every predetermined interval overlap, and the timing at which the control unit 1 acquires the skin image is determined by the image acquisition unit 5. To instruct. At each timing instructed to acquire the skin image, the image acquisition unit 5 acquires in parallel the skin image when light is emitted by the light source 51 and when the light is not irradiated (step S23). Each obtained skin image is stored in the storage unit 2.

FIG. 8 exemplifies skin image G1 with light source obtained by irradiating light and skin image F1 without light source obtained without irradiating light in parallel with skin image G1. Yes.
The skin images G1 and F1 share the mole image portions g1 and g2, the blot image portion g3, and the raised image portion g4, but the skin image G1 irradiated with light from the light source 51 is irradiated with light. Compared with the skin image F1 which is not, brightness and contrast are high. The skin image G1 includes a shadow image portion g5 that extends from one end of the raised image portion g4 by light irradiation, but does not exist in the skin image F1.

When the user finishes scanning the entire skin with the skin processing device 10 and the movement detection unit 7 does not detect the movement of the skin processing device 10 for a predetermined time or longer, the control unit 1 displays each skin image stored in the storage unit 2. The feature points of the skin are extracted from the read out skin images (step S24). Specifically, the control unit 1 reads a sample image of each unique portion from the sample table 2a, compares it with the skin image, and extracts an image portion that matches the sample image as a feature point.
For example, in the case of the skin image G1 shown in FIG. 8, the mole image portions g1 and g2 match the mole sample images in the sample table 2a, and therefore the mole image portions g1 and g2 are extracted as feature points.
Note that a feature amount of the skin image, for example, an average value of signal values, a standard deviation, or the like may be calculated, and an image portion having a small difference from the feature amount of the sample image may be extracted as a feature point.

The control unit 1 specifies the position of each pixel on the skin by setting the coordinates indicating the position on the skin of the user to each pixel of the skin image with reference to the position of the extracted feature point (step S25).
For example, in the case of the skin image G1 shown in FIG. 8, the control unit 1 sets the coordinates (x, y) of the pixel located at the center of the mole image part g1 as (0, 0) and coordinates of each pixel of the skin image G1. Set (x, y). Next, the control unit 1 searches the other skin image for the same feature point as that of the skin image G1, that is, the feature point that matches the mole image portion g1 and the like. The same coordinates as the feature points of the skin image G1 are set. Based on the coordinates set for the feature points, the control unit 1 sets the coordinates of each pixel of another skin image. In this way, common coordinates are set for all acquired skin images with reference to the positions of the common feature points.

  Next, the control unit 1 reads out the respective skin images with and without the light source from the storage unit 2 and binarizes them (step S26). The binarized image obtained by binarization represents the brightness of the original skin image. In the binarized image, the signal value of each pixel of the skin image is compared with a threshold for binarization, a signal value equal to or higher than the threshold is set to a maximum value (for example, 1), and a signal value less than the threshold is set to a minimum value (for example, , 0) can be obtained.

In the flag table 2b, the control unit 1 sets a dark flag of 0 for a pixel having a maximum signal value of a binarized image with a light source, and sets a dark flag of 1 for a pixel having a minimum signal value. Similarly, the control unit 1 sets a dark flag of 0 or 1 according to the signal value of the binarized image without a light source (step S27). A dark flag of 0 indicates that the skin image is bright, and a dark flag of 1 indicates that the skin image is dark.
In addition, in the flag table 2b, the control unit 1 sets a change flag of 1 for each pixel whose dark flag is 1 when there is a light source but whose dark flag is 0 when there is no light source. A change flag of 0 is set for the other pixels (step S28). A change flag of 1 indicates that the brightness of the skin image has changed when light is not irradiated as compared with the case of irradiation with light, and a change flag of 0 indicates that there is no change.

Next, the control part 1 detects the specific part of a skin state according to a dark flag and a change flag (step S29).
FIG. 9 shows the processing procedure of step S29 for detecting a singular part.
As shown in FIG. 9, the control unit 1 searches for a dark image portion in which the dark flag is 1 in the flag table 2 b in both cases where there is a light source and no light source as a specific portion of the skin state. When the dark image portion is detected (step S291; Y), the control unit 1 compares the detected dark image portion with the sample images of the specific portions of the blot, wrinkle, blood vessel, and pores in the sample table 2a. If it matches any of the sample images (step S292; Y), the control unit 1 detects that the detected dark image portion is a unique portion, and the kind of skin condition of the specific portion matches the sample image. Or it determines that it is a pore. In the flag table 2b, the control unit 1 sets the flag of the singular part that matches the sample image among the blot, wrinkle, blood vessel or pore flag of each pixel of the detected dark image part to 1, and the sample image is The flag of the singular part that does not match is set to 0 (step S293).

  On the other hand, in both cases where there is a light source and no light source, a dark image portion whose dark flag is 1 is not detected (step S291; N). When the images do not match (step S292; N), the control unit 1 sets all the flags of the specific portions of the blot, wrinkle, blood vessel and pore in the flag table 2b to 0 (step S294).

  Next, the control unit 1 detects an image part whose change flag is 1 in the flag table 2b as a shadow image part (step S295; Y). When the shadow is a raised shadow, the raised shadow extends from the root of the raised brush, and therefore, the shadow image portion and the raised image portion coincide with each other. Therefore, the control unit 1 detects a dark image portion as a specific portion of the skin state in the same manner as in step S291, and determines whether a pixel at one end of the shadow image portion or the dark image portion matches. If they match (step S296; Y), the control unit 1 in the flag table 2b determines that the detected dark image portion is a peculiar portion and the skin state type of the peculiar portion is raised, and the dark image portion The raised flag of each pixel is set to 1 (step S297).

  For example, in the case of the skin image G1 with the light source shown in FIG. 8, the dark flag is set to 1 because the signal value is low in the raised shadow image portion g5. Since this shadow image portion g5 is not present in the skin image F1 when there is no light source, the change flag of each pixel of the shadow image portion g5 is set to 1. On the other hand, in the raised image portion g4, the dark flag is set to 1 in both the skin images G1 and F1, and one end thereof coincides with the shadow image portion g5. Therefore, the raised flag of each pixel of the raised image portion g4 is set to 1.

On the other hand, when an image portion having a change flag of 1 is not detected (step S295; N), the control unit 1 sets all raised flags of each pixel of the skin image to 0 (step S298). In addition, when an image portion having a change flag of 1 is detected, but a dark image portion in which the image portion and one end pixel coincide with each other is not detected (step S296; N), there is a shadow but a raised shadow. Therefore, the control unit 1 sets all raised flags of each pixel of the skin image to 0 (step S298).
Thereafter, the process proceeds to step S3 for determining skin treatment conditions.

FIG. 10 shows the processing procedure of step S3 for determining the skin processing conditions.
As illustrated in FIG. 10, the control unit 1 determines an image part in which flags of all singular parts in the flag table 2 b are 0 as a normal part of the skin state. And the control part 1 calculates the sum total of the signal value of each pixel of a normal part for every color of R, G, and B (step S31).

The control unit 1 divides the sum of the signal values of each color of R, G, and B by the number of pixels in the normal part where all the singular part flags are 0, and averages the signal value of each pixel in the normal part A value is calculated for each color (step S32). This average value represents the color and brightness of the normal part.
The sum of the signal values of the R, G, and B colors calculated in step S31 is represented as ΣR, ΣG, and ΣB, respectively, and the average values for the R, G, and B colors calculated in step S32 are Rav, Gav, respectively. And Bav, the average values Rav, Gav and Bav of the respective colors are calculated by the following formulas. In the following formula, N represents the number of pixels in the normal part.
Rav = ΣR / N
Gav = ΣG / N
Bav = ΣB / N

Next, the control unit 1 calculates the difference between the obtained average value of each color and the signal value of each color of the pixel whose flag of any specific part is 1 in the flag table 2b (step S33).
Signal values of R, G, and B colors of a pixel having a singular part flag of 1 are represented as r, g, and b, respectively, and differences from the average values Rav, Gav, and Bav are represented as hr, hg, and hb, respectively. , Differences hr, hg and hb are calculated by the following equations. The differences hr, hg, and hb may be calculated for each type of skin condition of the unique portion.
hr = Rav-r
hg = Gav-g
hb = Bav−b

After the difference is calculated, an alert screen is displayed on the display 41 by the display unit 4 to inform the user that the preparation for the skin treatment is complete (step S34).
Then, the process proceeds to step S4 for executing skin processing.

FIG. 11 shows the processing procedure of step S4 for executing the skin processing.
As shown in FIG. 11, in the skin treatment apparatus 10, the alert screen is displayed on the display 41 by the display unit 4 (step S401). In the alert screen, the user is prompted to scan the entire skin with the skin treatment device 10 after operating the execution switch 33 with one end of the skin treatment device 10 facing the user's skin. Thereafter, until the execution switch 33 is operated (step S402; N), the process returns to step S1 and the alert display by the display unit 4 is continued.

  When the execution switch 33 is operated by the user (step S <b> 402; Y), the image acquisition unit 5 irradiates light with the light source 51 to acquire a skin image. Then, in the same manner as the process of step S24, the control unit 1 extracts feature points from the obtained skin image, and assigns coordinates to each pixel of the skin image with reference to the coordinates of the feature points. Identify the location of the skin. The control unit 1 specifies the current position on the skin of each inkjet head 62 based on the coordinates assigned to the skin image (step S403). Since the positional relationship between the area sensor 53 of the image acquisition unit 5 and each inkjet head 62 is fixed, the positional relationship between the skin image obtained by the area sensor 53 and each inkjet head 62 is always the same. For example, if the cosmetic outlet of the inkjet head 62 is located at the 50th pixel from the top of the skin image and the 50th pixel from the right, the coordinates of the pixel corresponding to this position are specified as the current position of the inkjet head 62. do it.

The control unit 1 determines a pixel corresponding to the current position of each inkjet head 62 as an application target, and reads an application end flag of the pixel from the flag table 2b. An application end flag of 1 indicates that the skin process has been completed, and an application end flag of 0 indicates that the skin process has not yet ended.
When the application end flag is 1 (step S404; Y), since the skin processing of the pixel has been completed, the process proceeds to step S410. When the application end flag is 0 (step S404; N), the control unit 1 reads out the flag of each specific part of the blot, wrinkle, blood vessel, pore and raised part of the pixel to be applied from the flag table 2b.

When the flag of any unique part is 1 (step S405; N), the pixel to be applied is a unique part. The control unit 1 determines whether the flag other than the raised hair, the wrinkle, the blood vessel, or the pore flag is 1, or the raised flag is 1.
When the flag other than raising is 1 (step S406; A), the control unit 1 determines the correction value using the correction coefficient K of K = 20. When the correction values of the respective colors determined using the correction coefficient K are expressed as Rc, Gc, and Bc, the correction values Rc, Gc, and Bc are calculated by the following equations, respectively.
Rc = K × hr
Gc = K × hg
Bc = K × hb
The controller 1 corrects the signal value by adding the determined correction values Rc, Gc, and Bc to the signal values r, g, and b of the pixel to be applied, and the corrected signal value is supplied to the skin processing unit 6. Output (step S407).

  On the other hand, when the raised flag is 1 (step S406; B), the control unit 1 determines the correction values Rc, Gc, and Bc of the application target pixel using the correction coefficient K of K = 40. The control unit 1 corrects the signal value by adding the determined correction values Rc, Gc, and Bc to the signal values r, g, and b of the pixel to be applied, and the corrected signal value is the skin processing unit 6. (Step S408).

  When the differences hr, hg, and hb are calculated for each type of skin condition of the singular part, in the above formula, the difference hr calculated for the blot, wrinkle, pore, blood vessel, or brushed flag is 1. , Hg and hb may be used to calculate correction values Rc, Gc and Bc.

  When all the unique part flags are 0 (step S405; Y), the application target pixel is a normal part of the skin. The control unit 1 does not correct the signal value using the correction coefficient K, and the control unit 1 outputs the signal value of the pixel to be applied to the skin processing unit 6 as it is.

When a color or darkness other than normal is selected in steps S13 and S14, the control unit 1 adds an adjustment value corresponding to the selected color or darkness to the signal value output to the skin processing unit 6. The color or intensity may be adjusted.
For example, when a color with a strong red color is selected, the color can be adjusted so that the R color becomes strong by adding an adjustment value of +10 to the signal value of the R color.

  The process of step S3 is performed every time a pixel to be coated is determined, and the difference between the signal values r, g, and b of the pixel to be coated and the average values Rav, Gav, and Bav of the normal portions, hr, hg And hr can also be used to calculate correction values Rc, Gc, and Bc. In this case, since the correction according to the signal value of each pixel is possible, the correction accuracy is improved.

The skin processing unit 6 discharges the R, G, and B foundations contained in each ink cartridge 61 from each ink jet head 62 in accordance with the signal value input from the control unit 1 and applies it to the skin. Since the signal value of the singular part is corrected to have the same color and brightness as the normal part, the foundation is applied to the skin so that the skin color after application has a uniform color and brightness throughout the skin. You can adjust the color and brightness level. Further, since the correction coefficient K is switched depending on whether the hair is raised or not, the strength of the foundation applied to the skin and the level of brightness can be adjusted by switching the strength of the correction depending on the type of skin condition of the specific part. .
After application, the control unit 1 sets the application end flag of the pixel to be applied to 1 in the flag table 2b (step S409).

Thereafter, when the movement of the skin treatment device 10 is detected by the motion detection unit 7 (step S410; Y), the process returns to step S403 and the above-described processing is repeated.
When the movement of the skin treatment apparatus 10 is not detected for a predetermined time by the motion detection unit 7 (step S410; N), the control unit 1 searches for a 0 application end flag in the flag table 2b. When the application end flag of 0 is detected (step S411; Y), an alert screen is displayed on the display unit 4 to notify the user that there is unpainted (step S412). On the alert screen, the skin treatment device 10 may prompt the user to rescan the surface of the skin, or the user may be notified of the position of the unpainted skin based on the coordinates of the pixel whose application end flag is 0. . Thereafter, the processing returns to step S403, and the above-described processing is repeated.

  When the application end flag of 0 is not detected (step S411; N), since the cosmetic has been applied to the entire surface of the skin, the process proceeds to an inspection process. The inspection process is a process for confirming whether or not the cosmetic has been sufficiently applied. The inspection process is not always executed, but may be arbitrarily executed as necessary, for example, when instructed by the user.

FIG. 12 shows the processing procedure of step S5 for executing the inspection processing.
As shown in FIG. 12, in the skin treatment apparatus 10, the alert screen is displayed on the display 41 by the display unit 4 (step S51). In the alert screen, one end of the skin treatment apparatus 10 is brought close to the user's skin, and the user is prompted to scan the entire skin with the skin treatment apparatus 10 after operating the execution switch 33. After that, until the execution switch 33 is operated (step S52; N), the process returns to step S51 and the alert display by the display unit 4 is continued.
When the execution switch 33 is operated by the user (step S52; Y), the image acquisition unit 5 irradiates light with the light source 51 to acquire a skin image (step S53).

The control unit 1 extracts feature points from the obtained skin image in the same manner as in step S24, and collates with feature points extracted from the previous skin image obtained at the time of executing the skin processing. Then, the control unit 1 assigns the same coordinates as the feature points of the previous skin image to the matching feature points, and assigns the coordinates to each pixel of the skin image acquired with the assigned coordinates as a reference. The position at is specified (step S54).
The control unit 1 determines whether or not the signal value of each pixel whose position is specified matches the average value of the normal part calculated in step S32. Note that if the difference between the signal value and the average value is less than the threshold value, it is determined that they match, and if the difference is greater than or equal to the threshold value, it may be determined that they do not match.

When the signal value and the average value do not match (step S55; N), the control unit 1 determines that the cosmetic is not sufficiently applied by the skin treatment. In this case, an alert screen is displayed on the display 41 by the display unit 4 (step S56). On the alert screen, the user may be notified that there is an insufficiently applied skin portion, or may be prompted to reapply.
When the signal value matches the average value (step S55; Y), the alert is not displayed because the cosmetic is sufficiently applied by the skin treatment.

Thereafter, when the movement of the skin treatment device 10 is detected by the motion detection unit 7 (step S57; Y), the process returns to step S53, and the above-described processing is repeated at the position after the movement.
When the movement of the skin treatment device 10 is not detected for a predetermined time by the motion detection unit 7 (step S57; N), the inspection process is terminated.

As described above, the skin processing apparatus 10 according to the present embodiment determines the user's skin state using the image acquisition unit 5 that acquires the user's skin image and the skin image obtained by the image acquisition unit 5. The control part 1 and the skin process part 6 which performs the skin process of the level according to the skin state determined by the control part 1 with respect to a user's skin are provided.
Thereby, the level of the skin processing can be switched according to the skin state, and the skin processing according to the skin state can be executed.

In the skin treatment apparatus 10, the control unit 1 uses the skin image obtained by the image acquisition unit 5 to detect a specific part of the skin state in the user's skin, and determines that the skin part that is not the specific part is in the skin state. Determine as normal part.
Moreover, the control part 1 determines the kind of skin state of the detected special part.
The control unit 1 further specifies the position of the unique part and / or the normal part on the user's skin.
In addition, the skin processing unit 6 performs skin processing according to the specific part and / or the normal part detected by the control unit 1 according to the position of each skin specified by the control unit 1.
Thereby, a user's skin can be divided | segmented into a specific part and a normal part, and the appropriate skin process according to each can be performed.

In the skin processing device 10, the image acquisition unit 5 acquires skin images at regular intervals while the position of the skin processing device 10 with respect to the skin moves, and the control unit 1 uses the image acquisition unit 5 to perform regular intervals. Feature points are extracted from each of the obtained plurality of skin images, and the positions of the singular part and the normal part on the skin are specified based on the feature points.
Thereby, the position which applies cosmetics to skin can be pinpointed correctly, and the skin process according to the peculiar part and the skin process according to the normal part can be switched with sufficient accuracy.

In the skin treatment apparatus 10, the skin treatment unit 6 performs skin treatment for applying cosmetics to the user's skin as one type of skin treatment.
The skin treatment unit 6 includes an inkjet head 62, and cosmetics are applied by the inkjet head 62.
Therefore, it is possible to finish the skin with a smooth texture.

Moreover, the skin processing part 6 adjusts the level of the color and brightness of cosmetics according to each of a peculiar part and a normal part.
Further, the control unit 1 determines the singularity according to the difference between the signal value of the singular part in the skin image and the signal value of the normal part in the skin image so that the color and brightness of the singular part match the normal part. The skin processing unit 6 corrects the signal value of the part, and adjusts the color and brightness levels of the cosmetic according to the signal value corrected by the control unit 1.
Thereby, the color and brightness level of the cosmetics applied to the skin can be adjusted so that the color, surface shape, etc. of the skin after application are uniform throughout the skin.

Types of skin conditions in the unique part include spots, subcutaneous blood vessels, wrinkles, pores or raised hair.
Therefore, it is possible to execute skin treatment according to blots, subcutaneous blood vessels, wrinkles, pores, or raising.

Moreover, the image acquisition part 5 acquires each skin image when not irradiating light with the light source 51, and the control part 1 uses the skin image obtained by irradiating light, and light. In any skin image obtained without irradiation, a dark image portion whose brightness is less than a threshold value is detected as a unique portion.
As a result, it is possible to accurately detect a singular part having a brightness different from that of the normal part.

In addition, the control unit 1 compares the skin image obtained by irradiating the light with the skin image obtained without irradiating the light, and detects an image portion where the brightness is changed. When one end of the image portion and the dark image portion coincide with each other, the dark image portion is detected as a unique portion, and the unique portion is determined to be raised.
Thereby, it is possible to accurately detect a skin portion with raised hair as a unique portion.

[Modification 1]
In the skin treatment apparatus 10, the skin treatment unit 6 may perform a process of irradiating laser light to specific parts such as spots and pores as one type of skin treatment.
When a plurality of types of skin processing are possible in this way, the skin processing unit 6 can execute the types of skin processing according to the skin state. Specifically, the skin treatment unit 6 determines whether the skin state is a normal part or a peculiar part of the skin state, and whether it is a stain, a wrinkle, a pore, a blood vessel, or a brushed skin state. Execute by switching the type of processing. For example, the skin processing unit 6 can execute a skin process in which a cosmetic liquid is applied to the normal part of the skin state, and can perform a process of irradiating the specific part of the spot with laser light.
Thereby, the kind of skin treatment can be switched according to a skin state, and it becomes possible to perform the skin treatment according to the skin state.
The skin processing unit 6 can also perform skin processing at a level corresponding to the skin condition in the type of skin processing corresponding to the skin condition.

[Modification 2]
Moreover, the skin treatment apparatus 10 can also apply cosmetics as one type of skin treatment so as to form images such as characters, graphics, and photographs on not only the user's face but also skin such as limbs.
Specifically, an image table 2c as shown in FIG. 13 is stored in the storage unit 2, and the control unit 1 reads out the image selected by the user from the table 2c and outputs it to the skin processing unit 6. The skin processing unit 6 ejects R, G, and B color foundations by the inkjet head 62 according to the R, G, and B signal values of the input image and applies them to the user's skin.

[Modification 3]
In the above-described embodiment, the singular part of the skin state is detected by using the skin images with and without the light source. However, the inclination angle of the skin processing apparatus 10 with respect to the skin is different from the singular part other than the raising. It is also possible to detect using a plurality of different skin images.

FIG. 14 shows a processing procedure in the case where a singular part is detected using a plurality of skin images having different inclination angles in step S29 described above.
As shown in FIG. 14, in the skin treatment apparatus 10, the alert screen is displayed on the display 41 by the display unit 4 (step S61). The alert screen prompts the user to change the inclination angle of the skin treatment device 10 with respect to the user's skin after operating the execution switch 33. Thereafter, until the execution switch 33 is operated (step S62; N), the process returns to step S1 and continues displaying the alert on the display unit 4.

FIG. 15 shows the skin treatment apparatus 10 when the inclination angle θ1 with respect to the skin 100 is changed by the user.
The inclination angle θ <b> 1 is a method at the intersection point P between the light beam irradiated from the light source 51 of the image acquisition unit 5 and reflected on the surface of the skin 100 and incident on the area sensor 53 and the surface of the skin 100. The angle formed by the plane.

  When the execution switch 33 is operated by the user (step S62; Y), the motion detection unit 7 detects the inclination angle θ1 of the skin treatment device 10 with respect to the user's skin. In addition, the image acquisition unit 5 acquires a skin image every time the inclination angle θ1 detected by the motion detection unit 7 changes by a certain angle (step S63). The obtained plurality of skin images are stored in the storage unit 2. Note that the timing for acquiring the skin image may be a timing at which the change in the inclination angle θ1 becomes an arbitrary angle.

  When the acquisition of the skin image for each fixed angle is completed, the control unit 1 reads each skin image from the storage unit 2 and compares the signal values of pixels having the same position in each skin image. Since the skin color is dark or the surface shape of the skin is not flat in the specific part of the skin, the amount of light reflected and the direction of reflection on the skin surface changes greatly when the inclination angle θ1 is different. The control unit 1 searches for an image portion in which a change in signal value between a plurality of skin images having different inclination angles θ1 is equal to or greater than a threshold value as a unique portion of the skin state. When an image part whose signal value change is equal to or greater than the threshold value is detected (step S64; Y), the control unit 1 collates the detected image part with a sample image of a specific part stored in the sample table 2a. To do. If it matches any of the sample images (step S65; Y), the control unit 1 detects that the detected image portion is a unique portion, and the skin state type of the specific portion matches the sample image. It is determined to be a pore. In the flag table 2b, the control unit 1 sets, for each pixel of the detected image portion, a flag for a specific portion of a spot, wrinkle, pore, or blood vessel that matches the sample image, and sets a flag for a mismatched specific portion. Is set to 0 (step S66).

  On the other hand, when the image portion whose signal value change is equal to or greater than the threshold is not detected (step S64; N), or when it is detected but does not match any sample image (step S65; N), the control unit 1 sets the flag table 2b. In step S67, all the spots, wrinkles, pores, and singular part flags of the blood vessel pixels are set to 0 (step S67).

As described above, the skin treatment apparatus 10 detects the inclination angle of the skin treatment apparatus 10 with respect to the skin by the motion detection unit 7, acquires skin images having different inclination angles detected by the image acquisition unit 5, and the control unit The image portion in which the change in the signal value of the plurality of skin images having different inclination angles obtained by 1 is greater than or equal to the threshold is detected as a unique portion.
Accordingly, it is possible to accurately detect each specific portion of a spot, wrinkle, pore, and blood vessel in accordance with a change in the amount of reflected light and the reflection direction depending on the skin color, surface shape, and the like.

[Modification 4]
The skin treatment apparatus 10 can also detect a peculiar part other than the raised hair using a plurality of skin images obtained by polarizing light from the light source 51 under different polarization conditions.
When acquiring skin images with different polarization conditions, the skin processing apparatus 10 includes a first polarizer positioned between the light source 51 and the skin, and a second polarizer positioned between the skin and the area sensor 53. And changing at least one of the polarization conditions of the grating width and grating angle of each of the gratings of the first polarizer and the second polarizer. The polarization condition is changed by replacing a plurality of polarization covers, each of which is provided with a first polarizer and a second polarizer and can be attached to one end of the skin treatment apparatus 10 and each of which has a different polarization condition. It may be realized, or may be realized by providing a slide mechanism capable of sequentially exchanging the first polarizer and the second polarizer having different polarization conditions at one end of the skin treatment apparatus 10.

FIG. 16A shows a cross-sectional view of one end of the skin treatment apparatus 10 to which the polarizing cover 20 is attached as an example of the case where the polarizing cover is used. FIG. 16B is a perspective view illustrating the appearance of the polarizing cover 20.
As shown in FIGS. 16A and 16B, the polarization cover 20 includes a first polarizer 21 and a second polarizer 22. The first polarizer 21 is disposed on the optical path of light that is irradiated from the light source 51 and incident on the skin 100, and polarizes the light. The second polarizer 22 is disposed on the optical path of light incident on the area sensor 53 after passing through the first polarizer 21 and reflected by the skin 100, and polarizes the light. If the 1st polarizer 21 and the 2nd polarizer 22 can polarize light, they can be a polarizing lens, a polarizing film, etc., for example.

Each of the plurality of polarization covers 20 includes a grating width L1 of the first polarizer 21, a grating width L2 of the second polarizer 22, and a grating of the first polarizer 21 and the second polarizer 22 shown in FIG. At least one of the polarization conditions of the grating angle θ <b> 2 formed by the grating is different from that of the other polarizing cover 20.
For example, when the skin treatment apparatus 10 includes three polarizing covers 20, one of them can have a grating width L1 of 10 nm, a grating width L2 of 10 nm, and a grating angle θ2 of 0 °. Further, one of the other polarizing covers 20 has a grating width L1 of 20 nm, a grating width L2 of 20 nm, a grating angle θ2 of 0 °, and another grating width L1 of 10 nm, a grating width L2 of 10 nm, a grating The angle θ2 can be set to 30 °.

As shown in FIG. 16A, the housing of the skin treatment apparatus 10 is provided with a locking hole 9 that engages with the claw 23 of the polarizing cover 20. The polarizing cover 20 can be attached to one end of the skin treatment device 10 by engaging the locking hole 9 with the claw 23 of the polarizing cover 20.
A cover detector 8 for detecting the attached polarizing cover 20 is provided on the wall surface of the locking hole 9. When the cover detection unit 8 comes into contact with the claw 23 of the polarization cover 20 by attachment, the cover detection unit 8 outputs a detection signal of the polarization cover 20. As long as the attachment of the polarizing cover 20 can be detected, the detection method of the cover detection unit 8 is not limited to such a contact method, and may be an optical method or the like.

FIG. 17 shows a processing procedure in the case where a singular part is detected using skin images with different polarization conditions in step S29 described above.
As shown in FIG. 17, in the skin treatment apparatus 10, an alert screen is displayed on the display 41 by the display unit 4 (step S71). By displaying the alert screen, the user is prompted to attach one of the plurality of polarizing covers 20 to the skin treatment apparatus 10 and operate the execution switch 33. Until the detection signal of the polarization cover 20 is output from the cover detection unit 8 and the execution switch 33 is further operated (step S72; N, S73; N), the process returns to step S71 and the alert display by the display unit 4 is continued.

When the polarization cover 20 is attached, the detection signal of the polarization cover 20 is output from the cover detection unit 8 (step S72; Y), and when the execution switch 33 is further operated (step S73; Y), the image acquisition unit 5 Light is emitted from the light source 51 and a skin image is acquired by the area sensor 53 (step S74). The obtained skin image is stored in the storage unit 2.
When acquisition of the skin image using all the prepared polarizing covers 20 has not been completed (step S75; N), an alert is displayed on the display unit 4 (step S76). In the alert display, the user is prompted to operate the execution switch 33 by replacing the remaining polarizing cover 20. After that, the process returns to the process of step S72 and the skin image acquisition is repeated by the exchanged polarizing cover 20.

  When acquisition of skin images using all the polarizing covers 20 is completed (step S75; Y), the control unit 1 compares the obtained plurality of skin images. Since the skin color is dark or the surface shape of the skin is not flat in the specific part of the skin state, the change in the amount of light reflected and the reflection direction on the skin surface when the polarization condition is changed is large. Therefore, the control unit 1 searches for an image part whose signal value change is greater than or equal to a threshold value among a plurality of skin images having different polarization conditions as a specific part of the skin state.

  When an image part whose signal value change is equal to or greater than the threshold value is detected (step S77; Y), the control unit 1 detects the detected image part and each specific part of the spot, wrinkle, blood vessel, and pore in the sample table 2a. Match the sample image. If it matches any of the sample images (step S78; Y), the control unit 1 detects that the detected image portion is a unique portion, and the type of skin state of the specific portion matches the sample image. It is determined to be a pore. In the flag table 2b, the control unit 1 sets, for each pixel of the detected image portion, a flag for a specific portion of a spot, wrinkle, pore, or blood vessel that matches the sample image, and sets a flag for a mismatched specific portion. Is set to 0 (step S79).

  On the other hand, when the image portion whose signal value change is not less than the threshold value is not detected (step S77; N), or when it is detected but does not match any sample image (step S78; N), the control unit 1 sets the flag table 2b. In step S80, the stain, wrinkle, pore, and blood vessel flags are all set to 0.

As described above, the skin treatment apparatus 10 is located between the skin and the light source 51, and is located between the first polarizer 21 that polarizes the light emitted from the light source 51 and the skin and the area sensor 53. A second polarizer 22 that polarizes light incident on the area sensor 53 after passing through the first polarizer 21 and being reflected on the skin, and the image acquisition unit 5 uses the grating width of the first polarizer 21. The skin image is acquired every time at least one of the polarization conditions of the grating width of the second polarizer 22 and the grating angle formed by the grating of the first polarizer 21 and the grating of the second polarizer 22 is changed. Then, the control unit 1 detects, as a singular part, an image part in which the change in the signal value of the plurality of skin images obtained each time at least one of the polarization conditions is changed is greater than or equal to the threshold value.
Accordingly, it is possible to accurately detect each specific portion of a spot, wrinkle, pore, and blood vessel in accordance with a change in the amount of reflected light and the reflection direction depending on the skin color, surface shape, and the like.

Note that the singular part can also be detected by combining the third modification and the fourth modification.
For example, as in the third modification, the first candidate of the singular part is detected using a plurality of skin images obtained at every fixed angle at which the inclination angle of the skin processing apparatus 10 with respect to the skin changes. Further, as in Modification 4, the second candidate for the singular part is detected using a plurality of skin images obtained each time the polarization condition is polarized. And the specific part which is the 1st candidate and is also the 2nd candidate is detected as a true specific part. Thereby, the detection accuracy of a specific part can be improved.

The above-described embodiment is a preferred example of the present invention, and the present invention is not limited to this. Modifications can be made as appropriate without departing from the spirit of the present invention.
For example, in the above embodiment, after the skin surface is scanned by the skin processing apparatus 10 to determine whether it is a unique part or a normal part of the skin state, the skin surface is scanned again by the skin processing apparatus 10 to perform skin processing. However, the determination of the skin state and the skin processing may be performed by a single scan.

  Moreover, although the example which adjusts the level of the color and brightness of cosmetics was shown in the said embodiment, the skin process part 6 can also adjust the level of the coating amount or density | concentration of cosmetics. For example, when a skin care cosmetic is applied, the application amount can be double the reference amount for a specific portion and the reference amount for a normal portion. Also, two types of cosmetics for skin care, low-concentration lotion and high-concentration cosmetics, are prepared. Low cosmetics can be applied.

  In addition, the skin treatment method of the skin treatment unit 6 is not limited to the above-described ink jet method as long as the color, brightness, application amount, or concentration level of the cosmetic can be adjusted, and other methods such as a spray method. A method may be used.

  Moreover, in the said embodiment, although the skin process was performed with respect to human skin, if it is a biological body, it will not be limited to human skin, and the skin process mentioned above may be performed with respect to the skin (surface) of animals and plants. it can.

Although several embodiments of the present invention have been described, the scope of the present invention is not limited to these embodiments, and includes the scope of the invention described in the claims and a scope equivalent to the invention.
In the following, the invention described in the scope of claims attached to the application of this application is added. The number of the claim described in the appendix is as in the scope of the claims initially attached to the application of this application.

[Appendix]
[Claim 1]
Image acquisition means for acquiring a skin image of a living body;
Using the skin image obtained by the image acquisition means, a skin condition determination means for determining the skin condition of the living body;
Skin treatment means for executing skin treatment of the type or level corresponding to the skin condition determined by the skin condition determination means for the skin of the living body;
A skin treatment apparatus comprising:
[Claim 2]
The skin condition determination unit detects a specific part of the skin condition in the skin of the living body using the skin image obtained by the image acquisition unit, and sets a skin part that is not the specific part as a normal part of the skin condition. The skin treatment device according to claim 1, wherein the skin treatment device is determined.
[Claim 3]
The skin condition determination means detects a specific part of the skin condition in the skin of the living body using the skin image obtained by the image acquisition means, and determines the type of the skin condition of the specific part. The skin treatment apparatus according to claim 1 or 2.
[Claim 4]
The skin treatment apparatus according to claim 2, wherein the skin condition determination unit further specifies a position of the specific part and / or the normal part on the skin of the living body.
[Claim 5]
The skin processing means executes the skin processing according to the specific part and / or the normal part detected by the skin condition determining means at each skin position specified by the skin condition determining means. The skin treatment apparatus of Claim 4 characterized by these.
[Claim 6]
The image acquisition means acquires the skin image at regular intervals while the position of the skin treatment device moves relative to the skin,
The skin condition determination unit extracts feature points from each of a plurality of skin images obtained at regular intervals by the image acquisition unit, and positions of the singular part and the normal part in the skin based on the feature points The skin treatment device according to claim 4, wherein the skin treatment device is specified.
[Claim 7]
The skin treatment device according to any one of claims 2 to 6, wherein the skin treatment unit performs skin treatment for applying cosmetics to the skin of the living body as one type of the skin treatment. .
[Claim 8]
The skin treatment apparatus according to claim 7, wherein the skin treatment unit includes an inkjet head, and the cosmetic is applied by the inkjet head.
[Claim 9]
The skin treatment means adjusts the level of color, brightness, application amount, or concentration of the cosmetic according to each of the specific part and the normal part. Skin treatment equipment.
[Claim 10]
Depending on the difference between the signal value of the specific part in the skin image and the signal value of the normal part in the skin image, the color and brightness of the specific part match the normal part. A correction means for correcting the signal value;
The skin according to claim 9, wherein the skin processing unit adjusts the level of color, brightness, application amount, or density of the cosmetic according to the signal value corrected by the correction unit. Processing equipment.
[Claim 11]
The skin treatment device according to any one of claims 2 to 10, wherein the kind of skin condition of the unique portion includes a stain, a subcutaneous blood vessel, a wrinkle, a pore, or a raised hair.
[Claim 12]
The image acquisition means acquires the skin images when the skin is irradiated with light and when the skin is not irradiated with light,
The skin condition determining unit is configured to detect a dark image portion whose brightness is less than a threshold value in both the skin image obtained by irradiating the light and the skin image obtained without irradiating the light. The skin treatment device according to any one of claims 2 to 11, wherein the skin treatment device is detected.
[Claim 13]
The skin condition determining means detects an image part in which brightness is changed by comparing a skin image obtained by irradiating the light with a skin image obtained without irradiating the light, and detects 13. The method according to claim 12, wherein, when one end of the image portion and the dark image portion coincide with each other, the dark image portion is detected as the singular portion, and the singular portion is determined to be raised. Skin treatment equipment.
[Claim 14]
An angle detection means for detecting an inclination angle of the skin treatment device with respect to the skin;
The image acquisition means acquires skin images having different inclination angles detected by the angle detection means,
The skin condition determining means detects, as the singular part, an image part in which a change in signal value of a plurality of skin images having different inclination angles obtained by the image acquisition means is equal to or greater than a threshold value. The skin treatment apparatus as described in any one of 2-11.
[Claim 15]
A first polarizer that is positioned between the skin and the light source and polarizes light emitted from the light source;
A second polarizer that is located between the skin and the imaging device, passes through the first polarizer and reflects on the skin, and then polarizes light incident on the imaging device;
The image acquisition means includes the polarization conditions of the grating width of the first polarizer, the grating width of the second polarizer, and the grating angle formed by the grating of the first polarizer and the grating of the second polarizer, Each time at least one is changed, the skin image is acquired,
The skin condition determining unit determines, as the singular part, an image part in which a change in signal values of a plurality of skin images obtained by the image acquiring unit is greater than or equal to a threshold every time at least one of the polarization conditions is changed. The skin treatment device according to any one of claims 2 to 11, wherein
[Claim 16]
Obtaining a skin image of the living body;
Determining the skin state of the living body using the skin image;
Executing a type or level of skin treatment according to the skin condition on the skin of the living body;
The skin treatment method characterized by including.
[Claim 17]
A computer of a skin treatment apparatus comprising: an image acquisition unit that acquires a skin image of a living body; and a skin processing unit that performs skin processing on the skin of the living body.
Image control means for acquiring a skin image of the living body by the image acquisition means;
Skin state determination means for determining the skin state of the living body using the skin image obtained by the image acquisition means;
Skin treatment control means for executing skin treatment of the type or level corresponding to the skin condition determined by the skin condition determination means on the skin of the living body by the skin treatment means;
Program to function as.

DESCRIPTION OF SYMBOLS 10 Skin treatment apparatus 1 Control part 2 Memory | storage part 2a Sample table 2b Flag table 5 Image acquisition part 51 Light source 53 Area sensor 6 Skin treatment part 61 Ink cartridge 62 Inkjet head 7 Angle detection part 8 Cover detection part 20 Polarizing cover 21 First polarization Child 22 Second polarizer

Claims (18)

A light source for irradiating a living body with light
Image acquisition means for acquiring a skin image of the living body;
Using the skin image obtained by the image acquisition means, detecting a specific part of the skin state of the living body, and determining a skin state type of the specific part,
Skin treatment means for executing skin treatment of the type or level corresponding to the skin condition determined by the skin condition determination means for the skin of the living body;
With
The skin condition determining means determines a dark first image part whose brightness is less than a threshold value in two skin images in a state in which the living body is irradiated with light from the light source and a state in which the light is not irradiated. A skin treatment apparatus characterized by detecting as follows . Image acquisition means for acquiring a skin image of a living body;
Using the skin image obtained by the image acquisition means, detecting a specific part of the skin state of the living body, and determining a skin state type of the specific part,
Skin treatment means for executing skin treatment of the type or level corresponding to the skin condition determined by the skin condition determination means for the skin of the living body;
An angle detecting means for detecting an inclination angle of the skin treatment device with respect to the skin;
With
The image acquisition means acquires a plurality of skin images having different inclination angles detected by the angle detection means,
The skin condition determining means detects, as the singular part, an image part in which a change in signal value of a plurality of skin images having different inclination angles obtained by the image acquiring means is equal to or greater than a threshold value. Processing equipment. A light source for irradiating a living body with light;
Image acquisition means for acquiring a skin image of the living body;
Using the skin image obtained by the image acquisition means, detecting a specific part of the skin state of the living body, and determining a skin state type of the specific part,
Skin treatment means for executing skin treatment of the type or level corresponding to the skin condition determined by the skin condition determination means for the skin of the living body;
The image acquisition means includes an imaging element for acquiring a biological skin image;
A first polarizer located between the skin and the light source and polarizing light emitted from the light source with a first polarization condition;
A second polarizer located between the skin and the imaging device and having a second polarization condition to polarize light incident on the imaging device;
With
The image acquisition means acquires the skin image every time at least one of the first polarization condition of the first polarizer and the second polarization condition of the second polarizer is changed,
The skin condition determination means has a signal value change greater than or equal to a threshold value in the plurality of skin images obtained by the image acquisition means every time at least one of the first polarization condition and the second polarization condition is changed. A skin processing apparatus, wherein an image portion is determined as the unique portion. The skin treatment apparatus according to any one of claims 1 to 3, wherein the skin condition determination unit determines a skin part that is not the unique part as a normal part of the skin condition. The skin treatment apparatus according to claim 4, wherein the skin condition determination unit further specifies a position of the specific part and / or the normal part on the skin of the living body. The skin processing means executes the skin processing according to the specific part and / or the normal part detected by the skin condition determining means at each skin position specified by the skin condition determining means. The skin treatment apparatus of Claim 5 characterized by these. The image acquisition means acquires the skin image at regular intervals while the position of the skin treatment device moves relative to the skin,
The skin condition determination unit extracts feature points from each of a plurality of skin images obtained at regular intervals by the image acquisition unit, and positions of the singular part and the normal part in the skin based on the feature points The skin treatment device according to claim 4, wherein the skin treatment device is specified. The skin treatment device according to any one of claims 4 to 7, wherein the skin treatment unit performs skin treatment for applying cosmetics to the skin of the living body as one type of the skin treatment. . The skin treatment apparatus according to claim 8, wherein the skin treatment means includes an inkjet head, and the cosmetic is applied by the inkjet head. The skin treatment means adjusts the level of color, brightness, application amount, or density of the cosmetic according to each of the specific part and the normal part. Skin treatment equipment. Depending on the difference between the signal value of the specific part in the skin image and the signal value of the normal part in the skin image, the color and brightness of the specific part match the normal part. A correction means for correcting the signal value;
The skin according to claim 10, wherein the skin processing unit adjusts the level of color, brightness, application amount, or density of the cosmetic according to the signal value corrected by the correction unit. Processing equipment. The skin treatment apparatus according to any one of claims 1 to 11, wherein the kind of skin condition of the specific part includes a stain, a subcutaneous blood vessel, a wrinkle, a pore, or a raised hair. Obtaining a skin image of the living body;
Detecting a specific part of the skin state of the living body using the skin image, and determining a type of the skin state of the specific part;
Executing a type or level of skin treatment according to the skin condition on the skin of the living body;
Including
The step of acquiring the skin image includes the step of acquiring two skin images in a state where the living body is irradiated with light from a light source and a state where the light is not irradiated.
The step of determining the type of the skin condition includes detecting a dark first image portion whose brightness is less than a threshold value in the two skin images as the unique portion. Obtaining a skin image of the living body;
Detecting a specific part of the skin state of the living body using the skin image, and determining a type of the skin state of the specific part;
Executing a type or level of skin treatment according to the skin condition on the skin of the living body;
Detecting an inclination angle of the skin treatment device with respect to the skin;
Including
The step of acquiring the skin image acquires a plurality of skin images with different detected inclination angles,
The step of determining the type of the skin state includes an image portion in which a change in signal values of a plurality of skin images having different inclination angles obtained by an image acquisition unit that acquires the skin image of the living body is equal to or greater than a threshold value, A skin treatment method characterized by detecting as a peculiar part. Obtaining a skin image of the living body;
Detecting a specific part of the skin state of the living body using the skin image, and determining a type of the skin state of the specific part;
Executing a type or level of skin treatment according to the skin condition on the skin of the living body;
Including
The step of acquiring the skin image includes
A first polarization condition of a first polarizer, which is located between the skin and a light source that irradiates light to the living body and has a first polarization condition and polarizes light emitted from the light source, and the skin and imaging Each time at least one of the second polarization condition of the second polarizer that is positioned between the element and has a second polarization condition to polarize light incident on the imaging element is changed, the skin Get an image
Each time at least one of the first polarization condition and the second polarization condition is changed, a change in signal value is equal to or greater than a threshold in the plurality of skin images obtained by the image acquisition unit that acquires the skin image of the living body. A skin processing method, wherein an image portion is determined as the unique portion. A computer of a skin treatment apparatus comprising: a light source that irradiates light on a living body; an image acquisition unit that acquires a skin image of the living body; and a skin processing unit that performs skin processing on the skin of the living body.
Image control means for acquiring a skin image of the living body by the image acquisition means;
Using the skin image obtained by the image acquisition unit, a skin state determination unit that detects a specific part of the skin state of the living body and determines the type of the skin state of the specific part,
Skin treatment control means for executing skin treatment of the type or level corresponding to the skin condition determined by the skin condition determination means on the skin of the living body by the skin treatment means;
Function as
The skin condition determining means determines a dark first image part whose brightness is less than a threshold value in two skin images in a state in which the living body is irradiated with light from the light source and a state in which the light is not irradiated. Program to detect as. A computer of a skin treatment apparatus comprising: an image acquisition unit that acquires a skin image of a living body; and a skin processing unit that performs skin processing on the skin of the living body.
Image control means for acquiring a skin image of the living body by the image acquisition means;
Using the skin image obtained by the image acquisition unit, a skin state determination unit that detects a specific part of the skin state of the living body and determines the type of the skin state of the specific part,
An angle detection means for detecting an inclination angle of the skin treatment device with respect to the skin;
Skin treatment control means for executing skin treatment of the type or level corresponding to the skin condition determined by the skin condition determination means on the skin of the living body by the skin treatment means;
Function as
The image acquisition means acquires a plurality of skin images having different inclination angles detected by the angle detection means,
The skin condition determining unit is a program for detecting, as the singular part, an image part in which a change in signal value of a plurality of skin images having different inclination angles obtained by the image acquiring unit is greater than or equal to a threshold. A light source for irradiating light to a living body, an imaging device, a first polarizer positioned between the skin and the light source, and polarizing light emitted from the light source under a first polarization condition; and the skin A second polarizer for polarizing light incident on the image sensor having a second polarization condition, the first polarization condition for the first polarizer, and the second An image acquisition unit that acquires a skin image of the living body and a skin processing unit that performs skin processing on the skin of the living body each time at least one of the second polarization conditions of the polarizer is changed. Equipped with a computer for the skin treatment device,
Image control means for acquiring a skin image of the living body by the image acquisition means;
Using the skin image obtained by the image acquisition unit, a skin state determination unit that detects a specific part of the skin state of the living body and determines the type of the skin state of the specific part,
Skin treatment control means for executing skin treatment of the type or level corresponding to the skin condition determined by the skin condition determination means on the skin of the living body by the skin treatment means;
Function as
The image acquisition means acquires the skin image every time at least one of the first polarization condition of the first polarizer and the second polarization condition of the second polarizer is changed,
The skin condition determination means has a signal value change greater than or equal to a threshold value in the plurality of skin images obtained by the image acquisition means every time at least one of the first polarization condition and the second polarization condition is changed. A program for determining an image part as the specific part.

Images