JP2022141203A - Skin information collection and utilization system - Google Patents

Abstract

A skin information collection and utilization system that comprises element state acquisition means for acquiring a state of a predetermined element of skin at a monitoring target part and treatment means comprising a treatment unit and a treatment control unit for controlling treatment strength and/or notification means comprising a notification unit and a notification information generation unit for generating notification information performs treatment and/or information provision depending on a state of the predetermined element. The skin information collection and utilization system comprises: temporary variation detection means for detecting a temporary state variation by comparing the acquired state of the predetermined element with a past state; and exposure degree estimation means for estimating an ultraviolet radiation exposure degree on the basis of a degree of the detected temporary state variation. On the basis of the estimated ultraviolet radiation exposure degree, the skin information collection and utilization system performs treatment using the treatment means and/or information provision using the notification means.SELECTED DRAWING: Figure 2

Description

The present invention relates to a skin information collection/utilization system.

Healthy and beautiful skin is one of the important appearance factors that draw out the attractiveness of a person regardless of gender. Therefore, in order to maintain beautiful skin for a long time, it is desirable to continuously care for the skin, and it is more desirable to use an effective method.

For example, in order to efficiently prevent blemishes, it is effective to intensively care for areas where blemishes are likely to occur.

In particular, skin that has been exposed to a lot of ultraviolet rays is highly likely to develop blemishes, and intensive care for such areas is effective in keeping the skin beautiful.

Therefore, conventionally, tools have been proposed for counselors in beauty salons to advise customers about skin conditions based on weather information such as the amount of ultraviolet rays and temperature (see, for example, Patent Document 1.).

According to such a tool, it is possible to give advice considering the effects of weather conditions such as ultraviolet rays and temperature, so it is possible to perform accurate skin counseling.

JP 2006-103051 A

However, although the above-mentioned conventional skin counseling tools can include the degree of UV exposure in consideration, which part of the subject (hereinafter simply referred to as the subject) for treatment, counseling, etc. It was not intended to grasp how much UV exposure was received.

The present invention has been made in view of such circumstances, and it is possible to estimate that the subject has been exposed to a lot of ultraviolet rays and the part that has been exposed to a lot from temporary skin changes, and to provide treatment and advice. provide a system for collecting and using skin information.

In order to solve the conventional problems described above, the skin information collection/utilization system according to the present invention includes (1) an element state acquiring means for acquiring the state of a predetermined element of the skin of the monitoring target site, and performs skin treatment. and a treatment control unit that controls the intensity of the treatment of the treatment unit based on the degree of exposure of the skin to the estimated ultraviolet rays; a notification unit that provides information on the skin; and a reporting means comprising a reporting information generating unit that generates reporting information to be supplied to the reporting unit based on the degree of exposure to ultraviolet rays that the skin is estimated to have received, and acquiring a skin information collection/utilization system for performing treatment and/or providing information according to the condition of a predetermined element of the skin of a monitoring target site of a subject, wherein the state of the predetermined element acquired by the element state acquisition means; Temporary change detection means for detecting a temporary change in the condition of the predetermined element of the skin of the monitoring target site by comparing with the past state of the predetermined element; an exposure degree estimating means for estimating the degree of exposure of the skin of the monitoring target site to ultraviolet rays based on the degree of change in the state of the skin; We decided to perform treatment by and/or information provision by the notification means.
The skin information/use system according to the present invention also has the following features.
(2) The temporary change detection means may also refer to the state of the skin of other body surface parts of the predetermined element when comparing the state of the predetermined element with the past state of the predetermined element.
(3) A second element state acquiring means for acquiring the state of the predetermined element from the skin of the monitoring target site or the skin of another body surface site from which the element state acquiring section acquires the state of the predetermined element.
(4) The predetermined factor of the skin is skin color and/or skin temperature.
(5) Guidance means for sequentially guiding the user to the parts whose states of the predetermined elements are to be obtained by the element state obtaining means, wherein the plurality of monitoring target parts and the element state acquisition at each monitoring target part are provided. When associating with the state of the predetermined element of the skin acquired by the means, the state of the predetermined element acquired immediately after each guidance by the guidance means is set as the state of the predetermined element of the same guided region.
(6) Provide a visible light image presenting means capable of presenting a visible light image of substantially the entire face of the subject.
(7) the reporting means having a reporting section capable of displaying an image; geographical position information supply means for supplying geographical position information of the subject at a predetermined time; and UV dose information supply means, wherein the notification information generation unit provides the estimated exposure level estimated by the exposure level estimation means and the geographical position at the predetermined time supplied by the geographical position information supply means Data for displaying a calendar image in which the amount of ultraviolet rays supplied by the ultraviolet amount information supplying means and the amount of ultraviolet rays are written together for each day is supplied to the notification unit.
(8) The notification means has a notification unit capable of displaying an image, and the notification information generation unit generates weather information on a predetermined day, behavior information of a target person on the predetermined day, and target person on the predetermined day. and supplying data for displaying a daily report including information on UV countermeasures by the person and the estimated exposure degree estimated by the exposure degree estimating means to the reporting unit.
(9) Predicting the appearance of aging factors in the skin of the monitoring target site of the subject based on the history of the UV exposure degree estimated by the reporting means having a reporting unit capable of displaying an image and the exposure level estimation means; and an aging factor expression prediction means, wherein the notification information generation unit detects a temporary state change detected at a predetermined monitoring target part of the face by the temporary change detection means, and a facial condition change detected by the exposure level estimation means at least one selected from the estimated degree of exposure estimated for a predetermined monitoring target site of and skin aging factors whose expression is predicted for a predetermined monitoring target site on the face by the aging factor expression prediction means. Supplying face image data in which information is displayed at corresponding positions on the face image to the notification unit.
(10) Predicting the appearance of aging factors in the skin of the monitoring target site of the subject based on the history of the UV exposure degree estimated by the reporting means having a reporting unit capable of displaying an image and the exposure level estimation means. and an aging factor expression predicting means, wherein the notification information generating unit predicts that the skin aging factors whose appearance is predicted by the aging factor expression predicting means for a predetermined monitoring target site on the face are at corresponding positions on the face image. Supplying the drawn face image data to the notification unit.
(11) The face image is a photographed image of the subject's face.
(12) The reporting means has a reporting section capable of displaying an image, and the reporting information generating section generates data for displaying in chronological order the estimated degree of exposure estimated by the degree-of-exposure estimation means for each predetermined time. supply to the notification unit;
(13) The exposure level estimating means estimates the estimated exposure level for each monitoring target site for each predetermined time period. supply to the notification unit;
(14) The element state acquisition means and the treatment means are both constructed in two or more separate devices, and one device out of the plurality of devices is implemented.
(15) Composed of a skin information collecting device comprising the elemental condition acquiring means and a skin information analyzing device comprising the temporary change detecting means and the exposure degree estimating means, and the treatment means and/or notification The means is provided in the skin information collection device or the skin information analysis device.
(16) The skin information analysis device comprises an information communication terminal to which the skin information collection device is connected, and an information server device connected to the information communication terminal via the Internet, and the treatment means and/or The notification means is provided in the skin information collection device or the information communication terminal.
(17) The skin information collecting device includes imaging means for capturing an image of substantially the entire face of the subject person, and includes a plurality of predetermined monitoring target regions in the face, and the skin information collecting device at any one of these monitoring target regions. When associating with the state of the predetermined skin element acquired by the skin information collection device, the plurality of monitoring targets based on the face image captured by the imaging means during the acquisition of the state of the skin predetermined element estimating a part to be monitored from which the state of the predetermined element is obtained from among the parts, and setting the state of the predetermined element obtained when the face image is taken as the state of the predetermined element in the estimated part to be monitored; .

According to the skin information collection/use system according to the present invention, the element state acquiring means for acquiring the state of the predetermined element of the skin of the monitoring target site is provided, the treatment unit performs the skin treatment, and the skin is estimated to have received the treatment. A treatment means comprising a treatment control unit for controlling the intensity of treatment by the treatment unit based on the degree of exposure to ultraviolet rays, a notification unit for notifying information about the skin, and exposure to ultraviolet rays to which the skin is presumed to have been exposed. and at least one of a notification means comprising a notification information generation unit for generating notification information to be supplied to the notification unit based on the degree of the obtained skin condition of the monitoring target part of the subject. A skin information collection/utilization system for performing treatment and/or providing information according to the state of a predetermined element, wherein the state of the predetermined element obtained by the element state obtaining means is compared with the past state of the predetermined element. a temporary change detection means for detecting a temporary change in condition of a predetermined element of the skin of the monitoring target site; Provided with exposure level estimation means for estimating the level of UV exposure of the skin of the target part, based on the UV exposure level estimated by said exposure level estimation means, treatment by said treatment means and/or provision of information by said reporting means. To provide a system for collecting and using skin information that can estimate the amount of exposure to UV rays and the areas that have been exposed to a lot of UV rays based on temporary changes in the subject's skin, and provide treatment and advice. can be done.

FIG. 2 is an explanatory diagram showing a usage state of the skin information collection/utilization system according to this embodiment; 1 is an explanatory diagram showing the configuration of a skin information collection/utilization system; FIG. FIG. 4 is an explanatory diagram showing the configuration of a user input screen; FIG. 4 is an explanatory diagram showing the usage state of the skin information collection/utilization system; FIG. 4 is an explanatory diagram showing the structure of a calendar image; FIG. 4 is an explanatory diagram showing the structure of a daily report image; FIG. 4 is an explanatory diagram showing the structure of an information display screen; FIG. 10 is an explanatory diagram showing the configuration of a future face display screen; FIG. 10 is an explanatory diagram showing a mounted state of the close-up lens unit; FIG. 4 is an explanatory diagram showing a usage state of the close-up lens unit; FIG. 2 is an explanatory diagram showing the configuration of a skin information collection device provided with a macro lens camera section; FIG. 4 is an explanatory diagram showing the configuration of a skin analysis screen; FIG. 10 is an explanatory diagram showing the appearance of a second skin information collection/utilization system; FIG. 11 is an explanatory diagram showing a usage state of the second skin information collection/utilization system; FIG. 11 is an explanatory diagram showing a mirror-type user device of a third skin information collection/utilization system; FIG. 10 is an explanatory diagram showing the configuration of a third skin information collection/utilization system; It is an explanatory view showing the configuration of the mirror-type user device.

The present invention includes an element state acquisition means for acquiring the state of a predetermined element of the skin of the monitoring target site, and the treatment unit that performs the skin treatment, and the above-mentioned based on the degree of exposure of the ultraviolet rays that the skin is estimated to have received. A treatment means having a treatment control section for controlling the intensity of treatment of the treatment section, a notification section for notifying information about the skin, and information supplied to the notification section based on the degree of exposure to ultraviolet rays that the skin is estimated to have received. and at least one of reporting means comprising a reporting information generation unit for generating reporting information, and treatment and/or treatment according to the acquired condition of the predetermined element of the skin of the monitoring target part of the subject. Or a system for collecting and using skin information that provides information, which can estimate the amount of exposure to ultraviolet rays and the areas that have been exposed to a lot from temporary changes in the subject's skin, and provide treatment and advice. It provides an information collection/utilization system.

Hereinafter, the skin information collection/utilization system according to this embodiment will be described with reference to the drawings.

[1. First skin information collection/utilization system]
First, the first skin information collection/utilization system A1 will be described. FIG. 1 is an explanatory diagram showing the usage state of the first skin information collection/utilization system A1.

The first skin information collection/utilization system A1 according to the present embodiment estimates the degree of exposure to ultraviolet rays from the temporary changes in the skin caused by ultraviolet rays, and based on this, provides information for keeping the skin beautiful. system.

Also, the first skin information collection/utilization system A1 is used, for example, at home or at a beauty salon. Specifically, as shown in FIG. 1( a ), the user U can maintain beautiful skin by using it on his/her own skin and practicing the obtained beauty information and advice. .

In addition, as shown in FIG. 1(b), in a beauty salon or the like, a counselor becomes a user U of the first skin information collection/utilization system A1, and by using it on the skin of customers of the salon, the counselor can Based on the beauty information and advice obtained from the first skin information collection/utilization system A1, it is possible to provide more appropriate counseling and treatment. In this specification, including the description above, a person who uses the skin information collection/utilization system is referred to as a "user", and a person whose condition of a predetermined element of the skin is to be acquired by the skin information collection/utilization system. shall be referred to as the "subject". That is, the user U himself/herself is also the target person T in the embodiment shown in FIG. 1(a). In the embodiment shown in FIG. 1(b), the user U is the counselor and the target person T is the customer.

FIG. 2 is an explanatory diagram showing the overall configuration of the first skin information collection/utilization system A1. The first skin information collection/utilization system A1 includes a skin information collection device 10, a smart phone 11, an Internet network 12, and a server device 13.

The skin information collection device 10 is a device for acquiring the temperature state as a predetermined element from the skin of the monitoring target part of the subject T, in this embodiment, the skin at several places in the face, and supplying it to the smartphone 11. , which functions as an element state acquisition means in the first skin information collection/utilization system A1.

The skin information collection device 10 has a substantially cylindrical outer shape in this embodiment, and a temperature sensor 10b for measuring the temperature of the skin of the subject T with or without contact is arranged at the tip of the device. there is

The skin information collection device 10 also receives power supply from the smartphone 11 via the communication cable 10a, and transmits temperature state information obtained by the temperature sensor 10b to the smartphone 11 . Communication between the skin information collection device 10 and the smartphone 11 may be performed wirelessly. In this case, the power used by the skin information collection device 10 can be supplied from a battery or the like.

The smartphone 11 is an information communication terminal having a touch panel type liquid crystal display arranged substantially on one side, and is configured to be able to execute programs such as various applications.

In addition, camera units 16 (front camera 16f, rear camera 16b) as imaging means are provided on the front side where the liquid crystal display of the smartphone 11 is arranged and on the rear side behind it, respectively. It is also possible to acquire an image of the body and a macro image of the monitored part.

In the first skin information collection/utilization system A1, the smartphone 11 constitutes a part of the skin information analysis device together with the server device 13, functions as temporary change detection means, and provides information such as skin advice. It also functions as a notification means having a notification section that can be displayed as an image.

The smart phone 11 also incorporates a GPS (Global Positioning System) radio signal reception unit as a means for supplying geographical position information. For example, when the target person T carries the smartphone 11 around on a daily basis, the smartphone 11 can refer to when and where the target person T was based on position information and time information obtained from the radio wave signal receiving unit. Generate history. In the following description, the combination of the skin information collection device 10 and the smart phone 11 is also collectively referred to as the user device 15.

Also, the smartphone 11 can exchange information with the server device 13 via the Internet network 12 . Therefore, for example, the server device 13 is supplied with information on the position and element of the monitoring target site for which a temporary change has been detected by the temporary change detection means of the smartphone 11 (hereinafter also referred to as temporary change information). It is also possible to receive the results of analyzing these pieces of information from the server device 13 .

Functions as temporary change detection means of the first skin information collection/utilization system A1 by the smartphone 11, functions as geographical position information supply means, information communication functions with the server device 13, and power with the skin information collection device 10 Various means and functions such as the supply/information communication function are configured to be exhibited by executing a dedicated program (dedicated application) installed in the smartphone 11 in the present embodiment.

In addition, the smartphone 11 predicts the occurrence of skin aging factors such as spots, wrinkles, and uneven texture on each part of the face of the subject T based on information (described later) on the degree of exposure to ultraviolet rays estimated by the server device 13. Generates an image that functions as aging factor expression prediction means and includes notification information related to beauty based on the prediction of aging factor expression, that is, an image that is displayed on the display of the smartphone 11 to notify the user U of beauty information. It also functions as a notification information generation unit. These functions are also supposed to be implemented by the above app.

The server device 13 is a computer device that functions as exposure degree estimation means in the first skin information collection/utilization system A1, and constitutes a part of the skin information analysis device together with the smart phone 11 .

Based on the temporary change information supplied from the smartphone 11 , the server device 13 estimates the degree of exposure to ultraviolet light at each part of the face. Information about the estimated degree of exposure to ultraviolet rays is returned via the Internet network 12 to the smartphone 11 of the subject T, who is the source of the temporary change information.

Temporary change information supplied from the smartphone 11 to the server device 13 and information on the degree of exposure to ultraviolet rays estimated in correspondence therewith are stored in the database 13a. In particular, the server device 13 can be accessed by a plurality of user devices 15, such as user device 15a and user device 15b of another user, via the Internet network 12. The individual data supplied to is accumulated in the database 13a and can be utilized as big data. This big data may be provided for secondary use as well as for the operator of the first skin information collection/use system A1. That is, for example, it is possible to make a license agreement with a person who wishes to use big data, such as a cosmetic manufacturer, so that the big data can be used.

Next, regarding the first skin information collection/utilization system A1 having such a configuration, the usage procedure and processing flow will be described assuming a somewhat specific situation. Here, as shown in FIG. 1A, the target person T is the user U, and the user U carries the smartphone 11 on a daily basis. In addition, the user U has already started using the first skin information collection/utilization system A1 on a daily basis, and a predetermined Information is accumulated.

At the end of the day, before going to bed, the user U starts using the first skin information collection/utilization system A1 in order to confirm the information about the skin of today (Sunday, May 16, 20XX). By the way. Also, the subject T performed the same operation as described below before going to bed last night. Therefore, the skin information check performed by the subject T from now on is to check the information for about 24 hours from the last night's (previous) check to the present.

When using the first skin information collection/utilization system A1, the user U first activates a program for providing skin information (hereinafter also referred to as a skin information providing application) pre-installed in the smartphone 11 .

Then, as shown in FIG. 3, a screen (user input screen 20) prompting the user U to input is displayed. In addition to today's date display section 21, the user input screen 20 is provided with a countermeasure input section 22 for inputting UV countermeasures taken by the user U today, and a diary section 23 for freely inputting events of the day. and the user U makes an input for each.

In the example shown in FIG. 3, the user U inputs to the countermeasure input section 22 that he did not take any particular UV countermeasures today, and in the diary section 23, he wakes up at 6:30 in the morning and does housework. After that, I drove the car for a long time and played tennis in the sun in the afternoon.

A digital mirror section 24 is arranged on the user input screen 20 . The digital mirror unit 24 is a part that displays in real time the face of the user U photographed by the front camera 16f of the smartphone 11, and is a means for presenting a visible light image of the face to the user U, similar to a mirror (visible light image). It functions as an optical image presenting means).

The digital mirror unit 24 is used for confirmation when the user U uses the skin information collection device 10 to measure the skin of each part of the face (operation for acquiring the state of a predetermined element). That is, after inputting the countermeasure input section 22 and the diary section 23 described above, the user U connects the skin information collection device 10 to the smartphone 11 via the communication cable 10 a to construct the user device 15 .

Then, as shown in FIG. 4, the face is adjusted while referring to the digital mirror unit 24 so that the face is within the angle of view G of the front camera 16f, and the tip of the skin information collection device 10 is applied to the skin of each part of the face. , the state of a predetermined element of the skin, here the state of the temperature of the skin, is acquired for each part.

Further, in the first skin information collection/utilization system A1, four points (monitoring target parts) at which the temperature should be measured are determined in advance at the forehead, the left and right cheeks, and the chin. The tip of the information collecting device 10 is applied to the measurement, and the user U can perform the measurement from any of these four places in any order.

In other words, the smartphone 11 monitors four monitoring target regions, the forehead, the left and right cheeks, and the chin, on the face, and the skin information acquired by the skin information collection device 10 at any one of these monitoring target regions. In association with the temperature state, for example, the tip position of the skin information collection device 10 is image-analyzed based on the face image captured by the front camera 16f while the skin temperature state is being acquired by the skin information collection device 10. Then, from among the forehead, left and right cheeks, and chin, the part where the temperature condition was obtained is estimated, and the temperature condition obtained when the measurement button 10c of the skin information collection device 10 is pressed is measured at that time. It is configured to be the temperature state at the estimated site.

The user U acquires the temperature state of each monitored part in the order of right cheek→chin→left cheek→forehead (not shown). A temperature state is stored for each part.

In addition, the smartphone 11 refers to the past temperature state of each part that has been accumulated in the storage area by using the first skin information collection and utilization system A1 so far, and temporarily detect changes and determine their extent.

The operation of this temporary change detecting means is, for example, based on the past movement history and the amount of ultraviolet rays observed in the past. If the temperature is higher than this, it may be judged that a temporary change has occurred. method can be adopted.

Here, temporary changes are detected by the temporary change detection means in all four locations of the forehead, left and right cheeks, and chin, and the degree of change is "no change", "slight change", "slightly definite change", and "significant change". In the 4-grade evaluation of "change", the forehead, left cheek, and chin were evaluated as "somewhat definite change", and the right cheek as "significant change".

The smartphone 11 that has performed the operation of detecting a temporary change then transmits information (temporary change information) about the site and degree of the temporary change detected by the temporary change detection means to the server device 13 via the Internet network 12 . Send to

At the same time, the smartphone 11 stores geographical position information of the user U at each time, that is, 24-hour data, generated by accumulating data generated by a GPS radio signal receiving unit, which is a means for providing geographical position information, in a storage area. is also transmitted to the server device 13.

On the other hand, the server device 13 executes a program for functioning as a part of the first skin information collection/utilization system A1, analyzes information, and sends analysis results to each user device 15, which is a client. It is configured to function as various means such as transmission.

The server device 13 receives the temporary change information and the geographical location information supplied from the skin information collection device 10 via the Internet network 12, and the movement history based on the geographical location information and the movement information separately obtained from the Internet. Based on the information on the amount of ultraviolet rays observed in the historical area, the information on the countermeasures against ultraviolet rays input by the user U in the countermeasure input section 22 of the user input screen 20, and other various information as necessary. make an estimate.

For example, based on the moving speed obtained from the geographical location information, it is possible to obtain the result that the user U has moved by car, correct the temporary change information by taking into account the temperature, and furthermore, the server device 13 While referring to the big data accumulated in the database 13a, the degree of exposure to ultraviolet rays of the user U is estimated for each of the forehead, left and right cheeks, and chin by a known method, especially an AI method. The degree of exposure is also estimated. The estimated degree of exposure may be a numerical value, but may be evaluated by being classified into several stages. Here, it is assumed that the estimation information of the degree of exposure is output in five levels of low, slightly low, normal, slightly high, and high. Information on the degree of exposure estimated for each part and for the whole is transmitted to the smartphone 11 of the user U via the Internet network 12 .

The smartphone 11 that has received the estimated information on the degree of exposure further uses the movement history based on the GPS accumulated in the storage area and the information on the amount of ultraviolet rays in each area provided via the Internet network 12 to determine the region along the movement history. By acquiring information on the amount of ultraviolet rays and functioning as a notification information generating unit, it generates a calendar image 30 in which the estimated degree of exposure and the actual amount of ultraviolet rays according to the action history are written together.

The generated calendar image 30 is displayed on the liquid crystal touch panel of the smartphone 11, which is the notification unit, as shown in FIG. At this time, in the square on Sunday, May 16, the actual amount of ultraviolet rays according to the action history and the overall exposure degree of the user U estimated by the server device 13 functioning as exposure degree estimation means are displayed. A certain "many" is displayed as information.

Here, when the user U taps the cell for today (Sunday, May 16) with his fingertip, as indicated by the dashed line in FIG. Today's weather information obtained from the user U, today's movement history of the user U, user U's UV countermeasure information input on the user input screen 20, and information about the estimated degree of exposure for each monitoring target part and the whole Based on this, a daily report image 40 is generated.

In addition, at this time, the smartphone 11 refers to the history of the degree of exposure to ultraviolet rays that has been estimated each time the first skin information collection and utilization system A1 has been used, and based on this, the monitoring target of the user U It functions as an aging factor expression prediction means for predicting the appearance of aging factors of the skin of the site, such as age spots, wrinkles, sagging, other factors that make the face look aged, and factors that should be avoided cosmetically. In addition, the use of the first skin information collection/utilization system A1 thus far improves the accuracy of predicting the subsequent appearance of aging factors.

The generated daily report image 40 is an image in which more detailed information is summarized in a daily report format, and is displayed on the liquid crystal touch panel of the smartphone 11, which is the reporting unit, as shown in FIG.

The daily report image 40 includes today's weather information 41 , behavior information 42 of the user U, UV countermeasure information 43 , and overall estimated exposure degree information 44 .

The weather information 41 is obtained via the Internet network 12 and displays today's weather and the amount of ultraviolet rays. Here, it is displayed that the weather was fine today, May 16 (Sunday), and that the amount of ultraviolet rays was △△μw/cm ³ , which was extremely high. Although the amount of ultraviolet rays may be a specific numerical value as shown in FIG. 6, it is needless to say that only expressions classified into multiple levels such as high and low may be used.

The behavior information 42 indicates today's movement history of the user U, and here, the information is presented by displaying the trajectory on the map.

The ultraviolet ray countermeasure information 43 is information displayed based on the information input by the user U on the user input screen 20. Here, it is displayed that the user U did not take ultraviolet ray countermeasures today. there is

The estimated exposure degree information 44 is information estimated about the degree of exposure of the user U to today's ultraviolet rays, and is displayed here under the heading of influence of ultraviolet rays so that the user U can easily understand it. Here, it is displayed that the overall degree of UV exposure of the user U is estimated to be "high".

Further, the estimated exposure level information 44 includes a detailed confirmation button 44a for displaying the details of the influence of ultraviolet rays, that is, the estimated exposure level for each predetermined time period for each monitoring target site in chronological order.

When the user U presses the detail confirmation button 44a, the notification information generation unit constituting the notification means of the smartphone 11 generates image data for displaying the estimated exposure degree for each predetermined time in chronological order for each monitoring target site. is supplied to the liquid crystal touch panel, which is the notification unit, and displayed.

FIG. 7 is an explanatory diagram showing the region-by-part exposure level information display screen 50 displayed when the user U presses the detailed confirmation button 44a. As shown in FIG. 7, on the site-by-site exposure degree information display screen 50, site-by-site information 51 (51a to 51d) is displayed for each monitoring target site, namely, the forehead, right cheek, left cheek, and chin. It is

In addition, the region-specific information 51 is provided with a region display section 52a indicating the monitoring target region and a time-series display section 52b. The site display section 52a is a section that displays the degree of exposure of which site the time-series graph shown in the time-series display section 52b indicates.

The time-series display portion 52b is a portion showing a time-series graph of the degree of exposure at the portion shown in the portion display portion 52a. The degree of exposure is evaluated on a 5-point scale of "slightly high" and "high", and changes in the degree of exposure to ultraviolet rays at a predetermined monitoring target site of the user U are shown approximately every hour.

Here, when looking at the four time-series display portions 52b, the tendency of the degree of exposure common to each part is that the degree of exposure from morning to 9 o'clock is low to slightly low. It can be seen that after 12:00, they were continuously exposed to UV rays throughout the morning. In addition, although the influence of ultraviolet rays was small indoors during lunchtime, it can be seen that he was exposed to a large amount of ultraviolet rays from playing tennis in the sun for about two hours in the afternoon. After that, it can be seen that the degree of exposure gradually decreases as the sun sets while on the way home.

Also, what should be noted here is that, as shown by the dashed line in the time-series display portion 52b for the right cheek, the degree of UV exposure during the period from 9:00 to 12:00 during driving is higher than that of other parts. There are many. As will be mentioned later, this originates from the fact that the server device 13, which functions as exposure degree estimation means, estimated that the user U received strong solar radiation from the driver's seat side by considering the movement history of the user U. ing.

A time axis change button 54 is also arranged on the information display screen 50 . This time axis change button 54 is a button for changing the time axis of the time series graph displayed in the time series display section 52b, that is, the horizontal axis. plus button 54a for zooming in like 1 month→1 week→1 day, and minus button 54b for zooming out like 1 day→1 week→1 month.

For example, as shown in FIG. 7, pressing the minus button 54b when the time-series graph shown in the time-series display section 52b is a display showing changes in the degree of exposure at each time in one day causes the time axis to is zoomed out to display the variation in exposure levels for each day of the week.

Further, when the minus button 54b is pressed again in this state, the time axis is further zoomed out to display changes in the degree of exposure for each day in one month.

Conversely, when the plus button 54a is pressed while the display shows the fluctuations in the degree of exposure for each day in one month, the time axis is zoomed in to show the fluctuations in the degree of exposure for each day in one week. Return to display. If the plus button 54a is further pressed, the time-series graph shown in the time-series display section 52b returns to the display showing the variation in the degree of exposure at each hour of the day.

A return button 53 is arranged on the information display screen 50 , and the user U can return to the daily report image 40 by pressing the return button 53 .

Returning to the explanation of the daily report image 40 again, as shown in FIG. 6, in the lower half of the daily report image 40, a diagrammatic display section 45 of each part is arranged in which information about each part is described together with a face image. The diagrammatic display portion 45 for each part is composed of a face image 46 and an explanation 47 for each part.

The face image 46 is an image that allows intuitive recognition of each monitoring target part in the face. Here, it is captured by the front camera 16f when the temperature state of each monitoring target part shown in FIG. 4 is acquired. A photographed face image of the user U is adopted. Note that the face image 46 does not necessarily have to be a photographed image, and may be an illustration including the part to be monitored.

Each part commentary 47 includes at least one of information on temporary state changes in each monitoring target part, information on the estimated degree of exposure in the same part, and information on skin aging factors predicted to occur in the same part. This is a part where one piece of information is displayed, and an example in which all three pieces of information are displayed is shown here.

Further, the part commentary 47 is displayed for each monitored part, such as a part commentary 47a about the forehead, a part commentary 47b about the right cheek, a part commentary 47c about the left cheek, and a part commentary 47d about the chin.

For example, referring to section commentary 47c regarding the left cheek, the degree of temporary change is a slightly clear change, the estimated degree of exposure is estimated to be somewhat high, and furthermore, as described above, the smartphone 11 functioned as a means of predicting the expression of aging factors. Therefore, the appearance of blemishes is predicted.

Similarly, the degree of temporary change in the "forehead" and "chin" is somewhat clear, and the estimated degree of exposure is estimated to be somewhat high. It is

That is, according to analysis based on various information such as today's action history, actual UV dose, skin temperature state (element state) acquired by the skin information collection device 10, the forehead, left cheek, and chin are exposed to UV rays. This means that the degree of exposure was judged to be “somewhat high” for

On the other hand, referring to the section commentary 47b regarding the right cheek, although it is the same as the other three points in that the appearance of aging factors (blemishes) is predicted, the degree of temporary change is a remarkable change, and it is estimated The degree of exposure was estimated to be high, suggesting that it was more affected by UV than other sites.

When the server device 13 estimates the degree of exposure using AI technology, it refers to the movement history of the user U to determine that the user U is moving by car based on the movement speed, the direction of movement, and the amount of solar radiation. Comprehensively taking into consideration the situation and the remarkable temporary change in the right cheek, it is presumed that the user U sat in the driver's seat and drove for a long time while being exposed to the sun. This is a reflection of the point. Conversely, even if the temperature of the cheeks is higher than normal and is detected as a temporary change, if the temperature of the left and right cheeks is approximately the same, it may be caused by a cold, etc., taking into account other circumstances. It is also possible to presume that there is heat and to take appropriate action without reflecting it in the estimated degree of exposure.

In this way, the first skin information collection/utilization system A1 infers that the subject T, who is the user U, has been exposed to a lot of ultraviolet rays and the part that has been exposed to a lot of ultraviolet light from temporary skin changes, and gives advice. Therefore, the user U obtains the provided information about each monitoring target site, and clearly knows what kind of care should be given to which site, in addition, to some extent quantitatively. , it is possible to keep the skin beautiful.

Further, a future face prediction button 48 is displayed in the diagrammatic display portion 45 of each part. The future face prediction button 48 is a button for displaying the appearance of the user U that is predicted in the future. Based on the actual face image of the user U photographed by the front camera 16f at the time of acquisition of the temperature state, a future face image is generated by adding an aging factor to the same face image and displayed on the liquid crystal touch panel.

FIG. 8 is an explanatory diagram showing a future face display screen 60. As shown in FIG. The future face image 61 displayed substantially in the center of the future face display screen 60 is a face image in which the graphic of the aging factor predicted by the aging factor expression prediction means is displayed at the predicted part. A realistic future face image 61 obtained by processing a photographed face image of the person U is displayed.

Specifically, wrinkle images are displayed on the forehead where wrinkles are predicted to appear, blemish images are displayed on the left and right cheeks where blemishes are predicted, and sagging is displayed on the chin where sagging is predicted. The image will be displayed.

Also, the right cheek, which is presumed to have been exposed to ultraviolet light, is reproduced on the future face image 61 with more spots than the left cheek.

By displaying the future face display screen 60 in this manner, it is possible to make the user U more conscious of the importance of taking measures against ultraviolet rays.

Regarding the first skin information collection/utilization system A1 described above, the configuration of each unit can be changed as appropriate without departing from the gist of the present invention.

For example, in the above-described first skin information collection/utilization system A1, an example of using the smartphone 11 when constructing the user device 15 is shown, but the present invention is not limited to this. It may be a desktop computer or the like, or it may be a dedicated device for constructing the first skin information collection/utilization system A1.

In addition, in the example of the first skin information collection/utilization system A1 described above, the user U himself/herself was also the target person T as shown in FIG. In addition, the user U and the target person T may of course be different, as in a beauty salon.

Further, in the first skin information collection/utilization system A1, the face image 46 shown in the daily report image 40 and the future face image 61 shown in the future face display screen 60 are based on the photographed image of the subject T. However, it is not limited to this, and an illustration image may be used.

Further, although the action information 42 in the daily report image 40 is displayed on a map, it is also possible to display the action information by character information.

Further, in the first skin information collection/utilization system A1, when detecting a temporary change, the skin temperature of the monitoring target site when the user U is considered not to be affected by ultraviolet rays is set as the normal skin temperature, An example is shown in which it is determined that a temporary change has occurred when the temperature is higher than this, but the present invention is not limited to this. It is also possible to refer to the temperature of the skin on the body surface and determine that a temporary change has occurred when this temperature difference exceeds a predetermined value. In this case, the measurement of the skin temperature of the body surface part other than the monitoring target part may be performed by providing a temperature sensor different from the temperature sensor used for measuring the temperature of the monitoring target part as the second element state acquisition means. good.

In addition, in the first skin information collection/utilization system A1, the target for detecting a temporary change in the skin is the skin temperature, but the present invention is not limited to this. It may be configured to capture temporary changes in the color of the skin, or to measure both skin temperature and skin color. If the temporal change is detected by referring to both, the degree of UV exposure can be estimated with higher accuracy than when the temporary change is detected by using only one of them.

In addition, when a temporary change in skin color is to be detected, an imaging device as a sensor for identifying skin color captures skin image data. can be configured to identify by comparison with past skin colors.

At this time, the imaging element of the camera unit 16 provided in the smartphone 11 may be used as the imaging element. For example, a temporary change in skin color may be captured based on an image of substantially the entire face captured when displayed on the digital mirror section 24 of the user input screen 20 .

Also, if the camera section 16 has a macro function, it is possible to bring the camera section 16 close to the skin of the monitoring target site and take a close-up photograph to capture temporary changes in skin color. Also, even if there is no macro function, the rear camera 16b of the smartphone 11 shown in FIG. 9(a) can be additionally equipped with a close-up lens unit 70 as shown in FIG. 9(b).

With such a configuration, as shown in FIG. 10, the user can acquire a skin image by bringing the lens portion 71 of the close-up lens unit 70 close to the skin of the monitoring target site. Become.

In addition, in the first skin information collection/utilization system A1, the skin information collection device 10 was not equipped with imaging means. be.

For example, as shown in FIG. 11, a macro lens camera unit 80d as an imaging means capable of taking a close-up image of the skin is arranged at the tip of the skin information collection device 80, and a temperature sensor 80b, which is also arranged at the tip, It is also possible to acquire the temperature state and the captured image. Further, at this time, another temperature sensor 80 e , which is the above-described second element state acquiring means, can be arranged in the grip portion of the skin information collecting device 80 . By detecting a temporary change in the condition of a predetermined element of the skin based on the temperature information from the temperature sensors 80b and 80e and the captured image from the macro lens camera unit 80d, the degree of exposure to ultraviolet rays can be determined more accurately. can be estimated well. In addition, it is possible to improve the accuracy of analysis by estimating that the skin is exposed to a large amount of ultraviolet rays based on the close-up skin image and the skin temperature.

The acquired skin image can be used to detect skin texture and blemishes, and in beauty salons and the like, for example, by adjusting the color tone and contrast, etc., the skin texture and blemishes can be easily visualized. It is also possible to give advice or the like by presenting this to the customer.

Specifically, display of a skin analysis screen 90 as shown in FIG. 12 is conceivable. On the skin analysis screen 90, in addition to the skin analysis image display portion 91 and the skin analysis evaluation display portion 92, today's weather information 41 similar to the daily report image 40, ultraviolet ray countermeasure information 43, and overall estimated exposure degree information are displayed. 44 and an illustration display portion 45 of each part are included.

The skin analysis image display section 91 is a section for displaying a close-up photographed image of the skin acquired by the rear camera 16b or the macro lens camera section 80d or an image processed based on the same image. In addition to the skin image 91a, an image is displayed in which the presence of texture and blemishes is emphasized by image adjustment such as contrast. Such an image display enables the target person T to recognize the skin condition more clearly.

The skin analysis evaluation display unit 92 is a part that displays the skin condition analysis results obtained by analyzing the acquired close-up photographed image of the skin. Analysis results are displayed using a radar chart for each item, such as the state of skin and the amount of fine wrinkles. In addition, under the radar chart, the results of comparison with general skin of the same generation are shown, making it possible to grasp the condition of the skin for one's own age.

These analysis results may simply be displayed on the skin analysis evaluation display section 92, but may be referred to in estimating the degree of exposure to ultraviolet rays by the exposure degree estimating means. With such a configuration, it is possible to further improve the accuracy of estimating the degree of exposure.

In addition to presenting analysis results such as those shown in the skin analysis image display section 91 and skin analysis evaluation display section 92, or other skin information, recommended products according to the skin condition may be introduced. For example, in each screen for providing information, specifically, the calendar image 30, the daily report image 40, the information display screen 50, the future face display screen 60, the skin analysis screen 90, etc., it is possible to cool the skin heated by ultraviolet rays. It is also possible to display and introduce images of cosmetics such as skin lotions, etc., and to display and introduce images of skin care devices that have a beautiful facial effect. In particular, it is also possible to propose the amount of UV rays exposed and cosmetics suitable for the site, or to propose the usage schedule of cosmetics based on time-series data.

Further, in the first skin information collecting/utilizing system A1, a feedback information input button 93 is arranged in each part commentary 47 of each part illustration display part 45, respectively.

This feedback information input button 93 is a button that functions as an input means for inputting the validity of the result of the ultraviolet exposure degree estimated by the user U, and has three buttons: an upward correction button 93a, a proper button 93b, and a downward correction button 93c. Consists of buttons.

Here, referring to the description 47a for each part regarding the forehead, when the user U confirms the description 47a for each part regarding the forehead, the user U may have the impression, for example, that he or she may have actually received a little more ultraviolet light. If so, by pressing the upward correction button 93a, the sense of the user U is referred to the estimation of the degree of ultraviolet exposure in the server device 13 and fed back to improve the reliability of prediction.

In addition, when the user U has the impression, for example, that ``the ultraviolet rays are not really exposed to that extent'', the downward correction button 93c gives the impression that ``this is a reasonable estimation result''. In this case, by pressing the valid button 93b, the sense of the user U is similarly referred to in the estimation of the ultraviolet exposure degree in the server device 13 and fed back to improve the reliability of prediction.

In addition, in the first skin information collection/utilization system A1, the target skin monitoring sites are the forehead, the left and right cheeks, and the chin, but are not limited to these. The part under the nose, the part under the chin, etc. may also be monitored, and parts other than the face may be monitored.

[2. Second skin information collection/utilization system]
Next, the second skin information collection/utilization system A2 will be described. FIG. 13 is an explanatory diagram showing a second skin information collection/utilization system A2 having the form of a facial treatment device 100. As shown in FIG.

Compared with the first skin information collection/utilization system A1, the second skin information collection/utilization system A2 acquires the state of a predetermined element in the skin of each part of the face, which is the part to be monitored. , are similar in that they detect temporal changes and estimate UV exposure levels based thereon, but are functionally different in that they provide treatment based on the resulting estimated exposure levels.

In addition, the above-mentioned first skin information collection/use system A1 was constructed by connecting the skin information collection device 10, the smartphone 11, the Internet network 12, the server device 13, etc., but the present second skin The information collection/use system A2 is not linked to other devices, and is structurally different in that the system is completed within the facial treatment device 100 shown in FIG.

Although this device is the second skin information collection/utilization system A2, it is also a facial treatment device 100. Therefore, for convenience of explanation, the configuration will first be described from the viewpoint of the facial treatment device 100, and then , the second skin information collecting/utilizing system A2, the configuration and the operation thereof will be explained.

As shown in FIG. 14, the user U of the facial treatment device 100 holds the treatment device main body 112 and applies the contact portion 114 to the skin, so that the contact portion 114 functions as an iontophoresis portion to treat the skin. can be performed.

The intensity of this treatment is controlled by the second skin information collection/utilization system A2 based on the degree of exposure to ultraviolet rays. In other words, areas estimated to be highly exposed to ultraviolet rays are treated with a higher intensity of treatment to achieve efficient treatment, while areas estimated to be less exposed are reduced in intensity to reduce power consumption. Operate.

As shown in FIG. 13, the facial treatment device 100 has a thick plate-like external shape that is substantially rectangular in front view and slightly warped backward from the middle to the upper part, and the treatment device main body 112 can be held in the palm of the hand. , and the vertical length is set so that the upper part of the case can be seen from the hand when the case is gripped.

The treatment device main body 112 is a main part of the facial treatment device 100 in which the second skin information collection/utilization system A2 and the iontophoresis unit are mounted, and a substantially cylindrical contact portion 114 is protruded from the upper front surface of the treatment device main body 112 . ing.

The contact portion 114 is a portion to be brought into contact with the skin to be treated, and is made of a conductor such as metal so as to function as a one-side electrode for forming a potential gradient when the ion introduction portion functions.

Specifically, cotton 115 impregnated with cosmetics or the like is placed on upper surface 114 a of contact portion 114 , and a ring-shaped fixture (not shown) is attached from above cotton 115 . can be fixed on the abutment 114 . In this state, when an ion introduction part (to be described later) is activated and current is applied to the skin with the contact part 114 in contact via the cotton 115, ions of a predetermined component contained in cosmetics or the like can be introduced. It is possible. At this time, heating is also performed by a heater as required. Although illustration is omitted, the electrode, which becomes the other side during iontophoresis, is arranged on the back portion of the treatment device main body 112 .

A skin color acquisition unit 102 and a temperature acquisition unit 103 are provided on the upper surface 114 a of the contact portion 114 .

The skin color acquisition unit 102 is a part for acquiring the state of color as a predetermined element of the skin by an imaging device (not shown) built in the contact unit 114, and acquires the same skin color in the skin information collection mode described later. Information about the condition of the skin color (hereinafter also referred to as skin color information) acquired by the unit 102 is supplied to the control unit 130 and used to detect a temporary change in skin condition.

The temperature acquisition unit 103 is also a part for acquiring the state of temperature as a predetermined element of the skin. Information about the state of the skin temperature (hereinafter also referred to as skin temperature information) acquired by the temperature acquisition unit 103 in the skin information collection mode is supplied to the control unit 130 and used to detect a temporary change in skin condition. . A heat insulating portion 103a made of a material having a low thermal conductivity is formed around the temperature acquiring portion 103. As shown in FIG. The heat insulating portion 103a prevents the heat from affecting the measurement of the temperature acquiring portion 103 when the contact portion 114 is heated to warm the skin.

An operation unit 117 is arranged on the front surface of the facial treatment device 100 so that the user U can input an instruction to a control unit 130 housed inside the treatment device main body 112 .

A palm temperature acquisition unit 101 is provided on the side surface of the facial treatment device 100 . This palm temperature acquisition unit 101 is a second temperature acquisition unit for measuring the temperature of the palm as the skin of other body surface parts, not the skin of the face, which is the target for acquiring the state of the predetermined element. 2 corresponds to the element state obtaining means. It should be noted that the other side electrode for ion introduction, which is the opposite electrode of the abutment portion 114 and is provided on the back portion of the treatment device main body 112, should be provided at the same position as the palm temperature acquisition portion 101, not on the back portion. can also That is, it is preferable that the contact surface of the palm temperature acquisition unit 101 with the palm is made of a metal with good thermal conductivity. This is because it is possible to reduce the number of components.

A power button 117 a , a function button 117 b , and a mode selection button 117 c are arranged in the operation unit 117 , and each button is electrically connected to the control unit 130 .

The power button 117a is a button for activating the facial treatment device 100 and turning off the power. When the power button 117a is pressed in the state before startup, power is supplied from the power supply (in this embodiment, a battery (not shown) built into the facial treatment device 100) to the control unit 130, and the second skin information collection/use is performed. It becomes possible to function the system A2 and to function the iontophoresis section. Further, if the power button 117a is pressed in the activated state, power to the control unit 130 is cut off, and the facial treatment device 100 returns to the state before activation.

The function button 117b is a button that exhibits different functions according to the mode selected by the mode selection button 117c described below. When the operation unit 117 is pressed in the skin information collection mode, the elemental state of the skin is acquired in the same manner as the measurement button 10c of the skin information collection device 10 in the first skin information collection/utilization system A1. . In this facial treatment device 100 (second skin information collection/utilization system A2), both skin temperature and skin color are acquired as skin element states.

Further, when the operation unit 117 is pressed in the treatment mode, power is supplied to the pulse current supply circuit 49 (described later) etc. constituting the iontophoresis unit, and the cotton 115 is brought into contact with the contact unit 114 . Iontophoresis is performed into the skin. Further, power is supplied to a heater, a sensor, and the like that constitute the heating section, and the skin brought into contact with the contact section 114 is also heated as necessary.

The mode selection button 117c is a button for switching between the skin information collection mode and the treatment mode, as described above. Although it is possible to use the facial treatment device 100 only in the treatment mode, in order to achieve efficient treatment, the skin information collection mode is first executed to estimate the degree of exposure to ultraviolet rays for each part of the skin, and then A general mode of use assumed for this device is to perform treatment based on the estimation result.

Also, an indicator lamp 117d is provided at an upper position of the operation section 117. As shown in FIG. Under the control of the controller 130, the indicator lamp 117d is extinguished before activation of the facial treatment device 100 and turned on after activation to indicate the activation state of the facial treatment device 100. FIG. Also, the indicator lamp 117d is composed of a so-called multicolor light-emitting LED, and the color difference indicates whether the state of the facial treatment device 100 is the skin information collection mode or the treatment mode. Notify by

Next, regarding the facial treatment device 100, the point of view will be shifted to the second skin information collection/utilization system A2 according to the present embodiment, and the usage procedure and processing flow will be described while assuming a somewhat specific scene. The second skin information collection/utilization system A2 will also be explained assuming that the target person T is the user U. FIG. In addition, the user U has already started using the second skin information collection/utilization system A2 on a daily basis, and the storage area provided inside the facial treatment device 100 is not affected by ultraviolet rays. Skin color information (normal skin color information) measured by the user U himself for each monitored part is already stored. It should be noted that, similarly to the first skin information collection/utilization system A1 described above, the monitoring target parts are defined as the forehead, the left and right cheeks, and the chin in the face.

When using the second skin information collection/utilization system A2, the user U first presses the power button 117a to activate the second skin information collection/utilization system A2 (facial treatment device 100).

Next, when the mode selection button 117c is operated to select the skin information collection mode and the function button 117b is pressed, the second skin information collection/utilization system A2 shifts to the skin information collection mode.

Here, the control unit 130 guides the user U to measure the skin of each part of the face (an operation to obtain the state of a predetermined element) by emitting a voice. Specifically, the control unit 130 selects four parts of the face from which skin color and skin temperature conditions should be acquired by the skin color acquiring unit 102 and the temperature acquiring unit 103, which are elemental condition acquiring means, i.e., the forehead, the left and right cheeks, and the chin. It functions as guidance means for sequentially guiding the user U to the location.

For example, when the controller 130 functions as guidance means and the built-in speaker guides the user U to press the contact part against the right cheek, as shown in FIG. By pressing the function button 117b after prompting the user to acquire the state of the predetermined element, information on the skin color state of the right cheek by the skin color acquisition unit 102 and information on the temperature state of the right cheek by the temperature acquisition unit 103 are acquired. be. At this time, information on the temperature state of the palm is also acquired from the palm temperature acquisition unit 101 and supplied to the control unit 130 .

Next, the built-in speaker will tell you, "Put the contact part against your left cheek," "Put the contact part against your chin," and "Put the contact part against your forehead." Each time, the user U applies the contact portion 114 to a designated place, presses the function button 117b, and acquires the information on the skin color condition and the information on the temperature condition at each part. Each acquired information is stored in a predetermined storage area of the second skin information collection/use system A2.

As described above, in the second skin information collection/utilization system A2, in obtaining the state of the predetermined element, a plurality of monitoring target portions and the state of the predetermined skin element obtained by the element state obtaining means at each of the monitoring target portions are obtained. is characterized in that the state of the predetermined element acquired immediately after each guidance by the guidance means is used as the state of the predetermined element of the same guidance portion.

Next, the control unit 130 refers to the normal skin color information stored in advance in a predetermined storage area and the temperature state of the palm acquired by the palm temperature acquisition unit 101, and measures the temperature of each monitoring target site due to the ultraviolet rays. Detect significant changes and determine their extent.

Specifically, skin color information obtained from each part is compared with normal skin color information, and if the degree of redness is greater than a predetermined degree, for example, it can be determined that there is a temporary change. Also, the temperature information acquired from each site is compared with the palm temperature state information, and if the temperature is higher than a predetermined temperature, it can be determined that there is a temporary change. In comparing the skin color information obtained from each part with the normal skin color information, it is desirable to generate preliminary information such as whether the target person T is dark-skinned or light-skinned in advance based on the normal skin-color information. . If the skin of the subject T is dark, there is a tendency that the change in the skin color due to ultraviolet rays is difficult to appear. By referring to this, it is possible to take into account the fact that exposure to ultraviolet rays may be large even if there is a slight change, and it is possible to estimate the degree of temporal change with higher accuracy.

In addition, here, by comprehensively considering the results of temporary changes obtained based on skin color information and the results of temporary changes obtained based on temperature information, the degree of temporary changes can be determined. It is also possible to estimate By performing such processing, it is possible to further improve the estimation accuracy of the degree of temporary change.

Here, as a result of the temporary change detection means adding both the skin color information and the temperature information, the degree of temporary change is respectively "no change" in the above-mentioned four-grade evaluation for "forehead" and "chin". It is assumed that the right cheek has a "slight change" and the left cheek has a "somewhat definite change".

The control unit 130 that has performed the operation of detecting the temporary change estimates the degree of exposure of each monitoring target site based on the next supplied temporary change information.

For example, here, the processing is not as complicated as in the first skin information collection/utilization system A1, and the degree of exposure of each monitoring target site may be determined in proportion to the degree of temporary change. In addition, it is also possible to estimate the degree of exposure after performing processing for buffering errors due to predetermined factors such as room temperature at the time of measurement.

Here, there are five levels of low, slightly low, normal, slightly high, and high. Assume that it happened.

After estimating the degree of exposure, the control unit 130 next causes the built-in speaker to emit a sound prompting the user to switch to the treatment mode.

After hearing this voice, the user U operates the mode selection button 117c to select the treatment mode, and presses the function button 117b to switch the second skin information collection/use system A2 to the treatment mode.

Further, the user U places the cotton 115 impregnated with lotion on the upper surface 114a of the contact portion 114, and fixes the cotton 115 with a ring-shaped fixture (not shown).

Next, when the user U presses the function button 117b, the control unit 130 starts energizing the contact unit 114 and becomes ready for treatment. Please apply the contact part." is given.

When the user U brings the abutting portion 114 into contact with the right cheek according to this guidance, treatment of the right cheek by iontophoresis is started. Based on this, treatment is performed with a general level of electrification.

After the right cheek has been treated for a predetermined time, the control unit 130 then issues a guidance to the user U through the built-in speaker, saying, "Put the contact part on the left cheek." When the user U brings the contact portion 114 into contact with the left cheek according to this guidance, based on the fact that the estimated degree of exposure in the left cheek is "slightly high", the level of energization is relatively high compared to the normal level of energization applied to the right cheek. A moderately strong treatment is performed with relatively strong energization.

In this way, it is possible to efficiently perform skin maintenance by selectively performing high-intensity treatment on locations with a high estimated degree of exposure.

Similarly, the control unit 130 sequentially instructs the user U to "press the contact part on the chin" and "press the contact part on the forehead". At this point, the estimated degree of exposure for the chin and forehead was ``small'', so a weaker treatment was performed with a relatively weaker energization than the normal level of energization applied to the right cheek. will be

In this way, when a low-intensity treatment is selectively performed on locations with a low estimated degree of exposure, the power consumed by the second skin information collection/utilization system A2 can be suppressed. It is possible to lengthen the driving time of the second skin information collection/utilization system A2.

As described above, according to the second skin information collection/utilization system A2 according to the present embodiment, it is estimated from the temporary changes in the subject's skin that the subject has been exposed to a lot of ultraviolet rays and the part that has been exposed to a lot of ultraviolet rays, and treatment is performed. It is possible to provide a system for collecting and using skin information.

Regarding the above-described second skin information collection/utilization system A2, the configuration of each unit can be changed as appropriate without departing from the gist of the present invention.

For example, the above-mentioned second skin information collection/use system A2 was configured to be completed by a single device, but it is not limited to this, and a computer, smartphone, or the like connected by wire or wirelessly The second skin information collection/utilization system A2 may be configured together with the body apparatus. In this case, the facial treatment device 100 is provided with an element state acquisition means and a treatment means, and the other means constituting the second skin information collection/use system A2 can be entrusted to a smartphone or a personal computer. be.

In addition, although the above-described second skin information collection/use system A2 is not configured to be connected to the Internet network, it may be connected so that necessary information can be downloaded as appropriate.

Further, in the above-described second skin information collection/utilization system A2, the palm temperature acquisition unit 101, which is the second element state acquisition means (second temperature measurement unit), is provided on the side surface of the treatment device main body 112. However, it is not limited to this, and for example, it is also possible to set the temperature measurement target to the skin of other body surface parts. In addition, although the second element state acquiring means is provided integrally with the housing of the facial treatment device 100, for example, a thermometer capable of wireless communication with the facial treatment device 100 is adopted as the second element state acquiring means, and is separately provided. It is also possible to construct a second skin information collection/utilization system A2.

In addition, in the above-described second skin information collection/use system A2, after acquiring information on the skin color and temperature conditions of all four monitored parts, temporary changes are detected and the degree of exposure is estimated. However, the present invention is not limited to this. For example, the degree of exposure may be estimated by detecting a temporary change each time the state of a predetermined element is acquired at the monitoring target site.

Further, with such a configuration, it is also possible to notify the user U of the exposure level estimation result at each monitoring target site every time the state of the predetermined element is acquired.

Specifically, when the user U presses the function button 117b to obtain the state of the predetermined element, the built-in speaker issues a voice message such as "the estimated degree of exposure is 'slightly low'." An indicator lamp 117d provided on the operation unit 117 may be used to notify the degree of exposure by color.

In addition, in the above-described second skin information collection/utilization system A2, the treatment performed when switching to the treatment mode is treatment by iontophoresis. If the treatment is expected to be effective in keeping the skin beautiful, such as a treatment using shaving or vibration, it can be adopted as appropriate.

In addition, if the second skin information collection/utilization system A2 is provided with a skin cooling function via the contact part 114, the cooling function to lower the heat of the skin is first operated prior to treatment, or The cooling operation time may be lengthened.

In addition, the skin color acquisition unit 102 of the second skin information collection/utilization system A2 may be a predetermined element built in the contact unit 114, such as an imaging element, or may be a combination of a light emitting element and a light receiving element. As long as it is possible to obtain at least the state of color as a predetermined element of the skin, such as by analyzing reflected light, the resolution and the like are not critical.

However, an image pickup device having a sufficient number of pixels to detect skin texture and blemishes, and to enable the user U and the subject T to confirm the presence of skin texture and blemishes if an image is displayed, and a close-up shot of the skin surface. If a possible optical system is arranged in the skin color acquisition unit 102, the skin analysis image display unit 91 and the skin analysis evaluation display unit 92 of the skin analysis screen 90 described above with reference to FIG. To facilitate confirmation of the skin condition by image display, to display and notify the analysis result of the skin, and to further improve the accuracy of estimating the degree of exposure to ultraviolet rays by an exposure degree estimating means by referring to these analysis results. is also possible.

[3. Third Skin Information Collection/Usage System]
Next, the third skin information collection/utilization system A3 will be described. FIG. 15 is an explanatory view showing the manner of use of the mirror-type user device 200 having a form like a wall-mounted mirror in the configuration of the third skin information collection/utilization system A3. The third skin information collection/utilization system A3 has many points in common with the above-described first skin information collection/utilization system A1, but differs in some points.

For example, the user device 15 in the first skin information collection/utilization system A1 described above is configured by connecting the skin information collection device 10 and the smartphone 11, which are separate bodies, respectively. - The utilization system A3 is different in that the user device is integrally configured as a wall-mounted mirror.

The predetermined element of the skin to be acquired is the temperature state of the skin as in the first skin information collection/utilization system A1. The configuration is different in terms of acquisition.

The configuration of the third skin information collection/utilization system A3 according to this embodiment will be described below. Since there are many configurations that do, the description of similar configurations will be simplified or omitted.

FIG. 16 is an explanatory diagram showing the overall configuration of the third skin information collection/utilization system A3. The third skin information collection/use system A3 comprises a mirror-type user device 200, an Internet network 212, and a server device 213. FIG.

The mirror-type user device 200 acquires the temperature condition as a predetermined element from the skin of the monitoring target part of the user U who is the target person T, in this embodiment, from the skin at several locations (forehead, left and right cheeks, chin). It functions as element state acquisition means, temporary change detection means, and further functions as notification means having a notification section capable of displaying information such as skin advice as an image. Further, the mirror-type user device 200 is substantially an information communication terminal having a mirror-shaped outer shape, and the control unit 203, which will be described later, is configured to be able to execute programs such as various applications.

FIG. 17 is an explanatory diagram showing the configuration of the mirror-type user device 200. As shown in FIG. As shown in FIG. 17, the mirror-type user device 200 is constructed by arranging a mirror 202 over the entire surface of an annular frame 201 . In addition, on the back side of the mirror 202, a control unit 203 that controls the overall control of the mirror-type user device 200 and a thermography unit 207 that visualizes the temperature distribution on the body surface of the user U are accommodated. , the overall skin temperature of the user's U face can be measured.

Moreover, the lens portion 204 of the thermography unit 207 and the front camera 216f are arranged on the upper portion of the frame 201 so as to face the user U's face.

A human sensor 206 is arranged at the bottom of the frame 201 to detect the approach of a person to the mirror-type user device 200 .

A liquid crystal display 205 is arranged on the rear surface of the mirror 202 as a notification section capable of displaying an image. When an image is displayed on the liquid crystal display 205, the displayed image can be viewed through the mirror 202, but when the image is not displayed, the liquid crystal display 205 is not viewed and functions as a mirror. , the portion of the mirror 202 facing the liquid crystal display 205 is composed of a so-called magic mirror (one-way mirror).

A touch pad is arranged on the magic mirror portion to form a touch panel together with the liquid crystal display 205, and the user U can perform a predetermined input by touching.

The mirror 202 also functions as visible light image presenting means capable of presenting a visible light image of substantially the entire face of the user U in the mirror-type user device 200 . That is, a visible light image of the user U can be visually recognized when photographed by the thermography device.

Further, as shown in FIG. 16, the mirror-type user device 200 can exchange information with the server device 213 via the Internet network 212 .

Further, the mirror-type user device 200, based on the information about the degree of exposure to ultraviolet light estimated by the server device 213, removes blemishes and wrinkles on each part of the face in the same manner as the first skin information collection/utilization system A1. functioning as an aging factor expression predicting means for predicting the expression of aging factors of the skin, or an image containing notification information related to beauty based on the prediction of the expression of aging factors, that is, displayed on the liquid crystal display 205 to provide the user U with beauty information. It also functions as a notification information generation unit that generates an image for notification of. These functions are also implemented by an application executed within the control unit 203 .

Note that the Internet network 212 and the server device 213 have substantially the same configurations as the Internet network 12 and the server device 13 of the first skin information collection/utilization system A1, so description thereof will be omitted.

Next, regarding the third skin information collection/utilization system A3 having such a configuration, the usage procedure and processing flow will be described while assuming a somewhat specific situation. The third skin information collection/utilization system A3 will also be explained assuming that the target person T is the user U. FIG. In addition, the user U has already started using the third skin information collection/utilization system A3 on a daily basis, and the storage area provided inside the mirror-type user device 200 is affected by ultraviolet rays. A temperature distribution image (normal skin temperature distribution image) obtained by the thermography device of the user U when not in use is already stored. It should be noted that, similarly to the first skin information collection/utilization system A1 described above, the monitoring target parts are defined as the forehead, the left and right cheeks, and the chin within the face.

When the user U who has returned home from outside returns to his room and approaches the mirror-type user device 200 , the human sensor 206 detects the user U, and the control unit 203 starts the activation operation of the mirror-type user device 200 . .

Next, the control unit 203 displays on the liquid crystal display 205 whether or not to start obtaining the state of the skin temperature, and waits for an input from the user U.

When the user U touches the start button displayed on the liquid crystal display 205 via the touch pad and looks at the mirror 202, the thermography unit 207 is activated and the user U The entire face of U is photographed through the lens unit 204 to generate a temperature distribution image of the face. In addition, the front camera 216f is activated to photograph the user U's face image (visible light image).

Next, the control unit 203 refers to the normal skin temperature distribution image stored in advance in a predetermined storage area, and compares it with the acquired temperature distribution image, thereby temporarily Detect changes and determine their extent.

The control unit 203, which has performed the operation of detecting the temporary change, then sends information (temporary change information) about the site and degree of the temporary change detected by the temporary change detection means to the server device via the Internet network 212. 213.

The server device 213 receives the temporary change information supplied via the Internet network 12, and estimates the degree of exposure while referring to the information on the ultraviolet dose observation results obtained from the Internet and other various types of information. Information on the estimated degree of exposure is transmitted to user U's mirror-type user device 200 via Internet network 212 .

The mirror-type user device 200 that has received the estimated information on the degree of exposure then displays each image such as a calendar image on the liquid crystal display 205 in substantially the same manner as the first skin information collection/utilization system A1 described above, and uses it. Information on the skin is provided to the person U.

For example, the control unit 203 functions as a notification information generation unit, and while using information on the amount of ultraviolet rays in a predetermined area (for example, information on the amount of ultraviolet rays at home) acquired via the Internet network 212, the estimated degree of exposure produces a calendar image with the results of The generated calendar image is an image as shown in FIG. 5, and is displayed on the liquid crystal display 205 which is the notification unit.

Also, a screen similar to the daily report image, the information display screen, and the future face display screen is displayed based on the estimated information of the degree of exposure. Position information and other missing information should not be displayed as compared with the calendar image 30, the daily report image 40, the information display screen 50, the future face display screen 60, etc. of the first skin information collection/utilization system A1. Please note.

Then, according to the third skin information collection/utilization system A3 according to the present embodiment as well, it is possible to estimate that the user U, who is the target person T, has been exposed to a lot of ultraviolet rays and the part that has been exposed to a lot of ultraviolet rays from the temporary skin changes. , a skin information collection/utilization system capable of giving advice can be provided.

In particular, since the mirror-type user device 200 is employed, the user U can easily check the skin when checking his or her appearance, and can keep the skin beautiful.

Regarding the third skin information collection/utilization system A3 described above, the configuration of each unit can be changed as appropriate without departing from the gist of the present invention.

As described above, according to the first skin information collection/utilization system according to the present embodiment, the element state obtaining means for obtaining the state of the predetermined element of the skin of the monitoring target site is provided, and the skin is treated. A treatment means comprising: a treatment unit; a treatment control unit that controls the intensity of treatment by the treatment unit based on the degree of exposure of the skin to ultraviolet light that is estimated to have been received; a notification unit that provides information regarding the skin; and at least one of a notification means comprising a notification information generation unit that generates notification information to be supplied to the notification unit based on the degree of exposure to ultraviolet rays that the skin is estimated to have received, and A system for collecting and using skin information for performing treatment and/or providing information according to the state of a predetermined element of the skin of a monitoring target part of a subject, wherein the state of the predetermined element acquired by the element state acquisition means and the predetermined Temporary change detection means for detecting a temporary change in the state of a predetermined element of the skin of the monitoring target site by comparing the past state of the element, and temporary change detection means detected by the simultaneous change detection means An exposure degree estimating means for estimating the degree of exposure of the skin of the monitoring target site to ultraviolet rays based on the degree of state change, and the treatment means based on the degree of exposure to ultraviolet rays estimated by the exposure degree estimating means. Since treatment and/or provision of information by the notification means is performed, it is possible to estimate that the subject has been exposed to a lot of ultraviolet rays and the part that has been exposed to a lot from temporary changes in the subject's skin, and to provide treatment and advice. A system for collecting and using skin information can be provided.

Finally, the description of each embodiment mentioned above is an example of this invention, and this invention is not limited to the above-mentioned embodiment. Therefore, it goes without saying that various modifications other than the above-described embodiments can be made in accordance with the design and the like within the scope not departing from the technical idea of the present invention.

In particular, the configuration mentioned in the description of any one of the first skin information collection/utilization system A1 to the third skin information collection/utilization system A3 does not deviate from the technical idea according to the present invention. Needless to say, other systems of the skin information collection/utilization system A1 to the third skin information collection/utilization system A3 are also applicable, and naturally included in the present invention. Therefore, the fact that the configuration described in the embodiment of one skin information collection/utilization system is not described as the configuration of another embodiment of the skin information/utilization system cannot be It does not preclude the addition of the configuration when obtaining rights for the system, the skin information/utilization system, which is a broader concept that includes the system and each embodiment, and the inventions related thereto. However, when the applicant obtains rights for the above one skin information/utilization system, a broader concept of skin information/utilization system that includes each embodiment, and related inventions, the implementation of other skin information/utilization systems is prohibited. It is also possible to omit the configuration based on the fact that it is not described as the configuration of the example.

10 skin information collection device 10b temperature sensor 11 smartphone 13 server device 15 user device 16 camera unit 20 user input screen 21 date display unit 22 countermeasure input unit 24 digital mirror unit 30 calendar image 40 daily report image 41 weather information 42 action information 43 ultraviolet rays Countermeasure information 44 Estimated degree of exposure information 46 Face image 61 Future face image 100 Facial treatment device 101 Palm temperature acquisition unit 102 Skin color acquisition unit 103 Temperature acquisition unit 200 Mirror type user device A1 First skin information collection/utilization system A2 Second Skin information collection/utilization system A3 Third skin information collection/utilization system T Target person U User

Claims (17)

An element state acquiring means for acquiring the state of a predetermined element of the skin of the monitoring target site,
a treatment means comprising: a treatment unit that performs skin treatment; and a treatment control unit that controls the intensity of treatment by the treatment unit based on the degree of exposure of the skin to ultraviolet rays presumed to have been received;
a notification unit that notifies information about the skin, and a notification information generation unit that generates notification information to be supplied to the notification unit based on the degree of exposure to ultraviolet rays that the skin is estimated to have received; comprising at least one means,
A skin information collection/utilization system for performing treatment and/or providing information according to the condition of a predetermined element of the skin of a monitoring target site of a subject obtained,
temporary change detection means for detecting a temporary change in the condition of the predetermined element of the skin of the monitoring target site by comparing the state of the predetermined element acquired by the element state acquisition means and the past state of the predetermined element; ,
an exposure degree estimating means for estimating the degree of exposure of the skin of the monitoring target site to ultraviolet rays based on the degree of the temporary state change detected by the temporary change detecting means;
A system for collecting and using skin information, wherein treatment is performed by the treatment means and/or information is provided by the notification means based on the degree of exposure to ultraviolet rays estimated by the exposure degree estimation means. 3. The temporary change detecting means, when comparing the state of the predetermined element with the past state of the predetermined element, also refers to the state of the skin of other body surface parts of the predetermined element. 1. The system for collecting and using skin information according to 1. A second element state acquiring means for acquiring the state of the predetermined element from the skin of the part to be monitored where the element state acquiring means acquires the state of the predetermined element or the skin of another body surface part. 3. The system for collecting and using skin information according to claim 1 or 2. 4. The system for collecting and using skin information according to any one of claims 1 to 3, wherein the predetermined factor of skin is skin color and/or skin temperature. Guidance means for sequentially guiding the user to the parts for which the state of the predetermined element should be acquired by the element state acquisition means;
A predetermined element acquired immediately after each guidance by the guidance means when associating the plurality of monitoring target regions with the states of the predetermined skin elements acquired by the element state acquisition means at each monitoring target region. 5. The system for collecting and using skin information according to any one of claims 1 to 4, wherein the state of is set as the state of a predetermined element of the same guide portion. 6. The system for collecting and using skin information according to any one of claims 1 to 5, further comprising visible light image presentation means capable of presenting a visible light image of substantially the entire face of said subject. the notification means having a notification unit capable of displaying an image;
geographical location information supply means for supplying geographical location information of the subject at a predetermined time;
UV dose information supply means for supplying UV dose information observed in a predetermined area,
The notification information generation unit generates the estimated exposure degree estimated by the exposure degree estimation means, and the amount of ultraviolet rays supplied by the ultraviolet amount information supply means with respect to the geographical position at the predetermined time supplied by the geographical position information supply means. 7. The system for collecting and using skin information according to any one of claims 1 to 6, wherein data for displaying a calendar image in which . The notification means having a notification unit capable of displaying an image,
The notification information generation unit generates weather information on a predetermined day, behavior information of the subject on the predetermined day, information on measures against ultraviolet rays by the subject on the predetermined day, and the estimation estimated by the exposure degree estimation means 8. The system for collecting and using skin information according to any one of claims 1 to 7, wherein data for displaying a daily report including the degree of exposure is supplied to the reporting unit. the notification means having a notification unit capable of displaying an image;
an aging factor expression prediction means for predicting the appearance of aging factors in the skin of the monitoring target site of the subject based on the history of the ultraviolet exposure degree estimated by the exposure degree estimation means;
The notification information generating unit detects a temporary state change detected at a predetermined monitoring target part of the face by the temporary change detection means, and an estimation estimated for the predetermined monitoring target part of the face by the exposure level estimation means. Information relating to at least one selected from the degree of exposure and skin aging factors predicted to occur in a predetermined monitoring target portion of the face by the aging factor expression predicting means is displayed at a corresponding position on the face image. 9. The system for collecting and using skin information according to any one of claims 1 to 8, wherein the facial image data obtained from the skin information is supplied to the notification unit. the notification means having a notification unit capable of displaying an image;
an aging factor expression prediction means for predicting the appearance of aging factors in the skin of the monitoring target site of the subject based on the history of the ultraviolet exposure degree estimated by the exposure degree estimation means;
The notification information generating unit transmits face image data in which skin aging factors predicted to appear in a predetermined monitoring target part of the face by the aging factor expression prediction means are drawn at corresponding positions on the face image, to the notification unit. 10. The system for collecting and using skin information according to any one of claims 1 to 9, characterized in that it supplies skin information. 11. The system for collecting and using skin information according to claim 9, wherein said facial image is a photographed image of said subject's face. The notification means having a notification unit capable of displaying an image,
12. Any one of claims 1 to 11, wherein said notification information generation unit supplies data for displaying in time series the estimated degree of exposure estimated by said degree-of-exposure estimation means for each predetermined time to said notification unit. or the system for collecting and using skin information according to item 1. The exposure degree estimating means estimates the estimated exposure degree for each predetermined time for each monitoring target site,
13. The system for collecting and using skin information according to claim 12, wherein the notification information generating unit supplies the data for displaying in chronological order to the notification unit for each part to be monitored. 14. Any one of claims 1 to 13, characterized in that the element state acquisition means and the treatment means are constructed by two or more separate devices, and one of the plurality of devices is equipped with both the element state acquisition means and the treatment means. The skin information collection/utilization system according to item 1. a skin information collection device comprising the element state acquisition means;
A skin information analysis device comprising the temporary change detection means and the exposure level estimation means,
15. The skin information collection/use system according to any one of claims 1 to 14, wherein said treatment means and/or notification means are provided in said skin information collection device or skin information analysis device. The skin information analysis device comprises an information communication terminal to which the skin information collection device is connected, and an information server device connected to the information communication terminal via the Internet,
16. The system for collecting and using skin information according to claim 15, wherein said treatment means and/or notification means are provided in said skin information collection device or said information communication terminal. An imaging means for imaging substantially the entire face of the subject,
When associating a plurality of predetermined monitoring target parts in the face with the state of a predetermined element of the skin acquired by the skin information collecting device at any one of these monitoring target parts, Based on the face image captured by the imaging means while the condition of the predetermined element of the skin is being acquired by the skin information collecting device, the monitoring target part whose state of the predetermined element is acquired is estimated from the plurality of monitoring target parts. 17. The skin information collection/processing method according to claim 15 or 16, wherein the state of the predetermined element acquired when the face image is captured is used as the state of the predetermined element in the estimated monitoring target part. system of use.

Images