JP2022084299A - Skin condition measurement system - Google Patents

Abstract

To provide a skin condition measurement system that acquires measurement data on a user's skin condition using respective imaging by a skin condition measurement device and an imaging device to make it possible, on the basis of a plurality of sets of data, to improve quality of information on the user's skin condition.SOLUTION: A skin condition measurement system images a predetermined part of a user's skin using a skin condition measurement device 10, images a predetermined range of the user's body using an imaging device, acquires, by a control unit 31 on the basis of the respectively obtained image data, information on a skin condition, and associates the information on the skin condition of the predetermined part with partial information corresponding to the predetermined part of the skin out of information on a skin condition in the predetermined range of the body to enable utilization of the separately acquired information when trying to use the partial information corresponding to the predetermined part, which makes it possible to improve quality of information on the skin condition based on the picture data, to accurately perform processing on the skin condition, and to appropriately and efficiently perform skin condition diagnosis to allow the user to recognize the skin condition more accurately.SELECTED DRAWING: Figure 10

Description

The present invention relates to a skin condition measuring system capable of providing information on a user's skin condition to the user.

At stores where skin condition measuring devices and analysis equipment are installed, customers' skin conditions are measured, the measurement data is analyzed, the analysis results are obtained, and skin care cosmetics corresponding to the skin conditions shown in the analysis results are available. The service of recommending and selling beauty products to customers has been available for some time.

On the other hand, in recent years, using an electronic device that can be used by the user, the face data of the user is acquired, and the information obtained by analyzing the face data is shared with other users for facial skin care. Something that can be used has been proposed.
As an example of such a conventional device for acquiring information for facial skin care, there is one disclosed in Japanese Patent Application Laid-Open No. 2017-21970.

Japanese Unexamined Patent Publication No. 2017-21970

The conventional device for acquiring facial skin care information has the configuration shown in the above patent document, images the entire user's face, analyzes the obtained user's face data, and obtains information for skin care. It was something that could be obtained.

However, in such a conventional device, since the face data is obtained by imaging the entire user's face with an imaging device, the detection accuracy of the user's skin condition becomes coarse, the information to be analyzed is scarce, and the analysis can be obtained. The care information provided is not sufficient for skin care, and there is a problem that it is difficult for users to properly perform skin care by utilizing the care information.

The present invention has been made to solve the above-mentioned problems, and the measurement data of the user's skin condition is acquired by each imaging of the skin condition measuring device and the imaging device, and the user's skin condition is shown to the user based on a plurality of types of data. The purpose is to provide a skin condition measurement system that can improve the quality of information on skin condition.

The skin condition measuring system according to the disclosure of the present invention is capable of imaging a predetermined area of the user's skin including a skin condition measuring device capable of imaging a predetermined portion of the user's skin and a skin imaging target portion by the skin condition measuring device. The image pickup device is provided with a control unit for acquiring information on the skin condition based on the image data of the skin obtained by the image pickup, and the control unit is an image of the predetermined range of the body obtained by the image pickup of the image pickup device. Based on the data, it is possible to acquire information on the skin condition in the predetermined range of the body, and based on the image data of the predetermined portion of the skin obtained by the imaging of the skin condition measuring device, the skin condition of the predetermined portion. Further, among the information on the skin condition in the predetermined range of the body, the information on the skin condition of the predetermined portion is associated with a part of the information corresponding to the predetermined portion of the skin. ..

As described above, according to the disclosure of the present invention, the skin condition measuring device captures a predetermined portion of the user's skin, and the imaging device captures a predetermined range of the user's body, and the image data of the predetermined portion obtained respectively is obtained. And, based on the image data of the predetermined range of the body, the control unit acquires the information about the skin condition, and among the information about the skin condition of the predetermined range of the body derived from the image data of the predetermined range of the body, the skin. When it is attempted to use the partial information corresponding to the predetermined part of the skin by associating the information regarding the skin condition of the predetermined part derived from the image data of the predetermined part with the partial information corresponding to the predetermined part. By making it possible to use the separately acquired information on the skin condition of the predetermined part, the quality of the information on the user's skin condition based on the image data obtained by imaging can be improved, and the display and analysis of the skin condition can be performed. It is possible to perform such processing with high accuracy, proceed with the diagnosis of the skin condition appropriately and efficiently, and let the user grasp the skin condition more accurately.

Further, in the skin condition measuring system according to the disclosure of the present invention, if necessary, the control unit relates to the skin condition of the predetermined range of the body based on the image data of the predetermined range of the body obtained by the imaging of the imaging device. Information is acquired, a predetermined part of the skin to be imaged by the skin condition measuring device is selected from the information on the skin condition in the predetermined range of the body, and imaging by the skin condition measuring device can be performed on the predetermined part of the skin. It is a thing.

As described above, according to the disclosure of the present invention, information on the skin condition of the predetermined range of the body is acquired from the image data of the predetermined range of the body obtained by the image pickup of the imaging device, and the skin condition measuring device uses this information. By selecting a predetermined part of the skin to be imaged and performing imaging by a skin condition measuring device to obtain image data of the predetermined part, for example, the skin in the information regarding the skin condition in the predetermined range of the body. With only a part of the information corresponding to the predetermined part, the image data in the predetermined range of the body becomes coarse data due to insufficient resolution in detail due to the wide imaging range, and the information necessary for evaluating the skin condition of the predetermined part. Even if the quality of the information on the skin condition is not sufficient, such as when there is a shortage of data, information on the skin condition is newly acquired from the image data obtained by imaging the part with the skin condition measuring device, and this is used as described above. By using it as information related to the information on the skin condition in the predetermined range of the body, the user can be surely grasped the skin condition by the entire information on the skin condition on the predetermined part, and the user is appropriate for the skin on the predetermined part. It is possible to further promote the response such as care.

Further, the skin condition measuring system according to the disclosure of the present invention includes a display unit capable of displaying at least an image of the user's predetermined body range, if necessary, and the control unit controls the skin within the predetermined body range. As information on the state, an image of the predetermined range of the body derived from the image data of the predetermined range of the body is acquired, and as information on the skin condition of the predetermined portion, the predetermined portion derived from the image data of the predetermined portion of the skin. The image is acquired, the display unit is capable of executing the image display acquired by the control unit, and the control unit is a part corresponding to the predetermined part of the skin in the image of the predetermined range of the body. On the other hand, an image of the predetermined part is associated with the image of the predetermined part, and the image of the predetermined part is displayed simultaneously or sequentially with the image display of a part or all of the predetermined range of the body on the display unit. Is.

As described above, according to the disclosure of the present invention, a display unit capable of displaying an image is provided, information on the skin condition is regarded as display image information, and the display unit displays an image based on the display image information. For displaying the predetermined part of the skin based on the image data obtained by the image pickup of the skin condition measuring device, the partial information corresponding to the predetermined part of the skin in the display image information of the predetermined range of the body is used. When the display unit displays an image of the predetermined range of the body in association with the image information, the image display of the predetermined part based on the image information for display of the predetermined part is simultaneously performed with the image display of the predetermined range of the body. Or, based on the image data obtained by imaging by displaying the predetermined part of the predetermined range of the body displayed on the display unit as a new image on the same display unit in a continuous manner. By enriching the content of the image showing the user's skin condition as a display, at least for the image pickup target part of the skin condition measuring device, not only from the image display of the entire predetermined range of the body, but also a finer image derived from the skin condition measuring device. The skin condition can be confirmed from the display, and the user can grasp the skin condition more accurately and easily.

Further, the skin condition measuring system according to the disclosure of the present invention includes a display unit capable of displaying information on the skin condition of the user as needed, and the control unit can display information on the skin condition in the predetermined range of the body. As information on the skin condition of the predetermined region of the body, the diagnostic information of the skin condition of the predetermined region of the body is acquired by analyzing the image data of the predetermined region of the body, and the predetermined region of the skin is analyzed by analyzing the image data of the predetermined region of the skin. The control unit acquires the skin condition diagnostic information of the region, and the control unit obtains the skin condition diagnostic information of the predetermined region with respect to a part of the information corresponding to the predetermined skin condition in the skin condition diagnostic information of the predetermined range of the body. When displaying the diagnostic information of the skin condition in the predetermined range of the body on the display unit, the partial information corresponding to the predetermined part of the skin is supplemented or replaced with the partial information. It is intended to display the diagnostic information of the skin condition of a predetermined part.

As described above, according to the disclosure of the present invention, a display unit capable of displaying information on the skin condition is provided, and the information on the skin condition is used as diagnostic information on the skin condition by analyzing image data, and the skin condition in the predetermined range of the body is described. The partial information corresponding to the predetermined part of the skin in the diagnostic information of the above is associated with the diagnostic information of the skin condition of the predetermined part of the skin based on the image data obtained by the imaging of the skin condition measuring device, and the body is predetermined. When displaying the diagnostic information of the skin condition in the range on the display unit, the diagnostic information of the skin condition of the predetermined portion associated with the partial information corresponding to the predetermined portion of the diagnostic information is the above-mentioned one. It is displayed by supplementing or replacing the part information, and the diagnostic information is provided to the user as detailed information including the information analyzed from the image data obtained by the skin condition measuring device, so that it can be obtained by imaging. The content of the user's skin condition diagnostic information based on the image data is enriched, and at least for the image pickup target part of the skin condition measuring device, the diagnostic information from another viewpoint by analyzing the image data derived from this skin condition measuring device. It becomes possible for the user to grasp the skin condition more accurately and easily, such as being able to understand the skin condition by referring to.

Further, in the skin condition measuring system according to the disclosure of the present invention, if necessary, the skin condition measuring device is different from the light used as the illumination light in the imaging of the predetermined range of the body by the imaging device at the time of imaging. The imaging target is a predetermined portion of the user's skin irradiated with light from a predetermined light source.

As described above, according to the disclosure of the present invention, in the imaging in the skin condition measuring device, the predetermined portion of the user's skin is irradiated with light from a predetermined light source different from the light used as the illumination light in the imaging by the imaging device. By acquiring image data with different imaging conditions using the skin condition measuring device and the imaging device, the effects of reflection, absorption, and attenuation of the light emitted as illumination in each layer of the skin can be seen. It is possible to increase the difference in the received skin image between the skin condition measuring device and the imaging device, and increase the information content of the image data as a diagnostic material used in the diagnosis of the skin condition to make an appropriate diagnosis of the skin condition. In addition to making it possible, in particular, depending on the selection of the light to be irradiated, the skin condition measuring device can perform imaging under conditions suitable for detailed analysis of the partial skin condition, and the accuracy of the diagnosis of the skin condition can be achieved. Can be improved.

Further, in the skin condition measurement system according to the disclosure of the present invention, if necessary, the control unit performs an image on a part or the whole of the image data in the predetermined range of the body based on the image data of the predetermined portion. It performs correction processing.

As described above, according to the disclosure of the present invention, the control unit controls the body based on the image data of the predetermined portion based on the imaging of the skin condition measuring device, which makes it easy to adjust the imaging conditions by limiting the imaging range. The image data is shown by performing image correction processing on the image data in a predetermined range and matching the color of the skin image in the predetermined range of the body shown in the image data to that of the skin image in the image data of the predetermined portion. The skin image of the predetermined range of the body shows the skin condition more accurately, and the image data of the predetermined range of the body obtained by the imaging is related to the image display and the diagnosis of the skin condition regardless of the imaging conditions of the imaging device. It can be made easy to analyze and encourages the user to correctly grasp the skin condition.

Further, in the skin condition measurement system according to the disclosure of the present invention, if necessary, the control unit has at least the said image on the image of the predetermined range of the body derived from the image data of the predetermined range of the body. A process of synthesizing a predetermined guide design unit indicating that the image is the image target position of the skin condition measuring device is executed at a predetermined position to be imaged by the skin condition measuring device, and the display unit is the body predetermined position. In a state where an image of a range is displayed, the guide design unit is displayed as a part of the image.

As described above, according to the disclosure of the present invention, the control unit executes image processing for synthesizing a predetermined guide design unit at a position corresponding to an image pickup target portion of the skin condition measuring device in an image of the predetermined body range. By displaying the image of the predetermined range of the body including the guide design part by synthesis on the display unit and indicating the image pickup target part of the skin condition measuring device at the position of the guide design part, the predetermined range of the body is shown. The part to be imaged by the skin condition measuring device in the above can be easily understood by the user, and the user can appropriately perform imaging by using the skin condition measuring device.

It is a schematic block diagram of the skin condition measurement system which concerns on 1st Embodiment of this invention. It is a block block diagram of the skin condition measurement system which concerns on 1st Embodiment of this invention. It is a schematic block diagram of the skin condition measuring apparatus in the skin condition measuring system which concerns on 1st Embodiment of this invention. It is a display screen explanatory view just before image pickup of the terminal apparatus in the skin condition measurement system which concerns on 1st Embodiment of this invention. It is a display screen explanatory view of the skin condition measuring apparatus guide state based on the record information of the terminal apparatus in the skin condition measuring system which concerns on 1st Embodiment of this invention. It is a display screen explanatory view of the other skin condition measuring apparatus guide state based on the record information of the terminal apparatus in the skin condition measuring system which concerns on 1st Embodiment of this invention. It is explanatory drawing of the terminal apparatus display screen just before the image pickup by the skin condition measuring apparatus in the skin condition measuring system which concerns on 1st Embodiment of this invention. It is a skin image display state explanatory view based on the image pickup by the skin condition measuring apparatus by the terminal apparatus in the skin condition measuring system which concerns on 1st Embodiment of this invention. It is explanatory drawing of the diagnosis information display state of the skin condition based on the image pickup by the skin condition measuring apparatus by the terminal apparatus in the skin condition measuring system which concerns on 1st Embodiment of this invention. It is a block block diagram of the skin condition measurement system which concerns on 2nd Embodiment of this invention. It is a diagnostic information display state explanatory diagram of the skin condition based on the image pickup with the terminal apparatus in the skin condition measurement system which concerns on the 2nd Embodiment of this invention. It is a skin image display state explanatory view based on the image pickup by the terminal apparatus and the skin condition measuring apparatus in the skin condition measuring system which concerns on 2nd Embodiment of this invention. It is explanatory drawing information display state explanatory view of the skin condition based on the image pickup by the terminal apparatus and the skin condition measuring apparatus in the skin condition measuring system which concerns on 2nd Embodiment of this invention. It is a display screen explanatory view of the mark addition state to the hidden stain by the terminal apparatus in the skin condition measurement system which concerns on the 2nd Embodiment of this invention. It is other display state explanatory view of the skin image based on the terminal apparatus and the skin condition measuring apparatus in the skin condition measuring system which concerns on 2nd Embodiment of this invention. It is a display screen explanatory view just before the imageizing the foot part by the terminal apparatus in the skin condition measurement system which concerns on the 2nd Embodiment of this invention. It is explanatory drawing of the terminal apparatus display screen just before the image which targeted the predetermined part of the foot by the skin condition measuring apparatus in the skin condition measuring system which concerns on 2nd Embodiment of this invention. It is a skin image display state explanatory view of the foot part based on the image pickup by the terminal apparatus and the skin condition measuring apparatus in the skin condition measuring system which concerns on the 2nd Embodiment of this invention. It is a schematic block diagram of the skin condition measurement system which concerns on 3rd Embodiment of this invention. It is an information transmission / reception state explanatory diagram between a terminal apparatus and a server in the skin condition measurement system which concerns on 3rd Embodiment of this invention.

(First Embodiment of the present invention)
Hereinafter, the skin condition measurement system according to the first embodiment of the present invention will be described with reference to FIGS. 1 to 9.
In each of the above figures, the skin condition measuring system 1 according to the present embodiment also serves as the skin condition measuring device 10 capable of measuring the user's skin condition and the imaging device in which the skin condition measuring device 10 is communicably connected. , The terminal device 20 having the recording unit 21, the display unit 22, and the control unit 23.

In the present embodiment, the user who is the target of the skin condition measurement receives a contract for receiving the skin condition diagnosis service with the business operator that provides the skin condition measurement system 1 (hereinafter referred to as the provider). Have exchanged. Further, the user can use the skin condition measuring device 10 by purchasing or renting it by himself / herself.

As a result, the user can receive a skin condition diagnosis using the skin condition measurement system 1, obtain a skin condition diagnosis result by the skin condition measurement system 1, and give advice information according to the diagnosis result as necessary. You can enjoy the merit of being able to obtain. In addition, the provider can acquire data on the user's skin condition, and provides the user with skin care products or skin care services provided by the specified provider (for example, the sponsor of the provider) through advertisements, etc. By recommending, you can enjoy the merit of being able to realize the sales promotion effect of these skin care products and skin care services. The skin care product is a product used for skin care, and is, for example, a lotion, a beauty essence, a supplement, a facial cleanser, a facial cleanser, and the like. The skin care service is a service that cares for the skin, and is, for example, an esthetic service.

The skin condition measuring device 10 is a kind of camera capable of taking an image of a predetermined part of the user's skin as a measurement of the user's skin condition.
The skin condition measuring device 10 has a built-in a predetermined light source for lighting, and in the case of imaging, the light source different from the light used as the illumination light in the imaging of the predetermined range of the body by the terminal device 20 as the imaging device. The image is taken on a predetermined part of the user's skin that has been irradiated with light from.

In detail, the skin condition measuring device 10 includes a substantially cylindrical main body case 11 in which an opening having a size capable of capturing a predetermined number of skin hills is set in a state where the tip portion 11a is in contact with the user's skin. The image pickup element 12 housed in the main body case 11 and converting the light reflected by the user's skin into an electric signal indicating the image data of the skin, and the image pickup element 12 so as to focus on the light reflected from the user's skin. It is configured to include an optical mechanism unit 13 that forms an image so that it can be incident on the image pickup element 12, and a plurality of LEDs 14 and 15 as light sources that irradiate the user's skin with light for illumination from the inside of the main body case 11.

In addition to the optical system that shifts the focal position of the reflected light, the optical mechanism unit 13 includes a light diffusing plate 13a that is arranged adjacent to the LEDs 14 and 15 in the light irradiation direction and diffuses the light of each of the LEDs 14 and 15. The first polarizing plate 13b, which is arranged adjacent to the light diffuser plate 13a on the opposite side of the LEDs 14 and 15 to polarize the incident light in a predetermined direction, and the incident light are arranged between the LEDs 14 and 15 and the image pickup element 12. Only the second polarizing plate 13c that polarizes in the direction orthogonal to the polarization direction of the first polarizing plate 23 and the light that is arranged adjacent to the second polarizing plate 13c and reflected by the user's skin are passed to the image pickup element 12 side. It is configured to include a light-shielding plate 13d.

Of these, the first polarizing plate 13b is provided with a notch at a position facing a part of the LEDs 14, so that the diffused light derived from these LEDs 14 is unpolarized and guided to the user's skin, while the other LEDs 15 are derived. It guides the diffused light to the user's skin as linearly polarized light in a predetermined direction.

In the skin condition measuring device 10 of the present embodiment, the light from the LED 14 is diffused by the light diffusing plate 13a and then irradiated to the user's skin without polarization, and the unpolarized light irradiation detects the texture of the user's skin. Used as lighting for. Further, since the light from the other LED 15 is diffused by the light diffusing plate 13a and then irradiated to the user's skin as linearly polarized light by the first polarizing plate 13b, the light irradiation of this linearly polarized light detects the stain on the user's skin. It is used as lighting for.

Then, the reflected light from the user's skin based on two types of light, unpolarized light and linearly polarized light, passes through the openings provided in the first polarizing plate 13b and the light diffusing plate 13a, respectively, and is further polarized second. When the light passes through the plate 13c, is adjusted by the optical system of the optical mechanism unit 13, and then is incident on the image pickup element 12, the light is converted into an electric signal by the image pickup element 12 and output.

It should be noted that, as the illumination of the skin condition measuring device 10, unpolarized light irradiation and linearly polarized light irradiation are used properly to perform imaging so that texture detection and stain detection of the skin can be appropriately performed, but the present invention is not limited to this. It may be configured to irradiate circularly polarized light as illumination by using a circularly polarized light filter. Specifically, the case of right-handed circularly polarized light is used for detecting the texture of the skin, and the case of left-handedly turned circularly polarized light is used for skin. The lighting can be set to correspond to each of the stain detection. In addition, the color (wavelength) of the light emitted as lighting may be made to correspond to the texture detection and the stain detection of the skin, respectively. For example, the skin condition measuring device 10 may be used for skin color light and stain detection for texture detection. It is also possible to provide a light source capable of irradiating white light as illumination.

The skin condition measuring device 10 is a device that images the user's skin as a measurement of the user's skin condition, but is not limited to a device dedicated to skin condition measurement having a built-in light source for lighting as described above, and is not limited to a device equipped with a camera. The device may be, for example, a portable device such as a smartphone having a camera unit, or a device in which a conversion lens suitable for imaging the skin is attached to the camera unit of such a device. Further, the skin condition measuring device is not limited to such a device for imaging the skin, and includes another sensor for measuring the skin condition in place of or in combination with the imaging mechanism. It can also be configured. For example, the skin condition measuring device is a sensor that detects at least one of the water content of the user's skin, the oil content of the user's skin, the elasticity of the user's skin, etc. (that is, the moisture meter for the skin, the oil content meter). , Elasticity meter, etc.).

As the image pickup device, the terminal device 20 can image a predetermined range of the user's body including a skin condition measurement target portion by the skin condition measurement device 10 and the skin condition measurement device 10 existing in the vicinity of the measurement target portion. It also has the recording unit 21, the display unit 22, and the control unit 23.

Further, the terminal device 20 is connected to the skin condition measuring device 10 capable of imaging a predetermined part of the user's skin in a wired or wireless manner, and the skin condition measuring (imaging) is executed by the skin condition measuring device 10. And skin image data can be acquired.

The terminal device 20 is a known portable terminal device such as a mobile phone, a so-called smartphone, or a tablet device having a wireless communication means 24 for connecting to and communicating with an IP communication network, and among these, an application program on the device. And has a (hardware) interface 25 such as USB to which the skin condition measuring device 10 can be connected. The terminal device 20 is provided with a camera unit 26 capable of taking an image of a predetermined range of the user's body and the skin condition measuring device 10, so that the terminal device 20 can function as an image pickup device.

The terminal device 20 as an image pickup device is an information processing device that realizes functions and processing as the terminal device 20 by executing a program stored in advance, and is connected to a skin condition measuring device 10 to obtain a skin condition. As long as it can measure the above, it is not limited to a portable device, and may be a computer such as a notebook type or a desktop type with a camera. In addition, the image pickup device incorporates a camera or display behind the mirror portion (half mirror) of another information processing device specialized for a specific application such as beauty, for example, a mirror stand, makeup, or a table mirror for beauty. In addition to being used as a normal mirror, it is possible to display the user's image taken by the camera, the processed image, the information obtained by analyzing the user's image, etc. on the mirror surface as needed. It doesn't matter if it's an electronic device.

Further, it is needless to say that the terminal device 20 as an image pickup device is a device different from the skin condition measurement device 10 because it captures the user's skin and the skin condition measurement device 10. When a portable device with a camera such as a smartphone as described above is used as the device 10, the image pickup device (terminal device) may be a similar portable device with a camera.

The terminal device 20 can analyze image data obtained by imaging and acquire diagnostic information by using an application program for skin condition diagnosis, and the user can refer to the obtained diagnostic information. In this case, the terminal device 20 can be referred to by displaying the acquired diagnostic information as content on the display unit 22 by executing the application program.

The recording unit 21 in the terminal device 20 obtains the data related to the skin condition measuring device 10 as the skin condition measurement data obtained by the measurement by the skin condition measuring device 10, that is, the skin obtained by imaging the skin condition measuring device 10. It is recorded in association with the image data of a predetermined part.

When the recording unit 21 acquires the image data of the skin as the data related to the skin condition measuring device 10 by the imaging as the skin condition measurement by the skin condition measuring device 10, the recording unit 21 captures the image of the terminal device 20 as the imaging device. Information about the usage state of the skin condition measuring device 10 detected by analyzing the obtained image data will be recorded.

The display unit 22 is capable of displaying an image representing at least the predetermined range of the body of the user. The display unit 22 in the terminal device 20 is a touch panel type display device, and has a configuration that also serves as an input device.

The control unit 23 controls the measurement of the skin condition by the skin condition measuring device 10, and at least an image is displayed on the display unit 22 based on the image data of the predetermined range of the body obtained by the imaging of the terminal device 20 also serving as the imaging device. It is intended to display.

The control unit 23 refers to the measurement target portion of the user based on the information about the usage state of the skin condition measuring device recorded in the recording unit 21 at the time of new skin condition measurement by the skin condition measuring device 10. An image related to the previous usage state of the skin condition measuring device is acquired, the image is synthesized so as to be superimposed on the image representing the predetermined range of the user's body, and the processed image is displayed on the display unit 22. ..

Then, the control unit 23 detects the usage state of the skin condition measuring device 10 by analyzing the image data obtained by the image pickup of the terminal device 20 received from the terminal device 20, and continuously monitors this. Then, the control unit 23 changes the usage state of the skin condition measuring device 10 to the previous usage state of the skin condition measuring device 10 included in the information about the usage state of the skin condition measuring device 10 recorded in the recording unit 21. If it is determined whether or not they match and it is determined that they match the previous use state, the skin condition measuring device 10 can be made to measure the skin condition.

Further, the control unit 23 analyzes and detects an image captured and acquired by the terminal device 20 as an image pickup device, and provides information about the usage state of the skin condition measurement device 10 (for example, the position of the skin condition measurement device 10). The usage state (position and orientation) of the skin condition measuring device 10 for measuring the skin condition is adjusted to the previous usage state of the skin condition measuring device displayed on the display unit 22 based on the information on the orientation. It is also possible to give a guidance display by the display unit 22 or a notification related to the guidance by a predetermined notification means.

The image (face, etc.) representing the user's body predetermined range displayed on the display unit by the control unit 23 is an image as long as it is based on the image data of the body predetermined range obtained by the imaging of the terminal device 20 also serving as an image pickup device. In addition to the actual image of a predetermined range of the body obtained by converting the data as it is into an image for display and trimming it as necessary, a simplified image such as computer graphics (CG) may be generated and displayed. ..

In addition, the control unit 23 controls the imaging of the skin condition measuring device 10 based on the information about the usage state of the skin condition measuring device 10 recorded in the recording unit 21, and the user's skin condition with respect to the measurement target range. If it is determined that the usage state of the measuring device 10 matches the previous predetermined usage state of the skin condition measuring device 10, the skin condition measuring device 10 can be made to perform the skin condition measurement corresponding to the predetermined usage state. ..

Specifically, the control unit 23 grasps the position and orientation of the skin condition measuring device 10 as the usage state of the skin condition measuring device 10 corresponding to the portion to be imaged, and changes the imaging conditions accordingly. For example, when the skin condition measuring device 10 takes an image of a part of the skin that is easily exposed to sunlight or a part that is easily dried, the skin condition is such that the lighting at the time of imaging by the skin condition measuring device 10 is different from that at the time of imaging of other parts. Control the measuring device 10. Further, the control unit 23 can also perform diagnostic processing such as image analysis when deriving diagnostic information on the skin condition, which will be described later, by setting different conditions according to the characteristics of each portion.

The control unit 23 analyzes the image data of the predetermined portion of the skin acquired by the imaging of the skin condition measuring device 10 and the image data of the predetermined range of the body obtained by the imaging of the terminal device 20, respectively, and the user It has a function to acquire diagnostic information of skin condition. Such a function is realized by the control unit 23 executing a process according to an application program.

As the above process, the control unit 23 evaluates the user's skin based on the image data and obtains an index value indicating the user's skin condition. For example, the control unit 23 determines the skin condition as skin age, fineness of skin texture, degree of skin fairness, degree of skin pore opening, amount of skin stains, and amount of skin content (degree of moisturization). ), At least one of the items such as the amount of oil contained in the skin is evaluated, and the index value indicating the skin condition is obtained from the evaluation result.

In the present embodiment, the control unit 23 obtains an index value indicating the skin condition of the user by performing predetermined image processing on the images taken by the skin condition measuring device 10 and the terminal device 20.
For example, the control unit 23 performs edge detection on the captured image, detects the skin groove in the image, identifies the area of the skin hill surrounded by the detected skin groove, and the size of the specified skin hill area. An index value indicating the fineness of the texture of the skin (an index value indicating the skin condition) is obtained as an index value in which the value becomes larger as the uniformity becomes closer to constant.
Further, when the skin condition measuring device 10 includes another sensor, the control unit 23 may obtain an index value indicating the user's skin condition based on the signal obtained by the other sensor.

In the present embodiment, the control unit 23 determines as diagnostic information information indicating that the diagnostic result is obtained as an index value indicating the skin condition of the user. Then, the control unit 23 controls so that the acquired diagnostic information can be appropriately displayed on the display unit 22 as the display content of the display unit 22. For example, the control unit 23 can create a graph for some index values indicating the skin condition of the user among the diagnosis results, and display the graph as display content on the display unit 22.

Further, the control unit 23 receives data including information such as skin condition, skin care action information, skin image, and time when skin imaging is performed on the terminal device 20, and is an index indicating the accepted skin condition. The value, skin care action information, skin image, and skin imaging time information are associated with each other and temporarily stored in the recording unit 21 of the terminal device 20, and the stored index value of the skin condition and the skin imaging are performed. It is also possible to diagnose the user's skin condition based on the information on when the image was taken.

Specifically, the control unit 23 identifies the transition of the skin condition index value over time based on the skin condition index value stored in the recording unit 21 and the time information when the skin condition measurement is performed. Diagnose whether or not the skin condition has improved based on the identified transitional aspect. For example, the control unit 23 identifies the transition of the index value of the skin condition over time in the period (for example, about 28 days ± 1 day to 7 days) required for the metabolism (turnover) of the user's skin immediately before the treatment. Diagnose skin condition.

Further, the control unit 23 is designated for a period different from the period required for the user's turnover immediately before processing (for example, a period of a predetermined length immediately before processing (for example, 1 week, 10 days, 1 month, etc.)). The skin condition may be diagnosed by specifying the transition of the index value of the skin condition over time.

When the index value of the skin condition changes in the direction indicating the improvement of the skin condition over time, the control unit 23 gives a diagnosis result that the skin condition of the user has improved. On the other hand, the control unit 23 controls the user's skin when the index value of the skin condition does not change in the direction indicating improvement of the skin condition over time (changes in the direction showing deterioration or changes so as not to change). Gives a diagnosis that the condition has not improved.
Further, the control unit 23 may perform a diagnostic process in which attributes such as the age of the user are taken into consideration as the diagnostic process of the skin condition.

The control unit 23 controls so that an image including a graph or text showing diagnostic information is appropriately displayed on the display unit 22 of the terminal device 20. In addition, the control unit 23 is a transition graph showing the transition of the skin condition, an image group which is a skin image, an action information group showing information on the skin care action corresponding to the skin image, a predetermined skin care product or a skin care service. Control may be performed so that an image including an advertisement showing an advertisement (with a link) is appropriately displayed on the display unit 22.

Further, the control unit 23 may create a content showing the diagnosis result as a part of the diagnosis information, and display the content on the display unit 22 so that the content can be referred to by the terminal device 20. For example, the control unit 23 creates content including a bar object showing an index value of the skin condition for each of the degree of moisturization, the degree of pore opening, the degree of whitening, and the skin age (aging), and displays the content on the display unit 22. You may do so.

Next, the usage state of the skin condition measurement system according to the present embodiment will be described. As a premise, the skin condition measurement target portion by the skin condition measuring device 10 is a main part of the skin of the face (cheeks, eyes, mouth, etc.), and the entire face including these is defined as a predetermined range of the user's body. The terminal device 20 is a smartphone, and by using a camera unit (so-called in-camera) provided on a side of the display unit 22, it can function as an image pickup device, and a skin condition measuring device 10 which is a camera can be connected to the camera unit. It is supposed to be. The skin condition measuring device 10 has a narrower imaging range than the terminal device 20, but can perform imaging with a higher resolution, and images the skin in an extremely narrow range of the face as a measurement of the skin condition.

In order to measure the skin condition using the terminal device 20 and the skin condition measuring device 10, first, the user connects the skin condition measuring device 10 to the terminal device 20.
Subsequently, by the user's operation, when an application program that provides a user interface for using the skin condition measuring device 10 that exists in the terminal device in advance is started on the terminal device 20, the user can use the terminal device 20 to start the application program. The skin condition measuring device 10 can be used for measurement.

In addition, when the skin condition measuring device 10 is connected to the user's terminal device 20, an application program that provides a user interface for using the skin condition measuring device 10 recorded in advance in the terminal device 20 is operated by the user. It can also be automatically activated without the need to enable the user to use the skin condition measuring device 10 through the terminal device 20.

When the user performs an operation to start measurement on the user interface displayed on the terminal device 20, the terminal device 20 executes the image of the face as a predetermined range of the user's body.
Specifically, by executing the application program for skin condition measurement in the terminal device 20, the user operates the user interface displayed on the display unit 22, and first, the terminal device 20 as an image pickup device is used. Imaging of the user's face is started, and image data is continuously acquired by the terminal device 20.

When the user's face is imaged by the terminal device 20, the face image is displayed on the display unit 22 based on the image data obtained by the image pickup. The terminal device 20 causes the user to maintain a state of supporting the terminal device 20 so that the face is displayed in a predetermined direction and size by a predetermined guidance display or the like by the display unit 22 (see FIG. 4).

At this time, when the control unit 23 of the terminal device 20 refers to the recording unit 21 and performs information on the usage state of the skin condition measuring device 10 at the time of the previous skin condition measurement, that is, when the image is taken as the skin condition measurement. It is determined whether or not there is a record of information related to the position and orientation of the skin condition measuring device 10 in the above.

When the recording unit 21 has a record of information about the previous usage state, an image showing the usage state of the skin condition measuring device 10 based on this information, for example, a predetermined position and orientation indicating the position and orientation of the skin condition measuring device 10. A guide design unit (mark) is generated, a process of synthesizing the image of the face obtained by imaging of the terminal device 20 is performed, and the combined image is displayed on the display unit 22.

The user displays the skin condition measuring device 10 while looking at the screen of the display unit 22 showing the image showing his / her face and the usage state (position and orientation of the skin condition measuring device 10) of the previous skin condition measuring device 10. The position is adjusted so as to match the usage state shown in the unit 22 (see FIG. 5).

Here, based on the recording of information about the previous usage state, the guide design section showing the position and orientation of the skin condition measuring device 10 is synthesized and displayed as the usage state of the skin condition measuring device 10. However, the present invention is not limited to this, and as information on the usage state of the skin condition measuring device 10, an image showing a position on the face to be imaged according to the position and orientation of the skin condition measuring device 10 may be synthesized. It does not matter (see Fig. 6).

The control unit 23 of the terminal device 20 analyzes continuously acquired image data to derive information about the current usage state of the skin condition measuring device 10 held by the user, and this usage state is transmitted to the recording unit 21. When the used state of the skin condition measuring device 10 (position and orientation of the skin condition measuring device 10) in the recorded information is matched, the skin is indicated by the display unit 22 or the like of the terminal device 20 as necessary. An image is taken by the skin condition measuring device 10 on a predetermined part of the skin to which the state measuring device 10 is directed (see FIG. 7).

It should be noted that the image pickup by the skin condition measuring device 10 is automatically executed when the coincidence between the used state of the skin condition measuring device 10 and the recorded previous used state is recognized, but the present invention is not limited to this. The skin condition measuring device is made to operate the terminal device 60 by the user who confirms the matching of the used state only by notifying the user of the match between the used state of the skin condition measuring device 10 and the recorded previous used state by notification or the like. The image may be taken at 10.

On the other hand, when the recording unit 21 does not record information about the previous usage state of the skin condition measuring device 10, such as when the skin condition measuring is first executed, the control unit 23 of the terminal device 20 may use the user's body predetermined range. The user measures the skin condition of the part of the face that is to be measured by the skin condition measuring device 10, that is, the part of the skin that can be imaged by the skin condition measuring device 10 of the face. Guidance display, voice guidance, etc. are executed for the user so that the image can be taken by the device 10. Alternatively, a process of preliminarily selecting a part where the skin condition is generally measured and synthesizing a predetermined guide design part indicating one or more parts of the skin registered as an initial measurement position with a face image. Is performed, and the combined image is displayed on the display unit 22. In this way, the user can point the skin condition measuring device 10 at an arbitrary part of the face, or take an image while looking at the initial measurement position on the face indicated by the guidance design unit displayed on the display unit 22. The position of the skin condition measuring device 10 is adjusted so as to be.

In this case, instead of synthesizing and displaying the image of the initial measurement position with the image of the face, the image data previously obtained by the imaging by the terminal device 20 is analyzed by the control unit 23 of the terminal device 20 and the user For further appropriate diagnosis of skin condition, for example, it is necessary to confirm the presence or absence of stains because a sign of the presence of a stain or the like is found on a part of the skin from this information by deriving the diagnostic information of the skin condition of the face. Therefore, a part that needs to acquire a detailed image by imaging of the skin condition measuring device 10 is identified. The control unit 23 sets the portion indexed in this way at the measurement target position of the skin condition measuring device 10. Then, the control unit 23 performs a process of synthesizing a predetermined guide design unit indicating the measurement target position into a face image based on the image data, displays the combined image on the display unit 22, and is displayed by the user. It is also possible to adjust the position of the skin condition measuring device 10 while looking at the portion 22.

The control unit 23 of the terminal device 20 analyzes continuously acquired image data to derive information about the current usage state of the skin condition measuring device 10 held by the user, and the user cares from this usage state. When it is determined that the skin condition measuring device 10 is in a positioned state toward the part to be measured or so that the initial measurement position can be imaged, the display unit 22 of the terminal device 20 or the like indicates to that effect as necessary. In the same manner as described above, an image is taken by the skin condition measuring device 10 on a predetermined part of the skin to which the skin condition measuring device 10 is directed.

In this case as well, instead of automatically performing imaging by the skin condition measuring device 10 when the state in which the skin condition measuring device 10 is positioned is recognized, the image is directed to the portion of concern to the user, or the above. The user himself / herself recognizes that the skin condition measuring device 10 is positioned so that the initial measurement position can be imaged, or the skin condition measuring device 10 is positioned so that the initial measurement position can be imaged. When the display unit 22 or the like of the terminal device 20 indicates that there is a certain effect, the user presses the shutter button of the terminal device 20 or the like to operate the terminal device 20 by himself / herself to perform imaging with the skin condition measuring device 10. You may do so.

The skin condition measuring device 10 that has reached the stage of performing an image capture an image of the skin surface under a predetermined lighting condition by a built-in light source as a skin condition measurement, and outputs image data. This image data is acquired by the terminal device 20 communicated with and connected to the skin condition measuring device 10. For example, in the skin condition measuring device 10, the built-in light source capable of adjusting the light to be irradiated as illumination verifies the irradiation state of the light to the part to be imaged, and verifies the skin image obtained by the trial imaging of the skin condition measuring device 10. After being optimized after Each image data of is sent to the terminal device 20 and acquired by the terminal device 20.

When performing imaging by the skin condition measuring device 10, the control unit 23 acquires and analyzes the image data including the user's face and the skin condition measuring device 10 imaged by the terminal device 20, and uses the skin condition measuring device 10. Information about the state, that is, information on the position and orientation of the skin condition measuring device 10 during imaging with respect to the user's face is derived, and this is recorded in the recording unit 21. As the information on the usage state of the skin condition measuring device 10, information on the imaging conditions of the skin condition measuring device 10, for example, information on the lighting condition by the built-in light source, and the like are also recorded.

Then, the control unit 23 of the terminal device 20 acquires the image data of the predetermined portion of the skin obtained by the imaging of the skin condition measuring device 10, and then generates an image of the predetermined portion for display based on the image data. The image of the predetermined portion is displayed on the screen of the display unit 22 (see FIG. 8).

In this case, the control unit 23 of the terminal device 20 displays the image of the face for display based on the image data obtained by the imaging of the terminal device 20 in a predetermined area on the screen of the display unit 22, and at the same time. The image of the predetermined portion is displayed in a region different from the face image on the screen of the display unit 22, and the image of the entire face including the predetermined portion and the image of the predetermined portion are simultaneously displayed in parallel. It can also be displayed, and it is possible to compare each image with respect to the skin condition of the predetermined portion. The face image here is based on the image data obtained by imaging by the terminal device 20 during the imaging of the skin condition measuring device 10, and the face image as the predetermined range of the body on which the skin condition measuring device 10 overlaps. Although an image can be used, an image of a face on which the skin condition measuring device 10 does not overlap is used based on the image data obtained by imaging by the terminal device 20 before the skin condition measuring device 10 takes an image. Is desirable. When the skin condition measuring device 10 displays a non-overlapping face image, it is more desirable to indicate the image pickup position by the skin condition measuring device 10 in the face image based on the information about the usage state.

Further, the control unit 23 of the terminal device 20 analyzes the image data of the predetermined portion, acquires the diagnostic information of the user's skin condition, and displays the display unit 22 in parallel with the skin image or replaces the skin image. Display (see FIG. 9). By displaying this diagnostic information, one skin condition measurement by using the skin condition measuring device 10 is completed.

Regarding the display of the diagnostic information, not only the diagnostic information of the skin condition of the predetermined portion based on the imaging by the skin condition measuring device 10 is displayed, but also the skin condition measuring device obtained before the imaging by the skin condition measuring device 10 is displayed. The diagnostic information of the skin condition of the entire face obtained by analyzing the image data of the face as the predetermined range of the body where the 10s do not overlap is analyzed in parallel with the diagnostic information of the skin condition of the predetermined portion. It may be displayed on the display unit 22.

After that, in order to grasp the transition of the skin condition, the user repeats the skin condition measurement by the terminal device 20 and the skin condition measuring device 10 at predetermined measurement intervals. Similarly to the above, the user connects the skin condition measuring device 10 to the terminal device 20, enables the skin condition measuring device 10 to be used for measurement, and then operates the terminal device 20 to image the user's face on the terminal device 20. Then, the terminal device 20 continuously acquires image data by imaging.

The terminal device 20 displays an image of the face on the display unit 22 based on the image data obtained by imaging, and displays information on the usage state of the previous skin condition measuring device 10 recorded on the recording unit 21. An image showing the usage state of the skin condition measuring device 10 is generated based on the reading and information, a process of synthesizing the image with the face image is performed, and the combined image is displayed on the display unit 22. When the skin condition measurement is repeatedly performed in this way, since the information about the usage condition of the skin condition measuring device 10 is recorded in the recording unit and exists, the user's skin is set to the usage condition based on the information recorded in the recording unit 21. It is possible to smoothly guide and guide the state measuring device 10 to match.

The user adjusts the position of the skin condition measuring device 10 with reference to the display unit 22, and the usage state (position and orientation of the skin condition measuring device 10) of the skin condition measuring device 10 is the skin in the information recorded in the recording unit 21. When the usage state of the state measuring device 10 is matched, the control unit 23 of the terminal device 20 causes the skin state measuring device 10 to perform imaging of a predetermined part of the skin.

The skin condition measuring device 10 adjusts the lighting condition by the built-in light source based on the information related to the imaging condition among the information about the usage state of the skin condition measuring device 10 recorded in the recording unit 21 of the terminal device 20. After that, imaging is appropriately performed, and the obtained image data is transmitted to the terminal device 20.

The control unit 23 of the terminal device 20 displays an image for display based on the image data received from the skin condition measuring device 10 on the display unit 22, analyzes the image data, and acquires diagnostic information on the user's skin condition. Then, this diagnostic information is displayed on the display unit 22, and a series of skin condition measurements are completed.

Information about the usage state of the skin condition measuring device 10 is recorded in the recording unit 21, and by using this information to proceed with imaging by the skin condition measuring device 10, the skin condition measuring device 10 can be used as information about the usage state. Based on this, the setting of imaging conditions such as the state of light from the light source is promptly optimized, skin imaging is performed appropriately and smoothly, and the obtained image data also correctly reflects the skin condition. The quality of the diagnostic information derived by analyzing the image data by the control unit 23 of the above can be improved.

As described above, the skin condition measuring system according to the present embodiment is a terminal as an imaging device that captures a wider range of the skin together with the skin condition measuring device 10 as opposed to the skin condition measuring device 10 that performs imaging by measuring the skin condition. A device 20 is provided, an image including the skin condition measuring device 10 obtained by imaging of the terminal device 20 is analyzed, information about the usage state of the skin condition measuring device 10 is recorded in the recording unit 21, and the recorded skin is recorded. Since the measurement site by the skin condition measuring device 10 in the user's predetermined range can be correctly identified based on the information of the condition measuring device 10, the measurement result of the skin condition can be used, for example, the diagnosis based on the measured skin condition can be performed. Efficient use can be achieved, such as being able to perform more accurately based on the characteristics of the skin of each part within a predetermined range of the body.

Further, based on the recorded information of the skin condition measuring device 10, the skin condition measuring device 10 can be used at another measurement opportunity of the skin condition in the same manner as the usage state of the skin condition measuring device 10 at the previous measurement opportunity. Therefore, the measurement can be properly managed, such as by repeating the measurement of the skin condition after making the position and orientation of the skin condition measuring device 10 the same as the previous measurement opportunity, and correctly acquiring the time-series change of the skin condition. It is possible to improve the accuracy of skin condition diagnosis, reduce the work load associated with the alignment of the skin condition measuring device 10 at the time of measurement by the user, and use the device easily and reasonably.

(Second Embodiment of the present invention)
The skin condition measurement system according to the second embodiment of the present invention will be described with reference to FIGS. 10 to 14.
In each of the above figures, the skin condition measuring system 1 according to the present embodiment is connected to a skin condition measuring device 10 capable of imaging a predetermined part of the user's skin and the skin condition measuring device 10 in a communicable manner. It also has a configuration including a terminal device 30 having the control unit 31 and the display unit 32.

Also in this embodiment, the user who is the target person of the skin condition measurement has entered into a contract to receive the skin condition diagnosis service with the provider of the skin condition measurement system 1 as in the first embodiment. ing. Further, the user can use the skin condition measuring device 10 by purchasing or renting it by himself / herself.

As a result, as in the first embodiment, the user can obtain the skin condition diagnosis result by the skin condition measurement system 1, and the provider can enjoy the merits such as being able to acquire the data related to the user's skin condition. Become.

The skin condition measuring device 10 is a kind of camera capable of taking an image of a predetermined part of the user's skin as a measurement of the user's skin condition, and includes a point of incorporating a predetermined light source for lighting. It has the same device configuration as that shown in the first embodiment, and detailed description thereof will be omitted.

The terminal device 30 is capable of imaging a predetermined range of the user's body including a skin image pickup target portion by the skin condition measuring device 10 as the image pickup device, and also has the control unit 31 and the display unit 32. be.

Further, the terminal device 30 is connected to a skin condition measuring device 10 capable of imaging a predetermined part of the user's skin in a wired or wireless manner, and when imaging by the skin condition measuring device 10 is executed, skin image data is obtained. Can be obtained.

Similar to the first embodiment, the terminal device 30 is a known portable terminal device such as a mobile phone, a so-called smartphone, or a tablet device having a wireless communication means 34 for connecting to and communicating with an IP communication network. Among these, the device has a (hardware) interface 35 such as a USB that can execute an application program on the device and can connect the skin condition measuring device 10. The terminal device 30 is provided with a camera unit 36 capable of taking an image of a predetermined range of the user's body and the skin condition measuring device 10, so that the terminal device 30 can function as an image pickup device.

The terminal device 30 is an information processing device that realizes functions and processes as the terminal device 30 by executing a program stored in advance, and can measure the skin condition by connecting the skin condition measuring device 10. As long as it is, the device is not limited to the portable device as in the first embodiment, and may be a computer such as a notebook type or a desktop type, or another information processing device specialized for a specific application.

Similar to the first embodiment, the terminal device 30 can analyze image data obtained by imaging and acquire diagnostic information by using an application program for skin condition diagnosis, and the obtained diagnosis can be obtained. Information can be viewed by the user. In this case, the terminal device 30 can be referred to by displaying the acquired diagnostic information as content on the display unit 32 by executing the application program.

The control unit 31 in the terminal device 30 acquires information on the skin condition based on the skin image data obtained by imaging.
The control unit 31 is capable of acquiring information on the skin condition of the predetermined body range based on the image data of the predetermined range of the body obtained by the image pickup of the terminal device 30 also serving as the image pickup device, and is capable of acquiring the skin condition of the predetermined range of the body. It is possible to acquire information on the skin condition of the predetermined portion based on the image data of the predetermined portion of the skin obtained by the imaging of the measuring device 10. Then, the control unit 31 makes available the information regarding the skin condition of the predetermined portion in association with the partial information corresponding to the predetermined portion of the skin among the information regarding the skin condition of the predetermined range of the body. It becomes.

Specifically, the control unit 31 acquires an image for displaying the predetermined range of the body derived from the image data of the predetermined range of the body as information regarding the skin condition of the predetermined range of the body, and the control unit 31 acquires the image for displaying the predetermined range of the body and the skin condition of the predetermined portion. As the information regarding the skin, an image for displaying the predetermined portion derived from the image data of the predetermined portion of the skin is acquired.

Then, the control unit 31 associates the image of the predetermined portion with a part of the information corresponding to the predetermined portion of the skin in the image of the predetermined range of the body, and the image of the predetermined range of the body on the display unit 32. It is possible to display the image of the predetermined portion in parallel with the display of a part or all of the image.

Further, the control unit 31 acquires diagnostic information of the skin condition of the predetermined body range by analyzing the image data of the predetermined range of the body as other information regarding the skin condition of the predetermined range of the body, and similarly, the predetermined portion. As another information regarding the skin condition of the skin, the diagnostic information of the skin condition of the predetermined portion is acquired by analyzing the image data of the predetermined portion of the skin. The function of the control unit 31 to analyze each image data and acquire the diagnostic information of the user's skin condition is realized by the control unit 31 executing the process according to the application program, as described in the first embodiment. It is based on the same mechanism, and detailed description will be omitted.

Then, the control unit 31 associates the diagnostic information of the skin condition of the predetermined portion with the partial information corresponding to the predetermined portion of the skin in the diagnostic information of the skin condition of the predetermined range of the body, and the display unit 32 displays. When displaying the diagnostic information of the skin condition in the predetermined range of the body, the partial information corresponding to the predetermined portion of the skin is supplemented or replaced with the partial information of the diagnostic information of the skin condition of the predetermined portion. It will be displayed.

Further, the control unit 31 corrects a part or all of the image of the predetermined body range derived from the image data of the predetermined range of the body based on the image of the predetermined portion derived from the image data of the predetermined portion. Processing (eg, color calibration) can be performed.

Further, the control unit 31 sets the skin condition measuring device at a predetermined position on the image to be imaged by the skin condition measuring device 10 with respect to the image of the body predetermined range derived from the image data of the body predetermined range. It is also possible to execute a process of synthesizing a predetermined guide design unit indicating that the image is the position to be imaged of 10, and display the processed image on the display unit 32. As a result, the guide design unit is displayed as a part of the image of the body predetermined range displayed on the display unit 32, and the user visually recognizes the position to be imaged by the skin condition measuring device 10 in the body predetermined range. It becomes understandable.

In addition, the control unit 31 acquires skin condition diagnostic information as information regarding the skin condition of the body predetermined range based on the image data of the body predetermined range obtained by the imaging of the terminal device 30 as the imaging device. Then, from the diagnostic information of the skin condition in the predetermined range of the body, a predetermined part of the skin to be imaged by the skin condition measuring device 10 is selected, and the skin condition measuring device 10 can perform imaging on the predetermined part of the skin. You can also.

The display unit 32 is capable of displaying at least an image of the predetermined range of the user's body. More specifically, the display unit 32 executes the display of the image for displaying the predetermined range of the body acquired by the control unit 31 and the image for displaying the predetermined portion, and the predetermined body including the predetermined portion. The diagnostic information of the skin condition in the range will be displayed. Similar to the first embodiment, the display unit 32 is a touch panel type display device and has a configuration that also serves as an input device.

When the image of the predetermined portion is associated with a part corresponding to the predetermined portion in the image of the predetermined range of the body, the display unit 32 controls the body including the predetermined portion under the control of the control unit 31. While displaying an image of a predetermined range, an image of the predetermined portion having a larger enlargement ratio than the image of the predetermined range of the body is simultaneously and in parallel in an area different from the area on the screen of the display unit 32 on which the image is displayed. It is a mechanism to display.

In addition, when the image of the predetermined portion is associated with a part corresponding to the predetermined portion in the image of the predetermined range of the body, the display unit 32 also includes the predetermined range of the body including the predetermined portion. In the same area as the area on the screen of the display unit 32 in which the image of the predetermined range of the body is displayed by the control of the control unit 31 that receives the operation instruction to magnify and display the predetermined part while displaying the image of the above. It is also possible to enlarge the image of the predetermined range of the body and then switch to the image of the predetermined portion, and continuously display the image of the predetermined portion continuously from the previous image (see FIG. 15). On the contrary, when an operation instruction for reducing and displaying the predetermined part is given in a state where the image of the predetermined part is enlarged and displayed, the display of the image of the predetermined part is displayed by the control of the control unit 31 in response to the operation instruction. In the same area as the area on the screen of the unit 32, after the image of the predetermined part is reduced and displayed, the image is switched to the image of the predetermined range of the body, and the image of the predetermined range of the body is continuously continued from the previous image to the predetermined range. It may be displayed sequentially centering on the part.

Further, when the display unit 32 is associated with the partial information corresponding to the predetermined portion of the skin in the diagnostic information of the skin condition in the predetermined range of the body, the diagnostic information of the skin condition of the predetermined portion is associated with the partial information. Under the control of the control unit 31, of the diagnostic information of the skin condition in the predetermined range of the body, the partial information corresponding to the predetermined portion of the skin is supplemented with the diagnostic information of the skin condition of the predetermined portion. Alternatively, the partial information is replaced with the diagnostic information of the skin condition of the predetermined portion, and the information is displayed.

Next, the usage state of the skin condition measurement system according to the present embodiment will be described. As a premise, as in the first embodiment, the skin condition measurement target portion by the skin condition measuring device 10 is the main part of the skin of the face, and the entire face including these is defined as the user's body predetermined range. The terminal device 30 is a smartphone, and can be made to function as an image pickup device by using a camera on the display unit side. Further, the skin condition measuring device 10 connected to the terminal device 30 has a narrower imaging range than the terminal device 30, while being capable of imaging at a higher resolution, and images the skin in an extremely narrow range of the face. ..

Similar to the first embodiment, in order to perform imaging as a skin condition measurement using the terminal device 30 and the skin condition measuring device 10, the skin condition measuring device 10 is first connected to the terminal device 30 by the user. ..

Subsequently, by the user's operation, when an application program that provides a user interface for using the skin condition measuring device 10 existing in the terminal device 30 in advance is started on the terminal device 30, the user is started through the terminal device 30. Is ready to use the skin condition measuring device 10 for imaging.

In addition, when the skin condition measuring device 10 is connected to the user's terminal device 30, an application program that provides a user interface for using the skin condition measuring device 10 recorded in advance in the terminal device 30 is operated by the user. It can also be automatically activated without the need to enable the user to use the skin condition measuring device 10 through the terminal device 30.

When the user performs an operation to start imaging on the user interface displayed on the terminal device 30, the terminal device 30 executes imaging of the user's face.
Specifically, by executing the application program for skin condition measurement in the terminal device 30, the user operates the user interface displayed on the display unit 32, and first, the terminal device 30 as an image pickup device is used. The image of the user's face is executed, and the image data is continuously acquired by the terminal device 30.

When the user's face is imaged by the terminal device 30, the face image is displayed on the display unit 32 based on the image data obtained by the image pickup. The terminal device 30 causes the user to maintain a state of supporting the terminal device 30 so that the face is displayed in a predetermined direction and size by a predetermined guidance display or the like by the display unit 32.

The terminal storage 30 displays a face image based on the image data obtained by imaging on the display unit 32, and is a part of the face as a predetermined range of the user's body whose skin condition is measured by the skin condition measuring device 10. That is, in the skin portion that can be imaged by the skin condition measuring device 10 of the face, after the user sees the display of the face by the display unit 32, the user uses the skin condition measuring device 10 to target the portion that is concerned about the skin condition. Encourage the user to take an image by executing a guidance display or voice guidance.

Alternatively, the control unit 31 of the terminal device 30 analyzes the image data obtained by imaging to derive diagnostic information on the skin condition of the user's face, and from this information, for example, a spot or the like is present on a part of the skin. Find out the part where it is necessary to acquire a detailed image by imaging of the skin condition measuring device 10 for more appropriate diagnosis of the skin condition, such as the need to confirm the presence or absence of spots because the sign of the skin condition is found (see FIG. 11). .. Then, the control unit 31 sets the portion thus indexed to the imaging target position of the skin condition measuring device 10. Then, the control unit 31 performs a process of synthesizing a predetermined guide design unit indicating the image pickup target position into a face image based on the image data, and causes the display unit 32 to display the combined image.

The user is concerned about the skin condition of the face by holding the skin condition measuring device 10 in his hand while looking at the screen of the display unit 32 showing his / her face and, if necessary, the guide design unit. Adjust the position so that it faces the part or the position to be imaged indicated by the guide design section. When the position to be imaged by the skin condition measuring device 10 is indicated by the guide design section, the part to be imaged by the skin condition measuring device 10 on the face as the predetermined range of the body can be easily understood by the user, and the skin whose position is adjusted by the user can be easily understood. Imaging can be appropriately performed using the state measuring device 10.

The control unit 31 of the terminal device 30 analyzes continuously acquired image data to derive information about the current usage state of the skin condition measuring device 10 held by the user, and the user cares from this usage state. When it is determined that the skin condition measuring device 10 is in a positioned state toward the part to be measured or so that the measurement target position can be imaged, the display unit 32 of the terminal device 30 or the like indicates to that effect as necessary. After the above, the skin condition measuring device 10 is directed to perform imaging on a predetermined part of the skin to which the skin condition measuring device 10 is directed.

It should be noted that the image pickup by the skin condition measuring device 10 is automatically executed when the state in which the skin condition measuring device 10 is positioned is certified, but the present invention is not limited to this, and the image is not limited to this, and the image is not limited to this. Alternatively, the user himself / herself recognizes that the skin condition measuring device 10 is in a positioned state so that the measurement target position can be imaged, or the skin condition measuring device 10 is positioned so that the measurement target position can be imaged. When the display unit 32 or the like of the terminal device 30 indicates that the state is in a state, the user presses the shutter button of the terminal device 30 or the like, and the terminal device 30 is operated by himself to take an image with the skin condition measuring device 10. You may let it do.

The skin condition measuring device 10 that has reached the stage of performing an image capture an image of the skin surface under a predetermined lighting condition by a built-in light source as a skin condition measurement, and outputs image data. This image data is acquired by the terminal device 30 communicated with and connected to the skin condition measuring device 10. For example, in the skin condition measuring device 10, the built-in light source capable of adjusting the light to be irradiated as illumination verifies the irradiation state of the light to the part to be imaged, and verifies the skin image obtained by the trial imaging of the skin condition measuring device 10. After being optimized after Each image data of is sent to the terminal device 30 and acquired by the terminal device 30.

The imaging in the skin condition measuring device 10 is different from the light used as the illumination light in the imaging by the terminal device 30, such as natural light, indoor illumination light, and strobe light in the terminal device 30, for a predetermined portion of the user's skin. The image is taken in the state of irradiating the light from the built-in light source, and the image data with different imaging conditions can be acquired by the skin condition measuring device 10 and the terminal device 30. Therefore, it is possible to increase the difference between the images of the skin image affected by the reflection, absorption, and attenuation of the light irradiated as illumination in each layer of the skin between the skin condition measuring device 10 and the terminal device 30, and the skin condition. Select light by increasing the information content of the image data as a diagnostic material used in the diagnosis of the skin condition so that an appropriate diagnosis of the skin condition can be performed, and in particular, the wavelength of the light emitted as illumination is appropriate. Depending on the case, the skin condition measuring device 10 can perform imaging under conditions suitable for detailed analysis of partial skin condition, improving the accuracy of skin condition diagnosis based on the image data obtained by imaging. Be done.

At the time of executing the image pickup by the skin condition measuring device 10, the control unit 31 acquires and analyzes the image data including the user's face and the skin condition measuring device 10 imaged by the terminal device 30, and is in the process of imaging the user's face. Information on the position and orientation of the skin condition measuring device 10 is derived, and this information is recorded in a predetermined recording means, and in association with such information, information related to the imaging conditions of the skin condition measuring device 10 at the time of imaging, for example. It is desirable to record information about the lighting status of the built-in light source in the same manner so that it can be used for later imaging opportunities.

The control unit 31 of the terminal device 30 acquires the image data of the predetermined portion of the skin obtained by the imaging of the skin condition measuring device 10, and then generates an image of the predetermined portion for display based on the image data. The control unit 31 associates the image of the predetermined portion with a part corresponding to the predetermined portion in the face image based on the image data obtained by the image pickup of the terminal device 30. However, the face image here is defined as the predetermined range of the body on which the skin condition measuring device 10 does not overlap, based on the image data obtained by the image taken by the terminal device 30 before the skin condition measuring device 10 takes an image. It is an image of the face.

Then, the control unit 31 causes the display unit 32 to display a part or all of the face image associated with the image of the predetermined portion.
The display of a part or all of the face image on the display unit 32 can be displayed by setting a desired display range of the face by the control of the control unit 31 based on the user's operation. When the entire face is displayed in, or when only a part of the face is displayed, the range of the face displayed on the display unit 32 includes a part corresponding to the predetermined part. Simultaneously displays an image of the predetermined portion associated with a part corresponding to the predetermined portion in a region different from the region on the screen of the display unit 32 where the image of the face as the predetermined range of the body is displayed. (See FIG. 12).

In this way, the image of the face as the predetermined range of the body based on the image taken by the terminal device 30 and the image of the predetermined portion based on the image taken by the skin condition measuring device 10 are simultaneously and simultaneously displayed on the display unit 32. The image of the predetermined portion is displayed as a detailed image having a larger enlargement ratio than the face image based on the specifications of the skin condition measuring device 10, and is compared with the face image based on the image captured by the terminal device 30. It is possible to show a more detailed skin condition, and the user can confirm the skin condition from two image displays, and the skin condition can be grasped more accurately and easily.

On the other hand, the control unit 31 of the terminal device 30 acquires the image data of the predetermined portion of the skin from the skin condition measuring device 10 and then analyzes the image data to acquire the diagnostic information of the skin condition of the predetermined portion of the skin. do. The control unit 31 uses the diagnostic information about the predetermined part to correspond to the predetermined part in the diagnostic information of the skin condition of the face as the predetermined range of the body based on the image data obtained by the image pickup of the terminal device 30. Associate with department information. However, the diagnostic information of the skin condition of the face here is the diagnostic information based on the image data obtained by the imaging by the terminal device 30 before the imaging by the skin condition measuring device 10, and the analysis of the image data is performed by the terminal device. It is assumed that the image was taken immediately after the imaging by 30 until the diagnosis information of the skin condition of the predetermined portion was acquired.

Then, the control unit 31 replaces the diagnostic information of the skin condition of the face associated with the diagnostic information of the skin condition of the predetermined portion with the skin image of the face or the predetermined portion in parallel with the skin image or by replacing the skin image with the display unit 31. It is displayed on 32 (see FIG. 13).

When displaying the skin condition diagnostic information on the display unit 32, the control unit 31 may provide some information corresponding to the predetermined part of the skin among the diagnostic information of the facial skin condition as the predetermined range of the body. By supplementing or replacing this partial information, the diagnostic information of the skin condition of the predetermined portion is displayed.

In this way, among the diagnostic information of the skin of the face, the diagnostic information of the skin condition of the predetermined portion associated with the partial information corresponding to the predetermined portion is displayed so as to supplement or replace the diagnostic information. Is provided to the user as detailed information including information analyzed from the image data obtained by the skin condition measuring device 10, and the content of the user's skin condition diagnostic information based on the image data obtained by imaging. For at least the part of the face to be imaged by the skin condition measuring device 10, refer to the diagnostic information from another viewpoint by analyzing the image data derived from the skin condition measuring device 10 to check the skin condition. It enables the user to grasp the skin condition more accurately and easily, such as being able to understand.

The display of the diagnostic information on the skin condition of the face on the display unit 32 is not limited to the text-based information display, and the parts and symptoms of the skin to be noted are specifically shown on the face image by a marking image or the like. Information can also be provided. For example, the position and size of hidden stains derived as diagnostic information analyzed from the fine image data obtained by the skin condition measuring device 10 can be indicated by a predetermined color mark superimposed on the corresponding portion on the face image. It can be used as reference information when performing skin care such as stain prevention (see Fig. 14).
By displaying such diagnostic information, one skin condition measurement by using the skin condition measuring device 10 is completed.

The user repeats the imaging of the face as the predetermined range of the body by the same terminal device 30 and the imaging of the predetermined portion by the skin condition measuring device 10 at predetermined measurement intervals to obtain the transition of the skin condition on the face. It is possible to grasp the transition of the skin condition in more detail in the predetermined portion. Then, the terminal device 30 records an image of the face for display on the display unit 32 and the image of the predetermined portion based on the image data obtained by repeated imaging in the recording unit of the terminal device 30 for each imaging, and is necessary. It is also possible to display the images in a list in chronological order according to the situation, or to switch and display the images in chronological order, which is preferable because the user can easily grasp the change in the skin.

The image data of the face obtained by the imaging of the terminal device 30, which is the basis of the display image of the face as the predetermined range of the body and the diagnostic information of the skin condition, is captured by the skin condition measuring device 10. The image data is obtained by imaging with the previous terminal device 30, but instead of this, after the control unit 31 of the terminal device 30 acquires the image data of the predetermined portion of the skin from the skin condition measuring device 10, the said After performing image correction processing of the face image data based on the image data of the predetermined part, a face image for display based on the corrected face image data is generated, and the face image is displayed. It may be displayed on 32, or the corrected face image data may be analyzed to acquire diagnostic information on the skin condition of the face.

In this case, image correction processing is performed on the image data in the predetermined range of the body based on the image data of the predetermined portion based on the imaging of the skin condition measuring device 10, which makes it easy to adjust the imaging conditions by limiting the imaging range. Since the color of the skin image in the predetermined range of the body indicated by the image data is matched with that of the skin image in the image data of the predetermined portion, it can be obtained by imaging regardless of the imaging conditions of the terminal device 30. The image data in the predetermined range of the body can be easily analyzed for image display and diagnosis of the skin condition, and the user can be encouraged to correctly grasp the skin condition.

As described above, in the skin condition measuring system according to the present embodiment, the terminal device 30 captures the face as a predetermined range of the user's body, and the skin condition measuring device 10 captures a predetermined portion of the user's skin. Based on the obtained image data of the face and the image data of the predetermined portion, the control unit 31 acquires an image for display as information on the skin condition and diagnostic information on the skin condition, and images the skin condition 30. Of the facial image and skin condition diagnostic information based on the above, for some information corresponding to the predetermined portion of the skin, the image of the predetermined portion and the skin condition based on the image taken by the skin condition measuring device 10 When the diagnostic information is associated and a part of the information corresponding to the predetermined part of the skin is to be used, the separately acquired image of the predetermined part and the diagnostic information of the skin condition can be used, which is obtained by imaging. Based on the image data, the quality of each information about the user's skin condition can be improved, processing such as display and analysis of the skin condition can be performed with high accuracy, and the skin condition diagnosis can be appropriately and efficiently advanced to give the user skin. You can grasp the state more accurately.

In the skin condition measurement system according to the embodiment, when the control unit 31 displays an image of the body predetermined range on the display unit 32, the skin condition measuring device 10 in the image of the body predetermined range is used. When the image of the predetermined part is associated with a part corresponding to the predetermined part obtained by imaging, the image of the predetermined range of the body is simultaneously and simultaneously in a different area from the area on the screen on which the image of the predetermined range is displayed. The image of the predetermined part is displayed in parallel, but as shown in FIG. 15, as a method of displaying the image of the predetermined range of the body and the image of the predetermined part on the display unit 32, initially, as shown in FIG. While displaying the image of the predetermined range of the body, the image of the predetermined range of the body is displayed on the screen of the display unit 32 under the control of the control unit 31 that receives the operation instruction to magnify and display the predetermined portion of the image. In the same area as the area, the image of the predetermined area of the body may be enlarged and then switched to the image of the predetermined part, and the image of the predetermined part may be continuously displayed continuously from the previous image.

In this case, it is easy to recognize that the image of the predetermined part is an enlargement of a part of the image of the predetermined range of the body, and the position of the predetermined part captured by the skin condition measuring device 10 in the predetermined range of the body is impossible. It can be understood without any problem, and care based on the diagnostic information of the skin condition can be surely given to the appropriate position.

Further, in the skin condition measuring system according to the above embodiment, the skin condition measuring target portion by the skin condition measuring device 10 is set as a main part of the skin of the face, and the entire face including these is set as a predetermined range of the user's body. The image is taken by using the camera unit (so-called in-camera) 36 provided on the side of the display unit 32 in 30, but the image is not limited to this, and as shown in FIGS. 16 to 18, a smartphone is used. Using a camera unit (so-called out-camera) provided on the side opposite to the display unit 32 of the terminal device 30, a predetermined portion of the body away from the head, for example, an arm, a leg, a body portion, etc. While imaging is performed by the terminal device 30 as a predetermined range of the body, a narrow range of the skin is imaged by the skin condition measuring device 10 and the skin image captured by the terminal device 30 is displayed, or the image data obtained by imaging is used. It is also possible to acquire diagnostic information based on this and display the information content on the display unit 32 of the terminal device 30.

In this case, the image of the predetermined range of the body based on the image taken by the terminal device 30 is different from the case of the face in the embodiment, and the size of the predetermined area based on the image taken by the skin condition measuring device 10 is constant. Therefore, it is difficult to capture the size from the image, so it is desirable to synthesize an image of the scale showing the dimensional reference value in the image to make it easier to grasp the size.

(Third Embodiment of the present invention)
The skin condition measurement system according to the third embodiment of the present invention will be described with reference to FIGS. 19 and 20.
In each of the above figures, the skin condition measuring system 2 according to the present embodiment includes the skin condition measuring device 10 and the terminal device 40 also serving as the image pickup device, as in the first embodiment, except that the terminal device is different. While 40 has the display unit, it has a configuration including a server 90 having the control unit 42, which is arranged so that data communication is possible through the terminal device 40 and the network 100.

Also in this embodiment, the user who is the target person of the skin condition measurement has entered into a contract to receive the skin condition diagnosis service with the provider of the skin condition measurement system 2 as in the first embodiment. Moreover, since the skin condition measuring device 10 can be used, the skin condition measuring system 2 can obtain the skin condition diagnostic information.

The skin condition measuring device 10 is a kind of camera capable of taking an image of a predetermined part of the user's skin as a measurement of the user's skin condition, and includes a point of incorporating a predetermined light source for lighting. It has the same device configuration as that shown in the first embodiment, and detailed description thereof will be omitted.

As the image pickup device, the terminal device 40 can image a predetermined range of the user's body including a skin condition measurement target portion by the skin condition measurement device 10 and the skin condition measurement device 10 existing in the vicinity of the measurement target portion. At the same time, it has the display unit 41.

Further, the terminal device 40 is connected to the skin condition measuring device 10 capable of imaging a predetermined part of the user's skin in a wired or wireless manner, and when the imaging by the skin condition measuring device 10 is executed, the skin image data Can be obtained.

Similar to the first embodiment, the terminal device 40 is a known portable terminal device such as a mobile phone, a so-called smartphone, or a tablet device having a wireless communication means 44 for connecting to and communicating with an IP communication network. Among these, the device has a (hardware) interface 45 such as a USB that can execute an application program on the device and can connect the skin condition measuring device 10. The terminal device 40 is provided with a camera unit 46 capable of taking an image of a predetermined range of the user's body and the skin condition measuring device 10, so that the terminal device 40 can function as an image pickup device.

The terminal device 40 is an information processing device that realizes functions and processing as the terminal device 40 by executing a program stored in advance, is capable of communicating via the network 100, and is a skin condition measuring device. As long as it is possible to measure the skin condition by connecting the 10, the device is not limited to the portable device as in the first embodiment, but is specially applied to a computer such as a notebook type or a desktop type, or a specific application. It does not matter if it is another information processing device that has been converted.

The terminal device 40 activates an application program for measurement, images the face of the user as the predetermined range of the body of the user by the terminal device 40 itself which also serves as the image pickup device, acquires image data, and measures the skin condition. 10 is made to take an image of the predetermined portion of the skin as a measurement of the skin condition, image data of the predetermined portion of the skin is acquired from the skin condition measuring device 10, and these image data are transmitted to the server 90.

Further, the terminal device 40 performs communication requesting that the diagnostic information acquired by the server 90 can be referred to from the terminal device 40 by executing the application program, and acquires the diagnostic information as content from the responding server 90. It is displayed on the display unit 41. In addition, the terminal device 40 may receive and display the diagnostic information data transmitted from the server 90 side or download and display the diagnostic information data so that the diagnostic information can be referred to. ..

The terminal device 40 uses the notification function of the measurement application program to notify that the skin condition measuring device 10 is in a state where the skin condition can be measured, or a moving image explaining how to use the skin condition measuring device 10. It is also possible to show how to access the information of the above and make it possible to refer to this information.

The display unit 41 of the terminal device 40 is a display device having a display area capable of displaying an image of the user's body predetermined range. The display unit 41 is a touch panel type display device, and has a configuration that also serves as an input device.

More specifically, the display unit 41 executes the display of the image for displaying the predetermined range of the body acquired by the control unit 92 of the server 90 and the image for displaying the predetermined portion, and also the control unit 92. The diagnostic information of the skin condition in the predetermined range of the body including the acquired predetermined portion is displayed.

The server 90 is arranged so that data communication is possible through the terminal device 40 and the network 100, receives the image data acquired by the terminal device 40, acquires an image for display based on the image data, and obtains the image data. The analysis is performed to acquire the diagnostic information of the user's skin condition, the image for display and the diagnostic information are transmitted to the terminal device 40, and the display unit 41 of the terminal device 40 is made to display the image and the diagnostic information, respectively. It is a thing.

The server 90 is a computer provided with a CPU or the like that functions as a server. The function of the server is realized by the computer executing the process according to the recorded program.

The server 90 in the present embodiment is not necessarily limited to a computer having a single entity, and a plurality of computer devices are connected to a network and cooperate to provide one or a plurality of required services as a unit. In the case of a group of devices, or although it is only a part of the function of a computer device, it has a function to provide one or more required services as if it were one device, and the service is provided from the side to be provided. Is also included in the case of a virtual device that can be handled as one device.

The server 90 has image information for display on the terminal device and diagnostic information on the skin condition as information on the skin condition based on the skin image data obtained by imaging with the skin condition measuring device 10 and the terminal device 40. This is a configuration including a control unit 92 for acquiring the above. In other words, the server 90 realizes the function of the control unit 92 by the computer forming the server 90 executing the process according to the program.

The control unit 92 in the server 90 acquires information on the skin condition based on the skin image data obtained by imaging.
The control unit 92 is capable of acquiring information on the skin condition of the predetermined range of the body based on the image data of the predetermined range of the body obtained by the image pickup of the terminal device 40 received from the terminal device 40, and also. It is possible to acquire information on the skin condition of the predetermined portion based on the image data of the predetermined portion of the skin obtained by the image pickup of the skin condition measuring device 10 received from the terminal device 40. Then, the control unit 92 makes available the information regarding the skin condition of the predetermined portion in association with the partial information corresponding to the predetermined portion of the skin among the information regarding the skin condition of the predetermined range of the body. It becomes.

Specifically, the control unit 92 acquires an image for displaying the predetermined range of the body derived from the image data of the predetermined range of the body as information regarding the skin condition of the predetermined range of the body, and the control unit 92 obtains an image for displaying the predetermined range of the body and the skin condition of the predetermined portion. As the information regarding the skin, an image for displaying the predetermined portion derived from the image data of the predetermined portion of the skin is acquired.

Then, the control unit 92 associates the image of the predetermined portion with a part of the information corresponding to the predetermined portion of the skin in the image of the predetermined range of the body, and transmits the information of the associated image to the terminal device 40. can do. Based on the control of the control unit 92, the terminal device 40 causes the display unit 41 to display an image of the predetermined range of the body including the predetermined portion, while the area on the screen of the display unit 41 on which the image is displayed is. In another area, the image of the predetermined portion having a larger enlargement ratio than the image of the predetermined range of the body can be displayed simultaneously and in parallel.

Separately from this, while the display unit 41 displays the image of the predetermined range of the body including the predetermined portion transmitted by the control unit 92, when an operation instruction for enlarging the predetermined portion is given, the display unit 41 receives the operation instruction. The terminal device 40 transmits the information of the operation instruction to the server 90, and by the control from the control unit 92 corresponding to this, in the same area as the area on the screen of the display unit 41 in which the image of the predetermined range of the body is displayed. It is also possible to enlarge the image of the predetermined range of the body and then switch to the image of the predetermined portion so that the image of the predetermined portion is continuously displayed continuously from the previous image. On the contrary, when an operation instruction for reducing and displaying the predetermined portion is given in a state where the image of the predetermined portion is enlarged and displayed, the terminal device 40 receiving the operation instruction sends the operation instruction information to the server 90, and the operation instruction information is transmitted to the operation instruction. Under the control of the corresponding control unit 92, the image of the predetermined part is reduced and displayed in the same area on the screen of the display unit 41 where the image of the predetermined part is displayed, and then the image is switched to the image of the predetermined range of the body. The image of the predetermined range of the body may be continuously displayed from the previous image without interruption, and may be sequentially displayed centering on the predetermined portion.

Further, the control unit 92 acquires the diagnostic information of the skin condition of the predetermined body range by analyzing the image data of the predetermined range of the body as other information regarding the skin condition of the predetermined range of the body, and similarly, the predetermined portion. As another information regarding the skin condition of the skin, the diagnostic information of the skin condition of the predetermined portion is acquired by analyzing the image data of the predetermined portion of the skin. The function of the control unit 92 to analyze each image data and acquire the diagnostic information of the user's skin condition is the same as that of the first embodiment except that the server 90 is the main body that executes the process according to the application program. It is based on the same mechanism, and detailed description will be omitted.

Then, the control unit 92 associates the diagnostic information of the skin condition of the predetermined portion with the partial information corresponding to the predetermined portion of the skin in the diagnostic information of the skin condition of the predetermined range of the body, and the associated diagnostic information. Can be transmitted to the terminal device 40. Based on the control of the control unit 92, the terminal device 40 has, on the display unit 41, about the partial information corresponding to the predetermined part of the skin among the diagnostic information of the skin condition in the predetermined range of the body. It is possible to supplement the diagnostic information of the skin condition of the predetermined portion or to display the partial information replaced with the diagnostic information of the skin condition of the predetermined portion.

Further, the control unit 92 corrects a part or all of the image of the predetermined body range derived from the image data of the predetermined range of the body based on the image of the predetermined portion derived from the image data of the predetermined portion. Processing (eg, color calibration) can be performed.

Further, the control unit 92 sets the skin condition measuring device at a predetermined position on the image to be imaged by the skin condition measuring device 10 with respect to the image of the body predetermined range derived from the image data of the body predetermined range. It is also possible to execute a process of synthesizing a predetermined guide design unit indicating that the image is the position to be imaged, transmit the processed image to the terminal device 40, and display the processed image on the display unit 41 of the terminal device 40. .. As a result, the guide design unit is displayed as a part of the image of the body predetermined range displayed on the display unit 41 of the terminal device 40, and the user should take an image with the skin condition measuring device 10 in the body predetermined range. The position can be visually recognized and understood.

In addition, the control unit 92 has skin condition diagnostic information as information regarding the skin condition of the body predetermined range based on the image data of the body predetermined range obtained by the image pickup of the terminal device 40 received from the terminal device 40. Is acquired, a predetermined part of the skin to be imaged by the skin condition measuring device 10 is selected from the diagnosis information of the skin condition in the predetermined range of the body, and the information related to the predetermined part of the skin is transmitted to the terminal device 40 to be a terminal. By indicating to the user by the display unit 41 or the like of the device 40, it is possible to perform imaging by the skin condition measuring device 10 on a predetermined part of the skin.

Next, the usage state of the skin condition measurement system according to the present embodiment will be described. As a premise, as in the second embodiment, the skin condition measurement target portion by the skin condition measuring device 10 is the main part of the skin of the face, and the entire face including these is defined as the user's body predetermined range. The terminal device 40 is a smartphone, and by using a camera on the display unit side, it can function as an image pickup device and can communicate with the server 90 through the network 100. Further, the skin condition measuring device 10 connected to the terminal device 40 has a narrower imaging range than the terminal device 40, while being capable of imaging at a higher resolution, and images the skin in an extremely narrow range of the face. ..

Similar to the second embodiment, in order to perform imaging as a skin condition measurement using the terminal device 40 and the skin condition measuring device 10, the skin condition measuring device 10 is first connected to the terminal device 40 by the user. ..

Subsequently, the user operates the terminal device 40 to access a predetermined web page prepared by the skin condition measurement service providing server (for example, the server 90), and the access causes the server to access the predetermined web page. Online services such as the provided web application can be used on the terminal device 40, and the terminal device 40 activates an application program that provides a user interface for using the skin condition measuring device 10, and the user can use the skin through the terminal device 40. The state measuring device 10 can be used for measuring the skin condition.

In addition, by the user's operation on the terminal device 40, an application program that provides a user interface for using the skin condition measuring device 10 recorded in the terminal device in advance is started on the terminal device 40, and the terminal device is started. The skin condition measuring device 10 may be made available to the user for skin condition measurement through the 40. Further, when the skin condition measuring device 10 is connected to the user's terminal device 40, the application program that provides the user interface for using the skin condition measuring device 10 recorded in advance in the terminal device 40 is not operated by the user. It can also be automatically activated to enable the user to use the skin condition measuring device 10 through the terminal device 40.

When the user performs a measurement start operation on the user interface displayed on the display unit 41 of the terminal device 40, the terminal device 40 executes the image pickup of the face as the user's body predetermined range.

Specifically, in the terminal device 40, the user interface is displayed on the display unit 41 by executing the application program for measuring the skin condition. When the user operates on this user interface, the terminal device 40 as the image pickup device starts imaging the user's face, the terminal device 40 continuously acquires the image data, and transmits the image data to the server 90. ..

Then, the terminal device 40 causes the display unit 41 to display the image of the face based on the image data obtained by the imaging. The terminal device 40 causes the user to maintain a state of supporting the terminal device 40 so that the face is displayed in a predetermined direction and size by a predetermined guidance display or the like by the display unit 41.

In the server 90, the control unit 92 displays a face image based on the image data obtained by imaging on the display unit 41 of the terminal storage 60, and the skin condition measuring device 10 of the face as a predetermined range of the user's body. In the skin condition measurement target portion, that is, the skin portion that can be imaged by the facial skin condition measuring device 10, the user is interested in the skin condition after seeing the facial display by the display unit 41. Sends an instruction to guide the skin condition measuring device 10 to take an image to the terminal device 40, and causes the terminal device 40 to perform guidance display to the user, voice guidance, and the like.

Alternatively, the control unit 92 receives image data obtained by imaging by the terminal device 40 from the terminal device 40 and analyzes it to derive diagnostic information on the skin condition of the user's face, and from this information, for example, one of the skin. Since a sign of the presence of a stain or the like was found in the part, it is necessary to confirm the presence or absence of the stain. put out. Then, the control unit 92 sets the portion indexed in this way at the imaging target position of the skin condition measuring device 10. Then, the control unit 92 performs a process of synthesizing a predetermined guide design unit indicating the image pickup target position into a face image based on the image data, transmits the combined image to the terminal device 40, and causes the terminal device 40. Is displayed on the display unit 41 of.

The user is worried about the skin condition of the face while holding the skin condition measuring device 10 in his hand while looking at the screen of the display unit 41 showing his / her face and the guide design unit as needed. Adjust the position so that it faces the part or the position to be imaged indicated by the guide design section. When the position to be imaged by the skin condition measuring device 10 is indicated by the guide design section, the part to be imaged by the skin condition measuring device 10 on the face as the predetermined range of the body can be easily understood by the user, and the skin whose position is adjusted by the user can be easily understood. Imaging can be appropriately performed using the state measuring device 10.

In the server 90, the control unit 92 analyzes the image data continuously acquired by the terminal device 40 and transmitted to the server 90, and detects the usage state of the skin condition measuring device 10 held by the user at that time. And monitor this. When the control unit 92 determines that the skin condition measuring device 10 is positioned from this usage state toward a portion of concern to the user or so that the measurement target position can be imaged, the skin. An instruction to execute imaging by the skin condition measuring device 10 is transmitted to the terminal device 40 with respect to a predetermined part of the skin to which the state measuring device 10 is directed, and imaging by the skin condition measuring device 10 is executed through the terminal device 40.

The skin condition measuring device 10 that has reached the stage of performing an image capture an image of the skin surface under a predetermined lighting condition by a built-in light source as a skin condition measurement, and outputs image data. This image data is acquired by the terminal device 40 communication-connected to the skin condition measuring device 10, and further transmitted from the terminal device 40 to the server 90 (see FIG. 20).

For example, in the skin condition measuring device 10, the built-in light source capable of adjusting the light to be irradiated as illumination verifies the irradiation state of the light to the part to be imaged, and verifies the skin image obtained by the trial imaging of the skin condition measuring device 10. After being optimized after Each image data of is sent to the terminal device 40, acquired by the terminal device 40, and transmitted from the terminal device 40 to the server 90.

In the imaging in the skin condition measuring device 10, the built-in skin condition measuring device 10 is different from the light used as the illumination light in the imaging by the terminal device 40 for the predetermined portion of the user's skin, as in the second embodiment. Imaging is performed in a situation where light from a light source is irradiated, and image data with different imaging conditions can be acquired by the skin condition measuring device 10 and the terminal device 40. Therefore, it is possible to increase the difference between the images of the skin image affected by the reflection, absorption, and attenuation of the light irradiated as illumination in each layer of the skin between the skin condition measuring device 10 and the terminal device 40, and the server 90. By increasing the information content of the image data as a diagnostic material used for diagnosing the skin condition in the above, it is possible to make an appropriate diagnosis about the skin condition, and in particular, to make the wavelength of the light emitted as illumination appropriate. Depending on the selection of light, the skin condition measuring device 10 can perform imaging under conditions suitable for detailed analysis of the partial skin condition, and the skin condition on the server 90 based on the image data obtained by the imaging can be captured. The accuracy of diagnosis can be improved.

When the image pickup by the skin condition measuring device 10 is executed, the control unit 92 includes the user's face and skin condition measuring device 10 transmitted from the terminal device 40 to the server 90 and obtained by the imaging by the terminal device 40. The image data is received, the image data included in the user's face and the skin condition measuring device 10 is analyzed, and information about the usage state of the skin condition measuring device 10, that is, the skin condition measuring device during imaging on the user's face. Information on the position and orientation of 10 is derived, and this is recorded in the recording unit 91 of the server 90 in a form associated with the terminal device 40, and the skin condition transmitted together with the image data as a part of the information about the same usage state. Information related to the imaging conditions of the measuring device 10, for example, information about the lighting condition by the built-in light source, etc. are similarly recorded, and the information about the usage condition of the skin condition measuring apparatus 10 can be used for a later imaging opportunity. Is desirable.

In the server 90, the control unit 92 receives and acquires the image data of the predetermined portion of the skin obtained by the imaging of the skin condition measuring device 10 from the terminal device 40, and then the predetermined portion for display based on the image data. Generate an image of. Subsequently, the control unit 92 associates the image of the predetermined portion with a part corresponding to the predetermined portion in the image of the face based on the image data obtained by the imaging of the terminal device 40. However, the face image here is defined as the predetermined range of the body on which the skin condition measuring device 10 does not overlap, based on the image data obtained by the image taken by the terminal device 40 before the image is taken by the skin condition measuring device 10. It is an image of the face.

The control unit 92 transmits information on the face image associated with the image of the predetermined portion to the terminal device 40 (see FIG. 20), and a part or all of the face image is transferred to the display unit 41 of the terminal device 40. Display in a predetermined area on the screen.

While a part or all of the face image is displayed on the display unit 41, the terminal device 40 that receives the user's operation instruction transmits the operation instruction information to the control unit 92 of the server 90, and controls in response to this. By controlling the display range of the image, the unit 92 can display a part or all of the face image by setting a desired display range of the face. When the control unit 92 sets the display range so that the entire face is displayed on the display unit 41, or only a part of the face is displayed on the display unit 41, and the predetermined portion is in the displayed face range. When the control unit 92 sets the display range so as to include a part corresponding to the above, the control unit 92 displays an image of the predetermined part associated with the part corresponding to the predetermined part of the face image. On the screen of the display unit 41 of the terminal device 40, the image of the face as the predetermined range of the body is displayed in a different area from the area where the image is displayed.

In this way, the image of the face as the predetermined range of the body based on the image taken by the terminal device 40 and the image of the predetermined portion based on the image taken by the skin condition measuring device 10 are simultaneously and simultaneously displayed on the display unit 41. The image of the predetermined portion is displayed as a detailed image having a larger enlargement ratio than the face image based on the specifications of the skin condition measuring device 10, and is compared with the face image based on the image captured by the terminal device 40. It is possible to show a more detailed skin condition, and the user can confirm the skin condition from two image displays, and the skin condition can be grasped more accurately and easily.

On the other hand, in the server 90, the control unit 92 receives and acquires the image data of the predetermined portion of the skin obtained by the imaging of the skin condition measuring device 10 from the terminal device 40, and then analyzes the image data to analyze the skin. Acquires diagnostic information on the skin condition of the predetermined portion of the above. The control unit 92 uses the diagnostic information about the predetermined portion in the diagnostic information of the skin condition of the face as the predetermined range of the body based on the image data obtained by the image pickup of the terminal device 40, and corresponds to the predetermined portion. Associate with department information. However, the diagnostic information of the skin condition of the face here is the diagnostic information based on the image data obtained by the imaging by the terminal device 40 before the imaging by the skin condition measuring device 10, and the image data by the control unit 92. The analysis is performed from immediately after the image data is acquired by the image pickup by the terminal device 40 and the image data is received by the server 90 via transmission until the diagnostic information of the skin condition of the predetermined portion is acquired. It shall be.

Then, the control unit 92 transmits the diagnostic information of the skin condition of the face associated with the diagnostic information of the skin condition of the predetermined portion to the terminal device 40 (see FIG. 20), and transmits the diagnostic information to the face and the predetermined portion. It is displayed on the display unit 41 of the terminal device 40 in parallel with the skin image or by replacing the skin image.

When displaying the skin condition diagnostic information on the display unit 41, the control unit 92 may provide some information corresponding to the predetermined part of the skin among the diagnostic information of the facial skin condition as the predetermined range of the body. By supplementing or replacing this partial information, the diagnostic information of the skin condition of the predetermined portion is displayed.

In this way, among the diagnostic information of the skin of the face, the diagnostic information of the skin condition of the predetermined portion associated with the partial information corresponding to the predetermined portion is displayed so as to supplement or replace the diagnostic information. Is provided to the user as detailed information including information analyzed from the image data obtained by the skin condition measuring device 10, and the content of the user's skin condition diagnostic information based on the image data obtained by imaging. For at least the part of the face to be imaged by the skin condition measuring device 10, refer to the diagnostic information from another viewpoint by analyzing the image data derived from the skin condition measuring device 10 to check the skin condition. It enables the user to grasp the skin condition more accurately and easily, such as being able to understand.

The display of the diagnostic information on the skin condition of the face on the display unit 41 of the terminal device 40 is not limited to the text-based information display, and the skin is careful based on the display control of the diagnostic information on the control unit 92. It is also possible to provide information on a face image in a format specifically shown by a marking image or the like on a face image to indicate a part to be used or a symptom. For example, an image showing the position and size of hidden stains derived as diagnostic information analyzed from fine image data obtained by the skin condition measuring device 10 with a predetermined color mark superimposed on the corresponding portion on the face image. Information can also be displayed and provided, and can be used as reference information when performing skin care such as stain countermeasures.
By displaying and executing such diagnostic information, one skin condition measurement by using the skin condition measuring device 10 is completed.

The user repeats the imaging of the face as the predetermined range of the body by the same terminal device 40 and the imaging of the predetermined portion by the skin condition measuring device 10 at predetermined measurement intervals to obtain the transition of the skin condition on the face. It is possible to grasp the transition of the skin condition in more detail in the predetermined portion. Then, the server 90 records an image of the face for display on the display unit 41 of the terminal device 40 and the image of the predetermined portion based on the image data obtained by repeated imaging in the recording unit 91 of the server 90 for each imaging. However, if necessary, the display unit 41 of the terminal device 40 may be configured to display the images in a list in chronological order, or to switch and display the images in chronological order, which is preferable because the user can easily grasp the change in the skin. ..

The image data of the face obtained by the imaging of the terminal device 40, which is the basis of the image for displaying the face as the predetermined range of the body and the diagnostic information of the skin condition, acquired by the server 90, is the skin condition. The image data is obtained by imaging by the terminal device 40 before imaging by the measuring device 10, but instead, the control unit 92 of the server 90 is imaged by the skin condition measuring device 10 from the terminal device 40. After acquiring the image data of the predetermined part of the skin, the image correction process of the image data of the face is performed based on the image data of the predetermined part, and then the display is based on the image data of the corrected face. A face image is generated, and this face image is transmitted to the terminal device 40 to be displayed on the display unit 41 of the terminal device 40, or the corrected face image data is analyzed to determine the skin condition of the face. You may try to obtain diagnostic information.

In this case, image correction processing is performed on the image data in the predetermined range of the body based on the image data of the predetermined portion based on the imaging of the skin condition measuring device 10, which makes it easy to adjust the imaging conditions by limiting the imaging range. Since the color of the skin image in the predetermined range of the body indicated by the image data is matched with that of the skin image in the image data of the predetermined portion, it can be obtained by imaging regardless of the imaging conditions of the terminal device 40. The image data in the predetermined range of the body can be easily analyzed for image display and diagnosis of the skin condition, and the user can be encouraged to correctly grasp the skin condition.

As described above, in the skin condition measuring system according to the present embodiment, the terminal device 40 captures the face as a predetermined range of the user's body, and the skin condition measuring device 10 captures a predetermined portion of the user's skin. Based on the obtained image data of the face and the image data of the predetermined portion, the server 90 acquires an image for display as information on the skin condition and diagnostic information on the skin condition, and is used for imaging by the terminal device 40. Of the based facial images and skin condition diagnostic information, for some information corresponding to the predetermined portion of the skin, the image of the predetermined portion and the diagnosis of the skin condition based on the image taken by the skin condition measuring device 10 When the information is associated and the terminal device 40 tries to use a part of the information corresponding to the predetermined part of the skin, the separately acquired image of the predetermined part and the diagnostic information of the skin condition can be used. The quality of each information about the user's skin condition can be improved based on the image data obtained in the above, and the processing on the server 90 related to the display and analysis of the skin condition can be performed with high accuracy, and the skin condition can be diagnosed appropriately and. You can proceed efficiently and let the user grasp the skin condition more accurately.

In the skin condition measuring system according to each of the above-described embodiments, the skin condition measuring device 10 is configured to be a close-up type camera of a completely different type from the terminal devices 20, 30 and 40 as the imaging device. However, the present invention is not limited to this, and the skin condition measuring device may be configured to be a device of the same type as the image pickup device (terminal device), for example, a portable device with a camera such as a smartphone. In this case, the shape information of characteristic parts such as textures and stains in the image data of the face as the user's body predetermined range obtained by imaging with the imaging device, and the skin predetermined part obtained by imaging with the skin condition measuring device. By collating with the shape information of the same featured parts such as textures and stains in the image data of, and acquiring the mutual relationship, it is possible to accurately detect the imaged position by the skin condition measuring device on the face image, and the detected position information. It can be used for diagnosing the skin condition and positioning the skin condition measuring device at the time of the next imaging. In collating the shape information of characteristic parts such as textures and spots based on each of these images, it is related to the textures and spots included in the previous diagnosis information of the skin condition based on the image data from the skin condition measuring device. The information can also be used as reference information, and the accuracy of position detection can be improved.

Further, in the skin condition measuring system according to each of the above-described embodiments, the skin condition measuring device 10 is a device that locally captures the user's skin as a measurement of the user's skin condition, but the present invention is not limited to this. The condition measuring device can be another skin analysis device such as a moisture sensor that detects the moisture content of the user's skin, an oil content sensor that detects the oil content of the user's skin, and an elasticity sensor that detects the elasticity of the user's skin. By repeating the measurement of the skin condition diagnosis information based on the sensor output after making the usage state of the skin condition measuring device as a sensor the same as the previous measurement opportunity, the same skin position can be reliably measured as described above. Accurate diagnosis of skin condition can be performed.

Further, in the skin condition measuring system according to each of the above-described embodiments, a predetermined range of the user's body imaged by the terminal devices 20, 30, 40 as an imaging device is defined as a face, and a predetermined range of the skin imaged by the skin condition measuring device 10 is defined. The part is any part of the skin on the face, but in addition to this, the image pickup device is used to image the user's hair as a predetermined range of the user's body, and the skin condition measurement device is used to image the user's scalp (hair root). It can also be. In this case, as with the skin of the face, the skin condition of a specific part of the scalp can be accurately measured for the scalp, and the diagnosis based on the time-series change of the skin condition can be appropriately performed.

Furthermore, the target of skin condition measurement using an imaging device and a skin condition measuring device is not limited to humans, and skin condition measurement may be performed on animals such as pets, and the skin of animals may be measured. However, as in the case of human skin, the skin condition measurement for a specific part of the skin can be accurately repeated, and the diagnosis based on the time-series change of the skin condition can be appropriately performed.

Further, in the skin condition measurement system according to each of the above-described embodiments, as a diagnosis of the skin condition, it is assumed that the condition of the bare skin is diagnosed in principle, but the present invention is not limited to this, and the image pickup device and the skin condition measurement are not limited to this. As a diagnosis of the skin condition using the device, it is also possible to make a diagnosis on the skin in a cosmetic state (including the application state of basic cosmetics) in which the skin is coated with cosmetics.

In this case, as diagnostic information, in place of or in addition to the information related to the skin condition diagnosis result and the corresponding skin care in the case of bare skin, the quality of the makeup condition by cosmetics and basic cosmetics, In addition to being able to show diagnostic information such as improvement methods according to cosmetics and basic cosmetics and skin care methods for makeup, it is possible to understand the effects of makeup on the skin by repeatedly measuring the skin condition. , Appropriate measures can be taken.

Further, in the skin condition measuring system according to each of the above embodiments, the terminal devices 20, 30, and 40 as the imaging device capture a predetermined range of the user's body, and the skin condition measuring device 10 captures a predetermined portion of the skin. In addition to this, a series of actions related to skin care of the user's face are imaged and recorded using a terminal device, and then the skin condition measuring device is imaged. Diagnostic information on skin condition is derived from image data, and an image showing the contents of skin care (including used beauty equipment and cosmetics) obtained by imaging with a terminal device and diagnostic information are displayed in parallel at the same time for diagnosis. Informed users may be able to evaluate their skin care.

In this case, a care method for improving the skin condition based on the analysis result of the skin condition, for example, a care method different from the imaged previous care, or a point to be improved from the previous care is displayed. It is possible to make a smoother proposal to the user based on the display in the department. Further, at this time, it is also possible to communicate and talk with a counselor or the like on the terminal device to share the skin care contents and diagnostic information, and then allow the user to receive advice (counseling) on the care method. Then, while the user receives advice, the skin condition measuring device may perform imaging to acquire the skin condition at that time, and establish an appropriate care method based on the latest information based on advice and the like. It becomes possible.

Further, in the skin condition measuring system according to each of the above-described embodiments, the skin condition measuring device 10 is imaged together with the user's body predetermined range by the terminal devices 20, 30 and 40 as the imaging device, and the obtained image data is analyzed. Therefore, information on the position and orientation of the skin condition measuring device 10 is derived and recorded as information on the usage state, and the imaging conditions of the skin condition measuring device 10 at the time of imaging are also recorded as information on the usage state. However, these are used at the time of later skin condition measurement to control the imaging of the skin condition measuring device 10 according to the usage condition, but the present invention is not limited to this, and the skin condition measuring device may be replaced with another. (For example, a shaver, a facial device, etc.) can be used to control these other devices according to the usage state of the other devices obtained by imaging with the image pickup device.

In this case, as in the above embodiment, the output is adjusted for each position by obtaining information about the usage state, for example, information on the position of the device, by analyzing the image data obtained by imaging with the image pickup device. It will be possible to use the equipment appropriately by performing such controls.

Furthermore, when a device with a camera is applied to a predetermined range of the user's body (for example, a face), the image data of the predetermined part obtained by imaging the device is analyzed to acquire diagnostic information, and the information is displayed. While doing this, a predetermined range of the user's body including such a device is imaged by an image pickup device, and the obtained image data is analyzed to obtain information on the usage state (for example, position and orientation) of the device. It is also possible to perform control suitable for each position of the application target (for example, face) of such a device based on the above.

1, 2 Skin condition measurement system 10 Skin condition measurement device 11 Main body case 11a Tip part 12 Image pickup element 13 Optical mechanism part 13a Light diffusion plate 13b First polarizing plate 13c Second polarizing plate 13d Light-shielding plate 14, 15 LED
20, 30, 40 Terminal device 21 Recording unit 22, 32, 41 Display unit 23, 31 Control unit 24, 34, 44 Wireless communication means 25, 35, 45 Interface 26, 36, 46 Camera unit 90 Server 91 Recording unit 92 Control Department 100 network

Claims (7)

A skin condition measuring device that can image a predetermined part of the user's skin,
An image pickup device capable of imaging a predetermined range of the user's body including a part to be imaged of the skin by the skin condition measuring device, and an image pickup device.
It is equipped with a control unit that acquires information on the skin condition based on the skin image data obtained by imaging.
The control unit can acquire information on the skin condition of the predetermined range of the body based on the image data of the predetermined range of the body obtained by the imaging of the imaging device, and can obtain the information of the skin condition of the predetermined range of the body by imaging the skin condition measuring device. It is possible to acquire information on the skin condition of the predetermined part based on the image data of the predetermined part of the skin, and further, among the information on the skin condition in the predetermined range of the body, one corresponding to the predetermined part of the skin. A skin condition measurement system characterized by associating information on the skin condition of the predetermined portion with the part information. In the skin condition measuring system according to claim 1,
The control unit acquires information on the skin condition in the predetermined range of the body based on the image data of the predetermined range of the body obtained by imaging of the imaging device, and obtains the information on the skin condition in the predetermined range of the body from the information on the skin condition in the predetermined range of the body. A skin condition measurement system characterized in that a predetermined part of the skin to be imaged is selected by the measuring device and imaging by the skin condition measuring device can be performed on the predetermined part of the skin. In the skin condition measuring system according to claim 1,
A display unit capable of displaying at least an image of the user's body predetermined range is provided.
The control unit acquires an image of the predetermined range of the body derived from the image data of the predetermined range of the body as information regarding the skin condition of the predetermined range of the body, and the control unit obtains an image of the predetermined range of the body as information regarding the skin condition of the predetermined range of the body. The image of the predetermined part derived from the image data of the predetermined part is acquired, and the image of the predetermined part is acquired.
The display unit is capable of executing the image display acquired by the control unit.
The control unit associates the image of the predetermined portion with the part of the image of the predetermined range of the body corresponding to the predetermined portion of the skin, and the image of a part or all of the predetermined range of the body on the display unit. A skin condition measurement system characterized in that an image of the predetermined portion is displayed in parallel with the display or in sequence. In the skin condition measuring system according to claim 1,
Equipped with a display unit that can display information about the user's skin condition
As information on the skin condition of the predetermined range of the body, the control unit acquires diagnostic information of the skin condition of the predetermined range of the body by analyzing image data of the predetermined range of the body, and also as information on the skin condition of the predetermined range of the body. , Acquire diagnostic information on the skin condition of the predetermined part by analyzing the image data of the predetermined part of the skin.
The control unit associates the diagnostic information of the skin condition of the predetermined portion with the partial information corresponding to the predetermined portion of the skin in the diagnostic information of the skin condition of the predetermined range of the body, and the said display unit. When displaying the diagnostic information of the skin condition in the predetermined range of the body, for the partial information corresponding to the predetermined part of the skin, the diagnostic information of the skin condition of the predetermined part is displayed by supplementing or replacing the partial information. A skin condition measurement system characterized by having it done. In the skin condition measuring system according to any one of claims 1 to 4.
At the time of imaging, the skin condition measuring device captures a predetermined part of the user's skin, which is irradiated with light from a predetermined light source different from the light used as illumination light in the imaging of the predetermined range of the body by the imaging device. A skin condition measurement system characterized by the fact that In the skin condition measuring system according to any one of claims 1 to 5,
A skin condition measurement system characterized in that the control unit performs image correction processing on a part or the whole of image data in a predetermined range of the body based on the image data of the predetermined portion. In the skin condition measuring system according to claim 2,
The control unit measures the skin condition measuring device at least at a predetermined position on the image to be imaged by the skin condition measuring device with respect to the image of the body predetermined range derived from the image data of the body predetermined range. A process of synthesizing a predetermined guide design unit indicating that the image is to be imaged is executed.
A skin condition measuring system characterized in that the display unit displays an image of a predetermined range of the body, and displays the guide design unit as a part of the image.

Images