TW202300088A - skin condition measurement system - Google Patents

Abstract

Provided is a skin condition measurement system in which data related to a user's skin condition is acquired by image capturing performed by a plurality of image capture means, and with which it is possible to improve, on the basis of skin image data in a plurality of manners, the quality of information about the user's skin condition to be shown to the user. A first image capture unit 11 captures an image of a predetermined area of a user's body, and a second image capture unit 12 captures an image of a predetermined part of the user's skin. On the basis of resulting skin image data of the predetermined area of the user's body and resulting skin image data of the predetermined part, a control unit acquires information about the user's skin condition to analyze image data about the skin and derive information about the skin condition. Through the above, it is possible to improve the quality of the information about the user's skin condition based on the image data acquired by image capturing performed in a plurality of manners, to perform processing such as display or analysis of the skin condition with high accuracy, and to appropriately and efficiently proceed with diagnosis of the skin condition, so that the user can grasp the skin condition more accurately.

Description

skin condition measurement system

The present invention relates to a skin condition measurement system capable of providing information on the user's skin condition to the user.

At stores equipped with measuring devices or analysis machines for skin conditions, the customer's skin condition has been measured for a long time, the measurement data is analyzed to obtain the analysis results, and skin care corresponding to the skin condition indicated by the analysis results is recommended to the customer. Services for using and selling cosmetics or beauty appliances.

In contrast, in recent years, it has been proposed to use a small and inexpensive device that the user can use personally, detect the user's skin condition with a sensor, diagnose the skin condition based on the obtained data, and output the diagnosis with a display or the like. A system that sets and executes electronic treatment based on the results or diagnosis results. As an example of such a conventional system for diagnosing skin conditions and the like, there is one disclosed in Japanese Patent Application Laid-Open No. 2004-141259. [Prior Art Literature] [Patent Document]

[Patent Document 1] Japanese Unexamined Patent Publication No. 2004-141259

(Problem to be solved by the invention)

The known system for diagnosing the skin condition is formed as the structure shown in the aforementioned patent documents, the sensor is brought into contact with the user's skin, and the skin in the range touched by the sensor is used for diagnosis. The state of the skin can be detected, and the diagnosis result is output, so that the user can choose the appropriate type of treatment or its execution time according to the state of his own skin.

However, in the aforementioned known systems, the detection range of the sensor is small relative to the area of the skin where the state of the skin needs to be grasped, and the skin to be detected by the sensor is limited to a part of the entire area. Detection is performed on a part of the skin area where the skin condition is known, and the diagnosis based on the detection result does not reflect the skin condition of the entire skin area, so there is a problem that it is difficult to ensure the accuracy of the diagnosis.

The present invention is completed to solve the above-mentioned problems, and the purpose is to provide data on the user's skin condition obtained by each imaging of multiple imaging means, so that the information about the user's use can be shown to the user based on multiple skin image data. A skin condition measurement system that improves the quality of information on the patient's skin condition. (technical means to solve the problem)

The skin condition measurement system disclosed in the present invention is equipped with: a first imaging means, which can take an image of the skin of the predetermined range of the user's body; The predetermined part of the skin is photographed; and the control unit is based on the skin image data of the predetermined range of the body obtained by the first imaging means and the skin image of the predetermined part obtained by the second imaging means data to get information about the condition of your skin.

As mentioned above, through the disclosure of the present invention, the first imaging means is used to capture images of the user's predetermined range of body, and the second imaging means is used to capture images of predetermined parts of the user's skin. Data, and the skin image data of the aforementioned predetermined parts, the information about the user's skin state is obtained by the control unit, and when the image data for the skin is analyzed to derive the information about the skin state, the image data obtained based on multiple types of photography The quality of the information about the user's skin condition is improved, and the skin condition can be displayed or analyzed with high precision, and the skin condition can be properly and efficiently diagnosed, so that the user can more accurately grasp the skin condition.

In addition, the skin condition measurement system disclosed in the present invention is one in which the second imaging means takes an image of a predetermined part of the skin overlapping with the predetermined range of the body, if necessary.

As mentioned above, through the disclosure of the present invention, the predetermined part of the user's skin captured by the second imaging means overlaps with the predetermined range of the user's body captured by the first imaging means. Two types of skin image data can be obtained for the predetermined parts of the skin, so that the relationship between the image data can be grasped based on the common predetermined parts of the image data obtained by different imaging methods, and the body other than the overlapping parts can also be analogized. The detailed skin condition of each part of the predetermined range, etc., can be used to analyze the image data to obtain detailed information about the skin condition. With such information about the skin condition, the user can accurately grasp the condition of the skin, and further promote the information about the skin condition. Correspondence such as proper maintenance of the user.

In addition, the skin state measurement system disclosed in the present invention is one in which the second imaging means takes an image of a predetermined part of the skin that does not overlap with the predetermined range of the body, if necessary.

As mentioned above, through the disclosure of the present invention, the predetermined part of the user's skin captured by the second imaging means does not overlap with the predetermined range of the user's body captured by the first imaging means, and the predetermined range of the user's body and whether it is within the predetermined range of the user's body are obtained. Two skin image data of predetermined parts of the skin in the range, so that the comparison of the two skin image data can be used to derive information about the skin state. Compared with the skin condition of each part of the body based on the skin image data of the predetermined range of the body, the relative skin condition can be determined, and the analysis of the two skin image data can be used to easily obtain information about the skin condition. information, and enables the user to accurately grasp the state of their skin, and further promotes the appropriate maintenance of the user's skin in the predetermined range of the body.

In addition, the skin state measurement system disclosed in the present invention is based on the imaging of the predetermined area of the body by the first imaging means and the imaging of the predetermined part of the skin by the second imaging means, as needed. Executors in different timings.

As mentioned above, through the disclosure of the present invention, the imaging of the predetermined range of the user's body by the first imaging means and the imaging of the predetermined part of the user's skin by the second imaging means are performed in different ways. Time-sequential execution, the devices forming each imaging means exist around the user at the same time, eliminating the necessity of performing imaging separately, thereby eliminating the necessity of individually disposing the imaging means as a device for simultaneous imaging, for example, by collectively setting The imaging device of the imaging means can be used arbitrarily, such as sequentially imaging each object to be imaged, and the number of imaging devices can be minimized to suppress the cost of the device.

In addition, the skin condition measurement system disclosed in the present invention is one in which the aforementioned first imaging means and the aforementioned second imaging means are arranged on a predetermined terminal device as needed.

As shown above, through the disclosure of the present invention, the first imaging means and the second imaging means are set together in a terminal device, and the first imaging means and the second imaging means can be used to perform imaging in a terminal device, thereby enabling One terminal device corresponds to the imaging of the skin of the predetermined range of the body and the imaging of the predetermined part of the skin in the user, and only one imaging device is used to suppress the cost related to imaging.

In addition, in the skin condition measurement system disclosed in the present invention, the first imaging means can be switched between the state of imaging the skin of the predetermined range of the body and the state of imaging the aforementioned predetermined parts as needed, and also serves as the second imaging means. means.

As mentioned above, through the disclosure of the present invention, the first imaging means is used to switch the state of imaging the predetermined area of the body and the state of imaging the aforementioned predetermined part, and the first imaging means doubles as the second imaging means, with one terminal device One of the imaging means performs imaging of the predetermined range of the body and the predetermined part of the body to obtain respective image data, so that the imaging can be performed with the minimum required configuration, and the information on the skin condition can be obtained at low cost.

In addition, the skin condition measurement system disclosed in the present invention is intended to take pictures of at least the predetermined range of the user's body, as needed, if the aforementioned first imaging means is used as a part of the user's terminal device, or connected to the user's terminal device. camera device, and can transmit the image data obtained by the camera to another terminal device, and communicate between the aforementioned user's terminal device and the aforementioned other terminal device. According to the transmitted user's image data, The user's image including the predetermined range of the body is displayed on the terminal device of the other party. The person who obtains the information about the skin condition from the skin image data of the aforementioned predetermined part captured by the imaging means.

As mentioned above, through the disclosure of the present invention, the image data of the user is transmitted to another terminal device by the first imaging means that forms part of the user's terminal device, or is connected to the terminal device, that is, the imaging device, And while displaying the user's image on the other's terminal device, the control unit obtains information about the skin state based on the skin image data of the predetermined range of the body and the predetermined part of the body, and the user's terminal device and the other's In the communication of the terminal device, depending on the situation, not only the image of the user, but also the information about the state of the skin can be processed, so that the communication accompanied by the display of the image can be performed between the user's terminal device and another terminal device, such as Video calls, etc., while referring to the information about the user's skin condition, display the user's image on another terminal device, and communicate with the user through communication while utilizing the information about the skin. status information.

In addition, in the skin state measurement system disclosed in the present invention, if necessary, the aforementioned first imaging means is used as a part of another terminal device or connected to another terminal device, and captures images of at least the predetermined range of the user's body. In the predetermined imaging device, the image data of the user obtained by the first imaging means is used in another terminal device for purposes other than obtaining information on the user's skin condition, the control unit according to the following Information about the skin condition is obtained from the skin image data of the predetermined range of the body obtained by the first imaging means and the skin image data of the predetermined part obtained by the imaging of the second imaging means.

As mentioned above, through the disclosure of the present invention, the user is photographed by the first imaging means that forms part of the terminal device of another person, or is connected to the terminal device, that is, the camera device, and the image data of the user is displayed on the other person. The terminal device is used for a predetermined purpose, and at the same time, the control unit obtains information about the skin state based on the skin image data of the aforementioned predetermined range of the body from the first imaging means and the skin image data of the aforementioned predetermined parts from the second imaging means, And the information about the skin condition can be used, and the imaging device used together with other terminal devices, for example, can be formed in the form of embezzling the image data captured and obtained for the purpose of personal authentication, etc., for skin diagnosis. It is necessary to re-prepare the first imaging means, and it is possible to obtain information on the skin condition based on each image data at low cost and efficiently.

In addition, in the skin condition measurement system disclosed in the present invention, if necessary, the aforementioned first imaging means is used as a part of the user's terminal device, or is connected to the user's terminal device to capture at least the predetermined range of the user's body. Predetermined imaging device, the aforementioned second imaging means can perform imaging through the operation of the user, and the aforementioned control unit temporarily obtains information about the skin condition based on the skin image data of the predetermined range of the body obtained through the imaging of the aforementioned first imaging means information, and use the information to set a predetermined part of the skin that should be photographed by the second imaging means, and notify the user of the set information of the predetermined part through the user's terminal device. After the skin image data of the predetermined part of the skin is obtained by the second imaging means, based on the skin image data of the predetermined range of the body and the skin image data of the predetermined part of the body, information about the skin condition is newly obtained. informant.

As mentioned above, through the disclosure of the present invention, the user is photographed by the first imaging means that forms part of the user's terminal device, or is connected to the terminal device, that is, the imaging device, and according to the obtained predetermined range of the user's body The control unit temporarily acquires information about the state of the skin, and additionally sets a predetermined part of the skin that should be photographed by the second imaging means based on the information, and the user's terminal device notifies the user of the predetermined part. Make the user take an image of a predetermined part of the skin of the second imaging means, once the image data of the skin image of the aforementioned predetermined part is acquired during the imaging of the second imaging means, the control part promptly obtains information about the state of the skin again, and can use The information about the skin state is used to set the predetermined part of the skin to be photographed by the second imaging means according to the skin state of the user's aforementioned predetermined range of the body, and first extract dark spots and other signs that have problems with the skin state or find problems. For parts where more detailed information on the skin condition is necessary, if the matching part is taken as the predetermined part of the skin and taken by the second imaging means, the obtained skin image data can be used to obtain more detailed information focusing on the problem part. With regard to the information of the skin condition, the user can properly grasp the condition of the skin.

In addition, in the skin condition measurement system disclosed in the present invention, if necessary, the control unit acquires information about the skin condition of the predetermined part of the skin based on the image data of the skin of the predetermined part obtained by the second imaging means. , as the information about the skin condition, the person who acquires the information about the relative skin condition of each part of the predetermined range of the body based on the information about the skin condition of the predetermined part.

As mentioned above, through the disclosure of the present invention, the second imaging means takes an image of a predetermined part of the skin that does not overlap with the predetermined range of the body. In addition, in the control part, obtain the information about the skin state based on the skin image data of the aforementioned predetermined body area, as the relative information of each part of the aforementioned predetermined body area based on the information about the skin state of the aforementioned predetermined area. The information about the skin condition can be utilized, so that the skin condition of the aforementioned predetermined part can be used as a reference to relatively show the skin condition of the user's predetermined range of the body. If the predetermined part of the skin is used as a suitable evaluation Reference parts, for example, are less affected by ultraviolet rays and have a small degree of deterioration, and parts that avoid sunlight such as the face of the arm close to the body or the underside of the chin, etc., the skin condition of each part of the aforementioned predetermined body range can be expressed as the degree of deterioration from the reference part, It is displayed in a form that the user can easily understand the skin condition, so that the user can more accurately grasp the skin condition.

In addition, in the skin condition measurement system disclosed in the present invention, if necessary, the aforementioned first imaging means captures a mirror image of the aforementioned predetermined range of the body reflected on the mirror in front of the user, and the aforementioned second imaging means captures the image of the user's skin. Predetermined parts are captured at the same time as the imaging by the first imaging means, and the control unit is based on the skin image data of the predetermined range of the body obtained by the mirror image imaging by the first imaging means and the second imaging means. The person who obtains the information about the skin condition from the skin image data of the aforementioned predetermined part captured by the imaging means.

As mentioned above, through the disclosure of the present invention, use the first imaging means to capture the mirror image of the mirror reflected in front of the user, and obtain the skin image data of the predetermined range of the body. Obtain the skin image data of the aforementioned predetermined parts, and obtain the information about the skin state from each skin image data in the control unit, and the information about the skin state can be used, so that each imaging means can be taken at the same time, and the aforementioned body predetermined information can be obtained at one time. The skin image data of the range and the skin image data of the aforementioned predetermined parts can shorten the time from imaging to obtaining information about the skin condition, reduce the burden on the user related to the imaging, and encourage the user to continue to use it to obtain information about the skin condition It can obtain information about the skin condition without consuming time, and can quickly grasp the user's skin condition.

In addition, in the skin state measurement system disclosed in the present invention, if necessary, the aforementioned first imaging means is configured on one side of a predetermined terminal device, and the aforementioned second imaging means is configured on the aforementioned terminal device, which can be used in the terminal device In the state where the aforementioned first imaging means faces the aforementioned mirror surface, an image of the aforementioned predetermined part of the user is captured.

As mentioned above, according to the disclosure of the present invention, the first imaging means is arranged on one side of the predetermined terminal device, and in the state where the first imaging means faces the mirror surface, the aforementioned predetermined part of the user can be photographed, and the second imaging means can be photographed. The means are arranged on the same terminal device, and one device can correspond to the imaging of the user’s predetermined range of the body and the aforementioned predetermined parts, so that the skin image data of the predetermined range of the body can be obtained collectively in the imaging of each imaging means of the terminal device , and the skin image data of the above-mentioned predetermined parts, if the user only needs to deal with the terminal device equipped with each imaging means, the burden on the user related to the imaging can be greatly reduced, and the user can naturally continue to use it to obtain information about The activity of the information of the skin condition.

In addition, in the skin condition measurement system disclosed in the present invention, if necessary, the control unit records the information of the predetermined part of the skin that should be captured by the second imaging means, and resets the information that should be captured by the second imaging means. For the predetermined part of the skin, the information about the skin condition temporarily acquired based on the skin portrait data of the predetermined range of the body is used, and the information of the predetermined part that has been recorded is referred to, and the predetermined part that is not recorded in the predetermined range of the body is used. Among the locations, the aforementioned predetermined location is set.

As mentioned above, according to the disclosure of the present invention, according to the skin image data of the user’s predetermined range of body captured by the first imaging means, the control unit temporarily obtains information about the skin state, and sets the application according to the obtained information. When the predetermined part of the skin is photographed by the second imaging means, when such setting is performed each time, the information of the set predetermined part is recorded, and the information of the set predetermined part can be referred to later. Part information, in addition to the information about the skin state obtained temporarily based on the skin image data of the predetermined range of the body in the new camera using the aforementioned first imaging means, according to the information of the predetermined part that has been recorded, by Among the parts that have not been recorded as the predetermined parts in the predetermined range of the body, set the predetermined parts of the skin that should be photographed by the second imaging means, and set the predetermined parts of the skin that have not been captured by the second imaging means in the predetermined range of the user's body. The part of the skin is imaged as a predetermined part of the skin that should be photographed by the second imaging means, so that if the aforementioned predetermined part of the set skin is imaged by the second imaging means, the obtained skin image data can be used. By obtaining detailed information about the skin condition centering on the new predetermined part, the user can properly grasp the skin condition. In addition, if every time an image is taken by the first image means, that is, when an image is taken by the second image means a plurality of times, the skin image data of different parts are obtained without repeating each time the image is taken by the second image means. The information about the skin state based on the skin portrait data is formed into a more detailed and high-precision one.

In addition, in the skin condition measurement system disclosed in the present invention, if necessary, the control unit, together with the information of the predetermined part of the skin to be photographed by the second imaging means, captures the predetermined part by the second imaging means. The obtained skin image data can be recorded by distinguishing the date and time when the skin image data was obtained, and the aforementioned control unit and the new camera meeting with the aforementioned first imaging means set the schedule of the skin that should be imaged by the aforementioned second imaging means. Part parallel, refer to the information and skin image data of the predetermined part that has been recorded, and obtain the skin image data of the aforementioned predetermined part that is included in the past predetermined period corresponding to the metabolic cycle of the user's skin according to the date and time of the data, and set it in Predetermined part of the skin of the part to be photographed is the skin image data of the predetermined part captured by the second imaging means and the skin image data of the predetermined range of the body to obtain information about the skin condition.

As mentioned above, through the disclosure of the present invention, the information of the predetermined part of the skin that should be photographed by the second imaging means is recorded in the control part, and the set predetermined position is recorded to be performed by the second imaging means. For the skin image data obtained by imaging, when the skin image data of the predetermined part of the preset skin is captured by the second imaging means, the information of the predetermined part and the skin image data that have been recorded are referred to, and the date of data acquisition is obtained. The skin image data of the predetermined part whose time is included in the past predetermined period corresponding to the metabolic cycle of the user's skin is considered to be the person being photographed at the same time sequence as the new imaging, based on the completed record acquired during the predetermined period The above-mentioned skin image data, the skin image data of the above-mentioned predetermined part obtained from the latest photography, and the skin image data of the predetermined range of the body mentioned above are used to obtain information about the state of the skin, so that each time during the predetermined period corresponding to the metabolic cycle of the skin When repeatedly taking pictures of the predetermined parts of the skin by the second imaging means, sequentially record the skin image data of the predetermined parts to obtain the state of various parts covering a predetermined range of the body, which are obtained based on the skin image data of the predetermined body range. The information about the state of the skin reflects the user's skin state in detail and with high precision, and the user can properly grasp the state of the skin.

In addition, in the skin condition measurement system disclosed in the present invention, if necessary, the control unit records the information of a predetermined part of the skin to be photographed by the second imaging means, and the imaging of the part by the second imaging means Among the obtained skin image data of the aforementioned predetermined part, the recorded skin image data obtained earlier than the aforementioned past predetermined period corresponding to the metabolic cycle of the user's skin are deleted for each new camera, and Corresponding to the informant of the aforementioned predetermined part whose skin image data has been recorded.

As mentioned above, through the disclosure of the present invention, among the skin image data recorded by the control unit, the skin image data before the predetermined period corresponding to the metabolic cycle of the skin is deleted from the time point when a new image is to be taken, thereby together with the The information on the skin state is accurately derived using only the skin image data of the period considered to be in the same skin state together with the skin image data captured by the second imaging means, and the load on the record is suppressed by limiting the amount of recording.

(First embodiment of the present invention)

Hereinafter, the skin condition measuring system according to the first embodiment of the present invention will be described based on the above-mentioned Fig. 1 to Fig. 9 . In the foregoing figures, the skin state measurement system 1 of this embodiment is equipped with: the first imaging unit 11 as the first imaging means that can take pictures of the skin of the user's body in a predetermined range; The second imaging unit 12 as the aforementioned second imaging means for imaging the predetermined part of the narrow user’s skin; The skin image data of the aforementioned predetermined parts captured by the part 12, the control part 13 who obtains the information about the skin state, the first camera part 11, the second camera part 12, and the control part 13 are arranged in a terminal device 10 composition.

In this embodiment, the user who is the subject of the skin condition measurement is contracted to accept the contract with the business provider (hereinafter referred to as the provider) who provides the skin condition diagnosis service using the skin condition measurement system 1 . The contract for the state diagnostic service.

In this way, the user can enjoy the benefits of accepting the skin condition diagnosis using the skin condition measurement system 1, obtaining the diagnosis result of the skin condition obtained by the skin condition measurement system 1, and obtaining advice information according to the diagnosis result if necessary. . In addition, the provider can obtain information about the user's skin condition, and the skin care products or skin care services provided by the set provider (for example, the sponsor of the provider) can be displayed through advertisements, etc. Recommend it to users, so as to achieve the advantages of promotional effects for the skin care products or skin care services. Skin care products refer to products used in skin care, such as lotion, beauty essence, health food, face beautifier, face wash, etc. Skin care services refer to services for skin care, such as body beauty services, etc.

The aforementioned first imaging unit 11 is configured in the terminal device 10 as the aforementioned first imaging means, and as the measurement of the user's skin condition, it can capture a predetermined area of the user's body, for example, a person whose face is captured.

The aforementioned second imaging section 12 is used as the aforementioned second imaging means, and is disposed on the same terminal device 10 as the first imaging section 11, and as a measurement of the user's skin condition, it can be compared with the aforementioned body predetermined range of the user. A predetermined part of the user's skin that is narrow and overlaps with the predetermined range of the body, for example, a part of the cheek or forehead is photographed. The second imaging unit 12 is equipped with a conversion lens 19 to obtain image data with a higher resolution than the average unit area of the imaging target of the first imaging unit 11 .

The first camera unit 11 and the second camera unit 12 can be operated by the user of the terminal device 10 to perform camera operations. Next, the imaging of the predetermined area of the body by the first imaging unit 11 and the imaging of the aforementioned predetermined part of the skin by the second imaging unit 12 are in different timings, and the relative relationship between the imaging unit and the imaging object Execute separately depending on the positional relationship.

Wherein, the first imaging unit 11 and the second imaging unit 12 are respectively formed as a part of the user’s terminal device 10, but are not limited thereto, and may be any one of the first imaging means and the second imaging means, or The two are connected to the user's terminal device to perform imaging, and are independent imaging devices that obtain skin image data.

In addition, the second imaging unit 12 is formed as one of the plurality of camera units in a terminal device 10 such as a smart phone that can take pictures of the user's skin, and is not limited to installing a conversion lens 19 suitable for taking pictures of the skin. The components used can also be formed as a camera unit in a terminal device such as a smart phone that can directly capture images of a predetermined part of the skin without the need for a conversion lens.

In addition, the terminal device 10 is configured such that the first imaging unit 11 forming the first imaging means and the second imaging unit 12 forming the second imaging means are respectively provided in the terminal device 10. In addition, a terminal device may be provided with one The imaging unit that can switch between the state of imaging the skin of the predetermined range of the user's body and the state of imaging the predetermined part, that is, the imaging unit as the first imaging means capable of imaging the skin of the predetermined range of the user's body The part can also take an image of the aforementioned predetermined part as needed, and double as the composition of the aforementioned second imaging means.

In addition, the second imaging unit 12 forming the second imaging means is provided in the same terminal device 10 as the first imaging unit 11 forming the first imaging means. In addition, it may be formed differently from A configuration in which the first imaging means and the second imaging means are additionally provided is, for example, a configuration in which another device having a camera unit forming the second imaging means is used in combination with a terminal device having a camera unit forming the first imaging means.

In addition, the second imaging unit 12 forming the second imaging means may be arranged on a different surface of the terminal device 10 than the first imaging unit 11 forming the first imaging means. 12 is provided on the same surface of the terminal device 10 as the first imaging unit 11, in other words, any one of the plurality of imaging units provided on the same surface of the terminal device is used as the first imaging means, and the others are used as the second imaging means.

In addition, it can also be formed so that the second imaging unit 12 forming the second imaging means can take an image at a position closer to the user than when the first imaging unit 11 forming the first imaging means takes an image. When the second imaging unit 12 and the terminal device 10 approach the user, or the user approaches the second imaging unit 12, and the distance between the second imaging unit 12 and the predetermined part of the skin reaches a predetermined value, the second imaging unit 12 will automatically execute Composition of imaging of the aforementioned predetermined part of the skin.

In addition, it can also be configured to provide one or a plurality of lighting means that irradiate light in conjunction with each of the first imaging unit 11 and the second imaging unit 12, respectively executing the corresponding functions when the first imaging unit 11 performs imaging of a predetermined range of the body. Illumination and the configuration of illumination corresponding to the imaging of a predetermined part by the second imaging unit 12 . In addition, in the lighting means corresponding to the second imaging unit 12, when imaging the aforementioned predetermined part of the user, non-polarized light irradiation can be performed as illumination for detecting the texture of the user's skin. On the one hand, it is a configuration in which linearly polarized light is irradiated as illumination for detecting dark spots on the user's skin.

Therefore, by separately using unpolarized light and linearly polarized light as the illumination of the second imaging unit 12 to perform imaging, texture detection and dark spot detection of the skin can be appropriately performed. In addition, it may be configured to irradiate circularly polarized light as illumination. Specifically, it may be configured so that clockwise circularly polarized light corresponds to skin texture detection, and counterclockwise circularly polarized light corresponds to skin texture. Illumination for dark spot detection. In addition, it is also possible to make the colors (wavelengths) of the light irradiated as illumination correspond to the texture detection and dark spot detection of the skin, for example, it is formed to be able to link with the second imaging unit 12 to equip the skin color light for texture detection respectively. As illumination, a configuration of a light source that irradiates white light as illumination for dark spot detection.

The aforementioned terminal device 10 has the aforementioned first imaging unit 11 and the second imaging unit 12, and is formed as a device capable of capturing images of the user's body predetermined range and the aforementioned predetermined parts, and can obtain skin image data, and has the aforementioned control unit 13 By.

The terminal device 10 is a well-known portable terminal device such as a mobile phone, a so-called smart phone, and a tablet device having a wireless communication means 14 for communicating with an IP communication network, wherein an application program can be executed on the device, and It has a display unit 16 that can display various information. Next, the terminal device 10 is provided with two camera units, and these are configured to function as the aforementioned first imaging unit 11 or second imaging unit 12 .

The display unit 16 of the terminal device 10 is configured to be capable of displaying a portrait representing at least the predetermined range of the user's body. The display unit 16 is a touch panel-type display element and also functions as an input element.

Among them, the terminal device 10 is an information processing device that implements the function or processing of the control unit 13 by executing a pre-stored program. Or, it can also be a notebook or a desktop computer with a video camera, rather than being limited to a portable device.

The control unit 13 of the terminal device 10 uses an application program for diagnosing skin conditions, and analyzes the skin image data obtained by imaging to obtain diagnostic information, and the user can refer to the obtained diagnostic information. At this time, the control unit 13 of the terminal device 10 can display the acquired diagnostic information on the display unit 16 as contents through the execution of the application program for reference.

The above-mentioned control unit 13 is based on the image data of the skin obtained by imaging, that is, the skin image data of the predetermined range of the body obtained by the imaging of the first imaging unit 11 and the aforementioned predetermined skin imaging data acquired by the imaging of the second imaging unit 12. A person who obtains information about the skin condition of the skin image data of the part.

The control unit 13 analyzes the skin image data of the predetermined range of the body and the skin image data of the predetermined part to obtain diagnostic information of the skin state of the user's predetermined body range as information on the skin state. Therefore, the function of the control unit 13 to analyze each skin image data to obtain the diagnosis information of the user's skin condition is realized by the control unit 13 executing processing according to the application program.

The control unit 13 evaluates the user's skin based on the skin image data, and obtains an index value indicating the state of the user's skin as the above-mentioned processing. For example, the control unit 13 evaluates the age of the skin, the fineness of the texture of the skin, the degree of fairness of the skin, the degree of opening of the pores of the skin, the amount of dark spots on the skin, the water content of the skin (the degree of moisturizing), the oil content of the skin, etc. At least one is used as the skin condition, and an index value representing the skin condition is obtained from the evaluation result.

In this embodiment, the control unit 13 performs predetermined image processing on the images captured by the first imaging unit 11 and the second imaging unit 12 to obtain an index value indicating the state of the user's skin. For example, the control unit 13 performs edge detection on the photographed image, detects skin grooves in the image, specifies the area of the skin hills surrounded by the detected skin grooves, and obtains the area of the specified skin hills. The smaller the size and the closer the uniformity is to a constant value, the larger the index value is used as an index value indicating the fineness of the texture of the skin (an index value indicating the state of the skin).

In the present embodiment, the control unit 13 determines, as the diagnosis information, information indicating that the diagnosis result has been obtained as an index value representing the user's skin condition. Next, the control unit 13 performs control to appropriately display the acquired diagnostic information on the display unit 16 as the display content of the display unit 16 . For example, the control unit 13 may create a graph for some index values indicating the user's skin condition among the diagnosis results, and display this on the display unit 16 as display content.

In addition, the control unit 13 may also receive data on the terminal device 10 including information on skin conditions, skin maintenance activities, skin portraits, and the time when skin images have been taken, and display the received skin conditions. The index value of the skin care behavior information, the image of the skin, and the time information of the time when the skin has been photographed are associated, and temporarily recorded in the recording unit 17 for recording. The time information of the skin camera is collected to diagnose the user's skin condition.

Specifically, the control unit 13 specifies the temporal transition of the skin condition index value based on the skin condition indicator value recorded in the recording unit 17 and the period information when the skin condition measurement has been performed, and based on the specified It can be judged whether the skin condition has improved or not by the state of progress. For example, the control unit 13 specifies the change over time of the index value of the skin state during the period (for example, about 28 days ± 1 day to 7 days) spent on the turnover (turnover) of the user's skin immediately before the treatment, and diagnoses skin condition.

In addition, the control unit 13 may also specify a period different from the period consumed by the user's metabolism before the processing instant (for example, a period of a length set before the processing instant (for example, 1 week, 10 days, 1 month, etc.), A specified period, etc.) of the index value of the skin condition changes over time to diagnose the condition of the skin.

The control unit 13 provides the diagnosis result that the skin condition of the user has improved if the index value of the skin condition changes over time in a direction indicating improvement of the skin condition. On the other hand, if the index value of the skin condition does not change over time in the direction indicating improvement of the skin condition (in the direction indicating deterioration, when the change indicates no change), the control unit 13 supplies the user's skin A diagnosis whose status has not improved.

In addition, the control unit 13 may also perform diagnosis processing adding attributes such as the user's age as the diagnosis processing of the skin condition. In addition, the control unit 13 may also change the part or all of the diagnostic information based on the analysis of the skin image data of the predetermined part obtained by the second imaging unit 12 according to the place where the second imaging unit 12 takes the image. Diagnostic benchmarks.

The control unit 13 controls to appropriately display an image including graphs or texts representing diagnostic information on the display unit 16 of the terminal device 10 . In addition, the control unit 13 may include a transition graph showing the transition of the skin state, a group of portraits as skin portraits, a behavior information group showing information on skin care behaviors corresponding to the skin portraits, a group of behavior information showing scheduled skin care products or skin care products, etc. The image of the advertisement (attached link) of the advertisement of the service is controlled to be displayed on the display unit 16 as appropriate.

In addition, the control unit 13 may create content indicating the diagnosis result as a part of the diagnosis information, and display it on the display unit 16 in such a manner that the terminal device 10 can refer to it. For example, the control unit 13 may create the content of a bar object (bar object) including index values indicating skin conditions for each of the degree of moisture retention, the degree of open pores, the degree of whitening, and the age of the skin (aging), and use This is displayed on the display unit 16 .

In addition, the control unit 13 acquires the image for display of the predetermined body range of the user based on the skin image data of the predetermined range of the body captured by the first imaging unit 11 and the skin image data obtained by the imaging by the second imaging unit 12 . The display image of the aforementioned predetermined part of the user's skin image data of the aforementioned predetermined part of the skin serves as other information about the skin condition.

The control unit 13 obtains the user's skin image data according to the skin image data of the predetermined range of the body or the predetermined part of the aforementioned body in the imaging data whenever a new imaging is performed by the first imaging unit 11 and the second imaging unit 12. A display image of the predetermined range of the body or the predetermined part is displayed on the display unit 16 .

In addition, the control unit 13 may also associate the image for display of the predetermined part of the information corresponding to the predetermined part of the skin in the image for display of the predetermined range of the body with the predetermined range of the body on the display unit 16. The display of a part or all of the display image of the above-mentioned predetermined portion is simultaneously performed in parallel.

In addition, the control unit 13 may also use the image data for displaying the predetermined part guided by the image data of the predetermined part for part or all of the image for displaying the predetermined body part guided by the image data for the predetermined part. Image, perform image correction processing (such as color calibration).

In addition, the control unit 13 may perform, on the display image of the predetermined body range derived from the image data of the predetermined body range, the predetermined position to be captured by the second imaging unit 12 on the image, The process of synthesizing the predetermined guide pattern portion representing the imaging target position of the second imaging unit 12 is performed, and the processed image is displayed on the display unit 16 . Thereby, the guide pattern part is displayed as a part of the display image of the predetermined body range displayed on the display part 16, and the user can recognize the position to be captured by the second imaging part 12 in the predetermined body range.

In addition, the control unit 13 temporarily obtains diagnostic information on the skin condition of the user's skin condition in the predetermined range of the body as information on the skin condition based on the skin image data in the predetermined range of the body captured by the first imaging unit 11, and Using this diagnostic information, a predetermined part of the skin to be imaged by the second imaging unit 12 included in the predetermined range of the body is set. The control unit 13 can notify the user of the set predetermined location information through the user's terminal device 10 .

Next, when the image data of the skin image of the predetermined part is acquired by the second imaging part 12 according to the operation of the user who refers to the information of the predetermined part, the control part 13 is based on The skin image data of the predetermined range of the body and the skin image data of the predetermined part are re-acquired from the structure of the diagnosis information of the skin state of the predetermined body range.

In the setting of the predetermined part of the skin to be imaged by the second imaging part 12 by the control part 13, the diagnostic information of the skin state temporarily acquired from the skin image data of the face as the predetermined range of the body can also be used. Using AI to make a proposal of a predetermined part of the skin that should be photographed using the overall face image of the known current situation. At this time, in addition to diagnostic information, necessary information can also be appropriately obtained through user input, information input based on cooperation with other IOT devices, or access to so-called big data on the Internet. For example, in addition to the user's past and present wrinkles, the cause of dark spots or the tendency of the causes, and future predictions for the occurrence of wrinkles and dark spots, it is possible to obtain information on the parts of Japanese people who have dark spots and wrinkles and their ages. Statistics are used. In addition, statistical data (such as Okinawa, Hokkaido, etc.) obtained by the user's place of residence, or weather-related information (such as ultraviolet light, temperature, humidity, weather, etc.) of the user's residence area based on GPS can also be obtained. In addition, in terms of user information, it is also possible to obtain information on whether the user is outdoors or indoors based on GPS, or information on the user's living habits (such as sleep, exercise, bathing, stress, etc.) etc.), the user's biological information (blood pressure, body temperature, blood flow, electrocardiogram, etc.), the user's eating habits (like fried food, dislike vegetables, etc.), the cosmetics or skin care devices used by the user, etc. information, genetic information related to the user (such as dark spots of grandparents or parents, causes of wrinkles, etc.), user's skin color, skin temperature, etc. (including temporary changes caused by exposure to ultraviolet rays, etc.), relevant Various information such as information on improvement of the user's facial image (such as physiognomy, facial expression, smiley face, etc.) are used.

In the proposal of the predetermined part of the skin using AI, in particular, based on various information, it is possible to suggest to the user the part that may have dark spots or wrinkles in the future (including hidden dark spots); or suggest how to use maintenance, etc. Improvement is achieved, and the impression of the face will become better; or for the user to exist in a good state in the future several years or decades later, if the proposal is improved from the current point, a better result can be expected .

In addition, the control unit 13 can also roughly grasp the skin condition of the user's face as diagnostic information on the skin condition of the user's face based on the skin image data of the face in the predetermined range of the body captured by the first imaging unit 11. In the stage of dark spots, wrinkles, dark circles, freckles, etc. on the whole face, use AI to propose effective plans for skin care or makeup. Immediate improvement is not possible, so proposals such as covering up with foundation are currently being proposed.

The control unit 13 is equipped with: when a predetermined part of the skin to be imaged by the second imaging unit 12 is set using the diagnostic information of the skin condition of the predetermined body range temporarily acquired based on the skin image data of the predetermined body range, that is The recording unit 17 that records the information of the set predetermined location.

The recording unit 17 is capable of distinguishing and obtaining the skin image from the skin image data obtained by imaging the predetermined site by the second imaging unit 12, in addition to the information on the predetermined part of the skin that should be captured by the second imaging unit 12. The date and time of the data is used as the recorder.

When the control unit 13 resets the predetermined part of the skin that should be imaged by the second imaging unit 12, if it uses the diagnostic information of the skin state temporarily obtained based on the previously acquired skin image data of the predetermined range of the body, and the previously set When the information of the predetermined part is recorded in the recording part 17, the information of the predetermined part recorded in the recording part 17 is also referred to, and the predetermined part is set from the parts not recorded as the predetermined part in the predetermined range of the body.

If the imaging at the first imaging unit 11 is performed once, that is, the imaging at the second imaging unit 12 is performed a plurality of times, and when the skin image data is obtained for a plurality of predetermined parts, each imaging at the second imaging unit 12 is performed. The setting of predetermined parts of the skin to be imaged does not overlap with each other. In addition, every time each image is taken by the second image pickup unit 12 , the information of the set predetermined location is notified to the user through the terminal device 10 , and is recorded in the recording unit 17 in order to reflect it in the next setting.

In addition, the control unit 13 has the function of setting a predetermined part of the skin to be captured by the second imaging unit 12 in parallel with the new camera meeting of the first imaging unit 11, referring to the information of the predetermined position recorded in the recording unit 17, And the structure of the skin image data of the predetermined part.

Next, the control unit 13 includes the skin image data of the past predetermined period corresponding to the turnover cycle of the user's skin with the data acquisition date and time among the recorded skin image data of the predetermined part, It is regarded as a person who has been photographed at the same timing as the new photographing.

At this time, the control unit 13 is based on the recorded skin image data acquired during the aforementioned predetermined period, and the predetermined position of the skin set in the new camera location, the aforementioned image obtained by the second imaging unit 12. The skin image data of the predetermined part and the skin image data of the predetermined range of the body are used to obtain diagnostic information (information about the state of the skin) of the skin state of the predetermined body range.

On the other hand, the control unit 13 may also target the data acquisition date and time not included in the aforementioned predetermined period and exceeding the user’s skin among the information of the predetermined part recorded by the recording unit 17 and the skin image data of the predetermined part. The old time point of the metabolic cycle is a period when the metabolism of the skin does not overlap with the user's skin captured by the new camera in the first imaging unit 11, and it is not considered to be the same as the new camera. The time series photographer deletes the matching information of the predetermined part and the skin image data of the predetermined part from the recording part 17 .

Next, the use state of the skin condition measurement system of this embodiment will be described. Based on the premise, the entire face of the user is defined as the predetermined range of the body captured by the first imaging unit 11, and the predetermined parts captured by the second imaging unit 12 included therein are essential parts of the skin of the face. (cheeks, around the eyes, around the mouth, etc.). Next, the terminal device 10 is a smart phone, and a camera part (so-called in camera) provided on the side having the display part 16 is used as the first camera part 11. The camera unit on the opposite side (so-called out camera) serves as the second imaging unit 12 and can perform imaging respectively. When photographing a predetermined location, a conversion lens 19 is installed in front of the second imaging unit 12 in the terminal device 10, so that the imaging range of the second imaging unit 12 is narrower than that of the first imaging unit 11. On the other hand, it can be higher. The imaging is performed at different resolutions, and the skin in a very narrow range of the face is captured as the aforementioned predetermined part.

In order to perform imaging using each imaging unit of the terminal device 10 , first, the conversion lens 19 is attached to the terminal device 10 by the user. When an application program that provides a user interface for using each camera unit pre-existing in the terminal device is activated on the terminal device 10 through the operation of the user, the user can use the terminal device 10 to view each camera unit. Used in the state of recording.

When the user performs an operation to start imaging on the user interface displayed on the terminal device 10 , the first imaging unit 11 of the terminal device 10 executes imaging of a face which is a predetermined range of the user's body.

Specifically, by executing the application program for measuring the skin condition in the terminal device 10, the user operates the user interface displayed on the display unit 16, thereby, first, starts to use the first imaging means The first camera unit 11 captures the user's face, and the control unit 13 of the terminal device 10 continues to acquire image data. At this time, the control unit 13 of the terminal device 10 keeps the user in a state of supporting the terminal device 10 by displaying the face in a predetermined direction and size by using predetermined guidance display etc. by the display unit 16 . For example, the control unit 13 superimposes and displays on the display unit 16 an image of a frame containing the outline of the face on the screen of the display unit 16 in a state where the face is correctly captured, superimposed on the image captured by the first imaging unit 11, using While looking at the display unit 16, the user uses the framed portrait as a reference to adjust the relative positional relationship between the first imaging unit 11 and the face so that the face is contained therein.

If the user's face is photographed by the first photographing unit 11 , the control unit 13 makes the display unit 16 display the portrait of the face according to the image data obtained by the photographing. The control unit 13 keeps the user in a state of supporting the terminal device 10 by displaying the face in a preset direction and size by using the predetermined guidance display etc. made by the display unit 16 . In addition, as the user's face is captured by the first imaging unit 11 of the terminal device 10 , an image of the face is displayed on the display unit 16 based on the image data obtained by the imaging.

The user uses the image display of the face on the display unit 16 as a reference, and schedules the user interface of the terminal device 10 at the time sequence when the face is considered to be properly captured by the first camera unit 11 as the predetermined area of the body. operation, and determine the still portrait of the face. The data of the still image of the face at the determined moment is processed in the control unit 13 as data of the skin image of the predetermined range of the body captured by the first imaging unit 11 . However, the facial image may be automatically determined by the control unit 13 at the timing when the face as a predetermined range of the body is appropriately captured by the first imaging unit 11 , regardless of the user's operation.

Therefore, if the skin image data obtained by the first imaging unit 11 as the photographed face of the predetermined range of the body becomes determined, it can also be moved to the aforementioned predetermined position suitable for the second imaging unit 12 to take pictures of the skin. status.

The control unit 13 obtains an image for display of the face based on the skin image data captured by the first imaging unit 11, and displays the image on the display unit 16 while analyzing the skin image data to temporarily acquire the image of the user's face. Diagnostic information on skin conditions.

In addition, the control unit 13 refers to the information recorded in the recording unit 17 to determine whether there is information on the aforementioned predetermined part set during the previous imaging, that is, using the diagnostic information on the skin condition of the face temporarily acquired in the same way as above. On the other hand, the control unit 13 has recorded the information of the set predetermined part of the skin to be recorded when the second imaging part 12 sets the predetermined part of the skin to be imaged.

If the information of the previously set predetermined parts is recorded, the control unit 13 is based on the recorded information, for each part of the predetermined range of the body other than the part previously set as the predetermined part, using the aforementioned diagnosis information, inferring, for example, finding out the Part of the skin has precursors such as dark spots, so it is necessary to confirm the presence or absence of dark spots, etc., and it is necessary to obtain a detailed image of the part obtained by the imaging of the second imaging unit 12 for further appropriate diagnosis of the skin condition.

On the other hand, if the user's skin imaging is performed for the first time, etc., when the recording unit 17 has not recorded the information of the predetermined part that should be captured by the second imaging unit 12 previously set, the control unit 13 is for the entire predetermined range of the body. Using the pre-acquired diagnostic information on the skin condition of the face, similarly to the above, it is deduced that a detailed image must be acquired by the imaging of the second imaging unit 12 for further appropriate diagnosis of the skin condition.

The control unit 13 sets the thus deduced site as a predetermined site to be imaged by the second imaging unit 12 , and records the set information of the predetermined site in the recording unit 17 . Next, the control unit 13 generates, for the predetermined part, a predetermined guide pattern part (marker) representing a predetermined part of the face to be imaged by the second imaging part 12, for example, and synthesizes the guide pattern part on the basis of the predetermined part. The facial skin image data of the face is displayed using image processing, and the synthesized image is displayed on the display unit 16 (see FIG. 5 ). Looking at the display unit 16, the user recognizes a predetermined location to be captured by the second imaging unit 12, and adjusts the position of the terminal device 10 having the second imaging unit 12 so that the image can be captured.

If the position of the imaging target of the second imaging unit 12 is indicated on the guide pattern portion, the user can easily understand the predetermined part of the face that should be captured by the second imaging unit 12 in the predetermined range of the body. The second imaging unit 12 of the terminal device 10 can appropriately perform imaging.

Among them, the control unit 13 can also use the second imaging unit 12 to capture the image of the user by targeting the part that the user cares about in the face that is the predetermined range of the user's body. Instead of setting a predetermined location to be captured by the second imaging unit 12, the terminal device 10 executes guidance display or voice guidance, and displays the image representing the predetermined location by combining it with the image of the face. Alternatively, it is also generally possible to select in advance the part where the skin condition is mostly measured and register it as the initial measurement position, and to synthesize a predetermined guiding pattern part representing one or a plurality of parts of the skin at the initial setting position on the display of the face. The synthesized image is displayed on the display unit 16 by the processing of the image.

At this time, after the user recognizes any part of the face that is concerned, or looks at the initial measurement position on the face shown in the aforementioned guide pattern portion displayed on the display portion 16 and confirms it, the imaged parts can be determined. In this manner, the position adjustment of the terminal device 10 having the second imaging unit 12 is performed (see FIG. 6 ).

When the user adjusts the position of the terminal device 10 held in his hand, and determines that the second camera unit 12 is facing the aforementioned predetermined part of the face, etc., he performs a predetermined operation on the user interface such as the shutter button of the terminal device 10 to make it Imaging by the second imaging unit 12 .

In addition, the user can also bring the second imaging unit 12 and the terminal device 10 close to the aforementioned predetermined position, or the aforementioned predetermined position close to the second imaging unit 12, and the distance between the second imaging unit 12 and the aforementioned predetermined position of the skin reaches a predetermined value. value, the second imaging unit 12 automatically performs imaging of the aforementioned predetermined part of the skin, or is notified by the terminal device 10 as the optimum timing for imaging, and prompts the user to operate the terminal device 10 related to the imaging.

Therefore, at the stage of imaging, the second imaging unit 12 is under the predetermined lighting conditions caused by the external light source (such as the built-in light source of the conversion lens) or the built-in light source of the terminal device 10 to detect the aforementioned predetermined part of the skin. camera, and output skin portrait data. The control unit 13 acquires the skin image data.

For example, the built-in light source installed in the conversion lens 19 of the terminal device 10 can adjust the light irradiation state of the part of the imaging target by adjusting the built-in light source of the light irradiated as illumination, and the skin image obtained through the trial imaging of the second imaging unit 12 After being optimized for verification, etc., the imaging at the second imaging unit 12 is performed, and the image for texture diagnosis captured on the skin under the illumination by unpolarized light irradiation can be obtained at the control unit 13, and the image for texture diagnosis can be acquired by the control unit 13 Each image data of an image for dark spot diagnosis which is imaged on the skin under illumination by linearly polarized light irradiation.

The control unit 13 records the obtained skin image data of the predetermined part in the recording part 17 together with the previously recorded information of the predetermined part in a state where the date and time of obtaining the skin image data can be identified. Here, if the imaging at the second imaging unit 12 is performed a plurality of times in general, according to each imaging at the second imaging unit 12, based on the information recorded in the recording unit 17, the predetermined part of the skin to be imaged is displayed in the control unit 13. It is set in a manner that does not overlap with the previous time, and the imaging of the second imaging unit 12 by the user's operation according to the information of the predetermined position notified to the user through the terminal device 10 is repeatedly performed.

In addition, if the control unit 13 records the information of the previously set predetermined site in the recording unit 17, it sets the predetermined site of the skin to be photographed by the second imaging unit 12, and the predetermined site is captured by the second imaging unit 12 in parallel. With reference to the recording unit 17, the skin image data of a predetermined part whose data acquisition date and time are included in the past predetermined period corresponding to the metabolic cycle of the user’s skin is regarded as the same as the new imaging performed by the second imaging unit 12. The same timing is given to the photographer.

Next, after the control unit 13 obtains the skin image data of the aforementioned predetermined part of the skin from the second imaging unit 12, it analyzes the skin image data, and considers that the image is captured at the same timing as that obtained during the aforementioned predetermined period. The skin image data of the predetermined part and the image data of the face captured by the first imaging unit 11 obtained earlier obtain the diagnostic information of the skin condition of the face as the user's predetermined body range.

Wherein, if the information of the previously set predetermined part is not recorded in the recording part 17, the control part 13 analyzes the skin image data after obtaining the skin image data of the aforementioned predetermined part of the skin by the second imaging part 12, and obtains the image data first. The skin condition of the user's face is obtained from the facial skin image data captured by the first imaging unit 11 to obtain official diagnostic information.

Next, the control unit 13 displays the diagnostic information of the skin condition of the face on the display unit 16 in parallel with the face image or in place of the face image (see FIG. 7 ). The display of the diagnostic information of the skin condition of the face in the display unit 16 is not limited to the text-based information display, and the skin can also be specifically represented on the facial image with a marking image or the like. Information should be provided while paying attention to the site or symptoms. For example, a mark of a predetermined color can be superimposed on the corresponding part of the facial image to indicate the hidden dark spot guided as diagnostic information analyzed from the fine image data obtained by the second imaging unit 12. The location or size can be used as reference information when performing skin care such as dark spot countermeasures. By displaying the diagnostic information as above, the imaging as one measurement of the skin condition by the first imaging unit 11 and the second imaging unit 12 is completed.

After this, in order to grasp the transition of the skin state, the user repeats the above-mentioned same imaging of the face as the predetermined range of the body by the first imaging unit 11 and the aforementioned imaging by the second imaging unit 12 at predetermined intervals. For the imaging of a predetermined site, the control unit 13 acquires diagnostic information on the skin condition based on the acquired skin image data every time the imaging is performed, and displays it on the display unit 16 .

In repeating such imaging, etc., especially the information of the predetermined position set by the control unit 13 is recorded in the recording unit 17, and when the next imaging is performed, the recorded information is referred to to set a new predetermined position that does not overlap with the previous one (refer to Fig. 8), by this, the region of the face as the predetermined range of the aforementioned body is formed into a state of being gradually buried in the position where the detailed skin image data is obtained in the imaging of the second imaging unit 12 at each imaging, so that the complex high The high-precision skin image data is continuously in the shape of a map, and the analysis of the skin state based on the skin image data can be performed with higher precision, and accurate and reliable diagnostic information can be derived. Here, if the first imaging unit 11 is taken once, that is, when the second imaging unit 12 is taken multiple times, detailed skin image data covering all parts of the face can be obtained in a short period of time (for example, about one week). However, if such an action of photographing becomes a burden to the user, the burden of the user can be reduced by distributing the photographing. For example, the imaging at the first imaging unit 11 and the imaging at the second imaging unit 12 can also be performed once a week, and in a certain week, the cheek is photographed as the aforementioned predetermined part, and in the following week, the forehead is photographed as the aforementioned predetermined part. Parts, etc., and the imaging is repeated every week, and the imaging of the second imaging unit 12 reaches the entire face in about a month.

Wherein, the control unit 13 can also record the information of the predetermined position and the skin at the predetermined position obtained by the imaging of the second imaging unit 12 every time the second imaging unit 12 performs imaging of the aforementioned predetermined position. Among the image data, at the time of a new camera meeting, among the information or skin image data recorded in the recording unit 17, for the comparison of the data acquisition date and time exceeding the past predetermined period corresponding to the metabolic cycle of the user's skin, For the old one, if it is judged that the metabolism of the skin does not overlap with the skin of the user in the new camera session, such old information or skin image data can be deleted, and new recording can be repeated naturally.

In addition, when the control unit 13 performs a new imaging by the second imaging unit 12, the information recorded in the recording unit 17 may be referred to, and a new predetermined position that does not overlap with the previous one may be recorded on the second imaging unit 12. Carrying out imaging, but not limited to this, can also be formed to repeat the imaging of the aforementioned predetermined range of the body by the first imaging unit 11 and the imaging of the aforementioned predetermined position by the second imaging unit 12. The second imaging unit 12 repeatedly takes pictures of the same predetermined part of the body, and the diagnosis information of the skin state or the image for display obtained by the control part 13 based on the skin image data focusing on the same part of the skin can be grasped in the specific part. Detailed changes in skin conditions, and the degree of improvement achieved through skin care can be easily confirmed.

At this time, the control unit 13 can also be formed to display the image of the face or the aforementioned predetermined part on the display unit 16 according to the skin image data obtained by repeated imaging, and record it in the recording unit 17 every time it is captured, and if necessary A configuration in which the images are arranged in time series and displayed in a list, or sequentially switched and displayed in order of time series is ideal so that the user can easily grasp changes in the skin.

In addition, the skin image data of the face captured by the first imaging unit 11 as the basis for displaying the image of the face as the predetermined range of the body or the diagnosis information of the skin condition is carried out by the second imaging unit 12. The skin image data acquired by the first imaging unit 11 before the imaging can be replaced. After the second imaging unit 12 obtains the skin image data of the aforementioned predetermined position, the control unit 13 can be used according to the skin image data of the aforementioned predetermined position. Data, after carrying out the image correction processing of the facial skin image data, generate a facial image for display based on the corrected facial skin image data, display the facial image on the display unit 16, or display the corrected facial image data. The final skin image data of the face is analyzed together with the skin image data of the aforementioned predetermined parts to obtain diagnostic information on the skin condition of the face.

At this time, the image correction process is performed on the image data of the predetermined range of the body based on the image data of the aforementioned predetermined part captured by the second imaging unit 12, which is easy to meet the imaging conditions by limiting the imaging range. The skin tone in the predetermined range of the body shown in the image data is matched with the skin tone in the predetermined range of the body in the image data of the aforementioned predetermined parts, so it does not depend on the imaging conditions in the first imaging unit 11, and the image obtained in the imaging data The above-mentioned image data of the predetermined range of the body is formed in a state where the image display and the analysis of the diagnosis related to the skin state can be easily performed, and it can promote the accurate grasp of the skin state by the user.

As described above, in the skin condition measurement system of the present embodiment, the first imaging unit 11 captures an image of the user’s face as a predetermined range of the body, and the second imaging unit 12 captures an image of a predetermined part of the user’s face. The control unit 13 obtains information about the user's skin state based on the skin image data of the face and the skin image data of the aforementioned predetermined parts respectively obtained. Therefore, when analyzing the skin image data to import information about the skin state, the Improve the quality of information about the user's skin condition, such as diagnostic information on the skin condition of the skin image data obtained by multiple types of imaging, and perform processing such as display and analysis of the skin condition with high precision, and perform skin condition appropriately and efficiently. diagnosis, and also improve the reliability of the information obtained, and enable users to more accurately grasp the skin condition.

In addition, the first imaging unit 11 and the second imaging unit 12 are provided in the terminal device 10 together, and the first imaging unit 11 and the second imaging unit 12 can be used to perform imaging in one terminal device 10, so one terminal device 10 can Corresponding to the imaging of the user's face as the predetermined range of the body and the imaging of the predetermined part of the face, only one device used for imaging can be used to suppress the cost related to imaging.

Wherein, in the skin state measurement system of the aforementioned embodiment, the user can accurately capture the image of the part shown by the terminal device 10 with the control part 13 forming the predetermined part of the skin to be photographed. As a premise, the image captured by the second imaging unit 12 is identified as the image of the preset predetermined part. In addition, in the control unit, the image of the aforementioned predetermined range of the body captured by the first imaging unit In the image, a part having a common feature (for example, the texture of the skin or the shape of a characteristic part such as a dark spot) appearing in the image captured by the second imaging unit is extracted, and the part is set as the aforementioned predetermined position. parts, and the image captured by the second imaging unit is identified as the image of the aforementioned predetermined part, and the position in the predetermined range of the body can be correctly identified for the image captured by the second imaging unit, and the image will be determined according to the image data. The information about the condition of the skin is formed as the correct one. Next, as described above, if the control unit does not specifically set the predetermined part of the skin that should be photographed by the second imaging unit, the imaging by the second imaging unit may be later or later than the imaging by the first imaging unit. Can go first.

In addition, in the skin condition measurement system of the aforementioned embodiment, the first imaging unit 11, the second imaging unit 12, and the control unit 13 are formed in a portable terminal device 10 such as a smart phone. Not limited to this, if it is an information processing device that realizes the function or processing of the control unit 13 by executing a pre-stored program, it may be equipped with the first imaging unit 11 or the second imaging unit 12 to measure the skin condition. , the terminal device is not limited to a portable device, and may also be a notebook or desktop computer with a camera. In addition, the terminal device incorporates a camera or display in other information processing devices that have been specialized for specific purposes such as beauty, such as mirrors or mirrors (half mirrors) of desk mirrors for makeup and beauty. In addition to the use of a mirror, it may also be an electronic device that displays information obtained by analyzing a user's image captured by a camera, a processed image, or a user's image, etc., on a mirror as necessary.

If it is such a terminal device 50 having a mirror unit 55, as shown in FIG. The camera parts of the first part are all formed to face the direction of the user, and are arranged on the upper part of the mirror part 55 . In addition, the light source 53 for illumination during imaging can also be provided together with the first imaging unit 51 or the second imaging unit 52, especially if it is formed near the second imaging unit 52, the setting can be switched when imaging at the aforementioned predetermined position. The non-polarized light is irradiated as the state of illumination for detecting the texture of the user's skin, and the light source unit is irradiated with linearly polarized light as the state of illumination for detecting the dark spots of the user's skin, or can be switched between The configuration of the light source unit in the state of irradiating clockwise circularly polarized light for skin texture detection and the state of irradiating counterclockwise circularly polarized light for skin dark spots detection is used separately for illumination. The second imaging unit 52 is preferably irradiated with polarized light and linearly polarized light, or clockwise circularly polarized light and counterclockwise circularly polarized light, so that skin texture detection and dark spot detection can be properly performed.

Next, on the upper part of the reflector part having the first imaging part 51 or the second imaging part 52, a cover part covering the first imaging part or the second imaging part to block the incidence of unnecessary light from the surroundings may also be provided. (hood) 54. Such a cover portion 54 can also be used as a reflection plate for advancing illumination light toward the user if the light source 53 for illumination during imaging is provided near the first imaging portion 51 or the second imaging portion 52 .

In addition, if the cover portion 54 is provided, the size of the cover portion can also be adjusted. If a part of the user's face (for example, the forehead, etc.) touches the front end of the cover portion, it will be opposite to the user's predetermined body range. When the first imaging section 51 becomes suitable for the positional relationship of the image taken by it, it is set; It is set so that the positional relationship suitable for these imaging|photography will become with respect to the 2nd imaging part 52.

In such a terminal device 50, when imaging is performed by the second imaging unit 52, the imaging unit in the in-focus state and the imaging target are finely imaged in a narrower range than when imaging by the first imaging unit 51. The distance is usually shorter than that of the first imaging unit 51 , so the user must approach the terminal device 50 to the predetermined location to be captured by the second imaging unit 52 . In order to make the imaging at the second imaging unit 52 easier, it may also be configured to measure the distance between the terminal device 50 and the user with a predetermined measuring means of the terminal device 50, and the user approaches the predetermined position to the terminal device 50 and moves relative to the first predetermined position. When the distance between the two imaging units 52 becomes suitable for imaging, the configuration of imaging by the second imaging unit 52 is executed; The reporting means of the terminal device 50 is configured to prompt the user to move to a side closer to or farther away from the terminal device 50 at an appropriate interval. In addition, in order not to move the body so that the user changes the distance between the user and the terminal device 50 every time the first imaging unit 51 and the second imaging unit 52 capture images, it may also be formed so that the first imaging unit 51 and the distance between the terminal device 50 and the user's imaging target portion in each focus state of the second imaging unit 52 are set to be the same. At this time, the first imaging unit 51 and the second imaging unit 52 can Imaging is performed at the same time, reducing the burden on the user related to imaging.

(Second embodiment of the present invention) A skin condition measurement system according to a second embodiment of the present invention will be described based on the aforementioned Fig. 10 and Fig. 11 . In the foregoing figures, similarly to the first embodiment, the skin condition measurement system 2 of the present embodiment includes: a first imaging unit 21, a second imaging unit 22, and a control unit 93; In terms of point, the first imaging unit 21 and the second imaging unit 22 are disposed in the terminal device 20, and on the other hand, there is a server 90 configured to perform data communication with the terminal device 20 through the network 100, The components of the control unit 93 are arranged.

In this embodiment, the user who is the subject of the skin condition measurement also concludes a contract with the provider of the skin condition measurement system 2 to receive the skin condition diagnosis service similarly to the aforementioned first embodiment. Furthermore, the skin condition measurement system 2 can be used, whereby diagnostic information of the skin condition can be obtained through the skin condition measurement system 2 .

The first imaging unit 21 is provided in the terminal device 20 as the first imaging means similarly to the first embodiment, and is capable of imaging a predetermined range of the user's body. The second imaging unit 22 is the same as the first embodiment, and is disposed on the same terminal device 20 as the first imaging unit 21 as the second imaging means, and can image a predetermined part of the user's skin.

The first imaging unit 21 and the second imaging unit 22 are the camera units of the terminal device 20 capable of capturing images of the user's skin, each representing a point forming part of the user's terminal device 20, and has the same characteristics as the aforementioned first imaging unit 20. 1. The configuration is the same as that shown in Embodiment 1, and detailed description thereof will be omitted.

The aforementioned terminal device 20 has the aforementioned first imaging unit 21 and the second imaging unit 22, which can capture images of the predetermined area of the user's body and the aforementioned predetermined parts, and obtain skin image data. This terminal device 20 is a well-known portable terminal device such as a mobile phone, a so-called smart phone, a tablet device, etc., which has a wireless communication means 24 for connecting to an IP communication network and performing communication in the same manner as the first embodiment described above. The application program is executed on the device and has a display unit 26 capable of displaying various information. Next, the terminal device 20 is provided with two camera units, and these are configured to function as the aforementioned first imaging unit 21 or second imaging unit 22 .

The display unit 26 of the terminal device 20 can display a portrait representing at least the predetermined body range of the user. The display unit 26 is a touch panel-type display element and also functions as an input element. More specifically, in addition to displaying the image for display of the predetermined range of the body or the image for display of the predetermined part obtained by the control portion 93 of the server 90, the display portion 26 also displays the image obtained by the control portion 93 in the same manner. Diagnosis information of the skin condition in the predetermined range of the aforementioned body obtained.

Among them, the terminal device 20 is an information processing device that realizes various functions or processing by executing pre-stored programs. The person who measures the skin condition is not limited to a portable device as in the first embodiment, but may also be a computer such as a notebook or a desktop, or other information processing devices specialized for specific purposes.

The terminal device 20 activates the application program for skin condition measurement, and the first imaging unit 21 captures the face as the predetermined range of the user’s body to obtain facial skin image data, and the second imaging unit 22 Taking an image of the predetermined part of the skin, obtaining skin image data of the predetermined part, and sending the skin image data to the control part 93 of the server 90 .

In addition, the terminal device 20 executes the application program to perform a communication requesting that the terminal device 20 can refer to the diagnostic information obtained in the server 90, and the responsive server 90 obtains the diagnostic information as contents and displays it on the display. Section 26. In addition, the terminal device 20 may receive data transmission of the diagnostic information from the server 90 side to display the diagnostic information, or download the data of the diagnostic information to display the diagnostic information so that the diagnostic information can be referred to. Furthermore, the terminal device 20 receives from the server 90 the image for displaying the predetermined range of the body or the image for displaying the predetermined part acquired by the control unit 93 of the server 90 , and causes the display unit 26 to perform such display.

The aforementioned server 90 can be configured by performing data communication with the terminal device 20 through the network 100, and receives the skin image data of the aforementioned predetermined range of the body and the skin image data of the aforementioned predetermined parts obtained by the terminal device 20, as The control unit analyzes the skin image data to obtain diagnostic information on the user's skin condition, and obtains a display image based on each skin image data, and transmits the diagnostic information and the display image to the terminal device 20, and the terminal device 20 The display unit 26 of the device 20 performs the display of diagnostic information and the display of skin image respectively.

The server 90 is a computer including a CPU and the like that functions as a server. The computer performs processing according to the recorded program, thereby realizing the function of the server.

Among them, the server 90 in this embodiment is not necessarily limited to a single physical computer, but also includes a plurality of computer devices that are connected to the network and cooperate to provide one or more required services as a whole. In the case of a device group, or a virtual device that has only a part of the functions of a computer device, but provides one or more required services as a single device, the service-provided side is treated as a virtual device.

The server 90 is equipped with: based on the skin image data captured by the first imaging unit 21 and the second imaging unit 22 of the terminal device 20, it obtains diagnostic information on the skin condition as information on the skin condition and communicates to the terminal device. The control part 93 of the information of the image used for display; and the composition of the recording part 97 for recording. In other words, the server 90 is a computer forming the server 90 that executes processing according to a program, thereby realizing the functions of the control unit 93 and the recording unit 97 described above.

The control unit 93 in the server 90 acquires information about the state of the skin based on the image data of the skin obtained by the camera. The control unit 93 can obtain information about the skin condition of the predetermined body range based on the skin image data of the predetermined range of the body received by the terminal device 20 and captured by the first imaging unit 21. The same terminal device 20 receives the skin image data of the aforementioned predetermined part captured by the second imaging part 22 to obtain information about the skin condition of the aforementioned predetermined part.

Specifically, the control unit 93 acquires diagnostic information on the skin state of the predetermined body range obtained by analyzing the skin image data of the predetermined body range and the skin image data of the predetermined part, as information about the skin state. Therefore, the function of the control unit 93 to analyze each image data to obtain the diagnostic information of the user's skin condition is based on the same structure as that of the first embodiment, except that the server 90 executes the processing according to the application program, and the function is omitted. Detailed description.

Then, the control unit 93 can transmit the diagnostic information of the aforementioned skin condition in the predetermined range of the body to the terminal device 20 . The terminal device 20 can display on the display unit 26 the diagnosis information of the skin condition in the predetermined range of the body according to the control of the control unit 93 .

In addition, the control unit 93 acquires the display image of the predetermined body area derived from the skin image data of the predetermined body area, and obtains the display image of the predetermined part derived from the skin image data of the predetermined body area, as Other informants about skin condition.

Next, the control unit 93 can transmit the information of such a display image to the terminal device 20 . The terminal device 20 can, under the control of such a control unit 93, display the aforementioned predetermined area of the body on the display unit 26, specifically, an image of the face, and on the other hand, display it on the screen of the display unit 26 that displays it. In the state of replacing the image with the same area as the display area, or in an area other than the aforementioned display area, simultaneously and in parallel with the display of the face image, the aforementioned predetermined part of the image whose magnification rate is greater than the aforementioned predetermined range of the body The image of is displayed.

In addition, the control unit 93 may also use the image for displaying the predetermined part derived from the skin image data of the predetermined part for part or all of the image for displaying the predetermined body range derived from the skin image data of the predetermined part. Image, perform image correction processing (such as color calibration).

In addition, the control unit 93 can also execute the position corresponding to the predetermined part to be captured by the second imaging unit 22 on the image for display of the predetermined body range derived from the skin image data of the predetermined body range, Synthesizing the predetermined guidance pattern portion representing the imaging target position of the second imaging unit 22 , and transmitting the processed display image to the terminal device 20 to be displayed on the display unit 26 of the terminal device 20 . Thereby, the aforementioned guide pattern portion is displayed as a part of the image for displaying the aforementioned predetermined body range displayed on the display portion 26 of the terminal device 20, and the user can visually recognize the scheduled image to be captured by the second imaging portion 22 within the predetermined body range. parts to understand.

In addition, the control unit 93 temporarily acquires the skin condition of the predetermined body range as information about the skin condition based on the skin image data of the predetermined range of the body captured by the first imaging unit 21 received by the terminal device 20. Diagnosis information, and based on the diagnosis information, set the predetermined part of the skin that should be photographed by the second imaging part 22, and transmit the information about the predetermined part of the skin to the terminal device 20, through the display part 26 of the terminal device 20, etc. It is shown to the user, whereby imaging of a predetermined part of the skin by the second imaging unit 22 can be performed.

Next, if the skin image data of the predetermined part is transmitted to the server 90, the control The unit 93 is configured to reacquire diagnostic information on the skin condition of the predetermined range of the body based on the newly acquired skin image data of the predetermined part and the skin image data of the predetermined body range.

The recording unit 97 is based on the skin image data of the predetermined range of the body, and uses the diagnostic information of the skin condition of the predetermined range of the body temporarily acquired by the control unit 93 to record the image set by the control unit 93 that should be captured by the second imaging unit 12. The informant of the predetermined part of the skin.

In addition to the information of the predetermined part of the skin to be photographed by the second imaging part 22, the recording part 97 can distinguish and obtain the skin image data obtained by the second photographing part 22 at the predetermined part. The date and time of the skin portrait data are recorded.

Next, the use state of the skin condition measurement system of this embodiment will be described. On the premise, similarly to the aforementioned first embodiment, the entire face of the user is defined as the predetermined area of the body to be imaged by the first imaging unit 21, and the predetermined area to be imaged by the second imaging unit 22 including this is the face. The essential part of the skin. Next, the terminal device 20 is a smart phone, and the camera unit on the side of the display unit 26 is used as the first imaging unit 21, and on the other hand, the camera unit on the opposite side to the display unit 26 is used as the second imaging unit 22. camera, and can communicate with the server 90 through the network 100. When photographing a predetermined location, a conversion lens 29 is installed in front of the second imaging unit 22 in the terminal device 20, and the imaging range of the second imaging unit 22 is narrower than that of the first imaging unit 21. On the other hand, it can be higher. The resolution is high, and as the aforementioned predetermined part, the skin in a very narrow range of the face is photographed.

Similar to the aforementioned first embodiment, first, the user attaches a conversion lens (not shown) to the terminal device 20 so that each imaging unit of the terminal device 20 can be used to take an image. Next, by the user's operation on the terminal device 20, the terminal device 20 accesses the predetermined web page prepared by the service providing server (for example, the server 90) for skin condition measurement, and by this access, it is possible to When the terminal device 20 uses an online service (online service) such as a web application program provided by the server, the terminal device 20 becomes an application program that provides a user interface for using each camera unit, and through the terminal device 20 On the other hand, the user can use each imaging unit in the state of imaging as skin condition measurement.

In addition, the terminal device 20 may be operated by the user to activate the application program provided in advance on the terminal device to provide a user interface for using each camera unit on the terminal device 20, so that the user can see through the terminal device 20 On the other hand, the state of each imaging unit is used for imaging of the skin.

When the user performs a measurement start operation on the user interface displayed on the display unit 26 of the terminal device 20, the terminal device 20 executes imaging of a face as a predetermined range of the user's body.

Specifically, in the terminal device 20 , the user interface is displayed on the display unit 26 by executing the application for skin condition measurement. The user operates the user interface to start imaging the user's face by the first imaging unit 21 as the first imaging means in the terminal device 20, and continues to acquire skin image data in the terminal device 20. , and sent to the server 90.

Next, the control unit 93 of the server 90 causes the display unit 26 of the terminal device 20 to display a face image based on the image data obtained by the camera. In addition, the control unit 93 keeps the user in a state of supporting the terminal device 20 by displaying the face in a preset direction and size by using predetermined guidance display etc. made by the display unit 26 of the terminal device 20 .

The user uses the image display of the face on the display unit 26 as a reference, and the user interface of the terminal device 20 at the time when the face is considered to be properly captured by the first camera unit 21 as a predetermined range of the body. A predetermined operation is performed, and a still image of the face is determined. The still image data of the face at the determined moment is transmitted to the server 90 , and is formed into the skin image data of the predetermined range of the body captured by the first imaging unit 21 and processed by the control unit 93 .

The control unit 93 acquires a display image of the face based on the skin image data captured by the first imaging unit 21, transmits it to the terminal device 20 and displays it on the display unit 26, and analyzes the skin image data, Furthermore, diagnostic information on the skin condition of the user's face is temporarily acquired.

In addition, the control unit 13 refers to the information recorded in the recording unit 97 to determine whether there is information on the aforementioned predetermined part set during the previous imaging, that is, using the diagnostic information on the skin condition of the face temporarily acquired in the same way as above. On the other hand, the control unit 13 has recorded the information of the set predetermined part of the skin to be recorded when the second imaging part 12 sets the predetermined part of the skin to be imaged.

If the information of the previously set predetermined parts is recorded, the control unit 93 is based on the recorded information, and uses the aforementioned diagnosis information for each part of the aforementioned body predetermined range other than the parts previously set as the predetermined parts, inferring, for example, finding the Part of the skin has precursors such as dark spots, so it is necessary to confirm the presence or absence of dark spots, etc., and it is necessary to obtain a detailed image of the site by the imaging of the second imaging unit 22 for further appropriate diagnosis of the skin condition.

On the other hand, if the user's skin imaging is performed for the first time, etc., when the recording unit 97 has not recorded the information of the predetermined part that should be captured by the second imaging unit 22 previously set, the control unit 93 is for the whole predetermined range of the body. Using the diagnostic information, similarly to the above, it is deduced that the site that needs to obtain a detailed image by the imaging of the second imaging unit 22 is required for further appropriate diagnosis of the skin condition.

The control unit 93 sets the thus deduced site as a predetermined site to be imaged by the second imaging unit 22 , and records the set information of the predetermined site in the recording unit 97 . Next, the control unit 93 generates a predetermined guidance pattern portion representing the predetermined portion, and performs a process of synthesizing the guidance pattern portion with the display image of the face based on the facial skin image data, and the synthetic The completed image is transmitted to the terminal device 20 and displayed on the display unit 26 of the terminal device 20 . Looking at the display unit 26, the user recognizes a predetermined location to be captured by the second imaging unit 22, and adjusts the position of the terminal device 20 having the second imaging unit 22 so that the image can be captured.

Herein, similarly to the aforementioned first embodiment, the control unit 93 may also select the face that the user cares about after watching the display of the face by the display unit 26 among the faces in the predetermined range of the user's body. The part is used as an object, and the user takes an image by the second imaging unit 22, and the instruction guided by the terminal device 20 to the user is transmitted to the terminal device 20, so that the terminal device 20 executes the guidance display or display for the user. Instead of setting a predetermined location to be imaged by the second imaging unit 22, an audio guide or the like is displayed, and an image such as a guide pattern portion indicating the predetermined location is synthesized with an image of the face. Alternatively, it is also generally possible to select in advance the part where the skin condition is mostly measured and register it as the initial measurement position, and to synthesize a predetermined guiding pattern part representing one or a plurality of parts of the skin at the initial setting position on the display of the face. Using the image processing, the synthesized image is transmitted to the terminal device 20 and displayed on the display unit 26 .

When the user adjusts the position of the terminal device 20 held in his hand, and determines that the second imaging unit 22 is facing the aforementioned predetermined part of the face, etc., he performs a predetermined operation on the user interface such as the shutter button of the terminal device 20 to make it Imaging by the second imaging unit 22 .

Therefore, at the stage of taking an image, the second image pickup unit 22 performs the above-mentioned predetermined lighting conditions of the skin under the predetermined lighting conditions caused by the external light source (such as the built-in light source of the conversion lens) or the built-in light source of the terminal device 20. Parts of the camera, and output skin portrait data. The skin image data of the predetermined part is sent from the terminal device 20 to the server 90 and acquired by the control unit 93 .

For example, the built-in light source installed in the conversion lens of the terminal device 20 can adjust the irradiation state of the light irradiated to the part of the imaging target by the built-in light source of the light irradiated as illumination. After being optimized through verification, etc., imaging is performed, and images for texture diagnosis of the skin are imaged under illumination by irradiation of non-polarized light, and black images of the skin are imaged under illumination by illumination of linearly polarized light. Each skin image data of the image for spot diagnosis is transmitted from the terminal device 20 to the server 90 and acquired by the control unit 93 .

The control unit 93 can record the acquired skin image data of the predetermined part in the recording unit 97 by adding the previously recorded information of the predetermined part so that the date and time of the skin image data acquisition can be identified. In addition, if the control unit 93 records the information of the previously set predetermined site in the recording unit 97, it refers to the recording unit 97 and includes the data acquisition date and time in the predetermined site corresponding to the past predetermined period of the metabolic cycle of the user's skin. The skin image data is regarded as being captured at the same timing as the new imaging by the second imaging unit 22 .

Next, after the control unit 93 obtains the skin image data of the aforementioned predetermined part of the skin from the second imaging unit 22, it analyzes the skin image data, and considers that the recorded data acquired during the aforementioned predetermined period to be imaged at the same timing as this is completed. The skin image data of the predetermined part and the image data of the face captured by the first imaging unit 21 are acquired to obtain the formal skin condition diagnosis information of the user's face in the predetermined range of the body.

Wherein, if the recording unit 97 has not recorded the information of the previously set predetermined site, the control unit 93 analyzes the skin image data after the second imaging unit 22 obtains the skin image data of the aforementioned predetermined site of the skin, and obtains the image data first. The facial skin image data captured by the first imaging unit 21 is used to obtain formal diagnostic information for the skin condition of the user's face.

Next, the control unit 93 transmits the diagnostic information on the skin condition of the face to the terminal device 20 (refer to FIG. 11 ), and displays the diagnostic information on the terminal in parallel with the facial image or in replacement with the facial image. The display portion 26 of the device 20 .

In addition, the control unit 93 may also generate a display image of the predetermined part based on the image data of the predetermined part of the skin, transmit the information of the image for display of the predetermined part to the terminal device 20, and make the image of the predetermined part , is displayed on any area on the screen of the display unit 26 of the terminal device 20 as needed.

The display of the diagnostic information of the skin condition of the face in the display unit 26 of the terminal device 20 is the same as the above-mentioned first embodiment, and is not limited to a text-based information display. In the display control of the diagnostic information by the control unit 93 , information is provided by displaying specific parts of the skin or symptoms that should be paid attention to by using a marking image or the like on the facial image. For example, a mark of a predetermined color superimposed on the corresponding part of the facial image may also be used to indicate the latent diagnostic information guided as the diagnostic information analyzed from the fine image data obtained by the second imaging unit 22. The image information display of the position or size of dark spots is provided, which can be used as reference information when performing skin care such as dark spot countermeasures. By displaying the diagnostic information as described above, imaging as one measurement of the skin condition by the first imaging unit 21 and the second imaging unit 22 is completed.

After this, in order to grasp more detailed skin conditions, such as the skin conditions of each part of the face, or the transition of skin conditions accompanied by maintenance, the user repeats the above-mentioned same actions by the first imaging unit 21 at predetermined intervals. For the imaging of the face in the predetermined range of the body and the imaging of the aforementioned predetermined parts by the second imaging unit 22, the control unit 93 of the server 90 that has obtained the data of each skin image obtains the data according to each skin image data every time it is photographed. Diagnosis information of the skin condition of the patient is displayed on the display unit 26 of the terminal device 20 .

In repeating such imaging, etc., in particular, the information of the planned location set by the control unit 93 is recorded in the recording unit 97, and the recorded information is referred to in the next imaging to set a new planned location that does not overlap with the previous one. In the same manner as in the aforementioned first embodiment, the face region, which is the predetermined range of the body, is formed into a state of being gradually buried every time the image is taken, that is, the part where detailed skin image data is obtained in the image taken by the second imager unit 22. , so that the multiple high-precision skin image data are continuous into a map shape, the analysis of the skin state based on the skin image data can be performed with higher precision, and accurate and reliable diagnostic information can be derived.

Wherein, the control unit 13 can also record the information of the predetermined position and the skin at the predetermined position obtained by the imaging of the second imaging unit 22 every time the second imaging unit 22 performs imaging of the aforementioned predetermined position. Among the image data, at the time of a new camera session, among the information or skin image data recorded at a predetermined part of the recording unit 97, the data acquisition date and time exceed the past predetermined period corresponding to the metabolic cycle of the user's skin. For those who are older, it is judged that the metabolism of the skin does not overlap with the skin of the user in the new camera session, such old information or skin image data can be deleted, and new records can be repeated naturally.

In addition, the skin image data of the face captured by the first imaging unit 21 as the basis for the display image of the face as the predetermined range of the body acquired by the server 90 or the diagnostic information of the skin condition is The skin image data obtained by the first imaging unit 21 before the second imaging unit 22 takes the imaging can be replaced by the control unit 93 of the server 90 obtained by the terminal device 20 and captured by the second imaging unit 22. After performing image correction processing on the skin image data of the face based on the skin image data of the aforementioned predetermined part, a display of the face based on the corrected skin image data of the face is generated. Using the image, transmit the display image of the face to the terminal device 20 to be displayed on the display unit 26 of the terminal device 20, or analyze the skin image data of the corrected face together with the skin image data of the aforementioned predetermined parts , to obtain diagnostic information on the skin condition of the face.

At this time, the image correction process is performed on the image data of the predetermined range of the body based on the image data of the predetermined part captured by the second imaging unit 22, which is easy to meet the imaging conditions by limiting the imaging range. The color tone of the skin image in the predetermined range of the body shown in the image data matches the color tone of the skin image in the image data of the aforementioned predetermined part, so it is not dependent on the imaging conditions of the first imaging unit 21, and the aforementioned body image obtained by imaging The image data in a predetermined range is in a state where it is easy to analyze the image display or the diagnosis of the skin state, and it can promote the accurate understanding of the skin state by the user.

As described above, in the skin condition measurement system of this embodiment, the first imaging unit 21 captures an image of the user’s face as a predetermined area of the body, and the second imaging unit 22 captures an image of a predetermined part of the user’s face. , based on the skin image data of the face and the skin image data of the aforementioned predetermined part obtained separately, the diagnosis information of the skin state or the image for display as the information about the skin state of the user is obtained at the server 90, so that the skin image is analyzed When the information about the skin condition is imported from the data, the quality of the information about the user's skin condition, such as the diagnosis information of the skin condition based on the skin image data obtained by multiple types of photography, can be improved, and the display or the condition of the skin can be performed with high precision. Analyzing the processing in the server 90 can properly and efficiently diagnose the skin condition, improve the reliability of the obtained information, and enable the user to grasp the skin condition more accurately.

Wherein, in the skin condition measurement system of the above-mentioned embodiment, the skin image data of the face captured by the first imaging unit 21 as the first imaging means is formed so that the terminal device 20 only transmits it to the server 90. , which is used as a configuration for obtaining diagnostic information and other information processing on the skin state in the control unit 93, but it is not limited thereto. As shown in FIG. Data, together with the server 90, is sent to the other person's terminal device 60, and the control unit 93 of the server 90 obtains information about the skin state according to the skin image data in parallel, and at the other person's terminal device 60, according to the sent out The skin image data shows the composition of the user's image including the face.

This system can be applied to continuously display the usage status of the terminal device on the other side based on the image captured by each terminal device during the communication between the user's terminal device 20 and the other's terminal device 60, such as video call etc. As a specific example, in order to obtain diagnostic information, the user takes an image of his face with the first imaging unit 21 of his own terminal device 20, and browses the diagnostic information finally obtained on the server 90. The other party conducts a video call through the terminal device, and the user's portrait displayed on the terminal device 60 on the other party's side becomes the person based on the skin image data of the face captured by the first imaging unit 21 .

In addition, in this application example, it is also possible to obtain the support of the counselor obtained through the call while the user receives the consultation for the skin through the video call with the counselor through the terminal device. The user operates the terminal device 20 to take an image of the face or the aforementioned predetermined part as the predetermined range of the body, with the first imaging unit 21 and the second imaging unit 22 of the terminal device 20, and the skin image data obtained by the imaging The terminal device 20 is transmitted to the server 90, and the control unit 93 of the server 90 acquires the diagnosis information of the skin state.

At this time, the diagnosis information of the skin state obtained by the control unit 93 of the server 90 may also be sent to the counselor, that is, the terminal device 60 of someone other than the user, and the user and the counselor share the information. After the recognition of the user's skin condition is formed by using the diagnosis information, the counselor can conduct detailed consultation on the user's skin based on the diagnosis information. In addition, the diagnostic information of the skin condition may not be transmitted from the server 90 to the user's terminal device 20, but can only be viewed on the counselor's terminal device 60, without giving the user any inconvenience caused by the diagnostic information. In the case of preconceived ideas, the user can easily and smoothly accept the advice of the counselor. In addition, the second imaging unit as the second imaging means is arranged in the same direction on the side of the user's terminal device that has the first imaging unit, or is used by the first imaging unit of the terminal device, Or if it is an imaging device that is independent from the user's terminal device, the user can accept that the user's imaging can be confirmed through the display screen of the terminal device while the second imaging unit is performing imaging of the aforementioned predetermined part of the face. With the support of the imaging obtained by the conversation of the counselor, the user adjusts the distance between the second imaging unit and the aforementioned predetermined part of the user, or properly directs the second imaging unit toward the aforementioned predetermined position, etc., and then For photography, it is ideal.

In addition, in the skin state measurement system of the aforementioned embodiment, the first imaging unit 21 formed as the first imaging means is disposed on the terminal device 20 of the user, and the first imaging unit performs the operation by the user. 21 is the composition of taking pictures of the user’s face in the predetermined range of the body, but it is not limited to this, and it can also be formed as a part of the terminal device of the other person, or connected to the other person’s terminal device. The predetermined imaging device that takes pictures of at least the predetermined range of the user's body and uses the image data of the user obtained by such a first imaging means to obtain information about the user on another terminal device. Among the main purposes other than the information of the skin state, the server 90 receives the skin image data of the user’s predetermined range of the body captured by the first imaging means, and the control unit 93 of the server 90 according to the data of the predetermined range of the body The skin image data and the skin image data of the predetermined part obtained by the second imaging means are configured to obtain diagnostic information and other information about the user's skin condition.

As a specific example, as shown in FIG. 13 and FIG. 14 , the imaging unit of the terminal device 61 of another person takes an image of the user, and performs personal authentication processing for user identification based on the obtained image data. Among the main purposes, the data of the image captured by the other person's terminal device 61 is obtained from the server 90 in the form of embezzling the skin image data of the predetermined range of the user's body, and this is stored in the control unit. 93 Analyzing together with the skin image data of the predetermined part obtained by the second imaging means to obtain diagnostic information of the skin state.

At this time, the image data of the user acquired by the imaging unit of the other terminal device 61 can be used for skin diagnosis, thereby eliminating the need to re-prepare the first imaging of the aforementioned predetermined range of the user's body. By means of low-cost and efficient acquisition of information on skin conditions such as diagnosis information based on each image data.

(Third embodiment of the present invention) In the skin condition measuring system of the aforementioned first embodiment, the second imaging unit 12 as the second imaging means is formed so as to be capable of capturing a predetermined portion of the face ( For example, a part of the cheek or forehead etc.) imaging structure, in addition, in terms of the third embodiment, the second imaging means can also be configured to image a predetermined part of the skin that does not overlap with the aforementioned body predetermined range of the user. .

At this time, after the control unit obtains information about the skin state of the aforementioned predetermined portion of the skin based on the skin image data of the aforementioned predetermined portion captured by the second imaging means, as information about the skin state of the aforementioned predetermined range of the body, Acquiring information on the relative skin condition of each part of the predetermined range of the body based on the information on the condition of the skin on the predetermined part.

As a specific example, for the face in the predetermined range of the user's body captured by the first imaging unit 31 as the first imaging means, a predetermined part of the skin that does not overlap with this, for example, the arm is close to the body. Parts that are less exposed to sunlight and less affected by ultraviolet rays, such as the face or the underside of the chin, are captured by the second imaging unit 32 as the second imaging means provided in the terminal device 30 (see FIG. 15 ). However, the imaging by the second imaging unit 32 may be performed later or earlier than the imaging by the first imaging unit 31 .

Based on the skin image data of the predetermined part captured by the second imaging part 32, the control part (not shown) acquires information about the skin condition of the predetermined part of the skin. In addition, based on the skin image data of the face as the predetermined range of the body captured by the first imaging unit 31, when the control unit obtains information about the skin state of the face, the information about the skin state of the face is obtained, Information on the relative skin condition of each part of the face based on the previously obtained information on the skin condition of the predetermined part.

Thereby, the skin condition of the user's face can be relatively displayed with the condition of the skin of the user's face, which is less affected by the influence of ultraviolet rays, and the skin condition of the aforementioned predetermined part, which is a part suitable for the skin evaluation standard, as a reference, The degree of deterioration of the skin condition of each part of the face, which is the predetermined range of the body, is expressed in a form that is easy for the user to understand. The user can capture the skin condition of the face as a difference from the original skin condition, etc. The skin condition of the aforementioned predetermined part as a reference can be grasped accurately, and the user's appropriate maintenance of the skin of the face can be facilitated.

Wherein, it may also be configured such that the terminal device proposes to the user the information on the skin state of the face, such as the relative diagnostic information on the skin state obtained by the control unit based on the information on the skin state of the aforementioned predetermined part. A skin care structure that brings the skin condition of the face closer to the skin condition of the aforementioned predetermined target site. At this time, external AI can also be used to conduct more detailed analysis based on various information about skin conditions in addition to diagnostic information, so as to achieve more effective skin care proposals.

In addition, in the aforementioned embodiment, the first imaging unit 31 as the first imaging means and the second imaging unit 32 as the second imaging means are disposed on one terminal device 30, and the operations performed by each imaging unit are performed at different timings. The imaging can be easily performed by one terminal device 30. In addition, it can also be formed as a configuration in which a second imaging means is provided separately from the first imaging means. , and use the configuration of another imaging device 36 having a camera unit forming the second imaging means. In this case, the first imaging means and the second imaging means can simultaneously perform imaging (refer to FIG. 16 ), shorten the time until the information on the skin condition is obtained from the imaging, and reduce the burden on the user related to the imaging. It is easy for the user to continue activities such as photography to obtain information on the state of the skin.

(Fourth embodiment of the present invention) A skin condition measurement system according to a fourth embodiment of the present invention will be described based on the above-mentioned Fig. 17 to Fig. 19 . In each of the above-mentioned figures, similarly to the aforementioned first embodiment, the skin state measurement system 4 of the present embodiment is provided with: a first imaging unit 41, a second imaging unit 42, and a control unit 43; In point of view, the terminal device 40 equipped with the first imaging unit 41, the second imaging unit 42, and the control unit 43 has the ability to simultaneously perform the imaging by the first imaging unit 41 and the imaging by the second imaging unit 42. For the imaging, the first imaging unit 41 captures the mirror image of the user reflected on the mirror surface 80 in front of the user.

In this embodiment, the user who is the subject of the skin condition measurement also concludes a contract with the provider of the skin condition measurement system 4 to receive the skin condition diagnosis service similarly to the aforementioned first embodiment. Furthermore, the skin condition measurement system 4 can be used, whereby diagnostic information of the skin condition can be obtained through the skin condition measurement system 4 .

The aforementioned first imaging unit 41 is configured in the terminal device 40 as the aforementioned first imaging means. In terms of the measurement of the user's skin condition, it can capture a predetermined area of the user's body, for example, the face of the user. However, the first imaging unit 41 takes a mirror image of the predetermined range of the user's body reflected on the mirror surface 80 positioned in front of the user.

The aforementioned second imaging unit 42 is used as the aforementioned second imaging means, and is disposed on the same terminal device 40 as the first imaging unit 41. In terms of the measurement of the user's skin condition, it can be compared with the user's aforementioned body predetermined range. A predetermined portion of the user's skin that is a relatively narrow portion and overlaps with the predetermined range of the body, such as a part of the cheek or forehead, etc., is photographed.

The second imaging unit 42 is disposed on the other side opposite to the surface on which the first imaging unit 41 is disposed in the terminal device 40, and the first imaging unit 41 in the terminal device 40 can face the front of the user. In the state of the mirror surface 80, the aforementioned predetermined part of the user is photographed. In addition, compared with the first imaging unit 41 , the second imaging unit 42 can acquire image data with a higher resolution per unit area of the imaging object.

The first imaging unit 41 and the second imaging unit 42 can perform imaging through the operation of the user of the terminal device 40. The imaging of the aforementioned predetermined range of the body performed by the first imaging unit 41 and the imaging of the predetermined area of the body by the second imaging The imaging of the aforementioned predetermined part of the skin by the unit 42 is performed at the same timing.

The aforementioned terminal device 40 is formed as a device having the aforementioned first imaging unit 41 and the second imaging unit 42, which can capture images of the user's body predetermined range and the aforementioned predetermined parts, and obtain skin image data, and has the aforementioned control unit 43 By.

The terminal device 40 is a handheld device capable of executing an application program, and has a display unit 46 capable of displaying various information. The display unit 46 of the terminal device 40 can display the user's portrait. The display unit 46 is a touch panel-type display element and also functions as an input element.

Among them, the terminal device 40 is an information processing device that realizes the function or processing of the control unit 43 by executing a pre-stored program. If the two camera parts 42 simultaneously take pictures, it can also be a fixed device, rather than being limited to a hand-held device. In addition, the terminal device 40 considers the possibility that the mirror surface 80 is a mirror that is often installed in places with moisture such as bathrooms, washstands, and dressing tables. Since it is used in the same space, it is better to form a waterproof structure.

The control unit 43 of the terminal device 40 can use an application program for diagnosing skin conditions to analyze the skin image data obtained through photography to obtain diagnostic information, and the user can refer to the obtained diagnostic information. At this time, the control unit 43 of the terminal device 40 can display the obtained diagnostic information as contents on the display unit 46 by executing the application program, thereby making a reference.

The above-mentioned control unit 43 is based on the image data of the skin obtained by imaging, that is, the skin image data of the predetermined range of the body obtained by the imaging of the first imaging unit 41 and the aforementioned predetermined skin imaging data acquired by the imaging of the second imaging unit 42. A person who obtains information about the skin condition of the skin image data of the part.

The control unit 43 analyzes the skin image data of the predetermined range of the body and the skin image data of the predetermined part to obtain diagnostic information of the skin state of the user's predetermined body range as information about the skin state. Therefore, the function of the control unit 43 to analyze each skin image data to obtain the diagnostic information of the user's skin condition is realized by the control unit 43 executing processing according to the application program. The structure is the same as that of the first embodiment described above. Detailed description.

In addition, the control unit 43 obtains the display image of the predetermined body area based on the skin image data of the predetermined body area, and obtains the image of the predetermined area based on the skin image data of the predetermined area in terms of other information about the skin state. The display uses portraits.

Next, the control unit 43 can display the image of the aforementioned predetermined range of the body, specifically the face, on the display unit 46 of the terminal device 40, and on the other hand, display it on the screen of the display unit 46 corresponding to the display. In the state where the image is replaced in the same area as the display area, or in an area other than the aforementioned display area, simultaneously and in parallel with the display of the image for displaying the face, the magnification ratio is larger than that of the image for displaying the predetermined range of the body The display of the aforementioned predetermined portion is displayed with an image.

In addition, the control unit 43 may also use the diagnostic information on the skin condition of the user's skin condition in the predetermined range of the body obtained previously as information on the skin condition to set the areas included in the predetermined body range that should be captured by the second imaging unit 42. For the predetermined part of the skin, the information of the predetermined part is reported to the user through the terminal device 40 .

At this time, when the image data of the skin image of the predetermined part is acquired by the second imaging part 42 according to the operation of the user who refers to the information of the predetermined part, the control part 43 will Based on the skin image data of the aforementioned predetermined part and the skin image data of the predetermined body area obtained by capturing at the same time, the diagnostic information of the skin state of the predetermined body area can be obtained.

In addition, if the control unit 43 has the acquired diagnosis information of the skin state in the predetermined range of the body and sets a predetermined part of the skin that should be captured by the second imaging unit 42, it will record the information of the predetermined part that has been set. The recording part 47.

The recording unit 47 is not only the information of the predetermined part of the skin that should be photographed by the second imaging unit 42, but also the image data of the predetermined part of the skin that is captured by the second imaging unit 42 to determine and acquire the skin. The date and time of the portrait data is used as the recorder.

If the control unit 43 records the information of the previously set predetermined part in the recording unit 47, the new camera meeting of the first imaging unit 41 uses the diagnostic information of the skin condition of the aforementioned predetermined range of the body obtained last time, and refers to The information of the predetermined part recorded in the recording part 47 resets the predetermined part of the skin to be imaged by the second imaging part 42 from among the parts not recorded as the predetermined part in the predetermined range of the body.

In addition, the control unit 43 has a new camera meeting with the first imaging unit 41, and sets a predetermined part of the skin to be captured by the second imaging unit 42 in parallel, and refers to the information of the predetermined part recorded in the recording unit 47, The structure of the skin image data of the predetermined part and the date and time of obtaining the data.

Next, the control unit 43 regards, among the recorded skin image data of the predetermined part, the skin image data whose data acquisition date and time are included in the past predetermined period corresponding to the metabolic cycle of the user's skin, and regards them as the same as The subject of the new recording at the same timing.

At this time, the control unit 43 is obtained by the second imaging unit 42 based on the recorded skin image data obtained during the aforementioned predetermined period, and the location of the predetermined part of the skin where the new camera will be set. The skin image data of the predetermined part and the skin image data of the predetermined body area are used to obtain diagnostic information (information about the skin state) of the skin state of the predetermined body area.

On the other hand, the control unit 43 can also target the data acquisition date and time that is not included in the aforementioned predetermined period and exceeds the user’s skin among the information of the predetermined part recorded by the recording unit 47 and the skin image data of the predetermined part. The old time point of the metabolic cycle is a period when the metabolism of the skin does not overlap with the user's skin captured by the new camera in the first imaging unit 41, and it is not considered to be the same as the new camera. The person taking the time sequence will delete the matching information of the predetermined part and the skin image data of the predetermined part from the recording part 47 .

Next, the use state of the skin condition measurement system of this embodiment will be described. On the premise, similarly to the above-mentioned first embodiment, the entire face of the user is formed within a predetermined area of the body to be captured by the first imaging unit 41, including a predetermined portion to be captured by the second imaging unit 42. For the main part of the skin of the face. Next, the first imaging unit 41 and the second imaging unit 42 of the terminal device 40 are configured to be able to perform imaging respectively.

First, when an application program that provides a user interface for using each imaging unit pre-existing in the terminal device is activated on the terminal device 40 through the user's operation, the user can view each camera through the terminal device 40. The imaging part is used in the state of imaging.

Next, the user directs the first imaging unit 41 as the first imaging means towards the mirror image of the face of the predetermined range of the user's body that is reflected on the mirror surface 80 in front of the user, and the second imaging means as the second imaging means. The second imaging unit 42 holds the terminal device 40 so that it faces a part of the user's face.

In the state where the terminal device 40 is held in this way, the first imaging unit 41 performs imaging of the mirror image of the face as the aforementioned predetermined range of the body reflected on the mirror surface 80 located in front of the user, and the second imaging unit 42 performs the imaging of the user's face. Part of the face is captured, and the control unit 43 continues to acquire image data obtained by each imaging unit.

In addition, as the images are captured by the first imaging unit 41 and the second imaging unit 42 , persons captured by the respective imaging units are displayed on the display unit 46 of the terminal device 40 based on the image data obtained during the imaging. At this time, the control unit 43 keeps the user in a state that at least the mirror image of the face is captured in the first imaging unit 41 in a predetermined direction and size by using the predetermined guide display or the like on the display unit 46 . The state of the terminal device 40 or the distance between the user and the mirror 80 is supported, and the image for displaying the face is obtained in the control unit 43 based on the skin image data of the face captured by the first imaging unit 41, and the face The image for displaying the part is appropriately displayed on the display part 46 .

Next, the control unit 43 takes the image of the user by the second imaging unit 42 by targeting the part that the user cares about in the face that is the predetermined range of the user's body. The terminal device 40 executes guide display, audio guide, and the like. Or, generally, the part where the skin state is mostly measured is selected in advance and registered as the initial measurement position, and a predetermined guiding pattern part representing one or a plurality of parts of the skin at the initial setting position is synthesized on the display image of the face. The combined image is displayed on the display unit 46 through the processing.

After accepting this, the user recognizes any part of the face he cares about, or looks at the initial measurement position on the face shown in the aforementioned guide pattern part displayed on the display part 46 and confirms it, so that these images can be taken. In this way, fine adjustment of the position or direction of the terminal device 40 having the second imaging unit 42 is performed.

The user forms the first imaging unit 41 and the second imaging unit 42 in the state of facing each imaging object, and uses the mirror image of the face on the display unit 46 or the image display of a predetermined part of the face, etc. as a reference. It is considered that the timing at which each object to be photographed is properly captured by each corresponding imaging unit, a predetermined operation is performed on a user interface such as a shutter button of the terminal device 40, and a mirror image of the face and a still image of a predetermined part are determined. The data of the determined instant face mirror image or the still image of the predetermined part are processed by the control unit 43 as skin image data of the predetermined range of the body and skin image data of the predetermined part.

Therefore, at the stage of determining the image, the second imaging unit 42 may perform imaging of the aforementioned predetermined part of the skin under a predetermined lighting condition caused by an external light source or a built-in light source of the terminal device 40 . For example, in the terminal device 40, it is possible to adjust the irradiation state of the built-in light source serving as the light irradiated to illuminate a predetermined part of the face of the subject to be photographed. After being optimized through verification, etc., imaging under illumination is performed, and the image for texture diagnosis of the skin imaged under the illumination by unpolarized light irradiation and the image for texture diagnosis by linearly polarized light can be obtained in the control unit 43. Each image data of an image for freckle diagnosis that is imaged on the skin under the illumination by light irradiation.

The control unit 43 obtains the image for display of the face or the aforementioned predetermined part according to each skin image data captured by the first imaging unit 41 and the second imaging unit 42, and displays it on the display unit 46 while analyzing each image. Skin portrait data, and obtain diagnostic information on the skin condition of the user's face.

Next, the control unit 43 displays the diagnostic information on the skin condition of the face on the display unit 46 simultaneously with the face image or in place of the face image. In addition, the control unit 43 records the information on the position of the predetermined part of the face and the skin image data of the predetermined part in the recording unit 47 in a state where the date and time of obtaining the skin image data can be identified.

The display of the diagnostic information on the skin condition of the face in the display unit 46 is not limited to text-based information display, and it is also possible to specifically indicate that the skin should be paid attention to by using a marking image on the facial image. Site or symptom to provide information. For example, a mark of a predetermined color may be superimposed on the corresponding part of the facial image to indicate the hidden dark spots that are guided as diagnostic information analyzed from the fine image data obtained by the second imaging unit 42. The location or size can be used as reference information when performing skin care such as dark spot countermeasures. By displaying the diagnostic information as described above, imaging as one measurement of the skin condition by the first imaging unit 41 and the second imaging unit 42 is completed.

After this, in order to grasp the transition of the skin state, the user repeats the above-mentioned same imaging of the face as the predetermined range of the body by the first imaging unit 41 and the aforementioned imaging by the second imaging unit 42 at predetermined intervals. For imaging of a predetermined site, the control unit 43 obtains diagnostic information on the skin condition based on each obtained skin image data for each imaging, and displays it on the display unit 46 .

At this time, the control unit 43 refers to the information recorded in the recording unit 47 to determine whether there is information on the predetermined part of the face set in the previous imaging, that is, the control unit 43 responds by using diagnostic information on the state of the skin, etc. The information of the set predetermined part of the skin is recorded when the predetermined part of the skin to be imaged by the second imaging part 42 is set.

If the information of the previously set predetermined parts is recorded, the control unit 43 is based on the recorded information, for each part of the aforementioned predetermined range of the body other than the parts previously set as the predetermined parts, using the previous diagnosis information, inferring, for example, finding Part of the skin has precursors such as dark spots, so it is necessary to confirm the presence or absence of dark spots, etc., and it is necessary to obtain a detailed image obtained by imaging by the second imaging unit 42 for further appropriate diagnosis of the skin condition.

On the other hand, if the recording unit 47 has not recorded the previously set information on the predetermined site that should be captured by the second imaging unit 42, the control unit 43 uses the diagnostic information of the previous skin condition for the entire predetermined range of the body. In the same manner as described above, in order to further properly diagnose the skin condition, it is deduced that it is necessary to obtain a site for which a detailed image is obtained by imaging by the second imaging unit 42 .

The control unit 43 sets the thus deduced site as a predetermined site to be imaged by the second imaging unit 42 , and records the set information of the predetermined site in the recording unit 47 . Next, the control unit 43 generates, for the predetermined part, a predetermined guide pattern part (marker) indicating a predetermined part of the face to be imaged by the second imaging part 42, for example, and synthesizes the guide pattern part on the basis of the predetermined part. The display of the facial skin image data uses image processing, and the combined image is displayed on the display unit 46 . Viewing the display unit 46 , the user recognizes a predetermined location to be captured by the second imaging unit 42 , and finely adjusts the position or direction of the terminal device 40 so that the second imaging unit 42 can capture the position.

In repeating such imaging, etc., the information of the predetermined part set by the control part 43 is recorded in the recording part 47, and when the next time is taken, the information that has been recorded is referred to to set a new predetermined part that does not overlap with the previous one, thereby The region of the face, which is the predetermined range of the body, is formed into a state of being gradually embedded in each imaging, that is, the position where detailed skin image data is obtained in the imaging of the second imaging unit 42, so that multiple high-precision skin image data appear. Continuously in the shape of a map, the analysis of the skin state based on the skin image data can be performed with higher precision, and accurate and reliable diagnostic information can be derived.

In this way, the control unit 43 records the information of the predetermined position and the information obtained by the second imaging unit 42 at the predetermined position each time the second imaging unit 42 performs imaging of the aforementioned predetermined position. Among the skin image data, at the time of a new camera session, among the information or skin image data recorded in the recording unit 47, for the date and time of data acquisition that exceeds the past predetermined period corresponding to the metabolic cycle of the user's skin For those who are older, it can be judged that the metabolism of the skin does not overlap with the skin of the user in the new camera session, and such old information or skin image data can be deleted, and new records can be repeated naturally.

Wherein, the control unit 43 can refer to the information recorded in the recording unit 47 when performing a new imaging by the second imaging unit 42, and transfer a new predetermined position that does not overlap with the previous one to the second imaging unit 42. Carrying out imaging, but not limited thereto, can also be formed to repeat the imaging of the aforementioned predetermined range of the body by the first imaging unit 41 and the imaging of the aforementioned predetermined position by the second imaging unit 42. The structure in which the second imaging unit 42 repeatedly takes pictures of the same predetermined site several times can grasp the skin condition in the specific site from the diagnostic information of the skin state or the image for display obtained by the control unit 43 based on the skin image data focusing on the same site of the skin. Detailed changes in skin conditions, and the degree of improvement achieved through skin care can be easily confirmed.

As shown above, the skin condition measurement system of this embodiment is to capture the mirror image of the mirror 80 reflected in front of the user in the first imaging unit 41 to obtain the skin image data of the predetermined range of the body, and at the same time, by The second imaging unit 42 takes pictures to obtain the skin image data of the aforementioned predetermined parts, and obtains information about the skin state at the control unit 43 by each skin image data, and can use the information about the skin state, so it can be used in each imaging unit at the same time. By taking an image, the skin image data of the predetermined range of the body and the skin image data of the predetermined part of the aforementioned body can be obtained at one time, which can shorten the time from the image to the acquisition of the information about the skin state, and can reduce the burden on the user related to the image. The information can be obtained without consuming time, and can quickly grasp the user's skin condition.

In addition, the first imaging unit 41 is arranged on one side of the terminal device 40, and in the state where the first imaging unit 41 faces the mirror 80, it can take an image of the aforementioned predetermined part of the user, and the second imaging unit 42 is arranged on the The same terminal device 40 can correspond to the imaging of the predetermined range of the user's body and the predetermined position in one device. Therefore, the skin image data of the predetermined range of the body and the predetermined position of the aforementioned body can be obtained by taking pictures of each imaging unit of the terminal device 40. If the user only needs to deal with the terminal device 40 equipped with each imaging unit when taking pictures, the burden on the user related to taking pictures can be greatly reduced, and the user can naturally continue to use it to obtain information about the state of the skin activity.

Wherein, in the skin condition measurement system of the foregoing embodiment, the terminal device 40 equipped with the first imaging unit 41 as the first imaging means and the second imaging unit 42 as the second imaging means is formed as a dedicated The configuration of the device for obtaining diagnostic information on the skin condition by imaging by the first imaging unit 41 and the second imaging unit 42 is not limited thereto, and it may also be formed as a smart phone that can be used for various purposes. A communication terminal device such as a communication terminal device, and a device having a plurality of camera units, if the plurality of camera units are formed so that the images of each camera unit can be simultaneously captured and image data can be obtained individually, the plurality of camera units can be used as the first imaging means or A configuration in which a terminal device that functions separately as a second imaging means is used.

In addition, in the terminal device 40 described above, the second imaging unit 42 as the second imaging means is disposed on the opposite side of the surface of the terminal device 40 on which the first imaging unit 41 as the first imaging means is disposed. However, it is not limited thereto. If it is the second imaging means installed in the terminal device, the first imaging means in the terminal device faces the mirror 80 that reflects the user in front of the user. Those who take pictures of the above-mentioned predetermined parts can also arrange a second shooting means at any part of the terminal device. In particular, if the direction of the subject to be photographed is changed by adding a conversion lens or the like, the second photographing means can also be disposed on the surface of the terminal device on which the first photographing means is disposed. In addition, the second imaging unit 42 as the second imaging means is not limited to being provided in the same terminal device 40 as the first imaging unit 41 as the first imaging means, and may be formed differently from the first imaging means. A configuration in which a second imaging means is provided separately from the first imaging means is, for example, a configuration in which another device having a camera unit forming the second imaging means is used in combination with a terminal device having a camera unit forming the first imaging means.

In addition, in the skin state measurement system of the aforementioned embodiment, the second imaging unit 42 as the second imaging means can detect a predetermined part of the face (such as the cheek) that overlaps with the face in the predetermined range of the user's body. or a part of the forehead, etc.), on the other hand, the imaging range is formed so that it becomes a part hidden in the terminal device 40 in the mirror image of the face of the mirror surface 80 reflected in front of the user, and it is different from the mirror image imaging of the face. The imaging ranges of the first imaging unit 42 as the first imaging means do not overlap, and there is no configuration where the first imaging unit 41 and the second imaging unit 42 are commonly imaged. In addition, as shown in FIG. 20 , It can also be formed so that the second imaging unit 49 in the terminal device 45 can take an image of the aforementioned predetermined part of the user even from a slightly distant position, and the first imaging unit 48 can reflect the mirror surface 80 in front of the user. The range of the mirror imaging of the face is formed so that even if the terminal device 45 is located at a position deviated from the front of the face, such as in the oblique front or sideways of the face, the aforementioned predetermined part of the face can be photographed, The imaging range of the first imaging unit 48 capable of taking a mirror image of the entire face overlaps with the imaging range of the second imaging unit 49 capable of imaging a predetermined portion of the face, and there is a gap between the first imaging unit 48 and the second imaging unit. The imaging unit 49 shares the configuration of the site to be imaged.

At this time, the relationship between the skin image data can be grasped from the common predetermined parts in the skin image data obtained by the two different imaging parts, and the details of each part of the face in the predetermined range of the body other than the overlapped parts can also be inferred. Skin condition, etc., by analyzing the data of each skin image in the control unit, detailed information about the skin condition can be obtained, and such information about the skin condition enables the user to accurately grasp the condition of the skin, and further promotes information about the skin condition. Correspondence such as proper maintenance of the user.

In addition, in the skin state measurement system of the aforementioned embodiment, the first imaging unit 41 as the first imaging means in the terminal device is formed so that the first imaging unit 41 faces the mirror 80 that reflects the user in front of the user, and uses the image reflected on the mirror 80. The mirror imaging of the face of the aforementioned predetermined range of the body of the patient is taken, and the skin image data of the face is obtained, and when the control unit 43 analyzes the skin image data to obtain information about the skin state, the image is not specially processed, etc. If the image of the face is displayed on the display unit 46, it can be displayed in a state where the image is kept. In addition, it can also be formed to target the predetermined range of the user's body in the image data captured by the first imaging means. The part of the user's body other than the mirror image (face) outside the predetermined range of the body mentioned above or the wall behind the user is reflected as a background, to the extent that a third party cannot distinguish the displayed content even if the image is viewed by a third party, The configuration in which the image processing is performed in the control unit can reliably prevent the leakage of the user's personal information that is not related to the acquisition of information on the skin condition such as diagnosis information.

In addition, in the skin state measuring system of the above-mentioned embodiment, it is formed so that the skin image data of the face as the predetermined range of the body obtained by the first imaging unit 41 as the first imaging means, and the image data of the face as the first imaging means. Both of the skin image data of the above-mentioned predetermined parts captured by the second imaging part 42 of the two imaging means are analyzed in the control part 43 to obtain the diagnosis information of the skin state. According to the position of the terminal device included here, the skin image data of the user's predetermined range of the body obtained by the imaging means is used in the control unit only in the aforementioned predetermined area for specifying the image captured by the second imaging means of the terminal device. The position of the part is determined by the image analysis focusing on the skin by the control unit, using only the skin image data of the predetermined part obtained by the second imaging means, and correctly identifying the user's predetermined range of the body. The above-mentioned predetermined part to be imaged by the second imaging means, the acquisition of information on the skin state such as diagnostic information, while ensuring that the state can be performed accurately according to the characteristics of the skin of each part in the predetermined range of the body, while further simplifying the acquisition of information based on each skin image The acquisition process of the information on the skin state by the data control unit suppresses the load on the control unit and speeds up the processing.

1,2,4: Skin condition measurement system 10,20,30,40: terminal device 11,21,31,41: The first camera department 12,22,32,42: The second camera department 13,23,43: control part 14,24: Wireless communication means 16,26,46: display part 17,27,47: Department of Records 19: Conversion lens 35: Terminal device 36: camera device 45: Terminal device 48: The first camera department 49: The second camera department 50: terminal device 51: The first camera department 52: The second camera department 53: Light source for lighting 54: cover part 55: Mirror part 60,61: terminal device 80: mirror surface 90:Server 93: Control Department 97: Department of Records 100: Internet

[ Fig. 1] Fig. 1 is a schematic configuration diagram of a terminal device in a skin condition measurement system according to a first embodiment of the present invention. [ Fig. 2 ] is a block configuration diagram of the skin condition measurement system according to the first embodiment of the present invention. [ Fig. 3] Fig. 3 is an explanatory view showing the installation state of the conversion lens to the second imaging unit in the skin condition measurement system according to the first embodiment of the present invention. [ Fig. 4] Fig. 4 is an explanatory diagram of a display screen of a terminal device immediately before imaging by the first imaging unit in the skin condition measurement system according to the first embodiment of the present invention. [ Fig. 5] Fig. 5 is an explanatory diagram of a display screen of a terminal device immediately before an imaging by the second imaging unit in the skin condition measurement system according to the first embodiment of the present invention. [ Fig. 6 ] is an explanatory diagram of an imaging state by a second imaging unit in the skin condition measurement system according to the first embodiment of the present invention. [ Fig. 7] Fig. 7 is an explanatory view showing a display state of diagnosis information based on skin conditions captured by each imaging unit in the skin condition measurement system according to the first embodiment of the present invention. [FIG. 8] It is an explanatory diagram of the display screen of the terminal device immediately before the imaging of the second imaging unit of the new camera in the skin condition measurement system according to the first embodiment of the present invention. [ Fig. 9 ] It is an explanatory diagram of an imaging state by another terminal device in the skin condition measuring system according to the first embodiment of the present invention. [ Fig. 10 ] is a schematic configuration diagram of a skin condition measurement system according to a second embodiment of the present invention. [ Fig. 11 ] It is an explanatory diagram of the information transmission and reception state between the terminal device and the server in the skin condition measurement system according to the second embodiment of the present invention. [FIG. 12] It is an explanatory diagram of the information transmission and reception state between each terminal device of the user and others and the server in the first other example of the skin condition measurement system according to the second embodiment of the present invention. [ Fig. 13 ] It is an explanatory diagram of an imaging state of another terminal device having a first imaging unit in the second other example of the skin condition measurement system according to the second embodiment of the present invention. [FIG. 14] It is an explanatory diagram of the information transmission and reception state between each terminal device and the server in the second other example of the skin condition measurement system according to the second embodiment of the present invention. [ Fig. 15 ] It is an explanatory diagram of the imaging state by the second imaging unit in the skin condition measuring system according to the third embodiment of the present invention. [FIG. 16] It is an explanatory drawing of the display screen of the terminal device immediately before imaging by each imaging part in another example of the skin condition measurement system which concerns on the 3rd embodiment of this invention. [ Fig. 17 ] is an explanatory diagram of the use state of the terminal device in the skin condition measurement system according to the fourth embodiment of the present invention. [ Fig. 18 ] is a block configuration diagram of a skin condition measurement system according to a fourth embodiment of the present invention. [ Fig. 19 ] is an explanatory diagram of the imaging state by each imaging unit in the skin condition measuring system according to the fourth embodiment of the present invention. [ Fig. 20 ] It is an explanatory diagram of an imaging state by another terminal device in the skin condition measurement system according to the fourth embodiment of the present invention.

10: Terminal device

11: The first camera department

12: The second camera department

Claims (15)

A skin condition measurement system is characterized by: have: The first photographing means can photograph the skin of the predetermined range of the user's body; The second imaging means is capable of imaging a predetermined part of the user's skin that is narrower than the predetermined range of the aforementioned body; and The control unit obtains the information about the skin state based on the skin image data of the predetermined area of the body obtained by the imaging of the first imaging means and the skin image data of the predetermined part of the body obtained by the imaging of the second imaging means . The skin state measurement system according to claim 1, wherein the second imaging means takes an image of a predetermined part of the skin overlapping with the predetermined range of the body. The skin state measurement system according to claim 1, wherein the second imaging means takes an image of a predetermined part of the skin that does not overlap with the predetermined range of the body. The skin condition measurement system according to claim 2 or claim 3, wherein the imaging of the predetermined range of the body by the first imaging means and the imaging of the predetermined part of the skin by the second imaging means, be executed at different timings. The skin state measurement system according to claim 4, wherein the first imaging means and the second imaging means are arranged in a predetermined terminal device. The skin condition measurement system according to claim 5, wherein the first imaging means is configured to switch between the state of imaging the skin of the predetermined range of the body and the state of imaging the predetermined part, and also serves as the second imaging means. The skin state measurement system according to claim 4, wherein the first imaging means is a predetermined imaging device that is used as a part of the user's terminal device, or connected to the user's terminal device, and captures images of at least the predetermined range of the user's body. , and the image data obtained in the camera can be transmitted to other terminal devices, Communication is carried out between the terminal device of the aforementioned user and the terminal device of the aforementioned other, and according to the image data of the transmitted user, the portrait of the user including the predetermined range of the aforementioned body is displayed on the terminal device of the other, on the other hand The control unit obtains information about the skin condition based on the skin image data of the predetermined area of the body captured by the first imaging means and the skin image data of the predetermined part of the body obtained by the imaging of the second imaging means. The skin state measurement system according to Claim 4, wherein the first imaging means is a predetermined device that is used as a part of or connected to another terminal device to capture images of at least the predetermined range of the user's body. camera device, The user's image data obtained by the first imaging means is used in another terminal device for purposes other than obtaining information on the user's skin condition, and the control unit uses the first imaging means The skin image data of the predetermined range of the body obtained by imaging and the skin image data of the predetermined part obtained by the imaging of the second imaging means obtain information about the skin condition. The skin condition measurement system according to any one of claim 4 to claim 7, wherein the aforementioned first imaging means is used as a part of the user's terminal device or connected to the user's terminal device to capture at least the aforementioned a predetermined imaging device for imaging a predetermined range of the body, The aforementioned second imaging means can perform imaging by user's operation, The control unit temporarily acquires information about the state of the skin based on the skin image data of the predetermined range of the body captured by the first imaging means, and uses the information to set a predetermined part of the skin to be imaged by the second imaging means. , and inform the user of the set information of the predetermined location through the user's terminal device, After the control unit acquires the skin image data of the predetermined part of the skin along with the imaging of the predetermined part of the skin by the second imaging means, based on the skin image data of the predetermined range of the body and the skin image data of the predetermined part, Re-acquire information about the condition of the skin. The skin state measurement system according to claim 3, wherein the control unit acquires information about the skin state of the predetermined portion of the skin based on the skin image data of the predetermined portion captured by the second imaging means, The information on the skin state is obtained by obtaining information on the relative skin state of each part of the predetermined range of the body based on the information on the skin state of the predetermined part. The skin condition measurement system according to claim 2 or claim 3, wherein the first imaging means captures a mirror image of the predetermined range of the body reflected on the mirror in front of the user, The aforementioned second imaging means takes an image of a predetermined part of the user's skin simultaneously with the imaging by the aforementioned first imaging means, The aforementioned control unit acquires information about the skin according to the skin image data of the predetermined area of the body obtained through the imaging of the mirror image by the first imaging means and the skin image data of the aforementioned predetermined parts obtained through the imaging of the second imaging means. status information. The skin condition measurement system according to claim 11, wherein the aforementioned first imaging means is arranged on one side of the predetermined terminal device, The second imaging means is disposed on the terminal device, and can capture the predetermined part of the user in a state where the first imaging means in the terminal device faces the mirror. The skin condition measurement system according to claim 9, wherein the control unit records the information of the predetermined part of the skin that should be photographed by the second imaging means, and resets the predetermined position of the skin that should be photographed by the second imaging means. For the part, the information about the skin condition temporarily acquired based on the skin image data of the predetermined range of the body is used, and the information of the predetermined part that has been recorded is used, and the part that is not recorded as the predetermined part in the predetermined range of the body is used. , set the aforementioned predetermined location. The skin condition measurement system according to claim 13, wherein the control unit, together with the information of the predetermined part of the skin to be photographed by the second imaging means, uses the skin imaged by the second imaging means as the predetermined part. The portrait data can be recorded by identifying the date and time when the skin portrait data was obtained, The aforementioned control unit sets a predetermined part of the skin that should be photographed by the aforementioned second imaging means in parallel with the new video camera using the aforementioned first imaging means, and refers to the information of the recorded predetermined position and the skin image data, and obtains the date according to the data. The time includes the skin image data of the predetermined part that has been recorded in the past predetermined period corresponding to the metabolic cycle of the user's skin, and the predetermined part of the skin that is set at the part that should be imaged is captured by the second imaging means The obtained skin image data of the predetermined part and the skin image data of the predetermined range of the body are obtained to obtain information about the state of the skin. The skin condition measurement system according to claim 14, wherein the control unit records the information of a predetermined part of the skin to be photographed by the second imaging means, and the information of the predetermined part of the skin obtained by the second imaging means. Among the skin image data of the predetermined part, for each new camera, the recorded skin image data obtained earlier than the aforementioned past predetermined period corresponding to the metabolic cycle of the user's skin, and the skin image data corresponding to the skin are deleted. The information of the aforementioned predetermined location where the recording of the image data is completed.

Images