WO2022114103A1 - Système de mesure d'état de la peau - Google Patents

Système de mesure d'état de la peau Download PDF

Info

Publication number
WO2022114103A1
WO2022114103A1 PCT/JP2021/043331 JP2021043331W WO2022114103A1 WO 2022114103 A1 WO2022114103 A1 WO 2022114103A1 JP 2021043331 W JP2021043331 W JP 2021043331W WO 2022114103 A1 WO2022114103 A1 WO 2022114103A1
Authority
WO
WIPO (PCT)
Prior art keywords
skin condition
skin
measuring device
image
condition measuring
Prior art date
Application number
PCT/JP2021/043331
Other languages
English (en)
Japanese (ja)
Inventor
章 赤松
裕史 助田
和明 青山
邦裕 田端
文恵 楠本
健介 河原
健吾 三浦
龍也 今津
達彦 熱田
Original Assignee
マクセル株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by マクセル株式会社 filed Critical マクセル株式会社
Publication of WO2022114103A1 publication Critical patent/WO2022114103A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y20/00—Information sensed or collected by the things
    • G16Y20/40—Information sensed or collected by the things relating to personal data, e.g. biometric data, records or preferences
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y40/00—IoT characterised by the purpose of the information processing
    • G16Y40/20—Analytics; Diagnosis

Definitions

  • the present invention relates to a skin condition measuring system capable of providing information on a user's skin condition to the user.
  • the user's skin condition is detected by a sensor using a small and inexpensive device that can be used by the user, and the skin condition is diagnosed based on the obtained data, and the diagnosis result is obtained.
  • a system has been proposed in which an electronic treatment is set and executed based on a display or the like or based on a diagnosis result.
  • the conventional system for diagnosing a skin condition or the like has the configuration shown in the above patent document, and the sensor is brought into contact with the user's skin, and the skin in the contact range of the sensor is detected by the sensor.
  • the user can select an appropriate treatment type and its execution time according to his / her skin condition.
  • the detection range of the sensor is small with respect to the area of the skin for which the skin condition is to be grasped, and the skin to be detected by the sensor is limited to a part of the entire area. Since the position where the skin condition is detected by the sensor is not managed as a system, when the detection and diagnosis of the skin condition are repeated at predetermined time intervals such as every day, the sensor is placed in exactly the same place at each opportunity of detection execution by the sensor. There was a problem that it was not always possible to detect the skin condition, and the part detected by the skin sensor might shift, making it impossible to accurately diagnose the skin condition and acquire the changes over time. ..
  • the detection range of the sensor that detects the skin condition is small, it is usually necessary to detect only a part of the skin area for which the skin condition is to be grasped, and the diagnosis based on the detection result is the skin of the entire skin area. Since it does not reflect the condition, it has a problem that it is difficult to ensure the accuracy of the diagnosis.
  • the present invention has been made to solve the above-mentioned problems, and it is possible to accurately repeat the measurement work of the user's skin condition, improve the accuracy of the measurement data related to the skin condition, and appropriately diagnose the skin condition.
  • the purpose is to provide a skin condition measurement system that can be performed.
  • the skin condition measuring system includes a skin condition measuring device capable of measuring a user's skin condition, a predetermined range of the user's body including a part to be measured for the skin condition by the skin condition measuring device, and the measurement.
  • a skin unit is provided, and the recording unit analyzes and detects image data obtained by imaging of the imaging device when measuring the skin condition by the skin condition measuring device as data relating to the skin condition measuring device. It records information about the usage status of the status measuring device.
  • the skin condition measuring device for measuring the skin condition is provided with an imaging device that captures a wider range of the skin together with the skin condition measuring device, and the skin condition obtained by imaging the imaging device is provided.
  • the image including the measuring device is analyzed, information about the usage state of the skin condition measuring device is recorded in the recording unit, and based on the recorded information about the usage state, the skin condition measuring device within a predetermined range of the user's body is used.
  • the skin condition measuring device can be used at another measurement opportunity of the skin condition in the same manner as the usage state of the skin condition measuring device at the previous measurement opportunity. For example, if the skin condition measurement device is positioned in the same way as the previous measurement opportunity and the skin condition is measured, the measurement can be properly managed, such as the correct acquisition of time-series changes in the skin condition, and the skin diagnosis can be performed. The accuracy can be improved, and the work load associated with the alignment of the skin condition measuring device at the time of measurement by the user can be reduced, and the device can be used easily and reasonably.
  • the skin condition measurement system has a display unit capable of displaying at least an image representing a predetermined range of the body of the user, and the body obtained by imaging at least the image pickup device, if necessary.
  • a control unit that causes the display unit to display an image based on image data in a predetermined range is provided, and the control unit has a skin condition recorded in the recording unit when a new skin condition is measured by the skin condition measuring device.
  • Based on the information about the usage state of the measuring device an image relating to the previous usage state of the skin condition measuring device for the measurement target site of the user is acquired, and the image is superimposed on the image representing the predetermined range of the body of the user.
  • the processed image is displayed on the display unit.
  • a display unit for displaying a predetermined range of the body imaged by the imaging device is provided, and the skin condition is based on the information on the usage state of the recorded skin condition measuring device in the recording unit.
  • the previous usage state of the skin condition measuring device is superimposed on the image acquired by the image pickup device and displayed on the display unit, and the previous usage state of the skin condition measuring device is displayed from the image displayed on the display unit.
  • the skin condition measuring system includes a control unit that controls the measurement of the skin condition by the skin condition measuring device, if necessary, and the control unit can be obtained by imaging the imaging device.
  • the usage state of the skin condition measuring device is detected and monitored by analyzing the image data, and the skin condition measuring device included in the information about the usage state of the skin condition measuring device recorded in the recording unit regarding the usage state. If it is determined that the condition matches the previous usage condition, the skin condition measuring device is made to measure the skin condition.
  • a control unit for controlling the measurement execution of the skin condition in the skin condition measuring device is provided, and the skin is based on the information about the usage state of the skin condition measuring device recorded in the recording unit.
  • the control unit determines that the usage state of the skin condition measuring device for the measurement target site at that time matches the previous usage state of the state measuring device, the control unit informs the skin condition measuring device of the skin condition.
  • the measurement is automatically executed when the usage state of the skin condition measuring device matches the previous usage state, and the work related to the measurement by the user is required.
  • the burden can be reduced to the minimum, and the time-series changes of the same part can be reliably acquired by measurement to perform accurate diagnosis of skin condition.
  • the skin condition measuring system includes a control unit that controls the measurement of the skin condition by the skin condition measuring device, if necessary, and the control unit has recorded the skin in the recording unit. Based on the information about the usage state of the condition measuring device, when it is determined that the usage state of the skin condition measuring device with respect to the measurement target range of the user matches the previous predetermined usage state of the skin condition measuring device, the skin condition measuring device is determined. Is intended to perform measurement under the measurement conditions corresponding to the predetermined usage state.
  • the skin condition measuring device is made to measure the skin condition corresponding to the used condition, and the measurement is performed according to the difference in the used condition.
  • the skin condition can be grasped more accurately by the measurement corresponding to the usage condition, such as performing the measurement using the measurement method suitable for each part to be measured, and the accurate diagnosis of the skin condition can be performed for each usage condition. Can be done.
  • the skin condition measuring system 1 also serves as the skin condition measuring device 10 capable of measuring the user's skin condition and the imaging device in which the skin condition measuring device 10 is communicably connected.
  • the terminal device 20 having the recording unit 21, the display unit 22, and the control unit 23.
  • the user who is the target of the skin condition measurement receives a skin condition diagnosis service with a business operator that provides the skin condition measurement system 1 (hereinafter referred to as a provider business operator). Have exchanged. Further, the user can use the skin condition measuring device 10 by purchasing or renting it by himself / herself.
  • the user can receive a skin condition diagnosis using the skin condition measurement system 1, obtain a skin condition diagnosis result by the skin condition measurement system 1, and give advice information according to the diagnosis result as necessary.
  • the provider can acquire data on the user's skin condition, and provides the user with skin care products or skin care services provided by the specified provider (for example, the sponsor of the provider) through advertisements, etc. By recommending, you can enjoy the merit that you can realize the sales promotion effect for these skin care products and skin care services.
  • the skin care product is a product used for skin care, and is, for example, a lotion, a beauty essence, a supplement, a facial cleanser, a facial cleanser, and the like.
  • the skin care service is a service that cares for the skin, and is, for example, an esthetic service.
  • the skin condition measuring device 10 is a kind of camera capable of taking an image of a predetermined part of the user's skin as a measurement of the user's skin condition.
  • the skin condition measuring device 10 has a built-in predetermined light source for lighting, and when imaging, the light source different from the light used as the illumination light in the imaging of the predetermined range of the body by the terminal device 20 as the imaging device.
  • the image is taken on a predetermined part of the user's skin that has been irradiated with light from.
  • the skin condition measuring device 10 includes a substantially cylindrical main body case 11 in which an opening having a size capable of capturing a predetermined number of skin hills is set in a state where the tip portion 11a is in contact with the user's skin.
  • the image pickup element 12 housed in the main body case 11 and converting the light reflected by the user's skin into an electric signal indicating the image data of the skin, and the image pickup element 12 so as to focus on the light reflected from the user's skin. It is configured to include an optical mechanism unit 13 that forms an image so that it can be incident on the image pickup element 12, and a plurality of LEDs 14 and 15 as light sources that irradiate the user's skin with light for illumination from the inside of the main body case 11.
  • the optical mechanism unit 13 includes a light diffusing plate 13a that is arranged adjacent to the LEDs 14 and 15 in the light irradiation direction and diffuses the light of each of the LEDs 14 and 15.
  • the first polarizing plate 13b which is arranged adjacent to the light diffuser plate 13a on the opposite side of the LEDs 14 and 15 to polarize the incident light in a predetermined direction, and the incident light are arranged between the LEDs 14 and 15 and the image pickup element 12.
  • the image pickup element 12 Only the second polarizing plate 13c that polarizes in the direction orthogonal to the polarization direction of the first polarizing plate 23 and the light that is arranged adjacent to the second polarizing plate 13c and reflected by the user's skin are passed to the image pickup element 12. It is configured to include a light-shielding plate 13d.
  • the first polarizing plate 13b is provided with a notch at a position facing a part of the LEDs 14, so that the diffused light derived from these LEDs 14 is unpolarized and guided to the user's skin, while the other LEDs 15 are derived. It guides the diffused light to the user's skin as linearly polarized light in a predetermined direction.
  • the light from the LED 14 is diffused by the light diffusing plate 13a and then irradiated to the user's skin without polarization, and the unpolarized light irradiation detects the texture of the user's skin. Used as lighting for. Further, since the light from the other LED 15 is diffused by the light diffusing plate 13a and then irradiated to the user's skin as linearly polarized light by the first polarizing plate 13b, the light irradiation of this linearly polarized light detects the stain on the user's skin. It is used as lighting for.
  • the reflected light from the user's skin based on two types of light, unpolarized light and linearly polarized light passes through the openings provided in the first polarizing plate 13b and the light diffusing plate 13a, respectively, and is further polarized second.
  • the light passes through the plate 13c, is adjusted by the optical system of the optical mechanism unit 13, and then is incident on the image pickup element 12, the light is converted into an electric signal by the image pickup element 12 and output.
  • a circular polarization filter may be used to irradiate the skin with circularly polarized light.
  • the case of right-handed circular polarization is used for skin texture detection, and the case of left-handed circular polarization is used for skin.
  • the lighting can be set to correspond to each of the stain detection.
  • the color (wavelength) of the light emitted as lighting may be made to correspond to the texture detection and the stain detection of the skin, respectively.
  • the skin condition measuring device 10 may be used for skin color light and stain detection for texture detection. It is also possible to provide a light source capable of irradiating white light as illumination.
  • the skin condition measuring device 10 is a device that images the user's skin as a measurement of the user's skin condition, but is not limited to a device dedicated to skin condition measurement having a built-in light source for lighting as described above, and is not limited to a device equipped with a camera.
  • the device may be, for example, a portable device such as a smartphone having a camera unit, or a device in which a conversion lens suitable for imaging the skin is attached to the camera unit of such a device.
  • the skin condition measuring device is not limited to such a device for imaging the skin, and includes another sensor for measuring the skin condition in place of or in combination with the imaging mechanism. It can also be configured.
  • the skin condition measuring device is a sensor that detects at least one of the moisture content of the user's skin, the oil content of the user's skin, the elasticity of the user's skin, etc. (that is, the moisture meter for the skin, the oil content meter). , Elasticity meter, etc.).
  • the terminal device 20 can image a predetermined range of the user's body including a skin condition measurement target portion by the skin condition measurement device 10 and the skin condition measurement device 10 existing in the vicinity of the measurement target portion. It also has the recording unit 21, the display unit 22, and the control unit 23.
  • the terminal device 20 is connected to the skin condition measuring device 10 capable of measuring the user's skin condition by wire or wirelessly, and when the skin condition measurement (imaging) by the skin condition measuring device 10 is executed, the skin is measured. It is possible to acquire the measurement data of the state.
  • the terminal device 20 is a known portable terminal device such as a mobile phone, a so-called smartphone, or a tablet device having a wireless communication means 24 for connecting to and communicating with an IP communication network, and among these, an application program on the device. And has a (hardware) interface 25 such as USB to which the skin condition measuring device 10 can be connected.
  • the terminal device 20 is provided with a camera unit 26 capable of taking an image of a predetermined range of the user's body and the skin condition measuring device 10, so that the terminal device 20 can function as an image pickup device.
  • the terminal device 20 as an image pickup device is an information processing device that realizes functions and processing as the terminal device 20 by executing a program stored in advance, and is connected to a skin condition measuring device 10 to obtain a skin condition.
  • a skin condition measuring device 10 to obtain a skin condition.
  • the image pickup device incorporates a camera or display behind the mirror portion (half mirror) of another information processing device specialized for a specific application such as beauty, for example, a mirror stand, makeup, or a table mirror for beauty.
  • the terminal device 20 as an image pickup device is a device different from the skin condition measurement device 10 because it captures the user's skin and the skin condition measurement device 10.
  • the image pickup device may be a similar portable device with a camera.
  • This terminal device 20 can analyze image data obtained by imaging and acquire diagnostic information using an application program for skin condition diagnosis, and the user can refer to the obtained diagnostic information.
  • the terminal device 20 can be referred to by displaying the acquired diagnostic information as content on the display unit 22 by executing the application program.
  • the recording unit 21 in the terminal device 20 obtains the data related to the skin condition measuring device 10 as the skin condition measurement data obtained by the measurement by the skin condition measuring device 10, that is, the skin obtained by imaging the skin condition measuring device 10. It is recorded in association with the image data of a predetermined part.
  • the recording unit 21 acquires the image data of the skin by imaging as the skin condition measurement by the skin condition measuring device 10 as the data related to the skin condition measuring device 10, the recording unit 21 takes the image of the terminal device 20 as the imaging device. Information about the usage state of the skin condition measuring device 10 detected by analyzing the obtained image data will be recorded.
  • the display unit 22 is capable of displaying an image representing at least the predetermined range of the body of the user.
  • the display unit 22 in the terminal device 20 is a touch panel type display device, and has a configuration that also serves as an input device.
  • the control unit 23 controls the measurement of the skin condition by the skin condition measuring device 10, and at least an image is displayed on the display unit 22 based on the image data of the predetermined range of the body obtained by the imaging of the terminal device 20 also serving as the imaging device. It is intended to display.
  • the control unit 23 refers to the measurement target portion of the user based on the information about the usage state of the skin condition measuring device recorded in the recording unit 21 at the time of new skin condition measurement by the skin condition measuring device 10. An image related to the previous usage state of the skin condition measuring device is acquired, the image is synthesized so as to be superimposed on the image representing the predetermined range of the user's body, and the processed image is displayed on the display unit 22. ..
  • the control unit 23 detects the usage state of the skin condition measuring device 10 by analyzing the image data obtained by the image pickup of the terminal device 20 received from the terminal device 20, and continuously monitors this. Then, the control unit 23 changes the usage state of the skin condition measuring device 10 to the previous usage state of the skin condition measuring device 10 included in the information about the usage state of the skin condition measuring device 10 recorded in the recording unit 21. If it is determined whether or not they match and it is determined that they match the previous use state, the skin condition measuring device 10 can be made to measure the skin condition.
  • control unit 23 analyzes and detects an image captured and acquired by the terminal device 20 as an image pickup device, and provides information about the usage state of the skin condition measurement device 10 (for example, the position of the skin condition measurement device 10).
  • the usage state (position and orientation) of the skin condition measuring device 10 for measuring the skin condition is adjusted to the previous usage state of the skin condition measuring device displayed on the display unit 22 based on the information on the orientation. It is also possible to give a guidance display by the display unit 22 or a notification related to the guidance by a predetermined notification means.
  • the image (face, etc.) representing the user's body predetermined range displayed on the display unit by the control unit 23 is an image as long as it is based on the image data of the body predetermined range obtained by the imaging of the terminal device 20 also serving as an image pickup device.
  • a simplified image such as computer graphics (CG) may be generated and displayed. ..
  • control unit 23 controls the imaging of the skin condition measuring device 10 based on the information about the usage state of the skin condition measuring device 10 recorded in the recording unit 21, and the user's skin condition with respect to the measurement target range. If it is determined that the usage state of the measuring device 10 matches the previous predetermined usage state of the skin condition measuring device 10, the skin condition measuring device 10 can be made to perform the skin condition measurement corresponding to the predetermined usage state. ..
  • the control unit 23 grasps the position and orientation of the skin condition measuring device 10 as the usage state of the skin condition measuring device 10 corresponding to the part to be imaged, and changes the imaging conditions accordingly. For example, when the skin condition measuring device 10 takes an image of a part of the skin that is easily exposed to sunlight or a part that is easily dried, the skin condition is such that the illumination at the time of imaging by the skin condition measuring device 10 is different from that at the time of imaging of other parts. Controls the measuring device 10. Further, the control unit 23 can also perform diagnostic processing such as image analysis when deriving diagnostic information on the skin condition, which will be described later, by setting different conditions according to the characteristics of each portion.
  • the control unit 23 analyzes the image data of the predetermined portion of the skin acquired by the imaging of the skin condition measuring device 10 and the image data of the predetermined range of the body obtained by the imaging of the terminal device 20, respectively, and the user It has a function to acquire diagnostic information of skin condition. Such a function is realized by the control unit 23 executing a process according to an application program.
  • the control unit 23 evaluates the user's skin based on the image data and obtains an index value indicating the user's skin condition. For example, the control unit 23 determines the skin condition as skin age, fineness of skin texture, degree of skin fairness, degree of skin pore opening, amount of skin stains, and amount of skin content (degree of moisturization). ), At least one of the items such as the amount of oil contained in the skin is evaluated, and the index value indicating the skin condition is obtained from the evaluation result.
  • the control unit 23 obtains an index value indicating the skin condition of the user by performing predetermined image processing on the images taken by the skin condition measuring device 10 and the terminal device 20. For example, the control unit 23 performs edge detection on the captured image, detects the skin groove in the image, identifies the area of the skin hill surrounded by the detected skin groove, and the size of the specified skin hill area. An index value indicating the fineness of the texture of the skin (an index value indicating the skin condition) is obtained as an index value in which the value becomes larger as the uniformity becomes closer to constant. Further, when the skin condition measuring device 10 includes another sensor, the control unit 23 may obtain an index value indicating the user's skin condition based on the signal obtained by the other sensor.
  • the control unit 23 determines as diagnostic information information indicating that the diagnostic result is obtained as an index value indicating the skin condition of the user. Then, the control unit 23 controls so that the acquired diagnostic information can be appropriately displayed on the display unit 22 as the display content of the display unit 22. For example, the control unit 23 can create a graph for some index values indicating the skin condition of the user among the diagnosis results, and display the graph as display content on the display unit 22.
  • control unit 23 receives data including information such as skin condition, skin care action information, skin image, and time when skin imaging is performed on the terminal device 20, and is an index indicating the accepted skin condition.
  • the value, skin care action information, skin image, and skin imaging time information are associated with each other and temporarily stored in the recording unit 21 of the terminal device 20, and the stored index value of the skin condition and the skin imaging are performed. It is also possible to diagnose the user's skin condition based on the information on the time when the above was performed.
  • control unit 23 identifies the transition of the skin condition index value over time based on the skin condition index value stored in the recording unit 21 and the time information when the skin condition measurement is performed. Diagnose whether or not the skin condition has improved based on the identified transitional aspect. For example, the control unit 23 identifies the transition of the index value of the skin condition over time in the period (for example, about 28 days ⁇ 1 day to 7 days) required for the metabolism (turnover) of the user's skin immediately before the treatment. Diagnose skin condition.
  • control unit 23 is designated for a period different from the period required for the user's turnover immediately before processing (for example, a period of a predetermined length immediately before processing (for example, 1 week, 10 days, 1 month, etc.)).
  • the skin condition may be diagnosed by specifying the transition of the index value of the skin condition over time.
  • the control unit 23 gives a diagnosis result that the skin condition of the user has improved.
  • the control unit 23 is a skin care target when the index value of the skin condition does not change in the direction indicating improvement of the skin condition over time (when the index value changes in the direction indicating deterioration or does not change).
  • the control unit 23 may perform a diagnostic process in which attributes such as the age of the user are taken into consideration as the diagnostic process of the skin condition.
  • the control unit 23 controls so that an image including a graph or text showing diagnostic information is appropriately displayed on the display unit 22 of the terminal device 20.
  • the control unit 23 is a transition graph showing the transition of the skin condition, an image group which is a skin image, an action information group showing information on the skin care action corresponding to the skin image, a predetermined skin care product or a skin care service. Control may be performed so that an image including an advertisement showing an advertisement (with a link) is appropriately displayed on the display unit 22.
  • control unit 23 may create a content indicating the diagnosis result as a part of the diagnosis information, and display the content on the display unit 22 so that the content can be referred to by the terminal device 20.
  • the control unit 23 creates content including a bar object showing an index value of the skin condition for each of the degree of moisturization, the degree of pore opening, the degree of whitening, and the skin age (aging), and displays the content on the display unit 22. You may do so.
  • the skin condition measurement target portion by the skin condition measuring device 10 is a main part of the skin of the face (cheeks, eyes, mouth, etc.), and the entire face including these is defined as a predetermined range of the user's body.
  • the terminal device 20 is a smartphone, and by using a camera unit (so-called in-camera) provided on a side of the display unit 22, it can function as an image pickup device, and a skin condition measuring device 10 which is a camera can be connected to the camera unit. It is supposed to be.
  • the skin condition measuring device 10 has a narrower imaging range than the terminal device 20, but can perform imaging with a higher resolution, and images the skin in an extremely narrow range of the face as a measurement of the skin condition.
  • the user In order to measure the skin condition using the terminal device 20 and the skin condition measuring device 10, first, the user connects the skin condition measuring device 10 to the terminal device 20. Subsequently, by the user's operation, when an application program that provides a user interface for using the skin condition measuring device 10 that exists in the terminal device in advance is started on the terminal device 20, the user can use the terminal device 20 to start the application program.
  • the skin condition measuring device 10 can be used for measurement.
  • an application program that provides a user interface for using the skin condition measuring device 10 recorded in advance in the terminal device 20 is operated by the user. It can also be automatically activated without the need to enable the user to use the skin condition measuring device 10 through the terminal device 20.
  • the terminal device 20 executes the image of the face as a predetermined range of the user's body. Specifically, by executing the application program for skin condition measurement in the terminal device 20, the user operates the user interface displayed on the display unit 22, and first, the terminal device 20 as an image pickup device is used. Imaging of the user's face is started, and image data is continuously acquired by the terminal device 20.
  • the face image is displayed on the display unit 22 based on the image data obtained by the image pickup.
  • the terminal device 20 causes the user to maintain a state of supporting the terminal device 20 so that the face is displayed in a predetermined direction and size by a predetermined guidance display or the like by the display unit 22 (see FIG. 4).
  • control unit 23 of the terminal device 20 refers to the recording unit 21 and performs information on the usage state of the skin condition measuring device 10 at the time of the previous skin condition measurement, that is, when the image is taken as the skin condition measurement. It is determined whether or not there is a record of information related to the position and orientation of the skin condition measuring device 10 in the above.
  • the recording unit 21 When the recording unit 21 has a record of information about the previous usage state, an image showing the usage state of the skin condition measuring device 10 based on this information, for example, a predetermined position and orientation indicating the position and orientation of the skin condition measuring device 10.
  • a guide design unit (mark) is generated, a process of synthesizing the image of the face obtained by imaging of the terminal device 20 is performed, and the combined image is displayed on the display unit 22.
  • the user displays the skin condition measuring device 10 while looking at the screen of the display unit 22 showing the image showing his / her face and the usage state (position and orientation of the skin condition measuring device 10) of the previous skin condition measuring device 10.
  • the position is adjusted so as to match the usage state shown in the unit 22 (see FIG. 5).
  • the guide design section showing the position and orientation of the skin condition measuring device 10 is synthesized and displayed as the usage state of the skin condition measuring device 10.
  • information on the usage state of the skin condition measuring device 10 an image showing a position on the face to be imaged according to the position and orientation of the skin condition measuring device 10 is synthesized. It does not matter (see Fig. 6).
  • the control unit 23 of the terminal device 20 analyzes continuously acquired image data to derive information about the current usage state of the skin condition measuring device 10 held by the user, and this usage state is transmitted to the recording unit 21.
  • the skin condition measuring device 10 position and orientation of the skin condition measuring device 10
  • the skin is indicated by the display unit 22 or the like of the terminal device 20 as necessary.
  • An image is taken by the skin condition measuring device 10 on a predetermined part of the skin to which the state measuring device 10 is directed (see FIG. 7).
  • the image pickup by the skin condition measuring device 10 is automatically executed when a match between the used state of the skin condition measuring device 10 and the recorded previous used state is recognized, but the present invention is not limited to this.
  • the skin condition measuring device is made to operate the terminal device 60 by the user who confirms the matching of the used state only by notifying the user of the match between the used state of the skin condition measuring device 10 and the recorded previous used state by notification or the like.
  • the image may be taken at 10.
  • the control unit 23 of the terminal device 20 may use the user's body predetermined range.
  • the user measures the skin condition of the part of the face that is to be measured by the skin condition measuring device 10, that is, the part of the skin that can be imaged by the skin condition measuring device 10 of the face.
  • Guidance display, voice guidance, etc. are executed for the user so that the image can be taken by the device 10.
  • the user can point the skin condition measuring device 10 at an arbitrary part of the face, or take an image while looking at the initial measurement position on the face indicated by the guidance design unit displayed on the display unit 22.
  • the position of the skin condition measuring device 10 is adjusted so as to be.
  • the image data previously obtained by the image pickup by the terminal device 20 is analyzed by the control unit 23 of the terminal device 20, and the user
  • diagnosis of skin condition for example, it is necessary to confirm the presence or absence of stains because a sign such as a stain is found on a part of the skin from this information by deriving the diagnostic information of the skin condition of the face. Therefore, a part that needs to acquire a detailed image by imaging of the skin condition measuring device 10 is identified.
  • the control unit 23 sets the portion indexed in this way at the measurement target position of the skin condition measuring device 10.
  • control unit 23 performs a process of synthesizing a predetermined guide design unit indicating the measurement target position into a face image based on the image data, displays the combined image on the display unit 22, and is displayed by the user. It is also possible to adjust the position of the skin condition measuring device 10 while looking at the portion 22.
  • the control unit 23 of the terminal device 20 analyzes continuously acquired image data to derive information about the current usage state of the skin condition measuring device 10 held by the user, and the user cares from this usage state.
  • the display unit 22 of the terminal device 20 or the like indicates to that effect as necessary.
  • an image is taken by the skin condition measuring device 10 on a predetermined part of the skin to which the skin condition measuring device 10 is directed.
  • the image is directed to the portion of concern to the user, or the above.
  • the user himself / herself recognizes that the skin condition measuring device 10 is positioned so that the initial measurement position can be imaged, or the skin condition measuring device 10 is positioned so that the initial measurement position can be imaged.
  • the display unit 22 of the terminal device 20 or the like indicates that there is a certain effect, the user presses the shutter button of the terminal device 20 or the like to operate the terminal device 20 by himself / herself to perform imaging with the skin condition measuring device 10. You may do so.
  • the skin condition measuring device 10 that has reached the stage of performing image imaging captures the skin surface under a predetermined lighting condition by a built-in light source as skin condition measurement, and outputs image data.
  • This image data is acquired by the terminal device 20 communicated with and connected to the skin condition measuring device 10.
  • the built-in light source capable of adjusting the light to be irradiated as illumination verifies the irradiation state of the light to the part to be imaged, and verifies the skin image obtained by the trial imaging of the skin condition measuring device 10.
  • Each image data of is sent to the terminal device 20 and acquired by the terminal device 20.
  • the control unit 23 acquires and analyzes the image data including the user's face and the skin condition measuring device 10 imaged by the terminal device 20, and uses the skin condition measuring device 10.
  • Information about the state that is, information on the position and orientation of the skin condition measuring device 10 during imaging with respect to the user's face is derived, and this is recorded in the recording unit 21.
  • information on the usage state of the skin condition measuring device 10 information on the imaging conditions of the skin condition measuring device 10, for example, information on the lighting condition by the built-in light source, and the like are also recorded.
  • control unit 23 of the terminal device 20 acquires the image data of the predetermined portion of the skin obtained by the imaging of the skin condition measuring device 10, and then generates an image of the predetermined portion for display based on the image data.
  • the image of the predetermined portion is displayed on the screen of the display unit 22 (see FIG. 8).
  • the control unit 23 of the terminal device 20 displays the image of the face for display based on the image data obtained by the imaging of the terminal device 20 in a predetermined area on the screen of the display unit 22, and at the same time.
  • the image of the predetermined portion is displayed in a region different from the face image on the screen of the display unit 22, and the image of the entire face including the predetermined portion and the image of the predetermined portion are simultaneously displayed in parallel. It can also be displayed, and it is possible to compare each image with respect to the skin condition of the predetermined portion.
  • the face image here is based on the image data obtained by imaging by the terminal device 20 during the imaging of the skin condition measuring device 10, and the face image as the predetermined range of the body on which the skin condition measuring device 10 overlaps.
  • an image can be used, an image of a face on which the skin condition measuring device 10 does not overlap is used based on the image data obtained by imaging by the terminal device 20 before the skin condition measuring device 10 takes an image. Is desirable.
  • the skin condition measuring device 10 displays a non-overlapping face image, it is more desirable to indicate the image pickup position by the skin condition measuring device 10 in the face image based on the information about the usage state.
  • control unit 23 of the terminal device 20 analyzes the image data of the predetermined portion, acquires the diagnostic information of the skin condition of the user, and simultaneously displays the display unit 22 with the skin image or replaces the skin image with the skin image. Display (see FIG. 9). By displaying this diagnostic information, one skin condition measurement by using the skin condition measuring device 10 is completed.
  • the diagnostic information not only the diagnostic information of the skin condition of the predetermined portion based on the imaging by the skin condition measuring device 10 is displayed, but also the skin condition measuring device obtained before the imaging by the skin condition measuring device 10 is displayed.
  • the diagnostic information of the skin condition of the entire face obtained by analyzing the image data of the face as the predetermined range of the body where 10s do not overlap is analyzed in parallel with the diagnostic information of the skin condition of the predetermined portion. It may be displayed on the display unit 22.
  • the user repeats the skin condition measurement by the terminal device 20 and the skin condition measuring device 10 at predetermined measurement intervals.
  • the user connects the skin condition measuring device 10 to the terminal device 20, enables the skin condition measuring device 10 to be used for measurement, and then operates the terminal device 20 to image the user's face on the terminal device 20. Then, the terminal device 20 continuously acquires image data by imaging.
  • the terminal device 20 displays the image of the face on the display unit 22 based on the image data obtained by the imaging, and also displays the information on the usage state of the previous skin condition measuring device 10 recorded on the recording unit 21.
  • An image showing the usage state of the skin condition measuring device 10 is generated based on the reading and information, a process of synthesizing the image with the face image is performed, and the combined image is displayed on the display unit 22.
  • the user adjusts the position of the skin condition measuring device 10 with reference to the display unit 22, and the usage state (position and orientation of the skin condition measuring device 10) of the skin condition measuring device 10 is the skin in the information recorded in the recording unit 21.
  • the control unit 23 of the terminal device 20 causes the skin state measuring device 10 to perform imaging of a predetermined part of the skin.
  • the skin condition measuring device 10 adjusts the lighting condition by the built-in light source based on the information related to the imaging condition among the information about the usage state of the skin condition measuring device 10 recorded in the recording unit 21 of the terminal device 20. After that, imaging is appropriately performed, and the obtained image data is transmitted to the terminal device 20.
  • the control unit 23 of the terminal device 20 displays an image for display based on the image data received from the skin condition measuring device 10 on the display unit 22, analyzes the image data, and acquires diagnostic information on the user's skin condition. Then, this diagnostic information is displayed on the display unit 22, and a series of skin condition measurements are completed.
  • Information about the usage state of the skin condition measuring device 10 is recorded in the recording unit 21, and by using this information to proceed with imaging by the skin condition measuring device 10, the skin condition measuring device 10 can be used as information about the usage state. Based on this, the setting of imaging conditions such as the state of light from the light source is promptly optimized, skin imaging is performed appropriately and smoothly, and the obtained image data also correctly reflects the skin condition. The quality of the diagnostic information derived by analyzing the image data by the control unit 23 of the above can be improved.
  • the skin condition measuring system is a terminal as an imaging device that captures a wider range of the skin together with the skin condition measuring device 10 as opposed to the skin condition measuring device 10 that performs imaging by measuring the skin condition.
  • a device 20 is provided, an image including the skin condition measuring device 10 obtained by imaging of the terminal device 20 is analyzed, information about the usage state of the skin condition measuring device 10 is recorded in the recording unit 21, and the recorded skin is recorded. Since the measurement site by the skin condition measuring device 10 in the user's predetermined range can be correctly identified based on the information of the condition measuring device 10, the measurement result of the skin condition can be used, for example, the diagnosis based on the measured skin condition can be performed. Efficient use can be achieved, such as being able to perform more accurately based on the characteristics of the skin of each part within a predetermined range of the body.
  • the skin condition measuring device 10 can be used at another measurement opportunity of the skin condition in the same manner as the usage state of the skin condition measuring device 10 at the previous measurement opportunity. Therefore, the measurement can be properly managed, such as by repeating the measurement of the skin condition after making the position and orientation of the skin condition measuring device 10 the same as the previous measurement opportunity, and correctly acquiring the time-series change of the skin condition. It is possible to improve the accuracy of skin condition diagnosis, reduce the work load associated with the alignment of the skin condition measuring device 10 at the time of measurement by the user, and use the device easily and reasonably.
  • the skin condition measuring system 1 is connected to a skin condition measuring device 10 capable of imaging a predetermined part of the user's skin and the skin condition measuring device 10 in a communicable manner.
  • the terminal device 30 having the control unit 31 and the display unit 32 is provided.
  • the user who is the target person of the skin condition measurement has entered into a contract to receive the skin condition diagnosis service with the provider of the skin condition measurement system 1 as in the first embodiment. ing. Further, the user can use the skin condition measuring device 10 by purchasing or renting it by himself / herself.
  • the user can obtain the skin condition diagnosis result by the skin condition measurement system 1, and the provider can enjoy the merits such as being able to acquire the data related to the user's skin condition. Become.
  • the skin condition measuring device 10 is a kind of camera capable of taking an image of a predetermined part of the user's skin as a measurement of the user's skin condition, and includes a point of incorporating a predetermined light source for lighting. It has the same device configuration as that shown in the first embodiment, and detailed description thereof will be omitted.
  • the terminal device 30 is capable of imaging a predetermined range of the user's body including a skin image pickup target portion by the skin condition measuring device 10 as the image pickup device, and also has the control unit 31 and the display unit 32. be.
  • the terminal device 30 is connected to the skin condition measuring device 10 capable of imaging a predetermined part of the user's skin in a wired or wireless manner, and when the imaging by the skin condition measuring device 10 is executed, the skin image data is obtained. Can be obtained.
  • the terminal device 30 is a known portable terminal device such as a mobile phone, a so-called smartphone, or a tablet device having a wireless communication means 34 for connecting to and communicating with an IP communication network.
  • the device has a (hardware) interface 35 such as a USB that can execute an application program on the device and can connect the skin condition measuring device 10.
  • the terminal device 30 is provided with a camera unit 36 capable of taking an image of a predetermined range of the user's body and the skin condition measuring device 10, so that the terminal device 30 can function as an image pickup device.
  • the terminal device 30 is an information processing device that realizes functions and processes as the terminal device 30 by executing a program stored in advance, and can measure the skin condition by connecting the skin condition measuring device 10.
  • the device is not limited to the portable device as in the first embodiment, and may be a computer such as a notebook type or a desktop type, or another information processing device specialized for a specific application.
  • the terminal device 30 can analyze image data obtained by imaging and acquire diagnostic information by using an application program for diagnosing a skin condition, and the obtained diagnosis can be obtained. Information can be viewed by the user. In this case, the terminal device 30 can be referred to by displaying the acquired diagnostic information as content on the display unit 32 by executing the application program.
  • the control unit 31 in the terminal device 30 acquires information on the skin condition based on the skin image data obtained by imaging.
  • the control unit 31 is capable of acquiring information on the skin condition of the predetermined range of the body based on the image data of the predetermined range of the body obtained by the imaging of the terminal device 30 also serving as the image pickup device, and the skin condition. It is possible to acquire information on the skin condition of the predetermined portion based on the image data of the predetermined portion of the skin obtained by the imaging of the measuring device 10. Then, the control unit 31 makes available the information regarding the skin condition of the predetermined portion in association with the partial information corresponding to the predetermined portion of the skin among the information regarding the skin condition of the predetermined range of the body. It becomes.
  • control unit 31 acquires an image for displaying the predetermined range of the body derived from the image data of the predetermined range of the body as information regarding the skin condition of the predetermined range of the body, and also acquires the skin state of the predetermined range of the body. As the information regarding the skin, an image for displaying the predetermined portion derived from the image data of the predetermined portion of the skin is acquired.
  • control unit 31 associates the image of the predetermined portion with a part of the information corresponding to the predetermined portion of the skin in the image of the predetermined range of the body, and the image of the predetermined range of the body on the display unit 32. It is possible to display the image of the predetermined portion in parallel with the display of a part or all of the image.
  • control unit 31 acquires diagnostic information of the skin condition of the predetermined body range by analyzing the image data of the predetermined range of the body as other information regarding the skin condition of the predetermined range of the body, and similarly, the predetermined portion.
  • the diagnostic information of the skin condition of the predetermined portion is acquired by analyzing the image data of the predetermined portion of the skin.
  • the function of the control unit 31 to analyze each image data and acquire the diagnostic information of the user's skin condition is realized by the control unit 31 executing the process according to the application program, as described in the first embodiment. It is based on the same mechanism, and detailed description will be omitted.
  • the control unit 31 associates the diagnostic information of the skin condition of the predetermined portion with the partial information corresponding to the predetermined portion of the skin in the diagnostic information of the skin condition of the predetermined range of the body, and the display unit 32 displays.
  • the display unit 32 displays.
  • the partial information corresponding to the predetermined portion of the skin is supplemented or replaced with the partial information of the diagnostic information of the skin condition of the predetermined portion. It will be displayed.
  • control unit 31 corrects a part or all of the image of the predetermined body range derived from the image data of the predetermined range of the body based on the image of the predetermined portion derived from the image data of the predetermined portion. Processing (eg, color calibration) can be performed.
  • control unit 31 sets the skin condition measuring device at a predetermined position on the image to be imaged by the skin condition measuring device 10 with respect to the image of the body predetermined range derived from the image data of the body predetermined range. It is also possible to execute a process of synthesizing a predetermined guide design unit indicating that the image is the position to be imaged of 10, and display the processed image on the display unit 32. As a result, the guide design unit is displayed as a part of the image of the body predetermined range displayed on the display unit 32, and the user visually recognizes the position to be imaged by the skin condition measuring device 10 in the body predetermined range. It becomes understandable.
  • control unit 31 acquires skin condition diagnostic information as information regarding the skin condition of the body predetermined range based on the image data of the body predetermined range obtained by the imaging of the terminal device 30 as the imaging device. Then, from the diagnostic information of the skin condition in the predetermined range of the body, a predetermined part of the skin to be imaged by the skin condition measuring device 10 is selected, and the skin condition measuring device 10 can perform imaging on the predetermined part of the skin. You can also.
  • the display unit 32 is capable of displaying at least an image of the user's predetermined range of the body. More specifically, the display unit 32 executes the display of the image for displaying the predetermined range of the body acquired by the control unit 31 and the image for displaying the predetermined portion, and the predetermined body including the predetermined portion. The diagnostic information of the skin condition in the range will be displayed. Similar to the first embodiment, the display unit 32 is a touch panel type display device and has a configuration that also serves as an input device.
  • the display unit 32 controls the body including the predetermined portion under the control of the control unit 31. While displaying an image of a predetermined range, an image of the predetermined portion having a larger enlargement ratio than the image of the predetermined range of the body is simultaneously and in parallel in an area different from the area on the screen of the display unit 32 on which the image is displayed. It is a mechanism to display.
  • the display unit 32 also includes the predetermined range of the body including the predetermined portion. In the same area as the area on the screen of the display unit 32 in which the image of the predetermined range of the body is displayed by the control of the control unit 31 that receives the operation instruction to magnify and display the predetermined part while displaying the image of the above. It is also possible to enlarge the image of the predetermined range of the body and then switch to the image of the predetermined portion, and continuously display the image of the predetermined portion continuously from the previous image (see FIG. 15).
  • the display of the image of the predetermined part is displayed by the control of the control unit 31 in response to the operation instruction.
  • the image is switched to the image of the predetermined range of the body, and the image of the predetermined range of the body is continuously continued from the previous image to the predetermined range. It may be displayed sequentially centering on the part.
  • the display unit 32 when the display unit 32 is associated with the partial information corresponding to the predetermined portion of the skin in the diagnostic information of the skin condition in the predetermined range of the body, the diagnostic information of the skin condition of the predetermined portion is associated with the display unit 32.
  • the partial information corresponding to the predetermined part of the skin among the diagnostic information of the skin condition in the predetermined range of the body is supplemented with the diagnostic information of the skin condition of the predetermined part.
  • the partial information is replaced with the diagnostic information of the skin condition of the predetermined portion, and the information is displayed.
  • the skin condition measurement target portion by the skin condition measuring device 10 is the main part of the skin of the face, and the entire face including these is defined as the user's body predetermined range.
  • the terminal device 30 is a smartphone, and can be made to function as an image pickup device by using a camera on the display unit side. Further, the skin condition measuring device 10 connected to the terminal device 30 has a narrower imaging range than the terminal device 30, while being capable of imaging at a higher resolution, and images the skin in an extremely narrow range of the face. ..
  • the skin condition measuring device 10 is first connected to the terminal device 30 by the user. ..
  • an application program that provides a user interface for using the skin condition measuring device 10 recorded in advance in the terminal device 30 is operated by the user. It can also be automatically activated without the need to enable the user to use the skin condition measuring device 10 through the terminal device 30.
  • the terminal device 30 executes imaging of the user's face. Specifically, by executing the application program for skin condition measurement in the terminal device 30, the user operates the user interface displayed on the display unit 32, and first, the terminal device 30 as an image pickup device is used. The image of the user's face is executed, and the image data is continuously acquired by the terminal device 30.
  • the face image is displayed on the display unit 32 based on the image data obtained by the image pickup.
  • the terminal device 30 causes the user to maintain a state of supporting the terminal device 30 so that the face is displayed in a predetermined direction and size by a predetermined guidance display or the like by the display unit 32.
  • the terminal storage 30 displays a face image based on the image data obtained by imaging on the display unit 32, and is a part of the face as a predetermined range of the user's body whose skin condition is measured by the skin condition measuring device 10. That is, in the skin portion that can be imaged by the skin condition measuring device 10 of the face, after the user sees the display of the face by the display unit 32, the user uses the skin condition measuring device 10 to target the portion that is concerned about the skin condition. Encourage the user to take an image by executing a guidance display or voice guidance.
  • the control unit 31 of the terminal device 30 analyzes the image data obtained by imaging to derive diagnostic information on the skin condition of the user's face, and from this information, for example, a spot or the like is present on a part of the skin. Find out the part where it is necessary to acquire a detailed image by imaging of the skin condition measuring device 10 for more appropriate diagnosis of the skin condition, such as the need to confirm the presence or absence of spots because the sign of the skin condition is found (see FIG. 11). .. Then, the control unit 31 sets the portion thus indexed to the imaging target position of the skin condition measuring device 10. Then, the control unit 31 performs a process of synthesizing a predetermined guide design unit indicating the image pickup target position into a face image based on the image data, and causes the display unit 32 to display the combined image.
  • the user is concerned about the skin condition of the face by holding the skin condition measuring device 10 in his hand while looking at the screen of the display unit 32 showing his / her face and, if necessary, the guide design unit. Adjust the position so that it faces the part or the position to be imaged indicated by the guide design section.
  • the position to be imaged by the skin condition measuring device 10 is indicated by the guide design section, the part to be imaged by the skin condition measuring device 10 on the face as the predetermined range of the body can be easily understood by the user, and the skin whose position is adjusted by the user can be easily understood. Imaging can be appropriately performed using the state measuring device 10.
  • the control unit 31 of the terminal device 30 analyzes continuously acquired image data to derive information about the current usage state of the skin condition measuring device 10 held by the user, and the user cares from this usage state.
  • the display unit 32 of the terminal device 30 or the like indicates to that effect as necessary.
  • the skin condition measuring device 10 is directed to perform imaging on a predetermined part of the skin to which the skin condition measuring device 10 is directed.
  • the image pickup by the skin condition measuring device 10 is automatically executed when the state in which the skin condition measuring device 10 is positioned is certified, but the present invention is not limited to this, and the image is not limited to this, and the image is not limited to this.
  • the user himself / herself recognizes that the skin condition measuring device 10 is in a positioned state so that the measurement target position can be imaged, or the skin condition measuring device 10 is positioned so that the measurement target position can be imaged.
  • the display unit 32 or the like of the terminal device 30 indicates that the state is in a state
  • the skin condition measuring device 10 that has reached the stage of performing image imaging captures the skin surface under a predetermined lighting condition by a built-in light source as skin condition measurement, and outputs image data.
  • This image data is acquired by the terminal device 30 communicated with and connected to the skin condition measuring device 10.
  • the built-in light source capable of adjusting the light to be irradiated as illumination verifies the irradiation state of the light to the part to be imaged, and verifies the skin image obtained by the trial imaging of the skin condition measuring device 10.
  • Each image data of is sent to the terminal device 30 and acquired by the terminal device 30.
  • the imaging in the skin condition measuring device 10 is different from the light used as the illumination light in the imaging by the terminal device 30, such as natural light, indoor illumination light, and strobe light in the terminal device 30, for a predetermined portion of the user's skin.
  • the image is taken in the state of irradiating the light from the built-in light source, and the image data with different imaging conditions can be acquired by the skin condition measuring device 10 and the terminal device 30. Therefore, it is possible to increase the difference between the images of the skin image affected by the reflection, absorption, and attenuation of the light irradiated as illumination in each layer of the skin between the skin condition measuring device 10 and the terminal device 30, and the skin condition.
  • the skin condition measuring device 10 can perform imaging under conditions suitable for detailed analysis of partial skin condition, improving the accuracy of skin condition diagnosis based on the image data obtained by imaging. Be done.
  • the control unit 31 acquires and analyzes the image data including the user's face and the skin condition measuring device 10 imaged by the terminal device 30, and is in the process of imaging the user's face.
  • Information on the position and orientation of the skin condition measuring device 10 is derived, and this information is recorded in a predetermined recording means, and in association with such information, information related to the imaging conditions of the skin condition measuring device 10 at the time of imaging, for example. It is desirable to record information about the lighting status of the built-in light source in the same manner so that it can be used for later imaging opportunities.
  • the control unit 31 of the terminal device 30 acquires the image data of the predetermined portion of the skin obtained by the imaging of the skin condition measuring device 10, and then generates an image of the predetermined portion for display based on the image data.
  • the control unit 31 associates the image of the predetermined portion with a part corresponding to the predetermined portion in the face image based on the image data obtained by the image pickup of the terminal device 30.
  • the face image here is defined as the predetermined range of the body on which the skin condition measuring device 10 does not overlap, based on the image data obtained by the imaging by the terminal device 30 before the skin condition measuring device 10 takes an image. It is an image of the face.
  • the control unit 31 causes the display unit 32 to display a part or all of the face image associated with the image of the predetermined portion.
  • the display of a part or all of the face image on the display unit 32 can be displayed by setting a desired display range of the face by the control of the control unit 31 based on the user's operation.
  • the range of the face displayed on the display unit 32 includes a part corresponding to the predetermined part. Simultaneously displays an image of the predetermined portion associated with a part corresponding to the predetermined portion in a region different from the region on the screen of the display unit 32 where the image of the face as the predetermined range of the body is displayed. (See FIG. 12).
  • the image of the face as the predetermined range of the body based on the image taken by the terminal device 30 and the image of the predetermined portion based on the image taken by the skin condition measuring device 10 are simultaneously and simultaneously displayed on the display unit 32.
  • the image of the predetermined portion is displayed as a detailed image having a larger enlargement ratio than the face image based on the specifications of the skin condition measuring device 10, and is compared with the face image based on the image captured by the terminal device 30. It is possible to show a more detailed skin condition, and the user can confirm the skin condition from two image displays, and the skin condition can be grasped more accurately and easily.
  • the control unit 31 of the terminal device 30 acquires the image data of the predetermined portion of the skin from the skin condition measuring device 10 and then analyzes the image data to acquire the diagnostic information of the skin condition of the predetermined portion of the skin. do.
  • the control unit 31 uses the diagnostic information about the predetermined part to correspond to the predetermined part in the diagnostic information of the skin condition of the face as the predetermined range of the body based on the image data obtained by the image pickup of the terminal device 30. Associate with department information.
  • the diagnostic information of the skin condition of the face here is the diagnostic information based on the image data obtained by the imaging by the terminal device 30 before the imaging by the skin condition measuring device 10, and the analysis of the image data is performed by the terminal device. It is assumed that the image was taken immediately after the imaging by 30 until the diagnosis information of the skin condition of the predetermined portion was acquired.
  • control unit 31 replaces the diagnostic information of the skin condition of the face associated with the diagnostic information of the skin condition of the predetermined portion with the skin image of the face or the predetermined portion in parallel with the skin image or by replacing the skin image with the display unit 31. It is displayed on 32 (see FIG. 13).
  • the control unit 31 When displaying the skin condition diagnostic information on the display unit 32, the control unit 31 receives some information on the diagnostic information on the skin condition of the face as the predetermined range of the body, which corresponds to the predetermined portion of the skin. By supplementing or replacing this partial information, the diagnostic information of the skin condition of the predetermined portion is displayed.
  • the diagnostic information of the skin condition of the predetermined portion associated with the partial information corresponding to the predetermined portion is displayed so as to supplement or replace the diagnostic information.
  • the diagnostic information For at least the part of the face to be imaged by the skin condition measuring device 10, refer to the diagnostic information from another viewpoint by analyzing the image data derived from the skin condition measuring device 10 to check the skin condition. It enables the user to grasp the skin condition more accurately and easily, such as being able to understand.
  • the display of the diagnostic information on the skin condition of the face on the display unit 32 is not limited to the text-based information display, and the parts and symptoms of the skin to be noted are specifically shown on the face image by a marking image or the like. Information can also be provided. For example, the position and size of hidden stains derived as diagnostic information analyzed from the fine image data obtained by the skin condition measuring device 10 can be indicated by a predetermined color mark superimposed on the corresponding portion on the face image. It can be used as reference information when performing skin care such as stain prevention (see Fig. 14). By displaying such diagnostic information, one skin condition measurement by using the skin condition measuring device 10 is completed.
  • the user can change the skin condition on the face. It is possible to grasp the transition of the skin condition in more detail in the predetermined portion. Then, the terminal device 30 records an image of the face for display on the display unit 32 and the image of the predetermined portion based on the image data obtained by repeated imaging in the recording unit of the terminal device 30 for each imaging, and is necessary. It is also possible to display the images in a list in chronological order according to the situation, or to switch and display the images in chronological order, which is preferable because the user can easily grasp the change in the skin.
  • the skin condition measuring device 10 captures the image data of the face obtained by the imaging of the terminal device 30, which is the basis of the display image of the face as the predetermined range of the body and the diagnostic information of the skin condition.
  • the image data is obtained by imaging with the previous terminal device 30, but instead of this, after the control unit 31 of the terminal device 30 acquires the image data of the predetermined portion of the skin from the skin condition measuring device 10, the said After performing image correction processing of the face image data based on the image data of the predetermined part, a face image for display based on the corrected face image data is generated, and the face image is displayed. It may be displayed on 32, or the corrected face image data may be analyzed to acquire diagnostic information on the skin condition of the face.
  • image correction processing is performed on the image data in the predetermined range of the body based on the image data of the predetermined portion based on the imaging of the skin condition measuring device 10, which makes it easy to adjust the imaging conditions by limiting the imaging range. Since the color of the skin image in the predetermined range of the body indicated by the image data is matched with that of the skin image in the image data of the predetermined portion, it can be obtained by imaging regardless of the imaging conditions of the terminal device 30. The image data in the predetermined range of the body can be easily analyzed for image display and skin condition diagnosis, and the user can be encouraged to correctly grasp the skin condition.
  • the terminal device 30 captures the face as a predetermined range of the user's body, and the skin condition measuring device 10 captures a predetermined portion of the user's skin. Based on the obtained image data of the face and the image data of the predetermined portion, the control unit 31 acquires an image for display as information on the skin condition and diagnostic information on the skin condition, and images the skin condition 30.
  • the image of the predetermined portion and the skin condition based on the image taken by the skin condition measuring device 10
  • the diagnostic information is associated and a part of the information corresponding to the predetermined part of the skin is to be used
  • the separately acquired image of the predetermined part and the diagnostic information of the skin condition can be used, which is obtained by imaging.
  • the quality of each information about the user's skin condition can be improved, processing such as display and analysis of the skin condition can be performed with high accuracy, and the skin condition diagnosis can be appropriately and efficiently advanced to give the user skin. You can grasp the state more accurately.
  • the skin condition measuring device 10 in the image of the body predetermined range is used.
  • the image of the predetermined part is associated with a part corresponding to the predetermined part obtained by imaging, the image of the predetermined range of the body is simultaneously and simultaneously in a different area from the area on the screen on which the image of the predetermined range is displayed.
  • the image of the predetermined part is displayed in parallel.
  • the image of the predetermined range of the body is displayed on the screen of the display unit 32 under the control of the control unit 31 that receives the operation instruction to magnify and display the predetermined portion of the image.
  • the image of the predetermined area of the body may be enlarged and then switched to the image of the predetermined part, and the image of the predetermined part may be continuously displayed continuously from the previous image.
  • the image of the predetermined part is an enlargement of a part of the image of the predetermined range of the body, and the position of the predetermined part captured by the skin condition measuring device 10 in the predetermined range of the body is impossible. It can be understood without any problems, and care based on the diagnostic information of the skin condition can be surely given to the appropriate position.
  • the skin condition measuring target portion by the skin condition measuring device 10 is set as a main part of the skin of the face, and the entire face including these is set as a predetermined range of the user's body.
  • the image is taken by using the camera unit (so-called in-camera) 36 provided on the side of the display unit 32 in 30, but the image is not limited to this, and as shown in FIGS. 16 to 18, a smartphone is used.
  • a camera unit so-called out-camera
  • a predetermined part of the body away from the head for example, an arm, a leg, a body, etc.
  • the image of the predetermined range of the body based on the image taken by the terminal device 30 is different from the case of the face in the embodiment, and the size of the predetermined area based on the image taken by the skin condition measuring device 10 is constant. Therefore, it is difficult to capture the size from the image, so it is desirable to synthesize an image of the scale showing the dimensional reference value in the image to make it easier to grasp the size.
  • the skin condition measuring system 2 includes the skin condition measuring device 10 and the terminal device 40 also serving as the image pickup device, as in the first embodiment, except that the terminal device is different. While the 40 has the display unit, it has a configuration including the recording unit 91 and the server 90 as the control unit 92, which are arranged so that data communication is possible through the terminal device 40 and the network 100.
  • the user who is the target person of the skin condition measurement has entered into a contract to receive the skin condition diagnosis service with the provider of the skin condition measurement system 2 as in the first embodiment.
  • the skin condition measuring system 2 can obtain the skin condition diagnostic information.
  • the skin condition measuring device 10 is a kind of camera capable of taking an image of a predetermined part of the user's skin as a measurement of the user's skin condition, and includes a point of incorporating a predetermined light source for lighting. It has the same device configuration as that shown in the first embodiment, and detailed description thereof will be omitted.
  • the terminal device 40 can image a predetermined range of the user's body including a skin condition measurement target portion by the skin condition measurement device 10 and the skin condition measurement device 10 existing in the vicinity of the measurement target portion. At the same time, it has the display unit 41.
  • the terminal device 40 is connected to the skin condition measuring device 10 capable of imaging a predetermined part of the user's skin in a wired or wireless manner, and when the imaging by the skin condition measuring device 10 is executed, the skin image data Can be obtained.
  • the terminal device 40 is a known portable terminal device such as a mobile phone, a so-called smartphone, or a tablet device having a wireless communication means 44 for connecting to and communicating with an IP communication network.
  • the device has a (hardware) interface 45 such as a USB that can execute an application program on the device and can connect the skin condition measuring device 10.
  • the terminal device 40 is provided with a camera unit 46 capable of taking an image of a predetermined range of the user's body and the skin condition measuring device 10, so that the terminal device 40 can function as an image pickup device.
  • the terminal device 40 is an information processing device that realizes functions and processing as the terminal device 40 by executing a program stored in advance, is capable of communicating via the network 100, and is a skin condition measuring device. As long as it is possible to measure the skin condition by connecting the 10, the device is not limited to the portable device as in the first embodiment, but is specially applied to a computer such as a notebook type or a desktop type, or a specific application. It does not matter if it is another information processing device that has been converted.
  • the terminal device 40 activates an application program for measurement, images the face of the user as the predetermined range of the body of the user by the terminal device 40 itself which also serves as the image pickup device, acquires image data, and measures the skin condition. 10 is made to take an image of the predetermined portion of the skin as a measurement of the skin condition, image data of the predetermined portion of the skin is acquired from the skin condition measuring device 10, and these image data are transmitted to the server 90.
  • the terminal device 40 performs communication requesting that the diagnostic information acquired by the server 90 can be referred to from the terminal device 40 by executing the application program, and acquires the diagnostic information as content from the responding server 90. It is displayed on the display unit 41.
  • the terminal device 40 may receive and display the diagnostic information data transmitted from the server 90 side or download and display the diagnostic information data so that the diagnostic information can be referred to. ..
  • the terminal device 40 uses the notification function of the measurement application program to notify that the skin condition measuring device 10 is in a state where the skin condition can be measured, or a moving image explaining how to use the skin condition measuring device 10. It is also possible to show how to access the information of the above and make it possible to refer to this information.
  • the display unit 41 is a display device having a display area capable of displaying an image representing at least the predetermined range of the body of the user.
  • the display unit 41 in the terminal device 40 is a touch panel type display device, and has a configuration that also serves as an input device.
  • the server 90 is arranged so that data communication is possible through the terminal device 40 and the network 100, receives the image data acquired by the terminal device 40, acquires an image for display based on the image data, and obtains the image data.
  • the analysis is performed to acquire the diagnostic information of the user's skin condition, the image for display and the diagnostic information are transmitted to the terminal device 40, and the display unit 41 of the terminal device 40 is made to display the image and the diagnostic information, respectively. It is a thing.
  • This server 90 is a computer equipped with a CPU or the like that functions as a server.
  • the function of the server is realized by the computer executing the process according to the recorded program.
  • the server 90 in the present embodiment is not necessarily limited to a computer having a single entity, and a plurality of computer devices are connected to a network and cooperate to provide one or a plurality of required services as a unit.
  • a group of devices to be used or although it is only a part of the function of a computer device, it has a function of providing one or more required services as if it were one device, and the service is provided from the side to be provided.
  • the server 90 controls the recording unit 91 that records data related to the skin condition measuring device 10 in association with the skin condition measurement data obtained by the skin condition measuring device 10 and the skin condition measurement by the skin condition measuring device 10. It is configured to include a control unit 92. In other words, the server 90 realizes the functions of the recording unit 91 and the control unit 92 by executing the processing according to the program by the computer forming the server 90.
  • the recording unit 91 in the server 90 obtains the data related to the skin condition measuring device 10 as the skin condition measurement data obtained by the measurement by the skin condition measuring device 10, that is, the predetermined skin acquired by the imaging of the skin condition measuring device 10. It is recorded in association with the image data of the part.
  • the recording unit 91 acquires the image data of the skin by imaging as the skin condition measurement by the skin condition measuring device 10 as the data related to the skin condition measuring device 10, the image pickup of the terminal device 40 as the imaging device is performed. Information about the usage state of the skin condition measuring device 10 detected by analyzing the obtained image data will be recorded.
  • the control unit 92 controls the measurement of the skin condition by the skin condition measuring device 10, and at least displays the terminal device 40 based on the image data of the predetermined range of the body obtained by the imaging of the terminal device 40 also serving as the imaging device. The image is displayed on the unit 41.
  • the control unit 92 refers to the measurement target portion of the user based on the information about the usage state of the skin condition measuring device 10 recorded in the recording unit 91 at the time of new skin condition measurement by the skin condition measuring device 10.
  • An image relating to the previous usage state of the skin condition measuring device 10 is acquired, and this image is synthesized so as to be superimposed on the image representing the predetermined range of the user's body received from the terminal device 40, and this processed image is superimposed on the terminal device. It will be transmitted to 40 and displayed on the display unit 41 of the terminal device 40.
  • the image representing the user's predetermined body range displayed on the display unit 41 of the terminal device 40 by the control unit 92 is based on the image data of the predetermined body range obtained by the image pickup of the terminal device 40 also serving as an image pickup device.
  • a simplified image such as computer graphics (CG) is generated and displayed. May be good.
  • control unit 92 detects the usage state of the skin condition measuring device 10 by analyzing the image data obtained by the image pickup of the terminal device 40 received from the terminal device 40, and continuously monitors this. Then, the control unit 92 changes the usage state of the skin condition measuring device 10 to the previous usage state of the skin condition measuring device 10 included in the information about the usage state of the skin condition measuring device 10 recorded in the recording unit 91. If it is determined whether or not they match and it is determined that they match the previous use state, the skin condition measuring device 10 can be made to measure the skin condition.
  • control unit 92 has previously used the skin condition measuring device whose usage state of the skin condition measuring device 10 continuously monitored is shown in the image displayed on the display unit 41 of the terminal device 40.
  • information is transmitted to the terminal device 40, and a guidance display on the display unit 41 of the terminal device 40 or a predetermined notification of the terminal device 40 is performed. It is also possible to guide the user by the notification related to the guidance by means.
  • control unit 92 determines that the usage state of the skin condition measuring device 10 that is continuously monitored matches the previous usage state of the skin condition measuring device 10, the control unit 92 records the previous usage state. Based on the information recorded in the unit 91, additional information such as imaging conditions corresponding to the usage state is sent to the skin condition measuring device 10 through the terminal device 40, and the skin condition measuring device 10 performs the skin as in the previous usage state. It is also possible to take an image of.
  • control unit 92 grasps the position and orientation of the skin condition measuring device 10 as the usage state of the skin condition measuring device 10 corresponding to each part to be imaged by the user, and sets the imaging conditions accordingly. Control to change. For example, when the skin condition measuring device 10 takes an image of a part of the skin that is easily exposed to sunlight or a part that is easily dried, the lighting state at the time of imaging by the skin condition measuring device 10 is changed from that at the time of imaging of another part.
  • the control unit 92 transmits necessary information to control the skin condition measuring device 10. Further, the control unit 92 can also perform diagnostic processing such as image analysis when deriving diagnostic information on the skin condition by setting different conditions according to the characteristics of each skin portion.
  • the control unit 92 receives the image data of the predetermined portion of the skin acquired by the image pickup of the skin condition measuring device 10 received from the terminal device 40, and the image data of the predetermined range of the body obtained by the image pickup of the terminal device 40. It is equipped with a function to acquire diagnostic information on the user's skin condition by analyzing each of them.
  • the function of the control unit 92 to analyze each image data and acquire the diagnostic information of the user's skin condition is the same as that of the first embodiment except that the server 90 is the main body that executes the process according to the application program. It is based on the same mechanism, and detailed description will be omitted.
  • the skin condition measurement target portion by the skin condition measuring device 10 is the main part of the skin of the face, and the entire face including these is defined as the user's body predetermined range.
  • the terminal device 40 is a smartphone, and by using a camera on the display unit side, it can function as an image pickup device and can communicate with the server 90 through the network 100. Further, the skin condition measuring device 10 connected to the terminal device 40 has a narrower imaging range than the terminal device 40, while being capable of imaging at a higher resolution, and images the skin in an extremely narrow range of the face. ..
  • the user connects the skin condition measuring device 10 to the terminal device 40. Subsequently, the user operates the terminal device 40 to access a predetermined web page prepared by the skin condition measurement service providing server (for example, the server 90), and the access causes the server to access the predetermined web page.
  • the skin condition measurement service providing server for example, the server 90
  • Online services such as the provided web application can be used on the terminal device 40, and the terminal device 40 activates an application program that provides a user interface for using the skin condition measuring device 10, and the user can use the skin through the terminal device 40.
  • the state measuring device 10 can be used for measuring the skin condition.
  • an application program that provides a user interface for using the skin condition measuring device 10 recorded in the terminal device in advance is started on the terminal device 40, and the terminal device is started.
  • the skin condition measuring device 10 may be made available to the user for skin condition measurement through the 40.
  • the application program that provides the user interface for using the skin condition measuring device 10 recorded in advance in the terminal device 40 is not operated by the user. It can also be automatically activated to enable the user to use the skin condition measuring device 10 through the terminal device 40.
  • the terminal device 40 executes an image of the face as a predetermined range of the user's body.
  • the user interface is displayed on the display unit 41 by executing the application program for measuring the skin condition.
  • the terminal device 40 as the image pickup device starts imaging the user's face, the terminal device 40 continuously acquires the image data, and transmits the image data to the server 90. ..
  • the terminal device 40 causes the display unit 41 to display the image of the face based on the image data obtained by the imaging.
  • the terminal device 40 causes the user to maintain a state of supporting the terminal device 40 so that the face is displayed in a predetermined direction and size by a predetermined guidance display or the like by the display unit 41.
  • the control unit 92 receives the image data from the terminal device 40, refers to the recording unit 91 for the terminal device 40, and uses the skin condition measuring device 10 at the time of the previous skin condition measurement (imaging). That is, whether or not there is a record of information related to the position and orientation of the skin condition measuring device 10 when imaging as a skin condition measurement is performed using the terminal device 40 and the skin condition measuring device 10. Is determined.
  • the control unit 92 uses an image showing the usage state of the skin condition measuring device 10 based on this information, for example. , A predetermined guide design unit (mark) indicating the position and orientation of the skin condition measuring device 10 is generated, and a process of synthesizing the image of the face obtained by imaging of the terminal device 40 is performed, and the combined image is combined. It is transmitted to the terminal device 40 and displayed on the display unit 41 of the terminal device 40.
  • the user displays the skin condition measuring device 10 while looking at the screen of the display unit 41 showing an image showing his / her face and the usage state (position and orientation of the skin condition measuring device 10) of the previous skin condition measuring device 10.
  • the position is appropriately adjusted so as to match the usage state shown in the unit 41.
  • the control unit 92 analyzes the image data continuously acquired by the terminal device 40 and transmitted to the server 90, detects the current usage state of the skin condition measuring device 10 possessed by the user, and uses this. Monitor. When the control unit 92 finds that this usage state matches the previous usage state of the skin condition measuring device 10 (position and orientation of the skin condition measuring device 10) in the information recorded in the recording unit 91, the control unit 92 determines the skin. An instruction to execute imaging by the skin condition measuring device 10 is transmitted to the terminal device 40 with respect to a predetermined part of the skin to which the state measuring device 10 is directed, and imaging by the skin condition measuring device 10 is executed through the terminal device 40.
  • the control unit 92 may use the user's body.
  • the part to be measured for the skin condition by the skin condition measuring device 10 that is, the part of the skin that can be imaged by the skin condition measuring device 10 of the face, and the part that the user cares about is the skin of the user.
  • An instruction for guiding the image to be taken by the state measuring device 10 is transmitted to the terminal device 40, and the terminal device 40 is made to execute a guidance display to the user, a voice guide, and the like.
  • control unit 92 selects in advance a portion of the face as a predetermined range of the body where the skin condition is generally measured, and registers it as an initial measurement position or one of the skins.
  • a predetermined guide design unit indicating a plurality of parts is generated, a process of synthesizing this with a face image obtained by imaging of the terminal device 40 is performed, and the combined image is transmitted to the terminal device 40 to be transmitted to the terminal device 40. Is displayed on the display unit 41 of.
  • the user points the skin condition measuring device 10 to an arbitrary part of the face, or while looking at the initial measurement position on the face indicated by the guidance design unit displayed on the display unit 41 of the terminal device 40.
  • the position of the skin condition measuring device 10 is adjusted so that this can be imaged.
  • the control unit 92 analyzes the image data continuously acquired by the terminal device 40 and transmitted to the server 90, detects the current usage state of the skin condition measuring device 10 possessed by the user, and uses this. Monitor. When it is determined that the skin condition measuring device 10 is positioned from this usage state toward the part of concern by the user or so that the initial measurement position can be imaged, the skin condition measuring device 10 is used. An instruction to execute imaging by the skin condition measuring device 10 is transmitted to the terminal device 40 for a predetermined portion of the directed skin, and imaging by the skin condition measuring device 10 is executed through the terminal device 40.
  • the skin condition measuring device 10 that has reached the stage of performing image imaging captures the skin surface under a predetermined lighting condition by a built-in light source as skin condition measurement, and outputs image data.
  • This image data is acquired by the terminal device 40 communication-connected to the skin condition measuring device 10, and further transmitted from the terminal device 40 to the server 90 (see FIG. 20).
  • the built-in light source capable of adjusting the light to be irradiated as illumination verifies the irradiation state of the light to the part to be imaged, and verifies the skin image obtained by the trial imaging of the skin condition measuring device 10.
  • Each image data of is sent to the terminal device 40, acquired by the terminal device 40, and transmitted from the terminal device 40 to the server 90.
  • the terminal device 40 transmits the image data including the user's face and the skin condition measuring device 10 obtained by the imaging by the terminal device 40 to the server 90.
  • the control unit 92 analyzes the image data including the user's face and the skin condition measuring device 10 received from the terminal device 40, and the information about the usage state of the skin condition measuring device 10, that is, the user's Information on the position and orientation of the skin condition measuring device 10 during imaging with respect to the face is derived, and this is recorded in the recording unit 91 in a form associated with the terminal device 40.
  • the information on the usage state of the skin condition measuring device 10 information on the imaging conditions of the skin condition measuring device 10, for example, information on the lighting condition by the built-in light source, and the like are also recorded.
  • the control unit 92 receives the image data of the predetermined portion of the skin obtained by the imaging of the skin condition measuring device 10 from the terminal device 40, acquires the image data, and then displays the image data based on the image data. Generate an image of a predetermined part. Subsequently, the control unit 92 transmits the information of the image of the predetermined portion to the terminal device 40 (see FIG. 20), and displays the image of the predetermined portion on the screen of the display unit 41 of the terminal device 40.
  • control unit 92 transmits the image information of the face for display based on the image data obtained by the image pickup of the terminal device 40 to the terminal device 40 together with the image information of the predetermined portion, and the image of the face. Is displayed in a predetermined area on the screen of the display unit 41 of the terminal device 40, and at the same time, the image of the predetermined portion is displayed in a region different from the face image on the screen of the display unit 41. It is also possible to simultaneously display an image of the entire face including the predetermined portion and an image of the predetermined portion in parallel, and it is possible to compare each image with respect to the skin condition of the predetermined portion.
  • the face image here is based on the image data obtained by imaging by the terminal device 40 during the imaging of the skin condition measuring device 10, and the face image as the predetermined range of the body on which the skin condition measuring device 10 overlaps.
  • an image can be used, an image of a face on which the skin condition measuring device 10 does not overlap is used based on the image data obtained by imaging by the terminal device 40 before the skin condition measuring device 10 takes an image. Is desirable.
  • the skin condition measuring device 10 displays a non-overlapping face image, it is more desirable to indicate the image pickup position by the skin condition measuring device 10 in the face image based on the information about the usage state.
  • the control unit 92 analyzes the image data of the predetermined portion, acquires the diagnostic information of the skin condition of the user, and transmits this diagnostic information to the terminal device 40 (see FIG. 20).
  • the diagnostic information is displayed on the display unit 41 of the terminal device 40 in parallel with the skin image or by replacing the skin image. By displaying and executing this diagnostic information, one skin condition measurement by using the skin condition measuring device 10 is completed.
  • the diagnostic information not only the diagnostic information of the skin condition of the predetermined part based on the image pickup by the skin condition measuring device 10 is acquired and displayed, but also the skin condition measurement obtained before the imaging by the skin condition measuring device 10 is performed.
  • the image data of the face as the predetermined range of the body on which the devices 10 do not overlap is also analyzed by the control unit 92 together with the image data of the predetermined portion, and the diagnostic information of the skin condition of the user is acquired, and the obtained diagnostic information is obtained. May be transmitted to the terminal device 40 to display the diagnostic information on the display unit 41 of the terminal device 40 in parallel with the skin image or by replacing the skin image.
  • the user repeats the skin condition measurement by the terminal device 40 and the skin condition measuring device 10 at predetermined measurement intervals.
  • the user connects the skin condition measuring device 10 to the terminal device 40, enables the skin condition measuring device 10 to be used for measurement, and then operates the terminal device 40 to image the user's face on the terminal device 40. Then, the terminal device 40 continuously acquires the image data by imaging and transmits it to the server 90.
  • the server 90 displays the image of the face on the display unit 41 of the terminal device 40 based on the image data obtained by the imaging, and describes the usage state of the previous skin condition measuring device 10 recorded in the recording unit 91. Is read out, an image showing the usage state of the skin condition measuring device 10 is generated based on the information, a process of synthesizing this with a face image is performed, and the combined image is transmitted to the terminal device 40 to display a unit. Display on 41.
  • the skin condition measurement is repeatedly performed in this way, the information about the usage condition of the skin condition measuring device 10 is recorded in the recording unit 91 and exists, so that the user can use the usage condition based on the information recorded in the recording unit 91.
  • the terminal device 40 can smoothly guide and guide the skin condition measuring device 10 to match.
  • the usage state (position and orientation of the skin condition measuring device 10) of the skin condition measuring device 10 monitored by the server 90 is changed.
  • the control unit 92 sends an instruction to execute imaging by the skin condition measuring device 10 to the terminal device 40, and the terminal device 40 sends the skin condition.
  • An image of a predetermined part of the skin is performed by the measuring device 10.
  • the skin condition measuring device 10 is based on the information related to the imaging condition among the information about the usage state of the skin condition measuring device 10 recorded in the recording unit 91 of the server 90 transmitted from the server 90 to the terminal device 40. After adjusting the lighting conditions of the built-in light source, imaging is appropriately performed, and the obtained image data is transmitted to the terminal device 40. This image data is further transmitted from the terminal device 40 to the server 90.
  • the control unit 92 transmits an image for display based on image data based on the image taken by the skin condition measuring device 10 received from the terminal device 40 to the terminal device 40, and causes the display unit 41 of the terminal device 40 to display the image for display.
  • the image data is analyzed to acquire the diagnostic information of the user's skin condition, and this diagnostic information is transmitted to the terminal device 40 to be displayed on the display unit 41 to complete a series of skin condition measurements.
  • Information about the usage state of the skin condition measuring device 10 is recorded in the recording unit 91 of the server 90, and by using this information to proceed with imaging by the skin condition measuring device 10, the skin condition measuring device 10 can be used. Based on the information in, the setting of imaging conditions such as the light condition from the light source is quickly optimized, the skin is imaged appropriately and smoothly, and the obtained image data also correctly reflects the skin condition. The quality of the diagnostic information derived by analyzing the image data by the control unit 92 can be improved.
  • the skin condition measuring system analyzes the image data of the body predetermined range including the skin condition measuring device 10 obtained by the imaging of the terminal device 40 by the server 90, and the skin condition measuring device 10 is used.
  • Information on the usage state is recorded in the recording unit 91, and based on the recorded information on the usage state of the skin condition measuring device 10, the measurement site by the skin condition measuring device 10 in the user's predetermined range can be correctly identified.
  • the use of the measurement result of the skin condition for example, the diagnosis based on the measured skin condition can be performed more accurately based on the characteristics of the skin for each part of the predetermined range of the body, and the efficient use can be achieved.
  • the skin condition measuring device 10 is used at another measurement opportunity of the skin condition, and the skin condition measuring device 10 is used at the previous measurement opportunity. Since it can be used in the same usage state as the usage state of 10, the skin condition after the usage state of the skin condition measuring device 10, for example, the position and orientation of the skin condition measuring device 10 is the same as the previous measurement opportunity.
  • the measurement can be managed appropriately, the accuracy of the skin diagnosis can be improved, and the alignment of the skin condition measuring device 10 at the time of measurement by the user can be obtained. The work load associated with this can be reduced, and the device can be used easily and reasonably.
  • the skin condition measuring device 10 is configured to be a close-up type camera of a completely different type from the terminal devices 20, 30 and 40 as the imaging device.
  • the present invention is not limited to this, and the skin condition measuring device may be configured to be a device of the same type as the image pickup device (terminal device), for example, a portable device with a camera such as a smartphone.
  • the shape information of characteristic parts such as textures and stains in the image data of the face as a predetermined range of the user's body obtained by imaging with the imaging device, and the predetermined skin portion obtained by imaging with the skin condition measuring device.
  • the imaged position by the skin condition measuring device on the face image can be accurately detected, and the detected position information. It can be used for diagnosing the skin condition and positioning the skin condition measuring device at the time of the next imaging.
  • the shape information of characteristic parts such as textures and spots based on each of these images it is related to the textures and spots included in the previous diagnosis information of the skin condition based on the image data from the skin condition measuring device.
  • the information can also be used as reference information, and the accuracy of position detection can be improved.
  • the skin condition measuring device 10 is a device that locally captures the user's skin as a measurement of the user's skin condition, but the present invention is not limited to this.
  • the condition measuring device can be another skin analysis device such as a moisture sensor that detects the moisture content of the user's skin, an oil content sensor that detects the oil content of the user's skin, and an elasticity sensor that detects the elasticity of the user's skin.
  • a predetermined range of the user's body imaged by the terminal devices 20, 30, 40 as an imaging device is defined as a face, and a predetermined area of the skin imaged by the skin condition measuring device 10 is defined.
  • the part is any part of the skin on the face, but in addition to this, the image pickup device is used to image the user's hair as a predetermined range of the user's body, and the skin condition measurement device is used to image the user's scalp (hair root). It can also be.
  • the skin condition of a specific part of the scalp can be accurately measured for the scalp, and the diagnosis based on the time-series change of the skin condition can be appropriately performed.
  • the target of skin condition measurement using an imaging device and a skin condition measuring device is not limited to humans, and skin condition measurement may be performed on animals such as pets, and the skin of animals may be measured.
  • skin condition measurement for a specific part of the skin can be accurately repeated, and the diagnosis based on the time-series change of the skin condition can be appropriately performed.
  • the skin condition measurement system As a diagnosis of the skin condition, it is assumed that the condition of the bare skin is diagnosed in principle, but the present invention is not limited to this, and the imaging device and the skin condition measurement are not limited to this. As a diagnosis of the skin condition using the device, it is also possible to make a diagnosis on the skin in a makeup state (including the application state of basic cosmetics) in which cosmetics are applied to the skin.
  • diagnostic information in place of or in addition to the information related to the skin condition diagnosis result and the corresponding skin care in the case of bare skin, the quality of the makeup condition by cosmetics and basic cosmetics,
  • diagnostic information such as improvement methods according to cosmetics and basic cosmetics and skin care methods for makeup, it is possible to understand the effects of makeup on the skin by repeatedly measuring the skin condition. , Appropriate measures can be taken.
  • the terminal devices 20, 30, and 40 as the imaging device capture a predetermined range of the user's body, and the skin condition measuring device 10 captures a predetermined portion of the skin.
  • a series of actions related to skin care of the user's face are imaged and recorded using a terminal device, and then the skin condition measuring device is imaged.
  • Diagnostic information on skin condition is derived from image data, and an image showing the contents of skin care (including used beauty equipment and cosmetics) obtained by imaging with a terminal device and diagnostic information are displayed in parallel at the same time for diagnosis. Informed users may be able to evaluate their skin care.
  • a care method for improving the skin condition based on the analysis result of the skin condition for example, a care method different from the imaged previous care, or a point to be improved from the previous care is displayed. It is possible to make a smoother proposal to the user based on the display in the department. Further, at this time, it is also possible to communicate and talk with a counselor or the like on the terminal device to share the skin care contents and diagnostic information, and then allow the user to receive advice (counseling) on the care method. Then, while the user receives advice, the skin condition measuring device may perform imaging to acquire the skin condition at that time, and establish an appropriate care method based on the latest information based on advice and the like. It becomes possible.
  • the terminal devices 20, 30, and 40 as image pickup devices take an image of the skin condition measuring device 10 together with a predetermined range of the user's body, and analyze the obtained image data. Therefore, information on the position and orientation of the skin condition measuring device 10 is derived and recorded as information on the usage state, and the imaging conditions of the skin condition measuring device 10 at the time of imaging are also recorded as information on the usage state.
  • these are used at the time of later skin condition measurement to control the imaging of the skin condition measuring device 10 according to the usage condition, but the present invention is not limited to this, and the skin condition measuring device may be replaced with another. (For example, a shaver, a facial device, etc.) can be used to control these other devices according to the usage state of the other devices obtained by imaging with the image pickup device.
  • the output is adjusted for each position by obtaining information about the usage state, for example, information on the position of the device, by analyzing the image data obtained by imaging with the image pickup device. It will be possible to use the equipment appropriately by performing such controls.
  • a device with a camera when applied to a predetermined range of the user's body (for example, a face), the image data of the predetermined part obtained by imaging the device is analyzed to acquire diagnostic information, and the information is displayed. While doing this, a predetermined range of the user's body including such a device is imaged by an image pickup device, and the obtained image data is analyzed to obtain information on the usage state (for example, position and orientation) of the device. It is also possible to perform control suitable for each position of the application target (for example, face) of such a device based on the above.

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Biomedical Technology (AREA)
  • Computing Systems (AREA)
  • Physics & Mathematics (AREA)
  • Tourism & Hospitality (AREA)
  • Public Health (AREA)
  • Economics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Pathology (AREA)
  • Biophysics (AREA)
  • Medical Informatics (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

Ce système de mesure d'état de la peau permet de répéter avec précision des opérations pour mesurer l'état de la peau d'un utilisateur, ce qui permet d'augmenter la précision des données de mesure d'état de la peau et de pouvoir diagnostiquer de manière appropriée l'état de la peau. Un dispositif de mesure d'état de la peau (10) pour mesurer l'état de la peau comprend un dispositif d'imagerie qui capture une image du dispositif de mesure d'état de la peau (10) conjointement avec une plage plus large de la peau. En analysant une image comprenant le dispositif de mesure d'état de la peau (10) capturée par le dispositif d'imagerie et en enregistrant des informations prédéfinies indiquant l'état d'utilisation du dispositif de mesure d'état de la peau (10) dans une unité d'enregistrement (21), il est possible de déterminer avec précision la position de mesure du dispositif de mesure d'état de la peau (10) au sein d'une plage prédéfinie du corps de l'utilisateur sur la base des informations enregistrées concernant le dispositif de mesure d'état de la peau (10) ; ainsi, les résultats de mesure d'état de la peau peuvent être utilisés plus efficacement, par exemple, dans la réalisation de diagnostics précis sur la base de l'état mesuré de la peau en tenant compte des propriétés de la peau à chaque position dans la plage prédéfinie du corps.
PCT/JP2021/043331 2020-11-26 2021-11-26 Système de mesure d'état de la peau WO2022114103A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-196063 2020-11-26
JP2020196063A JP2022084298A (ja) 2020-11-26 2020-11-26 肌状態測定システム

Publications (1)

Publication Number Publication Date
WO2022114103A1 true WO2022114103A1 (fr) 2022-06-02

Family

ID=81754391

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/043331 WO2022114103A1 (fr) 2020-11-26 2021-11-26 Système de mesure d'état de la peau

Country Status (2)

Country Link
JP (1) JP2022084298A (fr)
WO (1) WO2022114103A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010284239A (ja) * 2009-06-10 2010-12-24 Nikon Corp 肌診断装置
JP2014061057A (ja) * 2012-09-20 2014-04-10 Sony Corp 情報処理装置、情報処理方法、プログラム、及び測定システム
JP2015167673A (ja) * 2014-03-06 2015-09-28 Ｎｅｃプラットフォームズ株式会社 測定支援装置、測定支援方法、測定支援システム、及びプログラム
WO2016076140A1 (fr) * 2014-11-14 2016-05-19 ソニー株式会社 Dispositif de traitement d'informations, procédé de traitement d'informations et programme
JP2018533775A (ja) * 2015-07-17 2018-11-15 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． 被検体に関してモバイルデバイスの位置を決定するためのデバイス及び方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010284239A (ja) * 2009-06-10 2010-12-24 Nikon Corp 肌診断装置
JP2014061057A (ja) * 2012-09-20 2014-04-10 Sony Corp 情報処理装置、情報処理方法、プログラム、及び測定システム
JP2015167673A (ja) * 2014-03-06 2015-09-28 Ｎｅｃプラットフォームズ株式会社 測定支援装置、測定支援方法、測定支援システム、及びプログラム
WO2016076140A1 (fr) * 2014-11-14 2016-05-19 ソニー株式会社 Dispositif de traitement d'informations, procédé de traitement d'informations et programme
JP2018533775A (ja) * 2015-07-17 2018-11-15 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． 被検体に関してモバイルデバイスの位置を決定するためのデバイス及び方法

Also Published As

Publication number Publication date
JP2022084298A (ja) 2022-06-07

Similar Documents

Publication Publication Date Title
JP6518726B2 (ja) 肌状態測定分析情報管理システムおよび肌状態測定分析情報管理方法
US7764303B2 (en) Imaging apparatus and methods for capturing and analyzing digital images of the skin
US10098545B2 (en) Lens information management system for surface condition measurement and analysis and information management method for surface condition measurement and analysis
EP2289413B1 (fr) Système d'imagérie de la peau comprenant une sonde
JP6289837B2 (ja) 肌状態測定分析情報管理システムおよび肌状態測定分析情報管理方法
EP1433418A1 (fr) Méthode et dispositif d'imagerie diagnostique de la peau
US11449997B2 (en) Skin condition measuring module
KR101927286B1 (ko) 무인 안면 및 손등 피부 분석장치
KR20090097904A (ko) 피부 이미징을 위한 시스템, 디바이스 및 방법
JP6404677B2 (ja) 画像処理技術を用いた被検者の肌状態の判定システム
WO2022114104A1 (fr) Système de mesure de l'état de la peau
KR102177070B1 (ko) 피부 맞춤 케어 서비스 중계 시스템 및 이를 이용한 피부 맞춤 케어 방법
JP2013101109A (ja) 照明装置及び画像取得装置
WO2022114103A1 (fr) Système de mesure d'état de la peau
JP2018175909A (ja) 画像処理技術を用いた被検者の肌状態の判定システム
JP6152938B2 (ja) 電子ミラー装置
JP2007130094A (ja) 肌状態解析方法、肌状態解析装置、肌状態解析プログラム、及び該プログラムが記録された記録媒体
JP4230848B2 (ja) 皮膚表面状態評価方法並びにその装置
KR101552853B1 (ko) 원스톱 진단이 가능한 토탈 하이브리드 피부 및 모발 진단방법과 그 장치
WO2022191269A1 (fr) Système de mesure de l'état de la peau
JP2018097899A (ja) 画像処理技術を用いた被検者の肌または頭皮状態の判定システムを用いたビジネス方法
US20040145656A1 (en) Atlas including at least one video sequence
KR102502944B1 (ko) 화장품 사용 및 피부 관리 비대면 컨설팅 시스템
JP7454465B2 (ja) 肌カウンセリングシステム
AU2013201634A1 (en) System, device and method for dermal imaging

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21898075

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21898075

Country of ref document: EP

Kind code of ref document: A1