US11324438B2 - Information processing apparatus, information processing method, and non-transitory computer-readable medium for acquiring and displaying a skin condition analysis result based on an epidermis image - Google Patents
Information processing apparatus, information processing method, and non-transitory computer-readable medium for acquiring and displaying a skin condition analysis result based on an epidermis image Download PDFInfo
- Publication number
- US11324438B2 US11324438B2 US15/303,270 US201515303270A US11324438B2 US 11324438 B2 US11324438 B2 US 11324438B2 US 201515303270 A US201515303270 A US 201515303270A US 11324438 B2 US11324438 B2 US 11324438B2
- Authority
- US
- United States
- Prior art keywords
- analysis result
- skin
- cutis
- display
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/44—Detecting, measuring or recording for evaluating the integumentary system, e.g. skin, hair or nails
- A61B5/441—Skin evaluation, e.g. for skin disorder diagnosis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient; User input means
- A61B5/742—Details of notification to user or communication with user or patient; User input means using visual displays
- A61B5/743—Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/40—Analysis of texture
- G06T7/49—Analysis of texture based on structural texture description, e.g. using primitives or placement rules
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2576/00—Medical imaging apparatus involving image processing or analysis
- A61B2576/02—Medical imaging apparatus involving image processing or analysis specially adapted for a particular organ or body part
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/107—Measuring physical dimensions, e.g. size of the entire body or parts thereof
- A61B5/1079—Measuring physical dimensions, e.g. size of the entire body or parts thereof using optical or photographic means
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30088—Skin; Dermal
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
Definitions
- the present technology relates to an information processing apparatus, an information processing method, and a program, and particularly, to an information processing apparatus, an information processing method, and a program through which it is possible to intuitively and visually recognize skin conditions.
- Patent Literature 1 technology in which a skin image obtained by capturing human skin is analyzed and skin texture conditions are evaluated is proposed (for example, refer to Patent Literature 1).
- Patent Literature 1 JP 2012-239768A
- Patent Literature 1 When the technology disclosed in Patent Literature 1 is used, it is possible to evaluate skin texture conditions. However, there are demands to intuitively and visually recognize skin conditions.
- the present technology has been made in view of the above-described circumstances and through which it is possible to intuitively and visually recognize skin conditions.
- an information processing apparatus including an acquisition unit configured to acquire a skin condition analysis result based on an epidermis image obtained by capturing skin epidermis, and a display control unit configured to display an analysis result image of a predetermined display form based on the skin condition analysis result on a display unit.
- the display control unit may display the analysis result image of a display form in which cristae cutis blocks adjacent through sulci cutis are differently expressed according to a surface area of cristae cutis.
- the display control unit may perform display such that the cristae cutis blocks are expressed in different colors of a same color family with different shades.
- the display control unit may perform display such that a width of the sulcus cutis is indicated by a type of a line, and a depth of the sulcus cutis is indicated by a color shade.
- the display control unit may perform display such that other skin conditions overlap the cristae cutis blocks that are expressed in different colors of a same color family with different shades.
- the display control unit may perform display such that a distribution of pores further overlaps the cristae cutis blocks that are expressed in different colors of a same color family with different shades.
- the distribution of the pores may be a distribution of clogged pores and a simple clogged pore and an acne risk serving as a cause of acne may be expressed in different colors.
- the display control unit may display the analysis result image of a display form in which cristae cutis blocks having a specific shape are differently expressed according to a shape of cristae cutis.
- the display control unit may display the analysis result image of a display form in which a gradation is applied according to directionality of texture by cristae cutis.
- the display control unit may display the analysis result image of a display form in which a color or a symbol is applied according to directionality of texture by sulci cutis.
- the display control unit may display the analysis result image of a display form according to cross sections of sulci cutis and cristae cutis.
- the display control unit may display the analysis result image of a display form in which at least one of a clogged pore distribution, a pore opening distribution, and a comedo distribution is expressed in a plurality of levels with shades of a same color family.
- a simple clogged pore and an acne risk serving as a cause of acne may be expressed in different colors.
- the display control unit may display information indicating a measurement optimal region that is a region suitable as a target of a skin condition analysis process on a facial surface.
- a recording unit may further be included which is configured to perform matching of the measurement optimal region included in the epidermis image using a skin texture distribution obtained from the skin condition analysis result whenever the user captures the skin epidermis of a face, and record the epidermis image including at least the measurement optimal region in time series.
- the recording unit may record the epidermis image according to settings performed by the user.
- the display control unit may display a message for showing the optimal imaging position from the current imaging position.
- the display control unit may display a distance from the current imaging position to the optimal imaging position.
- the information processing apparatus may be an independent device or an internal block configuring one device.
- An information processing method and a program according to an embodiment of the present technology is an information processing method and a program corresponding to the information processing apparatus according to an embodiment of the present technology described above.
- a skin condition analysis result based on an epidermis image obtained by capturing skin epidermis is acquired, and an analysis result image of a predetermined display form is displayed on a display unit on the basis of the skin condition analysis result.
- FIG. 1 is a diagram showing a configuration of an embodiment of a skin analysis display system to which the present technology is applied.
- FIG. 2 is a diagram showing a functional configuration example of a terminal device.
- FIG. 3 is a flowchart describing a flow of a skin analysis display process performed by a terminal device.
- FIG. 4 is a flowchart describing details of an analysis result image display control process.
- FIG. 5 is a diagram showing analysis result images of display forms according to a surface area of cristae cutis.
- FIG. 6 is a diagram showing a display example of an analysis result image expressed by a display with a shade according to a surface area of the cristae cutis.
- FIG. 7 is a diagram showing analysis result images of display forms according to a shape of the cristae cutis.
- FIG. 8 is a diagram showing analysis result images of display forms according to directionality of texture by the cristae cutis.
- FIG. 9 is a diagram showing analysis result images of display forms according to a width and a depth of sulci cutis.
- FIG. 10 is a diagram showing representation examples of cross sections of sulci cutis.
- FIG. 11 is a diagram showing representation examples of cross sections of cristae cutis.
- FIG. 12 is a diagram showing an analysis result image of a display form according to cross sections of the sulci cutis and the cristae cutis.
- FIG. 13 is a diagram showing analysis result images of display forms according to an analysis result of melanin and redness.
- FIG. 14 is a diagram showing analysis result images of display forms according to a distribution of pores and comedos.
- FIG. 15 is a diagram for describing an overlapping image.
- FIG. 16 is a diagram showing overlapping images of display forms in which skin conditions overlap skin texture conditions.
- FIG. 17 is a diagram showing a display example of an application.
- FIG. 18 is a diagram showing a display example of an application.
- FIG. 19 is a diagram showing a display example for indicating a measurement optimal region.
- FIG. 20 is a diagram showing an example when epidermis images are recorded in time series.
- FIG. 21 is a diagram showing a display example of a message for guiding to an optimal imaging position.
- FIG. 22 is a diagram showing a display example of a message for indicating capturing again.
- FIG. 23 is a diagram showing an analysis result image of another display form.
- FIG. 24 is a diagram showing an analysis result image of another display form.
- FIG. 25 is a diagram showing another configuration of an embodiment of the skin analysis display system to which the present technology is applied.
- FIG. 26 is a diagram showing another configuration of an embodiment of the skin analysis display system to which the present technology is applied.
- FIG. 27 is a diagram showing another configuration of an embodiment of the skin analysis display system to which the present technology is applied.
- FIG. 28 is a diagram showing a configuration example of a computer.
- FIG. 1 is a diagram showing a configuration of an embodiment of a skin analysis display system to which the present technology is applied.
- a skin analysis display system 1 of FIG. 1 presents, to a user, information about an image (hereinafter referred to as an “analysis result image”) of a predetermined display form according to an analysis result of skin conditions of the user.
- the skin analysis display system 1 includes a terminal device 10 and a skin measuring device 20 .
- the terminal device 10 is an electronic device, for example, a dedicated skin analyzer, a personal computer, a mobile communication terminal such as a smartphone, and a tablet type portable information device.
- the skin measuring device 20 is connected to the terminal device 10 through a cable 80 that supports a predetermined standard.
- the skin measuring device 20 includes an imaging device therein.
- the skin measuring device 20 captures (measures) the skin epidermis of the user's face, and provides a captured image obtained as the result (hereinafter referred to as an “epidermis image”) to the terminal device 10 through the cable 80 .
- the skin measuring device 20 preferably includes a manual focus adjustment function, a light source capable of uniformly emitting illumination light toward an entire subject, and a macro lens through which it is possible to perform capturing to the extent that a structure of a skin surface can be recognized.
- the skin measuring device 20 preferably includes an attachment causing the front of a lens to come in close contact with skin such that a focus position is fixed and capturing is performed each time.
- a light blocking function may be provided in the attachment.
- the terminal device 10 and the skin measuring device 20 may be connected by a wire or may be connected through, for example, predetermined wireless communication.
- the captured image is provided to the terminal device 10 from the skin measuring device 20 through the cable 80 .
- the terminal device 10 performs an analysis process in which skin conditions of the user are analyzed based on the captured image from the skin measuring device 20 .
- the terminal device 10 generates an analysis result image based on the analysis result of skin conditions and displays the image on a display unit.
- FIG. 2 is a diagram showing a functional configuration example of the terminal device 10 of FIG. 1 .
- the terminal device 10 includes a captured image acquisition unit 101 , a skin condition analysis unit 102 , an analysis result image display control unit 103 , and a display unit 104 .
- the captured image acquisition unit 101 acquires the captured image obtained by capturing the skin epidermis of the user's face that is provided from the skin measuring device 20 , and provides the image to the skin condition analysis unit 102 .
- the skin condition analysis unit 102 performs an analysis process in which skin conditions of the user are analyzed based on the captured image provided from the captured image acquisition unit 101 .
- the analysis process for example, in the captured image obtained by capturing the skin epidermis of the user's face, an epidermis pattern within the epidermis image formed in the epidermis according to cristae cutis or sulci cutis is detected, and a congenital factor and an acquired factor among factors indicating skin texture conditions are analyzed based on the detection result and the epidermis image. Then, skin texture conditions of the user are evaluated based on the analysis result of the congenital factor and the acquired factor.
- a skin condition analysis result for example, information about a surface area and a shape of cristae cutis, directionality of texture, a depth of sulci cutis, and cross sections of the sulci cutis and the cristae cutis is obtained.
- the analysis process for example, an analysis process of melanin and redness and an analysis process of a distribution of pores and comedos are performed, and analysis results of the processes may be obtained.
- the skin condition analysis result obtained in this manner is provided to the analysis result image display control unit 103 .
- Patent Literature 1 proposed by the applicant.
- the analysis result image display control unit 103 generates an analysis result image based on the skin condition analysis result obtained by the skin condition analysis unit 102 and displays the image on the display unit 104 including a liquid crystal display (LCD) or the like.
- the display unit 104 is not limited to the liquid crystal display, and the image may be directly displayed on a facial surface of the user through, for example, a projector.
- the analysis result image display control unit 103 includes an analysis result acquisition unit 151 , an analysis result image generation unit 152 , and a display control unit 153 .
- the analysis result acquisition unit 151 acquires the skin condition analysis result provided from the skin condition analysis unit 102 and provides the result to the analysis result image generation unit 152 .
- the analysis result image generation unit 152 generates an analysis result image of a predetermined display form according to the analysis result based on the skin condition analysis result provided from the analysis result acquisition unit 151 , and provides the image to the display control unit 153 .
- the display control unit 153 displays the analysis result image provided from the analysis result image generation unit 152 on the display unit 104 .
- the display control unit 153 displays various pieces of information, for example, a message, on the display unit 104 .
- Step S 101 the captured image acquisition unit 101 acquires the captured image provided from the skin measuring device 20 and provides the image to the skin condition analysis unit 102 .
- the skin condition analysis unit 102 performs an analysis process in which skin conditions of the user are analyzed based on the captured image provided from the captured image acquisition unit 101 .
- the analysis process for example, an epidermis pattern within the epidermis image is detected and at least one of an acquired factor and a congenital factor is analyzed based on the detection result and the epidermis image, and further skin conditions of the user are evaluated based on the analysis result.
- Step S 103 the analysis result image display control unit 103 performs an analysis result image display control process based on the skin condition analysis result provided from the skin condition analysis unit 102 .
- the analysis result image display control process an analysis result image based on the skin condition analysis result obtained by the skin condition analysis unit 102 is displayed on the display unit 104 . Details of the analysis result image display control process will be described below with reference to a flowchart of FIG. 4 .
- the skin analysis display process ends.
- the skin analysis display process has been described above.
- an image of the skin epidermis of the user's face captured by the skin measuring device 20 is analyzed, an analysis result image of a predetermined display form according to the analysis result is generated, and the image is displayed on the display unit 104 .
- Step S 151 the analysis result acquisition unit 151 acquires the skin condition analysis result obtained by the skin condition analysis unit 102 and provides the result to the analysis result image generation unit 152 .
- Step S 152 the analysis result image generation unit 152 generates an analysis result image based on the skin condition analysis result provided from the analysis result acquisition unit 151 , and provides the image to the display control unit 153 .
- Step S 153 the display control unit 153 displays the analysis result image generated in the process of Step S 152 on the display unit 104 .
- the process of Step S 153 ends, the process returns to Step S 103 of FIG. 3 .
- the analysis result image display control process has been described above.
- an analysis result image of a predetermined display form according to the analysis result of the image of the skin epidermis of the user's face is generated, and the analysis result image is displayed on the display unit 104 . Therefore, information obtained from the skin analysis result, for example, fineness of texture and whether the skin is in good condition, is represented according to a predetermined display form (a user interface (UI)), and thus the user can intuitively and visually recognize his or her skin conditions.
- UI user interface
- FIG. 5 is a diagram showing analysis result images of display forms according to a surface area of the cristae cutis.
- a captured image and analysis result images A to D obtained from the captured image are shown.
- the analysis result images A to D a surface area of the cristae cutis obtained by detecting an epidermis pattern within the epidermis image is compared with a predetermined threshold value, and cristae cutis blocks adjacent through the sulci cutis are expressed in a different color from the same color family with a different shade.
- the block of the cristae cutis is classified into three levels according to the surface area, and each level block is expressed in a different color, for example, dark green, light green, or green having an intermediate intensity.
- a block having a large surface area is expressed in a color having a high density
- a block having an intermediate size is expressed in a different color having an intermediate density
- a block having a small size is expressed in a color having a low density. That is, a portion in which blocks expressed in a color having a low density are concentrated indicates that texture is fine. On the other hand, a portion in which blocks expressed in a color having a high density are concentrated indicates that texture is coarse. Therefore, it is possible to intuitively and visually recognize skin texture conditions according to the shade of the color.
- the proportion of the color having a high density is greater than colors having other densities, it indicates that texture is coarse.
- the analysis result image C since blocks expressed in a color having a high density are concentrated and the proportion of such blocks is high, it indicates that texture is coarse.
- colors with a different shade are mixed, it indicates that texture is mixed.
- the analysis result image D shows that blocks expressed in colors having a different shade are mixed and texture is mixed.
- the analysis result image B shows the most ideal texture condition
- the analysis result image C shows the next best texture condition
- the analysis result image D shows a bad texture condition. Since epidermis blocks are expressed in colors having a different shade, it is possible to visually recognize, for example, a shape of texture and a distribution of sizes, at the same time, and it is possible to visually recognize fineness and quality of texture at a glance.
- FIG. 6 shows a display example of an analysis result image expressed by a display with a shade according to a surface area of the cristae cutis.
- the cristae cutis blocks are expressed at different densities of three levels, dark green, light green, and green having an intermediate intensity.
- the skin is considered to have fine texture.
- FIG. 7 is a diagram showing analysis result images of display forms according to a shape of the cristae cutis.
- reference shapes A to D for deciding relative merits of shapes of cristae cutis blocks are determined in advance.
- the triangular shape A and the diamond shape B are ideal shapes
- the concave shape C and the rectangular shape D are nonideal shapes. Therefore, for example, when the cristae cutis block has a small surface area and is formed in the shape A or the shape B, it has a high evaluation value.
- the shapes A to D are examples of the reference shape, and other shapes are used as references that can be classified into an ideal shape and a nonideal shape.
- the shapes may be classified into three or more levels.
- analysis result images E to H obtained from the captured image are shown.
- a surface area of the cristae cutis obtained by detecting an epidermis pattern within the epidermis image is compared with a predetermined threshold value, and the cristae cutis block is classified into three levels according to the surface area.
- a shape of the cristae cutis block is compared with the reference shapes A to D, and it is determined whether the shape of the cristae cutis block is an ideal shape or a nonideal shape.
- a block having a large surface area is expressed in a color having a high density
- a block having an intermediate size is expressed in a color having an intermediate density
- a block having a small size is expressed in a color having a low density.
- Blocks whose shapes are nonideal are expressed in a single achromatic color, for example, black or gray.
- cristae cutis blocks whose shapes are not ideal are also expressed with a shade of three levels according to the surface area.
- colors thereof are different from colors of the cristae cutis blocks having an ideal shape.
- a size of a cristae cutis block having an ideal shape is expressed in a green shade
- a size of a cristae cutis block having a nonideal shape is expressed in a gray shade.
- cristae cutis blocks other than the cristae cutis blocks belonging to ideal shapes such as a triangle and a diamond shape that is, cristae cutis blocks belonging to nonideal shapes such as a concave shape and a rectangular shape are expressed in an achromatic color shade. Therefore, evaluation using a size and a shape of the surface area is visually clarified and it is possible to intuitively and visually recognize skin texture conditions.
- a predetermined pattern is allocated to the reference shapes A to D, and a shape of the cristae cutis may be visually recognized by the pattern. For example, a right downward oblique line pattern can be allocated to the triangular shape A, a vertical stripe pattern can be allocated to the diamond shape B, a polka dot pattern can be allocated to the concave shape C, and a stepwise pattern can be allocated to the rectangular shape D.
- the cristae cutis blocks are expressed with a shade of three levels according to the surface area, and different expression according to a pattern corresponding to the shape is performed. For example, a right downward oblique line pattern is allocated to the shape A, a vertical stripe pattern is allocated to the shape B, a polka dot pattern is allocated to the shape C, and a stepwise pattern is allocated to the shape D. Therefore, a pattern corresponding to the shape is provided to each epidermis block.
- each epidermis block is expressed in a green shade according to the surface area and a pattern corresponding to the shape is provided, evaluation using a size and a shape of the surface area is visually clarified, and it is possible to intuitively and visually recognize skin texture conditions.
- a predetermined pattern is allocated to the reference shapes A to D. Therefore, different expression according to a pattern corresponding to the shape is performed. For example, a right downward oblique line pattern is allocated to the shape A, a vertical stripe pattern is allocated to the shape B, a polka dot pattern is allocated to the shape C, and a stepwise pattern is allocated to the shape D. Therefore, a pattern corresponding to the shape is provided to each epidermis block.
- four colors may be differently expressed according to the shape of the cristae cutis block.
- FIG. 8 is a diagram showing analysis result images of display forms according to directionality of texture by the cristae cutis.
- the cristae cutis and the sulci cutis are differently expressed according to directionality of texture.
- analysis result images I to L obtained from the captured image are shown.
- colors are expressed at different densities of three levels according to the surface area of the cristae cutis obtained by detecting an epidermis pattern within the epidermis image.
- a gradation according to directionality of texture by the cristae cutis is applied to colors expressed at different densities of three levels.
- the analysis result image I when a color shade in a band-like region across a plurality of cristae cutis blocks is differently expressed according to the gradation, directionality of texture by the cristae cutis is represented.
- a degree of directionality of texture at a certain angle is significantly greater than those of other angles, or when the number of cristae cutis belonging to a certain angle is greater than a certain number, a color shade in a band-like region is differently expressed according to the gradation such that the angle is expressed.
- the analysis result image J when a color shade in each cristae cutis block is differently expressed according to the gradation, directionality of texture by the cristae cutis is represented.
- the analysis result image K when sulci cutis G 1 to G 5 at a certain angle among sulci cutis within the epidermis image are colored, directionality of texture by the sulci cutis are displayed in an emphasized manner.
- the sulci cutis G 1 to G 5 at a certain angle are colored in red that is different from colors of the other sulci cutis, it is possible to emphasize directionality of texture.
- an angle of a certain sulcus cutis is indicated by an arrow M and directionality of texture is displayed in an emphasized manner.
- directionality of texture by the sulcus cutis is clarified (emphasized) by a color and a symbol, and it is possible to intuitively and visually recognize skin texture conditions.
- Directionality of texture by the cristae cutis according to the gradation and directionality of texture by the sulcus cutis according to a color, a symbol or the like are used in combination, and these may be included in one analysis result image. In such a combination, directionality of texture is further clarified (emphasized).
- FIG. 9 is a diagram showing analysis result images of display forms according to a depth of the sulci cutis.
- analysis result images M to O are shown.
- a width of the sulcus cutis within the epidermis image is represented by a type of a line (a thickness of a line) indicating the sulcus cutis.
- a thinner width of the line indicates a thinner width of the sulcus cutis
- a thicker width of the line indicates a thicker width of the sulcus cutis.
- a depth of the sulcus cutis within the epidermis image is indicated by a shade of a line indicating the sulcus cutis.
- a lighter shade of the line indicates a shallower depth of the sulcus cutis
- a darker shade of the line indicates a deeper depth of the sulcus cutis.
- a color line such as a red line may be used instead of the black line.
- a line indicating the sulcus cutis is expressed in a color, for example, red, and a depth of the sulcus cutis is expressed according to the shade of the color.
- FIG. 10 is a diagram showing representation examples of cross sections of sulci cutis.
- FIG. 10 shows six representation examples of cross sections of sulci cutis.
- a in FIG. 10 shows cross sections that have acute angles, are shallow, and have regularity.
- B in FIG. 10 shows cross sections that have acute angles but are deep.
- C in FIG. 10 shows cross sections that are deep and spread.
- D in FIG. 10 shows cross sections that have different depths.
- E in FIG. 10 shows cross sections that are smooth and shallow.
- F in FIG. 10 shows cross sections that are depressed.
- FIG. 11 is a diagram showing representation examples of cross sections of cristae cutis.
- FIG. 11 shows five representation examples of cross sections of cristae cutis.
- a in FIG. 11 shows cross sections having different heights.
- B in FIG. 11 shows cross sections having different undulations and cross sectional shapes.
- C in FIG. 11 shows cross sections having different sizes.
- D in FIG. 11 shows cross sections having uneven heights.
- E in FIG. 11 shows cross sections whose boundaries are blurred without sharpness.
- FIG. 12 shows an analysis result image P of a display form according to cross sections of the sulci cutis and the cristae cutis.
- a display form for example, elasticity of texture, comparison with previously measured texture conditions, comparison with ideal texture conditions and the like can be represented.
- cross sections are two-dimensionally represented, other display forms may be used, for example, shapes including cross sections of the sulcus cutis and the cristae cutis are three-dimensionally displayed.
- other display forms may be used, for example, shapes including cross sections of the sulcus cutis and the cristae cutis are three-dimensionally displayed.
- FIG. 13 is a diagram showing analysis result images of display forms according to an analysis result of melanin and redness.
- an analysis result image Q according to an analysis result of melanin, a position (a hatched region in the drawing) of melasma or a mole is expressed in a color (for example, blue) indicating the presence thereof in the epidermis image.
- a position (a hatched region in the drawing) of melasma considered to be caused by a capillary and the like is expressed in a color (for example, red) indicating the presence thereof in the epidermis image.
- the position of the melasma or the mole is clarified in the epidermis image and it is possible to intuitively and visually recognize skin conditions.
- FIG. 14 is a diagram showing analysis result images of display forms according to a distribution of pores and comedos.
- an analysis result image S according to an analysis result of a distribution of clogged pores, positions of a “clogged pore” and an “acne risk” are expressed in a color indicating the presence thereof in the epidermis image.
- clogged pore refers to conditions in which a pore is clogged with sebum, keratin plugs or the like.
- the term “acne risk” refers to conditions in which acne is caused.
- the “clogged pore” and the “acne risk” are expressed in different colors (for example, green and yellow) using such a display form, it is possible to intuitively and visually recognize whether the clogged pore is a simple clogged pore or there is an acne risk.
- a color having noticeable color contrast for example, yellow
- an analysis result image T according to an analysis result of a distribution of pore openings, a position of the pore is expressed in a color (for example, purple) indicating the presence thereof in the epidermis image.
- a pore having a large opening is expressed in a color having a high density.
- a pore having an intermediate size is expressed in a color having an intermediate density.
- a pore having a small size is expressed in a color having a low density.
- a position of a comedo is expressed in a color (for example, pink) indicating the presence thereof in the epidermis image.
- a comedo having a high intensity is expressed in a color having a high density
- a comedo having an intermediate intensity is expressed in a color having an intermediate density
- a comedo having a low intensity is expressed in a color having a low density.
- At least one of skin conditions (b) of a display form according to an analysis result of melanin and redness and skin conditions (c) of a display form according to a distribution of pores and comedos can overlap an analysis result image (a) of a display form according to an analysis result of texture conditions.
- an overlapping image B in which only the skin conditions (b) overlap the analysis result image (a) and an overlapping image C in which only the skin conditions (c) overlap the analysis result image (a) are obtained.
- At least one of the analysis result image Q ( FIG. 13 ) of a display form according to an analysis result of melanin and redness and the analysis result image S ( FIG. 14 ) of a display form according to an analysis result of a distribution of clogged pores can overlap the analysis result image A ( FIG. 5 ) of a display form according to a surface area of the cristae cutis.
- the texture conditions instead of the analysis result image A ( FIG. 5 ), other analysis result images, for example, the analysis result image E ( FIG. 7 ) of a display form according to a shape of the cristae cutis and the analysis result image I ( FIG. 8 ) of a display form according to directionality of texture by the cristae cutis can be used.
- the skin conditions (b) instead of the analysis result image Q ( FIG. 13 ), for example, the analysis result image R ( FIG. 13 ) can be used.
- the skin conditions (c) instead of the analysis result image S ( FIG. 14 ), for example, the analysis result image T ( FIG. 14 ) or the analysis result image U ( FIG. 14 ) can be used.
- the application is installed in the terminal device 10 in advance.
- the application is downloaded from an application server via the Internet and then installed.
- FIG. 17 in addition to the analysis result image of a display form according to a surface area of the cristae cutis, a numeric value (for example, evaluation of texture) and a graph (for example, a texture analysis graph) obtained from the texture analysis result are displayed.
- a numeric value for example, evaluation of texture
- a graph for example, a texture analysis graph
- a numeric value for example, evaluation of pores
- a screen of melasma is displayed in the same manner as a screen of the above-described texture and pore.
- the epidermis image obtained by capturing the measurement optimal region can be analyzed.
- FIG. 19 is a diagram showing a display example for indicating a measurement optimal region.
- frames A, B, and C for indicating a cheek, a mouth, and a forehead serving as measurement optimal regions are displayed.
- the user captures a skin epidermis image of his or her face by the skin measuring device 20 to use such frames A, B, and C as indicators.
- the epidermis image (“initial captured area (ICA)” of FIG. 19 ) captured by the skin measuring device 20 includes a measurement optimal region (“user targeted area (A)” of FIG. 19 ) of the cheek
- an epidermis image including the measurement optimal region is captured.
- Regions surrounded by dotted lines of FIG. 19 indicate measurable acceptable ranges (“acceptable area (AA)” of FIG. 19 ).
- Acceptable area (AA) acceptable area (AA)” of FIG. 19 ).
- FIG. 19 While a schematically illustrated facial surface is shown, an image of the user's face that is actually captured may be displayed.
- a distribution of skin texture is known as information for identifying an individual similarly to a fingerprint. Focusing thereon, matching of the measurement optimal region included in the epidermis image using the distribution of skin texture is performed.
- the epidermis image including at least the measurement optimal region for each user can be recorded in time series.
- the measurement optimal region of the cheek is included in an epidermis image (“initial captured area (ICA)” of FIG. 20 ) that is captured for the first time and an epidermis image (“Mar. 28, 2014 captured area (CA)” of FIG. 20 ) that is captured for the second time, matching of such measurement optimal regions is performed, and thus (the measurement optimal region included in) such epidermis images are recorded in association.
- the skin is measured at predetermined measurement intervals, for example, on a daily basis or a weekly basis, (the measurement optimal region included in) the epidermis images captured at the measurement intervals are recorded in time series.
- a matching process of the measurement optimal region is performed by the skin condition analysis unit 102 , and an epidermis image including at least the measurement optimal region is recorded in a recording unit (not illustrated) included in the skin condition analysis unit 102 .
- the user sets a specific region on the facial surface recorded in the recording unit and an epidermis image corresponding to the region may be recorded in the recording unit.
- a region of dark melasma and moles that can be visually recognized by the user is set to have top priority.
- the analysis result image for example, the analysis result images Q and R
- the analysis result image for example, the analysis result images S and T
- measurement is performed each time in an image-detected region, and the user can visually recognize (set) a specific region to be recorded in the recording unit.
- an imaging position may be guided to include the entire region.
- the skin measuring device 20 displays a message for guiding to an optimal imaging position, and capturing of an epidermis image including the entire measurement optimal region can be supported. That is, when the user captures the skin epidermis of the face, if a current imaging position is outside of the optimal imaging position, the display control unit 153 displays a message for guiding the current imaging position to the optimal imaging position.
- the epidermis image captured by the skin measuring device 20 does not include a target zone such as the optimal measurement region at all, a message indicating the fact is displayed, and it is possible to prompt to capture an epidermis image again.
- a distance from the target zone may be indicated using a schematically captured region as an indicator. That is, when the user captures the skin epidermis of the face, if a current imaging position is outside of the optimal imaging position, the display control unit 153 displays a distance from the current imaging position to the optimal imaging position.
- the skin analysis display system 1 of FIG. 1 has been described to include the terminal device 10 and the skin measuring device 20 , a dedicated server is provided on the Internet and the server may implement some functions of the terminal device 10 .
- a dedicated server is provided on the Internet and the server may implement some functions of the terminal device 10 .
- FIG. 25 to FIG. 27 another configuration of the skin analysis display system will be described with reference to FIG. 25 to FIG. 27 .
- FIG. 25 is a diagram showing another configuration of an embodiment of the skin analysis display system to which the present technology is applied.
- a skin analysis display system 2 includes the terminal device 10 , the skin measuring device 20 , an analysis server 30 , and an application server 40 .
- the terminal device 10 and the skin measuring device 20 are connected through a cable that supports a predetermined standard.
- the terminal device 10 is connected to the analysis server 30 and the application server 40 via the Internet 90 .
- the terminal device 10 accesses the application server 40 via the Internet 90 and downloads an application. While the application is executed, the terminal device 10 transmits the captured image provided from the skin measuring device 20 to the analysis server 30 via the Internet 90 .
- the analysis server 30 performs an analysis process in which skin conditions are analyzed based on the captured image transmitted from the terminal device 10 via the Internet 90 .
- the analysis server 30 transmits the skin condition analysis result obtained in the analysis process to the terminal device 10 via the Internet 90 .
- the terminal device 10 receives and acquires the skin condition analysis result transmitted from the analysis server 30 via the Internet 90 .
- the terminal device 10 generates an analysis result image of a predetermined display form based on the skin condition analysis result acquired from the analysis server 30 and displays the image on the display unit 104 .
- the analysis server 30 After the analysis process in which skin conditions are analyzed is performed, the analysis server 30 generates an analysis result image of a predetermined display form based on the skin condition analysis result obtained in the analysis process and may transmit the image to the terminal device 10 via the Internet 90 . In this case, the terminal device 10 receives the analysis result image transmitted from the analysis server 30 via the Internet 90 and displays the image on the display unit 104 .
- Step S 101 is performed by the terminal device 10
- the processes of Steps S 102 and 103 of FIG. 3 are performed by the analysis server 30 . That is, in this case, the terminal device 10 displays the analysis result image on the display unit 104 under control of the analysis server 30 .
- the skin analysis display system 2 since the analysis process and the like are concentrated at the analysis server 30 , it is possible to reduce a processing load of the terminal device 10 .
- the user can intuitively and visually recognize his or her skin conditions.
- FIG. 26 is a diagram showing another configuration of an embodiment of the skin analysis display system to which the present technology is applied.
- a skin analysis display system 3 of FIG. 26 is different from the skin analysis display system 2 of FIG. 25 in that the skin measuring device 20 is not connected to the terminal device 10 . That is, the terminal device 10 of FIG. 26 does not acquire the captured image from the skin measuring device 20 but acquires the captured image obtained by capturing the skin epidermis of the user's face by the skin measurement unit (not illustrated) included therein. Then, the terminal device 10 transmits the captured image to the analysis server 30 via the Internet 90 and thus displays an analysis result image of a predetermined display form according to the skin condition analysis result obtained by the analysis server 30 .
- the skin analysis display system 3 since the skin measuring device 20 is not connected, but the skin measurement unit included in the terminal device 10 is used, the user can save the time of preparing the skin measuring device 20 . In addition, even in the skin analysis display system 3 , since information obtained from the skin analysis result in a predetermined display form is displayed on the display unit 104 , the user can intuitively and visually recognize his or her skin conditions.
- FIG. 27 is a diagram showing another configuration of an embodiment of a skin analysis display system to which the present technology is applied.
- a skin analysis display system 4 of FIG. 27 is different from the skin analysis display system 3 of FIG. 26 in that the analysis server 30 is not connected to the Internet 90 .
- the terminal device 10 accesses the application server 40 via the Internet 90 , and downloads an application. While the application is executed, the terminal device 10 performs an analysis process in which skin conditions are analyzed based on the captured image that is captured by a skin measurement unit included therein. Then, the terminal device 10 generates an analysis result image of a predetermined display form based on the skin condition analysis result and displays the image on the display unit 104 .
- Steps S 101 to S 103 of FIG. 3 are performed by the terminal device 10 .
- the skin analysis display system 4 since the application is distributed from the application server 40 via the Internet 90 , it is possible to easily support version upgrade of the application.
- the skin analysis display system 4 since the skin measuring device 20 is not connected but the skin measurement unit included in the terminal device 10 is used, the user can save the time of preparing the skin measuring device 20 . Further, even in the skin analysis display system 4 , since information obtained from the skin analysis result in a predetermined display form is displayed on the display unit 104 , the user can intuitively and visually recognize his or her skin conditions.
- the series of processes described above can be executed by hardware but can also be executed by software.
- a program that constructs such software is installed into a computer.
- the expression “computer” includes a computer in which dedicated hardware is incorporated and a general-purpose personal computer or the like that is capable of executing various functions when various programs are installed.
- FIG. 28 is a block diagram showing an example configuration of the hardware of a computer that executes the series of processes described earlier according to a program.
- a CPU Central Processing Unit
- ROM Read Only Memory
- RAM Random Access Memory
- An input/output interface 905 is also connected to the bus 904 .
- An input unit 906 , an output unit 907 , a recording unit 908 , a communication unit 909 , and a drive 910 are connected to the input/output interface 905 .
- the input unit 906 is configured from a keyboard, a mouse, a microphone or the like.
- the output unit 907 configured from a display, a speaker or the like.
- the recording unit 908 is configured from a hard disk, a non-volatile memory or the like.
- the communication unit 909 is configured from a network interface or the like.
- the drive 910 drives a removable medium 911 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory or the like.
- the CPU 901 loads a program stored in the recording unit 908 via the input/output interface 905 and the bus 904 into the RAM 903 and executes the program to carry out the series of processes described earlier.
- the program executed by the computer 900 may be provided by being recorded on the removable medium 911 as a packaged medium or the like.
- the program can also be provided via a wired or wireless transfer medium, such as a local area network, the Internet, or a digital satellite broadcast.
- the program can be installed into the recording unit 908 via the input/output interface 905 . It is also possible to receive the program from a wired or wireless transfer medium using the communication unit 909 and install the program into the recording unit 908 . As another alternative, the program can be installed in advance into the ROM 902 or the recording unit 908 .
- the program executed by the computer 900 may be a program in which processes are carried out in a time series in the order described in this specification or may be a program in which processes are carried out in parallel or at necessary timing, such as when the processes are called.
- the processing step for describing a program causing the computer 900 to perform various kinds of processing is not necessarily processed in time series along the order illustrated as the flowchart, and may include processing performed in parallel or individually (e.g., parallel processing or processing by an object).
- the program may be processed by a single computer or may be dispersively processed by a plurality of computers. Moreover, the program may be transferred to a remote computer and then executed.
- a system has the meaning of a set of a plurality of configured elements (such as an apparatus or a module (part)), and does not take into account whether or not all the configured elements are in the same casing. Therefore, the system may be either a plurality of apparatuses, stored in separate casings and connected through a network, or a plurality of modules within a single casing.
- an embodiment of the disclosure is not limited to the embodiments described above, and various changes and modifications may be made without departing from the scope of the disclosure.
- the present disclosure can adopt a configuration of cloud computing which processes by allocating and connecting one function by a plurality of apparatuses through a network.
- each step described by the above-mentioned flow charts can be executed by one apparatus or by allocating a plurality of apparatuses.
- the plurality of processes included in this one step can be executed by one apparatus or by sharing a plurality of apparatuses.
- present technology may also be configured as below.
- An information processing apparatus including:
- an acquisition unit configured to acquire a skin condition analysis result based on an epidermis image obtained by capturing skin epidermis
- a display control unit configured to display an analysis result image of a predetermined display form based on the skin condition analysis result on a display unit.
- the display control unit displays the analysis result image of a display form in which cristae cutis blocks adjacent through sulci cutis are differently expressed according to a surface area of cristae cutis.
- the display control unit performs display such that the cristae cutis blocks are expressed in different colors of a same color family with different shades.
- the display control unit performs display such that a width of the sulcus cutis is indicated by a type of a line, and a depth of the sulcus cutis is indicated by a color shade.
- the display control unit performs display such that other skin conditions overlap the cristae cutis blocks that are expressed in different colors of a same color family with different shades.
- the display control unit performs display such that a distribution of pores further overlaps the cristae cutis blocks that are expressed in different colors of a same color family with different shades.
- the distribution of the pores is a distribution of clogged pores and a simple clogged pore and an acne risk serving as a cause of acne are expressed in different colors.
- the display control unit displays the analysis result image of a display form in which cristae cutis blocks having a specific shape are differently expressed according to a shape of cristae cutis.
- the display control unit displays the analysis result image of a display form in which a gradation is applied according to directionality of texture by cristae cutis.
- the display control unit displays the analysis result image of a display form in which a color or a symbol is applied according to directionality of texture by sulci cutis.
- the display control unit displays the analysis result image of a display form according to cross sections of sulci cutis and cristae cutis.
- the display control unit displays the analysis result image of a display form in which at least one of a clogged pore distribution, a pore opening distribution, and a comedo distribution is expressed in a plurality of levels with shades of a same color family.
- the display control unit displays information indicating a measurement optimal region that is a region suitable as a target of a skin condition analysis process on a facial surface.
- a recording unit configured to perform matching of the measurement optimal region included in the epidermis image using a skin texture distribution obtained from the skin condition analysis result whenever the user captures the skin epidermis of a face, and record the epidermis image including at least the measurement optimal region in time series.
- the recording unit records the epidermis image according to settings performed by the user.
- the display control unit displays a message for showing the optimal imaging position from the current imaging position.
- the display control unit displays a distance from the current imaging position to the optimal imaging position.
- An information processing method performed by an information processing apparatus including:
- an acquisition unit configured to acquire a skin condition analysis result based on an epidermis image obtained by capturing skin epidermis
- a display control unit configured to display an analysis result image of a predetermined display form based on the skin condition analysis result on a display unit.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Pathology (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Biophysics (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Dermatology (AREA)
- Quality & Reliability (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
Description
- 1, 2, 3, 4 skin analysis display system
- 10 terminal device
- 20 skin measurement unit
- 30 analysis server
- 40 application server
- 90 the Internet
- 101 captured image acquisition unit
- 102 skin condition analysis unit
- 103 analysis result image display control unit
- 104 display unit
- 151 analysis result acquisition unit
- 152 analysis result image generation unit
- 153 display control unit
- 900 computer
- 901 CPU
Claims (16)
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JPJP2014-086916 | 2014-04-18 | ||
| JP2014086916 | 2014-04-18 | ||
| JP2014-086916 | 2014-04-18 | ||
| PCT/JP2015/060925 WO2015159767A1 (en) | 2014-04-18 | 2015-04-08 | Information processing device, information processing method, and program |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US20170119301A1 US20170119301A1 (en) | 2017-05-04 |
| US11324438B2 true US11324438B2 (en) | 2022-05-10 |
Family
ID=54323978
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US15/303,270 Active 2036-10-31 US11324438B2 (en) | 2014-04-18 | 2015-04-08 | Information processing apparatus, information processing method, and non-transitory computer-readable medium for acquiring and displaying a skin condition analysis result based on an epidermis image |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US11324438B2 (en) |
| JP (1) | JPWO2015159767A1 (en) |
| KR (1) | KR102383182B1 (en) |
| CN (1) | CN106163384B (en) |
| TW (1) | TW201540264A (en) |
| WO (1) | WO2015159767A1 (en) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI701018B (en) * | 2015-01-29 | 2020-08-11 | 日商新力股份有限公司 | Information processing device, information processing method, and program |
| JP6380988B2 (en) * | 2015-03-31 | 2018-08-29 | 富士フイルム株式会社 | Skin evaluation apparatus, method and program |
| TWI657799B (en) * | 2016-09-29 | 2019-05-01 | 麗寶大數據股份有限公司 | Electronic device and method for providing skin quality detection information |
| CN109064438A (en) | 2017-06-09 | 2018-12-21 | 丽宝大数据股份有限公司 | Skin state detection method, electronic device and skin state detection system |
| EP3664016B1 (en) * | 2017-08-24 | 2022-06-22 | Huawei Technologies Co., Ltd. | Image detection method and apparatus, and terminal |
| KR102052723B1 (en) * | 2017-11-30 | 2019-12-13 | 주식회사 룰루랩 | portable skin condition measuring device, and the diagnosis and managing system using thereof |
| KR102055881B1 (en) * | 2018-01-09 | 2019-12-13 | 주식회사 룰루랩 | module using skin condition measurement |
| WO2020041030A1 (en) | 2018-08-21 | 2020-02-27 | The Procter & Gamble Company | Methods for identifying pore color |
| KR102268759B1 (en) * | 2019-05-20 | 2021-06-24 | 주식회사 룰루랩 | The device using skin condition measuring and care, and the system comprising thereof |
| WO2021197985A1 (en) * | 2020-04-03 | 2021-10-07 | Koninklijke Philips N.V. | A system for providing guidance |
| EP3903668A1 (en) * | 2020-04-30 | 2021-11-03 | Koninklijke Philips N.V. | A system for providing guidance |
| EP4147199B1 (en) * | 2020-05-08 | 2025-10-29 | The Procter & Gamble Company | Methods for identifying dendritic pores |
| CN112221021B (en) * | 2020-11-02 | 2023-02-07 | 中南大学湘雅三医院 | A dermatology intelligent laser freckle removal control system |
| JPWO2024135313A1 (en) * | 2022-12-19 | 2024-06-27 |
Citations (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08308634A (en) | 1995-05-23 | 1996-11-26 | Pola Chem Ind Inc | Device for evaluating skin |
| US20040146290A1 (en) * | 2001-11-08 | 2004-07-29 | Nikiforos Kollias | Method of taking images of the skin using blue light and the use thereof |
| JP2006305184A (en) | 2005-04-28 | 2006-11-09 | Shiseido Co Ltd | Skin condition analysis method, skin condition analysis apparatus, skin condition analysis program, and recording medium on which the program is recorded |
| EP1875863A1 (en) | 2005-04-28 | 2008-01-09 | Shiseido Company, Limited | Skin state analyzing method, skin state analyzing device, and recording medium on which skin state analyzing program is recorded |
| US20080045818A1 (en) * | 2006-06-29 | 2008-02-21 | Fred Wood | Laser vein contrast enhancer |
| US20090043363A1 (en) * | 2007-06-19 | 2009-02-12 | Astron Clinica Limited | Method and apparatus for measuring skin texture |
| US20120065518A1 (en) * | 2010-09-15 | 2012-03-15 | Schepens Eye Research Institute | Systems and methods for multilayer imaging and retinal injury analysis |
| US20120095350A1 (en) * | 2006-01-10 | 2012-04-19 | Ron Goldman | Three-dimensional imaging of veins |
| US20120300996A1 (en) * | 2011-05-23 | 2012-11-29 | Sony Corporation | Image processing device, image processing method, program, and recording medium |
| US20120307032A1 (en) * | 2011-06-06 | 2012-12-06 | Sony Corporation | Image processing device, image processing method, image processing system, program, and recording medium |
| US20130076858A1 (en) * | 2011-09-26 | 2013-03-28 | Samsung Electronics Co., Ltd. | Method and apparatus for converting 2d content into 3d content |
| US20130120393A1 (en) * | 2009-09-04 | 2013-05-16 | Holger Winnemoeller | Methods and Apparatus for Marker-Based Stylistic Rendering |
| JP2013169291A (en) | 2012-02-20 | 2013-09-02 | Kao Corp | Simulation apparatus and simulation method for epidermal tissues |
| WO2014027522A1 (en) | 2012-08-17 | 2014-02-20 | ソニー株式会社 | Image processing device, image processing method, program, and image processing system |
| US20140100442A1 (en) * | 2012-10-05 | 2014-04-10 | Volcano Corporation | Systems for indicating parameters in an imaging data set and methods of use |
| US20140139656A1 (en) * | 2011-08-01 | 2014-05-22 | Koninklijke Philips N.V. | Device and method for obtaining and processing measurement readings of a living being |
| US20140236019A1 (en) * | 2011-08-14 | 2014-08-21 | Uzi Rahum | Device, system and method for blood vessel imaging and marking |
| US20150373264A1 (en) * | 2013-02-14 | 2015-12-24 | Panasonic Intellectual Property Management Co., Ltd. | Digital mirror apparatus |
| US20160063312A1 (en) * | 2013-03-28 | 2016-03-03 | Shiseido Company, Ltd. | Image analysis apparatus, image analysis method, and image analysis program |
| US20160210764A1 (en) | 2013-08-30 | 2016-07-21 | Sony Corporation | Information processing apparatus, information processing method, and information processing system |
| US20160300094A1 (en) * | 2013-11-12 | 2016-10-13 | Zhejiang Wellcom Technology Co., Ltd. | Skin texture collection and identity recognition method and system |
| US20180263551A1 (en) | 2015-01-29 | 2018-09-20 | Sony Corporation | Information processing apparatus, information processing method, and program |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4230848B2 (en) * | 2003-07-16 | 2009-02-25 | 株式会社肌粧品科学開放研究所 | Skin surface condition evaluation method and apparatus |
| US8094186B2 (en) * | 2004-10-22 | 2012-01-10 | Shiseido Company, Ltd. | Skin condition diagnosis system and beauty counseling system |
| CN1961820B (en) * | 2005-11-08 | 2011-03-16 | 株式会社资生堂 | Skin state analysis method and device |
| TWI471117B (en) * | 2011-04-29 | 2015-02-01 | Nat Applied Res Laboratoires | Human facial skin roughness and wrinkle inspection based on smart phone |
-
2015
- 2015-03-11 TW TW104107810A patent/TW201540264A/en unknown
- 2015-04-08 US US15/303,270 patent/US11324438B2/en active Active
- 2015-04-08 JP JP2016513732A patent/JPWO2015159767A1/en active Pending
- 2015-04-08 CN CN201580019315.3A patent/CN106163384B/en active Active
- 2015-04-08 WO PCT/JP2015/060925 patent/WO2015159767A1/en not_active Ceased
- 2015-04-08 KR KR1020167024596A patent/KR102383182B1/en active Active
Patent Citations (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08308634A (en) | 1995-05-23 | 1996-11-26 | Pola Chem Ind Inc | Device for evaluating skin |
| US20040146290A1 (en) * | 2001-11-08 | 2004-07-29 | Nikiforos Kollias | Method of taking images of the skin using blue light and the use thereof |
| US20090054744A1 (en) | 2005-04-28 | 2009-02-26 | Naomi Kitamura | Skin state analyzing method, skin state analyzing apparatus, and computer-readable medium storing skin state analyzing program |
| EP1875863A1 (en) | 2005-04-28 | 2008-01-09 | Shiseido Company, Limited | Skin state analyzing method, skin state analyzing device, and recording medium on which skin state analyzing program is recorded |
| US20120157821A1 (en) | 2005-04-28 | 2012-06-21 | Shiseido Company, Ltd. | Skin state analyzing method, skin state analyzing apparatus, and computer-readable medium storing skin state analyzing program |
| EP2474264A1 (en) | 2005-04-28 | 2012-07-11 | Shiseido Company, Limited | Skin state analyzing method, skin state analyzing apparatus, and computer-readable medium storing skin state analyzing program |
| JP2006305184A (en) | 2005-04-28 | 2006-11-09 | Shiseido Co Ltd | Skin condition analysis method, skin condition analysis apparatus, skin condition analysis program, and recording medium on which the program is recorded |
| US20120095350A1 (en) * | 2006-01-10 | 2012-04-19 | Ron Goldman | Three-dimensional imaging of veins |
| US20080045818A1 (en) * | 2006-06-29 | 2008-02-21 | Fred Wood | Laser vein contrast enhancer |
| US20090043363A1 (en) * | 2007-06-19 | 2009-02-12 | Astron Clinica Limited | Method and apparatus for measuring skin texture |
| US20130120393A1 (en) * | 2009-09-04 | 2013-05-16 | Holger Winnemoeller | Methods and Apparatus for Marker-Based Stylistic Rendering |
| US20120065518A1 (en) * | 2010-09-15 | 2012-03-15 | Schepens Eye Research Institute | Systems and methods for multilayer imaging and retinal injury analysis |
| US20120300996A1 (en) * | 2011-05-23 | 2012-11-29 | Sony Corporation | Image processing device, image processing method, program, and recording medium |
| JP2012239768A (en) | 2011-05-23 | 2012-12-10 | Sony Corp | Image processing device, image processing method, program, and recording medium |
| US20120307032A1 (en) * | 2011-06-06 | 2012-12-06 | Sony Corporation | Image processing device, image processing method, image processing system, program, and recording medium |
| US20140139656A1 (en) * | 2011-08-01 | 2014-05-22 | Koninklijke Philips N.V. | Device and method for obtaining and processing measurement readings of a living being |
| US20140236019A1 (en) * | 2011-08-14 | 2014-08-21 | Uzi Rahum | Device, system and method for blood vessel imaging and marking |
| US20130076858A1 (en) * | 2011-09-26 | 2013-03-28 | Samsung Electronics Co., Ltd. | Method and apparatus for converting 2d content into 3d content |
| JP2013169291A (en) | 2012-02-20 | 2013-09-02 | Kao Corp | Simulation apparatus and simulation method for epidermal tissues |
| WO2014027522A1 (en) | 2012-08-17 | 2014-02-20 | ソニー株式会社 | Image processing device, image processing method, program, and image processing system |
| US20140100442A1 (en) * | 2012-10-05 | 2014-04-10 | Volcano Corporation | Systems for indicating parameters in an imaging data set and methods of use |
| US20150373264A1 (en) * | 2013-02-14 | 2015-12-24 | Panasonic Intellectual Property Management Co., Ltd. | Digital mirror apparatus |
| US20160063312A1 (en) * | 2013-03-28 | 2016-03-03 | Shiseido Company, Ltd. | Image analysis apparatus, image analysis method, and image analysis program |
| US20160210764A1 (en) | 2013-08-30 | 2016-07-21 | Sony Corporation | Information processing apparatus, information processing method, and information processing system |
| US20160300094A1 (en) * | 2013-11-12 | 2016-10-13 | Zhejiang Wellcom Technology Co., Ltd. | Skin texture collection and identity recognition method and system |
| US20180263551A1 (en) | 2015-01-29 | 2018-09-20 | Sony Corporation | Information processing apparatus, information processing method, and program |
Non-Patent Citations (3)
| Title |
|---|
| International Preliminary Report on Patentability and English translation thereof dated Oct. 27, 2016 in connection with International Application No. PCT/JP2015/060925. |
| International Search Report and Written Opinion and English translation thereof dated Jul. 14, 2015 in connection with International Application No. PCT/JP2015/060925. |
| Tanaka, "Dermoscopy basics and melanocytic lesions (Part 2 of 2)", Hong Kong J. Dermatol. Venereol. (2013) 21, 181-187 (Year: 2013). * |
Also Published As
| Publication number | Publication date |
|---|---|
| KR102383182B1 (en) | 2022-04-06 |
| TW201540264A (en) | 2015-11-01 |
| KR20160144971A (en) | 2016-12-19 |
| CN106163384A (en) | 2016-11-23 |
| WO2015159767A1 (en) | 2015-10-22 |
| CN106163384B (en) | 2019-11-19 |
| US20170119301A1 (en) | 2017-05-04 |
| JPWO2015159767A1 (en) | 2017-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11324438B2 (en) | Information processing apparatus, information processing method, and non-transitory computer-readable medium for acquiring and displaying a skin condition analysis result based on an epidermis image | |
| EP3249562B1 (en) | Method for obtaining care information, method for sharing care information, and electronic apparatus therefor | |
| US10682089B2 (en) | Information processing apparatus, information processing method, and program | |
| US9517029B2 (en) | Image processing device, image processing method, image processing system, program, and recording medium | |
| KR102383183B1 (en) | Information-processing device, information-processing system, and program | |
| EP3000386B1 (en) | Skin function evaluation device and skin evaluation method | |
| US9875394B2 (en) | Skin analysis method, skin analysis device, and method for controlling skin analysis device | |
| US10617301B2 (en) | Information processing device and information processing method | |
| US10638968B2 (en) | Skin gloss evaluation device, skin gloss evaluation method, and skin gloss evaluation program | |
| US20150199819A1 (en) | Image processing device, image processing method, program, and image processing system | |
| CN104105953A (en) | Device and method for color calibration | |
| KR20100029839A (en) | How to recommend personal care products and tools for him | |
| KR20210084102A (en) | Electronic apparatus, scalp care system and method for controlling the electronic apparatus and the server | |
| US11730372B2 (en) | Accessory device and imaging device | |
| TW201639520A (en) | Information processing device, information processing method and program | |
| Dugonik et al. | Image quality assessment of digital image capturing devices for melanoma detection | |
| JP2013212177A (en) | Image analysis method, image analyzer, and image analysis program | |
| CN112215808A (en) | A method for generating human face skin sensitivity map and related device | |
| JP2017023474A (en) | Skin pore analysis apparatus, skin pore analysis method and program for use in device | |
| CN121195285A (en) | Method and system for determining cosmetic skin properties based on disorder values | |
| KR20250053559A (en) | Display apparatus and method for controlling therof | |
| CN121263829A (en) | Methods and systems for visualizing color gradients in human facial features or for visualizing cosmetic skin properties based on such color gradients. | |
| JP2021171365A (en) | Methods and devices for measuring lip water content |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: SONY CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KIMURA, NATSUKI;REEL/FRAME:040332/0759 Effective date: 20160829 |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
| STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
| MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |