WO2023219131A1 - Evaluation device, evaluation system, evaluation method, and program - Google Patents

Evaluation device, evaluation system, evaluation method, and program Download PDF

Info

Publication number
WO2023219131A1
WO2023219131A1 PCT/JP2023/017725 JP2023017725W WO2023219131A1 WO 2023219131 A1 WO2023219131 A1 WO 2023219131A1 JP 2023017725 W JP2023017725 W JP 2023017725W WO 2023219131 A1 WO2023219131 A1 WO 2023219131A1
Authority
WO
WIPO (PCT)
Prior art keywords
evaluation
ultraviolet
image
protective agent
unit
Prior art date
Application number
PCT/JP2023/017725
Other languages
French (fr)
Japanese (ja)
Inventor
泰史 針生
智成 岡田
勝也 武田
凡 張
Original Assignee
花王株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 花王株式会社 filed Critical 花王株式会社
Publication of WO2023219131A1 publication Critical patent/WO2023219131A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N21/31Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
    • G01N21/33Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using ultraviolet light
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/47Scattering, i.e. diffuse reflection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning

Definitions

  • the present invention relates to an evaluation device, an evaluation system, an evaluation method, and a program.
  • Patent Document 1 discloses an evaluation device that includes an illumination section, a detection section, and an analysis section.
  • the illumination unit has a first filter that transmits light in a predetermined wavelength band, and irradiates the subject coated with an ultraviolet protective agent with ultraviolet light in a predetermined wavelength band.
  • the detection unit includes a second filter that transmits light in a predetermined wavelength band, and detects reflected light in the predetermined wavelength band.
  • the analysis section estimates the ultraviolet light transmittance of the ultraviolet protective agent based on the detection results.
  • Patent Document 2 discloses a technology that inputs an image file (target information) to a learning model that has been subjected to machine learning and calculates the reflection characteristics of the target object (specular reflection components representing gloss, etc.).
  • an acquisition unit that acquires an ultraviolet image of an object on which a coating film of an ultraviolet protective agent is placed; an image processing unit that uses a learning model to generate a processed image in which the specularly reflected light component is removed from the ultraviolet image; an evaluation unit that generates evaluation result data indicating evaluation results regarding the ultraviolet protective agent based on the processed image; an output unit that outputs the evaluation result data;
  • an acquisition unit that acquires an ultraviolet image of an object on which a coating film of an ultraviolet protective agent is placed; an image processing unit that uses a learning model to generate a processed image in which the specularly reflected light component is removed from the ultraviolet image; an evaluation unit that generates evaluation result data indicating evaluation results regarding the ultraviolet protective agent based on the processed image; an output unit that outputs the evaluation result data;
  • the computer is Obtain an ultraviolet image of an object with a coating of ultraviolet protection agent placed on its surface. Generate a processed image by removing the specularly reflected light component from the ultraviolet image using a learning model, generating evaluation result data indicating the results of evaluation regarding the ultraviolet protective agent based on the processed image; outputting the evaluation result data; An evaluation method is provided.
  • an acquisition means for acquiring an ultraviolet image of an object on which a coating film of an ultraviolet protective agent is disposed image processing means that uses a learning model to generate a processed image in which the specularly reflected light component is removed from the ultraviolet image; evaluation means for generating evaluation result data indicating evaluation results regarding the ultraviolet protective agent based on the processed image; output means for outputting the evaluation result data;
  • a program is provided to enable this function.
  • FIG. 1 is a block diagram showing one embodiment of an evaluation device. It is a figure for explaining the processing of an evaluation device.
  • FIG. 2 is a diagram for explaining an example of the hardware configuration of an evaluation device. It is an example of a functional block diagram of an evaluation device.
  • FIG. 3 is a diagram for explaining teacher data.
  • FIG. 3 is a diagram showing an example of an image output by the evaluation device. It is a flow chart which shows an example of the flow of processing of an evaluation device.
  • FIG. 3 is a block diagram showing another embodiment of the evaluation device.
  • FIG. 3 is a diagram illustrating an example of an image displayed by a user terminal when photographing. It is an example of the functional block diagram of an evaluation system.
  • FIG. 3 is a diagram for explaining evaluation criteria.
  • An object of the present invention is to provide a technique for easily performing various evaluations regarding ultraviolet protective agents.
  • the evaluation device 10 of this embodiment is a server 1.
  • the evaluation device 10 cooperates with the user terminal 20 to provide a service (hereinafter sometimes referred to as "evaluation service") that performs various evaluations regarding ultraviolet protective agents and provides the results.
  • Various evaluations include coating unevenness evaluation and performance evaluation of the UV protection agent.
  • a user can use the evaluation service to check whether the ultraviolet protective agent has been properly applied (that is, whether there is any uneven application). Additionally, the user can use the evaluation service to check the performance of a given UV protection agent.
  • the user uses an ultraviolet camera to photograph his or her face, etc., coated with an ultraviolet protection agent.
  • the user then transmits the ultraviolet image generated by the ultraviolet camera to the evaluation device 10 via the user terminal 20.
  • the evaluation device 10 performs the various evaluations described above based on the received ultraviolet image, and transmits the evaluation results to the user terminal 20.
  • the evaluation device 10 of this embodiment performs various evaluations such as coating unevenness evaluation and performance evaluation based on the intensity of internally scattered light, and specular reflection light (1) and specular reflection light (2) are unnecessary. It becomes a component. Therefore, the evaluation device 10 removes the specularly reflected light (1) and specularly reflected light (2) components from the ultraviolet image using a learning model prepared in advance, and the ultraviolet image after removing these components.
  • the above various evaluations will be made based on the above.
  • a user can easily perform various evaluations regarding ultraviolet protective agents.
  • Each functional unit of the evaluation device 10 includes a CPU (Central Processing Unit) of an arbitrary computer, a memory, a program loaded into the memory, and a storage unit such as a hard disk that stores the program (which is stored in advance from the stage of shipping the device).
  • a CPU Central Processing Unit
  • a memory such as RAM
  • a program loaded into the memory such as a hard disk
  • a storage unit such as a hard disk that stores the program (which is stored in advance from the stage of shipping the device).
  • CDs Compact Discs
  • servers on the Internet it is also possible to store programs downloaded from storage media such as CDs (Compact Discs) or servers on the Internet. Ru. It will be understood by those skilled in the art that there are various modifications to the implementation method and device.
  • FIG. 3 is a block diagram illustrating the hardware configuration of the evaluation device 10.
  • the evaluation device 10 includes a processor 1A, a memory 2A, an input/output interface 3A, a peripheral circuit 4A, and a bus 5A.
  • the peripheral circuit 4A includes various modules.
  • the evaluation device 10 does not need to have the peripheral circuit 4A.
  • the evaluation device 10 may be composed of a plurality of physically and/or logically separated devices. In this case, each of the plurality of devices can include the above hardware configuration.
  • the bus 5A is a data transmission path through which the processor 1A, memory 2A, peripheral circuit 4A, and input/output interface 3A exchange data with each other.
  • the processor 1A is, for example, an arithmetic processing device such as a CPU or a GPU (Graphics Processing Unit).
  • the memory 2A is, for example, a RAM (Random Access Memory) or a ROM (Read Only Memory).
  • the input/output interface 3A is an interface for acquiring information from an input device, an external device, an external server, an external sensor, a camera (normal camera, ultraviolet camera, etc.), and an interface for acquiring information from an output device, an external device, an external server, etc. Contains interfaces for outputting.
  • Input devices include, for example, a keyboard, mouse, microphone, physical button, touch panel, and the like.
  • the output device is, for example, a display, speaker, printer, or the like.
  • the processor 1A can issue commands to each module and perform calculations based on the results of those calculations.
  • FIG. 4 shows an example of a functional block diagram of the evaluation device 10.
  • the evaluation device 10 includes an acquisition section 11, an image processing section 12, an evaluation section 13, and an output section 14.
  • the acquisition unit 11 acquires an ultraviolet image of an object on which a coating film of an ultraviolet protective agent is disposed.
  • the acquisition unit 11 acquires an ultraviolet image transmitted by a user of the above-mentioned evaluation service using the user terminal 20.
  • the user does not need to perform an operation to remove the specularly reflected light (1) and specularly reflected light (2) components when photographing an ultraviolet image. That is, the user does not need to perform the process of removing the components of specularly reflected light (1) and specularly reflected light (2) using a polarizing plate as disclosed in Patent Document 1. Therefore, the user can easily use the evaluation service.
  • the ultraviolet image acquired by the acquisition unit 11 may include not only components of internally scattered light but also components of specularly reflected light (1) and specularly reflected light (2).
  • Ultraviolet protection agents are preparations containing ultraviolet absorbers (2-ethylhexyl para-methoxycinnamate, t-butylmethoxydibenzoylmethane, etc.) and/or ultraviolet scattering agents (fine titanium oxide, fine zinc oxide, etc.). Can be mentioned. Examples of the formulation include liquid, gel, semisolid, solid, foam, mist, and sheet forms. The present invention can be applied to all types of UV protection agents, but is particularly preferably applicable when a UV protection agent containing an ultraviolet absorber is placed on the surface of an object.
  • target object is exemplified by a living body such as a human body, but is not limited to this, and may be any other object.
  • the "surface of the object” is exemplified by the outer surface of a living body such as skin, hair, nails, eyes, etc., but is not limited thereto, and may be the outer surface of other objects.
  • “Placement” refers to the state in which the coating film of the ultraviolet protective agent is placed in contact with the surface of the object.
  • any means such as coating, pasting, adhesion, etc. can be adopted.
  • the acquisition unit 11 acquires the ultraviolet image transmitted by the user terminal 20.
  • Examples of the "user terminal 20" include, but are not limited to, a smartphone, a tablet terminal, a mobile phone, a mobile game, a personal computer, a smart watch, a smart mirror, a digital camera, and the like.
  • a "ultraviolet image” is an image taken and generated by an ultraviolet camera equipped with a sensor that detects ultraviolet light.
  • the user terminal 20 may be equipped with an ultraviolet camera function to take ultraviolet images.
  • the function may be realized by connecting a predetermined device to the user terminal 20 or installing predetermined software, or may be provided in the user terminal 20 in advance from the shipping stage. After photographing an ultraviolet image using the user terminal 20, the user may transmit the ultraviolet image from the user terminal 20 to the evaluation device 10.
  • a light source that contains ultraviolet rays is used.
  • an LED containing ultraviolet light can be attached to the user terminal 20 for use.
  • the user may take an ultraviolet image using an ultraviolet camera that is an external device that is logically and/or physically separated from the user terminal 20. Then, the user may input the ultraviolet image into the user terminal 20 by any means, and transmit the ultraviolet image from the user terminal 20 to the evaluation device 10.
  • a light source that contains ultraviolet light is used.
  • an ultraviolet camera by attaching an LED that emits ultraviolet light.
  • the evaluation device 10 and the user terminal 20 are connected to a communication network 30 such as the Internet. Transmission and reception of ultraviolet images between the user terminal 20 and the evaluation device 10 is realized via the communication network 30.
  • a communication network 30 such as the Internet.
  • Transmission and reception of ultraviolet images between the user terminal 20 and the evaluation device 10 is realized via the communication network 30.
  • an application program (software) dedicated to the evaluation service may be installed on the user terminal 20. Then, transmission (upload) of the ultraviolet image from the user terminal 20 to the evaluation device 10 may be realized via a function installed in the application program.
  • a web page dedicated to the evaluation service may be prepared. After accessing the web page via the web browser installed on the user terminal 20, the ultraviolet image is transmitted (uploaded) from the user terminal 20 to the evaluation device 10 via the function installed in the web page. may be realized. Note that the transmission and reception of the ultraviolet image may be realized by other means, such as transmission and reception as an email attachment.
  • the image processing unit 12 uses a learning model to generate a processed image in which the specularly reflected light component is removed from the ultraviolet image.
  • the specularly reflected light components to be removed are the specularly reflected light (1) and specularly reflected light (2) components described using FIG.
  • a learning model is prepared in advance that generates an ⁇ image from which specularly reflected light components have been removed'' from an ⁇ ultraviolet image taken of an object whose surface has a coating film of an ultraviolet protective agent.
  • the means for generating a learning model is not particularly limited, and any means can be adopted.
  • the technique disclosed in Patent Document 2 may be used.
  • An example of a learning model generating means will be described below.
  • the learning model uses ⁇ an ultraviolet image taken of an object on which a coating film of an ultraviolet protection agent is placed on the surface, which includes a component of specularly reflected light,'' and an image that contains a component of specularly reflected light. It is generated by machine learning based on a plurality of training data paired with an "ultraviolet light image of the object that does not include a specularly reflected light component.”
  • FIG. 5 shows an example of teacher data.
  • the image (A) is an ultraviolet image taken of an object on which a coating film of an ultraviolet protective agent is disposed, and includes a specularly reflected light component.
  • the image (B) is "an ultraviolet image taken of an object on which a coating film of an ultraviolet protective agent is disposed, and does not contain a specularly reflected light component.”
  • This image shows the condition when a commercially available O/W type UV inhibitor is applied to the face at a coating amount of 1.0mg/ cm2 , and a general xenon light source containing ultraviolet rays is used as the light source, and a camera is used.
  • These images were taken with a general ultraviolet camera equipped with a bandpass filter in the ultraviolet range of 315 nm to 325 nm.
  • the means for generating the teacher data is not particularly limited, but it can usually be generated by using a light source, an ultraviolet camera, and a polarizing plate.
  • the technique disclosed in Patent Document 1 can be used.
  • the specularly reflected light component can be transmitted or removed.
  • an ultraviolet image that includes the specularly reflected light component is taken of an object whose surface is coated with an ultraviolet protective agent. I can do it.
  • the adjustment is made to remove the specularly reflected light component, "an ultraviolet image taken of an object with a coating film of an ultraviolet protective agent on its surface that does not contain the specularly reflected light component" Can be photographed.
  • the generated ⁇ ultraviolet protection It is also possible to adjust the brightness of an image that is an ultraviolet image taken of an object on which a coating film of the agent is disposed and that does not contain a specularly reflected light component.
  • the learning means As an example of the learning means, a case will be described in which a generator and a discriminator are used.
  • the generator uses the training data, ⁇ an ultraviolet image taken of an object with a coating film of an ultraviolet protection agent on its surface, which includes a component of specularly reflected light'', to It is constructed using, for example, a multi-stage convolutional neural network (CCN) to generate an ultraviolet image taken of an object placed in the area, with the specularly reflected light component removed.
  • CCN convolutional neural network
  • the discriminator uses the training data, ⁇ an ultraviolet image taken of an object with a coating film of an ultraviolet protective agent on its surface, which does not include specularly reflected light components,'' and the ⁇ ultraviolet ray image'' generated by the generator.
  • the two images are configured to be identified as different when the degree of degree is not less than a predetermined ratio.
  • the parameters of the classifier that is, the predetermined value of the difference
  • the parameters of the generator are adjusted so that the classifier can generate an image that cannot be correctly identified.
  • a generator provided with parameters resulting from the adjustment becomes a learning model used in the present invention.
  • a commercially available product A (Evita Moist Water Shield UV manufactured by Kao Corporation) containing an ultraviolet absorber as an ultraviolet protection agent was applied at 1 mg/cm 2 to a 4 cm square part of the face. Under conditions that include the coated area and the uncoated area, it is determined that the image is an ultraviolet image taken of an object on which a coating film of an ultraviolet protective agent is placed, and that does not include specularly reflected light components. ⁇ An ultraviolet image taken of an object with a coating film of ultraviolet protection agent placed on its surface, with the specularly reflected light component removed (image generated by the generator)'', and a total of three images are obtained. When the degree of concordance was confirmed using images, the degree of concordance was approximately 80.0%.
  • FIG. 1 An example of two images with a matching degree of about 80.0% is shown in FIG.
  • the "image created using a polarizing plate to exclude specularly reflected light” is “an ultraviolet image taken of an object on which a coating film of an ultraviolet protective agent is placed, and which does not contain specularly reflected light components.” ”.
  • the "image from which specularly reflected light has been removed using machine learning” shown in the figure is "an ultraviolet image taken of an object with a coating film of an ultraviolet protective agent on its surface, and from which the specularly reflected light component has been removed” ( image generated by the generator). The degree of agreement was calculated using the following procedure.
  • the image processing unit 12 inputs the ultraviolet image acquired by the acquisition unit 11 into the learning model, and acquires a “processed image obtained by removing the specularly reflected light component from the ultraviolet image” output from the learning model.
  • the evaluation unit 13 evaluates the ultraviolet protective agent based on the processed image generated by the image processing unit 12, and generates evaluation result data indicating the results of the evaluation.
  • the evaluation unit 13 performs at least one of coating unevenness evaluation of the ultraviolet protection agent and performance evaluation of the ultraviolet protection agent as evaluation regarding the ultraviolet protection agent.
  • the evaluation unit 13 may be configured to perform only one of the coating unevenness evaluation of the ultraviolet protective agent and the performance evaluation of the ultraviolet protective agent, or may be configured to perform both. Each will be explained below.
  • the state of each location on the surface of the object shown in the processed image indicates the intensity of internally scattered light reflected at each location.
  • the intensity of the internally scattered light reflected at each location depends on the amount of ultraviolet protection agent applied at each location. As the amount of UV protection agent applied increases, the intensity of reflected internally scattered light becomes weaker. Note that the intensity of the ultraviolet light (internally scattered light) reflected at each location, that is, the amount of the ultraviolet protective agent applied at each location, can be evaluated by the brightness value of the processed image. As shown in FIG. 11, when the applied amount of the ultraviolet protection agent is small, the intensity of internally scattered light becomes strong and the brightness value becomes large.
  • An appropriate threshold value is set based on the brightness value of the processed image at the location where an appropriate amount of UV protection agent has been applied, and the application of UV protection agent at each location is determined by comparing the brightness value of each location in the processed image with this threshold value. It can be determined whether the amount is appropriate.
  • the degree of intensity of the detected internally scattered light (brightness value) Locations larger than the first threshold are locations where no ultraviolet protective agent is applied at all, or where the UV protection agent is applied but the amount of application is inappropriate (too little).
  • the lower limit of the brightness value of the area where an appropriate amount of UV protection agent is applied is set as the second threshold value, the degree of intensity of the detected internally scattered light (brightness value) will be lower than the second threshold value. Small areas are areas where the ultraviolet protection agent is applied, but the amount applied is inappropriate (too much).
  • a location where the intensity level (luminance value) of the detected internally scattered light is between the first threshold value and the second threshold value is a location where the ultraviolet protection agent is applied and the amount of application is appropriate.
  • the evaluation unit 13 evaluates areas where the intensity (luminance value) of the ultraviolet rays scattered within the object (internally scattered light) is greater than a first threshold, and determines where the applied amount of the ultraviolet protective agent is less than the first standard. It can be detected as a location. The evaluation unit 13 can then generate evaluation result data indicating the detection result.
  • the "first criterion” is a criterion for determining whether the amount of UV protection agent applied is acceptable (the portion where the amount of application is small).
  • the first criterion is determined based on the first threshold value.
  • the first threshold value is defined by the brightness value of the processed image.
  • the first threshold value is the brightness value of the processed image at the location where the lower limit amount of the ultraviolet protection agent is applied in the appropriate amount range. As shown in FIG. 11, the first threshold is the upper limit of the rejection level at which the coating amount is determined to be inappropriate (too small). In other words, the first threshold is the lower limit of the acceptable level at which the amount of coating is determined to be appropriate.
  • the applied amount of the ultraviolet protective agent is inappropriate (small) at a location where the luminance value is larger than the first threshold value (luminance value). Areas where the amount of coating is too small will not provide sufficient UV protection.
  • the evaluation unit 13 can generate, as evaluation result data, an image in which the results of the uneven coating evaluation of the ultraviolet protective agent are superimposed on the image showing the object. Specifically, the evaluation unit 13 superimposes information indicating locations where the applied amount of the ultraviolet protective agent is less than the first standard (locations where the brightness value is greater than the first threshold value) on the image showing the target object. , it is possible to generate an image in which the location is prominently identified.
  • FIG. 6 schematically shows an example of an image generated by the evaluation unit 13.
  • FIG. 6 shows an image generated by the evaluation unit 13 being displayed on the display D of the user terminal 20.
  • the object is a human body.
  • a frame M surrounding a partial area with a dotted line is superimposed on the image representing the object.
  • the area surrounded by frame M is the area where the amount of UV protection agent applied is less than the first standard.
  • advice is further displayed suggesting applying a little more UV protection agent to the area surrounded by frame M.
  • the predetermined location is clearly identified by surrounding it with a frame M, but other methods such as coloring the predetermined location or displaying an icon or stamp in the predetermined location may be used to make the predetermined location conspicuous for identification. Display may also be realized.
  • the "image showing the target object” may be an ultraviolet image acquired by the acquisition unit 11 or a processed image generated by the image processing unit 12.
  • the acquisition unit 11 may also acquire from the user terminal 20 an image of the object taken with a normal camera (a camera equipped with a sensor that detects light in the visible light range). Then, the image may be used as the above-mentioned "image showing the target object”.
  • an image displayed on the finder (display) of the user terminal 20 when the camera function is activated may be used as the above-mentioned "image showing the target object.”
  • the evaluation unit 13 evaluates the location where the intensity (luminance value) of the ultraviolet rays scattered in the object (internally scattered light) is smaller than the second threshold value. It can be detected as a location where the amount of protective agent applied is greater than the second standard. The evaluation unit 13 can then generate evaluation result data indicating the detection result.
  • the "second criterion" is another criterion for determining whether the amount of ultraviolet protection agent applied is acceptable (the portion where the amount of application is large).
  • the second criterion is determined based on the second threshold value.
  • the second threshold is defined by the brightness value of the processed image.
  • the second threshold value is the brightness value of the processed image at the location where the upper limit of the appropriate amount range of UV protection agent is applied. As shown in FIG. 11, the second threshold is the lower limit of the rejection level at which it is determined that the coating amount is inappropriate (large). In other words, the second threshold is the upper limit of the pass level at which the coating amount is determined to be appropriate.
  • the applied amount of the ultraviolet protective agent is inappropriate (too large) at a location where the luminance value is smaller than the second threshold value (luminance value). Areas where too much is applied may cause a poor feeling of use. In addition, consuming excessive amounts may lead to purchasing more UV protection agents than necessary (wasteful use), and applying excessive amounts may cause the excess amount of UV protection agents to be washed away, increasing environmental impact. undesirable from this point of view.
  • the evaluation unit 13 can generate evaluation result data indicating the detection result using a method similar to the method shown in FIG.
  • the evaluation unit 13 superimposes information (frame M) indicating a location where the amount of UV protection agent applied is greater than the second standard on the image showing the target object, and identifies the location conspicuously. Displayed images can be generated. In this example, a notification that too much UV protection agent has been applied to the area surrounded by frame M is displayed, along with advice suggesting that a little more UV protection agent be applied to other areas. It's okay.
  • the evaluation unit 13 uses a method similar to the method shown in FIG.
  • the evaluation unit 13 evaluates the areas where the amount of UV protection agent applied is less than the first standard (fail: too little) and the area where the amount of UV protection agent applied is more than the second standard (fail: too much). ) may be generated and output on the same screen in an image in which each is displayed in a distinguishable manner.
  • the evaluation unit 13 determines that the degree of intensity (luminance value) of the detected ultraviolet rays (internally scattered light) is smaller than the first threshold value (the applied amount of the ultraviolet protective agent is larger than the first criterion), and A portion where the amount of UV protection agent applied is larger than the threshold value (the amount of UV protection agent applied is less than the second standard) is determined to be appropriate (passed: not too much, not too little).
  • the evaluation unit 13 can divide the detected ultraviolet rays by an arbitrary value and detect the result as ultraviolet reflectance. The lower the UV reflectance, the higher the UV protection effect. The evaluation unit 13 can generate evaluation result data indicating ultraviolet reflectance. Then, the UV protection effect of the UV protection agent can be evaluated based on the UV reflectance.
  • the arbitrary value may be the average ultraviolet reflection intensity of human bare skin or the like, or the ultraviolet reflection intensity of the object before applying the ultraviolet protection agent.
  • UV reflectance (UV reflection intensity of skin coated with UV protection agent) / (average UV reflection intensity of bare skin without UV protection coating)
  • UV reflectance (UV reflection intensity of the object coated with UV protection agent) / (UV reflection intensity of the object before applying the UV protection agent)
  • the output unit 14 outputs the evaluation result data generated by the evaluation unit 13.
  • the output unit 14 transmits evaluation result data to the user terminal 20.
  • the user terminal 20 outputs the received evaluation result data via an output device such as a display, a projection device, or a printer.
  • the evaluation device 10 acquires an ultraviolet image of an object having a coating film of an ultraviolet protective agent on its surface (S10).
  • the evaluation device 10 acquires the ultraviolet image transmitted by the user terminal 20.
  • the evaluation device 10 uses the learning model to generate a processed image in which the specularly reflected light component is removed from the ultraviolet image (S11). Next, the evaluation device 10 performs evaluation regarding the ultraviolet protective agent based on the processed image, and generates evaluation result data indicating the evaluation results (S12).
  • the evaluation device 10 outputs the evaluation result data generated in S12 (S13).
  • the evaluation device 10 transmits evaluation result data to the user terminal 20.
  • the user terminal 20 outputs the received evaluation result data via an output device such as a display, a projection device, or a printer (see FIG. 6).
  • the user can conduct various evaluations regarding the ultraviolet protective agent, specifically, by performing an operation to take an ultraviolet image and transmit the ultraviolet image to the evaluation device 10. It is possible to perform unevenness evaluation and performance evaluation. In this way, according to the evaluation device 10 of this embodiment, the user can easily perform various evaluations regarding the ultraviolet protective agent.
  • FIG. 6 there are locations where the amount of UV protection agent applied is less than the first standard, and locations where the amount of application of the UV protection agent is greater than the second standard. It is possible to generate and output an image in which at least one of the following is prominently identified and displayed. Based on the image, the user can intuitively understand where the UV protection agent is not applied enough or where it is applied too much. Then, it is possible to obtain an ideal coating state with less uneven coating.
  • the evaluation device 10 that uses a learning model to generate a "processed image in which the specularly reflected light component is removed from the ultraviolet image" and performs an evaluation regarding the ultraviolet protective agent based on the processed image, the evaluation device 10 does not use a polarizing plate. It is possible to generate an ultraviolet image with specularly reflected light components removed, and to evaluate the ultraviolet protective agent based on the ultraviolet image.
  • the evaluation device 10 of this embodiment detects a location where the intensity (luminance value) of ultraviolet rays (internally scattered light) scattered within the object is greater than the first threshold value. , the area is detected as a location where the amount of applied ultraviolet protective agent is less than the first standard (a location where the amount of application is too small). In addition, the evaluation device 10 evaluates the areas where the intensity (luminance value) of the ultraviolet rays scattered in the object (internally scattered light) is smaller than the second threshold value, based on the amount of applied ultraviolet protective agent It is detected as a location where the amount of coating is too large (a location where the amount of coating is too large). Then, the evaluation device can dynamically change the first threshold value and the second threshold value. This will be explained in detail below.
  • the evaluation unit 13 evaluates the UV protection agent at a location where the intensity (luminance value) of the UV light scattered inside the object (internally scattered light) is greater than the first threshold value. can be detected as a location where the amount of application is less than the first reference (a location where the amount of application is too small).
  • the evaluation unit 13 determines the first threshold based on at least one of the date and time at the time of evaluation, and the forecast of the amount of ultraviolet rays. That is, a first threshold value for determining whether the amount of application is "appropriate” or “insufficient (too small)" based on at least one of the date, time, and forecast of the amount of ultraviolet rays at the time of evaluation. Determine.
  • the evaluation unit 13 evaluates the location where the intensity (luminance value) of the ultraviolet rays scattered in the object (internally scattered light) is smaller than the second threshold value. It can be detected as a location where the amount of the protective agent applied is greater than the second standard (a location where the amount of application is too large).
  • the evaluation unit 13 determines the second threshold based on at least one of the date and time at the time of evaluation, and the forecast of the amount of ultraviolet rays. That is, a second threshold value for determining that the amount of application is too large is determined based on at least one of the date and time at the time of evaluation, and the forecast of the amount of ultraviolet rays.
  • the amount of ultraviolet light that falls on the ground can vary depending on the season. Therefore, the amount of UV protection agent that should be applied to the human body as a measure against UV rays may also vary depending on the season.
  • Correspondence information that associates the date with at least one of the first threshold value and the second threshold value is generated in advance and registered in the evaluation device 10.
  • the first threshold value becomes smaller in a season when the amount of ultraviolet rays is higher, and the first threshold value becomes larger in a season when the amount of ultraviolet rays is lower.
  • the second threshold value becomes smaller in seasons when the amount of ultraviolet rays is higher, and the second threshold value becomes larger in seasons when the amount of ultraviolet rays is lower.
  • the evaluation unit 13 After acquiring the date at the time of evaluation by any means, acquires at least one of the first threshold value and the second threshold value corresponding to the acquired date from the corresponding information, and the acquired first threshold value.
  • the evaluation described in the first embodiment is performed using at least one of the threshold value and the second threshold value.
  • the amount of ultraviolet light that falls on the ground can vary depending on the time of day.
  • the amount of UV protection agent that should be applied to the human body as a measure against UV rays may also vary depending on the time of day.
  • Correspondence information that associates time with at least one of the first threshold value and the second threshold value is generated in advance and registered in the evaluation device 10.
  • the first threshold value becomes smaller as the amount of ultraviolet rays increases, and the first threshold value becomes larger as the amount of ultraviolet rays decreases.
  • the second threshold value becomes smaller as the amount of ultraviolet rays increases at a time, and the second threshold value becomes larger as the amount of ultraviolet rays decreases.
  • the evaluation unit 13 After acquiring the time at the time of evaluation by any means, acquires at least one of the first threshold value and the second threshold value corresponding to the acquired time from the corresponding information, and the acquired first threshold value.
  • the evaluation described in the first embodiment is performed using at least one of the threshold value and the second threshold value.
  • Correspondence information that associates the amount of ultraviolet rays shown in the forecast with at least one of the first threshold value and the second threshold value is generated in advance and registered in the evaluation device 10.
  • the second threshold value becomes smaller as the predicted amount of ultraviolet rays increases, and the second threshold value becomes larger as the predicted amount of ultraviolet rays decreases.
  • the evaluation unit 13 After acquiring the contents of the forecast at the time of evaluation by any means, the evaluation unit 13 acquires at least one of the first threshold and the second threshold corresponding to the contents of the acquired forecast from the corresponding information, The evaluation described in the first embodiment is performed using at least one of the acquired first threshold value and second threshold value.
  • the amount of ultraviolet rays indicated in the forecast may be the intensity of ultraviolet rays expressed in units such as "mW/cm 2 ", or may be expressed as "strong, somewhat strong, normal, somewhat weak, weak", etc. It may be a value that expresses the intensity using any method.
  • the evaluation unit 13 can determine at least one of the first threshold value and the second threshold value, and evaluate the uneven coating of the ultraviolet protective agent based on the determined content.
  • the other configuration of the evaluation device 10 of this embodiment is the same as that of the first embodiment.
  • the same effects as the evaluation device 10 of the first embodiment are realized. Further, according to the evaluation device 10 of the present embodiment, uneven coating can be evaluated based on appropriate criteria depending on the season, time of day, contents of the forecast of the amount of ultraviolet rays, and the like. As a result, it becomes possible to provide the user with evaluation results appropriate to the situation at that time.
  • the evaluation device 10 of the present embodiment sets the first threshold value and the second threshold value regarding the degree (luminance value) of the "intensity of detected ultraviolet light (internally scattered light)" described in the first embodiment to the second threshold value. It can be dynamically changed using a method different from the second embodiment. This will be explained in detail below.
  • the evaluation unit 13 acquires information indicating the action schedule input by the user.
  • the information indicates at least one of the length of time the user will be out and the time the user is out.
  • the user operates the user terminal 20 to input the information.
  • the information is then transmitted from the user terminal 20 to the evaluation device 10.
  • the means for accepting the user input may be realized using any technology.
  • it may be realized using an application program (software) dedicated to the evaluation service installed on the user terminal 20.
  • an input form for accepting input of the information may be provided on the web page dedicated to the evaluation service.
  • Correspondence information that associates the length of time spent away with at least one of the first threshold value and the second threshold value is generated in advance and registered in the evaluation device 10.
  • the evaluation unit 13 After specifying the length of time to go out based on the information indicating the action schedule input by the user, the evaluation unit 13 sets at least one of the first threshold and the second threshold corresponding to the specified length of time.
  • the evaluation described in the first embodiment is performed using at least one of the first threshold value and the second threshold value obtained from the correspondence information.
  • correspondence information that associates the time when the person is out with at least one of the first threshold value and the second threshold value is generated and registered in the evaluation device 10 in advance.
  • the first threshold value becomes smaller as the amount of ultraviolet rays increases, and the first threshold value becomes larger as the amount of ultraviolet rays decreases.
  • the second threshold value becomes smaller as the amount of ultraviolet rays increases at a time, and the second threshold value becomes larger as the amount of ultraviolet rays decreases.
  • the evaluation unit 13 After specifying the time to go out based on the information indicating the action schedule input by the user, the evaluation unit 13 acquires at least one of the first threshold value and the second threshold value corresponding to the specified time from the corresponding information. do. Note that if the time spent going out is long and the times at which the user goes out vary widely, the minimum value among the plurality of first threshold values corresponding to those times may be acquired. Furthermore, if the user is out for a long time and goes out at various times, the minimum value among the plurality of second threshold values corresponding to those times may be acquired. Then, the evaluation unit 13 performs the evaluation described in the first embodiment using at least one of the acquired first threshold value and second threshold value.
  • the same effects as those of the evaluation device 10 of the first and second embodiments are realized. Further, according to the evaluation device 10 of the present embodiment, uneven coating can be evaluated using appropriate criteria according to the user's action schedule. As a result, it becomes possible to provide the user with evaluation results appropriate to the situation.
  • the evaluation device 10 of this embodiment differs from the first to third embodiments in that, as shown in FIG. 8, it is not the server 1 but the user terminal 20.
  • an evaluation device 10 By installing an application program (software) dedicated to the evaluation service in the user terminal 20, an evaluation device 10 having an acquisition section 11, an image processing section 12, an evaluation section 13, and an output section 14 is realized in the user terminal 20. Ru.
  • the acquisition unit 11 of this embodiment realizes the acquisition of an ultraviolet image by taking an ultraviolet image using the ultraviolet camera function provided in the user terminal 20 (evaluation device 10).
  • the functions of the image processing section 12 and the evaluation section 13 are as described in the first to third embodiments.
  • the output unit 14 outputs the evaluation result data via an output device such as a display, a projection device, or a printer (see FIG. 6). Note that most indoor lighting generally does not contain ultraviolet rays, so when taking pictures indoors, a light source that contains ultraviolet rays is used. For example, an LED containing ultraviolet light may be attached to the user terminal 20 (evaluation device 10) for use.
  • the other configurations of the evaluation device 10 of this embodiment are the same as those of the first to third embodiments.
  • the same effects as those of the evaluation device 10 of the first to third embodiments are realized. Further, according to the evaluation device 10 of this embodiment, all processing can be completed within the evaluation device 10. Therefore, even in a situation where communication with an external device is not possible, the user can use the evaluation service.
  • the evaluation apparatus of the present invention is configured as an evaluation system 100 and includes an acquisition section 11, an image processing section 12, an evaluation section 13, and an output section 14.
  • the evaluation system 100 is composed of a plurality of devices that are communicably connected to each other via a communication network 30 that is composed of a private line or a public line.
  • the evaluation system 100 includes a server 1 and at least one, preferably a plurality of user terminals 20.
  • the plurality of functional units included in the evaluation system 100 are provided in arbitrary devices among the plurality of devices.
  • a plurality of user terminals 20 may each include an acquisition section 11 and an output section 14, and the server 1 may include an image processing section 12 and an evaluation section 13.
  • a plurality of user terminals 20 may each include an acquisition section 11, an image processing section 12, and an output section 14, and the server 1 may include an evaluation section 13.
  • a plurality of user terminals 20 may each include an acquisition section 11, an evaluation section 13, and an output section 14, and the server 1 may include an image processing section 12. Note that the combinations illustrated here are just examples, and the evaluation system 100 can employ any combination.
  • the server 1 includes at least an image processing section 12 that includes a learning model.
  • a light source that contains ultraviolet rays is used.
  • an LED containing ultraviolet light may be attached to the user terminal 20 (evaluation device 10).
  • the configuration and operation of the acquisition unit 11, image processing unit 12, evaluation unit 13, and output unit 14 of this embodiment are the same as those of the first to fourth embodiments.
  • Modification 1 When taking an ultraviolet image using the ultraviolet camera function of the user terminal 20, as shown in FIG.
  • the frame W may be displayed in a superimposed manner.
  • a function to take an ultraviolet image may be provided within an application program (software) dedicated to the evaluation service installed on the user terminal 20. Then, when the application program dedicated to the evaluation service is started and the function to take an ultraviolet image is launched, the display of the user terminal 20 becomes a viewfinder, and the real-time photographed image is displayed on the finder. The frame W may be displayed superimposed on the image.
  • a function to take ultraviolet images may be provided within the web page dedicated to the evaluation service. Then, when accessing the web page dedicated to the evaluation service and launching the function to take ultraviolet images, the display of the user terminal 20 becomes a finder, and the real-time shot image is displayed on the finder. The frame W may be displayed superimposed on the image.
  • the user photographs the ultraviolet image so that the object and the standard patch are included in the ultraviolet image.
  • the standard patch may be photographed with the standard patch attached to the surface of the object, or the standard patch may be held in the hand or attached to a predetermined object and photographed.
  • the standard patch has a known reflectance to ultraviolet light.
  • the user applies the UV protective agent until the brightness of the UV image after applying the UV protective agent becomes darker than the standard patch. For example, if you prepare a standard patch that has the same reflectance as the recommended amount of UV protection agent applied, you can apply the UV protection agent until the brightness of the UV image becomes darker than the standard patch as described above. This allows the user to apply more UV protection agent than the recommended usage amount.
  • a target color may be displayed as a guide on the image displayed on the finder (display).
  • the user applies the ultraviolet protective agent until the color of the ultraviolet image after applying the ultraviolet protective agent becomes the same tone as the color guide. For example, if you prepare in advance a color guide that has the same color as the recommended amount of UV protection agent applied, apply the UV protection agent until the color of the UV image becomes the same tone as the standard patch as described above. By doing so, the user can apply more UV protection agent than the recommended usage amount.
  • Modification 4" When capturing an ultraviolet image using the user terminal 20, the proportion of saturated pixels among multiple images included in the ultraviolet image is set to a predetermined value (e.g. 50%, 40%, 30%, 20%, etc.). ) You may adjust it so that it is as follows. For example, when the brightness of an image is expressed in a range of 0 to 255 (0 is the darkest and 255 is the brightest), pixels with a brightness of 255 or more are saturated pixels. By doing this, the brightness of the ultraviolet image is adjusted, making it easier to see. The proportion occupied by the saturated pixels changes depending on whether a light source is included in the image, the distance between the camera and the subject, the angle of the camera, and the like.
  • a predetermined value e.g. 50%, 40%, 30%, 20%, etc.
  • saturated pixels are more likely to occur when a light source is present, when the camera is close to the subject, or when the camera angle is such that a lot of specularly reflected light is detected.
  • the user himself/herself adjusts the photographing environment so that the proportion occupied by the saturated pixels is equal to or less than a predetermined value.
  • the server 1 or the user terminal 20 may analyze the ultraviolet image and determine whether the proportion occupied by saturated pixels is below a predetermined value. If the user terminal 20 determines that the proportion occupied by saturated pixels is not less than the predetermined value, the user terminal 20 displays messages such as ⁇ Please do not include the light source'', ⁇ Move the camera away from the subject'', and ⁇ Camera Advice such as "please change the angle of the screen" may be output to the user.
  • the output unit 14 may output product introduction information determined based on the evaluation results. For example, if the evaluation result is that "the product can be removed by rubbing," the output unit 14 can output product introduction information that introduces products that are difficult to remove by rubbing.
  • the evaluation is performed, for example, by acquiring processed images before and after friction of an object coated with an ultraviolet protective agent, and based on the rate of change in brightness of the processed images before and after friction. If the rate of change is greater than or equal to a threshold value (preset numerical value), it can be evaluated that it will be removed by rubbing.
  • a threshold value preset numerical value
  • Correspondence information that associates each of the plurality of evaluation results that can be calculated by the evaluation unit 13 with the products recommended at the time of each evaluation result is stored in advance in the evaluation device 10 or the evaluation system 100. Based on the correspondence information, the output unit 14 specifies the products to be introduced in the case of each evaluation result.
  • the output unit 14 may output care information according to the season at the time of evaluation.
  • Correspondence information that associates each of a plurality of seasons with care information indicating recommended skin care content for each season is stored in advance in the evaluation device 10 or the evaluation system 100.
  • the output unit 14 specifies care information to be introduced at the time of evaluation based on the correspondence information.
  • Modification 7 The evaluation device 10 or the evaluation system 100 may obtain the forecast of the amount of ultraviolet rays by any means. Then, the output unit 14 may output information indicating the contents of the forecast.
  • the acquisition unit 11 may acquire an image of an object whose surface is not coated with an ultraviolet protective agent, taken with a normal camera (a camera equipped with a sensor that detects light in the visible light range).
  • the evaluation unit 13 may use the image to visualize melanin in a conspicuous manner.
  • Melanin is photographed with a lower brightness value than bare skin. That is, the brightness value of the melanin area in the image is lower than the brightness value of the surrounding bare skin area.
  • the area below a certain brightness value is defined as the melanin area, and the inside of the melanin area and the outer edge of the melanin area are defined as melanin areas.
  • Melanin is a biological pigment that absorbs ultraviolet rays, so areas with a lot of melanin (for example, areas with spots on the face) have lower brightness values in the ultraviolet image than surrounding areas with less melanin. That is, the brightness value of a region with a lot of melanin in the ultraviolet image is lower than the brightness value of the surrounding bare skin region with a little melanin.
  • the area of the photographed ultraviolet image with a brightness value below a certain value is set as an area with a lot of melanin, and that area and the outer edge of that area are colored on the ultraviolet image or visible light image to make it more visible. It is possible to do so.
  • Modification 9 The evaluation unit 13 can generate evaluation result data indicating the evaluation results regarding the ultraviolet protective agent based on the processed image. Specifically, the evaluation unit 13 can use the processed image itself as evaluation result data. In this modification, the output unit 14 outputs a processed image as evaluation result data.
  • an acquisition unit that acquires an ultraviolet image of an object on which a coating film of an ultraviolet protective agent is placed; an image processing unit that uses a learning model to generate a processed image in which the specularly reflected light component is removed from the ultraviolet image; an evaluation unit that generates evaluation result data indicating evaluation results regarding the ultraviolet protective agent based on the processed image; an output unit that outputs the evaluation result data;
  • the evaluation device wherein the evaluation unit generates, as the evaluation result data, an image in which a result of the uneven coating evaluation of the ultraviolet protective agent is superimposed on an image showing the target object. 4.
  • the evaluation unit generates the image that identifies and displays one or both of a location where the amount of the UV protection agent applied is less than a first standard, and a location where the amount of the UV protection agent applied is more than a second standard.
  • the evaluation device 3. 5.
  • the evaluation device determines at least one of the first criterion and the second criterion based on at least one of the date, time, and forecast of the amount of ultraviolet rays at the time of evaluation. 6.
  • the evaluation department is Obtain information indicating the action schedule entered by the user, 6.
  • the evaluation device according to 4 or 5, wherein at least one of the first criterion and the second criterion is determined based on the action schedule. 7. 7. The evaluation device according to any one of 1 to 6, wherein the evaluation unit performs a performance evaluation of the ultraviolet protection agent as an evaluation regarding the ultraviolet protection agent. 8. 2. The evaluation device according to 1, wherein the evaluation unit evaluates the coating unevenness of the ultraviolet protective agent and the performance of the ultraviolet protective agent as evaluations regarding the ultraviolet protective agent. 9. The acquisition unit acquires the ultraviolet image that has not been processed to remove components of specularly reflected light using a polarizing plate, The evaluation device according to 1, wherein the image processing unit generates the processed image from the ultraviolet image. 10. The evaluation device according to 1, wherein the evaluation device is a user terminal. 11.
  • the computer is Obtain an ultraviolet image of an object with a coating of ultraviolet protection agent placed on its surface. Generate a processed image by removing the specularly reflected light component from the ultraviolet image using a learning model, generating evaluation result data indicating the results of evaluation regarding the ultraviolet protective agent based on the processed image; outputting the evaluation result data; Evaluation method. 13.
  • an acquisition means for acquiring an ultraviolet image of an object on which a coating film of an ultraviolet protective agent is disposed; image processing means that uses a learning model to generate a processed image in which the specularly reflected light component is removed from the ultraviolet image; evaluation means for generating evaluation result data indicating evaluation results regarding the ultraviolet protective agent based on the processed image; output means for outputting the evaluation result data;
  • image processing means that uses a learning model to generate a processed image in which the specularly reflected light component is removed from the ultraviolet image
  • evaluation means for generating evaluation result data indicating evaluation results regarding the ultraviolet protective agent based on the processed image
  • output means for outputting the evaluation result data
  • processor 2A memory 3A input/output I/F 4A Peripheral circuit 5A Bus 1 Server 10 Evaluation device 11 Acquisition section 12 Image processing section 13 Evaluation section 14 Output section 20 User terminal 30 Communication network 100 Evaluation system

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Biochemistry (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Analytical Chemistry (AREA)
  • Chemical & Material Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Multimedia (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Image Analysis (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)

Abstract

The present invention provides an evaluation device (10) having: an acquisition unit (11) that acquires an ultraviolet image in which is captured an object having a film of an ultraviolet-ray-blocking agent disposed on the surface thereof; an image processing unit (12) that, using a trained model, generates a processed image obtained by removing a regular-reflected-light component from the ultraviolet image; an evaluation unit (13) that, on the basis of the processed image, generates evaluation result data indicating the result of an evaluation relating to the ultraviolet-ray-blocking agent; and an output unit (14) that outputs the evaluation result data.

Description

評価装置、評価システム、評価方法及びプログラムEvaluation device, evaluation system, evaluation method and program
 本発明は、評価装置、評価システム、評価方法及びプログラムに関する。 The present invention relates to an evaluation device, an evaluation system, an evaluation method, and a program.
 本発明関連する技術が、特許文献1及び2に開示されている。 Technologies related to the present invention are disclosed in Patent Documents 1 and 2.
 特許文献1には、照明部と、検出部と、分析部とを有する評価装置が開示されている。照明部は、所定の波長帯域の光を透過させる第1のフィルターを有し、紫外線防御剤を塗布した被検体に所定の波長帯域の紫外線光を照射する。検出部は、所定の波長帯域の光を透過させる第2のフィルターを有し、所定の波長帯域の反射光を検出する。分析部は、検出結果に基づき紫外線防御剤の紫外線光の透過率を推定する。 Patent Document 1 discloses an evaluation device that includes an illumination section, a detection section, and an analysis section. The illumination unit has a first filter that transmits light in a predetermined wavelength band, and irradiates the subject coated with an ultraviolet protective agent with ultraviolet light in a predetermined wavelength band. The detection unit includes a second filter that transmits light in a predetermined wavelength band, and detects reflected light in the predetermined wavelength band. The analysis section estimates the ultraviolet light transmittance of the ultraviolet protective agent based on the detection results.
 特許文献2には、機械学習をさせた学習モデルに画像ファイル(対象情報)を入力し、対象物の反射特性(光沢を表す鏡面反射成分等)を算出する技術が開示されている。 Patent Document 2 discloses a technology that inputs an image file (target information) to a learning model that has been subjected to machine learning and calculates the reflection characteristics of the target object (specular reflection components representing gloss, etc.).
特許第6742108号Patent No. 6742108 特許第6982910号Patent No. 6982910
 本発明によれば、
 紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像を取得する取得部と、
 正反射光の成分を前記紫外線画像から除去した加工画像を、学習モデルを用いて生成する画像加工部と、
  前記加工画像に基づき前記紫外線防御剤に関する評価の結果を示す評価結果データを生成する評価部と、
 前記評価結果データを出力する出力部と、
を有する評価装置が提供される。
According to the invention,
an acquisition unit that acquires an ultraviolet image of an object on which a coating film of an ultraviolet protective agent is placed;
an image processing unit that uses a learning model to generate a processed image in which the specularly reflected light component is removed from the ultraviolet image;
an evaluation unit that generates evaluation result data indicating evaluation results regarding the ultraviolet protective agent based on the processed image;
an output unit that outputs the evaluation result data;
An evaluation device having the following is provided.
 また、本発明によれば、
 紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像を取得する取得部と、
 正反射光の成分を前記紫外線画像から除去した加工画像を、学習モデルを用いて生成する画像加工部と、
 前記加工画像に基づき前記紫外線防御剤に関する評価の結果を示す評価結果データを生成する評価部と、
 前記評価結果データを出力する出力部と、
を有する評価システムが提供される。
Further, according to the present invention,
an acquisition unit that acquires an ultraviolet image of an object on which a coating film of an ultraviolet protective agent is placed;
an image processing unit that uses a learning model to generate a processed image in which the specularly reflected light component is removed from the ultraviolet image;
an evaluation unit that generates evaluation result data indicating evaluation results regarding the ultraviolet protective agent based on the processed image;
an output unit that outputs the evaluation result data;
An evaluation system having the following is provided.
 また、本発明によれば、
 コンピュータが、
  紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像を取得し、
  正反射光の成分を前記紫外線画像から除去した加工画像を、学習モデルを用いて生成し、
  前記加工画像に基づき前記紫外線防御剤に関する評価の結果を示す評価結果データを生成し、
 前記評価結果データを出力する、
評価方法が提供される。
Further, according to the present invention,
The computer is
Obtain an ultraviolet image of an object with a coating of ultraviolet protection agent placed on its surface.
Generate a processed image by removing the specularly reflected light component from the ultraviolet image using a learning model,
generating evaluation result data indicating the results of evaluation regarding the ultraviolet protective agent based on the processed image;
outputting the evaluation result data;
An evaluation method is provided.
 また、本発明によれば、
 コンピュータを、
  紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像を取得する取得手段、
  正反射光の成分を前記紫外線画像から除去した加工画像を、学習モデルを用いて生成する画像加工手段、
  前記加工画像に基づき前記紫外線防御剤に関する評価の結果を示す評価結果データを生成する評価手段、
  前記評価結果データを出力する出力手段、
として機能させるプログラムが提供される。
Further, according to the present invention,
computer,
an acquisition means for acquiring an ultraviolet image of an object on which a coating film of an ultraviolet protective agent is disposed;
image processing means that uses a learning model to generate a processed image in which the specularly reflected light component is removed from the ultraviolet image;
evaluation means for generating evaluation result data indicating evaluation results regarding the ultraviolet protective agent based on the processed image;
output means for outputting the evaluation result data;
A program is provided to enable this function.
評価装置の1つ実施形態を示すブロック図である。FIG. 1 is a block diagram showing one embodiment of an evaluation device. 評価装置の処理を説明するための図である。It is a figure for explaining the processing of an evaluation device. 評価装置のハードウエア構成の一例を説明するための図である。FIG. 2 is a diagram for explaining an example of the hardware configuration of an evaluation device. 評価装置の機能ブロック図の一例である。It is an example of a functional block diagram of an evaluation device. 教師データを説明するための図である。FIG. 3 is a diagram for explaining teacher data. 評価装置が出力する画像の一例を示す図である。FIG. 3 is a diagram showing an example of an image output by the evaluation device. 評価装置の処理の流れの一例を示すフローチャートである。It is a flow chart which shows an example of the flow of processing of an evaluation device. 評価装置の他の1つ実施形態を示すブロック図である。FIG. 3 is a block diagram showing another embodiment of the evaluation device. 撮影時にユーザ端末が表示する画像の一例を示す図である。FIG. 3 is a diagram illustrating an example of an image displayed by a user terminal when photographing. 評価システムの機能ブロック図の一例である。It is an example of the functional block diagram of an evaluation system. 評価基準を説明するための図である。FIG. 3 is a diagram for explaining evaluation criteria. 「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を含まない画像」と「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を除去した画像(生成器が生成した画像)」の一例である。"An ultraviolet image taken of an object with a coating film of ultraviolet protection agent placed on its surface, which does not include a specularly reflected light component" and "An image taken of an object with a coating film of ultraviolet protection agent placed on its surface." This is an example of a UV image obtained by removing the specularly reflected light component (an image generated by a generator).
 紫外線防御剤に関する各種評価(塗りむら評価、性能評価等)を手軽に行う技術が望まれている。特許文献1に開示の技術の場合、紫外線防御剤に関する各種評価を行うユーザ各々が、特許文献1に開示のような大掛かりな装置を備える必要がある。特許文献2に開示の技術は、紫外線防御剤に関する各種評価を直接的に行うものではない。 There is a need for a technology that can easily perform various evaluations regarding UV protection agents (e.g., uneven coating evaluation, performance evaluation, etc.). In the case of the technique disclosed in Patent Document 1, each user who performs various evaluations regarding the ultraviolet protective agent needs to be equipped with a large-scale device as disclosed in Patent Document 1. The technique disclosed in Patent Document 2 does not directly perform various evaluations regarding ultraviolet protective agents.
 本発明の課題は、紫外線防御剤に関する各種評価を手軽に行う技術を提供することである。 An object of the present invention is to provide a technique for easily performing various evaluations regarding ultraviolet protective agents.
 本発明によれば、紫外線防御剤に関する各種評価を手軽に行う技術が実現される。 According to the present invention, a technology for easily performing various evaluations regarding ultraviolet protective agents is realized.
<第1の実施形態>
「概要」
 本実施形態の評価装置の概要を説明する。図1に示すように、本実施形態の評価装置10は、サーバ1である。評価装置10は、ユーザ端末20と連携して、紫外線防御剤に関する各種評価を行い、結果を提供するサービス(以下、「評価サービス」という場合がある)を提供する。各種評価は、紫外線防御剤の塗りむら評価や性能評価等である。例えば、ユーザは、紫外線防御剤をきちんと塗布できているか(すなわち、塗りむらがないか)確認するため、当該評価サービスを利用することができる。また、ユーザは、所定の紫外線防御剤の性能を確認するため、当該評価サービスを利用することができる。
<First embodiment>
"overview"
An overview of the evaluation device of this embodiment will be explained. As shown in FIG. 1, the evaluation device 10 of this embodiment is a server 1. The evaluation device 10 cooperates with the user terminal 20 to provide a service (hereinafter sometimes referred to as "evaluation service") that performs various evaluations regarding ultraviolet protective agents and provides the results. Various evaluations include coating unevenness evaluation and performance evaluation of the UV protection agent. For example, a user can use the evaluation service to check whether the ultraviolet protective agent has been properly applied (that is, whether there is any uneven application). Additionally, the user can use the evaluation service to check the performance of a given UV protection agent.
 ユーザは、紫外線防御剤を塗布した自身の顔等を紫外線カメラで撮影する。そして、ユーザは、ユーザ端末20を介して、紫外線カメラで生成された紫外線画像を評価装置10に送信する。評価装置10は、受信した紫外線画像に基づき上記各種評価を行い、評価の結果をユーザ端末20に送信する。 The user uses an ultraviolet camera to photograph his or her face, etc., coated with an ultraviolet protection agent. The user then transmits the ultraviolet image generated by the ultraviolet camera to the evaluation device 10 via the user terminal 20. The evaluation device 10 performs the various evaluations described above based on the received ultraviolet image, and transmits the evaluation results to the user terminal 20.
 ところで、紫外線防御剤の塗膜を表面に配置した対象物に紫外線を照射した場合、図2に示すように、紫外線防御剤の塗膜の表面で正反射する正反射光(1)と、紫外線防御剤の中に進入した後、対象物の表面で正反射する正反射光(2)と、対象物の内部で散乱する内部散乱光の成分が発生し得る。そして、当該対象物を撮影した紫外線画像の中には、上記3つの成分が含まれ得る。本実施形態の評価装置10は、内部散乱光の強さの程度に基づき塗りむら評価や性能評価等の各種評価を行うものであり、正反射光(1)及び正反射光(2)は不要な成分となる。そこで、評価装置10は、予め用意された学習モデルを用いて紫外線画像の中から正反射光(1)及び正反射光(2)の成分を除去し、これらの成分を除去した後の紫外線画像に基づき上記各種評価を行う。 By the way, when ultraviolet rays are irradiated onto an object on which a coating film of an ultraviolet protective agent is placed, as shown in FIG. After entering the protective agent, specularly reflected light (2) that is specularly reflected on the surface of the object and components of internally scattered light that are scattered inside the object may be generated. The above three components may be included in the ultraviolet image taken of the object. The evaluation device 10 of this embodiment performs various evaluations such as coating unevenness evaluation and performance evaluation based on the intensity of internally scattered light, and specular reflection light (1) and specular reflection light (2) are unnecessary. It becomes a component. Therefore, the evaluation device 10 removes the specularly reflected light (1) and specularly reflected light (2) components from the ultraviolet image using a learning model prepared in advance, and the ultraviolet image after removing these components. The above various evaluations will be made based on the above.
 このような処理装置10とユーザ端末20とを備えるシステムによれば、ユーザは、紫外線防御剤に関する各種評価を手軽に行うことが可能となる。 According to a system including such a processing device 10 and a user terminal 20, a user can easily perform various evaluations regarding ultraviolet protective agents.
「ハードウエア構成」
 次に、評価装置10のハードウエア構成の一例を説明する。評価装置10の各機能部は、任意のコンピュータのCPU(Central Processing Unit)、メモリ、メモリにロードされるプログラム、そのプログラムを格納するハードディスク等の記憶ユニット(あらかじめ装置を出荷する段階から格納されているプログラムのほか、CD(Compact Disc)等の記録媒体やインターネット上のサーバ等からダウンロードされたプログラムをも格納できる)、ネットワーク接続用インターフェイスを中心にハードウエアとソフトウエアの任意の組合せによって実現される。そして、その実現方法、装置にはいろいろな変形例があることは、当業者には理解されるところである。
"Hardware configuration"
Next, an example of the hardware configuration of the evaluation device 10 will be explained. Each functional unit of the evaluation device 10 includes a CPU (Central Processing Unit) of an arbitrary computer, a memory, a program loaded into the memory, and a storage unit such as a hard disk that stores the program (which is stored in advance from the stage of shipping the device). (In addition to programs downloaded from recording media such as CDs (Compact Discs) or servers on the Internet, it is also possible to store programs downloaded from storage media such as CDs (Compact Discs) or servers on the Internet. Ru. It will be understood by those skilled in the art that there are various modifications to the implementation method and device.
 図3は、評価装置10のハードウエア構成を例示するブロック図である。図3に示すように、評価装置10は、プロセッサ1A、メモリ2A、入出力インターフェイス3A、周辺回路4A、バス5Aを有する。周辺回路4Aには、様々なモジュールが含まれる。評価装置10は周辺回路4Aを有さなくてもよい。なお、評価装置10は物理的及び/又は論理的に分かれた複数の装置で構成されてもよい。この場合、複数の装置各々が上記ハードウエア構成を備えることができる。 FIG. 3 is a block diagram illustrating the hardware configuration of the evaluation device 10. As shown in FIG. 3, the evaluation device 10 includes a processor 1A, a memory 2A, an input/output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules. The evaluation device 10 does not need to have the peripheral circuit 4A. Note that the evaluation device 10 may be composed of a plurality of physically and/or logically separated devices. In this case, each of the plurality of devices can include the above hardware configuration.
 バス5Aは、プロセッサ1A、メモリ2A、周辺回路4A及び入出力インターフェイス3Aが相互にデータを送受信するためのデータ伝送路である。プロセッサ1Aは、例えばCPU、GPU(Graphics Processing Unit)などの演算処理装置である。メモリ2Aは、例えばRAM(Random Access Memory)やROM(Read Only Memory)などのメモリである。入出力インターフェイス3Aは、入力装置、外部装置、外部サーバ、外部センサ、カメラ(通常のカメラ、紫外線カメラ等)等から情報を取得するためのインターフェイスや、出力装置、外部装置、外部サーバ等に情報を出力するためのインターフェイスなどを含む。入力装置は、例えばキーボード、マウス、マイク、物理ボタン、タッチパネル等である。出力装置は、例えばディスプレイ、スピーカ、プリンター等である。プロセッサ1Aは、各モジュールに指令を出し、それらの演算結果をもとに演算を行うことができる。 The bus 5A is a data transmission path through which the processor 1A, memory 2A, peripheral circuit 4A, and input/output interface 3A exchange data with each other. The processor 1A is, for example, an arithmetic processing device such as a CPU or a GPU (Graphics Processing Unit). The memory 2A is, for example, a RAM (Random Access Memory) or a ROM (Read Only Memory). The input/output interface 3A is an interface for acquiring information from an input device, an external device, an external server, an external sensor, a camera (normal camera, ultraviolet camera, etc.), and an interface for acquiring information from an output device, an external device, an external server, etc. Contains interfaces for outputting. Input devices include, for example, a keyboard, mouse, microphone, physical button, touch panel, and the like. The output device is, for example, a display, speaker, printer, or the like. The processor 1A can issue commands to each module and perform calculations based on the results of those calculations.
「機能構成」
 次に、本実施形態の評価装置10の機能構成を詳細に説明する。図4に、評価装置10の機能ブロック図の一例を示す。図示するように、評価装置10は、取得部11と、画像加工部12と、評価部13と、出力部14とを有する。
"Functional configuration"
Next, the functional configuration of the evaluation device 10 of this embodiment will be explained in detail. FIG. 4 shows an example of a functional block diagram of the evaluation device 10. As illustrated, the evaluation device 10 includes an acquisition section 11, an image processing section 12, an evaluation section 13, and an output section 14.
 取得部11は、紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像を取得する。取得部11は、上述した評価サービスのユーザがユーザ端末20を用いて送信してきた紫外線画像を取得する。なお、当該評価サービスにおいて、ユーザは、紫外線画像を撮影する際等に、正反射光(1)及び正反射光(2)の成分を除去するための操作を行う必要がない。すなわち、ユーザは、特許文献1に開示されている偏光板を用いた正反射光(1)及び正反射光(2)の成分を除去する処理等を行う必要がない。このため、ユーザは、当該評価サービスを手軽に利用することができる。このような前提のため、取得部11が取得する紫外線画像は、内部散乱光の成分のみならず、正反射光(1)及び正反射光(2)の成分も含み得る。 The acquisition unit 11 acquires an ultraviolet image of an object on which a coating film of an ultraviolet protective agent is disposed. The acquisition unit 11 acquires an ultraviolet image transmitted by a user of the above-mentioned evaluation service using the user terminal 20. Note that in the evaluation service, the user does not need to perform an operation to remove the specularly reflected light (1) and specularly reflected light (2) components when photographing an ultraviolet image. That is, the user does not need to perform the process of removing the components of specularly reflected light (1) and specularly reflected light (2) using a polarizing plate as disclosed in Patent Document 1. Therefore, the user can easily use the evaluation service. Due to this premise, the ultraviolet image acquired by the acquisition unit 11 may include not only components of internally scattered light but also components of specularly reflected light (1) and specularly reflected light (2).
 「紫外線防御剤」は、紫外線吸収剤(パラメトキシケイ皮酸2-エチルヘキシル、t-ブチルメトキシジベンゾイルメタン等)及び/又は紫外線散乱剤(微粒子酸化チタン、微粒子酸化亜鉛等)を含有する製剤が挙げられる。製剤としては、液状、ゲル状、半固形状、固形状、泡状、ミスト状及びシート状などの形態が挙げられる。本発明は、紫外線防御剤全般に適用できるが、特に、紫外線吸収剤を含有する紫外線防御剤を対象物の表面に配置した場合に好ましく適用できる。 "Ultraviolet protection agents" are preparations containing ultraviolet absorbers (2-ethylhexyl para-methoxycinnamate, t-butylmethoxydibenzoylmethane, etc.) and/or ultraviolet scattering agents (fine titanium oxide, fine zinc oxide, etc.). Can be mentioned. Examples of the formulation include liquid, gel, semisolid, solid, foam, mist, and sheet forms. The present invention can be applied to all types of UV protection agents, but is particularly preferably applicable when a UV protection agent containing an ultraviolet absorber is placed on the surface of an object.
 「対象物」は、人体等の生体が例示されるが、これに限定されず、その他の物体でもよい。 The "target object" is exemplified by a living body such as a human body, but is not limited to this, and may be any other object.
 「対象物の表面」は、皮膚、毛髪、爪、目等の生体の外表面が例示されるが、これに限定されず、その他の物体の外表面でもよい。 The "surface of the object" is exemplified by the outer surface of a living body such as skin, hair, nails, eyes, etc., but is not limited thereto, and may be the outer surface of other objects.
 「配置」は、対象物の表面に紫外線防御剤の塗膜が接して位置する状態をいう。配置方法は、塗布、貼り付け、付着等のあらゆる手段を採用できる。 "Placement" refers to the state in which the coating film of the ultraviolet protective agent is placed in contact with the surface of the object. As the arrangement method, any means such as coating, pasting, adhesion, etc. can be adopted.
 取得部11は、ユーザ端末20が送信してきた紫外線画像を取得する。 The acquisition unit 11 acquires the ultraviolet image transmitted by the user terminal 20.
 「ユーザ端末20」は、スマートフォン、タブレット端末、携帯電話、携帯ゲーム、パーソナルコンピュータ、スマートウォッチ、スマートミラー、デジタルカメラ等が例示されるが、これらに限定されない。 Examples of the "user terminal 20" include, but are not limited to, a smartphone, a tablet terminal, a mobile phone, a mobile game, a personal computer, a smart watch, a smart mirror, a digital camera, and the like.
 「紫外線画像」は、紫外線を検出するセンサを備えた紫外線カメラで撮影・生成された画像である。 A "ultraviolet image" is an image taken and generated by an ultraviolet camera equipped with a sensor that detects ultraviolet light.
 ユーザ端末20が、紫外線画像を撮影する紫外線カメラ機能を備えてもよい。当該機能は、ユーザ端末20に所定の機器を接続したり所定のソフトウエアをインストールしたりすることで実現されてもよいし、予め出荷段階からユーザ端末20に備わっていてもよい。ユーザは、ユーザ端末20を使って紫外線画像を撮影した後、当該紫外線画像をユーザ端末20から評価装置10に送信してもよい。なお、室内照明には、一般には紫外線が含まれないものが多いので、室内での撮影では紫外線が含まれる光源を利用する。例えば、ユーザ端末20に紫外線を含むLEDを取り付けて利用することもできる。 The user terminal 20 may be equipped with an ultraviolet camera function to take ultraviolet images. The function may be realized by connecting a predetermined device to the user terminal 20 or installing predetermined software, or may be provided in the user terminal 20 in advance from the shipping stage. After photographing an ultraviolet image using the user terminal 20, the user may transmit the ultraviolet image from the user terminal 20 to the evaluation device 10. Note that most indoor lighting generally does not contain ultraviolet rays, so when taking pictures indoors, a light source that contains ultraviolet rays is used. For example, an LED containing ultraviolet light can be attached to the user terminal 20 for use.
 その他、ユーザは、ユーザ端末20と論理的及び/又は物理的に分離した外部装置である紫外線カメラを使って紫外線画像を撮影してもよい。そして、ユーザは、任意の手段で当該紫外線画像をユーザ端末20に入力し、当該紫外線画像をユーザ端末20から評価装置10に送信してもよい。室内での撮影では紫外線が含まれる光源を利用する。例えば、紫外線カメラに紫外線を含むLEDを取り付けて利用することもできる。 In addition, the user may take an ultraviolet image using an ultraviolet camera that is an external device that is logically and/or physically separated from the user terminal 20. Then, the user may input the ultraviolet image into the user terminal 20 by any means, and transmit the ultraviolet image from the user terminal 20 to the evaluation device 10. When shooting indoors, a light source that contains ultraviolet light is used. For example, it is also possible to use an ultraviolet camera by attaching an LED that emits ultraviolet light.
 図1に示すように、評価装置10及びユーザ端末20はインターネット等の通信ネットワーク30に接続されている。ユーザ端末20と評価装置10との間の紫外線画像の送受信は通信ネットワーク30を介して実現される。例えば、ユーザ端末20には、評価サービス専用のアプリケーションプログラム(ソフトウエア)がインストールされていてもよい。そして、当該アプリケーションプログラムに搭載された機能を介して、ユーザ端末20から評価装置10への紫外線画像の送信(アップロード)が実現されてもよい。その他、評価サービス専用のウェブページが用意されてもよい。そして、ユーザ端末20にインストールされたウェブブラウザを介して当該ウェブページにアクセスした後、当該ウェブページに搭載された機能を介して、ユーザ端末20から評価装置10への紫外線画像の送信(アップロード)が実現されてもよい。なお、電子メールの添付ファイルとしての送受信等、その他の手段で紫外線画像の送受信が実現されてもよい。 As shown in FIG. 1, the evaluation device 10 and the user terminal 20 are connected to a communication network 30 such as the Internet. Transmission and reception of ultraviolet images between the user terminal 20 and the evaluation device 10 is realized via the communication network 30. For example, an application program (software) dedicated to the evaluation service may be installed on the user terminal 20. Then, transmission (upload) of the ultraviolet image from the user terminal 20 to the evaluation device 10 may be realized via a function installed in the application program. In addition, a web page dedicated to the evaluation service may be prepared. After accessing the web page via the web browser installed on the user terminal 20, the ultraviolet image is transmitted (uploaded) from the user terminal 20 to the evaluation device 10 via the function installed in the web page. may be realized. Note that the transmission and reception of the ultraviolet image may be realized by other means, such as transmission and reception as an email attachment.
 画像加工部12は、正反射光の成分を紫外線画像から除去した加工画像を、学習モデルを用いて生成する。除去する正反射光の成分は、図2を用いて説明した正反射光(1)及び正反射光(2)の成分である。 The image processing unit 12 uses a learning model to generate a processed image in which the specularly reflected light component is removed from the ultraviolet image. The specularly reflected light components to be removed are the specularly reflected light (1) and specularly reflected light (2) components described using FIG.
 予め、「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像」から「正反射光の成分を除去した画像」を生成する学習モデルが用意される。 A learning model is prepared in advance that generates an ``image from which specularly reflected light components have been removed'' from an ``ultraviolet image taken of an object whose surface has a coating film of an ultraviolet protective agent.''
 学習モデルの生成手段は特段制限されず、あらゆる手段を採用できる。例えば、特許文献2に開示の技術を利用してもよい。以下、学習モデルの生成手段の一例を説明する。 The means for generating a learning model is not particularly limited, and any means can be adopted. For example, the technique disclosed in Patent Document 2 may be used. An example of a learning model generating means will be described below.
 学習モデルは、「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を含む画像」と、「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を含まない画像」とをペアとする複数の教師データに基づく機械学習で生成される。 The learning model uses ``an ultraviolet image taken of an object on which a coating film of an ultraviolet protection agent is placed on the surface, which includes a component of specularly reflected light,'' and an image that contains a component of specularly reflected light. It is generated by machine learning based on a plurality of training data paired with an "ultraviolet light image of the object that does not include a specularly reflected light component."
 図5に、教師データの一例を示す。(A)の画像が、「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を含む画像」である。そして、(B)の画像が、「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を含まない画像」である。この画像は市販のO/W型の紫外線防止剤を顔に1.0mg/cmの塗布量で塗布した時の状態であり、光源には紫外線を含む一般的なキセノン光源を使用し、カメラは紫外線領域の315nm~325nmのバンドバスフィルターが搭載された一般的な紫外線カメラで撮影したものである。 FIG. 5 shows an example of teacher data. The image (A) is an ultraviolet image taken of an object on which a coating film of an ultraviolet protective agent is disposed, and includes a specularly reflected light component. The image (B) is "an ultraviolet image taken of an object on which a coating film of an ultraviolet protective agent is disposed, and does not contain a specularly reflected light component." This image shows the condition when a commercially available O/W type UV inhibitor is applied to the face at a coating amount of 1.0mg/ cm2 , and a general xenon light source containing ultraviolet rays is used as the light source, and a camera is used. These images were taken with a general ultraviolet camera equipped with a bandpass filter in the ultraviolet range of 315 nm to 325 nm.
 当該教師データを生成する手段は特段制限されないが、通常、光源と紫外線カメラ、偏光板を使用することで生成することができる。例えば特許文献1に開示の技術を利用することができる。特許文献1に開示の技術における第1の偏光板及び第2の偏光板を適切に調整することで、正反射光の成分を透過させたり、除去したりできる。正反射光の成分を透過させるように調整した場合、「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を含む画像」を撮影することができる。一方、正反射光の成分を除去するように調整した場合、「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を含まない画像」を撮影することができる。 The means for generating the teacher data is not particularly limited, but it can usually be generated by using a light source, an ultraviolet camera, and a polarizing plate. For example, the technique disclosed in Patent Document 1 can be used. By appropriately adjusting the first polarizing plate and the second polarizing plate in the technique disclosed in Patent Document 1, the specularly reflected light component can be transmitted or removed. When adjusted to transmit the specularly reflected light component, an ultraviolet image that includes the specularly reflected light component is taken of an object whose surface is coated with an ultraviolet protective agent. I can do it. On the other hand, if the adjustment is made to remove the specularly reflected light component, "an ultraviolet image taken of an object with a coating film of an ultraviolet protective agent on its surface that does not contain the specularly reflected light component" Can be photographed.
 なお、教師データとして「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を含まない画像」を使用するときは、生成された「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を含まない画像」の明るさを調整して使用することもできる。 Note that when using ``an ultraviolet image taken of an object with a coating film of an ultraviolet protection agent on its surface that does not include specularly reflected light components'' as training data, the generated ``ultraviolet protection It is also possible to adjust the brightness of an image that is an ultraviolet image taken of an object on which a coating film of the agent is disposed and that does not contain a specularly reflected light component.
 学習の手段の一例として、生成器と識別器を用いる場合について説明する。 As an example of the learning means, a case will be described in which a generator and a discriminator are used.
 生成器は、教師データである「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を含む画像」から「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を除去した画像」を生成するように、例えば多段の畳み込みニューラルネットワーク(CCN)で構成される。 The generator uses the training data, ``an ultraviolet image taken of an object with a coating film of an ultraviolet protection agent on its surface, which includes a component of specularly reflected light'', to It is constructed using, for example, a multi-stage convolutional neural network (CCN) to generate an ultraviolet image taken of an object placed in the area, with the specularly reflected light component removed.
 識別器は、教師データである「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を含まない画像」と、生成器が生成した「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を除去した画像」との差分画像を求めて、差が大きいと判断されるルール、例えば一致度が所定の割合以上である、を満たさないとき、2つの画像が異なると識別するように構成される。 The discriminator uses the training data, ``an ultraviolet image taken of an object with a coating film of an ultraviolet protective agent on its surface, which does not include specularly reflected light components,'' and the ``ultraviolet ray image'' generated by the generator. An ultraviolet image taken of an object with a protective agent coating on its surface, from which the specularly reflected light component has been removed. The two images are configured to be identified as different when the degree of degree is not less than a predetermined ratio.
 そして、上記2つの画像を識別できるように識別器のパラメータ、すなわち差分の所定値を調整し、識別器が正しく識別できない画像を生成できるように生成器のパラメータを調整する。調整を終えた結果のパラメータを備えた生成器が、本発明で用いる学習モデルとなる。 Then, the parameters of the classifier, that is, the predetermined value of the difference, are adjusted so that the two images can be discriminated, and the parameters of the generator are adjusted so that the classifier can generate an image that cannot be correctly identified. A generator provided with parameters resulting from the adjustment becomes a learning model used in the present invention.
 なお、紫外線防御剤として紫外線吸収剤が配合されている市販品A(花王株式会社製エビータ モイストウォーターシールド UV)を顔の一部の4cm四方に1mg/cm2で塗布した。この塗布した領域と、塗布していない領域を含む条件で、「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を含まない画像」と「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を除去した画像(生成器が生成した画像)」とを取得し、計3枚の画像を用いてその一致度を確認したところ一致度は約80.0%であった。一致度が約80.0%となった2つの画像の一例を、図12に示す。図示する「偏光板で正反射光を含まないようにした画像」が「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を含まない画像」である。そして、図示する「機械学習で正反射光を除去した画像」が「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を除去した画像(生成器が生成した画像)」である。一致度は以下の手順で算出した。 A commercially available product A (Evita Moist Water Shield UV manufactured by Kao Corporation) containing an ultraviolet absorber as an ultraviolet protection agent was applied at 1 mg/cm 2 to a 4 cm square part of the face. Under conditions that include the coated area and the uncoated area, it is determined that the image is an ultraviolet image taken of an object on which a coating film of an ultraviolet protective agent is placed, and that does not include specularly reflected light components. ``An ultraviolet image taken of an object with a coating film of ultraviolet protection agent placed on its surface, with the specularly reflected light component removed (image generated by the generator)'', and a total of three images are obtained. When the degree of concordance was confirmed using images, the degree of concordance was approximately 80.0%. An example of two images with a matching degree of about 80.0% is shown in FIG. The "image created using a polarizing plate to exclude specularly reflected light" is "an ultraviolet image taken of an object on which a coating film of an ultraviolet protective agent is placed, and which does not contain specularly reflected light components." ”. The "image from which specularly reflected light has been removed using machine learning" shown in the figure is "an ultraviolet image taken of an object with a coating film of an ultraviolet protective agent on its surface, and from which the specularly reflected light component has been removed" ( image generated by the generator). The degree of agreement was calculated using the following procedure.
(1)「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を含まない画像」の中から塗りむらのある範囲(塗布されていない部分を含む)をImageJを使って80×80ピクセルの範囲の輝度値データを抽出する。
(2)横軸を輝度値、縦軸をピクセル数としたグラフをエクセルで作成し、近傍5点移動平均値を算出し、隣接セルとの差分が負から正に切り替わる点を極小値とする。
(3)輝度値0から輝度値の極小値までの積分値を塗布されている領域とし(積分値1)、ヒストグラム全体の積分値(積分値2)の比率(積分値1/積分値2)を求める。
(4)「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を除去した画像(生成器が生成した画像)」の上記(1)で抽出した範囲について、同様に(2)から(4)を行い比率を求める。なお、上記(1)で任意に抽出した範囲は画像1枚に対して3箇所である。
(5)「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を含まない画像」から算出した比率と、「紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像であって、正反射光の成分を除去した画像(生成器が生成した画像)」から算出した比率を比較し、その一致度を計算した。
(1) Areas with uneven coating (uncoated areas) from "an ultraviolet image taken of an object on which a coating film of an ultraviolet protective agent is placed and which does not contain specularly reflected light components" ) and use ImageJ to extract luminance value data in a range of 80 x 80 pixels.
(2) Create a graph in Excel with the horizontal axis as the brightness value and the vertical axis as the number of pixels, calculate the moving average value of 5 points in the vicinity, and define the point where the difference with the adjacent cell changes from negative to positive as the minimum value. .
(3) The integral value from luminance value 0 to the minimum luminance value is defined as the applied area (integral value 1), and the ratio of the integral value (integral value 2) of the entire histogram (integral value 1/integral value 2) seek.
(4) In the above (1) of "An ultraviolet image taken of an object on which a coating film of an ultraviolet protective agent is placed, the specularly reflected light component is removed (an image generated by a generator)" For the extracted range, similarly perform steps (2) to (4) to find the ratio. Note that the ranges arbitrarily extracted in (1) above are three for one image.
(5) The ratio calculated from "an ultraviolet image taken of an object with a coating film of ultraviolet protection agent on its surface, which does not include a specularly reflected light component" and The ratios calculated from "an ultraviolet image taken of an object placed on the surface, with the specularly reflected light component removed (image generated by the generator)" were compared, and the degree of agreement was calculated.
 また同様に、紫外線吸収剤と紫外線散乱剤が配合されている市販品B(花王株式会社製センサイ シルキィ ブロンズ セルラー プロテクティブ クリーム フォー ボディ)を使用した場合の一致度は約70.0%であった。 Similarly, when commercial product B (Sensai Silky Bronze Cellular Protective Cream for Body manufactured by Kao Corporation), which contains a UV absorber and a UV scattering agent, was used, the degree of concordance was approximately 70.0%.
 画像加工部12は、取得部11が取得した紫外線画像を上記学習モデルに入力し、当該学習モデルから出力される「正反射光の成分を紫外線画像から除去した加工画像」を取得する。 The image processing unit 12 inputs the ultraviolet image acquired by the acquisition unit 11 into the learning model, and acquires a “processed image obtained by removing the specularly reflected light component from the ultraviolet image” output from the learning model.
 評価部13は、画像加工部12が生成した加工画像に基づき紫外線防御剤に関する評価を行い、当該評価の結果を示す評価結果データを生成する。 The evaluation unit 13 evaluates the ultraviolet protective agent based on the processed image generated by the image processing unit 12, and generates evaluation result data indicating the results of the evaluation.
 評価部13は、紫外線防御剤に関する評価として、紫外線防御剤の塗りむら評価、及び紫外線防御剤の性能評価の少なくとも一方を実行する。評価部13は、紫外線防御剤の塗りむら評価、及び紫外線防御剤の性能評価のいずれか一方のみを行うように構成されてもよいし、両方を行うように構成されてもよい。以下、各々について説明する。 The evaluation unit 13 performs at least one of coating unevenness evaluation of the ultraviolet protection agent and performance evaluation of the ultraviolet protection agent as evaluation regarding the ultraviolet protection agent. The evaluation unit 13 may be configured to perform only one of the coating unevenness evaluation of the ultraviolet protective agent and the performance evaluation of the ultraviolet protective agent, or may be configured to perform both. Each will be explained below.
-紫外線防御剤の塗りむら評価-
 本実施形態の塗りむら評価では、
・塗られているところと、塗られていないところを識別する評価、及び、
・塗られているところの中で、塗布量が適切(多すぎず、かつ少なすぎず)なところと、塗布量が不適切(多すぎ、又は少なすぎ)なところを識別する評価、
を行うことができる。
- Evaluation of uneven coating of UV protection agent -
In the uneven coating evaluation of this embodiment,
・Evaluation to identify painted areas and unpainted areas, and
・Evaluation that identifies areas where the amount of application is appropriate (not too much or too little) and areas where the amount of application is inappropriate (too much or too little).
It can be performed.
 正反射光の成分を紫外線画像から除去した加工画像においては、加工画像で示される対象物の表面の各箇所の状態は、各箇所で反射した内部散乱光の強さの程度を示す。各箇所で反射した内部散乱光の強さの程度は、各箇所における紫外線防御剤の塗布量に応じたものとなる。紫外線防御剤の塗布量が増えるほど、反射した内部散乱光の強さは弱くなる。なお、各箇所で反射した紫外線(内部散乱光)の強さの程度、すなわち各箇所における紫外線防御剤の塗布量の程度は、加工画像の輝度値で評価できる。図11に示すように、紫外線防御剤の塗布量が少ないと、内部散乱光の強さは強くなり、輝度値が大きくなる。一方、紫外線防御剤の塗布量が多いと、内部散乱光の強さは弱くなり、輝度値が小さくなる。適切な量の紫外線防御剤を塗布した箇所の加工画像の輝度値に基づき適切な閾値を設定し、加工画像の各箇所の輝度値とこの閾値との比較により、各箇所における紫外線防御剤の塗布量が適切か否かを判定することができる。 In a processed image in which the specularly reflected light component is removed from the ultraviolet image, the state of each location on the surface of the object shown in the processed image indicates the intensity of internally scattered light reflected at each location. The intensity of the internally scattered light reflected at each location depends on the amount of ultraviolet protection agent applied at each location. As the amount of UV protection agent applied increases, the intensity of reflected internally scattered light becomes weaker. Note that the intensity of the ultraviolet light (internally scattered light) reflected at each location, that is, the amount of the ultraviolet protective agent applied at each location, can be evaluated by the brightness value of the processed image. As shown in FIG. 11, when the applied amount of the ultraviolet protection agent is small, the intensity of internally scattered light becomes strong and the brightness value becomes large. On the other hand, when the applied amount of the ultraviolet protection agent is large, the intensity of internally scattered light becomes weak and the brightness value becomes small. An appropriate threshold value is set based on the brightness value of the processed image at the location where an appropriate amount of UV protection agent has been applied, and the application of UV protection agent at each location is determined by comparing the brightness value of each location in the processed image with this threshold value. It can be determined whether the amount is appropriate.
 図11に示すように、適切な量の紫外線防御剤を塗布した箇所の輝度値の上限値を第1の閾値と設定した場合、検出された内部散乱光の強さの程度(輝度値)が第1の閾値より大きい箇所は、紫外線防御剤が全く塗布されていないか、又は塗布されているが塗布量が不適切(少なすぎ)な箇所である。また、適切な量の紫外線防御剤を塗布した部分の輝度値の下限値を第2の閾値と設定した場合、検出された内部散乱光の強さの程度(輝度値)が第2の閾値より小さい箇所は、紫外線防御剤が塗布されているが、塗布量が不適切(多すぎ)な箇所である。検出された内部散乱光の強さの程度(輝度値)が第1の閾値と第2の閾値との間である箇所は、紫外線防御剤が塗布され、塗布量が適切な箇所である。 As shown in Figure 11, when the upper limit of the brightness value of the area where an appropriate amount of UV protection agent is applied is set as the first threshold value, the degree of intensity of the detected internally scattered light (brightness value) Locations larger than the first threshold are locations where no ultraviolet protective agent is applied at all, or where the UV protection agent is applied but the amount of application is inappropriate (too little). In addition, if the lower limit of the brightness value of the area where an appropriate amount of UV protection agent is applied is set as the second threshold value, the degree of intensity of the detected internally scattered light (brightness value) will be lower than the second threshold value. Small areas are areas where the ultraviolet protection agent is applied, but the amount applied is inappropriate (too much). A location where the intensity level (luminance value) of the detected internally scattered light is between the first threshold value and the second threshold value is a location where the ultraviolet protection agent is applied and the amount of application is appropriate.
 評価部13は、対象物の中で散乱した紫外線(内部散乱光)の強さの程度(輝度値)が第1の閾値より大きい箇所を、紫外線防御剤の塗布量が第1の基準より少ない箇所として検出することができる。そして、評価部13は、当該検出結果を示す評価結果データを生成することができる。 The evaluation unit 13 evaluates areas where the intensity (luminance value) of the ultraviolet rays scattered within the object (internally scattered light) is greater than a first threshold, and determines where the applied amount of the ultraviolet protective agent is less than the first standard. It can be detected as a location. The evaluation unit 13 can then generate evaluation result data indicating the detection result.
 「第1の基準」は、紫外線防御剤の塗布量の合否(塗布量が少ない部分)を判定する基準である。第1の基準は、第1の閾値を基準に判定される。第1の閾値は加工画像の輝度値で定義される。第1の閾値は、適切な量の範囲の下限量の紫外線防御剤を塗布した箇所の加工画像の輝度値である。図11に示すように、第1の閾値は、塗布量が不適切(少なすぎる)と判断される不合格レベルの上限値である。換言すれば、第1の閾値が、塗布量が適切と判断される合格レベルの下限値である。加工画像の中で第1の閾値(輝度値)より大きい輝度値の箇所は、紫外線防御剤の塗布量が不適切(少ない)と判断される。塗布量が少なすぎる部分は充分な紫外線防御効果を得られない。 The "first criterion" is a criterion for determining whether the amount of UV protection agent applied is acceptable (the portion where the amount of application is small). The first criterion is determined based on the first threshold value. The first threshold value is defined by the brightness value of the processed image. The first threshold value is the brightness value of the processed image at the location where the lower limit amount of the ultraviolet protection agent is applied in the appropriate amount range. As shown in FIG. 11, the first threshold is the upper limit of the rejection level at which the coating amount is determined to be inappropriate (too small). In other words, the first threshold is the lower limit of the acceptable level at which the amount of coating is determined to be appropriate. In the processed image, it is determined that the applied amount of the ultraviolet protective agent is inappropriate (small) at a location where the luminance value is larger than the first threshold value (luminance value). Areas where the amount of coating is too small will not provide sufficient UV protection.
 評価部13は、評価結果データとして、対象物を示す画像上に、紫外線防御剤の塗りむら評価の結果を重畳した画像を生成することができる。具体的には、評価部13は、対象物を示す画像上に、紫外線防御剤の塗布量が第1の基準より少ない箇所(輝度値が第1の閾値より大きい箇所)を示す情報を重畳し、当該箇所を目立つように識別表示した画像を生成することができる。 The evaluation unit 13 can generate, as evaluation result data, an image in which the results of the uneven coating evaluation of the ultraviolet protective agent are superimposed on the image showing the object. Specifically, the evaluation unit 13 superimposes information indicating locations where the applied amount of the ultraviolet protective agent is less than the first standard (locations where the brightness value is greater than the first threshold value) on the image showing the target object. , it is possible to generate an image in which the location is prominently identified.
 図6に、評価部13が生成した画像の一例を模式的に示す。図6では、評価部13が生成した画像がユーザ端末20のディスプレイDに表示されている様子が示されている。図示する例では、対象物は人体である。そして、対象物を示す画像上に、点線で一部領域を囲む枠Mが重畳表示されている。枠Mで囲まれた箇所が、紫外線防御剤の塗布量が第1の基準より少ない箇所である。図示する例では、枠Mで囲まれた部分にもう少し紫外線防御剤を塗布することを提案するアドバイスがさらに表示されている。 FIG. 6 schematically shows an example of an image generated by the evaluation unit 13. FIG. 6 shows an image generated by the evaluation unit 13 being displayed on the display D of the user terminal 20. In the illustrated example, the object is a human body. A frame M surrounding a partial area with a dotted line is superimposed on the image representing the object. The area surrounded by frame M is the area where the amount of UV protection agent applied is less than the first standard. In the illustrated example, advice is further displayed suggesting applying a little more UV protection agent to the area surrounded by frame M.
 なお、図示する例では、枠Mで囲むことで所定箇所を目立つように識別表示しているが、その他、所定箇所を着色したり、所定箇所にアイコンやスタンプを表示することで目立つような識別表示を実現してもよい。 In the illustrated example, the predetermined location is clearly identified by surrounding it with a frame M, but other methods such as coloring the predetermined location or displaying an icon or stamp in the predetermined location may be used to make the predetermined location conspicuous for identification. Display may also be realized.
 「対象物を示す画像」は、取得部11が取得した紫外線画像であってもよいし、画像加工部12が生成した加工画像であってもよい。その他、取得部11は、紫外線画像に加えて、通常のカメラ(可視光域の光を検出するセンサを備えたカメラ)で対象物を撮影した画像をユーザ端末20から取得してもよい。そして、当該画像を上記「対象物を示す画像」として利用してもよい。また、カメラ機能起動時にユーザ端末20のファインダー(ディスプレイ)に表示される画像を、上記「対象物を示す画像」として利用してもよい。 The "image showing the target object" may be an ultraviolet image acquired by the acquisition unit 11 or a processed image generated by the image processing unit 12. In addition to the ultraviolet image, the acquisition unit 11 may also acquire from the user terminal 20 an image of the object taken with a normal camera (a camera equipped with a sensor that detects light in the visible light range). Then, the image may be used as the above-mentioned "image showing the target object". Furthermore, an image displayed on the finder (display) of the user terminal 20 when the camera function is activated may be used as the above-mentioned "image showing the target object."
 他の例として、図11に示すように、評価部13は、対象物の中で散乱した紫外線(内部散乱光)の強さの程度(輝度値)が第2の閾値より小さい箇所を、紫外線防御剤の塗布量が第2の基準より多い箇所として検出することができる。そして、評価部13は、当該検出結果を示す評価結果データを生成することができる。 As another example, as shown in FIG. 11, the evaluation unit 13 evaluates the location where the intensity (luminance value) of the ultraviolet rays scattered in the object (internally scattered light) is smaller than the second threshold value. It can be detected as a location where the amount of protective agent applied is greater than the second standard. The evaluation unit 13 can then generate evaluation result data indicating the detection result.
「第2の基準」は、紫外線防御剤の塗布量の合否(塗布量が多い部分)を判定するもう1つの基準である。第2の基準は、第2の閾値を基準に判定される。第2の閾値は加工画像の輝度値で定義される。第2の閾値は、適切な量の範囲の上限量の紫外線防御剤を塗布した箇所の加工画像の輝度値である。図11に示すように、第2の閾値は、塗布量が不適切(多い)と判断される不合格レベルの下限値である。換言すれば、第2の閾値が、塗布量が適切と判断される合格レベルの上限値である。加工画像の中で第2の閾値(輝度値)より小さい輝度値の箇所は、紫外線防御剤の塗布量が不適切(多すぎる)と判断される。塗布量が多すぎる部分は、使用感の悪化を引き起こす原因になる。また、過剰量の消費により必要以上の紫外線防御剤の購入につながったり(無駄使い)、過剰量の塗布により過剰量の紫外線防御剤を洗い流すことにもなり環境負荷を高める原因にもなり、SDGsの観点から好ましくない。 The "second criterion" is another criterion for determining whether the amount of ultraviolet protection agent applied is acceptable (the portion where the amount of application is large). The second criterion is determined based on the second threshold value. The second threshold is defined by the brightness value of the processed image. The second threshold value is the brightness value of the processed image at the location where the upper limit of the appropriate amount range of UV protection agent is applied. As shown in FIG. 11, the second threshold is the lower limit of the rejection level at which it is determined that the coating amount is inappropriate (large). In other words, the second threshold is the upper limit of the pass level at which the coating amount is determined to be appropriate. In the processed image, it is determined that the applied amount of the ultraviolet protective agent is inappropriate (too large) at a location where the luminance value is smaller than the second threshold value (luminance value). Areas where too much is applied may cause a poor feeling of use. In addition, consuming excessive amounts may lead to purchasing more UV protection agents than necessary (wasteful use), and applying excessive amounts may cause the excess amount of UV protection agents to be washed away, increasing environmental impact. undesirable from this point of view.
 評価部13は、図6に示す手法と同様の手法で、当該検出結果を示す評価結果データを生成することができる。当該例の場合、評価部13は、対象物を示す画像上に、紫外線防御剤の塗布量が第2の基準より多い箇所を示す情報(枠M)を重畳し、当該箇所を目立つように識別表示した画像を生成することができる。この例の場合、枠Mで囲まれた部分には過剰な紫外線防御剤が塗布されていることの通知とともに、それ以外の箇所にもう少し紫外線防御剤を塗布することを提案するアドバイスがさらに表示されてもよい。なお、評価部13は、図6に示す手法と同様の手法で、紫外線防御剤の塗布量が第1の基準より少ない箇所(不合格:少なすぎ)、及び紫外線防御剤の塗布量が第2の基準より多い箇所(不合格:多すぎ)の両方を目立つように識別表示した画像を生成し、出力してもよい。例えば、評価部13は、紫外線防御剤の塗布量が第1の基準より少ない箇所(不合格:少なすぎ)、及び紫外線防御剤の塗布量が第2の基準より多い箇所(不合格:多すぎ)の両方を同じ画面上で各々を識別可能に識別表示した画像を生成し、出力してもよい。 The evaluation unit 13 can generate evaluation result data indicating the detection result using a method similar to the method shown in FIG. In the case of this example, the evaluation unit 13 superimposes information (frame M) indicating a location where the amount of UV protection agent applied is greater than the second standard on the image showing the target object, and identifies the location conspicuously. Displayed images can be generated. In this example, a notification that too much UV protection agent has been applied to the area surrounded by frame M is displayed, along with advice suggesting that a little more UV protection agent be applied to other areas. It's okay. In addition, the evaluation unit 13 uses a method similar to the method shown in FIG. It is also possible to generate and output an image that prominently identifies and displays both locations that exceed the standard (failure: too many). For example, the evaluation unit 13 evaluates the areas where the amount of UV protection agent applied is less than the first standard (fail: too little) and the area where the amount of UV protection agent applied is more than the second standard (fail: too much). ) may be generated and output on the same screen in an image in which each is displayed in a distinguishable manner.
 評価部13は、検出された紫外線(内部散乱光)の強さの程度(輝度値)が第1の閾値より小さく(紫外線防御剤の塗布量が第1の基準より多い)、かつ第2の閾値より大きい(紫外線防御剤の塗布量が第2の基準より少ない)箇所を、紫外線防御剤の塗布量が適切(合格:多すぎず、少なすぎず)と判断する。 The evaluation unit 13 determines that the degree of intensity (luminance value) of the detected ultraviolet rays (internally scattered light) is smaller than the first threshold value (the applied amount of the ultraviolet protective agent is larger than the first criterion), and A portion where the amount of UV protection agent applied is larger than the threshold value (the amount of UV protection agent applied is less than the second standard) is determined to be appropriate (passed: not too much, not too little).
-性能評価-
 評価部13は、検出された紫外線を任意の値で除算し、紫外線反射率として検出することができる。紫外線反射率は低いほど紫外線防止効果が高いことを意味する。評価部13は、紫外線反射率を示す評価結果データを生成することができる。そして、紫外線反射率に基づいて紫外線防御剤の紫外線防御効果を評価することができる。なお、任意の値としては人の素肌などの平均的な紫外線反射強度でもよいし、紫外線防御剤を塗布する前の対象物の紫外線反射強度でもよい。例えば、以下の式のいずれかで計算できる。
(紫外線反射率)=(紫外線防御剤を塗布した肌の紫外線反射強度)/(紫外線防御剤を塗布していない素肌の平均的な紫外線反射強度)
(紫外線反射率)=(紫外線防御剤を塗布した対象物の紫外線反射強度)/(紫外線防御剤を塗布する前の対象物の紫外線反射強度)
-Performance evaluation-
The evaluation unit 13 can divide the detected ultraviolet rays by an arbitrary value and detect the result as ultraviolet reflectance. The lower the UV reflectance, the higher the UV protection effect. The evaluation unit 13 can generate evaluation result data indicating ultraviolet reflectance. Then, the UV protection effect of the UV protection agent can be evaluated based on the UV reflectance. Note that the arbitrary value may be the average ultraviolet reflection intensity of human bare skin or the like, or the ultraviolet reflection intensity of the object before applying the ultraviolet protection agent. For example, it can be calculated using one of the following formulas:
(UV reflectance) = (UV reflection intensity of skin coated with UV protection agent) / (average UV reflection intensity of bare skin without UV protection coating)
(UV reflectance) = (UV reflection intensity of the object coated with UV protection agent) / (UV reflection intensity of the object before applying the UV protection agent)
 図4に戻り、出力部14は、評価部13が生成した評価結果データを出力する。出力部14は、ユーザ端末20に評価結果データを送信する。ユーザ端末20は、受信した評価結果データを、ディスプレイ、投影装置、プリンター等の出力装置を介して出力する。 Returning to FIG. 4, the output unit 14 outputs the evaluation result data generated by the evaluation unit 13. The output unit 14 transmits evaluation result data to the user terminal 20. The user terminal 20 outputs the received evaluation result data via an output device such as a display, a projection device, or a printer.
 次に、図7のフローチャートを用いて、評価装置10の処理の流れの一例を説明する。 Next, an example of the process flow of the evaluation device 10 will be described using the flowchart in FIG. 7.
 まず、評価装置10は、紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像を取得する(S10)。評価装置10は、ユーザ端末20が送信してきた紫外線画像を取得する。 First, the evaluation device 10 acquires an ultraviolet image of an object having a coating film of an ultraviolet protective agent on its surface (S10). The evaluation device 10 acquires the ultraviolet image transmitted by the user terminal 20.
 次いで、評価装置10は、正反射光の成分を紫外線画像から除去した加工画像を、学習モデルを用いて生成する(S11)。次いで、評価装置10は、加工画像に基づき紫外線防御剤に関する評価を行い、評価の結果を示す評価結果データを生成する(S12)。 Next, the evaluation device 10 uses the learning model to generate a processed image in which the specularly reflected light component is removed from the ultraviolet image (S11). Next, the evaluation device 10 performs evaluation regarding the ultraviolet protective agent based on the processed image, and generates evaluation result data indicating the evaluation results (S12).
 そして、評価装置10は、S12で生成した評価結果データを出力する(S13)。評価装置10は、評価結果データをユーザ端末20に送信する。ユーザ端末20は、受信した評価結果データを、ディスプレイ、投影装置、プリンター等の出力装置を介して出力する(図6参照)。 Then, the evaluation device 10 outputs the evaluation result data generated in S12 (S13). The evaluation device 10 transmits evaluation result data to the user terminal 20. The user terminal 20 outputs the received evaluation result data via an output device such as a display, a projection device, or a printer (see FIG. 6).
「作用効果」
 本実施形態の評価装置10によれば、ユーザは、自身で紫外線画像を撮影し、当該紫外線画像を評価装置10に送信する操作を行うことで、紫外線防御剤に関する各種評価、具体的には塗りむら評価や性能評価を行うことができる。このように、本実施形態の評価装置10によれば、ユーザは手軽に紫外線防御剤に関する各種評価を行うことが可能となる。
"effect"
According to the evaluation device 10 of the present embodiment, the user can conduct various evaluations regarding the ultraviolet protective agent, specifically, by performing an operation to take an ultraviolet image and transmit the ultraviolet image to the evaluation device 10. It is possible to perform unevenness evaluation and performance evaluation. In this way, according to the evaluation device 10 of this embodiment, the user can easily perform various evaluations regarding the ultraviolet protective agent.
 また、本実施形態の評価装置10によれば、図6に示すように、紫外線防御剤の塗布量が第1の基準より少ない箇所、及び紫外線防御剤の塗布量が第2の基準より多い箇所の少なくとも一方を目立つように識別表示した画像を生成し、出力することができる。ユーザは、当該画像に基づき、紫外線防御剤の塗布が足りていない箇所や多すぎる箇所を直感的に把握することができる。そして、塗りむらの少ない理想的な塗布状態を獲得することができる。 Furthermore, according to the evaluation device 10 of this embodiment, as shown in FIG. 6, there are locations where the amount of UV protection agent applied is less than the first standard, and locations where the amount of application of the UV protection agent is greater than the second standard. It is possible to generate and output an image in which at least one of the following is prominently identified and displayed. Based on the image, the user can intuitively understand where the UV protection agent is not applied enough or where it is applied too much. Then, it is possible to obtain an ideal coating state with less uneven coating.
 また、学習モデルを用いて「正反射光の成分を紫外線画像から除去した加工画像」を生成し、当該加工画像に基づき紫外線防御剤に関する評価を行う評価装置10によれば、偏光板を用いずに正反射光の成分を除去した紫外線画像を生成し、その紫外線画像に基づき紫外線防御剤に関する評価を行うことができる。 Furthermore, according to the evaluation device 10 that uses a learning model to generate a "processed image in which the specularly reflected light component is removed from the ultraviolet image" and performs an evaluation regarding the ultraviolet protective agent based on the processed image, the evaluation device 10 does not use a polarizing plate. It is possible to generate an ultraviolet image with specularly reflected light components removed, and to evaluate the ultraviolet protective agent based on the ultraviolet image.
<第2の実施形態>
 本実施形態の評価装置10は、第1の実施形態で説明した通り、対象物の中で散乱した紫外線(内部散乱光)の強さの程度(輝度値)が第1の閾値より大きい箇所を、紫外線防御剤の塗布量が第1の基準より少ない箇所(塗布量が少なすぎる箇所)として検出する。また、評価装置10は、対象物の中で散乱した紫外線(内部散乱光)の強さの程度(輝度値)が第2の閾値より小さい箇所を、紫外線防御剤の塗布量が第2の基準より多い箇所(塗布量が多すぎる箇所)として検出する。そして、評価装置は、第1の閾値及び第2の閾値を動的に変更することができる。以下、詳細に説明する。
<Second embodiment>
As explained in the first embodiment, the evaluation device 10 of this embodiment detects a location where the intensity (luminance value) of ultraviolet rays (internally scattered light) scattered within the object is greater than the first threshold value. , the area is detected as a location where the amount of applied ultraviolet protective agent is less than the first standard (a location where the amount of application is too small). In addition, the evaluation device 10 evaluates the areas where the intensity (luminance value) of the ultraviolet rays scattered in the object (internally scattered light) is smaller than the second threshold value, based on the amount of applied ultraviolet protective agent It is detected as a location where the amount of coating is too large (a location where the amount of coating is too large). Then, the evaluation device can dynamically change the first threshold value and the second threshold value. This will be explained in detail below.
 第1の実施形態で説明した通り、評価部13は、対象物の中で散乱した紫外線(内部散乱光)の強さの程度(輝度値)が第1の閾値より大きい箇所を、紫外線防御剤の塗布量が第1の基準より少ない箇所(塗布量が少なすぎる箇所)として検出することができる。 As described in the first embodiment, the evaluation unit 13 evaluates the UV protection agent at a location where the intensity (luminance value) of the UV light scattered inside the object (internally scattered light) is greater than the first threshold value. can be detected as a location where the amount of application is less than the first reference (a location where the amount of application is too small).
 そして、評価部13は、評価時の日付、時刻、及び紫外線量の予報の中の少なくとも1つに基づき第1の閾値を決定する。すなわち、評価時の日付、時刻、及び紫外線量の予報の中の少なくとも1つに基づき、塗布量が「適切」か「不足している(少なすぎる)」かを判断するための第1の閾値を決定する。 Then, the evaluation unit 13 determines the first threshold based on at least one of the date and time at the time of evaluation, and the forecast of the amount of ultraviolet rays. That is, a first threshold value for determining whether the amount of application is "appropriate" or "insufficient (too small)" based on at least one of the date, time, and forecast of the amount of ultraviolet rays at the time of evaluation. Determine.
 また、第1の実施形態で説明した通り、評価部13は、対象物の中で散乱した紫外線(内部散乱光)の強さの程度(輝度値)が第2の閾値より小さい箇所を、紫外線防御剤の塗布量が第2の基準より多い箇所(塗布量が多すぎる箇所)として検出することができる。 Further, as described in the first embodiment, the evaluation unit 13 evaluates the location where the intensity (luminance value) of the ultraviolet rays scattered in the object (internally scattered light) is smaller than the second threshold value. It can be detected as a location where the amount of the protective agent applied is greater than the second standard (a location where the amount of application is too large).
 そして、評価部13は、評価時の日付、時刻、及び紫外線量の予報の中の少なくとも1つに基づき第2の閾値を決定する。すなわち、評価時の日付、時刻、及び紫外線量の予報の中の少なくとも1つに基づき、塗布量が多すぎると判断するための第2の閾値を決定する。 Then, the evaluation unit 13 determines the second threshold based on at least one of the date and time at the time of evaluation, and the forecast of the amount of ultraviolet rays. That is, a second threshold value for determining that the amount of application is too large is determined based on at least one of the date and time at the time of evaluation, and the forecast of the amount of ultraviolet rays.
 地上に降りかかる紫外線の量は、季節に応じて異なり得る。このため、紫外線対策として人体等に塗布すべき紫外線防御剤の塗布量も、季節に応じて異なり得る。評価時の季節に応じた適切な基準で第1の実施形態で説明した塗りむら評価を行うことで、季節に応じた適切な評価結果をユーザに提供することが可能となる。 The amount of ultraviolet light that falls on the ground can vary depending on the season. Therefore, the amount of UV protection agent that should be applied to the human body as a measure against UV rays may also vary depending on the season. By performing the uneven coating evaluation described in the first embodiment using criteria appropriate to the season at the time of evaluation, it is possible to provide the user with evaluation results appropriate to the season.
 予め、日付と第1の閾値及び第2の閾値の少なくとも一方とを対応付けた対応情報が生成され、評価装置10に登録されている。当該対応情報においては、紫外線量が多い季節ほど第1の閾値が小さくなり、紫外線量が少ない季節ほど第1の閾値が大きくなっている。また、当該対応情報においては、紫外線量が多い季節ほど第2の閾値が小さくなり、紫外線量が少ない季節ほど第2の閾値が大きくなっている。 Correspondence information that associates the date with at least one of the first threshold value and the second threshold value is generated in advance and registered in the evaluation device 10. In the correspondence information, the first threshold value becomes smaller in a season when the amount of ultraviolet rays is higher, and the first threshold value becomes larger in a season when the amount of ultraviolet rays is lower. Furthermore, in the correspondence information, the second threshold value becomes smaller in seasons when the amount of ultraviolet rays is higher, and the second threshold value becomes larger in seasons when the amount of ultraviolet rays is lower.
 評価部13は、評価時の日付を任意の手段で取得した後、取得した日付に対応する第1の閾値及び第2の閾値の少なくとも一方を当該対応情報の中から取得し、取得した第1の閾値及び第2の閾値の少なくとも一方を用いて第1の実施形態で説明した評価を行う。 After acquiring the date at the time of evaluation by any means, the evaluation unit 13 acquires at least one of the first threshold value and the second threshold value corresponding to the acquired date from the corresponding information, and the acquired first threshold value. The evaluation described in the first embodiment is performed using at least one of the threshold value and the second threshold value.
 また、地上に降りかかる紫外線の量は、時刻に応じて異なり得る。このため、紫外線対策として人体等に塗布すべき紫外線防御剤の塗布量も、時刻に応じて異なり得る。評価時の時刻に応じた適切な基準で第1の実施形態で説明した塗りむら評価を行うことで、適切な評価結果をユーザに提供することが可能となる。 Additionally, the amount of ultraviolet light that falls on the ground can vary depending on the time of day. For this reason, the amount of UV protection agent that should be applied to the human body as a measure against UV rays may also vary depending on the time of day. By performing the uneven coating evaluation described in the first embodiment using appropriate criteria depending on the time of evaluation, it is possible to provide the user with an appropriate evaluation result.
 予め、時刻と第1の閾値及び第2の閾値の少なくとも一方とを対応付けた対応情報が生成され、評価装置10に登録されている。当該対応情報においては、紫外線量が多い時刻ほど第1の閾値が小さくなり、紫外線量が少ない時刻ほど第1の閾値が大きくなっている。また、当該対応情報においては、紫外線量が多い時刻ほど第2の閾値が小さくなり、紫外線量が少ない時刻ほど第2の閾値が大きくなっている。 Correspondence information that associates time with at least one of the first threshold value and the second threshold value is generated in advance and registered in the evaluation device 10. In the corresponding information, the first threshold value becomes smaller as the amount of ultraviolet rays increases, and the first threshold value becomes larger as the amount of ultraviolet rays decreases. Further, in the corresponding information, the second threshold value becomes smaller as the amount of ultraviolet rays increases at a time, and the second threshold value becomes larger as the amount of ultraviolet rays decreases.
 評価部13は、評価時の時刻を任意の手段で取得した後、取得した時刻に対応する第1の閾値及び第2の閾値の少なくとも一方を当該対応情報の中から取得し、取得した第1の閾値及び第2の閾値の少なくとも一方を用いて第1の実施形態で説明した評価を行う。 After acquiring the time at the time of evaluation by any means, the evaluation unit 13 acquires at least one of the first threshold value and the second threshold value corresponding to the acquired time from the corresponding information, and the acquired first threshold value. The evaluation described in the first embodiment is performed using at least one of the threshold value and the second threshold value.
 また、近年、紫外線量の予報(紫外線指数と呼んだりする)が発表されている。この予報の内容に応じた適切な基準で第1の実施形態で説明した塗りむら評価を行うことで、適切な評価結果をユーザに提供することが可能となる。 In addition, in recent years, forecasts for the amount of ultraviolet rays (sometimes called the ultraviolet index) have been published. By performing the uneven coating evaluation described in the first embodiment using appropriate criteria according to the content of this forecast, it becomes possible to provide the user with an appropriate evaluation result.
 予め、予報で示される紫外線量と第1の閾値及び第2の閾値の少なくとも一方とを対応付けた対応情報が生成され、評価装置10に登録されている。当該対応情報においては、予測される紫外線量が多いほど第1の閾値が小さくなり、予測される紫外線量が少ないほど第1の閾値が大きくなっている。また、当該対応情報においては、予測される紫外線量が多いほど第2の閾値が小さくなり、予測される紫外線量が少ないほど第2の閾値が大きくなっている。 Correspondence information that associates the amount of ultraviolet rays shown in the forecast with at least one of the first threshold value and the second threshold value is generated in advance and registered in the evaluation device 10. In the correspondence information, the larger the predicted amount of ultraviolet rays is, the smaller the first threshold value is, and the smaller the predicted amount of ultraviolet rays is, the larger the first threshold value is. Further, in the corresponding information, the second threshold value becomes smaller as the predicted amount of ultraviolet rays increases, and the second threshold value becomes larger as the predicted amount of ultraviolet rays decreases.
 評価部13は、評価時の予報の内容を任意の手段で取得した後、取得した予報の内容に対応する第1の閾値及び第2の閾値の少なくとも一方を当該対応情報の中から取得し、取得した第1の閾値及び第2の閾値の少なくとも一方を用いて第1の実施形態で説明した評価を行う。なお、予報で示される紫外線量は、「mW/cm」等の単位で示される紫外線強度であってもよいし、「強い、やや強い、普通、やや弱い、弱い」等のように上記紫外線強度を任意の手法で表現した値であってもよい。 After acquiring the contents of the forecast at the time of evaluation by any means, the evaluation unit 13 acquires at least one of the first threshold and the second threshold corresponding to the contents of the acquired forecast from the corresponding information, The evaluation described in the first embodiment is performed using at least one of the acquired first threshold value and second threshold value. The amount of ultraviolet rays indicated in the forecast may be the intensity of ultraviolet rays expressed in units such as "mW/cm 2 ", or may be expressed as "strong, somewhat strong, normal, somewhat weak, weak", etc. It may be a value that expresses the intensity using any method.
 上述したように、評価部13は、第1の閾値及び第2の閾値の少なくとも一方を決定し、決定した内容に基づき紫外線防御剤の塗りむら評価を行うことができる。本実施形態の評価装置10のその他の構成は、第1の実施形態と同様である。 As described above, the evaluation unit 13 can determine at least one of the first threshold value and the second threshold value, and evaluate the uneven coating of the ultraviolet protective agent based on the determined content. The other configuration of the evaluation device 10 of this embodiment is the same as that of the first embodiment.
 本実施形態の評価装置10によれば、第1の実施形態の評価装置10と同様の作用効果が実現される。また、本実施形態の評価装置10によれば、季節、時刻、紫外線量の予報の内容等に応じた適切な基準で、塗りむら評価を行うことができる。結果、その時の状況に応じた適切な評価結果をユーザに提供することが可能となる。 According to the evaluation device 10 of this embodiment, the same effects as the evaluation device 10 of the first embodiment are realized. Further, according to the evaluation device 10 of the present embodiment, uneven coating can be evaluated based on appropriate criteria depending on the season, time of day, contents of the forecast of the amount of ultraviolet rays, and the like. As a result, it becomes possible to provide the user with evaluation results appropriate to the situation at that time.
<第3の実施形態>
 本実施形態の評価装置10は、第1の実施形態で説明した「検出された紫外線(内部散乱光)の強さ」の程度(輝度値)に関する第1の閾値及び第2の閾値を、第2の実施形態と異なる手法で動的に変更することができる。以下、詳細に説明する。
<Third embodiment>
The evaluation device 10 of the present embodiment sets the first threshold value and the second threshold value regarding the degree (luminance value) of the "intensity of detected ultraviolet light (internally scattered light)" described in the first embodiment to the second threshold value. It can be dynamically changed using a method different from the second embodiment. This will be explained in detail below.
 評価部13は、ユーザが入力した行動予定を示す情報を取得する。当該情報では、外出する時間の長さ、及び外出している時刻の少なくとも一方が示される。ユーザは、ユーザ端末20を操作して当該情報を入力する。そして、ユーザ端末20から評価装置10に当該情報が送信される。 The evaluation unit 13 acquires information indicating the action schedule input by the user. The information indicates at least one of the length of time the user will be out and the time the user is out. The user operates the user terminal 20 to input the information. The information is then transmitted from the user terminal 20 to the evaluation device 10.
 当該ユーザ入力を受付ける手段は、あらゆる技術を用いて実現される。例えば、ユーザ端末20にインストールされている評価サービス専用のアプリケーションプログラム(ソフトウエア)を用いて実現されてもよい。その他、評価サービス専用のウェブページ上で当該情報の入力を受付ける入力フォームが設けられていてもよい。 The means for accepting the user input may be realized using any technology. For example, it may be realized using an application program (software) dedicated to the evaluation service installed on the user terminal 20. In addition, an input form for accepting input of the information may be provided on the web page dedicated to the evaluation service.
 予め、外出している時間の長さと第1の閾値及び第2の閾値の少なくとも一方とを対応付けた対応情報が生成され、評価装置10に登録されている。当該対応情報においては、外出している時間が長いほど第1の閾値が小さくなり、外出している時間が短いほど第1の閾値が大きくなっている。また、当該対応情報においては、外出している時間が長いほど第2の閾値が小さくなり、外出している時間が短いほど第2の閾値が大きくなっている。 Correspondence information that associates the length of time spent away with at least one of the first threshold value and the second threshold value is generated in advance and registered in the evaluation device 10. In the correspondence information, the longer the time spent outside the home, the smaller the first threshold value becomes, and the shorter the time the user goes out, the larger the first threshold value becomes. In addition, in the corresponding information, the longer the time spent outside the home, the smaller the second threshold value becomes, and the shorter the time spent outside the home, the larger the second threshold value becomes.
 評価部13は、ユーザが入力した行動予定を示す情報に基づき外出する時間の長さを特定した後、特定した時間の長さに対応する第1の閾値及び第2の閾値の少なくとも一方を当該対応情報の中から取得し、取得した第1の閾値及び第2の閾値の少なくとも一方を用いて第1の実施形態で説明した評価を行う。 After specifying the length of time to go out based on the information indicating the action schedule input by the user, the evaluation unit 13 sets at least one of the first threshold and the second threshold corresponding to the specified length of time. The evaluation described in the first embodiment is performed using at least one of the first threshold value and the second threshold value obtained from the correspondence information.
 また、予め、外出している時刻と第1の閾値及び第2の閾値の少なくとも一方とを対応付けた対応情報が生成され、評価装置10に登録されている。当該対応情報においては、紫外線量が多い時刻ほど第1の閾値が小さくなり、紫外線量が少ない時刻ほど第1の閾値が大きくなっている。また、当該対応情報においては、紫外線量が多い時刻ほど第2の閾値が小さくなり、紫外線量が少ない時刻ほど第2の閾値が大きくなっている。 Additionally, correspondence information that associates the time when the person is out with at least one of the first threshold value and the second threshold value is generated and registered in the evaluation device 10 in advance. In the corresponding information, the first threshold value becomes smaller as the amount of ultraviolet rays increases, and the first threshold value becomes larger as the amount of ultraviolet rays decreases. Further, in the corresponding information, the second threshold value becomes smaller as the amount of ultraviolet rays increases at a time, and the second threshold value becomes larger as the amount of ultraviolet rays decreases.
 評価部13は、ユーザが入力した行動予定を示す情報に基づき外出する時刻を特定した後、特定した時刻に対応する第1の閾値及び第2の閾値の少なくとも一方を当該対応情報の中から取得する。なお、外出する時間が長く、外出する時刻が多岐に渡る場合、それら時刻に対応する複数の第1の閾値の中の最小値を取得してもよい。また、外出する時間が長く、外出する時刻が多岐に渡る場合、それら時刻に対応する複数の第2の閾値の中の最小値を取得してもよい。そして、評価部13は、取得した第1の閾値及び第2の閾値の少なくとも一方を用いて第1の実施形態で説明した評価を行う。 After specifying the time to go out based on the information indicating the action schedule input by the user, the evaluation unit 13 acquires at least one of the first threshold value and the second threshold value corresponding to the specified time from the corresponding information. do. Note that if the time spent going out is long and the times at which the user goes out vary widely, the minimum value among the plurality of first threshold values corresponding to those times may be acquired. Furthermore, if the user is out for a long time and goes out at various times, the minimum value among the plurality of second threshold values corresponding to those times may be acquired. Then, the evaluation unit 13 performs the evaluation described in the first embodiment using at least one of the acquired first threshold value and second threshold value.
 本実施形態の評価装置10のその他の構成は、第1及び第2の実施形態と同様である。 The other configurations of the evaluation device 10 of this embodiment are the same as those of the first and second embodiments.
 本実施形態の評価装置10によれば、第1及び第2の実施形態の評価装置10と同様の作用効果が実現される。また、本実施形態の評価装置10によれば、ユーザの行動予定に応じた適切な基準で、塗りむら評価を行うことができる。結果、状況に応じた適切な評価結果をユーザに提供することが可能となる。 According to the evaluation device 10 of this embodiment, the same effects as those of the evaluation device 10 of the first and second embodiments are realized. Further, according to the evaluation device 10 of the present embodiment, uneven coating can be evaluated using appropriate criteria according to the user's action schedule. As a result, it becomes possible to provide the user with evaluation results appropriate to the situation.
<第4の実施形態>
 本実施形態の評価装置10は、図8に示すように、サーバ1でなく、ユーザ端末20である点で、第1乃至第3の実施形態と異なる。
<Fourth embodiment>
The evaluation device 10 of this embodiment differs from the first to third embodiments in that, as shown in FIG. 8, it is not the server 1 but the user terminal 20.
 ユーザ端末20に評価サービス専用のアプリケーションプログラム(ソフトウエア)をインストールすることで、ユーザ端末20内に、取得部11、画像加工部12、評価部13及び出力部14を有する評価装置10が実現される。 By installing an application program (software) dedicated to the evaluation service in the user terminal 20, an evaluation device 10 having an acquisition section 11, an image processing section 12, an evaluation section 13, and an output section 14 is realized in the user terminal 20. Ru.
 本実施形態の取得部11は、ユーザ端末20(評価装置10)が備える紫外線カメラ機能を利用して紫外線画像を撮影することで、紫外線画像の取得を実現する。画像加工部12及び評価部13の機能は、第1乃至第3の実施形態で説明した通りである。出力部14は、評価結果データを、ディスプレイ、投影装置、プリンター等の出力装置を介して出力する(図6参照)。なお、室内照明には、一般には紫外線が含まれないものが多いので、室内での撮影では紫外線が含まれる光源を利用する。例えば、ユーザ端末20(評価装置10)に紫外線を含むLEDを取り付けて利用することもできる。 The acquisition unit 11 of this embodiment realizes the acquisition of an ultraviolet image by taking an ultraviolet image using the ultraviolet camera function provided in the user terminal 20 (evaluation device 10). The functions of the image processing section 12 and the evaluation section 13 are as described in the first to third embodiments. The output unit 14 outputs the evaluation result data via an output device such as a display, a projection device, or a printer (see FIG. 6). Note that most indoor lighting generally does not contain ultraviolet rays, so when taking pictures indoors, a light source that contains ultraviolet rays is used. For example, an LED containing ultraviolet light may be attached to the user terminal 20 (evaluation device 10) for use.
 本実施形態の評価装置10のその他の構成は、第1乃至第3の実施形態と同様である。 The other configurations of the evaluation device 10 of this embodiment are the same as those of the first to third embodiments.
 本実施形態の評価装置10によれば、第1乃至第3の実施形態の評価装置10と同様の作用効果が実現される。また、本実施形態の評価装置10によれば、評価装置10内ですべての処理を完結することができる。このため、外部装置と通信できない状況下でも、ユーザは、当該評価サービスを利用することができる。 According to the evaluation device 10 of this embodiment, the same effects as those of the evaluation device 10 of the first to third embodiments are realized. Further, according to the evaluation device 10 of this embodiment, all processing can be completed within the evaluation device 10. Therefore, even in a situation where communication with an external device is not possible, the user can use the evaluation service.
<第5の実施形態>
 図10に示すように、本実施形態では、本発明の評価装置が評価システム100として構成され取得部11と、画像加工部12と、評価部13と、出力部14とを有する。評価システム100は、専用回線もしくは公衆回線で構成される通信ネットワーク30を介して互いに通信可能に接続された複数の装置で構成される。一例として、評価システム100は、サーバ1と、少なくとも1台、好ましくは複数台のユーザ端末20とで構成される。
<Fifth embodiment>
As shown in FIG. 10, in this embodiment, the evaluation apparatus of the present invention is configured as an evaluation system 100 and includes an acquisition section 11, an image processing section 12, an evaluation section 13, and an output section 14. The evaluation system 100 is composed of a plurality of devices that are communicably connected to each other via a communication network 30 that is composed of a private line or a public line. As an example, the evaluation system 100 includes a server 1 and at least one, preferably a plurality of user terminals 20.
 評価システム100が備える複数の機能部(取得部11、画像加工部12、評価部13、及び出力部14)は、複数の装置の中の任意の装置が備える。一例として、複数台のユーザ端末20が各々取得部11及び出力部14を備え、サーバ1が画像加工部12及び評価部13を備えてもよい。他の例として、複数台のユーザ端末20が各々取得部11、画像加工部12及び出力部14を備え、サーバ1が評価部13を備えてもよい。他の例として、複数台のユーザ端末20が各々取得部11、評価部13及び出力部14を備え、サーバ1が画像加工部12を備えてもよい。なお、ここで例示した組み合わせはあくまで一例であり、評価システム100は、あらゆる組み合わせを採用することができる。学習モデルを入れ替えることの容易さから、サーバ1は、少なくとも学習モデルを含む画像加工部12を備えるのが好ましい。なお、室内照明には、一般には紫外線が含まれないものが多いので、室内での撮影では紫外線が含まれる光源を利用する。例えば、ユーザ端末20(評価装置10)に紫外線を含む LEDを取り付けて利用することもできる。 The plurality of functional units included in the evaluation system 100 (the acquisition unit 11, the image processing unit 12, the evaluation unit 13, and the output unit 14) are provided in arbitrary devices among the plurality of devices. As an example, a plurality of user terminals 20 may each include an acquisition section 11 and an output section 14, and the server 1 may include an image processing section 12 and an evaluation section 13. As another example, a plurality of user terminals 20 may each include an acquisition section 11, an image processing section 12, and an output section 14, and the server 1 may include an evaluation section 13. As another example, a plurality of user terminals 20 may each include an acquisition section 11, an evaluation section 13, and an output section 14, and the server 1 may include an image processing section 12. Note that the combinations illustrated here are just examples, and the evaluation system 100 can employ any combination. In order to easily replace learning models, it is preferable that the server 1 includes at least an image processing section 12 that includes a learning model. Note that most indoor lighting generally does not contain ultraviolet rays, so when taking pictures indoors, a light source that contains ultraviolet rays is used. For example, an LED containing ultraviolet light may be attached to the user terminal 20 (evaluation device 10).
 本実施形態の取得部11、画像加工部12、評価部13及び出力部14の構成および作用は、第1乃至第4の実施形態と同様である。 The configuration and operation of the acquisition unit 11, image processing unit 12, evaluation unit 13, and output unit 14 of this embodiment are the same as those of the first to fourth embodiments.
 本実施形態の評価システム100によれば、第1乃至第4の実施形態の評価装置10と同様の作用効果が実現される。 According to the evaluation system 100 of this embodiment, the same effects as the evaluation apparatus 10 of the first to fourth embodiments are realized.
<変形例>
 以下、第1乃至第5の実施形態に適用可能な変形例を説明する。
<Modified example>
Modifications applicable to the first to fifth embodiments will be described below.
「変形例1」
 ユーザ端末20が備える紫外線カメラ機能を利用して紫外線画像を撮影する際、図9に示すように、ファインダー(ディスプレイ)に表示される画像上に、顔の位置や大きさを適切に導くための枠Wが重畳表示されてもよい。
"Modification 1"
When taking an ultraviolet image using the ultraviolet camera function of the user terminal 20, as shown in FIG. The frame W may be displayed in a superimposed manner.
 この枠W内に顔が収まるように撮影することで、カメラと顔との距離や画角を自然に適切な状態に合わせることができる。結果、評価部13による評価を高精度に行うことが可能な紫外線画像を撮影することが可能となる。 By taking a picture so that the face fits within this frame W, the distance between the camera and the face and the angle of view can be naturally adjusted to an appropriate state. As a result, it becomes possible to capture an ultraviolet image that allows evaluation by the evaluation unit 13 to be performed with high precision.
 例えば、ユーザ端末20にインストールされた評価サービス専用のアプリケーションプログラム(ソフトウエア)内で、紫外線画像を撮影する機能が提供されてもよい。そして、評価サービス専用のアプリケーションプログラムを起動し、紫外線画像を撮影する機能を立ち上げると、ユーザ端末20のディスプレイがファインダーとなり、当該ファインダーにリアルタイムな撮影画像が表示されるとともに、ファインダーに表示された画像上に上記枠Wが重畳表示されてもよい。 For example, a function to take an ultraviolet image may be provided within an application program (software) dedicated to the evaluation service installed on the user terminal 20. Then, when the application program dedicated to the evaluation service is started and the function to take an ultraviolet image is launched, the display of the user terminal 20 becomes a viewfinder, and the real-time photographed image is displayed on the finder. The frame W may be displayed superimposed on the image.
 その他、評価サービス専用のウェブページ内で、紫外線画像を撮影する機能が提供されてもよい。そして、評価サービス専用のウェブページにアクセスし、紫外線画像を撮影する機能を立ち上げると、ユーザ端末20のディスプレイがファインダーとなり、当該ファインダーにリアルタイムな撮影画像が表示されるとともに、ファインダーに表示された画像上に上記枠Wが重畳表示されてもよい。 In addition, a function to take ultraviolet images may be provided within the web page dedicated to the evaluation service. Then, when accessing the web page dedicated to the evaluation service and launching the function to take ultraviolet images, the display of the user terminal 20 becomes a finder, and the real-time shot image is displayed on the finder. The frame W may be displayed superimposed on the image.
「変形例2」
 ユーザは、対象物と標準パッチが紫外線画像に含まれるように撮影する。例えば、標準パッチを対象物の表面に貼付した状態で撮影してもよいし、標準パッチを手に持ったり、所定の物体に貼付して撮影してもよい。標準パッチは、紫外線に対する反射率が既知のものである。
"Variation 2"
The user photographs the ultraviolet image so that the object and the standard patch are included in the ultraviolet image. For example, the standard patch may be photographed with the standard patch attached to the surface of the object, or the standard patch may be held in the hand or attached to a predetermined object and photographed. The standard patch has a known reflectance to ultraviolet light.
 そして、ユーザは紫外線防御剤を塗布した後の紫外線画像の明るさが標準パッチよりも暗くなるまで、紫外線防御剤を塗布する。たとえば標準パッチとして紫外線防御剤を推奨使用量塗布した状態と同じ反射率となるものを用意すれば、上述のように紫外線画像の明るさが標準パッチよりも暗くなるまで紫外線防御剤を塗布することで、ユーザは推奨使用量以上の紫外線防御剤を塗布することができる。 Then, the user applies the UV protective agent until the brightness of the UV image after applying the UV protective agent becomes darker than the standard patch. For example, if you prepare a standard patch that has the same reflectance as the recommended amount of UV protection agent applied, you can apply the UV protection agent until the brightness of the UV image becomes darker than the standard patch as described above. This allows the user to apply more UV protection agent than the recommended usage amount.
「変形例3」
 ユーザ端末20を利用して紫外線画像を撮影する際に、ファインダー(ディスプレイ)に表示される画像上に、目標となる色をガイドとして表示してもよい。
"Modification 3"
When photographing an ultraviolet image using the user terminal 20, a target color may be displayed as a guide on the image displayed on the finder (display).
 そして、変形例2と同様に、ユーザは紫外線防御剤を塗布した後の紫外線画像の色が色ガイドと同様の色調になるまで、紫外線防御剤を塗布する。たとえば色ガイドとして紫外線防御剤を推奨使用量塗布した状態と同じ色となるものをあらかじめ用意すれば、上述のように紫外線画像の色が標準パッチよりと同様の色調になるまで紫外線防御剤を塗布することで、ユーザは推奨使用量以上の紫外線防御剤を塗布することができる。 Then, as in Modification 2, the user applies the ultraviolet protective agent until the color of the ultraviolet image after applying the ultraviolet protective agent becomes the same tone as the color guide. For example, if you prepare in advance a color guide that has the same color as the recommended amount of UV protection agent applied, apply the UV protection agent until the color of the UV image becomes the same tone as the standard patch as described above. By doing so, the user can apply more UV protection agent than the recommended usage amount.
「変形例4」
 ユーザ端末20を利用して紫外線画像を撮影する際に、紫外線画像に含まれる複数の画像の中で飽和画素が占める割合が既定の値(例:50%、40%、30%、20%等)以下になるように調整してもよい。例えば画像の明るさが、0~255の範囲で表現される場合(なお、0が最も暗く、255が最も明るい)、255以上の明るさの画素が飽和画素となる。このようにすることで、紫外線画像の明るさが調整され、視認しやすくなる。上記飽和画素が占める割合は、光源が写り込んでいるか否か、カメラと被写体の距離、カメラの角度等に起因して変化する。例えば、光源が存在している場合、またカメラが被写体に近い場合、また、正反射光が多く検出されるカメラの角度である場合に、飽和画素が発生しやすくなる。ユーザ自身が、上記飽和画素が占める割合が既定の値以下になるように、撮影環境を調整する。
"Modification 4"
When capturing an ultraviolet image using the user terminal 20, the proportion of saturated pixels among multiple images included in the ultraviolet image is set to a predetermined value (e.g. 50%, 40%, 30%, 20%, etc.). ) You may adjust it so that it is as follows. For example, when the brightness of an image is expressed in a range of 0 to 255 (0 is the darkest and 255 is the brightest), pixels with a brightness of 255 or more are saturated pixels. By doing this, the brightness of the ultraviolet image is adjusted, making it easier to see. The proportion occupied by the saturated pixels changes depending on whether a light source is included in the image, the distance between the camera and the subject, the angle of the camera, and the like. For example, saturated pixels are more likely to occur when a light source is present, when the camera is close to the subject, or when the camera angle is such that a lot of specularly reflected light is detected. The user himself/herself adjusts the photographing environment so that the proportion occupied by the saturated pixels is equal to or less than a predetermined value.
 例えば、サーバ1又はユーザ端末20が、紫外線画像を解析し、飽和画素が占める割合が既定の値以下になっているか判断してもよい。そして、飽和画素が占める割合が既定の値以下になっていないと判断した場合、ユーザ端末20は、「光源が写り込まないようにしてください」、「カメラを被写体から離してください」、「カメラの角度を変えてください」等のアドバイスをユーザに向けて出力してもよい。 For example, the server 1 or the user terminal 20 may analyze the ultraviolet image and determine whether the proportion occupied by saturated pixels is below a predetermined value. If the user terminal 20 determines that the proportion occupied by saturated pixels is not less than the predetermined value, the user terminal 20 displays messages such as ``Please do not include the light source'', ``Move the camera away from the subject'', and ``Camera Advice such as "please change the angle of the screen" may be output to the user.
「変形例5」
 出力部14は、評価結果に基づいて決定した商品紹介情報を出力してもよい。例えば、「こすれで取れてしまう」という評価結果となった場合、出力部14は、こすれで取れにくい商品を紹介する商品紹介情報を出力することができる。当該評価は、例えば紫外線防御剤が塗布された対象物に対して摩擦前後の加工画像を取得し、摩擦前後の加工画像の明るさの変化率に基づき行われる。変化率が閾値(予め設定した数値)以上である場合、こすれで取れてしまうと評価できる。
"Modification 5"
The output unit 14 may output product introduction information determined based on the evaluation results. For example, if the evaluation result is that "the product can be removed by rubbing," the output unit 14 can output product introduction information that introduces products that are difficult to remove by rubbing. The evaluation is performed, for example, by acquiring processed images before and after friction of an object coated with an ultraviolet protective agent, and based on the rate of change in brightness of the processed images before and after friction. If the rate of change is greater than or equal to a threshold value (preset numerical value), it can be evaluated that it will be removed by rubbing.
 予め、評価部13が算出し得る複数の評価結果各々と、各評価結果時に推奨される商品とを対応付けた対応情報が評価装置10又は評価システム100に記憶されている。出力部14は、当該対応情報に基づき、各評価結果となった場合に紹介する商品を特定する。 Correspondence information that associates each of the plurality of evaluation results that can be calculated by the evaluation unit 13 with the products recommended at the time of each evaluation result is stored in advance in the evaluation device 10 or the evaluation system 100. Based on the correspondence information, the output unit 14 specifies the products to be introduced in the case of each evaluation result.
「変形例6」
 出力部14は、評価時の季節に応じたケア情報を出力してもよい。予め、複数の季節各々と、各季節の時に推奨される肌ケアの内容を示すケア情報とを対応付けた対応情報が評価装置10又は評価システム100に記憶されている。出力部14は、当該対応情報に基づき、評価時に紹介するケア情報を特定する。
"Variation 6"
The output unit 14 may output care information according to the season at the time of evaluation. Correspondence information that associates each of a plurality of seasons with care information indicating recommended skin care content for each season is stored in advance in the evaluation device 10 or the evaluation system 100. The output unit 14 specifies care information to be introduced at the time of evaluation based on the correspondence information.
「変形例7」
 評価装置10又は評価システム100が紫外線量の予報を任意の手段で取得してもよい。そして、出力部14は、その予報の内容を示す情報を出力してもよい。
"Modification 7"
The evaluation device 10 or the evaluation system 100 may obtain the forecast of the amount of ultraviolet rays by any means. Then, the output unit 14 may output information indicating the contents of the forecast.
「変形例8」
 取得部11は、紫外線防御剤の塗膜を表面に配置していない対象物を通常のカメラ(可視光域の光を検出するセンサを備えたカメラ)で撮影した画像を取得してもよい。評価部13は、当該画像を利用してメラニンを目立つように可視化してもよい。
"Modification 8"
The acquisition unit 11 may acquire an image of an object whose surface is not coated with an ultraviolet protective agent, taken with a normal camera (a camera equipped with a sensor that detects light in the visible light range). The evaluation unit 13 may use the image to visualize melanin in a conspicuous manner.
 メラニンは素肌に対して輝度値が低く撮影される。すなわち、画像内のメラニンの領域の輝度値は、周辺の素肌の領域よりも輝度値が低くなる。素肌(=紫外線防御剤の塗膜を表面に配置していない対象物)の撮影時にはある一定の輝度値以下の領域をメラニンの領域と定義し、そのメラニンの領域の内部やメラニンの領域の外縁を画像上で着色等することで、目立つように可視化することが可能である。 Melanin is photographed with a lower brightness value than bare skin. That is, the brightness value of the melanin area in the image is lower than the brightness value of the surrounding bare skin area. When photographing bare skin (objects that do not have a coating of UV protection agent placed on their surface), the area below a certain brightness value is defined as the melanin area, and the inside of the melanin area and the outer edge of the melanin area are defined as melanin areas. By coloring etc. on the image, it is possible to visualize it more conspicuously.
 メラニンは紫外線を吸収する生体色素であるため、メラニンが多い領域(例えば、顔の中でシミのある領域)はメラニンの少ない周辺領域と比較して紫外線画像の輝度値は低くなる。すなわち、紫外線画像内のメラニンの多い領域の輝度値は、メラニンの少ない周辺の素肌の領域よりも輝度値が低くなる。撮影された紫外線画像のある一定の輝度値以下の領域をメラニンの多い領域と設定し、その領域やその領域の外縁を紫外線画像上もしくは可視光画像上で着色などすることで、目立つように可視化することが可能である。 Melanin is a biological pigment that absorbs ultraviolet rays, so areas with a lot of melanin (for example, areas with spots on the face) have lower brightness values in the ultraviolet image than surrounding areas with less melanin. That is, the brightness value of a region with a lot of melanin in the ultraviolet image is lower than the brightness value of the surrounding bare skin region with a little melanin. The area of the photographed ultraviolet image with a brightness value below a certain value is set as an area with a lot of melanin, and that area and the outer edge of that area are colored on the ultraviolet image or visible light image to make it more visible. It is possible to do so.
「変形例9」
 評価部13は、加工画像に基づき紫外線防御剤に関する評価の結果を示す評価結果データを生成することができる。具体的には、評価部13は、加工画像自体を評価結果データとすることができる。当該変形例では、出力部14は、評価結果データとして加工画像を出力する。
“Modification 9”
The evaluation unit 13 can generate evaluation result data indicating the evaluation results regarding the ultraviolet protective agent based on the processed image. Specifically, the evaluation unit 13 can use the processed image itself as evaluation result data. In this modification, the output unit 14 outputs a processed image as evaluation result data.
 以上、図面を参照して本発明の実施形態について述べたが、これらは本発明の例示であり、上記以外の様々な構成を採用することもできる。上述した実施形態の構成は、互いに組み合わせたり、一部の構成を他の構成に入れ替えたりしてもよい。また、上述した実施形態の構成は、趣旨を逸脱しない範囲内において種々の変更を加えてもよい。また、上述した各実施形態や変形例に開示される構成や処理を互いに組み合わせてもよい。 Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various configurations other than those described above can also be adopted. The configurations of the embodiments described above may be combined with each other, or some of the configurations may be replaced with other configurations. Further, the configuration of the embodiment described above may be modified in various ways without departing from the spirit thereof. Moreover, the configurations and processes disclosed in each of the embodiments and modifications described above may be combined with each other.
 また、上述の説明で用いたフローチャートでは、複数の工程(処理)が順番に記載されているが、各実施の形態で実行される工程の実行順序は、その記載の順番に制限されない。各実施の形態では、図示される工程の順番を内容的に支障のない範囲で変更することができる。また、上述の各実施の形態は、内容が相反しない範囲で組み合わせることができる。 Furthermore, although a plurality of steps (processes) are described in order in the flowchart used in the above description, the order in which the steps are executed in each embodiment is not limited to the order in which they are described. In each embodiment, the order of the illustrated steps can be changed within a range that does not affect the content. Furthermore, the above-described embodiments can be combined as long as the contents are not contradictory.
 上記の実施の形態の一部または全部は、以下のようにも記載されうるが、以下に限られない。
1. 紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像を取得する取得部と、
 正反射光の成分を前記紫外線画像から除去した加工画像を、学習モデルを用いて生成する画像加工部と、
 前記加工画像に基づき前記紫外線防御剤に関する評価の結果を示す評価結果データを生成する評価部と、
 前記評価結果データを出力する出力部と、
を有する評価装置。
2. 前記評価部は、前記紫外線防御剤に関する評価として、前記紫外線防御剤の塗りむら評価を行う1に記載の評価装置。
3. 前記評価部は、前記評価結果データとして、前記対象物を示す画像上に、前記紫外線防御剤の塗りむら評価の結果を重畳した画像を生成する2に記載の評価装置。
4. 前記評価部は、前記紫外線防御剤の塗布量が第1の基準より少ない箇所、及び前記紫外線防御剤の塗布量が第2の基準より多い箇所の一方、又は両方を識別表示した前記画像を生成する3に記載の評価装置。
5. 前記評価部は、評価時の日付、時刻、及び紫外線量の予報の中の少なくとも1つに基づき、前記第1の基準及び前記第2の基準の少なくとも一方を決定する4に記載の評価装置。
6. 前記評価部は、
  ユーザが入力した行動予定を示す情報を取得し、
  前記行動予定に基づき、前記第1の基準及び前記第2の基準の少なくとも一方を決定する4又は5に記載の評価装置。
7. 前記評価部は、前記紫外線防御剤に関する評価として、前記紫外線防御剤の性能評価を行う1から6のいずれかに記載の評価装置。
8. 前記評価部は、前記紫外線防御剤に関する評価として、前記紫外線防御剤の塗りむら評価、及び記紫外線防御剤の性能評価を行う1に記載の評価装置。
9. 前記取得部は、偏光板を用いた正反射光の成分を除去する処理がなされていない前記紫外線画像を取得し、
 前記画像加工部は、前記紫外線画像から前記加工画像を生成する1に記載の評価装置。
10. 前記評価装置は、ユーザ端末である1に記載の評価装置。
11. 紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像を取得する取得部と、
 反射光の成分を前記紫外線画像から除去した加工画像を、学習モデルを用いて生成する画像加工部と、
 前記加工画像に基づき前記紫外線防御剤に関する評価の結果を示す評価結果データを生成する評価部と、
 前記評価結果データを出力する出力部と、
を有する評価システム。
12. コンピュータが、
  紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像を取得し、
  正反射光の成分を前記紫外線画像から除去した加工画像を、学習モデルを用いて生成し、
  前記加工画像に基づき前記紫外線防御剤に関する評価の結果を示す評価結果データを生成し、
 前記評価結果データを出力する、
評価方法。
13.コンピュータを、
  紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像を取得する取得手段、
  正反射光の成分を前記紫外線画像から除去した加工画像を、学習モデルを用いて生成する画像加工手段、
  前記加工画像に基づき前記紫外線防御剤に関する評価の結果を示す評価結果データを生成する評価手段、
  前記評価結果データを出力する出力手段、
として機能させるプログラム。
Part or all of the embodiments described above may be described as follows, but are not limited to the following.
1. an acquisition unit that acquires an ultraviolet image of an object on which a coating film of an ultraviolet protective agent is placed;
an image processing unit that uses a learning model to generate a processed image in which the specularly reflected light component is removed from the ultraviolet image;
an evaluation unit that generates evaluation result data indicating evaluation results regarding the ultraviolet protective agent based on the processed image;
an output unit that outputs the evaluation result data;
An evaluation device with
2. 2. The evaluation device according to 1, wherein the evaluation unit performs coating unevenness evaluation of the ultraviolet protection agent as evaluation regarding the ultraviolet protection agent.
3. 3. The evaluation device according to 2, wherein the evaluation unit generates, as the evaluation result data, an image in which a result of the uneven coating evaluation of the ultraviolet protective agent is superimposed on an image showing the target object.
4. The evaluation unit generates the image that identifies and displays one or both of a location where the amount of the UV protection agent applied is less than a first standard, and a location where the amount of the UV protection agent applied is more than a second standard. The evaluation device according to 3.
5. 5. The evaluation device according to 4, wherein the evaluation unit determines at least one of the first criterion and the second criterion based on at least one of the date, time, and forecast of the amount of ultraviolet rays at the time of evaluation.
6. The evaluation department is
Obtain information indicating the action schedule entered by the user,
6. The evaluation device according to 4 or 5, wherein at least one of the first criterion and the second criterion is determined based on the action schedule.
7. 7. The evaluation device according to any one of 1 to 6, wherein the evaluation unit performs a performance evaluation of the ultraviolet protection agent as an evaluation regarding the ultraviolet protection agent.
8. 2. The evaluation device according to 1, wherein the evaluation unit evaluates the coating unevenness of the ultraviolet protective agent and the performance of the ultraviolet protective agent as evaluations regarding the ultraviolet protective agent.
9. The acquisition unit acquires the ultraviolet image that has not been processed to remove components of specularly reflected light using a polarizing plate,
The evaluation device according to 1, wherein the image processing unit generates the processed image from the ultraviolet image.
10. The evaluation device according to 1, wherein the evaluation device is a user terminal.
11. an acquisition unit that acquires an ultraviolet image of an object on which a coating film of an ultraviolet protective agent is placed;
an image processing unit that uses a learning model to generate a processed image in which the reflected light component is removed from the ultraviolet image;
an evaluation unit that generates evaluation result data indicating evaluation results regarding the ultraviolet protective agent based on the processed image;
an output unit that outputs the evaluation result data;
Evaluation system with.
12. The computer is
Obtain an ultraviolet image of an object with a coating of ultraviolet protection agent placed on its surface.
Generate a processed image by removing the specularly reflected light component from the ultraviolet image using a learning model,
generating evaluation result data indicating the results of evaluation regarding the ultraviolet protective agent based on the processed image;
outputting the evaluation result data;
Evaluation method.
13. computer,
an acquisition means for acquiring an ultraviolet image of an object on which a coating film of an ultraviolet protective agent is disposed;
image processing means that uses a learning model to generate a processed image in which the specularly reflected light component is removed from the ultraviolet image;
evaluation means for generating evaluation result data indicating evaluation results regarding the ultraviolet protective agent based on the processed image;
output means for outputting the evaluation result data;
A program that functions as
 1A  プロセッサ
 2A  メモリ
 3A  入出力I/F
 4A  周辺回路
 5A  バス
 1   サーバ
 10  評価装置
 11  取得部
 12  画像加工部
 13  評価部
 14  出力部
 20  ユーザ端末
 30  通信ネットワーク
 100 評価システム
1A processor 2A memory 3A input/output I/F
4A Peripheral circuit 5A Bus 1 Server 10 Evaluation device 11 Acquisition section 12 Image processing section 13 Evaluation section 14 Output section 20 User terminal 30 Communication network 100 Evaluation system

Claims (13)

  1.  紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像を取得する取得部と、
     正反射光の成分を前記紫外線画像から除去した加工画像を、学習モデルを用いて生成する画像加工部と、
     前記加工画像に基づき前記紫外線防御剤に関する評価の結果を示す評価結果データを生成する評価部と、
     前記評価結果データを出力する出力部と、
    を有する評価装置。
    an acquisition unit that acquires an ultraviolet image of an object on which a coating film of an ultraviolet protective agent is placed;
    an image processing unit that uses a learning model to generate a processed image in which the specularly reflected light component is removed from the ultraviolet image;
    an evaluation unit that generates evaluation result data indicating evaluation results regarding the ultraviolet protective agent based on the processed image;
    an output unit that outputs the evaluation result data;
    An evaluation device with
  2.  前記評価部は、前記紫外線防御剤に関する評価として、前記紫外線防御剤の塗りむら評価を行う請求項1に記載の評価装置。 The evaluation device according to claim 1, wherein the evaluation unit performs coating unevenness evaluation of the ultraviolet protection agent as the evaluation regarding the ultraviolet protection agent.
  3.  前記評価部は、前記評価結果データとして、前記対象物を示す画像上に、前記紫外線防御剤の塗りむら評価の結果を重畳した画像を生成する請求項2に記載の評価装置。 The evaluation device according to claim 2, wherein the evaluation unit generates, as the evaluation result data, an image in which the results of the uneven coating evaluation of the ultraviolet protective agent are superimposed on an image showing the target object.
  4.  前記評価部は、前記紫外線防御剤の塗布量が第1の基準より少ない箇所、及び前記紫外線防御剤の塗布量が第2の基準より多い箇所の一方、又は両方を識別表示した前記画像を生成する請求項3に記載の評価装置。 The evaluation unit generates the image that identifies and displays one or both of a location where the amount of the UV protection agent applied is less than a first standard, and a location where the amount of the UV protection agent applied is more than a second standard. The evaluation device according to claim 3.
  5.  前記評価部は、評価時の日付、時刻、及び紫外線量の予報の中の少なくとも1つに基づき、前記第1の基準及び前記第2の基準の少なくとも一方を決定する請求項4に記載の評価装置。 The evaluation according to claim 4, wherein the evaluation unit determines at least one of the first criterion and the second criterion based on at least one of the date, time, and forecast of the amount of ultraviolet rays at the time of the evaluation. Device.
  6.  前記評価部は、
      ユーザが入力した行動予定を示す情報を取得し、
      前記行動予定に基づき、前記第1の基準及び前記第2の基準の少なくとも一方を決定する請求項4又は5に記載の評価装置。
    The evaluation department is
    Obtain information indicating the action schedule entered by the user,
    The evaluation device according to claim 4 or 5, wherein at least one of the first criterion and the second criterion is determined based on the action schedule.
  7.  前記評価部は、前記紫外線防御剤に関する評価として、前記紫外線防御剤の性能評価を行う請求項1に記載の評価装置。 The evaluation device according to claim 1, wherein the evaluation unit performs performance evaluation of the ultraviolet protection agent as the evaluation regarding the ultraviolet protection agent.
  8.  前記評価部は、前記紫外線防御剤に関する評価として、前記紫外線防御剤の塗りむら評価、及び記紫外線防御剤の性能評価を行う請求項1に記載の評価装置。 The evaluation device according to claim 1, wherein the evaluation section performs an uneven coating evaluation of the ultraviolet protective agent and a performance evaluation of the ultraviolet protective agent as evaluations regarding the ultraviolet protective agent.
  9.  前記取得部は、偏光板を用いた正反射光の成分を除去する処理がなされていない前記紫外線画像を取得し、
     前記画像加工部は、前記紫外線画像から前記加工画像を生成する請求項1に記載の評価装置。
    The acquisition unit acquires the ultraviolet image that has not been processed to remove components of specularly reflected light using a polarizing plate,
    The evaluation device according to claim 1, wherein the image processing unit generates the processed image from the ultraviolet image.
  10.  前記評価装置は、ユーザ端末である請求項1に記載の評価装置。 The evaluation device according to claim 1, wherein the evaluation device is a user terminal.
  11.  紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像を取得する取得部と、
     正反射光の成分を前記紫外線画像から除去した加工画像を、学習モデルを用いて生成する画像加工部と、
     前記加工画像に基づき前記紫外線防御剤に関する評価の結果を示す評価結果データを生成する評価部と、
     前記評価結果データを出力する出力部と、
    を有する評価システム。
    an acquisition unit that acquires an ultraviolet image of an object on which a coating film of an ultraviolet protective agent is placed;
    an image processing unit that uses a learning model to generate a processed image in which the specularly reflected light component is removed from the ultraviolet image;
    an evaluation unit that generates evaluation result data indicating evaluation results regarding the ultraviolet protective agent based on the processed image;
    an output unit that outputs the evaluation result data;
    Evaluation system with.
  12.  コンピュータが、
      紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像を取得し、
      正反射光の成分を前記紫外線画像から除去した加工画像を、学習モデルを用いて生成し、
      前記加工画像に基づき前記紫外線防御剤に関する評価の結果を示す評価結果データを生成し、
     前記評価結果データを出力する、
    評価方法。
    The computer is
    Obtain an ultraviolet image of an object with a coating of ultraviolet protection agent placed on its surface.
    Generate a processed image by removing the specularly reflected light component from the ultraviolet image using a learning model,
    generating evaluation result data indicating the results of evaluation regarding the ultraviolet protective agent based on the processed image;
    outputting the evaluation result data;
    Evaluation method.
  13. コンピュータを、
      紫外線防御剤の塗膜を表面に配置した対象物を撮影した紫外線画像を取得する取得手段、
      正反射光の成分を前記紫外線画像から除去した加工画像を、学習モデルを用いて生成する画像加工手段、
      前記加工画像に基づき前記紫外線防御剤に関する評価の結果を示す評価結果データを生成する評価手段、
      前記評価結果データを出力する出力手段、
    として機能させるプログラム。
    computer,
    an acquisition means for acquiring an ultraviolet image of an object on which a coating film of an ultraviolet protective agent is disposed;
    image processing means that uses a learning model to generate a processed image in which the specularly reflected light component is removed from the ultraviolet image;
    evaluation means for generating evaluation result data indicating evaluation results regarding the ultraviolet protective agent based on the processed image;
    output means for outputting the evaluation result data;
    A program that functions as
PCT/JP2023/017725 2022-05-11 2023-05-11 Evaluation device, evaluation system, evaluation method, and program WO2023219131A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022-078057 2022-05-11
JP2022078057 2022-05-11

Publications (1)

Publication Number Publication Date
WO2023219131A1 true WO2023219131A1 (en) 2023-11-16

Family

ID=88730352

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/017725 WO2023219131A1 (en) 2022-05-11 2023-05-11 Evaluation device, evaluation system, evaluation method, and program

Country Status (2)

Country Link
JP (1) JP2023168295A (en)
WO (1) WO2023219131A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004131672A (en) * 2002-10-15 2004-04-30 Yamagata Public Corp For The Development Of Industry Ultraviolet absorber
JP2011080915A (en) * 2009-10-08 2011-04-21 Shiseido Co Ltd Method, device and program for evaluating application unevenness of skin care preparation
US20200219272A1 (en) * 2019-01-07 2020-07-09 The University Of North Carolina At Chapel Hill Methods, systems, and computer readable media for deriving a three-dimensional (3d) textured surface from endoscopic video
US20200267299A1 (en) * 2019-02-18 2020-08-20 Samsung Electronics Co., Ltd. Apparatus and method for capturing and blending multiple images for high-quality flash photography using mobile electronic device
CN111583128A (en) * 2020-04-09 2020-08-25 清华大学 Face picture highlight removal method based on deep learning and realistic rendering

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004131672A (en) * 2002-10-15 2004-04-30 Yamagata Public Corp For The Development Of Industry Ultraviolet absorber
JP2011080915A (en) * 2009-10-08 2011-04-21 Shiseido Co Ltd Method, device and program for evaluating application unevenness of skin care preparation
US20200219272A1 (en) * 2019-01-07 2020-07-09 The University Of North Carolina At Chapel Hill Methods, systems, and computer readable media for deriving a three-dimensional (3d) textured surface from endoscopic video
US20200267299A1 (en) * 2019-02-18 2020-08-20 Samsung Electronics Co., Ltd. Apparatus and method for capturing and blending multiple images for high-quality flash photography using mobile electronic device
CN111583128A (en) * 2020-04-09 2020-08-25 清华大学 Face picture highlight removal method based on deep learning and realistic rendering

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
LIN JOHN, MOHAMED EL AMINE SEDDIK, MOHAMED TAMAAZOUSTI, YOUSSEF TAMAAZOUSTI, ADRIEN BARTOLI : "Deep Multi-class Adversarial Specularity Removal", IMAGE ANALYSIS 21ST SCANDINAVIAN CONFERENCE, SCIA 2019, SPRINGER, vol. LNCS 11482, 12 May 2019 (2019-05-12) - 13 June 2019 (2019-06-13), pages 3 - 15, XP093108893, DOI: /10.1007/978-3-030-20205-7_1 *

Also Published As

Publication number Publication date
JP2023168295A (en) 2023-11-24

Similar Documents

Publication Publication Date Title
JP6650423B2 (en) Simulator and computer-readable storage medium
CN108319953B (en) Occlusion detection method and device, electronic equipment and the storage medium of target object
CN108197546B (en) Illumination processing method and device in face recognition, computer equipment and storage medium
CN107633485B (en) Face brightness adjusting method, device, equipment and storage medium
JP2017174454A (en) Skin diagnosis and image processing method
US9838616B2 (en) Image processing method and electronic apparatus
CA2791370C (en) System for skin treatment analysis using spectral image data to generate 3d rgb model
CN108875452A (en) Face identification method, device, system and computer-readable medium
CN103813105A (en) Image Processing Apparatus And Method, And Program
US20160042502A1 (en) Image enhancement method and device
CA3041991C (en) System and method for correcting color of digital image based on the human sclera and pupil
CN109949250B (en) Image processing method and device
WO2023219131A1 (en) Evaluation device, evaluation system, evaluation method, and program
CN109410138A (en) Modify jowled methods, devices and systems
CN108875545A (en) Determine the method, apparatus, system and storage medium of the light condition of facial image
US10944903B2 (en) Method for acquiring image using different focus at different depth and electronic device using the same
CN113252585B (en) Method and device for judging gold surface coating based on hyperspectral image
FR3025044A1 (en) RECOMMENDATION SYSTEM, METHOD, COMPUTER PROGRAM, AND CORRESPONDING MEDIUM
Barros et al. Synthesis of human skin pigmentation disorders
US9058605B2 (en) Systems and methods for simulating accessory display on a subject
JP2021010652A (en) Information processing device, evaluation method, and information processing program
Gao et al. A feature-based quality metric for tone mapped images
CN109993687A (en) A kind of image information processing method and device
JP2022096316A (en) Skin evaluation device, method, program, and system
Roskam Brightness perception and the effect of synthetic glare in virtual lighting applications

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23803605

Country of ref document: EP

Kind code of ref document: A1