WO2022138912A1 - Dispositif d'observation de fluide lacrymal, dispositif de traitement d'informations, programme et procédé de génération de modèle d'apprentissage - Google Patents

Dispositif d'observation de fluide lacrymal, dispositif de traitement d'informations, programme et procédé de génération de modèle d'apprentissage Download PDF

Info

Publication number
WO2022138912A1
WO2022138912A1 PCT/JP2021/048180 JP2021048180W WO2022138912A1 WO 2022138912 A1 WO2022138912 A1 WO 2022138912A1 JP 2021048180 W JP2021048180 W JP 2021048180W WO 2022138912 A1 WO2022138912 A1 WO 2022138912A1
Authority
WO
WIPO (PCT)
Prior art keywords
tear
image
health
light
information processing
Prior art date
Application number
PCT/JP2021/048180
Other languages
English (en)
Japanese (ja)
Inventor
横井則彦
岡崎善朗
巖淵守
川田裕祥
李中
岡崎大道
Original Assignee
エルライズ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by エルライズ株式会社 filed Critical エルライズ株式会社
Publication of WO2022138912A1 publication Critical patent/WO2022138912A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/13—Ophthalmic microscopes

Definitions

  • the present invention relates to a tear sap observation device, an information processing device, a program, and a learning model generation method, and particularly observes the state of tear sap without contact.
  • Tear fluid has aspects of quantity and quality, both of which cause dry eye. So far, in order to evaluate the amount of tears in the eye in clinical practice, for example, a Sylmer test in which a filter paper is sandwiched between the lower eyelids and the filter paper is impregnated with tears has been known. According to this method, the amount of tear fluid secreted can be measured by measuring the length of the filter paper wet by the soaked tears. In addition, as a method for evaluating the amount of tear fluid accumulated on the surface of the eye, the tear fluid accumulated on the lower eyelid margin is stained and the tear meniscus height (TMH: Tear Meniscus Height) is measured with a slit lamp microscope. Things are being done.
  • TSH Tear Meniscus Height
  • the tear film destruction time (BUT: Tear Film Breakup Time), which measures the time until the tear film is stained and the tear film layer on the surface of the cornea is destroyed. It has been.
  • Tear Film Breakup Time Tear Film Breakup Time
  • the information on the natural tears of the eye which is the direct cause of dry eye, is evaluated because it causes considerable irritation to the eyes. It is hard to say that there is.
  • the irritation to the eyes may cause pain to the subject. Since the decrease in the amount of tear accumulated on the surface of the eye is one of the most important causes of dry eye, a method for non-invasively evaluating the amount of tear accumulated is being sought.
  • Patent Document 1 proposes an ophthalmic apparatus for simple non-contact diagnosis of dry eye.
  • white light from a white light source is guided to the oil layer of the tear fluid of the eye to be inspected (the tear fluid consists of two layers, an oil layer and a liquid layer from the surface).
  • the reflected light reflected by the tear film is received by the CCD camera.
  • the ophthalmic appliance acquires a color image of an interference pattern due to an interference phenomenon of reflected light reflected on the front surface and the back surface of the oil layer, respectively.
  • the color image of the interference pattern is displayed on the monitor.
  • the examiner can know the movement of the oil layer of the eye to be inspected and the state of destruction of the tear film, and dry eye without contact. Can be used for simple diagnosis.
  • the ophthalmic apparatus requires an examiner to diagnose the tear fluid of the subject, and the subject cannot observe the state of the tear fluid by himself / herself. Further, in order to irradiate the eye to be inspected with white light and to image an interference pattern due to the reflection thereof, it is necessary to install a CCD camera and position the eye to be inspected at an appropriate position for imaging. That is, the subject's chin is placed on the chin of the ophthalmic appliance, the main body of the ophthalmic appliance is slightly moved with respect to the subject, and the reflected light reflected on the front and back surfaces of the oil layer of the tear fluid of the subject makes the lens. The ophthalmic appliance is operated so as to come to the CCD light receiving surface via the device.
  • the white light is emitted by a fixative lamp attached to the ophthalmic apparatus by a link mechanism.
  • the fixative light is adjusted and arranged so that the subject can fix it.
  • the present invention solves the above-mentioned problems, and generates a tear observing device, an information processing device, a program, and a learning model that can easily grasp the state of the eye to be inspected by imaging the tear sap by the subject himself / herself.
  • the purpose is to provide a method.
  • the tear fluid observation device of the present invention has an imaging device for imaging an eye to be inspected, a covering portion having a concave surface inside facing the region of the subject's face including the eye to be inspected, and light toward the eye to be inspected.
  • the light emitting body includes a light emitting body to irradiate, and the light emitting body is a surface light source installed inside the covering portion, and the covering portion includes a tip portion facing the face of the subject and a concave surface.
  • a part of the image pickup device is provided with a light guide unit for guiding reflected light reflected on the surface of the eye to be inspected.
  • the information processing apparatus of the present invention is an information processing apparatus that estimates the degree of tear fluid health from the tear fluid image captured by the tear fluid observation apparatus, acquires the captured tear fluid image, and obtains the tear fluid. It includes an evaluation unit for calculating the tear quality from an image and an output unit for outputting the tear health.
  • the program of the present invention is for making a computer function as each part constituting the above-mentioned information processing apparatus.
  • the learning model generation method of the present invention includes a performance tear image taken in a state where the cornea of the subject is irradiated with light, and a tear health degree as a teacher label corresponding to the performance tear image.
  • the teacher data is acquired, and the tear data is used to generate a learning model in which the tear image captured by the tear observation device is input and the tear health level is output.
  • a tear image can be easily acquired by the subject's own hand.
  • the tear health can be evaluated without consulting an ophthalmologist or other examiner, and the subject can evaluate the condition of the tear in daily life. You can grasp the state.
  • FIG. 3 is a cross-sectional view of the tear observing apparatus 100 of FIG. It is a schematic diagram explaining the relationship between the concave surface 21 of the irradiation part 10 and the eye
  • FIG. 9 is a tear image obtained by imaging the corneal surface 62 using the irradiation unit 10 according to the first embodiment. This is an example of a state in which the eye 61 to be inspected is imaged using the tear observing apparatus 100 according to the first embodiment. It is a schematic diagram of the cross section of the irradiation part 10 which concerns on Embodiment 1.
  • FIG. 1 It is a schematic diagram of the cross section of the irradiation part 10 which concerns on Embodiment 1.
  • FIG. 2 It is a schematic diagram of the cross section of the modification of the irradiation part 10 which concerns on Embodiment 1.
  • FIG. This is an example of a state in which the eye to be inspected 61 is imaged using the irradiation unit 10B according to the modified example of the first embodiment. It is explanatory drawing of an example of an evaluation index (2). It is a figure which shows the hardware composition of the tear fluid health degree estimation system 1000 which concerns on Embodiment 2.
  • FIG. It is a figure which shows an example of the functional structure of the information processing apparatus 90 which concerns on Embodiment 2.
  • This is an example of a data set used as teacher data in the generation of the learning model according to the second embodiment.
  • FIG. 1 It is a conceptual diagram of the machine learning of the learning model which the tear fluid health degree estimation system 1000 which concerns on Embodiment 3 has. It is a conceptual diagram of the method of estimating the factor which should be improved by the optimization simulation from the learning model which the tears health degree estimation system 1000 which concerns on Embodiment 3 have. It is a flowchart which shows an example of the simulation processing procedure of the tear fluid health degree by the tear fluid health degree estimation system 1000 which concerns on Embodiment 3.
  • FIG. It is a schematic diagram of the structure of the tear observing apparatus 400 which concerns on Embodiment 4.
  • FIG. 1 is a perspective view of the tear observing apparatus 100 according to the first embodiment.
  • the tear observing device 100 is configured by combining, for example, a mobile communication terminal 90a such as a smartphone with an irradiation unit 10.
  • the tear fluid observation device 100 is not limited to the configuration in which the mobile communication terminal 90a is combined with the irradiation unit 10, and may be configured as described below.
  • it may be configured by connecting the irradiation unit 10 to an information processing device such as a personal computer, or may be a device dedicated to ophthalmologic measurement configured by integrating the information processing device and the irradiation unit 10.
  • the teardrop observation device 100 can be held by the subject 60 (see FIG.
  • a mobile communication terminal 90a having an image pickup device 91 (see FIG. 6 and the like) and an irradiation unit 10 for irradiating the eye 61 to be inspected with light are provided.
  • the tear observing device 100 uses the irradiation unit 10 to irradiate the eye to be inspected 61 with light, and the image pickup device 91 included in the mobile communication terminal 90a images the surface of the eye to be inspected 61.
  • the irradiation unit 10 includes a covering portion 20 that covers at least a part of the face of the subject 60 including the eye to be inspected 61, and a fixing tool 30 for fixing the covering portion 20 to the mobile communication terminal 90a.
  • the irradiation unit 10 shown in FIG. 1 is attached to the mobile communication terminal 90a, and an image is taken using the mobile communication terminal 90a with the covering unit 20 facing the face of the subject 60 and irradiating the corneal surface 62 with light. I do.
  • the covering portion 20 is formed in a conical shape, and the outer diameter decreases from the tip portion 22 toward the root portion 27.
  • the inner surface of the covering portion 20 has a concave surface 21 which is a concave surface when viewed from the tip portion 22.
  • the concave surface 21 is a conical surface.
  • a light guide portion 24 is provided behind the concave surface 21 when viewed from the tip portion 22.
  • the light guide unit 24 is a hole opened in the concave surface 21 and guides the reflected light reflected on the surface of the eye 61 to the image pickup device 91 of the mobile communication terminal 90a.
  • the fixture 30 is provided with a hole 36 connected to the light guide portion 24.
  • the irradiation unit 10 uses the tip portion 22 of the covering portion 20 toward the eye to be inspected 61, and the tip portion 22 may be brought into contact with the periphery of the eye to be inspected 61 of the subject 60.
  • a mobile communication terminal 90a such as a smartphone in hand
  • the positional relationship between the image pickup device 91 and the eye to be inspected 61 which is the subject is not blurred.
  • the tip portion 22 is provided with, for example, a soft resin eyepiece.
  • the eyepiece 22a of the tip portion 22 may be formed with a tab portion 22b in which a part thereof protrudes outward so as to follow the dent on the face of the subject 60 and cover the periphery of the eyepiece 61 without a gap. It is formed. Further, the portion of the tip portion 22 that comes into contact with the face may be made of a soft member such as silicone rubber or gauze. With this configuration, when the tip 22 is brought into contact with the face, the shape of the tip 22 is deformed even if there are irregularities in the bones around the nose and eyes, and stable contact is possible. Become.
  • the portion of the covering portion 20 that comes into contact with the face may be a portion other than the tip portion 22, for example, a protrusion (not shown) is provided, and the tip of the protrusion that comes into contact with the face is such as silicon rubber or gauze. It may be composed of a soft material.
  • a light emitting body 21a is provided on the concave surface 21.
  • the light emitting body 21a is a light emitting sheet attached along a conical surface.
  • the light emitting sheet forming the conical surface for example, an organic or inorganic EL (Electroluminescence) sheet, a fluorescent sheet, a fiber light emitting sheet, a light emitting sheet, an LED sheet, or an LCD sheet may be used. That is, the light emitting sheet is made of a flexible material, and it is preferable to use a sheet that emits surface light. Since the light emitting body 21a is directly directed to the eye to be inspected 61, if it is too bright, it becomes difficult to keep the eyes open.
  • the light emitting body 21a emits light as in the light emitting body 21a according to the first embodiment. It is desirable to emit light from the surface of the sheet. Further, the light emitting body 21a may be configured by providing a plurality of LEDs on a conical surface and arranging a diffuser plate on the LEDs. At this time, the diffuser diffuses the light from the LED having directivity, substantially equalizes the brightness of the surface facing the eye 61 to be inspected, and causes the entire concave surface to emit light.
  • FIG. 2 is a cross-sectional view of the tear observing apparatus 100 of FIG.
  • the cross section of FIG. 2 is a cross section including the center of the light guide portion 24 of the irradiation unit 10.
  • the covering portion 20 includes a housing 23 that forms a concave surface 21 and supports a light emitting sheet.
  • the housing 23 is, for example, a molded product made of resin, a light emitting sheet is attached to the inner side surface thereof, and the eyepiece 22a is attached to the tip portion 22.
  • the housing 23 is formed in a conical shape, and a hole serving as a light guide portion 24 is provided on the side that becomes the apex of the conical shape.
  • the light emitting body 21a arranged on the concave surface 21 emits light to irradiate the eye to be inspected 61 with light, and the housing 23 and the eyepiece 22a emit light to the outside of the space formed by the covering portion 20 and the face. It suppresses leakage to.
  • the fixture 30 includes a hinge portion 32, holding portions 35a and 35b for sandwiching the mobile communication terminal 90a, and an operating portion 34 for opening between the holding portions 35a and 35b.
  • the hinge portion 32 is configured to be rotatable about an axis.
  • the fixture 30 is provided with, for example, an elastic member (not shown), and is configured so that a load is applied in a direction in which the sandwiching portions 35a and 35b approach each other due to the elastic force of the elastic member.
  • one of the sandwiching portions 35a is provided with a hole 36, which communicates with the light guide portion 24 of the covering portion 20.
  • the center of the hole 36 is arranged so as to be aligned with the center of the opening of the image pickup device 91 of the mobile communication terminal 90a.
  • the pressing portion 33 provided on the other holding portion 35b is in contact with the back surface 90ab located on the back side of the front surface 90aa in which the opening of the image pickup device 91 of the mobile communication terminal 90a is installed.
  • the pressing portion 33 is rotatably attached to the holding portion 35 by a hinge structure.
  • the pressing portion 33 is configured so that a force is applied vertically to the back surface 90ab by rotating the pressing portion 33.
  • the pressing portion 33 presses the back surface 90ab in a state where the position of the hole 36 and the opening of the image pickup device 91 match even if the mobile communication terminal 90a has a different thickness dimension or shape, and the irradiation portion 10 is pressed by the portable communication terminal. It is fixed to 90a.
  • the fixture 30 has a clip structure in which the mobile communication terminal 90a is sandwiched and fixed by the holding portions 35a and 35b as shown in FIG. 2, but may have a different form.
  • the fixture 30 may have a structure in which a screw is tightened to sandwich the mobile communication terminal 90a, or a structure in which the fixture 30 is attached to the front surface 90aa of the mobile communication terminal 90a by a suction cup or the like.
  • FIG. 3 is a schematic diagram illustrating the relationship between the concave surface 21 of the irradiation unit 10 and the eye 61 to be inspected according to the first embodiment.
  • the irradiation unit 10 is arranged so that the covering portion 20 covers a part of the face including the eye to be inspected 61, and irradiates the eye to be inspected 61 with light.
  • the concave surface 21 of the covering portion 20 is arranged so as to face the corneal surface 62 of the eye 61 to be inspected.
  • the light emitting body 21a of the concave surface 21 emits light and uniformly irradiates the entire corneal surface 62 with light.
  • the light emitting body 21a emits white light substantially uniformly over the entire surface.
  • the light emitting body 21a arranged on the concave surface 21 can uniformly irradiate the entire surface of the cornea surface 62 with light by uniformly emitting light on the entire surface, and can reflect the light on the corneal surface 62.
  • the irradiation unit 10 reflects light on the tear film layer on the corneal surface 62.
  • the irradiation unit 10 irradiates the entire corneal surface 62 with light, and the image pickup apparatus 91 images a virtual image of the illuminant 21a formed on the entire or almost the entire corneal surface 62. Since the virtual image of the illuminant 21a is, for example, white and substantially uniform, it is suitable for evaluating the state of each part of the tear film on the corneal surface 62.
  • the tear film on the corneal surface 62 is formed of two layers, an oil layer located on the surface and a liquid layer located on the corneal surface 62 side.
  • the irradiation unit 10 irradiates the corneal surface 62 with light and observes an interference pattern caused by the interference of the light reflected on the front surface and the back surface of the oil layer.
  • the corneal surface 62 is uniformly irradiated with light. Therefore, it is desirable that the light emitter 21a is a dome-shaped curved surface with the corneal surface 62 offset as shown in FIG. 3A.
  • the corneal surface 62 has a curved surface represented by the arc S in FIG.
  • the light emitter 21a of the concave surface 21 is arranged so as to intersect the virtual lines b and c connecting the center C of the curved surface formed by the corneal surface 62 and the edges 63a and 63b of the corneal surface 62.
  • the curved surface of the corneal surface 62 is similar to a spherical surface.
  • FIG. 3 the arrangement of the light emitting body 21a in the vertical direction of the eye 61 to be inspected is shown, but the virtual line connecting the center C and arbitrary points of the edges 63a and 63b of the corneal surface 62 is the concave surface 21. It intersects the illuminant 21a.
  • the edge 63a and 63b of the corneal surface 62 are the vertical edge 63 of the edge 63 in the state where the corneal surface 62 is exposed at the time of opening the eyelid.
  • FIG. 3 only the vertical edge 63a and 63b are displayed, but the entire circumference of the corneal surface 62 including the horizontal and diagonal directions is the same as the vertical edge 63a and 63b.
  • the virtual line intersects the light emitting body 21a of the concave surface 21. That is, the positional relationship between the corneal surface 62 and the illuminant 21a in FIG. 3 is similarly established not only in the vertical direction but also in other directions.
  • the light emitting body 21a is an offset surface of the corneal surface 62, but in this case, it is difficult to form the surface shape and the manufacturing cost is high. Therefore, as shown in FIGS. 3 (b) to 3 (e), the surface of the light emitter 21a is configured to intersect the virtual line passing through the center C of the curved surface of the corneal surface 62 and the edge 63. Therefore, a surface light source having a shape other than the offset surface of the corneal surface 62 may be used.
  • the light emitting body 21a shown in FIG. 3B schematically represents the light emitting body 21a of the irradiation unit 10 shown in FIGS. 1 and 2.
  • the light emitting body 21a is composed of a conical surface, and the light guide portion 24 is installed at the apex of the conical surface.
  • the illuminant 21a shown in FIG. 3B is arranged between the eye to be inspected 61 and the image pickup apparatus 91, and is installed so that a virtual line passing through the center C of the curved surface of the corneal surface 62 and the edge 63 intersects. Has been done.
  • the distance L from the corneal surface 62 to the illuminant 21a on the virtual line passing through the center C is defined, the distance L on the virtual line passing through the edge 63 and the point on the corneal surface 62 not the edge 63 are defined. Compare with the distance L1 on the virtual line passing through.
  • the distance L1 is longer when the distance L and the distance L1 are compared.
  • the covering portion 20 is large enough to cover a part of the human face, the difference is small. Therefore, if the light emitting body 21a, which is a surface light source, can emit light uniformly, the corneal surface 62 can be irradiated with light substantially uniformly.
  • the light emitting body 21a shown in FIG. 3C has a conical surface as in FIG. 3B, but the light guide portion 24 is arranged on the tip end side of the conical surface.
  • the light guide portion 24 does not necessarily have to be the center of the light emitting body 21a, and may be opened at any position on the concave surface 21 of the covering portion 20 as long as the corneal surface 62 irradiated with light can be imaged.
  • the light emitter 21a shown in FIG. 3D is a plane. Even if the light emitting body 21a is a flat surface, the corneal surface 62 can be irradiated with light substantially uniformly by adjusting the distance L from the corneal surface 62 and the light intensity of the light emitting body 21a. When the illuminant 21a is a flat surface, the distance L from the edge 63 of the corneal surface 62 is long at the end of the illuminant 21a. Therefore, the flat light emitting body 21a tends to have a larger outer diameter r and a larger area than the light emitting bodies 21a of FIGS. 3A to 3C.
  • the light emitting body 21a shown in FIG. 3 (e) is formed in a bottomed tubular shape.
  • the light emitting body 21a formed in the shape of a bottomed cylinder does not have a large outer diameter r, but the areas of the surface 21p and the surface 21q constituting the light emitting body 21a tend to be large.
  • the bottomed tubular light emitting body 21a can be easily manufactured, for example, by combining a flat light emitting sheet and a cylindrically rolled light emitting sheet.
  • FIG. 4 is a tear image obtained by imaging the corneal surface 62 using the irradiation unit 10 according to the first embodiment.
  • the irradiation unit 10 shown in FIGS. 1, 2, 3, 3 (a), 3 (b), 3 (d), and 3 (e) is the central portion of the illuminant 21a, that is, the surface of the cornea.
  • the light guide portion 24 is installed on a virtual line passing through the center C of the curved surface of 62 and the central point of the cornea. Therefore, as shown in FIG. 4, the irradiation unit 10 shown in FIGS. 1, 2, 3 (a), 3 (b), 3 (d), and 3 (e) is used.
  • the light guide portion 24 In the tear image image taken by irradiating with light, the light guide portion 24 is reflected in the central portion of the cornea. Therefore, in the central portion of the tear liquid image in which the light guide portion 24 is reflected, the interference pattern due to the light of the light emitter 21a cannot be captured.
  • the light emitting body 21a shown in FIGS. 3A to 3E light can be applied to the entire corneal surface 62 except for the portion where the light guide portion 24 is reflected. Therefore, as shown in FIG. 4, in the image captured by the irradiation unit 10, a virtual image of the illuminant 21a is formed over almost the entire area of the corneal surface 62, and an interference pattern due to tears existing in each part of the corneal surface 62 appears. The distribution can be confirmed.
  • corneal topography there is a technique called corneal topography that can measure the shape change and disorder of the tear film by projecting a grid-like pattern on the surface of the cornea and analyzing the bending of the grid.
  • the tear film observation device 100 can easily visualize the disorder of the tear film layer by providing a grid-like pattern on the light emitting surface as in the corneal topography.
  • lines may be drawn in a grid pattern on the surface of the light emitting body 21a, or a transparent sheet (not shown) on which a grid pattern is drawn may be arranged on the light emitting body 21a.
  • the transparent sheet is not limited to the form in which it is arranged adjacent to the light emitting body 21a as a light source, and may be arranged between the light emitting body 21a and the corneal surface 62 as a subject.
  • FIG. 5 is an example of a state in which the eye 61 to be inspected is imaged using the tear observing apparatus 100 according to the first embodiment.
  • the subject 60 holds the tear observing device 100 in his / her hand and brings the tip portion 22 of the covering portion 20 into contact with the face.
  • the covering portion 20 covers a part of the face including the eye 61 to be inspected.
  • the orientation for holding the mobile communication terminal 90a may be the vertical direction as shown in FIG. 5 (a) or the horizontal direction as shown in FIG. 5 (b).
  • the longitudinal direction of the mobile communication terminal 90a is turned sideways as shown in FIG. 5B, the subject 60 is provided on the mobile communication terminal 90a with the other eye 61a not covered by the covering portion 20. You can take an image while checking the screen.
  • the procedure for using the tear observing apparatus 100 is as follows. First, the subject 60 puts the mobile communication terminal 90a in a moving image shooting state, holds the mobile communication terminal 90a by the subject 60's own hand, and points the mobile communication terminal 90a toward the eye 61 to be inspected. The subject 60 presses the tip 22 of the covering portion 20 of the irradiation portion 10 against the face, and the covering portion 20 covers the eye 61 to be inspected.
  • the eye to be inspected 61 is covered, the mobile communication terminal 90a is put into a moving image shooting state, and the subject 60 lightly closes the eyelids of the inspected eye 61 once. Then, the subject 60 opens the eyelids and keeps opening the eyelids for 10 seconds.
  • the image pickup device 91 of the mobile communication terminal 90a photographs the movement of tears on the corneal surface 62 during the period when the eyelids are open. At this time, the tear film on the corneal surface 62 is irradiated with white light projected from the illuminant 21a.
  • the white light is reflected on the front surface and the back surface of the oil layer on the front surface of the tear film, and the reflected light on the front surface and the reflected light on the back surface interfere with each other, and an interference pattern is exhibited on the corneal surface 62.
  • the image pickup apparatus 91 captures the interference pattern.
  • d the thickness of the tear film
  • ⁇ the incident angle of light
  • m 0, 1, 2, 3, ...
  • ⁇ the wavelength of light
  • n the refractive index of the tear film.
  • the captured image P shows an interference image due to reflection of each layer of the tear film layer distributed over a wide area of the keratoconjunctiva.
  • the light guide portion 24 that guides the image guide 91 is reflected in the region f that is displayed in relatively black at the center of the corneal surface 62, and the reflection from the tear film is almost obtained. Since there is no such area, the other areas are evaluated.
  • the interference pattern K shown in FIG. 4 changes under the influence of the state of the oil layer, that is, the presence or absence of the oil layer, the thickness and change of the oil layer, the flow of tear fluid on the corneal surface 62, and the viscosity of the tear fluid.
  • the tear observing apparatus 100 can also observe the destruction of the tear layer, which is indispensable for determining dry eye.
  • the subject 60 can confirm the state of his / her tear fluid by observing the interference pattern of the corneal surface 62 imaged by using the tear fluid observation device 100.
  • the tear observing apparatus 100 can image the corneal surface 62 while the subject 60 adjusts the measurement position by himself / herself. The subject 60 can finely adjust the position of the tear observing device 100 and bring it to the optimum position while watching the image displayed on the screen of the mobile communication terminal 90a, for example.
  • FIG. 6 is a schematic cross-sectional view of the irradiation unit 10 according to the first embodiment.
  • 7 and 8 are schematic cross-sectional views of a modified example of the irradiation unit 10 according to the first embodiment.
  • the irradiation unit 10 according to the first embodiment is an image pickup device 91 arranged in the back of the light guide unit 24 by irradiating the eye to be inspected 61 located on the tip portion 22 side of the covering portion 20 with the light emitting body 21a.
  • the eye 61 to be inspected is imaged.
  • the light emitting body 21a is supplied with electric power from the power supply unit 38 installed in the fixture 30 via the wiring 38a and emits light.
  • the power supply unit 38 is a battery, and the inverter 39 converts a direct current into an alternating current to supply electric power to the light emitter 21a.
  • the light reflected by the eye to be inspected 61 irradiated with the light by the light emitting body 21a is collected by the lens 37 arranged inside the light guide unit 24 and imaged by the image pickup apparatus 91.
  • a prism 28 is arranged inside the light guide unit 24 as compared with the irradiation unit 10, and the light entering the light guide unit 24 is reflected to be an image pickup device.
  • the light is guided to 91.
  • the prism 28 is arranged at a position where light enters inside the light guide unit 24.
  • another prism 28 is arranged in the direction perpendicular to the direction in which the light enters the light guide unit 24.
  • the light that has entered the light guide unit 24 is vertically bent by the reflecting surface 28a of the first prism 28A, and further vertically bent by the reflecting surface 28a of the second prism 28B, and enters the image pickup apparatus 91.
  • the second light emitting body 21b is arranged behind the first prism 28A arranged on the inlet side of the light guide unit 24, and the first prism is arranged.
  • Light is applied to the corneal surface 62 through 28A.
  • the second light emitting body 21b is a light emitting sheet installed separately from the first light emitting body 21a arranged around the light guide unit 24, and power is supplied from the power supply unit 38 via the wiring 38b.
  • the reflecting surface 28a of the first prism 28A is configured, for example, a half mirror so as to transmit the light of the second light emitting body 21b.
  • the irradiation unit 10B integrally includes an image pickup device 91.
  • the covering portion 20 is configured in the same manner as the irradiation portions 10 and 10A, but does not have the fixture 30.
  • a housing 93 in which the image pickup apparatus 91 is arranged is provided, and further, a power supply unit 38, an inverter 39, and a communication unit 40 are integrally provided in the housing 93.
  • the communication unit 40 communicates with an external device such as a mobile communication terminal 90a, and transmits data captured by the image pickup device 91.
  • the image captured by the irradiation unit 10B can be confirmed on the mobile communication terminal 90a.
  • the external device that communicates with the communication unit 40 is not limited to the mobile communication terminal 90a, and may be an information processing device such as a personal computer.
  • the communication unit 40 communicates by wireless communication, but may be wired communication.
  • FIG. 9 is an example of a state in which the eye 61 to be inspected is imaged using the irradiation unit 10B according to the modified example of the first embodiment.
  • the irradiation unit 10B according to the modified example is held in the hand of the subject 60 and directed toward the eye 61 to be inspected.
  • the subject 60 can check the screen of the mobile communication terminal 90a with the other eye 61a to which the irradiation unit 10B is not directed.
  • the irradiation units 10, 10A and 10B may be collectively referred to as the irradiation unit 10.
  • the subject 60 takes an image of one or more of the following tear fluid evaluation indexes (1) to (4) by himself / herself using the irradiation unit 10.
  • the subject 60 can compare the tear image obtained with the tear image and the actual tear image prepared in advance.
  • the evaluation indexes are (1) the color of the interference image after opening the eyelid, (2) the position where the tear oil layer reaches after opening the eyelid (see FIG. 10), and (3) the tear layer destruction image from the start of opening the eyelid.
  • Table 1 shows an example of the way of thinking when scoring tear health based on the above evaluation index.
  • the scores are set to 5 grades for each of the evaluation indexes (1) to (4), and the one with the highest tear health is 5 points and the one with the lowest tear health is 1 point.
  • the interference fringes after opening the eyelid are gray and uniform
  • the range of upward extension of the tear oil layer after opening the eyelid is the entire cornea
  • the tear image is destroyed for 10 seconds after opening the eyelid. If not observed, (4) the eyes can be kept open for 10 seconds after opening the eyelids, the tear health will be 5 points.
  • the subject 60 can score the tear health by comparing the reference video scored in advance with the image captured by the irradiation unit 10 for one or more items (1) to (4) (). ⁇ :Yokoi, N.; Takeshita, Y.; Kinoshita, S. Correlation of tear lipid layer interference patterns with the diagnosis and severity of dry eye. American Journal of Ophthalmology. 1996, 122(6), 818-824. ⁇ Evaluation of tear film by DR-1. Frontiers in Dry Eye. 2012, 7 (2), 50-55. Etc.).
  • FIG. 10 is an explanatory diagram of an example of the evaluation index (2).
  • the tear oil layer After opening the eyelid, the tear oil layer is pulled up with the upper eyelid, but if the tear volume is insufficient, the tear oil layer does not sufficiently spread over the entire cornea. Therefore, in the evaluation index (2), for example, whether the interference image of tears is spread over the entire cornea (score 5 points in Table 1) or exceeds the arrival position 64a shown in FIG. 10 (score 4 points in Table 1). , The same degree (score 3 points in Table 1), below the arrival position 64a (score 2 points in Table 1), or whether upward development of tear fluid cannot be confirmed (score 1 point in Table 1). The subject 60 determines whether or not. For example, if the interference image of the tear fluid reaches the arrival position 64b in FIG. 10, it is determined to have a score of 2 points, and if it reaches the arrival position 64c, it is determined to have a score of 1 point.
  • the evaluation indexes (1) to (4) are examples and can be changed as appropriate. Further, in the first embodiment, the tear health score is classified into the above five levels, but the number of levels may be appropriately changed to any n levels according to the evaluation index.
  • the tear observing device 100 has a covering portion having a concave surface facing the region including the image pickup device 91 for capturing the image of the eye to be inspected 61 and the eye to be inspected 61 on the face of the subject 60. 20 and a light emitting body 21a that irradiates light toward the eye 61 to be inspected.
  • the light emitting body 21a is installed on the concave surface 21 of the covering portion 20, and the covering portion 20 is provided on the tip portion 22 facing the face of the subject 60 and a part of the concave surface 21, and the image subject 91 has an eye subject 61. It is provided with a light guide unit 24 for guiding the reflected light reflected on the surface of the above.
  • the subject 60 can take an image while irradiating a wide range of the corneal surface 62 of the eye 61 with substantially uniform light with his / her own hands, and the state of the corneal surface 62 can be easily obtained. Can be confirmed at.
  • the illuminant 21a is a surface light source.
  • the corneal surface 62 of the eye to be inspected 61 is irradiated with substantially uniform light, so that the interference pattern of the tear film under the same conditions is observed in each part of the corneal surface 62. It becomes possible to take an image.
  • a light source such as a flat light emitter or a point light source
  • the light is spread and reflected on the convex surface, so that the virtual image of the light source formed on the angular conjunctiva becomes small.
  • the light emitting body 21a arranged on the concave surface 21 is a surface light source, and for example, the light emitting body 21a having a conical shape is arranged in close proximity while covering the eye 61 to be inspected.
  • a virtual image of the light source is created on almost the entire surface of the cornea surface 62, and information on the tear fluid of almost the entire surface of the cornea surface 62 can be obtained.
  • Table 1 (2) it is necessary to observe the dynamics of the tear fluid extending and moving from the lower part to the upper part of the corneal surface 62. Therefore, when evaluating Table 1 (2), it is necessary to observe as wide a range as possible of the cornea, and according to the irradiation unit 10 and the tear sap observation device 100 according to the first embodiment, Table 1 (2). Can properly evaluate the evaluation index of.
  • the light emitting body 21a is arranged around the light guide unit 24.
  • the light guide unit 24 can be arranged in the center of the light emitting body 21a, the corneal surface 62 can be imaged from the front, and the accuracy of observing the tear film can be improved. Can be done.
  • the light emitting body 21a includes a first light emitting body 21a arranged around the light guide unit 24, a second light emitting body 21b arranged in the light guide unit 24, and the like. including.
  • the light guide unit 24 includes a reflection surface 28a that is installed inside and reflects the light incident on the light guide unit 24 to the image pickup apparatus 91.
  • the second light emitting body 21b is arranged inside the light guide unit 24 and behind the reflecting surface 28a.
  • the light emitting body 21a is a light emitting sheet installed on the concave surface 21.
  • the concave surface 21 can be formed into a desired shape at no cost.
  • a thin light emitting sheet is suitable as a light source for the tear observing apparatus 100 because its surface emits light uniformly and can be easily formed into a conical shape.
  • the illuminant 21a is a virtual line b connecting the edge 63 of the exposed portion of the cornea of the eye 61 and the center C of the curved surface formed by the cornea surface 62.
  • c are specified, they are arranged in the region including each point where the concave surface 21 and the virtual line b or c intersect.
  • the illuminant 21a can irradiate a wider area than the corneal surface 62 of the eyeball.
  • the tear observing apparatus 100 can obtain an image in a state where the entire region up to the edge 63 of the corneal surface 62 is irradiated with light.
  • the arrangement of the light emitting body 21a on the concave surface 21 is realized in a state where at least a part of the tip portion 22 of the covering portion 20 is in contact with a part of the face of the subject 60.
  • the tear observing device 100 the positions of the corneal surface 62, the irradiation unit 10, and the imaging device 91 are stable, and accurate imaging and tear observing are possible.
  • the tear fluid observation device 100 further includes a fixture 30, the image pickup device 91 is installed in the mobile communication terminal 90a, and the fixator 30 guides the light guide unit 24 to the image pickup device 91.
  • the mobile communication terminal 90a is sandwiched and fixed.
  • the tear observing apparatus 100 is configured by combining various mobile communication terminals 90a and the irradiation unit 10. Since the subject 60 can use the mobile communication terminal 90a owned by the subject 60 as the tear observing device 100, the tear observing device 100 is highly convenient.
  • the tip portion 22 of the covering portion 20 is arranged farther than the shortest photographing distance of the imaging device 91.
  • the shortest shooting distance means the shortest distance that the image pickup apparatus 91 can focus on.
  • the tear observing apparatus 100 may be provided with a close-up lens 37 in the light guide portion 24 so that the corneal surface 62 can be photographed with the face in contact with the tip portion 22 of the covering portion 20. As a result, the tear observing device 100 can obtain a clear tear image by the image pickup device 91 while stabilizing the covering portion 20 in a state of being pressed against the face.
  • Embodiment 2 The tear fluid health estimation system 1000 according to the second embodiment acquires an image of the corneal surface 62 by using the tear fluid observation device 100 according to the first embodiment, and the information processing apparatus 90 obtains an image of the tear fluid based on the image. It estimates the degree of health.
  • the changes to the first embodiment will be mainly described.
  • FIG. 11 is a diagram showing a hardware configuration of the tear health estimation system 1000 according to the second embodiment.
  • the information processing device 90 corresponds to the mobile communication terminal 90a of the tear observing device 100 according to the first embodiment.
  • the information processing device 90 has the following hardware configuration.
  • the H11 is a CPU, functions as an arithmetic unit and a control unit, and controls various devices connected to the system bus (H20).
  • the H12 is a ROM and stores a BIOS (Basic Input / Output System) program and a boot program.
  • the H13 is a RAM and is used as a main storage device of the H11 which is a CPU.
  • H14 is an external memory, and stores a program processed by the information processing apparatus 90 and information necessary for estimating tear health.
  • the input unit (H15) is a touch panel, keyboard, mouse, controller, or voice input device, and performs processing related to input of information and the like.
  • the display unit (H16) outputs the calculation result of the information processing device 90 to the display device according to the instruction from the CPU (H11).
  • the display device may be of any type, such as a liquid crystal display device, an organic EL display device, a projector, or an LED indicator.
  • H17 is a communication interface for performing information communication via a network, and the communication interface may be of any type such as wired communication using USB or the like or wireless communication.
  • H18 is an input / output unit (I / O) and is connected to an external camera (H19b).
  • the H19a is a built-in camera.
  • the H27 is a sensor, for example, an environmental sensor (temperature, humidity, pressure, illuminance, proximity, fingerprint, heart rate or contact detection sensor, microphone, RGB camera, NFC sensor, magnetic communication, infrared camera, etc.), motion sensor ( Those that detect acceleration or gravity, gyro (rotation, movement, position), magnetism (distance to magnet, speed, acceleration), position detection (GPS, geomagnetism (electronic compass)), etc. Includes sensors capable of identifying substances and physical properties).
  • an environmental sensor temperature, humidity, pressure, illuminance, proximity, fingerprint, heart rate or contact detection sensor, microphone, RGB camera, NFC sensor, magnetic communication, infrared camera, etc.
  • motion sensor Those that detect acceleration or gravity, gyro (rotation, movement, position), magnetism (distance to magnet, speed, acceleration), position detection (GPS, geomagnetism (electronic compass)
  • GPS geomagnetism
  • the built-in camera (H19a) corresponds to the image pickup device 91 mounted on the mobile communication terminal 90a shown in FIGS. 2, 6 and 7.
  • the external camera (H19b) corresponds to the image pickup apparatus 91 mounted on the irradiation unit 10 shown in FIG. 8, and may not exist in the form shown in FIGS. 2, 6 and 7. .
  • the display unit (H16) corresponds to, for example, the display device 92 of the mobile communication terminal 90a.
  • the information processing device 90B is an external device such as a server connected via the Internet, and is connected to the communication interface (H17) of the information processing device 90 by a communication interface (H22).
  • the information processing device 90B includes a CPU (H23), a ROM (H24), a RAM (H25), and an external memory (H26), similarly to the information processing device 90.
  • the external information processing device 90B may be referred to as a second information processing device.
  • FIG. 12 is a diagram showing an example of the functional configuration of the information processing apparatus 90 according to the second embodiment.
  • FIG. 13 is a diagram showing an example of a method for estimating the degree of tear health according to the second embodiment.
  • the camera (H19a or H19b) of the information processing apparatus 90 according to the second embodiment captures an image of the eye 61 to be inspected.
  • the captured image is a moving image and is recorded in an external memory (H14) or the like.
  • the stored image may be a moving image or a still image. In the case of a still image, for example, a difference image obtained by subtracting an image after a certain number of seconds from the image immediately after opening the eyelid may be used, or only an image after a certain number of seconds after opening the eyelid may be used.
  • the camera (H19a or H19b) corresponds to the image pickup apparatus 91 shown in FIGS. 2, 6 to 8.
  • the camera (H19a or H19b) is an external camera (H19b) connected via an I / O (H18) which is an input / output unit, even if it is a built-in camera (H19a) built in the information processing apparatus 90. There may be.
  • the information processing device 90 estimates the tear health level from the data captured by the image pickup device 91.
  • the evaluation unit 101 processes the image captured by the image pickup device 91.
  • the feature extraction unit 102 of the evaluation unit 101 processes the input image into a necessary image and records it in the external memory (H14).
  • the feature extraction unit 102 extracts feature data from the input image.
  • the feature data is an image necessary for classifying the state of the eye 61 to be classified into any of n-level scores.
  • the image extracted as the feature data shows features that can be classified into n levels (5 levels in Table 1) based on the evaluation indexes (1) to (4) shown in Table 1, for example.
  • the n-level score may be used as a feature in machine learning.
  • the evaluation unit 101 is realized by a CPU (H23), a ROM (H24), a RAM (H25), and an external memory (H26) included in the information processing apparatus 90.
  • the evaluation unit 101 may be realized by an external information processing device 90B.
  • Feature data is (1) Information on the presence or absence of an interference fringe pattern generated by reflection of light on the tear oil layer of the tear layer and the color of the interference fringe pattern. (2) Information on the highest point at which the tear oil layer is pulled up in the height direction after opening the eyelids. (3) Information on the tear tear destruction time (BUT) until the tear film is destroyed, and (4) Information on the eyelid opening time from the start of the eyelid opening to the closing of the eyelid of the eye to be inspected. It is an image. As for these feature data, at least one image corresponding to each evaluation index is extracted from the image captured by the image pickup apparatus 91. The extracted image, which is the feature data, may be extracted by image recognition by the learning model.
  • the feature data is evaluated based on the evaluation index and converted into a feature vector by the conversion unit 103.
  • the feature data is evaluated based on the evaluation index and quantified by the conversion unit 103.
  • the feature data is extracted and converted into a feature vector in the evaluation unit 101 by using a learning model generated by using a machine learning algorithm such as a neural network.
  • the learning model referred to here is, for example, a network structure based on a neural network that outputs a result corresponding to an input image from an image and its parameters.
  • the learning model is specifically a CNN (convolutional neural network).
  • learning update of parameters
  • an image is set in the layer on the input side of the learning model, and the correct answer value for the image is set in the layer of the output image. It refers to the process of adjusting the parameters of the neural network so that the output calculated via the neural network approaches the set correct answer value.
  • the processing by the feature extraction unit 102 and the conversion unit 103 in FIG. 12 can be performed by the learning model generated using the teacher data.
  • the generation of the learning model is composed of a performance tear image under various conditions imaged using the tear observation device 100 according to the first embodiment and a score associated with the performance tear image as a teacher label.
  • Created using teacher data For example, teacher data is created by manually evaluating a performance tear image and associating a score from 1 to 5 with the performance tear image based on the evaluation index and judgment criteria shown in Table 1, for example. .. For example, if the actual tear image is in a state such as "the upward extension position of the tear is 1/2 or less" or "tear destruction is observed within 10 seconds after opening the eyelid", the tear is present.
  • the processing unit 104 obtains the tear health level based on the feature vector, the environmental information in which the image was taken, the attributes of the subject, and the behavior data.
  • related information such as the environmental information in which the image was taken, the attributes of the subject, and the behavior data are also input, and the tear fluid health degree. Is output. Tear health is determined, for example, based on images and criteria created from the performance of relevant information associated with the images.
  • the related information is composed of environmental information at the time of imaging, attributes of the subject, and behavior data. All of these relevant information associated with the images has been found to be related to dry eye and is a parameter related to tear fluid and tear health.
  • at least one or more of the related information is used.
  • Attribute information of the subject Gender is an example of related information attached to the image.
  • Attribute information of the subject Gender is an example of related information attached to the image.
  • Attribute information of the subject Gender is an example of related information attached to the image.
  • Attribute information of the subject Gender is an example of related information attached to the image.
  • Attribute information of the subject Gender is an example of related information attached to the image.
  • age Attribute information of the subject Gender, age, pre-existing illness, whether or not contact lenses are worn
  • DEQS / OSDI answers to the depression questionnaire Self-rating depression scale (SDS) .
  • Behavior data of the subject Health data such as sleep time for 24 hours before shooting, VDT usage time, and number of steps (activity amount).
  • Measurement environment information Humidity temperature, seasonal time, measurement model, setting information, shooting date and time, etc.
  • the processing unit 104 outputs the tear fluid health score using the learning model by inputting the feature vector obtained from the tear fluid image, the measurement environment information, the attributes of the subject, and the behavior data of the subject.
  • the learning model is generated using a machine learning algorithm such as a neural network.
  • the learning model is a teacher linked with tear fluid health as a teacher label by inputting related information such as feature vectors obtained from actual tear fluid images, measurement environment information, subject attributes, and subject behavior data. Generated using data.
  • the evaluation unit 101 may use a learning model in which the input is the tear image and the related information accompanying the tear image, and the output is the tear health.
  • CNN convolutional neural network
  • the processing unit 104 becomes a part corresponding to the "fully connected layer (classifier)" of the convolutional neural network, and the above-mentioned related information is provided here together with the feature vector obtained from the teardrop image. Is entered.
  • the classification is performed based on the related information accompanying the tear image, the estimation accuracy of the tear health is improved as compared with the case where only the tear image is compared as in the first embodiment.
  • the tear image when the sleep time of the previous day is 8 hours and the tear image when the sleep time is 1 hour are similar images.
  • the tear image when the sleep time is 1 hour is worse than the tear image when the sleep time is 8 hours.
  • a multimodal learning method for finding features from a plurality of types of input information may be used.
  • the display device 92 outputs the tear fluid health level output from the evaluation unit 101 and shows it to the subject 60.
  • the display device 92 is a screen integrally provided on the mobile communication terminal 90a, but may be displayed on another device such as a screen of a personal computer.
  • FIG. 14 is a flowchart showing an estimation processing procedure in which the information processing apparatus 90 executes estimation of tear health.
  • the processing procedure for estimating the degree of tear health in the second embodiment will be described.
  • each process (step) is described by adding S at the beginning.
  • the information processing apparatus 90 does not necessarily have to perform all the steps described in this flowchart.
  • the flowchart is realized by executing the computer program stored in the external memory (H14) by the CPU (H11) of FIG. 11 which is a computer.
  • the information processing apparatus 90 initializes the system. That is, the program is read from the external memory (H14), and the information processing apparatus 90 is put into an operable state.
  • the image pickup device 91 images the target eye 61.
  • the start of imaging is performed by the subject 60 operating the mobile communication terminal 90a and manually operating the image.
  • the information processing apparatus 90 may determine that the eye 61 to be inspected is in a predetermined position of the image and the image is in focus, and start imaging.
  • the end of the imaging is performed, for example, by the lapse of a predetermined time or by manually instructing the end.
  • the tear health level of the eye 61 to be inspected is estimated based on the recorded image.
  • the estimation of the tear health is input from the image captured by the image pickup apparatus 91a or 91b, processed by the evaluation unit 101 using the learning model, and the tear health is output.
  • the tear fluid health degree estimated by the evaluation unit 101 is displayed on the display device 92.
  • the flow in FIG. 14 may be executed and processed by the CPU (H11), ROM (H12), RAM (H13), and external memory (H14) inside the information processing apparatus 90.
  • the information processing device 90B communicates via the communication interfaces (H17 and H22), transmits a teardrop image to the information processing device 90B, and is an external server or the like.
  • the tear health may be estimated using the learning model recorded in the external memory (H26) of the information processing apparatus 90B.
  • the CPU (H23), ROM (H24), RAM (H25), and external memory (H26) inside the information processing apparatus 90B function as the evaluation unit 101, and the tear health levels of S1 to S4 in FIG. 14 are measured. Perform the estimation flow.
  • FIG. 15 is a flowchart showing a learning processing procedure of a learning model in which the information processing apparatus 90 estimates the tear health level. Next, the processing procedure of the learning flow of the learning model for estimating the tear health in the second embodiment will be described. In the following description, each process (step) is described by adding S at the beginning.
  • the information processing apparatus 90 initializes the system. That is, the program is read from the external memory H14 and the information processing apparatus 90 is put into an operable state.
  • the target eye 61 is imaged by the image pickup apparatus 91.
  • the start of imaging is performed by the subject 60 operating the mobile communication terminal 90a and manually operating the image.
  • the information processing apparatus 90 may determine that the eye 61 to be inspected is in a predetermined position of the image and the image is in focus, and start imaging.
  • the end of the imaging is performed, for example, by the lapse of a predetermined time or by manually instructing the end.
  • the tear quality of the eye 61 to be inspected is analyzed (annotated) with respect to the recorded tear image.
  • the tear quality is estimated using the learning model for the tear image recorded by the evaluation unit 101 in the flow shown in FIG. 14, but the subject 60 inputs the correct answer data for the tear image. Associate and annotate a new teacher label for tear images.
  • the learning model is tuned.
  • the parameters of the learning model are changed by inputting the tear image and the feature vector and the related information accompanying the tear image, and using the correct answer data newly associated by the subject 60 as the teacher label.
  • the evaluation unit 101 compares the tear health degree estimated by the flow shown in FIG. 14 with the correct answer data input by the subject 60.
  • the subject 60 repeatedly estimates the tear health of its own eye 61 using the tear health estimation system 1000, and the subject 60 annotates the learning model in S13.
  • the parameters are tuned to the subject 60.
  • the tear health estimation system 1000 can estimate the tear health of the subject 60 only by the trained tear health estimation model, but the learning flow of FIG. 15 shows data for each subject 60. Can be accumulated and a learning model can be created for each subject 60.
  • the learning model whose parameters have been changed in S14 is recorded in the external memory (H14) of the information processing apparatus 90.
  • the learning model may be recorded in the external memory (H26).
  • the learning model with modified recorded parameters will be used in the estimation flow at the next tear health estimation.
  • the process shown in FIG. 15 may be performed in the terminal of the information processing apparatus 90 or may be performed on the cloud via the Internet.
  • the learning model is CNN (convolutional neural network), but any method may be used as long as it is a method for estimating the health of tears using machine learning.
  • FIG. 16 is an example of a data set used as teacher data in the generation of the learning model according to the second embodiment.
  • the data set shown in FIG. 16 accompanies n tear image images of images t1, image t2, ..., Image tun captured at a certain time t1, t2, ..., Tn, and the tear image. It consists of related information and tear health. Related information includes sleep time, smartphone usage time, and evaluation of subjective symptoms.
  • the evaluation of the subjective symptom is an evaluation of the degree of dry eye felt by the subject, for example, on a scale of 10.
  • the evaluation of subjective symptoms may be expressed by any n level.
  • FIG. 17 is a diagram showing the correlation between dry eye and the quality and quantity of sleep.
  • PSQI is a method for efficiently measuring the quality and quantity of sleep.
  • the association of sleep quality with dry eye disease the Osaka study. Clinical Ophthalmology (Auckland, NZ), 10, 1015. ⁇ . The higher the PSQI score in FIG. 17, the worse the sleep.
  • FIG. 17 The higher the PSQI score in FIG. 17, the worse the sleep.
  • the sleep time data is input to the evaluation unit 101 as related information accompanying the tear image in the estimation of the tear health.
  • the sleep time may be input by the input unit (H15) by the hand of the subject 60, or the sleep time estimated from the information detected by the sensor (H27) may be input.
  • FIG. 18 is a diagram showing the correlation between dry eye and exercise.
  • FIG. 18 shows that non-dry eye has more exercise habits than the dry eye group.
  • Another document also shows that more exercise habits result in higher tear production. Therefore, it is desirable that the data on the exercise habit is input to the evaluation unit 101 as the related information accompanying the tear image in the estimation of the tear health.
  • the data related to the exercise habit may be a MET score, or may be an exercise intensity estimated from the input of the exercise time by the subject 60 itself or the information detected by the sensor (H27).
  • FIG. 19 is a diagram showing an example of the correlation between dry eye and NIBUT.
  • the vertical axis of FIG. 19 indicates the degree of subjective symptoms of dry eye, and the horizontal axis indicates NIBUT (non-invasive tear film destruction time). Symptoms. Eye (25) 502-510 (2011) >>.
  • FIG. 20 is a diagram showing an example of the correlation between NIBUT and smartphone usage time.
  • the vertical axis of FIG. 20 is NIBUT (non-invasive tear film destruction time), and the horizontal axis shows the usage time of the smartphone. status of the tear film and PLos ONE 13 (10): e0206541, 2018 >>.
  • FIGS. 19 and 20 it can be seen that the subjective symptoms of dry eye and the degree of tear health are correlated.
  • the tear fluid health estimation system 1000 As described with reference to FIGS. 16 to 20, there is a correlation between dry eye and VDT time such as sleep time, amount of exercise, and smartphone usage time.
  • VDT time such as sleep time, amount of exercise, and smartphone usage time.
  • the tear fluid health estimation system 1000 not only the tear fluid image but also the related information associated with the tear fluid image is input as the input data to the evaluation unit 101.
  • the tear health estimation system 1000 improves the accuracy of the estimation.
  • by training the tear fluid health estimation model using these related information it is possible to generate a learning model capable of estimating tear fluid health with high accuracy.
  • Embodiment 3 The tear health estimation system 1000 according to the third embodiment makes suggestions for improving or maximizing the tear health estimated in the second embodiment.
  • the changes to the first and second embodiments will be mainly described.
  • the tear health estimation system 1000 has a learning model for estimating tear health learned in the flow of FIG. 15, for example, factors such as sleep time and smartphone usage time are factors in tear health. Find out how much contribution it has. In other words, find out how tear health depends on the factor.
  • the tear health estimation system 1000 performs a simulation for improving or maximizing the tear health estimated in the flow of FIG. 14, and the value of the factor for improving or maximizing the tear health and the mobile communication terminal. Get suggestions for controlling 90a.
  • FIG. 21 is a conceptual diagram of machine learning of a learning model included in the tear health estimation system 1000 according to the third embodiment.
  • FIG. 22 is a conceptual diagram of a method of estimating factors to be improved by optimization simulation from the learning model of the tear health estimation system 1000 according to the third embodiment.
  • uncontrollable factors are fixed
  • controllable variables factors
  • tear health is improved and maximized within that range.
  • the tear image, age, and gender are fixed values because they are uncontrollable factors.
  • the sleep time which is a controllable factor, is set to a limit of 0 hours or more and 12 hours or less, and a value for improving or maximizing the tear health is obtained within the limit.
  • the tear health estimation system 1000 obtains suggestions regarding the contribution, value, and control of factors for improving or maximizing tear health and provides them to the subject 60. be able to.
  • the subject 60 can obtain improvement information on which factor should be changed and how much in order to improve or maximize the tear health, depending on each subject 60.
  • the improvement information leads to actions for improving the tear health level for each subject 60.
  • the mobile communication terminal 90a has a VDT working time of 6.
  • the time is exceeded, an alarm will be notified and lifestyle-related suggestions for improvement will be proposed.
  • the VDT work time means the smartphone usage time.
  • the simulation of the tear health by the tear health estimation system 1000 according to the third embodiment is carried out by varying each factor of the related information (metadata) accompanying the tear image described in the second embodiment, for example. can. As shown in FIG. 22, not only the sleeping time but also the usage time of the smartphone and the amount of activity (exercise intensity) are the factors to be simulated for the tear health.
  • FIG. 23 is a flowchart showing an example of a tear fluid health simulation processing procedure by the tear fluid health estimation system 1000 according to the third embodiment.
  • the target eye 61 is imaged by the image pickup device 91.
  • the image captured in S1 is recorded in the external memory (H14).
  • the tear health level of the eye 61 to be inspected is estimated based on the recorded image. Then, when the tear quality of the eye 61 to be inspected is not the desired tear health, a factor to be improved for obtaining the desired tear health is searched for.
  • Factors to be improved are, for example, sleep time, VDT work time, or the amount of activity of the subject as described above, and should be improved in the tear health estimation model shown in FIGS. 21 and 22. It is estimated how the factors are varied to achieve the desired tear health.
  • the tear health degree of the eye 61 estimated in S23 is displayed based on the recorded image.
  • the result of estimating which factor is changed to obtain the desired value of tear health, which was performed in S23 is displayed as a proposal to the subject.
  • the teardrop observation device 400 according to the fourth embodiment is a head-mounted display (HMD) type obtained by changing the form of the teardrop observation device 100 according to the first embodiment.
  • HMD head-mounted display
  • FIG. 24 is a schematic diagram of the structure of the tear observing apparatus 400 according to the fourth embodiment.
  • the tear observing apparatus 400 of FIG. 24 sees through and displays a part of the structure for explanation.
  • the tear observing device 400 is configured to be fixed to the head of the subject 60 by the fixing tool 450, and the screen 492 is arranged in front of the eye 61 to be inspected.
  • the tear observing apparatus 400 includes a camera 491 that photographs the anterior eye portion for the purpose of tracking the line of sight.
  • the camera 491 corresponds to the image pickup apparatus 91 according to the first embodiment, and can image the corneal surface 62 of the eye 61 to be inspected.
  • the screen 492 can emit light uniformly in white as a whole, and can irradiate the corneal surface 62.
  • the light from the screen 492 is applied to the entire area of the corneal surface 62 as in the light emitter 21a according to the first embodiment, and the reflected light is imaged by the camera 491.
  • the screen 492 may be formed on a concave surface when viewed from the subject 60 side. Further, a lens may be arranged between the screen 492 and the eye 61 to be inspected.
  • the tear health is periodically confirmed by the tear health estimation system 1000 described in the first embodiment or the second embodiment during the work using the head-mounted display. be able to. If necessary, information on actions that improve eye health can also be provided to the user of the head-mounted display.

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Ophthalmology & Optometry (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

Le problème décrit par la présente invention est de procurer un dispositif d'observation de fluide lacrymal, un dispositif de traitement d'informations, un programme, et un procédé de génération de modèle d'apprentissage permettant à des sujets d'imager eux-mêmes un fluide lacrymal et de déterminer facilement l'état de l'œil d'un sujet. La solution de l'invention porte sur un dispositif d'observation de fluide lacrymal qui comprend : un dispositif d'imagerie pour imager un œil d'un sujet ; une partie de couvercle ayant, sur le côté interne, une surface concave formée pour faire face à une région du visage d'un sujet qui comprend l'œil du sujet ; et un corps électroluminescent pour exposer l'œil du sujet à un rayonnement lumineux. Le corps électroluminescent est une source de lumière de surface installée sur le côté interne de la partie de couvercle. La partie de couvercle est pourvue d'une partie d'extrémité distale conçue pour faire face au visage du sujet, et une partie de guidage de lumière qui est disposée sur une partie de la surface concave et qui guide la lumière réfléchie par la surface de l'œil du sujet vers l'unité d'imagerie.
PCT/JP2021/048180 2020-12-26 2021-12-24 Dispositif d'observation de fluide lacrymal, dispositif de traitement d'informations, programme et procédé de génération de modèle d'apprentissage WO2022138912A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-218083 2020-12-26
JP2020218083A JP7464518B2 (ja) 2020-12-26 2020-12-26 涙液観察装置、情報処理装置、プログラム及び学習モデル生成方法

Publications (1)

Publication Number Publication Date
WO2022138912A1 true WO2022138912A1 (fr) 2022-06-30

Family

ID=82158031

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/048180 WO2022138912A1 (fr) 2020-12-26 2021-12-24 Dispositif d'observation de fluide lacrymal, dispositif de traitement d'informations, programme et procédé de génération de modèle d'apprentissage

Country Status (2)

Country Link
JP (1) JP7464518B2 (fr)
WO (1) WO2022138912A1 (fr)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015027008A (ja) * 2013-07-29 2015-02-05 富士通株式会社 情報処理装置、及びプログラム
US20180092534A1 (en) * 2015-10-02 2018-04-05 Tareq Issam Nabhan System and method for ophthalmological imaging adapted to a mobile processing device
JP2019025257A (ja) * 2017-08-04 2019-02-21 エルライズ株式会社 眼科測定装置、及び眼科測定システム
WO2019168142A1 (fr) * 2018-03-02 2019-09-06 興和株式会社 Procédé, dispositif et programme de classification d'image
WO2019193051A1 (fr) * 2018-04-04 2019-10-10 Aston University Dispositif ophtalmique
WO2019232575A1 (fr) * 2018-06-05 2019-12-12 Cylite Pty Ltd Appareil et procédé de mesure in vivo de réponse biomécanique cornéenne
US20200375451A1 (en) * 2019-05-29 2020-12-03 University Of Rochester Methods and Systems for Quantitative Ocular Surface Diagnostics

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015027008A (ja) * 2013-07-29 2015-02-05 富士通株式会社 情報処理装置、及びプログラム
US20180092534A1 (en) * 2015-10-02 2018-04-05 Tareq Issam Nabhan System and method for ophthalmological imaging adapted to a mobile processing device
JP2019025257A (ja) * 2017-08-04 2019-02-21 エルライズ株式会社 眼科測定装置、及び眼科測定システム
WO2019168142A1 (fr) * 2018-03-02 2019-09-06 興和株式会社 Procédé, dispositif et programme de classification d'image
WO2019193051A1 (fr) * 2018-04-04 2019-10-10 Aston University Dispositif ophtalmique
WO2019232575A1 (fr) * 2018-06-05 2019-12-12 Cylite Pty Ltd Appareil et procédé de mesure in vivo de réponse biomécanique cornéenne
US20200375451A1 (en) * 2019-05-29 2020-12-03 University Of Rochester Methods and Systems for Quantitative Ocular Surface Diagnostics

Also Published As

Publication number Publication date
JP7464518B2 (ja) 2024-04-09
JP2022102984A (ja) 2022-07-07

Similar Documents

Publication Publication Date Title
CN113164036B (zh) 用于眼科测试和测量的方法、设备和系统
JP6557707B2 (ja) 眼科測定装置、及び眼科測定システム
JP6072798B2 (ja) 幼児や小児における瞳孔赤色反射検査と眼の角膜光反射スクリーニングを文書化し記録するためのシステムおよび方法
CN110573061B (zh) 眼科检查方法及仪器
KR101785255B1 (ko) 형상 구별 시력 평가 및 추적 시스템
US7562981B2 (en) Biological information acquisition and presentation kit, and pupillary diameter measurement kit
JP6033883B2 (ja) 個人用コンピュータに基づく視野自己測定システムおよび視野自己測定方法
WO2016165052A1 (fr) Détection d'expressions faciales
JP7106569B2 (ja) ユーザーの健康状態を評価するシステム
CN105662343B (zh) 一种干眼检测手持成像装置及干眼检测设备
CN107184178A (zh) 一种智能便携式手持视力筛查仪及验光方法
CN106037626A (zh) 一种头戴式视野检查仪
CN104545787A (zh) 一种穿戴式瞳孔对光反射测量设备
CN110520032A (zh) 虚拟现实设备及其方法
KR102344493B1 (ko) 인공 지능 기반의 스마트 안진 검사 시스템, 방법 및 프로그램
US10070787B2 (en) System and method for detection and monitoring of a physical condition of a user
KR20230005733A (ko) 활동성 갑상선 눈병증 진료를 위한 내원 안내 방법 및 이를 수행하는 장치
US8591031B2 (en) Device and method for determining the visual field
CN204723023U (zh) 一种穿戴式瞳孔对光反射测量设备
US20210315453A1 (en) Visual field examination method and system based on virtual reality
US11185224B2 (en) Ocular monitoring headset
JP2020513870A (ja) 偏光を送達し、グルコースレベルを決定するための拡張現実および仮想現実アイウェア、システム、および方法
KR102304369B1 (ko) Vr을 이용한 안과검사방법 및 시스템
US10531794B1 (en) Photorefractive flash device and system
WO2022138912A1 (fr) Dispositif d'observation de fluide lacrymal, dispositif de traitement d'informations, programme et procédé de génération de modèle d'apprentissage

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21911049

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21911049

Country of ref document: EP

Kind code of ref document: A1