WO2020075656A1 - 眼科装置、および眼科装置制御プログラム - Google Patents

眼科装置、および眼科装置制御プログラム Download PDF

Info

Publication number
WO2020075656A1
WO2020075656A1 PCT/JP2019/039384 JP2019039384W WO2020075656A1 WO 2020075656 A1 WO2020075656 A1 WO 2020075656A1 JP 2019039384 W JP2019039384 W JP 2019039384W WO 2020075656 A1 WO2020075656 A1 WO 2020075656A1
Authority
WO
WIPO (PCT)
Prior art keywords
eye
inspected
detection data
control unit
face image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2019/039384
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
橋本　真一
徹 有川
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nidek Co Ltd
Original Assignee
Nidek Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nidek Co Ltd filed Critical Nidek Co Ltd
Priority to JP2020551128A priority Critical patent/JP7491218B2/ja
Publication of WO2020075656A1 publication Critical patent/WO2020075656A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions

Definitions

  • the present disclosure relates to an ophthalmologic apparatus for inspecting an eye to be inspected and an ophthalmologic apparatus control program.
  • an eye refractive power measuring device for example, an eye refractive power measuring device, a corneal curvature measuring device, an intraocular pressure measuring device, a fundus camera, OCT, SLO, etc.
  • a fundus camera for example, it is common to align the optometry portion with respect to the eye to be examined at a predetermined position by manual alignment by operation of a joystick or the like and automatic alignment by bright spot detection of an anterior segment image.
  • Patent Document 2 proposes a device that aligns the eye examination unit with respect to the eye to be examined based on an image obtained by photographing the face of the subject.
  • the position of the eye to be inspected may be erroneously detected, and the alignment may not be properly performed.
  • the present disclosure has a technical problem to provide an ophthalmologic apparatus and an ophthalmologic apparatus control program capable of performing suitable alignment.
  • the present disclosure is characterized by having the following configurations.
  • An ophthalmologic apparatus for inspecting an eye to be inspected which includes eye examining means for inspecting the eye to be inspected, adjusting means for adjusting a three-dimensional relative position between the eye to be inspected and the eye inspecting means, and A face image capturing unit for capturing a face image including at least one of the eyes to be inspected; and a control unit for controlling the adjusting unit, wherein the control unit opens the eyelids of the eye to be inspected based on the face image. Adjusting the three-dimensional relative position between the optometry means and the eye to be examined based on the face image when it is determined whether or not the eyelids of the eye to be inspected are stable It is characterized by doing.
  • An ophthalmologic apparatus for inspecting an eye to be inspected which includes eye examining means for inspecting the eye to be inspected, adjusting means for adjusting a three-dimensional relative position between the eye to be inspected and the eye inspecting means, and A face image capturing unit that captures a face image including at least one of the eyes to be inspected; and a control unit that controls the adjusting unit, wherein the control unit is based on the plurality of face images captured at different timings. The three-dimensional relative position between the eye to be inspected and the eye examining means is adjusted.
  • An ophthalmologic apparatus control program executed in an ophthalmologic apparatus for inspecting an eye to be inspected which is executed by a processor of the ophthalmic apparatus to capture a face image including at least one of the left and right eye to be inspected.
  • Face photographing step determine whether the eyelids of the eye to be inspected is stable based on the face image, based on the face image when it is determined that the eyelids of the eye to be inspected is stable
  • the ophthalmologic apparatus of this embodiment inspects an eye to be inspected.
  • the ophthalmologic apparatus includes, for example, an optometry unit (for example, the optometry unit 2), an adjusting unit (for example, the driving unit 4, the chin rest driving unit 12, and the like), a face photographing unit (for example, the face photographing unit 90), A control unit (for example, control unit 70) is provided.
  • the optometry unit examines the eye to be inspected.
  • the adjustment unit adjusts the three-dimensional relative position between the eye to be inspected and the eye examination unit.
  • the face photographing unit photographs a face image including at least one of the left and right eyes.
  • the control unit controls the adjustment unit.
  • the control unit determines whether the eyelids of the eye to be inspected are stable based on the face image, based on the face image when it is determined that the eyelids of the eye to be inspected are stable, the eye examination.
  • the three-dimensional relative position between the part and the eye to be inspected is adjusted. As a result, it is possible to perform accurate alignment based on the face image when the subject's eye is open.
  • the control unit may determine whether the eyelids of the eye to be inspected are stable based on whether or not the detection data of the eye to be inspected detected based on the face image is stable. In this case, the optometry unit and the subject's eye may be aligned based on the detection data when it is determined to be stable.
  • control unit may determine whether at least a part of the detection data among the plurality of detection data detected based on the plurality of face images captured at different timings is stable.
  • the control unit may select at least a part of the detection data from the plurality of detection data. Further, the control unit may switch the selection process when selecting at least a part of the detection data among the plurality of detection data. Thereby, it is possible to perform alignment between the optometry part and the subject's eye using appropriate detection data.
  • the detection data may include the feature amount of the subject's eye calculated based on the face image.
  • the control unit may switch the detection data selection processing based on the feature amount.
  • the detection data may include the coordinates of the eye to be inspected and the like.
  • the control unit may switch the detection data selection process based on the result of comparison between the feature amount of the eye to be inspected calculated based on the face image and a preset feature amount threshold value. This makes it possible to select appropriate detection data according to the eyelid open state of the subject.
  • control unit may switch between a first selection process of selecting detection data based on the time series newness and a second selection process of selecting detection data based on the size of the feature amount. This makes it possible to select appropriate detection data according to the eyelid open state of the subject.
  • the control unit performs the first selection process when the new K time-series (K ⁇ 1) feature amounts are equal to or more than the threshold value, and at least one of the new K time-series feature amounts is less than the threshold value. And the number of accumulated detection data is J (J ⁇ K) or more, the second selection process may be performed.
  • the control unit performs the first selection process or the second selection process when the new K time-series (K ⁇ 1) feature amounts are equal to or more than the threshold, and the new K time-series (K ⁇ 1) is selected. ) Is less than the threshold value and the accumulated detection data is less than J pieces (J ⁇ K), selection processing is not performed and new time series K pieces (K ⁇ 1)
  • the first selection process or the second selection process may be performed when the amount is less than the threshold and the accumulated detection data is J or more (J ⁇ K).
  • control unit may determine that the detection data is stable when the coordinates of the plurality of detection data are within a predetermined range of each other.
  • the control unit may weight the feature amount according to the position on the face image when detecting the detection data from the face image. This can reduce the possibility of detecting eyebrows, for example.
  • control unit may detect, from the detection data having a large feature amount, one having a low luminance value. As a result, for example, the possibility of detecting something other than the pupil can be reduced.
  • the feature amount may be the degree of circular separation of the pupil of the subject's eye, which is calculated by image processing on the face image. Further, the feature amount may be the circularity of the pupil or the center candidate point of the circle obtained by the Hough transform.
  • control unit may adjust the three-dimensional relative position between the eye to be inspected and the eye examination unit based on a plurality of face images taken at different timings. For example, the control unit may adjust the three-dimensional device positions of the eye to be inspected and the optometry unit based on a plurality of face images captured by the face imaging unit from the same direction. Further, the control unit may determine whether or not the face image is suitable for detecting the relative position.
  • the control unit may execute the ophthalmologic apparatus control program stored in the storage unit (for example, the storage unit 74) or the like.
  • the ophthalmologic apparatus control program includes, for example, a face photographing step and a control step.
  • the face photographing step is, for example, a step of photographing a face image including at least one of the left and right eyes.
  • the control step determines whether or not the eyelids of the eye to be inspected are stable based on the face image, based on the face image when it is determined that the eyelids of the eye to be inspected are stable, and This is a step of adjusting a three-dimensional relative position with respect to the eye to be inspected.
  • the ophthalmologic apparatus of the present embodiment inspects the eye to be inspected, for example.
  • an eye refractive power measuring device will be described as an example of an ophthalmologic device, but a corneal curvature measuring device, a corneal shape measuring device, an intraocular pressure measuring device, an axial length measuring device, a fundus camera, OCT (optical coherence). It is also applicable to other ophthalmologic devices such as tomography) and SLO (Scanning Laser Ophthalmoscope).
  • the ophthalmologic apparatus of the present embodiment may be an apparatus that performs an examination for each eye, or an apparatus that performs an examination for both eyes simultaneously (binocular vision).
  • the ophthalmologic apparatus 1 of the present embodiment mainly includes an optometry unit 2, a face photographing unit 90, and a drive unit 4.
  • the optometry unit 2 inspects the eye to be inspected.
  • the optometry unit 2 may include, for example, an optical system that measures the eye refractive power, corneal curvature, intraocular pressure, etc. of the subject's eye.
  • the optometry unit 2 may include an optical system or the like for photographing the anterior segment of the subject's eye, the fundus and the like.
  • the optometry unit 2 for measuring the refractive power will be described as an example.
  • the face photographing section 90 photographs, for example, the face of the subject's eye.
  • the face photographing unit 90 photographs, for example, a face including at least one of the left and right eyes to be inspected.
  • the drive unit 4 moves, for example, the optometry unit 2 and the face photographing unit 90 with respect to the base 5 in the up-down, left-right, front-back direction (three-dimensional direction).
  • the ophthalmologic apparatus 1 of the present embodiment may include, for example, the housing 6, the display unit 7, the operation unit 8, the face support unit 9, and the like.
  • the housing 6 houses the optometry unit 2, the face photographing unit 90, the driving unit 4, and the like.
  • the display unit 7 displays, for example, an observation image of the subject's eye and measurement results.
  • the display unit 7 may be provided integrally with the device 1 or may be provided separately from the device, for example.
  • the ophthalmologic apparatus 1 may include the operation unit 8.
  • the operation unit 8 is used for various settings of the device 1 and operations at the start of measurement. Various operation instructions from the examiner are input to the operation unit 8.
  • the operation unit 8 may be various human interfaces such as a touch panel, a joystick, a mouse, a keyboard, a trackball, and buttons.
  • the face support 9 may include, for example, a forehead rest 10 and a chin rest 11.
  • the chin rest 11 may be moved in the vertical direction by driving the chin rest drive unit 12.
  • the face support 9 may include a chin rest sensor 113 that detects whether or not the chin rests on the chin rest 11.
  • the chin rest sensor 13 detects, for example, that the chin rest 11 is pushed downward by the subject's chin.
  • the chin rest sensor 13 may be, for example, a photo sensor, a magnetic sensor, a pressure sensor, a contact sensor, or the like.
  • the present device 1 includes a control unit 70.
  • the control unit 70 controls various controls of the device 1.
  • the control unit 70 includes, for example, a general CPU (Central Processing Unit) 71, a ROM 72, a RAM 73, and the like.
  • the ROM 72 stores an ophthalmologic apparatus control program for controlling the ophthalmologic apparatus, initial values, and the like.
  • the RAM temporarily stores various information.
  • the control unit 70 includes an optometry unit 2, a face photographing unit 90, a drive unit 4, a display unit 7, an operation unit 8, a chin rest drive unit 12, a chin rest sensor 13, a storage unit (for example, a non-volatile memory) 74, and the like. It is connected.
  • the storage unit 74 is, for example, a non-transitory storage medium that can retain stored contents even when power supply is cut off.
  • a hard disk drive, a removable USB flash memory, or the like can be used as the storage unit 74.
  • the optometry unit 2 measures, inspects, photographs, etc. the eye to be inspected.
  • the optometry unit 2 may include, for example, a measurement optical system that measures the refractive power of the subject's eye.
  • the optometry unit 2 may include a measurement optical system 20, a fixation target presenting optical system 40, an index projecting optical system 50, and an anterior eye photographing optical system 60. .
  • the measurement optical system 20 may include a projection optical system (light projecting optical system) 20a and a light receiving optical system 20b.
  • the projection optical system 20a projects the light flux onto the fundus Ef through the pupil of the subject's eye.
  • the light receiving optical system 20b takes out a reflected light flux (fundus reflected light) from the fundus Ef in a ring shape through the peripheral part of the pupil and takes a ring-shaped fundus reflection image mainly used for measuring the refractive power. Good.
  • the projection optical system 20a has a measurement light source 21, a relay lens 22, a hall mirror 23, and an objective lens 24 on the optical axis L1.
  • the light source 21 projects a spot-shaped light source image from the relay lens 22 to the fundus Ef via the objective lens 24 and the center of the pupil.
  • the light source 21 is moved in the optical axis L1 direction by the moving mechanism 33.
  • the hole mirror 23 is provided with an opening through which the light flux from the light source 21 through the relay lens 22 passes.
  • the hole mirror 23 is arranged at a position optically conjugate with the pupil of the eye to be inspected.
  • the light receiving optical system 20b shares the hole mirror 23 and the objective lens 24 with the projection optical system 20a.
  • the light receiving optical system 20b has a relay lens 26 and a total reflection mirror 27.
  • the light receiving optical system 20b has a light receiving diaphragm 28, a collimator lens 29, a ring lens 30, and an image pickup device 32 on the optical axis L2 in the reflection direction of the hole mirror 23.
  • a two-dimensional light receiving element such as an area CCD can be used as the image pickup element 32.
  • the light receiving diaphragm 28, the collimator lens 29, the ring lens 30, and the imaging element 32 are moved by the moving mechanism 33 in the optical axis L2 direction integrally with the measurement light source 21 of the projection optical system 20a.
  • the light receiving diaphragm 28 and the image pickup device 32 are also arranged at positions optically conjugate with the fundus Ef.
  • the ring lens 30 is an optical element for shaping the fundus reflected light guided from the objective lens 24 through the collimator lens 29 into a ring shape.
  • the ring lens 30 has a ring-shaped lens portion and a light shielding portion. Further, when the light receiving diaphragm 28 and the image sensor 32 are arranged at a position optically conjugate with the fundus oculi Ef, the ring lens 30 is arranged at a position optically conjugate with the pupil of the eye to be examined.
  • the imaging element 32 receives the ring-shaped fundus reflected light (hereinafter, referred to as a ring image) via the ring lens 30.
  • the image sensor 32 outputs the image information of the received ring image to the control unit 70. As a result, the control unit 70 displays the ring image on the display unit 7 and calculates the refractive power based on the ring image.
  • a dichroic mirror 39 is arranged between the objective lens 24 and the eye to be inspected.
  • the dichroic mirror 39 transmits the light emitted from the light source 21 and the fundus reflection light corresponding to the light from the light source 21. Further, the dichroic mirror 39 guides the light flux from the fixation target presenting optical system 40, which will be described later, to the subject's eye. Further, the dichroic mirror 39 reflects anterior ocular segment reflected light of light from an index projection optical system 50 described later and guides the anterior ocular segment reflected light to the anterior ocular photographing optical system 60.
  • an index projection optical system 50 may be arranged in front of the subject's eye.
  • the index projection optical system 50 mainly projects an index used for alignment (alignment) of the optical system with respect to the subject's eye onto the anterior segment.
  • the index projection optical system 50 may also be used as anterior segment illumination for illuminating the anterior segment of the eye E.
  • the index projection optical system 50 projects an alignment index on the eye to be inspected.
  • the index projection optical system 50 may include a first index projection optical system 51 and a second index projection optical system 52.
  • the first index projection optical system 51 projects the diffused light on the cornea of the eye E to be inspected and projects an index at a finite distance.
  • the first index projection optical system 51 is also used as anterior segment illumination for illuminating the anterior segment of the subject's eye E.
  • the second index projection optical system 52 projects parallel light on the cornea of the eye to be inspected and projects an index at infinity.
  • the control unit 70 acquires the position information of the eye to be inspected by detecting the position of the bright point projected on the eye by the first index projection optical system 51 and the second index projection optical system from the anterior segment image.
  • the optotype presenting optical system 40 may be an optotype presenting optical system for fixing the eye to be examined.
  • the optotype presenting optical system 40 includes at least a light source 41 and a fixation target 42, for example.
  • the light source 41, the fixation target 42, and the relay lens 43 are provided on the optical axis L4 in the reflection direction of the reflection mirror 46.
  • the fixation target 42 is used to fixate the eye to be inspected when the objective refractive power is measured. For example, when the fixation target 42 is illuminated by the light source 41, the fixation target 42 is presented to the subject's eye.
  • the light source 41 and the fixation target 42 are integrally moved in the direction of the optical axis L4 by the drive mechanism 48.
  • the presentation position (presentation distance) of the fixation target may be changed by moving the light source 41 and the fixation target 42. This makes it possible to measure the refractive power by applying a cloud to the eye to be inspected.
  • the anterior eye photographing optical system 60 may be provided to capture an anterior segment image of the subject's eye.
  • the anterior eye photographing optical system 60 includes at least an imaging lens 61 and an imaging element 62.
  • the imaging lens 61 and the imaging element 62 are provided on the optical axis L3 in the reflection direction of the half mirror 63.
  • the image sensor 62 is arranged at a position optically conjugate with the anterior segment of the subject's eye.
  • the image sensor 62 images the anterior segment illuminated by the index projection optical system 51.
  • the output from the image sensor 62 is input to the control unit 70.
  • the anterior segment image 95 of the subject's eye imaged by the image sensor 62 is displayed on the display unit 7 (see FIG. 2).
  • the image pickup element 62 takes an image of the alignment index (in this example, the index at finite distance and the index at infinity) formed on the cornea of the subject's eye by the index projection optical system 50.
  • the control unit 70 can detect the alignment index based on the imaging result of the imaging element 62.
  • the control unit 70 can determine the suitability of the alignment state based on the position where the alignment index is detected.
  • the control unit 70 may detect the working distance based on the positional relationship between the finite distance index and the infinity index.
  • the optical axis L3 of the anterior eye photographing optical system 60 is coaxial with the measurement optical axis L1 by the half mirror 63 and the dichroic mirror 39.
  • the face photographing section 90 may include, for example, an optical system for photographing a face including at least one of the left and right eye to be inspected.
  • the face photographing section 90 of the present embodiment mainly includes, for example, an image pickup element 91 and an image pickup lens 92.
  • the face photographing unit 90 is provided, for example, at a position where both eyes of the eye to be examined can be photographed when the optometry unit 2 is at the initial position.
  • the initial position of the optometry unit 2 is set to a position displaced to the right side with respect to the examination optical axis of the optometry unit 2 so that the right eye can be easily examined. Therefore, the face photographing unit 90 is provided at a position where both eyes of the eye to be examined can be photographed in a state where the optometry unit 2 is at the initial position displaced to the right.
  • the face photographing unit 90 is arranged in the machine center with the optometry unit 2 in the initial position.
  • the face photographing unit 90 is laterally displaced from the machine center of the apparatus body by the one-eye interpupillary distance. It may be arranged in a position.
  • the average value of the distance between the pupils of one eye is about 32 mm.
  • the face photographing unit 90 of this embodiment is moved together with the optometry unit 2 by the driving unit 4.
  • the face photographing unit 90 may be fixed to the base 5 and may not move.
  • the face illumination optical system 80 illuminates the face of the subject's eye.
  • the face illumination optical system 80 may be provided to illuminate the face of the subject including both eyes of the subject.
  • the face illumination optical system 80 includes, for example, an illumination light source 81.
  • the illumination light source 81 emits infrared light.
  • the face illumination optical system 80 may be capable of uniformly illuminating the face of the eye to be inspected around the optical axis of the face photographing unit 90.
  • the illumination light source 81 is provided at the left and right positions of the optometry window.
  • the face illumination optical system 80 may be provided at symmetrical positions with respect to the face photographing unit 90. For example, it may be provided at symmetrical positions with respect to the face photographing unit 90, or may be provided at vertically symmetrical positions.
  • the face illumination optical system 80 uses a light source having a lower directivity than the index light source for alignment.
  • Control method> The control operation of the device 1 will be described below with reference to FIG.
  • the apparatus 1 automatically performs alignment of the optometry unit 2 and the eye to be inspected, for example, in order to inspect the eye.
  • Step S1 subject detection
  • the control unit 70 detects the presence or absence of the subject. For example, the control unit 70 determines the presence or absence of a person based on the output from the chin rest sensor 13. The control unit 70 determines that there is a subject when there is an output from the chin rest sensor 13, and determines that there is no subject when there is no output from the chin rest sensor 13. When determining that there is a subject, the control unit 70 proceeds to step S3.
  • the control unit 70 may detect the presence / absence of the subject based on the output from the face imaging unit instead of the output from the chin rest sensor 13. For example, the presence or absence of the subject may be detected based on the brightness value of the image captured by the face capturing unit 90, the change in the brightness, and the like.
  • Step S2 Face shooting
  • the control unit 70 captures the face of the subject supported by the face support unit 9 by the face capturing unit 90 and acquires a face image 96 as shown in FIG.
  • Step S3 Eye detection
  • the control unit 70 determines the most recognizable area A1 by performing image processing on the face image 96. For example, the control unit 70 determines the region A1 based on the characteristics of the face such as the eye to be inspected or the eyebrows.
  • the control unit 70 searches for the center of the eye (for example, the pupil) in this area A1.
  • the control unit 70 applies a circular separation degree filter to the area A1 to calculate the circular separation degree of each pixel.
  • the circular separability filter for example, 5 ⁇ 5 rectangles as shown in FIG. 6 are used.
  • the control unit 70 obtains the degree of separation of the average brightness and the like of the two areas of the 3 ⁇ 3 area A2 at the center of FIG. 6 and the area A3 around the area A2 as the degree of circular separation.
  • the circular separation degree ⁇ is calculated using the following equations (1) to (3).
  • N is the total number of rectangles in the two areas
  • n 1 and n 2 are the number of rectangles in the areas A 2 and A 3, respectively
  • ⁇ T is the total variance value of the entire areas
  • P i bar Indicates the average luminance value of the rectangle i
  • P 1 bar and P 2 bar indicate the average luminance value of the regions A2 and A3, respectively
  • P m bar indicates the average luminance value of the entire region.
  • control unit 70 leaves the point with the dark center as the candidate point of the pupil. For example, the control unit 70 sets the point where the central brightness is minimum as the candidate point of the pupil.
  • the circular separation may be higher in the eyebrows than in the pupils.
  • the control unit 70 determines that the point on the upper side of the area A1 having a high degree of circular separation is unlikely to be a pupil, and thus the circular degree of circular separation of the coordinates on the upper side of the area A1 becomes small as shown in FIG.
  • the circular separation degree may be weighted with a weighting coefficient. If the approximate vertical position of the pupil in the area A1 is known by the method for detecting the area A1 from the face image 96, the weighting coefficient below that position may be 1.0.
  • the control unit 70 uses the relationship that the pupil has lower luminance than the vicinity of the inner corner of the eye, and performs processing for leaving a point having a high degree of circular separation and a dark central region of 5 ⁇ 5 rectangles as a candidate point. To do. For example, the control unit 70 calculates the maximum circular separability among the candidate points of the pupil remaining by the processing up to this point, and selects the center among the candidate points having the circular separability of 60% or more of the maximum circular separability. Calculate the minimum value of brightness. Then, the control unit 70 leaves a point having a center luminance of 130% or less of the lowest luminance as a candidate point.
  • control unit 70 sets the pupil having the highest degree of circular separation among the candidate points narrowed down by the above processing as the pupil.
  • the control unit 70 stores the pupil detection data in the storage unit 74.
  • the detection data includes, for example, the coordinates of the pupil and the degree of circular separation.
  • Step S4 Data number determination (1)
  • the control unit 70 determines the number of data. For example, the control unit 70 determines whether the number of pieces of detection data stored in the storage unit 74 is K or more. In this embodiment, the control unit 70 determines whether there are two or more pieces of detection data. When there are two or more pieces of detection data, the process proceeds to step S5, and when there is less than two pieces of detection data, the process returns to step S2 to perform face shooting and eye detection.
  • Step S5 threshold determination
  • the control unit 70 determines whether or not the feature amount of the latest K pieces of detection data is equal to or more than a threshold value.
  • the control unit 70 uses, for example, the degree of circular separation as the feature amount.
  • the circular separability has a large feature amount in a circular portion such as a pupil and a small feature amount in a non-circular portion.
  • the circular resolution with the eyes closed is smaller than the circular resolution with the eyes open. Utilizing this feature, the control unit 70 determines whether or not the eyes are wide open in a stable manner or other than that by observing the time series change of the feature amount.
  • the control unit 70 determines whether or not the circular separability of the latest two pieces of detection data is equal to or more than a threshold value. If the degree of circular isolation is equal to or greater than the threshold value, the process proceeds to step S6, and if the degree of circular isolation is less than the threshold value, the process proceeds to step S7.
  • the process proceeds to step S6 when the eyes can be detected in the second frame.
  • Step S6 Data selection (1)
  • the control unit 70 selects the latest K pieces of detection data. In the case of the present embodiment, the control unit 70 selects the latest two pieces of detection data.
  • Step S7 Data number determination (2)
  • the control unit 70 determines the number of data. For example, the control unit 70 determines whether or not the detection data of the eye to be inspected is J or more. In this embodiment, the control unit 70 determines whether there are four or more pieces of detection data.
  • Step S8 Data selection (2)
  • the control unit 70 selects K pieces of data in descending order of feature amount from the accumulated data in which the detected data is accumulated. In the case of the present embodiment, the control unit 70 selects two pieces of data in descending order of feature amount.
  • step S5 the threshold value determination is performed after the fourth frame analysis, but the condition that the feature amount of the third frame does not exceed the threshold value and exceeds the threshold value for two consecutive frames (stable eyes wide open. Since it does not satisfy the condition (determined to be present), the process proceeds to step S7. After that, the process proceeds to step S8 and the accumulated data for the past four frames is traced back. For example, the control unit 70 sorts the accumulated data for the past four frames in descending order of the feature amount and selects the detection data having the high feature amount. As a result, it is possible to exclude the detection data of the blinking moment having a low feature amount. For example, as shown in FIG.
  • the coordinates D1 and D2 are below the eyes, and as shown in FIG. It is out of position. Therefore, as described above, by selecting the detection data having a high feature amount, the possibility that the detection data deviated from the position of the pupil is selected is reduced.
  • the feature amount of any frame may not exceed the threshold value (see FIG. 12). Even in such a case, a plausible analysis result can be obtained by selecting detection data of a highly reliable (large feature amount) frame among the detection data of the past J frames (for example, the past 4 frames). You can
  • control unit 70 does not have to select all the accumulated data when selecting K pieces of data in descending order of feature amount, and may select from J pieces of data.
  • Step S9 Judgment of stability condition
  • the control unit 70 determines whether the detection data of the eye to be inspected is stable. For example, the control unit 70 determines that the detection data is stable when the coordinates of the plurality of detection data are close (for example, within 32 pixels).
  • Step S10 Adoption of detection data
  • the control unit 70 adopts the detection data determined to be stable.
  • the control unit 70 may adopt the latest detected data in time series among the plurality of detected data, or may use the detected data having a large feature amount.
  • the control unit 70 may adopt the detection data having the maximum or minimum feature amount, or the detection data having the median feature amount, among the plurality of detection data. You may employ
  • the control unit 70 may change the detection data to be used according to the control flow.
  • the control unit 70 may adopt the latest detection data when passing through step S6, and may adopt the detection data having a large feature amount when passing through step S8.
  • Step S11 alignment
  • the control unit 70 performs the alignment based on the adopted detection data of the eye to be inspected.
  • the control unit 70 obtains the direction of the eye E to be inspected seen from the face photographing unit 90 based on the face image 96 photographed by the face photographing unit 90.
  • the direction of the eye to be inspected is, for example, a three-dimensional direction (for example, a space vector).
  • Equation 4 the relationship between y e ) and the actual coordinates (X e , Y e , Z e ) of the eye E is expressed as in Equation 4.
  • Equation 5 is a camera internal parameter
  • f x and f y are focal lengths
  • s is skew distortion
  • (c x , c y ) is an optical center on the image.
  • Equation 6 is a camera external parameter of the face photographing unit 90
  • Equation 7 is a rotation component of the face photographing unit 90.
  • T X , t Y , t Z is a translational component of the face photographing unit 90 (position of the face photographing unit 90).
  • h is an arbitrary scale.
  • Equation 8 is established from Equation 4.
  • h ' h / Z e .
  • h ′, m, and n, and m and n can be obtained by solving the simultaneous equations that expand the equation 9.
  • the ratio of X e ': Y e ': Z e 'is obtained, and as a result, the direction vector V of E'is obtained.
  • the control unit 70 obtains the direction of the eye to be inspected as seen from the face photographing unit 90.
  • the control unit 70 controls the drive unit 4 based on the detected direction of the eye to be inspected to move the eye examination unit 2. For example, as shown in FIG. 13, the control unit 70 moves the alignable area Aa by the anterior ocular segment imaging optical system 60 onto the straight line B connecting the face imaging unit 90 and the eye to be examined.
  • the alignable area Aa is, for example, an area where the three-dimensional position of the eye to be inspected can be detected from the anterior segment image 95 captured by the anterior segment imaging optical system 60 at a certain position.
  • the control unit 70 drives The alignable area Aa can be moved to the straight line B by the portion 4.
  • the control unit 70 moves the anterior ocular photographing optical system 60 from the position Q1 to the position Q2 so that the straight line B is included in the area of the alignable area Aa.
  • the position Q2 is, for example, a position on the straight line B where the position G1 of the measurable range Ea that can be measured by the optometry unit 2 on the side closest to the face photographing unit 90 matches the center of gravity of the alignable area Aa.
  • the measurable range Ea is determined by the working distance of the optometry unit 2 and the driving range of the driving unit 4, for example.
  • the control unit 70 moves the anterior ocular segment imaging optical system 60 to the position Q2 and positions the alignable area Aa on the straight line B. Then, the control unit 70 moves the anterior eye photographing optical system 60 further in the direction based on the straight line B while photographing the eye to be inspected by the anterior eye photographing optical system 60. For example, as shown in FIG. 14, the anterior ocular photographing optical system 60 is moved from the position Q2 to the position Q3.
  • the position Q3 is, for example, a position where the position G2 farthest from the origin O of the measurable range Ea coincides with the center of gravity of the alignable area Aa.
  • the control unit 70 moves the anterior ocular imaging optical system 60 in the direction along the straight line B so that the alignable area Aa includes at least a part of the straight line B, for example, while moving from the position Q2 to the position Q3.
  • the eye to be inspected can be positioned in the alignable area Aa.
  • the control unit 70 can align the eye to be inspected with the eye 2 from the anterior segment image 95 captured by the anterior segment imaging optical system 60.
  • the control unit 70 analyzes the anterior segment image 95 captured while moving in the direction to the subject's eye, and detects the bright spot T or the pupil U projected by the index projection optical system 50 on the subject's eye. For example, the control unit 70 detects the bright spot T based on the luminance information of the anterior segment image 95. Further, the control unit 70 detects the edge of the anterior segment image 95 and detects the pupil U based on the shape or the like.
  • the control unit 70 controls the drive unit 4 based on the detected bright spot T or pupil U to perform alignment of the optometry unit 2 with respect to the subject's eye.
  • Step S12 measurement
  • the control unit 70 causes the optometry unit 2 to start measuring the eye to be inspected.
  • the optometry unit 2 measures the eye refractive power of the subject's eye.
  • it is not limited to the measurement of the refractive power, and various kinds of measurement / imaging, etc. may be executed according to the type of the optometry part.
  • the coordinates other than the pupil are detected in the eye detection process in the face photographing unit 90. Is reduced. Thereby, the alignment is performed more favorably.
  • the circular separability is used for the detection of the center of the eye in step S3 and the feature amount in step S5, but the invention is not limited to this.
  • circularity which is a type of shape feature of a binary image
  • the circularity is a scale showing how close the shape of a binarized image is to a circle, and is calculated by 4 ⁇ S / L ⁇ 2 where S is the area and L is the perimeter.
  • S is the area and L is the perimeter.
  • the circularity has a value closer to 1 as it is closer to a perfect circle, and becomes smaller as the shape becomes more complicated.
  • the circularity is used for the image obtained by binarizing the face image 96. Since the center of the eye (for example, the pupil) has a black circular shape in the binarized image, the circularity is high.

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Ophthalmology & Optometry (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Eye Examination Apparatus (AREA)
PCT/JP2019/039384 2018-10-10 2019-10-04 眼科装置、および眼科装置制御プログラム Ceased WO2020075656A1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2020551128A JP7491218B2 (ja) 2018-10-10 2019-10-04 眼科装置、および眼科装置制御プログラム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018192184 2018-10-10
JP2018-192184 2018-10-10

Publications (1)

Publication Number Publication Date
WO2020075656A1 true WO2020075656A1 (ja) 2020-04-16

Family

ID=70165222

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/039384 Ceased WO2020075656A1 (ja) 2018-10-10 2019-10-04 眼科装置、および眼科装置制御プログラム

Country Status (2)

Country Link
JP (1) JP7491218B2 (https=)
WO (1) WO2020075656A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240110828A1 (en) * 2022-09-29 2024-04-04 Commissariat à l'Energie Atomique et aux Energies Alternatives Method for determining the operating state of a light-emitting implant

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004041470A (ja) * 2002-07-12 2004-02-12 Canon Inc 眼科装置
JP2013081518A (ja) * 2011-10-06 2013-05-09 Topcon Corp 眼科装置

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004041470A (ja) * 2002-07-12 2004-02-12 Canon Inc 眼科装置
JP2013081518A (ja) * 2011-10-06 2013-05-09 Topcon Corp 眼科装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
FUKUI, KAZUHIRO ET AL.: "Facial Feature Point Extraction Method Based on Combination of Shape Extraction and Pattern Matching", IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS D-II, vol. J80-D-II, no. 8, 25 August 1997 (1997-08-25), pages 2170 - 2177, XP000782034 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240110828A1 (en) * 2022-09-29 2024-04-04 Commissariat à l'Energie Atomique et aux Energies Alternatives Method for determining the operating state of a light-emitting implant
US12498266B2 (en) * 2022-09-29 2025-12-16 Commissariat à l'Energie Atomique et aux Energies Alternatives Method for determining the operating state of a light-emitting implant

Also Published As

Publication number Publication date
JP7491218B2 (ja) 2024-05-28
JPWO2020075656A1 (ja) 2021-09-16

Similar Documents

Publication Publication Date Title
CN107495919B (zh) 眼科装置
JP6143447B2 (ja) 眼科装置及び眼測定方法、並びにプログラム
JP6075844B2 (ja) 眼科装置および眼科方法並びに記憶媒体
CN109310316B (zh) 眼科装置
US10307058B2 (en) Ophthalmologic apparatus
JP6641730B2 (ja) 眼科装置、および眼科装置用プログラム
JP6853496B2 (ja) 検眼装置及び検眼プログラム
JP2014209994A (ja) 眼科装置、眼科装置の制御方法、プログラム
JP6701987B2 (ja) 眼科装置、および眼科装置制御プログラム
JP6862685B2 (ja) 眼科装置、および眼科装置制御プログラム
JP7266375B2 (ja) 眼科装置及びその作動方法
JP6634765B2 (ja) 眼科装置、および眼科装置制御プログラム
JP6407631B2 (ja) 眼科装置
JP6769092B2 (ja) 眼科装置
JP6843527B2 (ja) 眼科装置、および眼科装置制御プログラム
JP7550586B2 (ja) 眼科装置及びその作動方法
JP7607099B2 (ja) 眼科装置
JP7491218B2 (ja) 眼科装置、および眼科装置制御プログラム
JP2022157348A (ja) 眼科装置
JP7283391B2 (ja) 眼屈折力測定装置
JP6769091B2 (ja) 眼科装置、および眼科装置制御プログラム
JP6701988B2 (ja) 眼科装置
JP2020137915A (ja) 自覚式検眼装置及び自覚式検眼プログラム
JP7187769B2 (ja) 眼科装置、および眼科装置制御プログラム
JP6927389B2 (ja) 眼科装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19871639

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020551128

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19871639

Country of ref document: EP

Kind code of ref document: A1