WO2023284946A1 - Microscope ophtalmique ou chirurgical avec dispositif d'affichage et caméra - Google Patents

Microscope ophtalmique ou chirurgical avec dispositif d'affichage et caméra Download PDF

Info

Publication number
WO2023284946A1
WO2023284946A1 PCT/EP2021/069447 EP2021069447W WO2023284946A1 WO 2023284946 A1 WO2023284946 A1 WO 2023284946A1 EP 2021069447 W EP2021069447 W EP 2021069447W WO 2023284946 A1 WO2023284946 A1 WO 2023284946A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
microscope
camera
image plane
image
Prior art date
Application number
PCT/EP2021/069447
Other languages
English (en)
Inventor
Adrian ZIMMERMANN
Frank Zumkehr
Jörg Breitenstein
Claudio DELLAGIACOMA
Caspar TRITTIBACH
Original Assignee
Haag-Streit Ag
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Haag-Streit Ag filed Critical Haag-Streit Ag
Priority to DE112021007958.1T priority Critical patent/DE112021007958T5/de
Priority to PCT/EP2021/069447 priority patent/WO2023284946A1/fr
Publication of WO2023284946A1 publication Critical patent/WO2023284946A1/fr

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/0004—Microscopes specially adapted for specific applications
    • G02B21/0012—Surgical microscopes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/13—Ophthalmic microscopes
    • A61B3/135—Slit-lamp microscopes

Definitions

  • the invention relates to an ophthalmic or surgical microscope hav- ing at least one ocular, at least one camera, at least one beam splitter, and at least one built- in display, with the display provided for overlaying the image of the object with additional information.
  • the invention also relates to methods for operating and cali- brating such a microscope.
  • part of the light from the object to be viewed can be coupled out into the camera (while the rest of the light passes on into the ocular), and light from the display can be coupled into the ocular.
  • This allows to record pictures or videos of the object by means of the camera and overlay infor- mation over the image of the object as viewed through the ocular.
  • two beam splitters are arranged in the light path between the objective optics and the ocular.
  • One beam splitter is used for coupling out the light into the camera, and another beam splitter is used for coupling the light from the display into the light path.
  • the problem to be solved is to provide a microscope and method of this type that provide a simple device design.
  • the invention relates to an ophthalmic or surgical microscope having at least the following elements:
  • These optics comprise at least one objective lens to receive the light from the object to be viewed.
  • the object optics (in cooperation with optional further optics of the microscope) projects an image from an object plane (which is where the object should be located) into an image plane.
  • the objective op- tics may also comprise additional optical elements, such as adjustable zoom optics.
  • An ocular The ocular is adapted to project the image of the image plane into the eye(s) of the user (observer).
  • a camera The camera is positioned to record images from the ob- ject plane. The microscope is adapted to project the object plane into the camera.
  • the display is adapted to generate a display image to be shown to a user viewing the ocular.
  • the display is advantageously a dy- namic, pixel-based display, where each pixel can be controlled individually.
  • the display may also be a static display, e.g. comprising e.g. a mask forming a symbol to be displayed with a light source arranged behind it.
  • This beam splitter is arranged between the objective optics and the ocular. It is positioned to couple out light coming from the objective optics into the camera and to reflect light coming from the display into the ocular.
  • the same beam splitter for coupling out light for the camera and for coupling in light from the display simplifies the device design. In addition, it allows to achieve a higher overall transmission of the light from the object to the ocu- lar as compared to designs that use two beams splitters arranged in series, with one beam splitter adapted to couple the display light into the ocular and with the other beam splitter adapted to couple light out into the camera.
  • the microscope is adapted to prevent that light form the display is being recorded by the camera.
  • the camera may be adapted to repetitively record frames during integration periods separated by idle periods, e.g. for composing a video stream of the object plane.
  • the camera is advantageously adapted to not record frames in the idle period.
  • the display may be adapted to emit light only in the idle periods. This will prevent the light from the display from being recorded by the camera.
  • the invention can advantageously be used in a binocular micro- scope.
  • a microscope comprises at last the following elements:
  • At least two of the oculars are arranged as left ocular and right ocular in a binocular having a left and a right channel.
  • the ob- jective optics cooperate with the binocular to project the image from the object plane into a left and right image plane of the left and the right channel, respectively.
  • a left display and a right display are adapted and positioned to project two separate images into the left and the right channel.
  • the two displays are, advantageously, two separate display devices. Or they can be formed by two sep- arate regions of a s ingle display device,
  • a left beam splitter arranged in the left channel and a right beam splitter arranged in the right channel The left beam splitter is positioned to reflect light coming from the left display into the left channel of the binocular, and the right beam splitter is positioned to reflect light coming from the right display into the right channel of the binocular.
  • the microscope may comprise a left diaphragm in the left image plane and a right diaphragm in the right image plane in order to provide a de- fined field-of-view for both channels of the binocular.
  • the left dia- phragm and the right diaphragm have the same shape, size, and position in the left image coordinate system and the right image coordinate system, respectively.
  • the microscope may be adapted to display a left symbol in the left display and a right symbol in the right display. These two symbols are projected into the left and right image plane.
  • the symbols In these image planes, the symbols have the same size, shape and position in respect to the left and right image coordinate systems, respec- tively. This will make the symbols appear, in the user’s stereoscopic view, in the same plane as the diaphragm and the (correctly positioned) object to be viewed.
  • the user will automatically focus his vision on the image plane as he adjusts the mi- croscope on the object.
  • This, as a consequence, will also properly adjust the micro- scope to image the object onto the camera(s).
  • a good focusing of both the ana- logue image in the ocular as well as the camera image is achieved.
  • each display may display further symbols.
  • the left and right symbol When the left and right symbol have the same positions in the left and right image coordinate system, respectively, they may be at different positions on the left and right display. In other words, when the displays are misplaced or non-cen- trically located in a direction parallel to their display planes, this displacement is com- pensated by not displaying the left and right symbols at the same positions of their displays. This simplifies the manufacture of the device because the displays do not need to be placed with high accuracy, and misalignments can be compensated for while displaying the symbols.
  • the microscope may comprise an offset storage storing at least one display offset value.
  • the position of the left and/or the right symbol on the left or right display is a function of the display offset value.
  • the display offset value(s) can be used to store a parameter depending on the misalignment of the displays in the microscope.
  • the microscope can be cali- brated to compensate for the misalignment.
  • the invention also relates to a method for operating the microscope described herein.
  • the methods comprise the steps of recording at least one image by means of the camera and operating the display to display a symbol in the ocular while con- currently viewing an object through the ocular and the objective optics.
  • the method includes repetitively recording frames by means of the camera during integration periods separated by idle periods.
  • the display is operated to emit light only in the idle periods when the camera is not recording.
  • the invention relates to a microscope having
  • These optics comprise at least one objective lens to receive the light from the object to be viewed.
  • the object optics (in cooperation with optional further optics of the microscope) projects an image from an object plane (which is where the object should be located) into an image plane.
  • the objective op- tics may also comprise additional optical elements, such as adjustable zoom optics.
  • An ocular having an image plane, wherein the microscope is adapted to map an object coordinate system of an object plane into an image coordi- nate system in the image plane.
  • a display having a display coordinate system defined by pixel co- ordinates of the display.
  • each pixel of the display has a fixed coordi- nate in the display coordinate system
  • the coordinate transformation between the display coordinate system and the image coordinate sys- tem depends at least on the mutual alignment of the optics and the display.
  • a display offset storage storing at least one offset value depending on the coordinate transformation.
  • This type of microscope allows to digitally compensate for misa- lignments of its components. Hence, it makes the microscope easier to manufacture.
  • the invention can be used in surgical microscopes as well as oph- thalmic microscopes, and it is particularly suited for slit lamp microscopes.
  • Fig, 1 shows a schematic top view of a microscope
  • Fig, 2 shows a beam splitter, a camera, and a display
  • Fig. 3 shows an embodiment of a DMD display
  • Fig, 4 shows a block circuit diagram of some components of the mi- croscope
  • Fig, 5 is a timing diagram
  • Fig, 6 shows the diaphragm and the symbol as seen through an ocu- lar
  • Fig. 7 shows a perfectly aligned left and right display
  • Fig. 8 shows displays that are laterally misaligned in respect to their diaphragms
  • Fig, 9 illustrates how to adjust the ocular of a convergent binocular
  • Fig, 10 illustrates the coordinate transforms TL and TR from the ob- ject plane into the left and right image planes.
  • Fig, 1 shows some of the optical components of a microscope.
  • the device comprises objective optics 2, which typically include at least one objective lens 4 and further components, such as adjustable zoom optics 6,
  • the microscope fur- ther includes at least one ocular 10a, 10b.
  • a tube lens 9a and/or a prism 9b may be as- sociated with each ocular 10a, 10b.
  • FIG. 1 an embodiment with a binocular 10 comprising two oculars 10a, 10b is shown.
  • the microscope further comprises one or two camera-display-as- semblies 8, which will be described in more detail below.
  • the optics of the microscope are adapted to project an object plane 12 into one or two image planes 14, with each image plane 14 located in an ocular 10a, 10b.
  • the ocular 10a, 10b then projects the image plane 14, in cooperation with the eye lens of the observer, into the observer’s retina.
  • image plane 14 is located between two lenses of the ocular.
  • Other ocular designs are known to the skilled person where the image plane 14 is located on the object side of the ocular lens(es).
  • a diaphragm 16 located in image plane 14 laterally limits and de- fines the field of view of the observer.
  • the microscope When projecting the object plane 12 into the left and right image plane 14, the microscope transforms the “object coordinate system” XO, YO of the object plane into left and right “image coordinate systems” XL, YL and XR, YR as illustrated in Fig. 10 with a left coordinate transform TL and a right coordinate trans- form TR.
  • diaphragm 16 of the left ocular 10a has in the left image coordinate system XL, YL the same size, shape, and position as diaphragm 16 of the right ocular 10a in the right image coordinate system XR, YR.
  • Fig. 2 shows camera-display-assembly 8 in more detail. While Fig.
  • Fig. 1 is a top view of the device
  • Fig. 2 may represent a lateral view.
  • Assembly 8 comprises a display 20, display optics 22, a beam split- ter 24, camera optics 26, and a camera 28. Part of the light 30 coming from objective optics 2 passes beam splitter 24 without being reflected and continues, as light 32, towards the ocular 10a,
  • Display 20 is a pixel-based display, with the pixels arranged in a display plane 36.
  • the light from display 20 passes display optics 22. At least part of it is reflected at beam splitter 24 into the light 32 and proceeds into ocular 10a, 10b.
  • Display optics 22, the optics of ocular 10a, 10b, and any further optics of the micro- scope cooperate to project display plane 36 onto image plane 14. Hence, the observer will see a focused image of the pixels at image plane 36 when viewing the ocular.
  • the camera-display-assembly 8 is structured and or operated such that the light from display 20 is not recorded by camera 28, Options to achieve this are described below.
  • two separate assemblies 8 of the type shown in Fig. 2 may be provided.
  • the microscope shown here may be, as mentioned, a surgical mi- croscope or an ophthalmic microscope.
  • the microscope is an ophthalmic microscope, it may advanta- geously be a slit lamp microscope, in which case it has a slit light illumination 18 as shown in Fig. I, which is adapted to illuminate a patient’s eye with an elongate light field.
  • Slit lamp microscopes are known to the skilled person, see e.g. W02020192900.
  • Fig, 3 shows an embodiment of display 20.
  • display 20 comprises three light sources 38a - 38c of different spectral emission characteristics.
  • they may in- clude a red light source, a green light source, and a blue light source.
  • the light sources are LEDs.
  • each light source may be a single LED.
  • the light from each light source is substantially collimated by means of collimation optics 40a - 40c.
  • Two dichroic mirrors 42a, 42b are used to combine the collimated light from the light sources 38a - 38c to become coaxial,
  • a mirror 44 deflects the light into an assembly of two prisms 46a, 46b with a gap 48 between them.
  • the light beam passes prism 46a, gap 48, and prism 46b and arrives at a spatial light modulator 50,
  • spatial light modulator 50 is a DMD (“digital micro-mirror device”) with a two-dimensional array of individually de- flectable micro-mirrors. These mirrors, arranged in display plane 36, form the pixels of the display. Each mirror has a first and a second position that can be controlled by the control unit of the microscope (see below). For the micro-mirrors being in the first position, the light is re- flected back into prism 46b along a direction denoted by 52 in Fig. 3. Light traveling along this direction 52 is subject to total internal reflection at the interface of second prism 46b to gap 48 and reflected into a direction denoted by 54 in Fig. 3. As shown in Fig. 2, this is the light that will be incident on beam splitter 24.
  • DMD digital micro-mirror device
  • the light is still reflected back into prism 46b, but along a different direction (not shown in Fig.
  • the microscope is able to individually set each pixel (each micro-mirror) of spatial light modulator 50 into an on-state and an off- sate, thereby defining the graphics displayed by display 20).
  • Fig. 4 shows a block diagram of some of the electronic components of the microscope.
  • control unit 60 which may e.g. include a micropro- cessor and memory.
  • Control unit 60 is connected to the displays 20 and cameras 28 of the two camera-display-assemblies 8. It may also be connected to a display 62 for showing an image recorded by the cameras 28. Display 62 may be a stereographic display for showing a stereographic image recorded by the cameras 28.
  • Control unit 60 is adapted and structured, by hardware and/or soft- ware, to operate the microscope. In particular, it is adapted to implement the features “Display Suppression”, “Focus Support”, and “Display Alignment” described in the following sections. Display Suppression
  • camera-display-assembly 8 is structured and/or operated such that the light from display 20 is not recorded by camera 28.
  • beam splitter 24 may be a beam splitter that transmits a fraction t of the light and reflects a fraction 1 - 1 of the light.
  • beam splitter 24 is achromatic, e.g. in the sense that t does not vary by more than +/- 0.1 over the whole visible spectrum of 450 to 700 rna Fraction t may e.g. be between 0.25 and 0.75, the value being cho- sen depending on the light sensitivity of camera 28 and the desired operating condi- tions of the microscope.
  • a dynamic displaying and recording scheme as shown in Fig. 5 may be used as explained in the following.
  • Camera 28 is a digital camera that has a plurality of light sensors (pixels) arranged in a two-dimensional array. As known in the art, such cameras have an “integration phase” where each light sensor integrates the amount of incoming light as well as a “processing phase” where the integration stops and the sensors are read out by the camera electronics.
  • camera 28 repetitively records image frames during integration periods, with the integration periods separated by idle periods. These peri- ods are shown in the line “camera phases” of Fig. 5.
  • the integration period may extend over a time pe- riod T1 and the idle period may extend over a time period T2.
  • display 20 may be adapted to emit light only in the idle periods, i.e. only in time period T2,
  • Fig, 5 for a display 20 of the type shown in Fig. 3.
  • the light sources 38a, 38b, 38c remain off during time period Tl, i.e. during the integration phase of camera 28. Then, they are subsequently switched on during time periods TR (during which the red light source is switched on), TG (green light source), and TB (blue light source), as depicted in the line “light” of Fig. 5,
  • display 20 advantageously has at least two pulsed, differently colored light sources 38a, 38b, 38c. All light sources 38a, 38b, 38c are adapted to operate at different times during a single idle period. But all light sources 38a, 38b, 38c are off during the integration periods.
  • Fig. 5 further shows, in line “pix”, the position of a given pixel mir- ror of spatial light modulator 50.
  • the mirror may be in its on-position only during part of each period TR, TG, TB. This allows to modulate the brightness of the red, green, and blue components at the given pixel.
  • each mirror may be in its on-state or in its off-state.
  • control unit 60 is adapted to bal- ance (at least partially) the position of each mirror over a given time period (which time period may be larger than T1+T2) by determining the accumulated time in its on-state and off-state during the periods TR, TG, TB. If, during these times, a given mirror is longer in its on- state, control unit 60 will switch it into its off- state during the integration period Tl, otherwise it will switch it into its on- state.
  • time periods TR, TG, and TB may have non-equal lengths to compensate for an unequal brightness of the three light sources 38a, 38b, 38c. For the same reason, there may be two or more time periods dedicated to the same light source in a given cycle.
  • camera 28 is operated in free-running mode, i.e, it repetitively records frames without waiting for external trigger signals, This allows to operate camera 28 at a high frame rate.
  • Each integration phase is marked by a camera synch signal, gener- ated by camera 28, as shown in the second line of Fig. 5.
  • the microscope is adapted to time display 20 using the synch signal from the camera.
  • the signal “camera synch” may e.g. coincide with the beginning or the end of the integration phase.
  • Control unit 60 operates spatial light modulator 50 and the light sources 38a, 38b, 38c in synchronicity with the “camera synch” signal.
  • the frames may be defined as “regular” frames while other frames may be defined as “ignored” frames.
  • the regular frames which are advantageously recorded at regular intervals, are used for images or a video sequence suppressing the light from display 20, The ignored frames may be skipped (or used for purposes different from the “regular” frames) by control unit 60.
  • the “integration periods” as claimed designate regular frames only, i.e. display 20 may emit light during the ig- nored frames but must not emit light during the regular frames.
  • the frame rate of camera 28 (i.e, the repetition rate of the integration phases) is at least 60 fjps, in particular at least 120 fps, for flicker- free images.
  • the frame rate of camera 28 is at least 60 fjps, in particular at least 120 fps, for flicker- free images.
  • the user For properly focusing the microscope, the user has to adjust the mi- croscope such that the object to be viewed is located in the object plane 12, Only then will it be projected properly onto the cameras 28 and the image planes 14.
  • the user should have the lenses of Ms eyes focused on the image planes 14, i.e. he should have his view ac- commodated to clearly see the image planes 14, If he is focusing on a plane offset from the image planes 14, he may still be able to adjust the microscope to see the ob- ject clearly, also offset from object plane 12, but in that case the image recorded by the cameras 28 will be blurry.
  • the symbols from the displays 20 may help him focus better on the image planes 14.
  • the depth of field of the symbols from the displays 20 is fairly large and, therefore, an arbitrarily placed symbol alone may not provide sufficient focusing guidance.
  • the symbols displayed by the display 20 are adapted to guide the user’s left and right eyes to the same coordinates of the object coordinate system X0, Y0 and make him adjust the vergence of his eyes to the same point of the object, he will unconsciously accommodate (i.e. adjust the lenses of his eyes) on the image planes 14. For that reason, the user’s accommodation can be supported by pro- jecting the symbols from the left and right displays 20 to the same coordinates in the left and right image coordinate systems XL, YL and XR, YR, respectively.
  • the left display i.e. the display attributed to the left ocular
  • the right display i.e. the display attributed to the right ocular
  • con- trol unit 60 to display a left symbol and a right symbol.
  • These symbols should have, in the image coordinate systems XL, YL and XR, YR, the same size, shape, and posi- tion.
  • Such a symbol 70 in the image plane 14 (with the same image ap- plying to the left and the right image plane) is shown in Fig. 6. As shown, in the left and the right image coordinate system XL, YL and XR, YR, symbol 70 is at the same location with the same size. This assists the user in adjusting his vergence correctly.
  • symbol 70 is centered, in the left and right image plane 14, in the diaphragm 16, thereby further assisting the user to adjust his vergence correctly.
  • the microscope is advanta- geously operated by a method comprising at least the following steps: - Projecting an object image from the object plane 12 into a left im- age plane 14 in the left ocular 10a and into a right image plane 14 in the right ocular
  • left and right symbols have, as projected into the left and right image plane 14, the same sizes and shapes and, in respect to the left and right diaphragm 16, respectively, the same position.
  • symbol 70 comprises two circle sections
  • the circle sections 72a, 72b each have an angular length of less than 180°. There may also be a single circle section only. Or at least one circle section may have an angular length of more than 180° or even an angular length of 360° (in which case the circle section will form a complete circle).
  • symbol 70 may comprise at least one circle (i,e. a circle section of an angular length of 360°) centered in the respective diaphragms 16.
  • the left and right symbols 70 each may comprise at least one circle section 72a, 72b, wherein, in the image planes 14, the circle sections 72a, 72b have the same radii and a center coinciding with a center of the left and right; diaphragm 16, respectively.
  • symbol 70 should be placed such that the user’s attention is drawn to the center of diaphragm 16. Hence, it should be close to this center. However, advantageously, it should not extend into the center because that is usually the place where the user wants to observe a structure of interest.
  • the left and right symbols 70 are dark (ie. the display pixels do not emit light) in a circular core region 74 but have non-dark pixels in at least some of an annular region 76 adjacent to core region 74,
  • Core region 74 is centered in diaphragm 16.
  • the diameter D1 of core region 74 is advantageously at least 10% but less than 30% of the diameter D3 of diaphragm 16.
  • Symbol 70 does not reach into this core region 74.
  • the microscope is adapted to not light up the displays 20 in the regions corresponding to the core regions 74,
  • Annular region 76 is centered in the respective diaphragm 16, and it has an outer diameter D2 of no more than 75%, in particular of no more than 50%, of the diameter D3 of the diaphragm 16. At least part of the symbol 70 is located in this annular region
  • the microscope advantageously is adapted not to light up display pixels corresponding to a central region 77 of image plane 14.
  • This central region 77 extends vertically through the center of diaphragm 16, has a horizontal width W of at least 10% of the diameter D3 of the diaphragm 16 and a vertical height H of at least 50% of the diameter D3 of the diaphragm 16.
  • the microscope may have different operating modes, which may e.g. be selected by the user.
  • it is adapted to operate the displays 20 to fulfill the conditions of this section.
  • the microscope may have other operating modes where the displays 20 oper- ate differently.
  • the microscope may be adapted to display further elements 78 in one or both displays 20, such as tex- tual information or other elements that may e.g. provide information on the operating state of the microscope and/or of measured parameters.
  • These further elements 78 may be distinct (i.e. being at a distance from and not touching) the left and right sym- bol 70, or they may merge with them.
  • the coordinate transformation from the display coor- dinate system into the image coordinate system needs to be known for each micro- scope. In conventional microscopes, this is achieved by accurately aligning (in directions parallel to the display plane 36) the displays 20 with the rest of the opti- cal system. In this case, the coordinate transformation is the same for all microscopes of a given model. However, in view of the high density of pixels in modem displays and the large sensitivity to misalignments, such an accurate placement is costly.
  • Fig. 7 shows a theoretically perfectly aligned left display 20L and right display 20R and how their pixels are projected into the respective left and right image coordinate systems XL, YL and XR, YR, respectively.
  • Fig. 8 shows an exaggerated misalignment of the displays 20L, 20R in respect to the left and right image coordinate systems XL, YL and XR, YR,
  • Such a misalignment can be caused by a poor centering of the dis- plays 20 or of any other component, such as the display optics 22.
  • the transforms from the display coordinates x, y to the image plane coordinates XL, YL and XR, YR depends on the misalignments and may be different for the left and the right display/ocular.
  • Such misalignments can, however, be compensated for by providing control unit 60 with a modifiable offset storage 61 as shown in Fig. 4 and by storing “offset values” therein, which offset values depend on the individual coordinate trans- formation between display coordinates and image plane coordinates of the micro- scope.
  • offset values There may at least be one such offset value per display 20, e.g. if a misalign- ment is unlikely along a first direction but likely along a second direction.
  • two offset values per display 20 are stored in order to adjust for a misalign- ment along both directions x and y of Figs. 7 and 8.
  • the offset values may be offsets from the origin of the display coordinate system x, y to origin of the image plane coordinate system XL, YL orXR, YR.
  • the position of the symbol 70 as displayed in a given display 20 is a function of the offset value(s) stored for this display 20.
  • the offset value(s) can be set in a calibration procedure of the mi- croscope.
  • a calibration procedure may e.g. include the following steps:
  • This detection can e.g. be visual (i.e. by looking into the respective ocular) or by means of a measurement device (e.g. attached to the ocular).
  • the position may e.g. be deter- mined in respect to the feature of a reference image placed in image plane 12 or, as- suming that diaphragm is perfectly aligned, in respect to the diaphragm.
  • a symbol such as symbol 70
  • a symbol 70 may be displayed, in step 1, at a position that would project it centered in respect to the respective dia- phragm 16 or in respect to a mark of the reference image, if the display 20 were per- fectly aligned.
  • the symbol 70 would be centered in the diaphragm 16 or the mark.
  • the respective offset(s) can be stored as offset value(s) (or used to calculate the offset value(s) to be stored).
  • the invention also relates to a microscope having
  • an ocular 10a, 10b having a diaphragm 16 in an image plane 14, wherein the image plane 14 has an image plane coordinate system defined by a loca- tion of the diaphragm 16,
  • a display 20 having a display coordinate system defined by pixel coordinates of the display
  • - optics such as the beam splitter 24 and the display optics 22, for projecting the display into the image plane 14, wherein the coordinate transformation between the display coordinate system and the image plane coordinate system de- pends at least on the mutual alignment of the optics, the display, and the diaphragm,
  • a display offset storage 61 storing at least one offset value depend- ing on the coordinate transformation.
  • the control unit 60 of the microscope is advantageously adapted to determine a location of a symbol to be displayed on the display 20 as a function of the offset value.
  • the invention also relates to calibrating a mi- croscope having such an offset storage 61, which comprises at least the steps of:
  • This aspect of the invention also relates to a plurality of such micro- scopes of a common model type, wherein the offset values between at least some of the microscopes differ from each other.
  • a “common model type” is a set of microscopes that would have, if the optics, the display, and the diaphragm were aligned perfectly, have the same coordinate transformation.
  • Such a scheme allows to compensate, digitally, for hardware misa- lignments in the microscopes of a given model type.
  • This scheme can also be used for microscopes that have no camera and/or where different beam splitters are used for coupling the light from the display into the ocular and for coupling out the light from the objective optics into the cam- era.
  • the microscope of Fig. 1 has a binocular with a non-zero vergence angle ⁇ , i.e. the optical axes 1 la, 1 lb of the oculars 10a, 10b have a mutual non-zero angle ⁇ in respect to each other, advantageously an angle of at least 2°, In other words, the oculars 10a, I Ob are convergent.
  • the user when the user concentrates on the center of the image planes 14, i.e. on the center of the diaphragms 16, his eyes will have a non-zero vergence, too. In that case, he will unconsciously try to accommodate his eyes (i.e, adjust his eye lenses) to a distance corresponding to this vergence. And if lie does that, the ocu- lar and Ms eyes should project the image plane 14 onto Ms retina. Only then will he be able to properly adjust the microscope in respect to the object to be viewed. Hence, advantageously, the user’s eyes should be accommodated to non- infinity.
  • the focal length of the ocular 10a, 10b should be set such that it projects image plane 14 onto the retina 90 of the user’s eye 92 when the user’s eye 92 is accommodated to non- infinity, i.e. when the eye that “is accommodated” on a point at finite distance. This can be achieved by ad- justing the focal length of the ocular 10a, 10b such that the ocular 10a, 10b emits light, towards the user, from a given point 94 in the image plane 14 as a divergent light field 96. Notes
  • the microscope is advantageously adapted to prevent light from the display from being recorded by the camera. In the embodiments above, this is achieved by switching the display to be dark while the camera records a frame.
  • the display may be adapted to emit light that only has a first polarization direction.
  • the beam splitter may be a po- larizing beam splitter adapted to frilly reflect light having the first polarization. This can e.g. be implemented by adding a polarizer 21 (see Fig. 2) between display 20 and beam splitter 24.
  • the display may be adapted to emit in a spectral region only where the transmission of the beam splitter is low.
  • the microscope is a binocular micro- scope having two oculars for stereoscopically viewing the object. It also comprises two cameras, one for each channel of the binocular, Many of the techniques described herein can, however, also be used in devices having a singular ocular only, one display only, and/or one ocular only.
  • any microscope having at least one ocular, at least one display, and at least one camera may advantageously use the techniques for suppress- ing the image from the display in the camera.
  • the techniques to display the left and right symbols properly in the left and right image plane can also be exploited in de- vices having only one camera.
  • a digital micro-mirror device has been used as a display 20.
  • This kind of display is advantageous because it can be switched quickly and is therefore well-suited even for high camera frame rates.
  • another type of fast display may be used, such as an OLED display or a mi- cro-LED display.
  • display 20 is a dynamic, pixel-based display, where each pixel can be controlled by control unit 60 individu- ally to emit a time- varying amount of light.
  • the display may also be a static display .
  • Such a static display may comprise a mask arranged in the display plane and forming the symbol to be displayed.
  • a light source is arranged behind the mask.
  • the mask may e.g. comprise a transparent substrate covered by a non-transparent coating, where parts of the coating have been removed, e.g. by etch- ing, to allow light to pass. The removed parts will in that case e.g. form the symbol 70 to be displayed.
  • This kind of display can be switched on and off by switching the light source on and off. While there are shown and described presently preferred embodi- ments of the invention, it is to be distinctly understood that the invention is not lim- ited thereto but may be otherwise variously embodied and practiced within the scope of the following claims.

Landscapes

  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Surgery (AREA)
  • Ophthalmology & Optometry (AREA)
  • Biomedical Technology (AREA)
  • Optics & Photonics (AREA)
  • Analytical Chemistry (AREA)
  • Biophysics (AREA)
  • Chemical & Material Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Microscoopes, Condenser (AREA)

Abstract

Un microscope ophtalmique ou chirurgical binoculaire, en particulier un microscope à lampe à fente, comporte, pour chaque oculaire (10a, 10b), un affichage (20), une caméra (28) et un diviseur de faisceau (24). Le diviseur de faisceau (24) est utilisé pour coupler la lumière dans l'oculaire à partir de l'affichage (20) et pour coupler la lumière provenant de l'objet visualisé dans la caméra (28). Un affichage pulsé (20) est utilisé, synchronisé avec la fréquence de trame de la caméra, afin de supprimer l'image d'affichage dans l'image de caméra. Les dispositifs d'affichage (20) sont utilisés pour projeter des auxiliaires de focalisation dans l'oculaire, aider l'utilisateur à ajuster correctement le microscope pour prendre des images nettes avec les caméras (28).
PCT/EP2021/069447 2021-07-13 2021-07-13 Microscope ophtalmique ou chirurgical avec dispositif d'affichage et caméra WO2023284946A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
DE112021007958.1T DE112021007958T5 (de) 2021-07-13 2021-07-13 Ophthalmisches oder chirurgisches Mikroskop mit Displaygerät und Kamera
PCT/EP2021/069447 WO2023284946A1 (fr) 2021-07-13 2021-07-13 Microscope ophtalmique ou chirurgical avec dispositif d'affichage et caméra

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2021/069447 WO2023284946A1 (fr) 2021-07-13 2021-07-13 Microscope ophtalmique ou chirurgical avec dispositif d'affichage et caméra

Publications (1)

Publication Number Publication Date
WO2023284946A1 true WO2023284946A1 (fr) 2023-01-19

Family

ID=76943017

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2021/069447 WO2023284946A1 (fr) 2021-07-13 2021-07-13 Microscope ophtalmique ou chirurgical avec dispositif d'affichage et caméra

Country Status (2)

Country Link
DE (1) DE112021007958T5 (fr)
WO (1) WO2023284946A1 (fr)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050237384A1 (en) * 2003-08-14 2005-10-27 Helge Jess Optical viewing system and method for operating the same
US20080123938A1 (en) * 2006-11-27 2008-05-29 Samsung Electronics Co., Ltd. Apparatus and Method for Aligning Images Obtained by Stereo Camera Apparatus
US20150237335A1 (en) * 2014-02-18 2015-08-20 Cisco Technology Inc. Three-Dimensional Television Calibration
WO2015138988A1 (fr) * 2014-03-13 2015-09-17 Richard Awdeh Insert de microscope
US20190175402A1 (en) * 2017-12-12 2019-06-13 Novartis Ag Combined near infrared imaging and visible imaging in a compact microscope stack
WO2020192900A1 (fr) 2019-03-26 2020-10-01 Haag-Streit Ag Dispositif et procédé pour déterminer l'orientation d'un dispositif de microscope ophtalmique
WO2021008686A1 (fr) * 2019-07-16 2021-01-21 Haag-Streit Ag Microscope à lampe à fente ophtalmologique avec modulateur spatial de lumière
CN112346233A (zh) * 2020-12-03 2021-02-09 华中科技大学 一种用于显微镜的增强现实模块
WO2021057422A1 (fr) * 2019-09-25 2021-04-01 腾讯科技（深圳）有限公司 Système de microscope, dispositif médical intelligent, procédé de mise au point automatique et support de stockage

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050237384A1 (en) * 2003-08-14 2005-10-27 Helge Jess Optical viewing system and method for operating the same
US20080123938A1 (en) * 2006-11-27 2008-05-29 Samsung Electronics Co., Ltd. Apparatus and Method for Aligning Images Obtained by Stereo Camera Apparatus
US20150237335A1 (en) * 2014-02-18 2015-08-20 Cisco Technology Inc. Three-Dimensional Television Calibration
WO2015138988A1 (fr) * 2014-03-13 2015-09-17 Richard Awdeh Insert de microscope
US20190175402A1 (en) * 2017-12-12 2019-06-13 Novartis Ag Combined near infrared imaging and visible imaging in a compact microscope stack
WO2020192900A1 (fr) 2019-03-26 2020-10-01 Haag-Streit Ag Dispositif et procédé pour déterminer l'orientation d'un dispositif de microscope ophtalmique
WO2021008686A1 (fr) * 2019-07-16 2021-01-21 Haag-Streit Ag Microscope à lampe à fente ophtalmologique avec modulateur spatial de lumière
WO2021057422A1 (fr) * 2019-09-25 2021-04-01 腾讯科技（深圳）有限公司 Système de microscope, dispositif médical intelligent, procédé de mise au point automatique et support de stockage
US20210373308A1 (en) * 2019-09-25 2021-12-02 Tencent Technology (Shenzhen) Company Limited Microscope system, smart medical device, automatic focusing method and storage medium
CN112346233A (zh) * 2020-12-03 2021-02-09 华中科技大学 一种用于显微镜的增强现实模块

Also Published As

Publication number Publication date
DE112021007958T5 (de) 2024-04-25

Similar Documents

Publication Publication Date Title
KR100519864B1 (ko) 화상정보입력장치및그방법
US5712732A (en) Autostereoscopic image display adjustable for observer location and distance
JP3905736B2 (ja) ステレオ画像撮像装置及び自動輻輳調整装置
US5771066A (en) Three dimensional display device
US5993003A (en) Autostereo projection system
CN106605172A (zh) 显示装置、用于驱动显示装置的方法以及电子设备
JP2001218228A (ja) 立体画像撮影用光学系及びそれを用いた立体画像撮影装置
WO2018001323A1 (fr) Système d'affichage proche de l'oeil, dispositif de réalité virtuelle et dispositif à réalité augmentée
JP5050120B1 (ja) 立体画像表示装置
JPH04331908A (ja) 自動焦点検出装置
US10222597B2 (en) Medical optical observation instrument and method for contrasting polarization-rotating tissue
WO2018001324A1 (fr) Système d'affichage proche de l'œil, appareil de réalité virtuelle, et appareil à réalité augmentée
JPH06339155A (ja) ３次元画像撮影システム
JP2008225079A (ja) 画像表示システム及びボード
WO2023284946A1 (fr) Microscope ophtalmique ou chirurgical avec dispositif d'affichage et caméra
JPH10115878A (ja) 指向性スクリーンを用いる３次元画像投写システム
JP2004258594A (ja) 広角度から鑑賞できる立体画像表示装置
JP2001016620A (ja) 撮像装置、その輻輳距離決定方法、記憶媒体および光学装置
US20060077545A1 (en) Apparatus to align stereoscopic display
JP2001016619A (ja) 撮像装置、その輻輳距離決定方法、記憶媒体および光学装置
US10534156B2 (en) Devices and methods for lens alignment based on encoded color patterns
JP2000209615A (ja) 眼鏡無し立体映像表示装置
JP3064992B2 (ja) 立体画像表示方法及び装置
US7912364B2 (en) Optical observation apparatus and image-pickup apparatus
KR101575147B1 (ko) 무안경식 입체 영상 디스플레이장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21742405

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 112021007958

Country of ref document: DE