EP3769138A1 - Mikroskopsystem und verfahren zur steuerung eines solchen mikroskopsystems - Google Patents
Mikroskopsystem und verfahren zur steuerung eines solchen mikroskopsystemsInfo
- Publication number
- EP3769138A1 EP3769138A1 EP19711312.9A EP19711312A EP3769138A1 EP 3769138 A1 EP3769138 A1 EP 3769138A1 EP 19711312 A EP19711312 A EP 19711312A EP 3769138 A1 EP3769138 A1 EP 3769138A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- microscope
- control
- image
- adjustable
- display area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 238000001000 micrograph Methods 0.000 claims abstract description 58
- 238000005286 illumination Methods 0.000 claims abstract description 49
- 238000004590 computer program Methods 0.000 claims description 14
- 238000002073 fluorescence micrograph Methods 0.000 claims description 12
- 238000004891 communication Methods 0.000 claims description 9
- 230000008859 change Effects 0.000 claims description 7
- 230000001960 triggered effect Effects 0.000 claims description 5
- 230000002093 peripheral effect Effects 0.000 claims 1
- 210000003811 finger Anatomy 0.000 description 10
- 239000000523 sample Substances 0.000 description 8
- 238000006073 displacement reaction Methods 0.000 description 5
- 238000010079 rubber tapping Methods 0.000 description 5
- 230000003213 activating effect Effects 0.000 description 4
- 230000003321 amplification Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 4
- 238000003199 nucleic acid amplification method Methods 0.000 description 4
- 238000004113 cell culture Methods 0.000 description 3
- 230000002349 favourable effect Effects 0.000 description 3
- 238000011835 investigation Methods 0.000 description 3
- 210000005224 forefinger Anatomy 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 210000003813 thumb Anatomy 0.000 description 2
- 230000029663 wound healing Effects 0.000 description 2
- 206010028980 Neoplasm Diseases 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000001464 adherent effect Effects 0.000 description 1
- 230000033115 angiogenesis Effects 0.000 description 1
- 230000004071 biological effect Effects 0.000 description 1
- 239000012472 biological sample Substances 0.000 description 1
- 230000008602 contraction Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000005057 finger movement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 230000000873 masking effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 108090000623 proteins and genes Proteins 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 238000001890 transfection Methods 0.000 description 1
- 230000007998 vessel formation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/06—Means for illuminating specimens
- G02B21/08—Condensers
- G02B21/12—Condensers affording bright-field illumination
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/24—Base structure
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/24—Base structure
- G02B21/26—Stages; Adjusting means therefor
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/368—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements details of associated display arrangements, e.g. mounting of LCD monitor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Definitions
- the present invention relates to a microscope system, a method for controlling such a microscope system, and a computer program and a computer program product for implementing such a method.
- the present invention relates generally to the field of digital microscopes.
- Microscope components comprising at least one microscope objective, at least one microscope illumination device and (at least) a microscope camera for generating a microscope image are known from the prior art for various purposes.
- objects to be examined can be imaged in a transmitted-light brightfield illumination or in a reflected-light fluorescence illumination.
- the objects may, for example, be cell cultures which are investigated for tumor diagnostics and / or cancer research. Issues to be clarified are, for example, the existing growth (number of cells), angiogenesis (new blood vessel formation), transfection efficiency (number of cells with inserted gene), wound healing (duration for the merging of separate cell areas) or confluency (degree of coverage the surface of a culture vessel with adherent cells).
- WO 03/081235 Al a method for the examination of cells with a microscope is known, which has a computer-assisted movable microscope stage and a camera for generating a microscope image.
- the microscope stage carries the cell cultures, the camera transmits this
- Microscope image to a computer displaying this on a monitor. After taking an overview image, a cell of interest is identified, which is then viewed centered at a higher magnification.
- EP 2 023 127 A1 discloses a method and a device for examining biological samples, wherein a biological activity of the sample is to be monitored continuously over a long period of time.
- the device has a microscope with a temperature-controlled microscope stage and a microscope camera for generating a microscope image, which is displayed on a monitor.
- Microscope system and / or a remote display of the generated microscope images In this way, a remote control of the microscope image and a remote evaluation can be carried out especially for longer-lasting investigations.
- the object of the present invention is therefore to provide a microscope system and a corresponding method for controlling the same by means of which such a largely automated and in particular remotely controllable
- a microscope system has at least one microscope with a plurality of microscope components that are electrically adjustable and / or activated via a control device of the microscope
- Microscope lens at least one microscope illumination device and at least one microscope camera which generates a digital microscope image
- a control and display device (20) which generates control signals for controlling at least one of the adjustable and / or activatable microscope components and for displaying the microscope image.
- the control and display device is in communication with the control device of the microscope and has a display area on which at least a section of the generated digital microscope image is displayed, which is superimposed on a virtual graphical control element.
- the control element in this case has a plurality of control panels, wherein one or more control panels are set up such that the control and display device on selection of a control panel one or more of the adjustable and / or activatable microscope components and / or means for
- Microscope image wherein these components at least one Microscope illumination device, (at least) comprise a microscope objective and (at least) a microscope camera.
- these components at least one Microscope illumination device, (at least) comprise a microscope objective and (at least) a microscope camera.
- Microscope lighting device on or off or in their
- Illuminance can be adjusted, the desired microscope objective pivoted into the beam path or the existing be activated (including the simple presence of a fixed lens in the beam path to fall) and / or the microscope camera on or off or their
- the microscope system further comprises a control and display device, in particular in the form of a remote control and display device, for controlling at least one of the adjustable microscope components and for displaying the
- Microscope image wherein the control and display device has a display area for displaying at least a portion of the generated microscope image.
- control element is graphically overlaid on the displayed microscope image, wherein the control element has a plurality of selectable control panels (eg control buttons), one or more of these control panels being set up in such a way that upon selection or selection or
- Actuation of a control panel one or more of the adjustable / activatable microscope components via the control and display device or via a present in the control and display processor (hereinafter referred to as
- Arimetic unit of the control and display device which is or which communicates with the control device of the microscope in communication, are controlled; For example, by selecting a
- Microscope illumination select the appropriate (or existing) microscope objective and turn on the microscope camera to create a microscope image in the further course of the investigation can be, for example
- Control panel means for changing related to the display area settings in the control and display device via the control and display device or the above-defined "arithmetic unit” are controlled in the control and display device. In this way it is possible, for example, a digital shift or a digital enlargement (digital zoom) or a
- the operating element according to the invention is designed such that upon selection of the operating element itself, this is changed by means of gesture control in its position and / or in its size and / or shape. Under "Selection" of a
- Control panel or the operating element is here a selection or selection or operation eg. By tapping with the finger of a user on a touch screen or clicking with the cursor of an input keyboard meant.
- gesture control here is the automatic detection of
- gestures of the control and display device or from the above-defined "computing unit" in the control and display device are detected. Every posture and body movement can represent a gesture in principle. However, the greatest importance has the recognition of hand gestures.
- a variant of the gesture recognition is the recognition of so-called mouse gestures in the case of inputs with the cursor of an input keyboard or mouse.
- a control and display device with a touch display is used, for example a tablet or a smartphone.
- the gesture controls known from the field of tablets and mobile phones relate to the simple selection of a control panel by tapping, moving an object by touching with subsequent swipe, preferably with a finger, or zooming an object by touching with two (or more) fingers and then a corresponding divergence or Pulling movement of the fingers. Also in the present invention, the gestures in the control and display device are detected and control signals are generated which are used to control at least one of the adjustable and / or activatable
- Microscope components and to display the microscope image serve.
- Control device optionally be controlled via a single control and display device (tablet).
- the microscope system according to the invention allows a special
- control element can be enlarged, whereby possibly further control panels are displayed, or reduced in size by hiding a few important or all control panels.
- control element upon selection and displacement of the control element as a whole, this is shifted within the displayed microscope image and / or changed in its size and / or shape.
- this embodiment of the operating element it can be displayed at a position in the display area where it disturbs as little as possible in the displayed microscope image or covers as little image information as possible.
- a corresponding predefined gesture eg contraction of the fingers
- Size and shape of the control can thus be adapted to the ergonomic needs of a user, so that, for example, on a tablet computer with Overall, the way in which the display and the selection and gesture control options of the operating element and the control panels allow a user-friendly, safe and easier control of a microscope system or interaction with such a microscope system especially by remote users. In this context, it has proven to be particularly advantageous if, when selecting the operating element of this by moving in the form of a predefined gesture (eg contraction of the fingers) are reduced, which can be hidden in the mode unnecessary panels so that the image viewing is disturbed as little as possible, or it can for ease of selection another or changed image capture mode to full size by a corresponding other predefined gesture (eg, pulling the fingers) are increased.
- Size and shape of the control can thus be adapted to the ergonomic needs of a user, so that, for example, on a tablet computer with Overall, the way in which the display and the selection and gesture control options of the operating element and
- corresponding gesture within the display area is displaced and when moving in a predetermined edge region of the display area, the
- Control takes a changed size and / or shape by rearranging the panels. Otherwise, the control would be visible only partially when moving beyond the edge area, so that certain panels would not be displayed. This can be prevented by rearranging the panels that would otherwise "disappear" in a new size or shape.
- the control element in its modified form is adapted to the dimensions and the shape of the edge region.
- control and display device is, for example, a tablet computer with a touch screen
- an arcuate control element on an edge of the touch screen is particularly expedient, in particular if the selection or
- Selection of a control panel with the user's finger takes place as a Movement of the fingertip usually follows a curved path, so that in a simple manner a particular of several control panels, for example.
- the operating element is set up such that one or more further control panels are displayed when a control panel is selected.
- the selection of a control panel thus opens, for example, a (sub) menu with further associated control panels.
- the selection of a control panel for example, make a slider or slider visible as another associated control panel.
- a slider allows, for example, after selection or selection of a specific microscope illumination mode, an ergonomically favorable adjustment of the brightness, in particular via the adjustment of the illuminance of the relevant illumination device and / or the exposure time and / or signal amplification of the camera. It is ergonomically particularly advantageous if the slider or the other or control panels in shape and size are adapted to the (further displayed or previously displayed) control, so for example.
- the circular control element annular or ring segment surrounded or arcuately adjacent to the arcuate control , in a further advantageous embodiment, at least one of
- Control panels set up so that when dialing adjustable
- Microscope components are driven to produce a reflected light fluorescence image.
- the desired reflected light illumination source of the epi-fluorescence illumination device is switched on, the microscope camera in Operation and, if necessary, any further
- a slider as an additional control panel to control the illuminance of the LED and / or the exposure time / signal gain of the camera to user-friendly way to optimally adjust the resulting image brightness.
- Control panels set up so that when dialing adjustable
- Microscope components for generating a transmitted light brightfield image, in particular in phase contrast, are controlled.
- a corresponding control panel for example, the desired
- Illumination source of the transmitted light brightfield illumination device turned on and the microscope camera is put into operation. If necessary, any further microscope adjustments are made.
- Transmitted light source and the microscope camera are driven in this case, it is also useful again, a slider as additional
- Exposure time / signal amplification of the camera to control Exposure time / signal amplification of the camera to control.
- Control panels set up so that when you select the microscope camera to generate a live image or a still image is controlled.
- the corresponding control panel can be used to switch back and forth between the live image and the still image.
- Control panels set up so that when you select a displayed image is transmitted in digital form in a memory of the control and display device. In this way, examination results in the form of images can be easily documented.
- the at least one control panel is set up in such a way that, when it is selected, the display is switched between a full-screen mode and a menu-picture mode. In full-screen mode, for example, menu bars present on the screen edge are hidden, so that the display area for the microscope image becomes larger.
- Control panels set up so that when you select the recording and storage of multiple sequential images is triggered. By evaluating such sequential images, the evolution of confluence can be quantitatively evaluated.
- Control panels are set up such that when they are selected, the intensity of the Microscope illumination, so the illuminance of the illumination device, and / or the exposure time or signal amplification of the microscope camera can be controlled and changed. Reference is made to the above.
- Control panels are set up such that when they are selected means for changing the position of the microscope stage and / or the position of the microscope objective are controlled.
- This embodiment requires that the adjustable microscope components include means for changing the position of the microscope stage and / or the microscope objective.
- the microscope stage can be adjustable in X-Y and optionally also in the Z-direction, that microscope objective
- the invention further relates to a method for controlling a
- Microscope system with a microscope with several over one
- Control device of the microscope electrically adjustable and / or activatable microscope components and with a control and display device, the
- the method comprises the following steps:
- control signals by means of the control and display device, wherein the control signals at least one of the adjustable and / or activatable
- Microscope objective a microscope illumination device and a microscope
- Microscope camera as in particular electrically adjustable and / or activatable microscope components of the microscope, Displaying at least a portion of the generated digital microscope image on a display area of the control and display device, wherein the digital microscope image is superimposed on a virtual graphical control element having a plurality of selectable panels, wherein
- one or more of the adjustable and / or activatable microscope components and / or means for changing settings in the control and display device are controlled by the control and display device (or a processor therein) and wherein upon selection of the control element as Whole this is changed by means of gesture control within the display area in its position and / or in its size and / or shape.
- Display area is moved and that the operating element takes on a changed shape when moving to a border area of the display area, wherein the arrangement of the control panels is changed.
- arcuate or strip-shaped operating element is formed.
- arcuate or strip-shaped operating element is formed.
- a further advantageous embodiment is characterized in that when selecting at least one of the panels at least one further panel is additionally displayed in the display area.
- Microscope component and / or means for changing settings in the control and display device are described.
- a further advantageous refinement is characterized in that, when at least one of the control panels is selected, adjustable and / or activatable microscope components are actuated to produce a reflected-light fluorescence image.
- a further advantageous embodiment is characterized in that an LED incident light illumination source and the microscope camera are controlled as adjustable and / or activatable microscope components.
- a further advantageous embodiment is characterized in that upon selection of at least one of the control panels adjustable and / or activatable microscope components for generating a transmitted light brightfield image
- a further advantageous embodiment is characterized in that an LED transmitted light illumination source and the microscope camera are controlled as adjustable and / or activatable microscope components.
- a further advantageous embodiment is characterized in that when selecting at least one of the control panels, the microscope camera is driven to produce a live image or a still image.
- a further advantageous embodiment is characterized in that when selecting at least one of the panels a displayed image is transmitted in digital form in a memory of the control and display device.
- a further advantageous embodiment is characterized in that when selecting at least one of the panels of the display area and / or the display of the microscope image are changed.
- a further advantageous embodiment is characterized in that when selecting the at least one control panel, the display between a
- a further advantageous embodiment is characterized in that the selection and storage of a plurality of sequential microscope images is triggered when selecting at least one of the panels.
- a further advantageous embodiment is characterized in that upon selection of at least one of the control panels, the illuminance of the at least one microscope illumination device and / or the exposure time of the microscope camera are controlled.
- a further advantageous embodiment using a microscope with an adjustable in its position microscope stage and / or in its position adjustable microscope objective is characterized in that upon selection of at least one of the control panels means for changing the position of the microscope stage and / or the position of the microscope objective are controlled.
- the invention further relates to a computer program for implementing a method according to the invention for controlling a microscope system according to the invention, when the computer program is stored on a computer,
- the invention finally relates to a computer program product on which a computer program according to the invention is stored, such as
- USB stick for example, a USB stick, a floppy disk, a CD-ROM or other suitable computer program memory.
- Show it 1 shows an embodiment of a microscope system according to the invention in a schematic representation
- FIG. 2 shows a schematic representation of a display region of the control and display device from FIG. 1 with an exemplary operating element
- FIG. 3 shows the illustration according to FIG. 2, with a specific control panel being selected
- FIG. 4 shows a display area with an arcuate control element in FIG.
- Figure 5 shows a display area with arcuate control in the left
- Figure 6 shows a display area with arcuate control in the bottom
- the microscope system 1 shown schematically in FIG. 1 comprises a microscope 10 and a control and display device 20.
- the microscope 10 has adjustable microscope components which can be controlled via a control device 18 of the microscope 10.
- Figure 1 shows, for example, a digital
- Wide-field microscope 10 in which optionally can be switched between incident fluorescence illumination and transmitted light brightfield illumination, with two (or more) fluorescence illumination types for
- the epi-illumination device is denoted by 11 and comprises, as elements substantially illustrated here, two different epiluminescent illumination sources 111 and 112, whose
- Illumination beam paths optionally via unspecified beam splitters or deflecting mirrors can be coupled into the reflected light illumination axis.
- the microscope objective is denoted by 13.
- the transmitted light illumination device is denoted by 12, wherein again only the essential elements are shown, in particular an LED transmitted light illumination source 121 whose
- Illumination beam path can be directed to the object plane via a deflection mirror and a lens not specified.
- the microscope stage of the microscope 10 is denoted by 17. He owns for the purpose of
- Transmitted light illuminates a recess over which the object 161 to be examined is placed. In the case of examination of cell cultures, these are usually located in a Petri dish as a slide 16.
- the microscope stage can be displaceable in the horizontal direction, in the XY direction. A vertical displacement in the Z direction can also be provided.
- the microscope objective 13 can be displaceable in the Z direction.
- the corresponding actuators for the displacement of the microscope stage 17 or lens 13 are known per se and not shown separately in FIG. The same applies to the actuators for switching on and off and for adjusting the illuminance of the LED illumination sources 111, 112 and 121.
- the corresponding actuators are via control lines 181, 182, 184, 185 and 186 with the controller 18 of the microscope 10th
- the microscope 10 further has a tube lens 14 and a microscope camera 15.
- the microscope camera 15 is connected via the control line 183 with the
- Control device 18 connected.
- the illustrated microscope system 1 further comprises the control and
- Display device 20 which has a computing unit not shown here, that is, a processor, via which the device 20 is in communication communication with the control device 18 of the microscope 10.
- the control and display device 20 has a display area 22 for displaying at least a portion of the generated Microscope image and display a superimposed on the displayed microscope image control element 21. Other features of this
- Control element 21 will be explained in more detail with reference to the following figures.
- Transmitted light brightfield image a user selects the corresponding control panel on the control element 21 of its control and display device 20.
- this device 20 is a pad or tablet computer.
- the arithmetic unit or the processor of the device 20 which is usually present is in WLAN communication with the control device 18 of the microscope 10, so that the corresponding control command can be converted by the control device 18 of the microscope 10 and the corresponding microscope components can be controlled.
- about the control line 181 is the
- Transmitted light LED 121 is turned on.
- the illumination beam path hits via the deflection mirror and the lens of the
- the camera takes a transmitted-light bright field image in phase contrast and the controller 18 transmits the generated
- Embodiment two options Depending on the color, the sample can be excited with blue light, so that a substantially green emission image is formed, or be excited with green light, so that a red emission image is formed.
- the microscope camera 15 usually generates a black and white image, which is then displayed as a green or red false-color image.
- the user can select the control panels 21 which are respectively colored green or red for easier selection.
- the arithmetic unit (processor) in the display and control unit 20 in turn communicates with the control device 18 of the
- Microscope the latter depending on the selection via the control lines 184 or 185 one of the reflected light LEDs 112 and 111 drives.
- deflecting mirror or beam splitter of reflected-fluorescence illumination device 11 passes the illumination beam path of the corresponding illumination source 111 or 112 via the beam splitter 19 and a further deflection mirror in the lens 13, from which it is focused on the sample 161.
- the resulting observation beam path passes in reverse order to the beam splitter 19 and from there via the tube lens 14 to the microscope camera 15, which generates a corresponding incident light fluorescence image in red or green representation.
- the generated microscope image is transmitted via the control device 18 of the microscope 10 to the display device 20 and displayed there in the display area 22.
- the microscope stage 17 can also be adjusted manually in its position for convenient operation.
- the corresponding actuator or the corresponding actuators for an adjustment of the microscope stage 17 may also be connected via a control line 182 to the controller 18 of the microscope 10, so that a corresponding change in the position of the microscope stage 17 by a user on the display and Control unit 20 can be made.
- Microscope objective 13 in the Z direction also automated by the corresponding actuator via the control line 186 is connected to the control unit 18 of the microscope 10. In this way, in turn, a user on the display and control unit 20 to make the focus or a
- Trigger autofocusing In the following, the possible control functions with the corresponding control panels of a control element 21 will be explained in greater detail.
- FIG. 2 shows as a user interface a display region 22 with schematically represented biological cells 30 within the displayed microscope image, which is displayed on the entire display region 22.
- This microscope image the control element 21 is superimposed, wherein the control element 21 in this embodiment, various control panels 23 to 29 has.
- the control panel 23 the generation of a green incident light fluorescence image can be triggered in the manner described above with reference to FIG.
- the operating element 23 is colored green, at least in the circular inner region, with advantage.
- control panel 25 For example, generates a red incident light fluorescence image in the manner described above.
- the control panel 25 is colored red at least in the inner circular area.
- a phase contrast transmitted light bright field image is generated in the above-described manner.
- the control panel 24 is colored white, for example, in the inner circular area.
- Another control panel 29 has two subfields 29a and 29b. When you select it, you can switch between the creation of a life picture or a still picture. Thus, when the control panel 29a is selected, a live image is displayed while a still image is displayed when the operation panel 29b is selected.
- the life picture allows the observation of the processes of the cells, like theirs
- the still image captures the last recorded camera image, and the illumination source can be turned off to save the sample.
- the control panel 28 is selected, the displayed image or still image is transmitted in digital form to a memory of the control and display device 20.
- the arithmetic unit of the display device 20 transmits the corresponding image data to the memory of the display device 20.
- Another control panel 27 changes when dialing, for example, the
- Menu image mode contains further menu items for controlling or evaluating recorded microscope images. By hiding the
- Another control panel 26 triggers when recording the recording and storage of several temporally successive microscope images. When this control panel 26 is selected, another submenu in the form of further control panels is superimposed to control the image acquisition.
- the sequentially recorded microscope images can, for example, in terms of confluence or
- control panel may be present, upon selection of which a red and a green reflected-light fluorescence image are displayed superimposed. These two images are then taken in temporal succession and separated from each other and superimposed. Basically, it is also possible to create these images at the same time. In this case, any differences in the brightness of the two fluorescence images must be compensated.
- a microscope system 1 shown in FIG. 1 with a microscope stage 17 which can be adjusted in its position and controlled by the control device 18 and / or a microscope objective 13 which is adjustable in its position and which can likewise be activated via the control device 18, it makes sense to provide further control panels (here not shown) to the position of
- Microscope and / or microscope objective to change For example, a control panel for the change in position of the microscope objective 13 is present, when selected as another control panel, a slider or
- Corresponding control signals are transmitted from the arithmetic unit of the control and display device 20 to the control device 18 of the microscope 10, said control device 18 via the control line 186 controls the corresponding actuator for Z-displacement of the lens 13.
- a further control panel (not shown here) may be present, in the selection of which one or more further control panels, in particular in the form of sliders or sliders, are superimposed, by the actuation of which the microscope stage 17 can be moved in one or more directions in X-direction. and / or Y and / or Z direction can be shifted.
- the corresponding actuators of the microscope stage 17 are connected via the control line 182 to the control device 18 of the microscope 10.
- FIG. 3 shows the display area 22 of the control and display unit 20 after activating epi-fluorescence illumination to generate a red reflected-fluorescence image by selecting the control panel 25.
- the selection is made in a user-friendly manner by tapping the control panel 25 on a touchscreen.
- the corresponding incident illumination LED 111, 112 is activated, so turned on and set a preset level of illumination, and at the same time the microscope camera 15 is turned on and any predefined Camera settings made.
- the generated microscope image is in
- Display area 22 is displayed. Clearly visible are the (red) colored fluorescent cells 31 and the non-fluorescent cells 32. Simultaneously with selection of the control panel 25, a slider or slider 251 is displayed as another control panel.
- the shape of the slider 251 is adapted to the shape of the control element 21 and allows an ergonomically favorable adjustment of the image brightness, in particular by shifting the schematically indicated button along the path of the slider 251 with the finger of a user. Such an adjustment preferably alters the illuminance of the corresponding incident illumination LED 111 or 112 and controls parameters of the camera 15, such as the exposure time and the sensor sensitivity, in order to optimally adjust the dynamics of the camera.
- FIGS. 4 to 6 again show the display area 22 of the control and display unit 20, in a manner similar to FIG. 2.
- Control element 21 itself by tapping and holding as gesture control, a user can move, for example on a touch screen shown in Figure 2 or 3 control panel 21 by subsequent displacement to an arbitrary position in an inner region 41 of the display area 22.
- Border area 40 is moved, so it assumes there the arcuate shape shown, it is moved to the left part of the edge portion 40, it takes the arcuate shape shown in Figure 5, and it is moved to the lower part of the edge portion 40, so takes it indicates the arcuate shape shown in FIG.
- the operating element 21 When the operating element 21 is moved to the upper edge of the display area, it may also undergo a change in shape. But it can also remain unchanged, because an adaptation of the form is not essential, because typically a touch display, for example on a Tablet computer or a mobile phone, not touched on the top edge, because this is not ergonomic.
- the arcuate operating elements 21 shown in FIGS. 4 to 6 have the following advantages: On the one hand, as little as possible of the displayed one
- the arcuate control element 21 allows an ergonomically very advantageous selection of the individual control panels 23 to 29 and the slider 251 via a
- Finger movement for example, of the thumb or forefinger, in
- the arcuate control element 21 typically held on the right or left edge of the picture, so that the fingers or the thumb can ergonomically make a touch of the individual panels 23 to 29 and the slider 251 of the arcuate control element 21.
- the position of the arcuate control element 21 at the bottom of the screen proves to be particularly advantageous if the tablet computer is held in a stand in landscape format, which is for example placed on a table. Then a user can ergonomically place his hand palm down on the table and outstretched
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Analytical Chemistry (AREA)
- Chemical & Material Sciences (AREA)
- Optics & Photonics (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Signal Processing (AREA)
- Microscoopes, Condenser (AREA)
- Closed-Circuit Television Systems (AREA)
- Studio Devices (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102018107033.0A DE102018107033A1 (de) | 2018-03-23 | 2018-03-23 | Mikroskopsystem und Verfahren zur Steuerung eines solchen Mikroskopsystems |
PCT/EP2019/056245 WO2019179845A1 (de) | 2018-03-23 | 2019-03-13 | Mikroskopsystem und verfahren zur steuerung eines solchen mikroskopsystems |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3769138A1 true EP3769138A1 (de) | 2021-01-27 |
Family
ID=65802079
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP19711312.9A Pending EP3769138A1 (de) | 2018-03-23 | 2019-03-13 | Mikroskopsystem und verfahren zur steuerung eines solchen mikroskopsystems |
Country Status (5)
Country | Link |
---|---|
US (1) | US20210018741A1 (de) |
EP (1) | EP3769138A1 (de) |
JP (1) | JP7247210B2 (de) |
DE (1) | DE102018107033A1 (de) |
WO (1) | WO2019179845A1 (de) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2022194965A1 (en) * | 2021-03-18 | 2022-09-22 | Leica Instruments (Singapore) Pte. Ltd. | Microscope system and corresponding system, method and computer program |
CN113920224A (zh) * | 2021-09-29 | 2022-01-11 | 北京达佳互联信息技术有限公司 | 素材展示方法、装置、电子设备及存储介质 |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB0206765D0 (en) | 2002-03-22 | 2002-05-01 | Lonza Biologics Plc | Method of single cell cloning in eukaryotic cell culture |
DE10305117A1 (de) * | 2003-02-07 | 2004-08-19 | Leica Microsystems Wetzlar Gmbh | Einrichtung und Software zum Steuern von Funktionen eines Mikroskopsystems |
US8276095B2 (en) * | 2004-02-20 | 2012-09-25 | Advanced Intellectual Property Group, Llc | System for and method of generating and navigating within a workspace of a computer application |
JP2006092269A (ja) * | 2004-09-24 | 2006-04-06 | Hitachi Software Eng Co Ltd | 電子ボードシステム |
JP2007316452A (ja) | 2006-05-26 | 2007-12-06 | Omron Corp | 観察装置および観察装置の画面表示方法 |
JP5307539B2 (ja) | 2006-05-31 | 2013-10-02 | オリンパス株式会社 | 生体試料撮像方法および生体試料撮像装置 |
JP5034328B2 (ja) | 2006-06-08 | 2012-09-26 | 株式会社ニコン | 観察装置、および観察プログラム |
US8694919B2 (en) * | 2008-12-24 | 2014-04-08 | Panasonic Corporation | Menu display device, method for displaying menu, and imaging apparatus |
JP5608360B2 (ja) * | 2009-12-04 | 2014-10-15 | オリンパス株式会社 | 顕微鏡コントローラ及び顕微鏡コントローラを備える顕微鏡システム |
JP5468892B2 (ja) * | 2009-12-22 | 2014-04-09 | オリンパス株式会社 | 顕微鏡コントローラ及び顕微鏡コントローラを備える顕微鏡システム |
JP5479950B2 (ja) | 2010-03-03 | 2014-04-23 | オリンパス株式会社 | 顕微鏡装置及び観察位置再現方法 |
EP2557446B1 (de) * | 2010-04-05 | 2019-09-04 | Olympus Corporation | Mikroskopsteuerung und mikroskopsystem mit der mikroskopsteuerung |
US8922639B2 (en) * | 2011-09-27 | 2014-12-30 | Olympus Corporation | Microscope system |
JP5875813B2 (ja) * | 2011-09-27 | 2016-03-02 | オリンパス株式会社 | 顕微鏡システム |
DE202012100134U1 (de) * | 2012-01-13 | 2012-02-27 | Leica Microsystems (Schweiz) Ag | Medizinische Abbildungseinrichtung |
US20170030821A1 (en) * | 2014-04-25 | 2017-02-02 | Siemens Healthcare Diagnostics Inc. | Urine sediment analysis workstation |
US11636627B2 (en) * | 2016-08-28 | 2023-04-25 | Augmentiqs Medical Ltd. | System for histological examination of tissue specimens |
JP6887875B2 (ja) | 2017-05-22 | 2021-06-16 | オリンパス株式会社 | 顕微鏡システム、制御方法、及び、プログラム |
-
2018
- 2018-03-23 DE DE102018107033.0A patent/DE102018107033A1/de active Pending
-
2019
- 2019-03-13 US US17/040,020 patent/US20210018741A1/en not_active Abandoned
- 2019-03-13 JP JP2020550630A patent/JP7247210B2/ja active Active
- 2019-03-13 EP EP19711312.9A patent/EP3769138A1/de active Pending
- 2019-03-13 WO PCT/EP2019/056245 patent/WO2019179845A1/de active Application Filing
Also Published As
Publication number | Publication date |
---|---|
US20210018741A1 (en) | 2021-01-21 |
DE102018107033A1 (de) | 2019-09-26 |
JP2021518580A (ja) | 2021-08-02 |
JP7247210B2 (ja) | 2023-03-28 |
WO2019179845A1 (de) | 2019-09-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DE102010063392B4 (de) | Mikroskop mit Sensorbildschirm, zugehörige Steuereinrichtung und Betriebsverfahren | |
AU2013302966B2 (en) | Systems and methods for imaging tissue | |
DE202011110651U1 (de) | Digitalmikroskop | |
DE10152404C5 (de) | Laser-Mikrodissektionssystem | |
EP3472656A2 (de) | Verfahren zum digitalen aufnehmen einer probe durch ein mikroskop | |
DE102010035917A1 (de) | Strahlenschutzwand für Mammographiesysteme mit integrierter Benutzeroberfläche | |
DE102007033793A1 (de) | Verfahren und Vorrichtung zum mikroskopischen Untersuchen einer Probe, Computerprogramm und Computerprogrammprodukt | |
DE10015157A1 (de) | Verfahren zur Bearbeitung einer biologischen Masse und Steuersystem für eine Vorrichtung zur Bearbeitung einer biologischen Masse | |
EP3769138A1 (de) | Mikroskopsystem und verfahren zur steuerung eines solchen mikroskopsystems | |
DE102010043919A1 (de) | Tragbares Mikroskop | |
DE10332468B4 (de) | Mikroskop und Verfahren zur Bedienung eines Mikroskops | |
EP1565885B1 (de) | Verfahren zum erfassen einer eigenschaft mindestens eines gegenstands | |
EP1729162A1 (de) | Mikroskopsystem und Bildgebungsverfahren | |
DE112015006271T5 (de) | Mikroskopiesystem, Mikroskopieverfahren und Mikroskopieprogramm | |
DE102012220195A1 (de) | Mikroskop | |
EP2793068A1 (de) | Steuergerät und Verfahren zur Steuerung eines motorisierten Digitalmikroskops | |
DE10051299A1 (de) | Mikroskop mit multifunktionalen Bedienelementen | |
EP2263070B1 (de) | Synchronisierte bildgebung mittels optischer verfahren und rasterkraftmikroskopie | |
DE102013219194B4 (de) | Medizinsystem | |
EP1533643A1 (de) | Beobachtungsgerät mit separater Bedienungseinheit | |
DE19812599C2 (de) | Verfahren zur Video-Mikroskopie | |
EP3894929A1 (de) | Mikroskopsystem mit eingabeeinheit zum gleichzeitigen einstellen von wenigstens drei einstellparametern mittels eines in einer eingabefläche positionierbaren eingabezeigers | |
WO2013190058A1 (de) | Mikroskop | |
DE102018127076A1 (de) | Mikroskopsystem zur Abbildung eines Probenbereichs und entsprechendes Verfahren | |
DE102019108814A1 (de) | Verfahren zum Betreiben eines konfokalen Laser-Scanning-Mikroskops |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20201022 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20220825 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230414 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20240508 |