WO2023127001A1 - Système de microscope, unité de projection et procédé d'aide à la sélection - Google Patents

Système de microscope, unité de projection et procédé d'aide à la sélection Download PDF

Info

Publication number
WO2023127001A1
WO2023127001A1 PCT/JP2021/048510 JP2021048510W WO2023127001A1 WO 2023127001 A1 WO2023127001 A1 WO 2023127001A1 JP 2021048510 W JP2021048510 W JP 2021048510W WO 2023127001 A1 WO2023127001 A1 WO 2023127001A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
sperm
target
microscope system
microscope
Prior art date
Application number
PCT/JP2021/048510
Other languages
English (en)
Japanese (ja)
Inventor
拓人 山根
敏征 服部
勇大 尾原
琢磨 佐藤
沙織 村形
Original Assignee
株式会社エビデント
学校法人慈恵大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社エビデント, 学校法人慈恵大学 filed Critical 株式会社エビデント
Priority to PCT/JP2021/048510 priority Critical patent/WO2023127001A1/fr
Priority to JP2023570498A priority patent/JPWO2023127001A1/ja
Publication of WO2023127001A1 publication Critical patent/WO2023127001A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
    • G01N33/48—Biological material, e.g. blood, urine; Haemocytometers
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
    • G01N33/48—Biological material, e.g. blood, urine; Haemocytometers
    • G01N33/483—Physical analysis of biological material
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
    • G01N33/48—Biological material, e.g. blood, urine; Haemocytometers
    • G01N33/50—Chemical analysis of biological material, e.g. blood, urine; Testing involving biospecific ligand binding methods; Immunological testing

Definitions

  • the disclosure of this specification relates to a microscope system, a projection unit, and a selection support method.
  • ART is a general term for technologies such as in vitro fertilization (IVF) and microinsemination, in which eggs and sperm removed from humans are fertilized outside the body, and the collected sperm is injected into the uterus and fertilized with the egg inside the body. artificial insemination.
  • IVF in vitro fertilization
  • microinsemination in which eggs and sperm removed from humans are fertilized outside the body, and the collected sperm is injected into the uterus and fertilized with the egg inside the body. artificial insemination.
  • Patent Document 1 describes a microscope suitable for intracytoplasmic sperm injection (ICSI) used in microinsemination, which is a type of ART.
  • ICSI is a method of directly injecting sperm into an egg by piercing an injection pipette containing sperm into the egg fixed with a holding pipette.
  • the above problems can occur not only in the sperm sorting work but also in any target sorting work.
  • an object of one aspect of the present invention is to provide a technology that supports the selection of objects in a sample.
  • a microscope system includes a microscope that forms an optical image of a sperm sample containing a sorting target, an imaging device that acquires a digital image of the sperm sample, and sperm detection and sperm morphology in the digital image.
  • a projection unit is a projection unit attached to a microscope, and includes an imaging unit that acquires a digital image of a sperm sample, and sperm detection based on the digital image and evaluation of the sperm morphology. a processing unit that generates a target image that is an image of a sorting target contained in a sample; a projection unit for displaying in a larger size.
  • a selection support method forms an optical image of a sperm sample containing a selection target, acquires a digital image of the sperm sample, and performs sperm detection and sperm morphology evaluation on the digital image.
  • a target image that is an image to be sorted is generated, and the target image is displayed on an image plane on which the optical image is formed in a size larger than that of the sorting target in the optical image.
  • FIG. 1 is a diagram illustrating the configuration of a microscope system 1;
  • FIG. 1 is a diagram illustrating the configuration of a microscope 100;
  • FIG. 4 is a diagram illustrating the configuration of an operation unit of the input device 50;
  • FIG. 2 is a diagram illustrating a hardware configuration of a processing device 200;
  • FIG. It is a flowchart which shows an example of the procedure of ICSI by an embryologist.
  • 3 is a diagram illustrating the configuration of a drop formed as a sample 300 in a petri dish 310;
  • FIG. It is a flowchart which shows an example of the sperm selection procedure by an embryonic culture person.
  • FIG. 9 is a flowchart showing an example of sorting support processing; 6 is a flowchart showing an example of target image generation processing; 4 is a flowchart showing an example of image display processing; 4 is a diagram showing an example of an optical image generated by the microscope 100;
  • FIG. FIG. 2 is a diagram showing an example of a digital image acquired by an imaging device 143;
  • FIG. 10 is a diagram showing an example of object detection results for a digital image;
  • FIG. 4 is a diagram for explaining an example of a method of generating a target image; 4 is a diagram showing an example of an image seen through an eyepiece lens 101.
  • FIG. FIG. 10 is a diagram for explaining another example of a method of generating a target image;
  • FIG. 10 is a diagram showing another example of an image seen through the eyepiece 101; 9 is a flowchart showing another example of sorting support processing; 9 is a flowchart showing another example of image display processing; FIG. 4 is a diagram for explaining an example of a method of generating an auxiliary image; FIG. FIG. 10 is a diagram showing still another example of an image seen through the eyepiece 101; 2 is a diagram illustrating the configuration of a microscope system 2; FIG.
  • FIG. 1 is a diagram illustrating the configuration of a microscope system 1.
  • FIG. 2 is a diagram illustrating the configuration of the microscope 100.
  • FIG. 3 is a diagram illustrating the configuration of the operation unit of the input device 50.
  • FIG. 4 is a diagram illustrating the configuration of the processing device 200. As shown in FIG.
  • the microscope system 1 is a system for observing a sample by looking through an eyepiece 101.
  • the microscope system 1 is an inverted microscope system equipped with a transmitted illumination system 120 used for microscopic insemination, particularly sperm sorting.
  • the microscope system 1 is used, for example, by an embryologist.
  • a sample to be observed is a sperm suspension containing sperm contained in a petri dish or the like in the case of sperm sorting.
  • the microscope system 1 includes at least a microscope 100, an imaging device 143, a projection device 153, and a processing device 200.
  • Microscope 100 forms an optical image of a sample containing sperm to be sorted (that is, a sperm sample).
  • Imaging device 143 acquires a digital image of the specimen.
  • the processing device 200 generates an image to be sorted (hereinafter referred to as a target image) based on object detection on the digital image.
  • the selection target is a target whose quality is judged by the user, and means a target whose selection or non-selection is determined as a result of the quality judgment.
  • the projection device 153 is an example of an optical device that displays a target image in a size larger than the selection target in the optical image on the image plane where the optical image is formed.
  • "displaying an image (image)” refers to forming an image (image) in a visible manner. position).
  • the microscope system 1 uses the projection device 153 to display the target image in a size larger than the selection target in the optical image on the image plane where the optical image of the sample is formed by the microscope 100 .
  • the sorting target (sperm) in the optical image is displayed within, for example, a 1 mm ⁇ 1 mm area on the image plane
  • the target image is displayed on the image plane in a size larger than 1 mm ⁇ 1 mm.
  • the user who is looking through the eyepiece 101 and observing the sample can observe the sperm to be sorted included in the optical image in detail with a larger size target image without taking his eyes off the eyepiece 101. can do. Therefore, it is possible to accurately specify and collect good sperm in a short period of time. Therefore, according to the microscope system 1, it is possible to support the sperm sorting work of users such as embryologists.
  • the microscope system 1 includes a microscope controller 10, a display device 30, and a plurality of input devices in addition to the microscope 100, the imaging device 143, the projection device 153, and the processing device 200 described above. (input device 40 , input device 50 , input device 60 , input device 70 ) and identification device 80 .
  • the microscope system 1 is also connected to a database server 20 storing various data.
  • the imaging device 143 and the projection device 153 are arranged inside the microscope body 110 of the microscope 100 .
  • the microscope 100 is an inverted microscope equipped with an eyepiece 101.
  • the microscope 100 includes a microscope main body 110, a plurality of objective lenses 102 attached to the microscope main body 110, a stage 111, a transmitted illumination system 120, and an eyepiece tube 170, as shown in FIG. Further, the microscope 100 includes modulation elements for visualizing unstained samples such as sperm and ovum in each of the illumination optical path and the observation optical path, as will be described later.
  • a user such as an embryologist, can use the microscope 100 to examine a sample using four microscopy techniques: bright field (BF) observation, polarized light (PO) observation, differential interference contrast (DIC) observation, and modulation contrast (MC) observation. can be observed. Modulation contrast observation is also called relief contrast (RC) observation.
  • BF bright field
  • PO polarized light
  • DIC differential interference contrast
  • MC modulation contrast
  • Modulation contrast observation is also called relief contrast (RC) observation.
  • a plurality of objective lenses 102 are attached to a revolver 112 .
  • the multiple objective lenses 102 include an objective lens 102a for BF observation, an objective lens 102b for PO observation and DIC observation, and an objective lens 102c for MC observation.
  • the modulator 104 is included in the objective lens 102c.
  • the modulator 104 includes three regions with different transmittances (for example, a region with a transmittance of about 100%, a region with a transmittance of about 5%, and a region with a transmittance of about 0%).
  • FIG. 2 illustrates three objective lenses according to the microscopy method
  • the plurality of objective lenses 102 may include objective lenses with different magnifications for each microscopy method.
  • 4x objective lens for BF observation 10x, 20x, and 40x objective lenses for MC observation, 20x objective lens for PO observation, and 60x objective lens for DIC observation are included. will be described as an example.
  • the revolver 112 is a switching device that switches objective lenses arranged on the optical path among the plurality of objective lenses 102 .
  • the revolver 112 switches the objective lens arranged on the optical path according to the microscope method and observation magnification.
  • the objective lens arranged on the optical path by the revolver 112 guides the transmitted light that has passed through the sample to the eyepiece lens 101 .
  • a sample placed in a container is placed on the stage 111 .
  • the container is, for example, a petri dish, and the sample contains reproductive cells such as sperm and ovum.
  • the stage 111 moves in the optical axis direction of the objective lens 102 arranged on the optical path and in the direction orthogonal to the optical axis of the objective lens 102 .
  • the stage 111 may be a manual stage or an electric stage.
  • the transmitted illumination system 120 illuminates the sample placed on the stage 111 from above the stage 111 .
  • Transillumination system 120 includes a light source 121 and a universal condenser 122, as shown in FIGS.
  • the light source 121 may be, for example, an LED (Light Emitting Diode) light source or a lamp light source such as a halogen lamp light source.
  • the universal condenser 122 includes a polarizer 123 (first polarizing plate), a plurality of optical elements housed in a turret 124, and a condenser lens 128, as shown in FIG.
  • the polarizer 123 is used for MC observation, PO observation and DIC observation.
  • the turret 124 accommodates a plurality of optical elements that are switched for use according to the microscope method.
  • a DIC prism 125 is used for DIC observation.
  • Aperture plate 126 is used for BF observation and PO observation.
  • the optical element 127 is a combination of a slit plate 127a, which is a light shielding plate in which a slit is formed, and a polarizing plate 127b (second polarizing plate) arranged so as to partially cover the slit. used.
  • the eyepiece tube 170 includes the eyepiece lens 101 .
  • the imaging lens 103 is arranged between the eyepiece lens 101 and the objective lens 102 .
  • the imaging lens 103 forms an optical image of the sample on an image plane IP between the eyepiece lens 101 and the imaging lens 103 based on the transmitted light.
  • a target image which will be described later, is also formed on the image plane IP based on the light from the projection device 153 .
  • the optical image and the target image are displayed on the image plane IP.
  • a user of the microscope system 1 uses the eyepiece 101 to observe the optical image formed on the image plane IP and the virtual image of the target image.
  • the microscope body 110 includes a laser assisted hatching unit 130, an imaging unit 140, and a projection unit 150, as shown in FIGS.
  • the microscope body 110 also includes an intermediate magnification unit 160, as shown in FIG.
  • the microscope main body 110 includes a DIC prism 105 and an analyzer 106 that can be inserted into and removed from the optical path.
  • the laser assisted hatching unit 130 is a laser unit arranged between the objective lens 102 and the imaging lens 103, as shown in FIG.
  • the laser assisted hatching unit 130 irradiates the sample with laser light by introducing the laser light from between the objective lens 102 and the imaging lens 103 . More specifically, the laser-assisted hatching unit 130 irradiates, for example, a laser beam onto the zona pellucida surrounding an embryo grown from a fertilized egg.
  • Laser assisted hatching unit 130 includes splitter 131 , scanner 133 , lens 134 and laser 135 .
  • Splitter 131 is, for example, a dichroic mirror.
  • the scanner 133 is, for example, a galvanometer scanner, and adjusts the irradiation position of the laser light in a direction perpendicular to the optical axis of the objective lens 102 .
  • a lens 134 converts the laser beam into a parallel beam. Thereby, the laser light is focused on the sample by the objective lens 102 .
  • the imaging unit 140 includes a splitter 141 and an imaging device 143 that acquires a digital image of the sample based on transmitted light.
  • the imaging unit 140 is arranged between the imaging lens 103 and the eyepiece 101 .
  • Splitter 141 is, for example, a half mirror.
  • the imaging lens 103 forms an optical image of the sample on the light receiving surface of the imaging device included in the imaging device 143 .
  • the imaging device 143 is, for example, a digital camera that acquires a digital image, and the imaging device included in the imaging device 143 is, for example, a CCD (Charge Coupled Device) image sensor, a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor, or the like. is.
  • the imaging device detects light from a sample and converts the detected light into an electrical signal by photoelectric conversion.
  • the imaging unit 140 outputs digital images acquired by the imaging device 143 to the processing device 200 .
  • the projection unit 150 is arranged between the imaging lens 103 and the eyepiece lens 101 .
  • the projection unit 150 includes a splitter 151, a lens 152, and a projection device 153, as shown in FIG.
  • Splitter 151 is, for example, a half mirror.
  • the projection device 153 projects the target image generated by the processing device 200 . More specifically, the lens 152 converges the light from the projection device 153 onto the image plane IP of the imaging lens 103, that is, the image plane IP where an optical image is formed, so that the projection device 153 is projected onto the image plane IP. Project the target image.
  • the intermediate variable power unit 160 is arranged between the objective lens 102 and the imaging lens 103 .
  • the intermediate magnification unit 160 includes a plurality of lenses (lens 161, lens 162, and lens 163), and by switching the lenses arranged on the optical path among these, an image is formed on the image plane. Change the magnification of the optical image displayed. By using the intermediate magnification unit 160, the magnification of the optical image can be changed without switching the objective lens 102 located near the sample.
  • the DIC prism 105 and the analyzer 106 are arranged between the objective lens 102 and the imaging lens 103.
  • a DIC prism 105 is used for DIC observation.
  • Analyzer 106 is used for PO viewing and DIC viewing.
  • a polarizer 123 and an optical element 127 are arranged on the illumination light path as modulation elements (hereinafter referred to as first modulation elements) for modulating the illumination light irradiated to the sample.
  • a modulator 104 is arranged on the observation optical path as a modulating element (hereinafter referred to as a second modulating element) that modulates the transmitted light.
  • the polarizer 123 is arranged on the illumination optical path as a first modulation element
  • the analyzer 106 is arranged on the observation optical path as a second modulation element.
  • the polarizer 123 and the DIC prism 125 are arranged on the illumination optical path as the first modulation elements, and the analyzer 106 and the DIC prism 105 are arranged on the observation optical path as the second modulation elements. . Thereby, it is possible to visualize an unstained sample and, for example, to sort sperm.
  • the microscope controller 10 is a device that controls the microscope 100.
  • the microscope controller 10 is connected to the processing device 200 , the input device 50 and the microscope 100 and controls the microscope 100 according to commands from the processing device 200 or the input device 50 .
  • the display device 30 is, for example, a liquid crystal display, a plasma display, an organic EL display, a CRT display, an LED matrix panel, or the like.
  • the input device 40 includes a handle 41 and a handle 42. By operating the handle 41 and the handle 42, the operation of a micromanipulator (not shown) that moves the pipettes 43 and 44 is controlled. Pipettes 43 and 44 are used to manipulate samples in microinsemination procedures, including sperm sorting. Pipette 43 is, for example, a holding pipette, and pipette 44 is, for example, an injection pipette.
  • the input device 50 is a hand switch device for changing settings related to the microscopy method and observation magnification of the microscope 100 . As shown in FIG. 3, the input device 50 has, for example, six buttons (buttons 51 to 56), and the user can quickly switch the settings of the microscope 100 simply by pressing these buttons. can be done.
  • the setting of the microscope 100 is switched to BF observation with an observation magnification of 4x (hereinafter referred to as BF4x observation).
  • the setting of the microscope 100 is switched to the setting of MC observation with an observation magnification of 10 times (hereinafter referred to as MC10x observation).
  • the setting of the microscope 100 is switched to MC observation with an observation magnification of 20 times (hereinafter referred to as MC20x observation).
  • the setting of the microscope 100 is switched to MC observation with an observation magnification of 40 times (hereinafter referred to as MC40x observation).
  • the setting of the microscope 100 is switched to PO observation with an observation magnification of 20 times (hereinafter referred to as PO 20 ⁇ observation).
  • PO 20 ⁇ observation an observation magnification of 20 times
  • DIC60x observation an observation magnification of 60 times
  • the input device 60 is a keyboard.
  • Input device 70 is a mouse.
  • the input device 60 and the input device 70 are each connected to the processing device 200 .
  • the microscope system 1 may include other input devices (not shown) such as a touch panel, a voice input device, and a foot pedal.
  • the identification device 80 is a device that acquires identification information attached to the sample. Attached to the sample includes, for example, the case where the identification information is attached to a container containing the sample.
  • the identification information is information that identifies the sample, and more specifically, for example, information that identifies the patient who provided the sample.
  • the identification device 80 may be, for example, a barcode reader, an RFID (registered trademark) reader, a QR code (registered trademark) reader, or the like.
  • the processing device 200 generates a target image based on object detection on the digital image acquired by the imaging device 143 .
  • the generated target image is output to the projection device 153 of the microscope 100 directly or via the microscope controller 10 .
  • the processing device 200 is connected to the microscope 100, the microscope controller 10, the display device 30, the input device 60, the input device 70, and the identification device 80, as shown in FIG.
  • the processing device 200 is also connected to the database server 20 .
  • the processing device 200 includes an image analysis unit 210, an image generation unit 220, and a storage unit 230 as functional components related to target image generation.
  • the image analysis unit 210 detects an object on the digital image, and determines sperm to be selected (hereinafter simply referred to as a selection target) from the sperm detected by the object detection (hereinafter referred to as selection candidates). perform image analysis, including target determination;
  • the image analysis performed by the image analysis unit 210 may include candidate evaluation for evaluating selection candidates detected by object detection, in addition to object detection and target determination, and may include tracking processing for tracking selection candidates.
  • the selection candidate is a candidate to be selected, and the selection target is determined from among the selection candidates.
  • the method of object detection is not particularly limited.
  • the image analysis unit 210 may, for example, perform object detection using a learned model stored in the storage unit 230, and detect objects classified as sperm as sorting candidates.
  • Algorithms of the trained model are not particularly limited, but deep learning models such as SSD, YOLO, and FasterR-CNN may be used, for example.
  • the method of target determination is to evaluate the morphology of candidates for selection detected by object detection and determine the target to be selected.
  • the image analysis unit 210 recognizes the morphology of the candidate for selection based on the digital image, and determines whether the candidate for selection is classified into a normal morphology, an abnormal morphology, or an indistinguishable morphology based on the recognized morphology. Selection targets are determined by calculating the probability.
  • "indistinguishable" means that the sperm is out of focus or faces to the side and the morphology cannot be determined accurately.
  • the image analysis unit 210 may detect surplus cytoplasm and other abnormal sites included in the selection candidates based on the digital image, and may count them. Based on the digital image, the image analysis unit 210 may calculate parameters related to the shape and size of the candidates for selection, such as the circularity of the sperm head, the thickness of the neck, and the asymmetry of the neck position. .
  • the image generation unit 220 generates a target image, which is an image to be sorted determined by the image analysis unit 210, based on the digital image. That is, the image generator 220 generates a target image to be sorted based on sperm detection and sperm morphology evaluation for the digital image.
  • the image generation unit 220 displays the target image projected onto the image plane in a size larger than the selection target in the optical image similarly projected onto the image plane.
  • the size of the target image to be generated may be adjusted by enlarging or reducing the image clipped from the digital image by digital zooming.
  • the area to be sorted that is cut out from the digital image is, for example, an area that contains the entire sperm detected by object detection, but it is not necessary to cut out the entire sperm.
  • a setting of the microscope system 1 may be able to change which range of the sorting target is to be cut out. Therefore, the image generation unit 220 may cut out the entire sperm region (from the head to the tail) or cut out the region from the head to the neck of the sperm according to the settings of the microscope system 1. Alternatively, only the head region may be cut out, only the neck region may be cut out, only the tail region may be cut out, or a specified region of the sperm may be cut out.
  • the settings of the microscope system 1 may be changed according to, for example, which part of the object to be sorted is focused by the user for quality judgment.
  • the target image generated by the image generation unit 220 is output to the projection device 153.
  • the projection device 153 projects the target image onto the image plane, and the target image is projected onto the image plane in a size larger than that of the selection target in the optical image.
  • the target image is preferably displayed on the image plane at a higher overall magnification than the optical image.
  • the storage unit 230 stores learned models used in image analysis performed by the image analysis unit 210 . Specifically, the storage unit 230 stores a trained model for object detection performed to detect sperm that are candidates for selection and a trained model for candidate evaluation that evaluates sperm that are candidates for selection. there is The image analysis unit 210 performs object detection (sperm detection) and candidate evaluation using the learned model stored in the storage unit 230 .
  • the processing device 200 may be a general-purpose computer or a dedicated computer.
  • the processing device 200 is not particularly limited to this configuration, but may have, for example, a physical configuration as shown in FIG.
  • the processing device 200 may include a processor 201, a storage device 202, an input interface (I/F) 203, an output interface (I/F) 204, and a communication device 205. They may be connected to each other by bus 206 .
  • the processor 201 may include hardware, and the hardware may include, for example, at least one of circuitry for processing digital signals and circuitry for processing analog signals.
  • Processor 201 may include, for example, one or more circuit devices (eg, ICs) or one or more circuit elements (eg, resistors, capacitors) on a circuit board.
  • the processor 201 may be a CPU (central processing unit). Also, the processor 201 may use various types of processors including GPUs (Graphics Processing Units) and DSPs (Digital Signal Processors).
  • the processor 201 may be a hardware circuit having an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array).
  • Processor 201 may include amplifier circuits, filter circuits, etc. for processing analog signals.
  • the processor 201 functions as the image analysis unit 210 and the image generation unit 220 described above by executing programs stored in the storage device 202 .
  • the storage device 202 may include memory and/or other storage devices.
  • the memory may be, for example, random access memory (RAM).
  • the memory may be a semiconductor memory such as SRAM (Static Random Access Memory) or DRAM (Dynamic Random Access Memory).
  • Storage device 202 may be, for example, a register, a magnetic storage device such as a hard disk drive, an optical storage device such as an optical disk drive, an internal or external hard disk drive, a solid state storage device, a CD-ROM, a DVD, or other optical or magnetic storage device. It may be a disk storage device or other storage device.
  • the storage device 202 stores programs executed by the processor 201, learned models, and other data, and functions as the storage unit 230 described above. Note that the storage device 202 is an example of a non-temporary computer-readable storage medium.
  • the input I/F 203 is connected to an input device operated by a user of the microscope system 1 (for example, an embryologist), receives an operation signal according to the operation of the input device, and outputs it to the processor 201 .
  • a user of the microscope system 1 for example, an embryologist
  • the output I/F 204 is connected to the display device 30.
  • the output I/F 204 may be further connected to an audio output device such as a speaker that outputs audio, a light emitting device such as a lamp that outputs light, and a vibration device such as a vibrator that outputs vibration, which are not shown.
  • the communication device 205 is a device that exchanges data with the microscope 100 and other devices.
  • the communication device 205 may be a communication device that exchanges data by wire, or may be a communication device that exchanges data wirelessly.
  • the programs and learned models stored in the storage device 202 may be obtained by the communication device 205 from another device via the Internet.
  • FIG. 5 is a flow chart showing an example of the ICSI procedure by an embryologist.
  • FIG. 6 is a diagram illustrating the configuration of a drop formed as the sample 300 in the petri dish 310.
  • FIG. 7 is a flow chart showing an example of a sperm sorting procedure by an embryologist.
  • FIG. 8 is a flowchart showing an example of sorting support processing.
  • FIG. 9 is a flowchart illustrating an example of target image generation processing.
  • FIG. 10 is a flowchart illustrating an example of image display processing.
  • FIG. 11 is a diagram showing an example of an optical image generated by the microscope 100.
  • FIG. 12 is a diagram showing an example of a digital image acquired by the imaging device 143. As shown in FIG. FIG. FIG.
  • FIG. 13 is a diagram showing an example of object detection results for a digital image.
  • FIG. 14 is a diagram for explaining an example of a method of generating a target image.
  • FIG. 15 is a diagram showing an example of an image seen through the eyepiece lens 101. As shown in FIG. Specific utilization of the sperm sorting support method performed by the microscope system 1 in ICSI will be described below with reference to FIGS. 5 to 15 .
  • the user prepares a sample (step S1).
  • the user prepares a sample 300 containing a plurality of drops in a petri dish 310 and places it on the stage 111, as shown in FIG. 6, for example.
  • a drop 301 is a drop for cleaning and is used for cleaning the pipette.
  • the drop 302 is a sperm suspension drop, for example, a drop of a sperm suspension in a PVP solution.
  • a drop 303 is an oocyte manipulation drop, and is, for example, an oocyte in an m-HTF solution.
  • the m-HTF solution is a Hepps-containing HTF solution supplemented with 10% serum.
  • step S2 the user sets up the microscope system 1 (step S2).
  • the user presses the button 51 of the input device 50 to switch the setting of the microscope system 1 to BF4 ⁇ observation.
  • the positions of the pipettes 43 and 44 are adjusted by operating the input device 40 and the pipettes 43 and 44 are brought into focus.
  • the stage 111 is moved to wash the pipettes 43 and 44 with the drop 301 (washing drop).
  • the user confirms the state of the egg (egg cell) in the drop 303 (egg manipulation drop) (step S3).
  • the user presses the button 53 of the input device 50 to switch the setting of the microscope system 1 to MC20x observation.
  • the morphology of the ovum is observed by MC20x observation, and the ovum is selected.
  • the button 55 of the input device 50 may be pressed to switch the setting of the microscope system 1 to PO20x observation.
  • the degree of maturity of the ovum may be determined, and the ovum may be further selected.
  • step S4 the user sorts the sperm according to the procedure shown in FIG. 7 (step S4).
  • the stage 111 is moved to move the observation position to the drop 302 (sperm floating drop), and the sperm is focused by MC20 ⁇ observation (step S11).
  • step S12 the user selects sperm suitable for fertilization by MC20x observation.
  • embryologists judged sperm quality based on sperm morphology and motility observed in optical images, and sorted sperm based on that judgment.
  • MC20x a sufficient field of view is secured for the size of the sperm, which has the advantage of making it easy to understand the motility of the sperm. Too much. For this reason, it is necessary to observe the spermatozoa selected in step S12 at a higher magnification, which causes the problem that the sorting operation takes time and requires reworking.
  • step S12 the microscope system 1 classifies the sperm morphology into good, poor, and indistinguishable on the image plane, and the sperm determined to be good is larger than the target sperm in the optical image. Display by size.
  • the image By projecting the image in a size larger than the sorting object in the optical image, it is possible to assist the user in determining the morphology of the sperm, which has been difficult in this step in the past.
  • it is possible to suppress rework due to different judgments in the post-process and for example, it is possible to omit switching to MC40x observation in step S14 and shorten the time required for sperm sorting.
  • the optical image and the target image onto the same image plane, it is possible to accurately identify the morphology of the sperm of interest (sperm to be sorted) using the target image, while mainly confirming the motility of the sperm using the optical image. can be grasped. Therefore, since sperm can be sorted by confirming both motility and morphology, it is possible to suppress rework due to different determinations in the subsequent steps.
  • step S12 the microscope system 1 performs the selection support process shown in FIG. 8, so that the target image is projected onto the image plane together with the optical image.
  • the microscope system 1 projects an optical image of the sample onto the image plane (step S21).
  • the microscope 100 forms, for example, an optical image O1 shown in FIG. 11 on the image plane.
  • a region 143R shown in FIG. 11 indicates a region imaged by the imaging device 143 in step S22.
  • the microscope system 1 acquires a digital image at the same time as step S21 (step S22).
  • the imaging device 143 acquires, for example, a digital image D1 of the sample shown in FIG. 12 based on the light from the sample, and outputs the acquired digital image D1 to the processing device 200 .
  • the microscope system 1 After that, the microscope system 1 generates a target image based on the digital image (step S23).
  • the processing device 200 performs the target image generation processing shown in FIG.
  • the processing device 200 first performs object detection on the digital image D1 (step S31).
  • the image analysis unit 210 performs object detection by inputting the digital image D1 as an input image into the trained model, and detects spermatozoa as sorting candidates as shown in FIG.
  • FIG. 13 shows a box B attached to the position of an object (selection candidate) classified by the object detection.
  • the processing device 200 evaluates the selection candidate (step S32).
  • the image analysis unit 210 evaluates each of the selection candidates. Specifically, the image analysis unit 210 evaluates the forms of selection candidates.
  • the processing device 200 determines sorting targets based on the evaluation performed in step S32 (step S33).
  • the image analysis unit 210 determines the selection candidate with the highest evaluation among the selection candidates as the selection target. Specifically, for example, as shown in FIG. 13, the central sperm with the highest probability of determining good sperm is determined as the selection target.
  • the processing device 200 cuts out the selection target area from the digital image (step S34).
  • the image generation unit 220 cuts out a selection target area from the digital image D1 to generate the target image T1.
  • the size of the target image T1 may be adjusted in step S34 so that it is displayed larger than the selection target in the optical image when projected onto the image plane.
  • the microscope system 1 displays the target image on the image plane in a size larger than the selection target in the optical image (step S24).
  • the processing device 200 performs the image display processing shown in FIG. In the image display process, the processing device 200 first determines the overall magnification of the target image T1 displayed on the image plane (step S41), and further determines the size of the target image T1 (step S42).
  • step S41 when the total magnification of the optical image formed on the image plane is, for example, 200 times, the image analysis unit 210 sets the total magnification of the target image T1 projected on the image plane to a magnification exceeding 200 times (for example, 1000 times). times).
  • step S42 when the selection target in the optical image formed on the image plane is projected onto a region of 1 mm ⁇ 1 mm, the image analysis unit 210 determines the size of the target image T1 to be 1 mm ⁇ 1 mm or more. do.
  • the processing device 200 determines the position of the target image T1 displayed on the image plane (step S43).
  • the processing device 200 determines the position of the target image while avoiding the region of the sperm to be sorted included in the optical image, for example, so that the region of the sperm to be sorted included in the optical image does not overlap the target image. do.
  • the position of the target image may be arranged at a previously specified position such as the upper side, the lower side, the right side, or the left side with respect to the center of the field of view.
  • the processing device 200 displays the target image T1 with the overall magnification determined in step S41 and the size determined in step S42 at the position determined in step S43 (step S44).
  • the processing device 200 assigns each pixel of the target image T1 to a pixel of the projection device 153 based on the overall magnification determined in step S41, the size determined in step S42, and the position determined in step S43.
  • the projection device 153 projects the target image T1 in a size larger than the selection target in the optical image at a position that does not overlap the selection target in the optical image on the image plane. This allows the user to simultaneously confirm the optical image O1 and the target image T1 displayed on the image plane, as shown in FIG. 15, for example.
  • step S12 the sorting support process shown in FIG. 8 is repeatedly performed, so that the sorting target spermatozoa moving within the field of view can be tracked, so that the sorting target spermatozoa can be carefully observed in the target image. can be done.
  • step S12 the user immobilizes the sperm by scratching the tail of the sperm by RC20x observation (step S13).
  • the user immobilizes the sperm by rubbing the tail of the sperm against the bottom surface of the petri dish 310 with a pipette.
  • the user may observe the morphology of the immobilized sperm in more detail and further sort the sperm (step S14).
  • the user presses the button 54 of the input device 50 to switch the setting of the microscope system 1 to MC40 ⁇ observation.
  • the user may then further sort the sperm with MC40x viewing.
  • the microscope system 1 performs the sorting support process shown in FIG. 8 in the same manner as in step S12, and projects the target image onto the image plane in a size larger than the sorting target in the optical image. May assist in sperm sorting operations.
  • the user then takes the selected sperm into the pipette 44, which is an injection pipette, and moves the observation position to the drop 303 (egg manipulation drop) (step S15). Complete the sperm sorting sequence shown in .
  • the user confirms the position of the spindle in preparation for sperm injection (step S5).
  • the user observes the egg selected in step S3 in the drop 303 and confirms the position of the mitotic spindle of the egg.
  • the user presses the button 55 of the input device 50 to switch the setting of the microscope system 1 to PO20 ⁇ observation.
  • the user changes the orientation of the spindle by operating the pipette 43, which is a holding pipette, so that the spindle of the egg visualized by PO20x observation is positioned in the direction of 12 o'clock or 6 o'clock. This is to prevent the spindle from being damaged by the pipette thrust into the ovum from the 3 o'clock or 9 o'clock direction in step S6, which will be described later.
  • the user injects the sperm into the egg (step S6) and ends the ICSI.
  • the user presses the button 53 of the input device 50 to switch the setting of the microscope system 1 to MC20x observation.
  • the user fixes the ovum whose orientation has been adjusted in step S5 with a holding pipette 43 and pierces it with an injection pipette 44 .
  • good sperm is injected into the egg from the pipette 44 .
  • the user After completing the series of ICSI procedures shown in Figure 5, the user returns the sperm-injected egg to the incubator and cultures it. Also, the user may operate the processing device 200 using the input device 60 and the input device 70 to store the information obtained by ICSI in the database server 20 .
  • the processing device 200 may operate the processing device 200 using the input device 60 and the input device 70 to store the information obtained by ICSI in the database server 20 .
  • sperm and egg patient information may be associated with each other and stored in the database server 20 .
  • the target image which is the image of the sperm to be sorted, is projected onto the image plane in a size larger than that of the sorting target in the optical image.
  • the sperm size is about 60 ⁇ m, and an objective lens of at least 20 ⁇ is used to distinguish good sperm. Since the field number of an inverted microscope is generally about 22, the actual field of view is about ⁇ 1 mm. It is very difficult to select free-moving spermatozoa with a size of about 60 ⁇ m within the real field of view ⁇ 1 mm. In general, sperm that are presumed to be good sperm have high motility, and the ICSI work needs to be done in a short time. A good/bad judgment must be made.
  • the microscope system 1 can determine good sperm candidates from a morphological point of view while mainly confirming the motility of sperm in optical images. Then, it is possible to confirm the morphology of the sperm at the same time by projecting it onto the image plane at a higher total magnification than the optical image. As a result, good sperm can be selected appropriately and in a short period of time based on both motility and morphology of the sperm, so that the fertilization success rate can be improved. Therefore, according to the microscope system 1, it is possible to effectively assist the sorting operation of the spermatozoa in the sample.
  • FIG. 16 is a diagram for explaining another example of the target image generation method.
  • FIG. 17 is a diagram showing another example of an image seen through the eyepiece 101.
  • FIG. This embodiment will be described below with reference to FIGS. 16 and 17.
  • FIG. Note that the configuration of the microscope system according to the present embodiment (hereinafter also simply referred to as the microscope system) is the same as that of the microscope system 1 .
  • This embodiment differs from the first embodiment in that a plurality of target images are displayed on the image plane. Other points are the same as in the first embodiment.
  • the processing device 200 determines a plurality of selection targets based on the evaluation performed in step S32.
  • the number of sorting targets may be predetermined, such as two. Further, the number of selection targets may be determined based on the evaluation in step S32, and the processing device 200 may, for example, determine all selection candidates evaluated to exceed a certain criterion as selection targets. good.
  • step S34 for example, as shown in FIG. 16, the processing device 200 cuts out a plurality of selection target regions from the digital image to generate a plurality of target images (target image T1, target image T2). .
  • good sperm are projected onto the image plane in a size larger than that of the sorting object in the optical image, so that it is possible to assist the user in determining the morphology of the sperm. Since both the motility and morphology of the sperm can be simultaneously confirmed from the target image, good sperm can be selected appropriately and in a short period of time based on both the motility and morphology of the sperm. This is the same as the microscope system 1 according to the embodiment of . Further, in the microscope system according to the present embodiment, as shown in FIG.
  • a plurality of spermatozoa included in the optical image O1 is determined as a sorting target, and a plurality of target images (target image T1, target image T2) are optically selected. displayed with the image. Therefore, since the possibility of early discovery of good sperm that exceeds the user's criteria for judging quality increases, sperm can be sorted more efficiently than the microscope system 1 .
  • FIG. 18 is a flow chart showing another example of the sorting support process.
  • FIG. 19 is a flowchart showing another example of image display processing.
  • FIG. 20 is a diagram for explaining an example of a method of generating an auxiliary image.
  • FIG. 21 is a diagram showing still another example of an image seen through the eyepiece 101.
  • FIG. Note that the configuration of the microscope system according to the present embodiment (hereinafter also simply referred to as the microscope system) is the same as that of the microscope system 1 .
  • This embodiment differs from the first embodiment in that the sorting support process shown in FIG. 18 is performed instead of the sorting support process shown in FIG. Other points are the same as in the first embodiment.
  • the microscope system projects an optical image of the sample onto the image plane (step S51), acquires a digital image (step S52), and generates a target image (step S53).
  • the processing from step S51 to step S53 is the same as the processing from step S21 to step S23 in FIG.
  • the microscope system After that, the microscope system generates an auxiliary image for the target image (step S54).
  • the processing device 200 generates the auxiliary image.
  • the auxiliary image is an image that provides the user with information indicating whether the morphology of the sperm to be sorted is close to good, poor, or indistinguishable, and information on the size of the sperm head to be sorted.
  • step S54 for example, as shown in FIG. 20, the processing device 200 first generates an evaluation result ER by evaluating the sorting target based on the target image T1, and then generates an auxiliary image ER based on the evaluation result ER.
  • A1 may be generated.
  • the auxiliary image A1 includes evaluation information E1 regarding the morphology of the object to be sorted, and a marker M1 indicating the size of the head of the object to be sorted.
  • the marker M1 is also an example of a marker indicating a target position or area.
  • the auxiliary image A1 may include a marker indicating the position or region of excess cytoplasm in the sperm instead of or in addition to the marker M1 indicating the head size in the sperm. That is, the auxiliary image A1 may include a marker indicating the presence or absence of surplus cytoplasm.
  • the auxiliary image A1 may also include markers indicating the degree of circularity of the head, the thickness of the neck, and the asymmetry between the positions of the head and neck. In other words, it may include a marker indicating the target position or area to be sorted.
  • the evaluation information E1 preferably includes numerical information indicating the size of the head.
  • the auxiliary image A1 may include a marker indicating the position or region of the space or other defective part of the sperm.
  • FIG. 20 shows an example in which the auxiliary image A1 is generated based on the target image T1, but the auxiliary image A1 is information obtained in the process of generating the target image T1 in step S53 (for example, candidate evaluation information). result).
  • the microscope system displays the target image and the auxiliary image on the image plane (step S55). 19, the target image T1 and the auxiliary image A1 are displayed on the image plane together with the optical image O1, as shown in FIG.
  • the processing device 200 first determines the overall magnification of the target image T1 arranged on the image plane (step S61), then determines the size of the target image T1 (step S62), and further The position of the target image T1 displayed on the image plane is determined (step S63).
  • the processing from step S61 to step S63 is the same as the processing from step S41 to step S43 in FIG.
  • the processing device 200 determines the position of the auxiliary image A1 arranged on the image plane (step S64).
  • the processing device 200 may determine the position of the auxiliary image A1 in relation to the target image T1.
  • the processing device 200 may determine the positional relationship between the auxiliary image A1 and the target image T1, for example, such that the marker M1 in the auxiliary image A1 overlaps the region of interest in the target image T1. That is, the processing device 200 generates a projection image including the auxiliary image A1 and the target image T1 in the determined positional relationship.
  • the processing device 200 places the target image T1 having the overall magnification determined in step S61 and the size determined in step S62 at the position determined in step S63, and the auxiliary image A1 at the position determined in step S64. display (step S65). That is, the processing device 200 projects the projection image generated in step S64 onto the image plane.
  • the processing device 200 assigns each pixel of the projection image to a pixel of the projection device 153 . That is, each pixel of the target image T1 is assigned to a pixel of the projection device 153 based on the overall magnification determined in step S61, the size determined in step S62, and the position determined in step S63. Pixels are assigned to pixels of projection device 153 based on the positions determined in step S64.
  • the projection device 153 projects the target image T1 at a position that does not overlap the selection target in the optical image O1 on the image plane in a size larger than the selection target in the optical image, and also projects the auxiliary image A1 on the image plane. Project to the appropriate position of Thereby, the user can confirm the optical image O1, the target image T1, and the auxiliary image A1 at the same time, as shown in FIG.
  • the target image is projected onto the image plane in a size larger than that of the sorting target in the optical image. Since both the motility and morphology of the sperm can be simultaneously confirmed from the target image, good sperm can be selected appropriately and in a short period of time based on both the motility and morphology of the sperm.
  • the microscope system according to the present embodiment projects an auxiliary image that provides information related to the target image onto the image plane, thereby further assisting the user in determining the quality of the sperm. be able to.
  • the microscope system according to the present embodiment it is possible to select sperm suitable for fertilization with high accuracy, so that it is possible to suppress the difference in fertilization rate between embryologists.
  • the configuration of the microscope system is not limited to this example.
  • the microscope system 2 shown in FIG. 22 may be used.
  • the microscope system 2 differs from the microscope system 1 in that a microscope 400 is provided instead of the microscope 100 .
  • a microscope 400 has a projection unit 500 between a microscope main body 410 and a lens barrel 420 .
  • Projection unit 500 is a projection unit for a microscope, and includes a projection section (splitter 151, lens 152, and projection device 153) corresponding to projection unit 150 shown in FIG. 1, and an imaging section corresponding to imaging unit 140 shown in FIG. (splitter 141 and imaging device 143 ) and an image processor 510 .
  • the image processing unit 510 functions as the image analysis unit 210, the image generation unit 220, and the storage unit 230 shown in FIG.
  • the projection unit 500 and the microscope system 2 With the projection unit 500 and the microscope system 2, the same effects as those of the microscope system 1 can be obtained.
  • an existing microscope system can be expanded to obtain the above effects, so the existing microscope system can be effectively utilized.
  • sorting target is not limited to sperm.
  • the sorting target be selected based on both motility and morphology.
  • the target image is projected onto the image plane by the projection device 153 .
  • a device may be used.
  • the target image is displayed on the image plane in a size larger than the selection target in the optical image. It may be displayed in a size equal to or larger than that of the sorting object inside.
  • a target image obtained by cropping the entire sperm area and a target image obtained by cropping only the sperm head area may be generated and arranged on the image plane at different overall magnifications. As a result, it is possible to observe the entire sperm at an appropriate magnification while observing a specific portion of the sperm at a higher magnification.
  • the target image may be updated periodically based on, for example, the frame rate of the moving image captured by the imaging device 143, and the update frequency may be changeable according to settings. That is, the target image may be projected onto the image plane as a moving image, or may be projected as a still image. By projecting the target image as a still image, the user can carefully observe the morphology of the sperm. Further, by projecting the target image as the sperm image, it is possible to avoid a situation in which the auxiliary image is projected at a position shifted from the predetermined position with respect to the target image due to delay in creation of the auxiliary image.
  • the processing device tracks the sorting object. Further, even when projecting as a moving image, by adjusting the updating frequency, it is possible to avoid the inconvenience caused by the delay in creating the auxiliary image.
  • the phrase "based on A” does not mean “based only on A”, but means “based at least on A”, and furthermore, “based at least in part on A”. It also means “te”. That is, “based on A” may be based on B in addition to A, or may be based on a portion of A.

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Food Science & Technology (AREA)
  • Analytical Chemistry (AREA)
  • Urology & Nephrology (AREA)
  • Hematology (AREA)
  • Biomedical Technology (AREA)
  • Medicinal Chemistry (AREA)
  • Physics & Mathematics (AREA)
  • Molecular Biology (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Microscoopes, Condenser (AREA)

Abstract

L'invention concerne un système de microscope 1 qui comprend : un microscope 100 qui forme une image optique d'un échantillon de sperme qui contient un objet de sélection ; un dispositif d'imagerie 143 pour acquérir une image numérique de l'échantillon de sperme ; un dispositif de traitement 200 qui génère une image d'objet qui est une image de l'objet de sélection, une telle génération étant sur la base d'une détection de sperme et d'une évaluation de forme de sperme par rapport à l'image numérique ; et un dispositif de projection 153 qui affiche l'image d'objet sur une surface d'image sur laquelle est formée l'image optique, l'image d'objet étant affichée plus grande que l'objet de sélection dans l'image optique.
PCT/JP2021/048510 2021-12-27 2021-12-27 Système de microscope, unité de projection et procédé d'aide à la sélection WO2023127001A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/JP2021/048510 WO2023127001A1 (fr) 2021-12-27 2021-12-27 Système de microscope, unité de projection et procédé d'aide à la sélection
JP2023570498A JPWO2023127001A1 (fr) 2021-12-27 2021-12-27

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/048510 WO2023127001A1 (fr) 2021-12-27 2021-12-27 Système de microscope, unité de projection et procédé d'aide à la sélection

Publications (1)

Publication Number Publication Date
WO2023127001A1 true WO2023127001A1 (fr) 2023-07-06

Family

ID=86998306

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/048510 WO2023127001A1 (fr) 2021-12-27 2021-12-27 Système de microscope, unité de projection et procédé d'aide à la sélection

Country Status (2)

Country Link
JP (1) JPWO2023127001A1 (fr)
WO (1) WO2023127001A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0829694A (ja) * 1994-07-20 1996-02-02 Nikon Corp 画像処理装置付き顕微鏡
WO2005080944A1 (fr) * 2004-02-18 2005-09-01 The University Court Of The University Of Glasgow Analyse de la morphologie et de la motilite de cellules
WO2012150689A1 (fr) * 2011-05-02 2012-11-08 オリンパス株式会社 Microscope et procédé de micro-insémination utilisant un microscope
WO2020059522A1 (fr) * 2018-09-21 2020-03-26 公立大学法人横浜市立大学 Système de soutien à la médecine reproductive
WO2020066040A1 (fr) * 2018-09-28 2020-04-02 オリンパス株式会社 Système de microscope, unité de projection et procédé de projection d'image

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0829694A (ja) * 1994-07-20 1996-02-02 Nikon Corp 画像処理装置付き顕微鏡
WO2005080944A1 (fr) * 2004-02-18 2005-09-01 The University Court Of The University Of Glasgow Analyse de la morphologie et de la motilite de cellules
WO2012150689A1 (fr) * 2011-05-02 2012-11-08 オリンパス株式会社 Microscope et procédé de micro-insémination utilisant un microscope
WO2020059522A1 (fr) * 2018-09-21 2020-03-26 公立大学法人横浜市立大学 Système de soutien à la médecine reproductive
WO2020066040A1 (fr) * 2018-09-28 2020-04-02 オリンパス株式会社 Système de microscope, unité de projection et procédé de projection d'image

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
SATO, TAKUMI EL AL.: "A machine learning model created for the purpose of supporting sperm selection by embryologists in microinsemination", JOURNAL OF ASSISTED REPRODUCTION, vol. 66, no. 4, 19 October 2021 (2021-10-19), JP , pages 124 (244), XP009547336, ISSN: 1881-0098 *
SATO, TAKUMI ET AL.: "Feasibility study on selection support of good sperm by machine learning in Intracytoplasmic sperm injection", JOURNAL OF ASSISTED REPRODUCTION, vol. 64, no. 4, 9 October 2019 (2019-10-09), pages 272, XP009547337 *

Also Published As

Publication number Publication date
JPWO2023127001A1 (fr) 2023-07-06

Similar Documents

Publication Publication Date Title
JP7214753B2 (ja) 顕微鏡システム
WO2021200003A1 (fr) Système de microscope, unité de projection et procédé d'aide au triage de sperme
Louis et al. Review of computer vision application in in vitro fertilization: the application of deep learning-based computer vision technology in the world of IVF
US11869166B2 (en) Microscope system, projection unit, and image projection method
US10563177B2 (en) Evaluating a pluripotent stem cell based on a region of a phase distribution image having a phase amount less than a threshold phase amount of a mitochondrion in a somatic cell
US20210239961A1 (en) Method for generating an overview image using a large aperture objective
WO2019222839A1 (fr) Procédé de mesure non invasive automatisée de motilité et de morphologie de spermatozoïde et de sélection automatisée d'un spermatozoïde à intégrité d'adn élevée
US11948295B2 (en) Virtual staining systems and methods for observing one or more unstained cells
JP2013109119A (ja) 顕微鏡制御装置およびプログラム
WO2020059522A1 (fr) Système de soutien à la médecine reproductive
US20220091408A1 (en) Method, microscope, and computer program for determining a manipulation position in the sample-adjacent region
WO2023127001A1 (fr) Système de microscope, unité de projection et procédé d'aide à la sélection
EP3521750B1 (fr) Dispositif, procédé et programme d'évaluation d'image capturée
Sidhu Automated Blastomere Segmentation for Visual Servo on Early-stage Embryo
JP2023096267A (ja) 顕微鏡システム、投影ユニット、及び、選別支援方法
Yao et al. Automatic three-dimensional imaging for blastomere identification in early-stage embryos based on brightfield microscopy
WO2023248958A1 (fr) Système de microscope, unité de projection, procédé d'aide au tri et support d'enregistrement
US10690902B2 (en) Image processing device and microscope system
US11906433B2 (en) System and method for three-dimensional imaging of unstained samples using bright field microscopy
US20180204047A1 (en) Observation system
JP2024059329A (ja) 顕微鏡システム
JP2000155266A (ja) 顕微鏡光学系
JP2014092640A (ja) 顕微鏡および制御方法
Chang et al. Setup of micromanipulator for sperm selection and injection for IMSI: Configuring the microscope for intracytoplasmic morphology-selected sperm injection (IMSI)
Nolte et al. Digital Microscopy (ODMS)

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21969885

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023570498

Country of ref document: JP