EP2232320B1 - System zum steuerbaren scannen einer zytologischen probe - Google Patents

System zum steuerbaren scannen einer zytologischen probe Download PDF

Info

Publication number
EP2232320B1
EP2232320B1 EP08867319A EP08867319A EP2232320B1 EP 2232320 B1 EP2232320 B1 EP 2232320B1 EP 08867319 A EP08867319 A EP 08867319A EP 08867319 A EP08867319 A EP 08867319A EP 2232320 B1 EP2232320 B1 EP 2232320B1
Authority
EP
European Patent Office
Prior art keywords
scan line
scan
motorized stage
control element
scanning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP08867319A
Other languages
English (en)
French (fr)
Other versions
EP2232320A1 (de
Inventor
Patrick Guiney
Douglas A. Tenney
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cytyc Corp
Original Assignee
Cytyc Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cytyc Corp filed Critical Cytyc Corp
Publication of EP2232320A1 publication Critical patent/EP2232320A1/de
Application granted granted Critical
Publication of EP2232320B1 publication Critical patent/EP2232320B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/24—Base structure
    • G02B21/26—Stages; Adjusting means therefor
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison

Definitions

  • the invention is related to controlling automated microscopes and, more particularly, to controllably scanning a cytological specimen using an automated microscope.
  • a typical cytological technique is a "Pap smear" test, which involves scraping cells from a woman's cervix and analyzing the cells in order to detect the presence of abnormal cells, a precursor to the onset of cervical cancer. Cytological techniques are also used to detect abnormal cells and diseases in other parts of the human body.
  • cytological samples are often placed in solution and subsequently collected and transferred to a glass slide for viewing under magnification.
  • Fixative and staining solutions are typically applied to cells on the glass slide, often called a cell smear, for facilitating examination and for preserving the specimen for archival purposes.
  • Prepared specimens are examined using a microscope, such as the microscope 100 generally illustrated in Figures 1A-B , which includes a stage 110 having a surface 112 that supports a specimen slide 200 having a biological specimen 202 (e.g., as shown in Figure 2 ).
  • the microscope 100 may include a coaxial control knob 120 including a first knob 121 for moving the stage 110 in one direction (e.g., x direction) and a second knob 122 coaxial with the first knob 121 for moving the stage 110 in a different direction (e.g., y direction).
  • a light source 130 such as a tungsten-halogen light source, is positioned below the stage 110 to illuminate the specimen 202.
  • Objective lenses 140 form a magnified image of the specimen 202, and a cytologist may view the magnified image through an ocular lens 150.
  • Focus adjustments are made using a focus control 160, which may include coaxial focus knobs 161, 162 (e.g., for coarse and fine focus), which move the stage 110 vertically (e.g., z direction). Further aspects of microscope components are described in U.S. Publication No. 2007/0139638 A1 .
  • Machine vision devices and automated systems have also been utilized to acquire and analyze images of biological specimens.
  • One known automated system 300 shown in Figure 3 , includes an automated imaging microscope or station 310, a processing server 320, and an automated review station 330.
  • the imaging station 310 includes a camera 312 for acquiring images of the specimen 202 viewed through an imaging microscope 316.
  • the motorized stage 314 may include, or be operably coupled to, a stage control component or module 400 that includes one or more motors 402 and associated electronic components such as a processor 404 and memory 406, which are used to control the motors 402 and the position of the stage 314 and slide 200 thereon.
  • image data 318 generated by the camera 312 is provided to the server 320 that includes one or more processors 321-323 (generally referred to as processor 321) and memory 324 for processing image data 318 and storing results that are provided to the review station 330.
  • the processor 321 delineates between normal and abnormal (or suspicious) biological material within each specimen 202. That is, the processor 321 uses diagnostic information to determine the most pertinent biological objects and their locations (e.g., x-y coordinates) on the slide 200.
  • the server 320 processes image data 318 to identify "objects of interest" (OOIs) in the image data 318.
  • OOIs may take the form of individual cells and cell clusters of the specimen 202.
  • One or more OOIs can be organized within a defined boundary or fields of view of Fields of Interest (FOI), which may be defined by various geometries to include different numbers of OOIs.
  • FOIs may be identified based on (x,y) coordinates.
  • One known automated system identifies 22 FOIs, or 22 sets of (x,y) coordinates. Further aspects of OOIs and FOIs are described in U.S. Patent No. 7,083,106 and U.S. Publication No. 2004/0254738 A1 .
  • the processor 321 may be configured to rank identified OOIs, e.g., based on the degree to which certain cells or objects are at risk of having an abnormal condition such as malignancy or pre-malignancy. For example, a processor 321 may evaluate OOIs for their nuclear integrated or average optical density, and rank the OOIs according to optical density values.
  • the OOI and FOI coordinate information may be stored for subsequent processing, review or analysis using the review station 330.
  • the OII / FOI location information is provided to the review microscope 336, which automatically steps through the previously identified FOIs to present OOIs to the cytologist.
  • the review station 330 includes a mouse-like joystick that is used to navigate the slide 200.
  • one system includes "NEXT” and "PREVIOUS" buttons that are used to navigate the next FOI and the previous FOI.
  • the cytologist if the cytologist does not identify any suspicious cells, then that slide is considered normal. In this case, it is not necessary to scan the entire cell spot 202. However, if the cytologist identifies suspicious cells or OOIs within a FOI, the cytologist can electronically mark those OOIs by pressing a "MARK" button, and must scan the entire specimen or cell spot 202 before completing slide review.
  • Figure 5 shows one manner in which the entire cell spot 202 may be scanned using a serpentine scan pattern.
  • the scan starts at the beginning 502a (generally referred to as beginning 502) of a first scan line or chord 500a (generally referred to as "scan line 500"), traverses across a first portion of the cell spot 202 at certain positions 510 (represented as dots) on the first scan line 500a (e.g., moving left to right in the illustrated example), and beyond the cell spot 202 boundary 204 (to ensure that the entire length or width of the cell spot 202 is scanned) to the end 503a (generally referred to as end 503) of the first scan line 500a.
  • beginning 502a generally referred to as beginning 502
  • scan line 500a traverses across a first portion of the cell spot 202 at certain positions 510 (represented as dots) on the first scan line 500a (e.g., moving left to right in the illustrated example), and beyond the cell spot 202 boundary 204 (to ensure that the entire length
  • the automated system indexes 520a down to the second or next scan line 500b such that a second portion of the cell spot 202 may be scanned (e.g., right to left) from the beginning 502b to the end 503b of that scan line 502b, at which point it is indexed 520b again to the beginning 502c of the next scan line 500c, and so on, to scan 100% of the cell spot 202.
  • known automated systems include a motorized stage 334 that positions the cell spot 202 for scanning and review by the cytologist.
  • the motorized stage 334 and slide 200 move continuously along a pre-determined scan line 500 (e.g., as shown in Figure 5 ), in a manner similar to a slow moving picture.
  • the motorized stage 334 is controlled to move the slide 200 to positions 510 on a scan line 500, and pauses at each of position 520 for a pre-determined amount of time before moving to the next position 510, pausing again, moving again, and so one for each position 510 on each scan line 500.
  • the stage 334 and slide 200 are moved to fixed positions 510 on a scan line 500 and remain at that position 510 until the user presses a button (e.g., the "NEXT" button used for review control), to move to the next position 510 on a scan line 500.
  • a button e.g., the "NEXT” button used for review control
  • U.S. Publication No. 2003/0179445 discloses cytological imaging systems and methods
  • U.S. Patent No. 5,557,456 discloses positioning of a microscope stage.
  • certain scan modes of known automated screening systems do not permit the user to select when to stop or pause the scan, change scan directions, and/or move the scan position to view a different portion of the specimen that is not on the current scan path.
  • a user may not be able to stop or pause at a particular position for a desired amount of time but instead is moved onto the next position if too much time has passed.
  • known systems do not provide control adjustments that can be made on-the-fly.
  • scanning progresses in strict ordered and forward manner such that scanning is advanced. Thus, known systems are unidirectional and do not permit users to go back and review a previously reviewed portion.
  • Known automated scanning systems therefore, provide limited control and flexibility.
  • a system for scanning a cytological specimen includes manually controlling movement of a motorized stage supporting a slide including the cytological specimen along a first scan line to controllably scan a first portion of the cytological specimen along the first scan line, manually indexing the motorized stage from the first scan line to a second scan line, and manually controlling movement of the motorized stage along the second scan line to controllably scan a second portion of the cytological specimen along the second scan line.
  • the disclosed method of scanning a cytological specimen includes manually controlling movement of a motorized stage supporting a slide including the cytological specimen along a first scan line to controllably scan a first portion of the cytological specimen along the first scan line, automatically indexing the motorized stage from the first scan line to a second scan line, and manually controlling movement of the motorized stage along the second scan line to controllably scan a second portion of the cytological specimen along the second scan line.
  • the disclosed system for scanning a cytological specimen includes a motorized stage, a processor and a scan controller.
  • the motorized stage is configured to support a cytological specimen slide
  • the processor is operably coupled to the motorized stage
  • the scan controller is operably coupled to the processor.
  • the motorized stage, the processor, and the scan controller are configured such that manipulation of the scan controller provides manual control of movement of the motorized stage along a first scan line to controllably scan a first portion of the cytological specimen slide along the first scan line, manual indexing of the motorized stage from the first scan line to a second scan line, and manual control of movement of the motorized stage along the second scan line to controllably scan a second portion of the cytological specimen slide along the second scan line.
  • the disclosed system for scanning a cytological specimen includes a motorized stage, a processor and a scan controller.
  • the motorized stage is configured to support a cytological specimen slide
  • the processor operably coupled to the motorized stage
  • the scan controller is operably coupled to the processor.
  • the motorized stage, the processor and the scan controller are configured such that manipulation of the scan controller provides manual control of movement of the motorized stage along a first scan line to controllably scan a first portion of the cytological specimen along the first scan line and manual control of movement of the motorized stage along a second scan line to controllably scan a second portion of the cytological specimen along the second scan line, the processor and the scan controller being further configured such that the motorized stage may be automatically indexed from the first scan line to the second scan line.
  • Movement of the motorized stage may be manually controlled along the respective first and second scan lines by manually controlling a direction in which the motorized stage is moved. For example, movement of the motorized stage may be manually controlled in a first direction along the first scan line and manually controlled in a second, opposite direction, along another scan line.
  • the motorized stage may be controlled to move in a discontinuous manner and may be temporarily paused at a selected position on one of the scan lines. Further, the speed at which the motorized stage is moved may be manually controlled.
  • the motorized stage may be manually indexed from an end of the first scan line to a beginning of the second scan line.
  • Stage movement can be manually controlled by manipulating a coaxial controller, including a first rotary control element and a second rotary control element coaxial with the first rotary control element.
  • the first rotary control element can be rotated to manually control movement of the motorized stage along the first and second scan lines, and the second rotary control element can be rotated to manually index the motorized stage to another scan line.
  • one rotary control element can be disabled during manipulation or operation of the other rotary control element.
  • the motorized stage may also be manually indexed from an end of the first scan line to a beginning of the second scan line using the coaxial controller.
  • the second rotary control element is disabled, e.g., by a processor, during manual control of stage movement with the first rotary control element.
  • the previously disabled second rotary control element is enabled such that the motorized stage can then be indexed from the first scan line to the second scan line by rotation of the second rotary control element, during which time the first rotary control element may be disabled.
  • the second rotary control element may then be disabled after detecting that the motorized stage has been indexed to the next or second scan line.
  • a review control may be activated by the user or operator to temporarily suspend scanning of the cytological specimen and allow the operator to roam different portions of the specimen by allowing the motorized stage to be manually moved from a current position, which can be stored to memory for later use, to another position to review a selected portion of the cytological specimen, such as an object of interest, using the review control.
  • scanning may be re-activated, e.g. by a processor, and the motorized stage is re-positioned at the stored positioned where scanning was temporarily paused, such that manual control of stage movement to scan along a scan line may be resumed.
  • a review control may also be used to manually index the motorized stage to another scan line, or indexing may be automatic.
  • the motorized stage may be automatically indexed from an end of the first scan line to a beginning of the second scan line, and the direction and speed of the stage can be manually controlled.
  • the stage may also be temporarily paused at a selected location.
  • the motorized stage may be moved in a discontinuous manner.
  • a processor is configured to disable one of the rotary control elements of a rotary controller during use of the other rotary control element.
  • the processor is configured to detect that the motorized stage has been manually positioned at an end of the first scan line and enable the previously disabled second rotary control element such that the second rotary control element is rotatable to index the motorized stage from the first scan line to the second scan line.
  • a review controller is operably coupled to the processor, and the scan controller is a review controller that may include at least one button that can be pressed to manually index the motorized stage or temporarily suspend scanning of the cytological specimen at a current motorized stage position to allow manual review of selected portion of the cytological specimen at another motorized stage position.
  • Embodiments relate to methods and systems for allowing a user to controllably scan a cytological specimen of an automated screening system in a more effective, user-friendly, convenient and efficient manner, while remaining capable of achieving 100% cell spot coverage.
  • a scan control system 600 constructed according to one embodiment includes a scan control component or element 610 (generally referred to as scan controller 610) that is connected or operably coupled to a motorized stage 334 of an automated screening system, e.g., the motorized stage of the review station 330 shown in Figure 3 .
  • the scan controller 610 may be connected to the motorized stage 334 through a suitable control interface 400 or other suitable components, e.g., one or more motors 402, a processor 404, and a memory 406 (as generally illustrated in Figure 4 , but not shown in Figure 6 for ease of explanation).
  • Figure 6 generally illustrates a control interface 400, it should be understood that motor 402, processor 404, memory 406 and other components may be part of other system components, and the control interface 400 is generally illustrated for ease of explanation.
  • System 600 and method 700 embodiments are configured to allow a user to manually control scanning of a first portion of the specimen or cell spot 202 along a first scan line 500 or chord (generally referred to as scan line 500) at step 705, manually control or index 520 the motorized stage 334 to from a current scan line 500 to another scan line 500, e.g., the next or adjacent scan line 500, at step 710, and then continue to manual control movement of the motorized stage 334 to controllably scan a second portion of the cell spot 202 along the second scan line 500 at step 715.
  • scan line 500 first scan line 500 or chord
  • Figure 7 illustrates steps involving scanning along two scan lines, but additional manual indexing and manual scanning steps as shown in Figure 7 may be performed as necessary to controllably scan additional portions of the cell spot 202 until the entire cell spot 202 has been reviewed.
  • the ability to manually control cell spot 202 scanning along scan lines 510 and indexing 520 is in contrast to known automated scanning systems, which provide little, if any, user control and do not allow a user to control indexing between scan lines.
  • Figure 8 illustrates a system 800 constructed according to one embodiment having a scan controller 610 in the form of a coaxial rotary controller that includes first and second rotary control elements 811, 812, which may be similar to or the same as stage control wheels or knobs 121, 122 and focus control wheels or knobs 161, 162 shown in Figures 1A-B .
  • One or both of the rotary control elements 811, 812 can be rotated to control movement of the motorized stage 334, the position of the specimen slide 200, and indexing 520 of the stage 334 to another scan line 500.
  • a rotary control element e.g., the outer or larger rotary control element 811
  • the user can rotate the rotary control element 811 to move from position 510 (1) to position 510 (2), pause at position 510 (2), then rotate the rotary control element 811 to move from position 510 (2), e.g., through position 510 (3), to position 510 (4), where the user may pause again as desired.
  • the user can then continue rotating the rotary control element 811 to move from position 510 (4), e.g., through position 510 (5), to position 510 (6), and so on at the timing and pace selected by the user.
  • the rotary control element 811 can be configured such that when it is rotated, scanning is performed at a constant speed regardless of the rotational speed of the rotary control element 811, but rotation can be interrupted and resumed as desired to allow the user to stop, start, and resume scanning at his or her discretion.
  • the user may also control the speed at which different portions of the cell spot 202 are scanned.
  • the speed at which the rotary control element 811 is rotated is related to the speed at which the cell spot 202 is scanned along a particular scan line 500.
  • the rotary control element 811 can be rotated at a first rotational speed to scan a first portion of the cell spot 202 along a scan line 500 at a first speed (1), and then the user can rotate the rotary control 811 element more quickly to scan the second portion of the cell spot 202 more quickly at a faster, second speed (2).
  • the rotary control element 811 may also be rotated more slowly to scan the second portion at a slower, second speed.
  • system and method embodiments involve a combination of embodiments shown in Figures 9 and 10 .
  • the user may start and stop scanning as desired (as shown in Figure 9 ), and may also move through different positions 510 on the scan line 500 at different speeds (as shown in Figure 10 ).
  • the rotary control element 811 may be controllably rotated by a user to perform multi-directional scanning.
  • the user may rotate the rotary control element 811 in one direction (e.g., counter-clockwise) to advance the scan in a first direction (1), and then rotate the same control element 811 in another direction (e.g., clockwise) to reverse the scan direction (2).
  • Scan directions can be changed as desired by the user by rotating the rotary control element 811 in different directions, such that scanning may be advanced (3, 5) and reversed (4) as desired.
  • the user controls and selects the specific position 510 to be scanned, and when, and in which direction, the scan should proceed.
  • embodiments advantageously allow a user to controllably review a portion of the specimen that was previously reviewed to compare that portion to a portion that is currently being reviewed, which is not possible with known automated screening systems.
  • This embodiment may also be combined with the one or more or all of the embodiments shown in Figures 8-10 such that the user may control the direction, position and/or speed of the cell spot 202 scan.
  • method 1200 of scanning a cell spot 202 includes manipulating both of the rotary control elements 811, 812 to manually control scanning along scan lines 500 and to manually index 520 to another scan line 500.
  • one rotary control element such as the first rotary control element 811
  • the rotary control element 811 is rotated by the user to manually control movement of motorized stage 334 and scanning of the cell spot 202 (as described above with reference to Figures 6-11 ). While the other rotary control element 812 may be used for this purpose, reference is made to the first rotary control element 811 for ease of explanation.
  • the other rotary control element which, in this example, is the second rotary control element 812, is de-activated or disabled.
  • the second rotary control element 812 cannot be used to index to another scan line 500 while the first rotary element 811 is utilized, and not until the end 503 of the scan line 500 is reached.
  • only one of the rotary control elements 811, 812 is active or enabled at a given time. In this manner, embodiments eliminate inadvertent or premature indexing 520 before a particular scan line 500 is completely scanned, thereby ensuring that each scan line 500 is scanned in its entirety, and also to ensure that the scan position is maintained at the end 503 of a scan line 500 such that proper indexing 520 can be performed.
  • step 1215 a determination is made whether the scan of the first scan line 500 has been completed. If not, then step 1205 is repeated until the scan is advanced to the end 503 of the first scan line 500. With further reference to Figure 13 , if the first scan line 500 has been completely scanned to the end 503 (1), then at step 1220, the previously de-activated second rotary control element 812 or indexing element is activated or enabled, and the first rotary control element 811 is de-activated or disabled. The enabling and disabling may occur at the same time (e.g. as shown in Figure 12 ) or at different times. For ease of explanation, enabling and disabling is shown as a single step 1220.
  • the second rotary control element 812 is rotated by the user to manually index 520 (2) the motorized stage 834 from the end 503a of first scan line 500a to beginning 502b of second or next scan line 500b.
  • the second rotary controller 812 is de-activated, and the first rotary controller 811 is activated or enabled again. As discussed above, this may be done at the same time or different times.
  • the first rotary controller 811 is rotated by the user to control the scan along the next scan line 500b (3). If there are additional scan lines 500, steps of Figure 12 can be repeated as necessary to controllably scan additional scan lines until the entire cell spot 202 has been reviewed.
  • Figures 12 and 13 illustrate embodiments in which indexing 520 is performed to advance scanning in a forward manner, otherwise referred to as forward indexing.
  • a user may control the second rotary control element 812 for reverse indexing 1420 from a subsequent or "next" scan line 500 to a previous scan line 500. This may be performed by performing certain steps shown in Figure 12 in a reverse order.
  • the method 1200 shown in Figure 12 may be used to advance scanning along various positions 510 (1) to the end 503 of a scan line 500, index 520 (2) down to the beginning 502 of the next scan line 500, and then advance the scan along various positions 510 (3) as described above with reference to Figures 12 and 13 .
  • the user may want to review a previously viewed portion of a cell spot 202, e.g., to compare that portion to a current specimen portion.
  • the first rotary controller 811 is rotated in an opposite or reverse direction (4) to position the scan back at the beginning 503 of the scan line 500, the first rotary control element 811 can be disabled, and the second rotary control element 812 enabled, then the second rotated control element 812 may be rotated in the opposite or reverse direction to "reverse" index 1420 (5) up to the previous or higher scan line 500.
  • the second rotary control element 812 may then be disabled, and the first rotary control element 811 can be enabled and rotated in an opposite or reverse direction to backup to the desired scan position (6).
  • a method 1500 of scanning a specimen cell spot 202 permits a user to freely roam or review selected portions of a cell spot 202, while controlling when to return to the position 510 where scanning was paused or interrupted.
  • the first and/or second rotary control elements 811, 812 are manipulated by a user (e.g., as described above) to manually control movement of motorized stage 334 along a first or current scan line 500.
  • a user may activate a review control to pause scanning, and the current position 510 of the motorized stage 334 is stored to a memory at step 1515.
  • a system is configured such activating a review control is performed by pressing a "NEXT" button.
  • the user is free to move the motorized stage 334 and roam across the cell spot 202 without restriction and without being bound to the current position 510 or the current scan line 500.
  • Figure 16 illustrates initially scanning across a scan line 500 (1), and before reaching the end 503 of the scan line 500, at which time the user may activate a review control element, e.g., press a "NEXT" button. The user may then manipulate the first and second rotary control elements 811, 812 to freely roam across the cell spot 202, e.g., along selected paths (2-6) which, in this example, are not on the current scan line 500.
  • a review control element e.g., press a "NEXT” button.
  • the user may then manipulate the first and second rotary control elements 811, 812 to freely roam across the cell spot 202, e.g., along selected paths (2-6) which, in this example, are not on the current scan line 500.
  • the review control may be de-activated or disabled (e.g. by pressing the "NEXT" button again) to resume scanning.
  • the scan position 510 at the end of roaming is position 510 (6), which is not on the current scan line 500.
  • the stage 343 is automatically moved back to the previously stored position 510 to resume scanning from the same position 510 before the review control was activated.
  • the motorized stage 334 is manually controlled to complete the scan along scan line 500, index 520 to the next scan line 500, scan the next scan line 500, and so on, as described above. If necessary, roaming may be performed again as desired.
  • the embodiments shown in Figures 15 and 16 may also be used with one or more embodiments described with reference to Figures 9-14 .
  • Embodiments described above involve manual control of scanning along a scan line 500 and manual indexing 520 to another scan line 500.
  • another embodiment is directed to a method 1700 of scanning a cell spot 202 that involves manual scanning control (as described above with reference to Figures 6-16 ) and automatic indexing 520 (rather than manual indexing 520). More particularly, at step 1705, scanning of a cell spot 202 along a scan line 500 is manually controlled as described above, and at step 1710, a determination is made whether the scan of the first scan line 500 is completed and has reached the end 503 of the scan line 500.
  • step 1710 may be performed by a processor, sensor or other suitable components that monitor the position of the stage 334 to determine whether the end 503 of a scan line 500 has been reached. If not, then steps 1705 and 1710 are repeated until the scan is advanced to the end 503 of the first scan line 500.
  • step 1715 upon reaching the end 503 of a scan line 500, the motorized stage 334 is automatically indexed from the end of that scan line 500 to the beginning 502 of the next scan line 500 without user input.
  • the first rotary control element 811 may again be rotated to control the scan along the next or second scan line 500 following automatic indexing. Automatic indexing and manual scanning steps may be repeated as necessary until the entire cell spot 202 has been reviewed.
  • the embodiment shown in Figure 17 utilizes a combination of manual and automatic controls, and provides the user the ability to manually control scanning (e.g., as described with reference to Figures 6-16 above) without having to manually index the stage 334 to the next scan line.
  • the invention can be utilized in various types of review systems and devices that are utilized for scanning.
  • embodiments may be implemented in various types of imaging and review systems, one example of which an integrated imaging /review microscope system 1800 that is configured to perform specimen imaging and to allow a user to review OOIs identified as a result of specimen imaging.
  • an integrated imaging /review microscope system 1800 that is configured to perform specimen imaging and to allow a user to review OOIs identified as a result of specimen imaging.
  • the same microscope may be used for imaging and reviewing individual biological specimens, one slide 200 at a time using a computer 1810, monitor or display 1820 and associated control components 1830.
  • embodiments are described with reference to horizontal scanning of a specimen cell spot, embodiments may be used with vertical scanning or scanning at different angles.

Landscapes

  • Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Microscoopes, Condenser (AREA)
  • Sampling And Sample Adjustment (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)

Claims (2)

  1. System zum Scannen einer zytologischen Probe, umfassend:
    einen motorisierten Objekttisch, der eingerichtet ist, um einen zytologischen Probenträger zu halten;
    einen Prozessor, der funktionsfähig mit dem motorisierten Objekttisch verbunden ist; und
    ein Scansteuergerät, das funktionsfähig mit dem Prozessor verbunden ist,
    der motorisierte Objekttisch, der Prozessor, und das Scansteuergerät sind so eingerichtet, dass eine Handhabung des Scansteuergerätes bietet:
    manuelle Steuerung der Bewegung des motorisierten Objekttisches entlang einer ersten Scanlinie, um steuerbar einen ersten Abschnitt des zytologischen Probenträgers entlang der ersten Scanlinie zu scannen; und
    manuelle Steuerung der Bewegung des motorisierten Objekttisches entlang einer zweiten Scanlinie, um steuerbar einen zweiten Abschnitt des zytologischen Probenträgers entlang der zweiten Scanlinie zu scannen,
    das System ist weiter so eingerichtet, dass der motorisierte Objekttisch manuell oder automatisch von der ersten Scanlinie zu der zweiten Scanlinie indexiert werden kann,
    wobei das System weiter ein Überprüfungssteuergerät umfasst, das funktionsfähig mit dem Prozessor verbunden ist, das Überprüfungssteuergerät ist eingerichtet um (i) vorübergehend das Scannen der zytologischen Probe in einer gegenwärtigen Position des motorisierten Objekttisches bei Aktivierung auszusetzen, und einem Benutzer zu ermöglichen, die zytologischen Probe frei zu bewegen, wobei die gegenwärtige Position des motorisierten Objekttisches auf einem Speicher gespeichert wird, und (ii) den motorisierten Objekttisch zu der gespeicherten Position zurück zu fahren, um das Scannen entlang der Scanlinie bei Deaktivieren des Überprüfungssteuergeräts wiederaufzunehmen,
    wobei das Scansteuergerät ein koaxiales Steuergerät ist, umfassend ein erstes Drehsteuerelement, das drehbar ist, um manuell die Bewegung des motorisierten Objekttisches entlang der ersten und zweiten Scanlinie zu steuern, und ein zweites Drehsteuerelement koaxial zu dem ersten Drehsteuerelement, das zweite Drehsteuerelement ist drehbar, um manuell den motorisierten Objekttisch zu indexieren, der Prozessor ist eingerichtet, um das zweite Drehsteuerelement abzuschalten, während das erste Drehsteuerelement benutzt wird, um manuell die Bewegung des motorisierten Objekttisches zu steuern, und
    wobei der Prozessor eingerichtet ist, um zu erkennen, dass der motorisierte Objekttisch manuell an einem Ende der ersten Scanlinie positioniert worden ist und das zuvor abgeschaltete zweite Drehsteuerelement einzuschalten, das zweite Drehsteuerelement ist drehbar um den motorisierten Objekttisch von der ersten Scanlinie zu der zweiten Scanlinie zu indexieren.
  2. System nach Anspruch 1, wobei das Überprüfungssteuergerät mindestens einen Schalter enthält, der gedrückt werden kann, um den motorisierten Objekttisch manuell zu indexieren.
EP08867319A 2007-12-27 2008-12-15 System zum steuerbaren scannen einer zytologischen probe Active EP2232320B1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US1714007P 2007-12-27 2007-12-27
PCT/US2008/086861 WO2009085702A1 (en) 2007-12-27 2008-12-15 Methods and systems for controlably scanning a cytological specimen

Publications (2)

Publication Number Publication Date
EP2232320A1 EP2232320A1 (de) 2010-09-29
EP2232320B1 true EP2232320B1 (de) 2012-09-26

Family

ID=40599670

Family Applications (1)

Application Number Title Priority Date Filing Date
EP08867319A Active EP2232320B1 (de) 2007-12-27 2008-12-15 System zum steuerbaren scannen einer zytologischen probe

Country Status (10)

Country Link
US (1) US8174763B2 (de)
EP (1) EP2232320B1 (de)
JP (1) JP5529039B2 (de)
CN (1) CN101910907B (de)
AU (1) AU2008343378B2 (de)
CA (1) CA2709705C (de)
ES (1) ES2396607T3 (de)
HK (1) HK1143209A1 (de)
TW (1) TWI436061B (de)
WO (1) WO2009085702A1 (de)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010103389A1 (de) 2009-03-11 2010-09-16 Sensovation Ag Autofokusverfahren und autofokuseinrichtung
US20110193950A1 (en) * 2010-02-09 2011-08-11 Stephen Liye Chen Application of microscopic linear array scanner for measuring rate of change of live organisms
US10139613B2 (en) 2010-08-20 2018-11-27 Sakura Finetek U.S.A., Inc. Digital microscope and method of sensing an image of a tissue sample
CN102427502B (zh) * 2011-10-01 2014-05-07 麦克奥迪实业集团有限公司 一种显微切片的扫描方法及扫描装置
US9381524B2 (en) 2011-11-08 2016-07-05 Becton, Dickinson And Company System and method for automated sample preparation
WO2013190058A1 (de) * 2012-06-22 2013-12-27 Leica Microsystems Cms Gmbh Mikroskop
DE102013103971A1 (de) 2013-04-19 2014-11-06 Sensovation Ag Verfahren zum Erzeugen eines aus mehreren Teilbildern zusammengesetzten Gesamtbilds eines Objekts
US10007102B2 (en) 2013-12-23 2018-06-26 Sakura Finetek U.S.A., Inc. Microscope with slide clamping assembly
US11280803B2 (en) 2016-11-22 2022-03-22 Sakura Finetek U.S.A., Inc. Slide management system
CN107271442A (zh) * 2017-07-21 2017-10-20 黄宁 一种医学检验多功能测试装置
CN108067314A (zh) * 2017-12-21 2018-05-25 重庆骄直电气有限公司 实验室用操作台

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030179445A1 (en) * 1999-10-29 2003-09-25 Garrick Maenle Cytological imaging systems and methods

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4503555A (en) * 1982-04-21 1985-03-05 University Of California Semi-automatic optical scanning apparatus utilizing line integration
JPS6452113A (en) * 1987-08-24 1989-02-28 Shiseido Co Ltd Method and device for microscope image measurement
DE3824547C2 (de) 1988-07-20 2000-01-05 Zeiss Carl Fa Verfahren zur Steuerung eines auf Handbetrieb umschaltbaren motorischen Antriebs, Motorsteuerung mit Umschaltung auf Handbetrieb und deren Verwendung
ES2104767T3 (es) * 1992-04-30 1997-10-16 Becton Dickinson Co Procedimiento y dispositivo para controlar los desplazamientos coordinados de una plataforma.
DE4231379C2 (de) * 1992-09-19 2001-09-13 Leica Microsystems Mikroskop mit einem multifunktionalen Triebknopf
US5557456A (en) * 1994-03-04 1996-09-17 Oncometrics Imaging Corp. Personal interface device for positioning of a microscope stage
GB9801636D0 (en) 1998-01-27 1998-03-25 Reilly Peter J Microscope control
US6545264B1 (en) * 1998-10-30 2003-04-08 Affymetrix, Inc. Systems and methods for high performance scanning
JP2000321290A (ja) * 1999-05-10 2000-11-24 Jasco Corp 走査型顕微鏡のマッピング装置及び方法
AU2002228837B2 (en) * 2000-11-03 2007-06-28 Cytyc Corporation Cytological imaging systems and methods
EP1636625B1 (de) * 2003-05-20 2013-07-10 Lucid, Inc. Konfokales mikroskop zur abbildung gewählter stellen des körpers eines patienten
CA2524687C (en) * 2003-06-12 2013-03-12 Cytyc Corporation System for organizing multiple objects of interest in field of interest
US7083106B2 (en) * 2003-09-05 2006-08-01 Cytyc Corporation Locally storing biological specimen data to a slide
JP2005164815A (ja) * 2003-12-01 2005-06-23 Olympus Corp 光学装置
US20060133657A1 (en) * 2004-08-18 2006-06-22 Tripath Imaging, Inc. Microscopy system having automatic and interactive modes for forming a magnified mosaic image and associated method
JP4838004B2 (ja) * 2005-04-08 2011-12-14 オリンパス株式会社 顕微鏡、顕微鏡の制御方法、及びプログラム
DE102005040750A1 (de) 2005-08-26 2007-03-15 Olympus Soft Imaging Solutions Gmbh Optische Aufzeichnungs- oder Wiedergabeeinheit
JP2007114542A (ja) * 2005-10-21 2007-05-10 Olympus Corp 顕微鏡観察装置および顕微鏡観察方法
JP2007170862A (ja) * 2005-12-19 2007-07-05 Keyence Corp 走査型プローブ顕微鏡装置
US7433026B2 (en) * 2005-12-20 2008-10-07 Cytyc Corporation Microscope with LED illumination source

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030179445A1 (en) * 1999-10-29 2003-09-25 Garrick Maenle Cytological imaging systems and methods

Also Published As

Publication number Publication date
TWI436061B (zh) 2014-05-01
WO2009085702A1 (en) 2009-07-09
HK1143209A1 (en) 2010-12-24
CA2709705A1 (en) 2009-07-09
JP5529039B2 (ja) 2014-06-25
TW200935053A (en) 2009-08-16
US20090168160A1 (en) 2009-07-02
CN101910907A (zh) 2010-12-08
US8174763B2 (en) 2012-05-08
JP2011508238A (ja) 2011-03-10
AU2008343378A1 (en) 2009-07-09
CA2709705C (en) 2016-04-05
ES2396607T3 (es) 2013-02-22
EP2232320A1 (de) 2010-09-29
AU2008343378B2 (en) 2013-09-05
CN101910907B (zh) 2013-05-22

Similar Documents

Publication Publication Date Title
EP2232320B1 (de) System zum steuerbaren scannen einer zytologischen probe
CN107255863B (zh) 数字显微镜
EP1710610B1 (de) Mikroskop mit einer Steuereinrichtung zur Steuerung der Bewegungsgeschwindigkeit des Probentisches in Abhängigkeit von der Vergrösserung des ausgewählten Objektives
JP4156851B2 (ja) マイクロダイセクション装置
US7873193B2 (en) Serial section analysis for computer-controlled microscopic imaging
TWI398668B (zh) 單手控制顯微鏡功能之裝置
KR20210084602A (ko) 디지털 이미징 시스템 및 방법
WO2020215058A1 (en) Systems and methods for sample positioning to facilitate microscopy
JP2013190787A (ja) 描画データ生成装置、描画データ生成方法、及びプログラム
WO2007073521A2 (en) Microscope control device

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20100616

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1143209

Country of ref document: HK

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20110927

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RTI1 Title (correction)

Free format text: SYSTEM FOR CONTROLABLY SCANNING A CYTOLOGICAL SPECIMEN

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 577303

Country of ref document: AT

Kind code of ref document: T

Effective date: 20121015

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602008019067

Country of ref document: DE

Effective date: 20121122

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: KELLER AND PARTNER PATENTANWAELTE AG, CH

REG Reference to a national code

Ref country code: HK

Ref legal event code: GR

Ref document number: 1143209

Country of ref document: HK

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120926

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120926

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120926

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121226

REG Reference to a national code

Ref country code: NL

Ref legal event code: T3

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 577303

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120926

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2396607

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20130222

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

Effective date: 20120926

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120926

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120926

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120926

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120926

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120926

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130126

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120926

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120926

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130128

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120926

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20121225

Year of fee payment: 5

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120926

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121231

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121226

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120926

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20130627

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602008019067

Country of ref document: DE

Effective date: 20130627

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120926

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120926

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121215

REG Reference to a national code

Ref country code: NL

Ref legal event code: V1

Effective date: 20140701

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081215

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140701

REG Reference to a national code

Ref country code: CH

Ref legal event code: PCAR

Free format text: NEW ADDRESS: EIGERSTRASSE 2 POSTFACH, 3000 BERN 14 (CH)

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 9

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151215

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151215

PGRI Patent reinstated in contracting state [announced from national office to epo]

Ref country code: IT

Effective date: 20170710

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

REG Reference to a national code

Ref country code: CH

Ref legal event code: PFA

Owner name: CYTYC CORPORATION, US

Free format text: FORMER OWNER: CYTYC CORPORATION, US

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20230102

Year of fee payment: 15

Ref country code: CH

Payment date: 20230109

Year of fee payment: 15

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230526

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20231227

Year of fee payment: 16

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: TR

Payment date: 20231130

Year of fee payment: 16

Ref country code: SE

Payment date: 20231227

Year of fee payment: 16

Ref country code: IT

Payment date: 20231220

Year of fee payment: 16

Ref country code: IE

Payment date: 20231227

Year of fee payment: 16

Ref country code: FR

Payment date: 20231227

Year of fee payment: 16

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20240102

Year of fee payment: 16

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20231229

Year of fee payment: 16

Ref country code: CH

Payment date: 20240101

Year of fee payment: 16