Classifications

• • G—PHYSICS
  • G02—OPTICS
  • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
  • G02B21/00—Microscopes
  • G02B21/0004—Microscopes specially adapted for specific applications
  • G02B21/002—Scanning microscopes
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
  • H04N19/103—Selection of coding mode or of prediction mode
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
  • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
  • H04N19/156—Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
  • H04N19/162—User input
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
  • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
  • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
  • H04N19/587—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence

Definitions

• the invention relates to a method for data processing in a scanning microscope with a fast scanner.
• the invention further relates to a scanning microscope with a fast scanner.
• the invention relates to a scanning microscope with a fast scanner, which consists of a scanning module, a position sensor and at least one detector, with a computer system, with at least one peripheral device assigned to the computer system and with an input means.
• a method for setting the image acquisition of a microscope is disclosed.
• the image data is transferred from an image data acquisition element to a storage element.
• Control parameters are transferred to an encoder. Coding is carried out before the image data is transferred from the storage element to the computer.
• the encoded and transmitted image data are processed in the computer.
• the invention has the disadvantage that part of the image data and its information content is lost as a result of the coding. This data is irretrievably lost for evaluation.
• the invention has for its object to provide a method with which the data processing of all data recorded by a fast scanner is possible without delays occurring during processing.
• the objective object is achieved by a method which has the features of the characterizing part of patent claim 1.
• Another object of the invention is to provide a scanning microscope with which all recorded data are processed without any delays due to the computer system restricting the data processing of all data.
• the above object is achieved by a scanning microscope that has the features of the characterizing part of claim 12.
• the invention has the advantage that the method is used to record data blocks in real time with the fast scanner.
• the recorded data blocks are then transferred to a computer system.
• the data blocks are processed depending on a frame burst ratio.
• the recorded data blocks can also be transmitted to the computer system as a function of a frame burst ratio.
• the frame burst ratio is selected in such a way that optimal use is made of the performance of the computer system.
• the frame burst ratio is selected by the user depending on the processing characteristics of the computer system and remains constant during the recording of the data blocks.
• Another advantageous embodiment of the invention is that an adaptive control is provided that makes the frame burst ratio variable.
• the computer system then adjusts the frame burst ratio to the current working conditions in the computer system or to the parameter setting of the scanning microscope.
• the user can specify a start value for the frame burst ratio.
• the computer system can also select a start value and then adjust it accordingly.
• the frame burst ratio determines the frequency of the transmitted data blocks or the divider ratio.
• the frame burst ratio adapts the computer system to the current performance. All data blocks can initially be stored in the computer system and only those data blocks are processed which are determined by the variable “frame burst” ratio. It is also advantageous that only the data blocks are transferred to the computer system and from the computer system processed that correspond to the fixed frame burst ratio specified by the user. The data blocks that have not yet been transmitted are transmitted to the computer system with a delay and then processed there.
• Figure 1 is a schematic representation of a scanning microscope with a fast scanner.
• Fig. 2 is a schematic representation of the transfer of
• Fig. 3 is a block diagram of a first embodiment of the invention as shown schematically in Fig. 2;
• Fig. 4 is a schematic representation of the transfer of
• Data blocks can be adapted to the performance of the computer system
• Fig. 5 is a block diagram of a second embodiment of the
• Fig. 6 is a schematic representation of the transfer of
• Fig. 7 is a block diagram of a third embodiment of the invention as shown schematically in Fig. 6;
• Fig. 8 is a schematic representation of the transmission of the
• the frequency of the synchronously transmitted data blocks being adapted to the computer system and the data not transmitted on
• Fig. 9 is a block diagram of a fourth embodiment of the
• the exemplary embodiment of a confocal scanning microscope 100 is shown schematically in FIG. 1.
• the illuminating light beam 3 coming from at least one illumination system 1 is reflected by a beam splitter or a suitable deflection means 5 to a scan module 7.
• the scanning module 7 comprises a gimbal-mounted scanning mirror 9, which guides the illuminating light beam 3 through a scanning optics 12 and a microscope optics 13 over or through an object 15.
• the illuminating light beam 3 is guided over the object surface.
• a scanner is called a fast scanner, which records the data faster than it can be processed by a standard computer system.
• the illuminating light beam 3 can also be guided through the object 15.
• non-luminous preparations may be prepared with a suitable dye (not shown, since the state of the art is established). This means that different focal planes of the object are scanned in succession by the illuminating light beam 3.
• a position sensor 11, which determines the position data of the recorded image data, is connected to the scan module 7. The subsequent composition of position data and the image data results then a two- or three-dimensional frame (or image) of the object 15.
• the illuminating light beam 3 coming from the illumination system 1 is shown as a solid line.
• the light emanating from the object 15 defines a detection light beam 17. This passes through the microscope optics 13, the scanning optics 12 and via the scan module 7 to the deflecting means 5, passes it and passes through a detection pinhole 18 to at least one detector 19, which is designed here as a photomultiplier , It is clear to the person skilled in the art that other detection components such as diodes, diode arrays, CCD chips or CMOS image sensors can also be used.
• the detection light beam 17 originating or defined by the object 15 is shown in FIG. 1 as a dashed line. Electrical detection signals proportional to the power of the light emanating from the object are generated in the detector 19.
• the scan module 7, the position sensor 11 and the at least one detector 19 collectively represent a fast scanner 14.
• the fast scanner 14 is assigned a local memory 16 which receives the data from the at least one detector 19 and the position sensor 11. In a suitable manner, the data are forwarded from the local memory 16 and to a computer system 23. It is self-evident for a person skilled in the art that the position of the scanning mirror 9 can also be determined via the adjustment signals.
• At least one peripheral device 27 is assigned to the computer system 23.
• the peripheral device can be, for example, a display on which the user receives information about the setting of the microscope system or can take the current setup and also the image data in graphic form.
• At least one input means is assigned to the computer system 23, which consists, for example, of a keyboard 28, an adjustment device 29 for the components of the microscope system and a mouse 30.
• the processing of the data blocks takes place in at least one peripheral device 27. Processing can be understood to mean the output on a printer, the compression of the data, the representation on a display, the online evaluation or the storage in the storage units provided for this purpose. 2 shows an embodiment of a method, the so-called. "Frame burst ratio", in which only a certain number of data blocks are transmitted. The representation of a frame at once (“frame burst”) and not "block-wise" has been known for some time.
• the local memory 16 is assigned to the fast scanner, which, as already mentioned, consists of the scan module 7, the position sensor 11 and the at least one detector 19.
• the fast scanner transfers the data in real time to its own local memory 16 and at the same time to the computer system 23.
• all data blocks 35 ! , 35 2 , ..., 35 n (frames) saved.
• the frequency of the data blocks that are processed in the computer system 23 is constant.
• These data blocks (frames) are shown hatched in FIG. 2.
• the user has the option of specifying an arbitrary frame burst ratio N (or frequency) so that this can take into account the individual display characteristics of his computer system 23.
• the user enters the frame burst ratio N, for example using the keyboard 28, the mouse 30 or the setting device 28.
• FIG. 3 shows a block diagram that visualizes the first embodiment of the method according to the invention.
• a first step 40 the data blocks 35T, 35 2 ,..., 35 n (frames) captured by the fast scanner are transferred to an internal memory of the computer system 23.
• the computer system 23 fetches from the memory in the computer system 23 in accordance with the frame burst ratio N, such as every tenth data block.
• a first decision module 45 checks whether this was the last data block. If the result in decision module 45 is "NO”, then the method runs in a second Decision module 46. Here it is checked whether the current data block is a multiple of N. If "YES”, then the processing or display 48 of the data block takes place.
• the process jumps back to the second step 44 and a corresponding data block is fetched from the memory of the computer system. If the result in the first decision module 45 was “YES”, the remaining data blocks are retrieved from the memory of the computer system and processed and / or displayed for the remaining data blocks 49.
• the user can determine the frame burst ratio N on his own via an input module 47 This then acts on the second decision module 46. Depending on the load on the computer system 23, the user can decide whether he changes the frame burst ratio N or not.
• FIG. 4 shows a further embodiment of a method in which only a certain number of data blocks are also processed.
• the local scanner 16 is assigned to the fast scanner 14.
• the fast scanner transmits the data in real time to its own local memory 16 and at the same time to the computer system 23 via a transmission link 21 provided for this purpose. All data blocks 35 ⁇ 35 2 35 n (frames) are stored in the computer system 23.
• the processing characteristics of the confocal scanning microscope 100 are determined by various boundary conditions and are not deterministic. These can change over time and lead to a slowdown or acceleration of processing with an increasing number of frames. Therefore an adaptive readjustment of the frame burst ratio is essential for an optimal display or processing of the scan data.
• the processing on the side of the computer system 23 is continuously checked during the acquisition. Any deceleration / acceleration that arises is counteracted by increasing / decreasing the frame burst ratio. Similar to the method shown in FIG. 3, in a first step 40 the data blocks 35- ⁇ , 35 2 , ..., 35 n (frames) captured by the fast scanner are transferred to an internal memory of the computer system 23.
• a second step 44 the computer system 23 retrieves the frames or data blocks from the memory in the computer system 23 according to an initial frame burst ratio N, such as every tenth data block.
• a first decision module 45 checks whether this is the last data block was. If the result in the decision module 45 is “NO”, then the method runs into a second decision module 46. Here it is checked whether the current data block is a multiple of N. If “YES”, the data block 48 is processed. If the result in the second decision module 46 was “NO”, the process jumps back to the second step 44 and a corresponding data block is fetched from the memory of the computer system.
• FIG. 6 shows a schematic illustration of a method for a partially synchronous transmission, evaluation and display of the acquired ones Data from a scanner. The difference from the illustration in FIG. 2 is that only the frames selected by the user are sent to the computer system 23 the predetermined frame burst ratio N are transmitted and processed synchronously.
• the fast scanner transmits the data in real time to its own local memory 16 and at the same time only the frames or data blocks which correspond to the fixed frame burst ratio specified by the user are transmitted to the computer system 23.
• the frequency of the data blocks that are processed in the computer system 23 is constant.
• the data blocks (frames) processed in the computer system 23 are shown hatched in FIG. 6.
• the user has the option of specifying any frame burst ratio (or frequency) so that it is individual
• FIG. 6 A block diagram of the third embodiment of the invention, as shown schematically in FIG. 6, is shown in FIG. 7.
• FIG. 7 A block diagram of the third embodiment of the invention, as shown schematically in FIG. 6, is shown in FIG. 7.
• a first step 40 the data blocks determined by the user according to the frame burst ratio N 35 N ( N- i), 35 2 N- (N- I ), 35 NN . (N-1) (frames) are transferred to the internal memory of the computer system 23 and processed immediately in the computer system 23.
• a first decision module 45 checks whether this is the last data block according to the constant frame burst ratio was. If the result in the decision module 45 is “NO”, then the method runs into a second decision module 46. Here it is checked whether the current data block is a multiple of N. If “YES”, the transmission 52 to the computer system 23 and in the computer system 23 the processing 54 of the data block.
• the process jumps back to the second step 44 and a corresponding data block is transferred from the memory to the computer system 23. If the result was "YES" in the first decision module 45, the rest are not sent to the Data blocks transmitted to the computer system, sent directly from the fast scanner to the computer system 23. A delayed processing 56 of the data blocks which do not otherwise correspond to the frame burst ratio N then takes place in the computer system 23.
• FIG. 8 shows a schematic illustration of a method which is very similar to the method from FIG. 6.
• the method shown in FIG. 8 differs in that there is no fixed frame burst ratio N here, but a frame burst ratio that adapts to the current performance features of the computer system 23.
• a frame burst ratio N can be specified by the user.
• the fast scanner transmits the data in real time to its own local memory 16 and at the same time only those frames or data blocks are transmitted to the computer system 23 which initially correspond to the fixed frame burst ratio N specified by the user.
• the transmitted data blocks 35N- (ND, 35 2 N- (NI). •••, 35 NN . (N -i) (frames) are processed immediately in the computer system 23.
• An adaptive control is provided, which determines the frame burst ratio N. This means that the frequency of the processed data blocks or the division ratio changes and is adapted to the current performance of the computer system 23.
• a feedback 24 is provided between the fast scanner and the computer system 23, indicating a possible delay or acceleration checked by the computer system 23 relative to the fast scanner and optionally readjusts.
• FIG. 9 shows a block diagram that visualizes the fourth embodiment of the method according to the invention.
• a first step 40 the data blocks 35 N determined by the user according to the initially frame burst ratio N become N.
• N-1 35 2 N- (ND. •••. 35 NN- (N-1 ) (frames) are transferred to the internal memory of the computer system 23 and processed immediately in the computer system 23.
• a first decision module 45 checks whether this was the last data block according to the adaptable frame burst ratio N. If the result in the decision module 45 is "NO”, then the method runs into a second decision module 46. Here it is checked whether the current data block is a multiple of N. If "YES”, then the transfer 52 takes place to the computer system 23 and then the storage and processing 54 of the data block in the computer system 23.
• a feedback module 60 is connected to the computer system 23, in which the storage and processing 54 of the data block takes place.
• the process jumps back to the second step 44 and a corresponding data block is transferred from the memory to the computer system 23. If the result was "YES" in the first decision module 45, the rest are not sent to the Data blocks transmitted to the computer system are sent to the computer system 23. An asynchronous processing 56 of the remaining data blocks, which do not correspond to the frame burst ratio N, then takes place in the computer system 23.
• the frame burst ratio N can thus be adapted to the current performance of the computer system 23. Too slow data acceptance by the computer system 23, caused by the low transmission bandwidth, lack of memory or excessive system utilization by other processes, can thus be avoided.
• the frame burst ratio N is adapted to the conditions of the computer system 23.
• the computer system 23 itself can set a start value for the frame burst ratio N pretend. This is selected automatically as a function of the set scanning speed and any processing routines in the computer system 23 during the data acquisition cycle by means of a suitable algorithm.
• the computer system 23 constantly checks the difference between the data blocks acquired by the scanner and the number of data blocks actually processed by the computer system 23. The difference between the acquired and the processed data blocks is determined and a corresponding, associated action is initiated. In the optimal case, the difference is 0 when the computer system is fully utilized. This state should be maintained as far as possible by adaptive control.
• the computer system 23 is unable to meet the required frame burst ratio N.
• the frame burst ratio N is increased. If the difference is not zero and the computer system 23 is not fully utilized, the computer system 23 is able to meet the required frame burst ratio N by the required amount. The frame burst ratio N is reduced in this case.
• All determined values for the frame burst ratio N of the data acquisition cycle are combined into an empirical value in the computer system using a suitable algorithm (e.g. in the simplest case by averaging). This empirical value is stored in the computer system in order to provide an optimal starting value for later comparable data acquisition cycles.
• the following example scenario for a data acquisition cycle is intended to illustrate the adaptive control of the frame burst ratio N.
• the frame burst ratio N is preset to 10.
• the difference increases to 50 and the frame burst ratio N is increased to 20.
• the difference falls to 0 and when the computer system 23 is fully utilized, the frame burst ratio N remains set to the value 20.
• the user changes the scan parameters during data acquisition. Difference increases to 100.
• the frame burst ratio N is increased to 30.
• the scan parameters have changed and the difference falls below zero when the computer system 23 is not fully utilized. consequently the frame burst ratio N is reduced to 20.
• the computer system 23 is disturbed by an external process.
• the difference thus rises again to 50.
• the frame burst ratio N is increased to 25. This change in frame burst ratio N continues throughout an entire data acquisition cycle.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Physics & Mathematics (AREA)
• Chemical & Material Sciences (AREA)
• Analytical Chemistry (AREA)
• General Physics & Mathematics (AREA)
• Optics & Photonics (AREA)
• Computing Systems (AREA)
• Theoretical Computer Science (AREA)
• Microscoopes, Condenser (AREA)
• Facsimile Scanning Arrangements (AREA)

Applications Claiming Priority (3)

Publications (1)

Family

ID=27588313

Family Applications (1)

Country Status (5)

Families Citing this family (3)

Family Cites Families (5)

• 2002
  • 2002-02-02 DE DE10204369A patent/DE10204369A1/de not_active Withdrawn
• 2003
  • 2003-01-25 EP EP03701544A patent/EP1470720A1/de not_active Ceased
  • 2003-01-25 JP JP2003567101A patent/JP2005517364A/ja active Pending
  • 2003-01-25 US US10/501,686 patent/US7802027B2/en not_active Expired - Fee Related
  • 2003-01-25 WO PCT/EP2003/000768 patent/WO2003067891A1/de not_active Ceased

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events