US11529112B2 - X-ray imaging data processing device and method - Google Patents

X-ray imaging data processing device and method Download PDF

Info

Publication number
US11529112B2
US11529112B2 US16/322,509 US201816322509A US11529112B2 US 11529112 B2 US11529112 B2 US 11529112B2 US 201816322509 A US201816322509 A US 201816322509A US 11529112 B2 US11529112 B2 US 11529112B2
Authority
US
United States
Prior art keywords
energy bin
phase shift
ray
proportionality factor
energy
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US16/322,509
Other versions
US20210321970A1 (en
Inventor
Mattias Bartels
Thomas Koehler
Ewald Roessl
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Assigned to KONINKLIJKE PHILIPS N.V. reassignment KONINKLIJKE PHILIPS N.V. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BARTELS, MATTHIAS, KOEHLER, THOMAS, ROESSL, EWALD
Publication of US20210321970A1 publication Critical patent/US20210321970A1/en
Application granted granted Critical
Publication of US11529112B2 publication Critical patent/US11529112B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/52Devices using data or image processing specially adapted for radiation diagnosis
    • A61B6/5258Devices using data or image processing specially adapted for radiation diagnosis involving detection or reduction of artifacts or noise
    • A61B6/5264Devices using data or image processing specially adapted for radiation diagnosis involving detection or reduction of artifacts or noise due to motion
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/48Diagnostic techniques
    • A61B6/482Diagnostic techniques involving multiple energy imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/48Diagnostic techniques
    • A61B6/484Diagnostic techniques involving phase contrast X-ray imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/58Testing, adjusting or calibrating thereof
    • A61B6/582Calibration
    • A61B6/583Calibration using calibration phantoms

Definitions

  • the invention is related to processing x-ray imaging data, in particular phase contrast x-ray imaging data.
  • Grating-based differential phase contrast imaging has gained increased momentum in recent years. Such technique is capable of delivering additional information, which is complementary to the conventional attenuation image, namely refraction and dark-field signals.
  • full field digital mammography FFDM
  • the first clinical FFDM unit was successfully equipped with x-ray grating hardware based on the Philips MicroDose L30 (see, T. Koehler et al., Slit-scanning differential x-ray phase-contrast mammography: Proof-of-concept experimental studies, Medical Physics 42, 1959 (2015)).
  • First results demonstrate that the slit-scanning systems meet relevant requirements with respect to FOV, scan time, and dose.
  • Differential phase contrast imaging is susceptible to mechanical instabilities and vibrations.
  • the recorded data is typically processed by taking into account a reference scan without object (“blank scan”, see the article by T. Koehler et al, cited above). Consequently, the resulting image quality is limited by the repeatability of the Moiré pattern obtained during repeated scans.
  • deviations induced, for example, by vibration between blank scan and object scan are erroneously attributed to the object and result in image artifacts.
  • a processing device for energy-binned differential phase contrast x-ray imaging data comprising a proportionality factor providing unit arranged to provide a proportionality factor between an object induced phase shift for a first x-ray energy bin and an object induced phase shift for a second x-ray energy bin, and a dark field and phase shift determining unit arranged to determine at least one of a dark field signal and an object induced phase shift from a detected intensity value, included in the imaging data, of a pixel for the first energy bin and a detected intensity value of the pixel for the second energy bin, using the proportionality factor provided by the proportionality factor providing unit.
  • dark field and phase shift determination unit may also mean a single unit that is arranged to both determine a dark field signal and an object induced phase shift or a determination unit that is arranged to determine a dark field signal and an object induced phase shift individually in separate sub-units.
  • a proportionality factor determination device for determining a proportionality factor between an object induced phase shift for a first x-ray energy bin and an object induced phase shift for a second x-ray energy bin in the context of energy-binned differential phase contrast x-ray imaging comprising a calculation unit arranged to calculate a first phase shift for the first energy bin from a phase image obtained by differential phase contrast x-ray imaging, using the first energy bin, a phantom having a predetermined shape and to calculate a second phase shift for the second energy bin from a phase image obtained by differential phase contrast x-ray imaging, using the second energy bin, the phantom, and an obtaining unit arranged to obtain the proportionality factor from the first phase shift and the second phase shift.
  • a processing method for energy-binned differential phase contrast x-ray imaging data comprising a proportionality factor providing step of providing a proportionality factor between an object induced phase shift for a first x-ray energy bin and an object induced phase shift for a second x-ray energy bin, and a determining step of determining at least one of a dark field signal and an object induced phase shift from a detected intensity value, included in the imaging data, of a pixel for the first energy bin and a detected intensity value of the pixel for the second energy bin, using the proportionality factor provided by the proportionality factor providing step.
  • a proportionality factor determination method for determining a proportionality factor between an object induced phase shift for a first x-ray energy bin and an object induced phase shift for a second x-ray energy bin in the context of energy-binned differential phase contrast x-ray imaging is presented, comprising a calculation step of calculating a first phase shift for the first energy bin from a phase image obtained by differential phase contrast x-ray imaging, using the first energy bin, a phantom having a predetermined shape and calculating a second phase shift for the second energy bin from a phase image obtained by differential phase contrast x-ray imaging, using the second energy bin, the phantom, and an obtaining step of obtaining the proportionality factor from the first phase shift and the second phase shift.
  • the invention addresses the problems associated, for example, with vibrations in grating-based differential phase contrast imaging by making use of spectral information. It was realized by the inventors, that one may make use of the spectral information in determining the vibration state of the Moiré pattern based on multi-energy-bin x-ray detectors, the energy independence of vibration-induced Moiré pattern phase shifts, the energy dependence of object-induced Moiré pattern phase shifts and a phantom designed to allow for measuring the dependence of the object-induced phase shift as a function of the energy bin.
  • the invention is not limited to the case of just two energy bins, as more than two energy bins are also contemplated.
  • three or even more energy bins may be used for determining the phase shift due to vibration, while the use of further energy bins gives the benefit of allowing for separate (somewhat independent) determinations, e.g. by considering the first and the second energy bin, considering the first and a (further) third energy bin and considering the second and the third energy bin, respectively, as discussed herein explicitly for just two energy bins.
  • two energy bins may be used for identifying the phase shift due to the vibration, which is then used for compensation in a simultaneous differential phase contrast imaging using the third energy bin.
  • the proportionality factor providing unit is arranged to provide the proportionality factor depending on an attenuation value for the first energy bin and an attenuation value for the second energy bin.
  • the proportionality factor providing unit includes a look-up table.
  • a look-up table allows a quick access to the proportionality factor by using the attenuation values as parameters for the looking up. Nevertheless, also other ways of providing the factor are possible, e.g. providing an equation for calculating or a combination of calculation and look-up table.
  • the dark field signal and phase shift determining unit is arranged to determine, from measured data m i,1 of the first energy bin and measured data m i,2 of the second energy bin, an attenuation value A 1 for the first energy bin, an attenuation value A 2 for the second energy bin, a dark field signal D 1 for the first energy bin, a dark field signal D 2 for the second energy bin, an object induced phase shift ⁇ 1 and a disturbance induced phase shift ⁇ i in such way that a likelihood obtaining the measured data is maximized for the selected image values.
  • B i,1 , B i,2 , V i,1 , V i,2 , ⁇ i,1 , and ⁇ i,2 being the intensity, the visibility and the phase of a Moiré pattern obtained during a blank scan, respectively.
  • the dark field signal and phase shift determining unit is arranged to include, in the determination (e.g. in the least square minimization), a further limitation as to favor small differences between disturbance induced phase shifts of neighboring pixels.
  • this might correspond to a limitation as to the absolute difference between disturbance induced phase shifts of neighboring pixels being less than a predetermined value.
  • vibrations may change the relative position of the gratings with respect to each other, wherein furthermore the interferometer may be quite sensitive to such changes (it was found that even changes in a ⁇ m range may create a visible effect).
  • a differential phase contrast x-ray imaging system comprises a differential phase contrast imaging unit, an x-ray source arranged to provide x-rays of a first and a second energy bin, the processing device according to the present invention arranged to receive energy-binned differential phase contrast x-ray imaging data from the differential phase contrast imaging.
  • the imaging system further comprises the proportionality factor determination system according to the above embodiment, wherein the proportionality factor determination system is arranged to provide information on the proportionality factor to the proportionality factor providing unit of the processing device.
  • the proportionality factor may be constant (or at least sufficiently approximated by a constant value (or set of values)), so that no specific arrangement would be needed for determining the value (other than means for storing a predetermined value or set of value), while in other cases, the proportionality factor determination system, arranged for specifically determining the information on the proportionality factor, is advantageous, for instance in a case when the energy bin size is so large that the effective energy measured by these bins is significantly changed due to beam-hardening by the object. However, for narrow energy bins, it may be sufficient to use simply equation (5) (see below) to calculate the proportionality factor.
  • a software product for processing method for energy-binned differential phase contrast x-ray imaging data comprising program code means for causing a computer to carry out the steps of a method according to the invention when the software product is run on the computer and a software product for determining a proportionality factor between an object induced phase shift for a first x-ray energy bin and an object induced phase shift for a second x-ray energy bin in the context of energy-binned differential phase contrast x-ray imaging, the software product comprising program code means for causing a computer to carry out the steps of a method according to the invention when the software product is run on the computer are presented
  • FIG. 1 shows a differential phase contrast x-ray imaging system in accordance with an embodiment of the invention
  • FIG. 2 shows a flow diagram illustrating a processing method for energy-binned differential phase contrast x-ray imaging data in accordance with an embodiment of the invention.
  • FIG. 1 shows a differential phase contrast x-ray imaging system in accordance with an embodiment of the invention.
  • the system 10 includes an x-ray source 15 arranged to provide x-rays of a first and a second energy bin, e.g. including photons of a first energy range and photons of a second energy range and a corresponding differential phase contrast imaging unit 20 .
  • a phantom 25 is provided between the x-ray source 15 and the imaging unit 20 , while, in operation of the system 10 for imaging an object, the object (not shown) rather than the phantom 25 is provided between the x-ray source 15 and the imaging unit 20 .
  • the phantom 25 consists of several pillars 25 a of different height. On top of these pillars 25 a are triangles with constant slope of projected material height in beam direction. It is noted that a constant gradient of projected electron density (realized by material height in beam direction) produces a constant phase shift of the Moiré pattern.
  • the imaging unit 20 is coupled to a proportionality factor determination device 30 and a processing device 35 .
  • the proportionality factor determination device 30 includes a calculation unit 40 and an obtaining unit 45 , the operation of which is discussed below.
  • the processing unit 35 includes a proportionality factor providing unit 50 and a dark field signal and phase shift determining unit 55 , the operation of which becomes also clear from the discussion below.
  • the proportionality factor providing unit 50 is coupled to the proportionality factor determination device 30 to receive data or information on the proportionality factor therefrom.
  • FIG. 2 shows a flow diagram illustrating a processing method for energy-binned differential phase contrast x-ray imaging data in accordance with an embodiment of the invention.
  • the method of this embodiment includes a calculation step 60 , in which a first phase shift for the first energy bin is calculated from a phase image, which is obtained by differential phase contrast x-ray imaging a phantom as shown in FIG. 1 , wherein the phase image uses or corresponds to the first energy bin.
  • the calculation step 60 also includes calculating a second phase shift for the second energy bin from a phase image obtained by differential phase contrast x-ray imaging the phantom, here using the second energy bin.
  • a following obtaining step 65 includes obtaining the proportionality factor from the first phase shift and the second phase shift, while additionally the influence as to the attenuation is taken into consideration, based on the phantom.
  • the obtained proportionality factor is provided, in a proportionality factor providing step 70 , and indicates the proportionality between an object induced phase shift for a first x-ray energy bin and an object induced phase shift for a second x-ray energy bin.
  • a determining step 75 is provided of determining at least one of a dark field signal and an object induced phase shift from a detected intensity value, included in the imaging data, of a pixel for the first energy bin and a detected intensity value of the pixel for the second energy bin, using the proportionality factor provided by the proportionality factor providing step 70 .
  • B i , V i and ⁇ i denote the intensity, the visibility, and the phase of the Moiré pattern obtained during a blank scan, respectively.
  • the object parameters A, D and ⁇ correspond to attenuation, dark field signal, and phase shift, respectively.
  • ⁇ ⁇ ( E 2 ) ⁇ ⁇ ( E 1 ) ⁇ E 1 2 E 2 2 . ( 5 )
  • equation (2) separately for both energy bins yields phase images for both bins.
  • c phase images for both bins.
  • the pillars produce different degrees of beam hardening which is encoded in the attenuation signal for both bins A 1 , A 2 which can be extracted from the attenuation images.
  • the proportionality factor c is equaled, similar to the case of mono energetic x-ray photons, also for polychromatic x-rays as corresponding to the quotient of the mean energies of the energy bins, while correspondingly also such look-up table for c(A 1 , A 2 ) may be obtained.
  • I i,1 A 1 B i,1 (1+ D 1 V i,1 cos( ⁇ i,1 + ⁇ i + ⁇ 1 )).
  • I i,2 A 2 B i,2 (1+ D 2 V i,2 cos( ⁇ i,2 + ⁇ i +c ( A 1 ,A 2 ) ⁇ 1 )).
  • the above provides already sufficient information to separate between object induced phase shift and vibration induced phase shift on a per-pixel basis.
  • the estimate can be made even more robust by adding some further prior knowledge, namely that the vibration induced phase should be the same (or almost the same) for neighboring pixels if the data are acquired simultaneously with neighboring detector pixels.
  • is a regularization parameter that controls how much variation of the vibration-induced phase is allowed.
  • the vibration phase of the neighboring pixel is taken into consideration.
  • Bold symbols are used for referral to vectors. The last term favors small differences between disturbance induced phase shifts of neighboring pixels, which is in-line with the a-priori knowledge that these differences have the common cause of vibrating gratings.
  • the vibrational state of the Moiré pattern can be determined by exploiting the energy independence of vibration-induced Moiré pattern phase shifts and the energy dependence of object-induced shifts.
  • the inventors propose a phantom to measure the energy dependence of the object-induced phase shift. By suitable data processing the vibration-induced shifts can be disentangled from the object properties to minimize image artifacts.
  • a single processor, device or other unit may fulfill the functions of several items recited in the claims.
  • the mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
  • Operations like providing, determining, calculating, obtaining, and processing can be implemented as program code means of a computer program and/or as dedicated hardware.
  • a computer program may be stored and/or distributed on a suitable medium, such as an optical storage medium or a solid-state medium, supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
  • a suitable medium such as an optical storage medium or a solid-state medium, supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Optics & Photonics (AREA)
  • Pathology (AREA)
  • Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Analysing Materials By The Use Of Radiation (AREA)
  • Image Processing (AREA)

Abstract

Data in X-ray images of a medical device is processed in order to reduce vibration artifacts in differential phase contrast imaging. A proportionality factor between an object induced phase shift for a first x-ray energy bin and an object induced phase shift for a second x-ray energy bin is provided. At least one of a dark field signal and an object induced phase shift is determined from a detected intensity value of a pixel for the first energy bin and a detected intensity value of the pixel for the second energy bin using the proportionality factor.

Description

FIELD OF THE INVENTION
The invention is related to processing x-ray imaging data, in particular phase contrast x-ray imaging data.
BACKGROUND OF THE INVENTION
Grating-based differential phase contrast imaging has gained increased momentum in recent years. Such technique is capable of delivering additional information, which is complementary to the conventional attenuation image, namely refraction and dark-field signals. Among others, full field digital mammography (FFDM) is a promising application of this technology. Recently, the first clinical FFDM unit was successfully equipped with x-ray grating hardware based on the Philips MicroDose L30 (see, T. Koehler et al., Slit-scanning differential x-ray phase-contrast mammography: Proof-of-concept experimental studies, Medical Physics 42, 1959 (2015)). First results demonstrate that the slit-scanning systems meet relevant requirements with respect to FOV, scan time, and dose.
Differential phase contrast imaging, however, is susceptible to mechanical instabilities and vibrations. In order to extract the object parameters (attenuation, refraction and dark-field signal) the recorded data is typically processed by taking into account a reference scan without object (“blank scan”, see the article by T. Koehler et al, cited above). Consequently, the resulting image quality is limited by the repeatability of the Moiré pattern obtained during repeated scans. Conventionally, deviations induced, for example, by vibration between blank scan and object scan are erroneously attributed to the object and result in image artifacts.
There are attempts, as discussed for example, in DE 102014213817 A1, which aim at reducing the occurrence of vibrations and the like by means of structural modifications to the imaging arrangement. However, such structural modifications result in more complicated machinery, i.e. higher costs, while even sophisticated attempts may not completely eliminate undesired influences.
SUMMARY OF THE INVENTION
It is an object of the present invention to provide an approach for addressing the aforementioned problems associated with vibrations and the like in, in particular, grating-based differential phase contrast imaging.
In a first aspect of the present invention a processing device for energy-binned differential phase contrast x-ray imaging data is presented comprising a proportionality factor providing unit arranged to provide a proportionality factor between an object induced phase shift for a first x-ray energy bin and an object induced phase shift for a second x-ray energy bin, and a dark field and phase shift determining unit arranged to determine at least one of a dark field signal and an object induced phase shift from a detected intensity value, included in the imaging data, of a pixel for the first energy bin and a detected intensity value of the pixel for the second energy bin, using the proportionality factor provided by the proportionality factor providing unit. In the context of the claimed invention the term ‘dark field and phase shift determination unit’ may also mean a single unit that is arranged to both determine a dark field signal and an object induced phase shift or a determination unit that is arranged to determine a dark field signal and an object induced phase shift individually in separate sub-units.
In a second aspect of the present invention a proportionality factor determination device for determining a proportionality factor between an object induced phase shift for a first x-ray energy bin and an object induced phase shift for a second x-ray energy bin in the context of energy-binned differential phase contrast x-ray imaging is presented comprising a calculation unit arranged to calculate a first phase shift for the first energy bin from a phase image obtained by differential phase contrast x-ray imaging, using the first energy bin, a phantom having a predetermined shape and to calculate a second phase shift for the second energy bin from a phase image obtained by differential phase contrast x-ray imaging, using the second energy bin, the phantom, and an obtaining unit arranged to obtain the proportionality factor from the first phase shift and the second phase shift.
In a third aspect of the present invention a processing method for energy-binned differential phase contrast x-ray imaging data is presented comprising a proportionality factor providing step of providing a proportionality factor between an object induced phase shift for a first x-ray energy bin and an object induced phase shift for a second x-ray energy bin, and a determining step of determining at least one of a dark field signal and an object induced phase shift from a detected intensity value, included in the imaging data, of a pixel for the first energy bin and a detected intensity value of the pixel for the second energy bin, using the proportionality factor provided by the proportionality factor providing step.
In a fourth aspect of the present invention a proportionality factor determination method for determining a proportionality factor between an object induced phase shift for a first x-ray energy bin and an object induced phase shift for a second x-ray energy bin in the context of energy-binned differential phase contrast x-ray imaging is presented, comprising a calculation step of calculating a first phase shift for the first energy bin from a phase image obtained by differential phase contrast x-ray imaging, using the first energy bin, a phantom having a predetermined shape and calculating a second phase shift for the second energy bin from a phase image obtained by differential phase contrast x-ray imaging, using the second energy bin, the phantom, and an obtaining step of obtaining the proportionality factor from the first phase shift and the second phase shift.
The invention addresses the problems associated, for example, with vibrations in grating-based differential phase contrast imaging by making use of spectral information. It was realized by the inventors, that one may make use of the spectral information in determining the vibration state of the Moiré pattern based on multi-energy-bin x-ray detectors, the energy independence of vibration-induced Moiré pattern phase shifts, the energy dependence of object-induced Moiré pattern phase shifts and a phantom designed to allow for measuring the dependence of the object-induced phase shift as a function of the energy bin.
In particular, it was found that by suitable data processing the vibration-induced shifts and the like can be disentangled from the object properties and hence vibration artifacts in the image are reduced, while there is no particular need for changing the basic physical structure of the imaging device.
It is noted here that the invention is not limited to the case of just two energy bins, as more than two energy bins are also contemplated. When considering the respective detected intensity values, three or even more energy bins may be used for determining the phase shift due to vibration, while the use of further energy bins gives the benefit of allowing for separate (somewhat independent) determinations, e.g. by considering the first and the second energy bin, considering the first and a (further) third energy bin and considering the second and the third energy bin, respectively, as discussed herein explicitly for just two energy bins. Also, two energy bins may be used for identifying the phase shift due to the vibration, which is then used for compensation in a simultaneous differential phase contrast imaging using the third energy bin.
In a preferred embodiment, the proportionality factor providing unit is arranged to provide the proportionality factor depending on an attenuation value for the first energy bin and an attenuation value for the second energy bin.
In providing the proportionality factor in dependence from the attenuation values of the first and second energy bin, respectively, an increase accuracy is achievable, while depending on the circumstances it may be possible to provide just an approximation of the factor, which is not changing for different attenuations (e.g. in case there is only little influence).
In a preferred modification of the above embodiment, the proportionality factor providing unit includes a look-up table.
A look-up table allows a quick access to the proportionality factor by using the attenuation values as parameters for the looking up. Nevertheless, also other ways of providing the factor are possible, e.g. providing an equation for calculating or a combination of calculation and look-up table.
In a preferred embodiment, the dark field signal and phase shift determining unit is arranged to determine, from measured data mi,1 of the first energy bin and measured data mi,2 of the second energy bin, an attenuation value A1 for the first energy bin, an attenuation value A2 for the second energy bin, a dark field signal D1 for the first energy bin, a dark field signal D2 for the second energy bin, an object induced phase shift ϕ1 and a disturbance induced phase shift ψi in such way that a likelihood obtaining the measured data is maximized for the selected image values.
This includes, for example, that a cost function that penalizes differences between measured data and expected data is minimized.
In a preferred modification of the above embodiment, the dark field signal and phase shift determining unit is arranged to employ a least square minimization according to
Δ(A 1 ,A 2 ,D 1 ,D 21i)=Σ(m i,1 A 1 B i,1(1+D 1 V i,1 cos(αi,1i1)))2+
Σ(m i,2 −A 2 B i,2(1+D 2 V i,2 cos(αi,2i +c·ϕ 1)))2,
with Bi,1, Bi,2, Vi,1, Vi,2, αi,1, and αi,2 being the intensity, the visibility and the phase of a Moiré pattern obtained during a blank scan, respectively.
Using an approach like least square minimization, however, is just one option. As in the given situation, one deals with photon counting, minimizing a negative Poisson log-likelihood, if the blank scan intensities vary, one might also want to use a weighted least squares cost function.
In a further preferred embodiment, which may specifically considered also as a preferred modification of the above embodiment, the dark field signal and phase shift determining unit is arranged to include, in the determination (e.g. in the least square minimization), a further limitation as to favor small differences between disturbance induced phase shifts of neighboring pixels. In particular, specifically in the context of the least square minimization, this might correspond to a limitation as to the absolute difference between disturbance induced phase shifts of neighboring pixels being less than a predetermined value.
It may be considered as a priori knowledge that neighboring pixels would suffer from similar disturbance or vibration, so that such information may be included in the determination. It may be noted that vibrations may change the relative position of the gratings with respect to each other, wherein furthermore the interferometer may be quite sensitive to such changes (it was found that even changes in a μm range may create a visible effect).
In a preferred embodiment, a proportionality factor determination system for determining a proportionality factor between an object induced phase shift for a first x-ray energy bin and an object induced phase shift for a second x-ray energy bin in the context of energy-binned differential phase contrast x-ray imaging is provided and comprises a proportionality factor determination device according to the present invention, and a phantom, wherein the phantom includes a plurality of portions, each portion having a height changing in a direction transverse to a beam direction of the x-ray in predetermined manner, the height of the portions of the phantom being the extension of the portions in the beam direction, wherein different portions of the phantom have different average heights, wherein the proportionality factor determination device is arranged to determine the proportionality factor depending on an attenuation value for the first energy bin and an attenuation value for the second energy bin.
In a preferred embodiment, a differential phase contrast x-ray imaging system is provided and comprises a differential phase contrast imaging unit, an x-ray source arranged to provide x-rays of a first and a second energy bin, the processing device according to the present invention arranged to receive energy-binned differential phase contrast x-ray imaging data from the differential phase contrast imaging.
In a preferred modification of the above embodiment, the imaging system further comprises the proportionality factor determination system according to the above embodiment, wherein the proportionality factor determination system is arranged to provide information on the proportionality factor to the proportionality factor providing unit of the processing device.
Cases are contemplated where the proportionality factor may be constant (or at least sufficiently approximated by a constant value (or set of values)), so that no specific arrangement would be needed for determining the value (other than means for storing a predetermined value or set of value), while in other cases, the proportionality factor determination system, arranged for specifically determining the information on the proportionality factor, is advantageous, for instance in a case when the energy bin size is so large that the effective energy measured by these bins is significantly changed due to beam-hardening by the object. However, for narrow energy bins, it may be sufficient to use simply equation (5) (see below) to calculate the proportionality factor.
In further aspects of the present invention a software product for processing method for energy-binned differential phase contrast x-ray imaging data, the software product comprising program code means for causing a computer to carry out the steps of a method according to the invention when the software product is run on the computer and a software product for determining a proportionality factor between an object induced phase shift for a first x-ray energy bin and an object induced phase shift for a second x-ray energy bin in the context of energy-binned differential phase contrast x-ray imaging, the software product comprising program code means for causing a computer to carry out the steps of a method according to the invention when the software product is run on the computer are presented
It shall be understood that the processing device of claim 1, the determination unit of claim 7, the processing method of claim 11, the determination method of claim 12, and the computer programs of claims 13 and 14 have similar and/or identical preferred embodiments, in particular, as defined in the dependent claims.
It shall be understood that a preferred embodiment of the invention can also be any combination of the dependent claims or above embodiments with the respective independent claim.
These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter.
BRIEF DESCRIPTION OF THE DRAWINGS
In the following drawings:
FIG. 1 shows a differential phase contrast x-ray imaging system in accordance with an embodiment of the invention, and
FIG. 2 shows a flow diagram illustrating a processing method for energy-binned differential phase contrast x-ray imaging data in accordance with an embodiment of the invention.
DETAILED DESCRIPTION OF EMBODIMENTS
FIG. 1 shows a differential phase contrast x-ray imaging system in accordance with an embodiment of the invention.
The system 10 includes an x-ray source 15 arranged to provide x-rays of a first and a second energy bin, e.g. including photons of a first energy range and photons of a second energy range and a corresponding differential phase contrast imaging unit 20.
In FIG. 1 , between the x-ray source 15 and the imaging unit 20, a phantom 25 is provided, while, in operation of the system 10 for imaging an object, the object (not shown) rather than the phantom 25 is provided between the x-ray source 15 and the imaging unit 20.
The phantom 25 consists of several pillars 25 a of different height. On top of these pillars 25 a are triangles with constant slope of projected material height in beam direction. It is noted that a constant gradient of projected electron density (realized by material height in beam direction) produces a constant phase shift of the Moiré pattern.
Further, in the system 10, the imaging unit 20 is coupled to a proportionality factor determination device 30 and a processing device 35.
The proportionality factor determination device 30 includes a calculation unit 40 and an obtaining unit 45, the operation of which is discussed below.
The processing unit 35 includes a proportionality factor providing unit 50 and a dark field signal and phase shift determining unit 55, the operation of which becomes also clear from the discussion below.
The proportionality factor providing unit 50 is coupled to the proportionality factor determination device 30 to receive data or information on the proportionality factor therefrom.
FIG. 2 shows a flow diagram illustrating a processing method for energy-binned differential phase contrast x-ray imaging data in accordance with an embodiment of the invention.
As additionally also discussed below, the method of this embodiment includes a calculation step 60, in which a first phase shift for the first energy bin is calculated from a phase image, which is obtained by differential phase contrast x-ray imaging a phantom as shown in FIG. 1 , wherein the phase image uses or corresponds to the first energy bin. The calculation step 60 also includes calculating a second phase shift for the second energy bin from a phase image obtained by differential phase contrast x-ray imaging the phantom, here using the second energy bin.
Based on the information calculated in the calculation step 60, a following obtaining step 65 includes obtaining the proportionality factor from the first phase shift and the second phase shift, while additionally the influence as to the attenuation is taken into consideration, based on the phantom.
The obtained proportionality factor is provided, in a proportionality factor providing step 70, and indicates the proportionality between an object induced phase shift for a first x-ray energy bin and an object induced phase shift for a second x-ray energy bin.
Eventually, a determining step 75 is provided of determining at least one of a dark field signal and an object induced phase shift from a detected intensity value, included in the imaging data, of a pixel for the first energy bin and a detected intensity value of the pixel for the second energy bin, using the proportionality factor provided by the proportionality factor providing step 70.
In the following, the above outline of the embodiments of the invention is further discussed.
A commonly employed model for the intensity measured behind a Talbot-Lau interferometer for pixel i of a common geometrical ray is
I i =AB i(1+DV i cos(αi+ϕ))),  (1)
where Bi, Vi and αi denote the intensity, the visibility, and the phase of the Moiré pattern obtained during a blank scan, respectively. The object parameters A, D and ϕ correspond to attenuation, dark field signal, and phase shift, respectively. The object parameters are obtained by least square minimization using the measured data mi
Δ(A,D,ϕ)=Σ(m i −AB i(1+DV i cos(αi+ϕ)))2  (2)
However, as indicated above, mechanical vibrations produce additional phase shifts ψi of the Moiré pattern corresponding to
I i =AB i(1+DV i cos(αii+ϕ)).  (3)
With non-spectral data accumulation ϕ and ψi cannot be separated during minimization. However, using an x-ray detector with two energy bins e=[1,2], equation (3) reads
I i e =A e B i,e(1+D e V i,e cos(αi,eie)).  (4)
It is noted that all parameters depend on photon energy, except the vibration shift ψi.
For mono energetic x-ray photons the energy dependence of the phase shift ϕ yields
ϕ ( E 2 ) = ϕ ( E 1 ) E 1 2 E 2 2 . ( 5 )
For polychromatic x-rays the proportionality factor c describes the relation between the phase shifts ϕ1 and ϕ2 obtained in both energy bins via
ϕ1 =c(s 1 ,s 2)·ϕ2  (6)
and depends on the effective energy spectra s1 and s2 corresponding to both energy bins. It can be measured using a phantom sketched in FIG. 1 .
Using equation (2) separately for both energy bins yields phase images for both bins. By averaging over the area corresponding to individual pillars in the phase images one obtains c for each pillar via equation (6). Due to different heights the pillars produce different degrees of beam hardening which is encoded in the attenuation signal for both bins A1, A2 which can be extracted from the attenuation images. Following this strategy one may obtain a look-up-table for c(A1, A2).
In a slightly different embodiment (not illustrated), the proportionality factor c is equaled, similar to the case of mono energetic x-ray photons, also for polychromatic x-rays as corresponding to the quotient of the mean energies of the energy bins, while correspondingly also such look-up table for c(A1, A2) may be obtained.
In order to disentangle vibration-induced shifts from object parameters we explicitly write equation (3) for both energy bins and make use of equation (6).
I i,1 =A 1 B i,1(1+D 1 V i,1 cos(αi,1i1)).  (7)
I i,2 =A 2 B i,2(1+D 2 V i,2 cos(αi,2i +c(A 1 ,A 2)·ϕ1)).  (8)
By least square minimization using the measured data mi,e from both bins the object phase ϕ1 can be disentangled from the vibrational component ψi:
Δ(A 1 ,A 2 ,D 1 ,D 21i)=Σ(m i,1 −A 1 B i,1(1+D 1 V i,1 cos(αi,1i+
ϕ1)))2+
Σ(m i,2 −A 2 B i,2(1+D 2 V i,2 cos(αi,2i +c·ϕ 1)))2  (9)
It is noted that the above provides already sufficient information to separate between object induced phase shift and vibration induced phase shift on a per-pixel basis. However, the estimate can be made even more robust by adding some further prior knowledge, namely that the vibration induced phase should be the same (or almost the same) for neighboring pixels if the data are acquired simultaneously with neighboring detector pixels. If pixels in a line in the image perpendicular to the scan direction are indexed by x, the minimization can be formulated as:
Δ(A 1 ,A 2 ,D 1 ,D 21i)=Σi,x(m ix,1 −A 1x B ix,1(1+D 1x V ix,1 cos(αix,1+
ψix1x)))2+
Σi,x(m ix,2 −A 2x B ix,2(1+D 2x V ix,2 cos(αix,2ix +c·ϕ 1x)))2+
βΣi,xi,x−ψi,x+1)2  (10)
where β is a regularization parameter that controls how much variation of the vibration-induced phase is allowed. In this case, also the vibration phase of the neighboring pixel is taken into consideration. Bold symbols are used for referral to vectors. The last term favors small differences between disturbance induced phase shifts of neighboring pixels, which is in-line with the a-priori knowledge that these differences have the common cause of vibrating gratings.
It is proposed by the inventors to circumvent problems involved with mechanical instabilities and variations by making use of spectral information based on multi-energy-bin x-ray detectors. The vibrational state of the Moiré pattern can be determined by exploiting the energy independence of vibration-induced Moiré pattern phase shifts and the energy dependence of object-induced shifts. The inventors propose a phantom to measure the energy dependence of the object-induced phase shift. By suitable data processing the vibration-induced shifts can be disentangled from the object properties to minimize image artifacts.
While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive; the invention is not limited to the disclosed embodiments.
In particular, it is pointed out that the above discussion refers to the use of two energy bins, while the invention is not to be understood as being limited in such way, as, for example, in case of additional energy bins, additional proportionality factors may also be provided accordingly.
Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims.
In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality.
A single processor, device or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
Operations like providing, determining, calculating, obtaining, and processing can be implemented as program code means of a computer program and/or as dedicated hardware.
A computer program may be stored and/or distributed on a suitable medium, such as an optical storage medium or a solid-state medium, supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
Any reference signs in the claims should not be construed as limiting the scope.

Claims (11)

The invention claimed is:
1. A medical device for processing data in X-ray images to reduce vibration artifacts in differential phase contrast imaging, comprising:
a processor configured to provide a proportionality factor between an object induced phase shift for a first x-ray energy bin and an object induced phase shift for a second x-ray energy bin, and
determine at least one of a dark field signal and an object induced phase shift from a detected intensity value of a pixel for the first energy bin and a detected intensity value of the pixel for the second energy bin using the proportionality factor.
2. The medical device according to claim 1, wherein the proportionality factor is dependent on a first attenuation value for the first energy bin and a second attenuation value for the second energy bin.
3. The medical device according to claim 2, further comprising a look-up table that includes the first and second attenuation values and the proportionality factor.
4. The medical device according to claim 1, wherein first attenuation value for the first energy bin, a second attenuation value for the second energy bin, a first dark field signal for the first energy bin, a second dark field signal for the second energy bin, an object induced phase shift and a disturbance induced phase shift are determined based on measured data of the first and second energy bins in such way that a likelihood obtaining the measured data is maximized.
5. The medical device according to claim 1, wherein the processor is configured to use a least square minimization equation.
6. The medical device according to claim 1, wherein the dark field and phase shift determining unit is arranged to include, in the determination, a further limitation as to favor small differences between disturbance induced phase shifts of neighboring pixels.
7. The medical device according to claim 1, wherein the processor is further configured to:
using the first energy bin to calculate a first phase shift for the first energy bin from a phase image obtained by differential phase contrast x-ray imaging a phantom that has a predetermined shape;
using the second energy bin to calculate a second phase shift for the second energy bin from the phase image obtained by differential phase contrast x-ray imaging the phantom; and
obtain the proportionality factor from the first phase shift and the second phase shift.
8. The medical device according to claim 7, wherein the phantom includes a plurality of portions, each portion having a height changing in a direction transverse to a beam direction of an X-ray, and wherein different portions of the phantom have different average heights.
9. A differential phase contrast x-ray imaging system, comprising:
a differential phase contrast imaging unit;
an x-ray source arranged to provide x-rays of a first and a second energy bin; and
a medical device for processing data in X-ray images to reduce vibration artifacts in differential phase contrast imaging, comprising:
a processor configured to provide a proportionality factor between an object induced phase shift for a first x-ray energy bin and an object induced phase shift for a second x-ray energy bin, and determine at least one of a dark field signal and an object induced phase shift from a detected intensity value of a pixel for the first energy bin and a detected intensity value of the pixel for the second energy bin using the proportionality factor.
10. A method for processing data in X-ray images of a medical device to reduce vibration artifacts in differential phase contrast imaging, comprising:
providing a proportionality factor between an object induced phase shift for a first x-ray energy bin and an object induced phase shift for a second x-ray energy bin; and
determining at least one of a dark field signal and an object induced phase shift from a detected intensity value of a pixel for the first energy bin and a detected intensity value of the pixel for the second energy bin using the proportionality factor.
11. The method of claim 10, further comprising:
using the first energy bin to calculate a first phase shift for the first energy bin from a phase image obtained by differential phase contrast x-ray imaging a phantom having a predetermined shape;
using the second energy bin to calculate a second phase shift for the second energy bin from a phase image obtained by differential phase contrast x-ray imaging the phantom; and
obtaining the proportionality factor from the first phase shift and the second phase shift.
US16/322,509 2017-03-23 2018-03-23 X-ray imaging data processing device and method Active 2038-10-01 US11529112B2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
EP17162475 2017-03-23
EP17162475.2 2017-03-23
EP17162475.2A EP3378396A1 (en) 2017-03-23 2017-03-23 X-ray imaging data processing device and method
PCT/EP2018/057391 WO2018172501A1 (en) 2017-03-23 2018-03-23 X-ray imaging data processing device and method

Publications (2)

Publication Number Publication Date
US20210321970A1 US20210321970A1 (en) 2021-10-21
US11529112B2 true US11529112B2 (en) 2022-12-20

Family

ID=58412912

Family Applications (1)

Application Number Title Priority Date Filing Date
US16/322,509 Active 2038-10-01 US11529112B2 (en) 2017-03-23 2018-03-23 X-ray imaging data processing device and method

Country Status (5)

Country Link
US (1) US11529112B2 (en)
EP (2) EP3378396A1 (en)
JP (1) JP7117316B2 (en)
CN (1) CN109414237B (en)
WO (1) WO2018172501A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3922178A1 (en) * 2020-06-08 2021-12-15 Koninklijke Philips N.V. Spectral dark-field imaging

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7646843B2 (en) 2006-02-01 2010-01-12 Siemens Aktiengesellschaft Method for producing projective and tomographic phase contrast images with the aid of an X-ray system
US7924973B2 (en) 2007-11-15 2011-04-12 Csem Centre Suisse D'electronique Et De Microtechnique Sa Interferometer device and method
US8155422B2 (en) 2006-03-29 2012-04-10 Koninklijke Philips Electronics N.V. Dynamic optimization of the signal-to-noise ratio of dual-energy attenuation data for reconstructing images
WO2014100063A1 (en) 2012-12-21 2014-06-26 Carestream Health, Inc. Medical radiographic grating based differential phase contrast imaging
US20140185746A1 (en) 2012-12-28 2014-07-03 Pavlo Baturin Spectral grating-based differential phase contrast system for medical radiographic imaging
DE102014213817A1 (en) 2014-07-16 2015-06-18 Siemens Aktiengesellschaft Apparatus and method for obtaining a phase contrast image
CN104970815A (en) 2014-04-04 2015-10-14 曹红光 X-ray imaging system and method based on grating phase contrast and photon counting
US20160242726A1 (en) 2013-11-08 2016-08-25 Koninklijke Philips N.V. Empirical beam hardening correction for differential phase contrast ct
WO2016177903A1 (en) 2015-05-07 2016-11-10 Koninklijke Philips N.V. Beam hardening correction for scanning dark field and phase contrast imaging
US9538970B2 (en) 2012-01-12 2017-01-10 Koninklijke Philips N.V. Generating attenuation image data and phase image data in an X-ray system
US9907524B2 (en) 2012-12-21 2018-03-06 Carestream Health, Inc. Material decomposition technique using x-ray phase contrast imaging system
US20180228455A1 (en) * 2015-05-06 2018-08-16 Koninklijke Philips N.V. Optimal energy weighting of dark field signal in differential phase contrast x-ray imaging

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7646843B2 (en) 2006-02-01 2010-01-12 Siemens Aktiengesellschaft Method for producing projective and tomographic phase contrast images with the aid of an X-ray system
US8155422B2 (en) 2006-03-29 2012-04-10 Koninklijke Philips Electronics N.V. Dynamic optimization of the signal-to-noise ratio of dual-energy attenuation data for reconstructing images
US7924973B2 (en) 2007-11-15 2011-04-12 Csem Centre Suisse D'electronique Et De Microtechnique Sa Interferometer device and method
US9538970B2 (en) 2012-01-12 2017-01-10 Koninklijke Philips N.V. Generating attenuation image data and phase image data in an X-ray system
WO2014100063A1 (en) 2012-12-21 2014-06-26 Carestream Health, Inc. Medical radiographic grating based differential phase contrast imaging
US9907524B2 (en) 2012-12-21 2018-03-06 Carestream Health, Inc. Material decomposition technique using x-ray phase contrast imaging system
US20140185746A1 (en) 2012-12-28 2014-07-03 Pavlo Baturin Spectral grating-based differential phase contrast system for medical radiographic imaging
US20160242726A1 (en) 2013-11-08 2016-08-25 Koninklijke Philips N.V. Empirical beam hardening correction for differential phase contrast ct
CN104970815A (en) 2014-04-04 2015-10-14 曹红光 X-ray imaging system and method based on grating phase contrast and photon counting
DE102014213817A1 (en) 2014-07-16 2015-06-18 Siemens Aktiengesellschaft Apparatus and method for obtaining a phase contrast image
US20180228455A1 (en) * 2015-05-06 2018-08-16 Koninklijke Philips N.V. Optimal energy weighting of dark field signal in differential phase contrast x-ray imaging
WO2016177903A1 (en) 2015-05-07 2016-11-10 Koninklijke Philips N.V. Beam hardening correction for scanning dark field and phase contrast imaging

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Epple F. et al., Phase Unwrapping in Spectral X Ray Differential Phase-Contrast Imaging With an Energy-Resolving Photon-Counting Pixel Detector, IEEE Transactions On Medical Imaging, vol. 34, No. 3, pp. 816-823, 2015.
Koehler, T. et al., "Slit-Scanning Differential X-Ray Phase-Contrast Mammography: Proof-of-Concept Experimental Studies", Medical Physics, vol. 42, Issue 4, pp. 1959-1965, Apr. 2015.

Also Published As

Publication number Publication date
JP7117316B2 (en) 2022-08-12
EP3442423B1 (en) 2019-09-04
CN109414237B (en) 2020-02-21
WO2018172501A1 (en) 2018-09-27
CN109414237A (en) 2019-03-01
EP3378396A1 (en) 2018-09-26
JP2020512080A (en) 2020-04-23
EP3442423A1 (en) 2019-02-20
US20210321970A1 (en) 2021-10-21

Similar Documents

Publication Publication Date Title
US9437017B2 (en) Method and apparatus for metal artifact elimination in a medical image
EP3509034B1 (en) Image filtering based on image gradients
EP2852153B1 (en) Method and apparatus for providing panorama image data
US20080033677A1 (en) Methods And System For Compensating For Spatial Cross-Talk
US7404673B2 (en) Method for generating a gain-corrected x-ray image
US20100182459A1 (en) Apparatus and method of obtaining high-resolution image
JP2007309930A (en) X-ray detector and operation method of the x-ray detector
JP6642970B2 (en) Attention area detection device, attention area detection method, and program
JP2001351091A (en) Image processor, photographing device, system and method for image processing, and storage medium
JP2000287956A (en) Contour detection method for x-ray image
JP2009531109A (en) Temperature artifact correction
CN107124901A (en) The method for removing electron micrograph machine image abnormity point
CN104519274A (en) Image processing apparatus, image processing method
US11529112B2 (en) X-ray imaging data processing device and method
US11587223B2 (en) Inspection apparatus that detects defect in image and inspection method and storage medium thereof
US20160381342A1 (en) Image processing apparatus, imaging apparatus, image processing method, and recording medium
US8098920B2 (en) Method of extrapolating a grey-level bidimensional image in a radiography device and a radiography device implementing such a method
JP6838651B2 (en) Image processing equipment, image processing methods and programs
US20160284062A1 (en) Method of determining distortion and/or distortion correction for projection image obtained during computer tomography routine
EP3009862A2 (en) Method of determining distortion and/or distortion correction for projection image obtained during computer tomography routine
JP5167001B2 (en) Radiation image processing apparatus and method
US20080121792A1 (en) Image quality evaluation/calculation method, apparatus and program
JP3726700B2 (en) ECT device
JP4814123B2 (en) Apparatus and method for analyzing inspection by splitdose method
JP4194124B2 (en) Radiation image acquisition device

Legal Events

Date Code Title Description
AS Assignment

Owner name: KONINKLIJKE PHILIPS N.V., NETHERLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BARTELS, MATTHIAS;KOEHLER, THOMAS;ROESSL, EWALD;SIGNING DATES FROM 20180323 TO 20180718;REEL/FRAME:048215/0433

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: EX PARTE QUAYLE ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO EX PARTE QUAYLE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

Free format text: AWAITING TC RESP., ISSUE FEE NOT PAID

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE