WO2022187659A9 - Système de guidage vertébral peropératoire à navigation radiologique - Google Patents

Système de guidage vertébral peropératoire à navigation radiologique Download PDF

Info

Publication number
WO2022187659A9
WO2022187659A9 PCT/US2022/018959 US2022018959W WO2022187659A9 WO 2022187659 A9 WO2022187659 A9 WO 2022187659A9 US 2022018959 W US2022018959 W US 2022018959W WO 2022187659 A9 WO2022187659 A9 WO 2022187659A9
Authority
WO
WIPO (PCT)
Prior art keywords
ultrasound
computer
region
data
surface representation
Prior art date
Application number
PCT/US2022/018959
Other languages
English (en)
Other versions
WO2022187659A1 (fr
Inventor
Frank Schwab
Frank KOSAREK
Virginie Lafage
Original Assignee
New York Society For The Relief Of The Ruptured And Crippled, Maintaining The Hospital For Special Surgery
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by New York Society For The Relief Of The Ruptured And Crippled, Maintaining The Hospital For Special Surgery filed Critical New York Society For The Relief Of The Ruptured And Crippled, Maintaining The Hospital For Special Surgery
Priority to US18/278,670 priority Critical patent/US20240138818A1/en
Priority to JP2023553954A priority patent/JP2024510140A/ja
Priority to CA3209143A priority patent/CA3209143A1/fr
Priority to KR1020237033752A priority patent/KR20240016247A/ko
Priority to IL305327A priority patent/IL305327A/en
Priority to CN202280032767.5A priority patent/CN117241757A/zh
Priority to EP22764159.4A priority patent/EP4301268A1/fr
Priority to AU2022231159A priority patent/AU2022231159A1/en
Publication of WO2022187659A1 publication Critical patent/WO2022187659A1/fr
Publication of WO2022187659A9 publication Critical patent/WO2022187659A9/fr

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
    • A61B6/03—Computed tomography [CT]
    • A61B6/032—Transmission computed tomography [CT]
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/46—Arrangements for interfacing with the operator or the patient
    • A61B6/461—Displaying means of special interest
    • A61B6/466—Displaying means of special interest adapted to display 3D data
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
    • A61B6/5211—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
    • A61B6/5229—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image
    • A61B6/5247—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image combining images from an ionising-radiation diagnostic technique and a non-ionising radiation diagnostic technique, e.g. X-ray and ultrasound
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08—Detecting organic movements or changes, e.g. tumours, cysts, swellings
    • A61B8/0833—Detecting organic movements or changes, e.g. tumours, cysts, swellings involving detecting or locating foreign bodies or organic structures
    • A61B8/085—Detecting organic movements or changes, e.g. tumours, cysts, swellings involving detecting or locating foreign bodies or organic structures for locating body or organic structures, e.g. tumours, calculi, blood vessels, nodules
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/42—Details of probe positioning or probe attachment to the patient
    • A61B8/4245—Details of probe positioning or probe attachment to the patient involving determining the position of the probe, e.g. with respect to an external reference frame or to the patient
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/5238—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/5238—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image
    • A61B8/5246—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image combining images from the same or different imaging techniques, e.g. color Doppler and B-mode
    • A61B8/5253—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image combining images from the same or different imaging techniques, e.g. color Doppler and B-mode combining overlapping images, e.g. spatial compounding
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/5238—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image
    • A61B8/5261—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image combining images from different diagnostic modalities, e.g. ultrasound and X-ray
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/40—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/50—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for simulation or modelling of medical disorders
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2048—Tracking techniques using an accelerometer or inertia sensor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2051—Electromagnetic tracking systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2055—Optical tracking systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364—Correlation of different images or relation of image positions in respect to the body
    • A61B2090/365—Correlation of different images or relation of image positions in respect to the body augmented reality, i.e. correlating a live optical image with another image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/378—Surgical systems with images on a monitor during operation using ultrasound
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10072—Tomographic images
    • G06T2207/10081—Computed x-ray tomography [CT]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10132—Ultrasound image
    • G06T2207/10136—3D ultrasound image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30008—Bone
    • G06T2207/30012—Spine; Backbone
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/70—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients

Definitions

  • This description generally relates to intra-operative procedures, especially navigation during intra-operative procedures.
  • some implementations provide a computer-implemented method that includes: accessing, ultrasound data obtained from intra-operatively insonifying a region of a patient using an ultrasound probe wherein the ultrasound data encode, in realtime, 3D surface information of one or more bone structures in the region as well as locational information of the one or more bone structures relative to the ultrasound probe; extracting a first 3D surface representation of the one or more bone structures based on the ultrasound data; accessing non-ultrasound imaging data obtained from performing non-ultrasound imaging of the region of the patient prior to the surgical procedure, the non-ultrasound imaging data including 3D surface anatomical information of the one or more bone structures in the region; extracting a second 3D surface representation of the one or more bone structures based on the non-ultrasound imaging data; identifying, using a deep learning algorithm, one or more regions of interest (ROI)s from the first 3D surface representation such that when aligning the first 3D surface representation and the second 3D surface representation over the one or more regions of interest (ROI)s,
  • ROI
  • the implementations may include one or more of the following features.
  • the deep learning algorithm may include: adjusting a number of the one or more ROIs, a size of the one or more ROIs, a location of the one or more ROIs, a first threshold level for determining a match between the first and second 3D surface representations, and a second threshold level for determining a noise characteristic of the first and second 3D surface representations.
  • the deep learning algorithm may include: storing first templates of patches where the first 3D surface representation and the second 3D surface representation tend to match.
  • the deep learning algorithm may include: based on the spatial transformation for at least one of the ultrasound data or the nonultrasound imaging data, revising the first templates of ROIs where the first surface 3D representation and the second surface 3D representation tend to match.
  • the deep learning algorithm may include: storing second templates of patches where the first 3D surface representation and the second surface representation tend to mismatch.
  • the deep learning algorithm may include: based on the spatial transformation for at least one of the ultrasound data or the non-ultrasound imaging data, revising the second templates of ROIs where the first 3D surface representation and the second 3D surface representation tend to mismatch.
  • the implementations may further include: based on aligning the first 3D surface representation and the second 3D surface representation over the one or more ROIs, tracking a displacement of the one or more bone structures in the region between the nonultrasound imaging data obtained prior to the surgical procedure and the ultrasound data obtained during the surgical procedure; and based on the spatial transformation, quantifying the displacement of the one or more bone structures in the region between the non-ultrasound imaging data obtained prior to the surgical procedure and the ultrasound data obtained during the surgical procedure.
  • the implementations may further include: based on the tracked displacement, updating, in real-time, a navigational guidance to an operating surgeon during the surgical procedure such that a position of the ultrasound probe can be adjusted.
  • the implementations may further include: in response to the ultrasound probe being repositioned to insonify the one or more bone structure during the surgical procedure, refreshing the spatial transformation such that the overlay of the 3D surface anatomical information from the non-ultrasound imaging data on the 3D surface anatomical information from the ultrasound data is updated, wherein the ultrasound data is obtained from the repositioned ultrasound probe.
  • the implementations may further include: tracking, using the ultrasound data, a location of a device during the surgical procedure, wherein the device comprises: a surgical instrument, an implant, or a stimulator device; and projecting the tracked location of the device on the overlay where the 3D surface information of the one or more bone structures from the non-ultrasound imaging data is overlaid on the 3D surface information of the one or more bone structures from the ultrasound data.
  • Extracting the first 3D surface representation may include: determining a tissuebone interface based on applying a method that comprises a forward tracing method, or a back shadow method, wherein the method is performed along an ultrasound propagation direction to determine a tissue-bone interface, and wherein the method is performed without encountering reverberations from the tissue-bone interface.
  • the non-ultrasound imaging data may include: a computed tomography (CT) image, or a magnetic resonance imaging (MRI) image, wherein the MRI image comprises: a zero echo-time (TE) MRI image, and wherein the computer-implemented method is performed without accessing X-ray fluoroscopy data.
  • CT computed tomography
  • MRI magnetic resonance imaging
  • TE zero echo-time
  • the region may include a spinal column region, a pelvic region, a sacral region or an occipital region.
  • the region may include at least one of humeri, elbows, radius, ulna, metacarpals, phalanges, scapula, ribs, iliac wings, femurs, patella, tibias, fibulas, or metatarsal.
  • the region may include at least one of shoulders, elbows, wrists, hands, hips, knees, ankles or feet.
  • the region may include an area for biopsy of one or more lesions within a bone, around the bone, and on the surface of the bone.
  • the region may include one or more areas for a soft tissue or trigger point injection, and for injecting into (i) a joint for arthrocentesis, facet joint block, or arthrography, (ii) bursa or ganglia around one or more bones of at least one extremity, (iii) one or more ligamentous structures around the joint, (iv) one or more structural tunnels that include the carpal and tarsal tunnels in the hands or feet, or (v) one or more tendons.
  • the implementations may provide a system that includes: an ultrasound probe operable to insonify a region of a patient; a display device capable of providing real-time visual feedback during the surgical procedure; and a computer processor in communication with the ultrasound probe and the display device, the computer processor configured to: access ultrasound data obtained from intra-operatively insonifying the region of the patient during the surgical procedure, wherein the ultrasound data encode, in real-time, 3D surface information of one or more bone structures in the region as well as locational information of the one or more bone structures relative to the ultrasound probe; extract a first 3D surface representation of the one or more bone structures based on the ultrasound data; access non-ultrasound imaging data obtained from performing non-ultrasound imaging on the region of the patient prior to the surgical procedure, the non-ultrasound imaging data including 3D surface anatomical information of the one or more bone structures in the region; extract a second 3D surface representation of the one or more bone structures based on the non-ultrasound imaging data; identify, using a deep learning algorithm, one or more regions
  • the implementations may include one or more of the following features.
  • the computer processor may be further configured to: track, using the ultrasound data, a location of a surgical instrument during the surgical procedure; and project the tracked location of the surgical instrument on the overlay where the 3D surface information of the one or more bone structures from the non-ultrasound imaging data is overlaid on the 3D surface information of the one or more bone structures from the ultrasound data, wherein the surgical instrument is operable to facilitate placing a pedicle screw, an implant, or a stimulator, in the region during the surgical procedure.
  • the computer processor may be further configured to: based on aligning the first 3D surface representation and the second 3D surface representation over the one or more ROIs, track a displacement of the one or more bone structures in the region between the non-ultrasound imaging data obtained prior to the surgical procedure and the ultrasound data obtained during the surgical procedure; and based on the tracked displacement, update, in real-time, a navigational guidance to an operating surgeon during the surgical procedure such that a position of the ultrasound probe can be adjusted.
  • the display device may be configured to refresh, in real-time, the overlay of the 3D surface anatomical information from the non-ultrasound imaging data on the 3D surface information from the ultrasound data such that an augmented reality rendering is provided to navigate an operating surgeon during the surgical procedure.
  • the display device may include a wearable device, and wherein the ultrasound probe comprises a wireless ultrasound probe.
  • the system may further include: a tracking system configured to provide realtime tracking information of the ultrasound probe during the surgical procedure, wherein the real-time tracking information of the ultrasound probe, when combined with locational information of the one or more bone structures relative to the ultrasound probe, is translatable to a navigational guidance to an operating surgeon with respect to positioning the ultrasound probe during the surgical procedure.
  • the tracking system may include at least one of an optical tracker, a stepped motor, an electromagnetic sensor, an accelerator, or a gyroscope.
  • the region may include a spinal column region, a pelvic region, a sacral region or an occipital region.
  • the region may include at least one of humeri, elbows, radius, ulna, metacarpals, phalanges, scapula, ribs, iliac wings, femurs, patella, tibias, fibulas, or metatarsal.
  • the region may include at least one of shoulders, elbows, wrists, hands, hips, knees, ankles or feet.
  • the region may include one or more areas for biopsy of one or more lesions within a bone, around the bone, and on the surface of the bone.
  • the region may include one or more areas for a soft tissue or trigger point injection, and for injecting into (i) a joint for arthrocentesis, facet joint block, or arthrography, (ii) bursa or ganglia around one or more bones of at least one extremity, (iii) one or more ligamentous structures around the joint, (iv) one or more structural tunnels that include the carpal and tarsal tunnels in the hands or feet, or (v) one or more tendons.
  • some implementations provide: accessing, ultrasound data obtained from insonifying a region of a patient using an ultrasound probe wherein the ultrasound data encode, in real-time, 3D surface information of one or more bone structures in the region as well as locational information of the one or more bone structures relative to the ultrasound probe; extracting a first 3D surface representation of the one or more bone structures based on the ultrasound data; accessing non-ultrasound imaging data obtained from performing non-ultrasound imaging of the region of the patient, the non-ultrasound imaging data including 3D surface anatomical information of the one or more bone structures in the region; extracting a second 3D surface representation of the one or more bone structures based on the non-ultrasound imaging data; identifying, using a deep learning algorithm, one or more regions of interest (ROI)s from the first 3D surface representation such that when aligning the first 3D surface representation and the second 3D surface representation over the one or more regions of interest (ROI)s, a spatial transformation is determined; and based on applying the spatial transformation,
  • ROI regions of
  • Fig- 1 shows an example of a diagram illustrating a workflow as used by some implementations of the present disclosure.
  • Fig- 2 illustrates an example of pre-operative high-resolution CT images of the vertebrae as used by some implementations of the present disclosure.
  • Fig- 3 illustrates an example of an intra-operative ultrasound (US) image of a vertebra according to some implementations of the present disclosure.
  • US intra-operative ultrasound
  • Figs. 4A to 4D illustrate examples of identifying the osseous surface based on the intra-operative US data according to some implementations of the present disclosure.
  • Figs. 5A to 5D illustrate examples of aligning the surface representation from preoperative CT images with the surface representation from intra-operative ultrasound according to some implementations of the present disclosure.
  • Figs. 5E to 5F illustrate examples of superposition of pre-operative CT images and intra-operative US data according to some implementations of the present disclosure.
  • Figs. 6A to 6B illustrate examples of superimposing pre-operative CT images with intra-operative US data according to some implementations of the present disclosure.
  • Figs. 6C to 6D illustrate examples rendered surface resulting from superimposing pre-operative high-resolution CT images with intra-operative US data according to some implementations of the present disclosure.
  • Fig- 7 illustrate examples of patches during an example of superimposing preoperative CT images with intra-operative ultrasound data according to some implementations of the present disclosure.
  • Figs. 8A to 8C illustrate examples of flowcharts used by some implementations of the present disclosure.
  • Fig. 9 is a block diagram illustrating an example of a computer system used to provide computational functionalities associated with described algorithms, methods, functions, processes, flows, and procedures, according to an implementation of the present disclosure.
  • Implementations described by the present disclosure provide a novel system of ultrasound-based referencing of spinal landmarks coupled with a conventional camerabased navigation system or an augmented reality system.
  • the basis of the disclosed system relates to intra-operative use of an ultrasound device displaced over a patient or an exposed surgical field, which can be filled with saline solution or gel to provide coupling for the ultrasound waves to propagate into the patient’s body.
  • Intra-operative use can refer to the use of an instrument during a surgical operation.
  • the disclosed system can be coupled to a computer system which has pre-operative surface topography calculated from conventional computed tomography (CT) or magnetic resonance imaging (MRI).
  • CT computed tomography
  • MRI magnetic resonance imaging
  • sensors, gyroscopes, or optical trackers can be used to determine displacement and orientation such that the 3D surface of the vertebrae can be assessed and updated.
  • coupling the displacement of the ultrasound probe to an augmented reality headset can permit the operating surgeon to visualize the precise position of vertebra with overlay images from the pre-operative CT or MRI.
  • the disclosed system can track the ultrasound probe displacement with camera navigation in relation to a fixed reference marker attached to the patient.
  • the disclosed system can use a deep learning or artificial intelligence (Al) algorithm to identify bony surfaces of the osseous spine based on intra-operative ultrasound (US) data in real-time. Implementations may intelligently select areas or “patches/ROIs” from the intra-operative US data.
  • the deep learning or Al algorithm may be trained to identify these “patches,” which, when taken in conjunction with one another, can serve as a “thumbprint” of each, single vertebra.
  • implementations can treat each vertebra separately as patient movement would induce spatial changes between the positions of the vertebral bodies.
  • the Al algorithm can then match these “thumbprints” of the vertebral body on intra-operative ultrasound data with pre-operative CT/MRI images during the surgical procedure in-real time.
  • a 3D osseous surface of the posterior spine can be created in real-time.
  • the operating surgeon can visualize the real-time displacement of tracked instruments and/or implants (again with tracking beads through the camera based system) as well as implants on a screen display where an overlay on the pre-operative imaging is provided.
  • the advantages of the disclosed system include intraoperative use of ultrasound probes to map and match surface topography in relation to segmented pre-operative imaging (CT, MRI).
  • CT segmented pre-operative imaging
  • the advantages of this system also include radiation-free intraoperative navigation, improved acquisition speed of surface topography, decreased burden of workflow, and reduced infection risk.
  • the current need for fluoroscopic imaging, at times repeatedly for one procedure, is time-consuming and exposes the patient and clinical team to radiation.
  • repeated introduction of bulky fluoroscopic equipment can create a risk environment for contamination of the operative field.
  • Fig. 1 shows an example of diagram 100 illustrating a workflow as used by some implementations of the present disclosure.
  • diagram 100 imports CT image volume 101 and US image volume 103.
  • CT image volume 100 refers to a high-resolution CT image of the patient’s spinal region obtained before the surgical procedure. Implementations are not limited to the spinal column such as the vertebral region.
  • the regions can include a pelvic region, a sacral region, or a occipital region.
  • the pre-operative high- resolution CT images of the vertebral bodies of the spine can have a resolution of 0.33mm by 0.33 mm by 0.33 mm.
  • the spatial resolution can be even smaller than the resolution provided by example 200.
  • implementations are not limited to using high-resolution CT images. Indeed, high-resolution magnetic resonance imaging (MRI) images can also be used.
  • MRI magnetic resonance imaging
  • some implementations can incorporate a zero echo time (TE) fast MRI data set obtained before the surgical procedure.
  • Implementations may incorporate segmentation to identify the osseous external surface of individual vertebrae (vertebral bodies and posterior elements) from the pre-operative image data set to obtain a 3D representation of individual vertebrae. The segmentation can result in successful labeling of the individual vertebra to reveal the shape of the posterior elements at each vertebral level as well as specific anatomical landmarks along the spinal cord.
  • Ultrasound (US) image volume 103 may refer to intra-operative ultrasound data obtained during the surgical procedure from an ultrasound probe, typically with an array of ultrasound transducer elements.
  • the intra-operative ultrasound may cover the same region as the pre-operative images.
  • a surgeon may scan the posterior bony surface of the spine with the ultrasound probe.
  • a wireless ultrasound probe may be used. The scanning can be performed by passing the ultrasound probe along skin surface in area of interest, or directly in a surgical wound which has been filled with saline or other gel/fluid adapted for ultrasound insonification. An initial sweep of the spine could be performed in order to identify the osseous level e.g., LI, L2 L3 etc.
  • the initial sweep can be a quick, coarse pass with sufficient accuracy to detect spinal levels LI, L2, L3 etc. but not necessarily more fine grained to visualize the full bony detail.
  • the initial sweep can be followed by a second, more detailed sweep to more accurately visualize full bony details of the spine.
  • the detailed second sweep may identify bony landmarks for guidance of screws and plates into the spine.
  • the detailed sweep can generate 3-D ultrasound coverage of the posterior surface of the spine, as the operating surgeon moves the probe over the skin to scan the region of interest.
  • the operating surgeon can use either water or gel-based substance to cover the anatomy of interest.
  • the ultrasound probe can be displaced by smooth movement in varying directions and angulations in order to obtain a surface mapping of the spinal region of interest.
  • the implementations are not limited to the spine region.
  • the implementations may include imaging guided systems for biopsy of lesions within a bone, around the bone, and on the surface of the bone.
  • bone include humeri, elbows, radius, ulna, metacarpals, phalanges, scapula, ribs, iliac wings, femurs, patella, tibias, fibulas, metatarsal.
  • Implementations may also include diagnosis of a joint and guidance in joint replacement for a joint in the extremities including shoulders, elbows, wrists, hands, hips, knees, ankles and feet.
  • Implementations may also include imaging guided injection of periarticular or intraarticular structures in and around the extremities such as humeri, elbows, radius, ulna, metacarpals, phalanges, scapula, ribs, iliac wings, femurs, patella, tibias, fibulas, and metatarsal.
  • the injections may include needle injection into joints for arthrocentesis, facet joint block, or arthrography, needle injection into bursa or ganglia around the bones of the extremities, soft tissue or trigger point injections, injection into ligamentous structures around the joints, injection into structural tunnels such as the carpal and tarsal tunnels in the hands and feet respectively and injection of tendons or tendon sheaths.
  • a trigger point injection can help soothe muscle pain, especially in the arms, legs, lower back and neck.
  • the trigger point injection also can be used to treat fibromyalgia, tension headaches and myofascial pain.
  • Trigger points generally refer to painful “knots” in a muscle when the muscle is, for example, over stretched and becomes unable to relax.
  • ultrasound image volume 103 can be imported by a computing device.
  • ultrasound image volume 103 can be the raw ultrasound data from each transducer element on the ultrasound probe.
  • the raw ultrasound data may be obtained before beamforming that generates the B-mode data of an ultrasound image.
  • the raw ultrasound data may also include raw in-phase/quadrature (T/Q) or also may include the raw pre-beamformed RF data.
  • the B-mode data can be imported. Implementations may apply multiple methods to improve detailed ultrasonographic visualization of the osseous surface. The methods may include varying of the speed of sound configuration on the ultrasound scanner to sharpen the details and edges of the osseous surface.
  • the method may also exploit the propagation of sound through tissues of varying densities to improve the sensitivity of detecting the osseous surface. For example, sound propagates much faster through bone than soft tissue.
  • the methods may further include measuring ultrasonographic impedance as the ultrasound propagates through bone and soft tissue to facilitate the detection of the osseous surface.
  • the method may also include using multiple focal zones in both the vertical and horizontal planes relative to the ultrasound probe to sharpen the osseous surface.
  • the method may additionally include the use of elastography, which is an imaging technique that can evaluate the mechanical properties of tissue according to the propagation of mechanical waves
  • an imaging apparatus such as an ultrasound apparatus
  • the ultrasound image volume 103 may include location data of the ultrasound probe relative to the spinal structure.
  • the importation process may also import position data from a navigation system.
  • the computing device can be a device within the surgical field or outside. In either case, the computing device can implement a deep learning or an Al algorithm to identify bony surface of the osseous spine based on the US image volume 103 in real-time.
  • Implementations may extract information encoding ultrasound beam axis orientation from US image volume (104). Further referring to Fig. 3, an example of one frame of raw I/Q data is presented. As illustrated, the bony surface is approximately at a diagonal angle and the direction of ultrasound beams is approximately vertical, originating from the surface of the array elements of the ultrasound probe located at the top of the image. To the left of the image, a cross-sectional profile is presented, illustrating a reflection at the bony interface, as well as reverberations beyond the bony interface. Some implementations may leverage the raw data, for example, in-phase and quadrature (IQ) or Rf data, imported from the ultrasound probe.
  • IQ in-phase and quadrature
  • B-mode image may include beam formed data that delineate the underlying anatomical structure
  • beamformed data may lack an adequate dynamic range due to rebinning and postprocessing during the beamforming process.
  • the raw I/Q or RF data can be superior, for example, more sensitive, for detection of a bony surface.
  • some implementations may leverage the raw ultrasound data to generate B-mode images with a vertical resolution of 0.018mm and a horizontal resolution of 0.09mm.
  • the generated B-mode images may be further processed to have a more isotropic spatial resolution, for example, a vertical resolution of 0.27mm and a horizontal resolution of 0.275mm, as illustrated in Fig. 4B.
  • various implementations may use forward tracking and the raw I/Q or RF data to improve detection of the bony surface (108).
  • thresholding alone may not generate a consistent surface representation.
  • some implementations combine peak detection with padding to achieve a more consistent volume representation of the surface.
  • the padding may include two pixels on both sides of the detected peak.
  • a 3D osseous surface of the posterior spine can be created in real-time.
  • some implementations may thus generate a volume representation of the surface of each vertebral body from the imported ultrasound image volume (e.g., raw I/Q or RF data from each array element of the ultrasound probe) (109). Implementations can treat each vertebral body separately to accommodate patient movement, which can give rise to spatial changes between the positions of the vertebral bodies.
  • the created ultrasound surface volume representation (110) may be used for aligning with surface volume representation based on pre-operative CT.
  • the implementations may align the pre-operative high-resolution CT images with the extracted ultrasound beam axis (102).
  • Implementations may register surface of bone by identifying a thin 2-D region that represents the transition between tissue types.
  • the registration may involve detecting, in the underlying CT intensity profile, the edge of a step function followed by osseous tissue.
  • the ultrasound intensity profile may exhibit a peak followed by a shadow region.
  • the implementations may apply forward tracing to the preoperative CT image volume to yield bone surface with shadow regions identified using an intensity threshold (105).
  • the implementations may also apply back shadow tracking to identify the boundary.
  • the implementations may then create a surface representation of the bony surface by identifying voxels that represent the surface and applying padding on both sides of the voxels to create volumes for alignment (106).
  • some implementations may identify the direction for the incident ultrasound beam (501). The implementations may then rotate the CT or MRI image volume so that the ultrasound beam is vertically incident (502). Here, the implementations may segment the bony surface using a simple threshold where the incident ultrasound beam is vertical (503). The implementations may simulate expected shadowed area of ultrasound beam. Results of the segmentation and padding may be rotated back to the original orientation of the CT or MRI image volume.
  • the created CT or MRI surface volume representation (107) can be used for subsequent alignment of preoperative CT or MRI and intra-operative ultrasound.
  • the implementations may then identify the regions of interest (ROIs) for alignment using deep learning algorithms (111). Based on the ROIs, the implementations may spatially align ultrasound surface volume representation and CT or MRI surface volume representation (112). The implementations may generate the spatial transformation matrix for performing the spatial alignment (113).
  • ROIs regions of interest
  • the implementations may generate the spatial transformation matrix for performing the spatial alignment (113).
  • various implementations match the ultrasound surface volume representation and CT or MRI surface volume representation.
  • the implementations may focus on areas or regions of interest (ROIs) with excellent spatial resolution on the ultrasound image volume.
  • ROIs regions of interest
  • the implementations may leverage deep learning and Al to train the alignment process to identify the promising ROIs. For example, implementations can select ROIs that are more likely to yield matching surfaces (e.g., where the signal-to-noise ratio (SNR) is adequate). Conversely, the implementations may also prune areas from the ROIs that are unlikely to generate matching surfaces.
  • the patches can include at least three pixels and located at distinctly separate areas on the posterior aspect of the spine, or the desired bone region (e.g., pelvic region).
  • the “thumbprint” may appear as a “thumbprint” for each, single vertebral body to be used for matching the real-time 3D ultrasound surface representation to the 3D pre-operative CT/MRI surface representation.
  • the “thumbprint” can be on the posterior surface of the bone region of interest (e.g., vertebra, pelvis, sacrum, occipital region).
  • Each bone structure, or vertebra can be treated individually as changes in patient position may distort the relationship between real-time ultrasound and pre-operative CT/MRI images.
  • the operating surgeon can be alerted as soon as a match has occurred.
  • Some implementations can provide audio, visual, or tactile feedback to alert the operating surgeon when sufficient mapping has occurred to confirm an adequate surface has been covered by the ultrasound probe to achieve a matching with pre-operative images.
  • These implementations can incorporate a wearable display device for projecting the matched results to the operating surgeon.
  • the wearable device can include a goggle device.
  • the implementations can provide a platform for mixed-reality, augmented reality, or virtual reality in which the operating surgeon can receive navigational guidance for the on-going surgical procedure.
  • the ultrasound probe can be a wireless probe.
  • a deep learning algorithm may incorporate a layered structure of algorithms, also known as artificial neural network (ANN), programmed to detect, for example, features of the ROIs with sufficient quality for matching intraoperative ultrasound images to pre-operative CT/MRI images.
  • ANN artificial neural network
  • the ANN layers can be trained over large sets of data and through exemplary selections to detect the ROIs that are expected to serve as guidepost to match intra-operative ultrasound images to pre-operative CT/MRI images.
  • the implementations of the present disclosure can dynamically generate regions of interest (ROIs) based on intra-operative ultrasound scan.
  • ROIs regions of interest
  • ROIs are generated from each ultrasound scan and correspond to patches on the surface of bone structures where the ultrasound signal quality is sufficient (e.g., not hindered by multiple reverberations) for the purpose of morphing the intra-operative ultrasound image to the pre-operative CT/MRI images.
  • the ROI are also generated dynamically in terms of area and size (e.g., with adaptive region growth/shrinkage approaches).
  • FIG. 5E an example of the posterior spinal surface is provided based on the ultrasound data.
  • the ultrasound beam is incident vertically from the top.
  • FIG. 5F various examples are provided to illustrate superposition of pre-operative CT image volume with the ultrasound surface representation based on the direction of the incident ultrasound beam.
  • the CT image volume can be rotated relative to the ultrasound beam so that the ultrasound surface representation is overlaid on the bony surface.
  • Figs. 6A to 6B the illustrated examples of superimposing intraoperative US data (shaded with transparency) on pre-operative high-resolution CT images demonstrate a good match in regions over lamina, and transverse regions. In ligamentous areas between bones, however, the matching quality deteriorates significantly.
  • Fig. 6B particularly illustrates a distribution of patches that cover various regions. Over the trough area where the ligaments are, the patches are more sparsely distributed.
  • the overlap between the surface representation from the ultrasound data and the surface representation from the pre-operative CT image may be continuous and more consistent, as shown in Fig. 6C.
  • the overlap between the surface representation from the ultrasound data and the surface representation from the pre-operative CT image may include gaps.
  • the implementation can apply patches of varying sizes for matching purposes. Moreover, the implementations can intelligently adapt the sizes and the distribution of patches to yield high-quality matches.
  • panel 700 illustrates a surface with multiple areas as ROI candidates that include a full patch and a small patch.
  • a full patch can include a larger area for aligning an ultrasound surface representation with a CT surface representation
  • a small patch can refer to a partial mask for performing the alignment.
  • panels 701A and 701C each reveals the respective full patch and the small patch in 2D format where each pixel indicates the matching degree. In other words, if the match is perfect, the pixel becomes zero.
  • the pixel-wise displays demonstrate that the full patch has multiple adjoining areas where the matching is decent.
  • the small patch shows a zoomed version of the left hand side of the full patch where the degree of match is more concentrated.
  • panel 70 IB and 70 ID each showing the respective the histogram of pixel values.
  • panel 70 IB shows a larger mean with a higher standard deviation, which corresponds to a larger spread.
  • panel 70 ID shows a smaller mean with a smaller standard deviation, which corresponds to a smaller spread.
  • implementations can use deep learning or Al algorithms to adaptively select patches where matches are more likely and promising.
  • the layers can include an input layer, one or more hidden layer, and an output layer.
  • Each hidden layer may be a combination of one or more of: a convolutional layer, a pooling layer, a rectified linear unit (ReLU) layer, a softmax layer, a regressor layer, and a dropout layer.
  • These hidden layers can be arranged in any order as long as the input/output size criteria are met.
  • Each hidden layer can incorporate a set of image filters.
  • an example of a work flow process can start with input data 801, which can include the intra-operative surface representations based on an intra-operative ultrasound data volume as well as the preoperative surface representations based on pre-operative image volume.
  • the implementations may select patches for matching the intra-operative surface representations with the pre-operative surface representations (805).
  • the selection process may also receive templates of patches from the anatomy where matches are more likely and promising (802).
  • the template of patches can be a library of patches determined based on past historical data as well as the specific insonification angles during the intra-operative procedure. During a surgical procedure, the insonification angle may be changed when the ultrasound probe is re-positioned.
  • implementations can adjust the selected patches in response to the repositioning. Additionally, implementations can detect spinal column changes in the shape, size, position, and orientation caused by positioning the patient or operating an instrument during the surgical procedure. Detecting these changes relative to the static pre-operative images can be advantageous, especially when the detection allows for real-time feedback to the operating surgeon during the surgical procedure.
  • past historical data may include templates used successfully in past matches (for example, when applied to the same vertebrae and with comparable insonification angles). Simulations based on the pre-operative image volume and the vertebral anatomy may also assist the determination of the template.
  • the selected patches may update the template of patches (804). The feedback can enhance the deep learning process.
  • the implementations may activate a parallel pruning process to remove areas that are less likely to generate matches of decent quality (806).
  • the pruning process may also be based on templates of patches from the anatomy where matches are unlikely and unpromising (803).
  • Templates 803 may also include a library of patches determined based on past historical data as well as the specific insonification angles during the intra-operative procedure. For example, the pruning can be adjusted in response to a repositioning of the ultrasound probe. Templates 803 may also be updated based on the pruning process (807). The update can likewise enhance the deep learning process.
  • the combined action of selecting patches (805) and pruning patches (806) may generate the output regions of interests (ROIs) for computing an alignment of the intra-operative ultrasound surface representation with the pre-operative surface representation (808).
  • ROIs regions of interests
  • diagram 820 shows an example of a navigation system according to some implementations of the present disclosure.
  • an ultrasound probe 812 operated by an operating surgeon, can monitor a region of the patient 813.
  • the region can include a spinal column region, a pelvic region, a sacral region, or an occipital region.
  • an implant or a stimulator device may be implanted during the surgical procedure.
  • the implant may refer to a passive device such as a prosthetic implant or a hip implant.
  • a surgical instrument used by the operating surgeon can facilitate placing a device such as a pedicle screw in the region of the patient.
  • device 814 is inside the region of the patient.
  • the surgeon may operate the ultrasound probe to monitor the placement of the device during the surgical procedure.
  • the real-time data from the ultrasound probe during the surgical procedure can be fused with static pre-operative images. When the fused images are presented to the operating surgeon in real-time during the surgical procedure, the static pre-operative images are brought back to life.
  • the ultrasound data can confirm or track bone displacement against a pre-surgical plan, such as changes in lumbar lordosis.
  • the ultrasound data can also track an instrument, a device (e.g., tip of a needle device) during the surgical procedure. When the ultrasound data is merged with
  • the navigation system can include a separate tracking system 815 capable of tracking the position of ultrasound probe 812 as well as device 814 inside the region of the patient.
  • the tracking system can include at least one of: an optical tracker, a stepped motor, an electromagnetic sensor, an accelerator, or a gyroscope.
  • the tracking system can perform opto-electronic tracking based on the position data of the ultrasound probe and the location information of a vertebra so that real-time guidance information can be provided to the operating surgeon to adjust the position of the ultrasound probe.
  • the ultrasound probe may be mounted on a robotic arm, which can automatically adjust the position of the ultrasound probe 812.
  • Diagram 820 also includes image database 816, which stores pre-operative images of the region of the patient.
  • the pre-operative images can include CT images or MRI images.
  • the MRI images can include zero TE MRI images.
  • tracking information from tracking system 815, intra-operative ultrasound data from ultrasound probe 812, and pre-operative non-ultrasound images from image database 816 can be provided to computer processor 817.
  • the implementations can develop and establish a template of ROIs for aligning the intra-operative US data with the pre-operative images.
  • the template of ROIs can vary, depending on the underlying bone structure (or device interface), and the position of the ultrasound probe.
  • images based on the intraoperative ultrasound data can be fused with the pre-operative non-ultrasound images to provide a real-time navigation guidance to the operating surgeon during the surgical procedure.
  • the fused images can be presented on display 811.
  • the fused images can be projected on a platform for mixed-reality, augmented reality, or virtual reality.
  • the navigation system can combine the strengths of multiple radiological imaging modalities to achieve accurate and interactive guidance in the operating room.
  • Some implementations can accurately co-register, in real-time, navigated insonified data of the posterior osseous surface of the spine to pre-operatively acquired CT or MRI reference data of the posterior osseous surface of the spine.
  • the implementations are also capable of co-registering images from regions other than the spinal column region, such as the pelvic region, the sacral region, or the occipital region. Building on the co-registered data, the implementations can provide intraoperative guidance during spinal surgery, for example, by projecting fused images in real-time to the operating surgeon in the operating room.
  • Fig. 9 is a block diagram illustrating an example of a computer system used to provide computational functionalities associated with described algorithms, methods, functions, processes, flows, and procedures, according to an implementation of the present disclosure.
  • the illustrated computer 902 is intended to encompass any computing device such as a server, desktop computer, laptop/notebook computer, wireless data port, smart phone, personal data assistant (PDA), tablet computing device, one or more processors within these devices, another computing device, or a combination of computing devices, including physical or virtual instances of the computing device, or a combination of physical or virtual instances of the computing device.
  • a server desktop computer
  • laptop/notebook computer wireless data port
  • smart phone personal data assistant (PDA), tablet computing device
  • PDA personal data assistant
  • tablet computing device one or more processors within these devices
  • another computing device or a combination of computing devices, including physical or virtual instances of the computing device, or a combination of physical or virtual instances of the computing device.
  • the computer 902 can comprise a computer that includes an input device, such as a keypad, keyboard, touch screen, another input device, or a combination of input devices that can accept user information, and an output device that conveys information associated with the operation of the computer 902, including digital data, visual, audio, another type of information, or a combination of types of information, on a graphical-type user interface (UI) (or GUI) or other UI.
  • an input device such as a keypad, keyboard, touch screen, another input device, or a combination of input devices that can accept user information
  • an output device that conveys information associated with the operation of the computer 902, including digital data, visual, audio, another type of information, or a combination of types of information, on a graphical-type user interface (UI) (or GUI) or other UI.
  • UI graphical-type user interface
  • the computer 902 can serve in a role in a computer system as a client, network component, a server, a database or another persistency, another role, or a combination of roles for performing the subject matter described in the present disclosure.
  • the illustrated computer 902 is communicably coupled with a network 903.
  • one or more components of the computer 902 can be configured to operate within an environment, including cloud-computing-based, local, global, another environment, or a combination of environments.
  • the computer 902 is an electronic computing device operable to receive, transmit, process, store, or manage data and information associated with the described subject matter. According to some implementations, the computer 902 can also include or be communicably coupled with a server, including an application server, e-mail server, web server, caching server, streaming data server, another server, or a combination of servers.
  • a server including an application server, e-mail server, web server, caching server, streaming data server, another server, or a combination of servers.
  • the computer 902 can receive requests over network 903 (for example, from a client software application executing on another computer 902) and respond to the received requests by processing the received requests using a software application or a combination of software applications.
  • requests can also be sent to the computer 902 from internal users, external or third-parties, or other entities, individuals, systems, or computers.
  • Each of the components of the computer 902 can communicate using a system bus 903.
  • any or all of the components of the computer 902, including hardware, software, or a combination of hardware and software can interface over the system bus 903 using an application programming interface (API) 912, a service layer 913, or a combination of the API 912 and service layer 913.
  • the API 912 can include specifications for routines, data structures, and object classes.
  • the API 912 can be either computer-language independent or dependent and refer to a complete interface, a single function, or even a set of APIs.
  • the service layer 913 provides software services to the computer 902 or other components (whether illustrated or not) that are communicably coupled to the computer 902.
  • the functionality of the computer 902 can be accessible for all service consumers using this service layer.
  • Software services such as those provided by the service layer 913, provide reusable, defined functionalities through a defined interface.
  • the interface can be software written in JAVA, C++, another computing language, or a combination of computing languages providing data in extensible markup language (XML) format, another format, or a combination of formats.
  • XML extensible markup language
  • alternative implementations can illustrate the API 912 or the service layer 913 as stand-alone components in relation to other components of the computer 902 or other components (whether illustrated or not) that are communicably coupled to the computer 902.
  • any or all parts of the API 912 or the service layer 913 can be implemented as a child or a sub-module of another software module, enterprise application, or hardware module without departing from the scope of the present disclosure.
  • the computer 902 includes an interface 904. Although illustrated as a single interface 904 in Fig. 9, two or more interfaces 904 can be used according to particular needs, desires, or particular implementations of the computer 902.
  • the interface 904 is used by the computer 902 for communicating with another computing system (whether illustrated or not) that is communicatively linked to the network 903 in a distributed environment.
  • the interface 904 is operable to communicate with the network 903 and comprises logic encoded in software, hardware, or a combination of software and hardware. More specifically, the interface 904 can comprise software supporting one or more communication protocols associated with communications such that the network 903 or interface’s hardware is operable to communicate physical signals within and outside of the illustrated computer 902.
  • the computer 902 includes a processor 905. Although illustrated as a single processor 905 in Fig. 9, two or more processors can be used according to particular needs, desires, or particular implementations of the computer 902. Generally, the processor 905 executes instructions and manipulates data to perform the operations of the computer 902 and any algorithms, methods, functions, processes, flows, and procedures as described in the present disclosure.
  • the computer 902 also includes a database 906 that can hold data for the computer 902, another component in communication with the network 903 (whether illustrated or not), or a combination of the computer 902 and another component.
  • database 906 can be an in-memory, conventional, or another type of database storing data consistent with the present disclosure.
  • database 906 can be a combination of two or more different database types (for example, a hybrid in-memory and conventional database) according to particular needs, desires, or particular implementations of the computer 902 and the described functionality.
  • two or more databases of similar or differing types can be used according to particular needs, desires, or particular implementations of the computer 902 and the described functionality.
  • database 906 is illustrated as an integral component of the computer 902, in alternative implementations, database 906 can be external to the computer 902. As illustrated, the database 906 holds the previously described data 916 including, for example, pre-operative image volume (including CT and MRI data set), intra-operative data volume (including, for example, raw I/Q data from the ultrasound probe), templates of patches where matches are more likely and promising, and templates of matches where matches are more unlikely and unpromising, as outlined in Figs. 1 and 8B.
  • pre-operative image volume including CT and MRI data set
  • intra-operative data volume including, for example, raw I/Q data from the ultrasound probe
  • the computer 902 also includes a memory 907 that can hold data for the computer 902, another component or components communicatively linked to the network 903 (whether illustrated or not), or a combination of the computer 902 and another component.
  • Memory 907 can store any data consistent with the present disclosure.
  • memory 907 can be a combination of two or more different types of memory (for example, a combination of semiconductor and magnetic storage) according to particular needs, desires, or particular implementations of the computer 902 and the described functionality.
  • two or more memories 907 or similar or differing types can be used according to particular needs, desires, or particular implementations of the computer 902 and the described functionality.
  • memory 907 is illustrated as an integral component of the computer 902, in alternative implementations, memory 907 can be external to the computer 902.
  • the application 908 is an algorithmic software engine providing functionality according to particular needs, desires, or particular implementations of the computer 902, particularly with respect to functionality described in the present disclosure.
  • application 908 can serve as one or more components, modules, or applications.
  • the application 908 can be implemented as multiple applications 908 on the computer 902.
  • the application 908 can be external to the computer 902.
  • the computer 902 can also include a power supply 914.
  • the power supply 914 can include a rechargeable or non-rechargeable battery that can be configured to be either user- or non-user-replaceable.
  • the power supply 914 can include power-conversion or management circuits (including recharging, standby, or another power management functionality).
  • the power-supply 914 can include a power plug to allow the computer 902 to be plugged into a wall socket or another power source to, for example, power the computer 902 or recharge a rechargeable battery.
  • computers 902 there can be any number of computers 902 associated with, or external to, a computer system containing computer 902, each computer 902 communicating over network 903.
  • client can be any number of computers 902 associated with, or external to, a computer system containing computer 902, each computer 902 communicating over network 903.
  • client can be any number of computers 902 associated with, or external to, a computer system containing computer 902, each computer 902 communicating over network 903.
  • client can be used interchangeably, as appropriate, without departing from the scope of the present disclosure.
  • present disclosure contemplates that many users can use one computer 902, or that one user can use multiple computers 902.
  • Implementations of the subject matter and the functional operations described in this specification can be implemented in digital electronic circuitry, in tangibly embodied computer software or firmware, in computer hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them.
  • Software implementations of the described subject matter can be implemented as one or more computer programs, that is, one or more modules of computer program instructions encoded on a tangible, non-transitory, computer-readable computer- storage medium for execution by, or to control the operation of, data processing apparatus.
  • the program instructions can be encoded in/on an artificially generated propagated signal, for example, a machine-generated electrical, optical, or electromagnetic signal that is generated to encode information for transmission to a receiver apparatus for execution by a data processing apparatus.
  • the computer- storage medium can be a machine-readable storage device, a machine-readable storage substrate, a random or serial access memory device, or a combination of computer- storage mediums.
  • Configuring one or more computers means that the one or more computers have installed hardware, firmware, or software (or combinations of hardware, firmware, and software) so that when the software is executed by the one or more computers, particular computing operations are performed.
  • real-time means that an action and a response are temporally proximate such that an individual perceives the action and the response occurring substantially simultaneously.
  • time difference for a response to display (or for an initiation of a display) of data following the individual’s action to access the data can be less than 1 millisecond (ms), less than 1 second (s), or less than 5 s.
  • data processing apparatus refers to data processing hardware and encompass all kinds of apparatus, devices, and machines for processing data, including by way of example, a programmable processor, a computer, or multiple processors or computers.
  • the apparatus can also be, or further include special purpose logic circuitry, for example, a central processing unit (CPU), an FPGA (field programmable gate array), or an ASIC (application-specific integrated circuit).
  • the data processing apparatus or special purpose logic circuitry can be hardware- or software-based (or a combination of both hardware- and software-based).
  • the apparatus can optionally include code that creates an execution environment for computer programs, for example, code that constitutes processor firmware, a protocol stack, a database management system, an operating system, or a combination of execution environments.
  • code that constitutes processor firmware for example, code that constitutes processor firmware, a protocol stack, a database management system, an operating system, or a combination of execution environments.
  • the present disclosure contemplates the use of data processing apparatuses with an operating system of some type, for example LINUX, UNIX, WINDOWS, MAC OS, ANDROID, IOS, another operating system, or a combination of operating systems.
  • a computer program which can also be referred to or described as a program, software, a software application, a unit, a module, a software module, a script, code, or other component can be written in any form of programming language, including compiled or interpreted languages, or declarative or procedural languages, and it can be deployed in any form, including, for example, as a stand-alone program, module, component, or subroutine, for use in a computing environment.
  • a computer program can, but need not, correspond to a file in a file system.
  • a program can be stored in a portion of a file that holds other programs or data, for example, one or more scripts stored in a markup language document, in a single file dedicated to the program in question, or in multiple coordinated files, for example, files that store one or more modules, sub-programs, or portions of code.
  • a computer program can be deployed to be executed on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network.
  • While portions of the programs illustrated in the various figures can be illustrated as individual components, such as units or modules, that implement described features and functionality using various objects, methods, or other processes, the programs can instead include a number of sub-units, sub-modules, third-party services, components, libraries, and other components, as appropriate. Conversely, the features and functionality of various components can be combined into single components, as appropriate. Thresholds used to make computational determinations can be statically, dynamically, or both statically and dynamically determined.
  • Described methods, processes, or logic flows represent one or more examples of functionality consistent with the present disclosure and are not intended to limit the disclosure to the described or illustrated implementations, but to be accorded the widest scope consistent with the described principles and features.
  • the described methods, processes, or logic flows can be performed by one or more programmable computers executing one or more computer programs to perform functions by operating on input data and generating output data.
  • the methods, processes, or logic flows can also be performed by, and apparatus can also be implemented as, special purpose logic circuitry, for example, a CPU, an FPGA, or an ASIC.
  • Computers for the execution of a computer program can be based on general or special purpose microprocessors, both, or another type of CPU.
  • a CPU will receive instructions and data from and write to a memory.
  • the essential elements of a computer are a CPU, for performing or executing instructions, and one or more memory devices for storing instructions and data.
  • a computer will also include, or be operatively coupled to, receive data from or transfer data to, or both, one or more mass storage devices for storing data, for example, magnetic, magneto-optical disks, or optical disks.
  • mass storage devices for storing data, for example, magnetic, magneto-optical disks, or optical disks.
  • a computer need not have such devices.
  • a computer can be embedded in another device, for example, a mobile telephone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a global positioning system (GPS) receiver, or a portable memory storage device.
  • PDA personal digital assistant
  • GPS global positioning system
  • Non-transitory computer-readable media for storing computer program instructions and data can include all forms of media and memory devices, magnetic devices, magneto optical disks, and optical memory device.
  • Memory devices include semiconductor memory devices, for example, random access memory (RAM), read-only memory (ROM), phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), and flash memory devices.
  • RAM random access memory
  • ROM read-only memory
  • PRAM phase change memory
  • SRAM static random access memory
  • DRAM dynamic random access memory
  • EPROM erasable programmable read-only memory
  • EEPROM electrically erasable programmable read-only memory
  • flash memory devices include, for example, tape, cartridges, cassettes, internal/removable disks.
  • Optical memory devices include, for example, digital video disc (DVD), CD-ROM, DVD+/-R, DVD-RAM, DVD-ROM, HD-DVD, and BLURAY, and other optical memory technologies.
  • the memory can store various objects or data, including caches, classes, frameworks, applications, modules, backup data, jobs, web pages, web page templates, data structures, database tables, repositories storing dynamic information, or other appropriate information including any parameters, variables, algorithms, instructions, rules, constraints, or references. Additionally, the memory can include other appropriate data, such as logs, policies, security or access data, or reporting files.
  • the processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.
  • implementations of the subject matter described in this specification can be implemented on a computer having a display device, for example, a CRT (cathode ray tube), LCD (liquid crystal display), LED (Light Emitting Diode), or plasma monitor, for displaying information to the user and a keyboard and a pointing device, for example, a mouse, trackball, or trackpad by which the user can provide input to the computer.
  • Input can also be provided to the computer using a touchscreen, such as a tablet computer surface with pressure sensitivity, a multi-touch screen using capacitive or electric sensing, or another type of touchscreen.
  • Other types of devices can be used to interact with the user.
  • feedback provided to the user can be any form of sensory feedback.
  • Input from the user can be received in any form, including acoustic, speech, or tactile input.
  • a computer can interact with the user by sending documents to and receiving documents from a client computing device that is used by the user.
  • GUI graphical user interface
  • GUI can be used in the singular or the plural to describe one or more graphical user interfaces and each of the displays of a particular graphical user interface. Therefore, a GUI can represent any graphical user interface, including but not limited to, a web browser, a touch screen, or a command line interface (CLI) that processes information and efficiently presents the information results to the user.
  • a GUI can include a plurality of user interface (UI) elements, some or all associated with a web browser, such as interactive fields, pull-down lists, and buttons. These and other UI elements can be related to or represent the functions of the web browser.
  • UI user interface
  • Implementations of the subject matter described in this specification can be implemented in a computing system that includes a back-end component, for example, as a data server, or that includes a middleware component, for example, an application server, or that includes a front-end component, for example, a client computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the subject matter described in this specification, or any combination of one or more such back-end, middleware, or front-end components.
  • the components of the system can be interconnected by any form or medium of wireline or wireless digital data communication (or a combination of data communication), for example, a communication network.
  • Examples of communication networks include a local area network (LAN), a radio access network (RAN), a metropolitan area network (MAN), a wide area network (WAN), Worldwide Interoperability for Microwave Access (WIMAX), a wireless local area network (WLAN) using, for example, 802.11 a/b/g/n or 802.20 (or a combination of 802.1 lx and 802.20 or other protocols consistent with the present disclosure), all or a portion of the Internet, another communication network, or a combination of communication networks.
  • the communication network can communicate with, for example, Internet Protocol (IP) packets, Frame Relay frames, Asynchronous Transfer Mode (ATM) cells, voice, video, data, or other information between networks addresses.
  • IP Internet Protocol
  • ATM Asynchronous Transfer Mode
  • the computing system can include clients and servers.
  • a client and server are generally remote from each other and typically interact through a communication network.
  • the relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
  • the terms “comprises” and “comprising” are to be construed as being inclusive and open-ended, and not exclusive. Specifically, when used in the specification and claims, the terms “comprises” and “comprising” and variations thereof mean the specified features, steps or components are included. These terms are not to be interpreted to exclude the presence of other features, steps or components.
  • exemplary means “serving as an example, instance, or illustration,” and should not be construed as preferred or advantageous over other configurations disclosed herein.
  • the terms “about” and “approximately” are meant to cover variations that may exist in the upper and lower limits of the ranges of values, such as variations in properties, parameters, and dimensions. In one non-limiting example, the terms “about” and “approximately” mean plus or minus 10 percent or less.
  • any claimed implementation is considered to be applicable to at least a computer-implemented method; a non-transitory, computer-readable medium storing computer-readable instructions to perform the computer-implemented method; and a computer system comprising a computer memory interoperably coupled with a hardware processor configured to perform the computer-implemented method or the instructions stored on the non-transitory, computer-readable medium.

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Molecular Biology (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Veterinary Medicine (AREA)
  • Animal Behavior & Ethology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biophysics (AREA)
  • Epidemiology (AREA)
  • Theoretical Computer Science (AREA)
  • Primary Health Care (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Optics & Photonics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Vascular Medicine (AREA)
  • Pulmonology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • Computational Linguistics (AREA)
  • Evolutionary Computation (AREA)
  • Mathematical Physics (AREA)
  • Urology & Nephrology (AREA)
  • Robotics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Gynecology & Obstetrics (AREA)

Abstract

Un procédé comprend l'accès à des données ultrasonores codant des informations de surface tridimensionnelles d'une ou de plusieurs structures corporelles dans une région, l'extraction d'une première représentation de surface tridimensionnelle de la ou des structures corporelles sur la base des données ultrasonores, l'accès à des données d'imagerie non ultrasonores obtenues à partir de la réalisation d'une imagerie non ultrasonore de la région; l'extraction d'une seconde représentation de surface tridimensionnelle de la ou des structures corporelles sur la base des données d'imagerie non ultrasonores; l'identification, à l'aide d'un algorithme d'apprentissage profond, d'une ou de plusieurs régions d'intérêt (ROI) à partir de la première représentation de surface tridimensionnelle de telle sorte que, lors de l'alignement de la première représentation de surface tridimensionnelle et de la seconde représentation de surface tridimensionnelle sur la ou les régions d'intérêt (ROI), une transformation spatiale est déterminée; et, sur la base de l'application de la transformation spatiale, la génération d'une superposition des informations anatomiques de surface tridimensionnelle à partir des données d'imagerie non ultrasonores sur les informations de surface tridimensionnelle à partir des données ultrasonores.
PCT/US2022/018959 2021-03-05 2022-03-04 Système de guidage vertébral peropératoire à navigation radiologique WO2022187659A1 (fr)

Priority Applications (8)

Application Number Priority Date Filing Date Title
US18/278,670 US20240138818A1 (en) 2021-03-05 2022-03-04 Radiologically navigated intra-operative spinal guidance system
JP2023553954A JP2024510140A (ja) 2021-03-05 2022-03-04 放射線学的なナビゲートを用いる術中脊椎誘導システム
CA3209143A CA3209143A1 (fr) 2021-03-05 2022-03-04 Systeme de guidage vertebral peroperatoire a navigation radiologique
KR1020237033752A KR20240016247A (ko) 2021-03-05 2022-03-04 방사선학적으로 내비게이팅되는 수술-중 척추 안내 시스템
IL305327A IL305327A (en) 2021-03-05 2022-03-04 Radiologically guided intrasurgical spinal guidance system
CN202280032767.5A CN117241757A (zh) 2021-03-05 2022-03-04 放射导航的术中脊柱引导系统
EP22764159.4A EP4301268A1 (fr) 2021-03-05 2022-03-04 Système de guidage vertébral peropératoire à navigation radiologique
AU2022231159A AU2022231159A1 (en) 2021-03-05 2022-03-04 Radiologically navigated intra-operative spinal guidance system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202163157483P 2021-03-05 2021-03-05
US63/157,483 2021-03-05

Publications (2)

Publication Number Publication Date
WO2022187659A1 WO2022187659A1 (fr) 2022-09-09
WO2022187659A9 true WO2022187659A9 (fr) 2023-10-12

Family

ID=83155570

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2022/018959 WO2022187659A1 (fr) 2021-03-05 2022-03-04 Système de guidage vertébral peropératoire à navigation radiologique

Country Status (9)

Country Link
US (1) US20240138818A1 (fr)
EP (1) EP4301268A1 (fr)
JP (1) JP2024510140A (fr)
KR (1) KR20240016247A (fr)
CN (1) CN117241757A (fr)
AU (1) AU2022231159A1 (fr)
CA (1) CA3209143A1 (fr)
IL (1) IL305327A (fr)
WO (1) WO2022187659A1 (fr)

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6246784B1 (en) * 1997-08-19 2001-06-12 The United States Of America As Represented By The Department Of Health And Human Services Method for segmenting medical images and detecting surface anomalies in anatomical structures
US6106464A (en) * 1999-02-22 2000-08-22 Vanderbilt University Apparatus and method for bone surface-based registration of physical space with tomographic images and for guiding an instrument relative to anatomical sites in the image
US6379302B1 (en) * 1999-10-28 2002-04-30 Surgical Navigation Technologies Inc. Navigation information overlay onto ultrasound imagery
JP5161427B2 (ja) * 2006-02-20 2013-03-13 株式会社東芝 画像撮影装置、画像処理装置及びプログラム
US8771188B2 (en) * 2007-06-20 2014-07-08 Perception Raisonnement Action En Medecine Ultrasonic bone motion tracking system
CA2845044C (fr) * 2011-08-12 2023-03-28 Jointvue, Llc Dispositif et procedes d'echographie en 3d
CA2852233C (fr) * 2011-10-14 2023-08-08 Jointvue, Llc Reconstruction ultrasonore 3d en temps reel du genou et ses complications pour implants specifiques a un patient et injections articulaires 3d
US10957010B2 (en) * 2019-08-07 2021-03-23 General Electric Company Deformable registration for multimodal images

Also Published As

Publication number Publication date
KR20240016247A (ko) 2024-02-06
WO2022187659A1 (fr) 2022-09-09
EP4301268A1 (fr) 2024-01-10
AU2022231159A1 (en) 2023-09-07
US20240138818A1 (en) 2024-05-02
CA3209143A1 (fr) 2022-09-09
CN117241757A (zh) 2023-12-15
JP2024510140A (ja) 2024-03-06
IL305327A (en) 2023-10-01

Similar Documents

Publication Publication Date Title
US20230301633A1 (en) Ultrasound Bone Registration With Learning-Based Segmentation And Sound Speed Calibration
Hacihaliloglu et al. Automatic bone localization and fracture detection from volumetric ultrasound images using 3-D local phase features
Sternheim et al. Navigated pelvic osteotomy and tumor resection: a study assessing the accuracy and reproducibility of resection planes in Sawbones and cadavers
US20140046186A1 (en) Bone surface image reconstruction using ultrasound
Gong et al. Interactive initialization of 2D/3D rigid registration
Pandey et al. Fast and automatic bone segmentation and registration of 3D ultrasound to CT for the full pelvic anatomy: a comparative study
Chen et al. A system for ultrasound-guided computer-assisted orthopaedic surgery
Rasoulian et al. Feature‐based multibody rigid registration of CT and ultrasound images of lumbar spine
Gueziri et al. The state-of-the-art in ultrasound-guided spine interventions
Brudfors et al. Towards real-time, tracker-less 3D ultrasound guidance for spine anaesthesia
US20230293248A1 (en) Efficient positioning of a mechatronic arm
EP3234832B1 (fr) Procédé d'optimisation de la position d'une partie du corps d'un patient par rapport à une source d'imagerie
US10420532B2 (en) Method and apparatus for calculating the contact position of an ultrasound probe on a head
Schumann State of the art of ultrasound-based registration in computer assisted orthopedic interventions
Tang et al. A CNN-based method to reconstruct 3-D spine surfaces from US images in vivo
Brignol et al. Automatic extraction of vertebral landmarks from ultrasound images: A pilot study
Hamming et al. Automatic image‐to‐world registration based on x‐ray projections in cone‐beam CT‐guided interventions
Hacihaliloglu 3D ultrasound for orthopedic interventions
US20240138818A1 (en) Radiologically navigated intra-operative spinal guidance system
Krysztoforski et al. Noninvasive ultrasonic measuring system for bone geometry examination
Brendel et al. Bone registration with 3D CT and ultrasound data sets
Gonzalez et al. Visualization of custom drill bit tips in a human vertebra for photoacoustic-guided spinal fusion surgeries
Diakov et al. Vector field analysis for surface registration in computer‐assisted ENT surgery
TWI842001B (zh) 註冊二維影像資料組與感興部位的三維影像資料組的方法及導航系統
Mcdonald et al. A comparison of registration techniques for computer-and image-assisted elbow surgery

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22764159

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2022231159

Country of ref document: AU

WWE Wipo information: entry into national phase

Ref document number: 305327

Country of ref document: IL

WWE Wipo information: entry into national phase

Ref document number: 3209143

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 18278670

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2023553954

Country of ref document: JP

ENP Entry into the national phase

Ref document number: 2022231159

Country of ref document: AU

Date of ref document: 20220304

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 1020237033752

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 2022764159

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2022764159

Country of ref document: EP

Effective date: 20231005

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 202280032767.5

Country of ref document: CN