WO2016037160A2 - Système et procédé de protocole de détection d'objet étranger - Google Patents

Système et procédé de protocole de détection d'objet étranger Download PDF

Info

Publication number
WO2016037160A2
WO2016037160A2 PCT/US2015/048742 US2015048742W WO2016037160A2 WO 2016037160 A2 WO2016037160 A2 WO 2016037160A2 US 2015048742 W US2015048742 W US 2015048742W WO 2016037160 A2 WO2016037160 A2 WO 2016037160A2
Authority
WO
WIPO (PCT)
Prior art keywords
image
images
detection
objects
ray
Prior art date
Application number
PCT/US2015/048742
Other languages
English (en)
Other versions
WO2016037160A3 (fr
Inventor
Vicko GLUNCIC
Gady AGAM
Mario Moric
Shirley Virginia RICHARD
Gan LIN
Kevin Richard ERDMAN
Original Assignee
RaPID Medical Technologies, LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by RaPID Medical Technologies, LLC filed Critical RaPID Medical Technologies, LLC
Priority to EP15837652.5A priority Critical patent/EP3302284A2/fr
Priority to US14/846,885 priority patent/US9947090B2/en
Priority to US14/846,880 priority patent/US20160066877A1/en
Priority to US14/846,882 priority patent/US20160066787A1/en
Publication of WO2016037160A2 publication Critical patent/WO2016037160A2/fr
Publication of WO2016037160A3 publication Critical patent/WO2016037160A3/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/20—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
    • A61B6/12—Devices for detecting or locating foreign bodies
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
    • A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
    • A61B6/5211—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/70—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
    • A61B6/10—Application or adaptation of safety means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10116—X-ray image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30021—Catheter; Guide wire
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30052—Implant; Prosthesis

Definitions

  • the invention relates to medical pattern recognition systems and methods.
  • the field of the invention is that of medical protocols for enhancing the ability to detect and remove foreign objects from the body.
  • IMD's retained surgical foreign objects
  • RSFOs retained surgical foreign objects
  • RSF retained surgical items
  • IMD implanted medical device
  • An IMD is a medical device that is partly or totally surgically inserted into the human body or a natural orifice and is expected to remain implanted for an extended period or may be permanent. IMD's can further be classified either as active, those that use electricity, or passive, and those that do not use electricity. In the US, medical devices are regulated by the FDA and classified into three classes, on basis of risk and the level of regulatory control that is necessary to assure the safety and effectiveness: class I, class II, and class III. Class III devices include devices that generally affect the functioning of vital organs and/or life support systems with very high health risk if the device were to malfunction. [005] Identification of an IMD during patient admission, and especially in emergencies, is crucial for the safe and efficient management of that patient.
  • IMD's are initially reported by patients or noted on admission and/or emergency x-rays ("XR"), magnetic resonance images ("MRI"), ultrasound or computerized tomography (“CT”) images, necessitating, often ineffective, attempts to gather more information regarding the device in question. This usually involves contacting the patient's family, primary care providers or health care institutions previously visited by the patient. Even when such attempts are successful, available information about the patient's device is often incomplete, unreliable and delayed.
  • XR emergency x-rays
  • MRI magnetic resonance images
  • CT computerized tomography
  • radio-frequency identification (RFID) technology uses radio waves to transfer data from an electronic tag to identify and track the tagged device.
  • RFID radio-frequency identification
  • the rapidly increasing number of IMD's and their manufacturers, absence of the standardized tools/methods capable of RF sensing, identifying, and reprogramming IMD's, radio interference problems, ethical/security issues, and the fact that many IMD's do not have RF capabilities make this technology less convenient for rapid identification. This disadvantage is particularly obvious in medical emergencies and emergency room settings.
  • percutaneous catheters and ports have been damaged by exceeding their pressure ratings during therapeutic infusions, necessitating subsequent surgical interventions / exchange or repair.
  • IMD's are compatible with MRI and CT imaging but/and/or requires reprogramming after the completion of the MRI that has been frequently missed. These effects on the IMD are not always evident or immediately observed (such as unintended re-programming, e.g., ventricular-peritoneal shunts' valves) and can not only lead to delays but also to serious and possibly disastrous complications.
  • ventricular-peritoneal shunts' valves can not only lead to delays but also to serious and possibly disastrous complications.
  • there are patients that do not receive optimal treatment and diagnostic procedures even though their devices are compatible with such treatments.
  • pacemakers currently on the market are compatible with MRI.
  • RSI Retained surgical item
  • Intra-operative or early post-operative identification of RSIs is critical for safe and efficient management of surgical patients.
  • Current recommendations for prevention of RSIs in the operating room include methodical wound exploration before closing, usage of standardized practices for surgical items accounting, usage of items with radiopaque markers within the operative site, and mandatory operative field XRs before wound closure when a item count discrepancy occurs.
  • radiographic screening is recommended at the end of an emergent surgical procedure, unexpected change in the procedure, and for patients with a high body mass index.
  • Some institutions also conduct routine postoperative screening XRs for the prevention of RFOs. Therefore portable XR radiological protocols have become crucial for timely RSIs detection.
  • Technological aids to assist the OR team in the detection and prevention of retained sponges, gauze towels, and laparotomy pads include radio-frequency detectable sponge systems and bar-coded sponge systems. These aids are intended to augment the standardized manual count practices, and to not replace them.
  • Operative field XR is mandatory when there is a counting discrepancy of surgical instruments or materials at the end of the procedure.
  • surgical instruments and/or materials must be counted, except for procedures that are routinely concluded with a radiograph (for example, an orthopedic case to assure proper alignment of a bone or implant).
  • XR is mandatory if an instrument count is not performed, and the evaluation of the XR must be performed before the patient is transferred from the OR to determine whether any instruments or sponge has been retained.
  • XR screening is also recommended/mandatory at the end of emergent surgical procedures, unexpected changes in procedures, or in patients with high BMI. Some institutions use postoperative screening XRs routinely. In all of these cases, the completion of the surgical case may be delayed until radiologic evaluation is received. Assuming the patient is stable, current recommendations are that in the event of an incorrect count, a XR of the operative field should be made available to a radiologist within 20 minutes and their evaluation/confirmation of the results of the XR should be provided back to the OR within another 20 minutes. This process frequently takes significantly more time than 40 minutes.
  • Portable XR is also a method of choice for determination of the relative position/location of a RSI. This is particularly important if the specific tissue layer or surgical incision/wound is already closed and additional instruments are present in the XR image.
  • PACS picture archiving and communication system
  • ISO Digital Imaging and Communication in Medicine
  • patient safety measures include an effective operative room communication; mandatory counts of surgical instruments and sponges, methodical wound examinations, and XR imaging. Mistakes in counts happen in up to 12.5% of surgeries frequently prompting mandatory XR of the surgical field to rule out RSI. Due to these concerns many hospital systems nowadays mandate XR at the end of the complex surgeries.
  • IMDs Today there are more than 5000 IMDs on the market such as pacemakers, defibrillators, vagal nerve stimulators etc. Upon patient admission, IMDs are frequently initially reported by patients or noted on medical radiological images, necessitating often-ineffective attempts to determine the specific type of IMD. Each year more than 2,000 deaths occur due to mismanagement of IMDs such as pacemakers, insulin pumps, and others. Currently, there is no universal solution for the identification of IMDs - mandated by the United States Congress in 2007 but still not yet in place.
  • Embodiments of the present invention involve novel XR protocols that have unique combinations of specific steps / methods to optimize detection of RSIs and identification of IMDs by in clinical settings - process which has been termed "RaPID Response X-ray".
  • the invention in several embodiments, provides a quality assurance and patient safety platform including healthcare software for the detection of RSIs or identification of IMDs in radiological images integrated with hospitals' PACSs or standalone application available through the hospital electronic medical record interface.
  • the platform aids medical experts analyzing radiological images when searching for RSIs or when trying to identify IMDs. Specific algorithms may be used to enhance and improve the detection of RSIs and/or identification of IMDs, but the specific step of obtaining a XR image particularly for the detection of RSIs has yet to be implemented prior to the invention.
  • Another aspect of platform's embodiments is the identification of IMDs.
  • CADe Computer Aided Detection
  • the embodiments of the invention provide a specific workflow process - developed by using the business process modeling methods—which has been termed "RaPID Response X- ray.”
  • RaPID Response X- ray a specific workflow process - developed by using the business process modeling methods— which has been termed "RaPID Response X- ray.”
  • Other aspects of embodiments of the invention involve usage of CADe software in combination with: X-ray plate with telecommunication / Wi-Fi capabilities usage for the purpose of shortening the time for image transfer to PACS, and specific settings (kV and mAs) of the portable XR machine optimized for RSIs detection or EVIDs identification.
  • the insertion of specific textual denominators into the image is based on what information is needed on the portable XR machine before the image is being taken and uploaded to PACS.
  • optimization of the PACSs flow to automatically put on the top of the radiologist's work list images with these specific denominators is provided.
  • Still another embodiment provides automatic critical information feedback / alert if CADe detects RSIs or automatic IMD information insertion into electronic medical record if IMD is identified. This process significantly shortens the time necessary for radiological detection of RSIs or identification of IMD's and improves accuracy of the process.
  • the XR technician is provided with portable XR machine and XR plate with telecommunications / Wi-Fi capabilities in order for images to get instantaneously uploaded to PACS. This eliminates timely process of feeding a plate into the reader manually which is frequently not immediately available next to the OR suite or emergency department.
  • the portable XR machine is in the operating room and wireless XR plate is in the appropriate position beneath the patient the specific settings of the portable XR machine (including kV and mAs) should be applied rather then using standard setting for chest or abdomen XRs. These RSIs specific settings increase the image quality / contrast for detection of an IMD or RFO.
  • any deviation from the standard XR settings such as chest (CXR) or abdomen XR (KUB) predetermined settings with the intention to provide better contrast for identification is part of this process.
  • the ranges of XR settings are based on patient and physical characteristics of the RSI and IMD and demonstrated data.
  • specific textual image denominator will be assigned to the image— alerting physicians who will analyze image about RSI or IMD and providing information regarding the type of miscount / needle, sponge, or instrument, OR phone call back number, OR front desk pager, and surgeon's pager. This eliminates need for the phone call from the OR or ED to the radiologist specifying what we are searching for.
  • CADe software solutions for RSIs detection improves accuracy of detection and decreases time needed for image analysis by physician / radiologist.
  • Computer vision is in many respects superior to the human eye in the detection of defined objects.
  • Embodiments of the invention employ CADe software that is based on complex pattern recognition algorithms— combining elements of artificial intelligence with digital image processing— to detect RSIs on medical images. This system analyzes all the images and if any RSI is detected or IMD is identified inserts alert sign over the area of the image with suspected RFO / IMD.
  • radiologist will call the number assigned to the image while the software also triggers a pager alert sent to OR control desk and attending physician / surgeon.
  • the software automatically provide links in patient's EMR to the specific PACS images so that OR circulating nurse may pull specific set of images on the computer screen in the OR quickly. In this way a surgeon may get better orientation clues where in the operating field is RSI located.
  • the inventive software platform is not integrated into the PACS system but available on a portable X-ray machine or as a separate application— allowing the physician to have the option to activate for analysis.
  • the technician Once the technician arrives to take X-ray plate that stores the DICOM image, the technician asks: "Would you like a RAPID Response X-ray?" giving the option for the physician to choose.
  • the image is taken through RaPID Response X-ray process, analyzed through RaPID CADe application, and returned to portable XR machine screen, the operating room or emergency department physician or radiologist, the image is stamped with the RaPID Response X-ray logo along with any detections / identifications.
  • the RaPID patient safety and quality assurance platform / CADe software is integrated with the PACS. Images taken under the RaPID Response X-ray process are automatically stamped with RaPID' s logo and any identifications /detections are embedded in the image. The above-described process is thus routinely used when searching for the RSIs or trying to identify IMDs.
  • any of the two proceeding embodiments may be used.
  • a patient arrives and the physicians are in need of identifying the patient's IMD. If the RaPID patient safety and quality assurance platform / CADe software is not integrated within the PACS the first embodiment may apply and if integrated with the PACS the second embodiment may apply.
  • the present invention in another form, may be used for intraoperative identification of previously implanted IMDs such as in the cases of complex orthopedic procedures replacing the existing hardware in the patient.
  • the present invention in another form, may be used for the future assessment of complex robotic machinery / robots / humanoid robots / bionic robots / bionic human parts if they have specific modules replaced or upgraded.
  • XR or some other imaging modality may still be the fastest method to determine these parts by using methods and systems proposed in our current and previous application.
  • the present invention in another form, may be used to determine whether IMD is counterfeited or original.
  • XR or some other imaging modality may still be the fastest method to determine this by using methods and systems proposed in our current and previous application. This is becoming emerging patient safety issues as many patients are receiving counterfeited low or unacceptable quality IMDs aboard.
  • assessment whether IMD is real or forged may be crucial for transportation safety.
  • Existing XR scanners at the airports etc. may be upgraded with our software solutions and use slightly modified imaging process to determine counterfeited IMDs in passengers that possibly may be a security treat such as an implanted explosive device.
  • the present invention is also a method for more safe patient management and more effective OR time utilization as proposed combination of steps leads to faster interpretation of the intraoperative XR images even if some of the steps in the process are not available such as CADe software.
  • the OR circulating nurse should call the radiologist on call and convey the urgency of this particular X-ray, specify to the radiologist what item is apparently missing, and provide a call back number for him to call once he complete image analysis. Radiologist then identifies the image on the workflow list, analyze it, and report back to the OR.
  • the same process is pertinent in the case of the emergent or complex surgeries when the operational field X-ray is mandatory - except this time the OR circulating nurse communicates to the radiologist that clearance for RSIs is needed rather then specifying the missing object. This process takes approximately 20-40 minutes to complete.
  • RaPID Response X-ray RSI detection protocol Once the miscounts happens - the OR nurses communicate this finding to the OR team and request the surgeon to explore the surgical wound and the operation field and search for the missing item - while they perform another recount. If the recount confirms the missing item and surgeons don't find it they call the X-ray technician to take the RaPID Response X-ray of the operational field. Once in the OR, the technician has X-ray plate with Wi-Fi capabilities (which will automatically upload images to PACS as soon as they are taken rather then caring the plates to the reader machine) in the appropriate position, the specific settings of the X-ray machine (including kV and mAs) are applied (rather then using standard setting for chest or abdomen X-ray).
  • Wi-Fi capabilities which will automatically upload images to PACS as soon as they are taken rather then caring the plates to the reader machine
  • the specific textual image denominator will be assigned to the image - alerting physicians who will analyze image about emergent RSI suspicion - providing information regarding the type of miscount / needle, sponge, or instrument / and OR phone call back number with surgeon's pager.
  • specific optimization of the PACSs flow will automatically put it on the top of the radiologist's list images file with RSI specific denominator and alert. This will eliminate need for the phone call from the OR to the radiologist alerting that we need emergent analysis and specifying what is searching for and automatically put the X-rays on the top of the radiologist's workflow.
  • CADe computer assisted detection
  • radiologist's analysis is congruent with the CADe's software findings - positively detecting RSI an effective critical information alert will be conveyed - the radiologist calls the number assigned to the image while software - upon radiologist confirmation of the findings by mouse click on automatic conformation function embedded in image together with alert sign - also triggers a pager alert to be sent to OR control desk and attending surgeon. If radiologist's analysis is congruent with the CADe's software negative findings - the clearance information is conveyed in the same or similar manner.
  • the present invention is a detection system and method which addresses the aforementioned difficulties with a robust image processing and detection algorithm. By enhancing, extracting, and classifying small portions of each image, and the result is then spatially clustering the results to determine candidates for analysis and detection.
  • RSIs are difficult and challenging problem. This is evidenced by the fact that despite the many efforts to prevent such cases, the incidence of RSIs is still relatively high.
  • the technical challenge in developing a system for RSI lie in several areas.
  • objects such as sponges are deformable making it more difficult to develop computerized algorithms for their detection.
  • objects such as needles may be small and could be hard to detect especially in cases where they attach to other structures in the image.
  • the images may contain visual clutter due to wires, catheters, surgical instruments, and texture of other anatomical structures which make it more difficult to detect and recognize the objects of interest.
  • the contrast of the images may be low thus making it more difficult to detect the foreign objects in them.
  • the context of the image such as the anatomical region or acquisition parameters may vary and thus affect the performance of the classifiers.
  • the case of true retained surgical objects is rare, thus making it difficult to collect training and testing data.
  • embodiments of the invention avoid the additional hardware cost involved with RFID tags and RFID readers, and are suitable for small items such as needles which are difficult and/or impossible to be RFID tagged. Further, in contrast to RFID tags, embodiments of the invention are not susceptible to electromagnetic noise in the OR, and provide for localization of the RSI. This approach for RSI detection in X-ray images is unique. Similar commercial systems are not available on the market. [0047] Further aspects of the present invention involve usage of any specific XR machine settings and CADe software to asses / identify IMDs for counterfeiting purposes -such as determining whether IMD in the passenger boarding the airplane is real or fake on security XR screening.
  • a scanned image is sent from a local medical facility to an image processing remote computing facility, or cloud, for example over the Internet.
  • the remote facility has the public key of the local medical facility, so it may decode the image and encode encode the results so that only the local medical facility may identify the person associated with the image. Also, the remote facility does not need to save any information from the exchange, so no personal medical information needs to be stored in the cloud.
  • the local medical facility may identify the radiologist who will review the scan and the image processing output, and also send a package with the image and image processing results to the radiologist in an encrypted form.
  • Figure 1 is a schematic diagrammatic view of a network system in which embodiments of the present invention may be utilized.
  • Figure 2 is a block diagram of a computing system (either a server or client, or both, as appropriate), with optional input devices (e.g., keyboard, mouse, touch screen, etc.) and output devices, hardware, network connections, one or more processors, and memory/storage for data and modules, etc. which may be utilized in conjunction with embodiments of the present invention.
  • Figure 3 is a flow chart diagram of the operation of an embodiment of the present invention.
  • Figure 4 is a schematic diagrammatic view of operational hospital imaging systems involved with embodiments of the invention.
  • Figure 5 is a flow chart diagram of the operation of the present invention relating to the overall detection process of an embodiment of the present invention.
  • Figures 6A and 6B are radiographic photo images showing superimposed and actual sponges, respectively.
  • Figures 7A and 7B are radiographic photo images showing intermediate and final detection areas according to one embodiment of the present invention.
  • Figure 8 is a flow chart diagram of the operation of the present invention relating to the operational steps of an additional embodiment of the invention.
  • a computer generally includes a processor for executing instructions and memory for storing instructions and data.
  • the computer operating on such encoded instructions may become a specific type of machine, namely a computer particularly configured to perform the operations embodied by the series of instructions.
  • Some of the instructions may be adapted to produce signals that control operation of other machines and thus may operate through those control signals to transform materials far removed from the computer itself.
  • Data structures greatly facilitate data management by data processing systems, and are not accessible except through sophisticated software systems.
  • Data structures are not the information content of a memory, rather they represent specific electronic structural elements that impart or manifest a physical organization on the information stored in memory. More than mere abstraction, the data structures are specific electrical or magnetic structural elements in memory which simultaneously represent complex data accurately, often data modeling physical characteristics of related items, and provide increased efficiency in computer operation.
  • the manipulations performed are often referred to in terms, such as comparing or adding, commonly associated with mental operations performed by a human operator. No such capability of a human operator is necessary, or desirable in most cases, in any of the operations described herein which form part of embodiments of the present invention; the operations are machine operations.
  • Useful machines for performing the operations of one or more embodiments of the present invention include general purpose digital computers or other similar devices. In all cases the distinction between the method operations in operating a computer and the method of computation itself should be recognized.
  • One or more embodiments of the various embodiments of present invention relate to methods and apparatus for operating a computer in processing electrical or other (e.g., mechanical, chemical) physical signals to generate other desired physical manifestations or signals.
  • the computer operates on software modules, which are collections of signals stored on a media that represents a series of machine instructions that enable the computer processor to perform the machine instructions that implement the algorithmic steps.
  • Such machine instructions may be the actual computer code the processor interprets to implement the instructions, or alternatively may be a higher level coding of the instructions that is interpreted to obtain the actual computer code.
  • the software module may also include a hardware component, wherein some aspects of the algorithm are performed by the circuitry itself rather as a result of an instruction.
  • One or more embodiments of the present invention also relate to an apparatus for performing these operations.
  • This apparatus may be specifically constructed for the required purposes or it may comprise a general purpose computer as selectively activated or reconfigured by a computer program stored in the computer.
  • the algorithms presented herein are not inherently related to any particular computer or other apparatus unless explicitly indicated as requiring particular hardware.
  • the computer programs may communicate or relate to other programs or equipment through signals configured to particular protocols which may or may not require specific hardware or programming to interact.
  • various general purpose machines may be used with programs written in accordance with the teachings herein, or it may prove more convenient to construct more specialized apparatus to perform the required method steps. The required structure for a variety of these machines will appear from the description below.
  • One or more embodiments of the present invention may deal with "object-oriented” software, and particularly with an “object-oriented” operating system.
  • the "object-oriented” software is organized into “objects”, each comprising a block of computer instructions describing various procedures ("methods") to be performed in response to "messages" sent to the object or "events" which occur with the object.
  • Such operations include, for example, the manipulation of variables, the activation of an object by an external event, and the transmission of one or more messages to other objects.
  • Messages are sent and received between objects having certain functions and knowledge to carry out processes. Messages are generated in response to user instructions, for example, by a user activating an icon with a "mouse" pointer generating an event. Also, messages may be generated by an object in response to the receipt of a message. When one of the objects receives a message, the object carries out an operation (a message procedure) corresponding to the message and, if necessary, returns a result of the operation. Each object has a region where internal states (instance variables) of the object itself are stored and where the other objects are not allowed to access.
  • One feature of the object-oriented system is inheritance. For example, an object for drawing a "circle" on a display may inherit functions and knowledge from another object for drawing a "shape" on a display.
  • a programmer "programs" in an object-oriented programming language by writing individual blocks of code each of which creates an object by defining its methods.
  • a collection of such objects adapted to communicate with one another by means of messages comprises an object-oriented program.
  • Object-oriented computer programming facilitates the modeling of interactive systems in that each component of the system can be modeled with an object, the behavior of each component being simulated by the methods of its corresponding object, and the interactions between components being simulated by messages transmitted between objects.
  • An operator may stimulate a collection of interrelated objects comprising an object-oriented program by sending a message to one of the objects.
  • the receipt of the message may cause the object to respond by carrying out predetermined functions which may include sending additional messages to one or more other objects.
  • the other objects may in turn carry out additional functions in response to the messages they receive, including sending still more messages.
  • sequences of message and response may continue indefinitely or may come to an end when all messages have been responded to and no new messages are being sent.
  • a programmer need only think in terms of how each component of a modeled system responds to a stimulus and not in terms of the sequence of operations to be performed in response to some stimulus. Such sequence of operations naturally flows out of the interactions between the objects in response to the stimulus and need not be preordained by the programmer.
  • object-oriented programming makes simulation of systems of interrelated components more intuitive, the operation of an object-oriented program is often difficult to understand because the sequence of operations carried out by an object-oriented program is usually not immediately apparent from a software listing as in the case for sequentially organized programs. Nor is it easy to determine how an object-oriented program works through observation of the readily apparent manifestations of its operation. Most of the operations carried out by a computer in response to a program are "invisible" to an observer since only a relatively few steps in a program typically produce an observable computer output.
  • the term “object” relates to a set of computer instructions and associated data which can be activated directly or indirectly by the user.
  • the terms "windowing environment”, “running in windows”, and “object oriented operating system” are used to denote a computer user interface in which information is manipulated and displayed on a video display such as within bounded regions on a raster scanned video display.
  • the terms "network”, “local area network”, “LAN”, “wide area network”, or “WAN” mean two or more computers which are connected in such a manner that messages may be transmitted between the computers.
  • ⁇ typically one or more computers operate as a "server", a computer with large storage devices such as hard disk drives and communication hardware to operate peripheral devices such as printers or modems.
  • Other computers termed “workstations”, provide a user interface so that users of computer networks can access the network resources, such as shared data files, common peripheral devices, and inter-workstation communication.
  • Users activate computer programs or network resources to create “processes” which include both the general operation of the computer program along with specific operating characteristics determined by input variables and its environment. Similar to a process is an agent (sometimes called an intelligent agent), which is a process that gathers information or performs some other service without user intervention and on some regular schedule.
  • agent sometimes called an intelligent agent
  • an agent uses parameters typically provided by the user, searches locations either on the host machine or at some other point on a network, gathers the information relevant to the purpose of the agent, and presents it to the user on a periodic basis.
  • a “module” refers to a portion of a computer system and/or software program that carries out one or more specific functions and may be used alone or combined with other modules of the same system or program.
  • the term "desktop” means a specific user interface which presents a menu or display of objects with associated settings for the user associated with the desktop.
  • the desktop accesses a network resource, which typically requires an application program to execute on the remote server, the desktop calls an Application Program Interface (“API”), to allow the user to provide commands to the network resource and observe any output.
  • API Application Program Interface
  • the term “Browser” refers to a program which is not necessarily apparent to the user, but which is responsible for transmitting messages between the desktop and the network server and for displaying and interacting with the network user. Browsers are designed to utilize a communications protocol for transmission of text and graphic information over a world wide network of computers, namely the "World Wide Web" or simply the "Web”.
  • Examples of Browsers compatible with on or more embodiments of the present invention include the Chrome browser program developed by Google Inc. of Mountain View, California (Chrome is a trademark of Google Inc.), the Safari browser program developed by Apple Inc. of Cupertino, California (Safari is a registered trademark of Apple Inc.), Internet Explorer program developed by Microsoft Corporation (Internet Explorer is a trademark of Microsoft Corporation), the Opera browser program created by Opera Software ASA, or the Firefox browser program distributed by the Mozilla Foundation (Firefox is a registered trademark of the Mozilla Foundation).
  • Browsers display information which is formatted in a Standard Generalized Markup Language (“SGML”) or a HyperText Markup Language (“HTML”), both being scripting languages which embed non-visual codes in a text document through the use of special ASCII text codes.
  • SGML Standard Generalized Markup Language
  • HTML HyperText Markup Language
  • Files in these formats may be easily transmitted across computer networks, including global information networks like the Internet, and allow the Browsers to display text, images, and play audio and video recordings.
  • the Web utilizes these data file formats to conjunction with its communication protocol to transmit such information between servers and workstations.
  • Browsers may also be programmed to display information provided in an extensible Markup Language (“XML”) file, with XML files being capable of use with several Document Type Definitions (“DTD”) and thus more general in nature than SGML or HTML.
  • XML extensible Markup Language
  • the XML file may be analogized to an object, as the data and the stylesheet formatting are separately contained (formatting may be thought of as methods of displaying information, thus an XML file has data and an associated method).
  • JSON JavaScript Object Notation
  • PDA personal digital assistant
  • WW AN wireless wide area network
  • synchronization means the exchanging of information between a first device, e.g. a handheld device, and a second device, e.g. a desktop computer, either via wires or wirelessly. Synchronization ensures that the data on both devices are identical (at least at the time of synchronization).
  • communication primarily occurs through the transmission of radio signals over analog, digital cellular or personal communications service (“PCS”) networks. Signals may also be transmitted through microwaves and other electromagnetic waves.
  • PCS personal communications service
  • CDMA code-division multiple access
  • TDMA time division multiple access
  • GSM Global System for Mobile Communications
  • 3G Third Generation
  • 4G Fourth Generation
  • PDC personal digital cellular
  • CDPD packet-data technology over analog systems
  • AMPS Advance Mobile Phone Service
  • Mobile Software refers to the software operating system which allows for application programs to be implemented on a mobile device such as a mobile telephone or PDA.
  • Examples of Mobile Software are Java and Java ME (Java and JavaME are trademarks of Sun Microsystems, Inc. of Santa Clara, California), BREW (BREW is a registered trademark of Qualcomm Incorporated of San Diego, California), Windows Mobile (Windows is a registered trademark of Microsoft Corporation of Redmond, Washington), Palm OS (Palm is a registered trademark of Palm, Inc.
  • Symbian OS is a registered trademark of Symbian Software Limited Corporation of London, United Kingdom
  • ANDROID OS is a registered trademark of Google, Inc. of Mountain View, California
  • iPhone OS is a registered trademark of Apple, Inc. of Cupertino, California
  • Windows Phone 7 “Mobile Apps” refers to software programs written for execution with Mobile Software.
  • x-ray refers to x-ray (XR), magnetic resonance imaging (MRI), computerized tomography (CT), sonography, cone beam computerized tomography (CBCT), or any system that produces a quantitative spatial representation of a patient or object.
  • XR x-ray
  • MRI magnetic resonance imaging
  • CT computerized tomography
  • CBCT cone beam computerized tomography
  • PACS Picture Archiving and Communication System
  • Electronic images and reports are transmitted digitally via PACS; this eliminates the need to manually file, retrieve, or transport film jackets.
  • DICOM Digital Imaging and Communications in Medicine
  • Non-image data such as scanned documents, may be incorporated using consumer industry standard formats like PDF (Portable Document Format), once encapsulated in DICOM.
  • a PACS typically consists of four major components: imaging modalities such as X-ray computed tomography (CT) and magnetic resonance imaging (MRI) (although other modalities such as ultrasound (US), positron emission tomography (PET), endoscopy (ES), mammograms (MG), Digital radiography (DR), computed radiography (CR), etc. may be included), a secured network for the transmission of patient information, workstations and mobile devices for interpreting and reviewing images, and archives for the storage and retrieval of images and reports.
  • CT X-ray computed tomography
  • MRI magnetic resonance imaging
  • US positron emission tomography
  • ES endoscopy
  • MG mammograms
  • DR Digital radiography
  • CR computed radiography
  • PACS may refer to any image storage and retrieval system.
  • Figure 1 is a high-level block diagram of a computing environment 100 according to one embodiment.
  • Figure 1 illustrates server 110 and three clients 112 connected by network 114. Only three clients 112 are shown in Figure 1 in order to simplify and clarify the description.
  • Embodiments of the computing environment 100 may have thousands or millions of clients 112 connected to network 114, for example the Internet. Users (not shown) may operate software 116 on one of clients 112 to both send and receive messages network 114 via server 110 and its associated communications equipment and software (not shown).
  • FIG. 2 depicts a block diagram of computer system 210 suitable for implementing server 110 or client 112.
  • Computer system 210 includes bus 212 which interconnects major subsystems of computer system 210, such as central processor 214, system memory 217 (typically RAM, but which may also include ROM, flash RAM, or the like), input/output controller 218, external audio device, such as speaker system 220 via audio output interface 222, external device, such as display screen 224 via display adapter 226, serial ports 228 and 230, keyboard 232 (interfaced with keyboard controller 233), storage interface 234, disk drive 237 operative to receive floppy disk 238, host bus adapter (HBA) interface card 235A operative to connect with Fibre Channel network 290, host bus adapter (HBA) interface card 235B operative to connect to SCSI bus 239, and optical disk drive 240 operative to receive optical disk 242. Also included are mouse 246 (or other point-and-click device, coupled to bus 212 via serial port 228), modem 247 (coupled
  • Bus 212 allows data communication between central processor 214 and system memory 217, which may include read-only memory (ROM) or flash memory (neither shown), and random access memory (RAM) (not shown), as previously noted.
  • RAM is generally the main memory into which operating system and application programs are loaded.
  • ROM or flash memory may contain, among other software code, Basic Input- Output system (BIOS) which controls basic hardware operation such as interaction with peripheral components.
  • BIOS Basic Input- Output system
  • Applications resident with computer system 210 are generally stored on and accessed via computer readable media, such as hard disk drives (e.g., fixed disk 244), optical drives (e.g., optical drive 240), floppy disk unit 237, or other storage medium. Additionally, applications may be in the form of electronic signals modulated in accordance with the application and data communication technology when accessed via network modem 247 or interface 248 or other telecommunications equipment (not shown).
  • Storage interface 23 may connect to standard computer readable media for storage and/or retrieval of information, such as fixed disk drive 244.
  • Fixed disk drive 244 may be part of computer system 210 or may be separate and accessed through other interface systems.
  • Modem 247 may provide direct connection to remote servers via telephone link or the Internet via an internet service provider (ISP) (not shown).
  • ISP internet service provider
  • Network interface 248 may provide direct connection to remote servers via direct network link to the Internet via a POP (point of presence).
  • Network interface 248 may provide such connection using wireless techniques, including digital cellular telephone connection, Cellular Digital Packet Data (CDPD) connection, digital satellite data connection or the like.
  • CDPD Cellular Digital Packet Data
  • scan device 230 e.g., an x-ray machine, ultrasound, etc.
  • PACS 260 may be directly connected to bus 212
  • network interface 248 e.g., an x-ray machine, ultrasound, etc.
  • Many other devices or subsystems may be connected in a similar manner (e.g., document scanners, digital cameras and so on).
  • all of the devices shown in Figure 2 need not be present to practice the present disclosure.
  • Devices and subsystems may be interconnected in different ways from that shown in Figure 2. Operation of a computer system such as that shown in Fig. 2 is readily known in the art and is not discussed in detail in this application.
  • the system of Fig.2 may optionally include scan device 230 (such as an x-ray machine, ultrasonic scanner, or MRI) and may have a connection with PACS 260.
  • Software source and/or object codes to implement the present disclosure may be stored in computer-readable storage media such as one or more of system memory 217, fixed disk 244, optical disk 242, or floppy disk 238.
  • the operating system provided on computer system 210 may be a variety or veRFO'son of either MS-DOS® (MS-DOS is a registered trademark of Microsoft Corporation of Redmond, Washington), WINDOWS® (WINDOWS is a registered trademark of Microsoft Corporation of Redmond, Washington), OS/2® (OS/2 is a registered trademark of International Business Machines Corporation of Armonk, New York), UNIX® (UNIX is a registered trademark of X/Open Company Limited of Reading, United Kingdom), Linux® (Linux is a registered trademark of Linus Torvalds of Portland, Oregon), or other known or developed operating system.
  • computer system 210 may take the form of a tablet computer, typically in the form of a large display screen operated by touching the screen.
  • the operating system may be iOS® (iOS is a registered trademark of Cisco Systems, Inc. of San Jose, California, used under license by Apple Corporation of Cupertino, California), Android® (Android is a trademark of Google Inc. of Mountain View, California), Blackberry® Tablet OS (Blackberry is a registered trademark of Research In Motion of Waterloo, Ontario, Canada), webOS (webOS is a trademark of Hewlett-Packard Development Company, L.P. of Texas), and/or other suitable tablet operating systems.
  • iOS® iOS is a registered trademark of Cisco Systems, Inc. of San Jose, California, used under license by Apple Corporation of Cupertino, California
  • Android® is a trademark of Google Inc. of Mountain View, California
  • Blackberry® Tablet OS Blackberry is a registered trademark of Research In Motion of Waterloo, Ontario, Canada
  • webOS webOS is a trademark of Hewlett-Packard Development Company, L.P. of Texas
  • a signal may be directly transmitted from a first block to a second block, or a signal may be modified (e.g., amplified, attenuated, delayed, latched, buffered, inverted, filtered, or otherwise modified) between blocks.
  • a signal may be directly transmitted from a first block to a second block, or a signal may be modified (e.g., amplified, attenuated, delayed, latched, buffered, inverted, filtered, or otherwise modified) between blocks.
  • modified signals in place of such directly transmitted signals as long as the informational and/or functional aspect of the signal is transmitted between blocks.
  • a signal input at a second block may be conceptualized as a second signal derived from a first signal output from a first block due to physical limitations of the circuitry involved (e.g., there will inevitably be some attenuation and delay). Therefore, as used herein, a second signal derived from a first signal includes the first signal or any modifications to the first signal, whether due to circuit limitations or due to passage through other circuit elements which do not change the informational and/or final functional aspect of the first signal.
  • One or more embodiments of the present invention relate to the coupling of medical procedures with protocols and advanced software applications.
  • the previously described problems with RSIs and / or IMDs have existed for decades, as have pattern detection algorithms and software.
  • Embodiments of the invention specifically coordinate existing medical procedures and protocols with image detection software to integrate and enhance the identification of IMD's and the detection of RSIs that had previously been unattainable.
  • the emergency room or the operating room protocol is modified so that a scan or XR is taken of the patient for identification of any IMD.
  • the operating room protocol is modified so that there is an additional step of calibrating an intraoperative or post-operative scans or XR specifically for detecting RSIs in addition to any scans or XR performed for the purpose of monitoring the treatment of the patient.
  • the scan or XR is made under conditions that optimize the detection of RSIs or identification of IMDs.
  • Conventional image detecting algorithms using computing machinery described above or equivalent processors may be used with embodiments of the invention, and such conventional image detecting algorithms and / or improved image detecting algorithms developed in conjunction with embodiments of the invention to enhance the identification of IMDs and detection of RSIs using conventional XR and computing equipment.
  • patient safety measures include an effective operative room communication; mandatory counts of surgical instruments and sponges, methodical wound examinations, and XR imaging. Mistakes in counts conventionally happen in up to 12.5% of surgeries prompting mandatory x-ray of the surgical field to rule out any RSIs. Due to these concerns many hospital systems nowadays mandate XR at the end of the complex surgeries including all emergent surgical procedures.
  • RSIs are typically any surgical tool or sponge inadvertently left behind in a patient's body in the course of surgery.
  • RSIs Approximately two-thirds of the RSIs are surgical sponges, and other third represents mostly surgical needles and less frequently surgical instruments.
  • the consequences of RSIs include injury, repeated surgery, prolonged hospital stay, excess monetary cost, loss of hospital credibility, and death of the patient.
  • step 302 the RaPID response X-ray is ordered. Many specifics of this step are mentioned in the descriptions of various embodiments in this document.
  • step 304 the technician uses the X-ray plate, and it is recommended to have the X-ray plate outfitted with WiFi capabilities to enhance image processing speed.
  • the X-ray plate is otherwise electronfically coupled with other image processing systems including PACS server 404 (see discussion of Figure 4). While not recommended, it is also possible to use an X-ray plate that is not electronic, however such an image would need to be quickly digitized and communicated to PACS server 404.
  • step 306 specific settings of the X-ray machine are applied for the purpose of detecting foreign objects in the body rather than for diagnostic purposes. Because RSIs are fainter on most scans than most anatomical objects, the inventors have discovered that detection is enhanced when the settings of the X-ray machine are made with a lower power to enhance the contrast in regions where RSIs are likely to be disposed. In addition, many parts of IMDs, particularly those parts that help distinguish between similarly configured IMDs, are likewise difficult to ascertain from diagnostic scans, so that the lower power settings enhance IMD detection.
  • any RSI and/or IMD information and/or contact information is coupled to the image taken, which may be embedded in the image data structure or attached or otherwise associated with the image.
  • step 310 in the process of sending the image to PACS server 404, computer aided decision support software (CADe) also processes the image data searching for potential RSIs and IMDs.
  • This CADe software may be present in the originating locations (e.g., operating room 402 or emergency room 420), and optionally the results of the CADe software may be presented in the originating location.
  • the results may be used immediately, for example in remote locations without radiological support or in emergency situations where external communications are difficult or impossible.
  • a warning sign may be provided, such as a textual alert specifying the results of the analysis and any detected RSIs or any identified IMDs.
  • the warning sign may also include a box, circle, or other highlighting of the area of the scan where the suspected RSI or IMD is located.
  • the image with any warning indicators is inserted into the radiologist work-list.
  • the work-list software pushes the most immediate RaPID Response X-ray to the top of the list so that real time operations and emergency room operations are the first X-rays analyzed by the attending radiologist.
  • the urgency of the X-ray evaluation may be communicated through e-mail, SMS or text messaging, paging systems and the like.
  • step 314 if the physician/radiologist analysis indicates the presence of an RSI or identification of an IMD then the congruence of the CADe and physician/radiologist evaluation is communicated back to the originating location. [0094] Once the IMD or RFO's is suspected and XR is needed the protocol of embodiments of the present invention includes following specific steps and/or combination of elements:
  • the x-ray technician has available an XR plate with Wi-Fi capabilities in order for images to be instantaneously uploaded to PACS. This eliminates any time delay in the process of manually feeding a plate into a reader which is frequently not immediately available next to the OR suite or emergency department. This uploading process also identifies the new image to the PACS as being of the RaPID Response type, so that appropriate enhancements to the processing of the image are attend to.
  • the portable XR machine is in the operating room and wireless XR plate is in the appropriate position / beneath the patient / the specific settings of the portable XR machine (including kV and mAs) are applied rather then using a standard setting for chest or abdomen XR.
  • These IMD/RSI specific settings increase the chance of having a good quality contrast image of the IMD or RSI. Therefore, any deviation from the standard XR settings such as CXR or KUB predetermined settings with the intention to provide better contrast for identification of RSI or IMD is part of this process.
  • the exemplary ranges of XR settings based on patient and physical characteristics of the RSIs and IMDs are based on the use of specific XR and processing equipment and may vary between different types of units, and are presented in Table 1:
  • Table 1 X-ray settings for optimal visualization of RSIs and / or EVIDs.
  • a specific textual image denominator is assigned to the image— alerting physicians who analyze the image about any RSIs or IMDs and providing information regarding the type of miscount / needle, sponge, or instrument /, OR phone call back number, and surgeon' s pager. This eliminates the need for the phone call from the OR or ED to the radiologist specifying the type of object for which the image is being searched.
  • the illustrative embodiment referenced in Table 1 involved a Siemens Axiom Luminos TF with mobile Flat Detector digital radiography system.
  • a Siemens Axiom Luminos TF with mobile Flat Detector digital radiography system To evaluate the optimal settings for XR images to show RSI' s, combinations of settings were used for various RSI imbedded human-analog (phantom) set-ups. Phantom RSI' s were placed on or underneath the sectional imaging phantom (thorax) and then three consecutive images of the same set-up were taken with different parameter settings (High, Medium, Low technique). In this illustrative embodiment, three factors that were varied: the sponge type and x-ray machine parameters of Voltage and Current-exposure.
  • the parameter setting range for voltage was 50- 125 kV and for current (measured in milliampere- second - mAs) was 1-400 mAs.
  • the illustrative optimal parameter settings were determined in conjunction with a highly trained technician.
  • a specific optimization of the PACS workflow is specified that automatically puts any RaPID Response X-ray images on the top of the radiologist' s workflow list images file with RSIs / EVIDs denominator and visible alert.
  • Usage of computer assisted detection (CADe) software solutions for RSIs detection and / or IMD identification improves the accuracy of detection and decrease time needed for image analysis by radiologist.
  • Computer vision is superior to the human eye in the detection of defined pre-set objects.
  • Embodiments of the invention include software that is based on a novel system using complex pattern recognition algorithms— combining elements of artificial intelligence with digital image processing— to detect RSIs or identify IMDs on medical images. This system analyzes all the images and if any RSIs are detected or IMDs are identified, the system then inserts alert sign over the area of the image with suspected RSIs and/or IMDs.
  • a radiologist's analysis is congruent with the CADe software findings— positively detecting RSI or identifying IMD an effective critical information alert is conveyed— the radiologist calls the number assigned to the image while software will also trigger pager alert sent to OR control desk, OR circulating nurse, and attending surgeon.
  • embodiments of the software automatically provide a link in-patient EMR to the specific PACS images so that OR circulating nurse may pull specific set of images on the computer screen in the OR quickly. In this way, a surgeon may be provided better orientation clues as to where in the operating field any RFO's are located.
  • RaPID software platform not being integrated into the PACS system but available on portable x-ray machine or as a separate software application— so the physician has the option to activate a RaPID software procedure for analysis of an OR XR image on the screen of the portable XR machine.
  • the technician may ask: "Would you like a RAPID Response X-ray?" This gives the physician that option to choose.
  • a third scenario involves the Emergency Room (ER), where either of the preceding scenarios applies in the ER context. For example: a patient arrives in the ER and the physicians are in need of identifying any of the patient's IMD's. If the RaPID patient safety and quality assurance platform / CADe software is not integrated within the PACS the first mentioned scenario 1 may apply and if integrated with the PACS the second mentioned scenario may apply.
  • ER Emergency Room
  • a hospital PACS is relied upon.
  • such embodiments would optionally have the latest generation of imaging devices such as a portable flat-plate XR machine or a C-arm XR machine with processing unit.
  • the process of workflow integration requires the interaction with hospital protocols such as interfacing with hospital count policies and procedures as well as procedures relating to RSIs or IMDs discovery.
  • embodiments of the invention also interface with the radiological department protocols on managing workflow for image retrieval for examination and evaluation of XR using RaPID Medical Technologies' solutions.
  • embodiments of the invention impact several aspects of conventional medical protocols, particularly in the OR and EM contexts.
  • One aspect involves providing an additional step for the main procedure, optionally prior to any procedure to identify any IMD's, or optionally before preparing the patient for ending the procedure, the additional step involving an XR or other scan of the patient is made for the specific purpose of identifying IMDs and / or detecting RSIs.
  • This aspect involves both a protocol and mechanical alteration.
  • the protocol alteration involves having the XR or scan taken by the medical staff in a way to accentuate the entire area of the medical procedure which in some cases may be quite different from the perspective of an XR or scan taken for diagnostic purposes.
  • the mechanical alteration involves the particular settings used by the XR or scan machinery, as particular power levels and spectra may be better at identifying IMDs versus detecting RSis versus assisting diagnosis.
  • RaPID Response X-ray images are given priority in terms of both the computing processing and with the workflow of the radiological image processing system so that both the CADe and radiologist review are performed as quickly as possible given other system constraints.
  • the medical protocol itself is modified so that when a RaPID Response x-ray is taken, the appropriate computer and radiological review has been taken and the attending physician or surgeon has acknowledged and incorporated the finding of the RaPID Response into the procedure.
  • Implementation of the Rapid X-ray response process involves having an augmented protocol approved and accepted by hospitals patient safety committee as hospital OR and/or ER policy.
  • the exact implementation of a particular protocol may be specific to a particular health care facility, but should generally include, in some embodiments, a pre-operative scan to confirm initial information about the patient, including without limitation the identification and/or confirmation of the identity and location of any IMDs.
  • protocols should generally include, in some embodiments, a scan prior to closing up the patient to check or confirm any needle and/or sponge counts, including without limitation, the detection of any RFOs and/or the detection and/or confirmation of the connection of IMDs within the patient.
  • the XR technicians are trained to specifically adjust portable XR machine energy settings to settings that enhance the detection of RFOs and/or IMDs, which in some embodiments are according the recommendations in Table 1 and insert appropriate EVID / RSI denominators, that is to say that in some embodiments certain information about the patient, the procedure, the originating physician, the operative physician, and originating facility, before the XRs are taken.
  • the OR nursing staff are trained to understand the process of having the additional post-op x-ray step and appropriately react by immediately pulling images on the OR computer screen from the PACS or provide the separate application under the hospital electronic medical record environment.
  • radiologists are trained and familiarized with the usage of the CADe part of the Rapid x- ray response, including without limitation, the accelerated priority of evaluating RaPID response requests and the denominator information significance.
  • the XR or scan taken by the medical staff in a way to accentuates the entire area of the medical procedure is quite different from the perspective of a XR or scan taken for diagnostic purposes. More precisely, specific setting of the XR exposure energy for detection of the RSI or identification of IMD needs to be adjusted by programing specific kV and mAs settings before the images are taken. Table 1 summarizes optimal settings based on our current research with some embodiments of the invention. These settings are based on current typical x-ray equipment, and optimal settings for particular type of equipment, types of surgeries, and types of potential RFO's and IMD's may vary over the range of possible combinations.
  • IMD identification and / or RSI detection are identical as both are optimized to provide highest degree of contrast for non-tissue - radiopaque or metal components - in the images, rather than for detail of the diagnostic area of the body.
  • the scan may be other than an x-ray, for example without limitation an ultrasonic scan or a magnetic resonance imaging scan, then the scanning equipment is adjusted accordingly.
  • the associated CADe software may be integrated with PACSs either through APIs or as a module resulting in near instantaneous detection of RFOs or identification of IMDs in DIOCOM images as they reach the hosting server.
  • CADe software analyzes OR XR (or any other modality) images and if any RSI is detected or IMD is identified - it inserts an alert sign over the area of the image with suspected RSI / or identified IMD. This alert sign is already embedded in the image as it gets pulled up for analysis under the PACS environment by the surgeon, radiologist, or any other physician. In the case of IMD identification, if the alert sign gets additionally clicked it provides extensive information on IMD's specifications.
  • CADe software is integrated in the software environment of the portable XR machine in which case alert sign shows up immediately after the image is taken and shown on the portable XR machine screen.
  • CADe software may exist as a separate application hosted on separate server and as part of hospital electronic medical record environment / applications. In this case any image taken in the ORs are routed to this application that immediately returns pulled images on the computer OR screens with alert sign embedded in the image id IMD identified or RSI detected.
  • the RaPID CADe software serves as an advisory tool in detection of RSIs and as diagnostic tool in identifying IMDs. It does not disrupt the workflow of PACSs as the analysis of each image occurs before or in conjunction with the acquisition of the image by the PACS, so that the CADe software works seamlessly in coordination with these systems so that there is minimal image processing delay.
  • the RaPID CADe software acquires the image from the x-ray scanner and fees the analyzed image to PACS, once the images are pulled up under the PACS environment the RaPID CADe software already has alert signs inserted / embedded into the image.
  • the RaPID CADe software does acts as an image feeding mechanism and does not interfere with PACS at all.
  • the RaPID CADe software is part of the image acquisition and preparation phase of the PACS image storage process, and also relays the results of the RaPID CADe software back to the originating location, i.e. the operating room or emergency room where the scan was taken.
  • RaPID Response X-ray process images are automatically routed to the top of the radiologist workflow list based on image RSI and / or IMD denominators, source - portable XR machine, and OR location. While this is not a mandatory modification of a radiologist's workflow list, achieving one or several of the objects of the present invention is best accomplished in embodiments where such modification is made.
  • the radiologist workflow modification in some embodiments involves modification of the workflow PACS module so that RaPID response X-rays are appropriately prioritized. In other embodiments, such workflow may be directed by a separate radiologist situated workflow software which is modified to accommodate the prioritization of the RaPID Response X-ray image.
  • the RaPID Response X- ray images are additionally flagged clearly showing the urgent status.
  • the RaPID CADe software analyzes the images and embeds appropriate alert / warning signs if an RSI is detected or an IMD is identified. Therefore once the radiologist pulls up the images under the PACS environment the alert signs are displayed showing if the RaPID CADe software detects an RSI or identifies an IMD.
  • Figure 5 shows a general flow chart of the general operation of an embodiment of the present invention.
  • the general steps which may be altered in order, pre-processing of an image (the box "pre-processing"), detecting a portion of the image that may have an RFO (the box “Candidate part detection”), extracting a feature from an identified portion (the box “Part feature extraction”), classifying an identified portion for analysis (the box “Candidate part classification”), detection potential sponges in the image (the box “Candidate sponge detection”), extracting potential sponge features for the identified portion (the box “Sponge feature extraction”), classifying the identified features as a particular type of sponge (the box "Sponge classification”), and annotating the image to identify the parts of the image that have been extracted and analyzed for further examination (the box "Image annotation").
  • Figure 6A shows an image of a synthetic RFO
  • Figure 6B shows an image of an actual RFO
  • Figure 7 A shows an image with multiple potential locations for detection of an object
  • Figure 7B shows an image with final determined selected areas where items were identified.
  • Embodiments of the invention provide a system for RSIs detection.
  • Embodiments involve software to serve as a computer aided diagnosis (CAD) tool to assist radiologists and surgeons in analyzing X-ray images for RSIs by automatically detecting and marking RSI locations.
  • the software automatically analyzes all X-ray images received from the OR whether due to miscount or any other reason and alerts and mark detected foreign objects in predefined categories of sponges and needles.
  • the focus on specific objects such as sponges and needles is optional, in fact, while embodiments of the invention are described in this document generally relating to needles and sponges, this only reflects a particular implementation.
  • Other types of objects may be recognized by creating other object classifier software to detect those other objects and add them to the types of objects detected by embodiments of the inventive system.
  • Embodiments of the invention involve Core algorithms for RSI detection and recognition. Algorithms for the recognition of RSIs from X-ray images were developed from general recognition algorithms based on machine learning techniques. The algorithms include enhancement designed for RSI detection by removing artifacts and increasing contrast, candidate detection using machine learning and spatial clustering, feature extraction and selection for RSI recognition, and RSI classification. Using a set of classifiers where each classifier is trained for specific conditions such as anatomical region, object type, and exposure level. Thus, embodiments of the invention have designed a special classifier to identify specific conditions selected. Exemplary embodiments noted in this disclosure relate to certain types of sponges and needles our system, other embodiments may easily adapt to new objects by training the classifiers for them.
  • FIG. 1 For purposes of this specification, embodiments of the invention may rely on a large number of features and have a large training set. This is particularly so since embodiments use a set of classifiers that are suited to specific cases.
  • embodiments of the invention rely in part on collecting realistic images with RSIs. This is based on actual X-ray images of patients as well as images in which RSIs are placed before taking the X-ray image. The objective of the collection is to improve testing results.
  • Embodiments of the invention may also be involved in Validation studies. Embodiments may be tested by integrating software into a PACS system and analyzing operating room X-ray images for RSIs. Since the prevalence of RSIs in actual cases is typically extremely low, it is alternatively possible to base validation studies on actual X- ray images obtained from procedures in which surgical foreign objects are commonly left in or on the patient while taking the image. These may be manually or semi-automatically annotated and in conjunction with tools necessary for efficient annotation. The validation studies may include comparison of software evaluation to the performance of a human observer both in terms of accuracy and speed.
  • Embodiments of the invention provide automated RSI detection in X-ray images using one or more of several main steps: enhancement, detection, and recognition. The details of this sequence are shown in Figure 5.
  • an alternative approach involves superimposing segmented X-ray images of selected foreign objects on patient images that do not in actuality contain the foreign objects of interest. This allows the magnification of the amount of available data by several folds. The magnification of the data enhances development of embodiments of the invention. Without magnification, training data may take much longer to gather and assemble a sufficient quantity necessary for supervised learning algorithms.
  • the performance criterion employed for each of these steps involves improvement in recognition rates on actual data. That is, a goal oriented approach is employed by which an algorithm or a key parameter is considered useful only if it improves overall recognition results on actual data. For example, a specific algorithm for enhancement is considered useful only if it improves overall recognition results.
  • the enhancement approach employed manipulates certain regions of the intensity histogram so as to increase the contrast of specific regions by manipulating the cumulative distribution function. Targeting separately three different regions: dark, normal, and bright, the detection rate is increased in low contrast regions. Each region is processed separately using an individually trained classifier.
  • Candidate detection is based on the detection of edges in the image using an automatically computed threshold parameter to guarantee a certain number of candidates.
  • Each retained edge pixel defines a small box region around it and a mutual exclusion criterion is applied to get unique candidates.
  • Features, as described below, are extracted for each box region and are used to train and apply a classifier. Using support vector machines and decision tree classifiers based on testing, classifiers were enhanced. However, in principle the method may use any other supervised learning classifier.
  • candidate box regions are grouped using a spatial clustering algorithm and form candidate RFIs. Additional features are extracted for each RFI candidate and used these for training and classification of an additional classifier.
  • the features used relate to edge points count and distribution (based on covariance), gradient angle histogram, segmented pixel distributions, contour properties, connected components, and junction points.
  • the features are normalized to values between 0 and 1 except for histogram features which are normalized so that the histogram has an area of 1.
  • Feature vectors are produced comprising 100-200 feature values and use feature selection techniques to identify key features.
  • the features used are intensity and rotation independent.
  • RSIs Since the incidence of RSIs in actual X-ray images is typically extremely low, other sources of validation data may be used.
  • a dedicated PACS server tens of thousands of X-ray images that are taken in the OR for any reason (not just for miscount events) are collected. The collection is both prospective and retrospective. The collection may be split into two subsets. The first may be a set of images containing RSIs taken in procedures where foreign objects are left in or on the patient intentionally. This set also includes images taken due to miscount— although typically this number is extremely small. The second set may have the remaining images. These do not contain RSIs. In addition X-ray images in which RSIs are placed before taking the image may be used.
  • Embodiments of the system of the present invention as being based on supervised learning in a high dimensional feature space, benefits from increasing amounts of data.
  • the collected data is used to improve performance.
  • test collection images were semi-automatically labeled by marking the area of each sponge in the collection using a set of pixels that cover it. Then a tight axis- aligned bounding box was obtained for each sponge. These are considered as positive box locations.
  • automatically negative box locations were extracted. The negative box locations are locations that are identified by the algorithm as candidates. This is done so that specificity may be computed. Overall, correct detection was detected when a detected box sufficiently overlaps with a positive window.
  • Algorithm 1 Detect specific foreign objects in X-ray images
  • Algorithm 2 ColdGenerate training data
  • the type of image may be classified using Algorithm 3 (Classify image type).
  • the image and generate three versions (normal, dark, bright) versions of it may be enhanced using Algorithm 4 (RSI oriented image enhancement). Thereafter process each of the image versions separately.
  • Candidate foreign object locations may be detected using Algorithm 5 (Detect candidate locations).
  • Foreign object locations may be classified using Algorithm 6 (Classify candidate locations).
  • Cluster detected object locations may result from using Algorithm 7 (Cluster candidate locations).
  • Foreign object clusters may be classified using Algorithm 8 (Classify foreign objects). Report detection results may be created using Algorithm 9 (Report detection results). Continue to collect data and perform incremental training for each of the algorithms along or in combination so that each may learn from failed cases to improve performance.
  • Algorithm 2 (Collect training data) involves obtaining thousands or tens of thousands of X-ray images and marking the location and structure of foreign objects.
  • Algorithm 3 (Classify image type) defines types of interest (e.g. chest images or abdominal images and/or underexposed images or overexposed images, etc.) and labels a training set.
  • Extract features for each image type using Algorithm 13 that may involve classifying the image type using a supervised learning algorithm such as the SVM or random forest algorithm.
  • Algorithm 4 (RSI oriented image enhancement) involves smoothing the image to remove noise using a Gaussian filter. This may be in conjunction with enhancing the lower range of intensities to increase the contrast in them using Algorithm 11 (Enhance given intensity ranges).
  • Algorithm 5 involves detecting locations of edges with high magnitude of image gradient. The steps include: Computing a threshold parameter to control the number of candidates using Algorithm 12 (Compute a threshold parameter for candidate generation); Defining a box region around each candidate; and excluding box regions whose center is included in other box regions.
  • Algorithm 6 involves extracting candidate locations from a labeled training data. The true identity of each extracted location may be marked as positive if it substantially overlaps with a known object location, and as negative otherwise. Further, features in each box may be extracted using Algorithm 13 (Compute features), using the labeled data train a supervised learning algorithm such as the SVM or random forest algorithm, and using the model produced by the training classify candidates in the test data.
  • Algorithm 13 Computer features
  • Algorithm 7 Cluster candidate locations
  • Algorithm 7 Cluster candidate locations
  • Detected negative boxes that are near each other and far from other negative boxes are clustered using a spatial clustering algorithm, and further features in each candidate cluster (positive and negative) may be extracted using Algorithm 13 (Compute features).
  • Algorithm 8 Classify foreign objects
  • Algorithm 8 involves extracting candidate locations from a labeled training data. The true identity of each extracted location may be marked as positive if it substantially overlaps with a known object location, and as negative otherwise.
  • Features in each box may be extracted using Algorithm 13 (Compute features) using the labeled data train a supervised learning algorithm such as the SVM or random forest algorithm, or using the model produced by the training classify candidates in the test data.
  • Algorithm 13 Computer features
  • Algorithm 9 involves ignoring foreign objects that are of no interest, and marking detected objects of interest on the image by superimposing an axis aligned box around each detected relevant foreign object. A confidence measure for each detection using probabilities may be returned by the classifier and indicate the detection confidence next to each superimposed box. Alerts may be produced if specific foreign objects are detected with sufficient confidence, using additional information if such is available (e.g. knowledge of miscount).
  • Algorithm 11 (Enhance given intensity ranges) involves giving a low intensity range of [0, L], stretch intensities in this range to [0,255] thus saturating intensities above L, or alternatively a high intensity range of [H, 255], stretch intensities in this range to [0,255] thus saturating intensities below H.
  • Algorithm 12 (Compute a threshold parameter for candidate generation) involves settingt a desired number of candidates as a percentage of the number of pixels in the image or as an absolute value. Edge detection is performed using gradient magnitudes above a threshold H to initiate edge tracking, starting from locations detected in the previous stage so long as the connected edge points have gradient magnitudes above a threshold L. Further, starting with an initial value for L and H, their proper value may be searched such that the total number of edge pixels is close to the desired number of candidates. In the search scan the values of H and for each value of H scan the values of L.
  • Algorithm 13 (Compute features) involves selecting pixels in a box region in the area of interest, the segmenting the local box region using an adaptive segmentation technique.
  • Connected components in the box region are then detected, along with the contours of connected components and edges in the box region.
  • Junction points are then detected and the gradient vectors of all the pixels in the box region are determined to compute features relating to edge points count and distribution (based on covariance) or relating to gradient angle histogram.
  • Features may then be computed relating to segmented pixel distributions, contour properties, connected components, and junction points.
  • Feature values may be normalized to be between 0 and 1 except for histogram features which are normalized so that the histogram has an area of 1.
  • Some embodiments of the present invention involve locating the image processing capabilities of the aforementioned disclosures in a remote location so that the images and the results of the analysis are communicated in encrypted form and the results need not be stored in the remote location.
  • local medical facility 800 obtains the scan of a patient in the operating room as described in the foregoing disclosure.
  • Local medical facility 800 encrypts the image with its private encryption key, or private key, and optionally identifies the reading radiologist in a transmission to remote image processing facility 810.
  • Remote image processing facility 810 decrypts the transmitted image and performs the detection of RSO's as described in the aforementioned disclosures, encrypting the results with the public encryption key, or public key, of local medical facility 800 and then sends those encrypted results back to local medical facility 800.
  • remote image detection processing facility 810 also encrypts the results with the public key of reading radiologist 820, and prepares a version of the results for reading radiologist 820 using its public key.
  • local medical facility 800 identifies reading radiologist 820 in the initial message.
  • local medical facility 800 does not make that identification in the initial message, rather local medical facility 800 sends the image first to remote image processing facility 810, initiates the determination of the identity of reading radiologist 820 and then later sends remote image processing facility 810 the identity, contact information, and/or public key of reading radiologist 820 so that remote image processing facility 810 may provide results encrypted with the reading radiologist's public key either to local medical facility 800 or directly to reading radiologist 820.
  • remote image processing facility 810 maintains a transaction log of transmissions to and from local medical facility 800, but does not store either the received image or the detection results.
  • remote image processing facility 810 may perform a memory "scrub" to remove any non-volatile memory traces of either the image or results.
  • local medical facility 800 provides an identification of the sent image in the form of a new identification string that has no connection with the individual that was the subject of the image.
  • the image may have a 30 character string associated, a string that has no relationship with any of the subject's personal information.
  • local medical facility 800 removes such information from the image sent to remote image processing facility 810. In this way, the image information has no personally identifiable information other than the scan itself. While the image is transitorily decrypted for purposes of foreign object detection at remote image processing facility 810, such transitory copies of the image may be easily removed as is well known in the data processing art and shall not be further detailed.
  • remote image processing facility 810 while having a transitory copy of the image present for foreign object detection, remote image processing facility 810 may also be enabled to provide further processing of the type often provided by a SuperPACS facility.
  • local medical facility 800 may provide reading radiologist 820 patient identification information so that the radiologist may access metadata on a legacy archive to access prior patient images, or allow the radiologist to synchronize the image sent with multiple worklists for on-demand reporting, workload sharing and/or enterprise distribution.
  • remote processing facility 810 may provide reading radiologist 820 a reporting tool allowing the radiologist to include an integrated 3D rendering with image analysis, automatic registration with other patient medical record reporting, volumetric matching of prior images of the patient, voice recognition for user interaction and report dictation, and access to other medical records (for example, mammography) .

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Physics & Mathematics (AREA)
  • Biophysics (AREA)
  • Veterinary Medicine (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Optics & Photonics (AREA)
  • Databases & Information Systems (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Quality & Reliability (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Image Processing (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

La présente invention concerne le couplage de procédures médicales avec des protocoles et des applications logicielles avancées, la coordination de procédures médicales existantes et de protocoles médicaux existants avec un logiciel de détection d'image pour intégrer et améliorer l'identification des IMD et la détection des RSI. Dans un aspect, le protocole de la salle d'urgence ou de la salle d'opération est modifié de telle sorte qu'un balayage, ou XR, du patient est pris pour l'identification d'un quelconque IMD. Dans un autre aspect, le protocole de la salle d'opération est modifié de sorte qu'il existe une étape supplémentaire d'étalonnage de balayage, ou XR, peropératoire ou post-opératoire spécifiquement pour détecter des RSI et/ou identifier des IMD en plus d'un quelconque balayage, ou XR, effectué dans le but de contrôler le traitement du patient. Dans un autre mode de réalisation, le traitement d'image peut être géré de façon à être exécuté dans un emplacement à distance, au moyen d'un chiffrement à clé publique pour dépersonnaliser les informations personnelles associées à l'image.
PCT/US2015/048742 2014-09-06 2015-09-06 Système et procédé de protocole de détection d'objet étranger WO2016037160A2 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP15837652.5A EP3302284A2 (fr) 2014-09-06 2015-09-06 Système et procédé de protocole de détection d'objet étranger
US14/846,885 US9947090B2 (en) 2014-09-06 2015-09-07 Medical image dectection system and method
US14/846,880 US20160066877A1 (en) 2014-09-06 2015-09-07 Foreign object detection protocol system and method
US14/846,882 US20160066787A1 (en) 2014-09-06 2015-09-07 Foreign object detection protocol system and method

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201462046925P 2014-09-06 2014-09-06
US201462046926P 2014-09-06 2014-09-06
US62/046,925 2014-09-06
US62/046,926 2014-09-06
US201562116384P 2015-02-14 2015-02-14
US62/116,384 2015-02-14

Related Child Applications (3)

Application Number Title Priority Date Filing Date
US14/846,880 Continuation US20160066877A1 (en) 2014-09-06 2015-09-07 Foreign object detection protocol system and method
US14/846,882 Continuation US20160066787A1 (en) 2014-09-06 2015-09-07 Foreign object detection protocol system and method
US14/846,885 Continuation US9947090B2 (en) 2014-09-06 2015-09-07 Medical image dectection system and method

Publications (2)

Publication Number Publication Date
WO2016037160A2 true WO2016037160A2 (fr) 2016-03-10
WO2016037160A3 WO2016037160A3 (fr) 2018-03-01

Family

ID=55440492

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2015/048742 WO2016037160A2 (fr) 2014-09-06 2015-09-06 Système et procédé de protocole de détection d'objet étranger

Country Status (2)

Country Link
EP (1) EP3302284A2 (fr)
WO (1) WO2016037160A2 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101894537B1 (ko) * 2017-02-28 2018-09-04 인천대학교 산학협력단 컴퓨터 비전에 기반한 불법 객체 분류 방법 및 시스템
CN111832298A (zh) * 2020-07-14 2020-10-27 北京百度网讯科技有限公司 病历的质检方法、装置、设备以及存储介质
EP4018934A4 (fr) * 2019-08-19 2022-08-17 FUJIFILM Corporation Dispositif d'assistance médicale, procédé de fonctionnement et programme de fonctionnement associés, et système d'assistance médicale

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090287076A1 (en) * 2007-12-18 2009-11-19 Boyden Edward S System, devices, and methods for detecting occlusions in a biological subject
US8374415B2 (en) * 2010-05-19 2013-02-12 Siemens Corporation Shape modeling and detection of catheter
WO2012106580A2 (fr) * 2011-02-04 2012-08-09 The Regents Of The University Of California Procédés et appareil pour une détection et une imagerie radiologiques assistées par ordinateur
US9220467B2 (en) * 2011-09-19 2015-12-29 Siemens Aktiengesellschaft Method and system for tracking catheters in 2D X-ray fluoroscopy using a graphics processing unit
EP2852319B1 (fr) * 2012-05-21 2017-05-17 Sync-RX, Ltd. Co-utilisation de données endoluminales et d'imagerie extraluminale
US20160066877A1 (en) * 2014-09-06 2016-03-10 RaPID Medical Technologies, LLC Foreign object detection protocol system and method
US9947090B2 (en) * 2014-09-06 2018-04-17 RaPID Medical Technologies, LLC Medical image dectection system and method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101894537B1 (ko) * 2017-02-28 2018-09-04 인천대학교 산학협력단 컴퓨터 비전에 기반한 불법 객체 분류 방법 및 시스템
EP4018934A4 (fr) * 2019-08-19 2022-08-17 FUJIFILM Corporation Dispositif d'assistance médicale, procédé de fonctionnement et programme de fonctionnement associés, et système d'assistance médicale
CN111832298A (zh) * 2020-07-14 2020-10-27 北京百度网讯科技有限公司 病历的质检方法、装置、设备以及存储介质
CN111832298B (zh) * 2020-07-14 2024-03-01 北京百度网讯科技有限公司 病历的质检方法、装置、设备以及存储介质

Also Published As

Publication number Publication date
WO2016037160A3 (fr) 2018-03-01
EP3302284A2 (fr) 2018-04-11

Similar Documents

Publication Publication Date Title
US9947090B2 (en) Medical image dectection system and method
US9675273B2 (en) System and methods for identification of implanted medical devices and/or detection of retained surgical foreign objects from medical images
US9792682B2 (en) Training system for detection and classification of artificial objects in X-ray images
US11341646B2 (en) Systems and methods to deliver point of care alerts for radiological findings
JP7086933B2 (ja) 医用画像のアノテーションに基づく疾患の確率の更新
US10460838B2 (en) Automated anatomically-based reporting of medical images via image annotation
US10282835B2 (en) Methods and systems for automatically analyzing clinical images using models developed using machine learning based on graphical reporting
CN109817304A (zh) 针对放射学发现物传送现场护理警报的系统和方法
US20160066877A1 (en) Foreign object detection protocol system and method
US11610676B2 (en) Information processing device and information processing method
US20180060488A1 (en) Customizing annotations on medical images
CN104732086A (zh) 基于云计算的疾病计算机辅助检测系统
WO2016037160A2 (fr) Système et procédé de protocole de détection d'objet étranger
US20120039517A1 (en) System, method and computer instructions for aiding image analysis
Borovska et al. Internet of medical imaging Things and analytics in support of precision medicine for early diagnostics of thyroid cancer
US20220284579A1 (en) Systems and methods to deliver point of care alerts for radiological findings
Fowler et al. Protocol: Artificial intelligence as a diagnostic aid in cross-sectional radiological imaging of the abdominopelvic cavity: a protocol for a systematic review
Li et al. Radiologist-level Scaphoid Fracture Detection: Next Steps for Clinical Application
Agam et al. Automated identification of retained surgical items in radiological images

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2015837652

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2015837652

Country of ref document: EP