Classifications

• • G—PHYSICS
  • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
  • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
  • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
  • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
  • G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
• • G—PHYSICS
  • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
  • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
  • G16H15/00—ICT specially adapted for medical reports, e.g. generation or transmission thereof
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
  • G06F16/10—File systems; File servers
  • G06F16/14—Details of searching files based on file metadata
  • G06F16/156—Query results presentation

Definitions

• the following relates to an improved system and method for navigating and displaying medical information.
• Freeform medical reports are produced in various clinical domains.
• radiology examinations are summarized in freeform reports prepared by radiologists.
• a radiology examination is ordered and usually has a "reason for examination" included in the order.
• the radiologist report may address other clinical conditions besides the stated reason for examination.
• the freeform radiology reports may include content relating to numerous clinical concept categories, such as clinical findings, symptoms, diagnoses, procedures, or anatomical structures.
• EMR Electronic Medical Record
• RIS Radiology Information System
• a non-transitory storage medium storing instructions readable and executable by an electronic device to perform a method for navigating clinical information using a wheel structure in a graphical user interface.
• the method includes: annotating medical reports by associating clinical concepts with text segments of the medical reports; building and displaying on a display device a root concepts ring or arc including arc segments representing clinical concept categories; receiving via a user input device operating on the displayed root concepts ring or arc a user selection of an arc segment representing a clinical concept category whereby a user-selected clinical concept category is identified; building and displaying a children concept ring or arc expanding the user-selected clinical concept category and at least partially encircling the root concepts ring or arc, the children concept ring or arc including arc segments representing clinical concepts of the user- selected clinical concept category; receiving via the user input device operating on the displayed children concept ring or arc a user selection of an arc segment representing a clinical concept whereby a user-selected clinical concept is identified; and
• an electronic device for displaying medical information including building a root region and outwardly expanding regions includes: a display device; a user input device; and an electronic processor programmed to: build and display on the display device a root region including icons representing clinical concept categories; build and display on the display device a first outwardly expanding region at least partially surrounding the root region and including icons representing clinical concepts of a user-selected clinical concept category selected via the user input device from the root region; and build and display on the display device a second outwardly expanding region including icons representing clinical concepts or medical reports of a user-selected clinical concept selected via the user input device from the first outwardly expanding region.
• One advantage resides in a compact display for displaying medical information.
• Another advantage resides in a reduced burden on processors and memory of a medical display device.
• Another advantage resides in promoting continual awareness different viewing options in a medical display. Another advantage resides in a more complete utilization of information available for a specific patient.
• Another advantage resides in efficiently extracting and presenting information from diverse freeform textual sources.
• Another advantage resides allowing for a quick clinical overview of a patient before beginning examination of an imaging study.
• the invention may take form in various components and arrangements of components, and in various steps and arrangements of steps.
• the drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention.
• FIGURE 1 diagrammatically shows a system to explore clinical concepts.
• FIGURE 2 graphically displays a clinical concept annotator.
• FIGURE 3 shows an exemplary illustration of a clinical discovery wheel interface.
• FIGURE 4a shows another exemplary illustration of a clinical discovery wheel interface.
• FIGURE 4b shows another exemplary illustration of a clinical discovery wheel interface.
• FIGURE 5 illustrates a method of navigating medical report information using a CDW system.
• a radiology workflow usually starts with a physician (usually called a referring physician) ordering an imaging study to investigate a clinical condition of a patient.
• the referring physician states the "reason of exam" and image modality using a paper or electronic request system.
• the imaging study is performed by a technician, and results in a series of images.
• a radiologist investigates different images in the series of images with the goals of making one or more clinical findings (e.g., identifying a pulmonary nodule in the lung, or a suspicious mass in the liver, characterizing such features as potentially malignant, or so forth).
• the radiologist may also provide an appropriate treatment recommendation through a radiology report, although the referring physician more typically determines the treatment based on the radiology results and other available information.
• the referring physician will then read the radiology report and take appropriate action, for example prescribing further tests, a therapy regimen, or so forth.
• radiologists and referring physicians may need to consult additional patient information to understand the clinical condition of the patient or to understand various details of the report information.
• CDW Clinical Discovery Wheel
• the approaches described herein facilitate exploring clinical concepts.
• One approach involves constructing and displaying a set of concentric circles via which users drive the discovery of processed patient information.
• This context-sensitive tool described herein as the Clinical Discovery Wheel (CDW)
• CDW uses a data-driven strategy to present relevant patient information providing a gradual exposure of information based on the user inputs.
• the CDW also may provide a longitudinal view of a selected clinical concept creating an interactive timeline wherein the progression of a given clinical condition can be identified over time.
• CDW may provide an active link to external clinical knowledge source where the user can learn more details about a procedure or symptoms reported by a radiologist.
• user inputs cause the CDW to expand outward from a compact root concepts ring or arc to display information in the form of one or more outwardly expanding rings or arcs.
• the outermost ring, arc, or timeline presents medical reports for the patient.
• text of medical reports of a patient are analyzed, e.g. using regular expressions and/or natural language processing (NLP), to annotate text segments with clinical concepts from a medical ontology.
• NLP natural language processing
• This provides a standardized labeling of the medical reports with annotations made to specific text segments.
• the medical reports are represented by icons (e.g. arc segments of a ring or arc, or blocks of a linear timeline) that are labeled the relevant text segment that is annotated with the clinical concept.
• the proposed system provides a tool for presenting information on a patient from freeform medical reports in an accessible fashion.
• a clinical concept annotator annotates freeform medical reports based on regular expressions, natural language processing (NLP) or other analysis.
• the annotations are framed in a standard medical ontology such as the Systematized Nomenclature of Medicine (SNOMED ® ) ontology or the RadLex ® radiology ontology.
• SNOMED ® Systematized Nomenclature of Medicine
• RadLex ® radiology ontology radiology ontology
• the linked information database for the patient thus created is displayed using an interactive structure.
• the basic clinical concept categories (CCC's) form the hub or root of the wheel (e.g. the CDW).
• the CCCs include: "clinical findings”; “symptoms”; “diagnoses”; “medical procedures”; and “body structures”, which accord with some broad SNOMED CT categories.
• the wheel expands outward from the hub by displaying child categories, e.g. clinical concepts falling under the selected category.
• the final outermost level is the report timeline, in which freeform medical reports relating to the chosen category are listed in time order, with each medical report represented by a text block displaying a text snippet from the medical report relating to the chosen category. By clicking on such a text block the entire freeform medical report can be brought up, e.g. in a pop-up window.
• the illustrative report timeline may be formed in a ring fashion to wrap partway around the wheel for compactness.
• the approaches described herein may also provide a visualization tool to explore clinical concepts stored in a healthcare informatics system (HIS) such as Electronic Medical Record (EMR), Radiology Information System (RIS), or so forth.
• HIS healthcare informatics system
• EMR Electronic Medical Record
• RIS Radiology Information System
• Radiologists and referring physicians can interactively explore clinical concepts without interrupting their regular workflow.
• this allows for the exploration of clinical concepts in different levels of detail depending on the need and interest of the user.
• a radiologist can first look into a body structure section to learn the region affected by a metastasized sarcoma, then open more information on a specific body structure such as chest to see how sarcoma are described in the radiology reports, and finally choose a specific radiology report to view in more detail.
• the CDW minimizes the time expended to learn patient information in different systems across the HIS.
• the CDW may also associate clinical concepts to text segments using a medical ontology such as RadLex® or SNOMED, which provides additional information
• the CDW provides an interactive way to explore patient information.
• textual annotation tools such as Natural Language Processing (NLP), regular expressions, and/or deep machine learning
• NLP Natural Language Processing
• the CDW creates a compact and intelligent view of the freeform textual data spread over different healthcare silos (e.g. databases), thus providing a single interface point integrating these diverse data sources. Radiologists can review the most relevant patient events without interrupting their workflow.
• the CDW may also provide links to external clinical knowledge sources to facilitate medical reference during the discovery process.
• FIGURE 1 diagrammatically shows a system to explore clinical concepts.
• computer 100 includes a display 102 and illustrative keyboard 104. More generally, the user input device 104 may include a keyboard, a mouse, trackball or other pointing device, a touchscreen display component of the display 102, or so forth.
• Clinical knowledge 110 includes a database or databases that store medical information (e.g., medical ontologies such as SNOMED and RadLex®). Clinical knowledge 110 may further include general treatment information for conditions, as well as patient history information.
• Free text radiology reports (or other medical reports) 120 are generated by a radiologist or other medical professional in compliance with orders from a referring physician or other user.
• Clinical concept annotator module 130 uses Natural Language Processing (NLP), Regular Expression (Regex) analysis, keyword identification, extracted ICD-9 codes or other medical classification codes appearing in report text, or so forth to annotate specific text segments of the freeform text of the medical reports 120 with clinical concepts, for example using medical ontologies (e.g., SNOMED and RadLex®) to identify standard terms associated with various such concepts. Keywords or medical codes provide an efficient semantic analysis tool, but could produce misleading results due to lack of context. Regular expressions can provide some context (e.g. identifying a textual phrase positively or negatively linking "tumor" and "metastasiz."). NLP provides fuller contextual information by grammatically parsing textual sentences to provide richer information on interrelationships of medical terms.
• NLP provides fuller contextual information by grammatically parsing textual sentences to provide richer information on interrelationships of medical terms.
• the clinical concept annotator module 130 may parse and annotate clinical concepts in the healthcare information system (e.g., radiology report from the RIS or patient history from the EMR). This produces annotated radiology reports 132 (or, more generally, annotated medical reports, e.g. radiology reports, specialist examination reports, histopathology laboratory reports or other laboratory test reports, or so forth).
• each clinical concept may be weighted in accordance with their frequency and relevance for the patient history.
• FIGURE 2 provides a graphical illustration of the free text radiology reports 120, the clinical concept annotator module 130, the clinical knowledge 110, and clinical annotated radiology reports 132 discussed above.
• a clinical concepts rule engine 134 creates rules to guide the exploration of clinical concepts from healthcare information system. These rules associate clinical concepts in two different levels: report level and patient level.
• report level clinical concepts annotated by the annotator module 130 are clustered according to categories from clinical medical ontologies. For example, the clinical concepts could be clustered according with Systematized Nomenclature of Medicine - Clinical Terms
• Clinical concepts category categories such as clinical findings, symptoms, diagnoses, procedures or body structures.
• the categories are called clinical concepts categories (CCC).
• CCC clinical concepts categories
• the patient level of rules considers a longitudinal view of the clinical annotated radiology reports 132 from radiology reports and EMR data for a given patient. These context-sensitive rules link between clinical concepts in different radiology reports, and thus provide a comprehensive analysis of all the references of clinical concepts in all radiology report for a given patient.
• the context-sensitive rules associated with clinical heuristics provide the ability to learn how a disease or clinical finding evolves over the history of a patient by identifying text segments in medical reports generated for the patient over the course of treatment that pertain to the disease or clinical finding as labeled by the annotator 130.
• Clinical concepts rule engine 134 generates linkage information that is used by a clinical discovery wheel (CDW) graphical user interface (GUI) 136 in navigating the textual information contained in the medical reports 120.
• CDW clinical discovery wheel
• GUI graphical user interface
• the CDW 136 provides an interactive graphic user interface based on concentric rings or arcs that are shown or hidden by user interaction.
• a root concepts ring or arc 310 (a full ring in the illustrative example) containing icons in the form of arc segments 315 representing clinical concepts categories (CCC) obtained from patient heath information and using the two previous described modules
• CCC clinical concepts categories
• the user can select a CCC 315 from the root concepts ring 310, and in response a new ring or arc 320 is built and displayed around (i.e. at least partially encircling) the root concepts circle 310.
• the user selection of the user-selected clinical concept category uses the at least one user input device 104, and may for example be selected by clicking, double clicking, or mouseovering one of the CCCs 315.
• This newly created ring or arc 320 is called children concept ring or arc (CCR) 320 (displayed as an arc in the illustrative example) and contains arc segments 325 representing clinical concepts associated with the user- selected selected CCC 315.
• CCR children concept ring or arc
• Various user inputs may have varying effects: for example, in one embodiment the difference between the clicking and mouseover may be that clicking shows the children concepts until a later command is received; whereas, the mouseovering shows the children concepts only when the mouse is over the CCCs.
• the illustrative CCR 320 includes an end terminating in an arrow icon 327 (i.e. scroll icon 327) via which the user may rotate the CCR 320 to view additional clinical concepts under the user-selected CCC.
• the CCR 320 at least partially encircles the root concepts ring or arc 310. This provides a compact display.
• Other similar compact display formats are also contemplated, such as an arrangement in which the CCCs are displayed as icons in a central square root region, and the child clinical concepts built by user selection of a CCC are displayed as an added outer region that expands outwardly from the central square root region containing the CCC icons and at least partially surrounds it.
• the illustrative timeline 330 is an arced timeline that partially encircles the CCR 320, again enhancing compactness.
• the GCR 330 includes icons representing clinical (sub-)concepts or, in the outermost layer, representing individual medical reports or other at least partially text-based information sources.
• Each icon (e.g. block or arc segment) of the ring-fashion-timeline 330 includes (at least a portion of) a text segment of the medical report that is annotated with the user-selected clinical concept.
• the displayed text segment may optionally include a few words that precede and succeed the annotated text segment of the medical report. If space is limited, a scroll icon 340 may again be provided to scroll through the blocks of the timeline 330.
• the user wishes to see the entire medical report, this may be done by selecting the icon representing the medical report, which brings up a pop-up window 350 containing the entire medical report.
• this operation may open a separate program (e.g. a text editor or report browsing program) with the medical report loaded.
• the presented summary 340 may contain a part of the report that includes the children concept.
• a method of navigating medical report information using the CDW system of FIGURE 1 is described.
• medical reports 120 are annotated by the annotator module 130 by associating clinical concepts with text segments of the medical reports.
• the root concepts circle ring or arc 310 is built and displayed on the display device 102.
• the root concepts circle ring or arc 310 includes arc segments 315 representing clinical concept categories (CCC's).
• CCC's clinical concept categories
• a user selection is received of an arc segment representing a clinical concept category.
• the user operation identifies a user-selected clinical concept category.
• a children concept ring or arc 320 is then built and displayed, which expands the user-selected clinical concept category and at least partially encircles the root concepts ring or arc.
• the children concept ring or arc 320 includes arc segments 325 representing clinical concepts of the user-selected clinical concept category. It will be appreciated that the operations 404, 406 may optionally be repeated one or more times to create "grand-children", “great-grandchildren”, etc clinical concept rings or arcs, each encircling the previous ring or arc and each optionally including features such as the scroll icon 327. This is indicated in FIGURE 5 by loop arrow 408.
• an operation 410 user input is received via the user input device 104 operating on the displayed children (or grandchildren, or great-grandchildren, etc) concept ring or arc to make a user selection of an arc segment representing a clinical concept.
• This identifies a user-selected clinical concept for which relevant medical reports are to be viewed.
• the timeline 330 is built and displayed adjacent (and optionally at least partially encircling or surrounding) the children concept ring or arc from which it expands.
• the timeline 330 comprises arc segments or blocks representing medical reports annotated with the user-selected clinical concept.
• the wheel shaped components of CDW 136 result in a more compact design displayed on a medical display device. This more compact design results in lower burden on any processors and memory in the medical display device; thus, the compact design of CDW 136 improves the technical functioning of the medical display device.
• non-transitory storage medium storing instructions readable and executable by an electronic data processing device (such as the computer 100) to perform the disclosed techniques.
• a non-transitory storage medium may comprise a hard drive or other magnetic storage medium, an optical disk or other optical storage medium, a cloud-based storage medium such as a RAID disk array, flash memory or other non-volatile electronic storage medium, or so forth.

Landscapes

• Engineering & Computer Science (AREA)
• Health & Medical Sciences (AREA)
• Biomedical Technology (AREA)
• Epidemiology (AREA)
• General Health & Medical Sciences (AREA)
• Medical Informatics (AREA)
• Primary Health Care (AREA)
• Public Health (AREA)
• General Engineering & Computer Science (AREA)
• Theoretical Computer Science (AREA)
• General Business, Economics & Management (AREA)
• Business, Economics & Management (AREA)
• Human Computer Interaction (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Medical Treatment And Welfare Office Work (AREA)
• Measuring And Recording Apparatus For Diagnosis (AREA)

Priority Applications (3)

Applications Claiming Priority (2)

Publications (1)

Family

ID=57517936

Family Applications (1)

Country Status (4)

Families Citing this family (2)

Citations (2)

Family Cites Families (17)

• 2016
  • 2016-11-22 JP JP2018526914A patent/JP6899387B2/ja active Active
  • 2016-11-22 CN CN201680069962.XA patent/CN108292527A/zh active Pending
  • 2016-11-22 US US15/776,465 patent/US11990232B2/en active Active
  • 2016-11-22 WO PCT/IB2016/057019 patent/WO2017093846A1/en not_active Ceased

Patent Citations (2)

Also Published As

Similar Documents

Legal Events