EP3191991A1 - Image report annotation identification - Google Patents
Image report annotation identificationInfo
- Publication number
- EP3191991A1 EP3191991A1 EP15778726.8A EP15778726A EP3191991A1 EP 3191991 A1 EP3191991 A1 EP 3191991A1 EP 15778726 A EP15778726 A EP 15778726A EP 3191991 A1 EP3191991 A1 EP 3191991A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- image
- annotation
- previously annotated
- input image
- images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims abstract description 30
- 239000013598 vector Substances 0.000 claims description 7
- 230000003902 lesion Effects 0.000 description 12
- 238000003384 imaging method Methods 0.000 description 7
- 230000001788 irregular Effects 0.000 description 7
- 238000013459 approach Methods 0.000 description 6
- 230000000007 visual effect Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 238000002604 ultrasonography Methods 0.000 description 4
- 210000000481 breast Anatomy 0.000 description 3
- 238000002591 computed tomography Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000004075 alteration Effects 0.000 description 2
- 230000002708 enhancing effect Effects 0.000 description 2
- 238000002595 magnetic resonance imaging Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000002600 positron emission tomography Methods 0.000 description 2
- 238000002603 single-photon emission computed tomography Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 210000004072 lung Anatomy 0.000 description 1
- 238000009607 mammography Methods 0.000 description 1
- 238000009659 non-destructive testing Methods 0.000 description 1
- 230000000771 oncological effect Effects 0.000 description 1
- 210000000056 organ Anatomy 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 238000011524 similarity measure Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/56—Information retrieval; Database structures therefor; File system structures therefor of still image data having vectorial format
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H15/00—ICT specially adapted for medical reports, e.g. generation or transmission thereof
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
Definitions
- the following generally relates to determining an annotation for an electronically formatted image report based on previously annotated images.
- Structured reporting is commonly used to capture descriptive information about tissue of interest (e.g., oncologic lesions) in medical imaging.
- tissue of interest e.g., oncologic lesions
- a radiologist labels tissue of interest in images using a standardized set of text annotations, which describe the tissue shape, orientation, location, and/or other characteristics in a manner that can be more easily interpreted by others who are familiar with the annotation nomenclature.
- the Breast Imaging Reporting and Data System (BI-RADS) is a standard developed by the American College of Radiology.
- lesions evaluated on MRI should be described by shape (round, oval, lobular, irregular), margin (smooth, irregular, spiculated), enhancement (homogeneous, heterogeneous, rim enhancing, dark internal septation, enhancing internal septation, central enhancement), and other categories.
- masses should be annotated as to their shape (oval, round, irregular), orientation (parallel, not parallel), margin (circumscribed, indistinct, angular, microlobulated, spiculated), and other categories. Similar systems exist or are being considered for other organs, such as lung. With such standards, a radiologist reviews the image and selects text annotations based on his or her observations and understanding of the definitions of the annotation terms.
- a basic approach to structured reporting includes having a user directly select text annotations for an image or finding. This may be simply implemented as, e.g. a dropdown menu from which a user chooses a category via a mouse, touchscreen, keyboard, and/or other input device. However, such an approach is subject to the user's expertise and interpretation of the meaning of those terms.
- An alternative approach to structured reporting is visual reporting. With visual reporting, the drop-down list of text is replaced with example images (canonical images) from a database, and the user selects annotations aided by example images. For example, instead of selecting just the term "spiculated", the user may select an image showing example spiculated tissue from a group of predetermined fixed images. This reduces subjectivity because the definition of the structured annotation is given by the image rather than the textual term.
- a method for creating an electronically formatted image report with a image annotation includes receiving an input image, of a patient, to annotate. The method further includes comparing the input image with a set of previously annotated images. The method further includes generating a similarity metric for each of the previously annotated images based on a result of a corresponding comparison. The method further includes identifying a previously annotated image with a greatest similarity for each of a plurality of predetermined annotations. The method further includes visually displaying the identified image for each annotation along with the annotation. The method further includes receiving an input signal identifying one of the displayed images. The method further includes annotating the input image with the identified one of the displayed images. The method further includes generating, in an electronic format, a report for the input image that includes the identified annotation.
- a computing apparatus in another aspect, includes a first input device that receives an input image, of a patient, to annotate.
- the computing apparatus further includes a processor that compares the input image with a set of previously annotated images, generates a similarity metric for each of the previously annotated images based on a result of a corresponding comparison, and identifies a previously annotated image with a greatest similarity for each of a plurality of predetermined annotations.
- the computing apparatus further includes a display that visually displays the identified image for each annotation along with the annotation.
- a computer readable storage medium encoded with computer readable instructions, which, when executed by a processer, causes the processor to: receive an input image, of a patient, to annotate, compare the input image with a set of previously annotated images, generate a similarity metric for each of the previously annotated images based on a result of a corresponding comparison, identify a previously annotated image with a greatest similarity for each of a plurality of predetermined
- annotations visually display the identified image for each annotation along with the annotation, receive an input signal identifying one of the displayed images, annotate the input image with the identified one of the displayed images, and generate, in an electronic format, a report for the input image that includes the identified annotation.
- the invention may take form in various components and arrangements of components, and in various steps and arrangements of steps.
- the drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention.
- FIGURE 1 schematically illustrates an example computing system with a report module.
- FIGURE 2 schematically illustrates an example of report module.
- FIGURE 3 illustrates an example display showing best matched images for multiple different annotation types.
- FIGURE 4 illustrates an example method for generating a report with an annotation.
- FIGURE 1 illustrates a system 100 with a computing apparatus 102 that includes at least one processor 104, which executes one or more computer readable instructions 106 stored in computer readable storage medium 108, which excludes transitory medium and include physical memory and/or other non-transitory storage medium.
- the processor 104 can additionally or alternatively execute one or more computer readable instructions carried by a carrier wave, a signal or other transitory medium.
- the computing apparatus 102 receives information from one or more input devices 110 such as a keyboard, a mouse, a touch screen, etc. and/or conveys information to one or more output devices 112 such as one or more display monitors.
- the illustrated computing apparatus 102 is also in communication with a network 116 and one or more devices in communication with the network such as at least one data repository 118, at least one imaging system 120, and/or one or more other devices.
- Examples of data repositories 118 include, but are not limited to, a picture archiving and communication system (PACS), a radiology information system (RIS), a hospital information system (HIS), and an electronic medical record (EMR).
- Examples of imaging systems 120 include, but are not limited to, a computed tomography (CT) system, a magnetic resonance (MR) system, a positron emission tomography (PET) system, a single photon emission computed tomography (SPECT) system, an ultrasound (US) system, and an X-ray imaging system.
- CT computed tomography
- MR magnetic resonance
- PET positron emission tomography
- SPECT single photon emission computed tomography
- US ultrasound
- X-ray imaging system X-ray imaging system.
- the computing apparatus 102 can be a general purpose computer or the like located at a physician's office, a health care facility, an imaging center, etc.
- the computing apparatus 102 at least includes software that allows authorized personnel to generate electronic medical reports.
- the computing apparatus 102 can convey and/or receive information using formats such as Health Level Seven (HL7), Extensible Markup Language (XML), Digital Imaging and Communications in Medicine (DICOM), and/or one or more other format(s).
- HL7 Health Level Seven
- XML Extensible Markup Language
- DICOM Digital Imaging and Communications in Medicine
- the at least one computer readable instruction 106 includes a report module 122, which, when executed by the at least one processor 104 generates, in an electronic format, a report, for an input image to be annotated, that includes an annotation.
- the report module 122 determines the annotation based on the input image to be annotated and a set of previously acquired and annotated images of other patients.
- the final report includes an annotation corresponding to an image that visually matches tissue of interest in the input image better than a fixed example image with a generic representation of the tissue of interest.
- FIGURE 2 schematically illustrates an example of the report module 122.
- the report module 122 receives, as input, an image (of a subject or object) to be annotated.
- the input image can be from the imaging system(s) 120, the data repository(s) 118, and/or other device.
- the input image is a medical image, for example, a MRI, CT, ultrasound, mammography, x-ray, SPECT, or PET image.
- the input image can be a non- medical image, such as an image of an object in connection with non-destructive testing, security screening (e.g., airport), and/or other non-medical application.
- the report module 122 has access to the data repository(s) 118. It is to be appreciated that the report module 122 may have access to other data storage that stores previously acquired and annotated images, including cloud based storage, distributed storage, and/or other storage.
- the data repository(s) 118 includes, at least, a database of images of other patients for which annotations have already been created.
- Example image formats for such images include DICOM, JPG, PNG and/or other electronic image format.
- the data repository(s) 118 is a separately held curated database where images have been specifically reviewed for use in the application.
- the data repository(s) 118 is a database past patients at a medical institution, for example, as stored in a PACS.
- Other data repositories are also contemplated herein.
- the data repository(s) 118 includes the image and the annotation.
- the image and the annotation are stored on separated devices.
- the data repository(s) 118 includes at least one image representing each of the available annotations.
- a set of available annotations includes margin annotations (e.g., "spiculated” or “circumscribed"), shape annotations (e.g., "round” or “irregular”), and/or one or more other annotations.
- the data repository(s) 118 includes at least one spiculated example image, at least one circumscribed example image, at least one round example image, and at least one irregular example image.
- the report module 122 includes an image comparison module 202.
- the image comparison module 202 determines a similarity metric between the input image and one or more of the previously annotated images in the data repository(s) 118.
- the report module 122 receives a user input identifying a point or sub-region within the input image to identify tissue of interest in the input image to annotate.
- the entire input image, rather than just the point or the sub-region of the input image, is to be annotated. In the later instance, the user input is not needed.
- the identified portion or the entire two images are compared.
- the portion is first segmented using known and/or other approaches.
- Quantitative features are then computed using known and/or other approaches, generating numerical features descriptive of the size, position, brightness, contrast, shape, texture of the object and its surroundings, yielding a "feature vector".
- the two feature vectors are then compared using, e.g. a Euclidean distance measure, with shorter distances representing more similar objects.
- the images are compared in a pixel-wise (or voxel-wise, or sub-group of pixel or voxel-wise) approach such as sum-of-squared difference, mutual information, normalized mutual information, cross-correlation, etc.
- a single image comparison module e.g., the image comparison module 202 performs all of the comparisons.
- the report module 122 further includes an image selection module 204.
- the image selection module 204 selects a candidate image for each annotation.
- a single most similar image is selected. This can be done by identifying the image with a highest similarity measure and the requisite annotation. For example, where a lesion is described by margin ( "spiculated” or “circumscribed”) and shape ("round” or “irregular”), the most similar "spiculated” lesion is identified, the most similar "circumscribed” lesion is identified, the most similar "round” lesion, and the most similar "irregular” lesion. There may be overlap, e.g. the most similar circumscribed lesion may also be the most similar round lesion.
- a set of similar images is identified where each set consists of at least one image. This may be achieved by selecting a subset of images (from the data repository(s) 1 18) with a given annotation where a similarity is greater than a pre-set threshold. Alternatively, this may be done by selecting a percentage of cases. For example, if similarity is measured on a 0-to-l scale, with the above example, all spiculated lesions with a similarity greater than 0.8 may be chosen, or the 5% of spiculated lesions that have the highest similarity may be chosen. This is repeated for each annotation type.
- the report module 122 further includes a presentation module 206.
- the presentation module 206 visually presents (e.g., via a display of the output device(s) 112) each annotation and at least one most similar image for each annotation.
- FIGURE 3 shows an image 302 with spiculated tissue 304 for the annotation spiculated 306, and an image 308 with microlobulated tissue 310 for the annotation microlobulated 312.
- multiple images may be shown for an annotation.
- the report module 122 further includes an annotation module 208.
- the annotation module 208 in response to receiving a user input identifying one of the displayed images and/or annotations, annotates the input image with the displayed image.
- the visually presented images e.g., FIGURE 3
- the user can select an image, e.g. by clicking on a nearby button, clicking on the image, and/or similar operation.
- the report module 122 further includes a report generation module 210.
- the report generation module 210 generates, in an electronic format, a report for the input image that includes the user selected annotation spiculated 306.
- the report is a visual report, which further includes the identified annotated image 302 as a visual image annotation.
- FIGURE 4 illustrates an example flow chart in accordance with the disclosure herein.
- a similarity metric is determined between the two images.
- acts 404 through 408 are repeated.
- a most similar image is identified for each annotation based on the similarity metric.
- an input indicative of a user identified previously annotated image and/or annotation is received.
- the input image is annotated with the identified annotation.
- a report in electronic format, is generated for the input image with the identified annotation, and optionally, the identified image as a visual image annotation.
- the above may be implemented by way of computer readable instructions, encoded or embedded on computer readable storage medium, which, when executed by a computer processor(s), cause the processor(s) to carry out the described acts. Additionally or alternatively, at least one of the computer readable instructions is carried by a signal, carrier wave or other transitory medium.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Epidemiology (AREA)
- Primary Health Care (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Image Processing (AREA)
- Medical Treatment And Welfare Office Work (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201462048295P | 2014-09-10 | 2014-09-10 | |
PCT/IB2015/056866 WO2016038535A1 (en) | 2014-09-10 | 2015-09-08 | Image report annotation identification |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3191991A1 true EP3191991A1 (en) | 2017-07-19 |
EP3191991B1 EP3191991B1 (en) | 2021-01-13 |
Family
ID=54292840
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP15778726.8A Active EP3191991B1 (en) | 2014-09-10 | 2015-09-08 | Image report annotation identification |
Country Status (6)
Country | Link |
---|---|
US (1) | US20170300621A1 (en) |
EP (1) | EP3191991B1 (en) |
JP (1) | JP6796060B2 (en) |
CN (1) | CN106796621B (en) |
RU (1) | RU2699416C2 (en) |
WO (1) | WO2016038535A1 (en) |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10729396B2 (en) | 2016-08-31 | 2020-08-04 | International Business Machines Corporation | Tracking anatomical findings within medical images |
US10276265B2 (en) * | 2016-08-31 | 2019-04-30 | International Business Machines Corporation | Automated anatomically-based reporting of medical images via image annotation |
US11195313B2 (en) | 2016-10-14 | 2021-12-07 | International Business Machines Corporation | Cross-modality neural network transform for semi-automatic medical image annotation |
JP6926838B2 (en) * | 2017-08-31 | 2021-08-25 | 富士通株式会社 | Information processing equipment, information processing methods, and programs |
CN111448614B (en) * | 2017-11-02 | 2024-05-28 | 皇家飞利浦有限公司 | Method and apparatus for analyzing echocardiography |
US10916343B2 (en) | 2018-04-26 | 2021-02-09 | International Business Machines Corporation | Reduce discrepancy of human annotators in medical imaging by automatic visual comparison to similar cases |
US10290101B1 (en) * | 2018-12-07 | 2019-05-14 | Sonavista, Inc. | Heat map based medical image diagnostic mechanism |
US12001669B2 (en) * | 2019-03-29 | 2024-06-04 | Sony Group Corporation | Searching for write information corresponding to a feature of an image |
US11189375B1 (en) * | 2020-05-27 | 2021-11-30 | GE Precision Healthcare LLC | Methods and systems for a medical image annotation tool |
Family Cites Families (36)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
AU1365699A (en) * | 1997-10-27 | 1999-05-17 | Imagen Incorporated | Image search and retrieval system |
JP2004005364A (en) * | 2002-04-03 | 2004-01-08 | Fuji Photo Film Co Ltd | Similar image retrieval system |
US7941009B2 (en) * | 2003-04-08 | 2011-05-10 | The Penn State Research Foundation | Real-time computerized annotation of pictures |
US7298376B2 (en) * | 2003-07-28 | 2007-11-20 | Landmark Graphics Corporation | System and method for real-time co-rendering of multiple attributes |
US7876934B2 (en) * | 2004-11-08 | 2011-01-25 | Siemens Medical Solutions Usa, Inc. | Method of database-guided segmentation of anatomical structures having complex appearances |
WO2006128302A1 (en) * | 2005-06-02 | 2006-12-07 | The Medipattern Corporation | System and method of computer-aided detection |
JP2009513689A (en) * | 2005-10-31 | 2009-04-02 | ラボラトワール セローノ ソシエテ アノニム | Use of SDF-1 for the treatment and / or prevention of neurological disorders |
US8341112B2 (en) * | 2006-05-19 | 2012-12-25 | Microsoft Corporation | Annotation by search |
US20070280561A1 (en) * | 2006-05-30 | 2007-12-06 | General Electric Company | System, method and computer instructions for aiding image analysis |
US7792778B2 (en) * | 2006-07-31 | 2010-09-07 | Siemens Medical Solutions Usa, Inc. | Knowledge-based imaging CAD system |
JP4979334B2 (en) * | 2006-10-18 | 2012-07-18 | 富士フイルム株式会社 | Medical image interpretation support system and program |
US7995818B2 (en) * | 2006-11-22 | 2011-08-09 | General Electric Company | Systems and methods for synchronized image viewing with an image atlas |
AU2006249239B2 (en) * | 2006-12-07 | 2010-02-18 | Canon Kabushiki Kaisha | A method of ordering and presenting images with smooth metadata transitions |
CN101587478B (en) * | 2008-05-20 | 2013-07-24 | 株式会社理光 | Methods and devices for training, automatically labeling and searching images |
US10102347B2 (en) * | 2008-09-26 | 2018-10-16 | Koninklijke Philips N.V. | Patient specific anatiomical sketches for medical reports |
RU2385494C1 (en) * | 2008-10-22 | 2010-03-27 | Государственное образовательное учреждение высшего профессионального образования Московский инженерно-физический институт (государственный университет) | Method for recognition of cell texture image |
EP2380140B1 (en) * | 2008-12-18 | 2019-04-03 | Koninklijke Philips N.V. | Generating views of medical images |
RU2431191C2 (en) * | 2009-01-27 | 2011-10-10 | Государственное образовательное учреждение высшего профессионального образования Академия Федеральной службы охраны Российской Федерации (Академия ФСО России) | Method for personal identification through digital facial image |
RU2543563C2 (en) * | 2009-04-15 | 2015-03-10 | Конинклейке Филипс Электроникс Н.В. | Systems and methods for clinical decision support |
US8429173B1 (en) * | 2009-04-20 | 2013-04-23 | Google Inc. | Method, system, and computer readable medium for identifying result images based on an image query |
JP5383431B2 (en) * | 2009-10-27 | 2014-01-08 | キヤノン株式会社 | Information processing apparatus, information processing method, and program |
CN102667786A (en) * | 2009-11-24 | 2012-09-12 | 皇家飞利浦电子股份有限公司 | Protocol guided imaging procedure |
JP2011118543A (en) * | 2009-12-01 | 2011-06-16 | Shizuoka Prefecture | Case image retrieval device, method and program |
EP2617012B1 (en) * | 2010-09-16 | 2015-06-17 | Mor Research Applications Ltd. | Method and system for analyzing images |
EP2622582B1 (en) * | 2010-09-30 | 2019-01-02 | Koninklijke Philips N.V. | Image and annotation display |
US9378331B2 (en) * | 2010-11-19 | 2016-06-28 | D.R. Systems, Inc. | Annotation and assessment of images |
WO2012123829A1 (en) * | 2011-03-16 | 2012-09-20 | Koninklijke Philips Electronics N.V. | Method and system for intelligent linking of medical data. |
WO2012154216A1 (en) * | 2011-05-06 | 2012-11-15 | Sti Medical Systems, Llc | Diagnosis support system providing guidance to a user by automated retrieval of similar cancer images with user feedback |
JP5242866B1 (en) * | 2011-08-12 | 2013-07-24 | オリンパスメディカルシステムズ株式会社 | Image management apparatus, method, and interpretation program |
US9239848B2 (en) * | 2012-02-06 | 2016-01-19 | Microsoft Technology Licensing, Llc | System and method for semantically annotating images |
BR112015003472B1 (en) * | 2012-08-22 | 2022-04-12 | Koninklijke Philips N.V. | Annotation support system and method of providing annotation support |
US9098532B2 (en) * | 2012-11-29 | 2015-08-04 | International Business Machines Corporation | Generating alternative descriptions for images |
CA2804439A1 (en) * | 2012-12-13 | 2014-06-13 | Ehsan Fazl Ersi | System and method for categorizing an image |
US9349186B2 (en) * | 2013-02-11 | 2016-05-24 | General Electric Company | Systems and methods for image segmentation using target image intensity |
US9384213B2 (en) * | 2013-08-14 | 2016-07-05 | Google Inc. | Searching and annotating within images |
US9589349B2 (en) * | 2013-09-25 | 2017-03-07 | Heartflow, Inc. | Systems and methods for controlling user repeatability and reproducibility of automated image annotation correction |
-
2015
- 2015-09-08 CN CN201580048796.0A patent/CN106796621B/en active Active
- 2015-09-08 WO PCT/IB2015/056866 patent/WO2016038535A1/en active Application Filing
- 2015-09-08 US US15/508,169 patent/US20170300621A1/en not_active Abandoned
- 2015-09-08 JP JP2017513050A patent/JP6796060B2/en active Active
- 2015-09-08 EP EP15778726.8A patent/EP3191991B1/en active Active
- 2015-09-08 RU RU2017111632A patent/RU2699416C2/en active
Also Published As
Publication number | Publication date |
---|---|
CN106796621A (en) | 2017-05-31 |
JP6796060B2 (en) | 2020-12-02 |
US20170300621A1 (en) | 2017-10-19 |
JP2017534316A (en) | 2017-11-24 |
RU2699416C2 (en) | 2019-09-05 |
RU2017111632A (en) | 2018-10-10 |
WO2016038535A1 (en) | 2016-03-17 |
EP3191991B1 (en) | 2021-01-13 |
RU2017111632A3 (en) | 2019-03-14 |
CN106796621B (en) | 2021-08-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3191991B1 (en) | Image report annotation identification | |
US11380432B2 (en) | Systems and methods for improved analysis and generation of medical imaging reports | |
US10460838B2 (en) | Automated anatomically-based reporting of medical images via image annotation | |
US10275877B2 (en) | Methods and systems for automatically determining diagnosis discrepancies for clinical images | |
CN110140178B (en) | Closed loop system for context-aware image quality collection and feedback | |
CN106170799B (en) | Extracting information from images and including information in clinical reports | |
US10729396B2 (en) | Tracking anatomical findings within medical images | |
CN109564773B (en) | System and method for automatically detecting key images | |
JP7258772B2 (en) | holistic patient radiology viewer | |
CN102365641A (en) | A system that automatically retrieves report templates based on diagnostic information | |
US20190150870A1 (en) | Classification of a health state of tissue of interest based on longitudinal features | |
US20170221204A1 (en) | Overlay Of Findings On Image Data | |
JP2017513590A (en) | Method and system for visualization of patient history | |
US12062428B2 (en) | Image context aware medical recommendation engine | |
CN108352187A (en) | The system and method recommended for generating correct radiation | |
CN107257977B (en) | Detecting missing findings for automatically creating vertical discovery views | |
CN115249527A (en) | Method and system for generating and structuring medical examination information | |
Nishikawa et al. | Computer-aided detection evaluation methods are not created equal | |
US20120191720A1 (en) | Retrieving radiological studies using an image-based query |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20170410 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20181119 |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: KONINKLIJKE PHILIPS N.V. |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602015064766 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G06F0019000000 Ipc: G16H0015000000 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G16H 15/00 20180101AFI20200723BHEP Ipc: G06F 16/56 20190101ALI20200723BHEP |
|
INTG | Intention to grant announced |
Effective date: 20200810 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602015064766 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1355147 Country of ref document: AT Kind code of ref document: T Effective date: 20210215 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1355147 Country of ref document: AT Kind code of ref document: T Effective date: 20210113 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20210113 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210513 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210414 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210413 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210413 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210513 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602015064766 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |
|
26N | No opposition filed |
Effective date: 20211014 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20210930 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20210908 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210513 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210908 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210908 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210908 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210930 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210930 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210930 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210930 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20150908 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20230928 Year of fee payment: 9 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |