WO2012071016A1 - Procédé de création de rapports radiologiques multimédia - Google Patents

Procédé de création de rapports radiologiques multimédia Download PDF

Info

Publication number
WO2012071016A1
WO2012071016A1 PCT/SG2011/000417 SG2011000417W WO2012071016A1 WO 2012071016 A1 WO2012071016 A1 WO 2012071016A1 SG 2011000417 W SG2011000417 W SG 2011000417W WO 2012071016 A1 WO2012071016 A1 WO 2012071016A1
Authority
WO
WIPO (PCT)
Prior art keywords
workstation
report
interactions
series
radiological image
Prior art date
Application number
PCT/SG2011/000417
Other languages
English (en)
Inventor
Thirunavuukarusuu Arumugam
Guoliang Yang
Original Assignee
Agency For Science, Technology And Research
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Agency For Science, Technology And Research filed Critical Agency For Science, Technology And Research
Publication of WO2012071016A1 publication Critical patent/WO2012071016A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/10—Office automation; Time management
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H15/00—ICT specially adapted for medical reports, e.g. generation or transmission thereof
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing

Definitions

  • the invention relates to a method for creating a report of a radiological image.
  • a radiologist When creating a report of a radiological image, a radiologist typically dictates his observations and interpretations into a recording device while assessing the image. These dictations are then transcribed into text either manually or using a speech recognition software. The end result is thus a text report narrating the radiologist's findings.
  • This text report however is static and provides no information beyond textual information. Information which cannot be conveniently expressed using words is not reflected in the text report and this information may be useful for further interpretation and analysis of the radiologist's findings.
  • the absence of the physical presence of the radiologist thus hampers the communication of information from the radiologist to clinicians.
  • the radiologist has to meet with the referring clinicians in order to discuss about the radiological image and convey information which is not expressed in the text report.
  • This however results in a longer reaction time to a patient's condition and thus a longer turn-around time per patient. Consequently, the cost of radiological report and/or medical care is increased.
  • online video conference solutions such as MSN Messenger and Skype exist, they are not suitable for the sharing of medical images because their traffic is compressed such that image quality suffers, thus rendering them unsuitable for diagnostic purposes.
  • the present invention aims to provide a new and useful method for creating a report of a radiological image, and a workstation for carrying out the method.
  • the invention proposes a workstation receiving a series of inputs from a user signaling a series of interactions with a radiological image displayed on a screen.
  • a report is then generated at the workstation for storage in a database, the report incorporating at least part of the radiological image together with data encoding a video indicating the series of interactions.
  • a first expression of the invention is a method for creating at a workstation a report of a radiological image, the method comprising the steps of displaying the radiological image on a screen of the workstation;
  • Such a method produces reports which are better able to convey information between different radiologists and/or different clinicians. These reports when stored in the database serve as a better record of information. Additionally, the stored reports may be used for presenting information during conferences and training sessions.
  • the method further comprises the step of recording a voice or text narration which is associated with the series of interactions, the voice or text narration being included in the report.
  • a voice or text narration which is associated with the series of interactions
  • the voice or text narration being included in the report.
  • the video is compressed using lossless encoding.
  • lossless is understood to mean that the compressed video has the same image quality as the original image. This ensures that image detail is not lost when compressing the video, thus allowing for further observations or interpretations to be made upon the compressed video.
  • the series of interactions is selected from the group consisting of a scrolling of the displayed radiological image, a drawing of a region of interest (ROI) on the displayed radiological image, an overlay of a registered atlas on the displayed radiological image, and one or more annotations of the displayed radiological image.
  • ROI region of interest
  • a variety of interactions is available in order to allow for information to be better captured in the video.
  • the series of interactions is encoded in the video in a vectorized format. This advantageously results in videos which take up less space.
  • the method further comprises the steps of sending the series of inputs from the workstation to another workstation, and displaying graphically on a screen of the other workstation the result of the interactions.
  • the method further comprises the steps of receiving at the workstation from a further workstation a further series of inputs signaling a further series of interactions with the radiological image, and displaying graphically on the screen of the workstation the result of the received further series of interactions; and wherein the report further incorporates data encoding a video indicating the further series of interactions.
  • the database is connected to the workstation by the Internet. This allows the database to be accessed from multiple geographically distributed sites.
  • the workstation is a mobile device. This allows the radiologist or clinicians to work while on the move.
  • a second expression of the invention is a workstation for carrying out the method of the first expression, the workstation comprising
  • a screen configured to display the radiological image
  • an input device configured to receive from the user the series of inputs signaling the series of interactions with the displayed radiological image
  • a processor having software configured to display graphically on the screen the result of the interactions and generate the report
  • a transmitter configured to store the report in the database.
  • a third expression of the invention is a method for collaborative analysis of a radiological image across at least two workstations, the method comprising the steps of at each workstation,
  • a fourth expression of the invention is a method for creating a report comprising the steps of performing collaborative analysis of a radiological image across at least two workstations using the method of the third expression;
  • Such a method allows a report of the radiological image to be created with the consensus and input of multiple parties from different disciplines.
  • Figure 1 is a schematic drawing of a system for radiological reporting and/or analysis according to an example embodiment
  • Figure 2 is a flow-chart of a method for creating a report of a radiological image at a workstation of the system of Figure 1 ;
  • Figure 3 is a screenshot of a text report variation of the report of Figure 2 showing embedded links to two videos;
  • Figure 4 is a screenshot of a Radiology Information System (RIS) variation of the report of Figure 2 showing a patient case with an embedded link to a video;
  • RIS Radiology Information System
  • Figure 5 is a screenshot of a user interface displaying the radiological image of Figure 2.
  • Figure 6 is a flow-chart of a variation of the method of Figure 2 which allows the report of Figure 2 to be created with collaboration of another workstation of the system of Figure 1.
  • the system 100 comprises a Picture Archiving and Communication System (PACS) 180, a reports database 170, an acquisition terminal 110, and workstations 130 and 150.
  • the acquisition terminal 110 and workstations 130 and 150 are connected to the image repository 180 and reports database 170 by way of respective data networks 120, 140 and 160.
  • the data networks 120, 140 and 160 are for example the Internet, or a local network, and it is envisaged that the mode of connection for the data networks 120, 140 and 160 may either be wired or wireless. Further, the data networks 120, 140 and 160 may be different from each other.
  • the PACS 180 includes one or more radiological images 185 stored in it. These images 185 for example are X-ray images or CT, MRI and/or PET tomographic images.
  • the acquisition terminal 110 acquires the images from an imaging device (not shown) such as a digital camera, an X-ray scanner, or a
  • the acquired images are then uploaded onto the PACS 180 to form the radiological images 185.
  • These images 185 after being uploaded are retrievable by the workstations 130 and/or 150.
  • the acquisition terminal 110 may further comprise an input device 114 e.g. a mouse, a transmitter/receiver (not shown) for receiving and transmitting data, processor (not shown) configured to execute software, a screen 112 for displaying images and/or graphics, a pair of headphones 118, speakers 117 and/or a microphone 116.
  • Each of the workstations 130 and 150 comprises an input device (134 and 154 respectively) for receiving inputs from a user, a transmitter/receiver (not shown) for receiving, transmitting data, a processor (not shown) configured to execute software and a screen (132 and 152 respectively) for displaying images and/or graphics.
  • each of the workstations 130 and 150 include respective headphones 138 and 158, respective speakers 137 and 157, and/or respective microphones 136 and 156.
  • the workstations 130 and 150 are configured to execute software to retrieve at least one of the images 185 from the PACS 180.
  • the respective users of the workstations 130 and 150 then analyzes and/or creates a report of the retrieved image(s). This may be done either individually by the user at each workstation 130 or 150 or may be done collaboratively between all the workstations 130 and 150. Methods for creating a report of the retrieved image at one of the workstations 130 and 150 are disclosed later with the aid of Figures 2 and 6. It is noted that although the workstations 130 and 150 may have webcams installed, webcams are not required for the methods of Figures 2 and 6.
  • the report is then stored in the reports database 170 for subsequent retrieval by for example the workstations 130 and/or 150.
  • the reports database 170 is a secure database which preserves the privacy of the reports stored within.
  • the reports database 170 is illustrated in Figure 1 to be a separate device from the PACS 180, it is envisaged that the reports database 170 and the PACS 180 may co-exist on a single device and may even be provided by a common software. In the latter case, the reports database 170 may be integrated into the PACS 180.
  • the acquisition terminal 110 and/or workstations 130 and 150 may be a desktop computer, an embedded device or a mobile computer.
  • Figure 2 shows a method 200 for creating a report of a retrieved image at a workstation 130.
  • step 210 a radiological image is displayed on a screen 132 of the
  • step 210 is illustrated in Figure 5 which shows a user interface of the software displaying a radiological image.
  • step 220 the workstation 130 receives a series of inputs from a user by way of the input device 134. This series of inputs signal the user's corresponding series of interactions with the displayed image. The interactions include actions performed directly on the image e.g. a scrolling, zooming or editing of the displayed image, or actions overlaid on the image e.g.
  • the interactions also include the performing of window leveling i.e. the changing of the brightness and contrast of the image.
  • the results of the interaction is displayed graphically on the screen. This involves rendering the results of the interaction onto a graphical layer which is displayed on top of the original radiological image. The original radiological image does not need to be changed and the results of the interaction is rendered onto the graphical layer for overlay onto the original radiological image.
  • a report of the image is generated.
  • This report incorporates data encoding a video indicating the series of interactions and also includes at least part of the radiological image which is displayed on the screen 132 in step 210.
  • the video which is generated for the report contains the graphical results of the user's interactions with the displayed image.
  • the video stores the graphical layer (showing the results of the interactions) separately from the original radiological image.
  • the radiological image is stored in its original image quality and the graphical layer is stored in a vectorized format.
  • the report is stored in the reports database 170.
  • the video of the report is compressed before the report is stored.
  • the video is compressed using the method disclosed in PCT publication WO2007/046777, "Encoding, storing and decoding data for teaching radiology diagnosis", the contents of which are incorporated herein by reference. This method encodes the original image losslessly.
  • the video may be
  • the user may provide a voice narration or type a text narration while performing the series of interactions of step 220.
  • the workstation 130 additionally records the voice or text narration in step 220 and in step 240, the narration is included in the report.
  • the narration is a voice narration
  • the video may include an
  • the video is multi-media is nature and the video may be generated using the method disclosed in US Patent 7,047,235, "A method and apparatus for creating medical teaching files from image archives", the contents of which are incorporated herein by reference.
  • the video is incorporated into the report either by embedding a link to the video within a text report, or by associating a link to the video with a patient case of a Radiology Information System (RIS).
  • RIS Radiology Information System
  • the former case is illustrated in Figure 3 which shows a display of a text report with embedded links to two videos.
  • the report includes a text narration 310 providing an analysis of the radiological image and the videos are accessible via embedded links 322, 324 within the report.
  • the embedded links 322, 324 are created automatically within the report when the report is generated in step 240.
  • the report and the associated videos are all stored in the reports database 170 in step 250.
  • the embedded links 322, 324 take the form of pictorial representations of the respective videos and when a link is clicked, the corresponding video is streamed from the reports database 170 and played in a player. Should the video contain an audio narration, the narration is played back via the speakers 137 or the headphones 138.
  • the video is incorporated into the report by associating a link to the video with a patient case of a RIS.
  • Figure 4 shows a display of a RIS with a patient case having an embedded link to a video.
  • the RIS has a work-list 410 which lists a plurality of patient cases.
  • Each patient case forms a report including the patient's personal information and case history, and is associated with a video analysis of the one or more radiological images.
  • the report is generated in step 240, the patient case is generated along with the video and its associated link. Thereafter, when the RIS is displayed, the newly generated patient case is visible in the work-list 410.
  • the video is streamed from the reports database 170 and played in a player. Should the video contain an audio narration, the narration is played back via the speakers 137 or the headphones 138.
  • the method 200 further comprises steps which allow the report to be created at the workstation 130 with the collaboration of another workstation 150.
  • This method 600 is shown in Figure 6 where the steps 610, 620, 630, 640 and 650 respectively each include the steps 210, 220, 230, 240 and 250 as performed at the workstation 130.
  • Figure 5 shows this "discussion" button as 510.
  • a notification is sent to all other parties involved in the discussion i.e. the other workstation 50. If a RIS is used at the workstation 150, the radiologist receives this notification as a new patient case in the work- list 410. The radiologist can then accept the discussion notification by clicking on the new patient case.
  • step 610 the radiological image retrieved from the PACS 180 is displayed on the respective screens 132 and 152 of the workstation 130 and other workstation 150.
  • step 620 the workstation 130 receives a series of inputs from a user by way of the input device 134. This series of inputs signal the user's series of interactions with the image displayed on screen 132. The interactions which are possible are the same that of step 220.
  • step 622 the workstation 130 from the other workstation 150 a further series of inputs.
  • This further series of inputs is obtained from another user by way of the input device 154, thus signaling the other user's series of interactions with the image displayed on screen 152.
  • step 624 the series of inputs is sent from the workstation 130 to the other workstation 150.
  • steps 620, 622 and 624 collectively represent at each workstation, the receiving of inputs signaling each users' interactions with the displayed radiological image, and the sending of the received inputs to the other workstations. As the inputs at each workstation are sent to the other
  • step 630 the results of both series of interactions (received from the input devices 134 and 154) are displayed graphically on respective screens 132 and 152 of the workstations 130 and 150.
  • the screens 132 and 152 both show the combined results of both users' interactions with the display radiological image. The contents of the user interface of both screens 132 and 152 thus are identical.
  • step 640 the workstation 130 generates a report of the radiological image.
  • This report incorporates data encoding a video indicating both users' combined interactions with the radiological image.
  • the video is stored in the same fashion as is done in step 240.
  • step 650 report is stored in the reports database 170 in the same fashion as is done in step 250.
  • the radiological image retrieved from the PACS 180 in step 610 may be a moving radiological image, that is for example a video of a radiological scan, or a video that is associated with a report stored in the reports database 170.
  • the method 600 becomes a method for collaborative discussion of a radiological report. Additionally, it is understood that while the method 600 is described using only two workstations 130 and 150, the method 600 can be used with any number of workstations more than two.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Primary Health Care (AREA)
  • Public Health (AREA)
  • Medical Informatics (AREA)
  • Strategic Management (AREA)
  • General Health & Medical Sciences (AREA)
  • Epidemiology (AREA)
  • Economics (AREA)
  • Data Mining & Analysis (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Marketing (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Medical Treatment And Welfare Office Work (AREA)

Abstract

L'invention porte sur un procédé de création, au niveau d'un poste de travail, d'un rapport d'une image radiologique, le procédé comprenant les étapes d'affichage de l'image radiologique sur un écran du poste de travail, de réception d'une série d'entrées d'un utilisateur signalant une série d'interactions avec l'image radiologique affichée, d'affichage graphique sur l'écran du résultat des interactions avec l'image radiologique affichée, de génération du rapport, le rapport comprenant au moins une partie de l'image radiologique conjointement avec des données codant une vidéo (avec ou sans narration vocale) indiquant la série d'interaction, et de stockage du rapport dans une base de données pour une extraction ultérieure. L'invention porte également sur un procédé de création, d'une manière collaborative, d'un rapport avec un autre poste de travail selon le procédé décrit.
PCT/SG2011/000417 2010-11-26 2011-11-25 Procédé de création de rapports radiologiques multimédia WO2012071016A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
SG201008845 2010-11-26
SG201008845-8 2010-11-26

Publications (1)

Publication Number Publication Date
WO2012071016A1 true WO2012071016A1 (fr) 2012-05-31

Family

ID=46146134

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SG2011/000417 WO2012071016A1 (fr) 2010-11-26 2011-11-25 Procédé de création de rapports radiologiques multimédia

Country Status (1)

Country Link
WO (1) WO2012071016A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109564773A (zh) * 2016-06-28 2019-04-02 皇家飞利浦有限公司 用于自动检测关键图像的系统和方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040146221A1 (en) * 2003-01-23 2004-07-29 Siegel Scott H. Radiography Image Management System
US20050111711A1 (en) * 2003-11-25 2005-05-26 Deaven David M. Method and apparatus for remote processing of image data
EP1788502A1 (fr) * 2005-11-22 2007-05-23 General Electric Company Système de travail coopératif assisté par ordinateur permettant de manipuler simultanement des données partagées dans un environnement médical
US20090221881A1 (en) * 2004-01-21 2009-09-03 Edda Technology, Inc. Method and system for intelligent qualitative and quantitative analysis of digital radiography softcopy reading

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040146221A1 (en) * 2003-01-23 2004-07-29 Siegel Scott H. Radiography Image Management System
US20050111711A1 (en) * 2003-11-25 2005-05-26 Deaven David M. Method and apparatus for remote processing of image data
US20090221881A1 (en) * 2004-01-21 2009-09-03 Edda Technology, Inc. Method and system for intelligent qualitative and quantitative analysis of digital radiography softcopy reading
EP1788502A1 (fr) * 2005-11-22 2007-05-23 General Electric Company Système de travail coopératif assisté par ordinateur permettant de manipuler simultanement des données partagées dans un environnement médical

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109564773A (zh) * 2016-06-28 2019-04-02 皇家飞利浦有限公司 用于自动检测关键图像的系统和方法
CN109564773B (zh) * 2016-06-28 2023-07-07 皇家飞利浦有限公司 用于自动检测关键图像的系统和方法

Similar Documents

Publication Publication Date Title
Wootton et al. Introduction to telemedicine
Boland et al. A COVID-19-era rapid review: using Zoom and Skype for qualitative group research.
US8924864B2 (en) System and method for collaboratively communicating on images and saving those communications and images in a standard known format
US11989675B2 (en) Efficient surgical center workflow procedures
US11356488B2 (en) Frame synchronous rendering of remote participant identities
US10356022B2 (en) Systems and methods for manipulating and/or concatenating videos
US9641799B2 (en) Multimodal cognitive communications and collaborative knowledge exchange with visual neural networking and packetized augmented intelligence
US20060122482A1 (en) Medical image acquisition system for receiving and transmitting medical images instantaneously and method of using the same
JP2007141245A (ja) Ｐａｃｓ内部における計画及び協議のための完全にトランスペアレントなリアルタイム対話式共同作業
US20060236247A1 (en) Interface to display contextual patient information via communication/collaboration application
US10638089B2 (en) System and method of collaboratively communication on images via input illustrations and have those illustrations auto erase
US20120240061A1 (en) Methods and systems for sharing content items relating to multimedia captured and/or direct observations of persons performing a task for evaluation
JP6261183B2 (ja) 医用画像データ情報交換システム
US20230033576A1 (en) Systems and methods of establishing a communication session for live review of ultrasound scanning
JP7292782B2 (ja) 遠隔会議システム、遠隔会議のための方法、およびコンピュータ・プログラム
US9740378B2 (en) Collaboration content sharing
US20120281970A1 (en) Medical video production and distribution system
CN114093451A (zh) 一种pacs系统管理用户数据的方法及系统
US20230388356A1 (en) Note Capture In Communication Sessions
JP4649640B2 (ja) 画像処理方法、画像処理装置、及びコンテンツ作成システム
JPH0822503A (ja) 遠隔診療支援システム
WO2012071016A1 (fr) Procédé de création de rapports radiologiques multimédia
CN111653343A (zh) 一种医疗实时影像远程会诊系统及方法
Cohen A practical guide to graphic communication for quality assurance, education, and patient care in echocardiography
CN110136847B (zh) 远程会诊系统

Legal Events

Date Code Title Description
DPE2 Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11843958

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11843958

Country of ref document: EP

Kind code of ref document: A1