TWI755014B - Image synchronous processing system based on real-time web technology and method thereof - Google Patents
Image synchronous processing system based on real-time web technology and method thereof Download PDFInfo
- Publication number
- TWI755014B TWI755014B TW109126419A TW109126419A TWI755014B TW I755014 B TWI755014 B TW I755014B TW 109126419 A TW109126419 A TW 109126419A TW 109126419 A TW109126419 A TW 109126419A TW I755014 B TWI755014 B TW I755014B
- Authority
- TW
- Taiwan
- Prior art keywords
- image
- information
- user devices
- real
- server
- Prior art date
Links
Images
Landscapes
- Information Transfer Between Computers (AREA)
- Medical Treatment And Welfare Office Work (AREA)
Abstract
Description
本發明是有關於一種影像同步處理的系統與方法,且特別是有關於一種基於即時網路(real-time web)技術的影像同步處理系統及其方法。The present invention relates to an image synchronization processing system and method, and more particularly, to an image synchronization processing system and method based on real-time web technology.
隨著數位病理影像的快速發展以及雲端技術的成熟,成為解決病理醫師缺乏與地域分配不均的解決方案之一。當多位醫師需要對特定的數位病理影像進行討論時,往往採用當面進行討論的方法或者是透過網際網路進行線上討論的方法。然而,在線上討論的過程中,無法同時讓所有參與討論的醫師同時對特定的數位病理影像進行標註與編修。因此,如何解決目前線上討論的過程所遇到的上述問題,為本領域技術人員所關心的議題之一。With the rapid development of digital pathology imaging and the maturity of cloud technology, it has become one of the solutions to solve the lack of pathologists and uneven geographical distribution. When multiple doctors need to discuss a specific digital pathological image, they often use the method of face-to-face discussion or the method of online discussion through the Internet. However, in the process of online discussion, it is impossible for all participating physicians to annotate and edit specific digital pathological images at the same time. Therefore, how to solve the above problems encountered in the current online discussion process is one of the issues concerned by those skilled in the art.
本發明提供一種基於即時網路技術的影像同步處理系統,包括影像伺服器、多個使用者裝置以及即時網路伺服器。影像伺服器用以儲存第一影像的第一影像資訊,多個使用者裝置分別用以從影像伺服器接收第一影像資訊。即時網路伺服器連接影像伺服器與多個使用者裝置。當多個使用者裝置中至少一者標註至少一標註資訊於第一影像以顯示第二影像資訊時,即時網路伺服器響應於多個使用者裝置中至少一者的操作,從多個使用者裝置中的至少一者接收至少一標註資訊,以及將所接收之至少一標註資訊傳送至多個使用者裝置中的其餘使用者裝置,其中多個使用者裝置中的 其餘使用者裝置用以依據接收到的至少一標註資訊與第一影像資訊產生第二影像資訊。The present invention provides an image synchronization processing system based on real-time network technology, comprising an image server, a plurality of user devices and a real-time network server. The image server is used for storing the first image information of the first image, and the plurality of user devices are respectively used for receiving the first image information from the image server. The real-time web server connects the image server and multiple user devices. When at least one of the plurality of user devices annotates at least one label information on the first image to display the second image information, the real-time network server responds to the operation of at least one of the plurality of user devices, from the plurality of user devices At least one of the user devices receives at least one annotation information, and transmits the received at least one annotation information to the remaining user devices of the plurality of user devices, wherein the remaining user devices of the plurality of user devices are used for according to The received at least one annotation information and the first image information generate second image information.
本發明另提供一種基於即時網路技術的影像同步處理的方法,包括下列步驟:藉由多個使用者裝置分別從一影像伺服器接收一第一影像的第一影像資訊;當藉由多個使用者裝置中至少一者標註至少一標註資訊於第一影像以顯示第二影像資訊時,響應於多個使用者裝置中至少一者的操作,藉由即時網路伺服器從多個使用者裝置中的至少一者接收至少一標註資訊;藉由即時網路伺服器將所接收之至少一標註資訊傳送至多個使用者裝置中的其餘使用者裝置;以及藉由多個使用者裝置中的其餘使用者裝置用以依據接收到的至少一標註資訊與第一影像資訊產生第二影像資訊。The present invention further provides a method for image synchronization processing based on real-time network technology, comprising the following steps: receiving first image information of a first image from an image server through a plurality of user devices; When at least one of the user devices marks at least one label information on the first image to display the second image information, in response to an operation of at least one of the plurality of user devices, the real-time network server is used to obtain information from the plurality of users. at least one of the devices receives at least one annotation information; transmits the received at least one annotation information to the remaining user devices of the plurality of user devices by the real-time network server; and The other user devices are used for generating second image information according to the received at least one annotation information and the first image information.
基於上述,本發明的基於即時網路技術的影像同步處理的系統與方法可將各個使用者在各自使用的使用者裝置上對同一個影像的所有標註資訊立即同步到所有的使用者裝置上的影像。Based on the above, the system and method for image synchronization processing based on real-time network technology of the present invention can immediately synchronize all the annotation information of the same image on the user device used by each user to the data on all user devices. image.
為讓本發明的上述特徵和優點能更明顯易懂,下文特舉實施例,並配合所附圖式作詳細說明如下。In order to make the above-mentioned features and advantages of the present invention more obvious and easy to understand, the following embodiments are given and described in detail with the accompanying drawings as follows.
第1圖是根據本發明一些示範性實施例的基於即時網路(real-time web)技術的影像同步處理系統的方塊圖。請參照第1圖,本實施例的影像同步處理系統100包括影像伺服器110、多個使用者裝置120(1)~120(N)以及即時網路伺服器130,其中N為任意正整數,並沒有特別的限制。影像伺服器110可儲存多個影像的影像資訊。使用者裝置120(1)~120(N)可分別從影像伺服器110接收多個影像中至少一個影像所對應的影像資訊。即時網路伺服器130可連接於影像伺服器110與使用者裝置120(1)~120(N)之間。FIG. 1 is a block diagram of an image synchronization processing system based on real-time web technology according to some exemplary embodiments of the present invention. Referring to FIG. 1, the image
在一些實施例中,影像伺服器110例如是用以儲存與處理影像的伺服器主機或網路硬碟等。在進一步實施例中,影像伺服器110例如是獨立架設且具有高安全性的伺服器主機或網路硬碟等。In some embodiments, the
在一些實施例中,使用者裝置120(1)~120(N)例如是具有一般顯示器或觸控式顯示器的個人電腦(personal computer,PC)、平板電腦、行動電話、個人數位助理(personal digital assistant,PDA)等運算裝置等。In some embodiments, the user devices 120(1)-120(N) are, for example, a personal computer (PC), a tablet computer, a mobile phone, a personal digital assistant (personal digital assistant) with a normal display or a touch-sensitive display. assistant, PDA) and other computing devices.
在一些實施例中,即時網路伺服器130例如是用於建立即時網路應用程式(real-time web applications)的即時網路伺服器(real-time web server)。In some embodiments, the real-
在一些實施例中,影像伺服器110、多個使用者裝置120(1)~120(N)以及即時網路伺服器130皆可支援超文本傳輸協定(hypertext transfer protocol,HTTP)、檔案傳輸協定(file transfer protocol,FTP)或傳輸控制協定與網際網路協定(transmission control protocol/internet protocol,TCP/IP)等通訊協定。在一些實施例中,影像伺服器110可基於HTTP協定經由即時網路伺服器130將第一影像資訊傳送至使用者裝置120(1)~120(N)。In some embodiments, the
在一些實施例中,影像同步處理系統100也可包括不只一個影像伺服器(即,包括影像伺服器110以及除了影像伺服器110的其他影像伺服器)。此外,這些影像伺服器可以是醫院的用以儲存病灶影像的伺服器或教育機構的用以儲存教學影像的伺服器等各種影像伺服器。In some embodiments, the image
第2圖是根據本發明一些示範性實施例的基於即時網路技術的影像同步處理方法的流程圖。本實施例的方法適用於第1圖的影像同步處理系統100,但不以此為限。任何可應用第2圖所示方法的影像同步處理系統均在本案思及範圍內。為清楚說明起見,以下即搭配第1圖所示影像同步處理的系統100中各裝置之間的作動關係來說明第2圖所示之影像同步處理的方法的詳細步驟。FIG. 2 is a flowchart of an image synchronization processing method based on real-time network technology according to some exemplary embodiments of the present invention. The method of this embodiment is applicable to the image
首先,於步驟S201中,藉由使用者裝置120(1)~120(N)分別從影像伺服器110接收第一影像資訊。詳細而言,在多個使用者想要對特定的第一影像進行標註之前,多個使用者可藉由使用者裝置120(1)~120(N)向影像伺服器110傳送影像請求資訊,以請求第一影像的第一影像資訊。藉此,影像伺服器110可依據影像請求資訊從預先儲存的多個影像資訊取得第一影像資訊,並將第一影像資訊傳送至使用者裝置120(1)~120(N)。基於此,使用者裝置120(1)~120(N)可依據第一影像資訊顯示第一影像,且多個使用者便可分別藉由使用者裝置120(1)~120(N)觀看第一影像。First, in step S201, the user devices 120(1)-120(N) respectively receive the first image information from the
接著,於步驟S203中,當藉由使用者裝置120(1)~120(N)中至少一者標註至少一標註資訊於第一影像以顯示第二影像資訊時,響應於使用者裝置120(1)~120(N)中至少一者的操作,藉由即時網路伺服器130從使用者裝置120(1)~120(N)中的至少一者接收至少一標註資訊。詳細而言,當不同使用者裝置120(1)~120(N)經操作而標註至少一標註資訊於第一影像時,對應的使用者裝置可將對應的標註資訊傳送至即時網路伺服器130。換言之,一旦任何使用者操作對應的使用者裝置以對第一影像進行標註,對應的使用者裝置會立即把所有對應的標註資訊傳送至即時網路伺服器130。Next, in step S203, when at least one label information is marked on the first image by at least one of the user devices 120(1)-120(N) to display the second image information, the user device 120 ( 1) An operation of at least one of the user devices 120(1) to 120(N), through the real-
舉例而言,當M個使用者分別利用使用者裝置120(1)~120(M)標註M個標註資訊於第一影像,以產生M個第二影像時,響應於使用者裝置120(1)~120(M)中的操作,即時網路伺服器130可從使用者裝置120(1)~120(M)接收M個標註資訊,其中M為不大於N的正整數,並沒有特別的限制。換言之,M個使用者可對各自的使用者裝置進行操作以對第一影像進行標註,進而產生M個第二影像。一旦即時網路伺服器130偵測到上述操作,即時網路伺服器130可立即從使用者裝置120(1)~120(M)接收M個標註資訊。For example, when M users use the user devices 120( 1 ) to 120(M) to mark M pieces of labeling information on the first image, respectively, to generate M second images, the user device 120( 1 )~120(M), the real-
在一些實施例中,在對第一影像進行標註後,產生標註資訊的使用者裝置更可在其顯示器上顯示詢問資訊,以詢問是否分享此標註資訊。若對應的使用者輸入同意分享資訊,產生標註資訊的使用者裝置會立即把此標註對應的標註資訊傳送至即時網路伺服器130。In some embodiments, after the first image is annotated, the user device that generates the annotation information may further display query information on its display to ask whether to share the annotation information. If the corresponding user inputs the consent to share the information, the user device that generates the annotation information will immediately transmit the annotation information corresponding to the annotation to the real-
接著,於步驟S205中,藉由即時網路伺服器130將所接收之至少一標註資訊傳送至使用者裝置120(1)~120(N)中的其餘使用者裝置。詳細而言,在即時網路伺服器130接收到至少一標註資訊後,即時網路伺服器130可立即將所接收之至少一標註資訊傳送至使用者裝置120(1)~120(N)中的其餘使用者裝置。Next, in step S205, the real-
舉例而言,接續上個例子,在即時網路伺服器130從使用者裝置120(1)~120(M)接收M個使用者標註的M個標註資訊後,即時網路伺服器130可將M個使用者中的第1個使用者標註的標註資訊傳送至使用者裝置120(2)~120(M),並將第2個使用者標註的標註資訊傳送至使用者裝置120(1)、120(3)~120(N)。以此類推,即時網路伺服器130可對M個使用者中的其餘使用者標註的標註資訊採用相同的操作方法。For example, continuing from the previous example, after the real-
最後,於步驟S207中,藉由使用者裝置120(1)~120(N)中的其餘使用者裝置用以依據接收到的至少一標註資訊與第一影像資訊產生第二影像資訊。詳細而言,使用者裝置120(1)~120(N)中的其餘使用者裝置可將接收到的至少一標註資訊標註於第一影像資訊對應的第一影像以產生第二影像資訊。Finally, in step S207, the remaining user devices in the user devices 120(1)-120(N) are used to generate the second image information according to the received at least one annotation information and the first image information. Specifically, the remaining user devices in the user devices 120(1)-120(N) can label the received at least one label information on the first image corresponding to the first image information to generate the second image information.
在一些實施例中,至少一標註資訊更可包括至少一標註區域、至少一呈現訊息或至少一時間戳記(tag)等各種使用者在第一影像進行標註的相關訊息。標註區域可以是第一影像中進行標註的影像區域(例如是以影像座標的表示方式),且呈現訊息可以是使用者在上述標註區域中進行標註的各種訊息(例如,圈選的標記、畫線的標記或文字訊息等各種形式的標記),以及時間戳記可以是在使用者標註呈現訊息時的使用者所使用的使用者裝置的系統時間(即,當任一使用者在第一影像標註一個呈現訊息時,任一使用者使用的使用者裝置會依據此使用者裝置的系統時間產生時間戳記)。In some embodiments, the at least one labeling information may further include at least one labeling area, at least one presentation message, or at least one time stamp (tag) and other related information that the user labels on the first image. The marked area may be an image area marked in the first image (for example, in the form of image coordinates), and the presented information may be various information marked by the user in the above marked area (for example, circled marks, drawings, etc.). line markings or text messages, etc.), and the time stamp may be the system time of the user device used by the user when the user marked the presentation of the message (that is, when any user marked the first image When a message is presented, the user device used by any user will generate a timestamp based on the system time of the user device).
在進一步的實施例中,使用者裝置120(1)~120(N)可在第一影像資訊對應的第一影像中的接收到的至少一標註資訊中的至少一標註區域顯示接收到的至少一標註資訊中的至少一呈現訊息以產生第二影像資訊。In a further embodiment, the user devices 120(1)-120(N) may display the received at least one labeling area in the at least one labeling information received in the first image corresponding to the first image information. At least one presentation information in an annotation information is used to generate second image information.
舉例而言,接續上個例子,第1個使用者可藉由使用者裝置120(1)接收使用者裝置120(2)~120(M)對應的第2至第M個標註資訊,且第2個使用者可藉由使用者裝置120(2)接收使用者裝置120(1)、120(3)~120(M)對應的第1與第2至第M個標註資訊,以及第M+1個使用者可藉由使用者裝置120(M+1)接收使用者裝置120(1)~120(M)對應的第1至第M個標註資訊。以此類推,其餘的使用者裝置可採用相同的操作方法。藉此,使用者裝置120(1)~120(N)皆可在第一影像中第1至第M個標註資訊對應的第1至第M個顯示區域顯示第1至第M個標註資訊,以整合第1至第M個第二影像,進而產生一個整合影像的第二影像資訊。For example, continuing the previous example, the first user can receive the second to Mth annotation information corresponding to the user devices 120(2)~120(M) through the user device 120(1), and the The 2 users can receive the first and second to M-th annotation information corresponding to the user devices 120(1), 120(3)-120(M), and the M+th label information through the user device 120(2). One user can receive the 1st to Mth tag information corresponding to the user devices 120(1)-120(M) through the user device 120(M+1). By analogy, other user devices can adopt the same operation method. In this way, all of the user devices 120(1)-120(N) can display the 1st to Mth annotation information in the 1st to Mth display areas corresponding to the 1st to Mth annotation information in the first image. The 1st to Mth second images are integrated to generate second image information of an integrated image.
在進一步的實施例中,影像同步處理的系統100更可包括至少一記憶體(未繪示)。至少一記憶體可連接即時網路伺服器130並儲存多個資料庫。此外即時網路伺服器130可將至少一標註區域與至少一呈現訊息轉換為文字資訊,以將文字資訊與至少一時間戳記儲存於多個資料庫。在一些實施例中,即時網路伺服器130可基於JSON(javaScript object notation)格式將至少一標註區域與至少一呈現訊息轉換為具有結構化文字的文字資訊。In a further embodiment, the
在進一步的實施例中,響應於即時網路伺服器130從使用者裝置120(1)~120(N)中的至少一者接收到第一影像資訊對應的影像記錄要求資訊,即時網路伺服器130可從多個資料庫獲得文字資訊與至少一時間戳記,以將文字資訊與至少一時間戳記傳送至使用者裝置120(1)~120(N)中的至少一者。藉此,使用者裝置120(1)~120(N)中的至少一者可依據文字資訊、至少一時間戳記以及第一影像資訊產生歷史影像資訊。In a further embodiment, in response to the real-
舉例而言,第M個使用者可藉由使用者裝置120(M)向即時網路伺服器130傳送第二影像資訊對應的影像記錄要求資訊,且即時網路伺服器130可從多個資料庫獲得第二影像資訊對應的文字資訊與X個依序排列的時間戳記,以將文字資訊與X個時間戳記傳送至使用者裝置120(M),其中X為正整數,且X的數值為使用者裝置120(1)~120(N)針對第一影像資訊產生的時間戳記的數量的總和。For example, the M-th user can transmit the image recording request information corresponding to the second image information to the real-
藉此,使用者裝置120(M)可將文字資訊轉換為至少一標註區域與至少一呈現訊息,並在第M個使用者選擇X個時間戳記中的特定的時間戳記後提取所選擇的時間戳記與此所選擇的時間戳記之前的所有時間戳記對應的標註區域與呈現訊息。基於此,使用者裝置120(M)可以依據所選擇的時間戳記與所選擇的時間戳記之前的所有時間戳記,以在第一影像上依序顯示所選擇的時間戳記與所選擇的時間戳記之前的所有時間戳記對應的所有標註區域與呈現訊息,進而產生歷史影像資訊(即,播放所選擇的時間戳記與所選擇的時間戳記之前的所有標註區域與呈現訊息)。In this way, the user device 120(M) can convert the text information into at least one marked area and at least one presentation message, and extract the selected time after the Mth user selects a specific time stamp among the X time stamps Stamps the callout area and presentation message corresponding to all timestamps preceding this selected timestamp. Based on this, the user device 120(M) can display the selected time stamp and the selected time stamp on the first image in sequence according to the selected time stamp and all time stamps before the selected time stamp All the marked areas and presentation messages corresponding to all the time stamps of , and then generate historical image information (ie, play the selected time stamp and all the marked areas and presentation messages before the selected time stamp).
在進一步的實施例中,影像同步處理的系統100更可包括訓練伺服器(未繪示),且訓練伺服器可儲存病灶位置判斷模型,訓練伺服器可經由即時網路伺服器130從至少一記憶體所儲存的多個資料庫接收文字資訊,以利用文字資訊訓練病灶位置判斷模型,且即時網路伺服器130可從訓練伺服器接收病灶位置判斷模型,並依據病患的影像資訊以利用病灶位置判斷模型產生病灶位置資訊。In a further embodiment, the
換言之,當任一使用者想確定病患影像(例如,病患的核磁共振影像、電腦斷層影像或X光片影像等)中的病灶位置時,任一使用者可藉由使用者裝置120(1)~120(N)中的一者將病患影像的影像資訊傳送至即時網路伺服器130。藉此,即時網路伺服器130可從訓練伺服器接收病灶位置判斷模型,並依據病患的影像資訊以利用病灶位置判斷模型判斷出病患影像中的病灶位置以產生病灶位置資訊。In other words, when any user wants to determine the location of the lesion in the patient image (for example, the patient's MRI image, computed tomography image, or X-ray image, etc.), any user can use the user device 120 ( One of 1)˜120(N) transmits the image information of the patient image to the real-
藉由上述基於即時網路技術的影像同步處理的系統100,可將各個使用者在各自使用的使用者裝置上對同一個影像的所有標註資訊立即同步到所有的使用者裝置120(1)~120(N)上的影像。藉此,影像同步處理的系統100可讓所有使用者同時對同一個影像進行標註,且所有使用者也可以立即看到所有使用者的標註操作。With the above-mentioned
第3圖是根據本發明另一些示範性實施例的基於即時網路技術的影像同步處理系統的示意圖。請參照第3圖,本實施例的影像同步處理系統300包括影像伺服器110、多個使用者裝置120(1)~120(N)、即時網路伺服器130、資料庫140以及訓練伺服器150。影像伺服器110可儲存多個影像的影像資訊,且影像伺服器110也可以是不只一個影像伺服器,並沒有特別的限制)。使用者裝置120(1)~120(N)可分別從影像伺服器110接收多個影像中至少一個影像所對應的影像資訊。即時網路伺服器130可連接於影像伺服器110、使用者裝置120(1)~120(N)、資料庫140以及訓練伺服器150之間,其中N為任意正整數,並沒有特別的限制。FIG. 3 is a schematic diagram of an image synchronization processing system based on real-time network technology according to other exemplary embodiments of the present invention. Referring to FIG. 3, the image
首先,多個使用者可藉由使用者裝置120(1)~120(N)分別從影像伺服器110接收第一影像的第一影像資訊。First, a plurality of users can respectively receive the first image information of the first image from the
在一些實施例中,使用者裝置120(1)~120(N)更可包括影像觀看者(image viewer)模組1201(1)~1201(N)。多個使用者可藉由使用者裝置120(1)~120(N)向影像伺服器110傳送影像請求資訊以請求第一影像的第一影像資訊。藉此,影像伺服器110可依據影像請求資訊從預先儲存的多個影像資訊取得第一影像資訊,並將第一影像資訊傳送至使用者裝置120(1)~120(N)。因此,影像觀看者模組1201(1)~1201(N)可依據第一影像資訊顯示第一影像,且多個使用者便可分別藉由影像觀看者模組1201(1)~1201(N)觀看第一影像。In some embodiments, the user devices 120(1)-120(N) may further include image viewer modules 1201(1)-1201(N). A plurality of users can request the first image information of the first image by transmitting image request information to the
再者,當使用者裝置120(1)~120(N)中至少一者標註至少一標註資訊於第一影像以顯示第二影像資訊時,響應於使用者裝置120(1)~120(N)中至少一者的操作,即時網路伺服器130從使用者裝置120(1)~120(N)中的至少一者接收至少一標註資訊。Furthermore, when at least one of the user devices 120(1)-120(N) labels at least one label information on the first image to display the second image information, in response to the user devices 120(1)-120(N) ), the real-
在一些實施例中,使用者裝置120(1)~120(N)更可包括即時網路模組1202(1)~1202(N)。當多個使用者中的至少一使用者利用使用者裝置120(1)~120(N)中至少一使用者使用的至少一使用者裝置標註至少一標註資訊於第一影像資訊對應的第一影像(例如,藉由使用者裝置120(1)~120(N)中的各種輸入裝置或觸控顯示器等進行標註)以產生至少一第二影像對應的第二影像資訊時,上述至少一使用者裝置的即時網路模組可將至少一標註資訊傳送至即時網路伺服器130。換言之,一旦任何使用者在對應的使用者裝置上對第一影像進行標註,對應的使用者裝置的即時網路模組會立即把此標註對應的標註資訊傳送至即時網路伺服器130。In some embodiments, the user devices 120(1)-120(N) may further include real-time network modules 1202(1)-1202(N). When at least one user among the plurality of users uses at least one user device used by at least one user among the user devices 120(1) to 120(N) to label at least one labeling information on the first image information corresponding to the first image information When the images (for example, marked by various input devices or touch displays in the user devices 120(1)-120(N)) are used to generate the second image information corresponding to the at least one second image, the above at least one use The real-time network module of the user's device can transmit at least one annotation information to the real-
再者,即時網路伺服器130可將所接收之至少一標註資訊傳送至使用者裝置120(1)~120(N)中的其餘使用者裝置。Furthermore, the real-
在一些實施例中,即時網路伺服器130更可包括網路應用程式(web app)模組1301與即時訊息處理程序(real-time message handler)模組1302。即時訊息處理程序模組1302可接收上述至少一標註資訊。In some embodiments, the real-
在一些實施例中,至少一標註資訊更可包括至少一網路位址資訊(例如是網際網路協定(internet protocol,IP)位址的資訊),且網路應用程式模組1301可依據至少一標註資訊中的至少一網路位址資訊判斷至少一標註資訊需要傳送至使用者裝置120(1)~120(N)中的哪些使用者裝置以產生目的判斷資訊。即時訊息處理程序模組1302可依據此目的判斷資訊將所接收之至少一標註資訊傳送至使用者裝置120(1)~120(N)中的其餘使用者裝置。In some embodiments, the at least one label information may further include at least one network address information (eg, information of an internet protocol (IP) address), and the
舉例而言,當即時網路伺服器130接收使用者裝置120(1)、120(2)的標註資訊時,網路應用程式模組1301可依據使用者裝置120(1)、120(2)的標註資訊中的網路位址資訊判斷使用者裝置120(1)的標註資訊需要被傳送至使用者裝置120(2)~120(N)並判斷使用者裝置120(2)的標註資訊需要被傳送至使用者裝置120(1)、120(3)~120(N),以產生目的判斷資訊。藉此,即時訊息處理程序模組1302可依據此目的判斷資訊將所接收之使用者裝置120(1)的標註資訊傳送至使用者裝置120(2)~120(N),並可依據此目的判斷資訊將所接收之使用者裝置120(2)的標註資訊傳送至使用者裝置120(1)、120(3)~120(N)。For example, when the real-
在一些實施例中,多個使用者中的至少一者更可藉由使用者裝置120(1)~120(N)中至少一者對第一影像進行縮放以產生至少一縮放資訊,以標註至少一標註資訊於縮放後的第一影像,進而將至少一縮放資訊與至少一標註資訊傳送至即時網路伺服器130。藉此,即時網路伺服器130的即時訊息處理程序模組1302可忽略至少一縮放資訊。In some embodiments, at least one of the plurality of users can further zoom the first image through at least one of the user devices 120(1)-120(N) to generate at least one zoom information for marking The at least one annotation information is in the zoomed first image, and then the at least one zoom information and the at least one annotation information are sent to the real-
最後,使用者裝置120(1)~120(N)中的其餘使用者裝置用以依據接收到的至少一標註資訊與第一影像資訊產生第二影像資訊。換言之,使用者裝置120(1)~120(N)中未產生至少一標註資訊的使用者裝置的即時網路模組可接收至少一標註資訊,且使用者裝置120(1)~120(N)中產生至少一標註資訊的使用者裝置的即時網路模組可接收至少一標註資訊中非自己產生的所有標註資訊。Finally, the remaining user devices in the user devices 120(1)-120(N) are used to generate the second image information according to the received at least one annotation information and the first image information. In other words, the real-time network modules of the user devices 120(1)-120(N) that do not generate at least one annotation information can receive at least one annotation information, and the user devices 120(1)-120(N) ), the real-time network module of the user device that generates at least one annotation information can receive all annotation information that is not generated by itself in the at least one annotation information.
在一些實施例中,至少一標註資訊更可包括至少一標註區域以及至少一呈現訊息。使用者裝置120(1)~120(N)的影像觀看者模組1201(1)~1201(N)可在第一影像資訊對應的第一影像中的接收到的至少一標註資訊中的至少一標註區域顯示接收到的至少一標註資訊中的至少一呈現訊息以產生第二影像資訊。藉此,多個使用者可同時觀看第二影像資訊對應的整合影像。In some embodiments, the at least one markup information may further include at least one markup area and at least one presentation information. The image viewer modules 1201(1) to 1201(N) of the user devices 120(1) to 120(N) may receive at least one annotation information in the first image corresponding to the first image information. An annotation area displays at least one presentation information in the received at least one annotation information to generate the second image information. In this way, multiple users can watch the integrated image corresponding to the second image information at the same time.
在進一步的實施例中,至少一標註資訊更可包括至少一時間戳記。即時網路伺服器130的網路應用程式模組1301可將至少一標註區域與至少一呈現訊息轉換為文字資訊,且即時網路伺服器130的即時訊息處理程序模組1302可將文字資訊與至少一時間戳記儲存於資料庫140。在一些實施例中,網路應用程式模組1301可基於Json格式將至少一標註區域與至少一呈現訊息轉換為具有結構化文字的文字資訊。In a further embodiment, the at least one annotation information may further include at least one time stamp. The
在進一步的實施例中,響應於即時網路伺服器130的即時訊息處理程序模組1302從使用者裝置120(1)~120(N)中的至少一者的即時網路模組接收到第一影像資訊對應的影像記錄要求資訊,即時網路伺服器130的網路應用程式模組1301可從資料庫140獲得文字資訊與至少一時間戳記,以將文字資訊與至少一時間戳記傳送至使用者裝置120(1)~120(N)中的至少一者的即時網路模組。藉此,使用者裝置120(1)~120(N)中的至少一者的影像觀看者模組可依據文字資訊、至少一時間戳記以及第一影像資訊產生歷史影像資訊。In further embodiments, in response to the instant
在一些實施例中,訓練伺服器150可儲存病灶位置判斷模型,訓練伺服器可經由即時網路伺服器130從至少一記憶體所儲存的多個資料庫接收文字資訊,以利用文字資訊訓練病灶位置判斷模型。即時網路伺服器130的即時訊息處理程序模組1302可從訓練伺服器150接收病灶位置判斷模型,且即時網路伺服器130的網路應用程式模組1301可依據病患的影像資訊以利用病灶位置判斷模型產生病灶位置資訊。In some embodiments, the
綜上所述,本發明提供的基於即時網路技術的影像同步處理的系統與方法可將各個使用者在各自使用的使用者裝置上對同一個影像的所有標註資訊立即同步到所有的使用者裝置上的影像。如此一來,使用者不需要在等待其他使用者對病患影像完成標註後才能對病患影像進行標註。此外,使用者對病患影像的標註資訊更可被轉換為文字資訊以便於對用於判斷病患影像中的病灶位置的模型進行訓練。To sum up, the system and method for image synchronization processing based on real-time network technology provided by the present invention can immediately synchronize all the annotation information of the same image on the user device used by each user to all users. image on the device. In this way, the user does not need to wait for other users to complete the labeling of the patient image before labeling the patient image. In addition, the user's annotation information on the patient image can be further converted into text information to facilitate training of the model for judging the location of the lesion in the patient image.
雖然本發明已以實施例揭露如上,然其並非用以限定本發明,任何所屬技術領域中具有通常知識者,在不脫離本發明的精神和範圍內,當可作些許的更動與潤飾,故本發明的保護範圍當視後附的申請專利範圍所界定者為準。Although the present invention has been disclosed above by the embodiments, it is not intended to limit the present invention. Anyone with ordinary knowledge in the technical field can make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, The protection scope of the present invention shall be determined by the scope of the appended patent application.
100、300:影像同步處理系統100, 300: Image synchronization processing system
110:影像伺服器110: Image server
120(1)~120(N):使用者裝置120(1)~120(N): User device
130:即時網路伺服器130: Live web server
1201(1)~1201(N):影像觀看者模組1201(1)~1201(N): Video viewer module
1202(1)~1202(N):即時網路模組1202(1)~1202(N): Real-time network module
1301:網路應用程式模組1301: Web Application Modules
1302:即時訊息處理程序模組1302: Instant Messaging Program Module
140:資料庫140:Database
150:訓練伺服器150: Training Server
S201~S207:影像同步處理方法的流程S201~S207: The flow of the image synchronization processing method
第1圖是根據本發明一些示範性實施例的基於即時網路技術的影像同步處理系統的方塊圖。 第2圖是根據本發明一些示範性實施例的基於即時網路技術的影像同步處理方法的流程圖。 第3圖是根據本發明另一些示範性實施例的基於即時網路技術的影像同步處理系統的示意圖。 FIG. 1 is a block diagram of an image synchronization processing system based on real-time network technology according to some exemplary embodiments of the present invention. FIG. 2 is a flowchart of an image synchronization processing method based on real-time network technology according to some exemplary embodiments of the present invention. FIG. 3 is a schematic diagram of an image synchronization processing system based on real-time network technology according to other exemplary embodiments of the present invention.
100:影像同步處理系統 100: Image synchronization processing system
110:影像伺服器 110: Image server
120(1)~120(N):使用者裝置 120(1)~120(N): User device
130:即時網路伺服器 130: Live web server
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW109126419A TWI755014B (en) | 2020-08-05 | 2020-08-05 | Image synchronous processing system based on real-time web technology and method thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW109126419A TWI755014B (en) | 2020-08-05 | 2020-08-05 | Image synchronous processing system based on real-time web technology and method thereof |
Publications (2)
Publication Number | Publication Date |
---|---|
TWI755014B true TWI755014B (en) | 2022-02-11 |
TW202207711A TW202207711A (en) | 2022-02-16 |
Family
ID=81323418
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW109126419A TWI755014B (en) | 2020-08-05 | 2020-08-05 | Image synchronous processing system based on real-time web technology and method thereof |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI755014B (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1543190A (en) * | 2003-04-28 | 2004-11-03 | 商之器科技股份有限公司 | Synchronous transmission method for digital medical image |
CN103678475A (en) * | 2013-09-25 | 2014-03-26 | 艾塔斯科技(镇江)有限公司 | Medical image sending device and medical image storing method |
US20170347056A1 (en) * | 2016-05-26 | 2017-11-30 | Toshiba Medical Systems Corporation | Medical diagnostic apparatus and medical diagnostic system |
CN107578808A (en) * | 2017-09-06 | 2018-01-12 | 上海联影医疗科技有限公司 | Image data analysis method, cloud system and Cloud Server based on medical cloud system |
-
2020
- 2020-08-05 TW TW109126419A patent/TWI755014B/en active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1543190A (en) * | 2003-04-28 | 2004-11-03 | 商之器科技股份有限公司 | Synchronous transmission method for digital medical image |
CN103678475A (en) * | 2013-09-25 | 2014-03-26 | 艾塔斯科技(镇江)有限公司 | Medical image sending device and medical image storing method |
US20170347056A1 (en) * | 2016-05-26 | 2017-11-30 | Toshiba Medical Systems Corporation | Medical diagnostic apparatus and medical diagnostic system |
CN107578808A (en) * | 2017-09-06 | 2018-01-12 | 上海联影医疗科技有限公司 | Image data analysis method, cloud system and Cloud Server based on medical cloud system |
Also Published As
Publication number | Publication date |
---|---|
TW202207711A (en) | 2022-02-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9166935B1 (en) | System and method for managing and displaying data messages | |
US10382719B2 (en) | Method and apparatus for sharing information during video call | |
JP4881993B2 (en) | Electronic signage system and image display control method | |
CN107566793A (en) | Method, apparatus, system and electronic equipment for remote assistance | |
CN110673777A (en) | Online teaching method and device, storage medium and terminal equipment | |
US8788595B2 (en) | Methods, systems, and computer program products for instant messaging | |
CN113785288A (en) | System and method for generating and sharing content | |
CN111797351A (en) | Page data management method and device, electronic equipment and medium | |
JP5893825B2 (en) | Method and system for workflow | |
JP2008305104A (en) | Comment distribution system, server, terminal equipment, comment distribution method, comment display method and program | |
KR100440045B1 (en) | A method and system for chatting service providing realtime tag analysis | |
CN110445667A (en) | A kind of link delay detection method, device, storage medium and terminal | |
CN112395297B (en) | Method, device and server for synchronizing work information | |
CN111597628A (en) | Model marking method and device, storage medium and electronic equipment | |
JP2024502516A (en) | Data annotation methods, apparatus, systems, devices and storage media | |
TWI755014B (en) | Image synchronous processing system based on real-time web technology and method thereof | |
CN111400581B (en) | System, method and apparatus for labeling samples | |
KR20220006504A (en) | Media content capture and presentation | |
WO2023024959A1 (en) | Image labeling method and system, and device and storage medium | |
KR20120006312A (en) | Location based augmented reality contents data sharing system and method using mobile device | |
JP2011210076A (en) | Apparatus, system and method for determination of document quality, and program | |
CN112559940B (en) | Page labeling method, device, equipment and medium | |
CN115348441A (en) | Time delay measuring method, system, device, equipment and storage medium | |
US20160223352A1 (en) | Method and System for Providing Route Information to a Destination Location | |
Hu et al. | Mobile camera based cross-screen interaction by object matching and tracking |