TWM569887U - Augmented reality system - Google Patents
Augmented reality system Download PDFInfo
- Publication number
- TWM569887U TWM569887U TW107209821U TW107209821U TWM569887U TW M569887 U TWM569887 U TW M569887U TW 107209821 U TW107209821 U TW 107209821U TW 107209821 U TW107209821 U TW 107209821U TW M569887 U TWM569887 U TW M569887U
- Authority
- TW
- Taiwan
- Prior art keywords
- image
- augmented reality
- module
- virtual object
- reality system
- Prior art date
Links
Landscapes
- Processing Or Creating Images (AREA)
Abstract
一種擴增實境系統包括攝影模組、物件產生模組與影像處理模組。攝影模組產生第一影像,第一影像包括標記。物件產生模組產生第二影像,第二影像包括虛擬物件。影像處理模組訊號連接攝影模組與物件產生模組,影像處理模組接收第一影像與第二影像並將第一影像與第二影像合成以產生擴增實境影像,且擴增實境影像中的標記設置為可對應控制虛擬物件。An augmented reality system includes a photographic module, an object generation module, and an image processing module. The photography module generates a first image, and the first image includes a mark. The object generation module generates a second image, and the second image includes a virtual object. The image processing module signal is connected to the photographic module and the object generating module, and the image processing module receives the first image and the second image and synthesizes the first image and the second image to generate an augmented reality image, and augments the reality The markers in the image are set to correspond to the control of the virtual object.
Description
本創作是關於一種擴增實境的技術,且特別是關於一種擴增實境系統。This creation is about a technique for augmenting reality, and in particular with respect to an augmented reality system.
現有的遠距醫療服務,多半是透過視訊方式建立起醫護端與患者端之間的遠距聯繫。此種遠距醫療服務需要在醫療院所建置攝影設備與通訊設備,而患者端也需配備有影音播放裝置與通訊設備,且醫療院所與患者端的通訊設備會透過網路加以連接。在進行遠距醫療服務時,醫療院所的攝影設備會即時拍攝醫護人員,此時醫護人員可針對患者的病況或任何醫療狀況加以說明,而攝影設備所拍攝的視訊(包括有影像與聲音訊號)會透過通訊設備傳遞至患者端,並藉由患者端的影音播放裝置即時播放出來,而患者則可藉由醫護人員的視訊即時了解自身病況。當然,患者與醫護人員也可透過這些設備進行互動,醫護人員可即時問診,以了解患者的當前狀況,達到遠距診斷的效果。Most of the existing telemedicine services establish a long-distance connection between the medical end and the patient through video. Such telemedicine services require the installation of photographic equipment and communication equipment in medical institutions, and the patient terminal also needs to be equipped with audio-visual playback devices and communication devices, and the communication devices of the medical institutions and the patient terminals are connected through the network. In the case of telemedicine services, the photographic equipment of the medical institution will immediately take care of the medical staff. At this time, the medical staff can explain the patient's condition or any medical condition, and the video taken by the photographic equipment (including image and sound signals) It will be transmitted to the patient through the communication device and played out instantly by the patient's audio-visual playback device, and the patient can instantly understand the condition by the medical staff's video. Of course, patients and medical staff can also interact through these devices, and medical staff can immediately consult the patient to understand the current condition of the patient and achieve the effect of remote diagnosis.
一般來說,在視訊進行中,醫護人員可搭配醫療影像進行解說。例如,醫護人員可搭配患者先前所拍攝的X光圖片或超音波圖片,依此進行解說。前述醫療影像可透過醫療院所現場的播放設備(如電腦螢幕)呈現,或者以印出的實體紙張呈現。Generally speaking, in the course of video, medical staff can explain with medical images. For example, a medical professional can match an X-ray picture or an ultrasound picture previously taken by a patient to explain. The aforementioned medical images can be presented through a playback device (such as a computer screen) on the scene of the medical institution, or on a printed physical paper.
根據先前技術,在進行遠距醫療服務時,醫護人員雖然可搭配醫療影像進行解說,不過醫療影像是透過醫療院所現場的播放設備呈現或者以印出的實體紙張呈現,其呈現方式較為生硬,無論是醫護人員在解說上或患者在理解上都較為困難。According to the prior art, when performing telemedicine services, medical personnel can be explained with medical images, but the medical images are presented through the playing equipment on the scene of the medical institution or presented on the printed physical paper, and the presentation manner is relatively rigid. It is difficult for the medical staff to explain or understand the patient.
有鑑於此,本創作的目的在提出一種擴增實境系統,以期在進行遠距醫療服務時,可透過靈活的方式呈現出醫療影像,讓醫護人員在解說時能更加清楚,也讓患者更容易理解。In view of this, the purpose of this creation is to propose an augmented reality system, in order to present medical images in a flexible manner when performing telemedicine services, so that medical staff can be more clear in the explanation and also make patients more Easy to understand.
在本創作一實施例中,一種擴增實境系統包括攝影模組、物件產生模組與影像處理模組。攝影模組產生第一影像,第一影像包括標記。物件產生模組產生第二影像,第二影像包括虛擬物件。影像處理模組訊號連接攝影模組與物件產生模組,影像處理模組接收第一影像與第二影像並將第一影像與第二影像合成以產生擴增實境影像,且擴增實境影像中的標記設置為可對應控制虛擬物件。In an embodiment of the present invention, an augmented reality system includes a photography module, an object generation module, and an image processing module. The photography module generates a first image, and the first image includes a mark. The object generation module generates a second image, and the second image includes a virtual object. The image processing module signal is connected to the photographic module and the object generating module, and the image processing module receives the first image and the second image and synthesizes the first image and the second image to generate an augmented reality image, and augments the reality The markers in the image are set to correspond to the control of the virtual object.
在本創作一實施例中,影像處理模組分析並取得擴增實境影像中的標記的座標與虛擬物件的座標,以判斷擴增實境影像中的標記與虛擬物件是否彼此定位。In an embodiment of the present invention, the image processing module analyzes and obtains the coordinates of the mark and the virtual object in the augmented reality image to determine whether the mark and the virtual object in the augmented reality image are positioned with each other.
在本創作一實施例中,當擴增實境影像中的標記與虛擬物件彼此定位,影像處理模組根據標記的動態而移動、縮放或旋轉虛擬物件。In an embodiment of the present invention, when the mark in the augmented reality image and the virtual object are positioned relative to each other, the image processing module moves, scales, or rotates the virtual object according to the dynamic of the mark.
在本創作一實施例中,影像處理模組分析標記的動態以取得座標變化值,影像處理模組根據座標變化值而移動、縮放或旋轉虛擬物件。In an embodiment of the present invention, the image processing module analyzes the dynamics of the mark to obtain a coordinate change value, and the image processing module moves, scales, or rotates the virtual object according to the coordinate change value.
在本創作一實施例中,虛擬物件為三維器官模型或二維器官圖像。In an embodiment of the present creation, the virtual object is a three-dimensional organ model or a two-dimensional organ image.
在本創作一實施例中,擴增實境系統更包括顯示模組,其中,顯示模組訊號連接影像處理模組,且顯示模組顯示擴增實境影像。In an embodiment of the present invention, the augmented reality system further includes a display module, wherein the display module signal is connected to the image processing module, and the display module displays the augmented reality image.
在本創作一實施例中,擴增實境系統更包括遠端通訊模組,其中,遠端通訊模組訊號連接影像處理模組,且遠端通訊模組將擴增實境影像傳送至客戶端。In an embodiment of the present invention, the augmented reality system further includes a remote communication module, wherein the remote communication module signal is connected to the image processing module, and the remote communication module transmits the augmented reality image to the client. end.
在本創作一實施例中,擴增實境系統更包括診斷資料庫,其中,診斷資料庫訊號連接物件產生模組,且物件產生模組根據診斷資料庫中的人體醫學影像產生第二影像。In an embodiment of the present invention, the augmented reality system further includes a diagnostic database, wherein the diagnostic database signal connects the object generating module, and the object generating module generates the second image according to the human medical image in the diagnostic database.
在本創作一實施例中,人體醫學影像包括電腦斷層掃描影像檔、超音波影像檔或X光影像檔。In an embodiment of the present invention, the human medical image includes a computed tomography image file, an ultrasound image file, or an X-ray image file.
在本創作一實施例中,標記有複數個。In an embodiment of the present creation, a plurality of marks are marked.
綜上所述,藉由本創作各實施例的擴增實境系統,使得醫護人員與患者在進行遠距醫療服務時,醫護人員這一端可透過靈活的方式呈現出醫療影像,如此一來,醫護人員在解說時能更加清楚,也讓患者更容易理解。In summary, with the augmented reality system of the embodiments of the present invention, when the medical staff and the patient perform the telemedicine service, the medical staff can present the medical image in a flexible manner, and thus, the medical care The staff can be more clear in the explanation and make the patient easier to understand.
以下在實施方式中詳細敘述本創作之詳細特徵以及優點,其內容足以使任何熟悉相關技藝者暸解本創作之技術內容並據以實施,且根據本說明書所揭露之內容、申請專利範圍及圖式,任何熟習相關技藝者可輕易地理解本創作相關之目的及優點。The detailed features and advantages of the present invention are described in detail below in the embodiments, which are sufficient to enable anyone skilled in the art to understand the technical contents of the present invention and to implement the present invention, and to disclose the contents, patent claims, and drawings according to the present specification. Anyone familiar with the relevant art can easily understand the purpose and advantages of this creation.
請參照圖1,圖1所示為本創作一實施例的擴增實境系統100的方塊圖。在本實施例中,擴增實境系統100是一種運用了擴增實境(Augmented Reality,AR)技術的醫療裝置與系統,其可用於遠距醫療服務,但不限於此。在不同實施例中,擴增實境系統100亦可用於醫療院所的現場門診服務,也就是說,醫師在現場門診問診的過程中,亦可搭配擴增實境系統100向患者解說病情。並且,不論是遠距醫療服務或者是現場門診服務,都可藉由擴增實境系統100的擴增實境影像(如後述)讓醫護人員更容易解說患者的病況,且讓患者更容易理解自身的醫療狀況。在不同實施例中,擴增實境系統100亦可用於除了遠距醫療或現場門診以外的諸多領域,例如手術教育訓練、器械裝配教育訓練等;或者,擴增實境系統100也可應用於娛樂產業,例如遊戲的虛擬三維物件操作和在遊戲中跟虛擬三維物件的互動等。Please refer to FIG. 1. FIG. 1 is a block diagram of an augmented reality system 100 according to an embodiment of the present invention. In the present embodiment, the augmented reality system 100 is a medical device and system that utilizes Augmented Reality (AR) technology, which can be used for telemedicine services, but is not limited thereto. In different embodiments, the augmented reality system 100 can also be used for on-site outpatient services of a medical institution, that is, the physician can also explain the condition to the patient in conjunction with the augmented reality system 100 during the on-site clinic consultation. Moreover, whether it is a telemedicine service or an on-site outpatient service, the augmented reality image (as described later) of the augmented reality system 100 can make it easier for the medical staff to explain the patient's condition and make the patient easier to understand. Your own medical condition. In various embodiments, the augmented reality system 100 can also be used in many fields other than telemedicine or on-site clinics, such as surgical education training, instrument assembly education training, etc.; alternatively, the augmented reality system 100 can also be applied. The entertainment industry, such as the virtual three-dimensional object operation of the game and the interaction with virtual three-dimensional objects in the game.
如圖1所示,在本實施例中,擴增實境系統100包括攝影模組110、物件產生模組120與影像處理模組130,且影像處理模組130訊號連接攝影模組110與物件產生模組120。攝影模組110可設置於醫療院所中的適當位置,攝影模組110例如是攝影機與麥克風的組合,其可用於拍攝醫護人員的影像並接收現場的聲音。物件產生模組120與影像處理模組130可整合在一起,例如是整合在一台電腦設備中,而攝影模組110則透過線材連接到此電腦設備。As shown in FIG. 1 , in the embodiment, the augmented reality system 100 includes a camera module 110 , an object generating module 120 and an image processing module 130 , and the image processing module 130 is connected to the camera module 110 and the object. A module 120 is generated. The photography module 110 can be disposed at a suitable location in a medical institution. The camera module 110 is, for example, a combination of a camera and a microphone, which can be used to capture images of medical personnel and receive sounds from the scene. The object generation module 120 and the image processing module 130 can be integrated, for example, integrated into a computer device, and the camera module 110 is connected to the computer device through a wire.
請同時參照圖2,圖2所示為本創作一實施例的擴增實境系統100的擴增實境影像330的合成示意圖。如圖1與圖2所示,攝影模組110拍攝位於醫療院所現場的醫護人員,並相應地產生第一影像310,第一影像310中呈現了被拍攝的醫護人員的影像(以下稱為解說者影像311)。並且,物件產生模組120會根據特定操作而產生第二影像320,第二影像320會包括虛擬物件321。舉例來說,醫護人員在進行遠距醫療服務時,認為需要針對患者的特定患部進行解說,因此有必要將特定患部的影像透過物件產生模組120產生出來,以便搭配特定患部的虛擬影像進行解說。醫護人員可操作電腦設備的界面,以選擇患者的相關資料來建立虛擬物件321並產生第二影像320。Please refer to FIG. 2 at the same time. FIG. 2 is a schematic diagram showing the synthesis of the augmented reality image 330 of the augmented reality system 100 according to an embodiment of the present invention. As shown in FIG. 1 and FIG. 2, the photographic module 110 captures a medical staff located at a medical institution's site, and correspondingly generates a first image 310. The first image 310 presents an image of the photographed medical staff (hereinafter referred to as Narrator image 311). Moreover, the object generation module 120 generates a second image 320 according to a specific operation, and the second image 320 includes a virtual object 321 . For example, when the medical staff performs the telemedicine service, it is considered that the specific affected part of the patient needs to be explained. Therefore, it is necessary to generate the image of the specific affected part through the object generating module 120, so as to be explained with the virtual image of the specific affected part. . The medical staff can operate the interface of the computer device to select the relevant information of the patient to create the virtual object 321 and generate the second image 320.
如圖2所示,在本實施例中,第二影像320中的虛擬物件321即為前述患者的特定患部,此虛擬物件321例如是患者的心臟的三維建模影像。患者的心臟的三維建模影像可以是依據現有技術加以建立,舉例來說,患者在先前就醫過程中,已經透過醫療院所的電腦斷層設備進行胸腔掃描,掃描過程會建立一系列二維影像檔,接著經過現有技術將二維影像檔中的心臟部份分離出來,再透過二維轉換至三維的影像處理程序而建立患者的心臟的三維建模影像。As shown in FIG. 2, in the embodiment, the virtual object 321 in the second image 320 is a specific affected part of the patient, and the virtual object 321 is, for example, a three-dimensional model image of the heart of the patient. The three-dimensional modeling image of the patient's heart can be established according to the prior art. For example, during the previous medical treatment, the patient has performed a chest scan through the computerized tomography equipment of the medical institution, and the scanning process establishes a series of two-dimensional image files. Then, the heart part of the 2D image file is separated by the prior art, and then the 3D model image of the patient's heart is established by two-dimensional conversion to a three-dimensional image processing program.
如圖1與圖2所示,在本實施例中,影像處理模組130會接收第一影像310與第二影像320,並進一步將第一影像310與第二影像320合成,以產生擴增實境影像330。在一些實施例中,擴增實境影像330可透過醫療院所與患者端的顯示設備呈現出來,讓醫護人員與患者在進行遠距醫療的過程中,雙方皆可看到擴增實境影像330。在擴增實境影像330中,解說者影像311的前方會呈現出虛擬物件321,因而醫護人員可直覺且方便地對擴增實境影像330中的虛擬物件321進行解說。As shown in FIG. 1 and FIG. 2, in this embodiment, the image processing module 130 receives the first image 310 and the second image 320, and further synthesizes the first image 310 and the second image 320 to generate an amplification. Reality image 330. In some embodiments, the augmented reality image 330 can be presented through the display device of the medical institution and the patient end, so that both the medical staff and the patient can see the augmented reality image 330 during the telemedicine process. . In the augmented reality image 330, the virtual object 321 is presented in front of the narrator image 311, so that the medical staff can intuitively and conveniently explain the virtual object 321 in the augmented reality image 330.
如圖1與圖2所示,在一些實施例中,為了能增加醫護人員在解說時的靈活性,以及醫護人員與擴增實境影像330中的虛擬物件321之間的互動性,醫護人員可進一步在擴增實境影像330中操作或控制虛擬物件321。As shown in FIG. 1 and FIG. 2, in some embodiments, in order to increase the flexibility of the medical staff during the explanation, and the interaction between the medical staff and the virtual object 321 in the augmented reality image 330, the medical staff The virtual object 321 can be further manipulated or controlled in the augmented reality image 330.
如圖2所示,在本實施例中,第一影像310可包括標記313,而在第一影像310與第二影像320合成為擴增實境影像330之後,第一影像310的標記313就會對應呈現在擴增實境影像330中,並且,擴增實境影像330中的標記313設置為可對應控制虛擬物件321。舉例來說,擴增實境影像330中的虛擬物件321可隨著標記313的移動而跟著移動。As shown in FIG. 2, in the embodiment, the first image 310 may include the mark 313, and after the first image 310 and the second image 320 are combined into the augmented reality image 330, the mark 313 of the first image 310 is Correspondingly, it is presented in the augmented reality image 330, and the marker 313 in the augmented reality image 330 is set to correspond to the control virtual object 321 . For example, the virtual object 321 in the augmented reality image 330 can follow the movement of the marker 313.
如圖2所示,在本實施例中,標記313為複數個。在第一影像310與擴增實境影像330中,標記313呈現圓形影像並且分別位於解說者影像311的手指指尖。舉例來說,標記313可透過現有技術的影像處理的方式,在第一影像310中分離出解說者影像311中的手指指尖,並將圓形影像疊在解說者影像311的手指指尖上。在上述實施方式中,解說的醫護人員不須配戴手套或額外的標記裝置,只須透過攝影機拍攝,而影像處理的軟硬體可實時找出醫護人員在解說者影像311的手指指尖,以取得標記313,並分析其手勢與手部軌跡。在一些實施例中,上述實施方式還可搭配紅外線深度感測器來追蹤醫護人員的手勢與軌跡,增加整體可靠性。在一些實施例中,上述實施方式還可搭配微型雷射定位器來偵測醫護人員的手勢與手部軌跡。在一些實施例中,上述實施方式還可搭配人工智慧來追蹤其手勢與手部軌跡。在一些實施例中,醫護人員可配戴特製的手套,此種手套在其手指指尖的位置設置有發光元件,如此一來,影像處理時可更容易辨識出第一影像310或擴增實境影像330中的解說者影像311的手指指尖的位置。或者,此種手套在其手指指尖的位置也可設置有反光元件,並在紅外線的照射下,反光元件會在影像中反射紅外線,藉此在影像處理時也可容易辨識出手指指尖的位置。As shown in FIG. 2, in the present embodiment, the mark 313 is plural. In the first image 310 and the augmented reality image 330, the marker 313 presents a circular image and is located at the fingertip of the narrator image 311, respectively. For example, the mark 313 can separate the fingertips of the narrator image 311 in the first image 310 by the image processing method of the prior art, and stack the circular image on the fingertip of the narrator image 311. . In the above embodiment, the medical staff of the explanation does not need to wear gloves or an additional marking device, and only needs to be photographed through the camera, and the soft and hard body of the image processing can find the fingertip of the medical staff in the narrator image 311 in real time. To get the marker 313 and analyze its gesture and hand trajectory. In some embodiments, the above embodiments may also be used with an infrared depth sensor to track the gestures and trajectories of medical personnel, increasing overall reliability. In some embodiments, the above embodiments may also be used with a miniature laser locator to detect the gestures and hand trajectories of the healthcare professional. In some embodiments, the above embodiments may also be used with artificial intelligence to track their gestures and hand trajectories. In some embodiments, the medical staff can wear a special glove that is provided with a light-emitting element at the fingertip of the finger, so that the first image 310 or the augmentation can be more easily recognized during image processing. The position of the fingertip of the narrator image 311 in the image 330. Alternatively, the glove may be provided with a retroreflective element at the position of the fingertip of the finger, and under the illumination of the infrared ray, the reflective component will reflect the infrared ray in the image, thereby easily recognizing the fingertip of the finger during image processing. position.
舉例來說,影像處理模組130會持續且即時地分析擴增實境影像330,並取得擴增實境影像330中的標記313的座標與虛擬物件321的座標,以判斷擴增實境影像330中的標記313與虛擬物件321是否彼此定位。其中,標記313的座標可以是所述圓形影像的圓心處座標,而虛擬物件321的座標則是虛擬物件321的輪廓的複數座標。舉例來說,當擴增實境影像330中的標記313接觸到虛擬物件321的輪廓,也就是擴增實境影像330中的標記313的座標與虛擬物件321的輪廓的任一座標重疊,這表示標記313與虛擬物件321彼此定位。當擴增實境影像330中的標記313與虛擬物件321彼此定位,擴增實境影像330中的虛擬物件321就會根據標記313的動態而做出對應的動作,所述動作例如是移動、縮放或旋轉等。For example, the image processing module 130 continuously and immediately analyzes the augmented reality image 330, and obtains the coordinates of the mark 313 and the virtual object 321 in the augmented reality image 330 to determine the augmented reality image. Whether the mark 313 in the 330 and the virtual object 321 are positioned to each other. The coordinates of the mark 313 may be the coordinates of the center of the circular image, and the coordinates of the virtual object 321 are the complex coordinates of the outline of the virtual object 321 . For example, when the marker 313 in the augmented reality image 330 contacts the outline of the virtual object 321 , that is, the coordinates of the marker 313 in the augmented reality image 330 overlap with any of the coordinates of the outline of the virtual object 321 , which The indication mark 313 and the virtual object 321 are positioned to each other. When the mark 313 and the virtual object 321 in the augmented reality image 330 are positioned with each other, the virtual object 321 in the augmented reality image 330 performs a corresponding action according to the dynamics of the mark 313, for example, moving, Zoom or rotate, etc.
舉例來說,醫護人員在擴增實境影像330中可用兩手的手指抓住虛擬物件321,並透過兩手的上下左右移動、兩手的張開與合併或兩手的旋轉,而使虛擬物件321在擴增實境影像330中跟著移動、縮放或旋轉。也就是說,如圖2所示,當擴增實境影像330中的解說者影像311的左、右兩群標記313接觸虛擬物件321的左、右兩側輪廓(即標記313與虛擬物件321彼此定位),此時隨著左、右兩群標記313的動態,虛擬物件321會相應地移動、縮放或旋轉。在一些實施例中,影像處理模組130會分析標記313的動態以取得座標變化值,且影像處理模組130根據此座標變化值而移動、縮放或旋轉虛擬物件321。舉例來說,當標記313於第一時間點位在第一座標,而於第二時間點時位在第二座標,則虛擬物件321會於第一時間點與第二時間點,隨著標記313的第一座標至第二座標的移動而跟著移動,此即虛擬物件321的移動會對應於第一座標與第二座標的座標變化值。For example, in the augmented reality image 330, the medical staff can grasp the virtual object 321 with the fingers of both hands, and move the virtual object 321 through the up, down, left and right movement of the two hands, the opening and merging of the two hands, or the rotation of the two hands. The augmented reality image 330 is followed by movement, scaling or rotation. That is, as shown in FIG. 2, when the left and right groups of markers 313 of the narrator image 311 in the augmented reality image 330 contact the left and right sides of the virtual object 321 (ie, the marker 313 and the virtual object 321) Positioning each other), at this time, with the dynamics of the left and right groups of markers 313, the virtual object 321 will move, scale or rotate accordingly. In some embodiments, the image processing module 130 analyzes the dynamics of the marker 313 to obtain a coordinate change value, and the image processing module 130 moves, scales, or rotates the virtual object 321 according to the coordinate change value. For example, when the mark 313 is at the first coordinate at the first time point and at the second coordinate at the second time point, the virtual object 321 is at the first time point and the second time point, along with the mark The movement of the first coordinate to the second coordinate of 313 is followed by movement, that is, the movement of the virtual object 321 corresponds to the coordinate change value of the first coordinate and the second coordinate.
在本實施例中,虛擬物件321為三維器官模型(例如心臟的三維建模影像)。在其他實施例中,虛擬物件321也可以是二維器官圖像(例如胸腔的二維X光圖像)。在本實施例中,虛擬物件321為虛擬人體物件,例如肢體、骨骼或前述器官等。在其他實施例中,虛擬物件321不限於虛擬人體物件,例如在器材裝配教育訓練的應用中,虛擬物件321可以是需要施行訓練的器材。又例如在娛樂應用上,虛擬物件321可以是電玩遊戲中的角色或道具。In the present embodiment, the virtual object 321 is a three-dimensional organ model (eg, a three-dimensional modeled image of the heart). In other embodiments, the virtual object 321 can also be a two-dimensional organ image (eg, a two-dimensional X-ray image of the chest). In the present embodiment, the virtual object 321 is a virtual human object such as a limb, a bone, or the aforementioned organ. In other embodiments, the virtual object 321 is not limited to a virtual human object, such as in a device assembly education training application, the virtual object 321 may be a device that requires training. Also for example, in an entertainment application, the virtual object 321 can be a character or item in a video game.
請參照圖3,圖3所示為本創作另一實施例的擴增實境系統100’的方塊圖,其中,擴增實境系統100’的相同標號的元件與其作用可參照前述擴增實境系統100。如圖3所示,在本實施例中,擴增實境系統100’更包括顯示模組140,其中,顯示模組140訊號連接影像處理模組130,且顯示模組140可顯示擴增實境影像330。舉例來說,顯示模組140是位在攝影模組110附近的顯示螢幕,顯示螢幕以線材連接具有物件產生模組120與影像處理模組130的電腦設備。當醫護人員正在被攝影模組110拍攝並進行遠距醫療服務時,醫護人員可即時地由顯示模組140上看到擴增實境影像330中的自己(即解說者影像311)與虛擬物件321,以便於根據顯示模組140的視覺回饋來操作擴增實境影像330的虛擬物件321,並加以解說。Please refer to FIG. 3. FIG. 3 is a block diagram of an augmented reality system 100' according to another embodiment of the present invention, wherein the elements of the same reference number of the augmented reality system 100' and their functions can be referred to the foregoing augmentation. Environment system 100. As shown in FIG. 3, in the embodiment, the augmented reality system 100' further includes a display module 140, wherein the display module 140 is connected to the image processing module 130, and the display module 140 can display the augmentation Horizon image 330. For example, the display module 140 is a display screen located near the photographic module 110, and the display screen is connected to the computer device having the object generation module 120 and the image processing module 130 by wires. When the medical staff is being photographed by the photography module 110 and performing the telemedicine service, the medical staff can immediately see the self (ie, the narrator image 311) and the virtual object in the augmented reality image 330 from the display module 140. The virtual object 321 of the augmented reality image 330 is operated and interpreted according to the visual feedback of the display module 140.
如圖3所示,在本實施例中,擴增實境系統100’更包括遠端通訊模組150,其中,遠端通訊模組150訊號連接影像處理模組130,且遠端通訊模組150可將擴增實境影像330傳送至客戶端200。遠端通訊模組150例如是3G/4G通訊模組或者是網際網路通訊模組,影像處理模組130可將即時生成的擴增實境影像330,透過遠端通訊模組150,同步傳送給客戶端200。並且,客戶端200的顯示裝置(圖未示)可以顯示擴增實境影像330,使位於客戶端200的患者可即時看到擴增實境影像330。As shown in FIG. 3, in the embodiment, the augmented reality system 100' further includes a remote communication module 150, wherein the remote communication module 150 is connected to the image processing module 130, and the remote communication module The augmented reality image 330 can be transmitted to the client 200. The remote communication module 150 is, for example, a 3G/4G communication module or an internet communication module, and the image processing module 130 can synchronously transmit the generated augmented reality image 330 through the remote communication module 150. To the client 200. Moreover, the display device (not shown) of the client 200 can display the augmented reality image 330 so that the patient located at the client 200 can immediately see the augmented reality image 330.
如圖3所示,在本實施例中,擴增實境系統100’更包括診斷資料庫160,其中,診斷資料庫160訊號連接物件產生模組120。診斷資料庫160可儲存醫療院所的所有患者的所有診斷資料,所述診斷資料包括患者的人體醫學影像,所述人體醫學影像包括電腦斷層掃描影像檔、超音波影像檔或X光影像檔。也就是說,患者於醫療院所就診時,醫護人員利用電腦斷層設備、超音波設備或X光設備為患者實施檢查所取得的任何人體醫學影像都可儲存在診斷資料庫160中。物件產生模組120可根據診斷資料庫160中的人體醫學影像產生第二影像320,例如,物件產生模組120可根據診斷資料庫160中的患者的胸腔電腦斷層掃描影像檔而產生第二影像320,且第二影像320包括有患者的心臟的三維建模影像。As shown in FIG. 3, in the present embodiment, the augmented reality system 100' further includes a diagnostic database 160, wherein the diagnostic database 160 is connected to the object generating module 120. The diagnostic database 160 can store all diagnostic data for all patients in the hospital, including diagnostic medical images of the patient, including computed tomography images, ultrasound image files, or X-ray images. That is to say, any medical and medical images obtained by the medical staff using the computerized tomography device, the ultrasonic device or the X-ray device for the examination of the patient can be stored in the diagnostic database 160 when the patient is visiting the medical institution. The object generation module 120 can generate the second image 320 according to the human medical image in the diagnostic database 160. For example, the object generation module 120 can generate the second image according to the chest computed tomography image file of the patient in the diagnostic database 160. 320, and the second image 320 includes a three-dimensional modeled image of the patient's heart.
在一些實施例中,診斷資料庫160可以是位在雲端的伺服器中,也可以是位在本地端如診間的電腦設備中。在一些實施例中,物件產生模組120、影像處理模組130與診斷資料庫160可整合在同一台電腦設備中。In some embodiments, the diagnostic database 160 may be in a server located in the cloud or in a computer device located at the local end such as a clinic. In some embodiments, the object generation module 120, the image processing module 130, and the diagnostic database 160 can be integrated into the same computer device.
請參照圖4,圖4所示為圖3的擴增實境系統100’的使用狀態示意圖。如圖3與圖4所示,在本實施例中,擴增實境系統100’的物件產生模組120、影像處理模組130、遠端通訊模組150與診斷資料庫160整合在電腦設備400中。在本實施例中,顯示模組140有兩台,但不限於此。並且,電腦設備400、其中一台顯示模組140與攝影模組110是設置於醫療院所中,而此顯示模組140與攝影模組110以有線方式連接電腦設備400,而另一台顯示模組140則可設置於接受遠距醫療服務的客戶端200的所在處。在醫療院所處,顯示模組140與攝影模組110是設置為可讓進行遠距醫療服務的醫護人員面對此顯示模組140與攝影模組110。例如,此醫護人員(位於圖4中上方者)可被攝影模組110拍攝而產生圖2所示的解說者影像311,且顯示模組140可顯示擴增實境影像330,並讓此醫護人員透過顯示模組140觀看擴增實境影像330。而位於客戶端200所在處的另一台顯示模組140,可透過網際網路連接電腦設備400。並且,透過此位於客戶端200的顯示模組140,可讓位於客戶端200的相關人員如患者(位於圖4中下方者)同步觀看擴增實境影像330。Please refer to FIG. 4. FIG. 4 is a schematic diagram showing the state of use of the augmented reality system 100' of FIG. As shown in FIG. 3 and FIG. 4, in the embodiment, the object generation module 120, the image processing module 130, the remote communication module 150, and the diagnostic database 160 of the augmented reality system 100' are integrated in the computer device. 400. In this embodiment, there are two display modules 140, but are not limited thereto. Moreover, the computer device 400, one of the display modules 140 and the camera module 110 are disposed in the medical institution, and the display module 140 and the camera module 110 are connected to the computer device 400 in a wired manner, and the other display is The module 140 can be placed at the location of the client 200 that receives the telemedicine service. In the medical institution, the display module 140 and the camera module 110 are arranged to allow the medical staff performing the remote medical service to face the display module 140 and the camera module 110. For example, the medical staff (located in the upper part of FIG. 4) can be photographed by the camera module 110 to generate the narrator image 311 shown in FIG. 2, and the display module 140 can display the augmented reality image 330 and let the medical care The person views the augmented reality image 330 through the display module 140. Another display module 140 located at the client 200 can connect to the computer device 400 via the Internet. Moreover, through the display module 140 located at the client 200, the relevant person located at the client 200, such as the patient (located in the lower part of FIG. 4), can simultaneously view the augmented reality image 330.
綜上所述,藉由本創作各實施例的擴增實境系統,使得醫護人員與患者在進行遠距醫療服務時,醫護人員這一端可透過靈活的方式呈現出擴增實境影像,並利用擴增實境影像中的虛擬物件加以解說,如此一來,醫護人員在解說時能更加清楚,也讓患者更容易理解自身的醫療狀況。In summary, with the augmented reality system of the embodiments of the present invention, when the medical staff and the patient perform the telemedicine service, the medical staff can display the augmented reality image in a flexible manner and utilize the same. Amplify the virtual objects in the real-life image to explain, so that the medical staff can be more clear in the explanation, and make it easier for the patient to understand their medical condition.
雖然本創作的技術內容已經以較佳實施例揭露如上,然其並非用以限定本創作,任何熟習此技藝者,在不脫離本創作之精神所作些許之更動與潤飾,皆應涵蓋於本創作的範疇內,因此本創作之保護範圍當視後附之申請專利範圍所界定者為準。Although the technical content of the present invention has been disclosed in the above preferred embodiments, it is not intended to limit the present invention. Anyone who is familiar with the art, and some modifications and refinements that do not depart from the spirit of the present invention should be included in the creation. Therefore, the scope of protection of this creation is subject to the definition of the scope of the patent application.
100、100’‧‧‧擴增實境系統
110‧‧‧攝影模組
120‧‧‧物件產生模組
130‧‧‧影像處理模組
140‧‧‧顯示模組
150‧‧‧遠端通訊模組
160‧‧‧診斷資料庫
200‧‧‧客戶端
310‧‧‧第一影像
311‧‧‧解說者影像
313‧‧‧標記
320‧‧‧第二影像
321‧‧‧虛擬物件
330‧‧‧擴增實境影像
400‧‧‧電腦設備100, 100'‧‧‧Augmented Reality System
110‧‧‧Photography module
120‧‧‧ Object Generation Module
130‧‧‧Image Processing Module
140‧‧‧ display module
150‧‧‧Remote communication module
160‧‧‧Diagnostic database
200‧‧‧Client
310‧‧‧ first image
311‧‧‧ narrator image
313‧‧‧ mark
320‧‧‧Second image
321‧‧‧Virtual objects
330‧‧‧Augmented Reality Image
400‧‧‧Computer equipment
[圖1]所示為本創作一實施例的擴增實境系統的方塊圖; [圖2]所示為本創作一實施例的擴增實境系統的擴增實境影像的合成示意圖; [圖3]所示為本創作另一實施例的擴增實境系統的方塊圖;以及 [圖4]所示為圖3的擴增實境系統的使用狀態示意圖。1 is a block diagram showing an augmented reality system according to an embodiment of the present invention; [FIG. 2] is a schematic view showing a synthesis of an augmented reality image of an augmented reality system according to an embodiment of the present invention; [Fig. 3] is a block diagram showing an augmented reality system of another embodiment of the present invention; and [Fig. 4] is a view showing a state of use of the augmented reality system of Fig. 3.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW107209821U TWM569887U (en) | 2018-07-19 | 2018-07-19 | Augmented reality system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW107209821U TWM569887U (en) | 2018-07-19 | 2018-07-19 | Augmented reality system |
Publications (1)
Publication Number | Publication Date |
---|---|
TWM569887U true TWM569887U (en) | 2018-11-11 |
Family
ID=65035107
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW107209821U TWM569887U (en) | 2018-07-19 | 2018-07-19 | Augmented reality system |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWM569887U (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110783000A (en) * | 2019-10-28 | 2020-02-11 | 四川大学华西医院 | Cloud collaborative medical data system and use method thereof |
TWI706386B (en) * | 2019-11-15 | 2020-10-01 | 高雄榮民總醫院 | Wound care education system |
-
2018
- 2018-07-19 TW TW107209821U patent/TWM569887U/en unknown
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110783000A (en) * | 2019-10-28 | 2020-02-11 | 四川大学华西医院 | Cloud collaborative medical data system and use method thereof |
CN110783000B (en) * | 2019-10-28 | 2023-05-23 | 四川大学华西医院 | Cloud collaborative medical data system and application method thereof |
TWI706386B (en) * | 2019-11-15 | 2020-10-01 | 高雄榮民總醫院 | Wound care education system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9892655B2 (en) | Method to provide feedback to a physical therapy patient or athlete | |
US10170155B2 (en) | Motion information display apparatus and method | |
JP4296278B2 (en) | Medical cockpit system | |
Ruppert et al. | Touchless gesture user interface for interactive image visualization in urological surgery | |
Sielhorst et al. | An augmented reality delivery simulator for medical training | |
JP6181373B2 (en) | Medical information processing apparatus and program | |
JP6381918B2 (en) | Motion information processing device | |
US20190310819A1 (en) | Augmented reality image display systems and methods | |
TW201936114A (en) | Methods and apparatus for tele-medicine | |
JP2019514476A (en) | Positioning of ultrasound imaging probe | |
US11123031B2 (en) | Augmented reality for radiation dose monitoring | |
CN107847283A (en) | Surgical system is configured using surgical procedures atlas | |
CN103959179A (en) | Holographic user interfaces for medical procedures | |
CN105611877A (en) | Method and system for guided ultrasound image acquisition | |
US11322048B2 (en) | Ultrasound-guided medical tool insertion simulators | |
CN115315729A (en) | Method and system for facilitating remote presentation or interaction | |
US20230114385A1 (en) | Mri-based augmented reality assisted real-time surgery simulation and navigation | |
TWM569887U (en) | Augmented reality system | |
TWI636768B (en) | Surgical assist system | |
Hochreiter et al. | Touch sensing on non-parametric rear-projection surfaces: A physical-virtual head for hands-on healthcare training | |
Zhang et al. | Immersive augmented reality (I am real)–remote clinical consultation | |
Venkatakrishnan et al. | Give me a hand: Improving the effectiveness of near-field augmented reality interactions by avatarizing users' end effectors | |
TW201619754A (en) | Medical image object-oriented interface auxiliary explanation control system and method thereof | |
KR20180123310A (en) | Laparoscopic surgery education system using augmented reality | |
Bianchi | Exploration of augmented reality technology for surgical training simulators |