TWI694353B - Augmented reality positioning sharing system and method using same - Google Patents
Augmented reality positioning sharing system and method using same Download PDFInfo
- Publication number
- TWI694353B TWI694353B TW107147410A TW107147410A TWI694353B TW I694353 B TWI694353 B TW I694353B TW 107147410 A TW107147410 A TW 107147410A TW 107147410 A TW107147410 A TW 107147410A TW I694353 B TWI694353 B TW I694353B
- Authority
- TW
- Taiwan
- Prior art keywords
- augmented reality
- reality device
- plane
- parameter
- unit
- Prior art date
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 226
- 238000000034 method Methods 0.000 title claims abstract description 25
- 230000001360 synchronised effect Effects 0.000 claims abstract description 53
- 238000012545 processing Methods 0.000 claims description 49
- 238000004891 communication Methods 0.000 claims description 48
- 238000005259 measurement Methods 0.000 claims description 12
- 238000010276 construction Methods 0.000 claims description 10
- 238000005516 engineering process Methods 0.000 claims description 8
- 230000007774 longterm Effects 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 14
- 230000005540 biological transmission Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
Images
Landscapes
- Processing Or Creating Images (AREA)
Abstract
Description
本案係關於一種擴增實境定位之方法,尤指一種擴增實境之環境與物件之定位分享系統及其方法。This case relates to a method for positioning augmented reality, especially a positioning sharing system and method for augmented reality environment and objects.
擴增實境(Augmented Reality, AR) 是指透過攝影機影像的位置及角度精算並加上圖像分析技術,讓螢幕上的虛擬世界能夠與現實世界場景進行結合與互動的技術。一般擴增實境裝置,係利用即時定位與地圖建構演算法掃描周圍環境與物件的特徵點,由特徵點判斷產生一平面,再放置虛擬物件於已產生的平面上。然而此種作法下,每各擴增實境裝置皆會產生一個獨立的平面與一獨立的虛擬物件。不同的擴增實境裝置之間,無法產生共享相同平面與虛擬物件的效果。Augmented Reality (Augmented Reality, AR) refers to the technology that enables the integration and interaction of the virtual world on the screen with the real world scene through the actuarial of the position and angle of the camera image and the addition of image analysis technology. Generally, augmented reality devices use real-time positioning and map construction algorithms to scan the feature points of the surrounding environment and objects, determine a plane from the feature points, and then place virtual objects on the generated plane. However, under this method, each augmented reality device will generate an independent plane and an independent virtual object. Different augmented reality devices cannot share the same plane and virtual objects.
再者,現有擴增實境裝置所產生的虛擬物件,無論是遠端伺服器還是擴增實境裝置發送,鄰近環境的使用者無法依實際的相對位置進行互動,使用者間互動的效果因而大打折扣。Furthermore, the virtual objects generated by the existing augmented reality device, whether sent by a remote server or an augmented reality device, users in the adjacent environment cannot interact according to the actual relative position, so the effect of the interaction between users Great discount.
有鑒於此,實有必要提供一種擴增實境之環境與物件之定位分享系統及其方法,以解決習知技藝無法解決之問題。In view of this, it is necessary to provide an augmented reality environment and object positioning sharing system and method to solve the problems that cannot be solved by the conventional art.
本案之目的在於提供一種擴增實境之環境與物件之定位分享系統及其方法,透過擴增實境裝置以及例如無線直連協定(Wi-Fi Direct)、藍芽通訊(Bluetooth)或長期演進(long term evolution, LTE)之無線傳輸技術,同步化所有擴增實境裝置的平面與物件,以達到分享環境與物件的目的,使所有擴增實境裝置的使用者可以與共同之物件互動,俾利於擴增實境裝置達成例如虛擬象棋、虛擬足球或者文物欣賞等共享相同平面與虛擬物件的應用。The purpose of this case is to provide a positioning and sharing system and method for augmented reality environment and objects, through augmented reality devices and, for example, Wi-Fi Direct, Bluetooth or long-term evolution (long term evolution, LTE) wireless transmission technology synchronizes the plane and objects of all augmented reality devices to achieve the purpose of sharing the environment and objects, so that users of all augmented reality devices can interact with common objects It is beneficial for augmented reality devices to achieve applications such as virtual chess, virtual football, or cultural relic appreciation that share the same plane and virtual objects.
為達前述目的,本案提供一種擴增實境定位分享之方法,包括步驟:(a)提供至少一第一擴增實境裝置與至少一第二擴增實境裝置;(b)透過至少一第一擴增實境裝置擷取至少一第一影像,並依據至少一第一影像產生一第一平面參數以及一第一物件向量參數;(c)傳送第一平面參數以及第一物件向量參數至至少一第二擴增實境裝置;(d)第二擴增實境裝置擴增實境裝置擷取至少一第二影像,產生一第二平面參數;以及(e) 第二擴增實境裝置依據第二平面參數、第一平面參數以及第一物件向量參數,產生一第二更新平面參數,用以取代第二平面參數。To achieve the foregoing objective, the present case provides a method for positioning and sharing augmented reality, including the steps of: (a) providing at least one first augmented reality device and at least one second augmented reality device; (b) through at least one The first augmented reality device captures at least one first image and generates a first plane parameter and a first object vector parameter based on the at least one first image; (c) transmits the first plane parameter and the first object vector parameter To at least one second augmented reality device; (d) second augmented reality device augmented reality device captures at least one second image to generate a second plane parameter; and (e) second augmented reality device The environment device generates a second updated plane parameter based on the second plane parameter, the first plane parameter, and the first object vector parameter, to replace the second plane parameter.
於一實施例中,至少一第一平面參數包括一第一平面以及一第一物件,第一物件置於第一平面上,其中第一物件向量參數包括一第一向量距離、一第二向量距離以及一第一夾角,其中第一向量距離係第一物件與第一擴增實境裝置之距離,第二向量距離係第二擴增實境裝置與第一擴增實境裝置之距離,第一夾角為第一向量距離與第二向量距離的夾角,其中第二更新平面參數包括一第二更新平面以及第一物件相對第二擴增實境裝置之相對位置。In an embodiment, at least one first plane parameter includes a first plane and a first object, the first object is placed on the first plane, wherein the first object vector parameter includes a first vector distance and a second vector Distance and a first angle, where the first vector distance is the distance between the first object and the first augmented reality device, and the second vector distance is the distance between the second augmented reality device and the first augmented reality device, The first included angle is the included angle between the first vector distance and the second vector distance, wherein the second update plane parameter includes a second update plane and the relative position of the first object relative to the second augmented reality device.
於一實施例中,至少一第一擴增實境裝置至少包括一第一影像擷取單元、一第一同步定位與地圖構建單元、一第一中央處理器單元以及一第一通訊單元,第一同步定位與地圖構建單元透過第一中央處理器單元連接至第一影像擷取單元與第一通訊單元,於步驟(b)中,第一影像擷取單元擷取至少一第一影像,傳送至第一同步定位與地圖構建單元,第一同步定位與地圖構建單元,依據至少一第一影像產生第一平面參數以及第一物件向量參數。In one embodiment, at least one first augmented reality device at least includes a first image capturing unit, a first synchronous positioning and map building unit, a first central processing unit and a first communication unit, the first A synchronous positioning and map building unit is connected to the first image capturing unit and the first communication unit through the first central processing unit. In step (b), the first image capturing unit captures at least one first image and transmits To the first synchronous positioning and map construction unit, the first synchronous positioning and map construction unit generates a first plane parameter and a first object vector parameter according to at least one first image.
於一實施例中,至少一第二擴增實境裝置至少包括一第二影像處理單元、一第二同步定位與地圖構建單元、一第二中央處理器單元以及一第二通訊單元,第二同步定位與地圖構建單元透過第二中央處理器單元連接至第二影像處理單元與第二通訊單元,於步驟(d)中,第二影像擷取單元擷取至少一第二影像,傳送至第二同步定位與地圖構建單元,第一同步定位與地圖構建單元,依據至少一第二影像產生第二平面參數。In one embodiment, at least one second augmented reality device at least includes a second image processing unit, a second synchronous positioning and map building unit, a second central processing unit and a second communication unit, the second The synchronous positioning and map building unit is connected to the second image processing unit and the second communication unit through the second central processing unit. In step (d), the second image capturing unit captures at least one second image and sends it to the first Two synchronous positioning and map building units, the first synchronous positioning and map building unit generate second plane parameters based on at least one second image.
於一實施例中,於步驟(e)第二同步定位與地圖構建單元依據第二平面參數、第一平面參數以及第一物件向量參數,至少一第二擴增實境裝置產生一第二更新平面參數,用以取代第二平面參數。In one embodiment, in step (e), the second simultaneous positioning and map building unit generates a second update based on the second plane parameter, the first plane parameter, and the first object vector parameter, at least a second augmented reality device The plane parameter is used to replace the second plane parameter.
於一實施例中,步驟(c)係透過第一通訊單元與第二通訊單元,傳送第一平面參數以及第一物件向量參數至至少一第二擴增實境裝置。In one embodiment, step (c) is to transmit the first plane parameter and the first object vector parameter to at least one second augmented reality device through the first communication unit and the second communication unit.
於一實施例中,步驟(a)更包括一步驟(a0)至少一擴增實境裝置之第一通訊單元係與至少一第二擴增實境裝置之第二通訊單元建立網路連接。In one embodiment, step (a) further includes a step (a0) at least one first communication unit of the augmented reality device establishes a network connection with at least one second communication unit of the second augmented reality device.
於一實施例中,第一影像擷取單元包括一第一影像處理單元以及一第一慣性量測模組,第一中央處理器單元連接至第一影像處理單元、第一同步定位與地圖構建單元、第一通訊單元以及第一慣性量測模組,其中第二影像擷取單元包括一第二影像處理單元以及一第二慣性量測模組,第二中央處理器單元連接至第二影像處理單元、第二同步定位與地圖構建單元、第二通訊單元以及第二慣性量測模組。In one embodiment, the first image capture unit includes a first image processing unit and a first inertial measurement module, the first central processing unit is connected to the first image processing unit, the first synchronous positioning and map construction Unit, first communication unit and first inertial measurement module, wherein the second image capture unit includes a second image processing unit and a second inertial measurement module, and the second central processing unit is connected to the second image A processing unit, a second synchronous positioning and map building unit, a second communication unit, and a second inertial measurement module.
於一實施例中,第一通訊單元與第二通訊單元係透過一無線直連協定、一藍芽通訊或一長期演進技術進行網路連接。。In one embodiment, the first communication unit and the second communication unit are connected via a wireless direct connection protocol, a Bluetooth communication, or a long-term evolution technology. .
於一實施例中,擴增實境定位分享之方法,更包括步驟:(f) 至少一第二擴增實境裝置依據第二更新平面參數產生一第二物件向量參數;(g) 傳送第二更新平面參數以及第二物件向量參數至至少一第一擴增實境裝置;以及(h) 至少一第一擴增實境裝置依據第二更新平面參數、第一平面參數以及第二物件向量參數,計算產生一第一更新平面參數,用以取代第一平面參數。In an embodiment, the method of augmented reality positioning and sharing further includes the steps of: (f) at least one second augmented reality device generates a second object vector parameter according to the second updated plane parameter; (g) transmits the first Two update plane parameters and second object vector parameters to at least one first augmented reality device; and (h) at least one first augmented reality device according to the second updated plane parameters, the first plane parameters and the second object vector Parameters, a first updated plane parameter is calculated to replace the first plane parameter.
於一實施例中,第二更新平面參數包括一第二平面以及一第二物件,第二物件置於第二平面上,其中第二物件向量參數包括一第三向量距離、一第四向量距離以及一第二夾角,其中第三向量距離係第二物件與第二擴增實境裝置之距離,第四向量距離係第二擴增實境裝置與第一擴增實境裝置之距離,第二夾角為第三向量距離與第四向量距離的夾角,其中第一更新平面參數包括一第一更新平面以及第二物件相對第一擴增實境裝置之相對位置。In one embodiment, the second update plane parameters include a second plane and a second object, and the second object is placed on the second plane, wherein the second object vector parameters include a third vector distance and a fourth vector distance And a second angle, where the third vector distance is the distance between the second object and the second augmented reality device, and the fourth vector distance is the distance between the second augmented reality device and the first augmented reality device, the first The second angle is the angle between the third vector distance and the fourth vector distance, wherein the first update plane parameter includes a first update plane and the relative position of the second object relative to the first augmented reality device.
為達前述目的,本案另提供一種擴增實境定位分享系統,包括至少一第一擴增實境裝置以及至少一第二擴增實境裝置。至少一第一擴增實境裝置,包括第一影像擷取單元、第一同步定位與地圖構建單元、第一中央處理器單元以及一第一通訊單元。第一影像擷取單元擷取至少一第一影像。第一同步定位與地圖構建單元透過第一中央處理器單元連接至第一影擷取單元,接收至少一第一影像,且依據至少一第一影像產生一第一平面參數以及一第一物件向量參數。第一通訊單元透過第一中央處理器單元連接至第一同步定位與地圖構建單元,傳送第一平面參數以及第一物件向量參數。至少一第二擴增實境裝置,包括第二影像擷取單元、第二同步定位與地圖構建單元、第二中央處理器單元以及第二通訊單元。第二影像擷取單元擷取至少一第二影像。第二同步定位與地圖構建單元,通過第二中央處理器單元連接至第二影像擷取單元,接收至少一第二影像,且依據至少一第二影像產生一第二平面參數。第二通訊單元通過第二中央處理器單元連接至第二同步定位與地圖構建單元,接收第一平面參數以及第一物件向量參數,且傳送至第二同步定位與地圖構建單元。其中第二同步定位與地圖構建單元依據第二平面參數、第一平面參數以及第一物件向量參數,計算產生一第二更新平面參數,用以取代第二平面參數。To achieve the foregoing objective, the present invention also provides an augmented reality positioning and sharing system, including at least one first augmented reality device and at least one second augmented reality device. At least one first augmented reality device includes a first image capturing unit, a first synchronous positioning and map building unit, a first central processing unit, and a first communication unit. The first image capturing unit captures at least one first image. The first synchronous positioning and map building unit is connected to the first image capturing unit through the first central processing unit, receives at least one first image, and generates a first plane parameter and a first object vector according to the at least one first image parameter. The first communication unit is connected to the first synchronous positioning and map building unit through the first central processor unit, and transmits the first plane parameter and the first object vector parameter. At least one second augmented reality device includes a second image capturing unit, a second synchronous positioning and map building unit, a second central processing unit, and a second communication unit. The second image capturing unit captures at least one second image. The second synchronous positioning and map building unit is connected to the second image capturing unit through the second central processing unit, receives at least one second image, and generates a second plane parameter according to the at least one second image. The second communication unit is connected to the second synchronous positioning and map building unit through the second central processor unit, receives the first plane parameters and the first object vector parameters, and transmits to the second synchronous positioning and map building unit. The second synchronous positioning and map construction unit calculates and generates a second updated plane parameter based on the second plane parameter, the first plane parameter, and the first object vector parameter, to replace the second plane parameter.
於一實施例中,至少一第一平面參數包括一第一平面以及一第一物件,物件置於第一平面上,其中第一物件向量參數包括一第一向量距離、一第二向量距離以及一第一夾角,其中第一向量距離係一物件與第一擴增實境裝置之距離,第二向量距離係第二擴增實境裝置與第一擴增實境裝置之距離,第一夾角為第一向量距離與第二向量距離的夾角,其中第二更新平面參數包括一第二更新平面以及第一物件相對第二擴增實境裝置之相對位置。In an embodiment, at least one first plane parameter includes a first plane and a first object, and the object is placed on the first plane, wherein the first object vector parameter includes a first vector distance, a second vector distance, and A first angle, where the first vector distance is the distance between an object and the first augmented reality device, the second vector distance is the distance between the second augmented reality device and the first augmented reality device, the first angle Is the angle between the first vector distance and the second vector distance, where the second update plane parameter includes a second update plane and the relative position of the first object relative to the second augmented reality device.
體現本案特徵與優點的一些典型實施例將在後段的說明中詳細敘述。應理解的是本案能夠在不同的態樣上具有各種的變化,其皆不脫離本案的範圍,且其中的說明及圖示在本質上係當作說明之用,而非用於限制本案。Some typical embodiments embodying the characteristics and advantages of this case will be described in detail in the description in the following paragraphs. It should be understood that this case can have various changes in different forms, and they do not deviate from the scope of this case, and the descriptions and illustrations therein are essentially used for explanation, not for limiting the case.
第1圖係揭示本案較佳實施例之擴增實境定位分享系統之結構方塊圖。為達到分享環境與物件的目的,使所有擴增實境裝置的使用者可以與共同之物件互動,本案擴增實境定位分享系統1,包括至少一第一擴增實境裝置10以及至少一第二擴增實境裝置20,第一擴增實境裝置10與第二擴增實境裝置20可例如具有相同之結構,但並不以此為限。於本實施例中,至少一第一擴增實境裝置10包括第一影像擷取單元11、第一同步定位與地圖構建單元(Simultaneous Localization And Mapping unit, SLAM Unit)16、第一中央處理器單元15、第一通訊單元17以及第一顯示單元18。第一影像擷取單元11例如包括第一影像擷取模組12、第一影像處理單元13,以組配擷取至少一第一影像i1(參見第3圖)。第一影像擷取模組12可例如是一RGB攝像器或Mono攝像器,擷取原始影像數據(Raw Data)後,再經第一影像處理單元13轉換為例如是RGB格式。於本實施例中,第一影像擷取單元11更包括一第一慣性量測模組(Inertial Measurement Unit,IMU)14,俾以提高第一影像擷取單元11擷取之第一影像i1之精確性,惟本案並不受限於此。第一同步定位與地圖構建單元16透過第一中央處理器單元15連接至第一影擷取單元11,接收至少一第一影像i1,且依據至少一第一影像i1產生一第一平面參數m1以及一第一物件向量參數v1(參見第3圖)。第一通訊單元17透過第一中央處理器單元15連接至第一同步定位與地圖構建單元16,傳送第一平面參數m1以及第一物件向量參數v1。第一顯示單元18例如是一微顯示器單元,連接至第一中央處理器單元15,組配受第一中央處理器單元15控制而產生虛擬圖像供使用者觀看。FIG. 1 is a block diagram showing the structure of an augmented reality positioning and sharing system according to a preferred embodiment of this case. In order to achieve the purpose of sharing environment and objects, so that users of all augmented reality devices can interact with common objects, the augmented reality positioning and sharing
另外,於擴增實境定位分享系統1中,至少一第二擴增實境裝置20包括第二影像擷取單元21、第二同步定位與地圖構建單元26、第二中央處理器單元25、第二通訊單元27以及第二顯示單元28。第二影像擷取單元21例如包括第二影像擷取模組22、第二影像處理單元23,以組配擷取至少一第二影像i2(參考第3圖)。第二影像擷取模組22可例如是一RGB攝像器或Mono攝像器,擷取原始影像數據(Raw Data)後,再經第二影像處理單元23轉換為例如是RGB格式。於本實施例中,第二影像擷取單元21更包括一第二慣性量測模組(Inertial Measurement Unit,IMU)24,俾以提高第二影像擷取單元21擷取之第一影像i2之精確性,惟本案並不受限於此。第二同步定位與地圖構建單元26通過第二中央處理器單元25連接至第二影像擷取單元21,接收至少一第二影像i2(參見第3圖),且依據至少一第二影像i2產生一第二平面參數m2。第二通訊單元27通過第二中央處理器單元25連接至第二同步定位與地圖構建單元26,接收第一平面參數m1以及第一物件向量參數v1,且傳送至第二同步定位與地圖構建單元26。其中第二同步定位與地圖構建單元26依據第二平面參數m2、第一平面參數m1以及第一物件向量參數v1,計算產生一第二更新平面參數m2’,用以取代第二平面參數m2。第二顯示單元28例如是一微顯示器單元,連接至第二中央處理器單元25,組配受第二中央處理器單元25控制而產生虛擬圖像供使用者觀看。In addition, in the augmented reality positioning and
另一方面,依據前述擴增實境定位分享系統1,本案同時提供一種擴增實境定位分享之方法。第2圖係揭示本案佳實施例之擴增實境定位分享之方法流程圖。第3圖係揭示本案較佳實施例之擴增實境定位分享系統之第一示範性作動示意圖。第4圖係揭示本案較佳實施例之擴增實境定位分享系統中之第一擴增實境裝置、第二擴增實境裝置與第一物件之位置關係示意圖。第5圖係揭示本案較佳實施例之擴增實境定位分享系統中之第一擴增實境裝置、第二擴增實境裝置與第一物件之另一位置關係示意圖。參考第1圖至第5圖。首先,於擴增實境定位分享系統1中提供至少一第一擴增實境裝置10以及至少一第二擴增實境裝置20,以進行環境與物件的定位分享,如步驟S1所示。其中至少一第一擴增實境裝置10以及至少一第二擴增實境裝置20之結構如前所述,可例如具有相同的結構及構成組件,但本案並不以此為限。於本實施例中,至少一第一擴增實境裝置10以及至少一第二擴增實境裝置20執行環境與物件之定位分享前,擴增實境定位分享系統1中的至少一第一擴增實境裝置10之第一通訊單元17與至少一第二擴增實境裝置20之第二通訊單元27建立網路連接。於本實施例中,第一通訊單元17與第二通訊單元27可例如透過一無線直連協定、一藍芽通訊或一長期演進技術進行網路連接,本案並不以此為限。On the other hand, according to the aforementioned augmented reality positioning and sharing
接著,如步驟S2所示,透過至少一第一擴增實境裝置10的影像擷取單元11擷取至少一第一影像i1,至少一第一影像i1由第一中央處理器單元15傳送至第一同步定位與地圖構建單元16,第一同步定位與地圖構建單元16並依據至少一第一影像i1產生至少一第一平面參數m1以及至少一第一物件向量參數v1。於本實施例中,第一平面參數m1即可通過第一顯示單元18產生虛擬圖像供使用者觀看,可例如包括一第一平面M1以及一第一物件9,第一物件9置於第一平面M1上。第一物件向量參數v1包括一第一向量距離Q、一第二向量距離P以及一第一夾角β。其中第一向量距離Q係第一物件9與第一擴增實境裝置10之距離,第二向量距離P係第二擴增實境裝置20與第一擴增實境裝置10之距離,第一夾角β為第一向量距離Q與第二向量距離P的夾角,如第4圖所示。Next, as shown in step S2, at least one first image i1 is captured by the
爾後,如步驟S3所示,透過第一擴增實境裝置10的第一通訊單元17與第二擴增實境裝置20的第二通訊單元27,將第一平面參數m1以及第一物件向量參數v1傳送至第二擴增實境裝置20的第二同步定位與地圖構建單元26。Then, as shown in step S3, through the
另一方面,如步驟S4所示,透過至少一第二擴增實境裝置20的影像擷取單元21擷取至少一第二影像i2,至少一第二影像i2由第二中央處理器單元25傳送至第二同步定位與地圖構建單元26,第二同步定位與地圖構建單元26可依據至少一第二影像i2產生至少一第二平面參數m2。第二平面參數m2雖可通過第二顯示單元28產生虛擬圖像供使用者觀看,惟尚未與第一擴增實境裝置10之第一顯示單元18所產生的虛擬圖像達成同步化。On the other hand, as shown in step S4, at least one second image i2 is captured by the
最後,如步驟S5所示,第二同步定位與地圖構建單元26進一步依據第二平面參數m2與來自第一擴增實境裝置10的第一平面參數m1以及第一物件向量參數v1,計算產生一第二更新平面參數m2’,用以取代該第二平面參數m2。其中第二更新平面參數m2’即包括一第二更新平面M2以及第一物件9相對該第二擴增實境裝置20之相對位置,如第5圖所示,即第二擴增實境裝置20與第一物件9之間的向量距離R、第一向量距離Q與向量距離R之夾角α,以及第二向量距離P與向量距離R之夾角γ,均包含於第二更新平面參數m2中。此時,第一擴增實境裝置10的使用者由第一擴增實境裝置10之第一顯示單元18所觀看到第一物件9、第一擴增實境裝置10與第二擴增實境裝置20之相對位置關係,相同於第二擴增實境裝置20的使用者由第二擴增實境裝置20之第二顯示單元28所觀看到第一物件9、第一擴增實境裝置10與第二擴增實境裝置20之相對位置關係。藉此,擴增實境定位分享系統1即可同步化第一擴增實境裝置10與第二擴增實境裝置20的平面與物件,以達到分享環境與物件的目的,使第一擴增實境裝置10與第二擴增實境裝置20的使用者均可以與共同之第一物件9進行互動,進而達成例如虛擬象棋、虛擬足球或者文物欣賞等共享相同平面與虛擬物件的應用。Finally, as shown in step S5, the second synchronous positioning and
另一方面,需說明的是,前述第一示範例中,第一物件9與第一擴增實境裝置10以及第二擴增實境裝置20的相對位置及關係由第一擴增實境裝置10分享至第二擴增實境裝置20僅屬例示,非限制環境與物件定位分享之方向或從屬關係。於其他實施例中,包含相同之環境與物件定位分享之方向或從屬關係亦可由第二擴增實境裝置20分享至第一擴增實境裝置10。請再參考第6圖至第8圖。第6圖係揭示本案較佳實施例之擴增實境定位分享系統之第二示範性作動示意圖。第7圖係揭示本案較佳實施例之擴增實境定位分享系統中之第一擴增實境裝置、第二擴增實境裝置與第二物件之位置關係示意圖。第8圖係揭示本案較佳實施例之擴增實境定位分享系統中之第一擴增實境裝置、第二擴增實境裝置與第二物件之另一位置關係示意圖。若以第二擴增實境裝置20欲分享一第二物件9’至第一擴增實境裝置10為例,第二擴增實境裝置20的第二同步定位與地圖構建單元26可依據第二更新平面參數m2’產生一第二物件向量參數v2。其中第二更新平面參數m2’包含第二平面M2’以及一第二物件9’,第二物件9’置於第二平面M2’上。另外,第二物件向量參數v2包括一第三向量距離R’、一第四向量距離P’以及一第二夾角γ’,其中第三向量距離R’係第二物件9’與第二擴增實境裝置20之距離,第四向量距離P’係第二擴增實境裝置20與第一擴增實境裝置10之距離,第二夾角γ’為第三向量距離R’與第四向量距離P’的夾角,如第7圖所示。On the other hand, it should be noted that in the foregoing first example, the relative position and relationship between the
接著,透過第二擴增實境裝置20的第二通訊單元27與第一擴增實境裝置10的第一通訊單元17,將第二更新平面參數m2’以及第二物件向量參數v2傳送至第一擴增實境裝置10的第一同步定位與地圖構建單元16。最後,第一擴增實境裝置10依據第二更新平面參數m2’、第一平面參數m1以及第二物件向量參數v2,即可計算產生一第一更新平面參數m1’,用以取代該第一平面參數m1。其中第一更新平面參數m1’包括一第一更新平面M1’以及第二物件9’相對第一擴增實境裝置10之相對位置,如第8圖所示,即第一擴增實境裝置10與第二物件9’之間的向量距離Q’、第三向量距離R’與向量距離Q’之夾角α’,以及第四向量距離P’與向量距離R’之夾角γ,均包含於第一更新平面參數m1’中。此時,第一擴增實境裝置10的使用者由第一擴增實境裝置10之第一顯示單元18所觀看到第二物件9’、第一擴增實境裝置10與第二擴增實境裝置20之相對位置關係,相同於第二擴增實境裝置20的使用者由第二擴增實境裝置20之第二顯示單元28所觀看到第二物件9’、第一擴增實境裝置10與第二擴增實境裝置20之相對位置關係。藉此,擴增實境定位分享系統1即可同步化第一擴增實境裝置10與第二擴增實境裝置20的平面與物件,以達到分享環境與物件的目的,使第一擴增實境裝置10與第二擴增實境裝置20的使用者均可以與共同之第二物件9’進行互動,進而達成例如虛擬象棋、虛擬足球或者文物欣賞等共享相同平面與虛擬物件的應用。Next, the second updated plane parameter m2' and the second object vector parameter v2 are transmitted to the
當然,前述第一擴增實境裝置10與第二擴增實境裝置20之環境與物件之定件分享,並不僅限於單方向進行。換言之,第一擴增實境裝置10與第二擴增實境裝置20之間,第一物件9與第二物件9’之定件分享亦可同時進行。於眾多物件需進行定位分享的狀況下,可分別透過第一擴增實境裝置10與第二擴增實境裝置20進行定位分享,例如虛擬象棋的兩方的棋子分別透過第一擴增實境裝置10與第二擴增實境裝置20進行定位分享,以避免眾多物件之定位計算流程造成第一擴增實境裝置10的第一中央處理器單元15或第二擴增實境裝置20的第二中央處理器單元25單方過重負荷,當然本案並不受限於此,且不再贅述。Of course, the sharing of the environment and objects of the first
綜上所述,本案提供一種擴增實境之環境與物件之定位分享系統及其方法,透過擴增實境裝置以及例如無線直連協定、藍芽通訊或長期演進之無線傳輸技術,同步化所有擴增實境裝置的平面與物件,以達到分享環境與物件的目的,使所有擴增實境裝置的使用者可以與共同之物件互動,俾利於擴增實境裝置達成例如虛擬象棋、虛擬足球或者文物欣賞等共享相同平面與虛擬物件的應用。In summary, this case provides an augmented reality environment and object positioning sharing system and method, which are synchronized through augmented reality devices and wireless transmission technologies such as wireless direct connection protocol, Bluetooth communication or long-term evolution The planes and objects of all augmented reality devices, to achieve the purpose of sharing the environment and objects, so that the users of all augmented reality devices can interact with the common objects, so as to facilitate the augmented reality devices to achieve, for example, virtual chess, virtual Football or cultural relics appreciation applications that share the same plane and virtual objects.
本案得由熟習此技術之人士任施匠思而為諸般修飾,然皆不脫如附申請專利範圍所欲保護者。This case may be modified by any person familiar with the technology as a craftsman, but none of them may be as protected as the scope of the patent application.
1:擴增實境定位分享系統1: Augmented reality positioning and sharing system
10:第一擴增實境裝置10: The first augmented reality device
11:第一影像擷取單元11: The first image capture unit
12:第一影像擷取模組12: The first image capture module
13:第一影像處理單元13: The first image processing unit
14:第一慣性量測模組14: The first inertial measurement module
15:第一中央處理器單元15: The first central processing unit
16:第一同步定位與地圖構建單元16: The first synchronous positioning and map building unit
17:第一通訊單元17: The first communication unit
18:第一顯示單元18: The first display unit
20:第二擴增實境裝置20: Second augmented reality device
21:第二影像擷取單元21: Second image capture unit
22:第二影像擷取模組22: Second image capture module
23:第二影像處理單元23: Second image processing unit
24:第二慣性量測模組24: Second inertial measurement module
25:第二中央處理器單元25: second central processing unit
26:第二同步定位與地圖構建單元26: Second synchronous positioning and map building unit
27:第二通訊單元27: Second communication unit
28:第二顯示單元28: Second display unit
9:第一物件9: The first object
9’:第二物件9’: Second object
i1:第一影像i1: the first image
i2:第二影像i2: second image
m1:第一平面參數m1: first plane parameter
m2:第二平面參數m2: second plane parameter
m1’:第一更新平面參數m1’: first update plane parameters
m2’:第二更新平面參數m2’: Second update plane parameters
v1:第一物件向量參數v1: first object vector parameter
v2:第二物件向量參數v2: second object vector parameter
M1:第一平面M1: first plane
M2:第二更新平面M2: second update plane
M1’:第一更新平面M1’: First update plane
M2’:第二平面M2’: Second plane
Q:第一向量距離Q: First vector distance
P:第二向量距離P: second vector distance
R’:第三向量距離R’: third vector distance
P’:第四向量距離P’: Fourth vector distance
R、Q’:向量距離R, Q’: vector distance
α、γ、α'、β':夾角α, γ, α', β': included angle
β:第一夾角β: the first angle
γ':第二夾角γ': Second angle
S1~S5:步驟S1~S5: Step
第1圖係揭示本案較佳實施例之擴增實境定位分享系統之結構方塊圖。FIG. 1 is a block diagram showing the structure of an augmented reality positioning and sharing system according to a preferred embodiment of this case.
第2圖係揭示本案佳實施例之擴增實境定位分享之方法流程圖。FIG. 2 is a flowchart showing a method for augmented reality positioning and sharing according to a preferred embodiment of the present case.
第3圖係揭示本案較佳實施例之擴增實境定位分享系統之第一示範性作動示意圖。FIG. 3 is a schematic diagram illustrating the first exemplary operation of the augmented reality positioning and sharing system of the preferred embodiment of the present case.
第4圖係揭示本案較佳實施例之擴增實境定位分享系統中之第一擴增實境裝置、第二擴增實境裝置與第一物件之位置關係示意圖。FIG. 4 is a schematic diagram showing the positional relationship between the first augmented reality device, the second augmented reality device and the first object in the augmented reality location sharing system of the preferred embodiment of the present invention.
第5圖係揭示本案較佳實施例之擴增實境定位分享系統中之第一擴增實境裝置、第二擴增實境裝置與第一物件之另一位置關係示意圖。FIG. 5 is a schematic diagram showing another positional relationship between the first augmented reality device, the second augmented reality device and the first object in the augmented reality positioning sharing system of the preferred embodiment of the present invention.
第6圖係揭示本案較佳實施例之擴增實境定位分享系統之第二示範性作動示意圖。FIG. 6 is a schematic diagram illustrating a second exemplary operation of the augmented reality location sharing system of the preferred embodiment of the present case.
第7圖係揭示本案較佳實施例之擴增實境定位分享系統中之第一擴增實境裝置、第二擴增實境裝置與第二物件之位置關係示意圖。FIG. 7 is a schematic diagram showing the positional relationship between the first augmented reality device, the second augmented reality device and the second object in the augmented reality positioning sharing system of the preferred embodiment of the present invention.
第8圖係揭示本案較佳實施例之擴增實境定位分享系統中之第一擴增實境裝置、第二擴增實境裝置與第二物件之另一位置關係示意圖。FIG. 8 is a schematic diagram showing another positional relationship between the first augmented reality device, the second augmented reality device and the second object in the augmented reality positioning sharing system of the preferred embodiment of the present invention.
S1~S5:步驟 S1~S5: Step
Claims (11)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW107147410A TWI694353B (en) | 2018-12-27 | 2018-12-27 | Augmented reality positioning sharing system and method using same |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW107147410A TWI694353B (en) | 2018-12-27 | 2018-12-27 | Augmented reality positioning sharing system and method using same |
Publications (2)
Publication Number | Publication Date |
---|---|
TWI694353B true TWI694353B (en) | 2020-05-21 |
TW202024865A TW202024865A (en) | 2020-07-01 |
Family
ID=71896199
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW107147410A TWI694353B (en) | 2018-12-27 | 2018-12-27 | Augmented reality positioning sharing system and method using same |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI694353B (en) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI278772B (en) * | 2005-02-23 | 2007-04-11 | Nat Applied Res Lab Nat Ce | Augmented reality system and method with mobile and interactive function for multiple users |
CN106873768A (en) * | 2016-12-30 | 2017-06-20 | 中兴通讯股份有限公司 | A kind of augmented reality method, apparatus and system |
US20180308287A1 (en) * | 2015-10-16 | 2018-10-25 | Bent Image Lab, Llc | Augmented reality platform |
-
2018
- 2018-12-27 TW TW107147410A patent/TWI694353B/en not_active IP Right Cessation
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI278772B (en) * | 2005-02-23 | 2007-04-11 | Nat Applied Res Lab Nat Ce | Augmented reality system and method with mobile and interactive function for multiple users |
US20180308287A1 (en) * | 2015-10-16 | 2018-10-25 | Bent Image Lab, Llc | Augmented reality platform |
CN106873768A (en) * | 2016-12-30 | 2017-06-20 | 中兴通讯股份有限公司 | A kind of augmented reality method, apparatus and system |
Also Published As
Publication number | Publication date |
---|---|
TW202024865A (en) | 2020-07-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR102375307B1 (en) | Method, apparatus, and system for sharing virtual reality viewport | |
EP2613296A1 (en) | Mixed reality display system, image providing server, display apparatus, and display program | |
RU2534951C2 (en) | Device, method and system for sharing of plotted image at multiple workplaces, programme and recordable media | |
JP6896688B2 (en) | Position calculation device, position calculation program, position calculation method, and content addition system | |
TW201429242A (en) | System and method for determining individualized depth information in augmented reality scene | |
US20220067974A1 (en) | Cloud-Based Camera Calibration | |
US20220284620A1 (en) | Information terminal apparatus and position recognition sharing method | |
KR101769118B1 (en) | Device and system for synthesizing tele-presence video and device for filming remote area | |
US20220301270A1 (en) | Systems and methods for immersive and collaborative video surveillance | |
KR100545048B1 (en) | System for drawing blind area in aerial photograph and method thereof | |
JP2020065229A (en) | Video communication method, video communication device, and video communication program | |
US20140168375A1 (en) | Image conversion device, camera, video system, image conversion method and recording medium recording a program | |
US20220272164A1 (en) | Experience sharing system and experience sharing method | |
TWI694353B (en) | Augmented reality positioning sharing system and method using same | |
KR102588858B1 (en) | System for displaying 3d tour comparison | |
KR101473984B1 (en) | System for collecting field information using mobile device | |
US20170332014A1 (en) | Method for transforming wide-angle image to map projection image and perspective projection image | |
JP2005142765A (en) | Apparatus and method for imaging | |
JP5864371B2 (en) | Still image automatic generation system, worker information processing terminal, instructor information processing terminal, and determination device in still image automatic generation system | |
CN104410670A (en) | Auxiliary communication method capable of sharing self screen general situation and mouse position on real time interaction communication platform | |
JP2023121636A (en) | Information processing system, communication system, image sharing method, and program | |
US20200045234A1 (en) | Image display method, image display system and virtual window | |
CN115053262A (en) | Space recognition system, space recognition method, information terminal, and server device | |
JP2019140530A (en) | Server device, display device, video display system, and video display method | |
EP4033755A1 (en) | System for broadcasting volumetric videoconferences in 3d animated virtual environment with audio information, and method for operating said system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
MM4A | Annulment or lapse of patent due to non-payment of fees |