TWI694353B - Augmented reality positioning sharing system and method using same - Google Patents

Augmented reality positioning sharing system and method using same Download PDF

Info

Publication number
TWI694353B
TWI694353B TW107147410A TW107147410A TWI694353B TW I694353 B TWI694353 B TW I694353B TW 107147410 A TW107147410 A TW 107147410A TW 107147410 A TW107147410 A TW 107147410A TW I694353 B TWI694353 B TW I694353B
Authority
TW
Taiwan
Prior art keywords
augmented reality
reality device
plane
parameter
unit
Prior art date
Application number
TW107147410A
Other languages
Chinese (zh)
Other versions
TW202024865A (en
Inventor
楊世豪
嚴克勤
Original Assignee
仁寶電腦工業股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 仁寶電腦工業股份有限公司 filed Critical 仁寶電腦工業股份有限公司
Priority to TW107147410A priority Critical patent/TWI694353B/en
Application granted granted Critical
Publication of TWI694353B publication Critical patent/TWI694353B/en
Publication of TW202024865A publication Critical patent/TW202024865A/en

Links

Images

Landscapes

  • Processing Or Creating Images (AREA)

Abstract

An augmented reality positioning sharing system and a method using the same are disclosed. The method includes steps of: (a) providing a first augmented reality device and a second augmented reality device; (b) capturing a first image through the first augmented reality device and generating a first plane parameter and a first object vector parameter according to the first image; (c) transmitting the first plane parameter and the first object vector parameter to the second augmented reality device; (d) capturing a second image and generating a second plane parameter through the second augmented reality device; and (e) calculating to generate a second update plane parameter according to the second plane parameter, the first plane parameter, and the first object vector parameter through the second augmented reality device, so as to replace the second plane parameters. In this way, the planes and objects of all augmented reality devices can be synchronized to achieve the purpose of sharing the positions and objects.

Description

擴增實境定位分享系統及其方法Augmented reality positioning sharing system and method

本案係關於一種擴增實境定位之方法,尤指一種擴增實境之環境與物件之定位分享系統及其方法。This case relates to a method for positioning augmented reality, especially a positioning sharing system and method for augmented reality environment and objects.

擴增實境(Augmented Reality, AR) 是指透過攝影機影像的位置及角度精算並加上圖像分析技術,讓螢幕上的虛擬世界能夠與現實世界場景進行結合與互動的技術。一般擴增實境裝置,係利用即時定位與地圖建構演算法掃描周圍環境與物件的特徵點,由特徵點判斷產生一平面,再放置虛擬物件於已產生的平面上。然而此種作法下,每各擴增實境裝置皆會產生一個獨立的平面與一獨立的虛擬物件。不同的擴增實境裝置之間,無法產生共享相同平面與虛擬物件的效果。Augmented Reality (Augmented Reality, AR) refers to the technology that enables the integration and interaction of the virtual world on the screen with the real world scene through the actuarial of the position and angle of the camera image and the addition of image analysis technology. Generally, augmented reality devices use real-time positioning and map construction algorithms to scan the feature points of the surrounding environment and objects, determine a plane from the feature points, and then place virtual objects on the generated plane. However, under this method, each augmented reality device will generate an independent plane and an independent virtual object. Different augmented reality devices cannot share the same plane and virtual objects.

再者,現有擴增實境裝置所產生的虛擬物件,無論是遠端伺服器還是擴增實境裝置發送,鄰近環境的使用者無法依實際的相對位置進行互動,使用者間互動的效果因而大打折扣。Furthermore, the virtual objects generated by the existing augmented reality device, whether sent by a remote server or an augmented reality device, users in the adjacent environment cannot interact according to the actual relative position, so the effect of the interaction between users Great discount.

有鑒於此,實有必要提供一種擴增實境之環境與物件之定位分享系統及其方法,以解決習知技藝無法解決之問題。In view of this, it is necessary to provide an augmented reality environment and object positioning sharing system and method to solve the problems that cannot be solved by the conventional art.

本案之目的在於提供一種擴增實境之環境與物件之定位分享系統及其方法,透過擴增實境裝置以及例如無線直連協定(Wi-Fi Direct)、藍芽通訊(Bluetooth)或長期演進(long term evolution, LTE)之無線傳輸技術,同步化所有擴增實境裝置的平面與物件,以達到分享環境與物件的目的,使所有擴增實境裝置的使用者可以與共同之物件互動,俾利於擴增實境裝置達成例如虛擬象棋、虛擬足球或者文物欣賞等共享相同平面與虛擬物件的應用。The purpose of this case is to provide a positioning and sharing system and method for augmented reality environment and objects, through augmented reality devices and, for example, Wi-Fi Direct, Bluetooth or long-term evolution (long term evolution, LTE) wireless transmission technology synchronizes the plane and objects of all augmented reality devices to achieve the purpose of sharing the environment and objects, so that users of all augmented reality devices can interact with common objects It is beneficial for augmented reality devices to achieve applications such as virtual chess, virtual football, or cultural relic appreciation that share the same plane and virtual objects.

為達前述目的,本案提供一種擴增實境定位分享之方法,包括步驟:(a)提供至少一第一擴增實境裝置與至少一第二擴增實境裝置;(b)透過至少一第一擴增實境裝置擷取至少一第一影像,並依據至少一第一影像產生一第一平面參數以及一第一物件向量參數;(c)傳送第一平面參數以及第一物件向量參數至至少一第二擴增實境裝置;(d)第二擴增實境裝置擴增實境裝置擷取至少一第二影像,產生一第二平面參數;以及(e) 第二擴增實境裝置依據第二平面參數、第一平面參數以及第一物件向量參數,產生一第二更新平面參數,用以取代第二平面參數。To achieve the foregoing objective, the present case provides a method for positioning and sharing augmented reality, including the steps of: (a) providing at least one first augmented reality device and at least one second augmented reality device; (b) through at least one The first augmented reality device captures at least one first image and generates a first plane parameter and a first object vector parameter based on the at least one first image; (c) transmits the first plane parameter and the first object vector parameter To at least one second augmented reality device; (d) second augmented reality device augmented reality device captures at least one second image to generate a second plane parameter; and (e) second augmented reality device The environment device generates a second updated plane parameter based on the second plane parameter, the first plane parameter, and the first object vector parameter, to replace the second plane parameter.

於一實施例中,至少一第一平面參數包括一第一平面以及一第一物件,第一物件置於第一平面上,其中第一物件向量參數包括一第一向量距離、一第二向量距離以及一第一夾角,其中第一向量距離係第一物件與第一擴增實境裝置之距離,第二向量距離係第二擴增實境裝置與第一擴增實境裝置之距離,第一夾角為第一向量距離與第二向量距離的夾角,其中第二更新平面參數包括一第二更新平面以及第一物件相對第二擴增實境裝置之相對位置。In an embodiment, at least one first plane parameter includes a first plane and a first object, the first object is placed on the first plane, wherein the first object vector parameter includes a first vector distance and a second vector Distance and a first angle, where the first vector distance is the distance between the first object and the first augmented reality device, and the second vector distance is the distance between the second augmented reality device and the first augmented reality device, The first included angle is the included angle between the first vector distance and the second vector distance, wherein the second update plane parameter includes a second update plane and the relative position of the first object relative to the second augmented reality device.

於一實施例中,至少一第一擴增實境裝置至少包括一第一影像擷取單元、一第一同步定位與地圖構建單元、一第一中央處理器單元以及一第一通訊單元,第一同步定位與地圖構建單元透過第一中央處理器單元連接至第一影像擷取單元與第一通訊單元,於步驟(b)中,第一影像擷取單元擷取至少一第一影像,傳送至第一同步定位與地圖構建單元,第一同步定位與地圖構建單元,依據至少一第一影像產生第一平面參數以及第一物件向量參數。In one embodiment, at least one first augmented reality device at least includes a first image capturing unit, a first synchronous positioning and map building unit, a first central processing unit and a first communication unit, the first A synchronous positioning and map building unit is connected to the first image capturing unit and the first communication unit through the first central processing unit. In step (b), the first image capturing unit captures at least one first image and transmits To the first synchronous positioning and map construction unit, the first synchronous positioning and map construction unit generates a first plane parameter and a first object vector parameter according to at least one first image.

於一實施例中,至少一第二擴增實境裝置至少包括一第二影像處理單元、一第二同步定位與地圖構建單元、一第二中央處理器單元以及一第二通訊單元,第二同步定位與地圖構建單元透過第二中央處理器單元連接至第二影像處理單元與第二通訊單元,於步驟(d)中,第二影像擷取單元擷取至少一第二影像,傳送至第二同步定位與地圖構建單元,第一同步定位與地圖構建單元,依據至少一第二影像產生第二平面參數。In one embodiment, at least one second augmented reality device at least includes a second image processing unit, a second synchronous positioning and map building unit, a second central processing unit and a second communication unit, the second The synchronous positioning and map building unit is connected to the second image processing unit and the second communication unit through the second central processing unit. In step (d), the second image capturing unit captures at least one second image and sends it to the first Two synchronous positioning and map building units, the first synchronous positioning and map building unit generate second plane parameters based on at least one second image.

於一實施例中,於步驟(e)第二同步定位與地圖構建單元依據第二平面參數、第一平面參數以及第一物件向量參數,至少一第二擴增實境裝置產生一第二更新平面參數,用以取代第二平面參數。In one embodiment, in step (e), the second simultaneous positioning and map building unit generates a second update based on the second plane parameter, the first plane parameter, and the first object vector parameter, at least a second augmented reality device The plane parameter is used to replace the second plane parameter.

於一實施例中,步驟(c)係透過第一通訊單元與第二通訊單元,傳送第一平面參數以及第一物件向量參數至至少一第二擴增實境裝置。In one embodiment, step (c) is to transmit the first plane parameter and the first object vector parameter to at least one second augmented reality device through the first communication unit and the second communication unit.

於一實施例中,步驟(a)更包括一步驟(a0)至少一擴增實境裝置之第一通訊單元係與至少一第二擴增實境裝置之第二通訊單元建立網路連接。In one embodiment, step (a) further includes a step (a0) at least one first communication unit of the augmented reality device establishes a network connection with at least one second communication unit of the second augmented reality device.

於一實施例中,第一影像擷取單元包括一第一影像處理單元以及一第一慣性量測模組,第一中央處理器單元連接至第一影像處理單元、第一同步定位與地圖構建單元、第一通訊單元以及第一慣性量測模組,其中第二影像擷取單元包括一第二影像處理單元以及一第二慣性量測模組,第二中央處理器單元連接至第二影像處理單元、第二同步定位與地圖構建單元、第二通訊單元以及第二慣性量測模組。In one embodiment, the first image capture unit includes a first image processing unit and a first inertial measurement module, the first central processing unit is connected to the first image processing unit, the first synchronous positioning and map construction Unit, first communication unit and first inertial measurement module, wherein the second image capture unit includes a second image processing unit and a second inertial measurement module, and the second central processing unit is connected to the second image A processing unit, a second synchronous positioning and map building unit, a second communication unit, and a second inertial measurement module.

於一實施例中,第一通訊單元與第二通訊單元係透過一無線直連協定、一藍芽通訊或一長期演進技術進行網路連接。。In one embodiment, the first communication unit and the second communication unit are connected via a wireless direct connection protocol, a Bluetooth communication, or a long-term evolution technology. .

於一實施例中,擴增實境定位分享之方法,更包括步驟:(f) 至少一第二擴增實境裝置依據第二更新平面參數產生一第二物件向量參數;(g) 傳送第二更新平面參數以及第二物件向量參數至至少一第一擴增實境裝置;以及(h) 至少一第一擴增實境裝置依據第二更新平面參數、第一平面參數以及第二物件向量參數,計算產生一第一更新平面參數,用以取代第一平面參數。In an embodiment, the method of augmented reality positioning and sharing further includes the steps of: (f) at least one second augmented reality device generates a second object vector parameter according to the second updated plane parameter; (g) transmits the first Two update plane parameters and second object vector parameters to at least one first augmented reality device; and (h) at least one first augmented reality device according to the second updated plane parameters, the first plane parameters and the second object vector Parameters, a first updated plane parameter is calculated to replace the first plane parameter.

於一實施例中,第二更新平面參數包括一第二平面以及一第二物件,第二物件置於第二平面上,其中第二物件向量參數包括一第三向量距離、一第四向量距離以及一第二夾角,其中第三向量距離係第二物件與第二擴增實境裝置之距離,第四向量距離係第二擴增實境裝置與第一擴增實境裝置之距離,第二夾角為第三向量距離與第四向量距離的夾角,其中第一更新平面參數包括一第一更新平面以及第二物件相對第一擴增實境裝置之相對位置。In one embodiment, the second update plane parameters include a second plane and a second object, and the second object is placed on the second plane, wherein the second object vector parameters include a third vector distance and a fourth vector distance And a second angle, where the third vector distance is the distance between the second object and the second augmented reality device, and the fourth vector distance is the distance between the second augmented reality device and the first augmented reality device, the first The second angle is the angle between the third vector distance and the fourth vector distance, wherein the first update plane parameter includes a first update plane and the relative position of the second object relative to the first augmented reality device.

為達前述目的,本案另提供一種擴增實境定位分享系統,包括至少一第一擴增實境裝置以及至少一第二擴增實境裝置。至少一第一擴增實境裝置,包括第一影像擷取單元、第一同步定位與地圖構建單元、第一中央處理器單元以及一第一通訊單元。第一影像擷取單元擷取至少一第一影像。第一同步定位與地圖構建單元透過第一中央處理器單元連接至第一影擷取單元,接收至少一第一影像,且依據至少一第一影像產生一第一平面參數以及一第一物件向量參數。第一通訊單元透過第一中央處理器單元連接至第一同步定位與地圖構建單元,傳送第一平面參數以及第一物件向量參數。至少一第二擴增實境裝置,包括第二影像擷取單元、第二同步定位與地圖構建單元、第二中央處理器單元以及第二通訊單元。第二影像擷取單元擷取至少一第二影像。第二同步定位與地圖構建單元,通過第二中央處理器單元連接至第二影像擷取單元,接收至少一第二影像,且依據至少一第二影像產生一第二平面參數。第二通訊單元通過第二中央處理器單元連接至第二同步定位與地圖構建單元,接收第一平面參數以及第一物件向量參數,且傳送至第二同步定位與地圖構建單元。其中第二同步定位與地圖構建單元依據第二平面參數、第一平面參數以及第一物件向量參數,計算產生一第二更新平面參數,用以取代第二平面參數。To achieve the foregoing objective, the present invention also provides an augmented reality positioning and sharing system, including at least one first augmented reality device and at least one second augmented reality device. At least one first augmented reality device includes a first image capturing unit, a first synchronous positioning and map building unit, a first central processing unit, and a first communication unit. The first image capturing unit captures at least one first image. The first synchronous positioning and map building unit is connected to the first image capturing unit through the first central processing unit, receives at least one first image, and generates a first plane parameter and a first object vector according to the at least one first image parameter. The first communication unit is connected to the first synchronous positioning and map building unit through the first central processor unit, and transmits the first plane parameter and the first object vector parameter. At least one second augmented reality device includes a second image capturing unit, a second synchronous positioning and map building unit, a second central processing unit, and a second communication unit. The second image capturing unit captures at least one second image. The second synchronous positioning and map building unit is connected to the second image capturing unit through the second central processing unit, receives at least one second image, and generates a second plane parameter according to the at least one second image. The second communication unit is connected to the second synchronous positioning and map building unit through the second central processor unit, receives the first plane parameters and the first object vector parameters, and transmits to the second synchronous positioning and map building unit. The second synchronous positioning and map construction unit calculates and generates a second updated plane parameter based on the second plane parameter, the first plane parameter, and the first object vector parameter, to replace the second plane parameter.

於一實施例中,至少一第一平面參數包括一第一平面以及一第一物件,物件置於第一平面上,其中第一物件向量參數包括一第一向量距離、一第二向量距離以及一第一夾角,其中第一向量距離係一物件與第一擴增實境裝置之距離,第二向量距離係第二擴增實境裝置與第一擴增實境裝置之距離,第一夾角為第一向量距離與第二向量距離的夾角,其中第二更新平面參數包括一第二更新平面以及第一物件相對第二擴增實境裝置之相對位置。In an embodiment, at least one first plane parameter includes a first plane and a first object, and the object is placed on the first plane, wherein the first object vector parameter includes a first vector distance, a second vector distance, and A first angle, where the first vector distance is the distance between an object and the first augmented reality device, the second vector distance is the distance between the second augmented reality device and the first augmented reality device, the first angle Is the angle between the first vector distance and the second vector distance, where the second update plane parameter includes a second update plane and the relative position of the first object relative to the second augmented reality device.

體現本案特徵與優點的一些典型實施例將在後段的說明中詳細敘述。應理解的是本案能夠在不同的態樣上具有各種的變化,其皆不脫離本案的範圍,且其中的說明及圖示在本質上係當作說明之用,而非用於限制本案。Some typical embodiments embodying the characteristics and advantages of this case will be described in detail in the description in the following paragraphs. It should be understood that this case can have various changes in different forms, and they do not deviate from the scope of this case, and the descriptions and illustrations therein are essentially used for explanation, not for limiting the case.

第1圖係揭示本案較佳實施例之擴增實境定位分享系統之結構方塊圖。為達到分享環境與物件的目的,使所有擴增實境裝置的使用者可以與共同之物件互動,本案擴增實境定位分享系統1,包括至少一第一擴增實境裝置10以及至少一第二擴增實境裝置20,第一擴增實境裝置10與第二擴增實境裝置20可例如具有相同之結構,但並不以此為限。於本實施例中,至少一第一擴增實境裝置10包括第一影像擷取單元11、第一同步定位與地圖構建單元(Simultaneous Localization And Mapping unit, SLAM Unit)16、第一中央處理器單元15、第一通訊單元17以及第一顯示單元18。第一影像擷取單元11例如包括第一影像擷取模組12、第一影像處理單元13,以組配擷取至少一第一影像i1(參見第3圖)。第一影像擷取模組12可例如是一RGB攝像器或Mono攝像器,擷取原始影像數據(Raw Data)後,再經第一影像處理單元13轉換為例如是RGB格式。於本實施例中,第一影像擷取單元11更包括一第一慣性量測模組(Inertial Measurement Unit,IMU)14,俾以提高第一影像擷取單元11擷取之第一影像i1之精確性,惟本案並不受限於此。第一同步定位與地圖構建單元16透過第一中央處理器單元15連接至第一影擷取單元11,接收至少一第一影像i1,且依據至少一第一影像i1產生一第一平面參數m1以及一第一物件向量參數v1(參見第3圖)。第一通訊單元17透過第一中央處理器單元15連接至第一同步定位與地圖構建單元16,傳送第一平面參數m1以及第一物件向量參數v1。第一顯示單元18例如是一微顯示器單元,連接至第一中央處理器單元15,組配受第一中央處理器單元15控制而產生虛擬圖像供使用者觀看。FIG. 1 is a block diagram showing the structure of an augmented reality positioning and sharing system according to a preferred embodiment of this case. In order to achieve the purpose of sharing environment and objects, so that users of all augmented reality devices can interact with common objects, the augmented reality positioning and sharing system 1 in this case includes at least one first augmented reality device 10 and at least one For the second augmented reality device 20, the first augmented reality device 10 and the second augmented reality device 20 may have the same structure, but not limited thereto. In this embodiment, at least one first augmented reality device 10 includes a first image capturing unit 11, a first simultaneous localization and mapping unit (SLAM Unit) 16, and a first central processing unit Unit 15, first communication unit 17, and first display unit 18. The first image capturing unit 11 includes, for example, a first image capturing module 12 and a first image processing unit 13 to capture at least one first image i1 in combination (see FIG. 3 ). The first image capturing module 12 may be, for example, an RGB camera or a Mono camera. After capturing the raw image data (Raw Data), the first image processing unit 13 converts it into, for example, an RGB format. In this embodiment, the first image capturing unit 11 further includes a first inertial measurement unit (IMU) 14 to improve the first image i1 captured by the first image capturing unit 11 Accuracy, but this case is not limited to this. The first synchronous positioning and map building unit 16 is connected to the first image capturing unit 11 through the first central processing unit 15, receives at least one first image i1, and generates a first plane parameter m1 according to the at least one first image i1 And a first object vector parameter v1 (see Figure 3). The first communication unit 17 is connected to the first synchronous positioning and map building unit 16 through the first central processor unit 15 and transmits the first plane parameter m1 and the first object vector parameter v1. The first display unit 18 is, for example, a micro-display unit connected to the first central processor unit 15, and the assembly is controlled by the first central processor unit 15 to generate virtual images for the user to view.

另外,於擴增實境定位分享系統1中,至少一第二擴增實境裝置20包括第二影像擷取單元21、第二同步定位與地圖構建單元26、第二中央處理器單元25、第二通訊單元27以及第二顯示單元28。第二影像擷取單元21例如包括第二影像擷取模組22、第二影像處理單元23,以組配擷取至少一第二影像i2(參考第3圖)。第二影像擷取模組22可例如是一RGB攝像器或Mono攝像器,擷取原始影像數據(Raw Data)後,再經第二影像處理單元23轉換為例如是RGB格式。於本實施例中,第二影像擷取單元21更包括一第二慣性量測模組(Inertial Measurement Unit,IMU)24,俾以提高第二影像擷取單元21擷取之第一影像i2之精確性,惟本案並不受限於此。第二同步定位與地圖構建單元26通過第二中央處理器單元25連接至第二影像擷取單元21,接收至少一第二影像i2(參見第3圖),且依據至少一第二影像i2產生一第二平面參數m2。第二通訊單元27通過第二中央處理器單元25連接至第二同步定位與地圖構建單元26,接收第一平面參數m1以及第一物件向量參數v1,且傳送至第二同步定位與地圖構建單元26。其中第二同步定位與地圖構建單元26依據第二平面參數m2、第一平面參數m1以及第一物件向量參數v1,計算產生一第二更新平面參數m2’,用以取代第二平面參數m2。第二顯示單元28例如是一微顯示器單元,連接至第二中央處理器單元25,組配受第二中央處理器單元25控制而產生虛擬圖像供使用者觀看。In addition, in the augmented reality positioning and sharing system 1, at least one second augmented reality device 20 includes a second image capturing unit 21, a second synchronized positioning and map building unit 26, a second central processing unit 25, The second communication unit 27 and the second display unit 28. The second image capturing unit 21 includes, for example, a second image capturing module 22 and a second image processing unit 23 to capture at least one second image i2 in combination (refer to FIG. 3 ). The second image capturing module 22 may be, for example, an RGB camera or a Mono camera. After capturing the raw image data (Raw Data), the second image processing unit 23 converts it into an RGB format, for example. In this embodiment, the second image capturing unit 21 further includes a second inertial measurement unit (IMU) 24 to improve the first image i2 captured by the second image capturing unit 21 Accuracy, but this case is not limited to this. The second synchronous positioning and map building unit 26 is connected to the second image capturing unit 21 through the second central processing unit 25, receives at least one second image i2 (see FIG. 3), and generates based on at least one second image i2 A second plane parameter m2. The second communication unit 27 is connected to the second synchronous positioning and map building unit 26 through the second central processing unit 25, receives the first plane parameter m1 and the first object vector parameter v1, and transmits it to the second synchronous positioning and map building unit 26. The second synchronous positioning and map construction unit 26 calculates and generates a second updated plane parameter m2' based on the second plane parameter m2, the first plane parameter m1 and the first object vector parameter v1, to replace the second plane parameter m2. The second display unit 28 is, for example, a microdisplay unit connected to the second central processor unit 25, and the assembly is controlled by the second central processor unit 25 to generate virtual images for the user to view.

另一方面,依據前述擴增實境定位分享系統1,本案同時提供一種擴增實境定位分享之方法。第2圖係揭示本案佳實施例之擴增實境定位分享之方法流程圖。第3圖係揭示本案較佳實施例之擴增實境定位分享系統之第一示範性作動示意圖。第4圖係揭示本案較佳實施例之擴增實境定位分享系統中之第一擴增實境裝置、第二擴增實境裝置與第一物件之位置關係示意圖。第5圖係揭示本案較佳實施例之擴增實境定位分享系統中之第一擴增實境裝置、第二擴增實境裝置與第一物件之另一位置關係示意圖。參考第1圖至第5圖。首先,於擴增實境定位分享系統1中提供至少一第一擴增實境裝置10以及至少一第二擴增實境裝置20,以進行環境與物件的定位分享,如步驟S1所示。其中至少一第一擴增實境裝置10以及至少一第二擴增實境裝置20之結構如前所述,可例如具有相同的結構及構成組件,但本案並不以此為限。於本實施例中,至少一第一擴增實境裝置10以及至少一第二擴增實境裝置20執行環境與物件之定位分享前,擴增實境定位分享系統1中的至少一第一擴增實境裝置10之第一通訊單元17與至少一第二擴增實境裝置20之第二通訊單元27建立網路連接。於本實施例中,第一通訊單元17與第二通訊單元27可例如透過一無線直連協定、一藍芽通訊或一長期演進技術進行網路連接,本案並不以此為限。On the other hand, according to the aforementioned augmented reality positioning and sharing system 1, the present case also provides a method for augmented reality positioning and sharing. FIG. 2 is a flowchart showing a method for augmented reality positioning and sharing according to a preferred embodiment of the present case. FIG. 3 is a schematic diagram illustrating the first exemplary operation of the augmented reality positioning and sharing system of the preferred embodiment of the present case. FIG. 4 is a schematic diagram showing the positional relationship between the first augmented reality device, the second augmented reality device and the first object in the augmented reality location sharing system of the preferred embodiment of the present invention. FIG. 5 is a schematic diagram showing another positional relationship between the first augmented reality device, the second augmented reality device and the first object in the augmented reality positioning sharing system of the preferred embodiment of the present invention. Refer to Figures 1 to 5. First, at least one first augmented reality device 10 and at least one second augmented reality device 20 are provided in the augmented reality location sharing system 1 to perform location sharing of the environment and objects, as shown in step S1. The structures of at least one first augmented reality device 10 and at least one second augmented reality device 20 are as described above, and may have the same structure and components, for example, but this case is not limited to this. In this embodiment, before at least one first augmented reality device 10 and at least one second augmented reality device 20 perform positioning and sharing of environment and objects, at least one first in the augmented reality positioning and sharing system 1 The first communication unit 17 of the augmented reality device 10 establishes a network connection with the second communication unit 27 of at least one second augmented reality device 20. In this embodiment, the first communication unit 17 and the second communication unit 27 can be connected to the network through, for example, a wireless direct connection protocol, a Bluetooth communication, or a long-term evolution technology, which is not limited in this case.

接著,如步驟S2所示,透過至少一第一擴增實境裝置10的影像擷取單元11擷取至少一第一影像i1,至少一第一影像i1由第一中央處理器單元15傳送至第一同步定位與地圖構建單元16,第一同步定位與地圖構建單元16並依據至少一第一影像i1產生至少一第一平面參數m1以及至少一第一物件向量參數v1。於本實施例中,第一平面參數m1即可通過第一顯示單元18產生虛擬圖像供使用者觀看,可例如包括一第一平面M1以及一第一物件9,第一物件9置於第一平面M1上。第一物件向量參數v1包括一第一向量距離Q、一第二向量距離P以及一第一夾角β。其中第一向量距離Q係第一物件9與第一擴增實境裝置10之距離,第二向量距離P係第二擴增實境裝置20與第一擴增實境裝置10之距離,第一夾角β為第一向量距離Q與第二向量距離P的夾角,如第4圖所示。Next, as shown in step S2, at least one first image i1 is captured by the image capturing unit 11 of the at least one first augmented reality device 10, and the at least one first image i1 is transmitted from the first central processing unit 15 to The first synchronized positioning and map construction unit 16 generates the at least one first plane parameter m1 and at least one first object vector parameter v1 according to at least one first image i1. In this embodiment, the first plane parameter m1 can generate a virtual image for viewing by the first display unit 18, for example, it can include a first plane M1 and a first object 9, the first object 9 is placed in the first On a plane M1. The first object vector parameter v1 includes a first vector distance Q, a second vector distance P, and a first angle β. The first vector distance Q is the distance between the first object 9 and the first augmented reality device 10, and the second vector distance P is the distance between the second augmented reality device 20 and the first augmented reality device 10. An angle β is the angle between the first vector distance Q and the second vector distance P, as shown in FIG. 4.

爾後,如步驟S3所示,透過第一擴增實境裝置10的第一通訊單元17與第二擴增實境裝置20的第二通訊單元27,將第一平面參數m1以及第一物件向量參數v1傳送至第二擴增實境裝置20的第二同步定位與地圖構建單元26。Then, as shown in step S3, through the first communication unit 17 of the first augmented reality device 10 and the second communication unit 27 of the second augmented reality device 20, the first plane parameter m1 and the first object vector The parameter v1 is transmitted to the second synchronized positioning and map building unit 26 of the second augmented reality device 20.

另一方面,如步驟S4所示,透過至少一第二擴增實境裝置20的影像擷取單元21擷取至少一第二影像i2,至少一第二影像i2由第二中央處理器單元25傳送至第二同步定位與地圖構建單元26,第二同步定位與地圖構建單元26可依據至少一第二影像i2產生至少一第二平面參數m2。第二平面參數m2雖可通過第二顯示單元28產生虛擬圖像供使用者觀看,惟尚未與第一擴增實境裝置10之第一顯示單元18所產生的虛擬圖像達成同步化。On the other hand, as shown in step S4, at least one second image i2 is captured by the image capturing unit 21 of at least one second augmented reality device 20, and at least one second image i2 is captured by the second central processing unit 25 It is sent to the second synchronous positioning and map building unit 26. The second synchronous positioning and map building unit 26 can generate at least one second plane parameter m2 according to at least one second image i2. Although the second plane parameter m2 can be generated by the second display unit 28 for the user to view, it has not yet been synchronized with the virtual image generated by the first display unit 18 of the first augmented reality device 10.

最後,如步驟S5所示,第二同步定位與地圖構建單元26進一步依據第二平面參數m2與來自第一擴增實境裝置10的第一平面參數m1以及第一物件向量參數v1,計算產生一第二更新平面參數m2’,用以取代該第二平面參數m2。其中第二更新平面參數m2’即包括一第二更新平面M2以及第一物件9相對該第二擴增實境裝置20之相對位置,如第5圖所示,即第二擴增實境裝置20與第一物件9之間的向量距離R、第一向量距離Q與向量距離R之夾角α,以及第二向量距離P與向量距離R之夾角γ,均包含於第二更新平面參數m2中。此時,第一擴增實境裝置10的使用者由第一擴增實境裝置10之第一顯示單元18所觀看到第一物件9、第一擴增實境裝置10與第二擴增實境裝置20之相對位置關係,相同於第二擴增實境裝置20的使用者由第二擴增實境裝置20之第二顯示單元28所觀看到第一物件9、第一擴增實境裝置10與第二擴增實境裝置20之相對位置關係。藉此,擴增實境定位分享系統1即可同步化第一擴增實境裝置10與第二擴增實境裝置20的平面與物件,以達到分享環境與物件的目的,使第一擴增實境裝置10與第二擴增實境裝置20的使用者均可以與共同之第一物件9進行互動,進而達成例如虛擬象棋、虛擬足球或者文物欣賞等共享相同平面與虛擬物件的應用。Finally, as shown in step S5, the second synchronous positioning and map construction unit 26 further calculates and generates according to the second plane parameter m2 and the first plane parameter m1 from the first augmented reality device 10 and the first object vector parameter v1 A second updated plane parameter m2' is used to replace the second plane parameter m2. The second update plane parameter m2′ includes a second update plane M2 and the relative position of the first object 9 with respect to the second augmented reality device 20, as shown in FIG. 5, which is the second augmented reality device The vector distance R between 20 and the first object 9, the angle α between the first vector distance Q and the vector distance R, and the angle γ between the second vector distance P and the vector distance R are all included in the second update plane parameter m2 . At this time, the user of the first augmented reality device 10 views the first object 9, the first augmented reality device 10, and the second augmented reality as viewed by the first display unit 18 of the first augmented reality device 10 The relative positional relationship of the reality device 20 is the same as that the user of the second augmented reality device 20 views the first object 9 and the first augmented reality from the second display unit 28 of the second augmented reality device 20 The relative positional relationship between the environment device 10 and the second augmented reality device 20. In this way, the augmented reality positioning and sharing system 1 can synchronize the planes and objects of the first augmented reality device 10 and the second augmented reality device 20 to achieve the purpose of sharing the environment and objects, so that the first expansion The users of the augmented reality device 10 and the second augmented reality device 20 can interact with the common first object 9 to achieve applications such as virtual chess, virtual football, or cultural relic appreciation that share the same plane and virtual objects.

另一方面,需說明的是,前述第一示範例中,第一物件9與第一擴增實境裝置10以及第二擴增實境裝置20的相對位置及關係由第一擴增實境裝置10分享至第二擴增實境裝置20僅屬例示,非限制環境與物件定位分享之方向或從屬關係。於其他實施例中,包含相同之環境與物件定位分享之方向或從屬關係亦可由第二擴增實境裝置20分享至第一擴增實境裝置10。請再參考第6圖至第8圖。第6圖係揭示本案較佳實施例之擴增實境定位分享系統之第二示範性作動示意圖。第7圖係揭示本案較佳實施例之擴增實境定位分享系統中之第一擴增實境裝置、第二擴增實境裝置與第二物件之位置關係示意圖。第8圖係揭示本案較佳實施例之擴增實境定位分享系統中之第一擴增實境裝置、第二擴增實境裝置與第二物件之另一位置關係示意圖。若以第二擴增實境裝置20欲分享一第二物件9’至第一擴增實境裝置10為例,第二擴增實境裝置20的第二同步定位與地圖構建單元26可依據第二更新平面參數m2’產生一第二物件向量參數v2。其中第二更新平面參數m2’包含第二平面M2’以及一第二物件9’,第二物件9’置於第二平面M2’上。另外,第二物件向量參數v2包括一第三向量距離R’、一第四向量距離P’以及一第二夾角γ’,其中第三向量距離R’係第二物件9’與第二擴增實境裝置20之距離,第四向量距離P’係第二擴增實境裝置20與第一擴增實境裝置10之距離,第二夾角γ’為第三向量距離R’與第四向量距離P’的夾角,如第7圖所示。On the other hand, it should be noted that in the foregoing first example, the relative position and relationship between the first object 9 and the first augmented reality device 10 and the second augmented reality device 20 are determined by the first augmented reality The sharing of the device 10 to the second augmented reality device 20 is only an example, and the direction or affiliation of the location and sharing of the environment and objects is not limited. In other embodiments, the direction or subordinate relationship including the same environment and object positioning sharing can also be shared by the second augmented reality device 20 to the first augmented reality device 10. Please refer to Figure 6 to Figure 8 again. FIG. 6 is a schematic diagram illustrating a second exemplary operation of the augmented reality location sharing system of the preferred embodiment of the present case. FIG. 7 is a schematic diagram showing the positional relationship between the first augmented reality device, the second augmented reality device and the second object in the augmented reality positioning sharing system of the preferred embodiment of the present invention. FIG. 8 is a schematic diagram showing another positional relationship between the first augmented reality device, the second augmented reality device and the second object in the augmented reality positioning sharing system of the preferred embodiment of the present invention. If the second augmented reality device 20 wants to share a second object 9 ′ to the first augmented reality device 10 as an example, the second synchronized positioning and map construction unit 26 of the second augmented reality device 20 may be based on The second updated plane parameter m2' generates a second object vector parameter v2. The second updated plane parameter m2' includes the second plane M2' and a second object 9', and the second object 9'is placed on the second plane M2'. In addition, the second object vector parameter v2 includes a third vector distance R', a fourth vector distance P'and a second included angle γ', wherein the third vector distance R'is the second object 9'and the second amplification The distance of the reality device 20, the fourth vector distance P'is the distance between the second augmented reality device 20 and the first augmented reality device 10, and the second included angle γ'is the third vector distance R'and the fourth vector The angle of distance P'is shown in Figure 7.

接著,透過第二擴增實境裝置20的第二通訊單元27與第一擴增實境裝置10的第一通訊單元17,將第二更新平面參數m2’以及第二物件向量參數v2傳送至第一擴增實境裝置10的第一同步定位與地圖構建單元16。最後,第一擴增實境裝置10依據第二更新平面參數m2’、第一平面參數m1以及第二物件向量參數v2,即可計算產生一第一更新平面參數m1’,用以取代該第一平面參數m1。其中第一更新平面參數m1’包括一第一更新平面M1’以及第二物件9’相對第一擴增實境裝置10之相對位置,如第8圖所示,即第一擴增實境裝置10與第二物件9’之間的向量距離Q’、第三向量距離R’與向量距離Q’之夾角α’,以及第四向量距離P’與向量距離R’之夾角γ,均包含於第一更新平面參數m1’中。此時,第一擴增實境裝置10的使用者由第一擴增實境裝置10之第一顯示單元18所觀看到第二物件9’、第一擴增實境裝置10與第二擴增實境裝置20之相對位置關係,相同於第二擴增實境裝置20的使用者由第二擴增實境裝置20之第二顯示單元28所觀看到第二物件9’、第一擴增實境裝置10與第二擴增實境裝置20之相對位置關係。藉此,擴增實境定位分享系統1即可同步化第一擴增實境裝置10與第二擴增實境裝置20的平面與物件,以達到分享環境與物件的目的,使第一擴增實境裝置10與第二擴增實境裝置20的使用者均可以與共同之第二物件9’進行互動,進而達成例如虛擬象棋、虛擬足球或者文物欣賞等共享相同平面與虛擬物件的應用。Next, the second updated plane parameter m2' and the second object vector parameter v2 are transmitted to the second communication unit 27 of the second augmented reality device 20 and the first communication unit 17 of the first augmented reality device 10 to The first synchronized positioning and map building unit 16 of the first augmented reality device 10. Finally, according to the second updated plane parameter m2', the first plane parameter m1 and the second object vector parameter v2, the first augmented reality device 10 can calculate and generate a first updated plane parameter m1' to replace the first A plane parameter m1. The first update plane parameter m1′ includes a first update plane M1′ and the relative position of the second object 9′ relative to the first augmented reality device 10, as shown in FIG. 8, which is the first augmented reality device The vector distance Q′ between 10 and the second object 9′, the angle α′ between the third vector distance R′ and the vector distance Q′, and the angle γ between the fourth vector distance P′ and the vector distance R′ are included in In the first update plane parameter m1'. At this time, the user of the first augmented reality device 10 views the second object 9 ′, the first augmented reality device 10 and the second augmented reality through the first display unit 18 of the first augmented reality device 10 The relative positional relationship of the augmented reality device 20 is the same as that of the user of the second augmented reality device 20 viewed by the second display unit 28 of the second augmented reality device 20. The relative positional relationship between the augmented reality device 10 and the second augmented reality device 20. In this way, the augmented reality positioning and sharing system 1 can synchronize the planes and objects of the first augmented reality device 10 and the second augmented reality device 20 to achieve the purpose of sharing the environment and objects, so that the first expansion The users of the augmented reality device 10 and the second augmented reality device 20 can interact with the common second object 9', thereby achieving applications such as virtual chess, virtual football, or cultural relic appreciation that share the same plane and virtual objects .

當然,前述第一擴增實境裝置10與第二擴增實境裝置20之環境與物件之定件分享,並不僅限於單方向進行。換言之,第一擴增實境裝置10與第二擴增實境裝置20之間,第一物件9與第二物件9’之定件分享亦可同時進行。於眾多物件需進行定位分享的狀況下,可分別透過第一擴增實境裝置10與第二擴增實境裝置20進行定位分享,例如虛擬象棋的兩方的棋子分別透過第一擴增實境裝置10與第二擴增實境裝置20進行定位分享,以避免眾多物件之定位計算流程造成第一擴增實境裝置10的第一中央處理器單元15或第二擴增實境裝置20的第二中央處理器單元25單方過重負荷,當然本案並不受限於此,且不再贅述。Of course, the sharing of the environment and objects of the first augmented reality device 10 and the second augmented reality device 20 is not limited to one-way. In other words, between the first augmented reality device 10 and the second augmented reality device 20, the sharing of the first object 9 and the second object 9'can also be performed simultaneously. In a situation where many objects need to be positioned and shared, the first augmented reality device 10 and the second augmented reality device 20 can be used to perform location sharing, for example, the two pieces of virtual chess are respectively through the first augmented reality The local device 10 and the second augmented reality device 20 perform location sharing to avoid the positioning calculation process of many objects causing the first central processing unit 15 or the second augmented reality device 20 of the first augmented reality device 10 The second central processor unit 25 is overloaded unilaterally. Of course, this case is not limited to this, and will not be described in detail.

綜上所述,本案提供一種擴增實境之環境與物件之定位分享系統及其方法,透過擴增實境裝置以及例如無線直連協定、藍芽通訊或長期演進之無線傳輸技術,同步化所有擴增實境裝置的平面與物件,以達到分享環境與物件的目的,使所有擴增實境裝置的使用者可以與共同之物件互動,俾利於擴增實境裝置達成例如虛擬象棋、虛擬足球或者文物欣賞等共享相同平面與虛擬物件的應用。In summary, this case provides an augmented reality environment and object positioning sharing system and method, which are synchronized through augmented reality devices and wireless transmission technologies such as wireless direct connection protocol, Bluetooth communication or long-term evolution The planes and objects of all augmented reality devices, to achieve the purpose of sharing the environment and objects, so that the users of all augmented reality devices can interact with the common objects, so as to facilitate the augmented reality devices to achieve, for example, virtual chess, virtual Football or cultural relics appreciation applications that share the same plane and virtual objects.

本案得由熟習此技術之人士任施匠思而為諸般修飾,然皆不脫如附申請專利範圍所欲保護者。This case may be modified by any person familiar with the technology as a craftsman, but none of them may be as protected as the scope of the patent application.

1:擴增實境定位分享系統1: Augmented reality positioning and sharing system

10:第一擴增實境裝置10: The first augmented reality device

11:第一影像擷取單元11: The first image capture unit

12:第一影像擷取模組12: The first image capture module

13:第一影像處理單元13: The first image processing unit

14:第一慣性量測模組14: The first inertial measurement module

15:第一中央處理器單元15: The first central processing unit

16:第一同步定位與地圖構建單元16: The first synchronous positioning and map building unit

17:第一通訊單元17: The first communication unit

18:第一顯示單元18: The first display unit

20:第二擴增實境裝置20: Second augmented reality device

21:第二影像擷取單元21: Second image capture unit

22:第二影像擷取模組22: Second image capture module

23:第二影像處理單元23: Second image processing unit

24:第二慣性量測模組24: Second inertial measurement module

25:第二中央處理器單元25: second central processing unit

26:第二同步定位與地圖構建單元26: Second synchronous positioning and map building unit

27:第二通訊單元27: Second communication unit

28:第二顯示單元28: Second display unit

9:第一物件9: The first object

9’:第二物件9’: Second object

i1:第一影像i1: the first image

i2:第二影像i2: second image

m1:第一平面參數m1: first plane parameter

m2:第二平面參數m2: second plane parameter

m1’:第一更新平面參數m1’: first update plane parameters

m2’:第二更新平面參數m2’: Second update plane parameters

v1:第一物件向量參數v1: first object vector parameter

v2:第二物件向量參數v2: second object vector parameter

M1:第一平面M1: first plane

M2:第二更新平面M2: second update plane

M1’:第一更新平面M1’: First update plane

M2’:第二平面M2’: Second plane

Q:第一向量距離Q: First vector distance

P:第二向量距離P: second vector distance

R’:第三向量距離R’: third vector distance

P’:第四向量距離P’: Fourth vector distance

R、Q’:向量距離R, Q’: vector distance

α、γ、α'、β':夾角α, γ, α', β': included angle

β:第一夾角β: the first angle

γ':第二夾角γ': Second angle

S1~S5:步驟S1~S5: Step

第1圖係揭示本案較佳實施例之擴增實境定位分享系統之結構方塊圖。FIG. 1 is a block diagram showing the structure of an augmented reality positioning and sharing system according to a preferred embodiment of this case.

第2圖係揭示本案佳實施例之擴增實境定位分享之方法流程圖。FIG. 2 is a flowchart showing a method for augmented reality positioning and sharing according to a preferred embodiment of the present case.

第3圖係揭示本案較佳實施例之擴增實境定位分享系統之第一示範性作動示意圖。FIG. 3 is a schematic diagram illustrating the first exemplary operation of the augmented reality positioning and sharing system of the preferred embodiment of the present case.

第4圖係揭示本案較佳實施例之擴增實境定位分享系統中之第一擴增實境裝置、第二擴增實境裝置與第一物件之位置關係示意圖。FIG. 4 is a schematic diagram showing the positional relationship between the first augmented reality device, the second augmented reality device and the first object in the augmented reality location sharing system of the preferred embodiment of the present invention.

第5圖係揭示本案較佳實施例之擴增實境定位分享系統中之第一擴增實境裝置、第二擴增實境裝置與第一物件之另一位置關係示意圖。FIG. 5 is a schematic diagram showing another positional relationship between the first augmented reality device, the second augmented reality device and the first object in the augmented reality positioning sharing system of the preferred embodiment of the present invention.

第6圖係揭示本案較佳實施例之擴增實境定位分享系統之第二示範性作動示意圖。FIG. 6 is a schematic diagram illustrating a second exemplary operation of the augmented reality location sharing system of the preferred embodiment of the present case.

第7圖係揭示本案較佳實施例之擴增實境定位分享系統中之第一擴增實境裝置、第二擴增實境裝置與第二物件之位置關係示意圖。FIG. 7 is a schematic diagram showing the positional relationship between the first augmented reality device, the second augmented reality device and the second object in the augmented reality positioning sharing system of the preferred embodiment of the present invention.

第8圖係揭示本案較佳實施例之擴增實境定位分享系統中之第一擴增實境裝置、第二擴增實境裝置與第二物件之另一位置關係示意圖。FIG. 8 is a schematic diagram showing another positional relationship between the first augmented reality device, the second augmented reality device and the second object in the augmented reality positioning sharing system of the preferred embodiment of the present invention.

S1~S5:步驟 S1~S5: Step

Claims (11)

一種擴增實境定位分享之方法,包括步驟:(a)提供至少一第一擴增實境裝置與至少一第二擴增實境裝置;(b)透過該至少一第一擴增實境裝置擷取至少一第一影像,並依據該至少一第一影像產生一第一平面參數以及一第一物件向量參數,其中該第一平面參數包括一第一平面以及一第一物件,該第一物件置於該第一平面上,其中該第一物件向量參數包括一第一向量距離、一第二向量距離以及一第一夾角,其中該第一向量距離係該第一物件與該第一擴增實境裝置之距離,該第二向量距離係該第二擴增實境裝置與該第一擴增實境裝置之距離,該第一夾角為該第一向量距離與該第二向量距離的夾角;(c)傳送該第一平面參數以及該第一物件向量參數至該至少一第二擴增實境裝置;(d)該第二擴增實境裝置擷取至少一第二影像,產生一第二平面參數;以及(c)該第二擴增實境裝置依據該第二平面參數、該第一平面參數以及該第一物件向量參數,計算產生一第二更新平面參數,用以取代該第二平面參數,其中該第二更新平面參數包括一第二更新平面以及該第一物件相對該第二擴增實境裝置之相對位置。 A method for positioning and sharing augmented reality, including the steps of: (a) providing at least one first augmented reality device and at least one second augmented reality device; (b) through the at least one first augmented reality The device captures at least one first image and generates a first plane parameter and a first object vector parameter according to the at least one first image, wherein the first plane parameter includes a first plane and a first object, the first An object is placed on the first plane, wherein the first object vector parameter includes a first vector distance, a second vector distance, and a first included angle, wherein the first vector distance is the first object and the first The distance of the augmented reality device, the second vector distance is the distance between the second augmented reality device and the first augmented reality device, the first angle is the distance between the first vector distance and the second vector distance Angle; (c) transmitting the first plane parameter and the first object vector parameter to the at least one second augmented reality device; (d) the second augmented reality device capturing at least one second image, Generating a second plane parameter; and (c) the second augmented reality device calculates and generates a second updated plane parameter based on the second plane parameter, the first plane parameter and the first object vector parameter, for Instead of the second plane parameter, the second update plane parameter includes a second update plane and the relative position of the first object relative to the second augmented reality device. 如申請專利範圍第1項所述之擴增實境定位分享之方法,其中該至少一第一擴增實境裝置至少包括一第一影像擷取單元、一第一同步定位與地圖構建單元、一第一中央處理器單元以及一第一通訊單元,該第一同步定位與地圖構建單元透過該第一中央處理器單元連接至該第一影像擷取單元與該第一通訊單元,於該步驟(b)中,該第一影像擷取單元擷取該至少一第一影像,傳送至該第一同步定位與地圖構建單元,該第一同步定位與地圖構建單元依據該至少一第一影像產生該第一平面參數以及該第一物件向量參數。 The method of augmented reality positioning and sharing as described in item 1 of the patent scope, wherein the at least one first augmented reality device at least includes a first image capturing unit, a first synchronized positioning and map building unit, A first central processing unit and a first communication unit, the first synchronous positioning and map building unit is connected to the first image capturing unit and the first communication unit through the first central processing unit, at this step In (b), the first image capturing unit captures the at least one first image and transmits it to the first synchronized positioning and map building unit, the first synchronized positioning and map building unit generates according to the at least one first image The first plane parameter and the first object vector parameter. 如申請專利範圍第2項所述之擴增實境定位分享之方法,其中該至少一第二擴增實境裝置至少包括一第二影像處理單元、一第二同步定位與地圖構建單元、一第二中央處理器單元以及一第二通訊單元,該第二同步定位與地圖構建單元透過該第二中央處理器單元連接至該第二影像處理單元與該第二通訊單元,於該步驟(d)中,該第二影像擷取單元擷取該至少一第二影像,傳送至該第二同步定位與地圖構建單元,該第一同步定位與地圖構建單元,依據該至少一第二影像產生該第二平面參數。 The augmented reality positioning and sharing method as described in item 2 of the patent scope, wherein the at least one second augmented reality device at least includes a second image processing unit, a second synchronized positioning and map construction unit, a A second central processing unit and a second communication unit, the second synchronous positioning and map building unit is connected to the second image processing unit and the second communication unit through the second central processing unit, in the step (d ), the second image capturing unit captures the at least one second image and sends it to the second synchronous positioning and map building unit. The first synchronous positioning and map building unit generates the second image based on the at least one second image Second plane parameters. 如申請專利範圍第3項所述之擴增實境定位分享之方法,其中於該步驟(e)該第二同步定位與地圖構建單元依據該第二平面參數、該第一平面參數以及該第一物件向量參數,該至少一第二擴增實境裝置產生一第二更新平面參數,用以取代該第二平面參數。 The augmented reality positioning sharing method as described in item 3 of the patent application scope, wherein in the step (e) the second simultaneous positioning and map building unit is based on the second plane parameter, the first plane parameter and the first An object vector parameter, the at least one second augmented reality device generates a second updated plane parameter to replace the second plane parameter. 如申請專利範圍第3項所述之擴增實境定位分享之方法,其中該步驟(c)係透過該第一通訊單元與該第二通訊單元,傳送該第一平面參數以及該第一物件向量參數至該至少一第二擴增實境裝置。 The augmented reality positioning and sharing method as described in item 3 of the patent scope, wherein the step (c) is to transmit the first plane parameter and the first object through the first communication unit and the second communication unit Vector parameters to the at least one second augmented reality device. 如申請專利範圍第5項所述之擴增實境定位分享之方法,其中該步驟(a)更包括一步驟(a0)該至少一擴增實境裝置之該第一通訊單元係與該至少一第二擴增實境裝置之該第二通訊單元建立網路連接。 The method for positioning and sharing augmented reality as described in item 5 of the patent scope, wherein the step (a) further includes a step (a0) of the first communication unit of the at least one augmented reality device and the at least one The second communication unit of a second augmented reality device establishes a network connection. 如申請專利範圍第5項所述之擴增實境定位分享之方法,其中該第一影像擷取單元包括一第一影像處理單元以及一第一慣性量測模組,該第一中央處理器單元連接至該第一影像處理單元、該第一同步定位與地圖構建單元、該第一通訊單元以及該第一慣性量測模組,其中該第二影像擷取單元包括一第二影像處理單元以及一第二慣性量測模組,該第二中央處理器單元連接至該第二影像處理單元、該第二同步定位與地圖構建單元、該第二通訊單元以及該第二慣性量測模組。 The augmented reality positioning and sharing method as described in item 5 of the patent scope, wherein the first image capturing unit includes a first image processing unit and a first inertial measurement module, and the first central processor The unit is connected to the first image processing unit, the first synchronous positioning and map building unit, the first communication unit and the first inertial measurement module, wherein the second image capturing unit includes a second image processing unit And a second inertial measurement module, the second central processing unit is connected to the second image processing unit, the second synchronous positioning and map building unit, the second communication unit and the second inertial measurement module . 如申請專利範圍第6項所述之擴增實境定位分享之方法,其中該第一通訊單元與第二通訊單元係透過一無線直連協定、一藍芽通訊或一長期演進技術進行網路連接。 The augmented reality positioning and sharing method as described in item 6 of the patent application scope, wherein the first communication unit and the second communication unit are networked through a wireless direct connection protocol, a Bluetooth communication, or a long-term evolution technology connection. 如申請專利範圍第1項所述之擴增實境定位分享之方法,更包括步驟:(f)該至少一第二擴增實境裝置依據該第二更新平面參數產生一第二物件向量參數;(g)傳送該第二更新平面參數以及該第二物件向量參數至該至少一第一擴增實境裝置;以及(h)該至少一第一擴增實境裝置依據該第二更新平面參數、該第一平面參數以及該第二物件向量參數計算產生一第一更新平面參數,用以取代該第一平面參數。 The method for positioning and sharing augmented reality as described in item 1 of the scope of patent application further includes the steps of: (f) the at least one second augmented reality device generates a second object vector parameter according to the second updated plane parameter (G) sending the second update plane parameter and the second object vector parameter to the at least one first augmented reality device; and (h) the at least one first augmented reality device based on the second update plane The parameters, the first plane parameter and the second object vector parameter are calculated to generate a first updated plane parameter to replace the first plane parameter. 如申請專利範圍第9項所述之擴增實境定位分享之方法,其中該第二更新平面參數包括一第二平面以及一第二物件,該第二物件置於該第二平面上,其中該第二物件向量參數包括一第三向量距離、一第四向量距離以及一第二夾角,其中該第三向量距離係該第二物件與該第二擴增實境裝置之距離,該第四向量距離係該第二擴增實境裝置與該第一擴增實境裝置之距離,該第二夾角為該第三向量距離與該第四向量距離的夾角,其中該第一更新平面參數包括一第一更新平面以及該第二物件相對該第一擴增實境裝置之相對位置。 The augmented reality location sharing method as described in item 9 of the patent application scope, wherein the second updated plane parameter includes a second plane and a second object, the second object is placed on the second plane, wherein The second object vector parameter includes a third vector distance, a fourth vector distance and a second included angle, wherein the third vector distance is the distance between the second object and the second augmented reality device, the fourth The vector distance is the distance between the second augmented reality device and the first augmented reality device, the second included angle is the included angle between the third vector distance and the fourth vector distance, wherein the first updated plane parameter includes A first update plane and the relative position of the second object relative to the first augmented reality device. 一種擴增實境定位分享系統,包括:至少一第一擴增實境裝置,包括:一第一中央處理器單元;一第一影像擷取單元,擷取至少一第一影像; 一第一同步定位與地圖構建單元,透過該第一中央處理器單元連接至該第一影像擷取單元,接收該至少一第一影像,且依據該至少一第一影像產生一第一平面參數以及一第一物件向量參數;以及一第一通訊單元,透過該第一中央處理器單元連接至該第一同步定位與地圖構建單元,傳送該第一平面參數以及該第一物件向量參數;以及至少一第二擴增實境裝置,包括:一第二中央處理器單元;一第二影像擷取單元,擷取至少一第二影像;一第二同步定位與地圖構建單元,透過該第二中央處理器單元連接至該第二影像擷取單元,接收該至少一第二影像,且依據該至少一第二影像產生一第二平面參數,其中該至少一第一平面參數包括一第一平面以及一第一物件,該物件置於該第一平面上,其中該第一物件向量參數包括一第一向量距離、一第二向量距離以及一第一夾角,其中該第一向量距離係一物件與該第一擴增實境裝置之距離,該第二向量距離係該第二擴增實境裝置與該第一擴增實境裝置之距離,該第一夾角為該第一向量距離與該第二向量距離的夾角;以及一第二通訊單元,透過該第二中央處理器單元連接至該第二同步定位與地圖構建單元,接收該第一平面參數以及該第一物件向量參數,且傳送至該第二同步定位與地圖構建單元,其中該第二同步定位與地圖構建單元依據該第二平面參數、該第一平面參數以及該第一物件向量參數,計算產生一第二更新平面參數,用以取代該第二平面參數,其中該第二更新平面參數包括一第二更新平面以及該第一物件相對該第二擴增實境裝置之相對位置。An augmented reality positioning and sharing system includes: at least one first augmented reality device, including: a first central processing unit; a first image capturing unit, capturing at least a first image; A first synchronous positioning and map building unit is connected to the first image capturing unit through the first central processing unit, receives the at least one first image, and generates a first plane parameter according to the at least one first image And a first object vector parameter; and a first communication unit connected to the first synchronous positioning and map building unit through the first central processing unit to transmit the first plane parameter and the first object vector parameter; and At least one second augmented reality device, including: a second central processing unit; a second image capturing unit, capturing at least a second image; and a second synchronous positioning and map building unit, through the second The central processing unit is connected to the second image capturing unit, receives the at least one second image, and generates a second plane parameter according to the at least one second image, wherein the at least one first plane parameter includes a first plane And a first object placed on the first plane, wherein the first object vector parameters include a first vector distance, a second vector distance, and a first angle, wherein the first vector distance is an object The distance from the first augmented reality device, the second vector distance is the distance between the second augmented reality device and the first augmented reality device, and the first included angle is the first vector distance and the An angle between the second vector distance; and a second communication unit connected to the second synchronous positioning and map building unit through the second central processing unit, receiving the first plane parameter and the first object vector parameter, and transmitting To the second synchronous positioning and map building unit, wherein the second synchronous positioning and map building unit calculates and generates a second updated plane parameter based on the second plane parameter, the first plane parameter, and the first object vector parameter, It is used to replace the second plane parameter, wherein the second update plane parameter includes a second update plane and the relative position of the first object relative to the second augmented reality device.
TW107147410A 2018-12-27 2018-12-27 Augmented reality positioning sharing system and method using same TWI694353B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW107147410A TWI694353B (en) 2018-12-27 2018-12-27 Augmented reality positioning sharing system and method using same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW107147410A TWI694353B (en) 2018-12-27 2018-12-27 Augmented reality positioning sharing system and method using same

Publications (2)

Publication Number Publication Date
TWI694353B true TWI694353B (en) 2020-05-21
TW202024865A TW202024865A (en) 2020-07-01

Family

ID=71896199

Family Applications (1)

Application Number Title Priority Date Filing Date
TW107147410A TWI694353B (en) 2018-12-27 2018-12-27 Augmented reality positioning sharing system and method using same

Country Status (1)

Country Link
TW (1) TWI694353B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI278772B (en) * 2005-02-23 2007-04-11 Nat Applied Res Lab Nat Ce Augmented reality system and method with mobile and interactive function for multiple users
CN106873768A (en) * 2016-12-30 2017-06-20 中兴通讯股份有限公司 A kind of augmented reality method, apparatus and system
US20180308287A1 (en) * 2015-10-16 2018-10-25 Bent Image Lab, Llc Augmented reality platform

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI278772B (en) * 2005-02-23 2007-04-11 Nat Applied Res Lab Nat Ce Augmented reality system and method with mobile and interactive function for multiple users
US20180308287A1 (en) * 2015-10-16 2018-10-25 Bent Image Lab, Llc Augmented reality platform
CN106873768A (en) * 2016-12-30 2017-06-20 中兴通讯股份有限公司 A kind of augmented reality method, apparatus and system

Also Published As

Publication number Publication date
TW202024865A (en) 2020-07-01

Similar Documents

Publication Publication Date Title
KR102375307B1 (en) Method, apparatus, and system for sharing virtual reality viewport
EP2613296A1 (en) Mixed reality display system, image providing server, display apparatus, and display program
RU2534951C2 (en) Device, method and system for sharing of plotted image at multiple workplaces, programme and recordable media
JP6896688B2 (en) Position calculation device, position calculation program, position calculation method, and content addition system
TW201429242A (en) System and method for determining individualized depth information in augmented reality scene
US20220067974A1 (en) Cloud-Based Camera Calibration
US20220284620A1 (en) Information terminal apparatus and position recognition sharing method
KR101769118B1 (en) Device and system for synthesizing tele-presence video and device for filming remote area
US20220301270A1 (en) Systems and methods for immersive and collaborative video surveillance
KR100545048B1 (en) System for drawing blind area in aerial photograph and method thereof
JP2020065229A (en) Video communication method, video communication device, and video communication program
US20140168375A1 (en) Image conversion device, camera, video system, image conversion method and recording medium recording a program
US20220272164A1 (en) Experience sharing system and experience sharing method
TWI694353B (en) Augmented reality positioning sharing system and method using same
KR102588858B1 (en) System for displaying 3d tour comparison
KR101473984B1 (en) System for collecting field information using mobile device
US20170332014A1 (en) Method for transforming wide-angle image to map projection image and perspective projection image
JP2005142765A (en) Apparatus and method for imaging
JP5864371B2 (en) Still image automatic generation system, worker information processing terminal, instructor information processing terminal, and determination device in still image automatic generation system
CN104410670A (en) Auxiliary communication method capable of sharing self screen general situation and mouse position on real time interaction communication platform
JP2023121636A (en) Information processing system, communication system, image sharing method, and program
US20200045234A1 (en) Image display method, image display system and virtual window
CN115053262A (en) Space recognition system, space recognition method, information terminal, and server device
JP2019140530A (en) Server device, display device, video display system, and video display method
EP4033755A1 (en) System for broadcasting volumetric videoconferences in 3d animated virtual environment with audio information, and method for operating said system

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees