TWI585617B - Interaction method and system thereof - Google Patents

Interaction method and system thereof Download PDF

Info

Publication number
TWI585617B
TWI585617B TW105128153A TW105128153A TWI585617B TW I585617 B TWI585617 B TW I585617B TW 105128153 A TW105128153 A TW 105128153A TW 105128153 A TW105128153 A TW 105128153A TW I585617 B TWI585617 B TW I585617B
Authority
TW
Taiwan
Prior art keywords
electronic device
image data
user
virtual object
augmented reality
Prior art date
Application number
TW105128153A
Other languages
Chinese (zh)
Other versions
TW201812530A (en
Inventor
李鐘彬
Original Assignee
宅妝股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 宅妝股份有限公司 filed Critical 宅妝股份有限公司
Priority to TW105128153A priority Critical patent/TWI585617B/en
Priority to CN201610809899.0A priority patent/CN107783648B/en
Application granted granted Critical
Publication of TWI585617B publication Critical patent/TWI585617B/en
Publication of TW201812530A publication Critical patent/TW201812530A/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/20Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20Indexing scheme for editing of 3D models
    • G06T2219/2016Rotation, translation, scaling

Description

互動方法及系統 Interactive method and system

本發明是有關於一種互動方法及系統,且特別是一種可用於讓多個使用者在一虛擬實境(Virtual Reality,VR)影像資料及一擴增實境(Augmented Reality,AR)影像資料間進行互動的互動方法及系統。 The present invention relates to an interactive method and system, and particularly to a plurality of users that can be used between a virtual reality (VR) image material and an augmented reality (AR) image data. Interactive methods and systems for interaction.

一般來說,設計師在幫消費者進行室內裝潢的傢俱佈置時,往往會是透過簡單的靜態圖像或模型來向消費者進行擺設建議,又或者是更直接地帶著實體商品,以親臨至室內現場來進行擺設。但對於消費者而言,如果設計師是透過靜態圖像或模型來進行擺設建議的話,消費者往往則是必需透過想像的方式,以決定是否合適自己的喜好,且容易只有設計師的片面之詞,而未能夠使得消費者具有良好的體驗效果。 Generally speaking, when designers are decorating furniture for interior decoration, they tend to make recommendations to consumers through simple static images or models, or they can bring physical goods more directly to the interior. On-site to display. But for consumers, if designers use static images or models to make suggestions, consumers often have to imagine how to suit their preferences, and it is easy to have only one-sided designer. Words, but not able to make consumers have a good experience.

然而,在另外一種情況下,當設計師則是直接地帶著實體商品,以親臨至室內現場來進行擺設時,缺點就是當實體商品到達家中時,若感到不合適,包括尺寸不對、實際材質與照片差異甚大,又或者是擺設後與家中的環境空間不適合等,則會遇到退貨不便、運費損失,或甚至是害設計師白跑一趟的問題,這些因素皆有可能地浪費掉設計師及消費者的時間與金錢。有鑑於此,如何改善設計師及消費者在進行傢俱佈置時的互動,並且有效避免浪費到設計師或消費者的時間與金錢,確為所屬領域亟需解決之 問題。 However, in another case, when the designer directly carries the physical goods and presents them to the indoor scene, the disadvantage is that when the physical goods arrive at home, if they feel inappropriate, including the wrong size, the actual material and The photos are very different, or they are not suitable for the environment in the home after installation. They will encounter inconveniences in returning the goods, loss of shipping costs, or even a problem that the designer runs away. These factors are likely to waste the designer. And the time and money of the consumer. In view of this, how to improve the interaction between designers and consumers in the layout of furniture, and effectively avoid the waste of time and money of designers or consumers, it is urgent to solve the problem in its field. problem.

本發明實施例提供一種互動方法,用於讓多個使用者在一虛擬實境影像資料及一擴增實境影像資料間進行互動。所述互動方法的步驟如下。首先,至少一第一使用者操作第一電子裝置,並據以使得第一電子裝置獲取得到關聯於一第二使用者目前所在的實際環境空間的一影像資料。其次,根據一商品資料庫,第一使用者用以自此商品資料庫中選取出至少一第一虛擬物件,並且將此第一虛擬物件載入放置於影像資料中的第一預設位置,以藉此使得第一電子裝置生成出第一控制指令,其中第一控制指令包含具有此第一虛擬物件的尺寸參數,以及此第一虛擬物件所被放置於影像資料中的座標參數。接著,第二使用者操作一第二電子裝置,並據以使得第二電子裝置用以根據所接收到的第一控制指令,以及第二使用者目前所在的實際環境空間,來建構出結合含有此第一虛擬物件的擴增實境影像資料,並且第二電子裝置則會再根據第二使用者所操作第二電子裝置時的觀影位置與觀影角度,以及第一控制指令中的尺寸參數與座標參數,來確立出此第一虛擬物件及擴增實境影像資料所被結合呈現於第二電子裝置上的一顯示螢幕時的相對位置關係。 The embodiment of the invention provides an interaction method for allowing multiple users to interact between a virtual reality image data and an augmented reality image data. The steps of the interactive method are as follows. First, at least one first user operates the first electronic device, and accordingly, the first electronic device acquires an image data associated with the actual environmental space in which the second user is currently located. Secondly, according to a product database, the first user selects at least one first virtual object from the product database, and loads the first virtual object into a first preset position placed in the image data. Thereby, the first electronic device is configured to generate a first control instruction, wherein the first control instruction includes a size parameter having the first virtual object, and a coordinate parameter of the first virtual object being placed in the image data. Then, the second user operates a second electronic device, and accordingly, the second electronic device is configured to construct a combined content according to the received first control instruction and the actual environmental space in which the second user is currently located. Amplifying the real-time image data of the first virtual object, and the second electronic device is further configured according to the viewing position and the viewing angle when the second user operates the second electronic device, and the size in the first control instruction The parameter and the coordinate parameter are used to establish a relative positional relationship when the first virtual object and the augmented reality image data are combined and displayed on a display screen of the second electronic device.

優選的,第一電子裝置所獲取得到的影像資料,即表示為關聯於第二使用者目前所在的實際環境空間的虛擬實境影像資料,並且第一與第二電子裝置用以透過至少一通訊協定來達到彼此間的相互通信。 Preferably, the image data acquired by the first electronic device is represented as virtual reality image data associated with the actual environmental space in which the second user is currently located, and the first and second electronic devices are configured to transmit at least one communication. Agreements to achieve mutual communication with each other.

本發明實施例另提供一種互動系統,用於讓多個使用者在一虛擬實境影像資料及一擴增實境影像資料間進行互動。所述互動系統包括商品資料庫、第一電子裝置以及第二電子裝置。其中,第一電子裝置供至少一第一使用者所操作,且第一電子裝置用以獲 取得到關聯於一第二使用者目前所在的實際環境空間的一影像資料,並據以使得第一使用者用以自商品資料庫中選取出至少一第一虛擬物件,且將此第一虛擬物件載入放置於影像資料中的第一預設位置,以藉此使得第一電子裝置生成出第一控制指令,其中第一控制指令包含具有此第一虛擬物件的尺寸參數,以及此第一虛擬物件所被放置於影像資料中的座標參數。另外,第二電子裝置則供第二使用者所操作,且第二電子裝置用以根據所接收到的第一控制指令,以及第二使用者目前所在的實際環境空間,來建構出結合含有此第一虛擬物件的擴增實境影像資料,並且第二電子裝置則會再根據第二使用者所操作第二電子裝置時的觀影位置與觀影角度,以及第一控制指令中的尺寸參數與座標參數,來確立出此第一虛擬物件及擴增實境影像資料所被結合呈現於第二電子裝置上的一顯示螢幕時的相對位置關係。 An embodiment of the present invention further provides an interactive system for allowing a plurality of users to interact between a virtual reality image data and an augmented reality image data. The interactive system includes a product database, a first electronic device, and a second electronic device. The first electronic device is operated by at least one first user, and the first electronic device is used to obtain Obtaining an image data associated with a real environment space in which the second user is currently located, and thereby causing the first user to select at least one first virtual object from the product database, and using the first virtual object Loading the object at a first preset position in the image data, thereby causing the first electronic device to generate a first control instruction, wherein the first control instruction includes a size parameter having the first virtual object, and the first The coordinate parameter that the virtual object is placed in the image data. In addition, the second electronic device is operated by the second user, and the second electronic device is configured to construct a combination according to the received first control instruction and the actual environmental space in which the second user is currently located. Amplifying the real image data of the first virtual object, and the second electronic device is further configured according to the viewing position and the viewing angle of the second electronic device when the second user operates, and the size parameter in the first control instruction And a coordinate parameter to establish a relative positional relationship when the first virtual object and the augmented reality image data are combined and displayed on a display screen of the second electronic device.

優選的,第一電子裝置所獲取得到的影像資料,即表示為關聯於第二使用者目前所在的實際環境空間的虛擬實境影像資料,並且第一與第二電子裝置用以透過至少一通訊協定來達到彼此間的相互通信。 Preferably, the image data acquired by the first electronic device is represented as virtual reality image data associated with the actual environmental space in which the second user is currently located, and the first and second electronic devices are configured to transmit at least one communication. Agreements to achieve mutual communication with each other.

綜上所述,本發明實施例所提供的互動方法及系統,將完全不同於現有習知技藝的應用方式,而是提供了一種可用於讓多個使用者在一虛擬實境影像資料及一擴增實境影像資料間進行互動的互動方法及系統,故本發明實施例的互動方法及系統,將可以使得設計師能夠不用受限於使用環境上的區域性限制,並且使得消費者更能夠直觀地體驗到虛擬商品的特色,以藉此進而提供出良好的互動效果。 In summary, the interaction method and system provided by the embodiments of the present invention will be completely different from the prior art application methods, but provide a virtual reality image data and a plurality of users. An interactive method and system for augmenting the interaction between the real-world image data, so that the interactive method and system of the embodiment of the present invention can enable the designer to be free from regional restrictions on the use environment and enable the consumer to Visually experience the characteristics of virtual goods to provide a good interactive effect.

為使能更進一步瞭解本發明之特徵及技術內容,請參閱以下有關本發明之詳細說明與附圖,但是此等說明與所附圖式僅係用來說明本發明,而非對本發明的權利範圍作任何的限制。 The detailed description of the present invention and the accompanying drawings are to be understood by the claims The scope is subject to any restrictions.

10‧‧‧互動系統 10‧‧‧Interactive system

101‧‧‧商品資料庫 101‧‧‧Commodity database

103‧‧‧第一電子裝置 103‧‧‧First electronic device

105‧‧‧第二電子裝置 105‧‧‧Second electronic device

103a‧‧‧第一使用者 103a‧‧‧ first user

105a‧‧‧第二使用者 105a‧‧‧Second user

110‧‧‧實際環境空間 110‧‧‧ Actual environmental space

110a‧‧‧影像資料 110a‧‧‧Image data

110b‧‧‧擴增實境影像資料 110b‧‧‧Augmented Reality Imagery

120‧‧‧第一虛擬物件 120‧‧‧First virtual object

TS1、TS1’‧‧‧第一控制指令 TS1, TS1'‧‧‧ first control instruction

TS2‧‧‧第二控制指令 TS2‧‧‧Second Control Directive

DS1‧‧‧第一刪除指令 DS1‧‧‧First Deletion Directive

DS2‧‧‧第二刪除指令 DS2‧‧‧Second Delete Order

S201~S207、S301~S305、S501~S503、S701~S705、S901~S903‧‧‧流程步驟 S201~S207, S301~S305, S501~S503, S701~S705, S901~S903‧‧‧ Process steps

圖1是本發明實施例所提供的互動系統之應用示意圖。 FIG. 1 is a schematic diagram of an application of an interactive system according to an embodiment of the present invention.

圖2是本發明實施例所提供的互動方法之流程示意圖。 2 is a schematic flow chart of an interaction method provided by an embodiment of the present invention.

圖3是本發明另一實施例所提供的互動方法之流程示意圖。 FIG. 3 is a schematic flow chart of an interaction method according to another embodiment of the present invention.

圖4是本發明另一實施例所提供的互動系統之應用示意圖。 4 is a schematic diagram of an application of an interactive system according to another embodiment of the present invention.

圖5是本發明另一實施例所提供的互動方法之流程示意圖。 FIG. 5 is a schematic flow chart of an interaction method according to another embodiment of the present invention.

圖6是本發明另一實施例所提供的互動系統之應用示意圖。 FIG. 6 is a schematic diagram of an application of an interactive system according to another embodiment of the present invention.

圖7是本發明另一實施例所提供的互動方法之流程示意圖。 FIG. 7 is a schematic flow chart of an interaction method according to another embodiment of the present invention.

圖8是本發明另一實施例所提供的互動系統之應用示意圖。 FIG. 8 is a schematic diagram of an application of an interactive system according to another embodiment of the present invention.

圖9是本發明另一實施例所提供的互動方法之流程示意圖。 FIG. 9 is a schematic flow chart of an interaction method according to another embodiment of the present invention.

圖10是本發明另一實施例所提供的互動系統之應用示意圖。 FIG. 10 is a schematic diagram of an application of an interactive system according to another embodiment of the present invention.

在下文中,將藉由圖式說明本發明之各種實施例來詳細描述本發明。然而,本發明概念可能以許多不同形式來體現,且不應解釋為限於本文中所闡述之例示性實施例。此外,在圖式中相同參考數字可用以表示類似的元件。 In the following, the invention will be described in detail by way of illustration of various embodiments of the invention. However, the inventive concept may be embodied in many different forms and should not be construed as being limited to the illustrative embodiments set forth herein. In addition, the same reference numerals may be used in the drawings to represent similar elements.

首先,請參閱圖1,圖1是本發明實施例所提供的互動系統之應用示意圖。互動系統10主要包括商品資料庫101、第一電子裝置103以及第二電子裝置105。其中,第一電子裝置103可以是供至少一第一使用者103a所操作,而第二電子裝置105則可以是供一第二使用者105a所操作。因此,實務上,第一使用者103a即可例如為一設計師,而第二使用者105a則可例如為一消費者。然而,值得一提的是,為了方便以下說明,本發明實施例的第一使用者103a則是採用數量僅為1的例子來進行說明,但其並非用以限制本發明。 First, please refer to FIG. 1. FIG. 1 is a schematic diagram of an application of an interactive system according to an embodiment of the present invention. The interactive system 10 mainly includes a product database 101, a first electronic device 103, and a second electronic device 105. The first electronic device 103 can be operated by at least one first user 103a, and the second electronic device 105 can be operated by a second user 105a. Therefore, in practice, the first user 103a can be, for example, a designer, and the second user 105a can be, for example, a consumer. However, it is worth mentioning that, in order to facilitate the following description, the first user 103a of the embodiment of the present invention is described by using an example of only one, but it is not intended to limit the present invention.

另外,如同前面內容所述,當在第一使用者103a(亦即,設計師)則是直接地帶著實體商品,以親臨至第二使用者105a(亦即, 消費者)的家中來進行擺設的情況下,若是擺設後的實體商品與第二使用者105a的家中環境並不感到合適時,往往則是會浪費到第一使用者103a或第二使用者105a的時間與金錢。因此,相較於習知技藝,本發明實施例的第一使用者103a則是不需要帶著實體商品,以親臨至第二使用者105a的家中來進行擺設。換言之,第一使用者103a及第二使用者105a所分別操作第一電子裝置103及第二電子裝置105的使用環境,則可以是完全並不相同的兩個地方。 In addition, as described in the foregoing, when the first user 103a (ie, the designer) is directly carrying the physical item, to come to the second user 105a (ie, In the case where the consumer is placed in the home, if the physical product after the placement and the home environment of the second user 105a are not suitable, it is often wasted to the first user 103a or the second user 105a. Time and money. Therefore, compared with the prior art, the first user 103a of the embodiment of the present invention does not need to bring a physical commodity to visit the home of the second user 105a. In other words, the operating environments in which the first user 103a and the second user 105a operate the first electronic device 103 and the second electronic device 105 respectively may be two completely different places.

舉例來說,第一使用者103a可例如在為一設計師事務所中,操作著第一電子裝置103以透過一虛擬實境影像資料來向第二使用者105a(亦即,消費者)進行擺設建議。同理,第二使用者105a則可例如在為其自身的家中,操作著第二電子裝置105以透過一擴增實境影像資料來觀賞到第一使用者103a(亦即,設計師)所提供的擺設建議。因此,根據以上內容之教示,本技術領域中具有通常知識者應可理解到,本發明的主要精神之一便是在於,用於讓多個使用者在一虛擬實境影像資料及一擴增實境影像資料間進行互動,以藉此達到克服使用環境上的區域性限制。其中,值得一提的是,在實務上,第一電子裝置103乃可例如為一行動通訊裝置、一桌上型電腦、一筆記型電腦、一平板電腦,或甚至是一頭戴式顯示器等,而第二電子裝置105則可例如為一頭戴式顯示器,但本發明皆並不以此為限制。 For example, the first user 103a can operate the first electronic device 103 to display the second user 105a (ie, the consumer) through a virtual reality image data, for example, in a designer office. Suggest. Similarly, the second user 105a can, for example, operate the second electronic device 105 in its own home to view the first user 103a (ie, the designer) through an augmented reality image data. Suggestions provided. Therefore, in light of the above teachings, one of ordinary skill in the art should understand that one of the main spirits of the present invention is to enable multiple users to visualize and reconstruct a virtual reality image. Interact with real-world imagery to overcome regional constraints in the use environment. It should be noted that, in practice, the first electronic device 103 can be, for example, a mobile communication device, a desktop computer, a notebook computer, a tablet computer, or even a head mounted display. The second electronic device 105 can be, for example, a head mounted display, but the invention is not limited thereto.

另外,應當理解的是,第一電子裝置103及第二電子裝置105還可以是分別地透過各自所擁有的至少一通訊協定介面(未繪示)來連線至一網際網路(未繪示)。因此,第一電子裝置103與第二電子裝置105則會是用以透過此至少一通訊協定來達到彼此間的相互通信。除此之外,商品資料庫101可以是同時地內建於第一電子裝置103與/或第二電子裝置105之中,又或者是,商品資料庫101可同樣地用以透過此至少一通訊協定來與第一電子裝置 103與/或第二電子裝置105進行數據的傳輸。總而言之,本發明實施例亦不限制有關商品資料庫101、第一電子裝置103或第二電子裝置105的具體實現方式。 In addition, it should be understood that the first electronic device 103 and the second electronic device 105 may also be connected to an internet network through at least one communication protocol interface (not shown) respectively owned by the respective devices (not shown). ). Therefore, the first electronic device 103 and the second electronic device 105 are configured to communicate with each other through the at least one communication protocol. In addition, the product database 101 may be built in the first electronic device 103 and/or the second electronic device 105 at the same time, or the product database 101 may be used to transmit the at least one communication. Agreement with the first electronic device 103 and/or second electronic device 105 performs data transmission. In general, the embodiment of the present invention does not limit the specific implementation manner of the product database 101, the first electronic device 103, or the second electronic device 105.

更詳細來說,第一電子裝置103用以獲取得到關聯於第二使用者105a目前所在的實際環境空間110的一影像資料110a,並據以使得第一使用者103a用以自商品資料庫101中選取出至少一第一虛擬物件120,並且將此第一虛擬物件120載入放置於影像資料110a中的一第一預設位置,以藉此使得第一電子裝置130生成出一第一控制指令TS1。其中第一控制指令TS1包含具有此第一虛擬物件120的尺寸參數,以及此第一虛擬物件120所被放置於影像資料110a中的座標參數。 In more detail, the first electronic device 103 is configured to obtain an image data 110a associated with the actual environment space 110 in which the second user 105a is currently located, and accordingly, the first user 103a is used to access the product database 101. Selecting at least one first virtual object 120, and loading the first virtual object 120 into a first preset position placed in the image data 110a, thereby causing the first electronic device 130 to generate a first control Command TS1. The first control command TS1 includes a size parameter having the first virtual object 120, and a coordinate parameter of the first virtual object 120 placed in the image data 110a.

接著,第二電子裝置105則用以根據所接收到的第一控制指令TS1,以及第二使用者105a目前所在的實際環境空間110,來建構出結合含有第一虛擬物件120的擴增實境影像資料110b。然而,值得一提的是,由於擴增實境技術的主要目的,便是在於把一虛擬商品(亦即,第一虛擬物件120)套用在一現實世界中以進行互動。因此,第二電子裝置105(亦即,頭戴式顯示器)將不僅可以在其顯示螢幕中,顯示出含有此虛擬商品的影像畫面外,還可以再根據使用者的操作而即時運算第二電子裝置105的位置及角度,以相對改變此影像畫面的呈現內容。 Next, the second electronic device 105 is configured to construct an augmented reality combined with the first virtual object 120 according to the received first control command TS1 and the actual environment space 110 where the second user 105a is currently located. Image data 110b. However, it is worth mentioning that the main purpose of augmented reality technology is to apply a virtual item (i.e., the first virtual object 120) to a real world for interaction. Therefore, the second electronic device 105 (that is, the head mounted display) can display not only the image frame containing the virtual product in the display screen but also the second electronic device according to the user's operation. The position and angle of the device 105 to relatively change the presentation content of the image frame.

因此,根據以上內容之教示,本技術領域中具有通常知識者應可理解到,當在第二電子裝置105已經建構出含有第一虛擬物件120的擴增實境影像資料110b的情況下,第二電子裝置105則會再根據第二使用者105a所操作第二電子裝置105時的觀影位置與觀影角度,以及第一控制指令TS1中的尺寸參數與座標參數,來確立出此第一虛擬物件120及擴增實境影像資料110b所被結合呈現於第二電子裝置105上的一顯示螢幕時的相對位置關係。舉例來說,如圖1所示,當在第二使用者105a的觀影位置則是越來越 靠近此第一虛擬物件120的情況下,第二電子裝置105則應該會是根據即時運算後的結果,來相對改變擴增實境影像資料110b的呈現內容(例如,使得該呈現內容中的此第一虛擬物件120所佔之大小比例也就越多)。然而,由於擴增實境技術及其頭戴式顯示器(亦即,第二電子裝置105)的運作原理,皆為本技術領域中具有通常知識者所習知,因此有關於其細部內容於此便不再多加贅述。 Therefore, in accordance with the teachings of the foregoing, it will be understood by those of ordinary skill in the art that, when the second electronic device 105 has constructed the augmented reality image data 110b containing the first virtual object 120, The second electronic device 105 then establishes the first according to the viewing position and the viewing angle when the second user 105a operates the second electronic device 105, and the size parameter and the coordinate parameter in the first control command TS1. The virtual object 120 and the augmented reality image data 110b are combined to present a relative positional relationship when the screen is displayed on the second electronic device 105. For example, as shown in FIG. 1, when the viewing position of the second user 105a is more and more In the case of the first virtual object 120, the second electronic device 105 should relatively change the presentation content of the augmented reality image data 110b according to the result of the instant operation (for example, such that the content in the presentation content The first virtual object 120 occupies a larger proportion of the size). However, since the augmented reality technology and the operation principle of the head mounted display (i.e., the second electronic device 105) are well known to those of ordinary skill in the art, the details thereof are here. I will not repeat them.

於是,顯然地,本發明的主要精神之一亦在於,使得設計師(亦即,第一使用者103a)將可以直接地利用一虛擬實境技術來向消費者(亦即,第二使用者105a)進行至少一虛擬商品的擺設建議,而消費者則會相對地改利用一擴增實境技術來瀏覽到此虛擬物件所陳列於真實環境中的影像畫面,並且於真實環境中所選擇的位置與角度來觀看擺放感覺,以便進而清楚理解到此虛擬商品是否合適自己的喜好。如此一來,將可使得設計師(亦即,第一使用者103a)能夠不用受限於使用環境上的區域性限制,並且使得消費者(亦即,第二使用者105a)更能夠直觀地體驗到此虛擬商品的特色,以藉此提供出良好的互動效果。 Thus, it is apparent that one of the main spirits of the present invention is that the designer (i.e., the first user 103a) will be able to directly utilize a virtual reality technique to the consumer (i.e., the second user 105a). Advising at least one virtual product, and the consumer relatively uses an augmented reality technology to browse the image of the virtual object displayed in the real environment and select the location in the real environment. Look at the placement with the angle to understand clearly whether this virtual item is suitable for your preferences. In this way, the designer (ie, the first user 103a) can be made free from regional restrictions on the usage environment, and the consumer (ie, the second user 105a) can be more intuitively intuitive. Experience the features of this virtual item to provide a good interaction.

另外,如同前面內容所述,第一電子裝置103也可例如為一頭戴式顯示器。因此,在本實施例中,當第一使用者103a已經將此第一虛擬物件120載入放置於影像資料110a時,第一電子裝置103也可以是提供出以一虛擬實境模式來進行結合含有此第一虛擬物件120的影像資料110a的瀏覽。然而,由於虛擬實境模式的技術原理為本技術領域中具有通常知識者所習知,因此有關於其細部內容於此就不再多加贅述。於是,應當理解的是,第一電子裝置103所獲取得到的影像資料110a,即可表示為關聯於第二使用者105a目前所在的實際環境空間110的一虛擬影像資料。值得一提的是,在實務上,此虛擬影像資料的內容可例如為一3D虛擬互動場景或一可互動模型等。總而言之,本發明實施例亦不限制有關 此虛擬影像資料的具體實現方式。 Additionally, as described above, the first electronic device 103 can also be, for example, a head mounted display. Therefore, in the embodiment, when the first user 103a has loaded the first virtual object 120 into the image data 110a, the first electronic device 103 may also provide a virtual reality mode to combine. The browsing of the image material 110a containing the first virtual object 120. However, since the technical principle of the virtual reality mode is well known to those of ordinary skill in the art, the details thereof will not be further described herein. Therefore, it should be understood that the image data 110a obtained by the first electronic device 103 can be represented as a virtual image data associated with the actual environmental space 110 in which the second user 105a is currently located. It is worth mentioning that, in practice, the content of the virtual image material can be, for example, a 3D virtual interactive scene or an interactive model. In summary, the embodiments of the present invention also do not limit the related The specific implementation of this virtual image data.

接著,以下為了更進一步說明關於互動系統10的運作流程,本發明進一步提供其互動方法的一種實施方式。請參閱圖2,圖2是本發明實施例所提供的互動方法之流程示意圖。本例所述的方法可以在圖1所示的互動系統10中執行,因此請一併照圖1以利理解。另外,詳細步驟流程如前述實施例所述,故於此僅作概述而不再多加冗述。 Next, in order to further explain the operational flow of the interactive system 10, the present invention further provides an embodiment of the interactive method thereof. Please refer to FIG. 2. FIG. 2 is a schematic flowchart of an interaction method according to an embodiment of the present invention. The method described in this example can be performed in the interactive system 10 shown in FIG. 1, so please understand it in conjunction with FIG. In addition, the detailed steps are as described in the foregoing embodiments, and thus are merely summarized herein and are not redundantly described.

首先,在步驟S201中,至少一第一使用者操作第一電子裝置,並據以使得第一電子裝置獲取得到關聯於第二使用者目前所在的實際環境空間的一影像資料。其次,在步驟S203中,根據商品資料庫,第一使用者用以自商品資料庫中選取出至少一第一虛擬物件,並且將此第一虛擬物件載入放置於影像資料中的一第一預設位置,以藉此使得第一電子裝置生成出一第一控制指令。其中,第一控制指令包含具有此第一虛擬物件的一尺寸參數,以及此第一虛擬物件所被放置於影像資料中的一座標參數。 First, in step S201, at least one first user operates the first electronic device, and accordingly, the first electronic device acquires an image data associated with the actual environmental space in which the second user is currently located. Next, in step S203, according to the product database, the first user selects at least one first virtual object from the product database, and loads the first virtual object into a first one placed in the image data. Presetting the position to thereby cause the first electronic device to generate a first control command. The first control instruction includes a size parameter having the first virtual object, and a target parameter of the first virtual object placed in the image data.

接著,在步驟S205中,第二使用者操作第二電子裝置,並據以使得第二電子裝置用以根據所接收到的第一控制指令,以及第二使用者目前所在的實際環境空間,來建構出結合含有此第一虛擬物件的擴增實境影像資料。最後,在步驟S207中,第二電子裝置則會再根據第二使用者所操作第二電子裝置時的觀影位置與觀影角度,以及第一控制指令中的尺寸參數與座標參數,來確立出此第一虛擬物件及擴增實境影像資料所被結合呈現於第二電子裝置上的一顯示螢幕時的相對位置關係。 Next, in step S205, the second user operates the second electronic device, and accordingly, the second electronic device is configured to use the first control instruction received, and the actual environmental space in which the second user is currently located. Augmented reality image data combined with the first virtual object is constructed. Finally, in step S207, the second electronic device is further established according to the viewing position and the viewing angle when the second user operates the second electronic device, and the size parameter and the coordinate parameter in the first control command. The first virtual object and the augmented reality image data are combined in a relative positional relationship when displayed on the second electronic device.

另外一方面,下述將以多個實施例配合圖式說明介紹本發明實施例所提供的互動方法及系統的其他幾種應用。然而,應當理解的是,本發明概念可能以許多不同形式來體現,且不應解釋限於本文中所闡述之實施例。 On the other hand, the following describes the interaction method and other applications of the system provided by the embodiments of the present invention in conjunction with the following description. However, it should be understood that the concept of the invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein.

請同時參閱圖3至圖4,圖3及圖4係將用以來解釋本發明實 施例的互動方法及系統的其他一種應用。其中,圖3是本發明另一實施例所提供的互動方法之流程示意圖,圖4是本發明另一實施例所提供的互動系統之應用示意圖。值得注意的是,本例所述的方法可以在圖1及圖4所示的互動系統10中執行,因此請一併照圖1及圖4以利理解。另外,圖3中部分與圖2相同之流程步驟以相同之圖號標示,故於此不再多加詳述其細節。 Please refer to FIG. 3 to FIG. 4 at the same time, and FIG. 3 and FIG. 4 will explain the present invention. An interactive method of the example and another application of the system. 3 is a schematic flowchart of an interaction method according to another embodiment of the present invention, and FIG. 4 is a schematic diagram of an application of an interaction system according to another embodiment of the present invention. It should be noted that the method described in this example can be performed in the interactive system 10 shown in FIG. 1 and FIG. 4, so please understand it together with FIG. 1 and FIG. In addition, the same steps in FIG. 3 as those in FIG. 2 are denoted by the same reference numerals, and thus the details thereof will not be described in detail.

簡單來說,相較於圖2的互動方法,圖3的互動方法更是將第一使用者103a還可以接續改變第一虛擬物件120的原始擺設建議給考量進去。因此,於圖3的實施例中更可包含有步驟S301至步驟S305。其中,在步驟S301中,透過第一電子裝置103,第一使用者103a用以將此第一虛擬物件120移動或旋轉至影像資料110a中的一第二預設位置,以藉此使得第一電子裝置130生成出更新後的第一控制指令TS1’。其中,更新後的第一控制指令TS1’同樣包含具有此第一虛擬物件120的尺寸參數,以及此第一虛擬物件120所被更新放置於影像資料110a中的第二預設位置的一座標參數。 In brief, compared with the interaction method of FIG. 2, the interaction method of FIG. 3 further considers that the first user 103a can continue to change the original placement suggestion of the first virtual object 120. Therefore, step S301 to step S305 may be further included in the embodiment of FIG. 3. The first user 103a is configured to move or rotate the first virtual object 120 to a second preset position in the image data 110a, thereby enabling the first The electronic device 130 generates the updated first control command TS1'. The updated first control command TS1' also includes a size parameter having the first virtual object 120, and a target parameter of the second preset position that the first virtual object 120 is updated and placed in the image data 110a. .

接著,在步驟S303中,第二電子裝置105用以根據更新後的第一控制指令TS1’,以及第二使用者105a目前所在的實際環境空間110,來建構出結合含有此第一虛擬物件120的擴增實境影像資料110b。最後,在步驟S305中,第二電子裝置105則會再根據第二使用者105a所操作第二電子裝置105時的觀影位置與觀影角度,以及更新後的第一控制指令TS1’中的尺寸參數與座標參數,來確立出此第一虛擬物件120及擴增實境影像資料110b所被結合呈現於第二電子裝置105上的顯示螢幕時的相對位置關係。 Next, in step S303, the second electronic device 105 is configured to construct a combination of the first virtual object 120 according to the updated first control command TS1' and the actual environment space 110 where the second user 105a is currently located. Augmented reality image data 110b. Finally, in step S305, the second electronic device 105 is further based on the viewing position and the viewing angle when the second user 105a operates the second electronic device 105, and the updated first control command TS1' The size parameter and the coordinate parameter are used to establish a relative positional relationship when the first virtual object 120 and the augmented reality image data 110b are combined and displayed on the display screen of the second electronic device 105.

因此,根據以上內容之教示,本技術領域中具有通常知識者應可以理解到,步驟S205~步驟S207及步驟S303~步驟S305應為相似或雷同之步驟。舉例來說,當設計師(亦即,第一使用者103a)認為此第一虛擬物件120的原始擺設建議並不合適時,設計師便 可以直接從影像資料110a中改變此第一虛擬物件120的第一預設位置,而第一電子裝置130則會據以產生出更新後的第一控制指令TS1’,並且藉此使得第二電子裝置105進而建構出更新後的擴增實境影像資料110b。 Therefore, in accordance with the teachings of the above, those of ordinary skill in the art should understand that steps S205 to S207 and steps S303 to S305 should be similar or identical steps. For example, when the designer (ie, the first user 103a) considers that the original placement suggestion of the first virtual object 120 is not appropriate, the designer The first preset position of the first virtual object 120 can be directly changed from the image data 110a, and the first electronic device 130 generates the updated first control command TS1' accordingly, and thereby causes the second electronic The device 105 further constructs the updated augmented reality image data 110b.

然而,應當理解的是,在另一種情況下,也可能會是消費者(亦即,第二使用者105a)並不滿意此第一虛擬物件120的原始擺設建議。因此,再請同時參閱圖5至圖6,圖5及圖6係將用以來解釋本發明實施例的互動方法及系統的其他一種應用。其中,圖5是本發明另一實施例所提供的互動方法之流程示意圖,圖6是本發明另一實施例所提供的互動系統之應用示意圖。本例所述的方法則可以在圖1及圖6所示的互動系統10中執行,因此請一併照圖1及圖6以利理解。另外,圖5中部分與圖2相同之流程步驟以相同之圖號標示,故於此不再多加詳述其細節。 However, it should be understood that in another case, it may be that the consumer (ie, the second user 105a) is not satisfied with the original placement suggestion of the first virtual object 120. Therefore, please refer to FIG. 5 to FIG. 6 at the same time. FIG. 5 and FIG. 6 are other applications of the interactive method and system for explaining the embodiment of the present invention. 5 is a schematic flowchart of an interaction method according to another embodiment of the present invention, and FIG. 6 is a schematic diagram of an application of an interaction system according to another embodiment of the present invention. The method described in this example can be performed in the interactive system 10 shown in FIG. 1 and FIG. 6, so please understand it in conjunction with FIG. 1 and FIG. In addition, the same steps in FIG. 5 as those in FIG. 2 are denoted by the same reference numerals, and thus the details thereof will not be described in detail.

簡單來說,相較於圖3的互動方法,圖5的互動方法則是將第二使用者105a也可以改變第一虛擬物件120的原始擺設建議給考量進去。因此,於圖5的實施例中更可包含有步驟S501至步驟S503。其中,在步驟S501中,透過第二電子裝置105,第二使用者105a用以將此第一虛擬物件120移動或旋轉至擴增實境影像資料110b中的一第二預設位置,以藉此使得第二電子裝置150生成出一第二控制指令TS2。其中,第二控制指令TS2包含具有第一虛擬物件120的尺寸參數,以及第一虛擬物件120所被放置於擴增實境影像資料110b中的座標參數。 In brief, compared with the interaction method of FIG. 3, the interaction method of FIG. 5 is to consider that the second user 105a can also change the original placement suggestion of the first virtual object 120. Therefore, in the embodiment of FIG. 5, step S501 to step S503 are further included. In the step S501, the second user 105a is configured to move or rotate the first virtual object 120 to a second preset position in the augmented reality image data 110b. This causes the second electronic device 150 to generate a second control command TS2. The second control command TS2 includes a size parameter having the first virtual object 120, and a coordinate parameter of the first virtual object 120 placed in the augmented reality image data 110b.

接著,在步驟S503中,第一使用者103a則會操作第一電子裝置130,並據以使得第一電子裝置130用以根據所接收到的第二控制指令TS2,更新此第一虛擬物件120所被放置於影像資料110a中的座標參數。因此,根據以上內容之教示,本技術領域中具有通常知識者應可以理解到,圖3的步驟S301~步驟S305及圖5的步驟S501~步驟S503應為並行執行而未衝突之步驟。也就是 說,當第二使用者105a已決定利用第二電子裝置150來改變此第一虛擬物件120的原始擺設建議時,第二電子裝置150則會據以產生出相應的第二控制指令TS2,並且藉此使得第一電子裝置103則會根據所接收到的第二控制指令TS2,來改變此第一虛擬物件120所被放置於影像資料110a中的第一預設位置,如圖6所示。如此一來,將可使得消費者(亦即,第二使用者105a)也有權利地去進行虛擬商品的擺設建議,並且使得設計師(亦即,第一使用者103a)能夠同步地觀察到消費者所期望的擺設建議,以進而有效率地滿足消費者主動需求的期望,更藉此提供出其互動效果的豐富性。 Next, in step S503, the first user 103a operates the first electronic device 130, and accordingly, the first electronic device 130 is configured to update the first virtual object 120 according to the received second control command TS2. The coordinate parameters placed in the image data 110a. Therefore, in accordance with the teachings of the above, it should be understood by those of ordinary skill in the art that steps S301 to S305 of FIG. 3 and steps S501 to S503 of FIG. 5 should be performed in parallel without conflict. That is When the second user 105a has decided to use the second electronic device 150 to change the original placement suggestion of the first virtual object 120, the second electronic device 150 generates a corresponding second control command TS2, and Thereby, the first electronic device 103 changes the first preset position of the first virtual object 120 placed in the image data 110a according to the received second control command TS2, as shown in FIG. 6. In this way, the consumer (i.e., the second user 105a) can also have the right to make suggestions for the placement of the virtual goods, and enable the designer (i.e., the first user 103a) to observe the consumption synchronously. The expectations of the placement are expected to meet the expectations of the active needs of consumers, and to provide the richness of their interactions.

另外一方面,在其他一種情況下,也可能會是設計師(亦即,第一使用者103a)或消費者(亦即,第二使用者105a)發現其實並不喜歡此第一虛擬物件120的本身款式。因此,再請同時參閱圖7至圖8,圖7及圖8係將用以來解釋本發明實施例的互動方法及系統的其他一種應用。其中,圖7是本發明另一實施例所提供的互動方法之流程示意圖,圖8是本發明另一實施例所提供的互動系統之應用示意圖。本例所述的方法則可以在圖1及圖8所示的互動系統10中執行,因此請一併照圖1及圖8以利理解。另外,圖7中部分與圖2相同之流程步驟以相同之圖號標示,故於此不再多加詳述其細節。 On the other hand, in other cases, it may be that the designer (ie, the first user 103a) or the consumer (ie, the second user 105a) finds that the first virtual object 120 is not actually enjoyed. The style of itself. Therefore, please refer to FIG. 7 to FIG. 8 at the same time. FIG. 7 and FIG. 8 are other applications of the interactive method and system for explaining the embodiment of the present invention. 7 is a schematic flowchart of an interaction method according to another embodiment of the present invention, and FIG. 8 is a schematic diagram of an application of an interaction system according to another embodiment of the present invention. The method described in this example can be performed in the interactive system 10 shown in FIGS. 1 and 8, so please understand it in conjunction with FIG. 1 and FIG. In addition, the same steps in FIG. 7 as those in FIG. 2 are denoted by the same reference numerals, and thus the details thereof will not be described in detail.

簡單來說,相較於圖3的互動方法,圖7的互動方法更是將第一使用者103a還可以移除掉第一虛擬物件給考量進去。因此,於圖7的實施例中更可包含有步驟S701至步驟S705。其中,在步驟S701中,透過第一電子裝置103,第一使用者103a用以自影像資料110a中卸載移除掉此第一虛擬物件120,以藉此使得第一電子裝置130生成出一第一刪除指令DS1。接著,在步驟S703中,第二電子裝置105用以根據第一刪除指令DS1,以及第二使用者105a所在的實際環境空間110,來建構出未結合含有此第一虛擬 物件120的擴增實境影像資料110b。最後,在步驟S705中,第二電子裝置105則會再根據第二使用者105a所操作第二電子裝置105時的觀影位置與觀影角度,來確立出擴增實境影像資料110b所被呈現於第二電子裝置105上的顯示螢幕時的相對位置關係。 In brief, compared with the interaction method of FIG. 3, the interaction method of FIG. 7 further considers that the first user 103a can also remove the first virtual object. Therefore, step S701 to step S705 may be further included in the embodiment of FIG. 7. In the step S701, the first user 103a is used to unload the first virtual object 120 from the image data 110a, so that the first electronic device 130 generates a first A delete instruction DS1. Next, in step S703, the second electronic device 105 is configured to construct, according to the first deletion command DS1 and the actual environment space 110 where the second user 105a is located, the first virtual Augmented reality image data 110b of object 120. Finally, in step S705, the second electronic device 105 further establishes the augmented reality image data 110b according to the viewing position and the viewing angle when the second user 105a operates the second electronic device 105. The relative positional relationship when the screen is displayed on the second electronic device 105.

因此,根據以上內容之教示,本技術領域中具有通常知識者應可以理解到,圖3的步驟S301~步驟S305、圖5的步驟S501~步驟S503及圖7的步驟S701~步驟S705應皆為並行執行而未衝突之步驟。舉例來說,當設計師(亦即,第一使用者103a)認為此第一虛擬物件120並不合適擺設於此實際環境空間110時,設計師便可以直接地從影像資料110a中卸載移除掉此第一虛擬物件120,而第一電子裝置130則會據以生成出第一刪除指令DS1,並且藉此使得第二電子裝置105進而可建構出未包含有此第一虛擬物件120的擴增實境影像資料110b,如圖8所示。 Therefore, according to the teachings of the above, those skilled in the art should understand that steps S301 to S305 of FIG. 3, steps S501 to S503 of FIG. 5, and steps S701 to S705 of FIG. 7 should be Steps that are executed in parallel without conflict. For example, when the designer (ie, the first user 103a) considers that the first virtual object 120 is not properly disposed in the actual environment space 110, the designer can directly uninstall and remove the image material 110a. The first virtual object 120 is deleted, and the first electronic device 130 generates a first deletion instruction DS1, and thereby the second electronic device 105 can further construct an extension that does not include the first virtual object 120. The real image data 110b is added as shown in FIG.

同理,再請同時參閱圖9至圖10,圖9及圖10係將用以來解釋本發明實施例的互動方法及系統的其他一種應用。其中,圖9是本發明另一實施例所提供的互動方法之流程示意圖,圖10是本發明另一實施例所提供的互動系統之應用示意圖。本例所述的方法則可以在圖1及圖10所示的互動系統10中執行,因此請一併照圖1及圖10以利理解。另外,圖9中部分與圖2相同之流程步驟以相同之圖號標示,故於此不再多加詳述其細節。 Similarly, please refer to FIG. 9 to FIG. 10 at the same time. FIG. 9 and FIG. 10 are other applications of the interactive method and system for explaining the embodiment of the present invention. 9 is a schematic flowchart of an interaction method according to another embodiment of the present invention, and FIG. 10 is a schematic diagram of an application of an interaction system according to another embodiment of the present invention. The method described in this example can be implemented in the interactive system 10 shown in FIGS. 1 and 10, so please understand it in conjunction with FIG. 1 and FIG. In addition, the same steps in FIG. 9 as those in FIG. 2 are denoted by the same reference numerals, and thus the details thereof will not be described in detail.

簡單來說,相較於圖7的互動方法,圖9的互動方法更是將第二使用者105a也可以移除掉第一虛擬物件給考量進去。因此,於圖9的實施例中更可包含有步驟S901至步驟S903。其中,在步驟S901中,透過第二電子裝置105,第二使用者105a用以自擴增實境影像資料110b中卸載移除掉此第一虛擬物件120,以藉此使得第二電子裝置105生成出一第二刪除指令DS2。接著,在步驟S903中,第一使用者103a操作第一電子裝置103,並據以使得第一電子裝置103用以根據所接收到的第二刪除指令DS2,更新第 二使用者105a目前所在的實際環境空間110的影像資料110a,如圖10所示。如此一來,相較於習知技藝,本發明實施例的互動方法及系統,可以是藉由將一虛擬商品同步地透過在一虛擬實境模式(亦即,第一電子裝置103)及一擴增實境模式(亦即,第二電子裝置105)中進行呈現,以藉此達到改善設計師及消費者在進行傢俱佈置時的互動效果。 In brief, compared with the interaction method of FIG. 7, the interaction method of FIG. 9 further considers that the second user 105a can also remove the first virtual object. Therefore, in the embodiment of FIG. 9, step S901 to step S903 may be further included. In the step S901, the second user 105a is configured to unload the first virtual object 120 from the augmented reality image data 110b through the second electronic device 105, thereby causing the second electronic device 105 to be removed. A second delete command DS2 is generated. Next, in step S903, the first user 103a operates the first electronic device 103, and accordingly causes the first electronic device 103 to update the first instruction according to the received second deletion command DS2. The image data 110a of the actual environmental space 110 in which the user 105a is currently located is as shown in FIG. In this way, the interaction method and system of the embodiments of the present invention can be synchronously transmitted through a virtual reality mode (ie, the first electronic device 103) and a virtual product. The presentation is performed in the augmented reality mode (ie, the second electronic device 105) to thereby achieve an improved interaction between the designer and the consumer in the furniture arrangement.

綜上所述,本發明實施例所提供的互動方法及系統,將完全不同於現有習知技藝的應用方式,而是提供了一種可用於讓多個使用者在一虛擬實境影像資料及一擴增實境影像資料間進行互動的互動方法及系統,故本發明實施例的互動方法及系統,將可以使得設計師能夠不用受限於使用環境上的區域性限制,並且使得消費者更能夠直觀地體驗到虛擬商品的特色,以藉此進而提供出良好的互動效果。 In summary, the interaction method and system provided by the embodiments of the present invention will be completely different from the prior art application methods, but provide a virtual reality image data and a plurality of users. An interactive method and system for augmenting the interaction between the real-world image data, so that the interactive method and system of the embodiment of the present invention can enable the designer to be free from regional restrictions on the use environment and enable the consumer to Visually experience the characteristics of virtual goods to provide a good interactive effect.

以上所述僅為本發明之實施例,其並非用以侷限本發明之專利範圍。 The above description is only an embodiment of the present invention, and is not intended to limit the scope of the invention.

S201~S207‧‧‧流程步驟 S201~S207‧‧‧ Process steps

Claims (10)

一種互動方法,用於讓多個使用者在一虛擬實境(Virtual Reality,VR)影像資料及一擴增實境(Augmented Reality,AR)影像資料間進行互動,該互動方法包括:至少一第一使用者操作一第一電子裝置,並據以使得該第一電子裝置獲取得到關聯於一第二使用者目前所在的一實際環境空間的一影像資料;根據一商品資料庫,該第一使用者用以自該商品資料庫中選取出至少一第一虛擬物件,並且將該第一虛擬物件載入放置於該影像資料中的一第一預設位置,以藉此使得該第一電子裝置生成出一第一控制指令,其中該第一控制指令包含具有該第一虛擬物件的一尺寸參數,以及該第一虛擬物件所被放置於該影像資料中的一座標參數;以及該第二使用者操作一第二電子裝置,並據以使得該第二電子裝置用以根據所接收到的該第一控制指令,以及該第二使用者目前所在的該實際環境空間,來建構出結合含有該第一虛擬物件的該擴增實境影像資料,並且該第二電子裝置則會再根據該第二使用者所操作該第二電子裝置時的一觀影位置與一觀影角度,以及該第一控制指令中的該尺寸參數與該座標參數,來確立出該第一虛擬物件及該擴增實境影像資料所被結合呈現於該第二電子裝置上的一顯示螢幕時的相對位置關係。 An interactive method for allowing multiple users to interact between a virtual reality (VR) image material and an augmented reality (AR) image data, the interaction method including: at least one a user operating a first electronic device, and thereby causing the first electronic device to obtain an image data associated with an actual environmental space in which the second user is currently located; the first use according to a product database The method is configured to select at least one first virtual object from the product database, and load the first virtual object into a first preset position placed in the image data, thereby causing the first electronic device Generating a first control command, wherein the first control command includes a size parameter having the first virtual object, and a target parameter of the first virtual object placed in the image data; and the second use Operating a second electronic device, and wherein the second electronic device is configured to use the first control command received, and the current location of the second user The environment space is configured to combine the augmented reality image data containing the first virtual object, and the second electronic device is further configured according to the second user to operate the second electronic device a position and a viewing angle, and the size parameter and the coordinate parameter in the first control instruction, to establish that the first virtual object and the augmented reality image data are combined and presented on the second electronic device The relative positional relationship of a screen display. 如請求項第1項所述的互動方法,其中該第一電子裝置所獲取得到的該影像資料,即表示為關聯於該第二使用者目前所在的該實際環境空間的該虛擬實境影像資料,並且該第一與該第二電子裝置用以透過至少一通訊協定來達到彼此間的相互通信。 The interactive method of claim 1, wherein the image data obtained by the first electronic device is represented as the virtual reality image data associated with the actual environment space in which the second user is currently located. And the first and the second electronic device are configured to communicate with each other through at least one communication protocol. 如請求項第2項所述的互動方法,更包括:透過該第一電子裝置,該第一使用者用以將該第一虛擬物件移動或旋轉至該影像資料中的一第二預設位置,以藉此使得 該第一電子裝置生成出更新後的該第一控制指令;以及該第二電子裝置用以根據更新後的該第一控制指令,以及該第二使用者目前所在的該實際環境空間,來建構出結合含有該第一虛擬物件的該擴增實境影像資料,並且該第二電子裝置則會再根據該第二使用者所操作該第二電子裝置時的該觀影位置與該觀影角度,以及更新後的該第一控制指令中的該尺寸參數與該座標參數,來確立出該第一虛擬物件及該擴增實境影像資料所被結合呈現於該顯示螢幕時的該相對位置關係。 The interactive method of claim 2, further comprising: moving, by the first user, the first virtual object to a second preset position in the image data through the first electronic device In order to make The first electronic device generates the updated first control instruction; and the second electronic device is configured to be configured according to the updated first control instruction and the actual environment space in which the second user is currently located. Combining the augmented reality image data containing the first virtual object, and the second electronic device is further configured according to the viewing position and the viewing angle when the second user operates the second electronic device And the updated size parameter in the first control instruction and the coordinate parameter to establish the relative positional relationship when the first virtual object and the augmented reality image data are combined and displayed on the display screen. . 如請求項第2項所述的互動方法,更包括:透過該第一電子裝置,該第一使用者用以自該影像資料中卸載移除掉該第一虛擬物件,以藉此使得該第一電子裝置生成出一第一刪除指令;以及該第二電子裝置用以根據該第一刪除指令,以及該第二使用者所在的該實際環境空間,來建構出未結合含有該第一虛擬物件的該擴增實境影像資料,並且該第二電子裝置則會再根據該第二使用者所操作該第二電子裝置時的該觀影位置與該觀影角度,來確立出該擴增實境影像資料所被呈現於該顯示螢幕時的該相對位置關係。 The interactive method of claim 2, further comprising: removing, by the first user, the first virtual object from the image data by using the first electronic device, thereby causing the first An electronic device generates a first deletion instruction; and the second electronic device is configured to construct, according to the first deletion instruction and the actual environment space where the second user is located, the first virtual object is not combined And amplifying the real-time image data, and the second electronic device further establishes the augmentation according to the viewing position and the viewing angle when the second user operates the second electronic device The relative positional relationship of the image data displayed on the display screen. 如請求項第2項所述的互動方法,更包括:透過該第二電子裝置,該第二使用者用以將該第一虛擬物件移動或旋轉至該擴增實境影像資料中的一第二預設位置,以藉此使得該第二電子裝置生成出一第二控制指令,其中該第二控制指令包含具有該第一虛擬物件的該尺寸參數,以及該第一虛擬物件所被放置於該擴增實境影像資料中的該座標參數;以及該第一使用者操作該第一電子裝置,並據以使得該第一電子裝置用以根據所接收到的該第二控制指令,更新該第一虛擬物件所被放置於該影像資料中的該座標參數。 The interactive method of claim 2, further comprising: moving, by the second user, the first virtual object to the first virtual object in the augmented reality image data a second preset position, thereby causing the second electronic device to generate a second control command, wherein the second control command includes the size parameter having the first virtual object, and the first virtual object is placed on And the first user operates the first electronic device, and the first electronic device is configured to update the second electronic device according to the received second control instruction The coordinate parameter that the first virtual object is placed in the image data. 如請求項第2項所述的互動方法,更包括:透過該第二電子裝置,該第二使用者用以自該擴增實境影像資料中卸載移除掉該第一虛擬物件,以藉此使得該第二電子裝置生成出一第二刪除指令;以及該第一使用者操作該第一電子裝置,並據以使得該第一電子裝置用以根據所接收到的該第二刪除指令,更新該第二使用者目前所在的該實際環境空間的該影像資料。 The interactive method of claim 2, further comprising: using the second electronic device, the second user is configured to unload the first virtual object from the augmented reality image data to borrow The second electronic device generates a second deletion instruction; and the first user operates the first electronic device, and accordingly, the first electronic device is configured to use the second deletion instruction according to the received Updating the image data of the actual environment space where the second user is currently located. 如請求項第2項所述的互動方法,其中該商品資料庫內建於該第一與/或該第二電子裝置之中,又或者該商品資料庫用以透過該至少一通訊協定來與該第一與/或該第二電子裝置進行數據的傳輸。 The interactive method of claim 2, wherein the product database is built in the first and/or the second electronic device, or the product database is used to communicate with the at least one communication protocol. The first and/or the second electronic device performs data transmission. 一種互動系統,用於讓多個使用者在一虛擬實境影像資料及一擴增實境影像資料間進行互動,該互動系統包括:一商品資料庫;一第一電子裝置,供至少一第一使用者所操作,且用以獲取得到關聯於一第二使用者目前所在的一實際環境空間的一影像資料,並據以使得該第一使用者用以自該商品資料庫中選取出至少一第一虛擬物件,且將該第一虛擬物件載入放置於該影像資料中的一第一預設位置,以藉此使得該第一電子裝置生成出一第一控制指令,其中該第一控制指令包含具有該第一虛擬物件的一尺寸參數,以及該第一虛擬物件所被放置於該影像資料中的一座標參數;以及一第二電子裝置,供該第二使用者所操作,且用以根據所接收到的該第一控制指令,以及該第二使用者目前所在的該實際環境空間,來建構出結合含有該第一虛擬物件的該擴增實境影像資料,並且該第二電子裝置則會再根據該第二使用者所操作該第二電子裝置時的一觀影位置與一觀影角度,以及該第一控制指令中的該尺寸參數與該座標參數,來確立出該第一虛擬 物件及該擴增實境影像資料所被結合呈現於該第二電子裝置上的一顯示螢幕時的相對位置關係。 An interactive system for allowing a plurality of users to interact between a virtual reality image data and an augmented reality image data, the interactive system comprising: a product database; a first electronic device for at least one a user operating, and obtaining an image data associated with an actual environmental space in which the second user is currently located, and thereby causing the first user to select at least the product database a first virtual object, and loading the first virtual object into a first preset position placed in the image data, thereby causing the first electronic device to generate a first control instruction, wherein the first The control command includes a size parameter having the first virtual object, and a target parameter of the first virtual object placed in the image data; and a second electronic device for the second user to operate, and And configured to combine the augmented reality containing the first virtual object according to the received first control instruction and the actual environment space in which the second user is currently located. Image data, and the second electronic device is further based on a viewing position and a viewing angle when the second user operates the second electronic device, and the size parameter in the first control command Coordinate parameters to establish the first virtual The relative positional relationship between the object and the augmented reality image data is displayed on a display screen of the second electronic device. 如請求項第8項所述的互動系統,其中該第一電子裝置所獲取得到的該影像資料,即表示為關聯於該第二使用者目前所在的該實際環境空間的該虛擬實境影像資料,並且該第一與該第二電子裝置用以透過至少一通訊協定來達到彼此間的相互通信。 The interactive system of claim 8, wherein the image data obtained by the first electronic device is represented as the virtual reality image data associated with the actual environmental space in which the second user is currently located. And the first and the second electronic device are configured to communicate with each other through at least one communication protocol. 如請求項第9項所述的互動系統,其中該商品資料庫內建於該第一與/或該第二電子裝置之中,又或者該商品資料庫用以透過該至少一通訊協定來與該第一與/或該第二電子裝置進行數據的傳輸。 The interactive system of claim 9, wherein the product database is built in the first and/or the second electronic device, or the product database is used to communicate with the at least one communication protocol. The first and/or the second electronic device performs data transmission.
TW105128153A 2016-08-31 2016-08-31 Interaction method and system thereof TWI585617B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
TW105128153A TWI585617B (en) 2016-08-31 2016-08-31 Interaction method and system thereof
CN201610809899.0A CN107783648B (en) 2016-08-31 2016-09-08 Interaction method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW105128153A TWI585617B (en) 2016-08-31 2016-08-31 Interaction method and system thereof

Publications (2)

Publication Number Publication Date
TWI585617B true TWI585617B (en) 2017-06-01
TW201812530A TW201812530A (en) 2018-04-01

Family

ID=59688330

Family Applications (1)

Application Number Title Priority Date Filing Date
TW105128153A TWI585617B (en) 2016-08-31 2016-08-31 Interaction method and system thereof

Country Status (2)

Country Link
CN (1) CN107783648B (en)
TW (1) TWI585617B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI757941B (en) * 2020-10-30 2022-03-11 幻景啟動股份有限公司 Image processing system and image processing device

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109345637B (en) * 2018-08-27 2021-01-26 创新先进技术有限公司 Interaction method and device based on augmented reality
US11321768B2 (en) * 2018-12-21 2022-05-03 Shopify Inc. Methods and systems for an e-commerce platform with augmented reality application for display of virtual objects
US11908159B2 (en) 2020-07-27 2024-02-20 Shopify Inc. Systems and methods for representing user interactions in multi-user augmented reality
US11527045B2 (en) 2020-07-27 2022-12-13 Shopify Inc. Systems and methods for generating multi-user augmented reality content

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7292240B2 (en) * 2004-09-07 2007-11-06 Canon Kabushiki Kaisha Virtual reality presentation device and information processing method
US7480727B2 (en) * 2002-08-12 2009-01-20 Alcatel Method and devices for implementing highly interactive entertainment services using interactive media-streaming technology, enabling remote provisioning of virtual reality services
TW201503038A (en) * 2013-07-08 2015-01-16 Hwa Hsia Inst Of Technology Interior design simulation system
US20150363897A1 (en) * 2014-06-11 2015-12-17 Staging Design Inc. System for providing proposal of decoration for residence or exhibit and method for the same
TWI540525B (en) * 2014-06-11 2016-07-01 宅妝股份有限公司 System and method for providing proposal to furniture and decorations buyer

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102009037835B4 (en) * 2009-08-18 2012-12-06 Metaio Gmbh Method for displaying virtual information in a real environment
GB2501929B (en) * 2012-05-11 2015-06-24 Sony Comp Entertainment Europe Apparatus and method for augmented reality
US9823739B2 (en) * 2013-04-04 2017-11-21 Sony Corporation Image processing device, image processing method, and program
TWI484452B (en) * 2013-07-25 2015-05-11 Univ Nat Taiwan Normal Learning system of augmented reality and method thereof
CN105786311A (en) * 2016-02-24 2016-07-20 杨晟志 Virtual space application platform

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7480727B2 (en) * 2002-08-12 2009-01-20 Alcatel Method and devices for implementing highly interactive entertainment services using interactive media-streaming technology, enabling remote provisioning of virtual reality services
US7292240B2 (en) * 2004-09-07 2007-11-06 Canon Kabushiki Kaisha Virtual reality presentation device and information processing method
TW201503038A (en) * 2013-07-08 2015-01-16 Hwa Hsia Inst Of Technology Interior design simulation system
US20150363897A1 (en) * 2014-06-11 2015-12-17 Staging Design Inc. System for providing proposal of decoration for residence or exhibit and method for the same
TWI540525B (en) * 2014-06-11 2016-07-01 宅妝股份有限公司 System and method for providing proposal to furniture and decorations buyer

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI757941B (en) * 2020-10-30 2022-03-11 幻景啟動股份有限公司 Image processing system and image processing device

Also Published As

Publication number Publication date
CN107783648A (en) 2018-03-09
TW201812530A (en) 2018-04-01
CN107783648B (en) 2020-08-18

Similar Documents

Publication Publication Date Title
TWI585617B (en) Interaction method and system thereof
US11562544B2 (en) Transferring graphic objects between non-augmented reality and augmented reality media domains
US20180345144A1 (en) Multiple Frame Distributed Rendering of Interactive Content
EP2889844B1 (en) Diminished reality
CN103430123B (en) For carrying out the method and system of remote desktop session via HTML
US11009939B2 (en) Methods and systems for generating and providing immersive 3D displays
CN103460670B (en) The method and system of remote desktop session is carried out for using HTTP processors and remote desktop client general-purpose interface
US20210182948A1 (en) Product browsing method and apparatus, device and storage medium
US10891793B2 (en) Reality to virtual reality portal for dual presence of devices
CN107077348B (en) Segmented application rendering across devices
US10846939B2 (en) Augmented reality workspace system
JP2011090640A (en) Information processor, information processing method and program
CN106575158B (en) Environment mapping virtualization mechanism
US9721045B2 (en) Operation in an immersive virtual environment
US10777009B2 (en) Dynamically forming an immersive augmented reality experience through collaboration between a consumer and a remote agent
US20240087004A1 (en) Rendering 3d model data for prioritized placement of 3d models in a 3d virtual environment
US20160320936A1 (en) Techniques for displaying shared digital assets consistently across different displays
CN109213981B (en) Demonstration collaboration for various electronic devices
KR20160066044A (en) Rendering interface objects defined by a separate application
Kim et al. Cluster rendering on large high-resolution multi-displays using X3DOM and HTML
US11403831B1 (en) Efficient color theming of background images in web-based mixed reality environments
US11030811B2 (en) Augmented reality enabled layout system and method
JP7366197B1 (en) Information processing device, information processing method, and information processing program
US20240069712A1 (en) Techniques for Displaying Shared Digital Assets Consistently across Different Displays
US20150363371A1 (en) System and method for adaptive user interface scaling