201220818 六、發明說明： 【發明所屬之技術領威】 [0001] 本發明係有關於一種結合祝訊影像之即時虛擬共賞 數位標的物之方法’特別是指f以利用虛擬影像與實境 影像相互結合，旅且透過網路傳遞，藉以產生互動之作 用，而具有培養情感、疏緩壓力或排解叔寞等功效。 [先前技術] [0002] 由於現代人之工作繁忙，精神壓力大，因此人與人 〇201220818 VI. Description of the Invention: [Technology Leading to the Invention] [0001] The present invention relates to a method for combining real-time virtual shared digital objects of a video image, in particular, f to utilize virtual images and real-world images. They are combined with each other and traveled through the Internet to create an interactive role, which has the effect of cultivating emotions, relieving stress or resolving uncles. [Prior Art] [0002] Due to the busy work of modern people and the stress of the people, people are jealous.
099137648 之間的互動相對減少’尤其是對於獨居老人、小孩及家 庭關係疏離者皆疏於照料及關心’往翁樣要藉由電子等 高科技產品，來維繫及修補彼此之間的關係，例如手機 、視訊裝置或即時通訊軟體等’但由於上述產品之特性 較為單調、缺乏趣味性及變化性’因此市面上推出相當 多以擴增實境及虛擬實境等技術互相配合之產品，於使 用時可增添人性化，以吸引消費者使用，藉以達到真正 互動之功效。 例如中華民國98年7月11日所公告之新型第M36 j 〇68 號「虚擬水族箱」專㈣翁，其％揭露：於箱體外側 設置有影_取單元，又處理單㈣'内建有軟體程式， 可接收來自於影像擷取單元所取得之晝面訊號並進行處 Γ有出水族生態之視訊畫面至顯拜元播放，又配 合有互動讀可觸發控制單元發出 ，並經由軟體程式予以 化，而變化後之視訊畫應之互動式配合變 然，該專利前案雖然具備有Z輪出至顯示單元播放。 僅限於單1用者進扣:擬水族箱之培育樂趣’但 表單編號仙0】 第3頁/共:頁並無法達到多人同時交流 0992065616-0 201220818 使用之功能，因此仍然缺少互動之樂趣。 又有中華民國96年4月11日所公告之發明第1 278772 號「可供多人移動式互動使用之擴增實境系統及方法」 專利案所示，其係揭露：包括兩大部分，第一大部分是 可處理擴增實境之電腦系統，另一大部分是每一個使用 者擁有的使用者系統；可處理擴增實境之電腦系統主要 是具有強大之電腦影像運算功能，可將電腦繪圖資料轉 換成一立體之虛擬影像，再送至使用者系統；使用者系 統主要包括頭戴式顯示器，麥克風以及手持式電腦；使 用者可透過頭戴式顯示器觀看立體之虛擬影像，並且利 用麥克風或手持式電腦可以與其他使用者溝通。該專利 前案，僅能夠多人對於單一標的物，例如用在車子的虛 擬原型的評估與討論，但每一個使用者之間欠缺即時交 流之功能，也未揭露有對於同一個標的物進行即時互動 之影像傳輸，例如共同餵魚、逗魚、賞晝、種花等互相 交流之動作呈現，因此在使用上，仍然未能達到最佳之 即時互動功效。 【發明内容】 [0003] 爰此，有鑑於目前的即時互動方法具有上述種種之 缺失，故本發明提供一種結合視訊影像之即時虛擬共賞 數位標的物之方法，係設有A.於一第一端擷取一第一實 境影像；B.透過網路將該第一實境影像即時傳遞至一個 以上之第二端；C.於該第二端顯示一第一虛擬影像；D. 使該第一虛擬影像結合於該第一實境影像之前，而形成 一第一結合畫面顯示於該第二端。 進一步包括有：E.於該第一端輸出一第一控制指令 099137648 表單編號A0101 第4頁/共24頁 0992065616-0 ，並透過網路即時傳遞至第二端；F.於該第二端顯示相 對應該第一控制指令變化之第一結合畫面。 上述步驟C係同時於該第一端顯示該第一虛擬影像， 該步驟D係同時於該第一端顯示該第一結合晝面。 進一步包括有：E.於第一端輸出一第一控制指令， 並透過網路即時傳遞至第二端；F.於該第一端及第二端 同時顯示相對應該第一控制指令變化之第一結合晝面。 上述步驟A又於一第二端擷取一第二實境影像，該步 驟B透過網路將該第二實境影像即時傳遞至該第一端，該 步驟C又於該第一端顯示一第二虛擬影像，該步驟D又使 該第二虛擬影像結合於該第二實境影像之前，而形成一 第二結合畫面顯示於該第一端。 進一步包括有：E.於第一端輸出一第一控制指令， 並透過網路即時傳遞至該第二端，又於該第二端輸出一 第二控制指令，並透過網路即時傳遞至該第一端；F.於 該第二端顯示相對應該第一控制指令變化之第一結合畫 面，又於該第一^顯示相對應該第二控制指令變化之第 二結合晝面。 上述步驟A係同時擷取一數位音訊，該步驟B係透過 網路即時傳輸該數位音訊，該步驟D係播放該數位音訊， 該步驟E之控制指令係包含該數位音訊，該步驟F係播放 相對應變化之數位音訊。 上述結合畫面内容係顯示一物件之動態及/或靜態的 改變。 上述虛擬影像係包含2D平面影像及3D立體影像之變 化、或全2D平面影像之變化、或全3D立體影像之變化。 表單編號A0101 第5頁/共24頁 201220818 上述結合晝面中未顯示虛擬影像變化之局部區域係 成為透明，而該實境影像則顯示於該局部區域内。 本發明具有下列之優點： 1. 本發明主要係利用虛擬產生之虛擬水族箱、虛擬 風景、虛擬畫作或虛擬寵物，配合實體所產生之實境影 像，同時透過網路產生互動，進而藉以培養情感、疏緩 壓力或排解寂寞，尤適合獨居老人及其親屬之間、親子 之間及家庭關係疏離者之間作遠距離之關懷及互動。 2. 本發明並且可以於所形成之結合畫面中，下達控 制指令，而產生共同餵魚、除草、整理水族箱、打招呼 、作手勢、揮手、種花、賞畫、賞鳥、對話或唱歌等變 化的結合晝面，藉以增強互動之效果。 3. 本發明並可透過發聲單元播放出互動的數位音訊 ，藉以提高互動時的趣味性及變化性，並且達到互動之 功效 4. 本發明亦可供運用於遠距離之失智老人、行動不 便或是無自主行為能力之使用者及其照護人員，透過晝 面及音訊表達慰問或關懷之意，同樣可以達到培養情感 、疏緩壓力或排解寂寞等功效。 【實施方式】 [0004] 首先，請參閱第一圖及第二圖所示，本發明第一實 施例，係包括有下列步驟： A.於一第一端擷取一第一實境影像及一第一數位音 訊，又於一個以上之第二端擷取一第二實境影像及一第 二數位音訊：一第一使用者（3)係於該第一端之第一處理 單元（1)，利用一第一影像擷取單元（11)擷取第一使用者 099137648 表單編號A0101 第6頁/共24頁 0992065616-0 201220818 (3)之實體影像而形成一第一實境影像，該第一處理單元 (1)係可為電腦、筆記型電腦、平板電腦，而該第—影像 擷取單元（11)係可為數位攝影機、數位相機或手機，另 利用〜第一音訊擷取單元（12)擷取該第一使用者（3)所發 出之聲音形成一第一數位音訊，該第一音訊擷取單元 (12)係可為麥克風、數位錄音機或錄音筆，另外至少有 一個以上之第二端，其數量係可根據不同使用者之數量 而增加，並無人數上的限制，一位以上的第二使用者（4) 係於該第二端之第二處理單元（2)，利用一第二影像擷取 > 單儿（21)擷取第二使用者（4)今實體影像而形成一第二實 境影像，該第二處理單元（2)係可為電腦' 筆記型電腦、 平板電腦，而該第二影像擷取單元（21)係可為數位攝影 機、數位相機或手機，另利用一第二音訊擷取單元（22) 擷取該第二使用者所發出之聲音形成一第二數位音訊， 該第二音訊擷取單元（22)係可為麥克風、數位錄音機或 錄音筆。 B. 透過網路將該第一實境影像及該第一數位音訊即 》 時傳遞至該第二端，又透過網路將該第二實境影像及該 第一數位音訊即時傳遞至該第一端：該第一端之第一處 理單几（1)透過一網路（5)，將所擷取之第一實境影像及 第一數位音訊傳遞至第二端之第二處理單元（2)，同樣第 二端之第二處理單元（2)亦透過該網路（5)，將所擷取之 第二實境影像及第二數位音訊傳遞至第一端之第一處理 單元（1)。 C. 於該第二端顯示—第一虛擬影像，又於該第一端 顯示一第二虛擬影像：而該第一端之第一處理單元（1)則 099137648 表單編號 A0101 第 7 頁/共 24 頁 0992065616-0 201220818 透過網路（5)或直接連線到—資科 一点 卞厍（6)，而接收到― -业擬影像，並顯示於n示單元（13)上， 顯不單元⑽係可為-液晶螢幕顿影螢幕〆 虛擬影像係可為一虛擬水族箱、虛 μ弟― 占t 鞭風尽、虛擬畫作讳 虛擬寵物等物件⑺，又該第二蠕之第二處理單元-次 樣透過網路⑸或直接連線到該資料庫⑻，而接收到二 第—虛擬影像，並顯示於一第二顯示單元上，= 二顯示單元⑵）係可為-液晶螢幕或投影鋒，而= :虛擬影像之内容係相同於該第二虛擬影像之虛擬水族 相、虛擬風景、虛擬畫作或虛擬窺物之物件（？），其不s 處僅在於該物件⑺财角度上之差異而已，又本發= 一實施例中之物件（7)係以一虛擬水族箱作說明，上述古亥 第一虛擬景>像及第二虛擬影像係包含該物件（7)之a平面 影像及3D立體影像之變化、或全2D平面影像之變化或 全3D立體影像之變化，其中2D之平面影像係可為水族箱 中常見之水草、岩石或飼料等平面式固定物件而补立 體影像則可為魚、煆等立體移動式生物。 099137648 D.使該第一虛擬影像結合於該第一實境影像之前 而形成一第一結合畫面顯示於該第二端，並播放該第— 數位音訊，又使該第二虛擬影像結合於該第二實境奢像 之前，而形成一第二結合畫面顯示於該第一端，並播放 該第二數位音訊：於該第二端利用該第二處理單元（？）將 該第一虛擬影像及該第一實境影像進行處理運算，並於 忒第一顯示單元（23)上顯示，於該第二顯示單元（23)佥 面中未顯示出該第一虛擬影像變化之局部區域則處理成 為透明〔如第三圖所示〕，該第一虛擬影像中之物件（？） 表早編號A0101 第8頁/共24頁 0992065616-0 201220818 〔例如魚、水草或岩石等均以斜線表示之，以方便說明 〕以外的局部區域，則可供顯示出該第一實境影像〔例 如該第一使用者（3)之實體影像，如第四圖所示〕，藉以 構成一第一結合畫面，即可於該第二顯示單元（23)上呈 現出該第一虛擬影像係結合於該第一實境影像之前的視 覺效果，而由該第二端觀之，則可模擬出宛如第一使用 者（3)係站立於一水族箱另一方賞魚之晝面；而該第一端 則利用該第一處理單元（1)將該第二虛擬影像及該第二實 境影像進行處理運算，並於該第一顯示單元（13)上顯示 Ο ，同樣於該第一顯示單元（13)畫面中未顯示出該第二虛 擬影像變化之局部區域則處理成為透明，以供顯示出該 第二實境影像，藉以構成一第二結合畫面，則可於該第 一顯示單元（13)上呈現出該第二虛擬影像係結合於該第 二實境影像之前的視覺效果，而由該第一端觀之，則可 模擬出宛如第二使用者（4)係站立於該水族箱另一方賞魚 之畫面〔如第六圖所示〕。 E.於該第一端輸出一第一控制指令，並透過網路即 〇 時傳遞至第二端，又於該第二端輸出一第二控制指令， 並透過網路即時傳遞至該第一端：當第一端之第一使用 者（3)透過一第一鍵盤（14)、一第一滑鼠（15)或其他之 數位筆、數位板、觸控式螢幕、體感互動偵測元件等輸 入裝置，輸入一控制動作，經由第一處理單元（1)處理運 算後，輸出一第一控制指令，該第一控制指令係可為模 擬一倒飼料餵魚之動作，並透過網路（5)傳遞到該第二處 理單元（2)，而該第二端之第二使用者（4)則同樣可透過 一第二鍵盤（24)、一第二滑鼠（25)或其他之數位筆、數 099137648 表單編號A0101 第9頁/共24頁 0992065616-0 201220818 :觸控式勞幕、體感互動偵測元件等輸入裝置，輪 、:顧魚之控制動作，經由第二處理單元⑵處理運 二輸出—第二控制指令，並透過網路⑸傳遞到該第 一處理單元（1)。 示 一 F•於該第二端顯示相對應該第一控制指令變化之第 一結合畫面及該第—數位音訊，又於該第—端顯示相對 應該第二控制指令變化之第二結合畫面及該第二數位音 訊：該第二處理單元⑵接收到該第一控制指令後，即可 根據該第-控制指令之内容〔即模擬倒飼料傲魚之動作 〕，而於該第二顯示單元（23)上顯示出一相對變化 結合晝面〔如五圖所示〕，該第一結合晝面中會顯示 出第—使用者⑻握持一㈣罐倒出飼料及魚隻爭食之畫 面’同時該第二處理單元⑵亦會將所接收到之第一數2 音訊透過-第二發聲單元（26〉進行播放，該第二發聲單 元（26)係可為剩°八或耳機，又該第一處理單元⑴亦將所 接收到之第二控制指令’根據擁二控麵令之内容〔 相同為模擬倒飼料傲魚之動作〕,而於該第—顯示單元 (13)上顯示出一相對變化之第上結合畫面，即該第二結 a旦面中同樣會顯示出握持一飼料罐倒出飼料及魚隻爭 艮之畫面’同時該第一處理單元⑴亦會將所接收到之第 一數位音訊透過一第一發聲單元（16)進行播放，該第— 發聲單元（16)係可為喇叭或耳機，如此，該第一端之第 使用者（3)及第二端之第二使用者⑷係可同時透過網 路產生餵魚之互動，進而培養情感、疏緩壓力或排解寂 寞等，尤適合獨居老人及其親屬之間、親子之間及家庭 關係疏離者之間作遠距離之關懷及互動，又本實施例中 099137648 09920 表單編號A0101 第10頁/共24頁 201220818 之物件（7)並不限於虛擬水族箱，亦可共同處於一虛擬風 景中，或共同欣賞-虛擬畫作’或共同铜育—虛擬寵物 等物件（7)均可，故上述之控制動作亦不侷限於餵魚之互 動，亦可為共同除草、整理水族箱、打招呼、作手勢、 揮手 '種花、賞畫、賞鳥，甚至於是雙方進行對話、唱 歌等，均可達到上述互動所產生之功效。The interaction between 099137648 is relatively reduced, especially for elderly people living alone, children and family aliens who are neglected to care and care. Towards, we must maintain and repair the relationship with each other through high-tech products such as electronics. For example, mobile phones, video devices or instant messaging software, etc., but because the characteristics of the above products are relatively monotonous, lacking in interest and variability, there are quite a few products on the market that integrate technologies such as augmented reality and virtual reality. It can be added to humanity to attract consumers to use, so as to achieve the effect of true interaction. For example, the new type of M36 j 〇68 “Virtual Aquarium” (4) Weng announced by the Republic of China on July 11, 1998, revealed that it has a shadow_unit and a single (four) built-in on the outside of the cabinet. There is a software program that can receive the video signals obtained from the image capture unit and perform the video display of the aquarium ecology to the display of the worship, and with the interactive read trigger control unit, and via the software program. It will be changed, and the interactive video clip should be interactively matched. The patent case has a Z-round out to display unit. Only for single 1 user to buy and sell: the fun of aquarium cultivation 'but the form number is 0】 Page 3 / total: The page can not reach the multi-person and exchange the function of 0992065616-0 201220818, so there is still no interaction fun . In addition, the Invention No. 1 278772, "Augmented Reality System and Method for Multi-Person Mobile Interactive Use" announced by the Republic of China on April 11, 1996, is disclosed in the patent case: it includes two parts, The first part is a computer system that can handle augmented reality, and the other part is a user system owned by each user; the computer system that can handle augmented reality mainly has powerful computer image computing functions. The computer graphics data is converted into a three-dimensional virtual image and sent to the user system; the user system mainly includes a head-mounted display, a microphone and a handheld computer; the user can view the virtual image of the stereo through the head-mounted display, and use the microphone Or a handheld computer can communicate with other users. In the pre-patent case, only multiple people can evaluate and discuss the single target object, such as the virtual prototype of the car, but each user lacks the function of instant communication, and does not disclose the same object immediately. Interactive image transmission, such as feeding fish, teasing, watching, planting flowers and other interactions, is still not the best real-time interaction. SUMMARY OF THE INVENTION [0003] In view of the above, the current instant interaction method has the above-mentioned various kinds of defects, the present invention provides a method for combining the virtual virtual shared digital object of the video image, which is provided with A. One end captures a first real-world image; B. instantly transmits the first real-world image to more than one second end through the network; C. displays a first virtual image on the second end; D. The first virtual image is coupled to the first real image, and a first combined image is displayed on the second end. The method further includes: E. outputting a first control instruction 099137648 on the first end, form number A0101, page 4/24 pages 0992065616-0, and transmitting it to the second end through the network; F. at the second end A first combined picture corresponding to the change of the first control command is displayed. The step C is to display the first virtual image at the first end, and the step D is to display the first combined surface at the first end. The method further includes: E. outputting a first control command at the first end, and transmitting the first control command to the second end through the network; F. simultaneously displaying the change corresponding to the first control command at the first end and the second end A combination of noodles. The step A further captures a second real image on a second end, and the step B transmits the second real image to the first end through the network. The step C displays a first end at the first end. In the second virtual image, the step D further combines the second virtual image with the second virtual image to form a second combined image displayed on the first end. The method further includes: outputting a first control command to the first end, and transmitting the second control command to the second end through the network, and outputting a second control command to the second end, and transmitting the second control command to the second end through the network a first end; F. displaying a first combined picture corresponding to the change of the first control command at the second end, and displaying a second combined face corresponding to the change of the second control command at the first display. In the above step A, a digital audio is simultaneously captured, and the step B is to instantaneously transmit the digital audio through the network. In step D, the digital audio is played. The control command in the step E includes the digital audio, and the step F is played. Corresponding to the changing digital audio. The above combined screen content shows a dynamic and/or static change of an object. The virtual image includes a change of a 2D planar image and a 3D stereoscopic image, or a change of a full 2D planar image, or a change of a full 3D stereoscopic image. Form No. A0101 Page 5 of 24 201220818 The partial area of the above combined surface that does not show the virtual image change is transparent, and the real image is displayed in the local area. The invention has the following advantages: 1. The invention mainly utilizes virtual virtual aquarium, virtual landscape, virtual painting or virtual pet to cooperate with the real image generated by the entity, and simultaneously generates interaction through the network, thereby cultivating emotions. To relieve stress or to resolve loneliness, it is especially suitable for long-distance care and interaction between elderly people living alone and their relatives, between parents and between family members. 2. The present invention can also issue control commands in the formed combined picture to generate a common feeding, weeding, organizing an aquarium, greeting, gesturing, waving, planting flowers, painting, bird watching, dialogue or singing, etc. The combination of changes, in order to enhance the effect of interaction. 3. The present invention can play interactive digital audio through the sounding unit, thereby improving the fun and variability of the interaction and achieving the interactive effect. 4. The invention can also be applied to the elderly who are mentally retarded at a long distance and inconvenient to move. Users who are incapable of self-determination and their caregivers can express their feelings, relieve stress or resolve loneliness by expressing condolences or care through face and audio. [First Embodiment] Referring to the first and second figures, the first embodiment of the present invention includes the following steps: A. capturing a first real image on a first end and a first digital audio, and a second real image and a second digital audio at the second end: a first user (3) is connected to the first processing unit of the first end (1) And using a first image capturing unit (11) to capture a first virtual image of the first user 099137648 Form No. A0101, page 6 of 24, 0992065616-0 201220818 (3), to form a first real image, The first processing unit (1) can be a computer, a notebook computer, a tablet computer, and the first image capturing unit (11) can be a digital camera, a digital camera or a mobile phone, and the first audio capturing unit is used. (12) capturing a sound generated by the first user (3) to form a first digital audio, the first audio capturing unit (12) being a microphone, a digital sound recorder or a voice recorder, and at least one or more The second end, the number of which can be based on the number of different users Plus, there is no limit on the number of people. One or more second users (4) are attached to the second processing unit (2) at the second end, using a second image capture > single (21)撷Taking a second user (4) to form a second real image, the second processing unit (2) can be a computer 'note computer, a tablet computer, and the second image capturing unit (21) The system can be a digital camera, a digital camera or a mobile phone, and a second audio capture unit (22) captures the sound emitted by the second user to form a second digital audio, the second audio capture unit ( 22) can be a microphone, digital recorder or voice recorder. B. transmitting the first real image and the first digital audio to the second end through the network, and transmitting the second real image and the first digital audio to the first through the network One end: the first processing unit (1) of the first end transmits the captured first real-world image and the first digital audio to the second processing unit of the second end through a network (5) ( 2) The second processing unit (2) of the second end also transmits the captured second real-world image and the second digit audio to the first processing unit of the first end through the network (5) ( 1). C. displaying, at the second end, a first virtual image, and displaying a second virtual image at the first end: and the first processing unit (1) of the first end is 099137648, form number A0101, page 7 24 pages 0992065616-0 201220818 Through the network (5) or directly connected to - Zike 卞厍 (6), and received the - industry image, and displayed on the n indicator unit (13), the display unit (10) can be - LCD screen, shadow screen, virtual image system can be a virtual aquarium, virtual μ brother - accounted for t-whip wind, virtual paintings, virtual pets and other objects (7), and the second second processing unit - the second sample is received through the network (5) or directly connected to the database (8), and the second virtual image is received and displayed on a second display unit, and the second display unit (2) can be - LCD screen or projection Front, and =: the content of the virtual image is the same as the virtual aquarium phase, virtual landscape, virtual painting or virtual peek object (?) of the second virtual image, which is not only in the object (7) financial point The difference is only the present invention. The object (7) in an embodiment is In the case of a virtual aquarium, the first virtual scene of the above-mentioned Guhai image and the second virtual image system include changes in a plane image and 3D stereo image of the object (7), or changes in full 2D plane image or full 3D. The change of the stereoscopic image, wherein the 2D planar image can be a flat fixed object such as aquatic grass, rock or feed commonly found in the aquarium, and the stereoscopic image can be a stereoscopic mobile creature such as a fish or a dragonfly. 099137648 D. The first virtual image is combined with the first real image to form a first combined picture displayed on the second end, and the first digital video is played, and the second virtual image is combined with the first virtual image. Before the second real image, a second combined picture is displayed on the first end, and the second digital audio is played: the second virtual image is used by the second processing unit (?) at the second end And processing the first real-world image, and displaying on the first display unit (23), and processing the local area of the first virtual image change in the second display unit (23) Be transparent (as shown in the third figure), the object (?) in the first virtual image is numbered A0101, page 8 / 24 pages 0992065616-0 201220818 [eg fish, plants or rocks are indicated by diagonal lines) For the convenience of the local area other than the description, the first real image (for example, the physical image of the first user (3), as shown in the fourth figure) can be displayed to form a first combined picture. , that is, the second display The unit (23) presents a visual effect before the first virtual image is combined with the first real image, and by the second end, it can be simulated as if the first user (3) is standing at The other side of the aquarium is used to view the fish; and the first end uses the first processing unit (1) to process the second virtual image and the second real image, and the first display unit (13) displaying Ο, and the partial area of the second virtual image change is not displayed on the screen of the first display unit (13), the processing is transparent to display the second real image, thereby forming a The second combined picture can display the visual effect of the second virtual image system before the second virtual image is combined on the first display unit (13), and the first end view can simulate It is like a second user (4) standing on the other side of the aquarium to see the fish (as shown in the sixth figure). E. outputting a first control command to the first end, and transmitting the second control command to the second end through the network, and outputting a second control command to the second end, and immediately transmitting the first control command to the first end through the network End: When the first user (3) of the first end passes a first keyboard (14), a first mouse (15) or other digital pen, tablet, touch screen, and somatosensory interaction detection An input device such as a component inputs a control action, and after processing the operation by the first processing unit (1), outputs a first control command, which is a function of simulating a feed and feeding the fish through the network (5) is transmitted to the second processing unit (2), and the second user (4) of the second end is also permeable to a second keyboard (24), a second mouse (25) or the like. Digital pen, number 099137648 Form No. A0101 Page 9 / Total 24 page 0992065616-0 201220818 : Input device for touch screen, body interaction detection component, wheel, control action of fish, via second processing unit (2) processing the second output - the second control command, and transmitting to the first through the network (5) Processing unit (1). Displaying a first combined picture and the first-digit audio corresponding to the change of the first control command at the second end, and displaying a second combined picture corresponding to the change of the second control command at the first end and the Second digit audio: after receiving the first control command, the second processing unit (2) can be based on the content of the first control command (ie, the action of simulating the feed), and the second display unit (23) ) shows a relative change in combination with the face (as shown in Figure 5), which shows that the first user (8) holds a (four) can of pouring the feed and the fish is competing for food. The second processing unit (2) also transmits the received first number 2 audio through the second sounding unit (26>, and the second sounding unit (26) can be the remaining eight or the earphone, and the first A processing unit (1) also displays the second control command received according to the content of the second control command (the same as the action of simulating the feed), and displays a relative on the first display unit (13). The first combination of changes, that is, the second knot In the face, the same will show the picture of holding a feed can and pouring out the fish. The first processing unit (1) will also pass the received first digit audio through a first sounding unit (16). The playing unit, the first sounding unit (16) can be a speaker or an earphone, such that the user (3) of the first end and the second user (4) of the second end can simultaneously feed through the network. The interaction of fish, and then cultivate emotions, relieve stress or resolve loneliness, etc., is especially suitable for long-distance care and interaction between elderly people living alone and their relatives, between parents and between family members, and in this embodiment. 099137648 09920 Form No. A0101 Page 10 of 24 201220818 Objects (7) are not limited to virtual aquariums, but can also be shared in a virtual landscape, or shared together - virtual paintings 'or common copper breeding - virtual pets and other objects (7) Yes, so the above control actions are not limited to the interaction of feeding fish. They can also be used for weeding, organizing aquariums, greeting, making gestures, waving 'flowers, painting, bird watching, and even both sides. dialogue , singing songs, etc., can achieve the effects of the above interaction.
本發明第二實施例，請參考並沿用第—圖及第二圖 所示，係適用於單方面進行關懷互動，即僅其中第一端 之第一使用者（3)具有第一影像操取單元（11)，而第二端 之第一使用者（4 )通.常係為一失智老人:、行動不便或是無 自主行為能力之使用者，故並不需要具有第二影像擷取 單元（12)者，其係包括有下列步驟：The second embodiment of the present invention, which is referred to and used in the first and second figures, is suitable for unilateral care interaction, that is, only the first user (3) of the first end has the first image manipulation Unit (11), and the first user (4) of the second end is often a demented old man: a user with limited mobility or autonomous behavior, so there is no need to have a second image capture Unit (12), which includes the following steps:
A. 於一第一端擷取一第一實境影像，並同時操取一 數位音訊：一第一使用者（3)係於該第一端之第一處理單 元（1) ’利用一第一影像掏取單元（11)操取第一使用者 (3)之實體影像而形成一第一實境影像，另利用一第一 音訊操取單元（1 2).擷取該第一使用者（3)所發出之慰問或 關懷之聲音形成一第一數位音訊。 B. 透過網路將該第一實境影像及該數位音訊即時傳 遞至一個以上之第二端：該第一端之第一處理單元（丨）透 過一網路（5)將所擷取之第一實境影像及第一數位音訊傳 遞至第二端之第二處理單元（2)。 C. 於該第二端顯示一第一虛擬影像：而該第二端之 第二處理單元（2)係透過網路（5)或直接連線到一資料庫 (6) ’而接收到一第一虛擬影像，並顯示於一第二顯示單 元（23)上，而該第〆虛擬影像之内容係可為一虛擬水族 099137648 表單編號A0101 第11頁/共24頁 0992065616-0 201220818 相、虛擬風景、虛擬晝作或虛擬寵物之物件。 D·使該第-虛《彡像結合於實㈣像之前， 而形成-第-結合畫面顯示於該第二端，並播放該數位 音訊.於該第二端利用該第二處理單元⑴將該第—虛擬 影像及該第—實聽像進行處料算，並於該第二顯ζ 單元（23)上顯示，於該第二顯示單元（23)晝面中未顯示 出該第-虛擬影像變化之局部區域則處理成為透明〔如 第三圖所示〕’該透明之局部區域係可供顯示出該第— 實，影像，藉以構成—第一結合畫面，即可於該第二顯 示單元（23)上呈現出該第—虛擬影像係結合於該第—實 境影像之前的視覺效果，以模擬出宛如第一使用者（4 站立於一水族箱另一方賞魚之畫面。 Ε.於該第-端輸出—第一控制指令’並透過網路即 時傳遞至第二端：當第—端之第—使用者⑻透過一第一 鍵盤04)、-第-滑鼠〇5)或其他之數位筆數位板、 觸控式螢幕、體感互動㈣元件等輪人裝s置輸入一控 制動作，經由第一處理單元（1)處理運算後，輸出-二 控制指令，該第一控制指令係可為一揮手、打招呼、擁 抱、撫摸或關懷之動作，並透過網路⑸傳遞到該第二處 理單元（2)。 F.於該第二端顯示相對應該第一控制指令變化之第 一結合畫面及變化之數位音訊：該第二處理單元⑺接收 到該第-控制指令後，即可根據該第—控制指令之内容 ’而於該第二顯示單元⑵)上顯示出—相對變化之第一 結合畫面，該第一結合畫面中會顯示出第-使用者⑶隔 099137648 =1Γ 一揮手 '打”、擁抱、撫撰或關懷之畫 表卓編號Α0101 第12頁/共24頁 09920656] 201220818 面，同時該第二處理單元（2)亦會將所接收到之第一數位 音訊，透過一第二發聲單元（26)播放出慰問或關懷的言 語，藉以透過網路對於遠距離之失智老人、行動不便或 是無自主行為能力之使用者，表達慰問或關懷，藉以達 到培養情感、疏緩壓力或排解寂寞等之功效。 本發明第三實施例，係衍生自上述第二實施例，並 請參考及沿用第一圖及第二圖所示，同樣適用於單方面 進行關懷互動，即僅其中第一端之第一使用者（3)具有第 一影像擷取單元（11)，而第二端之第二使用者（4)相同為 〇 一失智老人、行動不便或是無自主行為能力之使用者， 其並不需要具有第二影像擷取單元（12)者，係包括有下 列步驟： A. 於一第一端擷取一第一實境影像，並同時擷取一 數位音訊：一第一使用者（3)係於該第一端之第一處理單 元（1)，利用一第一影像擷取單元（11)擷取第一使用者 (3)之實體影像而形成一第一實境影像，另利用一第一 音訊擷取單元（12)擷取該第一使用者（3)所發出之慰問或 ^ 關懷之聲音形成一第一數位音訊。 B. 透過網路將該第一實境影像及該數位音訊即時傳 遞至一個以上之第二端：該第一端之第一處理單元（1)透 過一網路（5)將所擷取之第一實境影像及第一數位音訊傳 遞至第二端之第二處理單元（2)。 C. 於該第二端顯示一第一虛擬影像，同時於該第一 端顯示一第二虛擬影像：而該第二端之第二處理單元（2) 係透過網路（5 )或直接連線到一資料庫（6 )，而接收到一 第一虛擬影像，並顯示於一第二顯示單元（23)上，而該 099137648 表單編號A0101 第13頁/共24頁 0992065616-0 201220818 =一虛擬影像之内容係可‘虛擬水族箱、虛擬風景、 虛擬畫作或虛擬寵物之物件⑺，同時該第一虛擬影像亦 顯不於該第一端之第一顯示單元（13)上。 D·使該第—虛㈣㈣合於實妓像之前， 而形成一第一結合畫面顯示於該第—端及第二端，並播 Γ數位音訊:於該第二端利用該第二處理單元⑺將該 弟一虛擬影像及該第—實鄉像進行處理運算，並於該 第二顯示單元（23)上顯示’於該第二顯示單元⑽書面 中未顯示出該第—虛擬影像變化之局部區域則處理成為 透明〔如第三圖所示〕，該透明之局部區域係可供顯示 出該第一實境影像，藉以構成一第一結合晝面，即可於 該第二顯示單元（23)上呈現出該第一虛擬影像係結合於 該弟一實境影像之前的視覺效果，以模擬出宛如第一使 ^者⑻係站立於一水族箱另一方賞魚之畫面，同時該第 —結合畫面亦顯示於該第—端之第—顯示單元（⑶上。 E.於該第-端輸出-第“控制指令’並透過網路即 時傳遞至第二端：當第-端之第-使甩者⑶透過一第一 鍵盤⑽、-第—滑鼠⑽或其狀數位筆、數位板、 觸控式螢幕、體感互動γ貞測元件等輸人裝置輸入一控 制動作，經由第—處理單元⑴處理運算後，輸出一第一 控制指令’該第—控制指令係可為一揮手、打招呼、擁 抱、撫摸或關懷之動作’並透過網路⑸傳遞到該第二處 理單元（2)。 099137648 F.於該第鳊及第二端同時顯示相對應該第一控制 指令變化之第-結合畫面及變化之數位音訊：該第二工處 理單元⑺接收到該第一控制指令後，即可根據該第一控 表單編號趣01 第u頁/共24頁 0992065616 201220818 制指令之内容，而於該第二顯示單元（23)上顯示出一相 對變化之第一結合畫面，該第一結合畫面中會顯示出第 一使用者（3)隔著水族箱作出一揮手、打招呼、擁抱、撫 摸或關懷之畫面，同時該第二處理單元（2)亦會將所接收 到之第一數位音訊，透過一第二發聲單元（26)播放出慰 問或關懷的言語，同時該變化之第一結合晝面係顯示於 該第一端之第一顯示單元（13)上，而該變化之第一數位 音訊則同時於該第一端之第一發聲單元（16)進行播放， 藉以透過網路對於遠距離之失智老人、行動不便或是無 〇 自主行為能力之使用者，表達慰問或關懷，藉以達到培 養情感、疏緩壓力或排解寂寞等之功效。 惟，以上所述僅為本發明其中之一最佳實施例，當 不能以此限定本發明之申請專利保護範圍，舉凡依本發 明之申請專利範圍及說明書内容所作之簡單的等效變化 與替換，皆應仍屬於本發明申請專利範圍所涵蓋保護之 範圍内" 【圖式簡單說明】 〇 W [0005] 第一圖係為本發明操作步驟之簡單流程圖。 第二圖係為本發明操作狀態之架構示意圖。 第三圖係為本發明於結合畫面中未顯示虛擬影像變 化之局部區域係為透明狀態之示意圖。 第四圖係為本發明第一虛擬影像結合於第一實境影 像之前而形成一第一結合畫面之示意圖。 第五圖係為本發明相對應該控制指令產生變化的結 合畫面之示意圖。 第六圖係為本發明第二虛擬影像結合於第二實境影 099137648 表單編號 A0101 第 15 頁/共 24 頁 0992065616-0 201220818 像之前而形成一第二結合晝面之示意圖。 【主要元件符號說明】 [0006] ( 1 ) 第一處理單元 (1 1 )第一影像擷取單元 (1 2)第一音訊擷取單元 (1 3)第一顯示單元 (1 4)第一鍵盤 (1 5 )第一滑鼠 (1 6)第一發聲單元 (2) 第二處理單元 (2 1 )第二影像擷取單元 (2 2)第二音訊擷取單元 (2 3)第二顯示單元 (2 4)第二鍵盤 (2 5)第二滑鼠 · (2 6)第二發聲單元 (3) 第一使用者 (4) 第二使用者 (5 ) 網路 (6) 資料庫 (7 ) 物件 099137648 表單編號A0101 第16頁/共24頁 0992065616-0A. capturing a first real image at a first end and simultaneously fetching a digital audio: a first user (3) is tied to the first processing unit (1) of the first end An image capture unit (11) captures a physical image of the first user (3) to form a first real-world image, and uses a first audio operation unit (1 2) to retrieve the first user. (3) The voice of condolences or care that is issued forms a first digit of audio. B. Instantly transmitting the first real-world image and the digital audio to more than one second end through the network: the first processing unit (丨) of the first end picks up the network through a network (5) The first real image and the first digit audio are transmitted to the second processing unit (2) at the second end. C. displaying a first virtual image on the second end: and the second processing unit (2) on the second end receives the first through the network (5) or directly connected to a database (6) The first virtual image is displayed on a second display unit (23), and the content of the third virtual image can be a virtual aquarium 099137648 Form No. A0101 Page 11 / Total 24 Page 0992065616-0 201220818 Phase, virtual Scenery, virtual creations or virtual pet objects. D. combining the first virtual virtual image before the real (four) image, and forming a -first-combined picture displayed on the second end, and playing the digital audio. The second processing unit (1) is used at the second end The first virtual image and the first real image are calculated and displayed on the second display unit (23), and the first virtual state is not displayed in the second display unit (23) The partial area of the image change is processed to be transparent (as shown in the third figure). The transparent partial area is used to display the first real image, thereby forming a first combined picture, which can be displayed on the second display. The unit (23) presents a visual effect before the first virtual image is combined with the first-reality image to simulate a picture like the first user (4 standing on the other side of the aquarium). Outputting the first control command at the first end and transmitting it to the second end through the network: when the first end - the user (8) passes through a first keyboard 04), - the first - mouse 〇 5) or Other digital pen tablet, touch screen, somatosensory interaction (four) components, etc. Into a control action, after processing the operation by the first processing unit (1), outputting a second control command, which may be a wave, greet, hug, touch or care action, and transmitted through the network (5) To the second processing unit (2). F. displaying, on the second end, a first combined picture and a changed digital audio corresponding to the change of the first control command: after receiving the first control instruction, the second processing unit (7) may be based on the first control instruction The content 'and the second display unit (2)) displays a first combined picture of relative change, and the first combined picture displays the first user (3) separated by 099137648 =1 Γ a wave of 'hitting', hugs, caress The essay or care picture number Α 0101 12 pages / 24 pages 09920656] 201220818 face, while the second processing unit (2) will also receive the first digital audio through a second sound unit (26 ) Play a message of condolences or care to express condolences or care to the remote, demented elderly, inconvenient or involuntary users through the Internet, so as to cultivate emotions, relieve stress or resolve loneliness. The third embodiment of the present invention is derived from the above second embodiment, and refers to and follows the first figure and the second figure, and is also applicable to the unilateral care interaction, that is, only The first user (3) at the first end has a first image capturing unit (11), and the second user (4) at the second end is the same as a demented old man, inconvenient or inactive. The user of the capability does not need to have the second image capturing unit (12), and includes the following steps: A. capturing a first real image at a first end and simultaneously capturing a digital audio a first user (3) is attached to the first processing unit (1) of the first end, and uses a first image capturing unit (11) to capture a physical image of the first user (3) to form a The first real-time image is further captured by a first audio capturing unit (12) to capture a first-digit audio signal from the first user (3). The first real-world image and the digital audio are immediately transmitted to more than one second end: the first processing unit (1) of the first end transmits the captured first real-world image through a network (5) and The first digital audio is transmitted to the second processing unit (2) at the second end. C. displaying a first virtual image on the second end, Simultaneously displaying a second virtual image on the first end: the second processing unit (2) of the second end receives the first through the network (5) or directly to a database (6) a virtual image displayed on a second display unit (23), and the 099137648 form number A0101 page 13 / 24 pages 0992065616-0 201220818 = a virtual image content can be 'virtual aquarium, virtual landscape, a virtual painting or an object of a virtual pet (7), and the first virtual image is also not displayed on the first display unit (13) of the first end. D· is formed by combining the first virtual (four) (four) before the real image A first combined picture is displayed on the first end and the second end, and the digital audio is broadcasted: the second processing unit (7) is used to process the virtual image and the first real image in the second end. And displaying on the second display unit (23) that the local area of the first virtual display unit (10) is not transparent, the processing is transparent (as shown in the third figure), the transparent The local area is available to display the first real The image, by which a first combined surface is formed, can present a visual effect on the second display unit (23) before the first virtual image is combined with the real image, to simulate the first Let the person (8) stand in the picture of the fish in the other side of the aquarium, and the first combined picture is also displayed on the first display unit ((3). E. at the first end of the output - the "control command" and instantly transmitted to the second end through the network: when the first end - the latter (3) through a first keyboard (10), - the first mouse (10) or The input device such as the digital pen, the digital tablet, the touch screen, the somatosensory interactive gamma detecting component inputs a control action, and after processing the operation by the first processing unit (1), outputs a first control command 'the first control' The command system can be a wave, greet, hug, touch or care action 'and transmitted to the second processing unit (2) through the network (5). 099137648 F. simultaneously display the corresponding first and second ends Controlling the change of the command-combined picture and the changed digital audio: after receiving the first control command, the second processing unit (7) can be numbered according to the first control form. 01 page u / 24 pages 0992065616 201220818 The first display unit displays a relatively changed first combined picture on the second display unit (23), and the first combined picture shows that the first user (3) makes a wave through the aquarium Greeting, hug, caress Or the care picture, and the second processing unit (2) also plays the first digital sound received through a second sounding unit (26) to express the condolences or care words, and the first combination of the changes The facet is displayed on the first display unit (13) of the first end, and the changed first digit audio is simultaneously played on the first sounding unit (16) of the first end, so as to Long-distance, demented elderly, inconvenient or involuntary self-perpetus, express condolences or care, so as to achieve the effect of cultivating emotions, relieving stress or relieving loneliness. However, the above is only the present invention. In the preferred embodiment, the scope of the claims of the present invention is not limited thereto, and the simple equivalent changes and substitutions made by the scope of the invention and the contents of the specification should still fall within the scope of the patent application of the present invention. Within the scope of the covered protection " [Simple Description] 〇W [0005] The first figure is a simple flow chart of the operation steps of the present invention. The second figure is the operation of the present invention. The third figure is a schematic diagram of the local area in which the virtual image change is not displayed in the combined picture in the present invention. The fourth picture is the first virtual image of the present invention before the first virtual image is combined with the first virtual image. A schematic diagram of a first combined picture is formed. The fifth figure is a schematic diagram of a combined picture of the invention corresponding to the change of the control instruction. The sixth figure is the second virtual image of the present invention combined with the second real image 099137648 form number A0101 Page 15 of 24 0992065616-0 201220818 A schematic diagram of forming a second combined surface as before. [Main component symbol description] [0006] (1) First processing unit (1 1 ) First image capture Unit (12) first audio capturing unit (13) first display unit (14) first keyboard (15) first mouse (16) first sounding unit (2) second processing unit ( 2 1) second image capturing unit (2 2) second audio capturing unit (2 3) second display unit (2 4) second keyboard (2 5) second mouse (2 6) second vocal Unit (3) First User (4) Second User (5) Network (6) Information (7) 099 137 648 objects Form Number A0101 Page 16 / Total 24 0992065616-0