45 7 51 A7 B7 經濟部智毽財產局員工消費合作社印製 五、發明說明（ 發明背景 1.技術領域： 本發明概言之係關於觀眾參與方法。尤其，本發明係關 於一種運用感覺回授來控制一表現岸列之方法及系統。更 明確地説’本發明係關於一種用以提供内隱式觀眾回授以 適應控制一循序表現之方法及系統。 2 .相關技術説明 互動/適應型電影需要觀眾之某種輸入，而此傳統上是 藉由要求觀眾回答問題或選擇下一場景之方向來達成。因 爲其需要有知覺地選擇一特定選項（指向選項A或選項B， 例如）以及一複雜之實體操作（指向，例如），所以這是一 種干擾型事件。用於觀眾與一表現之互動之該等方法因此 對於觀眾之表現經歷造成高度干擾。當互動式表現是用以 娛樂觀眾時’這項問題特別嚴重。若要自一候樂表現，例 如電影，獲得最佳之娛樂效果，觀眾必須能 注於表現。運用目前之互動式電影技術，由== 原因，非常不易達成此項目標。 自前文應可理解需要一種方法及系統，以運用來自觀眾 组成份子之感覺回授來控制一循序表現。因 序列進行適應以最佳符合觀眾组成份子對於表現之内阳式 反應’所以此種方法及I统，如果受到建構，將非常有 用。 發明概述 因此本發明之-目標是提供-改良之觀眾參與方法^ 本纸張尺度適用中國國家標準（CNS)A4規格（210 X 297公釐） --------— 丨----------訂---------- (猜先間讀背面之注意事項再填寫本頁) ^^751 A7 B7 經濟邹智慧財產局員工消費合作社印製 五、發明說明（2 本發明之另一目標是提供—運用咸坪 序列之方法及系統。 ^覺回授以控制-表現 本發明之另一目標是提供一 S Γ7 Λ ^ 万法及系統，以提供内隱 式觀眾回抆來適應控制一表現序列。 =明：何達成前述及其他目標一種根據來自觀眾 隱式回授以適應修改一循序表現來控制該循 ^ ^ ^ 又j揭不首先，在一表現期間，一 。。自觀眾组成份子之内隱式觀眾回授之感覺反應受 Η;、測接著，内隱式觀眾回授傳送至一表現序列控制 器。其後’内隱式觀眾回授是藉由指定該表現在表現序列 控制器内應如何進行來受到特徵化。最後，且，回應於内 隱式回k特欲化’㉟表現受到修改，以致該表現可以即時 方式來循序適應’且可最佳符合觀眾組成份子對於該表現 之感受及反應。 圖式簡單説明 *據信爲本發明之特徵之新奇特點陳述於附加之申請專利 範圍。但是當連同附圖來閲讀—示範實例之下列詳細説明 應可最易瞭解本發明本身，以及本發明之—較佳使用模 式，其他目標及優點，其中· 圖1展示一用以建構本發明之方法及系統之資料處理系 统的簡化圖形： 圖2描述一可用於本發明之一較佳實例之感覺回授迴圈 的簡化流程圖：且 圖3描述一些功能個體及裝置之簡化方塊圖，且該等功 '5- 請 先 閲 讀 背 面 之 注 意 事 項 再 填 I裝 頁 I I I I I I I 訂 線 445751 經濟部智慧財產局員工消費合作社印製 A7 B7 五、發明說明（3) 能個體及裝置形成一根據本發明之一較佳實例之適應表現 序列控制系統。 較佳實施例詳細説明 本發明之方法及系統同時運用下列二種型態之内隱式觀 眾回授：對於一表現序列之隨意及非隨意反應。可用於本 發明之一實例之隨意反應包含，但不限於：眼睛移動，手 勢’呼吸速率，等等。根據本發明所用之非隨意反應包含 血壓及心跳速率之變化，出汗，等等。一些可測量之生理 反應起因於對於一表現之隨意及非隨意反應之組合。此種 參數之一範例是眼睛移動。更明確地説，眼睛凝視追蹤在 獲得關於一觀眾組成份子對於—表現之隨意（有知覺）及非 隨意（無知覺）反應之廣泛資訊上可非常有用。眼睛凝視追 蹤技術目前是一快速發展技術之—部份，且在此提及以供45 7 51 A7 B7 Printed by the Consumer Cooperatives of the Intellectual Property Office of the Ministry of Economic Affairs. 5. Description of the invention (BACKGROUND OF THE INVENTION 1. Technical Field: The outline of the invention is about audience participation methods. In particular, the invention is about using sensory feedback Method and system for controlling a performance bank. More specifically, the present invention relates to a method and system for providing implicit audience feedback to adapt to controlling a sequential performance. 2. Description of related technologies Interactive / adaptive Movies require some kind of input from the audience, which is traditionally achieved by asking the audience to answer questions or choose the direction of the next scene. Because it requires the conscious choice of a specific option (pointing to option A or option B, for example) and A complex physical operation (pointing, for example), so this is a distracting event. The methods used for the interaction of the audience with a performance therefore cause a high degree of interference to the performance experience of the audience. When the interactive performance is used to entertain the audience This problem is especially serious. To get the best entertainment from a musical performance, such as a movie, the audience must Focus on performance. Using the current interactive film technology, it is very difficult to achieve this goal because of ==. It should be understood from the foregoing that a method and system are needed to use sensory feedback from audience members to control a sequential performance . Because the sequence adapts to best fit the audience's internal positive response to performance, so this method and system will be very useful if constructed. SUMMARY OF THE INVENTION Therefore, the objective of the present invention is to provide an improved audience. Participation method ^ This paper size is applicable to China National Standard (CNS) A4 (210 X 297 mm) ---------- 丨 ---------- Order ------ ---- (Guess to read the notes on the back before filling out this page) ^^ 751 A7 B7 Printed by the Consumer Cooperative of the Economic Zou Intellectual Property Bureau V. Invention Description (2 Another objective of the present invention is to provide-using salt Method and system of ping sequence. ^ Perceptual feedback for control-representation. Another object of the present invention is to provide an S Γ7 Λ ^^ method and system to provide implicit audience feedback to adapt to control a performance sequence. = 明: How to achieve one of the foregoing and other goals According to the implicit feedback from the audience to adapt to modify a sequential performance to control the sequence ^ ^ ^ It is not revealed first, during a performance period, one ... The implicit audience feedback from the audience members is affected by the sensory response ;, Next, the implicit audience feedback is transmitted to a performance sequence controller. Then the 'implicit audience feedback is characterized by specifying how the performance should behave in the performance sequence controller. Finally, And, in response to the implicit k-specific desire, 'the performance has been modified so that the performance can be adapted in a timely manner' and can best match the audience members ’feelings and reactions to the performance. The novel features of the letter as a feature of the invention are set forth in the appended patent application. But when read in conjunction with the drawings-the following detailed description of the exemplary examples should make it easier to understand the invention itself, as well as the preferred mode of use, other objectives and advantages of the invention, of which: Figure 1 shows a structure used to construct the invention Simplified diagram of the data processing system of the method and system: Figure 2 depicts a simplified flowchart of a sensory feedback loop that can be used in a preferred embodiment of the present invention: and Figure 3 depicts simplified block diagrams of some functional entities and devices, and These functions' 5- Please read the notes on the back before filling in I III. IIIIIII 445751 Printed by the Consumers ’Cooperative of the Intellectual Property Bureau of the Ministry of Economic Affairs A7 B7 V. Description of the invention (3) Individuals and devices can be formed according to the present invention A better example of an adaptive performance sequence control system. Detailed description of the preferred embodiment The method and system of the present invention simultaneously utilize the following two types of implicit audience feedback: random and non-random responses to a performance sequence. Random responses that can be used in one example of the present invention include, but are not limited to: eye movement, gesture ' breathing rate, and so on. Involuntary responses used in accordance with the present invention include changes in blood pressure and heart rate, sweating, and the like. Some measurable physiological responses result from a combination of casual and non-random responses to a performance. An example of such a parameter is eye movement. More specifically, eye gaze tracking can be very useful in obtaining extensive information about an audience's constituents' casual (perceptual) and non-arbitrary (unconscious) responses to performance. Eye gaze tracking is currently part of a rapidly evolving technology and is mentioned here for
參考D 現在請參看諸圖且尤其請參看圖〗，該圖描述一可有利 運用本發明之資料處理系統10之簡化圖形。圖1之資料處 理系統I 0是一包含一電腦之所有功能元件及其之相關硬 體之组態。資料處理系統！ 0包含一中央處理單元（CPU) 2 4，例如傳統之微處理器，與一些藉由系統匯流排2 6來 互連之其他單元^ CPU 24包含資料處理系統1 0之—部 份’且該部份控制整個電腦系統之運作，其中包括執行包 含於一特定電腦程式之算術及邏輯功能。雖然未展示於圖 1，CPU，例如CPU 24，一般包含一控制單元，以組織— 電腦記憶體之資料及程式儲存，並轉移資枓及其他資訊於 -6- 本紙張尺度適用中國國豕標準（CNS)A4規格（2】0 X 297公发） (請先閱讀背面之注意草項再填寫本頁> * ---------訂---I — — — — 4 4 5 7 5 Ί Α7 ______Β7___ 五、發明說明（4 ) 電腦系統之各種元件之間。此種CPU也通常包含一算術單 元，以執行算術及邏輯運算，例如加法，比較，乘法，等 (請先閱讀背面之注意事項再填寫本買) 等。 梭濟郤智慧財產局員工消費合作杜印製 資料處理系統1 0進一步包含隨機存取記憶.體（RAM、 28 ’惟讀記憶體（ROM) 30，顯示轉接器3 2以連接系統匯 流排26至顯示裝置14，與輸入/輸出轉接器34以連接週 邊裝置（例如磁碟及磁帶機33)至系統匯流排26。RAM 28 是一種設計成爲儲存於其之資料之位置無關於内容的記憶 體。而且，RAM 28之任何位置可直接受到存取，而無需 自開端開始存取。R0M 30是一種永久保存資訊之記憶 體，且電腦之程式或正常運作無法更改其所儲存之資訊。 顯示裝置丨4是資料處理系統1〇之視覺輸出。顯示裝置 可爲在電腦硬體技術領域爲系所知之陰極射線管（crt) 型視訊顯示器。但是，若使用可攜式或筆記型電腦，則液 晶顯示（LCD)型或氣相電梁型平面顯示器可取代顯示裝置 M。資料處理系統]。進一步包含使用者介面轉接㈣， 以連接鍵盤16，滑鼠20，揚聲器38，麥克風“ ’及^ 其他使用者介面裝置’例如觸摸螢幕裝置（未受到展示” 至系統E流排26。通訊轉接器42可用以連接資料處理系 統1〇至電子感測器，例如參照圖2之感覺回授系統所述之 裝置。雖然資料處理系統1〇如圖所示只包含單—㈣及 單一系统醒流排，應可瞭解衣發明同樣適用於 統：具有多個CPU之電m # j ” 只具有依照不同方式來執 行不同功能之多個匯流排之電腦系統。Reference D. Reference is now made to the drawings, and in particular to the drawings, which depict a simplified diagram of a data processing system 10 that can be advantageously used with the present invention. The data processing system I 0 in FIG. 1 is a configuration including all functional elements of a computer and its related hardware. Data processing system! 0 contains a central processing unit (CPU) 24, such as a conventional microprocessor, and some other units interconnected by a system bus 26. ^ CPU 24 contains a data processing system 10 of-part of the Partly controls the operation of the entire computer system, including performing arithmetic and logic functions contained in a specific computer program. Although not shown in Figure 1, CPUs, such as CPU 24, generally include a control unit to organize-computer memory data and programs to store, and transfer resources and other information to -6- This paper standard applies Chinese national standards (CNS) A4 specifications (2) 0 X 297 public hair) (Please read the note on the back before filling in this page> * --------- Order --- I — — — — 4 4 5 7 5 Ί Α7 ______ Β7 ___ 5. Description of the Invention (4) Between various components of a computer system. This type of CPU also usually contains an arithmetic unit to perform arithmetic and logical operations such as addition, comparison, multiplication, etc. (Please read first Note on the back then fill in this purchase), etc. The Suoji Intellectual Property Bureau staff consumer cooperation Du printed data processing system 10 further includes random access memory. RAM (28, read-only memory (ROM) 30, The display adapter 32 is used to connect the system bus 26 to the display device 14, and the input / output adapter 34 is used to connect peripheral devices (such as disks and tape drives 33) to the system bus 26. The RAM 28 is a The location of the information stored there is no record of the content Moreover, any location of RAM 28 can be accessed directly, without having to start from the beginning. ROM 30 is a type of memory that permanently stores information, and the program or normal operation of the computer cannot change its stored information. Display The device 4 is the visual output of the data processing system 10. The display device may be a cathode ray tube (crt) type video display known in the field of computer hardware technology. However, if a portable or notebook computer is used, Then a liquid crystal display (LCD) type or a gas-phase electric beam type flat display can replace the display device M. Data processing system]. It further includes a user interface adapter to connect the keyboard 16, mouse 20, speaker 38, and microphone "' And ^ other user interface devices, such as a touch screen device (not shown), to system E bus 26. The communication adapter 42 can be used to connect the data processing system 10 to an electronic sensor, such as the sensory feedback shown in FIG. 2 Device described in the system. Although the data processing system 10 as shown in the figure only includes a single system and a single system wake-up stream, it should be understood that the invention is also applicable to the system. Electrically m # j "has only a CPU having a plurality of bus bars in accordance with a plurality of ways to perform different functions at different computer systems.
本纸張尺度適用中®國家標準(CKS)AI 4457 5 1 經濟部智慧財產局員工消費合作社印製 A7 __B7 五、發明說明（5 ) 資料處理系統10也包含一位於機器可讀取型媒體内之 介面’以指揮資料處理系統1 〇之運作β任何適當之機器 可凟取型媒體皆可包含該介面，例如RAM 28、ROM 30、 磁碟、磁帶、或光碟（最後三項位於磁碟及磁帶機33)。 任何適當之作業系統及相關介面（例如微軟視窗）皆可指揮 CPU 24。例如，AIX作業系統及ADC Wind〇ws視窗化系統 可指揮CPU 24。AIX作業系統是UNIX™作業系統之IBM建 構版本。其他技術也可與CPU 24 —起受到使用，例如觸 摸螢幕技術或語音控制。 熟悉本技術領域者應可理解圖1所描述之硬體可隨著特 足感覺回授處理應用而改變。例如，其他週邊裝置，例如 光碟媒體，音頻轉接器，或晶片程式設計裝置，例如在電 腦硬體技術領域，等等，爲眾所知之PAL*EPR0M程式 设计裝置，除了前述硬體以外，也可受到使用，或者可用 以取代前述硬體。除此之外，主記憶體4 4連接至系統匯 流排2 6，且包含控制程式4 6。控制程式4 6常駐於主記憶 體44以内’且包含-些指令，纟中該等指令，當執行於 CPU 24時，執行下文將參照圖2及圖3更詳細加以解釋之 運作3 値得注意的是，雖然本發明―直是，且將繼續是，針對 一功能完備之電腦系統之環境來加以説明，但是孰采本技 術領域者應可理解本發明能狗依照多種型態受到分佈以做 爲一程式產A，且纟論用巧際執行該分佈之特定種類之 信號承載媒體爲何，本發明同樣適用^信號承载媒體之範 --------1-----襄---------訂---------線 ί請先閲讀背面之沒专？^項再填寫本頁) 本纸張尺度刺帽@家料（CNS)A4規格（2lU 的7公坌） 445 7 5 A7 B7 6 五、發明說明（ 例包含：可記錄型媒體，例如軟碟片，硬碟機，及CD ROM，與傳輪型媒體，例如數位及類比通訊鏈結。 現在請參看圖2，該圖展示—根據本發明之揭示之感覺 回授介面系统200的簡化方塊圖。感覺回授介面系統2〇〇 包含一顯示裝置202，一序列控制器216，一資枓處理系 统212 ’與許多感測器。在圖2所描述之本發明之實例 中，該等感測器連接至一觀眾組成份子204，或相對於該 觀眾組成份子來置放，以致每一感測器可在對於觀眾组成 份子204之認識注意造成最少干擾之下偵測觀眾組成份子 204之生理反應。 一眼睛凝視追縱器214是相對於觀眾組成份子2 1 〇來置 放’以致觀眾組成份子21 0之眼睛移動可以即時方式受到 決定’且傳送至資料處理系統212。除了眼睛凝視資訊以 外，资料處理系統212收集來自心跳速率偵測器206，姿 勢感測器21 0與血壓感測器208之其他即時觀眾反應資 訊0應注意的是圖2所描述之該等感測器只構成一可能之 感測器組態，而不是一涵蓋在本發明之精神及範疇以内可 受到使用之所有可能種類感測器的表列。 顯示裝置202提供針對觀眾組成份子204之一循序表現之 視覺顯示。熟悉本技術領域者應可理解及瞭解運用其他感 覺輸出裝置，例如只使用音頻揚聲器，或連同一祝覺顯示 裝置，例如顯示裝置202，以建構本發明之方法及系統所 必需之延伸。在圖2所描述之範例中，循序表現玎爲一電 影之型態，且顯示裝置202提供該電影之視覺輸出於投影 -9- 本紙張尺度適用中國國家標準（CNS)A4規格（210x297公釐） -----— — — — — — I --------訂---------線' <請先Mijt背面之ii意事項再填寫本頁) 經濟部智慧財產局員工消費合作社印製 445751 經濟部智慧財產局員工消費合作社印製 A7 B7 五、發明說明（7 ) 螢幕上。在本發明之另一實例中，顯示裝置202可爲陰極 射線管或其他類似之顯示螢幕裝置。 在本發明之一較佳實例中，資料處理系統21 2包含常駐 於控制程式4 6之指令，以收集及處理來自感測器214， 2〇8 ’ 210，及2〇6之即時感覺回授。來自感測器214，2〇8， 210 ’及206之此資訊之收集可運用一輸入資訊轉接器，例 如圖1之通訊轉接器42，來完成。根據本發明之揭示，資 料處理系統所執行之處理包含解讀所收集之感覺回授資 訊。因爲無干擾性是感覺回授介面系統2〇〇之一重要目 標，感覺回授之解讀並非如同建構直接指令一般簡單之運 作，而該等直接指令可爲例如電腦作業系統回應於來自使 用者之直接輸入所建構之直接指令。因此，—常駐於資料 處理系統212以内之控制程式可包含適用於處理來自感測 器214，208，210及206之非外顯或内隱式指令的模糊邏輯 或確知型方法。此處理可包含藉由指定該表現應如何最佳 進行來使所接收之觀眾回授特徵化。在本發明之一較佳實 例中，此特徵化可包含指配一相對重要性値給所接收之每 一感覺反應。 在圖2所描述之本發明之示例性實例中，資料處理系統 2U以一種方式處理其自感測器2〇6，2丨4，2〇8及21 〇所接 收之信號，以致循序表現可以即時方式進行適應，丑最佳 符合觀眾組成份子204對於該表現之反應。在循序表現期 間，來自資料處理系統212之該等經處理信號傳送至表現 控制器216。雖然循序控制器216在圖2中是描述成爲一不 -10- 本紙張尺度適用中θ ®家標準（CNS)A4規格（210 X 297公爱） --- ----- - - - I · I I-----訂 *---— — — — — * (請先閱讀背面之注意事項再填寫本頁) 經濟部智慧对產局員工消費合作社印製 A7 ^—---— - R7___ 五、發明說明（8) 同個體，但是在衣發明之另一實例中’循序控制器216可 1含於資料處理系統212以内。循序控制器216包含一腳 本資料庫218，而腳本資料庫2〗8包含構成該循序表現之 絰編碼圖形資訊。此經編碼之表現資訊可儲存於磁性或光 學儲存媒體’以致其可根據自資料處理系統2U所接收之 經處理回授資訊來迅速受到存取及循序受到配置。在本發 月之重要方面，顯示於顯示裝置202之循序表現必須能 夠又到修改以回應執行時間之回授。在感覺回授裝置2⑼ 中，此修改是藉由資料處理系統212及循序控制器之 結合功能來達成。例如，循序控制器2】6可包含程式指 令，以預測一觀眾组成份子對於表現所提供之剌激之生理 回應。循序控制器2〗6可進一步包含指令，以使該等預測 之生理回應相關於觀眾組成份子之生理反應。 現在請參看圖3，該圖描述根據本發明之揭示之感覺回 杈迴圈300的流程圖。感覺回授迴圈3〇〇開始於步驟， 而步驟302描述一循序表現之啓始化。在圓3所展示之實 例中，此循序表現是一顯示於視覺顯示裝置，例如陰極射 線管（CRT)或等效機制，之视覺表現。步騾3〇2所^述之 啓始化可能需要展現一系列之視覺場景之第—序列。任何 目前場景之顯示皆展示於步驟304，且是藉由運用—表現 輸出裝置來達成’其中該表現輪出裝置可包含顯示裝置 202以及循序控制器216與腳本資料庫2 1 8。接著，如步驟 306所示，一觀眾纽成份子，例如觀眾组成份子2〇4之反 應受到偵測。此偵測可運用下列裝置來達成：感測器214， -11 - 本纸張尺度这用中國國家標準（CNS)A4規格（2〗0 X 297公釐） -----------I ---I----訂-------*--i (請先閱讀背面之注意事項再填寫本頁) 4 4 5 7 5 1 A7 B7 經 濟 部 智 慧 財 產 局 消 費 合 作 社 印 五、發明說明（9) 208 ’ 206 ’及210〈任一或全部，以及能夠偵測一生理回 應疋任何其他裝置，且該生理回應可解讀成為來自—觀眾 組成份子之内隱式回授。 步驟308描述在步驟306受到偵出以做為一生理反應之偵 出感覺回授資訊之處理。本發明之方法及系統之基本概念 疋自一觀眾組成份子取得之回授應是内隱式，以致可對觀 眾组成份子對於表現之認識注意造成最少之干擾。因此在 不使用外顯式指令以控制一循序表現之適應之下，步驟 308可運用某種人工智慧，例如模糊邏輯程式所運用之人 工智慧，以解讀原始感覺資料。此種解讀可包含指定該表 現應如何進行來使-特定反應特徵化。而且，如果同時憤 出多個反應，則步驟3〇8之解讀可包含指配一相對重要性 給每H最後’步驟31q展示如何選擇—場景，且兮 場景將緊接在步驟304所描述之目前場景之後。在本發明 之一較佳實例中，步驟 Τ ϋ又選擇包含根據步驟308所展 示之解讀來修改目前之場景。 本發明之較佳建構包含建構成為-受到程式設計以執行 本文所述之該（等）方法之電腦系統，與成為—程式產品。 根據该兔腦系統建構’用以執行本發明之方法及系统之浐 令集常駐於一儲存裝置，例如— / Β • —^足多电^系統 < 隨機存 取兄憶(RAM)。直到受到❿$ ▲、、 〗又至J包恥系統之要求為止，該指令 集可儲存成為另一電腦記憶體 產品，其中該磁碟機可包含十用於：術電腦程式 ^ » 瑕終用於磁碟機之可移去式 記憶體’例如光碟或軟碟。 12 本紙張尺度適用中國國豕標準（CNS)A4規格（2K)； 297公釐） ---------- -- '裝 ------—訂--------- 線 ί請先閲讀背面之注意事項再填寫本頁) ^45751 A7 B7 五 '發明說明（1〇 ) 電腦程式產品也可儲存於 網路或外部通訊網路來傳送 術領域者應可理解該等指令 之媒體，以致該媒體承載電 電氣性，磁性，化學性，或 指令，符號，字元，等等， 者應記住所有該等及類似術 因此，一用以建構參照圖3 腦輔助型裝置來達成。在此 系统，例如一資料處理系統 一用以建構本發明之一較佳 本文所陳述之實例及範例 及本發明之實際應用，且因 造及運用本發明。但是，熟 之説明及範例只是用以展示 明並未意謂涵蓋所有可能， 型態。藉由前述揭示應可在 神及範疇之下提出許多修改 另—電腦，且當需要時，藉由 至使用者之工作站。熟悉本技 集之實體儲存實體改變儲存其 腦可讀取型資訊。該改變可爲 某種其他實體變化β雖然藉由 來説明本發明很方便，但是讀 語應相關於適當之實體組件。 所述之步驟之方法可利用—電 種方法中，儲存於一資料處理 之一記憶體單元之資料可表示 實例之方法的步驟。 是展現成爲最容易解釋本發明 此使得熟悉本技術領域者可製 悉本技術領域者應可認知前述 及做爲範例。本文所陳述之説 或限制本發明於所揭示之精確 不脱離下列申請專利範圍之精 及變型a {請先閱讀背面之注意事項再填寫本頁) 裝 ----訂---------線 經濟部智慧財產局員工消f合作社印 本纸張尺度通用中國國家標準（CNS)A4規格（幻〇 x 297公釐）Applicable to this paper standard® National Standard (CKS) AI 4457 5 1 Printed by the Consumer Cooperatives of the Intellectual Property Bureau of the Ministry of Economic Affairs A7 __B7 V. Description of the invention (5) The data processing system 10 also includes a machine-readable medium The interface 'directs the operation of the data processing system 10. Any suitable machine-retrievable media may include this interface, such as RAM 28, ROM 30, magnetic disks, magnetic tapes, or optical disks (the last three items are located on disks and Tape drive 33). Any suitable operating system and related interface (such as Microsoft Windows) can command the CPU 24. For example, the AIX operating system and the ADC Windows windowing system can command the CPU 24. The AIX operating system is an IBM architectural version of the UNIX ™ operating system. Other technologies can be used with the CPU 24, such as touch screen technology or voice control. Those skilled in the art will understand that the hardware described in Figure 1 may change with specific sensory feedback processing applications. For example, other peripheral devices, such as optical disc media, audio adapters, or chip programming devices, such as in the field of computer hardware technology, etc., are known as PAL * EPR0M programming devices, in addition to the aforementioned hardware, It can also be used or can be used in place of the aforementioned hardware. In addition, the main memory 44 is connected to the system bus 26 and contains a control program 46. The control program 46 is resident in the main memory 44 'and contains some instructions. Among these instructions, when executed in the CPU 24, the operation which will be explained in more detail with reference to FIGS. 2 and 3 below is executed. It is to be understood that although the present invention is, and will continue to be, an environment of a full-featured computer system, it will be understood by those skilled in the art that the present invention can be distributed according to various types to It is a program that produces A, and not to mention the specific type of signal-bearing medium that is used to perform the distribution. The present invention is equally applicable ^ The range of signal-bearing media -------- 1 ----- xiang- -------- Order --------- line ί Please read the book on the back first? ^ Please fill in this page again) This paper size stab cap @ 家 料 (CNS) A4 size (2lU of 7 cm) 445 7 5 A7 B7 6 V. Description of the invention (examples include: recordable media such as floppy disks Film, hard disk drive, and CD ROM, and transmission media, such as digital and analog communication links. Now refer to FIG. 2, which illustrates a simplified block diagram of a sensory feedback interface system 200 according to the present disclosure. The sensory feedback interface system 2000 includes a display device 202, a sequence controller 216, a data processing system 212 ', and a plurality of sensors. In the example of the present invention described in FIG. 2, the sensors The sensor is connected to a viewer component 204, or placed relative to the viewer component, so that each sensor can detect the physiological response of the viewer component 204 with minimal interference with the awareness of the viewer component 204 An eye gaze tracker 214 is placed relative to the audience component 2 1 0 'so that the eye movement of the audience component 21 0 can be determined in real time' and transmitted to the data processing system 212. In addition to the eye gaze information In addition, the data processing system 212 collects other real-time audience response information from the heart rate detector 206, the posture sensor 210 and the blood pressure sensor 208. It should be noted that these sensors described in FIG. 2 only constitute A possible sensor configuration, rather than a list that covers all possible types of sensors that can be used within the spirit and scope of the present invention. The display device 202 provides a visual view of the sequential performance of one of the viewer components 204 Display. Those skilled in the art should understand and understand the use of other sensory output devices, such as only audio speakers, or the same display device, such as display device 202, to build the necessary extensions of the method and system of the present invention. In the example described in FIG. 2, the sequential representation is in the form of a movie, and the display device 202 provides the visual output of the movie at the projection-9. This paper size applies the Chinese National Standard (CNS) A4 specification (210x297 mm) ) -----— — — — — — I -------- Order --------- line '< Please fill in this page with the items on the back of Mijt) Ministry of Economic Affairs Intellectual Property Bureau employees Printed by the Consumer Cooperative 445751 Printed by the Consumer Cooperative of the Intellectual Property Bureau of the Ministry of Economic Affairs A7 B7 V. Invention Description (7) on the screen. In another example of the present invention, the display device 202 may be a cathode ray tube or other similar display screen device. In a preferred embodiment of the present invention, the data processing system 21 2 includes instructions resident in the control program 46 to collect and process immediate sensory feedback from the sensors 214, 208'210, and 206. . The collection of this information from the sensors 214, 208, 210 ', and 206 can be accomplished using an input information adapter, such as the communication adapter 42 in Figure 1. According to the disclosure of the present invention, the processing performed by the data processing system includes interpreting the collected sensory feedback information. Because non-interference is an important goal of sensory feedback interface system 2000, the interpretation of sensory feedback is not as simple as constructing direct instructions, and these direct instructions can be, for example, a computer operating system responding to Enter the constructed direct instruction directly. Therefore, the control program resident within the data processing system 212 may include fuzzy logic or deterministic methods suitable for processing non-explicit or implicit instructions from the sensors 214, 208, 210, and 206. This process may include characterizing the audience feedback received by specifying how the performance should perform best. In a preferred embodiment of the invention, this characterization may include assigning a relative importance to each sensory response received. In the exemplary embodiment of the invention described in FIG. 2, the data processing system 2U processes the signals received by its self-sensors 206, 2 丨 4, 208, and 210 in such a way that the sequential performance can be Adapt in real time, and the ugliest best fits the response of audience component 204 to the performance. During sequential performance, the processed signals from the data processing system 212 are transmitted to the performance controller 216. Although the sequential controller 216 is described in FIG. 2 as becoming a -10- This paper size is applicable in the θ ® Home Standard (CNS) A4 specification (210 X 297 public love) --- --------I · I I ----- Order * ---— — — — — * (Please read the notes on the back before filling out this page) The Ministry of Economic Affairs printed A7 to the Production Bureau Staff Consumer Cooperative ^ — --- — -R7___ V. Description of the invention (8) The same individual, but in another example of the invention of clothing, the 'sequential controller 216 may be included in the data processing system 212. The sequential controller 216 includes a script database 218, and the script database 2} 8 contains the 绖 coded graphic information that constitutes the sequential performance. This coded performance information can be stored in a magnetic or optical storage medium 'so that it can be quickly accessed and sequentially configured based on the processed feedback information received from the data processing system 2U. In an important aspect of the current month, the sequential performance displayed on the display device 202 must be able to be modified to respond to the feedback of the execution time. In the sensory feedback device 2⑼, this modification is achieved by the combined function of the data processing system 212 and the sequential controller. For example, the sequential controller 2] 6 may include program instructions to predict the physiological response of an audience component to the stimulus provided by performance. The sequential controller 2] 6 may further include instructions to correlate the predicted physiological responses with the physiological responses of the viewer constituents. Reference is now made to Fig. 3, which illustrates a flow chart of a sensory loop 300 according to the present disclosure. The sensory feedback loop 300 starts at step, and step 302 describes the initiation of a sequential performance. In the example shown in circle 3, this sequential representation is a visual representation displayed on a visual display device, such as a cathode ray tube (CRT) or equivalent mechanism. The initiation described in step 302 may require the first sequence of a series of visual scenes. The display of any current scene is shown in step 304, and is achieved through the use of a performance output device. The performance rotation device may include a display device 202, a sequential controller 216, and a script database 2 1 8. Next, as shown in step 306, the response of a viewer component, such as the viewer component 024, is detected. This detection can be achieved using the following devices: Sensor 214, -11-This paper size uses the Chinese National Standard (CNS) A4 specification (2〗 0 X 297 mm) --------- --I --- I ---- Order ------- *-i (Please read the notes on the back before filling out this page) 4 4 5 7 5 1 A7 B7 Consumption of Intellectual Property Bureau, Ministry of Economic Affairs Cooperative cooperative seal V. Description of the invention (9) 208 '206' and 210 (any or all, and can detect a physiological response 疋 any other device, and the physiological response can be interpreted as an implicit reply from the audience members Grant. Step 308 describes the process of detecting sensory feedback information received as a physiological response in step 306. Basic concept of the method and system of the present invention 疋 The feedback obtained from an audience member should be implicit, so that it can cause the least disturbance to the audience members' awareness of performance. Therefore without adapting explicit instructions to control a sequential performance, step 308 can use some artificial intelligence, such as the artificial intelligence used by fuzzy logic programs, to interpret the original sensory data. Such an interpretation may include specifying how the performance should proceed to characterize a particular response. Moreover, if there are multiple reactions at the same time, the interpretation of step 308 may include assigning a relative importance to each H last 'step 31q to show how to choose a scene, and the scene will be described immediately after step 304 After the current scene. In a preferred embodiment of the present invention, step T 选择 chooses to further modify the current scene according to the interpretation shown in step 308. Preferred constructions of the present invention include computer systems that are designed to be programmed to perform the method (s) described herein, and program products. According to the rabbit brain system construction, a command set for executing the method and system of the present invention is resident in a storage device, for example,-/ Β • — ^ full power ^ system < random access memory (RAM). Until it is required by ❿ $ ▲ ,,〗 and J package system, the instruction set can be stored as another computer memory product, where the disk drive can contain ten for: computer program ^ »Defective end use Removable memory on disk drives such as optical or floppy disks. 12 This paper size is applicable to China National Standard (CNS) A4 (2K); 297 mm) -----------'Loading ------- Order ------ --- Line, please read the precautions on the back before filling this page) ^ 45751 A7 B7 Five 'invention description (1〇) Computer program products can also be stored on the network or external communication network to be understood by those in the field of transmission The medium of these instructions, so that the medium carries electrical, magnetic, chemical, or instructions, symbols, characters, etc., should remember all these and similar techniques. Therefore, a Auxiliary device to achieve. Here, a system, such as a data processing system, is used to construct one of the preferred embodiments of the present invention. The examples and examples set forth herein and the practical application of the present invention make and use the present invention. However, the familiar descriptions and examples are only used to show that it is not meant to cover all possible types. With the foregoing disclosure, many modifications can be made under God and the scope of another computer, and when needed, to the user's workstation. The physical storage entity familiar with this technology set changes the storage of its brain-readable information. The change may be some other physical change β. Although it is convenient to illustrate the present invention by this, the term should be related to the appropriate physical component. The method of the steps described can be used-in the electric method, the data stored in a memory unit of a data processing can represent the steps of the method of the example. It is shown to be the easiest to explain the present invention, so that those skilled in the art can understand that the foregoing art should recognize the foregoing and serve as examples. What this article states or restricts the present invention to the preciseness and variations of the disclosed invention without departing from the scope of the following patent applications a {Please read the precautions on the back before filling this page) Binding ---- Order ----- ---- The staff of the Bureau of Intellectual Property of the Ministry of Economics and Consumers, the paper size of the cooperatives, the common Chinese national standard (CNS) A4 specification (Magic 0x297 mm)