1311871 九、發明說明： 【發明所屬之技術領域】 ^本發明係關於一種人機互動系統及其互動方法，尤其 係有關於—種影像型手持式人機互動系統及其互動方法。 【先前技術】 、以遙控器來控制各類電子裝置，是十分便利的事情。 ^其是對於那些設置於不易接觸之位置上的電子裝置，更 〇需要藉由遙控的方絲操控。正因為如此，目前市場上 ^器的操作模式除了開或關的遙控操作模式外，已逐漸 X展出具有更多樣化、更精細的遙控操作模式。 满姚、的豕電產σσ大部份配備有紅外線遙控器，舉凡電 使用4 =機、ΐ響、選台11及某些吊燈及電風扇都可以 哭，控益來控制’於是家中便出現了許多支遙控 ί小，丄成使用者的混淆。此外遙控器的體積通常比 ^用a放置時很容易找不到。現有的一種解決方式是， =:1，表紅外線訊號的遙控器(可™ 發射紅外線訊號，亦可將其它紅外線 將各種家電常用=外線訊號紀錄到其任一按钮上。透過 用者即錄到此可錄式遙控器上，藉此使 然而其缺點之-騎用者必須㈣料=家電。 能是相對庫;$ 了°己匕某一豕龟的特定功 應於此了錄式遙控器上的哪個按純置。 1311871 【發明内容j 為解決前述習知遙控器之缺點，本 ’而直覺地對此物體進行 提供—種f彡像财料人歡㈣統及敍財法，_ 點選於環場影像中所看到的物體 曰者 遙控操作。 基於上述目的，根據本發明所 =動系統、包含，庫、-方位感測 置。其中，該資料庫中預先儲存有一實體 工門的％%4 ;該純_器_ 體空間的方位資訊；以及 =相對於^ 估田土_ 卞狩式人機互動裝置係用以使 二 利用該方位感測器所提供的該方位資訊，自動 庫取得相對於财位資訊_環場影像，並於顯 7 h相對應的場景影像，從而與場景中的物 動。 關於本發明之優點與精神可以藉由以下的發明詳述及 所附圖式得到進一步的瞭解。 【實施方式】 請純第1 ®，第1圖為本發明影像型手持式人機互 動糸統之示意圖。如第i圖所示，本發明影像型手持式人 統包含-預先儲存有—實體空間之環場影像與物 =像的卿6、一具有—顯示器14的手持式人機互 =衣置12 ’以及-可裝置在手持式人機互動裝置η上並 此提供方位資訊給手持式人機互動裝i 12的 1〇。前述資料庫16中預先儲存有一實體空間之環場影像^ 1311871 於該環場影像中可進行互動的-物體的物體影像，以及屬 於該物體的一互動設定。該物體存在於該實體空間中。做 為前述手持式人機互動裝置的例子，包含個人數位助理 (Pe_al Digital Assistant, PDA)與行動電話__ ph_ 等，但並不僅限於此。前述該方位感測器i 〇所提供之方位 資訊，包含方向資訊與位置資訊，其中該方向資訊可藉由 習知陀螺儀或數位羅盤等感測器來獲得，而該位置資訊則 可藉由習知無線基地台、無線射頻辨識系統(Mo Frequency Identiflcati()n，RFm)或藉由攝影機透過 析技術來估算。方位感測器1〇亦可與手持式人機互= ^離的設置。前述的手持式人機互動裝置係基於該转 所提供㈣方位資訊，而從該資料庫取得相對於兮 方位^的雜％影像以及該物體的該物體影像，並於一 ’’’、員示上顯示5亥環場影像和該物體的該物體影像。 #電=於本發明中所指出之物體包含靜態展示物與可遙 二=子裝置，但並不僅限於此。當該物體為可遙控電 人^互Γ!庫16中的互動設定為―遙控設定，且該手持ί 批&〜裝置進一步包含一控制鈕組，其係包含依據該遙 二C義的複數個按-，以及-無線發射器’其係用 訊號置發出相對於該些按紐的—無線遙控 電子q b，§使用者選定於該環場影像中的該可遙控 前述、置後，則依據該遙控設定遙控該可遙控電子裝置。 虛擬鈕組可為—實體難或示11上的—觸碰式 1311871 做為本發明的另一實施樣態，該人機互動系統可進一 步包含一公共資訊站，其係包含一顯示器，並可在取得一 可旋轉展示的展示ά後，於該顯示器上顯示該展示物的影 像。藉此’當一使用者使該展示物被展示於該顯示器後， 旋轉具有該方位感測器的該手持式人機互動裝置，可依據 °亥方位感測器所提供的該方位資訊’使該展示物被旋轉。1311871 IX. Description of the invention: [Technical field to which the invention pertains] The present invention relates to a human-machine interaction system and an interactive method thereof, and in particular to an image-type handheld human-machine interaction system and an interactive method thereof. [Prior Art] It is very convenient to control various electronic devices with a remote controller. ^ It is for those electronic devices that are placed in locations that are not easily accessible, and more need to be controlled by remotely controlled square wires. Because of this, in addition to the remote operation mode of on or off, the operating mode of the current device has gradually exhibited a more diverse and finer remote operation mode. Most of the σσ 满 σ 满 满 配备 配备 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大 大A lot of remote control ί small, become a user confusion. In addition, the volume of the remote control is usually easier to find than when placed with a. One of the existing solutions is: =: 1, the remote control of the infrared signal (can emit infrared signals, can also use other infrared to record various home appliances = external signal to any of its buttons. Recorded by the user This recordable remote control, however, has its disadvantages - the rider must (four) material = home appliance. Can be a relative library; $ 匕 匕 匕 豕 的 的 的 的 的 的 的 匕 匕1311871 [Inventive content j In order to solve the shortcomings of the aforementioned conventional remote control, this is intuitively provided for this object--------------------------------------------------- Selecting the remote control operation of the object seen in the image of the ring. Based on the above object, according to the present invention, the system, the inclusion, the library, and the azimuth sensing device, wherein a physical gate is pre-stored in the database. %%4; the position information of the pure _ _ body space; and = relative to the estimated field _ 卞 式 人 人 人 人 人 人 式 式 式 式 式 式 式 式 式 式 式 式 式 式 式 式 式 式 式 式 式 式Library obtains relative to financial position information The scene image corresponding to the 7h is displayed, and the object motion in the scene. The advantages and spirit of the present invention can be further understood by the following detailed description of the invention and the drawings. Pure 1st, 1st is a schematic diagram of the image-type handheld human-machine interaction system of the present invention. As shown in the figure i, the image-type handheld system of the present invention includes a pre-stored image of the ambient space. With the object = image of the Qing 6, a handheld human-machine with the display 14 = 12" and - can be installed on the handheld human-machine interaction device η and provide orientation information to the handheld human-computer interaction The first database of 12 is stored in the database 16 in advance with a physical space image of the ring image ^ 1311871 in the circular field image to interact with the object image of the object, and an interactive setting belonging to the object. In the physical space, as an example of the aforementioned handheld human-machine interaction device, including a personal digital assistant (PDA) and a mobile phone __ ph_, etc., but not limited thereto. The foregoing position sensor i The location information provided by the ,, including direction information and location information, wherein the direction information can be obtained by a sensor such as a conventional gyroscope or a digital compass, and the location information can be obtained by a conventional wireless base station, wireless The radio frequency identification system (Mo Frequency Identiflcati()n, RFm) is estimated by the camera through the analysis technology. The position sensor 1〇 can also be set with the handheld human machine. The aforementioned handheld human-computer interaction The device is based on the (4) orientation information provided by the transfer, and obtains the miscellaneous image relative to the 兮 position and the object image of the object from the database, and displays the image of the 5 hai ring field on a ''' And the object image of the object. #电 = The object indicated in the present invention contains a static display and a remote device, but is not limited thereto. When the object is a remotely controllable person, the interaction in the library 16 is set to "remote control setting", and the handheld ί batch &~ device further includes a control button group, which includes the plural according to the remote second C meaning Press-, and - the wireless transmitter's signal is used to send the wireless remote control electronic qb relative to the buttons, and the user can select the remote control in the ring image to remotely control the front and back, according to The remote control remotely controls the remotely controllable electronic device. The virtual button set may be - the physical difficulty or the touch type 1311871 on the display 11 is another embodiment of the present invention, and the human-machine interaction system may further comprise a public information station, which comprises a display, and After obtaining a display of the rotatable display, an image of the display is displayed on the display. Therefore, when a user displays the display on the display, the handheld human-machine interaction device having the orientation sensor can be rotated according to the orientation information provided by the position sensor. The display was rotated.
做為本發明的又一實施樣態，該人機互動系統則可進 二步包含一大型顯示螢幕，其係包含一顯示器，並可在取 传:可旋轉展示的展示物後，於該顯示ϋ上顯示該展示物 的〜像。藉此當—使用者使該展示物被展示於該顯示器 後’旋轉具有該方位感廳的該手持式人機互動裝置，可 依據該方位感測器所提供的該方位資訊，使該展示物被 轉。 〜 方面，當該物體為靜態展示物時，該資料 中互動設定為相對應於該靜態展示物的—展示資訊 之顯示於該顯示器上。 、 =:圖’第2圖為環場影像與方位資訊關！ 之L。如4 2 _示’環場影像2Q以及位 2〇中特定的物體影像2Ga(例如，古文像二 第1圖所示之資料庫】6所苑生* 義，璟場岑愎20 π 請切立亚儲存的影像。顧； 義像20乃以鳩度視角的方式將原 體空間的影像贱建立顧存。料庫16 ^ 像2。外’還健存已預先決定在環場影像2〇中二= 於可灯絲’並針對這些物體建立屬於這些物體的3 9 1311871 設定。 簡略而言’本發明影像型手持式人機互動系統主要是 利用依據由方位感測器1Q所提供的方位資訊，而在手持式 ^機互動裝置12的顯示器14上，湘影像展示出相對於 α亥方位資$場景的環場影像2Q。如此，當使用者選定於環 %如像20中特定的物體影像2〇&後，則依據互動設定可讓 使用者传以藉由手持式人機互動裝置12與此被選擇的物 體進行互動。 a由於，物體可為可遙控電子裝置或是靜態展示物，医 f刖述的互動設定可域遙控電子裝置的遙控奴或是驾 靜態展不物的展示資訊，因此，為了更具體說明本發明¥ 技術特徵，底下將分麟對可遙控電子裝置或是靜態展开 物作更進一步的說明。 °月參閲第3圖’第3圖為本發明手持式人機互動裝i ，、物體所進行的互動之流程圖。如第3圖所示，當手持# 機^動襄置被啟動後，手持式人機互動裝置會藉由方仿 感測器取得手料人機互動裝置與實財_相對方仿 T即方位資訊）。紐依據此方位資訊從如第1圖所示之 二^庫16取得相對於此方位資訊的環場影像。接著，根擄 =方位資訊，由環場影像中取出相對應影像並呈現於 料康互辭Ή。不過’在此並沒有_僅能從資 ’、 仔％場影像，此環場影像亦可藉由在手持式人 數絲雜，並藉由賴賴料取得(即 、Μ的環場影像。只是，此時仍需藉著方位感測器 1311871 所提供的方㈣訊㈣料庫取得哪些物縣於可互動的， 以及相對的互動設定。 一如第3圖所示’’當使用者點擊手持式人機互動裝置上 經過連結的物件(在環場影像中選擇可互動的物體飧，則 可依據可遙控電子裝置或是靜態展示物以及相對應的互動 2 ’執行姆應_作(或啟動铸式人機互動裝置上相 1的裝置)或展神對應的展示資訊。例如，在控制家電In another embodiment of the present invention, the human-computer interaction system can further include a large display screen, which includes a display, and can be displayed after the transfer: the display that can be rotated and displayed. The ~ image of the display is displayed on the ϋ. In this way, when the user displays the display on the display, the hand-held human-machine interaction device having the orientation hall is rotated, and the display object can be made according to the orientation information provided by the orientation sensor. Was transferred. In the aspect, when the object is a static display, the interaction in the data is set to be displayed on the display corresponding to the static display. , =: Figure 'Figure 2 is the ring image and orientation information off! L. For example, 4 2 _ shows 'ring image 2Q and bit 2 特定 specific object image 2Ga (for example, the database shown in Figure 1 of the ancient text 2) 6 Yuan Sheng * meaning, 璟场岑愎 20 π Please stand The image of the sub-storage. Gu; the image 20 is to create the image of the original space in a way of perspective. The library 16 ^ image 2. The external 'still' has been pre-determined in the ring image 2 2 = 可 丝 ' and set the 3 9 1311871 settings for these objects for these objects. Briefly, the image-based handheld human-machine interaction system of the present invention mainly utilizes the orientation information provided by the position sensor 1Q. On the display 14 of the handheld interactive device 12, the Xiang image shows the ring image 2Q relative to the alpha scene. Thus, when the user selects a specific object image in the ring % such as the image 20 After 2〇&, according to the interactive setting, the user can pass the interaction with the selected object by the handheld human-machine interaction device 12. a, because the object can be a remote control electronic device or a static display, The interactive setting of the doctor's statement can be remotely controlled by the electronic device. The remote control slaves or the display information of the static display, therefore, in order to more specifically explain the technical features of the present invention, the remote control electronic device or static expansion will be further explained below. Fig. 3 'Fig. 3 is a flow chart of the interaction between the handheld and the human-machine interactive device i, and the object. As shown in Fig. 3, when the handheld device is activated, the handheld person The interactive device of the machine will obtain the hand-held human-machine interaction device and the real money _ relative party T-direction information by means of the square-like sensor. According to this orientation information, the New Zealand obtains the ring image relative to the orientation information from the library 16 as shown in FIG. Then, based on the position information, the corresponding image is taken out from the image of the ring field and presented in the message. However, 'there is no _ only from the capital', the child's field image, this ring image can also be obtained by hand-held, and by relying on the material (ie, the ring image of the ring. Just At this time, it is still necessary to obtain the interactive and relative interaction settings of the county through the square (four) news (4) library provided by the position sensor 1311871. As shown in Fig. 3, when the user clicks on the handheld Connected objects on the human-machine interaction device (selecting an interactive object in the ring image, you can perform the operation according to the remote control electronic device or the static display and the corresponding interaction 2 ' The device of the phase 1 of the cast human-machine interaction device) or the exhibition information corresponding to the exhibition god. For example, in controlling the home appliance
田^用中可i疋呈現對應家電的遙㈣；在博物館的應 2，可叹提供對教物㈣狀手 的顯示器上。 雜料可遙㈣子裝鱗，絲狀錢控設定。 哭合I持式人機互動裝置上的一組控制鈕和無線發射 二，啟動。該組控制紐可為實體触或觸碰式的顯示器 體所以’當使用者敎於環場影像中特定物 則依據遙控設定遙控物體。換句話說，糾物體為 =先源時’#使时按下例如為調大亮度的控制紐時， 2式人機絲裝置會铺遙控設定較義雜，透過益 ::射斋對物體發出相對於按鈕的無線遙 此物體。 、 站第4圖’第4圖為本發3歧崎置與公用資訊 =:=所進行的互動之流程圖。若物體同樣為 I遙控电子裝置s寸’互動設定仍為遙控設定，但I須啟動 互域置上任健置，即可作為遙控公用資訊 占或大型顯示螢幕的遙控器。亦即，當使用者將手持式人 1311871 ==置與大型顯示螢幕之間建立連線後(例如建立結 = )_，即可使展示物被展示於制資訊站或大型顯示; =不器(此屬習知技術，在此不累述)。接著，可根: _ f彳人機互動裝1的三雜轉值，並根 據取付的三維旋轉值重纟fA型顯示螢幕上的三維物件。若 ^時旋轉具有綠❹彳器料持式人機互域置後，公用 貝讯站或大型顯示螢幕會依據方㈣測騎提供的方位資 訊，使展示物難轉。若物體為靜態展示㈣，互動設定 ，為相對應於靜態展示物的展示資訊，並將之顯示於顯示 盗0 綜上所述，本發明影像型手持式人機互動系統可藉由 圖像視覺的方式’從環場影像20中選擇特定的物體影像 20a後:再藉著例如一組控制紐、無線發射器對此物體進 仃遙控操作。如此—來’就可以避免紅外線無法準確對準 欲遙控物的2題，也因為該組遙控钮可以採關碰銀幕的 方式，而在單一銀幕上提供多元化的控制鈕，使得單一台 手持式人機絲裝置12即可遙控錄化且乡種遙控模式 的可互動電子裝置。 ' 藉由以上較佳具體實施例之詳述，係希望能更加清楚 描述本發明之特徵與精神，而並非以上述所揭露的較佳具 實靶例來對本發明之範疇加以限制。相反地，其目的是希 望能涵蓋各種改變及具轉性的安排於本發明所欲申請之 專利範圍的範疇内。 1311871 【圖式簡單說明】 第1圖為本發明影像型手持式人機互動系統之示意圖。 第2圖為環場影像與方位資訊關聯性之示意圖。 第3圖為本發明手持式人機互動裝置與物體所進行的互 動之流程圖。 第4圖為本發明手持式人機互動裝置與公用資訊站或大 型顯示螢幕所進行的互動之流程圖。 _ 【主要元件符號說明】 10 方位感測器 12 手持式人機互動裝置 14 顯示器 16 資料庫 20 環場影像 20a物體影像The field can be used to display the corresponding home appliances (4); in the museum's 2, it is sighed to provide a display on the teachings (four). Miscellaneous materials can be remotely (four) sub-scaled, silky money control set. A group of control buttons and wireless transmitters on the I-Meng interactive device are activated. The group control button can be a physical touch or touch type display body. ‘When the user hangs on a specific object in the ring image, the remote control object is set according to the remote control. In other words, when the correcting object is = first source, when the button is pressed, for example, to control the brightness of the brightness, the 2 type human wire device will be set to the remote control setting, and the benefit is generated by: Remotely this object relative to the button. Figure 4 of the station, Figure 4 is a flow chart of the interaction between the 3 and the common information =:=. If the object is also the I remote control electronic device, the interactive setting is still the remote control setting, but the I must activate the interactive field to set up the remote control, which can be used as the remote control public information or the large display screen remote control. That is, when the user establishes a connection between the handheld person 1311871 == and the large display screen (for example, establishing a knot = ) _, the display object can be displayed on the information station or the large display; (This is a conventional technique and will not be described here). Then, the root can be: _ f彳 The three-fold value of the human-machine interaction device 1 and the three-dimensional object on the screen is displayed on the fA type according to the three-dimensional rotation value taken. If the ^-time rotation has a green-carrying device and the human-machine inter-domain is set, the public broadcast station or the large-scale display screen will make the display difficult to rotate according to the orientation information provided by the side (4). If the object is a static display (4), the interactive setting is the display information corresponding to the static display, and is displayed in the display of the stolen 0. The image type handheld human-machine interactive system of the present invention can be visually imaged. The way 'after selecting a specific object image 20a from the ring image 20: the object is remotely operated by, for example, a set of control buttons and wireless transmitters. So - to 'can avoid the infrared can not accurately align with the 2 remote control object, but also because the group of remote control buttons can be used to touch the screen, and provide a variety of control buttons on a single screen, making a single handheld The human wire device 12 can be remotely recorded and interactive electronic devices of the remote control mode. The features and spirit of the present invention are intended to be more apparent from the detailed description of the preferred embodiments. On the contrary, it is intended to cover various modifications and changes in the scope of the invention as claimed. 1311871 [Simple description of the diagram] Fig. 1 is a schematic diagram of the image type handheld human-machine interaction system of the present invention. Figure 2 is a schematic diagram of the correlation between the ring image and the orientation information. Figure 3 is a flow chart showing the interaction between the handheld human-machine interaction device and the object of the present invention. Figure 4 is a flow chart showing the interaction between the handheld human-machine interactive device of the present invention and a public information station or a large display screen. _ [Main component symbol description] 10 Azimuth sensor 12 Handheld human-machine interaction device 14 Display 16 Data bank 20 Ring image 20a object image