TWI275979B - Open virtual input and display device and method thereof - Google Patents

Open virtual input and display device and method thereof Download PDF

Info

Publication number
TWI275979B
TWI275979B TW94116611A TW94116611A TWI275979B TW I275979 B TWI275979 B TW I275979B TW 94116611 A TW94116611 A TW 94116611A TW 94116611 A TW94116611 A TW 94116611A TW I275979 B TWI275979 B TW I275979B
Authority
TW
Taiwan
Prior art keywords
peripheral device
virtual input
display
input
open virtual
Prior art date
Application number
TW94116611A
Other languages
Chinese (zh)
Other versions
TW200641649A (en
Inventor
Ping-Chang Chu
Jui-Nan Yeh
Ching-Wen Yu
Original Assignee
Chung Shan Inst Of Science
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chung Shan Inst Of Science filed Critical Chung Shan Inst Of Science
Priority to TW94116611A priority Critical patent/TWI275979B/en
Publication of TW200641649A publication Critical patent/TW200641649A/en
Application granted granted Critical
Publication of TWI275979B publication Critical patent/TWI275979B/en

Links

Landscapes

  • Position Input By Displaying (AREA)
  • Input From Keyboards Or The Like (AREA)

Abstract

The present invention relates to an open virtual input and display device and method thereof, which uses a micro projection device to project images of different input interfaces, and simultaneously emits detecting light above an image plane by a detecting light emission module. A detecting light receiving module receives a reflection light beam so as to detect inputs of users on the image plane. A recognition module converts the inputs into operation commands by a recognition function. A switching module loads the corresponding input interface image data and the recognition function, and a template database for storing a plurality of application data files.

Description

1275979 九、發明說明: 【發明所屬之技術領域】 七月係為種開放式虛擬輸入與顯示之 •採用開放式的設計方式’使在同, - ^種應用,變化成為不同的虛擬輸入及顯示裝置。 【先前技術】 • 現在的科技產品多要求要做到體積越來越小,然而有此 東西體積作的小雖然是便於攜帶,但是,卻會造成使用者在使 用上之困擾,例如鍵盤或是按鍵就是一個典型的例子,鍵盤作 的小軸較不佔桌_空間,但是者在打字時卻很容易按 • _壁鍵’按鍵也是,按鍵作小了雖然可以使產品整體體積變 - 丨’但是使用者在作輸人之動作卻較為不方便,很容易就按錯 或是同時按到兩顆按鍵。 • 為改進這種問題’有人提出了虛擬鍵盤之方法來解決, 利用全像攝影或用光學掃描的方式產生「狀」之触影像, 再利用檢知光絲侧使用者在虛擬㈣上所輸人之操作命 令’如此使用者便只須攜帶一個投射裝置,就可以達到操作鍵 盤輸入之效果,而且還不會產生敲打鍵盤之聲音,也不用須惱 鍵盤會被敲壞,更可以擺放在任何地方來作輸入。 儘管這樣子的產品已經在市面上開始販售了,但是與傳 統之鍵盤比較起來,其價格卻是相當之昂貴,對使用者來說, 1275979 ,然不是—項具有㈣力之產品,如何在其基本硬體架構下 尋找較高之齡7触,的確是當前-健得財之問題。 【發明内容】 馨於以上關題,本發賴主要目的在於提供_種開放式 虛擬輸入麵私裝置及其方法,藉由f知之配對方式,並感 測使用者輸入動作之辨識’配合多種應用裝置資料播來投射出 多種不同之影像’以_虛擬多樣控㈣之效果,進而增加其 使用之附加價值。 、 因此’為達上述目的,本發明之系統包含了 ·· 微型投影模組,可用以投射出各種不同週邊設備之輸入介 面影像;檢知光源發射模組,用以於影像畫面上方發射檢知光 束;檢知光源接收模組,用以接收反射光束來測得使用者在該 投射影像上之輸入動作;識別模組,用以判斷出反射點之座標 位置,並將該輸入動作之鋪位置代入識別函式轉換為操作命 令;切換模組,用以根據操作命令來變換對應之應用裝置資料 檔’其中各應用裝置資料檔還包含輸入介面影像資料及其對應 谶別函式;以及樣版資料庫,用以儲存多個應用裝置資料檔。 為使本發明能成為多種週邊設備之輸入裝置,該方法包含 了下列步驟··首先偵測附近可進行設定之週邊設備,並由各個 週邊又備將本發明设為可作為其輸入操作命令之一裝置,接著 才又射出可没定週邊设備之基本選單影像,然後接收使用者所選 1275979 取之一週邊設備選項,進行與該週邊設備配對連線,最後切換 投射該週邊設備之輸入介面影像。 而在多種週邊設備配對完成後,本發明用以作為虛擬輸入 介面裝置之方法包含下列步驟··首先,投射出可見光之輸入介 面影像於實體平面上,以及啟動檢知光束於該影像上方之偵 測;然後,接收使用者於該影像上方輸入之操作命令;當使用 者輸入之指令被辨識完成時,判斷是否須變化投射影像?若 是’則至樣版資料庫尋找對應之應用裝置資料檔作載入,接著 變換投射之影像及其對應之識別函式;否則便將所接收到之操 作命令傳至週邊設備,由週邊設備進行對應之動作。 有關本發_特徵與實作,颇合®示作最佳實施例詳細 說明如下。 【實施方式】 本毛明將揭路-朗放式虛擬輸人與顯示之裝置及其方 法。在本發明的以下詳細說明中,將描述多種特定的細節以便 提供本發明的完整酬。然而,對熟知技藝者來說 ,並可以不 需要使用該等特定細節便可以實施本發明,或者可以藉著利用 =代的元件或方絲實施本㈣。健他的狀況下 ,並不特別 詳細地已知的方法、程序、部件、以及電路,以免不必要 地混淆本發明的重點。 明多照帛1圖」,此為本發明之系統架構圖,主要係由 下列幾個元件所構成: 1275979 微型投影模組110,可投射出各觀邊設備之輸入介面影 像520或者是各種文字、圖像等資料,如「第2圖」所示,當 開放式虛擬輸入與顯示裝置觸作為多媒體撥放機训之輸二 2置時,可於實體平面上投射出多媒體撥放機51G之輸入介面 • 影像52G;而如「第3圖」所示,在當作為隨时動裝置53〇, 如手機、個人數位助理(PDA,p⑽⑽咖㈣ 記型電腦(n〇teb〇〇k)等之輸入褒置時,則可切換投射出對應之 響 輸入介面影像520,例如我們所熟知之標準鍵盤。 甚至可如「第4圖」所示,此為個人數位助理之顯示畫面, 使用者了藉由開放式虛擬輸入與顯示裝置丨⑽於記事或文書 輸从操作時,投㈣縣絲個人練驗錄上之顯 示晝面,其中感應區塊32〇可顯示一輸入之鍵盤畫面供使用者 _ 祕上點職人,並在其上投㈣檢知光束,以藉由檢知光束 _ 之反射來偵測輸入之操作命令,而顯示區塊3丨〇則是由微型投 影器(micro-project〇r)於實體平面上直接投射顯示出電子書之 頁面,或是週期的顯示使用者所輸入之文字,如此一來,使用 者甚至無須從身邊拿出個人數位助理,即可直接進行輸入及閱 覽編輯。 將週邊設備的輸入裝置都整合在本發明之開放式虛擬輸 入與顯示裝置100時,不僅可節省各週邊設備放置鍵盤輸入之 體積’只須一配對鍵使兩者進行配對設定即可,也可省去一些 ί275979 週邊設備之顯示螢幕,不僅可使週邊設備之體積更為減小,更 可蜻省配備螢幕之成本,甚至家裡也不需要那麼多個各個週邊 设傷遙控器。 控制模組120則是指開放式虛擬輸入與顯示裝置100之中 • 央處理1(α>υ),可肋啟動微型投影模組110之投射功能, 於只體平面上投射出基本選單和輸入介面影像52〇,讀取樣版 春 :身料庫130之應用裝置資料檔I35並設定識別函式,計算檢知 光源接收模組170所接收到之檢知光束以決定手指所點選 之座標位置,設定投影時所要顯示之燈光色彩、投影範圍之尺 寸大小、解減的高低、輸人觸的速度及準確度,以及用跳 頻之方式與週邊設備建立配對連線。 士刀換权組150用以根據使用者於週邊設備之基本選單影 像中所選之3又疋’經由識別模組j 60辨識出傳回之反射區域座 鲁 ‘後傳至控制單元120以進行至樣版資料庫no載入該週邊 設備之輸人介面影像龍並投射,以及载人對應之識別函式, 並由配對模組190切斷與原本之週邊設備連線,並與另一週邊 設備依原本配對時之頻道建立連線。 其中配對模組19G包含於切換模組15()之中,用以於本系 統開機時與週邊設備進行配對,當週邊設備之配對鍵被按下 時’同時開始利用—藍芽傳輸、—無線網路、-無線電三種方 式任-種’來進行尋找附近可用以作為週邊設備輸入設定之週 1275979 邊設備,此時,配對模組190便可在一特定頻率中發出配對訊 號’待週邊設備以跳頻方式搜尋到開放式虛擬輸入與顯示裝置 100時便停止搜尋,爾後便以此頻率作為兩者訊號傳遞之通 道,而配對完成後,配對模組19〇便將此一頻率與該週邊設備 加入其配對之基本選單之中。1275979 IX. Invention Description: [Technical field of invention] July is an open type of virtual input and display. • Open design is used to make the same, - ^ application, change into different virtual input and display Device. [Prior Art] • Today's technology products require more and less volume. However, the small size of this product is easy to carry, but it will cause users to use it, such as keyboard or The button is a typical example. The small axis of the keyboard does not occupy the table_space, but it is easy to press when typing. The _wall button is also used. The button is small, although the overall volume of the product can be changed - 丨' However, it is inconvenient for the user to make a move, and it is easy to press the wrong button or press two buttons at the same time. • In order to improve this problem, someone proposed a virtual keyboard method to solve the problem. Using holographic photography or optical scanning to generate a "sense" touch image, and then using the detection of the light side user to lose on the virtual (four) The human operation command 'so that the user only needs to carry a projection device, the effect of operating the keyboard input can be achieved, and the sound of typing the keyboard is not generated, and the keyboard is not damaged, and the keyboard can be placed. Enter it anywhere. Although such products have already been sold on the market, compared with the traditional keyboard, the price is quite expensive. For the user, 1275979 is not a product with (four) force, how to Looking for a higher age 7 touch under its basic hardware architecture is indeed a problem with current health. [Summary of the Invention] In addition to the above issues, the main purpose of this is to provide an open virtual input surface private device and its method, by means of the pairing method, and to sense the user input action identification 'with a variety of applications The device data is broadcast to project a variety of different images' effects of _ virtual multi-control (4), thereby increasing the added value of its use. Therefore, in order to achieve the above object, the system of the present invention comprises a micro-projection module, which can be used to project an input interface image of various peripheral devices; and a light source transmitting module for detecting the emission of the image above the image frame. a light source; a light source receiving module for receiving a reflected light beam to measure a user input motion on the projected image; and an identification module for determining a coordinate position of the reflection point and placing the input action The substitution identification function is converted into an operation command; the switching module is configured to convert the corresponding application device data file according to the operation command, wherein each application device data file further includes an input interface image data and a corresponding screening function; and a pattern A database for storing multiple application device data files. In order to enable the present invention to be an input device for a variety of peripheral devices, the method includes the following steps: First, detecting peripheral devices that can be set nearby, and the peripherals are further configured to be operable as input commands thereof. a device, then injects a basic menu image of the peripheral device, and then receives a peripheral option selected by the user 1275979, performs pairing with the peripheral device, and finally switches the input interface of the peripheral device. image. After the pairing of various peripheral devices is completed, the method for using the present invention as a virtual input interface device includes the following steps: First, projecting the input interface image of the visible light on the physical plane, and starting the detection beam on the image. Then, receiving an operation command input by the user above the image; when the command input by the user is recognized, determining whether the projected image needs to be changed? If yes, then the template database is searched for the corresponding application device data file. Loading, then transforming the projected image and its corresponding identification function; otherwise, the received operation command is transmitted to the peripheral device, and the peripheral device performs the corresponding action. With regard to the present invention, the features and implementations of the present invention are described in detail below. [Embodiment] The present invention will uncover the road-language virtual input and display device and its method. In the following detailed description of the invention, numerous specific details However, it will be apparent to those skilled in the art that the present invention may be practiced without the use of the specific details. The methods, procedures, components, and circuits are not specifically described in detail in order to avoid unnecessarily obscuring the present invention. The present invention is a system architecture diagram, which is mainly composed of the following components: 1275979 miniature projection module 110, which can project the input interface image 520 of various viewing devices or various characters. , image and other information, as shown in "Figure 2", when the open virtual input and display device is touched as the multimedia player training, the multimedia player 51G can be projected on the physical plane. Input interface • Image 52G; as shown in “Figure 3”, as a mobile device, such as mobile phones, personal digital assistants (PDA, p(10) (10) coffee (four) computer (n〇teb〇〇k), etc. When the input device is set, the corresponding input interface image 520 can be switched and projected, for example, a standard keyboard that we are familiar with. Even as shown in "Fig. 4", this is the display screen of the personal digital assistant, the user has Through the open virtual input and display device 10 (10) in the note or document input operation, the display screen of the (4) county silk personal practice record, wherein the sensing block 32 〇 can display an input keyboard screen for the user _ Secret on the staff, And on the top (4) detecting the beam to detect the input operation command by detecting the reflection of the beam _, and the display block 3 是 is by the micro-project 〇r in the physical plane Directly projecting the page of the e-book, or periodically displaying the text input by the user, so that the user can directly input and view the editing without having to take out the personal digital assistant from the side. When the input device is integrated in the open virtual input and display device 100 of the present invention, not only the volume of the keyboard input of each peripheral device can be saved, but only one pairing button is needed to pair and set the two, and some can be omitted. Ί275979 The display screen of peripheral devices not only reduces the size of peripheral devices, but also saves the cost of the screen. Even the home does not need to have multiple remote control devices. The control module 120 refers to In the open virtual input and display device 100, the central processing 1 (α> υ), the rib can activate the projection function of the micro projection module 110, and project the base on the body plane only The menu and the input interface image 52〇, the sample spring: the application device data file I35 of the body library 130 is set and the identification function is set, and the detection light beam received by the detection light source receiving module 170 is calculated to determine the point of the finger. Select the coordinates of the coordinates, set the color of the light to be displayed during projection, the size of the projection range, the level of the decimation, the speed and accuracy of the input, and the way to establish a pairing with the peripherals by means of frequency hopping. The change group 150 is configured to recognize the returned reflection area by the recognition module j 60 according to the user selected in the basic menu image of the peripheral device, and then transmit it to the control unit 120 to perform the sample. The version database is loaded with the input interface image of the peripheral device and projected, and the identification function corresponding to the manned person, and the pairing module 190 cuts off the connection with the original peripheral device, and is connected with another peripheral device. The channel that was originally paired is connected. The pairing module 19G is included in the switching module 15() for pairing with the peripheral device when the system is powered on, and when the pairing button of the peripheral device is pressed, 'simultaneously starting to use—the Bluetooth transmission, the wireless The network and the radio can be used to search for a nearby 1275979 side device that can be used as a peripheral device input setting. At this time, the pairing module 190 can issue a pairing signal to a peripheral device at a specific frequency. When the frequency hopping method searches for the open virtual input and display device 100, the search is stopped, and then the frequency is used as the channel for the two signals to be transmitted. After the pairing is completed, the pairing module 19 will use the frequency and the peripheral device. Join the basic menu of its pairing.

輪出入模組180可用以自該週邊設備接收用於投射出該 週邊設備之應用裝置資料檔135,包括了輸入介面影像520資 料以及用於辨識使用者在該週邊設備之輸入介面影像上 所作輸入之識職式等職,並將這些職儲存於記憶體内的 :版_貝料庫130之中,也可由使用者自行以小單位區塊26〇為 早位編輯後透過各财線及無狀傳輸介面,例如傳輸線、 收232網路線、或是以記憶卡、行動碟以及藍芽⑼此t〇_ 等之方式傳入本發明之系統中。 檢知光源發射额14G可發出紅外線、雷料不可見光, 照射或掃啸入介面影像似的範圍,當使用者有按鍵輸入動 作時可照射到使用者的手_而將檢知光束反射。而檢知光 源接收模組m,可於_之範_,接收手指於輸入介 ^像520上作輸入動作時,所反射之檢知光束之發射角度與 接收角度,以及發射與接收之時縣,獲得手指輸入時所 點選之反射區域位置。 如「第5圖」所示,識別模組16〇接收來自檢知光源接收 1275979The wheel access module 180 can be configured to receive, from the peripheral device, an application device data file 135 for projecting the peripheral device, including input interface image 520 data and for identifying an input made by the user on the input interface image of the peripheral device. In the memory of the job, and the storage of these jobs in the memory: the version of the _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ The transmission interface, such as a transmission line, a 232 network route, or a memory card, a mobile disk, and a Bluetooth (9), etc., are introduced into the system of the present invention. It can detect that the light source emission amount of 14G can emit infrared rays, invisible light, and illuminate or sweep into the interface image range. When the user has a button input action, it can illuminate the user's hand _ and reflect the detected beam. And detecting the light source receiving module m, in the _ _ _, receiving the finger on the input interface 520 as an input action, the reflected angle of the reflected beam and the receiving angle, and the time of the transmission and reception , get the position of the reflection area selected when the finger is input. As shown in Figure 5, the recognition module 16 receives the received light from the detection source. 1275979

拉組m所_到之使用者手指勘位置時,利用檢知光源的 發射與接收之缝_,或魏與滅的時縣_出使用者 在畫面上的按鍵動倾位置。辨驗_位置只需她的解析 度’例如將按鍵可檢知的範圍(即投影晝面的範圍)切割為矩陣 j的小單位區塊㈣,其大小約與按鍵的手指相當,週邊 设備所須的按鍵均則、單健塊絲本單位來設計,—個按鍵 所魏的位置可以只佔用一個小單位區塊_,或是數個相鄰 小早位區塊的聯集27〇,由週邊設備廠商依產品的不同需求自 由規劃設計。 識別模、、且160用來计算取得被使用者按到的這個小單位 區塊的座標值,xl代表域應區域劃分後之X軸方向的第一 個區& ’ χ2代表為感應區域劃分後之χ車由方向㈣二個區段, 其餘其他小單位區塊之χ軸編號意義可由同理推得,y轴亦 ^ ;經由查詢細狀函式對絲_制職表之操作命 令’如「第6圖」所示,此為週邊設備之函式對絲_,包 3 了由感應區域各個小單位區塊260之χ軸與y軸區段所組成 的區段座標欄位610,以及點選該小單位區塊26〇座標位置時 所對應代表之操作命令攔位620。 舉例說明,例如使用者於輸入介面影像520上點選輸入 (4’2)座標之小單位區塊26〇時,便可查詢該輸入介面影像52〇 之函式對應表600中的操作命令攔位 ,得到 action number 乃 11 1275979 是代表切換週邊設#目錄,便可將該操作命令傳至控制模組 120 ’以驅動微型投影模組⑽於實體平面上顯示可配對設定 週邊設備之基本選單。而(η·2,3)與(n_3,3)皆對應到相同之▲ _ber ’意謂在輸入介面影像520中,此區域乃屬於同一圖示 (icon)所在位置’若查詢函式對應表6〇〇得到使用者點選這兩 塊小單位區塊26G任-皆為代表將正在編輯中之文件儲存,則 # 將此操作命令藉輸出入模組180傳至個人數位助理端,並執行 儲存編輯文件之動作。 口月參照帛7圖」’此為本發明與週邊設備進行設定之方 法流程圖,首先,配對模組19〇開始偵測附近可進行設定之週 歧備,並由各觸邊設本發日綠為可作為其輸入之一裝 置(步驟410),接著投射出可設定週邊設備之基本選單影像, 以提供使用者選擇欲作為何種週邊設備輸入裝置之設定(步驟 鲁 420)’然後接收該使用者所選取之-週邊設備選項(步驟430), 配對模組19W始以設定中之頻道進行與該週邊設備之配對 連線(步驟44〇);最後,由切換模組⑽至樣版資料庫1孙種 載入該週邊設備之輸入介面影像520,並由微型投影模組 切換投射該週邊設備之輸入介面影像52〇於實體平面上(步驟 450) 〇 而在與多種週邊設備配對完成後,開始利用本發明之開放 式虛擬輸入與顯示裝置100以作為一個週邊設備之輸入枣置 12 1275979 時,為達成切換成多種虛擬裝置之目的,請參照「第8圖」, 此為本發明作為輸入裝置投射之方法流程圖,包含了以下步 驟:首先,由微型投影模組110投射出週邊裝置之輸入介面影 像520於實體平面上,以及在該影像上方發射出檢知光束以進 行掃描_ (步驟21G);然:後,當使用者於輸入介面影像52〇 上做點選動作時,檢知光束便會掃到使用者之手指280而產生 反射’由檢知光源接收模植17〇接收反射光束,再由識別模組 160計算出點選之位置位在哪些小單位區塊26〇上,若是反射 之點選範在多個小單位區塊施且分屬對應不同之操作 命令時,則·將絲錄代人朗函式情算㈣可能之所 屬小單位區塊細,由該週邊設備之函式對應表㈣對應出該 影像上方所輸人之操作命令(步驟22()) ; #使用者輸入之指令 被辨識完絲’翻_操作命令是變化投鄕像?(步驟 230) 右是切換作為*同週邊設備讀人裝置時,酿樣版資料 庫130哥找對應該週邊設備之應用裝置資料槽作载入(步驟 24〇) ’並由控制模組m控制微型投影模組ιι〇變換投射之輸 入介面影像520及其對應之識別函式(步驟25());否則,則^ 代表所輸人乃賴週邊設備之操作命令,便將所接收到之操= 命令透過輸出入模組180傳至週邊設備(步驟26〇),由週邊設 備進行對應之動作,例如在個人數位助理進行電子書閱覽時, 1275979 則在投射影像之顯示區塊310可根據個人數位助理傳來之顯 示畫面顯示影像、圖案、及文字等内容,而感應區塊32〇則可 顯示輸入鍵盤、控制面板等操控介面,其中操控介面包含〜切 換週邊設備之按鍵,假設原本開放式虛擬輸入與顯示裝置1〇〇 正用於個人數位助理文書編輯之輸入裝置。 雖然本發明以前述之較佳實施例揭露如上,然其並非用以 限定本發明,任何熟習轉㈣者,在不麟本發明之精神和 範圍内,當可作些許之更動與潤飾,因此本發明之專利保護範 圍須視本綱書觸之_請專概騎界定者為準。 【圖式簡單說明】 第1圖係本發明之系統架構圖; 第2圖係本發明應用於多媒體撥放器之示意圖; 第3圖係本發明細於隨身行練置之示意圖; 第4圖係本發明應用於個人數位助理之示意圖; 第5圖係本發__識之小單傾顺機_示意圖; 第6圖係本發明之函式對應表; 第7圖係本發明設定週邊設備顯示之方法流程圖;及 第8圖係本發明作為輪人裝射之方法流程圖。 【主要元件符號說明】 開放式虛擬輸入與顯示裝置 微型投影模組 110 1275979 120 控制模組 130 樣版資料庫 135 應用裝置資料檔 140 檢知光源發射模組 150 切換模組 160 識別模組 170 檢知光源接收模組When the user's finger is surveyed by the group m, the seam of the transmitting and receiving of the light source is detected, or the time of the user's movement on the screen is shifted. The _ _ position only needs her resolution 'for example, the range in which the button can be detected (ie, the range of the projection surface) is cut into a small unit block (4) of the matrix j, and the size is about the same as the finger of the button, and the peripheral device All the required buttons are designed in a single block of silk. The position of the button can occupy only one small unit block _, or a collection of several adjacent small early blocks. The peripheral equipment manufacturers are free to plan and design according to the different needs of the products. The recognition mode, and 160 is used to calculate the coordinate value of the small unit block that is obtained by the user, and xl represents the first area & ' χ 2 of the X-axis direction after the domain should be divided into regions. After the car is driven by the direction (four) two sections, the meaning of the other axis of the other small unit block can be derived from the same reason, the y-axis is also ^; through the query fine function on the wire _ the job table operation command ' As shown in Fig. 6, this is the function of the peripheral device, and the packet coordinate field 610 consisting of the x-axis and the y-axis segment of each small unit block 260 in the sensing area is shown. And the operation command block 620 corresponding to the representative of the 26 unit coordinate position of the small unit block. For example, when the user clicks on the small unit block 26 of the input (4'2) coordinate on the input interface image 520, the operation command block in the function correspondence table 600 of the input interface image 52 can be queried. Bit, the action number is 11 1175979 is to switch the peripheral device # directory, the operation command can be transmitted to the control module 120' to drive the micro-projection module (10) to display the basic menu of the peripheral device that can be paired and set on the physical plane. And (η·2,3) and (n_3,3) all correspond to the same ▲ _ber ' means that in the input interface image 520, this area belongs to the same icon (icon) position 'if the query function correspondence table 6〇〇 The user clicks on the two small unit blocks 26G - all of which represent the file being edited, then # this operation command is transferred to the module 180 to the personal digital assistant and executed. Save the action of editing the file. According to the method of the present invention and the peripheral devices, the matching module 19 starts detecting the nearby peripherals that can be set, and sets the current date by each touch. Green is one of the inputs (step 410), and then the basic menu image of the peripheral device can be projected to provide the user with the setting of the peripheral device input device (step 420) 'and then receive the The peripheral device option selected by the user (step 430), the pairing module 19W starts the pairing with the peripheral device in the channel being set (step 44〇); finally, the switching module (10) to the template data The library 1 is loaded into the input interface image 520 of the peripheral device, and the micro-projection module switches the input interface image 52 of the peripheral device onto the physical plane (step 450), and after pairing with various peripheral devices, When using the open virtual input and display device 100 of the present invention as an input device for a peripheral device, 12 1275979, in order to achieve the purpose of switching to a plurality of virtual devices, please refer to Figure 8 is a flow chart of the method for projecting as an input device of the present invention. The method includes the following steps: First, the micro-projection module 110 projects the input interface image 520 of the peripheral device on a physical plane, and above the image. The detection beam is emitted for scanning _ (step 21G); then: when the user performs a click operation on the input interface image 52, the detected beam will sweep to the user's finger 280 to generate a reflection' The reflected light beam is received by the detecting light source and received by the recognition module 160, and the identification module 160 calculates which small unit blocks 26 are located at the point of selection, and if the reflection point is selected in a plurality of small unit blocks And when it belongs to different operation commands, then the silky generation will calculate the size of the small unit block, and the function corresponding to the peripheral device (4) corresponds to the person above the image. Operation command (step 22 ()); #user input command is recognized the silk 'turn _ operation command is a change cast image? (Step 230) When the right is switched as *reading device with the peripheral device, the brewing template database 130 finds the application device data slot corresponding to the peripheral device for loading (step 24〇)' and is controlled by the control module m. The micro-projection module ιι〇 transforms the input interface image 520 and its corresponding recognition function (step 25()); otherwise, ^ represents the operation command of the peripheral device, and the received operation The command is transmitted to the peripheral device through the input/output module 180 (step 26〇), and the peripheral device performs the corresponding action. For example, when the personal digital assistant performs the electronic book viewing, the 1275979 displays the image in the display block 310 according to the individual. The display screen displayed by the digital assistant displays images, patterns, and texts, while the sensing block 32〇 displays the input interface of the input keyboard and control panel. The control interface contains ~ buttons for switching peripheral devices, assuming the original open type The virtual input and display device 1 is being used as an input device for personal digital assistant editing. Although the present invention has been described above in terms of the preferred embodiments thereof, it is not intended to limit the invention, and any of the above-mentioned embodiments may be modified and retouched in the spirit and scope of the present invention. The scope of patent protection of the invention shall be subject to the definition of this catalogue. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a schematic diagram of a system architecture of the present invention; FIG. 2 is a schematic diagram of the present invention applied to a multimedia player; FIG. 3 is a schematic diagram of the present invention in a compact manner; The present invention is applied to a personal digital assistant; FIG. 5 is a schematic diagram of the present invention; FIG. 6 is a functional correspondence table of the present invention; A flow chart of the method of display; and Fig. 8 is a flow chart of the method of the present invention as a wheeled person. [Main component symbol description] Open virtual input and display device micro projection module 110 1275979 120 Control module 130 Pattern database 135 Application device data file 140 Detection light source transmitting module 150 Switching module 160 Identification module 170 Inspection Knowing light source receiving module

180 輸出入模組 190 配對模組 260 小單位區塊 270 相鄰小單位區塊聯集 280 手指 310 顯示區塊 320 感應區塊 510 多媒體撥放機 520 輸入介面影像 530 隨身行動裝置 600 函式對應表 610 座標搁位 620 操作命令欄位 步驟210 投射可見光之輸入介面影像及啟動檢知光束 15 1275979 進行偵測 步驟220 接收使用者輸入之操作命令 步驟230 判斷是否須變化投射影像? 步驟240 至樣版資料庫尋找對應之應用裝置資料檔作 載入 步驟250 變換投射之影像及其對應之識別函式 步驟260 輸出操作命令至週邊設備 步驟410 偵測可進行設定之週邊設備 步驟420 投射可設定週邊設備之基本選單影像 步驟430 接收使用者所選取之週邊設備選項 步驟440 進行與週邊設備配對連線 步驟450 切換投射該週邊設備之輸入介面影像180 input and output module 190 pairing module 260 small unit block 270 adjacent small unit block collection 280 finger 310 display block 320 sensing block 510 multimedia player 520 input interface image 530 portable mobile device 600 function corresponding Table 610 Coordinated Position 620 Operation Command Field Step 210 Projecting the Input Screen Image of the Visible Light and Starting the Detection Beam 15 1275979 Performing the Detection Step 220 Receiving the Operation Command Input by the User Step 230 Determine whether the projected image needs to be changed? Step 240: The template database searches for the corresponding application device data file for loading step 250. Transform the projected image and its corresponding identification function. Step 260: Output the operation command to the peripheral device. Step 410: Detect the peripheral device step 420 that can be set. Projection can set the basic menu image of the peripheral device. Step 430: Receive the peripheral device option selected by the user. Step 440 Perform pairing with the peripheral device. Step 450 Switch the input interface image of the peripheral device.

Claims (1)

1275979 U·如申料纖圍第Η)酬述之式細輸人與顯示之裝 置,其中該基本選單财括可用喃各麵邊設備建立各該連 線通道之設定參數。 12·如申晴專利範圍第!項所述之開放式虛擬輸入與顯示之裝置, 財各該週邊設備之對應資料可由該配對模組在與各該週邊設 触行朗時,將崎版㈣料尚核立資料之各該週邊設 鲁 備以有線或無線傳輸方式讀入各該週邊設備之設定資料。 13·如申請專利範圍第i項所述之開放式虛擬輸入與顯示之裝置, 其中該投射影像包含-切換週邊設備目錄之圖示影像。 種開放式虛擬輸入與顯示之方法,應用於複數個週邊設備以 刀別作為其輸入裝置,該方法包含下列步驟·· 投射-週邊設備之一可見光之投射影像於一實體平面上, 並發射一檢知光束於該投射影像上方以進行偵測; • 接收一使用者於該投射影像上方之一反射區域所反射之檢 知光束; 以该週邊設備之識別函式計算該反射區域之座標並轉換為 一操作命令; 判斷該操作命令之類型,若為切換該週邊設備之操作命 令,則至一樣版資料庫尋找一對應之應用裝置資料檔作載入; 及 依该對應之應用裝置資料槽變換投射之該投射影像及載入 1275979 對應之一識別函式。 15. 如申請專利範圍第14項所述之開放式虛擬輸入與顯示之方 法,其中該操作命令若為該週邊設備之輸入命令,則傳至該週 邊設備,由該週邊設備進行對應之動作。 16. 如申請專利範圍第η項所述之開放式虛擬輸入與顯示之方 法其中4傳达方式為透過一藍芽傳輸、一無線網路、一無線 電三種方式,任一組合傳送。 • Π.如申請專利範圍第Η項所述之開放式虛擬輸入與顯示之方 法’其中該投射影像包含—切換週邊設備目錄之圖示影像。 18·如申請專利範圍第14項所述之開放式虛擬輸入與顯示之方 法,其中該識別函式以一函式對應表來達成。 19·如申請專利範圍第18項所述之開放式虛擬輸入與顯示之方 法’其中該函式對應表包含—座標攔位及—操作命令搁位。 • 2〇· 士口申印專利範圍第14項所述之開放式虛擬輸入與顯示之方 法’其中該反射區域之座標係以一小單位區塊為基本單位計算。 21·如申请專利範圍帛14項所述之開放式虛擬輸入與顯示之方 法,其中切換該週邊設備時,還包含載入該週邊設備之連線設 定。 22·如申凊專利範圍第21項所述之開放式虛擬輸入與顯示之方 法,其中該週邊設備之連線設定之建立,還包含下列步驟: 偵測附近可進行設定之各該週邊設備; 1275979 設定成為各魏邊設叙可作為輸入 之一裝置; 加入已设定之各該週邊設備於一基本選單中;及 儲存各該猶設叙絲筆祕設定參數。 23. 如申睛專利範圍第22項所述之開放式虛擬輸入與顯示之方 法,其中該基本選單可投射於一實體平面供該使用者切換各該 週邊設備時作選擇。 24. 如申請專利範圍第14項所述之開放式虛擬輸入與顯示之方 法’其中該切換各該週邊設備時,可由按下一切換週邊設備目 錄之圖示影像,來顯示該基本選單以進行選擇切換。1275979 U·If the application of the material is the same as the display device, the basic menu includes the setting parameters of each connection channel. 12·If Shen Qing patent scope is the first! The open virtual input and display device described in the item, the corresponding data of the peripheral device can be set by the pairing module when each of the peripheral devices is set to touch the line, and the periphery of the data is still verified by the chip (four) materials. Let Lubei read the setting data of each peripheral device by wired or wireless transmission. 13. The device for open virtual input and display as described in claim i, wherein the projected image comprises a graphical image of a directory of switching peripheral devices. An open virtual input and display method is applied to a plurality of peripheral devices with a knife as its input device, and the method comprises the following steps: · Projecting a visible image of a peripheral device on a physical plane, and transmitting a Detecting a light beam above the projected image for detection; • receiving a detection beam reflected by a user in a reflective area above the projected image; calculating a coordinate of the reflective area and converting the identification function of the peripheral device An operation command; determining the type of the operation command, if the operation command of the peripheral device is switched, searching for a corresponding application device data file to the same version database; and converting according to the corresponding application device data slot Project the projected image and load one of the 1275979 corresponding recognition functions. 15. The open virtual input and display method of claim 14, wherein the operation command is an input command of the peripheral device, and is transmitted to the peripheral device, and the peripheral device performs a corresponding action. 16. The method of open virtual input and display as described in claim n, wherein the four modes of communication are transmitted by any combination of a Bluetooth transmission, a wireless network, and a radio. • Π. The method of open virtual input and display as described in the scope of the patent application, wherein the projected image contains a graphical image of the directory of the peripheral device. 18. The method of open virtual input and display as recited in claim 14, wherein the identification function is implemented in a functional correspondence table. 19. An open virtual input and display method as described in claim 18, wherein the function correspondence table includes a coordinate block and an operation command shelf. • The open virtual input and display method described in item 14 of the patent application section of the patent application, wherein the coordinates of the reflective area are calculated in units of a small unit block. 21. The method of open virtual input and display as described in claim 14, wherein when switching the peripheral device, the connection setting for loading the peripheral device is also included. 22. The method of open virtual input and display according to claim 21, wherein the establishing of the connection setting of the peripheral device further comprises the following steps: detecting each peripheral device that can be set nearby; 1275979 is set as one of the input devices of each Weibian set; it is added to each of the peripheral devices that have been set in a basic menu; and the storage parameters of each of these are set. 23. The open virtual input and display method of claim 22, wherein the basic menu is castable on a physical plane for the user to switch between the peripheral devices. 24. The method for open virtual input and display according to claim 14 of the patent application, wherein when the peripheral device is switched, the basic menu can be displayed by pressing a graphic image of the switching peripheral device directory. Choose to switch. 21twenty one
TW94116611A 2005-05-20 2005-05-20 Open virtual input and display device and method thereof TWI275979B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW94116611A TWI275979B (en) 2005-05-20 2005-05-20 Open virtual input and display device and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW94116611A TWI275979B (en) 2005-05-20 2005-05-20 Open virtual input and display device and method thereof

Publications (2)

Publication Number Publication Date
TW200641649A TW200641649A (en) 2006-12-01
TWI275979B true TWI275979B (en) 2007-03-11

Family

ID=38646126

Family Applications (1)

Application Number Title Priority Date Filing Date
TW94116611A TWI275979B (en) 2005-05-20 2005-05-20 Open virtual input and display device and method thereof

Country Status (1)

Country Link
TW (1) TWI275979B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI569174B (en) * 2010-06-01 2017-02-01 林卓毅 Portable optical touch system
TWI588735B (en) * 2014-07-15 2017-06-21 惠普發展公司有限責任合夥企業 Virtual keyboard
CN107422593A (en) * 2016-05-24 2017-12-01 仁宝电脑工业股份有限公司 The control method of Intelligent lightening device

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8839134B2 (en) 2010-12-24 2014-09-16 Intel Corporation Projection interface techniques
TWI557608B (en) * 2013-04-03 2016-11-11 宏碁股份有限公司 Input apparatus of electronic apparatus and setting method thereof
TWI509488B (en) * 2014-04-30 2015-11-21 Quanta Comp Inc Optical touch system
TWI531954B (en) 2014-11-14 2016-05-01 中強光電股份有限公司 Touch and gesture control system and touch and gesture control method

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI569174B (en) * 2010-06-01 2017-02-01 林卓毅 Portable optical touch system
TWI588735B (en) * 2014-07-15 2017-06-21 惠普發展公司有限責任合夥企業 Virtual keyboard
US10649653B2 (en) 2014-07-15 2020-05-12 Hewlett-Packard Development Company, L.P. Virtual keyboard
CN107422593A (en) * 2016-05-24 2017-12-01 仁宝电脑工业股份有限公司 The control method of Intelligent lightening device
CN107422576A (en) * 2016-05-24 2017-12-01 仁宝电脑工业股份有限公司 The control method of Intelligent lightening device
CN107426469A (en) * 2016-05-24 2017-12-01 仁宝电脑工业股份有限公司 The control method of Intelligent lightening device
CN107426503A (en) * 2016-05-24 2017-12-01 仁宝电脑工业股份有限公司 Intelligent lightening device
CN107422587A (en) * 2016-05-24 2017-12-01 仁宝电脑工业股份有限公司 Intelligent lightening device
CN107422576B (en) * 2016-05-24 2020-04-28 仁宝电脑工业股份有限公司 Control method of intelligent lighting device
CN107426469B (en) * 2016-05-24 2020-04-28 仁宝电脑工业股份有限公司 Control method of intelligent lighting device
CN107426503B (en) * 2016-05-24 2020-04-28 仁宝电脑工业股份有限公司 Intelligent lighting device
CN107422593B (en) * 2016-05-24 2020-06-30 仁宝电脑工业股份有限公司 Control method of intelligent lighting device

Also Published As

Publication number Publication date
TW200641649A (en) 2006-12-01

Similar Documents

Publication Publication Date Title
US20070035521A1 (en) Open virtual input and display device and method thereof
US8831814B2 (en) Electronic device with virtual display and input
CN101779188B (en) Systems and methods for providing a user interface
TWI275979B (en) Open virtual input and display device and method thereof
US20060279533A1 (en) Electronic book reading apparatus
US20070048717A1 (en) Electronic book reading apparatus and method
CN101730874B (en) Touchless gesture based input
KR101045609B1 (en) Devices and methods of operating the user interface and recording devices using the same
US20140160045A1 (en) Terminal and method for providing user interface using a pen
US20110141025A1 (en) Method for operating mobile device and touch-controlled mobile device
US20080309621A1 (en) Proximity based stylus and display screen, and device incorporating same
US20090167882A1 (en) Electronic device and operation method thereof
US8830192B2 (en) Computing device for performing functions of multi-touch finger gesture and method of the same
KR20140077510A (en) Method for searching information, device, and computer readable recording medium thereof
JP2015518604A (en) Text selection and input
AU2013273785A1 (en) Text-enlargement display method
TW201039214A (en) Optical touch system and operating method thereof
KR200477008Y1 (en) Smart phone with mouse module
KR20150019370A (en) Method for navigating pages using three-dimensinal manner in mobile device and the mobile device therefor
TWI414970B (en) Application method for electronic book to regard as a track input device and computer program product thereof
JP4871226B2 (en) Recognition device and recognition method
TW201131426A (en) Keyboards and methods thereof
JP2001265249A (en) Wireless sensor unit
JP2013239100A (en) Information input device
TWI298133B (en) Portable electronic apparatus with mouse function