M350762 八、新型說明： 【新型所屬之技術領域】 本創作係有關一種影像感測器，特別是關於一種搭酉己 影像感測器的輸入裝置及其應用。 【先前技術】 電容式觸控板因為具有成本低、感應度較電阻式觸控 板兩、使用哥命長，可支援多指操作，構造輕薄等優點， 目前已成為電子產品中常見的輸入裝置，逐漸取代滑鼠、 滾輪輸入裝置。 j而，電容式觸控板仍存在因感度不足或殘留水潰而 影響觸控板效能㈣題’因此’本創作提出—種搭配影像 ^測器的輸人裝置並加以應用，利用影像感測器提供與電 令式觸控板相同之功能，避免感度不足及殘水效應等問題M350762 VIII. New Description: [New Technology Field] This creation is about an image sensor, especially for an input device and its application. [Prior Art] Capacitive touch panels have become the common input devices in electronic products because of their low cost, relatively low sensitivity and resistive touch panels, long-term use, multi-finger operation, and light structure. , gradually replaced the mouse, roller input device. However, the capacitive touch panel still affects the performance of the touchpad due to insufficient sensitivity or residual water collapse. (4) The subject is therefore proposed to be used in conjunction with an image sensor and applied to image sensing. Provides the same functions as the electric touch panel, avoiding problems such as insufficient sensitivity and residual water effects
【新型内容】 本創作的目的之— 輪入裴置。 在於提出一種搭配影像感測器的 本創作的目的之— 裝置的桌上型電腦。 在於提出一種應用本創作之輸入 本創作的目的之— 襄置的筆記型電腦。 在於提出一種應用本創作之輸入 根據本創作 種搭配影像感測器的輸入裝置包括一 M350762 具有色差明顯之外部區域及内部區域的底座，以及一與像 感測器感測該底座的影像，區分出一操作區及其邊框^該 影像感測器感測該操作區的影像變化，提供—物體在該底 ' 座上的移動資訊。 以_ . I創作可與桌上型或筆記型電腦結合，做為取代電容 式觸控板的輸入裝置。 【實施方式】 • ® 1係本創作第一實施例，圖1之實施例以塑膠板16 做為底座，供影像感測器10辨識操作區域的邊界，内部區 域12為實際上的操作區’影像感測器1G辨識物體在内部 區域12的位置以達到定位或游標操作的功能；外部區域14 在色階上與内部區域12具有相當大的反差，用來提供一邊 框的功能，使影像感測器10能正確的判斷操作區域的邊界。 圖2係影像感測器1〇感測到之底座影像，包括内部區 φ域影像22及外部區域影像24，為了辨識出操作區域的位 置，圖2之影像經過一高通濾波器，本實施例以索貝爾運 算崙（Sobel Operator)將圖2之影像處理成圖3，使内部區域 影像22與外部區域影像24的交界處形成邊框，做為辨識 操作區32的邊界34。 多…圖4，右要加強對操作區的辨識率，可在内部區域 40旁加入可產生辅助形狀的指示裝置，例如在外部區域 增设LED光源44，藉由此已知輔助判斷位置提高辨識操作 區域的成功率，圖4經由高通濾波器後將更容易找出操作 6 M350762 區附近的特徵，達到操作區高辨識率的效果。 由於圖1中的内部區域12與外部區域14的辨識依賴 色階的差異’在低光環境下將無法有效辨識，為此，本創 作提出經進一步改良的實施例如圖5及圖6。圖5之實施例 係在圖1架構中的影像感測器10旁加入光源45，配合影像 感測器10的取像角度而移動’使影像感測器1〇得到足夠 的亮度辨別内部區域12與外部區域14的差別。目6係本 創作實施例，將底座16的内部區域12以具透光性的材料 製造’例如半透明壓克力板’外部區域14則以不透光的材 =遮罩，光源46由下往上方打光，使内部區域12在低光 環境下仍維持與外部區域14在色階上的差異。 圖7係當使用者的手指置於底座時的俯視圖，本實施 例以灰階CMOS Se聰做為影像感測器，#|取之影像如圖 8。在判疋操作區内物體所代表的絕對位置時，若將位於 作區内的影像全部納入計算，會因有些部份的影像位移量 很小而產生遲滯現象，例如本實施例中的手背部份，換古 之，因為操作時僅有指纟5〇快速移動，手f的移動量很小°， 會拖慢整體移動量。因此’本創作在演算判定操作區内物 體的絕對座標時，僅以指㈣為代表。另—方面，因為無 論使用者由任何方向料指伸人操作區，影像相器齡 到的物體影像-定會有一端為連接邊框，以圖8為例，使 】者的手指由邊框下緣進入操作區，此時若由最上方開始 知描操作區内影像的話，如圖9所示，掃目苗到的第一個色 階超過-臨界值的位置52即為指尖5G所在處；此處所指 M350762 之掃描並非影像感 影像後演算法執^之順掃描順序，而是得到該訊框 訊框影像下方開始掃晦.若=若手指自上方進入，從該 像右側開始掃晦；若手指：右=方進，，從該訊框影 側開始掃描等等，圖【 進入，則從该訊框影像左 向進入時’進行訊框影◦像至掃圖二示當： 例利用調整影像感測器曝u推。本實施 像素位置54即為指尖所=:到= 該臨界值的 定範圍區域内的像素值㈣像素位置周圍一 座標。參照圖18之示竟圖 亥訊框影像中手指的絕對 置54為中心、周圍一：像：第：個超過臨界值的像素位 由0 π ，、為叶算絕對座標範圍，即可經 出圖19中像素位置54的 m ¥ m m ^ . 炱p可依照後段應用端的需求，輸 Μ;)=疋與控制游標使用的移動向量(M-〜r; MV)。移動向量的計算公式如下 MV = C[n] —c[n·” :中，CW為該訊框影像中手指的絕對座標，二； 為則一矾框影像t手指的絕對座標。 圖則本創作之輸人裝置的應賴組示意圖，輪入裝 核、·且66的底座64上具有足供辨識色階邊界的内部區域 及外部區域，影像感測器60以支架62設置在底座64上方， 感測底座64上的影像變化。 M350762 ♦圖21係本創作之輸入裝置模組設置在桌上型電腦時的 貝施例’桌上型電腦包括螢幕70、主機72以及鍵盤74， 輸模組66與鍵盤74結合。圖22係本創作之輸入裝 置权、、且置在桌上型電腦時的另一實施例，將底座π與影 像感測器76分開，底座78設置於鍵盤74，影像感測器76 則設置於螢幕7〇上。 卜圖23係本創作之輸入裝置設置在筆記型電腦時的一實 ^例將底座86及影像感測器88内置於筆記型電腦80的 ，现86及螢幕88周圍。目24係本創作之輸人裝置設置在 型電腦時的另—實施例，將底座86及影像感測器88 設計為抽出式’要使用時才從筆記型電腦8G的螢幕82和 鍵盤84側邊抽出影像感測器88及底座86。 本創作提出之使用影像感測器輸入裝置除了可忽略電 =觸控板之感度不足與殘水效應等缺陷，還可支援辨識 夕、，手勢達成各種應用功能，且底座僅需使用—色階上 反差對比大的小面積平面即可，無需考慮使用材料及佔用 ㈣等問題’適用範圍的彈性大幅增加，適於設計更多元 的應用產品。 另外光學滑鼠演算法中，由於使用區塊匹配（B1〇ck Matching)方式作為其演算法，故訊框速度必須高達數千以 上乂 θ加可支援的移動速度，若訊框速度太低則參考區塊 (响1"⑽心叫將無法在新的訊框速度中找到最適合之匹 :位置，在此種訊框速度需求下通常使用硬體來進行運 算’但如此將會造成硬體面積的增加。本創作之輸入裝置 M3 50762 的定位運算所需的訊框速度較低，大約為i5 需以硬體進行運算，可讀體配合驅動器的方式來二不 因此更節省硬體成本。 八果進仃’ 以上對於本創作之較佳實施例所作的 目的’而無意限定本創刪地為所揭露 為：二之 =導或從本創作的實施例學習而作修改或變化= 、實靶例係為解說本創作的原理以及讓孰習 一 .各種實施例利用本創作在實際應用上而選擇：敘:術： ^的技術思想企圖由以下的中請專利範圍及其均等來決 【圖式簡單說明】 圖1係本創作第一實施例； =^圖1之實施例中影像感測器感測到的影像 糸圖2之影像經高通濾波器濾波後的結果； 圖4係增设指示裝置的底座上視圖； 圖5係本創作第二實施例的示意圖； 圖6係本創作第三實施例的示意圖； 圖係使用者的手指置於底座上時的俯視圖. 圖8係以影像感測器感測圖7而得的影 ， 圖9係掃瞒圖8之影像的示意圖； ’ 圖10至圖16 向及順序； 晦方 緣示當手指由不同方向進入時的掃 圖17繪不經由掃瞄得知手指位置的示意圖； 10 M350762 圖18、會：產生之手指絕對座標的内插示意圖； 圖19綠示繪示圖7 ’ 絕對座標與整體關係圖； 圖20係本創作之輸入裝置一應用例，· 圖21係本創作之輸人裳置應用於桌上型電腦的圖； 之影像經計算後，得出手指位置 的 圖22係本創作之輸入裝置應用於桌上型電腦 意圖； 不 圖23係本創作之輸入裝置應用於筆記型電腦的示音 圖；以及 、不思 意圖。 圖24係本創作之輸入裝置應用於筆記型電腦的另 【主要元件符號說明】 10 影像感測器 12 内部區域 14 外部區域 16 底座 22 内部區域影像 24 外部區域影像 32 操作區 34 邊界 40 内部區域 42 外部區域 11 M350762[New content] The purpose of this creation - the wheeled device. It is to propose a desktop computer for the purpose of the creation of the image sensor. It is to propose a notebook that uses the input of this creation for the purpose of this creation. An input device for applying the present invention is provided. The input device according to the present invention is equipped with an image sensor, and the M350762 has a base with an obvious external area and an inner region, and an image sensed by the image sensor to distinguish the image. An operation area and a frame thereof are provided. The image sensor senses an image change of the operation area, and provides movement information of the object on the bottom seat. The _.I creation can be combined with a desktop or notebook computer as an input device to replace the capacitive touch panel. [Embodiment] • ® 1 is the first embodiment of the present creation. The embodiment of Fig. 1 uses the plastic plate 16 as a base for the image sensor 10 to recognize the boundary of the operation area, and the internal area 12 is the actual operation area. The image sensor 1G recognizes the position of the object in the inner region 12 to achieve the function of positioning or cursor operation; the outer region 14 has a considerable contrast with the inner region 12 in the color gradation, and is used to provide a border function to make the image sense The detector 10 can correctly judge the boundary of the operation area. 2 is an image of the base sensor sensed by the image sensor 1 , including an inner region φ domain image 22 and an outer region image 24 . In order to recognize the position of the operation region, the image of FIG. 2 passes through a high-pass filter. The image of FIG. 2 is processed into a map by Sobel Operator, and a border is formed between the inner area image 22 and the outer area image 24 as a boundary 34 of the identification operation area 32. More... Figure 4, right to enhance the recognition rate of the operating area, can be added to the internal area 40 to create an auxiliary shape of the pointing device, for example, an additional LED light source 44 in the external area, by which the auxiliary position is known to improve the identification operation The success rate of the area, after passing through the high-pass filter in Figure 4, will make it easier to find the features near the operation 6 M350762 area, achieving the high recognition rate of the operating area. Since the difference between the identification of the inner region 12 and the outer region 14 in Fig. 1 depends on the color gradation, it will not be effectively recognized in a low light environment. For this reason, the present invention proposes a further improved embodiment such as Figs. 5 and 6. The embodiment of FIG. 5 is configured by adding a light source 45 adjacent to the image sensor 10 in the architecture of FIG. 1 to move with the image capturing angle of the image sensor 10 to enable the image sensor 1 to obtain sufficient brightness to distinguish the internal region 12 . The difference from the outer area 14. In the present embodiment, the inner region 12 of the base 16 is made of a light transmissive material. For example, the outer region 14 of the translucent acrylic sheet is opaque material = mask, and the light source 46 is under Lighting upwards causes the inner region 12 to maintain a difference in gradation from the outer region 14 in a low light environment. Figure 7 is a top view of the user's finger when placed on the base. In this embodiment, the gray-scale CMOS Se is used as the image sensor, and the image taken as #| is shown in Fig. 8. When the absolute position represented by the object in the operation area is judged, if all the images located in the processing area are included in the calculation, hysteresis may occur due to the small amount of image displacement in some parts, such as the back of the hand in this embodiment. For the sake of the ancients, because only the finger 纟 5〇 moves quickly during operation, the amount of movement of the hand f is small, which will slow down the overall movement. Therefore, when the calculation determines the absolute coordinates of the object in the operation area, it is represented by only the finger (4). On the other hand, because the user extends the operating area from any direction, the image of the object of the image phase is set to have a connecting frame at one end. Take Figure 8 as an example to make the finger of the lower edge of the frame. Entering the operation area, if the image in the operation area is known from the top, as shown in FIG. 9, the position 52 of the first color gradation exceeding the threshold value is the position of the fingertip 5G; The scan of the M350762 referred to here is not the scanning sequence of the image-sensing image algorithm, but the brow is started below the frame image. If the finger enters from above, the broom is started from the right side of the image; If the finger: right = square, start scanning from the shadow side of the frame, etc., if the picture enters, the image will be imaged from the left side of the frame image to the second picture. Adjust the image sensor exposure u push. The pixel position 54 of the present embodiment is the fingertip =: to = the pixel value in the range of the threshold value (4) a coordinate around the pixel position. Referring to FIG. 18, the absolute position 54 of the finger in the image of the image frame is centered, and the surrounding one: image: the pixel position exceeding the critical value is 0 π, and the absolute coordinate range of the leaf is calculated. In Fig. 19, m of the pixel position 54 is ¥ mm ^ . 炱p can be input according to the requirements of the later stage of the application;) = 疋 and the motion vector (M-~r; MV) used by the control cursor. The calculation formula of the motion vector is as follows: MV = C[n] - c[n·" : where CW is the absolute coordinate of the finger in the frame image, and 2; the absolute coordinate of the finger of the frame image t. A schematic diagram of the creation of the input device, the wheeled core, and the base 64 of the 66 has an inner region and an outer region for identifying the color gradation boundary, and the image sensor 60 is disposed above the base 64 with the bracket 62. , sensing the image change on the base 64. M350762 ♦ Figure 21 is a case where the input device module of the present invention is set on a desktop computer. The desktop computer includes a screen 70, a host 72, and a keyboard 74. The group 66 is combined with the keyboard 74. Fig. 22 is another embodiment of the input device of the present invention, and is disposed on the desktop computer. The base π is separated from the image sensor 76, and the base 78 is disposed on the keyboard 74. The image sensor 76 is disposed on the screen 7A. The figure 23 is a real example of the input device of the present invention being installed in the notebook computer, and the base 86 and the image sensor 88 are built in the notebook computer 80. Now 86 and around the screen 88. Head 24 is the creation device settings of this creation In another embodiment of the computer, the base 86 and the image sensor 88 are designed to be drawn out. When the image is to be used, the image sensor 88 and the base 86 are extracted from the side of the screen 82 and the keyboard 84 of the notebook computer 8G. The use of the image sensor input device proposed by the present invention can not only ignore the defects such as the lack of sensitivity and residual water effect of the electric touch panel, but also support the recognition of the eve, the gesture achieves various application functions, and the base only needs to use the color. The contrast on the scale can be compared with the large small-area plane, without considering the use of materials and occupation (4). The flexibility of the applicable range is greatly increased, and it is suitable for designing more applications. In addition, the optical mouse algorithm uses the area. Block matching (B1〇ck Matching) mode as its algorithm, the frame speed must be up to thousands or more 乂 θ plus supportable moving speed, if the frame speed is too low, the reference block (1 " (10) will call It is impossible to find the most suitable horse in the new frame speed: position, which is usually calculated using hardware for the frame speed requirement. 'But this will increase the hardware area. The frame operation speed required for the positioning operation of the input device M3 50762 is low, about i5 needs to be calculated by hardware, and the readable body is matched with the driver, so that the hardware cost is not saved. The purpose of the preferred embodiment of the present invention is not intended to limit the invention as being disclosed as: a change or change from the embodiment of the present invention, or a real target is a commentary. The principle of creation and letting you learn one. Various embodiments use this creation in practical application: Xu: surgery: ^ The technical idea is attempted by the following patent scope and its equalization [simplified diagram] 1 is the first embodiment of the present creation; =^ the image sensed by the image sensor in the embodiment of FIG. 1 is the result of filtering the image of FIG. 2 by the high-pass filter; FIG. 4 is the top view of the base of the additional indicating device Figure 5 is a schematic view of a second embodiment of the present invention; Figure 6 is a schematic view of a third embodiment of the present invention; Figure is a top view of the user's finger placed on the base. Figure 8 is a sensor sensor sensing map 7 shadows, Figure 9 A schematic view of the image of the broom of Fig. 8; 'Fig. 10 to Fig. 16 and sequence; 晦 square edge shows a schematic view of the finger when the finger enters from different directions. FIG. 17 depicts the position of the finger without scanning; 10 M350762 Fig. 18 , will: the interpolated schematic diagram of the absolute coordinates of the generated finger; Figure 19 shows the green diagram of Figure 7 'absolute coordinates and the overall relationship diagram; Figure 20 is an application example of the input device of the creation, · Figure 21 is the input of the creation Figure 2 is applied to the desktop computer; after the image is calculated, the finger position is obtained. Figure 22 is the input device of the present application applied to the desktop computer; The sound map of the computer; and, not thinking. Fig. 24 is another main component symbol description of the input device of the present invention applied to the notebook computer 10 image sensor 12 inner area 14 outer area 16 base 22 inner area image 24 outer area image 32 operation area 34 boundary 40 inner area 42 External area 11 M350762
44 LED光源 45 光源 46 光源 50 指尖 52 第一個色階發生變化的的位置 54 指尖的像素位置 56 指尖的絕對座標位置 60 影像感測器 62 支架 64 底座 66 輸入裝置模組 70 螢幕 72 主機 74 鍵盤 76 影像感測器 78 底座 80 筆記型電腦 82 螢幕 84 鍵盤 86 底座 88 影像感測器 1244 LED light source 45 Light source 46 Light source 50 Fingertip 52 Position where the first color gradation changes 54 Finger position of the fingertip 56 Absolute coordinate position of the fingertip 60 Image sensor 62 Bracket 64 Base 66 Input device module 70 Screen 72 Main unit 74 Keyboard 76 Image sensor 78 Base 80 Notebook 82 Screen 84 Keyboard 86 Base 88 Image sensor 12