201030558 四、指定代表圖： (一) 本案指定代表圖為：第（i )圖 (二) 本代表圖之元件符號簡單說明：201030558 IV. Designated representative map: (1) The representative representative of the case is: (i) Figure (2) The symbolic symbol of the representative figure is simple:
2.2.
3. 4.3. 4.
:連接電腦的投影機，錢幕顯示裝置。 :連接電腦的數位影像_取與 :雷射投影筆等可操控的指示性發光裝置。: A projector connected to a computer, a money screen display device. : Digital image connected to a computer _ Take and : A steerable indicating light-emitting device such as a laser projection pen.
u, :-般電腦程式，如簡報、_、多媒體程式。 :本發明 中才曰示性光點之移動或閃爍等變化。 示發明特徵的化學式 五、本案若有化學式時，請揭示最能顯 無 六、發明說明： 【發明所屬之技術領域】 ===之與電腦程式控制技術 【先前技術】 電腦畫面郷細*技減裝置、録賴轉娜技 置、電腦作業系統與軟體間訊息傳遞技術、指示性發署; 術、影像處理技術、軟體開發工具。 夜 201030558 【發明内容】 人機介面操作模式。以往普遍的人機介面操 鼠、鍵盤、遙控裝置、觸控螢幕或其他操 ί裝/4齡面絲雜置。這類絲対具有許多限 用遙^裝^用Γΐίϊ盤均需要靠近電腦或操控裝置，即使使 :類裝置，則“顯示二控= 代價較昂貴且Μ更鋪示郎位置广㈣電子機件在往 錢備，也不雜何紐I。= ，她軸“顯 ===:時^ =私並在影像中找尋指示性發光裝置的光點變化，例如光點 幕r::=r置直接與= 數位攝影機、魏_、_ 3 201030558 指示性發光裝置(如雷射投影筆、手電筒、投射光束等），另外 在控制原始顯示内容的軟件方面，透過軟體間控制機制(如 OLE、Message Sending等）’可建立起所需的操作環境。而本 發明的關鍵技術，則在於在擷取到的即時影像中辨識出指示性 光點的變化。這些關鍵元素的組合，表明於本發明的指定代表 圖第(1)圖中。 本發明應用範圍廣泛，例如應用於使用電腦與投影機進行簡報 時，可使用雷射投影筆，直接控制投影屏幕中的畫面進行開 始、換頁、跳頁、或結束等動作，也可以模擬畫筆控制簡報放 影軟體加上線條或圖案’此類應用的操作方式如第(2)圖所示。 =明另外達成-種特_效果。當指示性發絲 ^光點特徵（例如制產生不同顏色光點的多㈣射^ ί人?何以生由多人於一個屏幕上操作同一套系統。例t 多人可以同時進行分割晝面作業、電腦遊戲、 由辨識糊絲的變化效果即可達成。此效果有如多 么各自操作-個滑鼠在同—個畫面中控制—個系統，現 =置直接與顯讀面或屏幕互動，因此不再受單-電腦的# 用工間侷限。此類應用的操作方式如第⑶圖所示。、吏 本發明不僅可運用於投影機與掊 為投:環境“空間 電壤本衫频料與料，目 201030558 式 求較小。第⑶圖顯示直接擷取電腦螢幕影像的操作方 ===於大型顯示裝置。例如建築物牆面上掛附的大 孓液晶螢幕或其他顯示裝置，此時雷射投影筆 光束或絲代可 由^面控制大魏示齡_容，進行數位内容選取、捲 互動。此類應用的操作方式如第(6)圖所示。 【實施方式】 ❿ 月ΐίίίί，ί於關鍵的光點變化辨識與内容軟體控制 =要為電腦軟體，也可从包含軟體的硬 體裝置。而實施方式中，具備幾個步驟： 1. 環境的組成 面ί作模式環境，需包含電職具備等同於 (投職細轉和、縣擷取裝 置(數位攝像财其提絲^可處卿狀財錢 ΐϊίϊί 紐料），並顯_裝置及雜擷取裝置 或軟禮間可溝通_路作f平台上，而由人操 另外此操作模式須具備欲操作或控制的軟 ΪΪ式統’例如簡報放映軟體、繚圖軟體、多媒體軟 嫌實施可觸擷轉像+指示錄紐置所發之光點 變化的程序，麵雜由觸光點 體 此環境如第（1)圖所示。 Iu縣他欺體。 2. 影像的讀取與處理 影像的讀取，現已普遍經由電腦的 rr:3=，素陣列 其X 的RGB像素陣列’每秒約可獲取3〇張影 5 201030558 ^。本發明實施之軟體程序具娜像前處理她 續影像進行差異運算即可得到差異影像。 兩張連 3·光點的辨識 將差異影像使用與光點接近之顏色職細(例 照過濾)並用程式加以觸，即可快速找到 性$ 位置。由辨識到的光點位置，可即時紀錄其點 另外根據其停留於相近位置的 用者是否操作光點之閃爍，或連續兩次閃爍。 j疋使 〇 4.影像光點位置與原始顯示畫面位置之座標轉換 ^始=示畫面與實境擷取影像的範例_如第⑺圖所示。 ^不屏幕或脑上所顯福螢幕畫面原為-矩形四邊形此四 ，形因影像擷取為立體實境的關係，在操取影像中將成為一個 投影後的四邊形’即第⑺圖中標示的A、B、c、D四;晝面 程序糊始辨麟縣由使財點出四端點 二立於操取雜中的位置，接著程式可以將A、c兩端點相連， ❹ D兩1點相連，則可得到交點〇，此〇點即為原始影像的 。由此中心點根據平行線投影消失點原理，可找出原始 4二的水平與垂直巾線，再根據各端點至巾線點線段比例 各無深度資訊。這些端關縣縣座標與投影後影 像座標之相對關係即可將光點p轉換回原始畫面座標。 5.獲得使用者意圖後，控制原始顯示軟體的方法 當使用者將指示性發光裝置的光點於顯示屏幕上進行移動或 閃爍動後，影像辨識模組即時經上述過程獲得使用者之意 圖’接著變可藉由軟體訊息傳遞(Message Sending)或控制(OLE) 的f法通知原始提供顯示畫面之軟體，以達成讓人使用指示性 發光裝置就可以在投影或顯示屏幕晝面上對軟體進行直接互 動的人機介面操作模式。 6 201030558 【圖式簡單說明】 第(1)圖 此圖，本發明之代表圖。圖中顯示本發明之操作模 含顯不裝置、影軸取裝置、指示性發光裝置、 、’ $ 被控制的原始晝面提供軟體與關鍵的影像光點觸組I’。以 第(2)圖u, :-like computer programs, such as newsletters, _, multimedia programs. In the present invention, changes such as movement or flicker of the light spot are indicated. Chemical formula 5 showing the characteristics of the invention. If there is a chemical formula in this case, please reveal the most obvious. 6. Description of the invention: [Technical field of invention] === and computer program control technology [Prior technology] Computer screen fine Subtraction device, recording and transfer technology, computer operating system and software communication technology, indicative development; surgery, image processing technology, software development tools. Night 201030558 [Summary content] Human-machine interface operation mode. In the past, the common man-machine interface, keyboard, remote control, touch screen or other operating device / 4 years old silk miscellaneous. This type of wire has many restrictions. It is necessary to use a computer or a control device. Even if it is a type device, it will display "two controls". In the case of money, it is not complicated. I, her axis "display ===: when ^ = private and look for the light point change of the indicator light device in the image, such as the light spot screen r::=r Direct and = digital camera, Wei _, _ 3 201030558 indicative lighting device (such as laser projection pen, flashlight, projection beam, etc.), in addition to the software to control the original display content, through the software control mechanism (such as OLE, Message Sending, etc.' can establish the required operating environment. The key technique of the present invention is to recognize the change of the indicative spot in the captured instant image. The combination of these key elements is indicated in the designation diagram (1) of the present invention. The invention has wide application range, for example, when using a computer and a projector for briefing, the laser projection pen can be used to directly control the screen in the projection screen to start, change pages, jump pages, or end, or simulate brush control. Briefing the release software plus lines or patterns' The operation of such applications is shown in Figure (2). = Ming also achieved - a special _ effect. When the indicator hairline ^ spot features (for example, the system produces different color spots, the number of (four) shots ^ 人 people? How to operate multiple people on the same system on a screen. Example t multiple people can simultaneously split the face , computer games, the effect of the change of the identification of the paste can be achieved. This effect is like how each operation - a mouse in the same screen control - a system, now = set directly interact with the reading surface or screen, so not Restricted by the single-computer's # labor. The operation of this type of application is shown in Figure (3). 吏 The invention can be applied not only to projectors but also to the investment: environmental “space electric soil shirts and materials” The head of 201030558 is smaller. The figure (3) shows the operator who directly captures the computer screen image === in a large display device, such as a large LCD screen or other display device attached to the wall of a building. The projection pen beam or the silk generation can be controlled by the surface control, and the digital content selection and volume interaction can be performed. The operation mode of such an application is as shown in the figure (6). [Embodiment] ❿ ΐ ΐ ΐ ΐ ΐ ΐ ΐ ΐ ❿ ❿ ❿ ❿ ❿ At the key spot change Identification and content software control = to be a computer software, but also a hardware device containing software. In the implementation, there are several steps: 1. The composition of the environment, the mode environment, the need to include the electric job is equivalent to (Investment and transfer, and the county's picking device (digital camera money, its wire can be in the state of money, money, ΐϊ ϊ ϊ 纽), and display _ device and miscellaneous picking device or soft room can communicate _ road for f platform On the other hand, this mode of operation must have a soft-handed system to be operated or controlled, such as a briefing software, a graphic software, a multimedia soft-spot implementation, a touch-sensitive image, and a light spot. The changing program is covered by the light-touching point. This environment is shown in Figure (1). Iu County is a bullying. 2. Image reading and processing of image reading, now universally via computer rr: 3 =, the RGB pixel array of the prime array of X can obtain about 3 〇 影 5 per second. 201030558 ^. The software program implemented by the present invention has a difference image before the image is processed by the sequel to obtain a difference image. 3. The identification of the light spot will use the difference image with the light spot Nearly the color job (example filter) and use the program to touch, you can quickly find the position of the position. From the identified spot position, you can instantly record the point and according to whether the user stays at the similar position to operate the spot. Blinks, or blinks twice in a row. j疋Encloses the coordinates of the image spot position and the original display position. ^Starting example of the image and the actual image captured as shown in the figure (7). The screen displayed on the screen or the brain is originally a rectangular rectangle. The shape of the image is a solid state. It will become a projected quadrilateral in the image, which is the A in the (7) diagram. , B, c, D four; kneading process paste began to distinguish Lin Lin County by making the financial point out of the four endpoints in the position of the operation, then the program can connect the ends of A and c, ❹ D two 1 When the points are connected, you can get the intersection point, which is the original image. According to the principle of the vanishing point of the parallel line projection, the center point can find the horizontal and vertical line of the original 4, and then there is no depth information according to the proportion of each end point to the line point line segment. The relative relationship between these coordinates of the county and county and the image coordinates after projection can convert the spot p back to the original picture coordinates. 5. After obtaining the user's intention, the method of controlling the original display software, when the user moves or blinks the light of the indicative light-emitting device on the display screen, the image recognition module immediately obtains the user's intention through the above process. Then, the software that originally provided the display screen can be notified by the method of Message Sending or Control (OLE), so that the software can be used on the projection or display screen by using the indicator light-emitting device. Direct interaction with the human-machine interface mode of operation. 6 201030558 [Simple description of the diagram] (1) This diagram is a representative diagram of the present invention. The figure shows an operational mode of the present invention comprising a display device, a shadow capture device, an indicative illumination device, a 'controlled original face providing software and a key image spot contact group I'. Figure (2)
此圖說明本發明之操作模式顧於簡報投獅操 可見由電腦與投影機產生簡報投影晝面，使用者使用二= 筆進行簡報，朗時用此㈣娜筆直接湖軸頁^ 誌等互動，無須遙控電子裝置或觸控屏幕。 /示 第⑶圖 此圖說明本發明之操作模式應驗多人同時操作之方式。圖中 可見多人同時使用不同顏色光關雷射投轉與屏幕互動。 第(4)圖 此圖說明本發明之操作模式應用於繪圖或設計類軟體的操作 方式。利用雷射投影筆與軟體中的晝筆選項，可使用光點直接 對屏幕進行繪圖或物件設計（例如建築設計或工業設計等）。 第(5)圖 此圖說明本發明之操作模式擷取電腦螢幕畫面時的影像。 第⑹圖 此圖說明本發明之操作模式應用於大型牆上顯示幕的操作方 式，此時攝像頭需裝置於顯示幕附近並線取光點位置，而發光 裝置需為雷射光束或強光手電筒等較大型的光束發射裝置。 7 201030558 第(7)圖 圖表樣、、貞不w屏幕之影像内容，與經過攝像 實境中擷取之影像内容兩者之關係，圖中包含 槐f ; 四端點A、B、C、D與晝面中心點^ :二：:巧域外框 像中的位置標示’以及原影像水平巾線與垂直4。點P於影 【主要元件符號說明】 1. WM :連接賴的投额，或顯示裝置。 2. ^^賴制喊__取態入裝置。 3. 〆：雷射投影筆等可操控的指示性發 —涵_原始Ή 且 內容提^赖 4. :一般電腦程式，如符趣々 _ π間報、繪圖、多媒體程式 影像光點 5. ί摩」:本發明關鍵電腦程式痞麻辦 一 回枉式或硬體，可辨識判讀影 中指不性光點之移動或閃爍等變化。 6. :投影機。This figure illustrates the operation mode of the present invention. The briefing projection lion can be seen by the computer and the projector to generate a briefing projection, the user uses the second = pen for the briefing, and the time is used to directly interact with the lake axis page. No need to remotely control the electronic device or touch screen. / (3) Figure This figure illustrates the mode of operation of the present invention in a manner that allows multiple people to operate simultaneously. In the figure, it can be seen that many people use different colors to switch off the laser and interact with the screen. (4) This figure illustrates the operation mode of the present invention applied to a drawing or design software. Using the laser pen and the pen option in the software, you can use the light spot to draw directly to the screen or object design (such as architectural or industrial design). (5) This figure illustrates the image of the operation mode of the present invention when capturing a screen of a computer screen. (6) This figure illustrates the operation mode of the present invention applied to the operation mode of a large wall display screen. At this time, the camera needs to be placed near the display screen and takes the position of the light spot, and the light emitting device needs to be a laser beam or a strong light flashlight. A larger beam emitting device. 7 201030558 The relationship between the image of the picture (7), the image content of the screen, and the image content captured by the camera, including 槐f; four endpoints A, B, C, D and the center point of the face ^ : 2:: The position in the frame of the frame is marked 'and the original image horizontal line and vertical 4. Point P shadow [Main component symbol description] 1. WM: the connection amount, or display device. 2. ^^ 赖 喊 _ _ take the device into the device. 3. 〆: steerable projection pen and other steerable indicator hair - _ _ original Ή and content mentions 4. : General computer programs, such as the fun 々 _ π intergram, drawing, multimedia program image spot 5. ί ”: The key computer program of the present invention is rammed or hard, and can recognize the movement or flicker of the irregular light spot in the interpretation shadow. 6. : Projector.
:攝像頭。 :電腦或具備電腦功能之控制裴置 :投射光或強光手電筒。 10. :將攝像頭設於大型顯示幕上方 擷取光點軌跡。:camera. : Computer or control device with computer function: Projection light or flashlight. 10. : Set the camera above the large display screen to capture the spot track.