200847036 九、發明說明： 【發明所屬之技術領域】 本發明係有關於一種利用頸部以上的人體動作以辅助溝通 之方法’尤其指利用卷形開、目影像來對外傳遞訊息及控制= 式家電、電腦或輪椅、自動翻書機、病床舉升系統等之方法。 【先前技術】200847036 IX. INSTRUCTIONS: [Technical Fields of the Invention] The present invention relates to a method for utilizing human body movements above the neck to assist in communication, in particular, the use of a roll-shaped opening and an eye image to transmit information and control = home appliances , computer or wheelchair, automatic book-turning machine, bed lifting system, etc. [Prior Art]
按，提供輔具給殘障者控制各式家電，係幫助殘障者 溝通的一種方式。 傳統幫助殘障者對外溝通的輔具系統，必需在殘障者身上 配戴各種配件’關殘障者可以單鍵摩斯碼輸人及以頭部 滑鼠’但鱗者在長咖配航件後，會造成不舒適的情形二。 尤其是脊藝傷的重度傷殘患者，因為全身癱瘓的關係， 並無能力控做其它控制源作為._源_具，例如單鍵 碼輸入及明部控财鼠等，冑無控概力，请難傷全 ==患者’向外溝通的方式僅_^ 7唇形或眼部開、閉之影像，來對外傳遞訊息及 式豕電、電腦或輪椅、自動翻書機、病床舉升系統等，係杯 明人致力於幫助殘障者對外溝通的另一項創新。 a 【發明内容】 必需長期配戴各式配 本發明可以解決傳統殘障者輔具 件，造成殘障者使用不舒適的問題。、 200847036 本發明係提供-種利_部以 、 之方法，包括下列步驟：A.擷取人體 广輔助溝通 =述影像進行侧舆追蹤;C:對人態頸==; &域，進行影像定位與擷 乂上之％疋 域動作影像，經影像辨識後:可= 動作，E.將不财數與猶 間之扣疋 別轉換為摩斯碼的長短時間之特定動作，分 國家標準碼對換表，將曰摩斯石二鹿用摩斯碼與電腦内建的美國 作;反==簡函數’使電腦產生滑鼠 二=_，計數摩斯碼長音或短‘^ 便進仃豕電控制；】.執行自行對外溝通程序。 上述之特定區域包含唇、眼、眉及頭部。 上述之相對應的輸出入動作，包含輸立 輔助、盖t月之&點在於.本發明利用頸部以上的人體動作，以 =溝，之方法，其利用唇形開、閉的技巧，由攝影機讀入， 進tir形開、閉之辨識工作，使殘障者可以向外傳遞訊自， =:障=傳遞訊息及控制各式家電、電腦或‘ 電的舉升系統等，其簡化了殘障者控制各式家 去 _'、、、'、減少系統製作成本及架設的複雜度，並且使用 、身上不說戴任何配件，可提供舒適、便利的操作環境。 200847036 【實施方式】 請參閱第-圖，本發明係提供 作以辅助溝通之方法，包括下列步驟：MW以上的人體動 Α·擷取人體頸部以上的影像： 格叙觀雜讀人，_下練卡腦攝影將 第二圖）。 ^的衫像處理工作（請參閱 B.對上述影像進行偵測與追縱· 偵測、人臉驗證及追縱等（請參閱第二匕圖括)色彩空間轉換、膚色 c·對人體頸部以上之特定區 : 要係擷取唇、眼及頭部影像（請參閱第^位與擷取：其主 上的特定區域被準確定位後 弟二圖），當人體頸部以 上述之人__上⑽;算鋪取影像。 後，可區分為長時間、短時間作影像，經影像辨識 影像處理的技巧把特定區域的輪廊二=的_ 工作。 3取出末，並進行輪廓辨識 E·利用摩斯竭辨識演算法 短時間之特絲作分鄕換 ^數細序的長時間、 廓動作轉換成摩斯碼。辨識出摩擷取自特定區域的輪 卜如短音之開、閉時間為!秒，^：:’n其長短之比率如 F·將摩斯觸應轉換成電腦可接閉時間為秘。 碼，如第四、五圖中之淋，在丨接又之鍵盤及滑鼠國際標準 國際標準_對照表、制功能及英文字母A〜z摩斯竭= 7 200847036 的長、短龙國^準碼使電腦產生相應的動作··將辨識出摩斯碼 的移動、所屬電腦的標準碼，藉以模擬出執行滑鼠 H 及拖矣（請參閱第四圖）等動作。 長、短使電腦產生域的動作：將辨識出摩斯瑪的 鍵盤觸詩撕書處理時 (即嘴唇開期内，計數摩斯碼長音或短音的總次數 :了的…次數），以準備控制對應的家電硬體裝置。 則嘴辰對外溝通程序。例如··欲開啓編號1的家電， 若:; 時間週期内開啓一次，即可啟動編號1的家電， 家電了二 =Γ，嘴唇再開啓一次’則可關閉其編號1的 控制方式’可採有線控制或無線遙控方式。 實施制本翻稱以上的人體 :法’其利用卷形開、閉狀態演算法，將唇形開、閉二 ^貢取出來’透過線輪廓的技巧，判斷唇形開、閉狀態，並將 。'形開、閉的動作影像，經影像辨識後，轉換成摩斯碼，輸入 ，所屬電腦’再利用電腦内建的輸出入介面[如rs232， ^rallel port，USB P〇rt，PS2, IEEE 1394, Bluet〇〇th(藍 牙），IR(紅外線）等]，俾以輔助殘障者控制外界家電、電腦或 輪椅、自動翻書機、病床舉升系統等。 實施使用本發明利用頸部以上的人體動作，以輔助溝通之 方法，其利用唇形開、閉狀態演算法，將唇形開、閉狀態之輪 靡梅取出來’透過線輪廓的技巧，判斷唇形開、閉狀態，並將 200847036 建輸出入2動作轉換成摩斯碼輸人至所屬電腦，藉以電腦内 過唇形開、1閉動出聲音訊號，該聲音訊號係殘障者透 溝通無礙者。 遞訊息，肢全麟賴麟者對外 蹤、唇形影觀對、；法，包括人臉影像_及追 開、閉之動作，藉奸==理、御影像辨鱗；當唇形 像讀入，可對辰_像摘取卡及ccd攝影將懸格式之彩色影 測、人臉驗證及追縱，進行色彩㈣轉換、膚色偵 後，利用影像處靜以上的唇形影像被準確定位 理的技巧，二擷取4 ’將擷取的影像透過影像處 廓辨識工作ΓΓ輪_取出來，並進行唇形開、閉輪 的輪廓動作，轉開利=贤* 電腦内建的美國國、第五圖所示的摩斯碼與 石馬’再啤叫作業系統的ΑΡΙ函數二電===認識的標準 ·<及拖3等動作，達到幫 m τ心的移動、 另外，本發明之實m 1行對外溝通之目的者。 有眼部之開、閉，眉毛的動越=^形開、閉之動作外，尚 點頭之動作，來騎溝軌息之擷部之動作’域頭或 200847036 ^【圖式簡單說明】 ‘ 第一圖：係本發明之步驟流程圖。 第二圖··係本發明之人臉偵測與追蹤演算架構圖。 ‘ 第三圖：係本發明之唇形影像處理與開閉辨識架構圖。 • 第四圖：係本發明滑鼠模式之摩斯碼集合表。 第五圖：係本發明A〜Z的摩斯碼對照表。 【主要元件符號說明】According to the provision of auxiliary equipment to control various household appliances for the disabled, it is a way to help the disabled to communicate. Traditional aid systems that help people with disabilities communicate with each other. It is necessary to wear various accessories on the disabled. 'A disabled person can use a single-button Moss code to enter and use a head mouse', but the scales are after the long coffee distribution. It will cause uncomfortable situation two. In particular, patients with severe disability who have spinal arteries have no ability to control other sources of control as a source of sputum, such as single-key input and Ming control money, etc. Please don't hurt the whole == patients' way of communicating outwards only _^ 7 lips or open and closed images of the eyes, to send messages and electricity, computers or wheelchairs, automatic book-turning machines, bed lifts System, etc., is another innovation that Cup Ming people are committed to helping people with disabilities communicate with others. a [Summary of the Invention] It is necessary to wear various types of accessories for a long period of time. The present invention can solve the problems of the conventional disabled person's auxiliary devices, resulting in discomfort for the disabled. , 200847036 The present invention provides a method for providing a variety of methods, including the following steps: A. extracting the human body to assist the communication = describing the image for side tracking; C: for the human neck ==; & The image positioning and the % 疋 field motion image on the ,, after the image recognition: can = action, E. convert the non-financial and the deduction between the shackles into the specific action of the length of the Morse code, according to the national standard The code pair is changed, and the Moss stone two deer is made with the Moss code and the built-in computer in the United States; the inverse == simple function makes the computer produce the mouse two = _, counting the Morse code long or short '^仃豕Electric control;]. Perform self-external communication procedures. The specific areas described above include the lips, eyes, eyebrows, and head. The above-mentioned corresponding input and output operations include the support of the support, the cover of the month, and the point of the present invention. The present invention utilizes the action of the human body above the neck, and the method of using the lip to open and close, Read by the camera, enter the tir-shaped open and closed identification work, so that the disabled can pass the message to the outside, =: barrier = pass the message and control various appliances, computers or 'electric lift system, etc., which simplifies Disabled people control all kinds of homes to _',,, ', reduce system manufacturing costs and erection complexity, and use, do not wear any accessories, can provide a comfortable and convenient operating environment. 200847036 [Embodiment] Please refer to the figure - the present invention provides a method for assisting communication, including the following steps: the human body above MW and the image above the neck of the human body: Under the card brain photography will be the second picture). ^The shirt image processing work (please refer to B. Detecting and tracking the above images, detecting, face verification and tracking, etc. (please refer to the second picture) color space conversion, skin color c · on the human neck Specific areas above the department: To capture the image of the lips, eyes and head (please refer to the position and capture: the specific area on the main body is accurately positioned, the second picture), when the human neck is the above person __上(10); Calculate the image. After that, it can be divided into long time and short time for image. The technique of image recognition image processing puts the porch of the specific area to the _ work. 3 Take out the end and perform contour recognition. E·Using the Moss to identify the algorithm for a short time, the wire is divided into long-term and fine-ordered, and the contour action is converted into a Morse code. It is recognized that the wheel is taken from a specific area, such as a short sound. The closing time is !second, ^::'n the ratio of its length is as F. The Moss touch is converted into a computer that can be closed. The code, such as the shower in the fourth and fifth figures, is connected Keyboard and mouse international standard international standard _ comparison table, system function and English letters A ~ z Moss exhaust = 7 200847036 The long and short dragon country code enables the computer to generate the corresponding action. · It will recognize the movement of the Morse code and the standard code of the computer to simulate the execution of the mouse H and dragging (see the fourth figure). Action: Long and short action that causes the computer to generate a domain: When the keyboard of the Mosma is recognized, the total number of times of counting the long or short sound of the Morse code: the number of times... In order to control the corresponding home appliance hardware device, the mouth communication system is external. For example, if you want to turn on the number 1 home appliance, if: • Turn on once in the time period, you can start the number 1 home appliance, and the home appliance is 2=Γ If the lips are turned on again, the control method of the number 1 can be turned off. The wired control or the wireless remote control mode can be adopted. The human body that implements the above method is called: the method uses the roll-shaped open and closed state algorithms to apply the lip shape. Open and close two ^ tribute to take out 'through the line outline skills, determine the lip shape, open and closed state, and 'shaped open, closed motion image, after image recognition, converted into Morse code, input, computer 'Reuse the built-in loss of the computer Input interface [such as rs232, ^rallel port, USB P〇rt, PS2, IEEE 1394, Bluet〇〇th (Bluetooth), IR (infrared), etc.], to assist disabled people to control external appliances, computers or wheelchairs, automatic flip A book machine, a bed lift system, etc. The use of the present invention utilizes a human body action above the neck to assist in communication, and uses a lip-shaped open and closed state algorithm to pluck the lip-shaped open and closed states. Come out 'through the outline of the line, judge the opening and closing state of the lip shape, and convert the input and output of the 200847036 into the Moss code to the user, so that the computer has a lip-shaped opening and a closed-out sound signal. The voice signal is for the disabled to communicate without any obstacles. The message is sent, the limbs are all Lin Lin, the person is out of the way, the lip shape is right, and the law, including the face image _ and the chasing, closing action, swindling == When the lip image is read in, it can be used for color image measurement, face verification and tracking of the hang-like image and face detection, color (4) conversion, skin color detection, and image utilization. The lip image above the static position is accurately positioned Coincidentally, the second capture 4' will capture the captured image through the image recognition work wheel _ wheel, and carry out the contour movement of the lip-shaped open and closed wheels, and turn to the United States, the first built computer The Moss code shown in Figure 5 and the Shima 're-beer called the operating system's ΑΡΙ function two electric === the standard of recognition · < and drag 3 and other actions to achieve the movement of the help m τ heart, in addition, the present invention The real m 1 line of external communication purposes. There are open and closed eyes, eyebrows move more than ^ ^ shape open, closed action, but nod action, to ride the groove of the crotch of the action 'domain head or 200847036 ^ [schematic simple description] First Figure: A flow chart of the steps of the present invention. The second figure is a diagram of the face detection and tracking calculation architecture of the present invention. ‘The third figure: is the lip image processing and opening and closing identification architecture diagram of the present invention. • Fourth figure: is a Morse code set table of the mouse mode of the present invention. Fig. 5 is a comparison table of Morse codes of the invention A to Z. [Main component symbol description]