丄344111 、 九、發明說明： 【發明所屬之技術領域】 ... 轉明係有關於—種_頸部以上的人肋作以輔助溝通 , 之f法’尤其指利用唇形開、閉影像來對外傳遞訊息及控制= 式家電、電腦或輪椅、自動翻書機、病床舉升系統等之方法。 【先前技術】丄344111, IX, invention description: [Technical field to which the invention belongs] ... The melody system has a kind of ribs above the neck to assist communication, and the f method especially refers to the use of lip-shaped open and closed images. To send messages and control = home appliances, computers or wheelchairs, automatic book-turning machines, bed lift systems, etc. [Prior Art]
溝通1^^錄_者㈣各式家電，前職障者對外 傳統幫助殘障者對外溝通的辅具系統，必需在殘障 配戴各種配件者可叫鍵輕碼輸从明部 滑鼠’但殘障者在糾fa1配齡件後，會造成不舒適的情开二 尤其是脊傷的重度傷殘患者，^ 並無能力控制以其它控制源作為驅動源的輔具如單2斯 碼輸入及以頭部控制滑鼠等，皆無控制能力， 之開、閉等方式。 #通的方式僅有唇形開、閉或眼部 來對外傳遞訊息及控制各 病床舉升系崎，係本發 —項創新。 利用唇形或眼部開、閉之影像， 式家電、電腦或輪椅、自動翻書機、 明人致力於幫助殘障者對外溝通的另 【發明内容】 本發明可以解決傳統殘障者輔且， 件’造成殘障者使用不舒適的問題/…、而長期配戴各式配 1344111 • 本發明係提供—種利用頸部以上的人 之方法，包括下列步驟：A 1 體動作，以輔助溝通 僳·β對上,f · °取人體頰部以上之特徵區域的影 像，伙對上述影像進行偵測盥 區域，進行影像定位與摘取;對人體頸部以上之特定 ==，經影傢辨識後，可區分為長時間、短時間之特定 12 次數與順序的1 ί家標準長短音’·F•並採用摩斯碼與電腦内建的美國Communication 1^^录_ (4) All kinds of home appliances, the former disabled person's external support system for the disabled to communicate with the disabled, must wear a variety of accessories in the disabled can call the key code to lose from the Ming mouse 'but disabled After correcting the fa1 ageing parts, it will cause uncomfortable feelings, especially severely disabled patients with spinal injuries. ^ There is no ability to control the auxiliary equipment with other control sources as the driving source, such as single 2 code input and Head control mouse, etc., have no control ability, open, closed and other methods. #通的方式 has only lip-shaped opening, closing or eye to send messages to the outside and control each bed to lift the genus, which is the innovation of this issue. Using the image of the lip or the eye to open and close, the home appliance, the computer or the wheelchair, the automatic book-turning machine, and the Ming people are dedicated to helping the disabled to communicate externally. [Invention] The present invention can solve the problem of the traditional disabled person. 'The problem of uncomfortable use of disabled people/..., and long-term wear of various types of 1344111. The present invention provides a method of using a person above the neck, including the following steps: A 1 body action to assist communication 僳· On the β-pair, f · ° takes the image of the characteristic area above the cheek of the human body, and the image is detected and the image is positioned and extracted; the specificity of the human body above the neck ==, after being recognized by the photographer Can be distinguished as long time, short time specific 12 times and order of 1 ί standard long and short '·F• and use Morse code with computer built-in US
碼；g"*啐叫今、，丫將摩斯碼對應轉換成電腦可接受之標準 作』再哞業系統的奶函數’使電腦產生滑鼠相對應的動 作I /在/業系統的ΑΡί函數，使電腦產生鍵盤相對應的動 以便進―^0财#納，計數摩斯碼長音或短音的總次數， 订豕電控制；】·執行自行對外溝通程序。 上述之特定d域包含唇、眼、眉及頭部。 盤的對應的輸出入動作，包含輸出聲音訊號、執行鍵 ‘輸及執订滑鼠的移動、點選及拖良等動作。 結Μ 優點在於：本發簡用頸部以上的人體動作，以 mi之方法’其利㈣形開、閉的技巧，由攝影機讀入， 仃。形開、閉之辨識工作，使殘障者可以向外傳遞味自， 進而輔助殘障者料傳軌息及㈣各式家電、電腦或輪椅、 i動翻書機、病床之舉升系統等，其簡化了殘障者控制各式家 =的硬體系統、減少系統製作成本及架設的複雜度並且使用 的身上不需喊任何配件’可提供舒適、制賴作環境。Code; g"*啐叫今,,丫 converts the Morse code into a computer-acceptable standard. The milk function of the system is used to make the computer produce the corresponding action of the mouse I / in the system of the industry ΑΡ ΑΡ The function enables the computer to generate the corresponding movement of the keyboard in order to enter the ^^财财#, count the total number of long or short tones of the Morse code, and order the power control;]·Execute the self-external communication program. The specific d-domain described above includes the lips, eyes, eyebrows, and head. The corresponding input and output actions of the disc include the output of the sound signal, the execution of the key ‘transmission and the movement of the mouse, the selection and the dragging. The advantage of the knot is that the hair is used by the human body above the neck, and the method of mi is used to read and close the camera. The identification of open and closed, so that the disabled can pass the taste to the outside, and then assist the disabled to pass the track and (4) various home appliances, computers or wheelchairs, i flip books, bed lift systems, etc. It simplifies the control of various types of home hardware systems, reduces the cost of system manufacturing and the complexity of erection, and does not need to call any accessories to provide comfort and environment.
1344111 【實施方式】 请參閱第一圖，太私B日及· 4β 作以輔助溝通之方法，從7；^—鋪㈣抑上的人趙動 Α.擷取人體_以上的影像：影像 像讀入’晰-步的影像心^ Β·對上述影像進行偵測與追縱 偵測、人臉驗證及追縱等（_第二圖），換、膚色 C.對人體卿以上之特定 要係操取唇—影像(請參二位;主 後，可_長2部以上之_域動作影像，經影像辨識 :理職爾 動，換成摩斯碼。辨識出摩斯碼的長、短音（請參閱第三 】’_/、係利用唇形開、閉之時間長短，其長短之比率為3: 短曰之開、閉時間為】秒，則長音之開、閉時間為祕。 码，如^摩斯碼對應轉換成電腦可接受之鍵盤及滑鼠國際標準 國際標二:W力_文_〜2摩斯碼與 G.利用國際標準媽使電腦產生相 :短音，對應到所屬電腦的標準:T將辨識出摩斯碼· 的^動、點選及拖幾（請參閲第四圖）等^以模擬出執行滑鼠 广用標準碼使電腦產生相應的動作。 長、也音，對應到所屬電腦 將辨識出摩斯碼的 鍵盤所對應之動作（請參閱第/圖/、。’藉以模擬出文書處理時 在固定時f切軸，計 (即嘴唇__次 長音或短音的總次數 J.以執仃自行對外溝通程序 硬體裝置 則嘴唇需在固定時間週期内開啓—次，即;：:編號】的家電， 若在下-次時間週_，嘴 7可啟動編號1的家電， 家電，家電控制方式，可採可關閉其編號1的 實施使用本發明_頸部 万式 方法，其利用唇形開、閉狀”^人體動作，以輔助溝通之 _取出來，___；： 將唇形開、閉狀態之輪 辰㈣2線輪靡的技巧’判斷唇形開、閉狀態，並將 =、閉的動作影像，經影像辨識後，轉換成摩斯碼，輸入 所屬電腦，再利用電腦内建的輸出人介面[如微2， 笼咖1161 P〇rt，聰 P〇rt，PS2, IEEE 1394, Bluet00th(藍 穿）’ IR(紅外線）等]’俾以輔助殘障者控制外界家電 、電腦或 輪椅、自動翻書機、病床舉升系統等。 實施使用本發明利用頸部以上的人體動作，以輔助溝通之 方法’其利用唇形開、閉狀態演算法，將卷形開、閉狀態之輪 靡掏取出來’透過線輪廓的技巧，判斷唇形開、閉狀態，並將 唇形開、閉的動作轉換成摩斯碼輸入至所屬電腦，藉以電腦内 建輸出入"面’ _擬出輸出聲音訊號，該聲音訊舰殘障者透 過唇形開嶋倾外傳遞H，其使全㈣瘓的殘障者對外 溝通無礙者。 ，其中4形開、閉狀態演算法，包括人臉影像债測及追 h 像比對、唇形景〉像處理、唇形景彡像辨識等；當唇形 i閉之動作’藉由影賴取卡及GQ)攝影將RGB格式之彩色影 η貝入’可對唇形開、閉之動作，進行色彩空間轉換、膚色债 =、人臉驗證及追蹤，當人體頸部以上的唇形影像被準確定位 理的2 〃像處理决磁擷取影像’賴取的影像透過影像處 ^技巧’把唇卵像的財_取㈣，並騎唇形開、閉輪 作’同時計算唇部開、閉的時間，把齡自唇形影像 摩斯二Γ Γ:成摩斯碼，利用摩斯碼辨識演算法’辨識出 藉 關剛碼嶋，_所認識的標準 “彳作㈣、統的API錄，使鹤產生姆庫 :及=:訊號、執行鍵盤的心二： ^ 達到幫助殘障者自行對外溝通之目的者。 有眼部之門本:明Ϊ實施方式’除了唇形開、閉之動作外，尚 點頌之動====♦*—頭或 1344111 【圖式簡單說明】 第一圖：係本發明之步驟流程圖。 第二圖：係本發明之人臉偵測與追蹤演算架構圖。 第三圖：係本發明之唇形影像處理與開閉辨識架構圖。 第四圖：係本發明滑鼠模式之摩斯碼集合表。 第五圖：係本發明A〜Z的摩斯碼對照表。 【主要元件符號說明】1344111 [Embodiment] Please refer to the first picture, too private B day and · 4β for the method of assisting communication, from 7; ^ - shop (four) to suppress people Zhao moving 撷. Capture the image of the human body _ above: video image Read the image of 'clear-step image^ Β·Detect and trace the above images, face verification and tracking, etc. (_Second picture), change, skin color C. Take the lip-image (please refer to the second position; after the main, you can _ longer than 2 _ domain action images, after image recognition: responsibilities, change to Morse code. Identify the length of the Morse code, Short sound (please refer to the third) '_/, the length of time to open and close the lip shape, the ratio of length to length is 3: the opening and closing time of the short squat is seconds, then the opening and closing time of the long sound is secret. Code, such as ^ Morse code corresponding to the computer to accept the keyboard and mouse international standard international standard two: W force _ text _ ~ 2 Morse code and G. use the international standard mother to make the computer to produce phase: short tone, Corresponding to the standard of the computer to which it belongs: T will recognize the Moss code, click and drag (see the fourth figure), etc. to simulate the execution of the mouse. The code causes the computer to generate the corresponding action. The long sound is also corresponding to the action of the keyboard on which the computer will recognize the Morse code (please refer to the figure / picture /, '. Axis, meter (ie the total number of times the lips __ long or short sounds J. In order to perform the external communication program, the lips need to be turned on within a fixed time period - ie, ;:: number] In the next-week time _, the mouth 7 can activate the number 1 home appliance, the home appliance, the home appliance control method, and the method of closing the number 1 can be used. The present invention is used in the neck-style method, which uses the lip shape to open and close. ^ Human body movement, to assist in the communication _ take out, ___;: The lip of the open and closed state of the lip (four) 2-line rim skills 'determine the lip shape, closed state, and =, closed action image, by After image recognition, convert to Morse code, input the computer, and then use the built-in output interface of the computer [such as micro 2, cage coffee 1161 P〇rt, Cong P〇rt, PS2, IEEE 1394, Bluet00th (blue wear) 'IR (infrared), etc.'' to help the disabled to control the outside world Home appliances, computers or wheelchairs, automatic book-turning machines, bed lift systems, etc. Implementing the use of the present invention to utilize the human body action above the neck to assist in the communication method, which uses the lip-shaped open and closed state algorithms to open the roll The rim of the closed state is taken out to pass the skill of the line outline to judge the opening and closing state of the lip shape, and the action of opening and closing the lip shape is converted into the Morse code input to the computer, thereby the computer built-in input " The surface ' _ is intended to output an audio signal, and the voice of the disabled person transmits H through the lip shape, which makes the disabled person of the whole (four) 对外 uninterrupted. The 4-shaped open and closed state algorithm , including face image debt measurement and chasing h image comparison, lip shape > image processing, lip shape image recognition, etc.; when the lip shape i closed action 'by capturing cards and GQ" photography will be RGB format The color image ηBei' can be used to open and close the lip shape, perform color space conversion, skin color debt =, face verification and tracking. When the lip image above the human neck is accurately positioned, the 2 image processing is performed. Demagnetizing the image Like the ^ skill 'take the lip egg like the money _ take (four), and ride the lip shape open, closed wheel for 'simultaneous calculation of the opening and closing time of the lip, the age from the lip image Moss Γ Γ: into the Morse code Using the Morse code identification algorithm to identify the standard of the "Knowledge of the code", the standard of "Knowledge (four), the system of the API, so that the crane produces Mku: and =: signal, the heart of the keyboard: ^ Achieve the purpose of helping the disabled to communicate on their own. There is a door to the eye: Alum implementation mode 'except for the action of opening and closing the lip shape, it is still moving.====♦*-head or 1344111 [Simple description of the drawing] The first picture: the invention Step flow chart. The second figure is a diagram of the face detection and tracking calculation architecture of the present invention. The third figure is a diagram of the lip image processing and opening and closing identification architecture of the present invention. The fourth figure is a Morse code set table of the mouse mode of the present invention. Fig. 5 is a comparison table of Morse codes of the invention A to Z. [Main component symbol description]