TW201426401A - Somatosensory household electrical products control equipment and its system - Google Patents
Somatosensory household electrical products control equipment and its system Download PDFInfo
- Publication number
- TW201426401A TW201426401A TW101147760A TW101147760A TW201426401A TW 201426401 A TW201426401 A TW 201426401A TW 101147760 A TW101147760 A TW 101147760A TW 101147760 A TW101147760 A TW 101147760A TW 201426401 A TW201426401 A TW 201426401A
- Authority
- TW
- Taiwan
- Prior art keywords
- household electrical
- electrical product
- module
- somatosensory
- image data
- Prior art date
Links
Abstract
Description
本發明為提供一種體感家居用電產品控制設備及其系統，該系統結合體感辨識技術，將使用者動作及手勢比對預先定義之參照資料庫並發送遙控訊號，達成遙控操作之效果。 The invention provides a somatosensory household electrical product control device and a system thereof. The system combines a somatosensory identification technology to compare a user action and a gesture to a predefined reference database and send a remote control signal to achieve the effect of remote operation.
按，目前已知之家電自動化系統受限於輸入技術種類，採用接觸式-視覺介面作為使用者操控及接收系統回饋之依據，而接觸式-視覺介面意味使用者的操作自由度主要受顯示裝置之制約，亦即已知系統無法讓使用者免於操作實體裝置所帶來的不便和認知負擔。此外，已知系統中使用者仰賴視覺介面上的回饋進行操作，無法直覺式的觀照目標物進行操作，使其容易在操控目標-視覺回饋間產生認知不協調，而發生誤操作的情況。 According to the current known home appliance automation system, the type of input technology is limited, and the contact-visual interface is used as the basis for user feedback and receiving system feedback. The contact-visual interface means that the user's freedom of operation is mainly controlled by the display device. Constraints, that is, known systems do not protect the user from the inconvenience and cognitive burden of operating a physical device. In addition, it is known that the user in the system relies on feedback from the visual interface to operate, and it is impossible to intuitively observe the target to operate, so that it is easy to cause cognitive mismatch between the manipulation target-visual feedback, and misoperation occurs.
因此，需要發展一套非接觸式的直覺控制方式，讓使用者不需轉移視線確認指令的操作，並且盡量減少實體裝置的存在，以直覺式的操作取代按鈕及開關。 Therefore, it is necessary to develop a non-contact type of intuitive control, so that the user does not need to transfer the line of sight to confirm the operation of the instruction, and minimize the existence of the physical device, and replace the button and the switch with an intuitive operation.
是以，要如何解決上述習用之問題與缺失，即為本發明之發明人與從事此行業之相關廠商所亟欲研究改善之方向所在者。 Therefore, how to solve the above problems and deficiencies in the above-mentioned applications, that is, the inventors of the present invention and those involved in the industry are eager to study the direction of improvement.
故，本發明之發明人有鑑於上述缺失，乃搜集相關資料，經由多方評估及考量，並以從事於此行業累積之多年經驗，經由不斷試作及修改，始設計出此種能讓使用者在居住環境中，運用身體動作及手勢達到控制家居用電產品系統之目的，而無須另外透過硬體裝置進行指令輸入及視覺回饋。 Therefore, in view of the above-mentioned deficiencies, the inventors of the present invention have collected relevant information, evaluated and considered by various parties, and have accumulated many years of experience in the industry, and through continuous trial and modification, they have designed this kind of user to In the living environment, the body movements and gestures are used to achieve the purpose of controlling the household electrical product system without the need for additional command input and visual feedback through the hardware device.
為達上述之目的，本發明係一種體感家居用電產品控制設備及其系統，其係運用於具備家居用電產品設備之室內空間，該設備係包括：一裝設於該室內空間之主機裝置；至少一可接收動作影像資料之動作辨識裝置，該動作辨識裝置係與該主機裝置訊號連結；一裝設於各該家居用電產品之訊號接收模組，該訊號接收模組係接受該主機裝置發送出之訊號而運作；一外部設定介面，該外部設定介面係用以連結該主機裝置以進行資訊編輯與修改。 In order to achieve the above object, the present invention is a body-worn household electrical product control device and a system thereof, which are applied to an indoor space having a household electrical product device, and the device includes: a host installed in the indoor space The device has at least one motion recognition device that can receive motion image data, and the motion recognition device is coupled to the host device signal; and a signal receiving module installed in each of the household electrical products, the signal receiving module accepts The host device operates by transmitting a signal; an external setting interface is used to connect the host device for information editing and modification.
而系統則包括：a)啟動主機裝置；b)使用者體態動作輸入；c)是否可辨識之操作指令；d)辨識動作及定位目標家居用電產品；e)家居用電產品是否定位；f)訊號發送至家居用電產品；及g)完成操作家居用電產品。 The system includes: a) starting the host device; b) user body motion input; c) whether the identifiable operation command; d) identifying the action and positioning the target household electrical product; e) whether the household electrical product is positioned; The signal is sent to the household electrical product; and g) the household electrical product is completed.
根據本發明之一實施例，其中該主機裝置係包含：一目標判斷模組，該目標判斷模組接收 由該動作辨識裝置傳來之該動作影像資料，以判斷欲操控之目標家居用電產品；一模式辨識模組，該模式辨識模組接收由該動作辨識裝置傳來之該動作影像資料，以判斷該動作影像資料是否符合目標家居用電產品所預設之控制命令；及一家居用電產品控制模組，該家居用電產品控制模組將該控制命令發送至該訊號接收模組。 According to an embodiment of the present invention, the host device includes: a target determining module, and the target determining module receives The motion image data transmitted by the motion recognition device to determine a target home power product to be controlled; a pattern recognition module, the pattern recognition module receives the motion image data transmitted by the motion recognition device, Determining whether the motion image data meets a control command preset by the target home power product; and a home power product control module, the home power product control module transmitting the control command to the signal receiving module.
根據本發明之一實施例，其中該動作辨識裝置包含一供接收動作影像資料之偵測攝影機及一將該動作影像資料傳送至該目標判斷模組及該模式辨識模組進行整合分析之資料傳輸模組。 According to an embodiment of the present invention, the motion recognition device includes a detection camera for receiving motion image data and a data transmission for transmitting the motion image data to the target determination module and the pattern recognition module for integrated analysis. Module.
根據本發明之一實施例，其中該動作影像資料係為距離深度和彩色影像。 According to an embodiment of the invention, the motion image data is a distance depth and a color image.
根據本發明之一實施例，其中該家居用電產品更包含一接收訊號並執行家居用電產品開關、微調之控制模組。 According to an embodiment of the invention, the household electrical product further includes a control module for receiving signals and performing home electrical product switching and fine adjustment.
根據本發明之一實施例，其中該外部設定介面包括一供顯示家居用電產品偵測區域及其對應之辨識代碼之家居用電產品定位介面及一修改對應關係，修改編輯各家電/燈具動作操控設定介面。 According to an embodiment of the present invention, the external setting interface includes a home electrical product positioning interface for displaying a household electrical product detecting area and a corresponding identification code thereof, and a modified correspondence relationship, and modifying and editing each household appliance/lighting action Control the settings interface.
根據本發明之一實施例，其中該家居用電產品係為家電、電動窗簾或燈具其中之一者。 According to an embodiment of the invention, the household electrical product is one of a home appliance, an electric curtain or a light fixture.
根據本發明之一實施例，其中該步驟b)係由一動作辨識裝置擷取動作影像資料。 According to an embodiment of the invention, the step b) captures the motion image data by a motion recognition device.
根據本發明之一實施例，其中該步驟c)至步驟f)係由一主機設備進行分析。 According to an embodiment of the invention, the steps c) to f) are analyzed by a host device.
為達成上述目的及功效，本發明所採用之技術手段及構造，茲繪圖就本發明較佳實施例詳加說明其特徵與功能如下，俾利完全了解。 In order to achieve the above objects and effects, the technical means and the structure of the present invention will be described in detail with reference to the preferred embodiments of the present invention.
請參閱第一圖所示，係本發明較佳實施例之方塊示意圖，本發明係一種體感家居用電產品控制設備及其系統，其係運用於具備家居用電產品設備之室內空間，該設備主要由主機裝置1、動作辨識裝置2、外部設定介面3及家居用電產品4組成，其中一主機裝置1包含有一目標判斷模組10、一模式辨識模組12及一家居用電產品控制模組14，而動作辨識裝置2主要包含偵測攝影機20及資料傳輸模組22，前述偵測攝影機20主要是取得使用者在空間中之影像資料(為距離深度以及彩色影像)，透過資料傳輸模組22遞送至主機裝置1中的目標判斷模組10及模式辨識模組12進行整合分析。在進行目標判斷模組10分析時，係以擷取使用者動作及手勢所示之方向向量，據以判斷使用者欲操控之目標家居用電產品4，並將辨識後之家居用電 產品4代碼(此代碼係依照不同電器用品(如：家電、電動窗簾或燈具)作編號(可依實際需求設定如：#1、#2、#3...)並遞至模式辨識模組12。 Referring to the first embodiment, which is a block diagram of a preferred embodiment of the present invention, the present invention is a body-sensing household electrical product control device and system thereof, which is applied to an indoor space having a household electrical product device. The device is mainly composed of a host device 1, a motion recognition device 2, an external setting interface 3, and a household electrical product 4, wherein a host device 1 includes a target judging module 10, a pattern recognition module 12, and a household electrical product control. The module 14 and the motion recognition device 2 mainly include a detection camera 20 and a data transmission module 22. The detection camera 20 mainly acquires image data (distance depth and color image) of the user in space, and transmits the data through the data. The module 22 is delivered to the target determination module 10 and the pattern recognition module 12 in the host device 1 for integration analysis. In the analysis of the target judging module 10, the direction vector indicated by the user action and the gesture is taken to determine the target household electrical product 4 that the user wants to control, and the household electric power after the identification is used. Product 4 code (this code is numbered according to different electrical appliances (such as: home appliances, electric curtains or lamps) (can be set according to actual needs such as: #1, #2, #3...) and handed to the pattern recognition module 12.
在此同時，模式辨識模組12接收到由資料傳輸模組22傳來之影像資料，並將使用者動作及手勢轉換為可參數化之模式辨識，透過查詢由目標判斷模組10傳遞之目標家居用電產品4代碼，並比對外部設定介面3所預設之「動作模式-家居用電產品控制命令」對應表，以判斷使用者之動作及手勢是否匹配目標家居用電產品4所預設之控制命令，並將此控制命令傳遞至家居用電產品4中之控制模組40，以發送無線訊號予該家居用電產品4之訊號接收模組42。另外，訊號接收模組42透過無線訊號接收主機裝置1傳送之控制命令，從而執行家居用電產品4開關，微調等操作。透過上述結構可讓使用者在居住環境中，運用身體動作及手勢達到控制家居用電產品系統之目的，而無須另外透過硬體裝置進行指令輸入及視覺回饋。 At the same time, the pattern recognition module 12 receives the image data transmitted by the data transmission module 22, and converts the user actions and gestures into a parameterizable pattern recognition, and transmits the target transmitted by the target judgment module 10 through the query. The household electrical product 4 code, and compared to the "action mode - home electrical product control command" corresponding table preset by the external setting interface 3, to determine whether the user's action and gesture match the target household electrical product 4 A control command is provided, and the control command is transmitted to the control module 40 of the household electrical product 4 to transmit a wireless signal to the signal receiving module 42 of the household electrical product 4. In addition, the signal receiving module 42 receives the control command transmitted by the host device 1 through the wireless signal, thereby performing operations such as switching, fine adjustment, and the like of the household electrical product. Through the above structure, the user can use the body movements and gestures to control the household electrical product system in the living environment without the need for additional command input and visual feedback through the hardware device.
至於外部設定介面3部分所包含的家居用電產品定位介面30及一動作操控設定介面32，主要採用圖形介面協助使用者進行設定，而家居用電產品定位介面30在連接主機裝置1後，使用者可於畫面上標示出家居用電產品4偵測區域及其對應之辨識代碼(例如：在廚房區域其 代號顯示5，而原代碼5則定義為電冰箱)。另外，動作操控設定介面32為一人體動作及手勢對應至家居用電產品控制功能之列表，使用者可藉由修改對應關係，修改編輯各家居用電產品之動作控制模式2。 The home electrical product positioning interface 30 and an action control setting interface 32 included in the external setting interface 3 mainly use a graphic interface to assist the user in setting, and the household electrical product positioning interface 30 is used after connecting the host device 1. The home electrical product 4 detection area and its corresponding identification code can be marked on the screen (for example: in the kitchen area The code indicates 5, while the original code 5 is defined as a refrigerator). In addition, the action control setting interface 32 is a list of human body actions and gestures corresponding to the household electrical product control functions, and the user can modify and edit the action control mode 2 of each household electrical product by modifying the corresponding relationship.
配合上述結構，並運用以下流程即可達到更完善的體感家居用電產品控制，請參閱第二圖所示，其步驟如下：a)啟動主機裝置；b)使用者體態動作輸入；c)是否可辨識之操作指令；d)辨識動作及定位目標家居用電產品；e)家居用電產品是否定位；f)訊號發送至家居用電產品；及g)完成操作家居用電產品。 With the above structure, and using the following process to achieve a more complete control of home fitness products, please refer to the second figure, the steps are as follows: a) start the host device; b) user body motion input; c) Whether it is identifiable operation instructions; d) identification of actions and positioning of target household electrical products; e) positioning of household electrical products; f) transmission of signals to household electrical products; and g) completion of operation of household electrical products.
在進行步驟b)使用者體態動作輸入後，步驟c)則開始辨識使用者的體態動作是否夠清楚且足以辨識，倘若輸入正確則進行步驟d)開始辨識動作及定位目標家居用電產品，反之則須再一次且更清楚地做出動態動作直到可以辨識，完成步驟d)後步驟e)則是進行家居用電產品是否完成定位，此部分則由目標判斷模組10(第一圖)進行判斷，若順利定位完成則由步驟f)將訊號發送至家居用電產品，進而完成步驟g)，反之步驟e)定位失敗時則必須再回到步驟 步驟b)讓使用者重新做體態動作上的定義直到可以辨識為止。請同時參閱第一圖所示，在前述步驟b)中主要係由一動作辨識裝置2擷取動作影像資料，而步驟c)至步驟f)係由一主機設備1進行分析。 After step b) user body motion input, step c) begins to recognize whether the user's body motion is clear enough and sufficient to identify, if the input is correct, step d) starts the identification action and locates the target household power product, and vice versa. Then, the dynamic action must be made again and more clearly until it can be recognized. After step d), step e) is to determine whether the home electrical product is positioned, and this part is performed by the target judgment module 10 (first figure). Judging, if the smooth positioning is completed, the signal is sent to the household electrical product by step f), and then step g) is completed, otherwise the step e) when the positioning fails, the process must be returned to the step. Step b) Let the user re-do the definition of the body motion until it can be recognized. Please refer to the first figure at the same time. In the foregoing step b), the action image data is mainly captured by a motion recognition device 2, and the steps c) to f) are analyzed by a host device 1.
惟，以上所述僅為本發明之較佳實施例而已，非因此即侷限本發明之專利範圍，故舉凡運用本發明說明書及圖式內容所為之簡易修飾及等效結構變化，均應同理包含於本發明之專利範圍內，合予陳明。 However, the above description is only the preferred embodiment of the present invention, and thus it is not intended to limit the scope of the present invention. Therefore, the simple modification and equivalent structural changes of the present specification and the drawings should be treated similarly. It is included in the scope of the patent of the present invention and is combined with Chen Ming.
綜上所述，本發明之體感家居用電產品控制設備及其系統，為確實能達到其功效及目的，故本發明誠為一實用性優異之發明，為符合發明專利之申請要件，爰依法提出申請，盼 審委早日賜准本發明，以保障發明人之辛苦發明，倘若 鈞局審委有任何稽疑，請不吝來函指示，發明人定當竭力配合，實感德便。 In summary, the somatosensory household electrical product control device and system thereof of the present invention can achieve its efficacy and purpose. Therefore, the present invention is an invention with excellent practicability, and is an application for conforming to the invention patent. Applying in accordance with the law, I hope that the trial committee will grant the invention as soon as possible to protect the inventor's hard work. If there is any doubt in the trial committee, please do not hesitate to give instructions, the inventor will try his best to cooperate, and feel really good.
1‧‧‧主機裝置 1‧‧‧Host device
10‧‧‧目標判斷模組 10‧‧‧Target Judgment Module
12‧‧‧模式辨識模組 12‧‧‧Mode Identification Module
14‧‧‧家居用電產品控制模組 14‧‧‧Home Electrical Product Control Module
2‧‧‧動作辨識裝置 2‧‧‧Action recognition device
20‧‧‧偵測攝影機 20‧‧‧Detection camera
22‧‧‧資料傳輸模組 22‧‧‧Data Transmission Module
3‧‧‧外部設定介面 3‧‧‧External setting interface
30‧‧‧家居用電產品定位介面 30‧‧‧Home electrical product positioning interface
32‧‧‧動作操控設定介面 32‧‧‧Action control setting interface
4‧‧‧家居用電產品 4‧‧‧Home electric products
40‧‧‧控制模組 40‧‧‧Control Module
42‧‧‧訊號接收模組 42‧‧‧Signal receiving module
第一圖 係本發明較佳實施例之方塊示意圖。 The first figure is a block diagram of a preferred embodiment of the invention.
第二圖 係本發明較佳實施例之流程示意圖。 The second drawing is a schematic flow chart of a preferred embodiment of the present invention.
1‧‧‧主機裝置 1‧‧‧Host device
10‧‧‧目標判斷模組 10‧‧‧Target Judgment Module
12‧‧‧模式辨識模組 12‧‧‧Mode Identification Module
14‧‧‧家居用電產品控制模組 14‧‧‧Home Electrical Product Control Module
2‧‧‧動作辨識裝置 2‧‧‧Action recognition device
20‧‧‧偵測攝影機 20‧‧‧Detection camera
22‧‧‧資料傳輸模組 22‧‧‧Data Transmission Module
3‧‧‧外部設定介面 3‧‧‧External setting interface
30‧‧‧家居用電產品定位介面 30‧‧‧Home electrical product positioning interface
32‧‧‧動作操控設定介面 32‧‧‧Action control setting interface
4‧‧‧家居用電產品 4‧‧‧Home electric products
40‧‧‧控制模組 40‧‧‧Control Module
42‧‧‧訊號接收模組 42‧‧‧Signal receiving module
Claims (10)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW101147760A TW201426401A (en) | 2012-12-17 | 2012-12-17 | Somatosensory household electrical products control equipment and its system |
| CN201310150581.2A CN103869966A (en) | 2012-12-17 | 2013-04-26 | Somatosensory household electric product control equipment and system thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW101147760A TW201426401A (en) | 2012-12-17 | 2012-12-17 | Somatosensory household electrical products control equipment and its system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| TW201426401A true TW201426401A (en) | 2014-07-01 |
Family
ID=50908592
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW101147760A TW201426401A (en) | 2012-12-17 | 2012-12-17 | Somatosensory household electrical products control equipment and its system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN103869966A (en) |
| TW (1) | TW201426401A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104156065A (en) * | 2014-07-21 | 2014-11-19 | 小米科技有限责任公司 | Home media playing device control method, device and equipment |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104635537B (en) * | 2014-12-24 | 2017-10-20 | 北京元心科技有限公司 | A kind of control method of intelligent appliance |
| CN106155301A (en) * | 2015-04-27 | 2016-11-23 | 阿里巴巴集团控股有限公司 | A kind of family Internet of Things control method, Apparatus and system |
| CN104965417A (en) * | 2015-06-09 | 2015-10-07 | 张维秀 | Intelligent furniture control method, device and system |
| CN105549446A (en) * | 2016-02-24 | 2016-05-04 | 中国科学院城市环境研究所 | Intelligent control system of body sense environment-friendly stove |
| CN105629939A (en) * | 2016-02-26 | 2016-06-01 | 江苏巨数智能科技有限公司 | Intelligent operation and control system and intelligent operation and control method for electrical apparatus |
| CN107272902B (en) * | 2017-06-23 | 2019-12-10 | 深圳市盛路物联通讯技术有限公司 | intelligent home service terminal, control system and control method based on somatosensory interaction |
| CN108304155A (en) * | 2018-01-26 | 2018-07-20 | 广州源创网络科技有限公司 | A kind of man-machine interaction control method |
| CN108519749A (en) * | 2018-03-29 | 2018-09-11 | 北京华泽盛世机器人科技股份有限公司 | A kind of intelligent environment optimization system of family health care robot |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004135051A (en) * | 2002-10-10 | 2004-04-30 | Sony Corp | Information processing system, apparatus and method for providing service, apparatus and method for processing information, recording medium, and program |
| TWI423112B (en) * | 2009-12-09 | 2014-01-11 | Ind Tech Res Inst | Portable virtual human-machine interaction device and method therewith |
| CN102298443B (en) * | 2011-06-24 | 2013-09-25 | 华南理工大学 | Smart home voice control system combined with video channel and control method thereof |
| CN202584010U (en) * | 2012-04-06 | 2012-12-05 | 寇传阳 | Wrist-mounting gesture control system |
-
2012
- 2012-12-17 TW TW101147760A patent/TW201426401A/en unknown
-
2013
- 2013-04-26 CN CN201310150581.2A patent/CN103869966A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104156065A (en) * | 2014-07-21 | 2014-11-19 | 小米科技有限责任公司 | Home media playing device control method, device and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103869966A (en) | 2014-06-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TW201426401A (en) | Somatosensory household electrical products control equipment and its system | |
| US20190302714A1 (en) | Systems and methods to operate controllable devices with gestures and/or noises | |
| CN106233229B (en) | Remote operation device and method using camera-centered virtual touch | |
| CN106970535B (en) | Control method and electronic equipment | |
| US11163367B2 (en) | Method of obtaining gesture zone definition data for a control system based on user input | |
| US20170084275A1 (en) | Electrically operated domestic appliance having a voice recognition device | |
| JP2019532543A (en) | Control system and control processing method and apparatus | |
| TWI631507B (en) | Motion recognition apparatus and control method | |
| KR102507254B1 (en) | Home automation system using real-time indoor image | |
| TW201636784A (en) | Environment-oriented smart control apparatus, control system and control method | |
| US20150169075A1 (en) | Three-Dimensional Gesture Remote Control | |
| KR20150086807A (en) | Method and apparatus of universal remocon based on object recognition | |
| RU2673464C1 (en) | Method for recognition and control of household appliances via mobile phone and mobile phone for its implementation | |
| US20140214185A1 (en) | Somatosensory Household Electricity Control Equipment and System Thereof | |
| US9529443B2 (en) | Remote controller for motion recognition | |
| CN107066125B (en) | Mouse and display method of mouse graphic object | |
| TWI639111B (en) | Method of simulating a remote controller | |
| CN112166601B (en) | Information processing apparatus, information processing method, and computer readable medium | |
| TWI635388B (en) | Control device | |
| CN108828973A (en) | The intelligent electric appliance control system of gesture identification based on computer control | |
| Shi et al. | Direct gaze based environmental controls | |
| WO2020022254A1 (en) | Operation instruction control device and method therefor | |
| JP2016018644A (en) | Illumination control system | |
| EP3367193A1 (en) | Integrated control system and method for electronic devices | |
| TWI441040B (en) | A method of setting a switch to generate a control program |