JP2014081788A5 - - Google Patents

Download PDF

Info

Publication number
JP2014081788A5
JP2014081788A5 JP2012229238A JP2012229238A JP2014081788A5 JP 2014081788 A5 JP2014081788 A5 JP 2014081788A5 JP 2012229238 A JP2012229238 A JP 2012229238A JP 2012229238 A JP2012229238 A JP 2012229238A JP 2014081788 A5 JP2014081788 A5 JP 2014081788A5
Authority
JP
Japan
Prior art keywords
hand
user
detection
image
hand gesture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2012229238A
Other languages
Japanese (ja)
Other versions
JP6103875B2 (en
JP2014081788A (en
Filing date
Publication date
Application filed filed Critical
Priority to JP2012229238A priority Critical patent/JP6103875B2/en
Priority claimed from JP2012229238A external-priority patent/JP6103875B2/en
Publication of JP2014081788A publication Critical patent/JP2014081788A/en
Publication of JP2014081788A5 publication Critical patent/JP2014081788A5/ja
Application granted granted Critical
Publication of JP6103875B2 publication Critical patent/JP6103875B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Description

この課題を解決するため、例えば本発明のハンドジェスチャ認識装置は以下の構成を備える。すなわち、
像手段で時系列に撮像された画像中の、少なくとも人のユーザの顔領域を検出する顔検出手段と、
前記顔検出手段で検出された顔領域それぞれに対し、予め定義された顔領域との相対的位置情報が示す前記画像中の領域を、該顔領域に対応するユーザが行うハンドジェスチャを検出するための検出領域として決定する決定手段と、
前記撮像手段で時系列に撮像された画像のうち、前記決定手段によって決定される1以上の検出領域内で検出されるユーザの手の移動軌跡に基づいて、前記ユーザが行うハンドジェスチャを認識する認識手段を備え、
前記認識手段は、前記検出領域内から検出される前記ユーザの手の画像の移動軌跡のうち、前記検出領域の外部から内部に侵入する移動の軌跡は、前記ハンドジェスチャを認識する処理の対象としないことを特徴とする
In order to solve this problem, for example, the hand gesture recognition device of the present invention has the following configuration. That is,
In images captured in time series by an imaging unit, a face detecting unit that detects a face area of at least one user,
For each detected face area in the face detecting section, a region in the image represented by the relative position information of the predefined facial area, for detecting the hand gesture performed by the user corresponding to said pigment region Determining means for determining as a detection area;
The hand gesture performed by the user is recognized based on the movement trajectory of the user's hand detected in one or more detection areas determined by the determination unit among the images captured in time series by the imaging unit. With recognition means,
The recognizing unit is configured to recognize a movement trajectory that enters the inside of the detection region from the outside of the detection region of the image of the user's hand detected from the detection region. It is characterized by not .

Claims (10)

像手段で時系列に撮像された画像中の、少なくとも人のユーザの顔領域を検出する顔検出手段と、
前記顔検出手段で検出された顔領域それぞれに対し、予め定義された顔領域との相対的位置情報が示す前記画像中の領域を、該顔領域に対応するユーザが行うハンドジェスチャを検出するための検出領域として決定する決定手段と、
前記撮像手段で時系列に撮像された画像のうち、前記決定手段によって決定される1以上の検出領域内で検出されるユーザの手の移動軌跡に基づいて、前記ユーザが行うハンドジェスチャを認識する認識手段を備え、
前記認識手段は、前記検出領域内から検出される前記ユーザの手の画像の移動軌跡のうち、前記検出領域の外部から内部に侵入する移動の軌跡は、前記ハンドジェスチャを認識する処理の対象としないことを特徴とするハンドジェスチャ認識装置。
In images captured in time series by an imaging unit, a face detecting unit that detects a face area of at least one user,
For each detected face area in the face detecting section, a region in the image represented by the relative position information of the predefined facial area, for detecting the hand gesture performed by the user corresponding to said pigment region Determining means for determining as a detection area;
The hand gesture performed by the user is recognized based on the movement trajectory of the user's hand detected in one or more detection areas determined by the determination unit among the images captured in time series by the imaging unit. With recognition means,
The recognizing unit is configured to recognize a movement trajectory that enters the inside of the detection region from the outside of the detection region of the image of the user's hand detected from the detection region. A hand gesture recognition device characterized by not .
前記定手段は、
前記顔検出手段で複数のユーザの顔領域が検出され、それぞれの顔領域に対する検出領域が互いに重なる場合、重なりが無くなるようにそれぞれの検出領域のサイズを調整する手段を含む
ことを特徴とする請求項1に記載のハンドジェスチャ認識装置。
It said decision means,
When the face detection means detects face areas of a plurality of users and the detection areas for the respective face areas overlap with each other, the face detection means includes means for adjusting the size of each detection area so that there is no overlap. Item 4. The hand gesture recognition device according to Item 1.
前記撮像手段で時系列に撮像された画像のうち、前記決定手段によって決定される1以上の検出領域内で検出されるユーザの手の時系列の画像を保持する保持手段を更に備え、A holding unit that holds a time-series image of a user's hand detected in one or more detection areas determined by the determination unit out of images captured in time-series by the imaging unit;
前記認識手段は、前記保持手段に保持されている前記ユーザの手の時系列の画像に基づいて、前記移動軌跡を認識するThe recognition unit recognizes the movement locus based on a time-series image of the user's hand held by the holding unit.
ことを特徴とする請求項1又は2に記載のハンドジェスチャ認識装置。The hand gesture recognition device according to claim 1 or 2, wherein
前記保持手段に保持されている、前記撮像手段で時系列に撮像された画像のうち前記検出領域内で検出される前記ユーザの手の画像のうち、前記検出領域外部から前記検出領域の内部に侵入することが検出された手の画像を、前記保持手段から削除する削除手段を更に備え、Of the images of the user's hand detected in the detection area among the images captured in time series by the imaging means held in the holding means, from outside the detection area to inside the detection area A deletion unit that deletes the image of the hand detected to invade from the holding unit;
前記認識手段は、前記削除手段による削除処理の結果、前記保持手段に保持されている前記ユーザの手の時系列の画像に基づいて、前記移動軌跡を認識するThe recognition means recognizes the movement locus based on a time-series image of the user's hand held in the holding means as a result of the deletion process by the deletion means.
ことを特徴とする請求項3に記載のハンドジェスチャ認識装置。The hand gesture recognition device according to claim 3.
前記定手段で決定した検出領域内において、予め設定された時間が経過しても動きが無い手の画像を検出した場合、当該動きの無い手の画像を含む検出領域にて、ハンドジェスチャの認識が可能になったことを明示する明示手段を更に有することを特徴とする請求項1乃至4のいずれか1項に記載のハンドジェスチャ認識装置。 In the determined detection area determined in the constant section, if you also detects an image of the hand is no motion has elapsed a preset time, by the detection area including the image of the free hand of the motion, the hand gesture hand gesture recognition apparatus according to any one of claims 1 to 4, further comprising a manifest explicitly means that the recognition is enabled. 前記明示手段は、前記撮像手段で撮像した画像における、前記検出領域に相当する枠内に、所定のマークを表示する手段を含むことを特徴とする請求項に記載のハンドジェスチャ認識装置。 6. The hand gesture recognition apparatus according to claim 5 , wherein the specifying means includes means for displaying a predetermined mark in a frame corresponding to the detection area in the image captured by the imaging means. 前記識手段は、
前記削除手段による削除の結果、ハンドジェスチャを認識する対象の手の画像が分断されている場合、当該分断された消失部分を、分断された境界の座標に基づき補間する手段を含む
ことを特徴とする請求項に記載のハンドジェスチャ認識装置。
The recognition means,
As a result of deletion by the deletion means, when the image of the hand of the target that recognizes the hand gesture is divided, it includes means for interpolating the divided disappearance portion based on the coordinates of the divided boundary. The hand gesture recognition device according to claim 3 .
ンドジェスチャ認識装置の制御方法であって、
顔検出手段が、像手段で時系列に撮像された画像中の、少なくとも人のユーザの顔領域を検出する顔検出工程と、
決定手段が、前記顔検出工程で検出された顔領域それぞれに対し、予め定義された顔領域との相対的位置情報が示す前記画像中の領域を、該顔領域に対応するユーザが行うハンドジェスチャを検出するための検出領域として決定する決定工程と、
認識手段が、前記撮像手段で時系列に撮像された画像のうち、前記決定工程によって決定される1以上の検出領域内で検出されるユーザの手の移動軌跡に基づいて、前記ユーザが行うハンドジェスチャを認識する認識工程を備え、
前記認識工程は、前記検出領域内から検出される前記ユーザの手の画像の移動軌跡のうち、前記検出領域の外部から内部に侵入する移動の軌跡は、前記ハンドジェスチャを認識する処理の対象としないことを特徴とするハンドジェスチャ認識装置の制御方法。
A method of controlling a wafer command gesture recognition apparatus,
Face detection means, the image of which is captured in time series by an imaging unit, a face detecting step of detecting a facial region of at least one user,
Determining means, wherein for each face area detected by the face detecting step, the region in the image represented by the relative position information of the predefined facial region, hand gesture performed by the user corresponding to said pigment region Determining step for determining as a detection region for detecting,
The hand performed by the user based on the movement trajectory of the user's hand detected in one or more detection areas determined by the determination step among the images captured in time series by the imaging unit. It has a recognition process for recognizing gestures,
In the recognition step, of the movement trajectory of the image of the user's hand detected from within the detection area, the movement trajectory entering the inside from the outside of the detection area is an object of processing for recognizing the hand gesture. A method for controlling a hand gesture recognition device, characterized by not being performed.
撮像手段を有するコンピュータに、請求項に記載の方法に記載の各工程を実行させることで、前記コンピュータをハンドジェスチャ認識装置として機能させるためのプログラム。 A non-transitory computer-readable storage medium storing a program for causing a computer having an imaging unit to function as a hand gesture recognition device by causing the computer to execute each step described in the method according to claim 8 . 請求項に記載のプログラムを記憶したことを特徴とする、コンピュータが読み込み可能な記憶媒体。 A computer-readable storage medium storing the program according to claim 9 .
JP2012229238A 2012-10-16 2012-10-16 Hand gesture recognition device and control method thereof Expired - Fee Related JP6103875B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2012229238A JP6103875B2 (en) 2012-10-16 2012-10-16 Hand gesture recognition device and control method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2012229238A JP6103875B2 (en) 2012-10-16 2012-10-16 Hand gesture recognition device and control method thereof

Publications (3)

Publication Number Publication Date
JP2014081788A JP2014081788A (en) 2014-05-08
JP2014081788A5 true JP2014081788A5 (en) 2015-12-03
JP6103875B2 JP6103875B2 (en) 2017-03-29

Family

ID=50785929

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2012229238A Expired - Fee Related JP6103875B2 (en) 2012-10-16 2012-10-16 Hand gesture recognition device and control method thereof

Country Status (1)

Country Link
JP (1) JP6103875B2 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016015024A (en) * 2014-07-02 2016-01-28 株式会社東芝 Operation support apparatus and operation support system
KR102356599B1 (en) 2014-12-05 2022-01-28 삼성전자주식회사 Method for determining region of interest of image and device for determining region of interest of image
JP2017211739A (en) * 2016-05-24 2017-11-30 株式会社エクスビジョン User interface device and user interface program
JP7175257B2 (en) * 2019-12-24 2022-11-18 本田技研工業株式会社 GESTURE DETECTION DEVICE, GESTURE DETECTION METHOD, AND PROGRAM

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003230133A (en) * 2002-02-01 2003-08-15 Hitachi Ltd Trajectory editor and method thereof
US8726194B2 (en) * 2007-07-27 2014-05-13 Qualcomm Incorporated Item selection using enhanced control
US8555207B2 (en) * 2008-02-27 2013-10-08 Qualcomm Incorporated Enhanced input using recognized gestures
US8971565B2 (en) * 2008-05-29 2015-03-03 Hie-D Technologies, Llc Human interface electronic device
US8514251B2 (en) * 2008-06-23 2013-08-20 Qualcomm Incorporated Enhanced character input using recognized gestures
JP5618554B2 (en) * 2010-01-27 2014-11-05 キヤノン株式会社 Information input device, information input method and program
JP5488076B2 (en) * 2010-03-15 2014-05-14 オムロン株式会社 Object tracking device, object tracking method, and control program
JP2011243031A (en) * 2010-05-19 2011-12-01 Canon Inc Apparatus and method for recognizing gesture
JP5597064B2 (en) * 2010-08-26 2014-10-01 キヤノン株式会社 Information processing apparatus and method
JP5604279B2 (en) * 2010-12-08 2014-10-08 日本システムウエア株式会社 Gesture recognition apparatus, method, program, and computer-readable medium storing the program

Similar Documents

Publication Publication Date Title
JP2017059062A5 (en)
KR101551576B1 (en) Robot cleaner, apparatus and method for recognizing gesture
JP2016085487A5 (en)
JP2016515268A5 (en)
JP2015046732A5 (en)
JP2014235698A5 (en)
KR101631011B1 (en) Gesture recognition apparatus and control method of gesture recognition apparatus
JP2017073722A5 (en)
JP2016521894A5 (en)
JP2014041488A5 (en)
JP2012120151A5 (en) Imaging apparatus, frame rate control apparatus, imaging control method, and program
JP2018143338A5 (en)
JP2011138237A5 (en)
JP2014178968A5 (en)
JP2016136683A5 (en)
JP2015005197A5 (en)
JP2015207275A5 (en)
JP2015225374A5 (en)
JP2014203158A5 (en)
JP2017033144A5 (en)
JP2016091192A5 (en)
JP2018117280A5 (en)
JP2013222263A5 (en)
JP2014081788A5 (en)
JP2011209579A5 (en)