SG11201909139TA - Methods and apparatuses for recognizing dynamic gesture, and control methods and apparatuses using gesture interaction - Google Patents

Methods and apparatuses for recognizing dynamic gesture, and control methods and apparatuses using gesture interaction

Info

Publication number
SG11201909139TA
SG11201909139TA SG11201909139TA SG11201909139TA SG 11201909139T A SG11201909139T A SG 11201909139TA SG 11201909139T A SG11201909139T A SG 11201909139TA SG 11201909139T A SG11201909139T A SG 11201909139TA
Authority
SG
Singapore
Prior art keywords
apparatuses
gesture
methods
dynamic gesture
recognizing
Prior art date
Application number
Inventor
Quan Wang
Chen Qian
Original Assignee
Beijing Sensetime Technology Development Co Ltd
Shanghai Sensetime Intelligent Tech Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201711417801.8A external-priority patent/CN109960980B/en
Priority claimed from CN201810974244.8A external-priority patent/CN109144260B/en
Application filed by Beijing Sensetime Technology Development Co Ltd, Shanghai Sensetime Intelligent Tech Co Ltd filed Critical Beijing Sensetime Technology Development Co Ltd
Publication of SG11201909139TA publication Critical patent/SG11201909139TA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
    • G06F18/24133—Distances to prototypes
    • G06F18/24143—Distances to neighbourhood prototypes, e.g. restricted Coulomb energy networks [RCEN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language

Abstract

METHODS AND APPARATUSES FOR RECOGNIZING DYNAMIC GESTURE, AND CONTROL METHODS AND APPARATUSES USING GESTURE INTERACTION 5 Embodiments of the present application disclose methods and apparatuses for recognizing a dynamic gesture, and control methods and apparatuses using gesture interaction. The method for recognizing a dynamic gesture includes: positioning a dynamic gesture in a video stream to be detected to obtain a dynamic gesture box 10 (S101); capturing an image block corresponding to the dynamic gesture box from each of multiple image frames o f the video stream (S102); generating a detection sequence based on the captured image block (S103); and performing dynamic gesture recognition according to the detection sequence (S104). 15 [Figure 1]
SG11201909139T 2017-12-22 2018-12-21 Methods and apparatuses for recognizing dynamic gesture, and control methods and apparatuses using gesture interaction SG11201909139TA (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201711417801.8A CN109960980B (en) 2017-12-22 2017-12-22 Dynamic gesture recognition method and device
CN201810974244.8A CN109144260B (en) 2018-08-24 2018-08-24 Dynamic motion detection method, dynamic motion control method and device
PCT/CN2018/122767 WO2019120290A1 (en) 2017-12-22 2018-12-21 Dynamic gesture recognition method and device, and gesture interaction control method and device

Publications (1)

Publication Number Publication Date
SG11201909139TA true SG11201909139TA (en) 2019-10-30

Family

ID=66992452

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11201909139T SG11201909139TA (en) 2017-12-22 2018-12-21 Methods and apparatuses for recognizing dynamic gesture, and control methods and apparatuses using gesture interaction

Country Status (4)

Country Link
US (1) US11221681B2 (en)
JP (1) JP6765545B2 (en)
SG (1) SG11201909139TA (en)
WO (1) WO2019120290A1 (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6601644B1 (en) * 2018-08-03 2019-11-06 Ｌｉｎｎｅ株式会社 Image information display device
CN109344755B (en) * 2018-09-21 2024-02-13 广州市百果园信息技术有限公司 Video action recognition method, device, equipment and storage medium
CN110992426B (en) * 2019-12-09 2024-03-22 北京明略软件系统有限公司 Gesture recognition method and device, electronic equipment and storage medium
CN111273778B (en) * 2020-02-14 2023-11-07 北京百度网讯科技有限公司 Method and device for controlling electronic equipment based on gestures
CN112115801B (en) * 2020-08-25 2023-11-24 深圳市优必选科技股份有限公司 Dynamic gesture recognition method and device, storage medium and terminal equipment
JP2022087700A (en) * 2020-12-01 2022-06-13 京セラドキュメントソリューションズ株式会社 Electronic device and image forming apparatus
CN113239714A (en) * 2020-12-07 2021-08-10 北京理工大学 Attention mechanism fused dynamic gesture real-time recognition method
CN112396666A (en) * 2020-12-09 2021-02-23 广西双英集团股份有限公司 Intelligent assembling process control method based on gesture recognition
CN114967905A (en) * 2021-02-26 2022-08-30 广州视享科技有限公司 Gesture control method and device, computer readable storage medium and electronic equipment
CN113126753B (en) * 2021-03-05 2023-04-07 深圳点猫科技有限公司 Implementation method, device and equipment for closing equipment based on gesture
CN113222582B (en) * 2021-05-10 2022-03-08 广东便捷神科技股份有限公司 Face payment retail terminal
CN113642413A (en) * 2021-07-16 2021-11-12 新线科技有限公司 Control method, apparatus, device and medium
CN114356076B (en) * 2021-12-13 2023-10-03 中国船舶重工集团公司第七0九研究所 Gesture control method and system
JP2024502912A (en) * 2021-12-20 2024-01-24 センスタイム インターナショナル プライベート リミテッド Object identification method, apparatus, device and storage medium
WO2023118937A1 (en) * 2021-12-20 2023-06-29 Sensetime International Pte. Ltd. Object recognition method, apparatus, device and storage medium
US11899846B2 (en) * 2022-01-28 2024-02-13 Hewlett-Packard Development Company, L.P. Customizable gesture commands

Family Cites Families (51)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USRE46310E1 (en) * 1991-12-23 2017-02-14 Blanding Hovenweep, Llc Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
US6075895A (en) * 1997-06-20 2000-06-13 Holoplex Methods and apparatus for gesture recognition based on templates
US6501515B1 (en) * 1998-10-13 2002-12-31 Sony Corporation Remote control system
JP3657463B2 (en) * 1999-06-29 2005-06-08 シャープ株式会社 Motion recognition system and recording medium on which motion recognition program is recorded
US7274800B2 (en) * 2001-07-18 2007-09-25 Intel Corporation Dynamic gesture recognition from stereo sequences
US6937742B2 (en) * 2001-09-28 2005-08-30 Bellsouth Intellectual Property Corporation Gesture activated home appliance
US9959463B2 (en) * 2002-02-15 2018-05-01 Microsoft Technology Licensing, Llc Gesture recognition system using depth perceptive sensors
US20080065291A1 (en) * 2002-11-04 2008-03-13 Automotive Technologies International, Inc. Gesture-Based Control of Vehicular Components
US7421727B2 (en) * 2003-02-14 2008-09-02 Canon Kabushiki Kaisha Motion detecting system, motion detecting method, motion detecting apparatus, and program for implementing the method
US7308112B2 (en) * 2004-05-14 2007-12-11 Honda Motor Co., Ltd. Sign based human-machine interaction
JP5303355B2 (en) * 2009-05-21 2013-10-02 学校法人 中央大学 Periodic gesture identification device, periodic gesture identification method, periodic gesture identification program, and recording medium
KR20110007806A (en) * 2009-07-17 2011-01-25 삼성전자주식회사 Apparatus and method for detecting hand motion using a camera
US8818027B2 (en) * 2010-04-01 2014-08-26 Qualcomm Incorporated Computing device interface
US8751215B2 (en) 2010-06-04 2014-06-10 Microsoft Corporation Machine based sign language interpreter
US20110304541A1 (en) * 2010-06-11 2011-12-15 Navneet Dalal Method and system for detecting gestures
CN102402680B (en) 2010-09-13 2014-07-30 株式会社理光 Hand and indication point positioning method and gesture confirming method in man-machine interactive system
CN103250166A (en) * 2010-10-18 2013-08-14 诺基亚公司 Method and apparatus for providing hand detection
CN102053702A (en) 2010-10-26 2011-05-11 南京航空航天大学 Dynamic gesture control system and method
US20120268374A1 (en) * 2011-04-25 2012-10-25 Heald Arthur D Method and apparatus for processing touchless control commands
US8693726B2 (en) * 2011-06-29 2014-04-08 Amazon Technologies, Inc. User identification by gesture recognition
CN102426480A (en) * 2011-11-03 2012-04-25 康佳集团股份有限公司 Man-machine interactive system and real-time gesture tracking processing method for same
JP6243112B2 (en) * 2011-12-09 2017-12-06 ソニー株式会社 Information processing apparatus, information processing method, and recording medium
EP2650754A3 (en) * 2012-03-15 2014-09-24 Omron Corporation Gesture recognition apparatus, electronic device, gesture recognition method, control program, and recording medium
US9734393B2 (en) * 2012-03-20 2017-08-15 Facebook, Inc. Gesture-based control system
TWI489326B (en) * 2012-06-05 2015-06-21 Wistron Corp Operating area determination method and system
JP5935529B2 (en) * 2012-06-13 2016-06-15 ソニー株式会社 Image processing apparatus, image processing method, and program
US9128528B2 (en) * 2012-06-22 2015-09-08 Cisco Technology, Inc. Image-based real-time gesture recognition
US9111135B2 (en) * 2012-06-25 2015-08-18 Aquifi, Inc. Systems and methods for tracking human hands using parts based template matching using corresponding pixels in bounded regions of a sequence of frames that are a specified distance interval from a reference camera
US8934675B2 (en) * 2012-06-25 2015-01-13 Aquifi, Inc. Systems and methods for tracking human hands by performing parts based template matching using images from multiple viewpoints
TWI479430B (en) * 2012-10-08 2015-04-01 Pixart Imaging Inc Gesture identification with natural images
WO2014088621A1 (en) * 2012-12-03 2014-06-12 Google, Inc. System and method for detecting gestures
RU2013146529A (en) 2013-10-17 2015-04-27 ЭлЭсАй Корпорейшн RECOGNITION OF DYNAMIC HAND GESTURE WITH SELECTIVE INITIATION ON THE BASIS OF DETECTED HAND SPEED
CN103593680B (en) * 2013-11-19 2016-09-14 南京大学 A kind of dynamic gesture identification method based on the study of HMM independent increment
JP6460862B2 (en) * 2014-03-20 2019-01-30 国立研究開発法人産業技術総合研究所 Gesture recognition device, system and program thereof
US9355236B1 (en) * 2014-04-03 2016-05-31 Fuji Xerox Co., Ltd. System and method for biometric user authentication using 3D in-air hand gestures
US9418319B2 (en) * 2014-11-21 2016-08-16 Adobe Systems Incorporated Object detection using cascaded convolutional neural networks
US20160162148A1 (en) 2014-12-04 2016-06-09 Google Inc. Application launching and switching interface
CN104834894B (en) * 2015-04-01 2018-09-25 济南大学 A kind of gesture identification method of combination binary coding and class-Hausdorff distances
US10097758B2 (en) 2015-11-18 2018-10-09 Casio Computer Co., Ltd. Data processing apparatus, data processing method, and recording medium
US20170161607A1 (en) * 2015-12-04 2017-06-08 Pilot Ai Labs, Inc. System and method for improved gesture recognition using neural networks
US10318008B2 (en) * 2015-12-15 2019-06-11 Purdue Research Foundation Method and system for hand pose detection
CN106934333B (en) 2015-12-31 2021-07-20 芋头科技（杭州）有限公司 Gesture recognition method and system
JP2017191496A (en) * 2016-04-14 2017-10-19 株式会社東海理化電機製作所 Gesture determination device
WO2018017399A1 (en) * 2016-07-20 2018-01-25 Usens, Inc. Method and system for 3d hand skeleton tracking
US20180088671A1 (en) * 2016-09-27 2018-03-29 National Kaohsiung University Of Applied Sciences 3D Hand Gesture Image Recognition Method and System Thereof
CN106648112A (en) 2017-01-07 2017-05-10 武克易 Somatosensory action recognition method
CN107169411B (en) 2017-04-07 2019-10-29 南京邮电大学 A kind of real-time dynamic gesture identification method based on key frame and boundary constraint DTW
CN107180224B (en) 2017-04-10 2020-06-19 华南理工大学 Finger motion detection and positioning method based on space-time filtering and joint space Kmeans
CN107316022B (en) 2017-06-27 2020-12-01 歌尔光学科技有限公司 Dynamic gesture recognition method and device
CN108197596B (en) 2018-01-24 2021-04-06 京东方科技集团股份有限公司 Gesture recognition method and device
US10296102B1 (en) * 2018-01-31 2019-05-21 Piccolo Labs Inc. Gesture and motion recognition using skeleton tracking

Also Published As

Publication number Publication date
US11221681B2 (en) 2022-01-11
JP2020508511A (en) 2020-03-19
JP6765545B2 (en) 2020-10-07
US20190354194A1 (en) 2019-11-21
WO2019120290A1 (en) 2019-06-27

Similar Documents

Publication Publication Date Title
SG11201909139TA (en) Methods and apparatuses for recognizing dynamic gesture, and control methods and apparatuses using gesture interaction
PH12018500287A1 (en) Key frame acquisition method for human image video system
ZA202204436B (en) Systems and methods for structured illumination microscopy
WO2014186420A3 (en) Augmented reality (ar) capture & play
SG11201909887RA (en) Methods and apparatuses for recognizing video and training, electronic device and medium
SG11201909068XA (en) Methods and apparatuses for dynamically adding facial images into database, electronic devices, media and programs
GB2589506A9 (en) Method and apparatus for selecting background music for video capture, terminal device, and medium
WO2016189390A3 (en) Gesture control system and method for smart home
MY193941A (en) User identity verification method, apparatus and system
WO2015082572A3 (en) User feedback for real-time checking and improving quality of scanned image
MX2016003724A (en) Picture scene determining method and apparatus, and server.
MX2022004190A (en) Stabilizing video.
WO2014137806A3 (en) Visual language for human computer interfaces
IN2014CN02345A (en) Image processing apparatus image processing method and program
MY176768A (en) Object monitoring system, object monitoring method, and monitoring target extraction program
HK1141614A1 (en) Makeup simulation system and makeup simulation method
WO2013079778A3 (en) Method, apparatus and computer program product for capturing images
WO2012173401A3 (en) Image processing method and apparatus
TW201613338A (en) Method for generating image bokeh effect and image capturing device
EP4270976A3 (en) Devices and methods for high dynamic range video
GB201209723D0 (en) Apparatus and method for augmenting augmenting a video image
GB2553926A (en) Automatic detection of panoramic gestures
MX2016013398A (en) System and method for flatness detection for display stream compression (dsc).
WO2014102786A3 (en) A system and method for generating personal videos
EP4072142A3 (en) Video motion processing including static scene determination, occlusion detection, frame rate conversion, and adjusting compression ratio