WO2009124181A3 - Gesture based control using three-dimensional information extracted over an extended depth of field - Google Patents

Gesture based control using three-dimensional information extracted over an extended depth of field Download PDF

Info

Publication number
WO2009124181A3
WO2009124181A3 PCT/US2009/039285 US2009039285W WO2009124181A3 WO 2009124181 A3 WO2009124181 A3 WO 2009124181A3 US 2009039285 W US2009039285 W US 2009039285W WO 2009124181 A3 WO2009124181 A3 WO 2009124181A3
Authority
WO
WIPO (PCT)
Prior art keywords
gesture
field
processor
optical detectors
information extracted
Prior art date
Application number
PCT/US2009/039285
Other languages
French (fr)
Other versions
WO2009124181A2 (en
Inventor
Pierre St. Hilaire
John S. Underkoffler
Original Assignee
Oblong Industries, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US12/109,263 external-priority patent/US8407725B2/en
Application filed by Oblong Industries, Inc. filed Critical Oblong Industries, Inc.
Priority to EP09728557.1A priority Critical patent/EP2266016A4/en
Priority to JP2011503166A priority patent/JP5697590B2/en
Priority to CN200980120542.XA priority patent/CN102047203B/en
Publication of WO2009124181A2 publication Critical patent/WO2009124181A2/en
Publication of WO2009124181A3 publication Critical patent/WO2009124181A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0075—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. increasing, the depth of field or depth of focus
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/50—Optics for phase object visualisation
    • G02B27/52—Phase contrast optics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G06F3/0325—Detection arrangements using opto-electronic means using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Social Psychology (AREA)
  • Psychiatry (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Position Input By Displaying (AREA)
  • Studio Devices (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

Systems and methods are described for gesture-based control using three-dimensional information extracted over an extended depth of field. The system comprises a plurality of optical detectors coupled to at least one processor. The optical detectors image a body. At least two optical detectors of the plurality of optical detectors comprise wavefront coding cameras. The processor automatically detects a gesture of the body, wherein the gesture comprises an instantaneous state of the body. The detecting comprises aggregating gesture data of the gesture at an instant in time. The gesture data includes focus-resolved data of the body within a depth of field of the imaging system. The processor translates the gesture to a gesture signal, and uses the gesture signal to control a component coupled to the processor.
PCT/US2009/039285 2008-04-02 2009-04-02 Gesture based control using three-dimensional information extracted over an extended depth of field WO2009124181A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP09728557.1A EP2266016A4 (en) 2008-04-02 2009-04-02 Gesture based control using three-dimensional information extracted over an extended depth of field
JP2011503166A JP5697590B2 (en) 2008-04-02 2009-04-02 Gesture-based control using 3D information extracted from extended subject depth
CN200980120542.XA CN102047203B (en) 2008-04-02 2009-04-02 Use the control based on attitude that the three-dimensional information extracted in the depth of field of extension is carried out

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
US4189208P 2008-04-02 2008-04-02
US61/041,892 2008-04-02
US12/109,263 US8407725B2 (en) 2007-04-24 2008-04-24 Proteins, pools, and slawx in processing environments
US12/109,263 2008-04-24
US10524308P 2008-10-14 2008-10-14
US10525308P 2008-10-14 2008-10-14
US61/105,243 2008-10-14
US61/105,253 2008-10-14

Publications (2)

Publication Number Publication Date
WO2009124181A2 WO2009124181A2 (en) 2009-10-08
WO2009124181A3 true WO2009124181A3 (en) 2009-12-30

Family

ID=41136111

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2009/039285 WO2009124181A2 (en) 2008-04-02 2009-04-02 Gesture based control using three-dimensional information extracted over an extended depth of field

Country Status (5)

Country Link
EP (1) EP2266016A4 (en)
JP (1) JP5697590B2 (en)
KR (1) KR101550478B1 (en)
CN (1) CN102047203B (en)
WO (1) WO2009124181A2 (en)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011059404A2 (en) * 2009-11-12 2011-05-19 Nanyang Polytechnic Method and system for interactive gesture-based control
WO2012120521A1 (en) * 2011-03-04 2012-09-13 Hewlett-Packard Development Company, L.P. Gestural interaction identification
CN103135756B (en) * 2011-12-02 2016-05-11 深圳泰山体育科技股份有限公司 Generate the method and system of control instruction
JP5917125B2 (en) 2011-12-16 2016-05-11 キヤノン株式会社 Image processing apparatus, image processing method, imaging apparatus, and display apparatus
TWI451344B (en) * 2012-08-27 2014-09-01 Pixart Imaging Inc Gesture recognition system and method
CN104007819B (en) * 2014-05-06 2017-05-24 清华大学 Gesture recognition method and device and Leap Motion system
EP3631533A4 (en) 2017-05-24 2021-03-24 The Trustees of Columbia University in the City of New York Broadband achromatic flat optical components by dispersion-engineered dielectric metasurfaces
CN107515454B (en) * 2017-08-29 2019-12-20 宁夏巨能机器人股份有限公司 Automatic focal length adjusting device for 3D visual positioning and adjusting method thereof
EP3676973A4 (en) 2017-08-31 2021-05-05 Metalenz, Inc. Transmissive metasurface lens integration
US11978752B2 (en) 2019-07-26 2024-05-07 Metalenz, Inc. Aperture-metasurface and hybrid refractive-metasurface imaging systems
CN110609039B (en) * 2019-09-23 2021-09-28 上海御微半导体技术有限公司 Optical detection device and method thereof
US11927769B2 (en) 2022-03-31 2024-03-12 Metalenz, Inc. Polarization sorting metasurface microlens array device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060187196A1 (en) * 2005-02-08 2006-08-24 Underkoffler John S System and method for gesture based control system
US20060208169A1 (en) * 1992-05-05 2006-09-21 Breed David S Vehicular restraint system control system and method using multiple optical imagers
US20070139541A1 (en) * 2001-07-06 2007-06-21 Himanshu Amin Imaging system and methodology

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7218448B1 (en) * 1997-03-17 2007-05-15 The Regents Of The University Of Colorado Extended depth of field optical systems
JP2000275582A (en) * 1999-03-24 2000-10-06 Olympus Optical Co Ltd Depth-of-field enlarging system
SE0000850D0 (en) * 2000-03-13 2000-03-13 Pink Solution Ab Recognition arrangement
US7227526B2 (en) * 2000-07-24 2007-06-05 Gesturetek, Inc. Video-based image control system
US6842297B2 (en) * 2001-08-31 2005-01-11 Cdm Optics, Inc. Wavefront coding optics
WO2008008084A2 (en) * 2005-09-19 2008-01-17 Cdm Optics, Inc. Task-based imaging systems
JP2008070319A (en) * 2006-09-15 2008-03-27 Canon Inc Object measurement device and method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060208169A1 (en) * 1992-05-05 2006-09-21 Breed David S Vehicular restraint system control system and method using multiple optical imagers
US20070139541A1 (en) * 2001-07-06 2007-06-21 Himanshu Amin Imaging system and methodology
US20060187196A1 (en) * 2005-02-08 2006-08-24 Underkoffler John S System and method for gesture based control system

Also Published As

Publication number Publication date
JP2011523112A (en) 2011-08-04
KR20100136993A (en) 2010-12-29
WO2009124181A2 (en) 2009-10-08
EP2266016A2 (en) 2010-12-29
EP2266016A4 (en) 2014-10-29
CN102047203B (en) 2016-08-17
KR101550478B1 (en) 2015-09-04
CN102047203A (en) 2011-05-04
JP5697590B2 (en) 2015-04-08

Similar Documents

Publication Publication Date Title
WO2009124181A3 (en) Gesture based control using three-dimensional information extracted over an extended depth of field
TW201130305A (en) Video processing apparatus and related method thereof
EP2492785A3 (en) Creative design systems and methods
WO2012033658A3 (en) A 3-d camera
WO2009007917A3 (en) Object motion capturing system and method
WO2011026077A3 (en) Combination localization system
WO2011119337A3 (en) System and method for data capture, storage, and retrieval
WO2012088285A3 (en) Three-dimensional tracking of a user control device in a volume
WO2012145429A3 (en) Virtual keyboards and methods of providing the same
WO2011074891A3 (en) Method and system for controlling output of a mobile device
MX2013013545A (en) A toy construction system for augmented reality.
EP2590274A3 (en) Techniques for configuring contacts of a connector
WO2013059758A3 (en) Generating a depth map
EP2450831A3 (en) Method and system for detecting multi-view human face
WO2013009815A3 (en) Methods and systems for social overlay visualization
WO2010062117A3 (en) Immersive display system for interacting with three-dimensional content
WO2011044257A3 (en) Human tracking system
MY165967A (en) Moving-body-detecting device and moving-body-detecting system
EP2592820A4 (en) Product imaging device, product imaging method, image conversion device, image processing device, image processing system, program, and information recording medium
WO2011053027A3 (en) Image providing system and method
WO2012106370A2 (en) Correlating areas on the physical object to areas on the phone screen
EP2669846A3 (en) Target recognition system and target recognition method executed by the target recognition system, target recognition program executed on the target recognition system, and recording medium storing the target recognition program
WO2012011720A3 (en) Image display apparatus and method of operating the same
WO2013190409A3 (en) Multicamera device tracking
WO2011037805A3 (en) Shared face training data

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200980120542.X

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09728557

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 2011503166

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 7724/DELNP/2010

Country of ref document: IN

ENP Entry into the national phase

Ref document number: 20107024659

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2009728557

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE