US20090167679A1 - Pointing device and method - Google Patents

Pointing device and method Download PDF

Info

Publication number
US20090167679A1
US20090167679A1 US12/003,705 US370507A US2009167679A1 US 20090167679 A1 US20090167679 A1 US 20090167679A1 US 370507 A US370507 A US 370507A US 2009167679 A1 US2009167679 A1 US 2009167679A1
Authority
US
United States
Prior art keywords
pointing
system
point
imaging
screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US12/003,705
Other versions
US8149210B2 (en
Inventor
Zvi Klier
Sagi Katz
Mattias Marder
Giora Yahav
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft International Holdings BV
Original Assignee
Microsoft International Holdings BV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft International Holdings BV filed Critical Microsoft International Holdings BV
Priority to US12/003,705 priority Critical patent/US8149210B2/en
Assigned to 3DV SYSTEMS LTD. reassignment 3DV SYSTEMS LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KATZ, SAGI, KLIER, ZVI, MARDER, MATTIAS, YAHAV, GIORA
Publication of US20090167679A1 publication Critical patent/US20090167679A1/en
Assigned to MICROSOFT INTERNATIONAL HOLDINGS B.V. reassignment MICROSOFT INTERNATIONAL HOLDINGS B.V. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: 3DV SYSTEMS LTD.
Application granted granted Critical
Publication of US8149210B2 publication Critical patent/US8149210B2/en
Application status is Active legal-status Critical
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304Detection arrangements using opto-electronic means
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements

Abstract

A system and method for identifying a pointing organ or a pointing device in a field of imaging of a 3-D imaging system and for calculating a line of pointing relative to this organ or device are disclosed. The method and system may be used to enable a user to communicate with computer programs, such as computer games, 3-D design programs and the like. The method and system may further employ a trigger-like mechanism to identify a movement of a user that may be interpreted as trigger activation.

Description

    BACKGROUND OF THE INVENTION
  • Depth measurement in video scenery in general and Gesture Recognition are topic in computer science with goal of interpreting gestures of human or other bodies via specialized equipment and mathematical algorithms. Gestures may originate, for example, from any bodily motion or state. Some systems use two video stereo cameras together with a positioning reference such as a set of infrared emitters to enable automated recognition of the contour of a body in the field of view of the cameras and to identify certain movements of organs or portions of the body so that the identified movements or gestures may be used for communicating of the human with application running in communication with the gesture recognition system. Some of the systems using stereoscopic gesture identification rely on a process which pairs features of a first stereo video image with features of a second stereo video image.
  • Other systems may employ depth measurement of points on a body in the field of imaging (FOI) using a method known as Time of Flight (TOF), in which an irradiating source sends pulsed light towards the imaged body. The pulsed light travels to the body and is reflected back to a video camera that is equipped with a shutter to control the timing of receipt of light onto its sensor. Since the time takes to a reflected light from a point on the imaged body is relative to the distance (or depth) of that point from the camera, with proper synchronized gating light from the nearer point to be received at the sensor for a longer time longer than light that travels from a farther point on the body. Accordingly, the amount of energy (which may be represented as “grey level” in the 2-D buffer of the sensor) is inversely proportional to the distance of the point from the sensor. In order to compensate for variations in the reflectivity of different points on the body mathematical measures may be taken, such as normalizing the intensity based on an average intensity at point.
  • Depth measurement using TOF principals may also be done by calculating the distance of a point in the FOI by calculating the time that takes to a pulse of light to travel to the point and back to the sensor, and use this figure to calculate the distance (or depth) of that point. Another method of measuring depth of a point on an imaged body is by measuring the phase-shift of the reflected light when it is received by the sensor, with respect to the phase of the emitted light towards the body.
  • Some of the known methods which use a stereoscopic arrangement of cameras need also comparatively a large amount of computations in comparing the pictures taken from one camera to those taken by the other camera in order to pair together pictorial attributes of the two sets of pictures for creating calculated 3-D image out of the pairs of pictures based on the known location of the two cameras. Large amount is needed in such arrangements also in real time to solve the trigonometric equations involved in the establishment of a distance of a point. Naturally, the accuracy of such systems is highly influenced by the physical dimensions of the set of two cameras and especially the distance between the cameras, thus requirement for higher accuracy may impose larger physical dimensions of such systems.
  • Furthermore, use of methods such as stereoscopic gesture recognition is inherently inferior to other methods, such as depth measuring methods, for example measurement of time-of-flight (TOF) of a light pulse by a depth measuring arrangement and inclusion of that data into the graphical data of the picture, when it is required to recognize several body organs positioned close and in front of each other, such as a finger in front of a hand palm or in front of human face, or the like.
  • It may therefore be beneficial to have system and method which are capable of capturing and calculating 3-D imaging data of a body in the field of imaging of a 3-D capturing system which is accurate enough to allow distinction of organs positioned closely one in front of the other and that may maintain small physical dimensions regardless of the accuracy requirements and may require small amount of associated calculations.
  • SUMMARY OF THE INVENTION
  • A system and method for intuitively pointing and possibly also shooting in a computer based man-machine interactive environment is disclosed. The intuitive pointing may be carried out, according to some embodiments of the present invention, without needing any actual pointing device, but via use of, for example, an organ of the user's body such as a hand stretched out to point at the target on the screen of the computerized system. The system and method are based on a 3D imaging ability of the system of the present invention, using, for example, TOF 3D imaging. The system may provide identification of a predefined organ, to locate a pointing location on the organ—for example the tip of a first finger in said stretched hand, to draw an imaginary line from, for example, an eye of the user through that point and use this imaginary line to calculate a point on the screen where this line intersects the screen.
  • The system and method of the present invention may further identify another location on the users body, such as a second finger of said stretched hand that, which may indicate, when its movement was detected, activation state (such as pull of a trigger).
  • In yet another embodiment a system and method of the present invention may use a pointing device formed, for example, as a pistol, that may be held by a user and pointed at a point on the screen of the system. In such embodiment the pointing device may be identified by a 3D imaging device, at least two points on the pointing device may specifically be identified and may be used to calculate a line of pointing and/or shooting at the screen of the system. According to yet another embodiment, a pointing device may have a trigger like mechanism that may activate/deactivate a recognizable area on the pointing device (such as, for example, a reflective area) so that when such area is visually disclosed by the activation of the trigger it is noticed by the imaging system and may be interpreted as a command to the system. In yet another embodiment, the trigger mechanism may activate a light source, such as a laser light emitting diode (LED), to indicate activation of the trigger to the imaging system.
  • In an additional embodiment of the present invention a reflective area and/or a light source, used to indicate activation of the trigger, may further be used to assist in, and enhance the accuracy of the calculation of the pointing/shooting line of the pointing device.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The subject matter regarded as the invention is particularly pointed out and distinctly claimed in the concluding portion of the specification. The invention, however, both as to organization and method of operation, together with objects, features, and advantages thereof, may best be understood by reference to the following detailed description when read with the accompanying drawings in which:
  • FIG. 1 is a schematic illustration of a system for remotely and intuitively providing control commands to computerized system, according to embodiments of the present invention;
  • FIG. 2 is a schematic illustration of a system comprising a pointing device for intuitive pointing according to embodiments of the present invention; and
  • FIGS. 3A and 3B are schematic flow charts illustrating a method of calibrating the accuracy of pointing and a method of using a pointing object, respectively, according to embodiments of the present invention.
  • It will be appreciated that for simplicity and clarity of illustration, elements shown in the figures have not necessarily been drawn to scale. For example, the dimensions of some of the elements may be exaggerated relative to other elements for clarity. Further, where considered appropriate, reference numerals may be repeated among the figures to indicate corresponding or analogous elements
  • DETAILED DESCRIPTION OF THE INVENTION
  • In the method based on the Time-Of-Flight (TOF) principle, the depth information may be captured and acquired by emitting pulses of radiation to all objects in the scene and sensing the reflected light from the surface of each object. Depth information for each pixel may be transmitted using an additional channel (which called in some instances ‘D’ channel). The information representing the depth of a pixel may be interpreted in a suitable computing system. All objects in the scene may then be arranged in layers according to the distance information sensed by the depth pixels in the camera, providing the depth information in real time as standard black and white video where the grey-level correlates to relative distance. In this method, color data may be provided, for example, by using a normal color imaging sensor.
  • 3-D imaging of a body based on TOF is described in several references, including U.S. Pat. No. 6,057,909 for the applicant of the present invention. TOF 3-D imaging may support quick and relatively accurate acquiring of depth information of a scanned body in typical range of up to typically several meters at 60 HZ camera frame rate, using NIR wavelength and gating interval in the order of several nanoseconds.
  • These benefits of depth measurement and 3-D imaging of TOF based systems may be used in several applications. One of these applications is the Line of Sight (LOS) recognition and use of same for interactive control of a computer.
  • Several types of aiming devices are well known, such as a joy stick, a mouse, a track ball and the like. Such pointing devices (PDs) are used for long time now, and suffer of several drawbacks. For example, use of a joy stick may provide relatively quick movement of a cursor on a reference area, such as a screen, but are usually hard to control for final accuracy of position. Use of a trackball may provide good final accuracy but relatively slow movement toward the final position. A mouse is typically a moderate compromise of the previous two. Further, use of a mouse or of a track ball is usually cumbersome and require either a relatively large device (track ball) or large free area for movement (mouse). Yet, none of these PDs is intuitive in its operation and each of them requires certain training when first used and imposes certain inconvenience and even health hazards under long use.
  • The present invention provides system and method for accurate and intuitive pointing measures to be used by a user in interaction with a computerized system, in order to give control commands to the computerized system. Attention is made now to FIG. 1, which is a schematic illustration of a system 100 for remotely and intuitively providing control commands to computerized system, according to embodiments of the present invention. Control commands to computerized system 200 may be based on gesture recognition of the body 150 of a user by use of 3-D imaging, such as TOF method. System 100 may comprise a computerized system 200 comprising at least a computer 210 and a camera 220. Computer 210 may comprise a computing unit loaded with an appropriate software and a screen 212 on which said software may present graphical images, symbols and other presentable data which may require response from a user having a body 150 by way of pointing at a graphical entity on screen 212 and possibly further by dictating the computerized system 200 what are the commands that need to be effected to that graphical entity. Computerized system 200 may be further loaded with a piece of software which supports 3-D depth measurement of a body based on, for example, TOF principles. Based on the 3-D imaging the momentary position in space of certain points on body 150, such as a first point 152, located for example at the iris of an eye of user's body 150 and a second point 154 located, for example at the end of pointing finger of the user's hand. Camera 220 may have a spatial section of interest covering at least section 110 and may it be located slightly aside of screen 212. Yet in another embodiment of the present invention camera 220 may be located very close to screen 212. The use of 3-D imaging based on TOF calculations is known and may provide continuous data of the spatial position of points 152 and 154. Accordingly, computing system 200 may continuously provide data representing the line-of-sight (LOS) 140 connecting points 152 and 154 and extending to screen 212. In some embodiments, the initial location of screen 212 with respect to camera 220 may need to be calibrated. Such calibration may involve pointing at an intended point on the screen and instructing system 200 of the difference between the intended point and the point at which system 200 has calculated the hit-point of LOS 140. Such calibration may be required each time the setting of screen 212 has changed with respect to camera 220 and it may be done using, for example, a specific piece of software that when run controls the calibration process.
  • According to some embodiments of the present invention a user may intuitively point at a desired point on screen 212 and aim at a selected graphical entity on it, without needing to have any specific device and without needing to be connected, by wire or wirelessly, to system 100 for this purpose. Using the principles of TOF based 3-D imaging it is further possible to recognize gesture movement of an additional organ or a portion of an organ in user's body 150, such as, for example, left-hand long finger 156. Computerized system 200 may be trained to recognize plurality of different movements and gestures of user's body 150 and/or of organs of body 150 and to accord certain, predefined command to each such organ and/or movement. For example, in the pointing example detailed above while the computation of LOS 140 may be used for selecting one graphical entity on screen 212, gesture recognition of long finger 156 may be used for providing one or more control commands to that graphical entity, such as, in a non-limiting example, activation of software associated with that entity or for rotating a graphical symbol on the screen or for expending its size, and the like. It would be apparent for a person skilled in the art that pointing at a graphical entity on the screen is a most intuitive yet accurate way of performing point-and-select action since it fully imitates the natural action daily performed by humans. It would be apparent for person skilled in the art that additional to the devices and units described above system 100 may further comprise another camera (not shown) for providing graphical imaging of the user's body 150, as well as other units and capabilities.
  • According to additional embodiment of the invention a user may use a pointing object which is completely inactive (i.e. not connected, electrically, to system 100) in order to point at a selected graphical object on screen 212 and further to activate or inactivate software programs at the user's command. Attention is made to FIG. 2, which is a schematic illustration of a system comprising a pointing device 250 for intuitive pointing according to embodiments of the present invention. Pointing device 250 may be a passive device which does not require any electrical connection to system 100 of FIG. 1. Pointing device may be formed to comfortably fit into a user's hand, such as like a pistol. Yet, it would be apparent that pointing device may have any other shape, as may be desired, according to the applications to which it is adapted, to the user's preferences, etc. An imaginary line-of-pointing 258 may be defined as the “line-of-firing” of pointing device 250. As described above, system 100, to which pointing device 250 may be connected, may identify line 258 according to the principles of operations described above. In another embodiment of the present invention pointing device 250 may further include a frontal visual point 252 and a rear visual point 254 defined in close vicinity to line 258 in pointing device 250. Visual points 252 and 254 may be placed on pointing device 250 so that they are easily seen by camera 220 when pointing device 250 is in the field of view 110 of camera 220. Visual points 252 and 254 may further have distinct visual property, such as a high reflective feature, reflectivity with specific color or phase, and the like. This feature may be used to ease the identification of the gesture of pointing device 250 for purposes of identification of line-of-pointing 258. According to embodiment of the present invention pointing device 250 may further be equipped with a trigger-like assembly 256. Assembly 256 may be designed so that when pulled by the user it discloses a reflective area 264 that is visible to and identifiable by camera 220. Accordingly, camera 220 may identity that trigger 256 was pulled, and may send this information to system 100, in order to activate, for example, a relevant piece of software. In an embodiment of the present invention pointing device may comprise a light source 262 which may be activated/deactivated by pulling/releasing trigger 256. As with reflective area 264, light source 262 may indicate to system 100, when identified as in ON status, that trigger 256 was activated.
  • In yet another embodiment of the present invention either reflective area 264 or light source 262, when identified by camera 220 and system 100, may further be used to improve the accuracy and certainty of calculation of pointing line 258 by adding a third point with high certainty of identification as their location in pointing device may be pre-loaded to system 100.
  • Attention is made now to FIGS. 3A and 3B which are schematic flow charts illustrating a method of calibrating the accuracy of pointing and of using pointing method, respectively, according to embodiments of the present invention. In order to calibrate the accuracy of pointing according to the present invention a pointing object is identified by camera 220 and supporting software and/or hardware (block 302). Two points, rear and frontal, are identified on the pointing organ or device and a pointing line is calculated between these points (block 304). Optionally a ‘trigger’ organ or object/assembly are also identified on the pointing organ/device (block 306). A graphical object is presented on screen 212 and a hit point of pointing line 140, 258 on screen 212 is identified (block 308). Finally, the user informs system 100 of the difference between the actual and the intended hit points (block 310). If the accuracy at this stage is not good enough a collection is applied by system 100 and the steps of blocks 308 and 310 are repeated. Once the accuracy of the point of hit is good enough the calibration process terminates.
  • In a calibrated system the process of using a pointing organ or device may comprise the steps of: pointing object is identified by camera 220 and supporting software and/or hardware (block 352); two points, rear and frontal, are identified on the pointing organ or device and a pointing line is calculated between these points (block 354); optionally a ‘trigger’ organ or object/assembly are also identified on the pointing organ/device (block 356); a graphical object is presented on screen 212 and a hit point of pointing line 140, 258 on screen 212 is identified (block 358). Finally, data representing the position of the hit point on screen 212 and the activation of trigger 256 (if activated) is sent to system 100 (block 360). This process is repeated as long as the pointing organ/device is in use and may terminate (block 362) at other times.
  • The above described intuitive point-select-and-activate process may be used in many ways and in many applications. For example it may be used in Human-Machine-Interface (HMI) applications for the activation and control of computer applications, gaming applications and the like. For example the above described intuitive point-select-and-activate process may be used to point-and-shoot action in computer games. In another embodiment of the present invention
  • Thus, the ability of system 100 to identify representative points on an object in the FOI and to deduce a pointing line form this information may be used to allow for intuitive pointing of a user at a scene, for example on a screen. The intuitive pointing may be carried out by drawing a pointing line between an eye of the user and a pointing finger or between two points on a pointing passive object such as a pistol-like piece, and the like. Additionally, the 3-D imaging ability may further be used to identify one or more gesture movements, such as that of the bending of the first finger, as a movement associated with pulling of a trigger and to activate an associated program in system 100 in response. Alternatively, when a pistol-like passive object 250 is used a trigger-like assembly 256 may be configured so that when it is pulled by the user it is easily identified by camera 220 (for example, due to the exposure of high reflectivity portion of the trigger to camera 220).

Claims (15)

1. A system for intuitively pointing at a scene on a screen the system comprising:
a 3-D imaging system capable of identifying at least a first and a second points on a pointing object in the field-of-imaging (FOI) of said imaging system; and
a computation system capable of calculating a pointing line extending from said first point through said second point towards said screen and to calculate an imaginary point on said screen at which said pointing line hits said screen.
2. The system of claim 1, wherein said 3-D imaging system uses at least one of the methods comprising: Time of Flight (TOF) 3-D imaging and stereoscopic triangulation 3-D imaging.
3. The system of claim 2, wherein said TOF imaging system uses at least one of 3-D imaging based on collected light, 3-D based on time-of-flight and 3-D imaging based on phase shift to calculate depth of points in the FOI.
4. The system of claim 1, wherein said pointing object is one of a pointing organ, a passive pointing device and an active pointing device.
5. The system of claim 4, wherein said pointing organ is a hand having at least one pointing finger fully extended out.
6. The system of claim 4, wherein said pointing device is shaped substantially as a pistol.
7. The system of claim 6, wherein said pointing device comprises also a trigger-like mechanism.
8. A method for intuitively pointing at a screen and activating programs, comprising:
identifying a pointing object in a field of imaging of a 3-D imaging camera;
identifying a first point and a second point on said pointing object, said first point is located substantially close to the rear end of said pointing object and said second point is located substantially close to the front end of said pointing object;
calculating a pointing line, said line extends from said first point, through said second point towards said screen;
identifying a hit point on said pointing line on said screen; and
providing data of the location of said hit point on said screen.
9. The method of claim 8, further comprising identifying activation of a trigger part.
10. The method of claim 9, wherein said trigger part is one of a trigger organ and a trigger mechanism.
11. The method of claim 8, further comprising presenting graphical image on said screen to point said pointing line at which.
12. The method of claim 11 further comprising presenting a cursor on said screen at the hit point.
13. The system of claim 7 wherein said pointing device further comprises a reflective area adapted to be disclosed to said imaging system when said trigger-like mechanism is activated.
14. The system of claim 7 wherein said pointing device further comprises a light source adapted to be disclosed to said imaging system when said trigger-like mechanism is activated.
15. The method of claim 10, wherein said calculating is based further on location information of visual indicator of trigger activation.
US12/003,705 2007-12-31 2007-12-31 Pointing device and method Active 2029-10-13 US8149210B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/003,705 US8149210B2 (en) 2007-12-31 2007-12-31 Pointing device and method

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US12/003,705 US8149210B2 (en) 2007-12-31 2007-12-31 Pointing device and method
CN201510616571.2A CN105334980A (en) 2007-12-31 2008-12-31 3D pointing system
PCT/IL2008/001703 WO2009083984A2 (en) 2007-12-31 2008-12-31 3d pointing system
EP08868690.2A EP2243066B1 (en) 2007-12-31 2008-12-31 3d pointing system
CN2008801276878A CN101960409A (en) 2007-12-31 2008-12-31 3D pointing system

Publications (2)

Publication Number Publication Date
US20090167679A1 true US20090167679A1 (en) 2009-07-02
US8149210B2 US8149210B2 (en) 2012-04-03

Family

ID=40433797

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/003,705 Active 2029-10-13 US8149210B2 (en) 2007-12-31 2007-12-31 Pointing device and method

Country Status (4)

Country Link
US (1) US8149210B2 (en)
EP (1) EP2243066B1 (en)
CN (2) CN105334980A (en)
WO (1) WO2009083984A2 (en)

Cited By (56)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100081507A1 (en) * 2008-10-01 2010-04-01 Microsoft Corporation Adaptation for Alternate Gaming Input Devices
US20100194741A1 (en) * 2009-01-30 2010-08-05 Microsoft Corporation Depth map movement tracking via optical flow and velocity prediction
US20100194872A1 (en) * 2009-01-30 2010-08-05 Microsoft Corporation Body scan
US20100199221A1 (en) * 2009-01-30 2010-08-05 Microsoft Corporation Navigation of a virtual plane using depth
US20100231512A1 (en) * 2009-03-16 2010-09-16 Microsoft Corporation Adaptive cursor sizing
US20100238182A1 (en) * 2009-03-20 2010-09-23 Microsoft Corporation Chaining animations
US20100278431A1 (en) * 2009-05-01 2010-11-04 Microsoft Corporation Systems And Methods For Detecting A Tilt Angle From A Depth Image
US20100281438A1 (en) * 2009-05-01 2010-11-04 Microsoft Corporation Altering a view perspective within a display environment
US20100277489A1 (en) * 2009-05-01 2010-11-04 Microsoft Corporation Determine intended motions
US20100281437A1 (en) * 2009-05-01 2010-11-04 Microsoft Corporation Managing virtual ports
US20100278384A1 (en) * 2009-05-01 2010-11-04 Microsoft Corporation Human body pose estimation
US20100277470A1 (en) * 2009-05-01 2010-11-04 Microsoft Corporation Systems And Methods For Applying Model Tracking To Motion Capture
US20100281436A1 (en) * 2009-05-01 2010-11-04 Microsoft Corporation Binding users to a gesture based system and providing feedback to the users
US20100306712A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Gesture Coach
US20100306685A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation User movement feedback via on-screen avatars
US20100302395A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Environment And/Or Target Segmentation
US20100306713A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Gesture Tool
US20100304813A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Protocol And Format For Communicating An Image From A Camera To A Computing Environment
US20100302257A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Systems and Methods For Applying Animations or Motions to a Character
US20100303302A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Systems And Methods For Estimating An Occluded Body Part
US20100306710A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Living cursor control mechanics
US20100303289A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Device for identifying and tracking multiple humans over time
US20100303290A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Systems And Methods For Tracking A Model
US20100302138A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Methods and systems for defining or modifying a visual representation
US20100306261A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Localized Gesture Aggregation
US20100306715A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Gestures Beyond Skeletal
US20100306716A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Extending standard gestures
US20100311280A1 (en) * 2009-06-03 2010-12-09 Microsoft Corporation Dual-barrel, connector jack and plug assemblies
US20110007142A1 (en) * 2009-07-09 2011-01-13 Microsoft Corporation Visual representation expression based on player expression
US20110007079A1 (en) * 2009-07-13 2011-01-13 Microsoft Corporation Bringing a visual representation to life via learned input from the user
US20110025689A1 (en) * 2009-07-29 2011-02-03 Microsoft Corporation Auto-Generating A Visual Representation
US20110035666A1 (en) * 2009-05-01 2011-02-10 Microsoft Corporation Show body position
US20110055846A1 (en) * 2009-08-31 2011-03-03 Microsoft Corporation Techniques for using human gestures to control gesture unaware programs
US20110109617A1 (en) * 2009-11-12 2011-05-12 Microsoft Corporation Visualizing Depth
US20120113219A1 (en) * 2010-11-10 2012-05-10 Samsung Electronics Co., Ltd. Image conversion apparatus and display apparatus and methods using the same
US8509479B2 (en) 2009-05-29 2013-08-13 Microsoft Corporation Virtual object
US8542252B2 (en) 2009-05-29 2013-09-24 Microsoft Corporation Target digitization, extraction, and tracking
EP2677399A2 (en) * 2011-02-18 2013-12-25 VTouch Co., Ltd. Virtual touch device without pointer
US8620113B2 (en) 2011-04-25 2013-12-31 Microsoft Corporation Laser diode modes
US8635637B2 (en) 2011-12-02 2014-01-21 Microsoft Corporation User interface presenting an animated avatar performing a media reaction
US8638985B2 (en) 2009-05-01 2014-01-28 Microsoft Corporation Human body pose estimation
US8649554B2 (en) 2009-05-01 2014-02-11 Microsoft Corporation Method to control perspective for a camera-controlled computer
US8760395B2 (en) 2011-05-31 2014-06-24 Microsoft Corporation Gesture recognition techniques
US8898687B2 (en) 2012-04-04 2014-11-25 Microsoft Corporation Controlling a media program based on a media reaction
US20140348377A1 (en) * 2013-05-24 2014-11-27 Honda Motor Co., Ltd. Field of vision capture
US8942428B2 (en) 2009-05-01 2015-01-27 Microsoft Corporation Isolate extraneous motions
US8942917B2 (en) 2011-02-14 2015-01-27 Microsoft Corporation Change invariant scene recognition by an agent
US8959541B2 (en) 2012-05-04 2015-02-17 Microsoft Technology Licensing, Llc Determining a future portion of a currently presented media program
US9100685B2 (en) 2011-12-09 2015-08-04 Microsoft Technology Licensing, Llc Determining audience state or interest using passive sensor data
US9256282B2 (en) 2009-03-20 2016-02-09 Microsoft Technology Licensing, Llc Virtual object manipulation
US9400559B2 (en) 2009-05-29 2016-07-26 Microsoft Technology Licensing, Llc Gesture shortcuts
US9465980B2 (en) 2009-01-30 2016-10-11 Microsoft Technology Licensing, Llc Pose tracking pipeline
US9898675B2 (en) 2009-05-01 2018-02-20 Microsoft Technology Licensing, Llc User movement tracking feedback to improve tracking
EP3234732A4 (en) * 2014-12-19 2018-07-25 Hewlett-Packard Development Company, L.P. 3d visualization
EP3373114A1 (en) * 2017-03-10 2018-09-12 Alterface Projects Tracking system and method using a depth aware camera
US10275113B2 (en) 2014-12-19 2019-04-30 Hewlett-Packard Development Company, L.P. 3D visualization

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110102570A1 (en) * 2008-04-14 2011-05-05 Saar Wilf Vision based pointing device emulation
GB2483168B (en) 2009-10-13 2013-06-12 Pointgrab Ltd Computer vision gesture based control of a device
US9285874B2 (en) 2011-02-09 2016-03-15 Apple Inc. Gaze detection in a 3D mapping environment
KR101151962B1 (en) * 2011-02-16 2012-06-01 김석중 Virtual touch apparatus and method without pointer on the screen
JP6074170B2 (en) 2011-06-23 2017-02-01 インテル・コーポレーション System and method of tracking a short distance operation
CN103999018B (en) * 2011-12-06 2016-12-28 汤姆逊许可公司 The method of selecting a user gesture in response to the three-dimensional objects and the display system
CN104471511B (en) * 2012-03-13 2018-04-20 视力移动技术有限公司 Pointing gesture recognition apparatus, and method for user interface
US9377863B2 (en) 2012-03-26 2016-06-28 Apple Inc. Gaze-enhanced virtual touchscreen
KR101533320B1 (en) * 2012-04-23 2015-07-03 주식회사 브이터치 Apparatus for acquiring 3 dimension object information without pointer
US8938124B2 (en) 2012-05-10 2015-01-20 Pointgrab Ltd. Computer vision based tracking of a hand
WO2013190538A1 (en) * 2012-06-20 2013-12-27 Pointgrab Ltd. Method for touchless control of a device
WO2014106219A1 (en) * 2012-12-31 2014-07-03 Burachas Giedrius Tomas User centric interface for interaction with visual display that recognizes user intentions
CN103105929B (en) * 2013-01-05 2016-02-10 北京农业信息技术研究中心 Virtual interactive design and experience rural zone method and system
US20140245200A1 (en) * 2013-02-25 2014-08-28 Leap Motion, Inc. Display control with gesture-selectable control paradigms
KR101533319B1 (en) 2014-02-22 2015-07-03 주식회사 브이터치 Remote control apparatus and method using camera centric virtual touch
CN104699249B (en) * 2015-03-27 2018-04-27 联想(北京)有限公司 An information processing method and an electronic device
CN106440948B (en) * 2015-08-13 2018-02-09 株式会社理光 An exercise system and method for shooting practice shooting
CN107801413A (en) * 2016-06-28 2018-03-13 华为技术有限公司 Terminal For Controlling Electronic Device And Processing Method Therefor

Citations (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6057909A (en) * 1995-06-22 2000-05-02 3Dv Systems Ltd. Optical ranging camera
US6072494A (en) * 1997-10-15 2000-06-06 Electric Planet, Inc. Method and apparatus for real-time gesture recognition
US6222465B1 (en) * 1998-12-09 2001-04-24 Lucent Technologies Inc. Gesture-based computer interface
US6531999B1 (en) * 2000-07-13 2003-03-11 Koninklijke Philips Electronics N.V. Pointing direction calibration in video conferencing and other camera-based system applications
US20040046736A1 (en) * 1997-08-22 2004-03-11 Pryor Timothy R. Novel man machine interfaces and applications
US6937742B2 (en) * 2001-09-28 2005-08-30 Bellsouth Intellectual Property Corporation Gesture activated home appliance
US6950534B2 (en) * 1998-08-10 2005-09-27 Cybernet Systems Corporation Gesture-controlled interfaces for self-service machines and other applications
US6993255B2 (en) * 1999-02-16 2006-01-31 3Dv Systems, Ltd. Method and apparatus for providing adaptive illumination
US20060033713A1 (en) * 1997-08-22 2006-02-16 Pryor Timothy R Interactive video based games using objects sensed by TV cameras
US20060132432A1 (en) * 2002-05-28 2006-06-22 Matthew Bell Interactive video display system
US20060139314A1 (en) * 2002-05-28 2006-06-29 Matthew Bell Interactive video display system
US20060187196A1 (en) * 2005-02-08 2006-08-24 Underkoffler John S System and method for gesture based control system
US7098891B1 (en) * 1992-09-18 2006-08-29 Pryor Timothy R Method for providing human input to a computer
US7151530B2 (en) * 2002-08-20 2006-12-19 Canesta, Inc. System and method for determining an input selected by a user through a virtual interface
US20070024579A1 (en) * 2005-07-28 2007-02-01 Outland Research, Llc Gaze discriminating electronic control apparatus, system, method and computer program product
US7227526B2 (en) * 2000-07-24 2007-06-05 Gesturetek, Inc. Video-based image control system
US20070132721A1 (en) * 2005-12-09 2007-06-14 Edge 3 Technologies Llc Three-Dimensional Virtual-Touch Human-Machine Interface System and Method Therefor
US20070298882A1 (en) * 2003-09-15 2007-12-27 Sony Computer Entertainment Inc. Methods and systems for enabling direction detection when interfacing with a computer program
US7340077B2 (en) * 2002-02-15 2008-03-04 Canesta, Inc. Gesture recognition system using depth perceptive sensors
US20080056561A1 (en) * 2006-08-30 2008-03-06 Fujifilm Corporation Image processing device

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080246759A1 (en) * 2005-02-23 2008-10-09 Craig Summers Automatic Scene Modeling for the 3D Camera and 3D Video
CN100354875C (en) * 2005-09-29 2007-12-12 上海交通大学 Red eye moving method based on human face detection

Patent Citations (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7098891B1 (en) * 1992-09-18 2006-08-29 Pryor Timothy R Method for providing human input to a computer
US6057909A (en) * 1995-06-22 2000-05-02 3Dv Systems Ltd. Optical ranging camera
US20060033713A1 (en) * 1997-08-22 2006-02-16 Pryor Timothy R Interactive video based games using objects sensed by TV cameras
US20060202953A1 (en) * 1997-08-22 2006-09-14 Pryor Timothy R Novel man machine interfaces and applications
US20080122786A1 (en) * 1997-08-22 2008-05-29 Pryor Timothy R Advanced video gaming methods for education and play using camera based inputs
US20040046736A1 (en) * 1997-08-22 2004-03-11 Pryor Timothy R. Novel man machine interfaces and applications
US6072494A (en) * 1997-10-15 2000-06-06 Electric Planet, Inc. Method and apparatus for real-time gesture recognition
US6950534B2 (en) * 1998-08-10 2005-09-27 Cybernet Systems Corporation Gesture-controlled interfaces for self-service machines and other applications
US6222465B1 (en) * 1998-12-09 2001-04-24 Lucent Technologies Inc. Gesture-based computer interface
US6993255B2 (en) * 1999-02-16 2006-01-31 3Dv Systems, Ltd. Method and apparatus for providing adaptive illumination
US6531999B1 (en) * 2000-07-13 2003-03-11 Koninklijke Philips Electronics N.V. Pointing direction calibration in video conferencing and other camera-based system applications
US7227526B2 (en) * 2000-07-24 2007-06-05 Gesturetek, Inc. Video-based image control system
US6937742B2 (en) * 2001-09-28 2005-08-30 Bellsouth Intellectual Property Corporation Gesture activated home appliance
US7340077B2 (en) * 2002-02-15 2008-03-04 Canesta, Inc. Gesture recognition system using depth perceptive sensors
US20060139314A1 (en) * 2002-05-28 2006-06-29 Matthew Bell Interactive video display system
US20060132432A1 (en) * 2002-05-28 2006-06-22 Matthew Bell Interactive video display system
US7151530B2 (en) * 2002-08-20 2006-12-19 Canesta, Inc. System and method for determining an input selected by a user through a virtual interface
US7646372B2 (en) * 2003-09-15 2010-01-12 Sony Computer Entertainment Inc. Methods and systems for enabling direction detection when interfacing with a computer program
US20070298882A1 (en) * 2003-09-15 2007-12-27 Sony Computer Entertainment Inc. Methods and systems for enabling direction detection when interfacing with a computer program
US20060187196A1 (en) * 2005-02-08 2006-08-24 Underkoffler John S System and method for gesture based control system
US20070024579A1 (en) * 2005-07-28 2007-02-01 Outland Research, Llc Gaze discriminating electronic control apparatus, system, method and computer program product
US20070132721A1 (en) * 2005-12-09 2007-06-14 Edge 3 Technologies Llc Three-Dimensional Virtual-Touch Human-Machine Interface System and Method Therefor
US20080056561A1 (en) * 2006-08-30 2008-03-06 Fujifilm Corporation Image processing device

Cited By (117)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8133119B2 (en) 2008-10-01 2012-03-13 Microsoft Corporation Adaptation for alternate gaming input devices
US20100081507A1 (en) * 2008-10-01 2010-04-01 Microsoft Corporation Adaptation for Alternate Gaming Input Devices
US20100194872A1 (en) * 2009-01-30 2010-08-05 Microsoft Corporation Body scan
US20100199221A1 (en) * 2009-01-30 2010-08-05 Microsoft Corporation Navigation of a virtual plane using depth
US9607213B2 (en) 2009-01-30 2017-03-28 Microsoft Technology Licensing, Llc Body scan
US8467574B2 (en) 2009-01-30 2013-06-18 Microsoft Corporation Body scan
US20100194741A1 (en) * 2009-01-30 2010-08-05 Microsoft Corporation Depth map movement tracking via optical flow and velocity prediction
US8294767B2 (en) 2009-01-30 2012-10-23 Microsoft Corporation Body scan
US8866821B2 (en) 2009-01-30 2014-10-21 Microsoft Corporation Depth map movement tracking via optical flow and velocity prediction
US8897493B2 (en) 2009-01-30 2014-11-25 Microsoft Corporation Body scan
US9465980B2 (en) 2009-01-30 2016-10-11 Microsoft Technology Licensing, Llc Pose tracking pipeline
US9007417B2 (en) 2009-01-30 2015-04-14 Microsoft Technology Licensing, Llc Body scan
US9153035B2 (en) 2009-01-30 2015-10-06 Microsoft Technology Licensing, Llc Depth map movement tracking via optical flow and velocity prediction
US9652030B2 (en) 2009-01-30 2017-05-16 Microsoft Technology Licensing, Llc Navigation of a virtual plane using a zone of restriction for canceling noise
US20100231512A1 (en) * 2009-03-16 2010-09-16 Microsoft Corporation Adaptive cursor sizing
US8773355B2 (en) 2009-03-16 2014-07-08 Microsoft Corporation Adaptive cursor sizing
US9478057B2 (en) 2009-03-20 2016-10-25 Microsoft Technology Licensing, Llc Chaining animations
US9256282B2 (en) 2009-03-20 2016-02-09 Microsoft Technology Licensing, Llc Virtual object manipulation
US20100238182A1 (en) * 2009-03-20 2010-09-23 Microsoft Corporation Chaining animations
US9824480B2 (en) 2009-03-20 2017-11-21 Microsoft Technology Licensing, Llc Chaining animations
US8988437B2 (en) 2009-03-20 2015-03-24 Microsoft Technology Licensing, Llc Chaining animations
US20100281436A1 (en) * 2009-05-01 2010-11-04 Microsoft Corporation Binding users to a gesture based system and providing feedback to the users
US8942428B2 (en) 2009-05-01 2015-01-27 Microsoft Corporation Isolate extraneous motions
US20100278384A1 (en) * 2009-05-01 2010-11-04 Microsoft Corporation Human body pose estimation
US9377857B2 (en) 2009-05-01 2016-06-28 Microsoft Technology Licensing, Llc Show body position
US20100281437A1 (en) * 2009-05-01 2010-11-04 Microsoft Corporation Managing virtual ports
US20100277489A1 (en) * 2009-05-01 2010-11-04 Microsoft Corporation Determine intended motions
US10210382B2 (en) 2009-05-01 2019-02-19 Microsoft Technology Licensing, Llc Human body pose estimation
US9498718B2 (en) 2009-05-01 2016-11-22 Microsoft Technology Licensing, Llc Altering a view perspective within a display environment
US9910509B2 (en) 2009-05-01 2018-03-06 Microsoft Technology Licensing, Llc Method to control perspective for a camera-controlled computer
US9898675B2 (en) 2009-05-01 2018-02-20 Microsoft Technology Licensing, Llc User movement tracking feedback to improve tracking
US20110035666A1 (en) * 2009-05-01 2011-02-10 Microsoft Corporation Show body position
US20100281438A1 (en) * 2009-05-01 2010-11-04 Microsoft Corporation Altering a view perspective within a display environment
US20100277470A1 (en) * 2009-05-01 2010-11-04 Microsoft Corporation Systems And Methods For Applying Model Tracking To Motion Capture
US9015638B2 (en) 2009-05-01 2015-04-21 Microsoft Technology Licensing, Llc Binding users to a gesture based system and providing feedback to the users
US20100278431A1 (en) * 2009-05-01 2010-11-04 Microsoft Corporation Systems And Methods For Detecting A Tilt Angle From A Depth Image
US8762894B2 (en) 2009-05-01 2014-06-24 Microsoft Corporation Managing virtual ports
US9519970B2 (en) 2009-05-01 2016-12-13 Microsoft Technology Licensing, Llc Systems and methods for detecting a tilt angle from a depth image
US8340432B2 (en) 2009-05-01 2012-12-25 Microsoft Corporation Systems and methods for detecting a tilt angle from a depth image
US8181123B2 (en) 2009-05-01 2012-05-15 Microsoft Corporation Managing virtual port associations to users in a gesture-based computing environment
US8253746B2 (en) 2009-05-01 2012-08-28 Microsoft Corporation Determine intended motions
US8290249B2 (en) 2009-05-01 2012-10-16 Microsoft Corporation Systems and methods for detecting a tilt angle from a depth image
US8503766B2 (en) 2009-05-01 2013-08-06 Microsoft Corporation Systems and methods for detecting a tilt angle from a depth image
US8649554B2 (en) 2009-05-01 2014-02-11 Microsoft Corporation Method to control perspective for a camera-controlled computer
US9298263B2 (en) 2009-05-01 2016-03-29 Microsoft Technology Licensing, Llc Show body position
US8638985B2 (en) 2009-05-01 2014-01-28 Microsoft Corporation Human body pose estimation
US9519828B2 (en) 2009-05-01 2016-12-13 Microsoft Technology Licensing, Llc Isolate extraneous motions
US9262673B2 (en) 2009-05-01 2016-02-16 Microsoft Technology Licensing, Llc Human body pose estimation
US9524024B2 (en) 2009-05-01 2016-12-20 Microsoft Technology Licensing, Llc Method to control perspective for a camera-controlled computer
US8451278B2 (en) 2009-05-01 2013-05-28 Microsoft Corporation Determine intended motions
US8503720B2 (en) 2009-05-01 2013-08-06 Microsoft Corporation Human body pose estimation
US9191570B2 (en) 2009-05-01 2015-11-17 Microsoft Technology Licensing, Llc Systems and methods for detecting a tilt angle from a depth image
US9861886B2 (en) 2009-05-29 2018-01-09 Microsoft Technology Licensing, Llc Systems and methods for applying animations or motions to a character
US8509479B2 (en) 2009-05-29 2013-08-13 Microsoft Corporation Virtual object
US8542252B2 (en) 2009-05-29 2013-09-24 Microsoft Corporation Target digitization, extraction, and tracking
US8418085B2 (en) 2009-05-29 2013-04-09 Microsoft Corporation Gesture coach
US8379101B2 (en) 2009-05-29 2013-02-19 Microsoft Corporation Environment and/or target segmentation
US8625837B2 (en) 2009-05-29 2014-01-07 Microsoft Corporation Protocol and format for communicating an image from a camera to a computing environment
US8896721B2 (en) 2009-05-29 2014-11-25 Microsoft Corporation Environment and/or target segmentation
US8351652B2 (en) 2009-05-29 2013-01-08 Microsoft Corporation Systems and methods for tracking a model
US8320619B2 (en) 2009-05-29 2012-11-27 Microsoft Corporation Systems and methods for tracking a model
US8660310B2 (en) 2009-05-29 2014-02-25 Microsoft Corporation Systems and methods for tracking a model
US8744121B2 (en) 2009-05-29 2014-06-03 Microsoft Corporation Device for identifying and tracking multiple humans over time
US8176442B2 (en) 2009-05-29 2012-05-08 Microsoft Corporation Living cursor control mechanics
US8145594B2 (en) 2009-05-29 2012-03-27 Microsoft Corporation Localized gesture aggregation
US9656162B2 (en) 2009-05-29 2017-05-23 Microsoft Technology Licensing, Llc Device for identifying and tracking multiple humans over time
US8803889B2 (en) 2009-05-29 2014-08-12 Microsoft Corporation Systems and methods for applying animations or motions to a character
US9943755B2 (en) 2009-05-29 2018-04-17 Microsoft Technology Licensing, Llc Device for identifying and tracking multiple humans over time
US8856691B2 (en) 2009-05-29 2014-10-07 Microsoft Corporation Gesture tool
US20100306716A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Extending standard gestures
US20100306715A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Gestures Beyond Skeletal
US20100306261A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Localized Gesture Aggregation
US20100302138A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Methods and systems for defining or modifying a visual representation
US9400559B2 (en) 2009-05-29 2016-07-26 Microsoft Technology Licensing, Llc Gesture shortcuts
US20100303290A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Systems And Methods For Tracking A Model
US9383823B2 (en) 2009-05-29 2016-07-05 Microsoft Technology Licensing, Llc Combining gestures beyond skeletal
US20100303289A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Device for identifying and tracking multiple humans over time
US20100306710A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Living cursor control mechanics
US20100303302A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Systems And Methods For Estimating An Occluded Body Part
US20100302257A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Systems and Methods For Applying Animations or Motions to a Character
US20100304813A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Protocol And Format For Communicating An Image From A Camera To A Computing Environment
US20100306713A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Gesture Tool
US20100302395A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Environment And/Or Target Segmentation
US20100306712A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Gesture Coach
US9182814B2 (en) 2009-05-29 2015-11-10 Microsoft Technology Licensing, Llc Systems and methods for estimating a non-visible or occluded body part
US20100306685A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation User movement feedback via on-screen avatars
US9215478B2 (en) 2009-05-29 2015-12-15 Microsoft Technology Licensing, Llc Protocol and format for communicating an image from a camera to a computing environment
US20100311280A1 (en) * 2009-06-03 2010-12-09 Microsoft Corporation Dual-barrel, connector jack and plug assemblies
US7914344B2 (en) 2009-06-03 2011-03-29 Microsoft Corporation Dual-barrel, connector jack and plug assemblies
US20110007142A1 (en) * 2009-07-09 2011-01-13 Microsoft Corporation Visual representation expression based on player expression
US8390680B2 (en) 2009-07-09 2013-03-05 Microsoft Corporation Visual representation expression based on player expression
US9519989B2 (en) 2009-07-09 2016-12-13 Microsoft Technology Licensing, Llc Visual representation expression based on player expression
US9159151B2 (en) 2009-07-13 2015-10-13 Microsoft Technology Licensing, Llc Bringing a visual representation to life via learned input from the user
US20110007079A1 (en) * 2009-07-13 2011-01-13 Microsoft Corporation Bringing a visual representation to life via learned input from the user
US20110025689A1 (en) * 2009-07-29 2011-02-03 Microsoft Corporation Auto-Generating A Visual Representation
US20110055846A1 (en) * 2009-08-31 2011-03-03 Microsoft Corporation Techniques for using human gestures to control gesture unaware programs
US9141193B2 (en) 2009-08-31 2015-09-22 Microsoft Technology Licensing, Llc Techniques for using human gestures to control gesture unaware programs
US20110109617A1 (en) * 2009-11-12 2011-05-12 Microsoft Corporation Visualizing Depth
US20120113219A1 (en) * 2010-11-10 2012-05-10 Samsung Electronics Co., Ltd. Image conversion apparatus and display apparatus and methods using the same
US8942917B2 (en) 2011-02-14 2015-01-27 Microsoft Corporation Change invariant scene recognition by an agent
EP2677399A4 (en) * 2011-02-18 2014-09-03 Vtouch Co Ltd Virtual touch device without pointer
EP2677399A2 (en) * 2011-02-18 2013-12-25 VTouch Co., Ltd. Virtual touch device without pointer
US8620113B2 (en) 2011-04-25 2013-12-31 Microsoft Corporation Laser diode modes
US8760395B2 (en) 2011-05-31 2014-06-24 Microsoft Corporation Gesture recognition techniques
US9372544B2 (en) 2011-05-31 2016-06-21 Microsoft Technology Licensing, Llc Gesture recognition techniques
US8635637B2 (en) 2011-12-02 2014-01-21 Microsoft Corporation User interface presenting an animated avatar performing a media reaction
US9154837B2 (en) 2011-12-02 2015-10-06 Microsoft Technology Licensing, Llc User interface presenting an animated avatar performing a media reaction
US9100685B2 (en) 2011-12-09 2015-08-04 Microsoft Technology Licensing, Llc Determining audience state or interest using passive sensor data
US9628844B2 (en) 2011-12-09 2017-04-18 Microsoft Technology Licensing, Llc Determining audience state or interest using passive sensor data
US8898687B2 (en) 2012-04-04 2014-11-25 Microsoft Corporation Controlling a media program based on a media reaction
US8959541B2 (en) 2012-05-04 2015-02-17 Microsoft Technology Licensing, Llc Determining a future portion of a currently presented media program
US9788032B2 (en) 2012-05-04 2017-10-10 Microsoft Technology Licensing, Llc Determining a future portion of a currently presented media program
US9117120B2 (en) * 2013-05-24 2015-08-25 Honda Motor Co., Ltd. Field of vision capture
US20140348377A1 (en) * 2013-05-24 2014-11-27 Honda Motor Co., Ltd. Field of vision capture
US10275113B2 (en) 2014-12-19 2019-04-30 Hewlett-Packard Development Company, L.P. 3D visualization
EP3234732A4 (en) * 2014-12-19 2018-07-25 Hewlett-Packard Development Company, L.P. 3d visualization
EP3373114A1 (en) * 2017-03-10 2018-09-12 Alterface Projects Tracking system and method using a depth aware camera

Also Published As

Publication number Publication date
EP2243066B1 (en) 2018-11-07
WO2009083984A3 (en) 2009-08-27
US8149210B2 (en) 2012-04-03
WO2009083984A2 (en) 2009-07-09
CN101960409A (en) 2011-01-26
EP2243066A2 (en) 2010-10-27
CN105334980A (en) 2016-02-17

Similar Documents

Publication Publication Date Title
KR101184170B1 (en) Volume recognition method and system
US8547327B2 (en) Proximity object tracker
US9690099B2 (en) Optimized focal area for augmented reality displays
JP5865910B2 (en) Depth camera based on structured light and stereopsis
US9710973B2 (en) Low-latency fusing of virtual and real content
US8436811B2 (en) Three-dimensional virtual input and simulation apparatus
US7961174B1 (en) Tracking groups of users in motion capture system
US9423879B2 (en) Systems and methods for controlling device operation according to hand gestures
US10168791B2 (en) Extramissive spatial imaging digital eye glass apparatuses, methods and systems for virtual or augmediated vision, manipulation, creation, or interaction with objects, materials, or other entities
US20140176591A1 (en) Low-latency fusing of color image data
US8860760B2 (en) Augmented reality (AR) system and method for tracking parts and visually cueing a user to identify and locate parts in a scene
US20180329213A1 (en) Measuring content brightness in head worn computing
US7826641B2 (en) Apparatus and method for determining an absolute pose of a manipulated object in a real three-dimensional environment with invariant features
US20110304632A1 (en) Interacting with user interface via avatar
US8558873B2 (en) Use of wavefront coding to create a depth image
CN102681661B (en) Using a three-dimensional environment model in gameplay
EP1704465B1 (en) Method and apparatus for light input device
US20110234481A1 (en) Enhancing presentations using depth sensing cameras
US20130342572A1 (en) Control of displayed content in virtual environments
EP2893388B1 (en) Head mounted system and method to compute and render a stream of digital images using a head mounted system
US8897493B2 (en) Body scan
CA2760210C (en) Systems and methods for applying animations or motions to a character
US20090296991A1 (en) Human interface electronic device
US9881026B2 (en) Method and apparatus for identifying input features for later recognition
US8856691B2 (en) Gesture tool

Legal Events

Date Code Title Description
AS Assignment

Owner name: 3DV SYSTEMS LTD., ISRAEL

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KLIER, ZVI;KATZ, SAGI;MARDER, MATTIAS;AND OTHERS;REEL/FRAME:021819/0309

Effective date: 20081111

AS Assignment

Owner name: MICROSOFT INTERNATIONAL HOLDINGS B.V., NETHERLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:3DV SYSTEMS LTD.;REEL/FRAME:022939/0241

Effective date: 20090601

Owner name: MICROSOFT INTERNATIONAL HOLDINGS B.V.,NETHERLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:3DV SYSTEMS LTD.;REEL/FRAME:022939/0241

Effective date: 20090601

FPAY Fee payment

Year of fee payment: 4