JPH0844490A - Interface device - Google Patents

Interface device

Info

Publication number
JPH0844490A
JPH0844490A JP17685194A JP17685194A JPH0844490A JP H0844490 A JPH0844490 A JP H0844490A JP 17685194 A JP17685194 A JP 17685194A JP 17685194 A JP17685194 A JP 17685194A JP H0844490 A JPH0844490 A JP H0844490A
Authority
JP
Grant status
Application
Patent type
Prior art keywords
unit
display
interface device
shape
object
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP17685194A
Other languages
Japanese (ja)
Inventor
Taro Imagawa
Toshiyuki Koda
Susumu Maruno
Michiyo Moriie
進 丸野
太郎 今川
みち代 森家
敏行 香田
Original Assignee
Matsushita Electric Ind Co Ltd
松下電器産業株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00335Recognising movements or behaviour, e.g. recognition of gestures, dynamic facial expressions; Lip-reading

Abstract

PURPOSE:To attain an interface device capable of simply operating an equipment without requiring an input device such as a keyboard and a mouse. CONSTITUTION:The interface device is provided with a host computer 1 for recognizing the shape and movement of a target in a picture picked up by a CCD camera 3 and a display 2 for displaying the shape and movement of the target recognized by the host computer 1. When a user is opposed to the camera 3 and a command is applied by gesture e.g. the applied gesture is displayed on the display screen of the display 2, virtual switches 201 to 203 or the like displayed on the display screen can be selected through an icon 200 expressed by an arrow cursor by gesture, so that an extermely simple equipment can be operated without requiring an input device such as a mouse.

Description

【発明の詳細な説明】 DETAILED DESCRIPTION OF THE INVENTION

【0001】 [0001]

【産業上の利用分野】本発明は、コンピュータやワードプロセッサ等の情報機器や、テレビ等のディスプレイを有する機器の入出力を行うインターフェイス装置に関する。 The present invention relates to and information devices such as computers and word processors, for the interface apparatus for inputting and outputting apparatus having a display such as a television.

【0002】 [0002]

【従来の技術】この種の従来のインターフェイス装置として、表示画面中のマウスによって検出した座標位置にカーソルを表示し、画面中に表示した任意の操作ボタンをユーザーに選択させるものがある。 As a conventional interface apparatus of this type, there is to select to display the cursor on the coordinate position detected by the mouse in the display screen, any operating buttons displayed on the screen to the user.

【0003】図7はこの種の従来のインターフェイス装置の概要を示すものである。 [0003] Figure 7 shows an outline of a conventional interface device of this kind. 図7において、71はディスプレイで、ディスプレイ71中にはホストコンピュータ72 7, 71 denotes a display, the host computer 72 in the display 71
により、仮想の操作ボタン711、712、713が表示されている。 By, the virtual operation button 711, 712, and 713 are displayed. 73はマウス、710はマウスカーソルで、マウス73 73 is a mouse, 710 with the mouse cursor, mouse 73
によって検出したマウス73の移動量に基づき、マウス73 Based on the amount of movement of the mouse 73 detected by the mouse 73
の動きに同期して画面中を動くように、ホストコンピュータ72が表示制御する。 To move through the screen in synchronization of the motion, the host computer 72 to the display control. ユーザーは、マウス73を動かす事により、表示画面中の任意の仮想操作ボタンの位置にマウスカーソル710を移動させ、マウス73上のスイッチ7 User, by moving the mouse 73 to move the mouse cursor 710 to the position of any virtual operation button in the display screen, the switch 7 on the mouse 73
31を押すことにより、操作ボタンを選択し、ホストコンピュータ72に動作の指示を与えられるようになっている。 By pressing the 31, select the operation button, so that given an indication of the operation to the host computer 72.

【0004】 [0004]

【発明が解決しようとする課題】しかしながら上記従来の装置においては、機器の本体とは別にマウスという入力装置が必要で、又マウスを操作するテーブル等の基台が必要であり、携帯情報機器等に用いる事は適さない。 In [0006] However the conventional apparatus, requires input devices that separate mice and the body of the device, also requires a base such as a table to operate the mouse, a portable information equipment, etc. it is not suitable to be used for.
又、マウスを介して操作を行なうため、必ずしも直接的で分かりやすいインターフェイスにはなっていないという課題を有していた。 In addition, in order to perform the operation through a mouse, it has been a problem that not in a necessarily direct and easy-to-understand interface.

【0005】本発明はかかる点に鑑み、キーボードやマウス等の入力装置を必要とせず、簡単に機器の操作が可能なインターフェイス装置を提供することを目的とする。 [0005] In view of the above problems, without requiring input device such as a keyboard and a mouse, and an object thereof is to provide a simple operation capable interface device of the equipment.

【0006】 [0006]

【課題を解決するための手段】本発明は上記目的を達成するため、少なくとも撮像部と、前記撮像部で撮像した画像中の物体の形状と動きまたは形状もしくは動きを認識する動作認識部と、前記動作認識部によって認識した物体の形状と動きまたは形状もしくは動きを表示する表示部とを備えた構成である。 Since SUMMARY OF THE INVENTION The present invention to achieve the above object, at least the imaging unit, the operation recognition portion recognizes the object shape and movement or shape or movement in the image captured by the imaging unit, a configuration in which a display unit for displaying the shape and movement or shape or motion of the object recognized by the motion recognizing unit.

【0007】 [0007]

【作用】以上のように構成した本発明のインターフェイス装置の撮像部にユーザーが向い、例えば手振りによって指示を与えると、与えた手振りが表示画面上に表示され、例えば表示画面上に表示した仮想スイッチ等を手振りによって選択出来るものであり、マウス等の入力装置を必要とせず、非常に簡便な機器の操作が可能となるものである。 User faces the imaging unit of the interface device of the present invention constructed as described above [action], for example, give an indication by hand gesture is displayed on the given hand gesture is a display screen, a virtual switch that is displayed, for example, the display screen etc. are those of can be selected by the hand gesture, without requiring input device such as a mouse, in which very operation simple equipment becomes possible.

【0008】 [0008]

【実施例】以下、本発明の実施例について、図面を参照しながら説明する。 EXAMPLES The following examples of the present invention will be described with reference to the drawings. 図1は、本発明によるインターフェイス装置の実施例の外観を示したものである。 Figure 1 shows the appearance of the embodiment of the interface apparatus according to the present invention.

【0009】図1において、1はホストコンピュータ、 [0009] In FIG. 1, 1 is the host computer,
2は表示に用いるディスプレイ、3は画像を撮像するC 2 uses the display displaying, 3 captures an image C
CDカメラである。 It is a CD camera. CCDカメラ3は、ディスプレイ2 CCD camera 3, display 2
の表示方向と同一方向に撮像面を配置してあり、ユーザーが表示面に向かうことにより、ユーザーの手振りを撮像できるようになっている。 Display Yes by placing direction and the imaging surface in the same direction, by the user toward the display surface, so that it captures a user's hand gesture. 又、CCDカメラ3の撮像面上には、図示しない肌色領域の波長の光透過フィルタを配置してあり、人間の顔や手等の画像のみがCCDカメラ3によって撮像され、背景等の画像がカットされるようになっている。 Further, on the imaging surface of the CCD camera 3, Yes arranged light transmission filter in the wavelength of the skin color area (not shown), only the image, such as a human face and hands is picked up by the CCD camera 3, an image such as a background It is adapted to be cut. ディスプレイ2上には、仮想スイッチ201、202、203、及び前記仮想スイッチを選択する矢印カーソル200が表示できるようになっている。 On the display 2, the arrow cursor 200 for selecting the virtual switches 201, 202, 203, and the virtual switch is to be displayed.

【0010】図2は、本実施例の詳細なブロック図を示すものである。 [0010] Figure 2 shows a detailed block diagram of this embodiment. 図2において、CCDカメラ3から入力された画像は、フレームメモリ21に蓄えられる。 2, the image input from the CCD camera 3 is stored in the frame memory 21. 動作認識部22は、フレームメモリ21の中に蓄えた画像中から、 Operation recognition unit 22, from an image that stored in the frame memory 21,
例えば、ユーザーの手に相当する部分を抽出し、その形状が、例えば図3(A)に示すような、一本指の形状であるのか、又図3(B)に示すような握り拳の形状であるのかを判断する。 For example, to extract a portion corresponding to the user's hand, its shape, for example, FIG. 3 (A) to the shown, whether in the form of a finger, the shape of the fist as shown in Matazu 3 (B) to determine which of the or the.

【0011】図4は、動作認識部22の詳細な実施例を示したもので、輪郭抽出部221と、物体抽出部222と、形状変化識別部223と、位置検出部224とによって構成した例を示したものである。 [0011] FIG. 4 shows a detailed embodiment of the operation recognition section 22, a contour extraction unit 221, an object extraction unit 222, a shape change identifying unit 223, constituted by the position detection unit 224 Example It shows the.

【0012】輪郭抽出部221は、画像中に存在する物体の輪郭形状を抽出する。 [0012] contour extraction unit 221 extracts the object contour present in the image. 具体的な方法例としては、画像を二値化し、そのエッジを抽出することにより、簡単に輪郭形状が抽出できる。 As a specific method examples, images were binarized by extracting the edge, it can be extracted easily contour shape.

【0013】物体抽出部222は、輪郭抽出部221によって抽出した複数の物体の輪郭形状中から、例えばユーザーの手に相当する輪郭形状を抽出する。 [0013] object extraction unit 222, the contour shape of the plurality of objects extracted by the contour extracting unit 221, for example, extracts a contour shape corresponding to the user's hand. 具体的方法の一例としては、輪郭線で囲まれた閉領域の面積を判断させる方法や、又、ニューラルネットワークを用いて手の部分の輪郭形状を抽出する方法を用いることが出来る。 An example of a specific method, and a method for determining the area of ​​a closed region enclosed by the contour line, also can be used a method of extracting the contour shape of the portion of the hand using a neural network.

【0014】形状変化識別部223は、物体抽出部222によって抽出した手の部分の輪郭形状を更に詳細に識別し、 [0014] shape change identifying unit 223 further identifies detail the outline shape of the portion of the hand extracted by the object extraction unit 222,
例えばその形状が、図3(A)に示すような、一本指の形状であるのか、又図3(B)に示すような握り拳の形状であるのかを判断する。 For example its shape, as shown in FIG. 3 (A), whether in the form of one finger, it is determined whether in the form of a fist as shown in Matazu 3 (B). 同時に位置検出部224は、前記ユーザーの手の部分の輪郭形状の重心座標を演算する。 At the same time the position detection unit 224 calculates the barycentric coordinates of the contour shape of the portion of the user's hand. アイコン生成部24は、形状変化識別部223による手の形状の識別結果に基づいて、ディスプレイに表示すべきアイコン画像を生成する。 Icon generating unit 24, based on the identification result of the shape of the hand by the shape change identifying unit 223, generates an icon image to be displayed on the display. 例えば、手の形状の識別結果が一本指の形状であれば、例えば図5(A)に示すような矢印のアイコンを、また握り拳の形状であれば、例えば図5 For example, if the hand shape identifying result is the shape of one finger, for example, the arrow icon shown in FIG. 5 (A), also it has a shape of a fist, for example, FIG. 5
(B)に示すような、X印のアイコンを生成する。 (B) in as shown, to generate an X mark icon.

【0015】表示制御部23は、アイコン生成部24によって生成したアイコンのディスプレイ上での表示位置を制御するもので、座標変換部231と座標反転部232から成る。 The display control unit 23, controls the display position on the display of the icon generated by the icon generating unit 24, consisting of the coordinate conversion unit 231 and a coordinate inverting unit 232. 座標変換部231は、撮像した画像の座標からディスプレイの表示座標への変換を行ない、また、座標反転部 The coordinate conversion unit 231 performs conversion to a display coordinates of the display from the coordinates of the image captured, also coordinate inverting unit
232は、変換した表示座標の左右位置を反転する。 232, inverts the lateral positions of the transformed display coordinates. 即ち、位置検出部224によって検出したユーザーの手に相当する部分の画像中の重心座標から、ディスプレイの表示座標への変換を行い、左右の座標を反転させてディスプレイにアイコンを表示するわけである。 That is, the center coordinates of the image of a portion corresponding to the user's hand detected by the position detection unit 224, performs conversion to a display coordinates of the display is not displaying an icon on the display by reversing the left and right coordinates . この操作により、ユーザーが手を右に動かせば、この動作を鏡に写したのと同様に、表示画面状でアイコンが向かって右に動く。 This action By moving the user hands in the right, similar to the copy of this operation in a mirror, the icon on the display screen like moves to the right.

【0016】以上の様に構成した本実施例による操作例を以下に示す。 [0016] The operation example according to the present embodiment constructed as described above are shown below. 図1に示すように、本実施例によるインターフェイス装置を備えた機器にユーザーが向い、手を一本指の形状にして動かすと、ディスプレイ上に表示した矢印カーソルのアイコン200が、手の動きに対応した任意の位置に移動する。 As shown in FIG. 1, the user faces the apparatus including an interface device according to the present embodiment, moving to hand in the shape of one finger, an icon 200 of the arrow cursor displayed on the display, the movement of the hand It moved to any position corresponding. 次に、ディスプレイ上に表示した任意の仮想スイッチの上に、手を動かすことによって矢印カーソルのアイコン200を移動させ、手を握り、握り拳形状にすると、その仮想スイッチが選択され、ホストコンピュータ1に指令を与えることができるわけである。 Then, over any virtual switch displayed on the display, the hand moves the icon 200 of the arrow cursor by moving the grip hands, when the fist shape, the virtual switch is selected, the host computer 1 it is not can give a command.

【0017】図6は、本発明によるインターフェイス装置の動作認識部の他の実施例を示すものである。 [0017] Figure 6 illustrates another embodiment of the operation recognition portion of the interface device according to the present invention. この実施例では、動作認識部22を、輪郭抽出部221と形状変化識別部223と、位置検出部224とによって構成した例である。 In this embodiment, the operation recognition portion 22, a contour extraction unit 221 and the shape change identifying unit 223, an example in which the position detection unit 224. 即ち、物体抽出部221の動作を形状変化識別部223によって一括して行なわせるものである。 That is, what causes collectively the operation of the object extraction section 221 by the shape change identifying unit 223. 前述の実施例においては、物体抽出部222によって、手の形状の物体を一旦抽出し、更に形状変化識別部223によって、手の形状の細かな違いを詳細に識別するものであった。 In the illustrated embodiment, the object extraction unit 222 extracts once the object of the hand shape was achieved, further by the shape change identifying unit 223, identifying the slight differences between the shape of the hand in detail. 手の形状変化が、例えば、一本指と握り拳の2種類程度に限定するのであれば、図5に示すように、形状変化識別部22 Change in shape of the hand, for example, if the limit to two the order of one finger and fist, as shown in FIG. 5, the shape change identifying unit 22
3によって、画像中の複数の物体中から、この2種類の形状の何れかに相当する物体を識別、抽出させるだけで充分実用に耐える。 By 3, from among a plurality of objects in an image, endure an object corresponding to one of the two form identification, the suffices practical to extract.

【0018】又、表示するアイコンの例としては、例えば図5(C)、(D)に示すように、手の形状そのものをアイコン化すれば、実際の手の動きと対応が取れ、分かりやすい。 [0018] Also, examples of icons displayed, for example, as shown in FIG. 5 (C), (D), if the icon of the shape itself of the hand, correspondence taken from the actual movement of the hand, easy to understand . 具体的には、図5(C)、(D)のような画像を予め登録しておいてもよいし、又、輪郭抽出部221によって抽出した手の輪郭形状データを任意の大きさに縮小又は拡大し、アイコン画像として用いることもできる。 Specifically, FIG. 5 (C), the to image may be registered in advance such as (D), also reduces the contour shape data of the hand extracted by the contour extracting unit 221 into an arbitrary size or expanded, it can be used as an icon image.

【0019】 [0019]

【発明の効果】以上のように本発明は、少なくとも撮像部と、前記撮像部で撮像した画像中の物体の形状及び又は動きを認識する動作認識部と、前記動作認識部によって認識した物体の形状及び又は動きを表示する表示部とによって構成され、この撮像部にユーザーが向い、例えば手振りによって指示を与えると、与えた手振りが表示画面上に表示され、例えば表示画面上に表示した仮想スイッチ等を手振りによって選択でき、マウス等の入力装置を必要とせず、非常に簡便な機器の操作が可能となるものである。 The present invention as described above, according to the present invention includes at least the imaging unit, and the shape and or operation recognition portion recognizes the motion of an object in the image captured by the imaging unit, and the object of recognition by the motion recognizing unit is constituted by the shape and or display unit for displaying a motion, virtual switch user oriented, for example, give an indication by hand gesture, which gave hand gesture is displayed on the display screen, for example, displayed on a display screen in the image pickup unit etc. can be selected by the hand gesture, and without requiring input device such as a mouse, in which very operation simple equipment becomes possible.

【図面の簡単な説明】 BRIEF DESCRIPTION OF THE DRAWINGS

【図1】本発明の一実施例におけるインターフェイス装置の外観図 External view of an interface device according to an embodiment of the present invention; FIG

【図2】本発明の一実施例におけるインターフェイス装置の詳細なブロック図 Detailed block diagram of an interface device according to an embodiment of the present invention; FIG

【図3】(A),(B)は同インターフェイス装置によって判断する手の形状例を示す図 [3] (A), (B) is a diagram showing an example of the shape of the hand to be determined by the interface device

【図4】同インターフェイス装置の動作認識部の詳細な実施例を示すブロック図 Block diagram illustrating a detailed example of the operation recognition portion of Figure 4 the interface device

【図5】(A)〜(D)は同インターフェイス装置によって表示画面上に表示するアイコンの例を示す図 [5] (A) ~ (D) illustrates an example of icons displayed on the display screen by the interface apparatus of FIG

【図6】本発明によるインターフェイス装置の動作認識部の他の詳細な実施例を示すブロック図 Block diagram showing another detailed example of the operation recognition portion of the interface device according to the present invention; FIG

【図7】従来のマウスによるインターフェイス装置を示す外観図 7 are external views illustrating the conventional mouse interface device

【符号の説明】 DESCRIPTION OF SYMBOLS

1 ホストコンピュータ 2 ディスプレイ 3 CCDカメラ 21 フレームメモリ 22 動作認識部 23 表示制御部 24 アイコン生成部 200 アイコン 201、202、203 仮想スイッチ 221 輪郭抽出部 222 物体抽出部 223 形状変化識別部 224 位置検出部 231 座標変換部 232 座標反転部 1 host computer 2 display 3 CCD camera 21 frame memory 22 operation recognition portion 23 display control unit 24 the icon generating unit 200 icons 201, 202, and 203 virtual switch 221 contour extraction unit 222 object extraction unit 223 shape change identifying unit 224 position detection unit 231 coordinate conversion unit 232 coordinate inverting unit

───────────────────────────────────────────────────── フロントページの続き (72)発明者 森家 みち代 大阪府門真市大字門真1006番地 松下電器 産業株式会社内 ────────────────────────────────────────────────── ─── of the front page continued (72) inventor forest home Michiyo Osaka Prefecture Kadoma Oaza Kadoma 1006 address Matsushita Electric industrial Co., Ltd. in

Claims (10)

    【特許請求の範囲】 [The claims]
  1. 【請求項1】少なくとも撮像部と、前記撮像部で撮像した画像中の物体の形状及び又は動きを認識する動作認識部と、前記動作認識部によって認識した物体の形状及び又は動きを表示する表示部とによって構成したインターフェイス装置。 And 1. A least imaging unit, a display for displaying the shape and or operation recognition portion recognizes the motion of an object in the image captured by the imaging unit, the shape and or motion of an object recognized by the motion recognizing unit configured interface device by the Department.
  2. 【請求項2】表示部の表示方向と同一方向に撮像部の撮像面を配置した請求項1記載のインターフェイス装置。 2. A method according to claim 1, wherein the interface device is arranged an imaging surface of the imaging unit on the display in the same direction of the display unit.
  3. 【請求項3】使用者の目に対向させて表示部を配置した請求項1記載のインターフェイス装置。 3. A process according to claim 1, wherein the interface device is arranged to display to face the user's eyes.
  4. 【請求項4】撮像部の撮像範囲と表示部の表示範囲とを割当る表示制御部を設け、前記表示制御部により、前記撮像部の撮像範囲を左右逆転させて前記表示部の表示範囲に割当るようにした請求項1または2記載のインターフェイス装置。 Wherein providing the display control unit to assign the display range of the display portion imaging range of the imaging unit by the display control unit, the display range of the display unit of the imaging range by mirror reversing said image pickup unit assigning so interface device of claim 1, wherein the in.
  5. 【請求項5】表示制御部を、撮像した画像の座標から表示部の表示座標に変換する座標変換部と、前記変換した表示座標の左右の座標を反転させる座標反転部とにより構成した請求項4記載のインターフェイス装置。 5. A display control unit, according to claim constructed a coordinate converter for converting the display coordinates of the display unit from the coordinates of the captured image, the coordinate inverting unit for inverting the left and right coordinates of the transformed display coordinates 4, wherein the interface device.
  6. 【請求項6】動作認識部によって識別した物体の形状及び又は動きを、複数のアイコン画像として生成するアイコン生成部を設けた請求項1記載のインターフェイス装置。 6. The shape and or motion of the object identified by the motion recognizing unit, the interface device according to claim 1, wherein providing the icon generating unit for generating a plurality of icon images.
  7. 【請求項7】アイコン生成部が、動作認識部によって識別した物体の概略形状をアイコン画像として生成する事を特徴とした請求項6記載のインターフェイス装置。 7. A icon generating unit, the interface device according to claim 6, wherein the generating means generates the object outline shape identified by the operation recognition unit as an icon image.
  8. 【請求項8】画像中の所定の物体の形状変化を識別する形状変化識別部と、前記物体の重心を検出する位置検出部とによって動作認識部を構成した請求項1記載のインターフェイス装置。 8. A shape change identifying unit that identifies a change in shape of the predetermined object in the image, interface device of claim 1, wherein configuring the operation recognition portion by a position detector for detecting the center of gravity of the object.
  9. 【請求項9】物体識別部に物体抽出部を設け、画像中の複数の物体中から所定の物体を予め抽出させた後、形状変化識別部によって、前記物体抽出部によって抽出した物体の形状変化を識別させるようにした請求項1または7記載のインターフェイス装置。 9. The object extraction unit provided in the object identification unit, after pre-by extracting a predetermined object from among a plurality of objects in an image, the shape change identifying unit, object shape changes in extracted by the object extraction unit was to be identified claims 1 or 7, wherein the interface device.
  10. 【請求項10】撮像素子と、前記撮像素子の前面に配置した、人間の肌色近傍の波長の光を透過する肌色透過フィルタとによって撮像部を構成した請求項1記載のインターフェイス装置。 10. A imaging element was placed in front of the image sensor, a skin color transmission filter and claim 1, wherein the interface device where the image-capturing unit by which transmits light of a wavelength of human skin color vicinity.
JP17685194A 1994-07-28 1994-07-28 Interface device Pending JPH0844490A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP17685194A JPH0844490A (en) 1994-07-28 1994-07-28 Interface device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP17685194A JPH0844490A (en) 1994-07-28 1994-07-28 Interface device

Publications (1)

Publication Number Publication Date
JPH0844490A true true JPH0844490A (en) 1996-02-16

Family

ID=16020947

Family Applications (1)

Application Number Title Priority Date Filing Date
JP17685194A Pending JPH0844490A (en) 1994-07-28 1994-07-28 Interface device

Country Status (1)

Country Link
JP (1) JPH0844490A (en)

Cited By (164)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0823683A1 (en) * 1995-04-28 1998-02-11 Matsushita Electric Industrial Co., Ltd. Interface device
US5990893A (en) * 1996-09-13 1999-11-23 Kabushiki Kaisha Toshiba Data input device and method
WO2003098420A1 (en) * 2002-05-20 2003-11-27 Tau Engineering, Inc. Remote operation detection device, program, and recording medium
US7161596B2 (en) 2001-12-21 2007-01-09 British Telecommunications Public Limited Company Display location calculation means
JP2007310914A (en) * 2007-08-31 2007-11-29 Nippon Telegr & Teleph Corp <Ntt> Mouse alternating method, mouse alternating program and recording medium
WO2007135835A1 (en) * 2006-05-19 2007-11-29 Panasonic Corporation Image operating device, image operating method and image operating program
JP2009003576A (en) * 2007-06-19 2009-01-08 Canon Inc Appliance control device and control method
EP2040156A2 (en) 2007-09-19 2009-03-25 Sony Corporation Image processing
JP2009141441A (en) * 2007-12-03 2009-06-25 Nec Corp Character input-functional operation device, method, program, and portable terminal
JP2009188780A (en) * 2008-02-07 2009-08-20 Kuu-Kan Com Inc Video direction system and video direction method
US7629959B2 (en) 2004-09-21 2009-12-08 Victor Company Of Japan, Limited Controller for electronic appliance
JP2010122735A (en) * 2008-11-17 2010-06-03 Toshiba Information Systems (Japan) Corp Interface apparatus and interfacing program
US20100199221A1 (en) * 2009-01-30 2010-08-05 Microsoft Corporation Navigation of a virtual plane using depth
JP2010176510A (en) * 2009-01-30 2010-08-12 Sanyo Electric Co Ltd Information display device
US7978907B2 (en) 2005-10-26 2011-07-12 Fuji Xerox, Co., Ltd. Image analyzer
WO2011148607A1 (en) * 2010-05-28 2011-12-01 パナソニック株式会社 Gesture recognition device and gesture recognition method
US8099460B2 (en) 2004-07-27 2012-01-17 Sony Corporation Information processing device and method, recording medium, and program
JP2012103938A (en) * 2010-11-11 2012-05-31 Seiko Epson Corp Optical detection system and program
JP2013114647A (en) * 2011-12-01 2013-06-10 Exvision Inc Gesture input system
JP2013186500A (en) * 2012-03-05 2013-09-19 Toshiba Tec Corp Operation support display device and program
JP2013222317A (en) * 2012-04-17 2013-10-28 Toshiba Mach Co Ltd Numerical control device
KR101330810B1 (en) * 2012-02-24 2013-11-18 주식회사 팬택 User device for recognizing gesture and method thereof
US8638985B2 (en) 2009-05-01 2014-01-28 Microsoft Corporation Human body pose estimation
US8693724B2 (en) 2009-05-29 2014-04-08 Microsoft Corporation Method and system implementing user-centric gesture control
JP2014157352A (en) * 2013-02-18 2014-08-28 Samsung Electronics Co Ltd Display device
US8843857B2 (en) 2009-11-19 2014-09-23 Microsoft Corporation Distance scalable no touch computing
US8856691B2 (en) 2009-05-29 2014-10-07 Microsoft Corporation Gesture tool
US8854426B2 (en) 2011-11-07 2014-10-07 Microsoft Corporation Time-of-flight camera with guided light
US8860663B2 (en) 2009-01-30 2014-10-14 Microsoft Corporation Pose tracking pipeline
US8861839B2 (en) 2009-10-07 2014-10-14 Microsoft Corporation Human tracking system
US8867820B2 (en) 2009-10-07 2014-10-21 Microsoft Corporation Systems and methods for removing a background of an image
US8864581B2 (en) 2010-01-29 2014-10-21 Microsoft Corporation Visual based identitiy tracking
US8869072B2 (en) 2009-01-30 2014-10-21 Microsoft Corporation Gesture recognizer system architecture
US8866889B2 (en) 2010-11-03 2014-10-21 Microsoft Corporation In-home depth camera calibration
US8879831B2 (en) 2011-12-15 2014-11-04 Microsoft Corporation Using high-level attributes to guide image processing
US8882310B2 (en) 2012-12-10 2014-11-11 Microsoft Corporation Laser die light source module with low inductance
US8884968B2 (en) 2010-12-15 2014-11-11 Microsoft Corporation Modeling an object from image data
US8885890B2 (en) 2010-05-07 2014-11-11 Microsoft Corporation Depth map confidence filtering
US8891067B2 (en) 2010-02-01 2014-11-18 Microsoft Corporation Multiple synchronized optical sources for time-of-flight range finding systems
US8891827B2 (en) 2009-10-07 2014-11-18 Microsoft Corporation Systems and methods for tracking a model
US8888331B2 (en) 2011-05-09 2014-11-18 Microsoft Corporation Low inductance light source module
US8897493B2 (en) 2009-01-30 2014-11-25 Microsoft Corporation Body scan
US8896721B2 (en) 2009-05-29 2014-11-25 Microsoft Corporation Environment and/or target segmentation
US8897491B2 (en) 2011-06-06 2014-11-25 Microsoft Corporation System for finger recognition and tracking
US8898687B2 (en) 2012-04-04 2014-11-25 Microsoft Corporation Controlling a media program based on a media reaction
US8908091B2 (en) 2009-09-21 2014-12-09 Microsoft Corporation Alignment of lens and image sensor
US8917240B2 (en) 2009-06-01 2014-12-23 Microsoft Corporation Virtual desktop coordinate transformation
US8920241B2 (en) 2010-12-15 2014-12-30 Microsoft Corporation Gesture controlled persistent handles for interface guides
US8929612B2 (en) 2011-06-06 2015-01-06 Microsoft Corporation System for recognizing an open or closed hand
US8928579B2 (en) 2010-02-22 2015-01-06 Andrew David Wilson Interacting with an omni-directionally projected display
US8929668B2 (en) 2011-11-29 2015-01-06 Microsoft Corporation Foreground subject detection
US8933884B2 (en) 2010-01-15 2015-01-13 Microsoft Corporation Tracking groups of users in motion capture system
US8942428B2 (en) 2009-05-01 2015-01-27 Microsoft Corporation Isolate extraneous motions
US8942917B2 (en) 2011-02-14 2015-01-27 Microsoft Corporation Change invariant scene recognition by an agent
US8953844B2 (en) 2010-09-07 2015-02-10 Microsoft Technology Licensing, Llc System for fast, probabilistic skeletal tracking
US8959541B2 (en) 2012-05-04 2015-02-17 Microsoft Technology Licensing, Llc Determining a future portion of a currently presented media program
US8963829B2 (en) 2009-10-07 2015-02-24 Microsoft Corporation Methods and systems for determining and tracking extremities of a target
US8968091B2 (en) 2010-09-07 2015-03-03 Microsoft Technology Licensing, Llc Scalable real-time motion recognition
US8971612B2 (en) 2011-12-15 2015-03-03 Microsoft Corporation Learning image processing tasks from scene reconstructions
US8976986B2 (en) 2009-09-21 2015-03-10 Microsoft Technology Licensing, Llc Volume adjustment based on listener position
US8983233B2 (en) 2010-10-04 2015-03-17 Microsoft Technology Licensing, Llc Time-of-flight depth imaging
US8982151B2 (en) 2010-06-14 2015-03-17 Microsoft Technology Licensing, Llc Independently processing planes of display data
US8988432B2 (en) 2009-11-05 2015-03-24 Microsoft Technology Licensing, Llc Systems and methods for processing an image for target tracking
US8988437B2 (en) 2009-03-20 2015-03-24 Microsoft Technology Licensing, Llc Chaining animations
US8988508B2 (en) 2010-09-24 2015-03-24 Microsoft Technology Licensing, Llc. Wide angle field of view active illumination imaging system
US8994718B2 (en) 2010-12-21 2015-03-31 Microsoft Technology Licensing, Llc Skeletal control of three-dimensional virtual world
US9001118B2 (en) 2012-06-21 2015-04-07 Microsoft Technology Licensing, Llc Avatar construction using depth camera
US9008355B2 (en) 2010-06-04 2015-04-14 Microsoft Technology Licensing, Llc Automatic depth camera aiming
US9013489B2 (en) 2011-06-06 2015-04-21 Microsoft Technology Licensing, Llc Generation of avatar reflecting player appearance
US9015638B2 (en) 2009-05-01 2015-04-21 Microsoft Technology Licensing, Llc Binding users to a gesture based system and providing feedback to the users
US9019201B2 (en) 2010-01-08 2015-04-28 Microsoft Technology Licensing, Llc Evolving universal gesture sets
US9031103B2 (en) 2010-03-31 2015-05-12 Microsoft Technology Licensing, Llc Temperature measurement and control for laser and light-emitting diodes
US9039528B2 (en) 2009-01-30 2015-05-26 Microsoft Technology Licensing, Llc Visual target tracking
US9052746B2 (en) 2013-02-15 2015-06-09 Microsoft Technology Licensing, Llc User center-of-mass and mass distribution extraction using depth images
US9054764B2 (en) 2007-05-17 2015-06-09 Microsoft Technology Licensing, Llc Sensor array beamformer post-processor
US9052382B2 (en) 2008-06-30 2015-06-09 Microsoft Technology Licensing, Llc System architecture design for time-of-flight system having reduced differential pixel size, and time-of-flight systems so designed
US9063001B2 (en) 2009-09-14 2015-06-23 Microsoft Technology Licensing, Llc Optical fault monitoring
US9067136B2 (en) 2011-03-10 2015-06-30 Microsoft Technology Licensing, Llc Push personalization of interface controls
US9069381B2 (en) 2010-03-12 2015-06-30 Microsoft Technology Licensing, Llc Interacting with a computer based application
US9075434B2 (en) 2010-08-20 2015-07-07 Microsoft Technology Licensing, Llc Translating user motion into multiple object responses
US9092657B2 (en) 2013-03-13 2015-07-28 Microsoft Technology Licensing, Llc Depth image processing
US9098110B2 (en) 2011-06-06 2015-08-04 Microsoft Technology Licensing, Llc Head rotation tracking from depth-based center of mass
US9098493B2 (en) 2010-06-04 2015-08-04 Microsoft Technology Licensing, Llc Machine based sign language interpreter
US9098873B2 (en) 2010-04-01 2015-08-04 Microsoft Technology Licensing, Llc Motion-based interactive shopping environment
US9100685B2 (en) 2011-12-09 2015-08-04 Microsoft Technology Licensing, Llc Determining audience state or interest using passive sensor data
US9117281B2 (en) 2011-11-02 2015-08-25 Microsoft Corporation Surface segmentation from RGB and depth images
US9123316B2 (en) 2010-12-27 2015-09-01 Microsoft Technology Licensing, Llc Interactive content creation
US9135516B2 (en) 2013-03-08 2015-09-15 Microsoft Technology Licensing, Llc User body angle, curvature and average extremity positions extraction using depth images
US9137463B2 (en) 2011-05-12 2015-09-15 Microsoft Technology Licensing, Llc Adaptive high dynamic range camera
US9141193B2 (en) 2009-08-31 2015-09-22 Microsoft Technology Licensing, Llc Techniques for using human gestures to control gesture unaware programs
US9147253B2 (en) 2010-03-17 2015-09-29 Microsoft Technology Licensing, Llc Raster scanning for depth detection
US9154837B2 (en) 2011-12-02 2015-10-06 Microsoft Technology Licensing, Llc User interface presenting an animated avatar performing a media reaction
US9159151B2 (en) 2009-07-13 2015-10-13 Microsoft Technology Licensing, Llc Bringing a visual representation to life via learned input from the user
US9171264B2 (en) 2010-12-15 2015-10-27 Microsoft Technology Licensing, Llc Parallel processing machine learning decision tree training
US9182814B2 (en) 2009-05-29 2015-11-10 Microsoft Technology Licensing, Llc Systems and methods for estimating a non-visible or occluded body part
US9191570B2 (en) 2009-05-01 2015-11-17 Microsoft Technology Licensing, Llc Systems and methods for detecting a tilt angle from a depth image
US9195305B2 (en) 2010-01-15 2015-11-24 Microsoft Technology Licensing, Llc Recognizing user intent in motion capture system
US9210401B2 (en) 2012-05-03 2015-12-08 Microsoft Technology Licensing, Llc Projected visual cues for guiding physical movement
US9208571B2 (en) 2011-06-06 2015-12-08 Microsoft Technology Licensing, Llc Object digitization
US9215478B2 (en) 2009-05-29 2015-12-15 Microsoft Technology Licensing, Llc Protocol and format for communicating an image from a camera to a computing environment
US9244533B2 (en) 2009-12-17 2016-01-26 Microsoft Technology Licensing, Llc Camera navigation for presentations
US9247238B2 (en) 2011-01-31 2016-01-26 Microsoft Technology Licensing, Llc Reducing interference between multiple infra-red depth cameras
US9242171B2 (en) 2011-01-31 2016-01-26 Microsoft Technology Licensing, Llc Real-time camera tracking using depth maps
CN105278661A (en) * 2014-07-11 2016-01-27 胜华科技股份有限公司 Gesture control method with mouse tracking control and five-direction-key waving control
US9251590B2 (en) 2013-01-24 2016-02-02 Microsoft Technology Licensing, Llc Camera pose estimation for 3D reconstruction
US9256282B2 (en) 2009-03-20 2016-02-09 Microsoft Technology Licensing, Llc Virtual object manipulation
US9259643B2 (en) 2011-04-28 2016-02-16 Microsoft Technology Licensing, Llc Control of separate computer game elements
US9264807B2 (en) 2008-06-19 2016-02-16 Microsoft Technology Licensing, Llc Multichannel acoustic echo reduction
US9262673B2 (en) 2009-05-01 2016-02-16 Microsoft Technology Licensing, Llc Human body pose estimation
US9268404B2 (en) 2010-01-08 2016-02-23 Microsoft Technology Licensing, Llc Application gesture interpretation
US9274747B2 (en) 2010-06-21 2016-03-01 Microsoft Technology Licensing, Llc Natural user input for driving interactive stories
US9274606B2 (en) 2013-03-14 2016-03-01 Microsoft Technology Licensing, Llc NUI video conference controls
US9291449B2 (en) 2010-11-02 2016-03-22 Microsoft Technology Licensing, Llc Detection of configuration changes among optical elements of illumination system
US9292083B2 (en) 2010-06-11 2016-03-22 Microsoft Technology Licensing, Llc Interacting with user interface via avatar
US9298287B2 (en) 2011-03-31 2016-03-29 Microsoft Technology Licensing, Llc Combined activation for natural user interface systems
US9298263B2 (en) 2009-05-01 2016-03-29 Microsoft Technology Licensing, Llc Show body position
US9313376B1 (en) 2009-04-01 2016-04-12 Microsoft Technology Licensing, Llc Dynamic depth power equalization
US9342139B2 (en) 2011-12-19 2016-05-17 Microsoft Technology Licensing, Llc Pairing a computing device to a user
US9349040B2 (en) 2010-11-19 2016-05-24 Microsoft Technology Licensing, Llc Bi-modal depth-image analysis
US9372544B2 (en) 2011-05-31 2016-06-21 Microsoft Technology Licensing, Llc Gesture recognition techniques
US9384329B2 (en) 2010-06-11 2016-07-05 Microsoft Technology Licensing, Llc Caloric burn determination from body movement
US9383823B2 (en) 2009-05-29 2016-07-05 Microsoft Technology Licensing, Llc Combining gestures beyond skeletal
US9400548B2 (en) 2009-10-19 2016-07-26 Microsoft Technology Licensing, Llc Gesture personalization and profile roaming
US9400559B2 (en) 2009-05-29 2016-07-26 Microsoft Technology Licensing, Llc Gesture shortcuts
US9442186B2 (en) 2013-05-13 2016-09-13 Microsoft Technology Licensing, Llc Interference reduction for TOF systems
US9443310B2 (en) 2013-10-09 2016-09-13 Microsoft Technology Licensing, Llc Illumination modules that emit structured light
US9454244B2 (en) 2002-02-07 2016-09-27 Microsoft Technology Licensing, Llc Recognizing a movement of a pointing device
US9462253B2 (en) 2013-09-23 2016-10-04 Microsoft Technology Licensing, Llc Optical modules that reduce speckle contrast and diffraction artifacts
US9470778B2 (en) 2011-03-29 2016-10-18 Microsoft Technology Licensing, Llc Learning from high quality depth measurements
US9468848B2 (en) 2010-01-08 2016-10-18 Microsoft Technology Licensing, Llc Assigning gesture dictionaries
US9484065B2 (en) 2010-10-15 2016-11-01 Microsoft Technology Licensing, Llc Intelligent determination of replays based on event identification
US9491226B2 (en) 2010-06-02 2016-11-08 Microsoft Technology Licensing, Llc Recognition system for sharing information
US9498718B2 (en) 2009-05-01 2016-11-22 Microsoft Technology Licensing, Llc Altering a view perspective within a display environment
US9508385B2 (en) 2013-11-21 2016-11-29 Microsoft Technology Licensing, Llc Audio-visual project generator
US9519989B2 (en) 2009-07-09 2016-12-13 Microsoft Technology Licensing, Llc Visual representation expression based on player expression
US9524024B2 (en) 2009-05-01 2016-12-20 Microsoft Technology Licensing, Llc Method to control perspective for a camera-controlled computer
US9539500B2 (en) 2011-04-05 2017-01-10 Microsoft Technology Licensing, Llc Biometric recognition
US9551914B2 (en) 2011-03-07 2017-01-24 Microsoft Technology Licensing, Llc Illuminator with refractive optical element
US9557836B2 (en) 2011-11-01 2017-01-31 Microsoft Technology Licensing, Llc Depth image compression
US9557574B2 (en) 2010-06-08 2017-01-31 Microsoft Technology Licensing, Llc Depth illumination and detection optics
US9594430B2 (en) 2011-06-01 2017-03-14 Microsoft Technology Licensing, Llc Three-dimensional foreground selection for vision system
US9596643B2 (en) 2011-12-16 2017-03-14 Microsoft Technology Licensing, Llc Providing a user interface experience based on inferred vehicle state
US9597587B2 (en) 2011-06-08 2017-03-21 Microsoft Technology Licensing, Llc Locational node device
US9641825B2 (en) 2009-01-04 2017-05-02 Microsoft International Holdings B.V. Gated 3D camera
US9646340B2 (en) 2010-04-01 2017-05-09 Microsoft Technology Licensing, Llc Avatar-based virtual dressing room
US9652042B2 (en) 2003-03-25 2017-05-16 Microsoft Technology Licensing, Llc Architecture for controlling a computer using hand gestures
US9656162B2 (en) 2009-05-29 2017-05-23 Microsoft Technology Licensing, Llc Device for identifying and tracking multiple humans over time
US9674563B2 (en) 2013-11-04 2017-06-06 Rovi Guides, Inc. Systems and methods for recommending content
US9696427B2 (en) 2012-08-14 2017-07-04 Microsoft Technology Licensing, Llc Wide angle depth detection
US9720089B2 (en) 2012-01-23 2017-08-01 Microsoft Technology Licensing, Llc 3D zoom imager
US9724600B2 (en) 2011-06-06 2017-08-08 Microsoft Technology Licensing, Llc Controlling objects in a virtual environment
US9769459B2 (en) 2013-11-12 2017-09-19 Microsoft Technology Licensing, Llc Power efficient laser diode driver circuit and method
US9823339B2 (en) 2010-12-21 2017-11-21 Microsoft Technology Licensing, Llc Plural anode time-of-flight sensor
US9821224B2 (en) 2010-12-21 2017-11-21 Microsoft Technology Licensing, Llc Driving simulator control with virtual skeleton
US9836590B2 (en) 2012-06-22 2017-12-05 Microsoft Technology Licensing, Llc Enhanced accuracy of user presence status determination
US9842405B2 (en) 2009-01-30 2017-12-12 Microsoft Technology Licensing, Llc Visual target tracking
US9848106B2 (en) 2010-12-21 2017-12-19 Microsoft Technology Licensing, Llc Intelligent gameplay photo capture
US9857470B2 (en) 2012-12-28 2018-01-02 Microsoft Technology Licensing, Llc Using photometric stereo for 3D environment modeling
US9898675B2 (en) 2009-05-01 2018-02-20 Microsoft Technology Licensing, Llc User movement tracking feedback to improve tracking
US9940553B2 (en) 2013-02-22 2018-04-10 Microsoft Technology Licensing, Llc Camera/object pose from predicted coordinates
US9953213B2 (en) 2013-03-27 2018-04-24 Microsoft Technology Licensing, Llc Self discovery of autonomous NUI devices
US9971491B2 (en) 2014-01-09 2018-05-15 Microsoft Technology Licensing, Llc Gesture library for natural user input
US10085072B2 (en) 2009-09-23 2018-09-25 Rovi Guides, Inc. Systems and methods for automatically detecting users within detection regions of media devices
US10113868B2 (en) 2014-10-16 2018-10-30 Microsoft Technology Licensing, Llc Multiple synchronized optical sources for time-of-flight range finding systems

Cited By (210)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0823683A1 (en) * 1995-04-28 1998-02-11 Matsushita Electric Industrial Co., Ltd. Interface device
EP0823683A4 (en) * 1995-04-28 2000-12-06 Matsushita Electric Ind Co Ltd Interface device
US5990893A (en) * 1996-09-13 1999-11-23 Kabushiki Kaisha Toshiba Data input device and method
US7161596B2 (en) 2001-12-21 2007-01-09 British Telecommunications Public Limited Company Display location calculation means
US9454244B2 (en) 2002-02-07 2016-09-27 Microsoft Technology Licensing, Llc Recognizing a movement of a pointing device
WO2003098420A1 (en) * 2002-05-20 2003-11-27 Tau Engineering, Inc. Remote operation detection device, program, and recording medium
US9652042B2 (en) 2003-03-25 2017-05-16 Microsoft Technology Licensing, Llc Architecture for controlling a computer using hand gestures
US8856231B2 (en) * 2004-07-27 2014-10-07 Sony Corporation Information processing device and method, recording medium, and program
US20120110081A1 (en) * 2004-07-27 2012-05-03 Sony Corporation Information processing device and method, recording medium, and program
US8099460B2 (en) 2004-07-27 2012-01-17 Sony Corporation Information processing device and method, recording medium, and program
US7629959B2 (en) 2004-09-21 2009-12-08 Victor Company Of Japan, Limited Controller for electronic appliance
US7978907B2 (en) 2005-10-26 2011-07-12 Fuji Xerox, Co., Ltd. Image analyzer
JPWO2007135835A1 (en) * 2006-05-19 2009-10-01 パナソニック株式会社 Image manipulation device, image manipulation method, and image manipulation program
US8089457B2 (en) 2006-05-19 2012-01-03 Panasonic Corporation Image operating device, image operating method, and image operating program embodied on computer readable medium
WO2007135835A1 (en) * 2006-05-19 2007-11-29 Panasonic Corporation Image operating device, image operating method and image operating program
US9054764B2 (en) 2007-05-17 2015-06-09 Microsoft Technology Licensing, Llc Sensor array beamformer post-processor
JP2009003576A (en) * 2007-06-19 2009-01-08 Canon Inc Appliance control device and control method
JP2007310914A (en) * 2007-08-31 2007-11-29 Nippon Telegr & Teleph Corp <Ntt> Mouse alternating method, mouse alternating program and recording medium
US8643598B2 (en) 2007-09-19 2014-02-04 Sony Corporation Image processing apparatus and method, and program therefor
US8896535B2 (en) 2007-09-19 2014-11-25 Sony Corporation Image processing apparatus and method, and program therefor
EP2040156A2 (en) 2007-09-19 2009-03-25 Sony Corporation Image processing
JP2009141441A (en) * 2007-12-03 2009-06-25 Nec Corp Character input-functional operation device, method, program, and portable terminal
JP2009188780A (en) * 2008-02-07 2009-08-20 Kuu-Kan Com Inc Video direction system and video direction method
US9264807B2 (en) 2008-06-19 2016-02-16 Microsoft Technology Licensing, Llc Multichannel acoustic echo reduction
US9052382B2 (en) 2008-06-30 2015-06-09 Microsoft Technology Licensing, Llc System architecture design for time-of-flight system having reduced differential pixel size, and time-of-flight systems so designed
JP2010122735A (en) * 2008-11-17 2010-06-03 Toshiba Information Systems (Japan) Corp Interface apparatus and interfacing program
US9641825B2 (en) 2009-01-04 2017-05-02 Microsoft International Holdings B.V. Gated 3D camera
US8869072B2 (en) 2009-01-30 2014-10-21 Microsoft Corporation Gesture recognizer system architecture
JP2010176510A (en) * 2009-01-30 2010-08-12 Sanyo Electric Co Ltd Information display device
US9607213B2 (en) 2009-01-30 2017-03-28 Microsoft Technology Licensing, Llc Body scan
US20100199221A1 (en) * 2009-01-30 2010-08-05 Microsoft Corporation Navigation of a virtual plane using depth
US9652030B2 (en) * 2009-01-30 2017-05-16 Microsoft Technology Licensing, Llc Navigation of a virtual plane using a zone of restriction for canceling noise
US9007417B2 (en) 2009-01-30 2015-04-14 Microsoft Technology Licensing, Llc Body scan
US9039528B2 (en) 2009-01-30 2015-05-26 Microsoft Technology Licensing, Llc Visual target tracking
US9465980B2 (en) 2009-01-30 2016-10-11 Microsoft Technology Licensing, Llc Pose tracking pipeline
US9842405B2 (en) 2009-01-30 2017-12-12 Microsoft Technology Licensing, Llc Visual target tracking
US8860663B2 (en) 2009-01-30 2014-10-14 Microsoft Corporation Pose tracking pipeline
US8897493B2 (en) 2009-01-30 2014-11-25 Microsoft Corporation Body scan
US9280203B2 (en) 2009-01-30 2016-03-08 Microsoft Technology Licensing, Llc Gesture recognizer system architecture
US9824480B2 (en) 2009-03-20 2017-11-21 Microsoft Technology Licensing, Llc Chaining animations
US9478057B2 (en) 2009-03-20 2016-10-25 Microsoft Technology Licensing, Llc Chaining animations
US8988437B2 (en) 2009-03-20 2015-03-24 Microsoft Technology Licensing, Llc Chaining animations
US9256282B2 (en) 2009-03-20 2016-02-09 Microsoft Technology Licensing, Llc Virtual object manipulation
US9313376B1 (en) 2009-04-01 2016-04-12 Microsoft Technology Licensing, Llc Dynamic depth power equalization
US9377857B2 (en) 2009-05-01 2016-06-28 Microsoft Technology Licensing, Llc Show body position
US9519970B2 (en) 2009-05-01 2016-12-13 Microsoft Technology Licensing, Llc Systems and methods for detecting a tilt angle from a depth image
US9015638B2 (en) 2009-05-01 2015-04-21 Microsoft Technology Licensing, Llc Binding users to a gesture based system and providing feedback to the users
US8638985B2 (en) 2009-05-01 2014-01-28 Microsoft Corporation Human body pose estimation
US9898675B2 (en) 2009-05-01 2018-02-20 Microsoft Technology Licensing, Llc User movement tracking feedback to improve tracking
US9262673B2 (en) 2009-05-01 2016-02-16 Microsoft Technology Licensing, Llc Human body pose estimation
US9498718B2 (en) 2009-05-01 2016-11-22 Microsoft Technology Licensing, Llc Altering a view perspective within a display environment
US9524024B2 (en) 2009-05-01 2016-12-20 Microsoft Technology Licensing, Llc Method to control perspective for a camera-controlled computer
US9191570B2 (en) 2009-05-01 2015-11-17 Microsoft Technology Licensing, Llc Systems and methods for detecting a tilt angle from a depth image
US8942428B2 (en) 2009-05-01 2015-01-27 Microsoft Corporation Isolate extraneous motions
US9519828B2 (en) 2009-05-01 2016-12-13 Microsoft Technology Licensing, Llc Isolate extraneous motions
US9910509B2 (en) 2009-05-01 2018-03-06 Microsoft Technology Licensing, Llc Method to control perspective for a camera-controlled computer
US9298263B2 (en) 2009-05-01 2016-03-29 Microsoft Technology Licensing, Llc Show body position
US9569005B2 (en) 2009-05-29 2017-02-14 Microsoft Technology Licensing, Llc Method and system implementing user-centric gesture control
US9400559B2 (en) 2009-05-29 2016-07-26 Microsoft Technology Licensing, Llc Gesture shortcuts
US9383823B2 (en) 2009-05-29 2016-07-05 Microsoft Technology Licensing, Llc Combining gestures beyond skeletal
US8856691B2 (en) 2009-05-29 2014-10-07 Microsoft Corporation Gesture tool
US8693724B2 (en) 2009-05-29 2014-04-08 Microsoft Corporation Method and system implementing user-centric gesture control
US9215478B2 (en) 2009-05-29 2015-12-15 Microsoft Technology Licensing, Llc Protocol and format for communicating an image from a camera to a computing environment
US8896721B2 (en) 2009-05-29 2014-11-25 Microsoft Corporation Environment and/or target segmentation
US9182814B2 (en) 2009-05-29 2015-11-10 Microsoft Technology Licensing, Llc Systems and methods for estimating a non-visible or occluded body part
US9656162B2 (en) 2009-05-29 2017-05-23 Microsoft Technology Licensing, Llc Device for identifying and tracking multiple humans over time
US8917240B2 (en) 2009-06-01 2014-12-23 Microsoft Corporation Virtual desktop coordinate transformation
US9519989B2 (en) 2009-07-09 2016-12-13 Microsoft Technology Licensing, Llc Visual representation expression based on player expression
US9159151B2 (en) 2009-07-13 2015-10-13 Microsoft Technology Licensing, Llc Bringing a visual representation to life via learned input from the user
US9141193B2 (en) 2009-08-31 2015-09-22 Microsoft Technology Licensing, Llc Techniques for using human gestures to control gesture unaware programs
US9063001B2 (en) 2009-09-14 2015-06-23 Microsoft Technology Licensing, Llc Optical fault monitoring
US8908091B2 (en) 2009-09-21 2014-12-09 Microsoft Corporation Alignment of lens and image sensor
US8976986B2 (en) 2009-09-21 2015-03-10 Microsoft Technology Licensing, Llc Volume adjustment based on listener position
US10085072B2 (en) 2009-09-23 2018-09-25 Rovi Guides, Inc. Systems and methods for automatically detecting users within detection regions of media devices
US9821226B2 (en) 2009-10-07 2017-11-21 Microsoft Technology Licensing, Llc Human tracking system
US9582717B2 (en) 2009-10-07 2017-02-28 Microsoft Technology Licensing, Llc Systems and methods for tracking a model
US8861839B2 (en) 2009-10-07 2014-10-14 Microsoft Corporation Human tracking system
US8970487B2 (en) 2009-10-07 2015-03-03 Microsoft Technology Licensing, Llc Human tracking system
US8867820B2 (en) 2009-10-07 2014-10-21 Microsoft Corporation Systems and methods for removing a background of an image
US9679390B2 (en) 2009-10-07 2017-06-13 Microsoft Technology Licensing, Llc Systems and methods for removing a background of an image
US9522328B2 (en) 2009-10-07 2016-12-20 Microsoft Technology Licensing, Llc Human tracking system
US8897495B2 (en) 2009-10-07 2014-11-25 Microsoft Corporation Systems and methods for tracking a model
US9659377B2 (en) 2009-10-07 2017-05-23 Microsoft Technology Licensing, Llc Methods and systems for determining and tracking extremities of a target
US8891827B2 (en) 2009-10-07 2014-11-18 Microsoft Corporation Systems and methods for tracking a model
US8963829B2 (en) 2009-10-07 2015-02-24 Microsoft Corporation Methods and systems for determining and tracking extremities of a target
US9400548B2 (en) 2009-10-19 2016-07-26 Microsoft Technology Licensing, Llc Gesture personalization and profile roaming
US8988432B2 (en) 2009-11-05 2015-03-24 Microsoft Technology Licensing, Llc Systems and methods for processing an image for target tracking
US10048763B2 (en) 2009-11-19 2018-08-14 Microsoft Technology Licensing, Llc Distance scalable no touch computing
US8843857B2 (en) 2009-11-19 2014-09-23 Microsoft Corporation Distance scalable no touch computing
US9244533B2 (en) 2009-12-17 2016-01-26 Microsoft Technology Licensing, Llc Camera navigation for presentations
US9268404B2 (en) 2010-01-08 2016-02-23 Microsoft Technology Licensing, Llc Application gesture interpretation
US9468848B2 (en) 2010-01-08 2016-10-18 Microsoft Technology Licensing, Llc Assigning gesture dictionaries
US9019201B2 (en) 2010-01-08 2015-04-28 Microsoft Technology Licensing, Llc Evolving universal gesture sets
US9195305B2 (en) 2010-01-15 2015-11-24 Microsoft Technology Licensing, Llc Recognizing user intent in motion capture system
US8933884B2 (en) 2010-01-15 2015-01-13 Microsoft Corporation Tracking groups of users in motion capture system
US9278287B2 (en) 2010-01-29 2016-03-08 Microsoft Technology Licensing, Llc Visual based identity tracking
US8926431B2 (en) 2010-01-29 2015-01-06 Microsoft Corporation Visual based identity tracking
US8864581B2 (en) 2010-01-29 2014-10-21 Microsoft Corporation Visual based identitiy tracking
US8891067B2 (en) 2010-02-01 2014-11-18 Microsoft Corporation Multiple synchronized optical sources for time-of-flight range finding systems
US8928579B2 (en) 2010-02-22 2015-01-06 Andrew David Wilson Interacting with an omni-directionally projected display
US9069381B2 (en) 2010-03-12 2015-06-30 Microsoft Technology Licensing, Llc Interacting with a computer based application
US9147253B2 (en) 2010-03-17 2015-09-29 Microsoft Technology Licensing, Llc Raster scanning for depth detection
US9031103B2 (en) 2010-03-31 2015-05-12 Microsoft Technology Licensing, Llc Temperature measurement and control for laser and light-emitting diodes
US9646340B2 (en) 2010-04-01 2017-05-09 Microsoft Technology Licensing, Llc Avatar-based virtual dressing room
US9098873B2 (en) 2010-04-01 2015-08-04 Microsoft Technology Licensing, Llc Motion-based interactive shopping environment
US8885890B2 (en) 2010-05-07 2014-11-11 Microsoft Corporation Depth map confidence filtering
US8730164B2 (en) 2010-05-28 2014-05-20 Panasonic Corporation Gesture recognition apparatus and method of gesture recognition
JP4897939B2 (en) * 2010-05-28 2012-03-14 パナソニック株式会社 Gesture recognition device and gesture recognition method
WO2011148607A1 (en) * 2010-05-28 2011-12-01 パナソニック株式会社 Gesture recognition device and gesture recognition method
US9491226B2 (en) 2010-06-02 2016-11-08 Microsoft Technology Licensing, Llc Recognition system for sharing information
US9958952B2 (en) 2010-06-02 2018-05-01 Microsoft Technology Licensing, Llc Recognition system for sharing information
US9098493B2 (en) 2010-06-04 2015-08-04 Microsoft Technology Licensing, Llc Machine based sign language interpreter
US9008355B2 (en) 2010-06-04 2015-04-14 Microsoft Technology Licensing, Llc Automatic depth camera aiming
US9557574B2 (en) 2010-06-08 2017-01-31 Microsoft Technology Licensing, Llc Depth illumination and detection optics
US9292083B2 (en) 2010-06-11 2016-03-22 Microsoft Technology Licensing, Llc Interacting with user interface via avatar
US9384329B2 (en) 2010-06-11 2016-07-05 Microsoft Technology Licensing, Llc Caloric burn determination from body movement
US8982151B2 (en) 2010-06-14 2015-03-17 Microsoft Technology Licensing, Llc Independently processing planes of display data
US9274747B2 (en) 2010-06-21 2016-03-01 Microsoft Technology Licensing, Llc Natural user input for driving interactive stories
US9075434B2 (en) 2010-08-20 2015-07-07 Microsoft Technology Licensing, Llc Translating user motion into multiple object responses
US8953844B2 (en) 2010-09-07 2015-02-10 Microsoft Technology Licensing, Llc System for fast, probabilistic skeletal tracking
US8968091B2 (en) 2010-09-07 2015-03-03 Microsoft Technology Licensing, Llc Scalable real-time motion recognition
US8988508B2 (en) 2010-09-24 2015-03-24 Microsoft Technology Licensing, Llc. Wide angle field of view active illumination imaging system
US8983233B2 (en) 2010-10-04 2015-03-17 Microsoft Technology Licensing, Llc Time-of-flight depth imaging
US9484065B2 (en) 2010-10-15 2016-11-01 Microsoft Technology Licensing, Llc Intelligent determination of replays based on event identification
US9291449B2 (en) 2010-11-02 2016-03-22 Microsoft Technology Licensing, Llc Detection of configuration changes among optical elements of illumination system
US8866889B2 (en) 2010-11-03 2014-10-21 Microsoft Corporation In-home depth camera calibration
JP2012103938A (en) * 2010-11-11 2012-05-31 Seiko Epson Corp Optical detection system and program
US9349040B2 (en) 2010-11-19 2016-05-24 Microsoft Technology Licensing, Llc Bi-modal depth-image analysis
US8920241B2 (en) 2010-12-15 2014-12-30 Microsoft Corporation Gesture controlled persistent handles for interface guides
US9171264B2 (en) 2010-12-15 2015-10-27 Microsoft Technology Licensing, Llc Parallel processing machine learning decision tree training
US8884968B2 (en) 2010-12-15 2014-11-11 Microsoft Corporation Modeling an object from image data
US9821224B2 (en) 2010-12-21 2017-11-21 Microsoft Technology Licensing, Llc Driving simulator control with virtual skeleton
US8994718B2 (en) 2010-12-21 2015-03-31 Microsoft Technology Licensing, Llc Skeletal control of three-dimensional virtual world
US9848106B2 (en) 2010-12-21 2017-12-19 Microsoft Technology Licensing, Llc Intelligent gameplay photo capture
US9489053B2 (en) 2010-12-21 2016-11-08 Microsoft Technology Licensing, Llc Skeletal control of three-dimensional virtual world
US9823339B2 (en) 2010-12-21 2017-11-21 Microsoft Technology Licensing, Llc Plural anode time-of-flight sensor
US9529566B2 (en) 2010-12-27 2016-12-27 Microsoft Technology Licensing, Llc Interactive content creation
US9123316B2 (en) 2010-12-27 2015-09-01 Microsoft Technology Licensing, Llc Interactive content creation
US9247238B2 (en) 2011-01-31 2016-01-26 Microsoft Technology Licensing, Llc Reducing interference between multiple infra-red depth cameras
US9242171B2 (en) 2011-01-31 2016-01-26 Microsoft Technology Licensing, Llc Real-time camera tracking using depth maps
US10049458B2 (en) 2011-01-31 2018-08-14 Microsoft Technology Licensing, Llc Reducing interference between multiple infra-red depth cameras
US8942917B2 (en) 2011-02-14 2015-01-27 Microsoft Corporation Change invariant scene recognition by an agent
US9619561B2 (en) 2011-02-14 2017-04-11 Microsoft Technology Licensing, Llc Change invariant scene recognition by an agent
US9551914B2 (en) 2011-03-07 2017-01-24 Microsoft Technology Licensing, Llc Illuminator with refractive optical element
US9067136B2 (en) 2011-03-10 2015-06-30 Microsoft Technology Licensing, Llc Push personalization of interface controls
US9470778B2 (en) 2011-03-29 2016-10-18 Microsoft Technology Licensing, Llc Learning from high quality depth measurements
US9298287B2 (en) 2011-03-31 2016-03-29 Microsoft Technology Licensing, Llc Combined activation for natural user interface systems
US9539500B2 (en) 2011-04-05 2017-01-10 Microsoft Technology Licensing, Llc Biometric recognition
US9259643B2 (en) 2011-04-28 2016-02-16 Microsoft Technology Licensing, Llc Control of separate computer game elements
US8888331B2 (en) 2011-05-09 2014-11-18 Microsoft Corporation Low inductance light source module
US9137463B2 (en) 2011-05-12 2015-09-15 Microsoft Technology Licensing, Llc Adaptive high dynamic range camera
US9372544B2 (en) 2011-05-31 2016-06-21 Microsoft Technology Licensing, Llc Gesture recognition techniques
US9594430B2 (en) 2011-06-01 2017-03-14 Microsoft Technology Licensing, Llc Three-dimensional foreground selection for vision system
US8929612B2 (en) 2011-06-06 2015-01-06 Microsoft Corporation System for recognizing an open or closed hand
US9724600B2 (en) 2011-06-06 2017-08-08 Microsoft Technology Licensing, Llc Controlling objects in a virtual environment
US9208571B2 (en) 2011-06-06 2015-12-08 Microsoft Technology Licensing, Llc Object digitization
US9098110B2 (en) 2011-06-06 2015-08-04 Microsoft Technology Licensing, Llc Head rotation tracking from depth-based center of mass
US8897491B2 (en) 2011-06-06 2014-11-25 Microsoft Corporation System for finger recognition and tracking
US9953426B2 (en) 2011-06-06 2018-04-24 Microsoft Technology Licensing, Llc Object digitization
US9013489B2 (en) 2011-06-06 2015-04-21 Microsoft Technology Licensing, Llc Generation of avatar reflecting player appearance
US9597587B2 (en) 2011-06-08 2017-03-21 Microsoft Technology Licensing, Llc Locational node device
US9557836B2 (en) 2011-11-01 2017-01-31 Microsoft Technology Licensing, Llc Depth image compression
US9117281B2 (en) 2011-11-02 2015-08-25 Microsoft Corporation Surface segmentation from RGB and depth images
US8854426B2 (en) 2011-11-07 2014-10-07 Microsoft Corporation Time-of-flight camera with guided light
US9056254B2 (en) 2011-11-07 2015-06-16 Microsoft Technology Licensing, Llc Time-of-flight camera with guided light
US8929668B2 (en) 2011-11-29 2015-01-06 Microsoft Corporation Foreground subject detection
JP2013114647A (en) * 2011-12-01 2013-06-10 Exvision Inc Gesture input system
US9154837B2 (en) 2011-12-02 2015-10-06 Microsoft Technology Licensing, Llc User interface presenting an animated avatar performing a media reaction
US9100685B2 (en) 2011-12-09 2015-08-04 Microsoft Technology Licensing, Llc Determining audience state or interest using passive sensor data
US9628844B2 (en) 2011-12-09 2017-04-18 Microsoft Technology Licensing, Llc Determining audience state or interest using passive sensor data
US8971612B2 (en) 2011-12-15 2015-03-03 Microsoft Corporation Learning image processing tasks from scene reconstructions
US8879831B2 (en) 2011-12-15 2014-11-04 Microsoft Corporation Using high-level attributes to guide image processing
US9596643B2 (en) 2011-12-16 2017-03-14 Microsoft Technology Licensing, Llc Providing a user interface experience based on inferred vehicle state
US9342139B2 (en) 2011-12-19 2016-05-17 Microsoft Technology Licensing, Llc Pairing a computing device to a user
US9720089B2 (en) 2012-01-23 2017-08-01 Microsoft Technology Licensing, Llc 3D zoom imager
KR101330810B1 (en) * 2012-02-24 2013-11-18 주식회사 팬택 User device for recognizing gesture and method thereof
JP2013186500A (en) * 2012-03-05 2013-09-19 Toshiba Tec Corp Operation support display device and program
US8898687B2 (en) 2012-04-04 2014-11-25 Microsoft Corporation Controlling a media program based on a media reaction
JP2013222317A (en) * 2012-04-17 2013-10-28 Toshiba Mach Co Ltd Numerical control device
US9210401B2 (en) 2012-05-03 2015-12-08 Microsoft Technology Licensing, Llc Projected visual cues for guiding physical movement
US8959541B2 (en) 2012-05-04 2015-02-17 Microsoft Technology Licensing, Llc Determining a future portion of a currently presented media program
US9788032B2 (en) 2012-05-04 2017-10-10 Microsoft Technology Licensing, Llc Determining a future portion of a currently presented media program
US9001118B2 (en) 2012-06-21 2015-04-07 Microsoft Technology Licensing, Llc Avatar construction using depth camera
US10089454B2 (en) 2012-06-22 2018-10-02 Microsoft Technology Licensing, Llc Enhanced accuracy of user presence status determination
US9836590B2 (en) 2012-06-22 2017-12-05 Microsoft Technology Licensing, Llc Enhanced accuracy of user presence status determination
US9696427B2 (en) 2012-08-14 2017-07-04 Microsoft Technology Licensing, Llc Wide angle depth detection
US8882310B2 (en) 2012-12-10 2014-11-11 Microsoft Corporation Laser die light source module with low inductance
US9857470B2 (en) 2012-12-28 2018-01-02 Microsoft Technology Licensing, Llc Using photometric stereo for 3D environment modeling
US9251590B2 (en) 2013-01-24 2016-02-02 Microsoft Technology Licensing, Llc Camera pose estimation for 3D reconstruction
US9052746B2 (en) 2013-02-15 2015-06-09 Microsoft Technology Licensing, Llc User center-of-mass and mass distribution extraction using depth images
JP2014157352A (en) * 2013-02-18 2014-08-28 Samsung Electronics Co Ltd Display device
US9940553B2 (en) 2013-02-22 2018-04-10 Microsoft Technology Licensing, Llc Camera/object pose from predicted coordinates
US9135516B2 (en) 2013-03-08 2015-09-15 Microsoft Technology Licensing, Llc User body angle, curvature and average extremity positions extraction using depth images
US9959459B2 (en) 2013-03-08 2018-05-01 Microsoft Technology Licensing, Llc Extraction of user behavior from depth images
US9311560B2 (en) 2013-03-08 2016-04-12 Microsoft Technology Licensing, Llc Extraction of user behavior from depth images
US9092657B2 (en) 2013-03-13 2015-07-28 Microsoft Technology Licensing, Llc Depth image processing
US9824260B2 (en) 2013-03-13 2017-11-21 Microsoft Technology Licensing, Llc Depth image processing
US9274606B2 (en) 2013-03-14 2016-03-01 Microsoft Technology Licensing, Llc NUI video conference controls
US9787943B2 (en) 2013-03-14 2017-10-10 Microsoft Technology Licensing, Llc Natural user interface having video conference controls
US9953213B2 (en) 2013-03-27 2018-04-24 Microsoft Technology Licensing, Llc Self discovery of autonomous NUI devices
US9442186B2 (en) 2013-05-13 2016-09-13 Microsoft Technology Licensing, Llc Interference reduction for TOF systems
US9462253B2 (en) 2013-09-23 2016-10-04 Microsoft Technology Licensing, Llc Optical modules that reduce speckle contrast and diffraction artifacts
US10024968B2 (en) 2013-09-23 2018-07-17 Microsoft Technology Licensing, Llc Optical modules that reduce speckle contrast and diffraction artifacts
US9443310B2 (en) 2013-10-09 2016-09-13 Microsoft Technology Licensing, Llc Illumination modules that emit structured light
US9674563B2 (en) 2013-11-04 2017-06-06 Rovi Guides, Inc. Systems and methods for recommending content
US9769459B2 (en) 2013-11-12 2017-09-19 Microsoft Technology Licensing, Llc Power efficient laser diode driver circuit and method
US9508385B2 (en) 2013-11-21 2016-11-29 Microsoft Technology Licensing, Llc Audio-visual project generator
US9971491B2 (en) 2014-01-09 2018-05-15 Microsoft Technology Licensing, Llc Gesture library for natural user input
CN105278661A (en) * 2014-07-11 2016-01-27 胜华科技股份有限公司 Gesture control method with mouse tracking control and five-direction-key waving control
US10113868B2 (en) 2014-10-16 2018-10-30 Microsoft Technology Licensing, Llc Multiple synchronized optical sources for time-of-flight range finding systems

Similar Documents

Publication Publication Date Title
Kirstein et al. Interaction with a projection screen using a camera-tracked laser pointer
Zhang et al. Visual panel: virtual mouse, keyboard and 3D controller with an ordinary piece of paper
US6243491B1 (en) Methods and apparatus for controlling a video system with visually recognized props
US7168047B1 (en) Mouse having a button-less panning and scrolling switch
Koike et al. Integrating paper and digital information on EnhancedDesk: a method for realtime finger tracking on an augmented desk system
US5973689A (en) Cursor control with user feedback mechanism
US8086971B2 (en) Apparatus, methods and computer program products providing finger-based and hand-based gesture commands for portable electronic device applications
US6160899A (en) Method of application menu selection and activation using image cognition
US20050057524A1 (en) Gesture recognition method and touch system incorporating the same
US6654001B1 (en) Hand-movement-sensing input device
US20060190836A1 (en) Method and apparatus for data entry input
US5594469A (en) Hand gesture machine control system
Wellner Interacting with paper on the DigitalDesk
US7170492B2 (en) Interactive video display system
Sato et al. Fast tracking of hands and fingertips in infrared images for augmented desk interface
US20030174125A1 (en) Multiple input modes in overlapping physical space
US6765555B2 (en) Passive optical mouse using image sensor with optional dual mode capability
US6775014B2 (en) System and method for determining the location of a target in a room or small area
US20090103780A1 (en) Hand-Gesture Recognition Method
Malik et al. Visual touchpad: a two-handed gestural input device
US20120102438A1 (en) Display system and method of displaying based on device interactions
US6191773B1 (en) Interface apparatus
US20110216007A1 (en) Keyboards and methods thereof
US6831664B2 (en) Low cost interactive program control system and method
Cabral et al. On the usability of gesture interfaces in virtual reality environments