JPH0844490A - Interface device - Google Patents
Interface deviceInfo
- Publication number
- JPH0844490A JPH0844490A JP6176851A JP17685194A JPH0844490A JP H0844490 A JPH0844490 A JP H0844490A JP 6176851 A JP6176851 A JP 6176851A JP 17685194 A JP17685194 A JP 17685194A JP H0844490 A JPH0844490 A JP H0844490A
- Authority
- JP
- Japan
- Prior art keywords
- unit
- interface device
- display
- shape
- image pickup
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
Abstract
Description
【０００１】[0001]
【産業上の利用分野】本発明は、コンピュータやワード
プロセッサ等の情報機器や、テレビ等のディスプレイを
有する機器の入出力を行うインターフェイス装置に関す
る。BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an interface device for inputting / outputting information equipment such as a computer and a word processor, and equipment having a display such as a television.
【０００２】[0002]
【従来の技術】この種の従来のインターフェイス装置と
して、表示画面中のマウスによって検出した座標位置に
カーソルを表示し、画面中に表示した任意の操作ボタン
をユーザーに選択させるものがある。2. Description of the Related Art As a conventional interface device of this type, there is one which displays a cursor at a coordinate position detected by a mouse on a display screen and allows a user to select an arbitrary operation button displayed on the screen.
【０００３】図７はこの種の従来のインターフェイス装
置の概要を示すものである。図７において、71はディス
プレイで、ディスプレイ71中にはホストコンピュータ72
により、仮想の操作ボタン711、712、713が表示されて
いる。73はマウス、710はマウスカーソルで、マウス73
によって検出したマウス73の移動量に基づき、マウス73
の動きに同期して画面中を動くように、ホストコンピュ
ータ72が表示制御する。ユーザーは、マウス73を動かす
事により、表示画面中の任意の仮想操作ボタンの位置に
マウスカーソル710を移動させ、マウス73上のスイッチ7
31を押すことにより、操作ボタンを選択し、ホストコン
ピュータ72に動作の指示を与えられるようになってい
る。FIG. 7 shows an outline of a conventional interface device of this type. In FIG. 7, reference numeral 71 denotes a display, and in the display 71, a host computer 72
Thus, virtual operation buttons 711, 712, 713 are displayed. 73 is a mouse, 710 is a mouse cursor, mouse 73
Based on the amount of movement of mouse 73 detected by
The host computer 72 controls the display so that it moves in the screen in synchronization with the movement of the. The user moves the mouse 73 to move the mouse cursor 710 to the position of any virtual operation button on the display screen, and the switch 7 on the mouse 73 is moved.
By pressing 31, an operation button can be selected and an operation instruction can be given to the host computer 72.
【０００４】[0004]
【発明が解決しようとする課題】しかしながら上記従来
の装置においては、機器の本体とは別にマウスという入
力装置が必要で、又マウスを操作するテーブル等の基台
が必要であり、携帯情報機器等に用いる事は適さない。
又、マウスを介して操作を行なうため、必ずしも直接的
で分かりやすいインターフェイスにはなっていないとい
う課題を有していた。However, in the above-mentioned conventional device, an input device called a mouse is required in addition to the main body of the device, a base such as a table for operating the mouse is required, and portable information devices, etc. Is not suitable for use in.
Moreover, since the operation is performed via the mouse, there is a problem that the interface is not always direct and easy to understand.
【０００５】本発明はかかる点に鑑み、キーボードやマ
ウス等の入力装置を必要とせず、簡単に機器の操作が可
能なインターフェイス装置を提供することを目的とす
る。SUMMARY OF THE INVENTION In view of the above points, an object of the present invention is to provide an interface device that does not require an input device such as a keyboard or a mouse and can easily operate the device.
【０００６】[0006]
【課題を解決するための手段】本発明は上記目的を達成
するため、少なくとも撮像部と、前記撮像部で撮像した
画像中の物体の形状と動きまたは形状もしくは動きを認
識する動作認識部と、前記動作認識部によって認識した
物体の形状と動きまたは形状もしくは動きを表示する表
示部とを備えた構成である。In order to achieve the above object, the present invention provides at least an image pickup section, and a motion recognition section for recognizing the shape and movement of an object in an image picked up by the image pickup section or the shape or movement of the object. The configuration includes a shape and movement of the object recognized by the motion recognition section, and a display section that displays the shape or the movement.
【０００７】[0007]
【作用】以上のように構成した本発明のインターフェイ
ス装置の撮像部にユーザーが向い、例えば手振りによっ
て指示を与えると、与えた手振りが表示画面上に表示さ
れ、例えば表示画面上に表示した仮想スイッチ等を手振
りによって選択出来るものであり、マウス等の入力装置
を必要とせず、非常に簡便な機器の操作が可能となるも
のである。When the user turns to the image pickup unit of the interface device of the present invention configured as described above and gives an instruction by, for example, a hand gesture, the given hand gesture is displayed on the display screen. For example, the virtual switch displayed on the display screen. And the like can be selected by a hand gesture, and an extremely simple operation of the device is possible without requiring an input device such as a mouse.
【０００８】[0008]
【実施例】以下、本発明の実施例について、図面を参照
しながら説明する。図１は、本発明によるインターフェ
イス装置の実施例の外観を示したものである。Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 shows the appearance of an embodiment of an interface device according to the present invention.
【０００９】図１において、１はホストコンピュータ、
２は表示に用いるディスプレイ、３は画像を撮像するＣ
ＣＤカメラである。ＣＣＤカメラ３は、ディスプレイ２
の表示方向と同一方向に撮像面を配置してあり、ユーザ
ーが表示面に向かうことにより、ユーザーの手振りを撮
像できるようになっている。又、ＣＣＤカメラ３の撮像
面上には、図示しない肌色領域の波長の光透過フィルタ
を配置してあり、人間の顔や手等の画像のみがＣＣＤカ
メラ３によって撮像され、背景等の画像がカットされる
ようになっている。ディスプレイ２上には、仮想スイッ
チ201、202、203、及び前記仮想スイッチを選択する矢
印カーソル200が表示できるようになっている。In FIG. 1, 1 is a host computer,
2 is a display used for display, 3 is C for capturing an image
It is a CD camera. CCD camera 3 is display 2
The image pickup surface is arranged in the same direction as the display direction, and when the user faces the display surface, the hand gesture of the user can be picked up. Further, on the image pickup surface of the CCD camera 3, a light transmission filter having a wavelength in a skin color region (not shown) is arranged, and only the image of a human face or a hand is picked up by the CCD camera 3, and an image of the background or the like is obtained. It is designed to be cut. On the display 2, virtual switches 201, 202, 203 and an arrow cursor 200 for selecting the virtual switch can be displayed.
【００１０】図２は、本実施例の詳細なブロック図を示
すものである。図２において、ＣＣＤカメラ３から入力
された画像は、フレームメモリ21に蓄えられる。動作認
識部22は、フレームメモリ21の中に蓄えた画像中から、
例えば、ユーザーの手に相当する部分を抽出し、その形
状が、例えば図３(Ａ)に示すような、一本指の形状であ
るのか、又図３(Ｂ)に示すような握り拳の形状であるの
かを判断する。FIG. 2 is a detailed block diagram of this embodiment. In FIG. 2, the image input from the CCD camera 3 is stored in the frame memory 21. The motion recognition unit 22 selects from among the images stored in the frame memory 21,
For example, a portion corresponding to the user's hand is extracted, and the shape is, for example, the shape of a single finger as shown in FIG. 3 (A), or the shape of a clenched fist as shown in FIG. 3 (B). To determine if.
【００１１】図４は、動作認識部22の詳細な実施例を示
したもので、輪郭抽出部221と、物体抽出部222と、形状
変化識別部223と、位置検出部224とによって構成した例
を示したものである。FIG. 4 shows a detailed embodiment of the motion recognizing section 22, which is composed of a contour extracting section 221, an object extracting section 222, a shape change identifying section 223, and a position detecting section 224. Is shown.
【００１２】輪郭抽出部221は、画像中に存在する物体
の輪郭形状を抽出する。具体的な方法例としては、画像
を二値化し、そのエッジを抽出することにより、簡単に
輪郭形状が抽出できる。The contour extraction unit 221 extracts the contour shape of the object existing in the image. As a concrete example of the method, the contour shape can be easily extracted by binarizing the image and extracting the edges thereof.
【００１３】物体抽出部222は、輪郭抽出部221によって
抽出した複数の物体の輪郭形状中から、例えばユーザー
の手に相当する輪郭形状を抽出する。具体的方法の一例
としては、輪郭線で囲まれた閉領域の面積を判断させる
方法や、又、ニューラルネットワークを用いて手の部分
の輪郭形状を抽出する方法を用いることが出来る。The object extracting unit 222 extracts, for example, a contour shape corresponding to the hand of the user from the contour shapes of the plurality of objects extracted by the contour extracting unit 221. As an example of a specific method, a method of determining the area of a closed region surrounded by a contour line, or a method of extracting a contour shape of a hand part using a neural network can be used.
【００１４】形状変化識別部223は、物体抽出部222によ
って抽出した手の部分の輪郭形状を更に詳細に識別し、
例えばその形状が、図３(Ａ)に示すような、一本指の形
状であるのか、又図３(Ｂ)に示すような握り拳の形状で
あるのかを判断する。同時に位置検出部224は、前記ユ
ーザーの手の部分の輪郭形状の重心座標を演算する。ア
イコン生成部24は、形状変化識別部223による手の形状
の識別結果に基づいて、ディスプレイに表示すべきアイ
コン画像を生成する。例えば、手の形状の識別結果が一
本指の形状であれば、例えば図５(Ａ)に示すような矢印
のアイコンを、また握り拳の形状であれば、例えば図５
(Ｂ)に示すような、Ｘ印のアイコンを生成する。The shape change identifying section 223 identifies the contour shape of the hand extracted by the object extracting section 222 in more detail,
For example, it is determined whether the shape is the shape of a single finger as shown in FIG. 3 (A) or the shape of a clenched fist as shown in FIG. 3 (B). At the same time, the position detection unit 224 calculates the barycentric coordinates of the contour shape of the user's hand. The icon generation unit 24 generates an icon image to be displayed on the display based on the hand shape identification result by the shape change identification unit 223. For example, if the hand shape identification result is a one-finger shape, for example, an arrow icon as shown in FIG.
An icon with an X mark as shown in (B) is generated.
【００１５】表示制御部23は、アイコン生成部24によっ
て生成したアイコンのディスプレイ上での表示位置を制
御するもので、座標変換部231と座標反転部232から成
る。座標変換部231は、撮像した画像の座標からディス
プレイの表示座標への変換を行ない、また、座標反転部
232は、変換した表示座標の左右位置を反転する。即
ち、位置検出部224によって検出したユーザーの手に相
当する部分の画像中の重心座標から、ディスプレイの表
示座標への変換を行い、左右の座標を反転させてディス
プレイにアイコンを表示するわけである。この操作によ
り、ユーザーが手を右に動かせば、この動作を鏡に写し
たのと同様に、表示画面状でアイコンが向かって右に動
く。The display control unit 23 controls the display position of the icon generated by the icon generation unit 24 on the display, and includes a coordinate conversion unit 231 and a coordinate reversal unit 232. The coordinate conversion unit 231 converts the coordinates of the captured image to the display coordinates of the display, and the coordinate inversion unit 231.
232 inverts the horizontal position of the converted display coordinates. That is, the barycentric coordinates in the image of the portion corresponding to the user's hand detected by the position detection unit 224 are converted into the display coordinates on the display, and the left and right coordinates are reversed to display the icon on the display. . By this operation, when the user moves his or her hand to the right, the icon moves to the right on the display screen in the same manner as when this action is mirrored.
【００１６】以上の様に構成した本実施例による操作例
を以下に示す。図１に示すように、本実施例によるイン
ターフェイス装置を備えた機器にユーザーが向い、手を
一本指の形状にして動かすと、ディスプレイ上に表示し
た矢印カーソルのアイコン200が、手の動きに対応した
任意の位置に移動する。次に、ディスプレイ上に表示し
た任意の仮想スイッチの上に、手を動かすことによって
矢印カーソルのアイコン200を移動させ、手を握り、握
り拳形状にすると、その仮想スイッチが選択され、ホス
トコンピュータ１に指令を与えることができるわけであ
る。An operation example according to the present embodiment configured as described above will be shown below. As shown in FIG. 1, when a user faces a device equipped with the interface device according to the present embodiment and moves the device in the shape of one finger, the arrow cursor icon 200 displayed on the display changes to a hand motion. Move to any corresponding position. Next, by moving the hand over the virtual switch displayed on the display to move the arrow cursor icon 200, and grasping the hand to make a clenched fist shape, the virtual switch is selected and stored in the host computer 1. You can give orders.
【００１７】図６は、本発明によるインターフェイス装
置の動作認識部の他の実施例を示すものである。この実
施例では、動作認識部22を、輪郭抽出部221と形状変化
識別部223と、位置検出部224とによって構成した例であ
る。即ち、物体抽出部221の動作を形状変化識別部223に
よって一括して行なわせるものである。前述の実施例に
おいては、物体抽出部222によって、手の形状の物体を
一旦抽出し、更に形状変化識別部223によって、手の形
状の細かな違いを詳細に識別するものであった。手の形
状変化が、例えば、一本指と握り拳の２種類程度に限定
するのであれば、図５に示すように、形状変化識別部22
3によって、画像中の複数の物体中から、この２種類の
形状の何れかに相当する物体を識別、抽出させるだけで
充分実用に耐える。FIG. 6 shows another embodiment of the operation recognition unit of the interface device according to the present invention. This embodiment is an example in which the motion recognition unit 22 is configured by a contour extraction unit 221, a shape change identification unit 223, and a position detection unit 224. That is, the operation of the object extracting unit 221 is collectively performed by the shape change identifying unit 223. In the above-described embodiment, the object extracting unit 222 temporarily extracts the hand-shaped object, and the shape change identifying unit 223 further identifies the minute difference in the hand shape. If the shape change of the hand is limited to, for example, about two types, one finger and a clenched fist, as shown in FIG.
According to 3, by just identifying and extracting an object corresponding to one of these two types from the plurality of objects in the image, it is sufficiently practical.
【００１８】又、表示するアイコンの例としては、例え
ば図５(Ｃ)、(Ｄ)に示すように、手の形状そのものをア
イコン化すれば、実際の手の動きと対応が取れ、分かり
やすい。具体的には、図５(Ｃ)、(Ｄ)のような画像を予
め登録しておいてもよいし、又、輪郭抽出部221によっ
て抽出した手の輪郭形状データを任意の大きさに縮小又
は拡大し、アイコン画像として用いることもできる。As an example of the icon to be displayed, for example, as shown in FIGS. 5C and 5D, if the shape of the hand itself is made into an icon, it can be easily understood because it corresponds to the actual movement of the hand. . Specifically, the images shown in FIGS. 5C and 5D may be registered in advance, or the contour shape data of the hand extracted by the contour extraction unit 221 may be reduced to an arbitrary size. Alternatively, it can be enlarged and used as an icon image.
【００１９】[0019]
【発明の効果】以上のように本発明は、少なくとも撮像
部と、前記撮像部で撮像した画像中の物体の形状及び又
は動きを認識する動作認識部と、前記動作認識部によっ
て認識した物体の形状及び又は動きを表示する表示部と
によって構成され、この撮像部にユーザーが向い、例え
ば手振りによって指示を与えると、与えた手振りが表示
画面上に表示され、例えば表示画面上に表示した仮想ス
イッチ等を手振りによって選択でき、マウス等の入力装
置を必要とせず、非常に簡便な機器の操作が可能となる
ものである。As described above, according to the present invention, at least the image pickup section, the motion recognition section for recognizing the shape and / or the motion of the object in the image picked up by the image pickup section, and the object recognized by the motion recognition section A display unit that displays a shape and / or a movement, and when the user faces the image pickup unit and gives an instruction by, for example, a hand gesture, the given hand gesture is displayed on the display screen, for example, a virtual switch displayed on the display screen. And the like can be selected by a hand gesture, an input device such as a mouse is not required, and a very simple operation of the device is possible.
【図１】本発明の一実施例におけるインターフェイス装
置の外観図FIG. 1 is an external view of an interface device according to an embodiment of the present invention.
【図２】本発明の一実施例におけるインターフェイス装
置の詳細なブロック図FIG. 2 is a detailed block diagram of an interface device according to an embodiment of the present invention.
【図３】（Ａ），（Ｂ）は同インターフェイス装置によ
って判断する手の形状例を示す図3A and 3B are diagrams showing examples of the shape of a hand judged by the interface device.
【図４】同インターフェイス装置の動作認識部の詳細な
実施例を示すブロック図FIG. 4 is a block diagram showing a detailed embodiment of a motion recognition unit of the interface device.
【図５】（Ａ）〜（Ｄ）は同インターフェイス装置によ
って表示画面上に表示するアイコンの例を示す図5A to 5D are diagrams showing examples of icons displayed on a display screen by the interface device.
【図６】本発明によるインターフェイス装置の動作認識
部の他の詳細な実施例を示すブロック図FIG. 6 is a block diagram showing another detailed embodiment of the operation recognition unit of the interface device according to the present invention.
【図７】従来のマウスによるインターフェイス装置を示
す外観図FIG. 7 is an external view showing an interface device using a conventional mouse.
１ ホストコンピュータ ２ ディスプレイ ３ ＣＣＤカメラ 21 フレームメモリ 22 動作認識部 23 表示制御部 24 アイコン生成部 200 アイコン 201、202、203 仮想スイッチ 221 輪郭抽出部 222 物体抽出部 223 形状変化識別部 224 位置検出部 231 座標変換部 232 座標反転部 1 host computer 2 display 3 CCD camera 21 frame memory 22 operation recognition unit 23 display control unit 24 icon generation unit 200 icons 201, 202, 203 virtual switch 221 contour extraction unit 222 object extraction unit 223 shape change identification unit 224 position detection unit 231 Coordinate conversion unit 232 Coordinate inversion unit
───────────────────────────────────────────────────── フロントページの続き (72)発明者 森家 みち代 大阪府門真市大字門真1006番地 松下電器 産業株式会社内 ─────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Michiyo Moriya, 1006 Kadoma, Kadoma City, Osaka Prefecture Matsushita Electric Industrial Co., Ltd.
Claims (10)
た画像中の物体の形状及び又は動きを認識する動作認識
部と、前記動作認識部によって認識した物体の形状及び
又は動きを表示する表示部とによって構成したインター
フェイス装置。1. A display for displaying at least an imaging section, a motion recognition section for recognizing the shape and / or motion of an object in an image captured by the imaging section, and a shape and / or motion of the object recognized by the motion recognition section. An interface device composed of a part and a part.
像面を配置した請求項１記載のインターフェイス装置。2. The interface device according to claim 1, wherein the image pickup surface of the image pickup unit is arranged in the same direction as the display direction of the display unit.
請求項１記載のインターフェイス装置。3. The interface device according to claim 1, wherein the display unit is arranged so as to face the eyes of the user.
割当る表示制御部を設け、前記表示制御部により、前記
撮像部の撮像範囲を左右逆転させて前記表示部の表示範
囲に割当るようにした請求項１または２記載のインター
フェイス装置。4. A display control unit for allocating an image pickup range of the image pickup unit and a display range of the display unit is provided, and the image pickup range of the image pickup unit is reversed to the left and right by the display control unit. 3. The interface device according to claim 1, wherein the interface device is assigned.
示部の表示座標に変換する座標変換部と、前記変換した
表示座標の左右の座標を反転させる座標反転部とにより
構成した請求項４記載のインターフェイス装置。5. The display control unit comprises a coordinate conversion unit for converting the coordinates of a captured image into display coordinates of the display unit, and a coordinate reversal unit for reversing the left and right coordinates of the converted display coordinates. 4. The interface device according to 4.
び又は動きを、複数のアイコン画像として生成するアイ
コン生成部を設けた請求項１記載のインターフェイス装
置。6. The interface device according to claim 1, further comprising an icon generation unit that generates the shape and / or the motion of the object identified by the motion recognition unit as a plurality of icon images.
別した物体の概略形状をアイコン画像として生成する事
を特徴とした請求項６記載のインターフェイス装置。7. The interface device according to claim 6, wherein the icon generation unit generates a schematic shape of the object identified by the motion recognition unit as an icon image.
形状変化識別部と、前記物体の重心を検出する位置検出
部とによって動作認識部を構成した請求項１記載のイン
ターフェイス装置。8. The interface device according to claim 1, wherein the motion recognizing unit includes a shape change identifying unit that identifies a shape change of a predetermined object in the image, and a position detecting unit that detects a center of gravity of the object.
複数の物体中から所定の物体を予め抽出させた後、形状
変化識別部によって、前記物体抽出部によって抽出した
物体の形状変化を識別させるようにした請求項１または
７記載のインターフェイス装置。9. An object extracting section is provided in the object identifying section, a predetermined object is extracted in advance from a plurality of objects in an image, and the shape change identifying section then changes the shape of the object extracted by the object extracting section. The interface device according to claim 1 or 7, wherein the interface device is identified.
した、人間の肌色近傍の波長の光を透過する肌色透過フ
ィルタとによって撮像部を構成した請求項１記載のイン
ターフェイス装置。10. The interface device according to claim 1, wherein the image pickup section is composed of an image pickup element and a flesh color transmission filter which is arranged in front of the image pickup element and transmits light having a wavelength near a human flesh color.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP6176851A JPH0844490A (en) | 1994-07-28 | 1994-07-28 | Interface device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP6176851A JPH0844490A (en) | 1994-07-28 | 1994-07-28 | Interface device |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2003327809A Division JP2004078977A (en) | 2003-09-19 | 2003-09-19 | Interface device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| JPH0844490A true JPH0844490A (en) | 1996-02-16 |
Family
ID=16020947
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP6176851A Pending JPH0844490A (en) | 1994-07-28 | 1994-07-28 | Interface device |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JPH0844490A (en) |
Cited By (187)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH09185456A (en) * | 1995-04-28 | 1997-07-15 | Matsushita Electric Ind Co Ltd | Interface device |
| JPH1031551A (en) * | 1996-07-15 | 1998-02-03 | Mitsubishi Electric Corp | Human interface system and high-speed moving body position detecting device using the same |
| EP0823683A1 (en) * | 1995-04-28 | 1998-02-11 | Matsushita Electric Industrial Co., Ltd. | Interface device |
| JPH10207619A (en) * | 1997-01-22 | 1998-08-07 | Toshiba Corp | User interface device and operation range indicating method |
| US5990893A (en) * | 1996-09-13 | 1999-11-23 | Kabushiki Kaisha Toshiba | Data input device and method |
| JP2000181601A (en) * | 1998-12-18 | 2000-06-30 | Fujitsu General Ltd | Information display system |
| JP2001246161A (en) * | 1999-12-31 | 2001-09-11 | Square Co Ltd | Device and method for game using gesture recognizing technic and recording medium storing program to realize the method |
| KR20020037106A (en) * | 2000-11-13 | 2002-05-18 | 오희범 | System for three-dimensional sensing of the end portion of object including human body |
| JP2003223640A (en) * | 2002-01-29 | 2003-08-08 | Yokogawa Electric Corp | Object recognizing device |
| KR100404745B1 (en) * | 2001-07-10 | 2003-11-07 | 조두희 | image switch and method of controlling a product using therof |
| WO2003098420A1 (en) * | 2002-05-20 | 2003-11-27 | Tau Engineering, Inc. | Remote operation detection device, program, and recording medium |
| JP2005301479A (en) * | 2004-04-08 | 2005-10-27 | Akinori Yoshino | Instruction input device based on projected action of presenter |
| JP2006091948A (en) * | 2004-09-21 | 2006-04-06 | Victor Co Of Japan Ltd | Controller for electronic equipment |
| US7161596B2 (en) | 2001-12-21 | 2007-01-09 | British Telecommunications Public Limited Company | Display location calculation means |
| JP2007310914A (en) * | 2007-08-31 | 2007-11-29 | Nippon Telegr & Teleph Corp <Ntt> | Mouse alternating method, mouse alternating program and recording medium |
| WO2007135835A1 (en) * | 2006-05-19 | 2007-11-29 | Panasonic Corporation | Image operating device, image operating method and image operating program |
| JP2009003576A (en) * | 2007-06-19 | 2009-01-08 | Canon Inc | Appliance control device and control method |
| EP2040156A2 (en) | 2007-09-19 | 2009-03-25 | Sony Corporation | Image processing |
| JP2009141441A (en) * | 2007-12-03 | 2009-06-25 | Nec Corp | Character input-functional operation device, method, program, and portable terminal |
| JP2009188780A (en) * | 2008-02-07 | 2009-08-20 | Kuu-Kan Com Inc | Video direction system and video direction method |
| JP2010122735A (en) * | 2008-11-17 | 2010-06-03 | Toshiba Information Systems (Japan) Corp | Interface apparatus and interfacing program |
| US20100199221A1 (en) * | 2009-01-30 | 2010-08-05 | Microsoft Corporation | Navigation of a virtual plane using depth |
| JP2010176510A (en) * | 2009-01-30 | 2010-08-12 | Sanyo Electric Co Ltd | Information display device |
| US7978907B2 (en) | 2005-10-26 | 2011-07-12 | Fuji Xerox, Co., Ltd. | Image analyzer |
| WO2011148607A1 (en) * | 2010-05-28 | 2011-12-01 | パナソニック株式会社 | Gesture recognition device and gesture recognition method |
| US8099460B2 (en) | 2004-07-27 | 2012-01-17 | Sony Corporation | Information processing device and method, recording medium, and program |
| JP2012103938A (en) * | 2010-11-11 | 2012-05-31 | Seiko Epson Corp | Optical detection system and program |
| JP2013114647A (en) * | 2011-12-01 | 2013-06-10 | Exvision Inc | Gesture input system |
| JP2013186500A (en) * | 2012-03-05 | 2013-09-19 | Toshiba Tec Corp | Operation support display device and program |
| JP2013222317A (en) * | 2012-04-17 | 2013-10-28 | Toshiba Mach Co Ltd | Numerical control device |
| KR101330810B1 (en) * | 2012-02-24 | 2013-11-18 | 주식회사 팬택 | User device for recognizing gesture and method thereof |
| TWI421728B (en) * | 2011-03-07 | 2014-01-01 | Avermedia Information Inc | Document camera and associated method of object sensing control |
| US8638985B2 (en) | 2009-05-01 | 2014-01-28 | Microsoft Corporation | Human body pose estimation |
| US8693724B2 (en) | 2009-05-29 | 2014-04-08 | Microsoft Corporation | Method and system implementing user-centric gesture control |
| JP2014157352A (en) * | 2013-02-18 | 2014-08-28 | Samsung Electronics Co Ltd | Display device |
| US8843857B2 (en) | 2009-11-19 | 2014-09-23 | Microsoft Corporation | Distance scalable no touch computing |
| US8854426B2 (en) | 2011-11-07 | 2014-10-07 | Microsoft Corporation | Time-of-flight camera with guided light |
| US8856691B2 (en) | 2009-05-29 | 2014-10-07 | Microsoft Corporation | Gesture tool |
| US8861839B2 (en) | 2009-10-07 | 2014-10-14 | Microsoft Corporation | Human tracking system |
| US8860663B2 (en) | 2009-01-30 | 2014-10-14 | Microsoft Corporation | Pose tracking pipeline |
| US8867820B2 (en) | 2009-10-07 | 2014-10-21 | Microsoft Corporation | Systems and methods for removing a background of an image |
| US8869072B2 (en) | 2009-01-30 | 2014-10-21 | Microsoft Corporation | Gesture recognizer system architecture |
| US8866889B2 (en) | 2010-11-03 | 2014-10-21 | Microsoft Corporation | In-home depth camera calibration |
| US8864581B2 (en) | 2010-01-29 | 2014-10-21 | Microsoft Corporation | Visual based identitiy tracking |
| US8879831B2 (en) | 2011-12-15 | 2014-11-04 | Microsoft Corporation | Using high-level attributes to guide image processing |
| US8885890B2 (en) | 2010-05-07 | 2014-11-11 | Microsoft Corporation | Depth map confidence filtering |
| US8882310B2 (en) | 2012-12-10 | 2014-11-11 | Microsoft Corporation | Laser die light source module with low inductance |
| US8884968B2 (en) | 2010-12-15 | 2014-11-11 | Microsoft Corporation | Modeling an object from image data |
| US8891067B2 (en) | 2010-02-01 | 2014-11-18 | Microsoft Corporation | Multiple synchronized optical sources for time-of-flight range finding systems |
| US8891827B2 (en) | 2009-10-07 | 2014-11-18 | Microsoft Corporation | Systems and methods for tracking a model |
| US8888331B2 (en) | 2011-05-09 | 2014-11-18 | Microsoft Corporation | Low inductance light source module |
| US8897491B2 (en) | 2011-06-06 | 2014-11-25 | Microsoft Corporation | System for finger recognition and tracking |
| US8898687B2 (en) | 2012-04-04 | 2014-11-25 | Microsoft Corporation | Controlling a media program based on a media reaction |
| US8896721B2 (en) | 2009-05-29 | 2014-11-25 | Microsoft Corporation | Environment and/or target segmentation |
| US8897493B2 (en) | 2009-01-30 | 2014-11-25 | Microsoft Corporation | Body scan |
| US8908091B2 (en) | 2009-09-21 | 2014-12-09 | Microsoft Corporation | Alignment of lens and image sensor |
| US8917240B2 (en) | 2009-06-01 | 2014-12-23 | Microsoft Corporation | Virtual desktop coordinate transformation |
| US8920241B2 (en) | 2010-12-15 | 2014-12-30 | Microsoft Corporation | Gesture controlled persistent handles for interface guides |
| US8928579B2 (en) | 2010-02-22 | 2015-01-06 | Andrew David Wilson | Interacting with an omni-directionally projected display |
| US8929612B2 (en) | 2011-06-06 | 2015-01-06 | Microsoft Corporation | System for recognizing an open or closed hand |
| US8929668B2 (en) | 2011-11-29 | 2015-01-06 | Microsoft Corporation | Foreground subject detection |
| US8933884B2 (en) | 2010-01-15 | 2015-01-13 | Microsoft Corporation | Tracking groups of users in motion capture system |
| US8942917B2 (en) | 2011-02-14 | 2015-01-27 | Microsoft Corporation | Change invariant scene recognition by an agent |
| US8942428B2 (en) | 2009-05-01 | 2015-01-27 | Microsoft Corporation | Isolate extraneous motions |
| US8953844B2 (en) | 2010-09-07 | 2015-02-10 | Microsoft Technology Licensing, Llc | System for fast, probabilistic skeletal tracking |
| US8959541B2 (en) | 2012-05-04 | 2015-02-17 | Microsoft Technology Licensing, Llc | Determining a future portion of a currently presented media program |
| US8963829B2 (en) | 2009-10-07 | 2015-02-24 | Microsoft Corporation | Methods and systems for determining and tracking extremities of a target |
| US8971612B2 (en) | 2011-12-15 | 2015-03-03 | Microsoft Corporation | Learning image processing tasks from scene reconstructions |
| US8968091B2 (en) | 2010-09-07 | 2015-03-03 | Microsoft Technology Licensing, Llc | Scalable real-time motion recognition |
| US8976986B2 (en) | 2009-09-21 | 2015-03-10 | Microsoft Technology Licensing, Llc | Volume adjustment based on listener position |
| US8983233B2 (en) | 2010-10-04 | 2015-03-17 | Microsoft Technology Licensing, Llc | Time-of-flight depth imaging |
| US8982151B2 (en) | 2010-06-14 | 2015-03-17 | Microsoft Technology Licensing, Llc | Independently processing planes of display data |
| US8988432B2 (en) | 2009-11-05 | 2015-03-24 | Microsoft Technology Licensing, Llc | Systems and methods for processing an image for target tracking |
| US8988508B2 (en) | 2010-09-24 | 2015-03-24 | Microsoft Technology Licensing, Llc. | Wide angle field of view active illumination imaging system |
| US8988437B2 (en) | 2009-03-20 | 2015-03-24 | Microsoft Technology Licensing, Llc | Chaining animations |
| US8994718B2 (en) | 2010-12-21 | 2015-03-31 | Microsoft Technology Licensing, Llc | Skeletal control of three-dimensional virtual world |
| US9001118B2 (en) | 2012-06-21 | 2015-04-07 | Microsoft Technology Licensing, Llc | Avatar construction using depth camera |
| US9008355B2 (en) | 2010-06-04 | 2015-04-14 | Microsoft Technology Licensing, Llc | Automatic depth camera aiming |
| US9015638B2 (en) | 2009-05-01 | 2015-04-21 | Microsoft Technology Licensing, Llc | Binding users to a gesture based system and providing feedback to the users |
| US9013489B2 (en) | 2011-06-06 | 2015-04-21 | Microsoft Technology Licensing, Llc | Generation of avatar reflecting player appearance |
| US9019201B2 (en) | 2010-01-08 | 2015-04-28 | Microsoft Technology Licensing, Llc | Evolving universal gesture sets |
| US9031103B2 (en) | 2010-03-31 | 2015-05-12 | Microsoft Technology Licensing, Llc | Temperature measurement and control for laser and light-emitting diodes |
| US9039528B2 (en) | 2009-01-30 | 2015-05-26 | Microsoft Technology Licensing, Llc | Visual target tracking |
| US9052746B2 (en) | 2013-02-15 | 2015-06-09 | Microsoft Technology Licensing, Llc | User center-of-mass and mass distribution extraction using depth images |
| US9054764B2 (en) | 2007-05-17 | 2015-06-09 | Microsoft Technology Licensing, Llc | Sensor array beamformer post-processor |
| US9052382B2 (en) | 2008-06-30 | 2015-06-09 | Microsoft Technology Licensing, Llc | System architecture design for time-of-flight system having reduced differential pixel size, and time-of-flight systems so designed |
| US9063001B2 (en) | 2009-09-14 | 2015-06-23 | Microsoft Technology Licensing, Llc | Optical fault monitoring |
| US9067136B2 (en) | 2011-03-10 | 2015-06-30 | Microsoft Technology Licensing, Llc | Push personalization of interface controls |
| US9069381B2 (en) | 2010-03-12 | 2015-06-30 | Microsoft Technology Licensing, Llc | Interacting with a computer based application |
| US9075434B2 (en) | 2010-08-20 | 2015-07-07 | Microsoft Technology Licensing, Llc | Translating user motion into multiple object responses |
| US9092657B2 (en) | 2013-03-13 | 2015-07-28 | Microsoft Technology Licensing, Llc | Depth image processing |
| US9098493B2 (en) | 2010-06-04 | 2015-08-04 | Microsoft Technology Licensing, Llc | Machine based sign language interpreter |
| US9100685B2 (en) | 2011-12-09 | 2015-08-04 | Microsoft Technology Licensing, Llc | Determining audience state or interest using passive sensor data |
| US9098110B2 (en) | 2011-06-06 | 2015-08-04 | Microsoft Technology Licensing, Llc | Head rotation tracking from depth-based center of mass |
| US9098873B2 (en) | 2010-04-01 | 2015-08-04 | Microsoft Technology Licensing, Llc | Motion-based interactive shopping environment |
| US9117281B2 (en) | 2011-11-02 | 2015-08-25 | Microsoft Corporation | Surface segmentation from RGB and depth images |
| US9123316B2 (en) | 2010-12-27 | 2015-09-01 | Microsoft Technology Licensing, Llc | Interactive content creation |
| US9135516B2 (en) | 2013-03-08 | 2015-09-15 | Microsoft Technology Licensing, Llc | User body angle, curvature and average extremity positions extraction using depth images |
| US9137463B2 (en) | 2011-05-12 | 2015-09-15 | Microsoft Technology Licensing, Llc | Adaptive high dynamic range camera |
| US9141193B2 (en) | 2009-08-31 | 2015-09-22 | Microsoft Technology Licensing, Llc | Techniques for using human gestures to control gesture unaware programs |
| US9147253B2 (en) | 2010-03-17 | 2015-09-29 | Microsoft Technology Licensing, Llc | Raster scanning for depth detection |
| US9154837B2 (en) | 2011-12-02 | 2015-10-06 | Microsoft Technology Licensing, Llc | User interface presenting an animated avatar performing a media reaction |
| US9159151B2 (en) | 2009-07-13 | 2015-10-13 | Microsoft Technology Licensing, Llc | Bringing a visual representation to life via learned input from the user |
| US9171264B2 (en) | 2010-12-15 | 2015-10-27 | Microsoft Technology Licensing, Llc | Parallel processing machine learning decision tree training |
| US9182814B2 (en) | 2009-05-29 | 2015-11-10 | Microsoft Technology Licensing, Llc | Systems and methods for estimating a non-visible or occluded body part |
| US9191570B2 (en) | 2009-05-01 | 2015-11-17 | Microsoft Technology Licensing, Llc | Systems and methods for detecting a tilt angle from a depth image |
| US9195305B2 (en) | 2010-01-15 | 2015-11-24 | Microsoft Technology Licensing, Llc | Recognizing user intent in motion capture system |
| US9210401B2 (en) | 2012-05-03 | 2015-12-08 | Microsoft Technology Licensing, Llc | Projected visual cues for guiding physical movement |
| US9208571B2 (en) | 2011-06-06 | 2015-12-08 | Microsoft Technology Licensing, Llc | Object digitization |
| US9215478B2 (en) | 2009-05-29 | 2015-12-15 | Microsoft Technology Licensing, Llc | Protocol and format for communicating an image from a camera to a computing environment |
| US9244533B2 (en) | 2009-12-17 | 2016-01-26 | Microsoft Technology Licensing, Llc | Camera navigation for presentations |
| US9247238B2 (en) | 2011-01-31 | 2016-01-26 | Microsoft Technology Licensing, Llc | Reducing interference between multiple infra-red depth cameras |
| US9242171B2 (en) | 2011-01-31 | 2016-01-26 | Microsoft Technology Licensing, Llc | Real-time camera tracking using depth maps |
| CN105278661A (en) * | 2014-07-11 | 2016-01-27 | 胜华科技股份有限公司 | Gesture control method with mouse tracking control and five-direction-key waving control |
| US9251590B2 (en) | 2013-01-24 | 2016-02-02 | Microsoft Technology Licensing, Llc | Camera pose estimation for 3D reconstruction |
| US9256282B2 (en) | 2009-03-20 | 2016-02-09 | Microsoft Technology Licensing, Llc | Virtual object manipulation |
| US9264807B2 (en) | 2008-06-19 | 2016-02-16 | Microsoft Technology Licensing, Llc | Multichannel acoustic echo reduction |
| US9262673B2 (en) | 2009-05-01 | 2016-02-16 | Microsoft Technology Licensing, Llc | Human body pose estimation |
| US9259643B2 (en) | 2011-04-28 | 2016-02-16 | Microsoft Technology Licensing, Llc | Control of separate computer game elements |
| US9268404B2 (en) | 2010-01-08 | 2016-02-23 | Microsoft Technology Licensing, Llc | Application gesture interpretation |
| US9274606B2 (en) | 2013-03-14 | 2016-03-01 | Microsoft Technology Licensing, Llc | NUI video conference controls |
| US9274747B2 (en) | 2010-06-21 | 2016-03-01 | Microsoft Technology Licensing, Llc | Natural user input for driving interactive stories |
| US9292083B2 (en) | 2010-06-11 | 2016-03-22 | Microsoft Technology Licensing, Llc | Interacting with user interface via avatar |
| US9291449B2 (en) | 2010-11-02 | 2016-03-22 | Microsoft Technology Licensing, Llc | Detection of configuration changes among optical elements of illumination system |
| US9298287B2 (en) | 2011-03-31 | 2016-03-29 | Microsoft Technology Licensing, Llc | Combined activation for natural user interface systems |
| US9298263B2 (en) | 2009-05-01 | 2016-03-29 | Microsoft Technology Licensing, Llc | Show body position |
| US9313376B1 (en) | 2009-04-01 | 2016-04-12 | Microsoft Technology Licensing, Llc | Dynamic depth power equalization |
| US9342139B2 (en) | 2011-12-19 | 2016-05-17 | Microsoft Technology Licensing, Llc | Pairing a computing device to a user |
| US9349040B2 (en) | 2010-11-19 | 2016-05-24 | Microsoft Technology Licensing, Llc | Bi-modal depth-image analysis |
| US9372544B2 (en) | 2011-05-31 | 2016-06-21 | Microsoft Technology Licensing, Llc | Gesture recognition techniques |
| US9384329B2 (en) | 2010-06-11 | 2016-07-05 | Microsoft Technology Licensing, Llc | Caloric burn determination from body movement |
| US9383823B2 (en) | 2009-05-29 | 2016-07-05 | Microsoft Technology Licensing, Llc | Combining gestures beyond skeletal |
| US9400559B2 (en) | 2009-05-29 | 2016-07-26 | Microsoft Technology Licensing, Llc | Gesture shortcuts |
| US9400548B2 (en) | 2009-10-19 | 2016-07-26 | Microsoft Technology Licensing, Llc | Gesture personalization and profile roaming |
| US9442186B2 (en) | 2013-05-13 | 2016-09-13 | Microsoft Technology Licensing, Llc | Interference reduction for TOF systems |
| US9443310B2 (en) | 2013-10-09 | 2016-09-13 | Microsoft Technology Licensing, Llc | Illumination modules that emit structured light |
| US9454244B2 (en) | 2002-02-07 | 2016-09-27 | Microsoft Technology Licensing, Llc | Recognizing a movement of a pointing device |
| US9462253B2 (en) | 2013-09-23 | 2016-10-04 | Microsoft Technology Licensing, Llc | Optical modules that reduce speckle contrast and diffraction artifacts |
| US9468848B2 (en) | 2010-01-08 | 2016-10-18 | Microsoft Technology Licensing, Llc | Assigning gesture dictionaries |
| US9470778B2 (en) | 2011-03-29 | 2016-10-18 | Microsoft Technology Licensing, Llc | Learning from high quality depth measurements |
| US9484065B2 (en) | 2010-10-15 | 2016-11-01 | Microsoft Technology Licensing, Llc | Intelligent determination of replays based on event identification |
| US9491226B2 (en) | 2010-06-02 | 2016-11-08 | Microsoft Technology Licensing, Llc | Recognition system for sharing information |
| US9498718B2 (en) | 2009-05-01 | 2016-11-22 | Microsoft Technology Licensing, Llc | Altering a view perspective within a display environment |
| US9508385B2 (en) | 2013-11-21 | 2016-11-29 | Microsoft Technology Licensing, Llc | Audio-visual project generator |
| US9519989B2 (en) | 2009-07-09 | 2016-12-13 | Microsoft Technology Licensing, Llc | Visual representation expression based on player expression |
| US9524024B2 (en) | 2009-05-01 | 2016-12-20 | Microsoft Technology Licensing, Llc | Method to control perspective for a camera-controlled computer |
| US9539500B2 (en) | 2011-04-05 | 2017-01-10 | Microsoft Technology Licensing, Llc | Biometric recognition |
| US9551914B2 (en) | 2011-03-07 | 2017-01-24 | Microsoft Technology Licensing, Llc | Illuminator with refractive optical element |
| US9557574B2 (en) | 2010-06-08 | 2017-01-31 | Microsoft Technology Licensing, Llc | Depth illumination and detection optics |
| US9557836B2 (en) | 2011-11-01 | 2017-01-31 | Microsoft Technology Licensing, Llc | Depth image compression |
| US9596643B2 (en) | 2011-12-16 | 2017-03-14 | Microsoft Technology Licensing, Llc | Providing a user interface experience based on inferred vehicle state |
| US9594430B2 (en) | 2011-06-01 | 2017-03-14 | Microsoft Technology Licensing, Llc | Three-dimensional foreground selection for vision system |
| US9597587B2 (en) | 2011-06-08 | 2017-03-21 | Microsoft Technology Licensing, Llc | Locational node device |
| US9641825B2 (en) | 2009-01-04 | 2017-05-02 | Microsoft International Holdings B.V. | Gated 3D camera |
| US9646340B2 (en) | 2010-04-01 | 2017-05-09 | Microsoft Technology Licensing, Llc | Avatar-based virtual dressing room |
| US9652042B2 (en) | 2003-03-25 | 2017-05-16 | Microsoft Technology Licensing, Llc | Architecture for controlling a computer using hand gestures |
| US9656162B2 (en) | 2009-05-29 | 2017-05-23 | Microsoft Technology Licensing, Llc | Device for identifying and tracking multiple humans over time |
| US9674563B2 (en) | 2013-11-04 | 2017-06-06 | Rovi Guides, Inc. | Systems and methods for recommending content |
| US9696427B2 (en) | 2012-08-14 | 2017-07-04 | Microsoft Technology Licensing, Llc | Wide angle depth detection |
| US9720089B2 (en) | 2012-01-23 | 2017-08-01 | Microsoft Technology Licensing, Llc | 3D zoom imager |
| US9724600B2 (en) | 2011-06-06 | 2017-08-08 | Microsoft Technology Licensing, Llc | Controlling objects in a virtual environment |
| US9769459B2 (en) | 2013-11-12 | 2017-09-19 | Microsoft Technology Licensing, Llc | Power efficient laser diode driver circuit and method |
| US9821224B2 (en) | 2010-12-21 | 2017-11-21 | Microsoft Technology Licensing, Llc | Driving simulator control with virtual skeleton |
| US9823339B2 (en) | 2010-12-21 | 2017-11-21 | Microsoft Technology Licensing, Llc | Plural anode time-of-flight sensor |
| US9836590B2 (en) | 2012-06-22 | 2017-12-05 | Microsoft Technology Licensing, Llc | Enhanced accuracy of user presence status determination |
| US9842405B2 (en) | 2009-01-30 | 2017-12-12 | Microsoft Technology Licensing, Llc | Visual target tracking |
| US9848106B2 (en) | 2010-12-21 | 2017-12-19 | Microsoft Technology Licensing, Llc | Intelligent gameplay photo capture |
| US9857470B2 (en) | 2012-12-28 | 2018-01-02 | Microsoft Technology Licensing, Llc | Using photometric stereo for 3D environment modeling |
| US9898675B2 (en) | 2009-05-01 | 2018-02-20 | Microsoft Technology Licensing, Llc | User movement tracking feedback to improve tracking |
| US9940553B2 (en) | 2013-02-22 | 2018-04-10 | Microsoft Technology Licensing, Llc | Camera/object pose from predicted coordinates |
| US9953213B2 (en) | 2013-03-27 | 2018-04-24 | Microsoft Technology Licensing, Llc | Self discovery of autonomous NUI devices |
| US9971491B2 (en) | 2014-01-09 | 2018-05-15 | Microsoft Technology Licensing, Llc | Gesture library for natural user input |
| US10085072B2 (en) | 2009-09-23 | 2018-09-25 | Rovi Guides, Inc. | Systems and methods for automatically detecting users within detection regions of media devices |
| US10234545B2 (en) | 2010-12-01 | 2019-03-19 | Microsoft Technology Licensing, Llc | Light source module |
| US10257932B2 (en) | 2016-02-16 | 2019-04-09 | Microsoft Technology Licensing, Llc. | Laser diode chip on printed circuit board |
| US10296587B2 (en) | 2011-03-31 | 2019-05-21 | Microsoft Technology Licensing, Llc | Augmented conversational understanding agent to identify conversation context between two humans and taking an agent action thereof |
| US10412280B2 (en) | 2016-02-10 | 2019-09-10 | Microsoft Technology Licensing, Llc | Camera with light valve over sensor array |
| US10462452B2 (en) | 2016-03-16 | 2019-10-29 | Microsoft Technology Licensing, Llc | Synchronizing active illumination cameras |
| US10534438B2 (en) | 2010-06-18 | 2020-01-14 | Microsoft Technology Licensing, Llc | Compound gesture-speech commands |
| US10551930B2 (en) | 2003-03-25 | 2020-02-04 | Microsoft Technology Licensing, Llc | System and method for executing a process using accelerometer signals |
| US10585957B2 (en) | 2011-03-31 | 2020-03-10 | Microsoft Technology Licensing, Llc | Task driven user intents |
| US10642934B2 (en) | 2011-03-31 | 2020-05-05 | Microsoft Technology Licensing, Llc | Augmented conversational understanding architecture |
| US10671841B2 (en) | 2011-05-02 | 2020-06-02 | Microsoft Technology Licensing, Llc | Attribute state classification |
| US10726861B2 (en) | 2010-11-15 | 2020-07-28 | Microsoft Technology Licensing, Llc | Semi-private communication in open environments |
| US10796494B2 (en) | 2011-06-06 | 2020-10-06 | Microsoft Technology Licensing, Llc | Adding attributes to virtual representations of real-world objects |
| US10878009B2 (en) | 2012-08-23 | 2020-12-29 | Microsoft Technology Licensing, Llc | Translating natural language utterances to keyword search queries |
| CN114578951A (en) * | 2014-03-14 | 2022-06-03 | 三星电子株式会社 | Display device and control method thereof |
-
1994
- 1994-07-28 JP JP6176851A patent/JPH0844490A/en active Pending
Cited By (247)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0823683A1 (en) * | 1995-04-28 | 1998-02-11 | Matsushita Electric Industrial Co., Ltd. | Interface device |
| EP0823683A4 (en) * | 1995-04-28 | 2000-12-06 | Matsushita Electric Ind Co Ltd | Interface device |
| JPH09185456A (en) * | 1995-04-28 | 1997-07-15 | Matsushita Electric Ind Co Ltd | Interface device |
| JPH1031551A (en) * | 1996-07-15 | 1998-02-03 | Mitsubishi Electric Corp | Human interface system and high-speed moving body position detecting device using the same |
| US5990893A (en) * | 1996-09-13 | 1999-11-23 | Kabushiki Kaisha Toshiba | Data input device and method |
| JPH10207619A (en) * | 1997-01-22 | 1998-08-07 | Toshiba Corp | User interface device and operation range indicating method |
| JP2000181601A (en) * | 1998-12-18 | 2000-06-30 | Fujitsu General Ltd | Information display system |
| JP2001246161A (en) * | 1999-12-31 | 2001-09-11 | Square Co Ltd | Device and method for game using gesture recognizing technic and recording medium storing program to realize the method |
| KR20020037106A (en) * | 2000-11-13 | 2002-05-18 | 오희범 | System for three-dimensional sensing of the end portion of object including human body |
| KR100404745B1 (en) * | 2001-07-10 | 2003-11-07 | 조두희 | image switch and method of controlling a product using therof |
| US7161596B2 (en) | 2001-12-21 | 2007-01-09 | British Telecommunications Public Limited Company | Display location calculation means |
| JP2003223640A (en) * | 2002-01-29 | 2003-08-08 | Yokogawa Electric Corp | Object recognizing device |
| US9454244B2 (en) | 2002-02-07 | 2016-09-27 | Microsoft Technology Licensing, Llc | Recognizing a movement of a pointing device |
| US10331228B2 (en) | 2002-02-07 | 2019-06-25 | Microsoft Technology Licensing, Llc | System and method for determining 3D orientation of a pointing device |
| US10488950B2 (en) | 2002-02-07 | 2019-11-26 | Microsoft Technology Licensing, Llc | Manipulating an object utilizing a pointing device |
| WO2003098420A1 (en) * | 2002-05-20 | 2003-11-27 | Tau Engineering, Inc. | Remote operation detection device, program, and recording medium |
| US10551930B2 (en) | 2003-03-25 | 2020-02-04 | Microsoft Technology Licensing, Llc | System and method for executing a process using accelerometer signals |
| US9652042B2 (en) | 2003-03-25 | 2017-05-16 | Microsoft Technology Licensing, Llc | Architecture for controlling a computer using hand gestures |
| JP2005301479A (en) * | 2004-04-08 | 2005-10-27 | Akinori Yoshino | Instruction input device based on projected action of presenter |
| US20120110081A1 (en) * | 2004-07-27 | 2012-05-03 | Sony Corporation | Information processing device and method, recording medium, and program |
| US8099460B2 (en) | 2004-07-27 | 2012-01-17 | Sony Corporation | Information processing device and method, recording medium, and program |
| US8856231B2 (en) * | 2004-07-27 | 2014-10-07 | Sony Corporation | Information processing device and method, recording medium, and program |
| JP2006091948A (en) * | 2004-09-21 | 2006-04-06 | Victor Co Of Japan Ltd | Controller for electronic equipment |
| US7629959B2 (en) | 2004-09-21 | 2009-12-08 | Victor Company Of Japan, Limited | Controller for electronic appliance |
| US7978907B2 (en) | 2005-10-26 | 2011-07-12 | Fuji Xerox, Co., Ltd. | Image analyzer |
| JPWO2007135835A1 (en) * | 2006-05-19 | 2009-10-01 | パナソニック株式会社 | Image operation device, image operation method, and image operation program |
| WO2007135835A1 (en) * | 2006-05-19 | 2007-11-29 | Panasonic Corporation | Image operating device, image operating method and image operating program |
| US8089457B2 (en) | 2006-05-19 | 2012-01-03 | Panasonic Corporation | Image operating device, image operating method, and image operating program embodied on computer readable medium |
| US9054764B2 (en) | 2007-05-17 | 2015-06-09 | Microsoft Technology Licensing, Llc | Sensor array beamformer post-processor |
| JP2009003576A (en) * | 2007-06-19 | 2009-01-08 | Canon Inc | Appliance control device and control method |
| JP2007310914A (en) * | 2007-08-31 | 2007-11-29 | Nippon Telegr & Teleph Corp <Ntt> | Mouse alternating method, mouse alternating program and recording medium |
| EP2040156A2 (en) | 2007-09-19 | 2009-03-25 | Sony Corporation | Image processing |
| US8896535B2 (en) | 2007-09-19 | 2014-11-25 | Sony Corporation | Image processing apparatus and method, and program therefor |
| US8643598B2 (en) | 2007-09-19 | 2014-02-04 | Sony Corporation | Image processing apparatus and method, and program therefor |
| JP2009141441A (en) * | 2007-12-03 | 2009-06-25 | Nec Corp | Character input-functional operation device, method, program, and portable terminal |
| JP2009188780A (en) * | 2008-02-07 | 2009-08-20 | Kuu-Kan Com Inc | Video direction system and video direction method |
| US9264807B2 (en) | 2008-06-19 | 2016-02-16 | Microsoft Technology Licensing, Llc | Multichannel acoustic echo reduction |
| US9052382B2 (en) | 2008-06-30 | 2015-06-09 | Microsoft Technology Licensing, Llc | System architecture design for time-of-flight system having reduced differential pixel size, and time-of-flight systems so designed |
| JP2010122735A (en) * | 2008-11-17 | 2010-06-03 | Toshiba Information Systems (Japan) Corp | Interface apparatus and interfacing program |
| US9641825B2 (en) | 2009-01-04 | 2017-05-02 | Microsoft International Holdings B.V. | Gated 3D camera |
| US9039528B2 (en) | 2009-01-30 | 2015-05-26 | Microsoft Technology Licensing, Llc | Visual target tracking |
| US9607213B2 (en) | 2009-01-30 | 2017-03-28 | Microsoft Technology Licensing, Llc | Body scan |
| US10599212B2 (en) | 2009-01-30 | 2020-03-24 | Microsoft Technology Licensing, Llc | Navigation of a virtual plane using a zone of restriction for canceling noise |
| US9465980B2 (en) | 2009-01-30 | 2016-10-11 | Microsoft Technology Licensing, Llc | Pose tracking pipeline |
| US9280203B2 (en) | 2009-01-30 | 2016-03-08 | Microsoft Technology Licensing, Llc | Gesture recognizer system architecture |
| US20100199221A1 (en) * | 2009-01-30 | 2010-08-05 | Microsoft Corporation | Navigation of a virtual plane using depth |
| JP2010176510A (en) * | 2009-01-30 | 2010-08-12 | Sanyo Electric Co Ltd | Information display device |
| US9652030B2 (en) * | 2009-01-30 | 2017-05-16 | Microsoft Technology Licensing, Llc | Navigation of a virtual plane using a zone of restriction for canceling noise |
| US8860663B2 (en) | 2009-01-30 | 2014-10-14 | Microsoft Corporation | Pose tracking pipeline |
| US8897493B2 (en) | 2009-01-30 | 2014-11-25 | Microsoft Corporation | Body scan |
| US8869072B2 (en) | 2009-01-30 | 2014-10-21 | Microsoft Corporation | Gesture recognizer system architecture |
| US9842405B2 (en) | 2009-01-30 | 2017-12-12 | Microsoft Technology Licensing, Llc | Visual target tracking |
| US9007417B2 (en) | 2009-01-30 | 2015-04-14 | Microsoft Technology Licensing, Llc | Body scan |
| US9256282B2 (en) | 2009-03-20 | 2016-02-09 | Microsoft Technology Licensing, Llc | Virtual object manipulation |
| US9478057B2 (en) | 2009-03-20 | 2016-10-25 | Microsoft Technology Licensing, Llc | Chaining animations |
| US8988437B2 (en) | 2009-03-20 | 2015-03-24 | Microsoft Technology Licensing, Llc | Chaining animations |
| US9824480B2 (en) | 2009-03-20 | 2017-11-21 | Microsoft Technology Licensing, Llc | Chaining animations |
| US9313376B1 (en) | 2009-04-01 | 2016-04-12 | Microsoft Technology Licensing, Llc | Dynamic depth power equalization |
| US9015638B2 (en) | 2009-05-01 | 2015-04-21 | Microsoft Technology Licensing, Llc | Binding users to a gesture based system and providing feedback to the users |
| US9377857B2 (en) | 2009-05-01 | 2016-06-28 | Microsoft Technology Licensing, Llc | Show body position |
| US8638985B2 (en) | 2009-05-01 | 2014-01-28 | Microsoft Corporation | Human body pose estimation |
| US9524024B2 (en) | 2009-05-01 | 2016-12-20 | Microsoft Technology Licensing, Llc | Method to control perspective for a camera-controlled computer |
| US9898675B2 (en) | 2009-05-01 | 2018-02-20 | Microsoft Technology Licensing, Llc | User movement tracking feedback to improve tracking |
| US9191570B2 (en) | 2009-05-01 | 2015-11-17 | Microsoft Technology Licensing, Llc | Systems and methods for detecting a tilt angle from a depth image |
| US10210382B2 (en) | 2009-05-01 | 2019-02-19 | Microsoft Technology Licensing, Llc | Human body pose estimation |
| US9498718B2 (en) | 2009-05-01 | 2016-11-22 | Microsoft Technology Licensing, Llc | Altering a view perspective within a display environment |
| US9519970B2 (en) | 2009-05-01 | 2016-12-13 | Microsoft Technology Licensing, Llc | Systems and methods for detecting a tilt angle from a depth image |
| US9262673B2 (en) | 2009-05-01 | 2016-02-16 | Microsoft Technology Licensing, Llc | Human body pose estimation |
| US9910509B2 (en) | 2009-05-01 | 2018-03-06 | Microsoft Technology Licensing, Llc | Method to control perspective for a camera-controlled computer |
| US9519828B2 (en) | 2009-05-01 | 2016-12-13 | Microsoft Technology Licensing, Llc | Isolate extraneous motions |
| US9298263B2 (en) | 2009-05-01 | 2016-03-29 | Microsoft Technology Licensing, Llc | Show body position |
| US8942428B2 (en) | 2009-05-01 | 2015-01-27 | Microsoft Corporation | Isolate extraneous motions |
| US9569005B2 (en) | 2009-05-29 | 2017-02-14 | Microsoft Technology Licensing, Llc | Method and system implementing user-centric gesture control |
| US8896721B2 (en) | 2009-05-29 | 2014-11-25 | Microsoft Corporation | Environment and/or target segmentation |
| US9215478B2 (en) | 2009-05-29 | 2015-12-15 | Microsoft Technology Licensing, Llc | Protocol and format for communicating an image from a camera to a computing environment |
| US10691216B2 (en) | 2009-05-29 | 2020-06-23 | Microsoft Technology Licensing, Llc | Combining gestures beyond skeletal |
| US9182814B2 (en) | 2009-05-29 | 2015-11-10 | Microsoft Technology Licensing, Llc | Systems and methods for estimating a non-visible or occluded body part |
| US8693724B2 (en) | 2009-05-29 | 2014-04-08 | Microsoft Corporation | Method and system implementing user-centric gesture control |
| US8856691B2 (en) | 2009-05-29 | 2014-10-07 | Microsoft Corporation | Gesture tool |
| US9383823B2 (en) | 2009-05-29 | 2016-07-05 | Microsoft Technology Licensing, Llc | Combining gestures beyond skeletal |
| US9400559B2 (en) | 2009-05-29 | 2016-07-26 | Microsoft Technology Licensing, Llc | Gesture shortcuts |
| US9656162B2 (en) | 2009-05-29 | 2017-05-23 | Microsoft Technology Licensing, Llc | Device for identifying and tracking multiple humans over time |
| US8917240B2 (en) | 2009-06-01 | 2014-12-23 | Microsoft Corporation | Virtual desktop coordinate transformation |
| US9519989B2 (en) | 2009-07-09 | 2016-12-13 | Microsoft Technology Licensing, Llc | Visual representation expression based on player expression |
| US9159151B2 (en) | 2009-07-13 | 2015-10-13 | Microsoft Technology Licensing, Llc | Bringing a visual representation to life via learned input from the user |
| US9141193B2 (en) | 2009-08-31 | 2015-09-22 | Microsoft Technology Licensing, Llc | Techniques for using human gestures to control gesture unaware programs |
| US9063001B2 (en) | 2009-09-14 | 2015-06-23 | Microsoft Technology Licensing, Llc | Optical fault monitoring |
| US8908091B2 (en) | 2009-09-21 | 2014-12-09 | Microsoft Corporation | Alignment of lens and image sensor |
| US8976986B2 (en) | 2009-09-21 | 2015-03-10 | Microsoft Technology Licensing, Llc | Volume adjustment based on listener position |
| US10085072B2 (en) | 2009-09-23 | 2018-09-25 | Rovi Guides, Inc. | Systems and methods for automatically detecting users within detection regions of media devices |
| US8963829B2 (en) | 2009-10-07 | 2015-02-24 | Microsoft Corporation | Methods and systems for determining and tracking extremities of a target |
| US9582717B2 (en) | 2009-10-07 | 2017-02-28 | Microsoft Technology Licensing, Llc | Systems and methods for tracking a model |
| US9821226B2 (en) | 2009-10-07 | 2017-11-21 | Microsoft Technology Licensing, Llc | Human tracking system |
| US9522328B2 (en) | 2009-10-07 | 2016-12-20 | Microsoft Technology Licensing, Llc | Human tracking system |
| US8891827B2 (en) | 2009-10-07 | 2014-11-18 | Microsoft Corporation | Systems and methods for tracking a model |
| US8861839B2 (en) | 2009-10-07 | 2014-10-14 | Microsoft Corporation | Human tracking system |
| US9679390B2 (en) | 2009-10-07 | 2017-06-13 | Microsoft Technology Licensing, Llc | Systems and methods for removing a background of an image |
| US9659377B2 (en) | 2009-10-07 | 2017-05-23 | Microsoft Technology Licensing, Llc | Methods and systems for determining and tracking extremities of a target |
| US8970487B2 (en) | 2009-10-07 | 2015-03-03 | Microsoft Technology Licensing, Llc | Human tracking system |
| US8867820B2 (en) | 2009-10-07 | 2014-10-21 | Microsoft Corporation | Systems and methods for removing a background of an image |
| US8897495B2 (en) | 2009-10-07 | 2014-11-25 | Microsoft Corporation | Systems and methods for tracking a model |
| US9400548B2 (en) | 2009-10-19 | 2016-07-26 | Microsoft Technology Licensing, Llc | Gesture personalization and profile roaming |
| US8988432B2 (en) | 2009-11-05 | 2015-03-24 | Microsoft Technology Licensing, Llc | Systems and methods for processing an image for target tracking |
| US10048763B2 (en) | 2009-11-19 | 2018-08-14 | Microsoft Technology Licensing, Llc | Distance scalable no touch computing |
| US8843857B2 (en) | 2009-11-19 | 2014-09-23 | Microsoft Corporation | Distance scalable no touch computing |
| US9244533B2 (en) | 2009-12-17 | 2016-01-26 | Microsoft Technology Licensing, Llc | Camera navigation for presentations |
| US10398972B2 (en) | 2010-01-08 | 2019-09-03 | Microsoft Technology Licensing, Llc | Assigning gesture dictionaries |
| US9468848B2 (en) | 2010-01-08 | 2016-10-18 | Microsoft Technology Licensing, Llc | Assigning gesture dictionaries |
| US9019201B2 (en) | 2010-01-08 | 2015-04-28 | Microsoft Technology Licensing, Llc | Evolving universal gesture sets |
| US9268404B2 (en) | 2010-01-08 | 2016-02-23 | Microsoft Technology Licensing, Llc | Application gesture interpretation |
| US9195305B2 (en) | 2010-01-15 | 2015-11-24 | Microsoft Technology Licensing, Llc | Recognizing user intent in motion capture system |
| US8933884B2 (en) | 2010-01-15 | 2015-01-13 | Microsoft Corporation | Tracking groups of users in motion capture system |
| US8926431B2 (en) | 2010-01-29 | 2015-01-06 | Microsoft Corporation | Visual based identity tracking |
| US8864581B2 (en) | 2010-01-29 | 2014-10-21 | Microsoft Corporation | Visual based identitiy tracking |
| US9278287B2 (en) | 2010-01-29 | 2016-03-08 | Microsoft Technology Licensing, Llc | Visual based identity tracking |
| US10113868B2 (en) | 2010-02-01 | 2018-10-30 | Microsoft Technology Licensing, Llc | Multiple synchronized optical sources for time-of-flight range finding systems |
| US8891067B2 (en) | 2010-02-01 | 2014-11-18 | Microsoft Corporation | Multiple synchronized optical sources for time-of-flight range finding systems |
| US8928579B2 (en) | 2010-02-22 | 2015-01-06 | Andrew David Wilson | Interacting with an omni-directionally projected display |
| US9069381B2 (en) | 2010-03-12 | 2015-06-30 | Microsoft Technology Licensing, Llc | Interacting with a computer based application |
| US9147253B2 (en) | 2010-03-17 | 2015-09-29 | Microsoft Technology Licensing, Llc | Raster scanning for depth detection |
| US9031103B2 (en) | 2010-03-31 | 2015-05-12 | Microsoft Technology Licensing, Llc | Temperature measurement and control for laser and light-emitting diodes |
| US9646340B2 (en) | 2010-04-01 | 2017-05-09 | Microsoft Technology Licensing, Llc | Avatar-based virtual dressing room |
| US9098873B2 (en) | 2010-04-01 | 2015-08-04 | Microsoft Technology Licensing, Llc | Motion-based interactive shopping environment |
| US8885890B2 (en) | 2010-05-07 | 2014-11-11 | Microsoft Corporation | Depth map confidence filtering |
| WO2011148607A1 (en) * | 2010-05-28 | 2011-12-01 | パナソニック株式会社 | Gesture recognition device and gesture recognition method |
| JP4897939B2 (en) * | 2010-05-28 | 2012-03-14 | パナソニック株式会社 | Gesture recognition device and gesture recognition method |
| US8730164B2 (en) | 2010-05-28 | 2014-05-20 | Panasonic Corporation | Gesture recognition apparatus and method of gesture recognition |
| US9491226B2 (en) | 2010-06-02 | 2016-11-08 | Microsoft Technology Licensing, Llc | Recognition system for sharing information |
| US9958952B2 (en) | 2010-06-02 | 2018-05-01 | Microsoft Technology Licensing, Llc | Recognition system for sharing information |
| US9008355B2 (en) | 2010-06-04 | 2015-04-14 | Microsoft Technology Licensing, Llc | Automatic depth camera aiming |
| US9098493B2 (en) | 2010-06-04 | 2015-08-04 | Microsoft Technology Licensing, Llc | Machine based sign language interpreter |
| US9557574B2 (en) | 2010-06-08 | 2017-01-31 | Microsoft Technology Licensing, Llc | Depth illumination and detection optics |
| US9384329B2 (en) | 2010-06-11 | 2016-07-05 | Microsoft Technology Licensing, Llc | Caloric burn determination from body movement |
| US9292083B2 (en) | 2010-06-11 | 2016-03-22 | Microsoft Technology Licensing, Llc | Interacting with user interface via avatar |
| US8982151B2 (en) | 2010-06-14 | 2015-03-17 | Microsoft Technology Licensing, Llc | Independently processing planes of display data |
| US10534438B2 (en) | 2010-06-18 | 2020-01-14 | Microsoft Technology Licensing, Llc | Compound gesture-speech commands |
| US9274747B2 (en) | 2010-06-21 | 2016-03-01 | Microsoft Technology Licensing, Llc | Natural user input for driving interactive stories |
| US9075434B2 (en) | 2010-08-20 | 2015-07-07 | Microsoft Technology Licensing, Llc | Translating user motion into multiple object responses |
| US8968091B2 (en) | 2010-09-07 | 2015-03-03 | Microsoft Technology Licensing, Llc | Scalable real-time motion recognition |
| US8953844B2 (en) | 2010-09-07 | 2015-02-10 | Microsoft Technology Licensing, Llc | System for fast, probabilistic skeletal tracking |
| US8988508B2 (en) | 2010-09-24 | 2015-03-24 | Microsoft Technology Licensing, Llc. | Wide angle field of view active illumination imaging system |
| US8983233B2 (en) | 2010-10-04 | 2015-03-17 | Microsoft Technology Licensing, Llc | Time-of-flight depth imaging |
| US9484065B2 (en) | 2010-10-15 | 2016-11-01 | Microsoft Technology Licensing, Llc | Intelligent determination of replays based on event identification |
| US9291449B2 (en) | 2010-11-02 | 2016-03-22 | Microsoft Technology Licensing, Llc | Detection of configuration changes among optical elements of illumination system |
| US8866889B2 (en) | 2010-11-03 | 2014-10-21 | Microsoft Corporation | In-home depth camera calibration |
| JP2012103938A (en) * | 2010-11-11 | 2012-05-31 | Seiko Epson Corp | Optical detection system and program |
| US10726861B2 (en) | 2010-11-15 | 2020-07-28 | Microsoft Technology Licensing, Llc | Semi-private communication in open environments |
| US9349040B2 (en) | 2010-11-19 | 2016-05-24 | Microsoft Technology Licensing, Llc | Bi-modal depth-image analysis |
| US10234545B2 (en) | 2010-12-01 | 2019-03-19 | Microsoft Technology Licensing, Llc | Light source module |
| US8884968B2 (en) | 2010-12-15 | 2014-11-11 | Microsoft Corporation | Modeling an object from image data |
| US8920241B2 (en) | 2010-12-15 | 2014-12-30 | Microsoft Corporation | Gesture controlled persistent handles for interface guides |
| US9171264B2 (en) | 2010-12-15 | 2015-10-27 | Microsoft Technology Licensing, Llc | Parallel processing machine learning decision tree training |
| US9823339B2 (en) | 2010-12-21 | 2017-11-21 | Microsoft Technology Licensing, Llc | Plural anode time-of-flight sensor |
| US8994718B2 (en) | 2010-12-21 | 2015-03-31 | Microsoft Technology Licensing, Llc | Skeletal control of three-dimensional virtual world |
| US9848106B2 (en) | 2010-12-21 | 2017-12-19 | Microsoft Technology Licensing, Llc | Intelligent gameplay photo capture |
| US9821224B2 (en) | 2010-12-21 | 2017-11-21 | Microsoft Technology Licensing, Llc | Driving simulator control with virtual skeleton |
| US9489053B2 (en) | 2010-12-21 | 2016-11-08 | Microsoft Technology Licensing, Llc | Skeletal control of three-dimensional virtual world |
| US9123316B2 (en) | 2010-12-27 | 2015-09-01 | Microsoft Technology Licensing, Llc | Interactive content creation |
| US9529566B2 (en) | 2010-12-27 | 2016-12-27 | Microsoft Technology Licensing, Llc | Interactive content creation |
| US10049458B2 (en) | 2011-01-31 | 2018-08-14 | Microsoft Technology Licensing, Llc | Reducing interference between multiple infra-red depth cameras |
| US9242171B2 (en) | 2011-01-31 | 2016-01-26 | Microsoft Technology Licensing, Llc | Real-time camera tracking using depth maps |
| US9247238B2 (en) | 2011-01-31 | 2016-01-26 | Microsoft Technology Licensing, Llc | Reducing interference between multiple infra-red depth cameras |
| US9619561B2 (en) | 2011-02-14 | 2017-04-11 | Microsoft Technology Licensing, Llc | Change invariant scene recognition by an agent |
| US8942917B2 (en) | 2011-02-14 | 2015-01-27 | Microsoft Corporation | Change invariant scene recognition by an agent |
| US9551914B2 (en) | 2011-03-07 | 2017-01-24 | Microsoft Technology Licensing, Llc | Illuminator with refractive optical element |
| TWI421728B (en) * | 2011-03-07 | 2014-01-01 | Avermedia Information Inc | Document camera and associated method of object sensing control |
| US9067136B2 (en) | 2011-03-10 | 2015-06-30 | Microsoft Technology Licensing, Llc | Push personalization of interface controls |
| US9470778B2 (en) | 2011-03-29 | 2016-10-18 | Microsoft Technology Licensing, Llc | Learning from high quality depth measurements |
| US10585957B2 (en) | 2011-03-31 | 2020-03-10 | Microsoft Technology Licensing, Llc | Task driven user intents |
| US10296587B2 (en) | 2011-03-31 | 2019-05-21 | Microsoft Technology Licensing, Llc | Augmented conversational understanding agent to identify conversation context between two humans and taking an agent action thereof |
| US10642934B2 (en) | 2011-03-31 | 2020-05-05 | Microsoft Technology Licensing, Llc | Augmented conversational understanding architecture |
| US9298287B2 (en) | 2011-03-31 | 2016-03-29 | Microsoft Technology Licensing, Llc | Combined activation for natural user interface systems |
| US9539500B2 (en) | 2011-04-05 | 2017-01-10 | Microsoft Technology Licensing, Llc | Biometric recognition |
| US9259643B2 (en) | 2011-04-28 | 2016-02-16 | Microsoft Technology Licensing, Llc | Control of separate computer game elements |
| US10671841B2 (en) | 2011-05-02 | 2020-06-02 | Microsoft Technology Licensing, Llc | Attribute state classification |
| US8888331B2 (en) | 2011-05-09 | 2014-11-18 | Microsoft Corporation | Low inductance light source module |
| US9137463B2 (en) | 2011-05-12 | 2015-09-15 | Microsoft Technology Licensing, Llc | Adaptive high dynamic range camera |
| US10331222B2 (en) | 2011-05-31 | 2019-06-25 | Microsoft Technology Licensing, Llc | Gesture recognition techniques |
| US9372544B2 (en) | 2011-05-31 | 2016-06-21 | Microsoft Technology Licensing, Llc | Gesture recognition techniques |
| US9594430B2 (en) | 2011-06-01 | 2017-03-14 | Microsoft Technology Licensing, Llc | Three-dimensional foreground selection for vision system |
| US8897491B2 (en) | 2011-06-06 | 2014-11-25 | Microsoft Corporation | System for finger recognition and tracking |
| US10796494B2 (en) | 2011-06-06 | 2020-10-06 | Microsoft Technology Licensing, Llc | Adding attributes to virtual representations of real-world objects |
| US9013489B2 (en) | 2011-06-06 | 2015-04-21 | Microsoft Technology Licensing, Llc | Generation of avatar reflecting player appearance |
| US9208571B2 (en) | 2011-06-06 | 2015-12-08 | Microsoft Technology Licensing, Llc | Object digitization |
| US9724600B2 (en) | 2011-06-06 | 2017-08-08 | Microsoft Technology Licensing, Llc | Controlling objects in a virtual environment |
| US9953426B2 (en) | 2011-06-06 | 2018-04-24 | Microsoft Technology Licensing, Llc | Object digitization |
| US8929612B2 (en) | 2011-06-06 | 2015-01-06 | Microsoft Corporation | System for recognizing an open or closed hand |
| US9098110B2 (en) | 2011-06-06 | 2015-08-04 | Microsoft Technology Licensing, Llc | Head rotation tracking from depth-based center of mass |
| US9597587B2 (en) | 2011-06-08 | 2017-03-21 | Microsoft Technology Licensing, Llc | Locational node device |
| US9557836B2 (en) | 2011-11-01 | 2017-01-31 | Microsoft Technology Licensing, Llc | Depth image compression |
| US9117281B2 (en) | 2011-11-02 | 2015-08-25 | Microsoft Corporation | Surface segmentation from RGB and depth images |
| US8854426B2 (en) | 2011-11-07 | 2014-10-07 | Microsoft Corporation | Time-of-flight camera with guided light |
| US9056254B2 (en) | 2011-11-07 | 2015-06-16 | Microsoft Technology Licensing, Llc | Time-of-flight camera with guided light |
| US8929668B2 (en) | 2011-11-29 | 2015-01-06 | Microsoft Corporation | Foreground subject detection |
| JP2013114647A (en) * | 2011-12-01 | 2013-06-10 | Exvision Inc | Gesture input system |
| US9154837B2 (en) | 2011-12-02 | 2015-10-06 | Microsoft Technology Licensing, Llc | User interface presenting an animated avatar performing a media reaction |
| US9100685B2 (en) | 2011-12-09 | 2015-08-04 | Microsoft Technology Licensing, Llc | Determining audience state or interest using passive sensor data |
| US10798438B2 (en) | 2011-12-09 | 2020-10-06 | Microsoft Technology Licensing, Llc | Determining audience state or interest using passive sensor data |
| US9628844B2 (en) | 2011-12-09 | 2017-04-18 | Microsoft Technology Licensing, Llc | Determining audience state or interest using passive sensor data |
| US8879831B2 (en) | 2011-12-15 | 2014-11-04 | Microsoft Corporation | Using high-level attributes to guide image processing |
| US8971612B2 (en) | 2011-12-15 | 2015-03-03 | Microsoft Corporation | Learning image processing tasks from scene reconstructions |
| US9596643B2 (en) | 2011-12-16 | 2017-03-14 | Microsoft Technology Licensing, Llc | Providing a user interface experience based on inferred vehicle state |
| US9342139B2 (en) | 2011-12-19 | 2016-05-17 | Microsoft Technology Licensing, Llc | Pairing a computing device to a user |
| US9720089B2 (en) | 2012-01-23 | 2017-08-01 | Microsoft Technology Licensing, Llc | 3D zoom imager |
| KR101330810B1 (en) * | 2012-02-24 | 2013-11-18 | 주식회사 팬택 | User device for recognizing gesture and method thereof |
| JP2013186500A (en) * | 2012-03-05 | 2013-09-19 | Toshiba Tec Corp | Operation support display device and program |
| US8898687B2 (en) | 2012-04-04 | 2014-11-25 | Microsoft Corporation | Controlling a media program based on a media reaction |
| JP2013222317A (en) * | 2012-04-17 | 2013-10-28 | Toshiba Mach Co Ltd | Numerical control device |
| US9210401B2 (en) | 2012-05-03 | 2015-12-08 | Microsoft Technology Licensing, Llc | Projected visual cues for guiding physical movement |
| US8959541B2 (en) | 2012-05-04 | 2015-02-17 | Microsoft Technology Licensing, Llc | Determining a future portion of a currently presented media program |
| US9788032B2 (en) | 2012-05-04 | 2017-10-10 | Microsoft Technology Licensing, Llc | Determining a future portion of a currently presented media program |
| US9001118B2 (en) | 2012-06-21 | 2015-04-07 | Microsoft Technology Licensing, Llc | Avatar construction using depth camera |
| US10089454B2 (en) | 2012-06-22 | 2018-10-02 | Microsoft Technology Licensing, Llc | Enhanced accuracy of user presence status determination |
| US9836590B2 (en) | 2012-06-22 | 2017-12-05 | Microsoft Technology Licensing, Llc | Enhanced accuracy of user presence status determination |
| US9696427B2 (en) | 2012-08-14 | 2017-07-04 | Microsoft Technology Licensing, Llc | Wide angle depth detection |
| US10878009B2 (en) | 2012-08-23 | 2020-12-29 | Microsoft Technology Licensing, Llc | Translating natural language utterances to keyword search queries |
| US8882310B2 (en) | 2012-12-10 | 2014-11-11 | Microsoft Corporation | Laser die light source module with low inductance |
| US11215711B2 (en) | 2012-12-28 | 2022-01-04 | Microsoft Technology Licensing, Llc | Using photometric stereo for 3D environment modeling |
| US9857470B2 (en) | 2012-12-28 | 2018-01-02 | Microsoft Technology Licensing, Llc | Using photometric stereo for 3D environment modeling |
| US9251590B2 (en) | 2013-01-24 | 2016-02-02 | Microsoft Technology Licensing, Llc | Camera pose estimation for 3D reconstruction |
| US9052746B2 (en) | 2013-02-15 | 2015-06-09 | Microsoft Technology Licensing, Llc | User center-of-mass and mass distribution extraction using depth images |
| JP2014157352A (en) * | 2013-02-18 | 2014-08-28 | Samsung Electronics Co Ltd | Display device |
| US11710309B2 (en) | 2013-02-22 | 2023-07-25 | Microsoft Technology Licensing, Llc | Camera/object pose from predicted coordinates |
| US9940553B2 (en) | 2013-02-22 | 2018-04-10 | Microsoft Technology Licensing, Llc | Camera/object pose from predicted coordinates |
| US9959459B2 (en) | 2013-03-08 | 2018-05-01 | Microsoft Technology Licensing, Llc | Extraction of user behavior from depth images |
| US9135516B2 (en) | 2013-03-08 | 2015-09-15 | Microsoft Technology Licensing, Llc | User body angle, curvature and average extremity positions extraction using depth images |
| US9311560B2 (en) | 2013-03-08 | 2016-04-12 | Microsoft Technology Licensing, Llc | Extraction of user behavior from depth images |
| US9824260B2 (en) | 2013-03-13 | 2017-11-21 | Microsoft Technology Licensing, Llc | Depth image processing |
| US9092657B2 (en) | 2013-03-13 | 2015-07-28 | Microsoft Technology Licensing, Llc | Depth image processing |
| US9787943B2 (en) | 2013-03-14 | 2017-10-10 | Microsoft Technology Licensing, Llc | Natural user interface having video conference controls |
| US9274606B2 (en) | 2013-03-14 | 2016-03-01 | Microsoft Technology Licensing, Llc | NUI video conference controls |
| US9953213B2 (en) | 2013-03-27 | 2018-04-24 | Microsoft Technology Licensing, Llc | Self discovery of autonomous NUI devices |
| US9442186B2 (en) | 2013-05-13 | 2016-09-13 | Microsoft Technology Licensing, Llc | Interference reduction for TOF systems |
| US9462253B2 (en) | 2013-09-23 | 2016-10-04 | Microsoft Technology Licensing, Llc | Optical modules that reduce speckle contrast and diffraction artifacts |
| US10024968B2 (en) | 2013-09-23 | 2018-07-17 | Microsoft Technology Licensing, Llc | Optical modules that reduce speckle contrast and diffraction artifacts |
| US9443310B2 (en) | 2013-10-09 | 2016-09-13 | Microsoft Technology Licensing, Llc | Illumination modules that emit structured light |
| US9674563B2 (en) | 2013-11-04 | 2017-06-06 | Rovi Guides, Inc. | Systems and methods for recommending content |
| US10205931B2 (en) | 2013-11-12 | 2019-02-12 | Microsoft Technology Licensing, Llc | Power efficient laser diode driver circuit and method |
| US9769459B2 (en) | 2013-11-12 | 2017-09-19 | Microsoft Technology Licensing, Llc | Power efficient laser diode driver circuit and method |
| US9508385B2 (en) | 2013-11-21 | 2016-11-29 | Microsoft Technology Licensing, Llc | Audio-visual project generator |
| US10325628B2 (en) | 2013-11-21 | 2019-06-18 | Microsoft Technology Licensing, Llc | Audio-visual project generator |
| US9971491B2 (en) | 2014-01-09 | 2018-05-15 | Microsoft Technology Licensing, Llc | Gesture library for natural user input |
| CN114578951A (en) * | 2014-03-14 | 2022-06-03 | 三星电子株式会社 | Display device and control method thereof |
| CN105278661A (en) * | 2014-07-11 | 2016-01-27 | 胜华科技股份有限公司 | Gesture control method with mouse tracking control and five-direction-key waving control |
| US10412280B2 (en) | 2016-02-10 | 2019-09-10 | Microsoft Technology Licensing, Llc | Camera with light valve over sensor array |
| US10257932B2 (en) | 2016-02-16 | 2019-04-09 | Microsoft Technology Licensing, Llc. | Laser diode chip on printed circuit board |
| US10462452B2 (en) | 2016-03-16 | 2019-10-29 | Microsoft Technology Licensing, Llc | Synchronizing active illumination cameras |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JPH0844490A (en) | Interface device | |
| JP2004078977A (en) | Interface device | |
| US8666115B2 (en) | Computer vision gesture based control of a device | |
| US6775014B2 (en) | System and method for determining the location of a target in a room or small area | |
| US10015392B2 (en) | Information processing apparatus, information processing method, and program | |
| JP4323180B2 (en) | Interface method, apparatus, and program using self-image display | |
| JP3114813B2 (en) | Information input method | |
| US20070216642A1 (en) | System For 3D Rendering Applications Using Hands | |
| JPH07141101A (en) | Input system using picture | |
| JPH09185456A (en) | Interface device | |
| KR19990008158A (en) | Interface device | |
| CN102460373A (en) | Surface computer user interaction | |
| JPH08315154A (en) | Gesture recognition system | |
| US20140053115A1 (en) | Computer vision gesture based control of a device | |
| JP4733600B2 (en) | Operation detection device and its program | |
| CN108536273A (en) | Man-machine menu mutual method and system based on gesture | |
| WO2015159548A1 (en) | Projection control device, projection control method, and recording medium recording projection control program | |
| TW201737023A (en) | Information processing system, information processing device, control method, and program | |
| CN103677442B (en) | Keyboard device and electronic device | |
| JP2005063225A (en) | Interface method, system and program using self-image display | |
| JP3792907B2 (en) | Hand pointing device | |
| JP2005301583A (en) | Typing input device | |
| JP6465197B2 (en) | Information processing apparatus, information processing method, and program | |
| KR101998786B1 (en) | Non-contact Finger Input Device and Method in Virtual Space | |
| CN109144235B (en) | Man-machine interaction method and system based on head-hand cooperative action |