CN1582567A - 交互式视频显示系统 - Google Patents

交互式视频显示系统 Download PDF

Info

Publication number
CN1582567A
CN1582567A CNA028152069A CN02815206A CN1582567A CN 1582567 A CN1582567 A CN 1582567A CN A028152069 A CNA028152069 A CN A028152069A CN 02815206 A CN02815206 A CN 02815206A CN 1582567 A CN1582567 A CN 1582567A
Authority
CN
China
Prior art keywords
image
utilize
video
source
pattern
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA028152069A
Other languages
English (en)
Other versions
CN1582567B (zh
Inventor
马修·贝尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Reactrix Systems Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=26856697&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=CN1582567(A) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Reactrix Systems Inc filed Critical Reactrix Systems Inc
Publication of CN1582567A publication Critical patent/CN1582567A/zh
Application granted granted Critical
Publication of CN1582567B publication Critical patent/CN1582567B/zh
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/20—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00—Projectors or projection-type viewers; Accessories therefor
    • G03B21/14—Details
    • G03B21/26—Projecting separately subsidiary matter simultaneously with main image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1012—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
    • A63F2300/1093—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera using visible light
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/69—Involving elements of the real world in the game world, e.g. measurement in live races, real video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/30—Transforming light or analogous information into electric information
    • H04N5/33—Transforming infrared radiation

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Details Of Television Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Position Input By Displaying (AREA)

Abstract

一种设备通过利用人的(或别的对象的)活动和位置作为计算机的输入，使得人与计算机显示系统之间可以轻易且不受妨碍地进行交互。在某些配置中，显示可以投影到用户的周围，使得人的动作可以显示在其周围。视频摄像机和投影仪以不同的波长工作，这样它们不会相互干扰。这种设备的用处包括俱乐部或活动场所的人的交互式照明效果，交互式广告显示等，但并不局限于此。计算机产生的角色和虚拟对象可以对过路人的活动作出反应，产生公共场所(比如餐厅、公共活动室和公园)、视频游戏系统等的交互式环境照明，和建立交互式信息空间和艺术设置。可以利用图案照射以及亮度和梯度处理来改善针对视频图像的背景检测出对象的能力。

Description

交互式视频显示系统
相关申请的相互参考
本申请要求2001年6月5日申请的共同未决的美国临时专利申请号60/296,189的优先权，该临时专利申请的名称为“INTERACTIVEVIDEO DISPLAY SYSTEM THAT USES VIDEO INPUT”，在此其所有内容在本文中全部作为参考。
发明背景
本发明一般涉及图像处理系统，尤其涉及这样一种系统，它用于接收和处理人用户的图像，使得可以与视频显示进行交互。
在分析、教育、商业和娱乐等许多领域中，都要用到图像处理。图像处理的一个方面包括人-机交互，通过检测人的形态和活动使得可以与图像进行交互。这些处理的应用可以采用与图像交互的有效或有趣的方法来确定数字形状或其他数据、使对象生动化、建立表示形式等。
检测人体的位置和活动被称为“动作捕捉”。利用动作捕捉技术，可以将人表演者的活动的数学描述输入到计算机或其他处理系统中。自然身体活动可以作为计算机的输入，以便研究运动员的活动、捕捉一些便于以后重放或仿真的数据、加强医用方面的分析等。
尽管动作捕捉提供了一些好处和优点，然而，动作捕捉技术往往较复杂。有些技术要求人动作者穿上在某些位置具有高可见度点的特殊服装。其他方法使用射频或其他类型的发射器、多个传感器和检测器、蓝底色屏幕、大量的后处理等。依赖于简单可见光图像捕捉的技术通常不足以准确地提供清晰精确的动作捕捉。
有些动作捕捉应用允许动作者或用户与计算机系统所建立和显示的图像进行交互。例如，动作者可以站在多个对象的大型视频屏幕投影的前面。动作者可以利用身体活动来移动这些对象，或者是产生、变更和操纵这些对象。基于动作者的活动的不同效果可以由处理系统来计算，并显示在显示屏上。例如，计算机系统可以跟踪显示屏前面的动作者的轨迹，并在显示屏上呈现该轨迹的近似或艺术解释。动作者所交互的图像可以例如在地面上、墙面上或其他表面上；可以以三维方式悬挂在空间，显示在一个或多个监视器上、投影屏上或其他设备上。可以用任何类型的显示设备或技术来呈现用户所能控制或交互的图像。
在某些应用中，比如销售点、零售广告、促销、拱廊娱乐场所等，希望以很不显眼的方式捕捉未经训练的用户(比如经过的人)的动作。最好，用户不需要专门的准备或训练，而系统不使用过于昂贵的设备。此外，这种用于对动作者进行动作捕捉的方法和系统最好是用户所看不见的或不可觉察的。许多现实应用必须工作在这样一些环境下：背景和前景对象复杂且在变化，捕捉时间间隔短，照明条件在变化，以及存在使得难以进行动作捕捉的其他因素。
发明内容
本发明通过利用用户的(或别的对象的)活动和位置作为计算机的输入，使得用户与计算机显示系统之间可以进行交互。计算机产生对用户的位置和活动作出响应的显示。所产生的显示可包括用户的身体活动所能移动、变更或者是控制的对象或形状。
在本发明的一种优选实施方式中，所显示的图像实时地受用户的动作的影响。显示可以投影到用户的周围，这样用户的动作可以产生发自用户的效果，并且可以影响与用户接近的显示区。或者，用户可以通过例如踢、推、移动、变形、触及视频图像中的项目等方式来影响视频对象。利用基本上不同波长的光，可以最大限度地减小用于显示交互式图像的光与用于检测用户的光之间的干扰。
在一种实施方式中，用人眼看不见的红外光对用户进行照射。对红外光感光的摄像机用来捕捉用户的图像，以便进行位置和动作分析。投影仪将可见光投影到屏幕上、玻璃面上或其他表面上，以显示交互式图像、对象、图案或其他形状和效果。显示面可以位于用户周围，这样，显示中其实际存在与其虚拟存在相应，从而可具有与虚拟对象实际接触和交互的感受。
本发明的一个方面可以使用图案照射而不使用简单的、不可见的、均匀的“泛光照射”。利用图案照射，可以投影出诸如棋盘格、随机点图案等的图案。计算机中执行的过程利用这种图案来解释摄像机图像并从场景中的背景和/或其他项目中检测出对象。该图案可以作为背景被产生(这样，它没有触及到所要检测的对象)，或者，该图案可以被投影到所有的摄像机可视场景上，这样它可以照射背景、前景以及所要检测和所要进行动作捕捉的对象。
实现图案照射的一种方法包括：在幻灯投影仪中使用红外LED簇或其他不可见光源。另一种方法可以使用红外激光束，该红外激光束被偏转、遮光、扫描等，以产生一个图案。
实现图案照射的另一种方法是：使用有规则的“泛光照射”，但利用对摄像机的接受频率发暗或者强反射的墨水、染料或颜料将上述图案标记到摄像机的可视区上。可以使这种墨水、染料或颜料是人眼看不见的，以便改善显示的美观。
本发明的另一个方面使用梯度方法来确定对象-图像的交互作用。通过在所检测对象的周围形成梯度流或灰度级过渡来形成“感应图像”。当所检测对象活动时，实时计算梯度流。当梯度流触及到一个视频图像或项目时，计算所触及到的项目区域中的亮度和梯度。交互作用(例如推动该项目)的强度和方向分别是所触及区域的亮度和梯度的函数。
在一种实施方式中，本发明提供了一种系统，用于检测对象和相应地产生一个显示，该系统包括：第一源，用于输出第一波长范围的电磁能量；检测器，用于检测来自对象的电磁能量的第一源的反射；与检测器连接的处理器，利用检测到的反射产生一个显示信号；第二源，用于输出第二波长范围的电磁能量，其中第二源根据显示信号产生一个可见显示，其中第一和第二波长范围是不同的。
在另一种实施方式中，本发明提供了一种方法，用于检测摄像机所捕捉到的图像中的对象，该方法包括：利用图案照射以与照射对象不同的方式来照射背景；和利用一种处理系统从背景中分离出对象。
在另一种实施方式中，本发明提供了一种方法，用于计算对象与视频项目的交互作用，该方法包括：利用一种处理器来确定对象的梯度；利用一种处理器来确定视频项目的边界；和利用该梯度和边界来识别交互作用。
附图说明
图1示出了使用并置的投影仪和摄像机的优选实施方式的第一配置；
图2示出了一种头顶投影配置；
图3示出了一种背面投影配置；
图4示出了一种侧面投影配置；
图5A表示均匀照射情况下的主体；
图5B表示随机点图案照射情况下的背景；
图5C表示随机点图案照射情况下的主体和背景；
图5D表示从使用随机点图案照射的背景中检测出主体的结果；
图6A表示与视频对象交互的人用户；和
图6B表示感应图像。
发明详细描述
下面将描述本发明的几种配置。通常，本发明使用第一光源来照射用户或别的对象。第一光源使用人看不见的光。例如，可以使用红外或紫外光。对第一光源的波长范围的光感光的摄像机用来检测该第一光源所照射的用户。计算机(或其他处理系统)用来处理所检测到的对象图像并产生显示图像。第二光源(例如投影仪、视频屏幕等)用来向人用户或观众显示所产生的显示图像。所显示的图像处在对摄像机的对象检测的干扰最小的波长。通常，用可见光谱来显示图像。
在一种优选实施方式中，这种显示围绕在用户周围，使得用户的虚拟存在与用户的实际存在相一致。因此，显示中的虚拟场景具有用户周围的实际位置，并且显示中的用户活动将会造成虚拟场景中用户表示的同样活动。例如，用户可以触击虚拟对象的实际区域并可以知道这将会使其虚拟表示去触及计算机系统中的虚拟对象。本说明书中，使用“触及”这个词并不表示与一个对象(比如一个人)和一个图像项目的实际接触。更合适地，触及的意思是指将实际空间中对象的位置和动作转化为所产生图像中的效果，包括移动所产生图像中的项目的效果。
所显示的图像或项目可以包括对象、图案、形状或任何虚拟图案、效果等。本发明的某些方面可以应用于：例如，俱乐部或活动场所的人的交互式照明效果，交互式广告显示，对过路人的活动作出反应的角色和虚拟对象，公共场所(比如餐厅、购物中心、运动场所、零售商店、公共活动室和公园等)的交互式环境照明，视频游戏系统，和交互式信息显示。在本发明的范围内，还可以有其他一些应用。
图1示出了使用并置的投影仪和摄像机的本发明的正面投影的实施方式。图1中，用红外(或其他不可见光)灯2对某人1进行照射。用红外(或其他不可见光)摄像机3来拍摄人的图像。这一信号实时发送4到计算机5。该计算机执行对象检测算法，并实时产生视频效果。这一效果实时发送6到视频投影仪7。投影仪将所得到的图像投影到屏幕8或其他某种表面上。于是，视频效果将实时显示9在该屏幕上，并与这个人相一致。
图2示出了系统的一种头顶投影配置。组件10包括上述系统。这里，所示组件10是垂直安装的，除此之外，10中的摄像机、投影仪和光源还可以水平安装，然后用一面镜子将其重新向下定向。在地面上活动的人11可以使视频信号投影到其周围的地面12上。当投影仪在头顶正上方时，人本身的影子遮掩图像的最小部分。
图3和4示出了摄像机和投影仪的另外两种配置。在这两个图中，摄像机20捕捉屏幕23前面的对象比如人22。摄像机视见的角度如21所示。在图3中，投影仪25置于屏幕后面。从屏幕两侧都可以看到来自投影仪的投射光24。在图4中，投影仪25与屏幕成一个倾斜角；图中示出了其锥形光束24。这两种配置使得更有可能不会出现挡住投影图像的影子的情况。
如以上这些配置中所述，用视频摄像机来捕捉特定区域的场景，以便输入到计算机。在该设备的大多数配置中，摄像机将看到输出视频显示的一部分。为了避免不需要的视频反馈，摄像机可以在视频显示未用到的波长工作。在大多数情况下，这种显示将使用可见光谱。这样，摄像机必须用不可见波长(比如红外线)来拍摄，使得检测不到视频显示输出。
准备录制的场景必须用摄像机的波长的光来照射。在红外线的情况下，可以用包括日光、白炽灯或红外LED的源来照射场景。这些光源可以置于任何地方；然而，使光源帖近摄像机可以最大程度地减小摄像机看到的来自这些光的寄生影子。光源(比如一个或多个灯)可以以均匀的照明来照射对象，这与以下所讨论的图案照射相反。在一种优选实施方式中，视频信号实时输出到计算机中。然而，其他实施方式不需要达到实时或近实时，有时可以在显示图像之前相当长一段时间来处理对象或视频图像(即显示图像)。
这种组件可以模块化；这里，可以使用任何这样的计算机软件，它使用来自先前组件的视频输入并将结果输出到视频显示。
这种组件的大多数实例都有两个部分：第一部分负责从静态背景中检测出活动对象，而第二部分利用对象信息来产生视频输出。这里将描述每一部分的很多实例；这些实例只是一些例子，而决不是详尽的。
在第一部分中，实时处理来自视频摄像机的实况图像，以便从静态背景(无论什么背景)中分离出活动对象(比如人)。这可以按如下方式来处理：
首先，将来自视频摄像机的输入帧转换成灰度级，以减少数据量和简化检测过程。接着，可以使帧略微模糊以减小噪声。
任何长时间不动的对象都被假定是背景；因此，系统最终可以适应变化的照明或背景状况。可以用许多种方法来产生背景的模型图像，其中每种方法都要在一段时间范围内检查输入帧。在一种方法中，可以通过平均方法、产生中间值的方法、检测亮度不变的时段的方法或者其他直观推断法，检查最终几个输入帧(或其子集)来产生背景的模型。检查输入帧的时间长度决定了背景的模型适应输入图像中的变化的速率。
在另一种方法中，在每一时间步骤(或偶尔)，通过计算当前帧和来自前一时间步骤的背景模型的加权平均来产生背景模型。在这一计算中，当前帧的权重相对较小；因此，实际背景中的变化逐渐地被同化成背景模型。这一权重可以调整，以改变背景模型适应输入图像中的变化的速率。
假定，所考虑的对象与背景的亮度不同。为了在每一时间步骤都找到对象，从背景的模型图像中减去当前视频输入。如果在某一特定区域这一差值的绝对值大于特定阈值，那么把这一区域归类为对象；否则，把它归类为背景。
第二部分可以是任何这样一种程序，它把图像的对象/背景归类(可能还要加上其他数据)作为输入，并可能实时输出基于这一输入的视频图像。这一程序可以采取无限多种形式，因此可以象计算机应用那样广义进行定义。例如，这一组件可以象按所检测对象的形状来产生照射圈那样简单，或者可以象通过被检测为对象的人所作姿态所控制的画图程序那样复杂。此外，有些应用可以采用其他输入形式，比如声音、温度、键盘输入等，还可以采用其他输出形式，比如音频、触觉、虚拟现实、香味等。
一类主要应用包括一些使用这种对象/背景类别作为输入的特殊效果。例如，在输出视频图像中，可以在被归类为“对象”的区域的随机部分中画上一些星号、线条或其他形状。于是，可以将这些形状设置成随时间逐渐衰弱，这样，当人走来走去时其身后将留下瞬时踪迹。下面是同一种类中的其他效果的一些例子：
-对象周围的轮廓和波纹
-由于对象存在所造成变形的栅格
-火焰和风的仿真以及应用于对象的其他模型卷绕
-随单独检测到的音乐节拍跳动的特殊效果
另一类主要应用可以使实际对象与虚拟对象和角色进行交互。例如，可以编排出一种表示一群小鸭子的图像跟随在显示的前面所行走的任何实际对象(例如人)的后面。
此外，在摄像机前面活动的人可以玩的计算机游戏还可以形成另一类应用。
然而，这种列举并不是排他的；由于这一组件可被设计成是可编程的，因此这一组件能运行任何应用。
来自前一组件的处理软件的输出被可视地显示。可能的显示包括视频投影仪、电视机、等离子体显示和激光显示，但并不局限于此。所显示的图像可以与视频摄像机的输入范围相一致，这样，视频效果与导致这种效果的人的区域相一致。由于视频摄像机的某些配置可以用不可见光来检测对象，因此，可以避免对摄像机有干扰的显示的问题。
对于不同的组件，有很多种可能的配置。例如，摄像机和视频投影仪可以在同一位置并指向同一方向。于是，摄像机和投影仪可以如图1中所示指向墙面，如图2中所示指向地面、用一面镜子重新定向，或者指向其他任何表面。此外，投影仪可以如图3所示置于屏幕后面，这样显示与图1中的显示完全相同，但是，由于人不再在投影途中，因此人就不会投射出一个影子。此外，还可以如图4中所示使投影仪与屏幕成一个倾斜角来避免这种影子。视频显示还可以是大屏幕TV、等离子体显示或视频墙。尽管上述配置都有与视频输入排成一线的视频显示，然而未必如此；视频显示可以置于任何地方。上述列举并不是详尽的；还可以有许多种其他可能的配置。
整个系统可以被联网，从而使视觉信息和处理软件状态信息可以在系统之间进行交换。因此，从一个系统的视觉信号中检测出的对象可以影响另一个系统中的处理软件。此外，一个系统的显示中的虚拟项目可以移动到其他系统中。如果多个系统的显示被排列在一起从而构成单个大型显示，那么，可以使多个系统起到他们好象是单个大型系统的作用，于是对象和交互作用可以无缝地跨越显示边界。
视觉系统的一个共同的问题是，在存在着来自与摄像机相比角度差别很大的无法控制的环境照射(如日光)对摄像机的可视区进行照射的情况下，对象会在背景上投射出影子。如果这些影子足够强，那么视觉系统可能将它们误解为对象。通过频闪摄像机的光源可以检测和去除这些影子。通过从既有环境光又有摄像机的光的摄像机输入图像中减去只有单独环境光的摄像机输入图像，系统可以产生捕捉了场景的图像，就好象只用了摄像机的光，因此，消除了从环境光中可检测到的影子。
利用图案照射或图案标记，可以得到在用摄像机所捕捉到的图像来检测对象时的附加精度。
对于计算机视觉，利用简单的泛光照射系统的一个缺点在于，如果摄像机观察到的一些对象的色彩很相似，那么，这些对象可能很难以检测出。如果摄像机以单色进行操作，那么，对象和背景看上去更有可能相同。
利用图案对象来覆盖摄像机的可视区可以改善对象检测。如果使用一种含有混合的很接近的两种或两种以上的色彩的图案，那么，其他对象几乎不可能有相似的外观，这是因为这种图案至少有一种色彩看上去与周围的对象的色彩不同。如果将图案对象(比如屏幕)在要被检测的对象之前作为背景，那么，利用视觉算法更容易检测出从该图案屏幕前面通过的对象。
例如，在红外视觉应用中，图案对象可以是一种人眼感觉是白色的背景垫层，但含有人眼看不见的而摄像机却可见的明暗多变的图案。利用一种不可见光谱的图案，该图案垫层不会干扰系统的美观。显示系统(例如投影视频)可以将输出图像投影到该垫层上，如上所述。可以为在处理系统(比如计算机系统)上执行的过程提供背景图案，从而使得更容易地检测垫层前面的对象，尽管该系统可能要以视觉算法学习其他任何背景同样的方法来学习这种图案背景。此外，不会对系统适应背景光亮度变化的能力产生不利影响。
图案照射还可以从光源投影到摄像机的可视区。只要摄像机和不可见光源具有不同的偏移位置，当对象穿过摄像机的可视区时，视差效果就会导致摄像机对投影图案的观察失真。这种失真有助于使得具有相似色彩的对象彼此突显。如果获得摄像机所看到的两个图像之间的差别，结果将可以显示在这两个图像之间所出现、消失或活动的任何对象的形状。如果从单独背景的图像中减去背景前面的对象的图像，那么，得到的结果是一个背景所在地为零而其他对象所在地为非零的图像。这种技术可以与这里所讨论的本发明的其他方面组合起来进行应用。
图案光源可以通过若干种方法来实现。一种方法是在幻灯投影仪中使用红外发光二极管(LED)簇或其他不可见光源。可以用一组透镜来聚焦穿过含有所需图案的幻灯片的光源，从而将图案的图像投射到摄像机的可视区。在另一种方法中，可以将红外激光束照射到激光图案发生器或其他散射器件上，以便在摄像机的可视区上产生光图案。光可以被偏转、遮光、扫描等，以便得到一个图案。还有许多其他可行的方法。
图案光源还可以用于3-D计算机视觉。3-D计算机视觉技术(比如Marr-Poggio算法)把从略微不同的角度得到的同一场景的两个图像取为输入。使这些图像上的图案相配，以确定图像中每个点的偏移量，从而确定与摄像机的距离。这种算法在处理统一色彩的对象时其性能会降低，这是因为，统一色彩使得在图像对中难以使相应的部分相配。因此，图案光源可以改善某些3D计算机视觉算法的距离估算。
进入这些3-D计算机视觉算法的两个输入图像通常用指向场景的一对摄像机来产生。不过，也可能只用一台摄像机。第二个图像可以是提前知道的投影图案的完全不失真形式。这种图案的图像基本上与第二摄像机看到的情况完全相同(只要该摄像机置于与图案光源完全相同的位置)。因此，单个摄像机的观察与投影图案可以一起作为3-D视觉算法的输入。此外，第二图像可以是取自同一摄像机的单独背景的图像。
尽管可以使用许多不同种类的图案，然而，高分辨率的随机点图案无论对2-D还是对3-D视觉都有某些优点。由于点图案的随机性，点图案的每一个相当大的部分几乎不可能看似图案的其他任何部分。因此，对象在视区中出现所导致的置换图案几乎不可能看似没有对象的图案。这最大程度地提高了视觉算法检测出图案中的置换部分的能力，因此也最大程度地提高了检测出对象的能力。使用有规则的图案(比如栅格)可能带来某些困难，这是因为，图案的不同部分是完全相同的，从而会使置换图案经常看似非置换图案。
图5A-D表示在检测对象时随机点图案的有效性。图5A表示普通照射情况下一个人的帧。这个人具有与背景相似的亮度从而难以检测。在图5B中，随机点图案从摄像机旁边的光源投影到背景上。当人站在这一图案的前面时，用人的反射图案来置换，如图5C中所示。通过获得图5B和5C中的图像之间的差别，可以得到图5D的图像，该图像用一种强信号确定了这个人的图像区。
此外，还可以用其他方法来改善对象检测。例如，光源可以被频闪，即周期性的开启和关掉，这样使得可以更容易地检测出起因于其他光源(例如环境光)的影子。
一旦对象被检测和确定，这种优选实施方式就可以使用梯度流(aura)来确定对象与所显示图像项目的交互作用的程度和方向。
图6A表示与视频对象交互的人用户。
图6A中，对象304已经被检测到并以轮廓形式被显示。在计算机的处理中，该对象的一种表示可以采用图6A中所示轮廓定义。视频屏幕302显示了几个图像项目，比如球状物的图像306。
图6B表示图6A的308的区域的感应图像。
在图6B中，利用用户的脚320的轮廓图像和小腿来连续地产生更大的轮廓区，原轮廓区320的区域被赋以一个与白色相应的大的像素亮度值。每个连续的轮廓区322、324、326、328、330都被赋以一个逐级降低的值，这样，离初始轮廓(白色)区越远的点将具有越小的像素值。注意，可以使用任意多个轮廓区。此外，轮廓区的大小和增量值可以根据需要而变化。例如，可以使用连续梯度，而不是离散区。所有轮廓区的集合称为“感应图像”。
将感应图像与不同的图像项目进行比较。在图6B中，球状项目306触及到梯度区326、328和330。如技术人员所知，对于所触及到的区，按像素值场的梯度方向确定方向线。图6B在项目306中示出了三例方向线。方向线可以是例如通过平均被合成的，或者可以选用单一线。这种处理还检测出项目所触及到的最亮轮廓区是轮廓区326。此外，还可以采用其他方法。例如，可以在图像项目的区中的每个点上或这些点的子集上对亮度和梯度进行平均。此外，某些实施方式除了包括作为要素的亮度和梯度之外还可以包括接触的持续时间。
一个对象(比如一个人)与屏幕上的一个项目之间的交互作用可利用触及到的轮廓区的亮度和方向来计算，其中方向是利用一条或多条方向线求得的。所触及的亮度与用户“触及”项目所用的强度相应。梯度相应于项目被触及的方向(或反向，这取决于计算的符号)。
尽管本发明参照其具体实施方式进行了讨论，然而，这些实施方式是本发明的举例说明而并不是限定性的。例如，尽管这些优选实施方式用摄像机作为检测器，然而，还可以使用不同类型的检测设备。该摄像机可以是数字或模拟的。可以用立体的摄像机，以便提供深度信息和位置。在不是实时进行处理和显示的情况下，可以使用胶片或其他类型的媒体，再进行数字转换，然后再将数据输入到处理器。可以使用光传感器或检测器。例如，可以使用一组光电探测器来代替摄像机。此外，还可以使用这里没有考虑到的具有合适结果的其他检测器。
通常，本发明可以使用任何类型的显示设备。例如，尽管这里在不同的实施方式和配置中描述了一些视频设备，然而，还可以使用其他类型的视觉显示设备。可以使用发光二极管(LED)阵列、有机LED(OLED)、发光聚合体(LEP)、电磁、阴极射线、等离子体、机械或其他显示系统。
可以使用虚拟现实、三维或其他类型的显示。例如，用户可以戴上成像目镜或头罩，使得他们可以沉浸在所产生的环境中。利用这种方法，所产生的显示可以与用户对其所在环境的感觉相一致，以形成加强或增强的真实性。一种实施方式可以使用户与角色的图像进行交互。该角色可以是计算机产生的，人动作者所扮演的，等等。该角色可以对用户的动作和身体位置作出反应。交互包括语音、对象的共同操作等。
多个系统可以通过例如数字网络进行相互连接。例如，可以使用以太网、通用串行总线(USB)、IEEE 1394(火热线)等。可以使用诸如802.11b所定义的无线通信链路。通过使用多个系统，不同地理位置的用户可以通过所产生的图像相互进行协作、比赛或者交互。两个或两个以上的系统所产生的图像可以被“平铺”在一起，或者被组合以产生集成显示。
此外，还可以使用与光不同的其他类型的照射。例如，可以使用雷达信号、微波或其他电磁波，这有利于检测的对象(例如金属对象)对这些波具有强反射的情况。例如在空中或水中通过使用声波可以使这种系统的一些方面适用于其他形式的检测。
尽管描述了用计算机系统来接收和处理对象图像信号并产生显示信号，然而，还可以使用其他任何类型的处理系统。例如，可以使用一种没有使用通用计算机的处理系统。有这样一些系统可以适用于本发明，这些系统的设计基于定制或半定制电路或芯片、专用集成电路(ASIC)、现场可编程门阵列(FPGA)、多处理器、异步或任何类型的结构设计或方法。
因此，本发明的范围只由附属权利要求书来确定。

Claims (36)

1.一种用于检测对象和相应地产生一个显示的系统，该系统包括：
第一源，用于输出第一波长范围的电磁能量；
检测器，用于检测对象对该电磁能量的第一源的反射；
与检测器连接的处理器，利用检测到的反射产生一个显示信号；
第二源，用于输出第二波长范围的电磁能量，其中第二源根据所述显示信号产生一个可见显示，其中第一和第二波长范围是不同的。
2.权利要求1的系统，其中第一源输出不可见光谱的光，而其中第二源输出可见光谱的光。
3.权利要求2的系统，其中第一源输出红外光。
4.权利要求1的系统，其中第二源包括视频投影仪。
5.权利要求4的系统，其中视频投影仪从对象上方投影图像。
6.权利要求4的系统，其中视频投影仪将图像投影到一个与对象邻近的表面上。
7.权利要求6的系统，其中该表面是背面投影系统的一部分。
8.权利要求6的系统，其中该表面是前面投影系统的一部分。
9.权利要求1的系统，其中对象包括人用户。
10.权利要求1的系统，其中第一源包括一种照射图案。
11.权利要求10的系统，其中该图案包括随机点图案。
12.权利要求10的系统，还包括：
红外发光二极管簇，用于产生所述照射图案。
13.权利要求1的系统，还包括：
用于确定感应图像的过程，其中感应图像包括一个在从对象得到的对象图像周围的区域。
14.权利要求13的系统，其中可见显示包括一个项目，该系统还包括：
用于确定感应图像的梯度的过程；和
利用该梯度来确定所述对象与项目之间的交互作用的过程。
15.权利要求1的系统，其中可见显示包括角色的呈现。
16.一种用于获得人用户的图像的方法，其中，人用户邻近显示的图像，该方法包括：
利用第一波长的光来照射人用户；
利用对第一波长的光响应的摄像机来检测人用户的图像；和
利用与第一波长不同的第二波长的光来产生所显示的图像。
17.权利要求16的方法，其中使用多台摄像机。
18.权利要求17的方法，其中使用至少两台摄像机来产生立体效果。
19.权利要求16的方法，其中使用等离子体屏幕来产生所显示的图像。
20.权利要求16的方法，其中所显示的图像包括广告。
21.权利要求16的方法，其中所显示的图像是视频游戏的一部分。
22.权利要求16的方法，还包括：
频闪第一波长的光。
23.权利要求16的方法，还包括：
将多个系统相互连接，使得可以在各系统之间传送关于图像检测和显示的信息。
24.权利要求23的方法，还包括：
利用所传送的信息，由两个或两个以上的显示形成单个显示。
25.一种用于检测摄像机所捕捉到的图像中的对象的方法，该方法包括：
利用图案照射来照射背景而不照射对象；和
利用一种处理系统从背景中分离出对象。
26.权利要求25的系统，其中图案照射包括随机点图案。
27.权利要求25的系统，其中图案照射包括棋盘格图案。
28.权利要求25的系统，其中图案照射也照射对象。
29.一种用于检测摄像机所捕捉到的图像中的对象的方法，该方法包括：
使用图案背景；和
利用一种处理系统从背景中分离出对象。
30.一种用于计算对象与视频项目的交互作用的方法，该方法包括：
利用一种处理器来确定对象的梯度；
利用一种处理器来确定视频项目的边界；和
利用该梯度和边界来识别交互作用。
31.权利要求30的系统，还包括：
利用一种处理器来确定从对象得到的一个区的亮度；和
利用该区的亮度和边界来识别交互作用。
32.权利要求30的系统，其中交互作用是人推动该项目。
33.权利要求30的系统，其中交互作用是人触及该项目。
34.权利要求30的系统，其中交互作用是人使该项目变形。
35.权利要求30的系统，其中交互作用是人操纵该项目。
36.一种用于检测对象和相应地产生一个输出的系统，该系统包括：
第一源，用于输出第一波长范围的电磁能量；
检测器，用于检测对象对该电磁能量的第一源的反射；
与检测器连接的处理器，利用检测到的反射产生一个显示信号；
第二源，用于输出第二波长范围的电磁能量，其中第二源根据所述显示信号产生一个可见显示，其中第一和第二波长范围是不同的；和
音频输出，用于输出音频。
CN028152069A 2001-06-05 2002-06-04 交互式视频显示系统 Expired - Lifetime CN1582567B (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US29618901P 2001-06-05 2001-06-05
US60/296,189 2001-06-05
US10/160,217 US7259747B2 (en) 2001-06-05 2002-05-28 Interactive video display system
US10/160,217 2002-05-28
PCT/US2002/017843 WO2002100094A2 (en) 2001-06-05 2002-06-04 Interactive video display system

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN201010266853.1A Division CN102033608B (zh) 2001-06-05 2002-06-04 交互式视频显示系统

Publications (2)

Publication Number Publication Date
CN1582567A true CN1582567A (zh) 2005-02-16
CN1582567B CN1582567B (zh) 2010-10-13

Family

ID=26856697

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201010266853.1A Expired - Lifetime CN102033608B (zh) 2001-06-05 2002-06-04 交互式视频显示系统
CN028152069A Expired - Lifetime CN1582567B (zh) 2001-06-05 2002-06-04 交互式视频显示系统

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN201010266853.1A Expired - Lifetime CN102033608B (zh) 2001-06-05 2002-06-04 交互式视频显示系统

Country Status (14)

Country Link
US (2) US7259747B2 (zh)
EP (1) EP1393549B1 (zh)
JP (1) JP4077787B2 (zh)
KR (1) KR100847795B1 (zh)
CN (2) CN102033608B (zh)
AT (1) ATE336860T1 (zh)
BR (1) BR0210162A (zh)
CA (1) CA2449300C (zh)
DE (1) DE60213975T2 (zh)
ES (1) ES2271272T3 (zh)
IL (1) IL159207A0 (zh)
MX (1) MXPA03011203A (zh)
RU (1) RU2298294C2 (zh)
WO (1) WO2002100094A2 (zh)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100359437C (zh) * 2005-05-11 2008-01-02 凌阳科技股份有限公司 交互式影像游戏系统
CN101306249B (zh) * 2008-05-30 2011-09-14 北京中星微电子有限公司 动作分析装置和方法
CN102637397A (zh) * 2012-05-02 2012-08-15 大连工业大学 一种具有照明功能的互动媒体设施
CN102741781A (zh) * 2009-12-04 2012-10-17 奈克斯特控股公司 用于位置探测的传感器方法和系统
CN103019014A (zh) * 2011-09-22 2013-04-03 卡西欧计算机株式会社 投影装置以及投影控制方法
CN103141080A (zh) * 2010-09-23 2013-06-05 索尼电脑娱乐公司 使用热成像的用户接口系统和方法
CN103548073A (zh) * 2011-05-25 2014-01-29 皇家飞利浦有限公司 用于表面的识别系统
CN105824173A (zh) * 2015-01-27 2016-08-03 财团法人工业技术研究院 交互式投影仪及其用于确定对象的深度信息的操作方法
CN105850116A (zh) * 2013-12-27 2016-08-10 索尼公司 控制装置、控制方法和计算机程序
CN106055082A (zh) * 2015-04-10 2016-10-26 三星电子株式会社 用于基于事件显示屏幕的装置和方法
CN107002203A (zh) * 2015-08-19 2017-08-01 新日铁住金高新材料株式会社 不锈钢箔
CN107002209A (zh) * 2015-08-17 2017-08-01 新日铁住金高新材料株式会社 铁素体系不锈钢箔
CN109107149A (zh) * 2012-10-29 2019-01-01 索尼电脑娱乐公司 经由控制台的环境光控制和校准
CN110996080A (zh) * 2014-04-22 2020-04-10 日本电信电话株式会社 视频呈现装置、视频呈现方法、数据结构以及程序
CN114650365A (zh) * 2020-12-18 2022-06-21 丰田自动车株式会社 图像显示系统

Families Citing this family (533)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8352400B2 (en) 1991-12-23 2013-01-08 Hoffberg Steven M Adaptive pattern recognition based controller apparatus and method and human-factored interface therefore
US7966078B2 (en) 1999-02-01 2011-06-21 Steven Hoffberg Network media appliance system and method
US6982649B2 (en) 1999-05-04 2006-01-03 Intellimats, Llc Floor display system with interactive features
US7009523B2 (en) * 1999-05-04 2006-03-07 Intellimats, Llc Modular protective structure for floor display
US8300042B2 (en) 2001-06-05 2012-10-30 Microsoft Corporation Interactive video display system using strobed light
US8035612B2 (en) 2002-05-28 2011-10-11 Intellectual Ventures Holding 67 Llc Self-contained interactive video display system
US7259747B2 (en) 2001-06-05 2007-08-21 Reactrix Systems, Inc. Interactive video display system
US7088684B2 (en) * 2001-07-16 2006-08-08 International Business Machines Corporation Methods and arrangements for dynamically modifying subsource address multicast data distribution trees
US20030063052A1 (en) * 2001-09-28 2003-04-03 Rebh Richard G. Methods and systems of conveying information with an electroluminescent display
US6990639B2 (en) 2002-02-07 2006-01-24 Microsoft Corporation System and process for controlling electronic components in a ubiquitous computing environment using multimodal integration
US7710391B2 (en) 2002-05-28 2010-05-04 Matthew Bell Processing an image utilizing a spatially varying pattern
US20050122308A1 (en) * 2002-05-28 2005-06-09 Matthew Bell Self-contained interactive video display system
US7646372B2 (en) * 2003-09-15 2010-01-12 Sony Computer Entertainment Inc. Methods and systems for enabling direction detection when interfacing with a computer program
US7775883B2 (en) * 2002-11-05 2010-08-17 Disney Enterprises, Inc. Video actuated interactive environment
US7671843B2 (en) * 2002-11-12 2010-03-02 Steve Montellese Virtual holographic input method and device
WO2004055776A1 (en) 2002-12-13 2004-07-01 Reactrix Systems Interactive directed light/sound system
US20100262489A1 (en) * 2002-12-13 2010-10-14 Robert Salinas Mobile enabled advertising and marketing methods for computer games, simulations, demonstrations, and the like
US6840627B2 (en) 2003-01-21 2005-01-11 Hewlett-Packard Development Company, L.P. Interactive display device
JP3849654B2 (ja) * 2003-02-21 2006-11-22 株式会社日立製作所 投射型表示装置
US8745541B2 (en) 2003-03-25 2014-06-03 Microsoft Corporation Architecture for controlling a computer using hand gestures
US7665041B2 (en) 2003-03-25 2010-02-16 Microsoft Corporation Architecture for controlling a computer using hand gestures
US7428997B2 (en) * 2003-07-29 2008-09-30 Microvision, Inc. Method and apparatus for illuminating a field-of-view and capturing an image
IL157156A0 (en) * 2003-07-29 2004-08-31 Rafael Armament Dev Authority Predictive display for system having delayed feedback of a command issued
GB2406634A (en) * 2003-10-02 2005-04-06 Mathmos Ltd An object sensing lighting apparatus
EP1676442A2 (en) * 2003-10-24 2006-07-05 Reactrix Systems, Inc. Method and system for managing an interactive video display system
US7536032B2 (en) 2003-10-24 2009-05-19 Reactrix Systems, Inc. Method and system for processing captured image information in an interactive video display system
KR100588042B1 (ko) * 2004-01-14 2006-06-09 한국과학기술연구원 인터액티브 프레젠테이션 시스템
JP4559092B2 (ja) * 2004-01-30 2010-10-06 株式会社エヌ・ティ・ティ・ドコモ 携帯通信端末及びプログラム
JP2005276139A (ja) * 2004-02-23 2005-10-06 Aruze Corp 情報入力装置
CN100573548C (zh) * 2004-04-15 2009-12-23 格斯图尔泰克股份有限公司 跟踪双手运动的方法和设备
US7467380B2 (en) * 2004-05-05 2008-12-16 Microsoft Corporation Invoking applications with virtual objects on an interactive display
US20050265580A1 (en) * 2004-05-27 2005-12-01 Paul Antonucci System and method for a motion visualizer
JP2008506140A (ja) 2004-06-01 2008-02-28 マイケル エー． ベセリー 水平透視ディスプレイ
KR100616532B1 (ko) * 2004-06-07 2006-08-28 조열 광고 콘텐츠 제공방법
US7593593B2 (en) 2004-06-16 2009-09-22 Microsoft Corporation Method and system for reducing effects of undesired signals in an infrared imaging system
ATE532330T1 (de) * 2004-09-21 2011-11-15 Nikon Corp Projektoreinrichtung, mobiltelefon und kamera
US20060109274A1 (en) * 2004-10-28 2006-05-25 Accelerated Pictures, Llc Client/server-based animation software, systems and methods
US20060126926A1 (en) * 2004-11-30 2006-06-15 Vesely Michael A Horizontal perspective representation
US8508710B2 (en) 2004-12-02 2013-08-13 Hewlett-Packard Development Company, L.P. Display panel
EP3693889A3 (en) * 2005-01-07 2020-10-28 QUALCOMM Incorporated Detecting and tracking objects in images
US20070189544A1 (en) 2005-01-15 2007-08-16 Outland Research, Llc Ambient sound responsive media player
JP4689684B2 (ja) * 2005-01-21 2011-05-25 ジェスチャー テック，インコーポレイテッド 動作に基づくトラッキング
WO2006085834A1 (en) * 2005-01-28 2006-08-17 Microvision, Inc. Method and apparatus for illuminating a field-of-view and capturing an image
US20060170871A1 (en) * 2005-02-01 2006-08-03 Dietz Paul H Anti-blinding safety feature for projection systems
JP5631535B2 (ja) 2005-02-08 2014-11-26 オブロング・インダストリーズ・インコーポレーテッド ジェスチャベースの制御システムのためのシステムおよび方法
US7760962B2 (en) * 2005-03-30 2010-07-20 Casio Computer Co., Ltd. Image capture apparatus which synthesizes a plurality of images obtained by shooting a subject from different directions, to produce an image in which the influence of glare from a light is reduced
JP5542330B2 (ja) * 2005-04-05 2014-07-09 グーグル・インコーポレーテッド ビデオゲームからの広告表示の監査された報告をサポートする方法およびシステム
US9128519B1 (en) 2005-04-15 2015-09-08 Intellectual Ventures Holding 67 Llc Method and system for state-based control of objects
US20060241864A1 (en) * 2005-04-22 2006-10-26 Outland Research, Llc Method and apparatus for point-and-send data transfer within an ubiquitous computing environment
US20060250391A1 (en) 2005-05-09 2006-11-09 Vesely Michael A Three dimensional horizontal perspective workstation
US8717423B2 (en) 2005-05-09 2014-05-06 Zspace, Inc. Modifying perspective of stereoscopic images based on changes in user viewpoint
US20060262188A1 (en) * 2005-05-20 2006-11-23 Oded Elyada System and method for detecting changes in an environment
US20060267952A1 (en) * 2005-05-26 2006-11-30 Steve Alcorn Interactive display table top
US8081822B1 (en) 2005-05-31 2011-12-20 Intellectual Ventures Holding 67 Llc System and method for sensing a feature of an object in an interactive video display
JP2007017364A (ja) * 2005-07-11 2007-01-25 Kyoto Univ シルエット抽出装置及び該方法並びに３次元形状データ生成装置及び該方法
US20070018989A1 (en) * 2005-07-20 2007-01-25 Playmotion, Llc Sensory integration therapy system and associated method of use
FR2889303B1 (fr) * 2005-07-26 2008-07-11 Airbus France Sas Procede de mesure d'une anomalie de forme sur un panneau d'une structure d'aeronef et systeme de mise en oeuvre
US8625845B2 (en) * 2005-08-06 2014-01-07 Quantum Signal, Llc Overlaying virtual content onto video stream of people within venue based on analysis of the people within the video stream
TWI412392B (zh) * 2005-08-12 2013-10-21 Koninkl Philips Electronics Nv 互動式娛樂系統及其操作方法
US7911444B2 (en) 2005-08-31 2011-03-22 Microsoft Corporation Input method for surface of interactive display
US20070063981A1 (en) * 2005-09-16 2007-03-22 Galyean Tinsley A Iii System and method for providing an interactive interface
US8176101B2 (en) 2006-02-07 2012-05-08 Google Inc. Collaborative rejection of media for physical establishments
US7917148B2 (en) 2005-09-23 2011-03-29 Outland Research, Llc Social musical media rating system and method for localized establishments
US7697827B2 (en) 2005-10-17 2010-04-13 Konicek Jeffrey C User-friendlier interfaces for a camera
US8098277B1 (en) 2005-12-02 2012-01-17 Intellectual Ventures Holding 67 Llc Systems and methods for communication between a reactive video system and a mobile communication device
US20070145680A1 (en) * 2005-12-15 2007-06-28 Outland Research, Llc Shake Responsive Portable Computing Device for Simulating a Randomization Object Used In a Game Of Chance
AT503008B1 (de) * 2005-12-16 2008-09-15 Dobler & Stampfl Audite Oeg Interaktives optisches system und verfahren zum extrahieren und verwerten von interaktionen in einem optischen system
US7630002B2 (en) * 2007-01-05 2009-12-08 Microsoft Corporation Specular reflection reduction using multiple cameras
DE102006002602A1 (de) 2006-01-13 2007-07-19 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Kalibrierungsverfahren und Kalibrierungssystem
WO2007088942A1 (ja) * 2006-02-03 2007-08-09 Matsushita Electric Industrial Co., Ltd. 入力装置、及びその方法
US8531396B2 (en) 2006-02-08 2013-09-10 Oblong Industries, Inc. Control system for navigating a principal dimension of a data space
US9823747B2 (en) 2006-02-08 2017-11-21 Oblong Industries, Inc. Spatial, multi-modal control device for use with spatial operating system
US9075441B2 (en) * 2006-02-08 2015-07-07 Oblong Industries, Inc. Gesture based control using three-dimensional information extracted over an extended depth of field
US8537111B2 (en) 2006-02-08 2013-09-17 Oblong Industries, Inc. Control system for navigating a principal dimension of a data space
US9910497B2 (en) * 2006-02-08 2018-03-06 Oblong Industries, Inc. Gestural control of autonomous and semi-autonomous systems
US8370383B2 (en) 2006-02-08 2013-02-05 Oblong Industries, Inc. Multi-process interactive systems and methods
US8537112B2 (en) * 2006-02-08 2013-09-17 Oblong Industries, Inc. Control system for navigating a principal dimension of a data space
ITRM20060136A1 (it) * 2006-03-10 2007-09-11 Link Formazione S R L Sistema multimediale interattivo
US8930834B2 (en) * 2006-03-20 2015-01-06 Microsoft Corporation Variable orientation user interface
WO2007107874A2 (en) * 2006-03-22 2007-09-27 Home Focus Development Ltd Interactive playmat
US8139059B2 (en) * 2006-03-31 2012-03-20 Microsoft Corporation Object illumination in a virtual environment
KR100742664B1 (ko) * 2006-05-10 2007-07-25 주식회사 플러 인터랙티브 영상의 디스플레이 시스템 및 방법
CN103778635B (zh) * 2006-05-11 2016-09-28 苹果公司 用于处理数据的方法和装置
US7724952B2 (en) * 2006-05-15 2010-05-25 Microsoft Corporation Object matting using flash and no-flash images
US8121361B2 (en) 2006-05-19 2012-02-21 The Queen's Medical Center Motion tracking system for real time adaptive imaging and spectroscopy
US7735730B2 (en) 2006-05-24 2010-06-15 International Business Machines Corporation System and method for state-based execution and recovery in a payment system
US20070292033A1 (en) * 2006-06-19 2007-12-20 Chao-Wang Hsiung Passive and interactive real-time image recognition software method
US8001613B2 (en) * 2006-06-23 2011-08-16 Microsoft Corporation Security using physical objects
US20080040692A1 (en) * 2006-06-29 2008-02-14 Microsoft Corporation Gesture input
JP5028038B2 (ja) * 2006-07-06 2012-09-19 クラリオン株式会社 車載表示装置および車載表示装置の表示方法
JP4707034B2 (ja) * 2006-07-07 2011-06-22 株式会社ソニー・コンピュータエンタテインメント 画像処理方法、入力インタフェース装置
US9696808B2 (en) 2006-07-13 2017-07-04 Northrop Grumman Systems Corporation Hand-gesture recognition method
US8180114B2 (en) * 2006-07-13 2012-05-15 Northrop Grumman Systems Corporation Gesture recognition interface system with vertical display
US8972902B2 (en) * 2008-08-22 2015-03-03 Northrop Grumman Systems Corporation Compound gesture recognition
US8589824B2 (en) * 2006-07-13 2013-11-19 Northrop Grumman Systems Corporation Gesture recognition interface system
US8234578B2 (en) * 2006-07-25 2012-07-31 Northrop Grumman Systems Corporatiom Networked gesture collaboration system
US20080028312A1 (en) * 2006-07-28 2008-01-31 Accelerated Pictures, Inc. Scene organization in computer-assisted filmmaking
WO2008014486A2 (en) * 2006-07-28 2008-01-31 Accelerated Pictures, Inc. Improved camera control
US8432448B2 (en) * 2006-08-10 2013-04-30 Northrop Grumman Systems Corporation Stereo camera intrusion detection system
US7693331B2 (en) * 2006-08-30 2010-04-06 Mitsubishi Electric Research Laboratories, Inc. Object segmentation using visible and infrared images
WO2008058277A2 (en) * 2006-11-09 2008-05-15 Smartdrive Systems, Inc. Video event recorders having integrated illumination sources
CN101636745A (zh) 2006-12-29 2010-01-27 格斯图尔泰克股份有限公司 使用增强型交互系统操纵虚拟对象
US8212857B2 (en) 2007-01-26 2012-07-03 Microsoft Corporation Alternating light sources to reduce specular reflection
JP5015270B2 (ja) * 2007-02-15 2012-08-29 クアルコム，インコーポレイテッド 点滅する電磁放射線を用いた入力
US8005238B2 (en) 2007-03-22 2011-08-23 Microsoft Corporation Robust adaptive beamforming with enhanced noise suppression
US9171399B2 (en) * 2013-03-12 2015-10-27 Autodesk, Inc. Shadow rendering in a 3D scene based on physical light sources
US20080252596A1 (en) * 2007-04-10 2008-10-16 Matthew Bell Display Using a Three-Dimensional vision System
US20080262909A1 (en) * 2007-04-18 2008-10-23 Microsoft Corporation Intelligent information display
WO2008134452A2 (en) 2007-04-24 2008-11-06 Oblong Industries, Inc. Proteins, pools, and slawx in processing environments
WO2008134745A1 (en) 2007-04-30 2008-11-06 Gesturetek, Inc. Mobile video-based therapy
US8005237B2 (en) 2007-05-17 2011-08-23 Microsoft Corp. Sensor array beamformer post-processor
US7808532B2 (en) 2007-05-29 2010-10-05 Microsoft Corporation Strategies for extracting foreground information using flash and no-flash image pairs
EP2017526A1 (en) * 2007-06-13 2009-01-21 Royal College Of Art Directable light
US20080316432A1 (en) * 2007-06-25 2008-12-25 Spotless, Llc Digital Image Projection System
US20110001935A1 (en) * 2007-06-25 2011-01-06 Spotless, Llc Digital image projection system
US8726194B2 (en) 2007-07-27 2014-05-13 Qualcomm Incorporated Item selection using enhanced control
US20090059094A1 (en) * 2007-09-04 2009-03-05 Samsung Techwin Co., Ltd. Apparatus and method for overlaying image in video presentation system having embedded operating system
JP5430572B2 (ja) 2007-09-14 2014-03-05 インテレクチュアル ベンチャーズ ホールディング ６７ エルエルシー ジェスチャベースのユーザインタラクションの処理
US8218811B2 (en) 2007-09-28 2012-07-10 Uti Limited Partnership Method and system for video interaction based on motion swarms
US20090086027A1 (en) * 2007-10-01 2009-04-02 Benjamin Antonio Chaykin Method And System For Providing Images And Graphics
US8629976B2 (en) 2007-10-02 2014-01-14 Microsoft Corporation Methods and systems for hierarchical de-aliasing time-of-flight (TOF) systems
US7874681B2 (en) * 2007-10-05 2011-01-25 Huebner Kenneth J Interactive projector system and method
US8139110B2 (en) * 2007-11-01 2012-03-20 Northrop Grumman Systems Corporation Calibration of a gesture recognition interface system
US9377874B2 (en) * 2007-11-02 2016-06-28 Northrop Grumman Systems Corporation Gesture recognition light and video image projector
US8159682B2 (en) 2007-11-12 2012-04-17 Intellectual Ventures Holding 67 Llc Lens system
US20090124382A1 (en) * 2007-11-13 2009-05-14 David Lachance Interactive image projection system and method
KR101079598B1 (ko) * 2007-12-18 2011-11-03 삼성전자주식회사 디스플레이장치 및 그 제어방법
US8166421B2 (en) * 2008-01-14 2012-04-24 Primesense Ltd. Three-dimensional user interface
US9035876B2 (en) 2008-01-14 2015-05-19 Apple Inc. Three-dimensional user interface session control
US8933876B2 (en) 2010-12-13 2015-01-13 Apple Inc. Three dimensional user interface session control
KR101335346B1 (ko) 2008-02-27 2013-12-05 소니 컴퓨터 엔터테인먼트 유럽 리미티드 장면의 심도 데이터를 포착하고, 컴퓨터 액션을 적용하기 위한 방법들
US20090219253A1 (en) * 2008-02-29 2009-09-03 Microsoft Corporation Interactive Surface Computer with Switchable Diffuser
US7946922B2 (en) 2008-03-05 2011-05-24 Howard Hung Yin Advertising funded gaming system
US8259163B2 (en) 2008-03-07 2012-09-04 Intellectual Ventures Holding 67 Llc Display with built in 3D sensing
US8194233B2 (en) 2008-04-11 2012-06-05 Microsoft Corporation Method and system to reduce stray light reflection error in time-of-flight sensor arrays
US9495013B2 (en) 2008-04-24 2016-11-15 Oblong Industries, Inc. Multi-modal gestural interface
US9740293B2 (en) 2009-04-02 2017-08-22 Oblong Industries, Inc. Operating environment with gestural control and multiple client devices, displays, and users
US9952673B2 (en) 2009-04-02 2018-04-24 Oblong Industries, Inc. Operating environment comprising multiple client devices, multiple displays, multiple users, and gestural control
US9684380B2 (en) 2009-04-02 2017-06-20 Oblong Industries, Inc. Operating environment with gestural control and multiple client devices, displays, and users
US8723795B2 (en) 2008-04-24 2014-05-13 Oblong Industries, Inc. Detecting, representing, and interpreting three-space input: gestural continuum subsuming freespace, proximal, and surface-contact modes
US10642364B2 (en) 2009-04-02 2020-05-05 Oblong Industries, Inc. Processing tracking and recognition data in gestural recognition systems
US9740922B2 (en) 2008-04-24 2017-08-22 Oblong Industries, Inc. Adaptive tracking system for spatial input devices
US8405727B2 (en) * 2008-05-01 2013-03-26 Apple Inc. Apparatus and method for calibrating image capture devices
US8595218B2 (en) 2008-06-12 2013-11-26 Intellectual Ventures Holding 67 Llc Interactive display management systems and methods
CN102112945B (zh) * 2008-06-18 2016-08-10 奥布隆工业有限公司 用于交通工具接口的基于姿态的控制系统
US8385557B2 (en) 2008-06-19 2013-02-26 Microsoft Corporation Multichannel acoustic echo reduction
US8345920B2 (en) * 2008-06-20 2013-01-01 Northrop Grumman Systems Corporation Gesture recognition interface system with a light-diffusive screen
US8325909B2 (en) 2008-06-25 2012-12-04 Microsoft Corporation Acoustic echo suppression
US8203699B2 (en) 2008-06-30 2012-06-19 Microsoft Corporation System architecture design for time-of-flight system having reduced differential pixel size, and time-of-flight systems so designed
US7515136B1 (en) 2008-07-31 2009-04-07 International Business Machines Corporation Collaborative and situationally aware active billboards
RU2461143C2 (ru) * 2008-08-13 2012-09-10 Александр Львович Шведов Способ создания эффекта виртуального присутствия с комбинированным видеоизображением
US8538084B2 (en) * 2008-09-08 2013-09-17 Apple Inc. Method and apparatus for depth sensing keystoning
WO2010027291A1 (ru) * 2008-09-08 2010-03-11 Rurin Oleg Stanislavovich Способ отображения информации
US8508671B2 (en) 2008-09-08 2013-08-13 Apple Inc. Projection systems and methods
US20100064213A1 (en) * 2008-09-10 2010-03-11 Zhou Ye Operation device for a graphical user interface
US8527908B2 (en) 2008-09-26 2013-09-03 Apple Inc. Computer user interface system and methods
US7881603B2 (en) * 2008-09-26 2011-02-01 Apple Inc. Dichroic aperture for electronic imaging device
US8610726B2 (en) * 2008-09-26 2013-12-17 Apple Inc. Computer systems and methods with projected display
US20100079426A1 (en) * 2008-09-26 2010-04-01 Apple Inc. Spatial ambient light profiling
TWI527429B (zh) * 2008-10-28 2016-03-21 皇家飛利浦電子股份有限公司 三維顯示系統
US9383814B1 (en) 2008-11-12 2016-07-05 David G. Capper Plug and play wireless video game
US10086262B1 (en) 2008-11-12 2018-10-02 David G. Capper Video motion capture for wireless gaming
US9586135B1 (en) 2008-11-12 2017-03-07 David G. Capper Video motion capture for wireless gaming
GB2466497B (en) 2008-12-24 2011-09-14 Light Blue Optics Ltd Touch sensitive holographic displays
US8903191B2 (en) * 2008-12-30 2014-12-02 Intel Corporation Method and apparatus for noise reduction in video
US8681321B2 (en) 2009-01-04 2014-03-25 Microsoft International Holdings B.V. Gated 3D camera
KR20100084338A (ko) * 2009-01-16 2010-07-26 삼성전자주식회사 이미지 드로잉 방법 및 장치
US8448094B2 (en) 2009-01-30 2013-05-21 Microsoft Corporation Mapping a natural input device to a legacy system
US20100199231A1 (en) 2009-01-30 2010-08-05 Microsoft Corporation Predictive determination
US9652030B2 (en) 2009-01-30 2017-05-16 Microsoft Technology Licensing, Llc Navigation of a virtual plane using a zone of restriction for canceling noise
US8267781B2 (en) 2009-01-30 2012-09-18 Microsoft Corporation Visual target tracking
US8295546B2 (en) 2009-01-30 2012-10-23 Microsoft Corporation Pose tracking pipeline
US8487938B2 (en) 2009-01-30 2013-07-16 Microsoft Corporation Standard Gestures
US8588465B2 (en) 2009-01-30 2013-11-19 Microsoft Corporation Visual target tracking
US8565476B2 (en) 2009-01-30 2013-10-22 Microsoft Corporation Visual target tracking
US8577085B2 (en) 2009-01-30 2013-11-05 Microsoft Corporation Visual target tracking
US8294767B2 (en) 2009-01-30 2012-10-23 Microsoft Corporation Body scan
US8565477B2 (en) 2009-01-30 2013-10-22 Microsoft Corporation Visual target tracking
US7996793B2 (en) 2009-01-30 2011-08-09 Microsoft Corporation Gesture recognizer system architecture
US8577084B2 (en) 2009-01-30 2013-11-05 Microsoft Corporation Visual target tracking
US8682028B2 (en) 2009-01-30 2014-03-25 Microsoft Corporation Visual target tracking
US8624962B2 (en) * 2009-02-02 2014-01-07 Ydreams—Informatica, S.A. Ydreams Systems and methods for simulating three-dimensional virtual interactions from two-dimensional camera images
US8773355B2 (en) 2009-03-16 2014-07-08 Microsoft Corporation Adaptive cursor sizing
US8988437B2 (en) 2009-03-20 2015-03-24 Microsoft Technology Licensing, Llc Chaining animations
US9256282B2 (en) 2009-03-20 2016-02-09 Microsoft Technology Licensing, Llc Virtual object manipulation
US8375311B2 (en) * 2009-03-24 2013-02-12 Disney Enterprises, Inc. System and method for determining placement of a virtual object according to a real-time performance
US8291328B2 (en) * 2009-03-24 2012-10-16 Disney Enterprises, Inc. System and method for synchronizing a real-time performance with a virtual object
ITRM20090153A1 (it) * 2009-04-01 2010-10-02 Stark Srl Modulo integrato di proiettore interattivo
US9313376B1 (en) 2009-04-01 2016-04-12 Microsoft Technology Licensing, Llc Dynamic depth power equalization
US10824238B2 (en) 2009-04-02 2020-11-03 Oblong Industries, Inc. Operating environment with gestural control and multiple client devices, displays, and users
US9317128B2 (en) 2009-04-02 2016-04-19 Oblong Industries, Inc. Remote devices used in a markerless installation of a spatial operating environment incorporating gestural control
US8942428B2 (en) 2009-05-01 2015-01-27 Microsoft Corporation Isolate extraneous motions
US8340432B2 (en) 2009-05-01 2012-12-25 Microsoft Corporation Systems and methods for detecting a tilt angle from a depth image
US8181123B2 (en) 2009-05-01 2012-05-15 Microsoft Corporation Managing virtual port associations to users in a gesture-based computing environment
US8638985B2 (en) * 2009-05-01 2014-01-28 Microsoft Corporation Human body pose estimation
US8503720B2 (en) 2009-05-01 2013-08-06 Microsoft Corporation Human body pose estimation
US20100277470A1 (en) * 2009-05-01 2010-11-04 Microsoft Corporation Systems And Methods For Applying Model Tracking To Motion Capture
US9377857B2 (en) 2009-05-01 2016-06-28 Microsoft Technology Licensing, Llc Show body position
US9498718B2 (en) 2009-05-01 2016-11-22 Microsoft Technology Licensing, Llc Altering a view perspective within a display environment
US9898675B2 (en) 2009-05-01 2018-02-20 Microsoft Technology Licensing, Llc User movement tracking feedback to improve tracking
US8660303B2 (en) 2009-05-01 2014-02-25 Microsoft Corporation Detection of body and props
US8649554B2 (en) 2009-05-01 2014-02-11 Microsoft Corporation Method to control perspective for a camera-controlled computer
US9015638B2 (en) 2009-05-01 2015-04-21 Microsoft Technology Licensing, Llc Binding users to a gesture based system and providing feedback to the users
US8253746B2 (en) 2009-05-01 2012-08-28 Microsoft Corporation Determine intended motions
US20100295782A1 (en) 2009-05-21 2010-11-25 Yehuda Binder System and method for control based on face ore hand gesture detection
US8379101B2 (en) 2009-05-29 2013-02-19 Microsoft Corporation Environment and/or target segmentation
US9400559B2 (en) 2009-05-29 2016-07-26 Microsoft Technology Licensing, Llc Gesture shortcuts
US8856691B2 (en) 2009-05-29 2014-10-07 Microsoft Corporation Gesture tool
US8744121B2 (en) 2009-05-29 2014-06-03 Microsoft Corporation Device for identifying and tracking multiple humans over time
US8320619B2 (en) 2009-05-29 2012-11-27 Microsoft Corporation Systems and methods for tracking a model
US9383823B2 (en) 2009-05-29 2016-07-05 Microsoft Technology Licensing, Llc Combining gestures beyond skeletal
US8625837B2 (en) 2009-05-29 2014-01-07 Microsoft Corporation Protocol and format for communicating an image from a camera to a computing environment
US8418085B2 (en) 2009-05-29 2013-04-09 Microsoft Corporation Gesture coach
US8693724B2 (en) 2009-05-29 2014-04-08 Microsoft Corporation Method and system implementing user-centric gesture control
US9182814B2 (en) 2009-05-29 2015-11-10 Microsoft Technology Licensing, Llc Systems and methods for estimating a non-visible or occluded body part
US8542252B2 (en) 2009-05-29 2013-09-24 Microsoft Corporation Target digitization, extraction, and tracking
US8509479B2 (en) 2009-05-29 2013-08-13 Microsoft Corporation Virtual object
US8487871B2 (en) 2009-06-01 2013-07-16 Microsoft Corporation Virtual desktop coordinate transformation
US8223196B2 (en) * 2009-06-10 2012-07-17 Disney Enterprises, Inc. Projector systems and methods for producing digitally augmented, interactive cakes and other food products
JP5553546B2 (ja) * 2009-07-07 2014-07-16 キヤノン株式会社 画像投影装置、及びその制御方法
US8390680B2 (en) 2009-07-09 2013-03-05 Microsoft Corporation Visual representation expression based on player expression
US9159151B2 (en) 2009-07-13 2015-10-13 Microsoft Technology Licensing, Llc Bringing a visual representation to life via learned input from the user
TW201104494A (en) * 2009-07-20 2011-02-01 J Touch Corp Stereoscopic image interactive system
US8616971B2 (en) 2009-07-27 2013-12-31 Obscura Digital, Inc. Automated enhancements for billiards and the like
US8847984B2 (en) * 2009-07-27 2014-09-30 Disney Enterprises, Inc. System and method for forming a composite image in a portable computing device having a dual screen display
US8727875B2 (en) * 2009-07-27 2014-05-20 Obscura Digital, Inc. Automated enhancements for billiards and the like
US8992315B2 (en) * 2009-07-27 2015-03-31 Obscura Digital, Inc. Automated enhancements for billiards and the like
KR101276199B1 (ko) * 2009-08-10 2013-06-18 한국전자통신연구원 시청자 참여의 ｉｐｔｖ 원격 방송 시스템 및 그 서비스 제공 방법
US8565479B2 (en) * 2009-08-13 2013-10-22 Primesense Ltd. Extraction of skeletons from 3D maps
US8264536B2 (en) 2009-08-25 2012-09-11 Microsoft Corporation Depth-sensitive imaging via polarization-state mapping
US9141193B2 (en) 2009-08-31 2015-09-22 Microsoft Technology Licensing, Llc Techniques for using human gestures to control gesture unaware programs
US8330134B2 (en) 2009-09-14 2012-12-11 Microsoft Corporation Optical fault monitoring
US8508919B2 (en) 2009-09-14 2013-08-13 Microsoft Corporation Separation of electrical and optical components
US8760571B2 (en) 2009-09-21 2014-06-24 Microsoft Corporation Alignment of lens and image sensor
US8976986B2 (en) 2009-09-21 2015-03-10 Microsoft Technology Licensing, Llc Volume adjustment based on listener position
US8428340B2 (en) 2009-09-21 2013-04-23 Microsoft Corporation Screen space plane identification
US9014546B2 (en) 2009-09-23 2015-04-21 Rovi Guides, Inc. Systems and methods for automatically detecting users within detection regions of media devices
US8502926B2 (en) * 2009-09-30 2013-08-06 Apple Inc. Display system having coherent and incoherent light sources
US8619128B2 (en) 2009-09-30 2013-12-31 Apple Inc. Systems and methods for an imaging system using multiple image sensors
US8452087B2 (en) 2009-09-30 2013-05-28 Microsoft Corporation Image selection techniques
US8723118B2 (en) 2009-10-01 2014-05-13 Microsoft Corporation Imager for constructing color and depth images
US8963829B2 (en) 2009-10-07 2015-02-24 Microsoft Corporation Methods and systems for determining and tracking extremities of a target
US7961910B2 (en) 2009-10-07 2011-06-14 Microsoft Corporation Systems and methods for tracking a model
US8564534B2 (en) 2009-10-07 2013-10-22 Microsoft Corporation Human tracking system
US8867820B2 (en) * 2009-10-07 2014-10-21 Microsoft Corporation Systems and methods for removing a background of an image
US8547327B2 (en) * 2009-10-07 2013-10-01 Qualcomm Incorporated Proximity object tracker
US9971807B2 (en) 2009-10-14 2018-05-15 Oblong Industries, Inc. Multi-process interactive systems and methods
US9933852B2 (en) 2009-10-14 2018-04-03 Oblong Industries, Inc. Multi-process interactive systems and methods
US9400548B2 (en) 2009-10-19 2016-07-26 Microsoft Technology Licensing, Llc Gesture personalization and profile roaming
US8988432B2 (en) 2009-11-05 2015-03-24 Microsoft Technology Licensing, Llc Systems and methods for processing an image for target tracking
US8843857B2 (en) 2009-11-19 2014-09-23 Microsoft Corporation Distance scalable no touch computing
US8672763B2 (en) 2009-11-20 2014-03-18 Sony Computer Entertainment Inc. Controller for interfacing with a computing program using position, orientation, or motion
US9244533B2 (en) 2009-12-17 2016-01-26 Microsoft Technology Licensing, Llc Camera navigation for presentations
US20110150271A1 (en) 2009-12-18 2011-06-23 Microsoft Corporation Motion detection using depth images
US8320621B2 (en) 2009-12-21 2012-11-27 Microsoft Corporation Depth projector system with integrated VCSEL array
US8687070B2 (en) * 2009-12-22 2014-04-01 Apple Inc. Image capture device having tilt and/or perspective correction
US9268404B2 (en) 2010-01-08 2016-02-23 Microsoft Technology Licensing, Llc Application gesture interpretation
US9019201B2 (en) * 2010-01-08 2015-04-28 Microsoft Technology Licensing, Llc Evolving universal gesture sets
US8631355B2 (en) 2010-01-08 2014-01-14 Microsoft Corporation Assigning gesture dictionaries
US8933884B2 (en) 2010-01-15 2015-01-13 Microsoft Corporation Tracking groups of users in motion capture system
US8334842B2 (en) 2010-01-15 2012-12-18 Microsoft Corporation Recognizing user intent in motion capture system
US8676581B2 (en) 2010-01-22 2014-03-18 Microsoft Corporation Speech recognition analysis via identification information
US8265341B2 (en) 2010-01-25 2012-09-11 Microsoft Corporation Voice-body identity correlation
KR101005599B1 (ko) * 2010-01-27 2011-01-05 주식회사 미디어프론트 인터랙티브 영상처리 시스템 및 방법, 그리고 인터랙티브 영상처리장치
US8864581B2 (en) 2010-01-29 2014-10-21 Microsoft Corporation Visual based identitiy tracking
US8717360B2 (en) * 2010-01-29 2014-05-06 Zspace, Inc. Presenting a view within a three dimensional scene
US8891067B2 (en) 2010-02-01 2014-11-18 Microsoft Corporation Multiple synchronized optical sources for time-of-flight range finding systems
US8619122B2 (en) 2010-02-02 2013-12-31 Microsoft Corporation Depth camera compatibility
US8687044B2 (en) 2010-02-02 2014-04-01 Microsoft Corporation Depth camera compatibility
US8717469B2 (en) 2010-02-03 2014-05-06 Microsoft Corporation Fast gating photosurface
US8499257B2 (en) 2010-02-09 2013-07-30 Microsoft Corporation Handles interactions for human—computer interface
US8659658B2 (en) 2010-02-09 2014-02-25 Microsoft Corporation Physical interaction zone for gesture-based user interfaces
US8633890B2 (en) 2010-02-16 2014-01-21 Microsoft Corporation Gesture detection based on joint skipping
NL2004273C2 (en) * 2010-02-22 2010-12-28 Valeri Mischenko Embedding humans and objects in virtual reality environments.
US8928579B2 (en) 2010-02-22 2015-01-06 Andrew David Wilson Interacting with an omni-directionally projected display
US8787663B2 (en) * 2010-03-01 2014-07-22 Primesense Ltd. Tracking body parts by combined color image and depth processing
JP5740822B2 (ja) * 2010-03-04 2015-07-01 ソニー株式会社 情報処理装置、情報処理方法およびプログラム
US8411948B2 (en) 2010-03-05 2013-04-02 Microsoft Corporation Up-sampling binary images for segmentation
US8655069B2 (en) 2010-03-05 2014-02-18 Microsoft Corporation Updating image segmentation following user input
US8422769B2 (en) 2010-03-05 2013-04-16 Microsoft Corporation Image segmentation using reduced foreground training data
US20110223995A1 (en) 2010-03-12 2011-09-15 Kevin Geisner Interacting with a computer based application
US8279418B2 (en) * 2010-03-17 2012-10-02 Microsoft Corporation Raster scanning for depth detection
US8213680B2 (en) 2010-03-19 2012-07-03 Microsoft Corporation Proxy training data for human body tracking
US8514269B2 (en) 2010-03-26 2013-08-20 Microsoft Corporation De-aliasing depth images
US8523667B2 (en) 2010-03-29 2013-09-03 Microsoft Corporation Parental control settings based on body dimensions
US8605763B2 (en) 2010-03-31 2013-12-10 Microsoft Corporation Temperature measurement and control for laser and light-emitting diodes
US9646340B2 (en) 2010-04-01 2017-05-09 Microsoft Technology Licensing, Llc Avatar-based virtual dressing room
US9098873B2 (en) 2010-04-01 2015-08-04 Microsoft Technology Licensing, Llc Motion-based interactive shopping environment
US8917905B1 (en) * 2010-04-15 2014-12-23 Don K. Dill Vision-2-vision control system
EP2378394A3 (en) * 2010-04-15 2015-03-25 Electronics and Telecommunications Research Institute User interface device and method for recognizing user interaction using same
US8351651B2 (en) 2010-04-26 2013-01-08 Microsoft Corporation Hand-location post-process refinement in a tracking system
US20110267264A1 (en) * 2010-04-29 2011-11-03 Mccarthy John Display system with multiple optical sensors
US8379919B2 (en) 2010-04-29 2013-02-19 Microsoft Corporation Multiple centroid condensation of probability distribution clouds
US8284847B2 (en) 2010-05-03 2012-10-09 Microsoft Corporation Detecting motion for a multifunction sensor device
US8885890B2 (en) 2010-05-07 2014-11-11 Microsoft Corporation Depth map confidence filtering
US8498481B2 (en) 2010-05-07 2013-07-30 Microsoft Corporation Image segmentation using star-convexity constraints
US8457353B2 (en) 2010-05-18 2013-06-04 Microsoft Corporation Gestures and gesture modifiers for manipulating a user-interface
US8594425B2 (en) 2010-05-31 2013-11-26 Primesense Ltd. Analysis of three-dimensional scenes
US8803888B2 (en) 2010-06-02 2014-08-12 Microsoft Corporation Recognition system for sharing information
US9008355B2 (en) 2010-06-04 2015-04-14 Microsoft Technology Licensing, Llc Automatic depth camera aiming
US8751215B2 (en) 2010-06-04 2014-06-10 Microsoft Corporation Machine based sign language interpreter
US9557574B2 (en) 2010-06-08 2017-01-31 Microsoft Technology Licensing, Llc Depth illumination and detection optics
US8330822B2 (en) 2010-06-09 2012-12-11 Microsoft Corporation Thermally-tuned depth camera light source
US8675981B2 (en) 2010-06-11 2014-03-18 Microsoft Corporation Multi-modal gender recognition including depth data
US9384329B2 (en) 2010-06-11 2016-07-05 Microsoft Technology Licensing, Llc Caloric burn determination from body movement
US8749557B2 (en) 2010-06-11 2014-06-10 Microsoft Corporation Interacting with user interface via avatar
US8982151B2 (en) 2010-06-14 2015-03-17 Microsoft Technology Licensing, Llc Independently processing planes of display data
US8670029B2 (en) 2010-06-16 2014-03-11 Microsoft Corporation Depth camera illuminator with superluminescent light-emitting diode
US8558873B2 (en) 2010-06-16 2013-10-15 Microsoft Corporation Use of wavefront coding to create a depth image
US8296151B2 (en) 2010-06-18 2012-10-23 Microsoft Corporation Compound gesture-speech commands
US8381108B2 (en) 2010-06-21 2013-02-19 Microsoft Corporation Natural user input for driving interactive stories
US8416187B2 (en) 2010-06-22 2013-04-09 Microsoft Corporation Item navigation using motion-capture data
EP2590396B1 (en) 2010-07-02 2018-08-08 Sony Interactive Entertainment Inc. Information processing system and information processing method
US9789392B1 (en) * 2010-07-09 2017-10-17 Open Invention Network Llc Action or position triggers in a game play mode
US9201501B2 (en) 2010-07-20 2015-12-01 Apple Inc. Adaptive projector
JP5791131B2 (ja) 2010-07-20 2015-10-07 アップル インコーポレイテッド 自然な相互作用のための相互作用的現実拡張
US8497897B2 (en) 2010-08-17 2013-07-30 Apple Inc. Image capture using luminance and chrominance sensors
US9075434B2 (en) 2010-08-20 2015-07-07 Microsoft Technology Licensing, Llc Translating user motion into multiple object responses
US8613666B2 (en) 2010-08-31 2013-12-24 Microsoft Corporation User selection and navigation based on looped motions
US20120058824A1 (en) 2010-09-07 2012-03-08 Microsoft Corporation Scalable real-time motion recognition
US8437506B2 (en) 2010-09-07 2013-05-07 Microsoft Corporation System for fast, probabilistic skeletal tracking
US8582867B2 (en) 2010-09-16 2013-11-12 Primesense Ltd Learning-based pose estimation from depth maps
US8538132B2 (en) 2010-09-24 2013-09-17 Apple Inc. Component concentricity
US8988508B2 (en) 2010-09-24 2015-03-24 Microsoft Technology Licensing, Llc. Wide angle field of view active illumination imaging system
US8959013B2 (en) 2010-09-27 2015-02-17 Apple Inc. Virtual keyboard for a non-tactile three dimensional user interface
US8681255B2 (en) 2010-09-28 2014-03-25 Microsoft Corporation Integrated low power depth camera and projection device
US9805617B2 (en) * 2010-09-29 2017-10-31 Hae-Yong Choi System for screen dance studio
US8548270B2 (en) 2010-10-04 2013-10-01 Microsoft Corporation Time-of-flight depth imaging
US9484065B2 (en) 2010-10-15 2016-11-01 Microsoft Technology Licensing, Llc Intelligent determination of replays based on event identification
US9195345B2 (en) * 2010-10-28 2015-11-24 Microsoft Technology Licensing, Llc Position aware gestures with visual feedback as input method
WO2012058782A1 (en) * 2010-11-01 2012-05-10 Technicolor(China) Technology Co., Ltd Method and device for detecting gesture inputs
US8592739B2 (en) 2010-11-02 2013-11-26 Microsoft Corporation Detection of configuration changes of an optical element in an illumination system
US8866889B2 (en) 2010-11-03 2014-10-21 Microsoft Corporation In-home depth camera calibration
US8667519B2 (en) 2010-11-12 2014-03-04 Microsoft Corporation Automatic passive and anonymous feedback system
US10726861B2 (en) 2010-11-15 2020-07-28 Microsoft Technology Licensing, Llc Semi-private communication in open environments
US9349040B2 (en) 2010-11-19 2016-05-24 Microsoft Technology Licensing, Llc Bi-modal depth-image analysis
GB2487043B (en) * 2010-12-14 2013-08-14 Epson Norway Res And Dev As Camera-based multi-touch interaction and illumination system and method
US10234545B2 (en) 2010-12-01 2019-03-19 Microsoft Technology Licensing, Llc Light source module
US8553934B2 (en) 2010-12-08 2013-10-08 Microsoft Corporation Orienting the position of a sensor
US8872762B2 (en) 2010-12-08 2014-10-28 Primesense Ltd. Three dimensional user interface cursor control
US8618405B2 (en) 2010-12-09 2013-12-31 Microsoft Corp. Free-space gesture musical instrument digital interface (MIDI) controller
US8408706B2 (en) 2010-12-13 2013-04-02 Microsoft Corporation 3D gaze tracker
US9171264B2 (en) 2010-12-15 2015-10-27 Microsoft Technology Licensing, Llc Parallel processing machine learning decision tree training
US8884968B2 (en) 2010-12-15 2014-11-11 Microsoft Corporation Modeling an object from image data
US8920241B2 (en) 2010-12-15 2014-12-30 Microsoft Corporation Gesture controlled persistent handles for interface guides
US8448056B2 (en) 2010-12-17 2013-05-21 Microsoft Corporation Validation analysis of human target
US8803952B2 (en) 2010-12-20 2014-08-12 Microsoft Corporation Plural detector time-of-flight depth mapping
US9823339B2 (en) 2010-12-21 2017-11-21 Microsoft Technology Licensing, Llc Plural anode time-of-flight sensor
US8385596B2 (en) 2010-12-21 2013-02-26 Microsoft Corporation First person shooter control with virtual skeleton
US9821224B2 (en) 2010-12-21 2017-11-21 Microsoft Technology Licensing, Llc Driving simulator control with virtual skeleton
US9848106B2 (en) 2010-12-21 2017-12-19 Microsoft Technology Licensing, Llc Intelligent gameplay photo capture
US8994718B2 (en) 2010-12-21 2015-03-31 Microsoft Technology Licensing, Llc Skeletal control of three-dimensional virtual world
US8845107B1 (en) * 2010-12-23 2014-09-30 Rawles Llc Characterization of a scene with structured light
US8905551B1 (en) 2010-12-23 2014-12-09 Rawles Llc Unpowered augmented reality projection accessory display device
US9123316B2 (en) 2010-12-27 2015-09-01 Microsoft Technology Licensing, Llc Interactive content creation
US8488888B2 (en) 2010-12-28 2013-07-16 Microsoft Corporation Classification of posture states
US8401242B2 (en) 2011-01-31 2013-03-19 Microsoft Corporation Real-time camera tracking using depth maps
US9247238B2 (en) 2011-01-31 2016-01-26 Microsoft Technology Licensing, Llc Reducing interference between multiple infra-red depth cameras
US8401225B2 (en) 2011-01-31 2013-03-19 Microsoft Corporation Moving object segmentation using depth images
US8587583B2 (en) 2011-01-31 2013-11-19 Microsoft Corporation Three-dimensional environment reconstruction
US8724887B2 (en) * 2011-02-03 2014-05-13 Microsoft Corporation Environmental modifications to mitigate environmental factors
US9285874B2 (en) 2011-02-09 2016-03-15 Apple Inc. Gaze detection in a 3D mapping environment
US8942917B2 (en) 2011-02-14 2015-01-27 Microsoft Corporation Change invariant scene recognition by an agent
US8497838B2 (en) 2011-02-16 2013-07-30 Microsoft Corporation Push actuation of interface controls
US9551914B2 (en) 2011-03-07 2017-01-24 Microsoft Technology Licensing, Llc Illuminator with refractive optical element
US9067136B2 (en) 2011-03-10 2015-06-30 Microsoft Technology Licensing, Llc Push personalization of interface controls
DE202011108622U1 (de) * 2011-03-11 2012-01-23 Automate Images Gmbh Vorrichtung zur freigestellten Abbildung eines Objekts
US8571263B2 (en) 2011-03-17 2013-10-29 Microsoft Corporation Predicting joint positions
US9470778B2 (en) 2011-03-29 2016-10-18 Microsoft Technology Licensing, Llc Learning from high quality depth measurements
US9760566B2 (en) 2011-03-31 2017-09-12 Microsoft Technology Licensing, Llc Augmented conversational understanding agent to identify conversation context between two humans and taking an agent action thereof
US9298287B2 (en) 2011-03-31 2016-03-29 Microsoft Technology Licensing, Llc Combined activation for natural user interface systems
US10642934B2 (en) 2011-03-31 2020-05-05 Microsoft Technology Licensing, Llc Augmented conversational understanding architecture
US9842168B2 (en) 2011-03-31 2017-12-12 Microsoft Technology Licensing, Llc Task driven user intents
KR20120113058A (ko) 2011-04-04 2012-10-12 한국전자통신연구원 현실-가상 융합 공간 기반의 교육 장치 및 방법
US8503494B2 (en) 2011-04-05 2013-08-06 Microsoft Corporation Thermal management system
US8824749B2 (en) 2011-04-05 2014-09-02 Microsoft Corporation Biometric recognition
US8620113B2 (en) 2011-04-25 2013-12-31 Microsoft Corporation Laser diode modes
US8702507B2 (en) 2011-04-28 2014-04-22 Microsoft Corporation Manual and camera-based avatar control
US9259643B2 (en) 2011-04-28 2016-02-16 Microsoft Technology Licensing, Llc Control of separate computer game elements
US10671841B2 (en) 2011-05-02 2020-06-02 Microsoft Technology Licensing, Llc Attribute state classification
US8888331B2 (en) 2011-05-09 2014-11-18 Microsoft Corporation Low inductance light source module
US9064006B2 (en) 2012-08-23 2015-06-23 Microsoft Technology Licensing, Llc Translating natural language utterances to keyword search queries
US9137463B2 (en) 2011-05-12 2015-09-15 Microsoft Technology Licensing, Llc Adaptive high dynamic range camera
US8786529B1 (en) 2011-05-18 2014-07-22 Zspace, Inc. Liquid crystal variable drive voltage
US8788973B2 (en) 2011-05-23 2014-07-22 Microsoft Corporation Three-dimensional gesture controlled avatar configuration interface
US8760395B2 (en) 2011-05-31 2014-06-24 Microsoft Corporation Gesture recognition techniques
US8526734B2 (en) 2011-06-01 2013-09-03 Microsoft Corporation Three-dimensional background removal for vision system
US9594430B2 (en) 2011-06-01 2017-03-14 Microsoft Technology Licensing, Llc Three-dimensional foreground selection for vision system
US9208571B2 (en) 2011-06-06 2015-12-08 Microsoft Technology Licensing, Llc Object digitization
US8929612B2 (en) 2011-06-06 2015-01-06 Microsoft Corporation System for recognizing an open or closed hand
US9098110B2 (en) 2011-06-06 2015-08-04 Microsoft Technology Licensing, Llc Head rotation tracking from depth-based center of mass
US9724600B2 (en) 2011-06-06 2017-08-08 Microsoft Technology Licensing, Llc Controlling objects in a virtual environment
US10796494B2 (en) 2011-06-06 2020-10-06 Microsoft Technology Licensing, Llc Adding attributes to virtual representations of real-world objects
US8897491B2 (en) 2011-06-06 2014-11-25 Microsoft Corporation System for finger recognition and tracking
US9013489B2 (en) 2011-06-06 2015-04-21 Microsoft Technology Licensing, Llc Generation of avatar reflecting player appearance
US8597142B2 (en) 2011-06-06 2013-12-03 Microsoft Corporation Dynamic camera based practice mode
US9597587B2 (en) 2011-06-08 2017-03-21 Microsoft Technology Licensing, Llc Locational node device
CN102221887B (zh) * 2011-06-23 2016-05-04 康佳集团股份有限公司 互动投影系统及方法
US8881051B2 (en) 2011-07-05 2014-11-04 Primesense Ltd Zoom-based gesture user interface
US9459758B2 (en) 2011-07-05 2016-10-04 Apple Inc. Gesture-based interface with enhanced features
US9377865B2 (en) 2011-07-05 2016-06-28 Apple Inc. Zoom-based gesture user interface
US9069164B2 (en) 2011-07-12 2015-06-30 Google Inc. Methods and systems for a virtual input device
US8228315B1 (en) 2011-07-12 2012-07-24 Google Inc. Methods and systems for a virtual input device
RU2486403C2 (ru) * 2011-07-28 2013-06-27 Александр Викторович Белокопытов Способ освещения изображения, система для освещения изображения и машиночитаемый носитель
CN103703763B (zh) 2011-07-29 2018-02-27 惠普发展公司，有限责任合伙企业 视觉分层的系统和方法
CN104024936A (zh) 2011-07-29 2014-09-03 惠普发展公司，有限责任合伙企业 投影捕获系统，程序和方法
US9521276B2 (en) 2011-08-02 2016-12-13 Hewlett-Packard Development Company, L.P. Portable projection capture device
US8971572B1 (en) 2011-08-12 2015-03-03 The Research Foundation For The State University Of New York Hand pointing estimation for human computer interaction
US9030498B2 (en) 2011-08-15 2015-05-12 Apple Inc. Combining explicit select gestures and timeclick in a non-tactile three dimensional user interface
US8786730B2 (en) 2011-08-18 2014-07-22 Microsoft Corporation Image exposure using exclusion regions
RU2486608C2 (ru) * 2011-08-23 2013-06-27 Федеральное государственное автономное образовательное учреждение высшего профессионального образования "Национальный исследовательский университет "МИЭТ" Устройство для организации интерфейса с объектом виртуальной реальности
US9122311B2 (en) 2011-08-24 2015-09-01 Apple Inc. Visual feedback for tactile and non-tactile user interfaces
US9218063B2 (en) 2011-08-24 2015-12-22 Apple Inc. Sessionless pointing user interface
WO2013032933A2 (en) 2011-08-26 2013-03-07 Kinecticor, Inc. Methods, systems, and devices for intra-scan motion correction
US9002099B2 (en) 2011-09-11 2015-04-07 Apple Inc. Learning-based estimation of hand and finger pose
JP2013061552A (ja) * 2011-09-14 2013-04-04 Ricoh Co Ltd プロジェクタ装置および操作検出方法
US9557836B2 (en) 2011-11-01 2017-01-31 Microsoft Technology Licensing, Llc Depth image compression
US9117281B2 (en) 2011-11-02 2015-08-25 Microsoft Corporation Surface segmentation from RGB and depth images
US8854426B2 (en) 2011-11-07 2014-10-07 Microsoft Corporation Time-of-flight camera with guided light
US8724906B2 (en) 2011-11-18 2014-05-13 Microsoft Corporation Computing pose and/or shape of modifiable entities
US9106903B2 (en) * 2011-11-18 2015-08-11 Zspace, Inc. Head tracking eyewear system
US8509545B2 (en) 2011-11-29 2013-08-13 Microsoft Corporation Foreground subject detection
US8803800B2 (en) 2011-12-02 2014-08-12 Microsoft Corporation User interface control based on head orientation
US8635637B2 (en) 2011-12-02 2014-01-21 Microsoft Corporation User interface presenting an animated avatar performing a media reaction
US9100685B2 (en) 2011-12-09 2015-08-04 Microsoft Technology Licensing, Llc Determining audience state or interest using passive sensor data
JP2015504204A (ja) * 2011-12-13 2015-02-05 アルカテル−ルーセント コンピュータアプリケーションの対話型制御の方法
US8630457B2 (en) 2011-12-15 2014-01-14 Microsoft Corporation Problem states for pose tracking pipeline
US8879831B2 (en) 2011-12-15 2014-11-04 Microsoft Corporation Using high-level attributes to guide image processing
US8971612B2 (en) 2011-12-15 2015-03-03 Microsoft Corporation Learning image processing tasks from scene reconstructions
US8811938B2 (en) 2011-12-16 2014-08-19 Microsoft Corporation Providing a user interface experience based on inferred vehicle state
US9342139B2 (en) 2011-12-19 2016-05-17 Microsoft Technology Licensing, Llc Pairing a computing device to a user
US9720089B2 (en) 2012-01-23 2017-08-01 Microsoft Technology Licensing, Llc 3D zoom imager
US9229534B2 (en) 2012-02-28 2016-01-05 Apple Inc. Asymmetric mapping for tactile and non-tactile user interfaces
CN104246682B (zh) 2012-03-26 2017-08-25 苹果公司 增强的虚拟触摸板和触摸屏
JP5550670B2 (ja) * 2012-03-28 2014-07-16 株式会社デンソーアイティーラボラトリ 情報処理装置
US8898687B2 (en) 2012-04-04 2014-11-25 Microsoft Corporation Controlling a media program based on a media reaction
US9025111B2 (en) 2012-04-20 2015-05-05 Google Inc. Seamless display panel using fiber optic carpet
US20130285919A1 (en) * 2012-04-25 2013-10-31 Sony Computer Entertainment Inc. Interactive video system
US9183676B2 (en) 2012-04-27 2015-11-10 Microsoft Technology Licensing, Llc Displaying a collision between real and virtual objects
US9047507B2 (en) 2012-05-02 2015-06-02 Apple Inc. Upper-body skeleton extraction from depth maps
US9210401B2 (en) 2012-05-03 2015-12-08 Microsoft Technology Licensing, Llc Projected visual cues for guiding physical movement
CA2775700C (en) 2012-05-04 2013-07-23 Microsoft Corporation Determining a future portion of a currently presented media program
IL219639A (en) 2012-05-08 2016-04-21 Israel Aerospace Ind Ltd Remote object tracking
KR20130140295A (ko) * 2012-06-14 2013-12-24 엘지이노텍 주식회사 거리측정 장치 및 방법
US9682321B2 (en) * 2012-06-20 2017-06-20 Microsoft Technology Licensing, Llc Multiple frame distributed rendering of interactive content
KR101911133B1 (ko) 2012-06-21 2018-10-23 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 깊이 카메라를 이용한 아바타 구성
US9836590B2 (en) 2012-06-22 2017-12-05 Microsoft Technology Licensing, Llc Enhanced accuracy of user presence status determination
SE1200428A1 (sv) * 2012-07-09 2012-10-22 Electrolux Ab Anordning för köket
US20140018169A1 (en) * 2012-07-16 2014-01-16 Zhong Yuan Ran Self as Avatar Gaming with Video Projecting Device
US9696427B2 (en) 2012-08-14 2017-07-04 Microsoft Technology Licensing, Llc Wide angle depth detection
KR20140029864A (ko) * 2012-08-30 2014-03-11 삼성디스플레이 주식회사 표시 장치 및 이를 이용한 에어 터치 인식 방법 및 이를 이용한 입체 영상 표시 방법
US8933970B2 (en) * 2012-09-11 2015-01-13 Longsand Limited Controlling an augmented reality object
TWI590099B (zh) * 2012-09-27 2017-07-01 緯創資通股份有限公司 互動系統及移動偵測方法
US9164596B1 (en) 2012-10-22 2015-10-20 Google Inc. Method and apparatus for gesture interaction with a photo-active painted surface
US9014417B1 (en) 2012-10-22 2015-04-21 Google Inc. Method and apparatus for themes using photo-active surface paint
US9195320B1 (en) 2012-10-22 2015-11-24 Google Inc. Method and apparatus for dynamic signage using a painted surface display system
US9019267B2 (en) 2012-10-30 2015-04-28 Apple Inc. Depth mapping with enhanced resolution
US8882310B2 (en) 2012-12-10 2014-11-11 Microsoft Corporation Laser die light source module with low inductance
TW201423484A (zh) * 2012-12-14 2014-06-16 Pixart Imaging Inc 動態偵測系統
TWI454968B (zh) 2012-12-24 2014-10-01 Ind Tech Res Inst 三維互動裝置及其操控方法
US9857470B2 (en) 2012-12-28 2018-01-02 Microsoft Technology Licensing, Llc Using photometric stereo for 3D environment modeling
EP2946361B1 (en) 2013-01-15 2018-01-03 Israel Aerospace Industries Ltd. Remote tracking of objects
IL224273B (en) 2013-01-17 2018-05-31 Cohen Yossi Delay compensation during remote sensor control
US10327708B2 (en) 2013-01-24 2019-06-25 Kineticor, Inc. Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan
US9717461B2 (en) 2013-01-24 2017-08-01 Kineticor, Inc. Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan
US9251590B2 (en) 2013-01-24 2016-02-02 Microsoft Technology Licensing, Llc Camera pose estimation for 3D reconstruction
US9305365B2 (en) 2013-01-24 2016-04-05 Kineticor, Inc. Systems, devices, and methods for tracking moving targets
US9782141B2 (en) 2013-02-01 2017-10-10 Kineticor, Inc. Motion tracking system for real time adaptive motion compensation in biomedical imaging
US9052746B2 (en) 2013-02-15 2015-06-09 Microsoft Technology Licensing, Llc User center-of-mass and mass distribution extraction using depth images
US9940553B2 (en) 2013-02-22 2018-04-10 Microsoft Technology Licensing, Llc Camera/object pose from predicted coordinates
US10134267B2 (en) 2013-02-22 2018-11-20 Universal City Studios Llc System and method for tracking a passive wand and actuating an effect based on a detected wand path
US9393695B2 (en) 2013-02-27 2016-07-19 Rockwell Automation Technologies, Inc. Recognition-based industrial automation control with person and object discrimination
US9804576B2 (en) 2013-02-27 2017-10-31 Rockwell Automation Technologies, Inc. Recognition-based industrial automation control with position and derivative decision reference
US9498885B2 (en) 2013-02-27 2016-11-22 Rockwell Automation Technologies, Inc. Recognition-based industrial automation control with confidence-based decision support
US9798302B2 (en) 2013-02-27 2017-10-24 Rockwell Automation Technologies, Inc. Recognition-based industrial automation control with redundant system input support
US9524028B2 (en) 2013-03-08 2016-12-20 Fastvdo Llc Visual language for human computer interfaces
US9135516B2 (en) 2013-03-08 2015-09-15 Microsoft Technology Licensing, Llc User body angle, curvature and average extremity positions extraction using depth images
US9092657B2 (en) 2013-03-13 2015-07-28 Microsoft Technology Licensing, Llc Depth image processing
US9274606B2 (en) 2013-03-14 2016-03-01 Microsoft Technology Licensing, Llc NUI video conference controls
US9953213B2 (en) 2013-03-27 2018-04-24 Microsoft Technology Licensing, Llc Self discovery of autonomous NUI devices
CN104076988B (zh) * 2013-03-27 2017-12-01 联想(北京)有限公司 一种显示方法、显示控制方法及电子设备
CN203165407U (zh) * 2013-04-16 2013-08-28 宋戈 自媒体玻璃橱窗
US9442186B2 (en) 2013-05-13 2016-09-13 Microsoft Technology Licensing, Llc Interference reduction for TOF systems
US9829984B2 (en) * 2013-05-23 2017-11-28 Fastvdo Llc Motion-assisted visual language for human computer interfaces
US9356061B2 (en) 2013-08-05 2016-05-31 Apple Inc. Image sensor with buried light shield and vertical gate
CN103455141B (zh) * 2013-08-15 2016-07-06 无锡触角科技有限公司 互动投影系统及其深度传感器和投影仪的校准方法
US9778546B2 (en) * 2013-08-15 2017-10-03 Mep Tech, Inc. Projector for projecting visible and non-visible images
US9462253B2 (en) 2013-09-23 2016-10-04 Microsoft Technology Licensing, Llc Optical modules that reduce speckle contrast and diffraction artifacts
US9443310B2 (en) 2013-10-09 2016-09-13 Microsoft Technology Licensing, Llc Illumination modules that emit structured light
US9674563B2 (en) 2013-11-04 2017-06-06 Rovi Guides, Inc. Systems and methods for recommending content
US9769459B2 (en) 2013-11-12 2017-09-19 Microsoft Technology Licensing, Llc Power efficient laser diode driver circuit and method
US9508385B2 (en) 2013-11-21 2016-11-29 Microsoft Technology Licensing, Llc Audio-visual project generator
US9971491B2 (en) 2014-01-09 2018-05-15 Microsoft Technology Licensing, Llc Gesture library for natural user input
US9990046B2 (en) 2014-03-17 2018-06-05 Oblong Industries, Inc. Visual collaboration interface
US10004462B2 (en) 2014-03-24 2018-06-26 Kineticor, Inc. Systems, methods, and devices for removing prospective motion correction from medical imaging scans
US10061058B2 (en) 2014-05-21 2018-08-28 Universal City Studios Llc Tracking system and method for use in surveying amusement park equipment
US10025990B2 (en) 2014-05-21 2018-07-17 Universal City Studios Llc System and method for tracking vehicles in parking structures and intersections
US10207193B2 (en) 2014-05-21 2019-02-19 Universal City Studios Llc Optical tracking system for automation of amusement park elements
US10593113B2 (en) 2014-07-08 2020-03-17 Samsung Electronics Co., Ltd. Device and method to display object with visual effect
US9993733B2 (en) 2014-07-09 2018-06-12 Lumo Interactive Inc. Infrared reflective device interactive projection effect system
CN106714681A (zh) 2014-07-23 2017-05-24 凯内蒂科尔股份有限公司 用于在医学成像扫描期间追踪和补偿患者运动的系统、设备和方法
TWI569085B (zh) * 2014-09-10 2017-02-01 Ophaya Electronics Corp A projection system with optical image recognition function, a projection device and a projector to be projected
DE102014013677B4 (de) 2014-09-10 2017-06-22 Faro Technologies, Inc. Verfahren zum optischen Abtasten und Vermessen einer Umgebung mit einem Handscanner und unterteiltem Display
US9693040B2 (en) 2014-09-10 2017-06-27 Faro Technologies, Inc. Method for optically measuring three-dimensional coordinates and calibration of a three-dimensional measuring device
DE102014013678B3 (de) 2014-09-10 2015-12-03 Faro Technologies, Inc. Verfahren zum optischen Abtasten und Vermessen einer Umgebung mit einem Handscanner und Steuerung durch Gesten
US9602811B2 (en) * 2014-09-10 2017-03-21 Faro Technologies, Inc. Method for optically measuring three-dimensional coordinates and controlling a three-dimensional measuring device
US10417801B2 (en) 2014-11-13 2019-09-17 Hewlett-Packard Development Company, L.P. Image projection
US10321100B2 (en) * 2014-12-02 2019-06-11 Ademco Inc. System and method of foreground extraction for digital cameras
US10122976B2 (en) * 2014-12-25 2018-11-06 Panasonic Intellectual Property Management Co., Ltd. Projection device for controlling a position of an image projected on a projection surface
CN107430785B (zh) * 2014-12-31 2021-03-30 Alt有限责任公司 用于显示三维对象的方法和系统
US9843744B2 (en) * 2015-01-13 2017-12-12 Disney Enterprises, Inc. Audience interaction projection system
GB201503832D0 (en) * 2015-03-06 2015-04-22 Compurants Ltd Inamo big book V3
US9943247B2 (en) 2015-07-28 2018-04-17 The University Of Hawai'i Systems, devices, and methods for detecting false movements for motion correction during a medical imaging scan
IN2015CH03967A (zh) 2015-07-31 2015-08-14 Wipro Ltd
AU2016341196B2 (en) 2015-10-20 2021-09-16 Magic Leap, Inc. Selecting virtual objects in a three-dimensional space
WO2017091479A1 (en) 2015-11-23 2017-06-01 Kineticor, Inc. Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan
US10043279B1 (en) 2015-12-07 2018-08-07 Apple Inc. Robust detection and classification of body parts in a depth map
US10412280B2 (en) 2016-02-10 2019-09-10 Microsoft Technology Licensing, Llc Camera with light valve over sensor array
US10257932B2 (en) 2016-02-16 2019-04-09 Microsoft Technology Licensing, Llc. Laser diode chip on printed circuit board
US10462452B2 (en) 2016-03-16 2019-10-29 Microsoft Technology Licensing, Llc Synchronizing active illumination cameras
KR20230098927A (ko) 2016-03-31 2023-07-04 매직 립, 인코포레이티드 포즈들 및 멀티-dof 제어기들을 사용하는 3d 가상 객체들과상호작용들
KR102666960B1 (ko) * 2016-04-21 2024-05-17 매직 립, 인코포레이티드 시야 주위의 시각적 아우라
US10529302B2 (en) 2016-07-07 2020-01-07 Oblong Industries, Inc. Spatially mediated augmentations of and interactions among distinct devices and applications via extended pixel manifold
JP6739059B2 (ja) 2016-08-30 2020-08-12 パナソニックＩｐマネジメント株式会社 照明装置
US10366278B2 (en) 2016-09-20 2019-07-30 Apple Inc. Curvature-based face detector
KR102393299B1 (ko) * 2017-08-09 2022-05-02 삼성전자주식회사 이미지 처리 방법 및 그에 따른 장치
ES2728787B2 (es) * 2018-04-25 2021-02-09 Defensya Ingenieria Int S L Sistema y procedimiento para crear, modular y detectar sombras en sistemas con control basado en un sistema de visualizacion remota
US20200014909A1 (en) 2018-07-03 2020-01-09 Faro Technologies, Inc. Handheld three dimensional scanner with autofocus or autoaperture
US11247099B2 (en) * 2018-12-05 2022-02-15 Lombro James Ristas Programmed control of athletic training drills
US10924639B2 (en) 2019-05-29 2021-02-16 Disney Enterprises, Inc. System and method for polarization and wavelength gated transparent displays
RU2760179C1 (ru) * 2021-01-20 2021-11-22 Виктор Александрович Епифанов Система дополненной реальности
US11740689B1 (en) * 2022-06-16 2023-08-29 Apple Inc. Electronic devices with projectors
CN114973333B (zh) * 2022-07-13 2023-07-25 北京百度网讯科技有限公司 人物交互检测方法、装置、设备以及存储介质

Family Cites Families (136)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5794672A (en) 1980-12-05 1982-06-12 Hitachi Ltd Method for inspecting whether parts are present or not
DE3176016D1 (en) 1980-12-30 1987-04-23 Ibm System for remotely displaying and sensing information using shadow parallax
JPS59182688A (ja) 1983-03-31 1984-10-17 Toshiba Corp ステレオ視処理装置
GB8421783D0 (en) 1984-08-29 1984-10-03 Atomic Energy Authority Uk Stereo camera
US5001558A (en) 1985-06-11 1991-03-19 General Motors Corporation Night vision system with color video camera
US4843568A (en) * 1986-04-11 1989-06-27 Krueger Myron W Real time perception of and response to the actions of an unencumbered participant/user
US4887898A (en) 1988-04-13 1989-12-19 Rowe Furniture Corporation Fabric projection system
US4948371A (en) 1989-04-25 1990-08-14 The United States Of America As Represented By The United States Department Of Energy System for training and evaluation of security personnel in use of firearms
CA2030139C (en) 1989-11-20 2002-04-23 David M. Durlach 3-d amusement and display device
CA2040273C (en) * 1990-04-13 1995-07-18 Kazu Horiuchi Image displaying system
US5138304A (en) * 1990-08-02 1992-08-11 Hewlett-Packard Company Projected image light pen
US5239373A (en) * 1990-12-26 1993-08-24 Xerox Corporation Video computational shared drawing space
US5534917A (en) * 1991-05-09 1996-07-09 Very Vivid, Inc. Video image based control system
US5325473A (en) * 1991-10-11 1994-06-28 The Walt Disney Company Apparatus and method for projection upon a three-dimensional object
US5861881A (en) 1991-11-25 1999-01-19 Actv, Inc. Interactive computer system for providing an interactive presentation with personalized video, audio and graphics responses for multiple viewers
US5444462A (en) * 1991-12-16 1995-08-22 Wambach; Mark L. Computer mouse glove with remote communication
EP0553700B1 (de) 1992-01-29 1997-06-04 Deutsche Thomson-Brandt GmbH Videokamera, wahlweise als Projektor betreibbar
US5982352A (en) * 1992-09-18 1999-11-09 Pryor; Timothy R. Method for providing human input to a computer
US6008800A (en) 1992-09-18 1999-12-28 Pryor; Timothy R. Man machine interfaces for entering data into a computer
US5436639A (en) * 1993-03-16 1995-07-25 Hitachi, Ltd. Information processing system
JPH07135623A (ja) 1993-10-27 1995-05-23 Kinseki Ltd 網膜直接表示装置
US5510828A (en) * 1994-03-01 1996-04-23 Lutterbach; R. Steven Interactive video display system
US5426474A (en) 1994-03-22 1995-06-20 Innersense, Inc. Light projection system using randomized fiber optic bundle
US5528263A (en) * 1994-06-15 1996-06-18 Daniel M. Platzker Interactive projected video image display system
US5682468A (en) * 1995-01-23 1997-10-28 Intergraph Corporation OLE for design and modeling
US5548694A (en) 1995-01-31 1996-08-20 Mitsubishi Electric Information Technology Center America, Inc. Collision avoidance system for voxel-based object representation
JP3539788B2 (ja) * 1995-04-21 2004-07-07 パナソニック モバイルコミュニケーションズ株式会社 画像間対応付け方法
US5633691A (en) 1995-06-07 1997-05-27 Nview Corporation Stylus position sensing and digital camera with a digital micromirror device
US5882204A (en) * 1995-07-13 1999-03-16 Dennis J. Lannazzo Football interactive simulation trainer
US5591972A (en) * 1995-08-03 1997-01-07 Illumination Technologies, Inc. Apparatus for reading optical information
US5574511A (en) 1995-10-18 1996-11-12 Polaroid Corporation Background replacement for an image
US6308565B1 (en) * 1995-11-06 2001-10-30 Impulse Technology Ltd. System and method for tracking and assessing movement skills in multidimensional space
US6176782B1 (en) * 1997-12-22 2001-01-23 Philips Electronics North America Corp. Motion-based command generation technology
US5828485A (en) 1996-02-07 1998-10-27 Light & Sound Design Ltd. Programmable light beam shape altering device using programmable micromirrors
US6084979A (en) * 1996-06-20 2000-07-04 Carnegie Mellon University Method for creating virtual reality
US6400374B2 (en) * 1996-09-18 2002-06-04 Eyematic Interfaces, Inc. Video superposition system and method
US5969754A (en) 1996-12-09 1999-10-19 Zeman; Herbert D. Contrast enhancing illuminator
DE19708240C2 (de) * 1997-02-28 1999-10-14 Siemens Ag Anordnung und Verfahren zur Detektion eines Objekts in einem von Wellen im nichtsichtbaren Spektralbereich angestrahlten Bereich
US6118888A (en) 1997-02-28 2000-09-12 Kabushiki Kaisha Toshiba Multi-modal interface apparatus and method
US6088612A (en) 1997-04-04 2000-07-11 Medtech Research Corporation Method and apparatus for reflective glare removal in digital photography useful in cervical cancer detection
US6058397A (en) 1997-04-08 2000-05-02 Mitsubishi Electric Information Technology Center America, Inc. 3D virtual environment creation management and delivery system
JPH10334270A (ja) * 1997-05-28 1998-12-18 Mitsubishi Electric Corp 動作認識装置及び動作認識プログラムを記録した記録媒体
US6075895A (en) * 1997-06-20 2000-06-13 Holoplex Methods and apparatus for gesture recognition based on templates
JP3968477B2 (ja) * 1997-07-07 2007-08-29 ソニー株式会社 情報入力装置及び情報入力方法
JP2942222B2 (ja) * 1997-08-11 1999-08-30 株式会社つくばソフト研究所 カラー画像及び濃淡画像の通信装置
US6720949B1 (en) * 1997-08-22 2004-04-13 Timothy R. Pryor Man machine interfaces and applications
JP3795647B2 (ja) 1997-10-29 2006-07-12 株式会社竹中工務店 ハンドポインティング装置
JP3794180B2 (ja) * 1997-11-11 2006-07-05 セイコーエプソン株式会社 座標入力システム及び座標入力装置
US6166744A (en) * 1997-11-26 2000-12-26 Pathfinder Systems, Inc. System for combining virtual images with real-world scenes
US6611241B1 (en) 1997-12-02 2003-08-26 Sarnoff Corporation Modular display system
US6388657B1 (en) 1997-12-31 2002-05-14 Anthony James Francis Natoli Virtual reality keyboard system and method
EP0933924B1 (en) 1998-01-28 2004-03-24 Konica Corporation Image processing apparatus
US6349301B1 (en) 1998-02-24 2002-02-19 Microsoft Corporation Virtual environment bystander updating in client server architecture
US6266053B1 (en) 1998-04-03 2001-07-24 Synapix, Inc. Time inheritance scene graph for representation of media content
BR9909611B1 (pt) * 1998-04-13 2012-08-07 mÉtodo e aparelho para detectar caracterÍsticas faciais em uma sequÊncia de quadros de imagem compreendendo uma imagem de um rosto.
US6263339B1 (en) 1998-08-25 2001-07-17 Informix Software, Inc. Dynamic object visualization and code generation
JP2000163196A (ja) 1998-09-25 2000-06-16 Sanyo Electric Co Ltd ジェスチャ認識装置及びジェスチャ認識機能を有する指示認識装置
DE19845030A1 (de) 1998-09-30 2000-04-20 Siemens Ag Bildsystem
US6501515B1 (en) * 1998-10-13 2002-12-31 Sony Corporation Remote control system
US6106119A (en) 1998-10-16 2000-08-22 The Board Of Trustees Of The Leland Stanford Junior University Method for presenting high level interpretations of eye tracking data correlated to saved display images
AU1930700A (en) * 1998-12-04 2000-06-26 Interval Research Corporation Background estimation and segmentation based on range and color
GB9902235D0 (en) 1999-02-01 1999-03-24 Emuse Corp Interactive system
US6333735B1 (en) 1999-03-16 2001-12-25 International Business Machines Corporation Method and apparatus for mouse positioning device based on infrared light sources and detectors
JP3644295B2 (ja) 1999-03-17 2005-04-27 セイコーエプソン株式会社 投写型表示装置
US6292171B1 (en) 1999-03-31 2001-09-18 Seiko Epson Corporation Method and apparatus for calibrating a computer-generated projected image
US6614422B1 (en) * 1999-11-04 2003-09-02 Canesta, Inc. Method and apparatus for entering data using a virtual input device
US6545706B1 (en) 1999-07-30 2003-04-08 Electric Planet, Inc. System, method and article of manufacture for tracking a head of a camera-generated image of a person
JP3905670B2 (ja) 1999-09-10 2007-04-18 株式会社リコー 座標入力検出装置、情報記憶媒体及び座標入力検出方法
US6826727B1 (en) 1999-11-24 2004-11-30 Bitstream Inc. Apparatus, methods, programming for automatically laying out documents
JP3760068B2 (ja) * 1999-12-02 2006-03-29 本田技研工業株式会社 画像認識装置
GB2356996A (en) 1999-12-03 2001-06-06 Hewlett Packard Co Improvements to digital cameras
JP4332964B2 (ja) * 1999-12-21 2009-09-16 ソニー株式会社 情報入出力システム及び情報入出力方法
WO2001056010A1 (en) * 2000-01-26 2001-08-02 New York University Method and system for facilitating wireless, full-body, real-time user interaction with digitally generated text data
AU2001249994A1 (en) 2000-02-25 2001-09-03 Interval Research Corporation Method and system for selecting advertisements
JP3842515B2 (ja) * 2000-03-24 2006-11-08 セイコーエプソン株式会社 多重解像度画像解析による指示位置検出
JP4402262B2 (ja) 2000-06-07 2010-01-20 オリンパス株式会社 プリンタ装置及び電子カメラ
US7149262B1 (en) 2000-07-06 2006-12-12 The Trustees Of Columbia University In The City Of New York Method and apparatus for enhancing data resolution
US7227526B2 (en) * 2000-07-24 2007-06-05 Gesturetek, Inc. Video-based image control system
JP4666808B2 (ja) * 2000-07-27 2011-04-06 キヤノン株式会社 画像表示システム、画像表示方法、及び記憶媒体、プログラム
US6754370B1 (en) 2000-08-14 2004-06-22 The Board Of Trustees Of The Leland Stanford Junior University Real-time structured light range scanning of moving scenes
US6707444B1 (en) 2000-08-18 2004-03-16 International Business Machines Corporation Projector and camera arrangement with shared optics and optical marker for use with whiteboard systems
US7103838B1 (en) 2000-08-18 2006-09-05 Firstrain, Inc. Method and apparatus for extracting relevant data
US6654734B1 (en) 2000-08-30 2003-11-25 International Business Machines Corporation System and method for query processing and optimization for XML repositories
US7058204B2 (en) 2000-10-03 2006-06-06 Gesturetek, Inc. Multiple camera control system
JP3467017B2 (ja) * 2000-11-30 2003-11-17 キヤノン株式会社 位置姿勢の決定方法及び装置並びに記憶媒体
US6431711B1 (en) * 2000-12-06 2002-08-13 International Business Machines Corporation Multiple-surface display projector with interactive input capability
JP2002222424A (ja) 2001-01-29 2002-08-09 Nec Corp 指紋照合システム
US6621483B2 (en) 2001-03-16 2003-09-16 Agilent Technologies, Inc. Optical screen pointing device with inertial properties
US20020178440A1 (en) * 2001-03-28 2002-11-28 Philips Electronics North America Corp. Method and apparatus for automatically selecting an alternate item based on user behavior
US6912313B2 (en) 2001-05-31 2005-06-28 Sharp Laboratories Of America, Inc. Image background replacement method
US7259747B2 (en) 2001-06-05 2007-08-21 Reactrix Systems, Inc. Interactive video display system
US8035612B2 (en) 2002-05-28 2011-10-11 Intellectual Ventures Holding 67 Llc Self-contained interactive video display system
US8300042B2 (en) 2001-06-05 2012-10-30 Microsoft Corporation Interactive video display system using strobed light
EP1689172B1 (en) 2001-06-05 2016-03-09 Microsoft Technology Licensing, LLC Interactive video display system
AU2002319621A1 (en) 2001-07-17 2003-03-03 Amnis Corporation Computational methods for the segmentation of images of objects from background in a flow imaging instrument
US7274800B2 (en) 2001-07-18 2007-09-25 Intel Corporation Dynamic gesture recognition from stereo sequences
US7068274B2 (en) 2001-08-15 2006-06-27 Mitsubishi Electric Research Laboratories, Inc. System and method for animating real objects with projected images
JP2003173237A (ja) 2001-09-28 2003-06-20 Ricoh Co Ltd 情報入出力システム、プログラム及び記憶媒体
US8561095B2 (en) * 2001-11-13 2013-10-15 Koninklijke Philips N.V. Affective television monitoring and control in response to physiological data
US7006055B2 (en) 2001-11-29 2006-02-28 Hewlett-Packard Development Company, L.P. Wireless multi-user multi-projector presentation system
US7307636B2 (en) 2001-12-26 2007-12-11 Eastman Kodak Company Image format including affective information
US20030128389A1 (en) 2001-12-26 2003-07-10 Eastman Kodak Company Method for creating and using affective information in a digital imaging system cross reference to related applications
JP4027118B2 (ja) 2002-02-25 2007-12-26 富士通株式会社 本人認証方法、プログラム及び装置
US6607275B1 (en) 2002-03-20 2003-08-19 The Neiman Marcus Group, Inc. Merchandise display case and system
US6707054B2 (en) 2002-03-21 2004-03-16 Eastman Kodak Company Scannerless range imaging system having high dynamic range
US6831664B2 (en) 2002-03-22 2004-12-14 Koninklijke Philips Electronics N.V. Low cost interactive program control system and method
US20050122308A1 (en) 2002-05-28 2005-06-09 Matthew Bell Self-contained interactive video display system
US7710391B2 (en) 2002-05-28 2010-05-04 Matthew Bell Processing an image utilizing a spatially varying pattern
US7170492B2 (en) 2002-05-28 2007-01-30 Reactrix Systems, Inc. Interactive video display system
US7348963B2 (en) 2002-05-28 2008-03-25 Reactrix Systems, Inc. Interactive video display system
US7171404B2 (en) 2002-06-13 2007-01-30 Mark Logic Corporation Parent-child query indexing for XML databases
US7574652B2 (en) 2002-06-20 2009-08-11 Canon Kabushiki Kaisha Methods for interactively defining transforms and for generating queries by manipulating existing query data
US7576727B2 (en) 2002-12-13 2009-08-18 Matthew Bell Interactive directed light/sound system
WO2004055776A1 (en) 2002-12-13 2004-07-01 Reactrix Systems Interactive directed light/sound system
US6999600B2 (en) 2003-01-30 2006-02-14 Objectvideo, Inc. Video scene background maintenance using change detection and classification
EP1619622B1 (en) 2003-04-25 2009-11-25 Fujitsu Limited Fingerprint matching device, fingerprint matching method, and fingerprint matching program
US7193608B2 (en) 2003-05-27 2007-03-20 York University Collaborative pointing devices
FR2856963B1 (fr) 2003-07-03 2006-09-01 Antolin Grupo Ing Sa Siege de vehicule automobile
EP1676442A2 (en) 2003-10-24 2006-07-05 Reactrix Systems, Inc. Method and system for managing an interactive video display system
US7536032B2 (en) 2003-10-24 2009-05-19 Reactrix Systems, Inc. Method and system for processing captured image information in an interactive video display system
US7681114B2 (en) 2003-11-21 2010-03-16 Bridgeborn, Llc Method of authoring, deploying and using interactive, data-driven two or more dimensional content
WO2005091651A2 (en) 2004-03-18 2005-09-29 Reactrix Systems, Inc. Interactive video display system
CN100573548C (zh) 2004-04-15 2009-12-23 格斯图尔泰克股份有限公司 跟踪双手运动的方法和设备
US7382897B2 (en) 2004-04-27 2008-06-03 Microsoft Corporation Multi-image feature matching using multi-scale oriented patches
US7394459B2 (en) 2004-04-29 2008-07-01 Microsoft Corporation Interaction between objects and a virtual environment display
US20050265587A1 (en) 2004-06-01 2005-12-01 Schneider John K Fingerprint image database and method of matching fingerprint sample to fingerprint images
US7330584B2 (en) 2004-10-14 2008-02-12 Sony Corporation Image processing apparatus and method
WO2006081428A2 (en) 2005-01-27 2006-08-03 Symyx Technologies, Inc. Parser for generating structure data
US20060184993A1 (en) 2005-02-15 2006-08-17 Goldthwaite Flora P Method and system for collecting and using data
US7570249B2 (en) 2005-03-30 2009-08-04 Microsoft Corporation Responding to change of state of control on device disposed on an interactive display surface
US7428542B1 (en) 2005-05-31 2008-09-23 Reactrix Systems, Inc. Method and system for combining nodes into a mega-node
US20080252596A1 (en) 2007-04-10 2008-10-16 Matthew Bell Display Using a Three-Dimensional vision System
JP5430572B2 (ja) 2007-09-14 2014-03-05 インテレクチュアル ベンチャーズ ホールディング ６７ エルエルシー ジェスチャベースのユーザインタラクションの処理
US8159682B2 (en) 2007-11-12 2012-04-17 Intellectual Ventures Holding 67 Llc Lens system
US20100039500A1 (en) 2008-02-15 2010-02-18 Matthew Bell Self-Contained 3D Vision System Utilizing Stereo Camera and Patterned Illuminator
US8259163B2 (en) 2008-03-07 2012-09-04 Intellectual Ventures Holding 67 Llc Display with built in 3D sensing

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100359437C (zh) * 2005-05-11 2008-01-02 凌阳科技股份有限公司 交互式影像游戏系统
CN101306249B (zh) * 2008-05-30 2011-09-14 北京中星微电子有限公司 动作分析装置和方法
CN102741781A (zh) * 2009-12-04 2012-10-17 奈克斯特控股公司 用于位置探测的传感器方法和系统
CN103500008B (zh) * 2010-09-23 2017-09-12 索尼电脑娱乐公司 用于控制计算机程序的热成像接口方法和装置
CN103141080A (zh) * 2010-09-23 2013-06-05 索尼电脑娱乐公司 使用热成像的用户接口系统和方法
CN103500008A (zh) * 2010-09-23 2014-01-08 索尼电脑娱乐公司 用于控制计算机程序的热成像接口方法和装置
CN103141080B (zh) * 2010-09-23 2016-10-05 索尼电脑娱乐公司 使用热成像的用户接口系统和方法
CN103548073B (zh) * 2011-05-25 2016-09-14 皇家飞利浦有限公司 用于表面的识别系统
CN103548073A (zh) * 2011-05-25 2014-01-29 皇家飞利浦有限公司 用于表面的识别系统
US8957851B2 (en) 2011-09-22 2015-02-17 Casio Computer Co., Ltd. Projection apparatus, projection control method and storage medium storing program
CN103019014B (zh) * 2011-09-22 2015-03-11 卡西欧计算机株式会社 投影装置以及投影控制方法
CN103019014A (zh) * 2011-09-22 2013-04-03 卡西欧计算机株式会社 投影装置以及投影控制方法
CN102637397B (zh) * 2012-05-02 2014-07-23 大连工业大学 一种具有照明功能的互动媒体设施
CN102637397A (zh) * 2012-05-02 2012-08-15 大连工业大学 一种具有照明功能的互动媒体设施
CN109107149A (zh) * 2012-10-29 2019-01-01 索尼电脑娱乐公司 经由控制台的环境光控制和校准
CN105850116A (zh) * 2013-12-27 2016-08-10 索尼公司 控制装置、控制方法和计算机程序
CN110996080A (zh) * 2014-04-22 2020-04-10 日本电信电话株式会社 视频呈现装置、视频呈现方法、数据结构以及程序
CN110996080B (zh) * 2014-04-22 2021-10-08 日本电信电话株式会社 视频呈现装置、视频呈现方法、以及记录介质
CN105824173A (zh) * 2015-01-27 2016-08-03 财团法人工业技术研究院 交互式投影仪及其用于确定对象的深度信息的操作方法
CN106055082A (zh) * 2015-04-10 2016-10-26 三星电子株式会社 用于基于事件显示屏幕的装置和方法
CN107002209A (zh) * 2015-08-17 2017-08-01 新日铁住金高新材料株式会社 铁素体系不锈钢箔
CN107002203A (zh) * 2015-08-19 2017-08-01 新日铁住金高新材料株式会社 不锈钢箔
CN114650365A (zh) * 2020-12-18 2022-06-21 丰田自动车株式会社 图像显示系统
CN114650365B (zh) * 2020-12-18 2023-12-01 丰田自动车株式会社 图像显示系统

Also Published As

Publication number Publication date
DE60213975T2 (de) 2007-02-15
RU2003137846A (ru) 2005-05-27
IL159207A0 (en) 2004-06-01
ES2271272T3 (es) 2007-04-16
KR20040029998A (ko) 2004-04-08
WO2002100094A3 (en) 2003-05-22
WO2002100094A2 (en) 2002-12-12
BR0210162A (pt) 2004-04-27
CA2449300A1 (en) 2002-12-12
JP4077787B2 (ja) 2008-04-23
CN102033608B (zh) 2014-02-12
EP1393549A2 (en) 2004-03-03
MXPA03011203A (es) 2004-10-28
DE60213975D1 (de) 2006-09-28
CN1582567B (zh) 2010-10-13
US7834846B1 (en) 2010-11-16
RU2298294C2 (ru) 2007-04-27
ATE336860T1 (de) 2006-09-15
CA2449300C (en) 2013-04-23
CN102033608A (zh) 2011-04-27
KR100847795B1 (ko) 2008-07-23
US7259747B2 (en) 2007-08-21
US20020186221A1 (en) 2002-12-12
EP1393549B1 (en) 2006-08-16
JP2005500719A (ja) 2005-01-06

Similar Documents

Publication Publication Date Title
CN1582567B (zh) 交互式视频显示系统
US8300042B2 (en) Interactive video display system using strobed light
EP1689172B1 (en) Interactive video display system
US10564731B2 (en) Processing of gesture-based user interactions using volumetric zones
US20080252596A1 (en) Display Using a Three-Dimensional vision System
JP2009037620A (ja) 三次元バーチャルインプットとシミュレートの装置
CN105027190A (zh) 用于虚拟或增强介导视觉的射出空间成像数字眼镜
CN102298786A (zh) 一种虚拟绘画实现的装置及其方法
CN104699389A (zh) 互动显示方法及其电子装置
KR20120114767A (ko) 사물 투척형 게임 디스플레이 시스템 및 그 방법
AU2002312346A1 (en) Interactive video display system
ES2332561B1 (es) Sistema de inmersion visual interactiva.
KR20120113906A (ko) 불규칙 표면에 대한 멀티 터치 디스플레이를 이용한 멀티 터치 인터랙션 시스템 및 그 방법

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
ASS Succession or assignment of patent right

Owner name: REACTRIX (FOR CREDITOR'S BENEFIT DISTRIBUTION) CO.

Free format text: FORMER OWNER: REACTRIX SYSTEMS INC.

Effective date: 20110304

Owner name: HAND INVESTMENT INC.

Free format text: FORMER OWNER: REACTRIX (FOR CREDITOR'S BENEFIT DISTRIBUTION) CO., LTD.

Effective date: 20110304

Owner name: WISDOM INVESTMENT HOLDINGS 67 CO., LTD.

Free format text: FORMER OWNER: HAND INVESTMENT INC.

Effective date: 20110304

C41 Transfer of patent application or patent right or utility model
COR Change of bibliographic data

Free format text: CORRECT: ADDRESS; FROM: DELAWARE, USA TO: NEVADA, USA

Free format text: CORRECT: ADDRESS; FROM: CALIFORNIA, USA TO: DELAWARE, USA

TR01 Transfer of patent right

Effective date of registration: 20110304

Address after: Nevada

Patentee after: INTELLECTUAL VENTURES HOLDING 67 LLC

Address before: Delaware

Patentee before: Han investment JSC

Effective date of registration: 20110304

Address after: Delaware

Patentee after: Han investment JSC

Address before: American California

Patentee before: Rick Chu J (for the benefit of creditors) LLC

Effective date of registration: 20110304

Address after: American California

Patentee after: Rick Chu J (for the benefit of creditors) LLC

Address before: American California

Patentee before: REACTRIX SYSTEMS, Inc.

ASS Succession or assignment of patent right

Owner name: MICROSOFT CORPORATION

Free format text: FORMER OWNER: WISDOM INVESTMENT HOLDINGS 67 CO., LTD.

Effective date: 20120713

C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20120713

Address after: Washington, USA

Patentee after: Microsoft Corp.

Address before: Nevada

Patentee before: INTELLECTUAL VENTURES HOLDING 67 LLC

ASS Succession or assignment of patent right

Owner name: MICROSOFT TECHNOLOGY LICENSING LLC

Free format text: FORMER OWNER: MICROSOFT CORP.

Effective date: 20150429

C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20150429

Address after: Washington State

Patentee after: MICROSOFT TECHNOLOGY LICENSING, LLC

Address before: Washington, USA

Patentee before: Microsoft Corp.

CX01 Expiry of patent term

Granted publication date: 20101013

CX01 Expiry of patent term