CN102681663A - 身临其境的显示体验 - Google Patents

身临其境的显示体验 Download PDF

Info

Publication number
CN102681663A
CN102681663A CN2012100517451A CN201210051745A CN102681663A CN 102681663 A CN102681663 A CN 102681663A CN 2012100517451 A CN2012100517451 A CN 2012100517451A CN 201210051745 A CN201210051745 A CN 201210051745A CN 102681663 A CN102681663 A CN 102681663A
Authority
CN
China
Prior art keywords
display
environment
peripheral images
degree
master image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2012100517451A
Other languages
English (en)
Inventor
G·佩雷兹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Corp filed Critical Microsoft Corp
Publication of CN102681663A publication Critical patent/CN102681663A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/25—Output arrangements for video game devices
    • A63F13/26—Output arrangements for video game devices having at least one additional display device, e.g. on the game controller or outside a game booth
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/428—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
    • A63F2300/1093—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera using visible light
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/30—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device
    • A63F2300/301—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device using an additional display connected to the game console, e.g. on the controller
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/30—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device
    • A63F2300/308—Details of the user interface
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/6045—Methods for processing data by generating or executing the game program for mapping control signals received from the input arrangement into game commands

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Stored Programmes (AREA)

Abstract

本发明涉及身临其境的显示体验。提供了保持可由逻辑子系统执行的指令的数据保持子系统。该指令可被配置为将主图像输出到主显示器以供由主显示器显示，并将外围图像输出到环境显示器以供由环境显示器投影到显示环境的环境表面上，以使得外围图像看上去是主图像的延伸。

Description

身临其境的显示体验
技术领域
本发明涉及显示技术，尤其涉及身临其境的显示体验。
背景技术
用户对视频游戏的欣赏和相关的媒体体验可通过使得游戏体验更真实来提升。使体验更真实的先前的尝试包括从二维动画技术切换到三维动画化技术、增加游戏图形的分辨率、产生增强的声音效果以及创建更自然的游戏控制器。
发明内容
通过将外围图像投影到人类用户周围的环境表面上来向人类用户提供了身临其境的显示环境。外围图像充当在主显示器上显示的主图像的延伸。
提供本发明内容以便以简化的形式介绍将在以下具体实施方式中进一步描述的一些概念。本发明内容并不旨在标识所要求保护主题的关键特征或必要特征，也不旨在用于限制所要求保护主题的范围。此外，所要求保护的主题不限于解决在本发明的任一部分中提及的任何或所有缺点的实现。
附图说明
图1示意性地示出身临其境的显示环境的实施例。
图2示出向用户提供身临其境的显示体验的示例方法。
图3示意性地示出被显示为主图像的延伸的外围图像的实施例。
图4示意性地示出外围图像的示例屏蔽区域，该屏蔽区域屏蔽了外围图像在用户位置处的显示。
图5示意性地示出被调整为在稍后的时间跟踪用户移动的图4的屏蔽区域。
图6示意性地示出根据本发明的一实施例的交互式计算系统。
具体实施方式
诸如视频游戏之类的交互式媒体体验通常由高质量、高分辨率的显示器来传递。这样的显示器通常是可视内容的唯一源，使得媒体体验以显示器的边框为界。即使聚焦于显示器，用户也可经由用户的外围视觉来感知显示器所在的房间的架构和装饰特征。这些特征对于所显示的图像而言通常是脱离上下文的，从而使媒体体验的娱乐可能静音。此外，因为某些娱乐体验涉及(engage)用户的情景知晓(例如，在类似上述的视频游戏场景的体验中)，感知运动并标识外围环境中(即，在高分辨率显示器外部的区域中)的对象的能力可增强娱乐体验。
此处描述了通过显示主显示器上的主图像以及对用户而言看似是主图像的延伸的外围图像来向用户提供身临其境的显示体验的各实施例。
图1示意性地示出身临其境的显示环境的实施例。显示环境100被标绘为被配置成用于用户家中的休闲和社交活动的房间。在图1所示的示例中，显示环境100包括家具和墙，但应该理解还可出现未在图1中示出的各装饰元素和架构固定物。
如图1所示，用户102正使用交互式计算系统110(诸如游戏控制台)在玩视频游戏，该交互式计算系统110将主图像输出到主显示器104并经由环境显示器116将外围图像投影到显示环境100内的环境表面(例如，墙、家具)上。交互式计算系统110的实施例将在下文中参照图6更详细地描述。
在图1所示的示例中，主图像被显示在主显示器104上。如图1所描绘的，主显示器104是平板显示器，但可以理解，任何合适的显示器都可用于主显示器104而不背离本发明的范围。在图1所示的游戏场景中，用户102聚焦于主显示器104上显示的主图像。例如，用户102可能正参与在主显示器104上示出的攻击视频游戏敌人。
如图1所描绘的，交互式计算系统110在操作上与各外围设备连接。例如，交互式计算系统110在操作上与环境显示器116连接，环境显示器116被配置为在显示环境的环境表面上显示外围图像。外围图像被配置为当被用户查看时看上去是主显示器上显示的主图像的延伸。因此，环境显示器116可投影与主图像具有相同图像上下文的图像。当用户用用户的外围视觉感知到外围图像时，用户可以在情景上知晓外围视觉中的图像和对象同时聚焦于主图像。
在图1所示的示例中，用户102聚焦于主显示器104上显示的墙，但从用户对环境表面112上显示的外围图像的感知中可以知晓正在迫近的视频游戏敌人。在某些实施例中，外围图像被这样配置，使得对于用户而言当外围图像被环境显示器投影时外围图像看上去围绕着用户。因此，在图1所示的游戏场景的上下文中，用户102可转过身并观察到从后方偷偷走近的敌人。
在图1所示的实施例中，环境显示器116是被配置为将外围图像投影在围绕环境显示器116的360度场中的投影显示设备。在某些实施例中，环境显示器116可包括面向左侧和面向右侧(相对于主显示器104前方的)广角RGB投影仪之一。在图1中，环境显示器116位于主显示器104顶部，尽管这不是必需的。环境显示器可位于接近主显示器的另一位置，或者位于远离主显示器的位置。
虽然图1所示的示例主显示器104和环境显示器116包括2-D显示设备，但可以理解，可以使用合适的3-D显示器而不背离本发明的范围。例如，在某些实施例中，用户102可使用合适的头盔来欣赏身临其境的3-D体验，该头盔诸如被配置为与主显示器104和环境显示器116处的合适的交替帧图像定序同步操作的活动快门式眼镜(未示出)。在某些实施例中，身临其境的3-D体验可由合适的互补色彩眼镜来提供，互补色彩眼镜用于查看由主显示器104和环境显示器116显示的合适的立体图像。
在某些实施例中，用户102可在不使用头盔的情况下欣赏身临其境的3-D显示体验。例如，主显示器104可配备有合适的视差障碍或晶体状透镜，以在环境显示器116以适当快速连续地呈现外围图像的视差视图的同时提供自动立体显示，从而经由“摆动”立体视觉来实现外围图像的3-D显示。可以理解，可采用包括上述方法在内的3-D显示技术的任何合适的组合而不背离本发明的范围。此外，可以理解，在某些实施例中，3-D主图像可经由主显示器104来提供，而2-D外围图像经由环境显示器116或类似的其他方式来提供。
交互式计算系统110还在操作上与深度相机114连接。在图1所示的实施例中，深度相机114被配置为生成显示环境100的三维深度信息。例如，在某些实施例中，深度相机114可被配置为飞行时间相机，飞行时间相机被配置为通过计算发射光脉冲和反射光脉冲的启动和捕捉时间之差来确定空间距离信息。另选地，在某些实施例中，深度相机114可包括三维扫描仪，三维扫描仪被配置为收集反射结构化光，诸如由MEMS激光发射的光图案或LCD、LCOS或DLP投影仪投影的红外光图案。可以理解，在某些实施例中，光脉冲或结构化光可由环境显示器116或由任何合适的光源发射。
在某些实施例中，深度相机114可包括多个合适的图像捕捉设备以捕捉显示环境100内的三维深度信息。例如，在某些实施例中，深度相机114可包括前向和背向(相对于面向用户102的前侧主显示器104)鱼眼图像捕捉设备中的每一个，该设备被配置为从显示环境100接收反射光并提供环绕深度相机114的360度视野的深度信息。另外地或另选地，在某些实施例中，深度相机114可包括被配置为从多个捕捉到的图像缝合全景图像的图像处理软件。在这样的实施例中，多个图像捕捉设备可被包括在深度相机114中。
如下文所说明的，在某些实施例中，深度相机114或伴随相机(未示出)还可被配置为收集来自显示环境100的色彩信息，诸如通过从收集到的RGB图案中生成色彩反射性信息。然而，可以理解，可使用其他合适的外围设备来收集和生成色彩信息，而不背离本发明的范围。例如，在一场景中，可从由CCD摄像机收集的图像中生成色彩信息，该CCD摄像机在操作上与交互式计算系统110或深度相机114连接。
在图1所示的实施例中，深度相机114与环境显示器116共享共同的外壳。通过共享共同的外壳，深度相机114和环境显示器116可具有接近公共的角度，与深度相机114和环境显示器116彼此离的较远的情况相比，这可增强外围图像中的失真校正。然而，可以理解，深度相机114可以是在操作上与交互式计算系统110耦合的独立的外围设备。
如图1的实施例中所示，交互式计算系统110在操作上与用户跟踪设备118耦合。用户跟踪设备118可包括被配置为跟踪用户移动和特征(例如，头部跟踪、眼部跟踪、身体跟踪等)的合适的深度相机。进而，交互式计算系统110可标识和跟踪用户102的用户位置，并且响应于由用户跟踪设备118检测到的用户移动来进行动作。因此，在用户102玩在交互式计算系统110上运行的视频游戏的同时执行的姿势可被识别和解释为游戏控制。换言之，跟踪设备118允许用户在不使用常规手持式游戏控制器的情况下来控制游戏。在向用户呈现3-D图像的某些实施例中，用户跟踪设备118可跟踪用户的眼睛来确定用户凝视的方向。例如，可跟踪用户的眼睛，以便与不跟踪用户的眼睛的方法相比，相对地提高主显示器104处的自动立体显示所显示图像的外观，或者相对地放大主显示器104处的自动立体显示的立体“甜区(sweet spot)”的大小。
可以理解，在某些实施例中，用户跟踪设备118可与环境显示器116和/或深度相机114共享共同的外壳。在某些实施例中，深度相机114可执行用户跟踪设备118的全部功能，或者另选地，用户跟踪设备118可执行深度相机114的全部功能。此外，环境显示器116、深度相机114和跟踪设备118中的一个或多个可与主显示器104集成。
图2示出向用户提供身临其境的显示体验的方法200。可以理解，方法200的各实施例可使用诸如此处描述的硬件和软件等合适的硬件和软件来执行。此外，可以理解，方法200的次序不是限制性的。
在202，方法200包括在主显示器上显示主图像，以及在204，在环境显示器上显示外围图像，使得外围图像看上去是主图像的延伸。换言之，外围图像可包括与主图像中描绘的场景和对象展示相同的样式和上下文的场景和对象的图像，以使得在可接受的容忍度内，聚焦于主图像的用户在形成完全和完整的场景时感知到主图像和外围图像。在某些情况下，相同的虚拟对象可被部分地显示为主图像的一部分并且被部分地显示为外围图像的一部分。
在某些实施例中，因为用户可能聚焦于主显示器上显示的图像并正与其交互，所以外围图像可以用比主图像分辨率低的分辨率来显示而不会负面地影响用户体验。这可以提供可接受的身临其境的显示环境同时降低计算开销。例如，图3示意性地示出显示环境100的一部分的实施例和主显示器104的实施例。在图3所示的示例中，外围图像302被显示在环境表面112上主显示器104的后方，而主图像304被显示在主显示器104上。外围图像302的分辨率低于主图像304，这在图3中通过外围图像302的像素尺寸比主图像304的像素尺寸相对较大来示意性地示出。
转回图2，在某些实施例中，方法200可包括在206显示失真校正的外围图像。在这样的实施例中，外围图像的显示可被调整以对显示环境内的环境表面的地形和/或色彩进行补偿。
在某些这样的实施例中，地形和/或色彩补偿可基于显示环境的深度图和/或通过构建显示环境的色彩图，该深度图用于校正外围图像中的地形和几何失真，该色彩图用于校正外围图像中的色彩失真。因此，在这样的实施例中，方法200包括在208从与显示环境有关的深度、色彩和/或角度信息中生成失真校正，以及在210将失真校正应用于外围图像。下面描述几何失真校正、角度失真校正和色彩失真校正的非限制性示例。
在某些实施例中，将失真校正应用于外围图像210可包括在212对环境表面的地形进行补偿，以使得外围图像看上去是主图像的经几何失真校正的延伸。例如，在某些实施例中，几何失真校正变形可基于深度信息来计算，并在投影之前被应用于外围图像以对环境表面的地形进行补偿。这样的几何失真校正变形可用任何合适的方式来生成。
在某些实施例中，用于生成几何失真校正的深度信息可通过将结构化光投影到显示环境的环境表面上并从反射的结构化光中构建深度图来生成。这样的深度图可由被配置为测量反射的结构化光(或在使用飞行时间深度相机来收集深度信息的情况下的反射光脉冲)的合适的深度相机来生成。
例如，结构化光可被投影到墙、家具、以及用户的娱乐室的装饰和架构元素上。深度相机可收集特定环境表面所反射的结构化光，以确定该特定环境表面的空间位置和/或与显示环境内的其他环境表面的空间关系。显示环境内的若干环境表面的空间位置可被汇编成显示环境的深度图。尽管以上示例指代结构化光，但可以理解，可使用用于构建显示环境的深度图的任何合适的光。在某些实施例中可使用红外结构化光，而在另外一些实施例中可使用被配置为用于飞行时间深度相机的不可见光脉冲。此外，可使用飞行时间深度分析而不背离本发明的范围。
一旦几何失真校正被生成，它就可由被配置为调整外围图像的图像校正处理器使用，以对由深度信息描述的环境表面的地形进行补偿。图像校正处理器的输出随后被输出到环境显示器，以使得外围图像看上去是主图像的经几何失真校正的延伸。
例如，因为在显示环境中包括的圆柱形灯上显示的水平线的未经校正的投影看上去像半圆，所以交互式计算设备可按合适的校正系数放大要显示在灯表面上的外围图像的部分。因此，灯上的显示像素可在投影之前被调整以形成圆形区域。一旦被投影到灯上，该圆形区域将看上去是水平线。
在某些实施例中，可使用用户位置信息来调整外围图像显示的视角度。因为深度相机可能不位于用户的位置处或用户的眼睛水平线处，所以所收集的深度信息可能不表示用户所感知的深度信息。换言之，深度相机可能不具有与用户相同的对显示环境的角度，以使得经几何校正的外围图像可能看上去对用户而言仍然稍有不正确。因此在某些实施例中，外围图像可被进一步校正，以使得外围图像看上去是从用户位置投影的。在这样的实施例中，在212对环境表面的地形进行补偿包括对位于深度相机位置处的深度相机的角度和位于用户位置处用户角度之间的差进行补偿。在某些实施例中，深度相机或其他合适的跟踪设备可跟踪用户的眼睛以调整外围图像的角度。
在3-D外围图像由环境显示器显示给用户的某些实施例中，上述几何失真校正变形可包括被配置为实现3-D显示的合适的变形。例如，几何失真校正变形可包括对环境表面的地形的变形校正，同时提供被配置为提供外围图像的视差视图的交替视图。
在某些实施例中，将失真校正应用于外围图像210可包括在214对环境表面的色彩进行补偿，以使得外围图像看上去是主图像的经色彩失真校正的延伸。例如，在某些实施例中，色彩失真校正变形可基于色彩信息来计算，并在投影之前被应用于外围图像以对环境表面的色彩进行补偿。这样的色彩失真校正变形可用任何合适的方式来生成。
在某些实施例中，用于生成色彩失真校正的色彩信息可通过将合适的色彩图案投影到显示环境的环境表面上并从反射光中构建色彩图来生成。这样的色彩图可由被配置为测量色彩反射性的合适的相机来生成。
例如，RGB图案(或任何合适的色彩图案)可由环境显示器或由任何合适的色彩投影设备投影到显示环境的环境表面上。可收集(例如，由深度相机)从显示环境的环境表面反射的光。在某些实施例中，从所收集的反射光中生成的色彩信息可用于构建显示环境的色彩图。
例如，基于反射的RGB图案，深度相机可感知到用户的娱乐室的墙被刷成蓝色。因为显示在墙上的蓝光的未经校正的投影将看上去是未着色的，所以交互式计算设备可用合适的色彩校正系数来放大要被显示在墙上的外围图像的部分。具体地，墙上的显示像素可在投影之前被调整以增加这些像素的红色内容。一旦被投影在墙上，外围图像对用户而言将看上去是蓝色的。
在某些实施例中，可构造显示环境的色彩简档而不将着色的光投影到显示环境上。例如，相机可用于捕捉在环境光下的显示环境的色彩图像，且可估计合适的色彩校正。
在3-D外围图像由环境显示器显示给佩戴3-D头盔的用户的某些实施例中，上述色彩失真校正变形可包括被配置为实现3-D显示的合适的变形。例如，色彩失真校正变形可被调整以将3-D显示提供给佩戴具有经着色的透镜的眼镜的用户，透镜包括但不限于，琥珀色和蓝色透镜或红色和蓝绿色透镜。
可以理解，外围图像的失真校正可在任何合适的时间并以任何合适的次序来执行。例如，失真校正可在身临其境的显示活动开始时发生和/或在身临其境的显示活动期间以合适的间隔发生。例如，可随着用户在显示环境内四处移动、随着光照水平改变等来调整失真校正。
在某些实施例中，由环境显示器204显示外围图像可包括在216遮挡用户位置的一部分使其不被从由环境显示器投影的光照到。换言之，外围图像的投影可被实际地和/或虚拟地遮掩，以使得用户将感知从外围显示器照射到用户位置的相对较少的光。当外围图像的移动部分看上去沿着用户的身体移动时，这可保护用户的视力并且可避免使用户分心。
在某些这样的实施例中，交互式计算设备使用从深度相机接收的深度输入来跟踪用户位置并输出外围图像，以使得遮挡用户位置的一部分使其不被环境显示器所投影的外围图像光照到。因此，遮挡用户位置的一部分216可包括在218确定用户位置。例如，用户位置可从深度相机或其他合适的用户跟踪设备来接收。可任选地，在某些实施例中，接收用户位置可包括接收用户轮廓。此外，在某些实施例中，在执行上述角度校正时，用户位置信息还可用于跟踪用户的头部、眼部等。
用户位置和/或轮廓可通过用户相对于显示环境的环境表面的运动来标识，或者由任何合适的检测方法来标识。可随着时间跟踪用户位置，以使得被遮挡的外围图像的部分跟踪用户位置的改变。
在跟踪显示环境中的用户位置时，调整外围图像，以使得在用户位置处不显示外围图像。因此，在216遮挡用户位置的部分可包括在220遮掩用户位置使其不在外围图像的部分中。例如，因为显示环境的物理空间中的用户位置是已知的，且因为上述深度图包括显示环境的三维图以及外围图像的哪些特定部分将在显示环境中显示，所以可以标识外围图像中将在用户位置处显示的部分。
一旦被标识，外围图像的该部分可被遮挡和/或遮掩而不在外围图像输出中。这样的遮掩可通过建立外围图像的遮挡区域(在该区域内光不被投影)来发生。例如，DLP投影设备中的像素可被关闭或被设为在用户位置区域中显示黑色。可以理解，在计算遮挡区域时，可包括对投影仪的光学特性和/或对其他衍射情况的校正。因此，投影仪处被遮掩的区域可具有与所投影的遮掩区域不同的外观。
图4和5示意性地示出显示环境100的实施例，其中外围图像302在时间T0(图4)和稍后的时间T1(图5)被投影。出于说明的目的，用户102的轮廓在两张附图中示出，用户102随着时间推移从左向右移动。如上所说明的，遮挡区域602(出于说明的目的仅用轮廓线示出)跟踪用户的头部，以使得投影光不被引导至用户的眼睛。尽管图4和5将遮挡区域602描绘为大致椭圆形的区域，但可以理解，遮挡区域602可具有任何合适的形状和大小。例如，遮挡区域602可根据用户的身体形状来成形(从而阻止光投影到用户身体的其他部分上)。此外，在某些实施例中，遮挡区域602可包括合适的缓冲区域。这样的缓冲区域可阻止被投影的光在可接受的容忍度内泄漏到用户身体上。
在某些实施例中，以上所描述的方法和过程可与包括一个或多个计算机的计算系统关联。具体而言，此处描述的方法和过程可被实现为计算机应用程序、计算机服务、计算机API、计算机库和/或其它计算机程序产品。
图6示意性地示出在操作上与交互式计算系统110连接的主显示器104、深度相机114、环境显示器116和用户跟踪设备118的各实施例。具体地，外围输入114a在操作上将深度相机114连接到交互式计算系统110；主显示器输出104a在操作上将主显示器104连接到交互式计算系统110；以及环境显示器输出116a在操作上将环境显示器116连接到交互式计算系统110。如上所介绍的，用户跟踪设备118、主显示器104、环境显示器116和/或深度相机114中的一个或多个可被集成到多功能设备中。由此，上述连接中的一个或多个可以是多功能的。换言之，上述连接中的两个或更多个可被集成到公共连接中。合适的连接的非限制性示例包括，USB、USB 2.0、IEEE 1394、HDMI、802.11x和/或实质上任何其他合适的有线或无线连接。
以简化形式示出交互式计算系统110。应当理解，实际上可使用任何计算机体系结构而不背离本公开的范围。在不同的实施例中，交互式计算系统110可采取大型计算机、服务器计算机、台式计算机、膝上型计算机、平板计算机、家庭娱乐计算机、网络计算设备、移动计算设备、移动通信设备、游戏设备等形式。
交互式计算系统110包括逻辑子系统802和数据保持子系统804。交互式计算系统110还可以任选地包括用户输入设备，诸如例如键盘、鼠标、游戏控制器、相机、话筒和/或触摸屏等等。
逻辑子系统802可包括被配置为执行一个或多个指令的一个或多个物理设备。例如，逻辑子系统可被配置为执行一个或多个指令，该一个或多个指令是一个或多个应用程序、服务、程序、例程、库、对象、组件、数据结构、或其它逻辑构造的部分。可以实现这样的指令以执行任务、实现数据类型、变换一个或多个设备的状态、或以其它方式得到所需结果。
逻辑子系统可包括被配置为执行软件指令的一个或多个处理器。附加地或替代地，逻辑子系统可包括被配置为执行硬件或固件指令的一个或多个硬件或固件逻辑机。逻辑子系统的处理器可以是单核或多核，且在其上执行的程序可被配置为并行或分布式处理。逻辑子系统可以可选地包括遍布两个或多个设备的独立组件，所述设备可远程放置和/或被配置为进行协同处理。逻辑子系统的一个或多个方面可被虚拟化并由以云计算配置进行配置的可远程访问的联网计算设备执行。
数据保持子系统804可包括一个或多个物理的、非瞬态设备，所述设备被配置为保留数据和/或可由逻辑子系统执行的指令，以实现此处描述的方法和过程。在实现此类方法和过程时，可以变换数据保持子系统804的状态(例如，保持不同数据)。
数据保持子系统804可包括可移动介质和/或内置设备。数据保持子系统804可包括光学存储器设备(例如，CD、DVD、HD-DVD、蓝光盘等)、半导体存储器设备(例如，RAM、EPROM、EEPROM等)和/或磁存储器设备(例如，硬盘驱动器、软盘驱动器、磁带驱动器、MRAM等)等等。数据保持子系统804可包括具有以下特性中的一个或多个特性的设备：易失性、非易失性、动态、静态、读/写、只读、随机存取、顺序存取、位置可寻址、文件可寻址、以及内容可寻址。在某些实施例中，可以将逻辑子系统802和数据保持子系统804集成到一个或多个常见设备中，如应用程序专用的集成电路或片上系统。
图6还示出可移动的计算机可读存储介质806形式的数据保持子系统的一方面，该介质可以用于存储和/或传送可执行以实现此处所述的方法和过程的数据和/或指令。可移动的计算机可读存储介质806可采用CD、DVD、HD-DVD、蓝光盘、EEPROM和/或软盘等形式。
应该理解，数据保持子系统804包括一个或多个物理非瞬态设备。相反，在某些实施例中，此处描述的指令的各方面可用瞬态的方式由物理设备不会保持持续至少有限时间段的纯信号(例如，电磁信号、光信号等)来传播。此外，关于本发明的数据和/或其他形式的信息可由纯信号来传播。
在某些情况下，可以经由逻辑子系统802执行由数据保持子系统804所保存的指令来实例化此处描述的方法。应该理解，这样的方法可采用模块、程序和/或引擎的形式。在某些实施例中，可以从同一应用、服务、代码块、对象、库、例程、API、功能等来实例化不同的模块、程序和/或引擎。同样，可以由不同的应用程序、服务、代码块、对象、例程、API、函数等来实例化同一模块、程序和/或引擎。术语“模块”、“程序”和“引擎”意在涵盖单个或成组的可执行文件、数据文件、库、驱动程序、脚本、数据库纪录等。
应该理解，此处描述的配置和/或方法在本质上是示例性的，且这些具体实施例或示例不应被理解为是局限性的，因为多种变体是可能的。此处描述的具体例程或方法可表示任何数量的处理策略中的一个或多个。由此，所示的各个动作可以按所示的顺序执行、按其他顺序执行、并行地执行、或者在某些情形下省略。同样，可以改变上述过程的顺序。
本发明的主题包括各种过程、系统和配置的所有新颖和非显而易见的组合和子组合、和此处所公开的其它特征、功能、动作、和/或特性、以及其任何和全部等效物。

Claims (10)

1.一种被配置为在显示环境(100)内提供身临其境的显示体验的交互式计算系统(110)，所述系统包括：
外围输入(114a)，所述外围输入被配置为从深度相机(114)接收深度输入；
主显示器输出(104a)，所述主显示器输出被配置为将主图像(304)输出到主显示器设备(104)；
环境显示器输出(116a)，所述环境显示器输出被配置为将外围图像(302)输出到环境显示器(116)；
逻辑子系统(802)，所述逻辑子系统在操作上经由外围输入连接到所述深度相机，经由主显示器输出连接到主显示器，以及经由环境显示器输出连接到环境显示器；以及
保持指令的数据保持子系统(804)，所述指令能由逻辑子系统执行以：
在所述显示环境内，使用从所述深度相机接收的深度输入来跟踪用户位置，以及
将外围图像输出到所述环境显示器以供投影到所述显示环境的环境表面(112)上，以使得所述外围图像看上去是所述主图像的延伸，并且遮挡用户位置的一部分使其不被所述环境显示器所投影的光照到。
2.如权利要求1所述的系统，其特征在于，所述深度相机被配置为通过测量从所述环境表面反射的结构化、不可见光来检测深度信息。
3.如权利要求1所述的系统，其特征在于，还包括用于以下的指令：
从所述深度相机接收所述显示环境的深度信息和色彩信息中的一个或多个；以及
在所述显示环境的环境表面上显示外围图像，以使得外围图像看上去是主图像的经失真校正的延伸。
4.如权利要求3所述的系统，其特征在于，还包括用于对由深度信息描述的环境表面的地形进行补偿，以使得外围图像看上去是主图像的经几何失真校正的延伸的指令。
5.如权利要求3所述的系统，其特征在于，相机被配置为通过测量来自所述环境表面的色彩反射性来检测色彩信息。
6.如权利要求5所述的系统，其特征在于，还包括用于对由色彩信息描述的环境表面的色彩进行补偿，以使得所述外围图像看上去是所述主图像的经色彩失真校正的延伸的指令。
7.一种保持能由逻辑子系统(802)执行的指令的数据保持子系统(804)，所述指令被配置为在显示环境(100)内提供身临其境的显示体验，所述指令被配置为：
将主图像(304)输出到主显示器(104)以供由所述主显示器显示，以及
将外围图像(302)输出到环境显示器(116)以供由所述环境显示器投影到显示环境的环境表面(112)上，以使得所述外围图像看上去是所述主图像的延伸，所述外围图像具有比所述主图像的分辨率低的分辨率。
8.如权利要求7所述的子系统，其特征在于，所述外围图像被配置为对于用户而言，当所述外围图像被所述环境显示器投影时所述外围图像看上去围绕着所述用户。
9.如权利要求7所述的子系统，其特征在于，还包括在所述显示环境中使用从深度相机接收的深度信息来跟踪用户位置的指令，其中所述外围图像的输出被配置为遮挡所述用户位置的一部分使其不被所述环境显示器所投影的光照到。
10.如权利要求7所述的子系统，其特征在于，还包括从所述深度相机接收所述显示环境的深度信息和色彩信息中的一个或多个的指令，其中所述外围图像在所述显示环境的环境表面上的输出被配置为使所述外围图像看上去是所述主图像的经失真校正的延伸。
CN2012100517451A 2011-03-02 2012-03-01 身临其境的显示体验 Pending CN102681663A (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13/039,179 US20120223885A1 (en) 2011-03-02 2011-03-02 Immersive display experience
US13/039,179 2011-03-02

Publications (1)

Publication Number Publication Date
CN102681663A true CN102681663A (zh) 2012-09-19

Family

ID=46752990

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012100517451A Pending CN102681663A (zh) 2011-03-02 2012-03-01 身临其境的显示体验

Country Status (8)

Country Link
US (1) US20120223885A1 (zh)
EP (1) EP2681641A4 (zh)
JP (1) JP2014509759A (zh)
KR (1) KR20140014160A (zh)
CN (1) CN102681663A (zh)
AR (1) AR085517A1 (zh)
TW (1) TW201244459A (zh)
WO (1) WO2012118769A2 (zh)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107306332A (zh) * 2016-04-19 2017-10-31 奥多比公司 闭塞直接视图增强现实系统的图像补偿
CN109565567A (zh) * 2016-09-09 2019-04-02 谷歌有限责任公司 三维遥现系统
CN109712522A (zh) * 2017-10-25 2019-05-03 Tcl集团股份有限公司 一种沉浸式信息呈现方法和系统
JP2020503599A (ja) * 2016-12-14 2020-01-30 サムスン エレクトロニクス カンパニー リミテッド ディスプレイ装置及びその制御方法
CN113168080A (zh) * 2018-12-18 2021-07-23 索尼半导体解决方案公司 图像显示装置

Families Citing this family (337)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9158116B1 (en) 2014-04-25 2015-10-13 Osterhout Group, Inc. Temple and ear horn assembly for headworn computer
US8427424B2 (en) 2008-09-30 2013-04-23 Microsoft Corporation Using physical objects in conjunction with an interactive surface
US20150205111A1 (en) 2014-01-21 2015-07-23 Osterhout Group, Inc. Optical configurations for head worn computing
US9400390B2 (en) 2014-01-24 2016-07-26 Osterhout Group, Inc. Peripheral lighting for head worn computing
US20150277120A1 (en) 2014-01-21 2015-10-01 Osterhout Group, Inc. Optical configurations for head worn computing
US9366867B2 (en) 2014-07-08 2016-06-14 Osterhout Group, Inc. Optical systems for see-through displays
US9298007B2 (en) 2014-01-21 2016-03-29 Osterhout Group, Inc. Eye imaging in head worn computing
US9229233B2 (en) 2014-02-11 2016-01-05 Osterhout Group, Inc. Micro Doppler presentations in head worn computing
US9952664B2 (en) 2014-01-21 2018-04-24 Osterhout Group, Inc. Eye imaging in head worn computing
US9965681B2 (en) 2008-12-16 2018-05-08 Osterhout Group, Inc. Eye imaging in head worn computing
US9715112B2 (en) 2014-01-21 2017-07-25 Osterhout Group, Inc. Suppression of stray light in head worn computing
US20110165923A1 (en) 2010-01-04 2011-07-07 Davis Mark L Electronic circle game system
US9971458B2 (en) 2009-03-25 2018-05-15 Mep Tech, Inc. Projection of interactive environment
US20110256927A1 (en) * 2009-03-25 2011-10-20 MEP Games Inc. Projection of interactive game environment
US8730309B2 (en) 2010-02-23 2014-05-20 Microsoft Corporation Projectors and depth cameras for deviceless augmented reality and interaction
US9111326B1 (en) 2010-12-21 2015-08-18 Rawles Llc Designation of zones of interest within an augmented reality environment
US8905551B1 (en) 2010-12-23 2014-12-09 Rawles Llc Unpowered augmented reality projection accessory display device
US8845107B1 (en) 2010-12-23 2014-09-30 Rawles Llc Characterization of a scene with structured light
US9418479B1 (en) 2010-12-23 2016-08-16 Amazon Technologies, Inc. Quasi-virtual objects in an augmented reality environment
US9134593B1 (en) 2010-12-23 2015-09-15 Amazon Technologies, Inc. Generation and modulation of non-visible structured light for augmented reality projection system
US8845110B1 (en) 2010-12-23 2014-09-30 Rawles Llc Powered augmented reality projection accessory display device
US9721386B1 (en) 2010-12-27 2017-08-01 Amazon Technologies, Inc. Integrated augmented reality environment
US9508194B1 (en) 2010-12-30 2016-11-29 Amazon Technologies, Inc. Utilizing content output devices in an augmented reality environment
US9607315B1 (en) 2010-12-30 2017-03-28 Amazon Technologies, Inc. Complementing operation of display devices in an augmented reality environment
US9329469B2 (en) 2011-02-17 2016-05-03 Microsoft Technology Licensing, Llc Providing an interactive experience using a 3D depth camera and a 3D projector
US9480907B2 (en) 2011-03-02 2016-11-01 Microsoft Technology Licensing, Llc Immersive display with peripheral illusions
US10972680B2 (en) * 2011-03-10 2021-04-06 Microsoft Technology Licensing, Llc Theme-based augmentation of photorepresentative view
US9007473B1 (en) * 2011-03-30 2015-04-14 Rawles Llc Architecture for augmented reality environment
US9478067B1 (en) 2011-04-08 2016-10-25 Amazon Technologies, Inc. Augmented reality environment with secondary sensory feedback
US9597587B2 (en) 2011-06-08 2017-03-21 Microsoft Technology Licensing, Llc Locational node device
US9996972B1 (en) 2011-06-10 2018-06-12 Amazon Technologies, Inc. User/object interactions in an augmented reality environment
US9921641B1 (en) 2011-06-10 2018-03-20 Amazon Technologies, Inc. User/object interactions in an augmented reality environment
US10008037B1 (en) 2011-06-10 2018-06-26 Amazon Technologies, Inc. User/object interactions in an augmented reality environment
US10595052B1 (en) 2011-06-14 2020-03-17 Amazon Technologies, Inc. Dynamic cloud content distribution
US9723293B1 (en) * 2011-06-21 2017-08-01 Amazon Technologies, Inc. Identifying projection surfaces in augmented reality environments
US9973848B2 (en) * 2011-06-21 2018-05-15 Amazon Technologies, Inc. Signal-enhancing beamforming in an augmented reality environment
US9194938B2 (en) 2011-06-24 2015-11-24 Amazon Technologies, Inc. Time difference of arrival determination with direct sound
US9292089B1 (en) 2011-08-24 2016-03-22 Amazon Technologies, Inc. Gestural object selection
US9462262B1 (en) 2011-08-29 2016-10-04 Amazon Technologies, Inc. Augmented reality environment with environmental condition control
US9380270B1 (en) 2011-08-31 2016-06-28 Amazon Technologies, Inc. Skin detection in an augmented reality environment
US9269152B1 (en) 2011-09-07 2016-02-23 Amazon Technologies, Inc. Object detection with distributed sensor array
US8953889B1 (en) 2011-09-14 2015-02-10 Rawles Llc Object datastore in an augmented reality environment
US9118782B1 (en) 2011-09-19 2015-08-25 Amazon Technologies, Inc. Optical interference mitigation
US9595115B1 (en) 2011-09-19 2017-03-14 Amazon Technologies, Inc. Visualizing change in augmented reality environments
US9349217B1 (en) 2011-09-23 2016-05-24 Amazon Technologies, Inc. Integrated community of augmented reality environments
US9033516B2 (en) * 2011-09-27 2015-05-19 Qualcomm Incorporated Determining motion of projection device
US9628843B2 (en) * 2011-11-21 2017-04-18 Microsoft Technology Licensing, Llc Methods for controlling electronic devices using gestures
US8983089B1 (en) 2011-11-28 2015-03-17 Rawles Llc Sound source localization using multiple microphone arrays
US8887043B1 (en) 2012-01-17 2014-11-11 Rawles Llc Providing user feedback in projection environments
US9418658B1 (en) 2012-02-08 2016-08-16 Amazon Technologies, Inc. Configuration of voice controlled assistant
US9947333B1 (en) 2012-02-10 2018-04-17 Amazon Technologies, Inc. Voice interaction architecture with intelligent background noise cancellation
KR101922589B1 (ko) * 2012-02-15 2018-11-27 삼성전자주식회사 디스플레이장치 및 그 시선추적방법
US20130222369A1 (en) 2012-02-23 2013-08-29 Charles D. Huston System and Method for Creating an Environment and for Sharing a Location Based Experience in an Environment
US10600235B2 (en) 2012-02-23 2020-03-24 Charles D. Huston System and method for capturing and sharing a location based experience
US10937239B2 (en) 2012-02-23 2021-03-02 Charles D. Huston System and method for creating an environment and for sharing an event
US9704027B1 (en) 2012-02-27 2017-07-11 Amazon Technologies, Inc. Gesture recognition
US8662676B1 (en) 2012-03-14 2014-03-04 Rawles Llc Automatic projector calibration
US9338447B1 (en) 2012-03-14 2016-05-10 Amazon Technologies, Inc. Calibrating devices by selecting images having a target having fiducial features
US9351089B1 (en) 2012-03-14 2016-05-24 Amazon Technologies, Inc. Audio tap detection
US8898064B1 (en) 2012-03-19 2014-11-25 Rawles Llc Identifying candidate passwords from captured audio
US9111542B1 (en) 2012-03-26 2015-08-18 Amazon Technologies, Inc. Audio signal transmission techniques
US9462255B1 (en) 2012-04-18 2016-10-04 Amazon Technologies, Inc. Projection and camera system for augmented reality environment
US9129375B1 (en) 2012-04-25 2015-09-08 Rawles Llc Pose detection
US9456187B1 (en) 2012-06-01 2016-09-27 Amazon Technologies, Inc. Edge-based pose detection
US9060224B1 (en) 2012-06-01 2015-06-16 Rawles Llc Voice controlled assistant with coaxial speaker and microphone arrangement
US9055237B1 (en) 2012-06-01 2015-06-09 Rawles Llc Projection autofocus
US8837778B1 (en) 2012-06-01 2014-09-16 Rawles Llc Pose tracking
US9800862B2 (en) 2012-06-12 2017-10-24 The Board Of Trustees Of The University Of Illinois System and methods for visualizing information
US9195127B1 (en) 2012-06-18 2015-11-24 Amazon Technologies, Inc. Rear projection screen with infrared transparency
US9262983B1 (en) 2012-06-18 2016-02-16 Amazon Technologies, Inc. Rear projection system with passive display screen
US9734839B1 (en) * 2012-06-20 2017-08-15 Amazon Technologies, Inc. Routing natural language commands to the appropriate applications
US9892666B1 (en) 2012-06-20 2018-02-13 Amazon Technologies, Inc. Three-dimensional model generation
US9330647B1 (en) 2012-06-21 2016-05-03 Amazon Technologies, Inc. Digital audio services to augment broadcast radio
US9280973B1 (en) 2012-06-25 2016-03-08 Amazon Technologies, Inc. Navigating content utilizing speech-based user-selectable elements
US8885815B1 (en) 2012-06-25 2014-11-11 Rawles Llc Null-forming techniques to improve acoustic echo cancellation
US8971543B1 (en) 2012-06-25 2015-03-03 Rawles Llc Voice controlled assistant with stereo sound from two speakers
US9373338B1 (en) 2012-06-25 2016-06-21 Amazon Technologies, Inc. Acoustic echo cancellation processing based on feedback from speech recognizer
US9485556B1 (en) 2012-06-27 2016-11-01 Amazon Technologies, Inc. Speaker array for sound imaging
US9560446B1 (en) 2012-06-27 2017-01-31 Amazon Technologies, Inc. Sound source locator with distributed microphone array
US9767828B1 (en) 2012-06-27 2017-09-19 Amazon Technologies, Inc. Acoustic echo cancellation using visual cues
US10528853B1 (en) 2012-06-29 2020-01-07 Amazon Technologies, Inc. Shape-Based Edge Detection
US9551922B1 (en) 2012-07-06 2017-01-24 Amazon Technologies, Inc. Foreground analysis on parametric background surfaces
US9294746B1 (en) 2012-07-09 2016-03-22 Amazon Technologies, Inc. Rotation of a micro-mirror device in a projection and camera system
US9071771B1 (en) 2012-07-10 2015-06-30 Rawles Llc Raster reordering in laser projection systems
US9317109B2 (en) 2012-07-12 2016-04-19 Mep Tech, Inc. Interactive image projection accessory
US9406170B1 (en) 2012-07-16 2016-08-02 Amazon Technologies, Inc. Augmented reality system with activity templates
US9786294B1 (en) 2012-07-30 2017-10-10 Amazon Technologies, Inc. Visual indication of an operational state
US9779757B1 (en) 2012-07-30 2017-10-03 Amazon Technologies, Inc. Visual indication of an operational state
US8970479B1 (en) 2012-07-31 2015-03-03 Rawles Llc Hand gesture detection
US9052579B1 (en) 2012-08-01 2015-06-09 Rawles Llc Remote control of projection and camera system
US9641954B1 (en) 2012-08-03 2017-05-02 Amazon Technologies, Inc. Phone communication via a voice-controlled device
US10111002B1 (en) 2012-08-03 2018-10-23 Amazon Technologies, Inc. Dynamic audio optimization
US9874977B1 (en) 2012-08-07 2018-01-23 Amazon Technologies, Inc. Gesture based virtual devices
US9704361B1 (en) 2012-08-14 2017-07-11 Amazon Technologies, Inc. Projecting content within an environment
US9779731B1 (en) 2012-08-20 2017-10-03 Amazon Technologies, Inc. Echo cancellation based on shared reference signals
US9329679B1 (en) 2012-08-23 2016-05-03 Amazon Technologies, Inc. Projection system with multi-surface projection screen
US9275302B1 (en) 2012-08-24 2016-03-01 Amazon Technologies, Inc. Object detection and identification
US9548012B1 (en) 2012-08-29 2017-01-17 Amazon Technologies, Inc. Adaptive ergonomic keyboard
US9726967B1 (en) 2012-08-31 2017-08-08 Amazon Technologies, Inc. Display media and extensions to display media
US9424840B1 (en) 2012-08-31 2016-08-23 Amazon Technologies, Inc. Speech recognition platforms
US9147399B1 (en) 2012-08-31 2015-09-29 Amazon Technologies, Inc. Identification using audio signatures and additional characteristics
US9160904B1 (en) 2012-09-12 2015-10-13 Amazon Technologies, Inc. Gantry observation feedback controller
US9197870B1 (en) 2012-09-12 2015-11-24 Amazon Technologies, Inc. Automatic projection focusing
KR101429812B1 (ko) * 2012-09-18 2014-08-12 한국과학기술원 외부 프로젝터를 활용한 텔레비전 화면의 확장 장치 및 방법
US9058813B1 (en) 2012-09-21 2015-06-16 Rawles Llc Automated removal of personally identifiable information
US9805721B1 (en) * 2012-09-21 2017-10-31 Amazon Technologies, Inc. Signaling voice-controlled devices
US10175750B1 (en) 2012-09-21 2019-01-08 Amazon Technologies, Inc. Projected workspace
US9922646B1 (en) 2012-09-21 2018-03-20 Amazon Technologies, Inc. Identifying a location of a voice-input device
US9127942B1 (en) 2012-09-21 2015-09-08 Amazon Technologies, Inc. Surface distance determination using time-of-flight of light
US9076450B1 (en) 2012-09-21 2015-07-07 Amazon Technologies, Inc. Directed audio for speech recognition
US9355431B1 (en) 2012-09-21 2016-05-31 Amazon Technologies, Inc. Image correction for physical projection-surface irregularities
US9495936B1 (en) 2012-09-21 2016-11-15 Amazon Technologies, Inc. Image correction based on projection surface color
US9286899B1 (en) 2012-09-21 2016-03-15 Amazon Technologies, Inc. User authentication for devices using voice input or audio signatures
US8933974B1 (en) 2012-09-25 2015-01-13 Rawles Llc Dynamic accommodation of display medium tilt
US9020825B1 (en) 2012-09-25 2015-04-28 Rawles Llc Voice gestures
US8983383B1 (en) 2012-09-25 2015-03-17 Rawles Llc Providing hands-free service to multiple devices
US9319816B1 (en) 2012-09-26 2016-04-19 Amazon Technologies, Inc. Characterizing environment using ultrasound pilot tones
US9251787B1 (en) 2012-09-26 2016-02-02 Amazon Technologies, Inc. Altering audio to improve automatic speech recognition
US8988662B1 (en) 2012-10-01 2015-03-24 Rawles Llc Time-of-flight calculations using a shared light source
US9762862B1 (en) 2012-10-01 2017-09-12 Amazon Technologies, Inc. Optical system with integrated projection and image capture
US10149077B1 (en) 2012-10-04 2018-12-04 Amazon Technologies, Inc. Audio themes
US9870056B1 (en) 2012-10-08 2018-01-16 Amazon Technologies, Inc. Hand and hand pose detection
US8913037B1 (en) 2012-10-09 2014-12-16 Rawles Llc Gesture recognition from depth and distortion analysis
US9109886B1 (en) 2012-10-09 2015-08-18 Amazon Technologies, Inc. Time-of-flight of light calibration
US9392264B1 (en) * 2012-10-12 2016-07-12 Amazon Technologies, Inc. Occluded object recognition
US9323352B1 (en) 2012-10-23 2016-04-26 Amazon Technologies, Inc. Child-appropriate interface selection using hand recognition
US9978178B1 (en) 2012-10-25 2018-05-22 Amazon Technologies, Inc. Hand-based interaction in virtually shared workspaces
US9281727B1 (en) 2012-11-01 2016-03-08 Amazon Technologies, Inc. User device-based control of system functionality
US9275637B1 (en) 2012-11-06 2016-03-01 Amazon Technologies, Inc. Wake word evaluation
GB2499694B8 (en) * 2012-11-09 2017-06-07 Sony Computer Entertainment Europe Ltd System and method of image reconstruction
US9685171B1 (en) 2012-11-20 2017-06-20 Amazon Technologies, Inc. Multiple-stage adaptive filtering of audio signals
US9204121B1 (en) 2012-11-26 2015-12-01 Amazon Technologies, Inc. Reflector-based depth mapping of a scene
US9336607B1 (en) 2012-11-28 2016-05-10 Amazon Technologies, Inc. Automatic identification of projection surfaces
US9541125B1 (en) 2012-11-29 2017-01-10 Amazon Technologies, Inc. Joint locking mechanism
US10126820B1 (en) 2012-11-29 2018-11-13 Amazon Technologies, Inc. Open and closed hand detection
US9087520B1 (en) 2012-12-13 2015-07-21 Rawles Llc Altering audio based on non-speech commands
US9271111B2 (en) 2012-12-14 2016-02-23 Amazon Technologies, Inc. Response endpoint selection
US9098467B1 (en) 2012-12-19 2015-08-04 Rawles Llc Accepting voice commands based on user identity
US9047857B1 (en) 2012-12-19 2015-06-02 Rawles Llc Voice commands for transitioning between device states
US9147054B1 (en) 2012-12-19 2015-09-29 Amazon Technolgies, Inc. Dialogue-driven user security levels
US9595997B1 (en) 2013-01-02 2017-03-14 Amazon Technologies, Inc. Adaption-based reduction of echo and noise
US9922639B1 (en) 2013-01-11 2018-03-20 Amazon Technologies, Inc. User feedback for speech interactions
US9466286B1 (en) 2013-01-16 2016-10-11 Amazong Technologies, Inc. Transitioning an electronic device between device states
US9171552B1 (en) 2013-01-17 2015-10-27 Amazon Technologies, Inc. Multiple range dynamic level control
US9159336B1 (en) 2013-01-21 2015-10-13 Rawles Llc Cross-domain filtering for audio noise reduction
US9189850B1 (en) 2013-01-29 2015-11-17 Amazon Technologies, Inc. Egomotion estimation of an imaging device
US9191742B1 (en) 2013-01-29 2015-11-17 Rawles Llc Enhancing audio at a network-accessible computing platform
US8992050B1 (en) 2013-02-05 2015-03-31 Rawles Llc Directional projection display
US9041691B1 (en) 2013-02-11 2015-05-26 Rawles Llc Projection surface with reflective elements for non-visible light
US9201499B1 (en) 2013-02-11 2015-12-01 Amazon Technologies, Inc. Object tracking in a 3-dimensional environment
US9304379B1 (en) 2013-02-14 2016-04-05 Amazon Technologies, Inc. Projection display intensity equalization
US9336602B1 (en) 2013-02-19 2016-05-10 Amazon Technologies, Inc. Estimating features of occluded objects
US9866964B1 (en) 2013-02-27 2018-01-09 Amazon Technologies, Inc. Synchronizing audio outputs
US9460715B2 (en) 2013-03-04 2016-10-04 Amazon Technologies, Inc. Identification using audio signatures and additional characteristics
US10289203B1 (en) 2013-03-04 2019-05-14 Amazon Technologies, Inc. Detection of an input object on or near a surface
US9196067B1 (en) 2013-03-05 2015-11-24 Amazon Technologies, Inc. Application specific tracking of projection surfaces
US9062969B1 (en) 2013-03-07 2015-06-23 Rawles Llc Surface distance determination using reflected light
US9065972B1 (en) 2013-03-07 2015-06-23 Rawles Llc User face capture in projection-based systems
US10297250B1 (en) 2013-03-11 2019-05-21 Amazon Technologies, Inc. Asynchronous transfer of audio data
US9081418B1 (en) 2013-03-11 2015-07-14 Rawles Llc Obtaining input from a virtual user interface
US9465484B1 (en) 2013-03-11 2016-10-11 Amazon Technologies, Inc. Forward and backward looking vision system
US9020144B1 (en) 2013-03-13 2015-04-28 Rawles Llc Cross-domain processing for noise and echo suppression
US9721586B1 (en) 2013-03-14 2017-08-01 Amazon Technologies, Inc. Voice controlled assistant with light indicator
US10424292B1 (en) 2013-03-14 2019-09-24 Amazon Technologies, Inc. System for recognizing and responding to environmental noises
US9813808B1 (en) 2013-03-14 2017-11-07 Amazon Technologies, Inc. Adaptive directional audio enhancement and selection
US9659577B1 (en) 2013-03-14 2017-05-23 Amazon Technologies, Inc. Voice controlled assistant with integrated control knob
US9390500B1 (en) 2013-03-14 2016-07-12 Amazon Technologies, Inc. Pointing finger detection
US9842584B1 (en) 2013-03-14 2017-12-12 Amazon Technologies, Inc. Providing content on multiple devices
US10133546B2 (en) 2013-03-14 2018-11-20 Amazon Technologies, Inc. Providing content on multiple devices
US9101824B2 (en) 2013-03-15 2015-08-11 Honda Motor Co., Ltd. Method and system of virtual gaming in a vehicle
US9429833B1 (en) 2013-03-15 2016-08-30 Amazon Technologies, Inc. Projection and camera system with repositionable support structure
US9689960B1 (en) 2013-04-04 2017-06-27 Amazon Technologies, Inc. Beam rejection in multi-beam microphone systems
US8975854B1 (en) 2013-04-05 2015-03-10 Rawles Llc Variable torque control of a stepper motor
US9781214B2 (en) 2013-04-08 2017-10-03 Amazon Technologies, Inc. Load-balanced, persistent connection techniques
US9304736B1 (en) 2013-04-18 2016-04-05 Amazon Technologies, Inc. Voice controlled assistant with non-verbal code entry
US9491033B1 (en) 2013-04-22 2016-11-08 Amazon Technologies, Inc. Automatic content transfer
EP2797314B1 (en) 2013-04-25 2020-09-23 Samsung Electronics Co., Ltd Method and Apparatus for Displaying an Image
US10514256B1 (en) 2013-05-06 2019-12-24 Amazon Technologies, Inc. Single source multi camera vision system
US9293138B2 (en) 2013-05-14 2016-03-22 Amazon Technologies, Inc. Storing state information from network-based user devices
US10002611B1 (en) 2013-05-15 2018-06-19 Amazon Technologies, Inc. Asynchronous audio messaging
US9563955B1 (en) 2013-05-15 2017-02-07 Amazon Technologies, Inc. Object tracking techniques
US9282403B1 (en) 2013-05-31 2016-03-08 Amazon Technologies, Inc User perceived gapless playback
US9494683B1 (en) 2013-06-18 2016-11-15 Amazon Technologies, Inc. Audio-based gesture detection
US11893603B1 (en) 2013-06-24 2024-02-06 Amazon Technologies, Inc. Interactive, personalized advertising
US9557630B1 (en) 2013-06-26 2017-01-31 Amazon Technologies, Inc. Projection system with refractive beam steering
US9747899B2 (en) 2013-06-27 2017-08-29 Amazon Technologies, Inc. Detecting self-generated wake expressions
US9602922B1 (en) 2013-06-27 2017-03-21 Amazon Technologies, Inc. Adaptive echo cancellation
US9640179B1 (en) 2013-06-27 2017-05-02 Amazon Technologies, Inc. Tailoring beamforming techniques to environments
US9978387B1 (en) 2013-08-05 2018-05-22 Amazon Technologies, Inc. Reference signal generation for acoustic echo cancellation
US9778546B2 (en) 2013-08-15 2017-10-03 Mep Tech, Inc. Projector for projecting visible and non-visible images
US20150067603A1 (en) * 2013-09-05 2015-03-05 Kabushiki Kaisha Toshiba Display control device
US9864576B1 (en) 2013-09-09 2018-01-09 Amazon Technologies, Inc. Voice controlled assistant with non-verbal user input
US9346606B1 (en) 2013-09-09 2016-05-24 Amazon Technologies, Inc. Package for revealing an item housed therein
US9672812B1 (en) 2013-09-18 2017-06-06 Amazon Technologies, Inc. Qualifying trigger expressions in speech-based systems
US9755605B1 (en) 2013-09-19 2017-09-05 Amazon Technologies, Inc. Volume control
US9516081B2 (en) 2013-09-20 2016-12-06 Amazon Technologies, Inc. Reduced latency electronic content system
US9001994B1 (en) 2013-09-24 2015-04-07 Rawles Llc Non-uniform adaptive echo cancellation
US9558563B1 (en) 2013-09-25 2017-01-31 Amazon Technologies, Inc. Determining time-of-fight measurement parameters
US10134395B2 (en) 2013-09-25 2018-11-20 Amazon Technologies, Inc. In-call virtual assistants
US9536493B2 (en) 2013-09-25 2017-01-03 Samsung Electronics Co., Ltd. Display apparatus and method of controlling display apparatus
US9877080B2 (en) 2013-09-27 2018-01-23 Samsung Electronics Co., Ltd. Display apparatus and method for controlling thereof
US9441951B1 (en) 2013-11-25 2016-09-13 Amazon Technologies, Inc. Documenting test room configurations
US9698999B2 (en) 2013-12-02 2017-07-04 Amazon Technologies, Inc. Natural language control of secondary device
US9391575B1 (en) 2013-12-13 2016-07-12 Amazon Technologies, Inc. Adaptive loudness control
US10055190B2 (en) 2013-12-16 2018-08-21 Amazon Technologies, Inc. Attribute-based audio channel arbitration
US9721570B1 (en) 2013-12-17 2017-08-01 Amazon Technologies, Inc. Outcome-oriented dialogs on a speech recognition platform
US10224056B1 (en) 2013-12-17 2019-03-05 Amazon Technologies, Inc. Contingent device actions during loss of network connectivity
US9304674B1 (en) 2013-12-18 2016-04-05 Amazon Technologies, Inc. Depth-based display navigation
US9304582B1 (en) 2013-12-19 2016-04-05 Amazon Technologies, Inc. Object-based color detection and correction
US9319787B1 (en) 2013-12-19 2016-04-19 Amazon Technologies, Inc. Estimation of time delay of arrival for microphone arrays
US10147441B1 (en) 2013-12-19 2018-12-04 Amazon Technologies, Inc. Voice controlled system
US9319782B1 (en) 2013-12-20 2016-04-19 Amazon Technologies, Inc. Distributed speaker synchronization
US9911414B1 (en) 2013-12-20 2018-03-06 Amazon Technologies, Inc. Transient sound event detection
US11227294B2 (en) 2014-04-03 2022-01-18 Mentor Acquisition One, Llc Sight information collection in head worn computing
US9366868B2 (en) 2014-09-26 2016-06-14 Osterhout Group, Inc. See-through computer display systems
US9594246B2 (en) 2014-01-21 2017-03-14 Osterhout Group, Inc. See-through computer display systems
US10254856B2 (en) 2014-01-17 2019-04-09 Osterhout Group, Inc. External user interface for head worn computing
US11103122B2 (en) 2014-07-15 2021-08-31 Mentor Acquisition One, Llc Content presentation in head worn computing
US20150228119A1 (en) 2014-02-11 2015-08-13 Osterhout Group, Inc. Spatial location presentation in head worn computing
US10684687B2 (en) 2014-12-03 2020-06-16 Mentor Acquisition One, Llc See-through computer display systems
US9299194B2 (en) 2014-02-14 2016-03-29 Osterhout Group, Inc. Secure sharing in head worn computing
US20160019715A1 (en) 2014-07-15 2016-01-21 Osterhout Group, Inc. Content presentation in head worn computing
US9841599B2 (en) 2014-06-05 2017-12-12 Osterhout Group, Inc. Optical configurations for head-worn see-through displays
US20150277118A1 (en) 2014-03-28 2015-10-01 Osterhout Group, Inc. Sensor dependent content position in head worn computing
US9529195B2 (en) 2014-01-21 2016-12-27 Osterhout Group, Inc. See-through computer display systems
US9829707B2 (en) 2014-08-12 2017-11-28 Osterhout Group, Inc. Measuring content brightness in head worn computing
US9575321B2 (en) 2014-06-09 2017-02-21 Osterhout Group, Inc. Content presentation in head worn computing
US9746686B2 (en) 2014-05-19 2017-08-29 Osterhout Group, Inc. Content position calibration in head worn computing
US10649220B2 (en) 2014-06-09 2020-05-12 Mentor Acquisition One, Llc Content presentation in head worn computing
US9810906B2 (en) 2014-06-17 2017-11-07 Osterhout Group, Inc. External user interface for head worn computing
US10191279B2 (en) 2014-03-17 2019-01-29 Osterhout Group, Inc. Eye imaging in head worn computing
US9448409B2 (en) 2014-11-26 2016-09-20 Osterhout Group, Inc. See-through computer display systems
US9939934B2 (en) 2014-01-17 2018-04-10 Osterhout Group, Inc. External user interface for head worn computing
US9671613B2 (en) 2014-09-26 2017-06-06 Osterhout Group, Inc. See-through computer display systems
US9651784B2 (en) 2014-01-21 2017-05-16 Osterhout Group, Inc. See-through computer display systems
US9494800B2 (en) 2014-01-21 2016-11-15 Osterhout Group, Inc. See-through computer display systems
US20150205135A1 (en) 2014-01-21 2015-07-23 Osterhout Group, Inc. See-through computer display systems
US9836122B2 (en) 2014-01-21 2017-12-05 Osterhout Group, Inc. Eye glint imaging in see-through computer display systems
US11487110B2 (en) 2014-01-21 2022-11-01 Mentor Acquisition One, Llc Eye imaging in head worn computing
US11737666B2 (en) 2014-01-21 2023-08-29 Mentor Acquisition One, Llc Eye imaging in head worn computing
US9753288B2 (en) 2014-01-21 2017-09-05 Osterhout Group, Inc. See-through computer display systems
US9811153B2 (en) 2014-01-21 2017-11-07 Osterhout Group, Inc. Eye imaging in head worn computing
US9615742B2 (en) 2014-01-21 2017-04-11 Osterhout Group, Inc. Eye imaging in head worn computing
US9310610B2 (en) 2014-01-21 2016-04-12 Osterhout Group, Inc. See-through computer display systems
US20150206173A1 (en) 2014-01-21 2015-07-23 Osterhout Group, Inc. Eye imaging in head worn computing
US11669163B2 (en) 2014-01-21 2023-06-06 Mentor Acquisition One, Llc Eye glint imaging in see-through computer display systems
US11892644B2 (en) 2014-01-21 2024-02-06 Mentor Acquisition One, Llc See-through computer display systems
US9529199B2 (en) 2014-01-21 2016-12-27 Osterhout Group, Inc. See-through computer display systems
US9766463B2 (en) 2014-01-21 2017-09-19 Osterhout Group, Inc. See-through computer display systems
US9846308B2 (en) 2014-01-24 2017-12-19 Osterhout Group, Inc. Haptic systems for head-worn computers
US9753119B1 (en) 2014-01-29 2017-09-05 Amazon Technologies, Inc. Audio and depth based sound source localization
US9363598B1 (en) 2014-02-10 2016-06-07 Amazon Technologies, Inc. Adaptive microphone array compensation
US9401540B2 (en) 2014-02-11 2016-07-26 Osterhout Group, Inc. Spatial location presentation in head worn computing
US9852545B2 (en) 2014-02-11 2017-12-26 Osterhout Group, Inc. Spatial location presentation in head worn computing
US11132173B1 (en) 2014-02-20 2021-09-28 Amazon Technologies, Inc. Network scheduling of stimulus-based actions
JP6039594B2 (ja) * 2014-02-20 2016-12-07 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置および情報処理方法
US9615177B2 (en) 2014-03-06 2017-04-04 Sphere Optics Company, Llc Wireless immersive experience capture and viewing
US9294860B1 (en) 2014-03-10 2016-03-22 Amazon Technologies, Inc. Identifying directions of acoustically reflective surfaces
US9739609B1 (en) 2014-03-25 2017-08-22 Amazon Technologies, Inc. Time-of-flight sensor with configurable phase delay
US9374554B1 (en) 2014-03-25 2016-06-21 Amazon Technologies, Inc. Display selection for video conferencing
US9373318B1 (en) 2014-03-27 2016-06-21 Amazon Technologies, Inc. Signal rate synchronization for remote acoustic echo cancellation
US9336767B1 (en) 2014-03-28 2016-05-10 Amazon Technologies, Inc. Detecting device proximities
US20160187651A1 (en) 2014-03-28 2016-06-30 Osterhout Group, Inc. Safety for a vehicle operator with an hmd
US9607207B1 (en) 2014-03-31 2017-03-28 Amazon Technologies, Inc. Plane-fitting edge detection
US9363616B1 (en) 2014-04-18 2016-06-07 Amazon Technologies, Inc. Directional capability testing of audio devices
US9526115B1 (en) 2014-04-18 2016-12-20 Amazon Technologies, Inc. Multiple protocol support in distributed device systems
US9423842B2 (en) 2014-09-18 2016-08-23 Osterhout Group, Inc. Thermal management for head-worn computer
US20150309534A1 (en) 2014-04-25 2015-10-29 Osterhout Group, Inc. Ear horn assembly for headworn computer
US9651787B2 (en) 2014-04-25 2017-05-16 Osterhout Group, Inc. Speaker assembly for headworn computer
US10853589B2 (en) 2014-04-25 2020-12-01 Mentor Acquisition One, Llc Language translation with head-worn computing
US9672210B2 (en) 2014-04-25 2017-06-06 Osterhout Group, Inc. Language translation with head-worn computing
US20160137312A1 (en) 2014-05-06 2016-05-19 Osterhout Group, Inc. Unmanned aerial vehicle launch system
US10210885B1 (en) 2014-05-20 2019-02-19 Amazon Technologies, Inc. Message and user profile indications in speech-based systems
US10249296B1 (en) 2014-05-27 2019-04-02 Amazon Technologies, Inc. Application discovery and selection in language-based systems
US10663740B2 (en) 2014-06-09 2020-05-26 Mentor Acquisition One, Llc Content presentation in head worn computing
US10236016B1 (en) 2014-06-16 2019-03-19 Amazon Technologies, Inc. Peripheral-based selection of audio sources
US9185391B1 (en) 2014-06-17 2015-11-10 Actality, Inc. Adjustable parallax distance, wide field of view, stereoscopic imaging system
US9430931B1 (en) 2014-06-18 2016-08-30 Amazon Technologies, Inc. Determining user location with remote controller
US10102195B2 (en) 2014-06-25 2018-10-16 Amazon Technologies, Inc. Attribute fill using text extraction
US9368105B1 (en) 2014-06-26 2016-06-14 Amazon Technologies, Inc. Preventing false wake word detections with a voice-controlled device
US9691379B1 (en) 2014-06-26 2017-06-27 Amazon Technologies, Inc. Selecting from multiple content sources
US9548066B2 (en) 2014-08-11 2017-01-17 Amazon Technologies, Inc. Voice application architecture
US10325591B1 (en) * 2014-09-05 2019-06-18 Amazon Technologies, Inc. Identifying and suppressing interfering audio content
US9456276B1 (en) 2014-09-30 2016-09-27 Amazon Technologies, Inc. Parameter selection for audio beamforming
CN104501001B (zh) * 2014-11-28 2016-11-23 广景科技有限公司 一种智能投影灯泡及其互动和智能投影方法
US9684172B2 (en) 2014-12-03 2017-06-20 Osterhout Group, Inc. Head worn computer display systems
USD743963S1 (en) 2014-12-22 2015-11-24 Osterhout Group, Inc. Air mouse
USD751552S1 (en) 2014-12-31 2016-03-15 Osterhout Group, Inc. Computer glasses
USD753114S1 (en) 2015-01-05 2016-04-05 Osterhout Group, Inc. Air mouse
US9898078B2 (en) 2015-01-12 2018-02-20 Dell Products, L.P. Immersive environment correction display and method
EP3251343A4 (en) * 2015-01-30 2018-09-05 Ent. Services Development Corporation LP Room capture and projection
WO2016122582A1 (en) * 2015-01-30 2016-08-04 Hewlett Packard Enterprise Development Lp Relationship preserving projection of digital objects
US10878775B2 (en) 2015-02-17 2020-12-29 Mentor Acquisition One, Llc See-through computer display systems
US20160239985A1 (en) 2015-02-17 2016-08-18 Osterhout Group, Inc. See-through computer display systems
CN107430841B (zh) 2015-03-31 2021-03-09 索尼公司 信息处理设备、信息处理方法、程序以及图像显示系统
JP6467039B2 (ja) * 2015-05-21 2019-02-06 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置
US10139966B2 (en) 2015-07-22 2018-11-27 Osterhout Group, Inc. External user interface for head worn computing
JP6977731B2 (ja) * 2015-10-26 2021-12-08 コン リアン 没入型ディスプレイエンクロージャ
US10850116B2 (en) 2016-12-30 2020-12-01 Mentor Acquisition One, Llc Head-worn therapy device
US10591728B2 (en) 2016-03-02 2020-03-17 Mentor Acquisition One, Llc Optical systems for head-worn computers
US10667981B2 (en) 2016-02-29 2020-06-02 Mentor Acquisition One, Llc Reading assistance system for visually impaired
US9826299B1 (en) 2016-08-22 2017-11-21 Osterhout Group, Inc. Speaker systems for head-worn computer systems
US9880441B1 (en) 2016-09-08 2018-01-30 Osterhout Group, Inc. Electrochromic systems for head-worn computer systems
ES2636782B1 (es) 2016-04-07 2018-07-20 Broomx Technologies, S.L. Sistema para proyectar contenidos audiovisuales inmersivos
US10824253B2 (en) 2016-05-09 2020-11-03 Mentor Acquisition One, Llc User interface systems for head-worn computers
US10684478B2 (en) 2016-05-09 2020-06-16 Mentor Acquisition One, Llc User interface systems for head-worn computers
US9910284B1 (en) 2016-09-08 2018-03-06 Osterhout Group, Inc. Optical systems for head-worn computers
US10466491B2 (en) 2016-06-01 2019-11-05 Mentor Acquisition One, Llc Modular systems for head-worn computers
SG11201810918PA (en) 2016-06-14 2019-01-30 Razer Asia Pacific Pte Ltd Image processing devices, methods for controlling an image processing device, and computer-readable media
US10690936B2 (en) 2016-08-29 2020-06-23 Mentor Acquisition One, Llc Adjustable nose bridge assembly for headworn computer
US10438264B1 (en) 2016-08-31 2019-10-08 Amazon Technologies, Inc. Artificial intelligence feature extraction service for products
US10135950B2 (en) * 2016-10-10 2018-11-20 Google Llc Creating a cinematic storytelling experience using network-addressable devices
US10819952B2 (en) * 2016-10-11 2020-10-27 Sony Interactive Entertainment LLC Virtual reality telepresence
USD840395S1 (en) 2016-10-17 2019-02-12 Osterhout Group, Inc. Head-worn computer
US10004984B2 (en) * 2016-10-31 2018-06-26 Disney Enterprises, Inc. Interactive in-room show and game system
USD864959S1 (en) 2017-01-04 2019-10-29 Mentor Acquisition One, Llc Computer glasses
US10780358B1 (en) * 2017-03-22 2020-09-22 Intuitive Research And Technology Corporation Virtual reality arena system
KR101760639B1 (ko) * 2017-03-31 2017-07-24 한국과학기술원 입력영상의 주변뷰 영상을 생성하는 몰입형 디스플레이 장치 및 방법
US10908679B2 (en) * 2017-04-24 2021-02-02 Intel Corporation Viewing angles influenced by head and body movements
US10719947B2 (en) 2017-05-19 2020-07-21 Faro Technologies, Inc. Three-dimensional measurement device with annotation features
ES2695250A1 (es) * 2017-06-27 2019-01-02 Broomx Tech S L Procedimiento para proyectar contenidos audiovisuales inmersivos
EP3422707A1 (en) * 2017-06-29 2019-01-02 Vestel Elektronik Sanayi ve Ticaret A.S. Display system and method
US11409105B2 (en) 2017-07-24 2022-08-09 Mentor Acquisition One, Llc See-through computer display systems
US10578869B2 (en) 2017-07-24 2020-03-03 Mentor Acquisition One, Llc See-through computer display systems with adjustable zoom cameras
US10422995B2 (en) 2017-07-24 2019-09-24 Mentor Acquisition One, Llc See-through computer display systems with stray light management
US10969584B2 (en) 2017-08-04 2021-04-06 Mentor Acquisition One, Llc Image expansion optic for head-worn computer
TWI642973B (zh) * 2017-09-12 2018-12-01 晶將數位多媒體科技股份有限公司 3D floating stereoscopic image creation and display device
US10515637B1 (en) 2017-09-19 2019-12-24 Amazon Technologies, Inc. Dynamic speech processing
US11194464B1 (en) 2017-11-30 2021-12-07 Amazon Technologies, Inc. Display control using objects
US10713007B2 (en) 2017-12-12 2020-07-14 Amazon Technologies, Inc. Architecture for a hub configured to control a second device while a connection to a remote system is unavailable
US10859831B1 (en) * 2018-05-16 2020-12-08 Facebook Technologies, Llc Systems and methods for safely operating a mobile virtual reality system
US10997963B1 (en) * 2018-05-17 2021-05-04 Amazon Technologies, Inc. Voice based interaction based on context-based directives
US20200014909A1 (en) 2018-07-03 2020-01-09 Faro Technologies, Inc. Handheld three dimensional scanner with autofocus or autoaperture
US10540797B1 (en) 2018-08-02 2020-01-21 Disney Enterprises, Inc. Image customization using a persona
US11132837B2 (en) * 2018-11-06 2021-09-28 Lucasfilm Entertainment Company Ltd. LLC Immersive content production system with multiple targets
TWI747333B (zh) * 2020-06-17 2021-11-21 光時代科技有限公司 基於光通信裝置的交互方法、電子設備以及電腦可讀取記錄媒體
WO2022220707A1 (ru) * 2021-04-12 2022-10-20 Хальдун Саид Аль-Зубейди Виртуальная телепорт комната

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040046736A1 (en) * 1997-08-22 2004-03-11 Pryor Timothy R. Novel man machine interfaces and applications
US20070126864A1 (en) * 2005-12-05 2007-06-07 Kiran Bhat Synthesizing three-dimensional surround visual field
WO2007134456A1 (en) * 2006-05-24 2007-11-29 Smart Technologies Ulc Method and apparatus for inhibiting a subject's eyes from being exposed to projected light

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3880561B2 (ja) * 2002-09-05 2007-02-14 株式会社ソニー・コンピュータエンタテインメント 表示システム
CA2464569A1 (en) * 2003-04-16 2004-10-16 Universite De Montreal Single or multi-projector for arbitrary surfaces without calibration nor reconstruction
KR101098306B1 (ko) * 2003-08-19 2011-12-26 코닌클리케 필립스 일렉트로닉스 엔.브이. 시각적 콘텐트 신호 디스플레이 장치 및 시각적 콘텐트 신호 디스플레이 방법
US7077529B2 (en) * 2004-02-20 2006-07-18 L-3 Communications Corporation Masked image projection system and method
US7182465B2 (en) * 2004-02-25 2007-02-27 The University Of North Carolina Methods, systems, and computer program products for imperceptibly embedding structured light patterns in projected color images for display on planar and non-planar surfaces
US8195006B2 (en) * 2004-08-30 2012-06-05 Bauhaus-Universitaet Weimar Method and device for representing a digital image on a surface which is non-trivial in terms of its geometry and photometry
US8130330B2 (en) * 2005-12-05 2012-03-06 Seiko Epson Corporation Immersive surround visual fields
JP2007264633A (ja) * 2006-03-28 2007-10-11 Seiko Epson Corp サラウンド・ビジュアル・フィールド・システム、入力ストリームに関連するサラウンド・ビジュアル・フィールドを生成する方法およびサラウンド・ビジュアル・フィールド・コントローラ
MX2008012473A (es) * 2006-03-31 2008-10-10 Koninkl Philips Electronics Nv Reproduccion adaptada de contenido de video basada en cuadros adicionales de contenido.
US7972005B2 (en) * 2007-04-02 2011-07-05 Agere Systems Inc. Computer projector method and apparatus having a safety feature for blacking out a portion of the image being projected onto a person
JP2009031334A (ja) * 2007-07-24 2009-02-12 Sharp Corp プロジェクタ及びプロジェクタの投射方法
US8488129B2 (en) * 2007-10-05 2013-07-16 Artec Group, Inc. Combined object capturing system and display device and associated method
US20090128783A1 (en) * 2007-11-15 2009-05-21 Yueh-Hong Shih Ocular-protection projector device
US8235534B2 (en) * 2008-05-21 2012-08-07 Panasonic Corporation Projector that projects a correction image between cyclic main image signals

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040046736A1 (en) * 1997-08-22 2004-03-11 Pryor Timothy R. Novel man machine interfaces and applications
US20070126864A1 (en) * 2005-12-05 2007-06-07 Kiran Bhat Synthesizing three-dimensional surround visual field
WO2007134456A1 (en) * 2006-05-24 2007-11-29 Smart Technologies Ulc Method and apparatus for inhibiting a subject's eyes from being exposed to projected light

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107306332A (zh) * 2016-04-19 2017-10-31 奥多比公司 闭塞直接视图增强现实系统的图像补偿
US10891804B2 (en) 2016-04-19 2021-01-12 Adobe Inc. Image compensation for an occluding direct-view augmented reality system
US11514657B2 (en) 2016-04-19 2022-11-29 Adobe Inc. Replica graphic causing reduced visibility of an image artifact in a direct-view of a real-world scene
CN109565567A (zh) * 2016-09-09 2019-04-02 谷歌有限责任公司 三维遥现系统
US10880582B2 (en) 2016-09-09 2020-12-29 Google Llc Three-dimensional telepresence system
JP2020503599A (ja) * 2016-12-14 2020-01-30 サムスン エレクトロニクス カンパニー リミテッド ディスプレイ装置及びその制御方法
JP7050067B2 (ja) 2016-12-14 2022-04-07 サムスン エレクトロニクス カンパニー リミテッド ディスプレイ装置及びその制御方法
CN109712522A (zh) * 2017-10-25 2019-05-03 Tcl集团股份有限公司 一种沉浸式信息呈现方法和系统
CN109712522B (zh) * 2017-10-25 2022-03-29 Tcl科技集团股份有限公司 一种沉浸式信息呈现方法和系统
CN113168080A (zh) * 2018-12-18 2021-07-23 索尼半导体解决方案公司 图像显示装置
CN113168080B (zh) * 2018-12-18 2023-09-22 索尼半导体解决方案公司 图像显示装置

Also Published As

Publication number Publication date
KR20140014160A (ko) 2014-02-05
JP2014509759A (ja) 2014-04-21
WO2012118769A9 (en) 2012-11-22
EP2681641A4 (en) 2014-08-27
EP2681641A2 (en) 2014-01-08
AR085517A1 (es) 2013-10-09
TW201244459A (en) 2012-11-01
US20120223885A1 (en) 2012-09-06
WO2012118769A2 (en) 2012-09-07

Similar Documents

Publication Publication Date Title
CN102681663A (zh) 身临其境的显示体验
US10803670B2 (en) Constructing augmented reality environment with pre-computed lighting
US10497175B2 (en) Augmented reality virtual monitor
US10621785B2 (en) Blended reality systems and methods
US9734633B2 (en) Virtual environment generating system
US20150312561A1 (en) Virtual 3d monitor
US8199186B2 (en) Three-dimensional (3D) imaging based on motionparallax
CA2857510C (en) Display of shadows via see-through display
US20150348326A1 (en) Immersion photography with dynamic matte screen
EP3242274A1 (en) Method and device for displaying three-dimensional objects
US20130141419A1 (en) Augmented reality with realistic occlusion
CN103761763B (zh) 用于使用预先计算的光照构建增强现实环境的方法
CN102540464A (zh) 提供环绕视频的头戴式显示设备
CN102419631A (zh) 虚拟内容到现实内容中的融合
EP3308539A1 (en) Display for stereoscopic augmented reality
US20130285919A1 (en) Interactive video system
KR20150071595A (ko) 사전 계산된 조명으로 증강 현실 환경을 구성하는 기법
CN113227876B (zh) 经修改慢扫描驱动信号

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1173798

Country of ref document: HK

SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
ASS Succession or assignment of patent right

Owner name: MICROSOFT TECHNOLOGY LICENSING LLC

Free format text: FORMER OWNER: MICROSOFT CORP.

Effective date: 20150728

C41 Transfer of patent application or patent right or utility model
TA01 Transfer of patent application right

Effective date of registration: 20150728

Address after: Washington State

Applicant after: Micro soft technique license Co., Ltd

Address before: Washington State

Applicant before: Microsoft Corp.

C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20120919

REG Reference to a national code

Ref country code: HK

Ref legal event code: WD

Ref document number: 1173798

Country of ref document: HK