CN104603719B - Augmented reality display surface - Google Patents

Augmented reality display surface Download PDF

Info

Publication number
CN104603719B
CN104603719B CN201380045744.9A CN201380045744A CN104603719B CN 104603719 B CN104603719 B CN 104603719B CN 201380045744 A CN201380045744 A CN 201380045744A CN 104603719 B CN104603719 B CN 104603719B
Authority
CN
China
Prior art keywords
reference
surface
scene
user
virtual
Prior art date
Application number
CN201380045744.9A
Other languages
Chinese (zh)
Other versions
CN104603719A (en
Inventor
朱利亚诺·马乔奇
詹姆斯·约瑟夫·马尔霍兰
Original Assignee
高通股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US201261696761P priority Critical
Priority to US61/696,761 priority
Priority to US13/802,194 priority patent/US9530232B2/en
Application filed by 高通股份有限公司 filed Critical 高通股份有限公司
Priority to PCT/US2013/053954 priority patent/WO2014039201A1/en
Publication of CN104603719A publication Critical patent/CN104603719A/en
Application granted granted Critical
Publication of CN104603719B publication Critical patent/CN104603719B/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/60Editing figures and text; Combining figures or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00335Recognising movements or behaviour, e.g. recognition of gestures, dynamic facial expressions; Lip-reading
    • G06K9/00355Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00624Recognising scenes, i.e. recognition of a whole field of perception; recognising scene-specific objects
    • G06K9/00664Recognising scenes such as could be captured by a camera operated by a pedestrian or robot, including objects at substantially different ranges from the camera
    • G06K9/00671Recognising scenes such as could be captured by a camera operated by a pedestrian or robot, including objects at substantially different ranges from the camera for providing information about objects in the scene to a user, e.g. as in augmented reality applications
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • G06T2207/20221Image fusion; Image merging
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30244Camera pose

Abstract

本发明提出用于提供使头戴式显示器单元或另一具有扩增实境功能的装置的用户能够与由此单元或装置提供的各种用户接口和其它特征互动的直观、功能性且方便的方式的方法、系统、计算机可读媒体和设备。 The present invention proposes to provide a head mounted display unit or another user interface with a variety of other features and functions of the user augmented reality apparatus can be provided with interactive means whereby the unit or intuitive, convenient and functional the method aspect, the system, apparatus and computer-readable media. 在一些实施例中,例如头戴式显示器单元的计算装置可接收场景的摄像机输入。 In some embodiments, a computing device may receive a head-mounted display unit of the camera input scene. 随后,所述计算装置可例如基于检测到所述接收到的摄像机输入中的一或多个矩形而识别所述场景中的至少一个参照物。 Subsequently, the computing device may be, for example, based on one or more rectangular camera input is detected in the received identifying at least one reference object in the scene. 所述计算装置接着可接收相对于所述至少一个参照物定义表面区段的输入。 Then the computing device may receive at least one input with respect to the reference surface section of the definition. 其后,所述计算装置可呈现所述表面区段。 Thereafter, the computing device may present the surface section.

Description

扩増实境表面显示 Zo expanded reality display surface

技术领域 FIELD

[0001] 本发明的方面涉及计算技术,包含计算机软件和计算机硬件。 Aspect [0001] The present invention relates to computing technology, including computer software and computer hardware. 确切地说,本发明的各种方面涉及可提供扩增实境(AR)的技术和装置。 Rather, various aspects of the invention relates to techniques and devices augmented reality (AR) may be provided.

背景技术 Background technique

[0002] 人们正日益按许多不同方式将各种类型的现有和新计算装置用于许多不同用途。 [0002] There is an increasing number of different ways according to various types of existing and new means for computing a number of different purposes. 已被提议且可变得日益流行的一种类型的装置为头戴式显示器(HMD)单元。 It has been proposed, and increasingly popular type of device may be made as a head-mounted display (HMD) units. 此头戴式显示器单元可(例如)包含处理组件,或与包含一或多个处理组件的另一装置通信,以对头戴式显示器单元的用户呈现和/或另外提供内容。 This head-mounted display unit may be (e.g.) comprising a processing component, or other communication means comprises one or more of the processing components, the head mounted display to the user presentation unit and / or otherwise provide content. 这些用户接口可(例如)由在由用户戴在其眼睛上的特殊透镜上的头戴式显示器单元呈现,使得内容显得完全或部分覆盖于用户的实际实体环境上,和/或另外相对于用户的实际实体环境显示。 These user interfaces may be (e.g.) presented by a special lens on the eye which is worn on the user's head mounted display unit, so that the content appears completely or partially covers the user's actual physical environment, and / or otherwise with respect to the user the actual physical environment display.

[0003] 常规和/或当前可用的头戴式显示器单元通常受到处理功率和提供这些功能性所需要的其它资源限制。 [0003] The conventional and / or head-mounted display unit currently available is usually subjected to these processing power and other resources required functional limitations. 另外,由这些头戴式显示器单元提供的内容可能为基本的和/或不便利的。 Further, the content provided by these units may be substantially head-mounted display and / or inconvenient.

发明内容 SUMMARY

[0004] 描述提供使头戴式显示器单元的用户能够与由头戴式显示器单元提供的各种用户接口和其它特征互动的更直观、更有功能性且更方便的方式的某些实施例。 Certain embodiments [0004] The description provided makes the user head-mounted display unit can be more intuitive interaction with the user interface and various other features provided by the head-mounted display unit, more functional and more convenient way.

[0005] 在一些实施例中,且如下文更详细地论述,可使用矩形追踪技术与利用经由头戴式摄像机接收的输入的指追踪技术的组合将现实世界表面实时地分段。 [0005] In some embodiments, and as discussed in more detail below, may be used in combination rectangular tracking technology and using the received input means via a head-mounted camera tracking techniques to segment the surface of the real world in real time. 在至少一个布置中,例如智能电话的日常物件可被用作参照物,其亦可被称作用于追踪各种目标和确定表平面对准的“参照物”。 In at least one arrangement, such as a smart phone everyday objects can be used as a reference, which may also be referred to track targets and planar alignment of the determination table "reference." 此目标追踪和表平面对准确定可(例如)随后用于经由头戴式显示器单元、用户接口或正确地对准其锚定于之上的实际表面的其它虚拟物件呈现中。 This planar alignment table and the target track may be determined (e.g.) then via a head-mounted display unit, a user interface or other proper alignment of the actual surface of the virtual object which is anchored to the above presentation.

[0006] 根据本发明的各种方面可经由头戴式显示器单元呈现于表面区段上的用户接口和其它虚拟物件的一些实例包含:网页、共享和/或合作工作空间、可导航应用、游戏、虚拟键盘和/或其它虚拟外围装置和输入装置、视频和/或媒体播放应用、统计显像和/或其它资料表示和各种三维物件。 [0006] In accordance with some examples of the various aspects of the invention may be presented on the surface section of the head-mounted display via a user interface unit and other virtual objects comprising: a web, sharing and / or collaborative work space, navigation applications, games, , virtual keyboard and / or other virtual peripheral devices and input devices, video and / or media player application, statistics imaging and / or other data representation and a variety of three-dimensional objects. 虽然此处将这些类型的用户接口和虚拟物件作为可使用头戴式显示器单元所呈现之物的实例列出,但替代以上列出之物和/或除了以上列出之物外,也可同样地呈现和/或另外提供任一其它类型的用户接口或虚拟物件。 While here the user interface, and these types may be used as a virtual object presented examples of head-mounted display unit was listed, but the alternatives listed above and / or in addition to the objects listed above, may likewise presented and / or otherwise provide a user interface or any other type of virtual object.

[0007] 在一些实施例中,例如头戴式显示器单元的计算装置可接收场景的摄像机输入。 [0007] In some embodiments, a computing device may receive a head-mounted display unit of the camera input scene. 随后,计算装置可(例如)基于检测到接收到的摄像机输入中的一或多个矩形而识别场景中的至少一个参照物。 Subsequently, the computing device may be (e.g.) based on one or more rectangular camera input is detected in the received identifying at least one reference scene. 计算装置接着可接收相对于所述至少一个参照物定义表面区段的输入。 The computing device then may receive at least one input with respect to reference surfaces defined segment. 其后,计算装置可呈现表面区段。 Thereafter, the computing device may present surface section.

[0008] 在一些实施例中,一种用于扩增实境表面分段的系统可包括:用于光学感测场景的图像的装置;用于识别所述场景中的至少一个参照物的装置,其中所述参照物为物理物件;用于接收相对于所述至少一个参照物定义表面区段的输入的装置;和用于使所述表面区段被呈现的装置。 [0008] In some embodiments, a method for augmented reality system may segment surface comprising: an image sensing optical scene; means for identifying said at least one reference scene for , wherein the reference object is a physical object; at least one reference input means for receiving a defined surface section relative to the; and means for causing said surface portion to be presented.

[0009] 在所述系统的一些实施例中,用于识别所述场景中的至少一个参照物的所述装置包含用于检测所述接收到的摄像机输入中的一或多个特征点的装置。 At least one reference object device [0009] In some embodiments of the system for identifying the scene comprises means for one or more feature points of the received input to the camera detected .

[0010] 在所述系统的一些实施例中,用于识别所述场景中的至少一个参照物的所述装置包含用于从所述至少一个参照物接收无线通信的装置。 At least one reference object device [0010] In some embodiments of the system for identifying the scene includes means for receiving from said at least one reference radio communication.

[0011] 在所述系统的一些实施例中,用于识别所述场景中的至少一个参照物的所述装置包含用于检测所述接收到的摄像机输入中的一或多个矩形的装置。 At least one reference object device [0011] In some embodiments of the system for identifying the scene comprising means for detecting a plurality of rectangular or the received input is a camera.

[0012] 在一些实施例中,用于扩增实境表面分段的系统可进一步包括:用于基于所述一或多个检测的矩形确定所述场景的当前视角的装置,其中所述表面区段是相对于所述场景的所述当前视角呈现。 [0012] In some embodiments, a surface segment augmented reality system may further comprise: means for determining the current angle of view of the scene based on the one or more rectangular detection, wherein said surface the segments are relative to the current viewing angle of the scene rendering.

[0013] 在一些实施例中,用于扩增实境表面分段的系统可进一步包括:用于基于确定所述场景的所述当前视角已改变而动态更新所述呈现的表面区段的装置。 [0013] In some embodiments, a surface segment augmented reality system may further comprise: means for determining based on the current viewing angle of the scene has changed dynamically updated section of the surface presented for .

[0014] 在所述系统的一些实施例中,定义所述表面区段的所述输入为定义所述表面区段的形状的手指移动,其中所述手指移动由使所述表面区段被呈现的装置的用户执行。 [0014] In some embodiments of the system, the input surface section defining the shape of the finger surface section defining the movement, wherein the movement of the finger from the surface of the section to be presented performed by the user device.

[0015] 在所述系统的一些实施例中,用于使所述表面区段被呈现的所述装置包括:用于在虚拟工作空间中按第一角度呈现所述表面区段的装置;和用于在所述虚拟工作空间中按不同于所述第一角度的第二角度呈现由所述用户定义的第二表面区段的装置。 [0015] In some embodiments of the system, said means for causing said surface portion to be presented comprising: means for presenting the virtual workspace surface for the first angle section; and means second surface portion defined by the user in the virtual workspace at a second angle different from the first angle presentation.

[0016] 在一些实施例中,用于扩增实境表面分段的系统可进一步包括:用于基于确定已从所述场景去除所述至少一个参照物关闭所述虚拟工作空间的装置。 [0016] In some embodiments, the augmented reality system for a surface segment may further comprise: means for determining based on at least one of said closed reference virtual workspace from the removal of the scene.

[0017] 在一些实施例中,用于扩增实境表面分段的系统可进一步包括:用于基于确定已将所述至少一个参照物再引入到所述场景或另一场景内打开所述虚拟工作空间的装置。 [0017] In some embodiments, a surface segment augmented reality system may further comprise: at least one re-introduced into said reference object scene based on the scene or another has been the determination of the opening the virtual workspace.

[0018] 在一些实施例中,用于扩增实境表面分段的系统可进一步包括:用于基于检测到不同于所述至少一个参照物的第二参照物打开不同于所述虚拟工作空间的第二虚拟工作空间的装置。 [0018] In some embodiments, the augmented reality system for a surface segment may further comprise: a virtual workspace is different from the opening based on the detected second reference is different from the at least one reference object the second virtual device workspace.

[0019] 在所述系统的一些实施例中,检测所述第二参照物包括基于由所述第二参照物显示的代码识别所述第二参照物。 [0019] In some embodiments of the system, comprising detecting the second reference codes identifying the display by the second reference based on a second reference.

[0020] 在一些实施例中,用于扩增实境表面分段的系统可进一步包括:用于将包括包含所述表面区段的虚拟工作空间的数据信号传输到至少一个其它装置的装置。 [0020] In some embodiments, a surface segment augmented reality system may further comprise: means for transmitting a data signal comprising a virtual workspace comprising a surface section of the at least one device to the other devices.

[0021] 在所述系统的一些实施例中,所述虚拟工作空间由提供定义所述表面区段的所述输入的第一用户定义,且所述至少一个其它装置与不同于所述第一用户的第二用户相关联。 [0021] In some embodiments of the system, the first virtual workspace user defined input by providing the surface defining the segment, and at least one other means different from the first the second user associated with the user.

[0022] 在所述系统的一些实施例中,用于使所述表面区段被呈现的所述装置包括:用于呈现用于所述第一用户的所述虚拟工作空间的装置;和用于基于所述第二用户与所述虚拟工作空间中包含的一或多个虚拟物件互动的互动动态更新用于所述第一用户的所述虚拟工作空间的所述呈现的装置。 [0022] In some embodiments of the system, said means for causing said surface portion to be presented comprises: means for the user for the first virtual workspace presentation; and with in interactive virtual object based on one or more of the user and the second virtual workspace comprising a means for updating the dynamic interaction of the user of the first virtual workspace presented.

[0023] 在一些实施例中,用于扩增实境表面分段的系统可进一步包括用于至少部分基于所述摄像机输入确定所述至少一个参照物的姿态的装置,和用于至少部分基于所述确定的姿态确定与所述至少一个参照物分开的虚拟表面的装置,其中所述表面区段呈现于所述虚拟表面上。 [0023] In some embodiments, the augmented reality system for a surface segment may further comprise means for determining at least one reference gesture input based at least in part for the camera, based at least in part, and the posture determining means determines the at least one separate virtual reference surface, wherein said surface segments presented on the virtual surface.

[0024] 在一些实施例中,一种用于扩增实境表面分段的系统可包括非暂时性计算机可读媒体,所述非暂时性计算机可读媒体包括在由处理器执行时经配置以使所述处理器进行以下操作的程序代码:接收场景的摄像机输入;识别所述场景中的至少一个参照物,其中所述参照物为物理物件;接收相对于所述至少一个参照物定义表面区段的输入;和呈现所述表面区段。 [0024] In some embodiments, a method for augmented reality system may include a surface segment of the non-transitory computer readable medium comprising a non-transitory computer-readable medium configured when executed by a processor, to cause the processor to program code to: receive a scene camera input; identifying said at least one reference scene, wherein the reference object is a physical object; at least one receiver relative to the reference surface is defined an input section; and rendering the surface sections.

[0025] 在一些实施例中,识别所述场景中的至少一个参照物包含检测所述接收到的摄像机输入中的一或多个特征点。 [0025] In some embodiments, identifying the at least one reference scene comprises a plurality of feature points detected or received by the camera input.

[0026] 在一些实施例中,识别所述场景中的至少一个参照物包含从所述至少一个参照物接收无线通信。 [0026] In some embodiments, identifying the scene comprising at least a reference receive wireless communications from said at least one reference.

[0027] 在一些实施例中,识别所述场景中的至少一个参照物包含检测所述接收到的摄像机输入中的一或多个矩形。 [0027] In some embodiments, identifying the at least one reference scene comprises a plurality of rectangular or camera detects the received input.

[0028] 在一些实施例中,一种用于扩增实境表面分段的系统可进一步包括在由处理器执行时经配置以使所述处理器进行以下操作的程序代码:基于所述一或多个检测的矩形确定所述场景的当前视角,其中相对于所述场景的所述当前视角呈现所述表面区段。 [0028] In some embodiments, a method for surface augmented reality system may further include a segment when executed by the processor is configured to cause the processor to perform the following program code: based on the one determining a plurality of rectangular or detected current angle of view of the scene, wherein the scene with respect to the current perspective rendering the surface section.

[0029] 在一些实施例中,一种用于扩增实境表面分段的系统可进一步包括在由处理器执行时经配置以使所述处理器进行以下操作的程序代码:基于确定所述场景的所述当前视角已改变动态更新所述呈现的表面区段。 [0029] In some embodiments, a method for augmented reality system may further surface segments comprises program code configured to, when executed by a processor, cause the processor to: determine based on the perspective of the scene has changed dynamically updated current surface section of the presentation.

[0030] 在一些实施例中,定义所述表面区段的所述输入为定义所述表面区段的形状的手指移动,其中所述手指移动由使所述表面区段被呈现的装置的用户执行。 [0030] In some embodiments, the input for defining the movement of the finger surface section defining the shape of the surface section, wherein the surface of the finger movement by the section of the device is presented the user carried out.

[0031] 在一些实施例中,呈现所述表面区段包括:在虚拟工作空间中按第一角度呈现所述表面区段;和在所述虚拟工作空间中按不同于所述第一角度的第二角度呈现第二表面区段。 [0031] In some embodiments, the present surface section comprising: a first angle in the virtual workspace rendering the surface section; and in the virtual workspace is different from the first angle by presenting a second angle of the second surface portion.

[0032] 在一些实施例中,一种用于扩增实境表面分段的系统可进一步包括在由处理器执行时经配置以使所述处理器进行以下操作的程序代码:确定已从所述场景去除所述至少一个参照物,和基于确定已从所述场景去除所述至少一个参照物关闭所述虚拟工作空间。 [0032] In some embodiments, a method for augmented reality system may further surface segments comprises program code configured to, when executed by a processor, cause the processor to: determine from the removing said at least one reference scene, from the scene based on the determination and removing the at least one reference closing the virtual workspace.

[0033] 在一些实施例中,一种用于扩增实境表面分段的系统可进一步包括在由处理器执行时经配置以使所述处理器进行以下操作的程序代码:确定已将所述至少一个参照物再引入到所述场景或另一场景内,和基于确定已将所述至少一个参照物再引入到所述场景或另一场景内打开所述虚拟工作空间。 [0033] In some embodiments, a method for augmented reality system may further surface segments comprises program code configured to, when executed by a processor, cause the processor to perform operations comprising: determining that have said at least one reference reintroduced into another scene or the scene, and based on determining at least one reference object has been re-introduced into the opening scene or another scene of the virtual workspace.

[0034] 在一些实施例中,一种用于扩增实境表面分段的系统可进一步包括在由处理器执行时经配置以使所述处理器进行以下操作的程序代码:检测不同于所述至少一个参照物的第二参照物,和基于检测不同于所述至少一个参照物的第二参照物打开不同于所述虚拟工作空间的第二虚拟工作空间。 [0034] In some embodiments, a method for surface augmented reality system may further include a segment when executed by the processor is configured to cause the processor to perform the following program code: detecting different from the said at least one second reference of the reference, and based on the detected second reference is different from the at least one reference opening different from the second virtual workspace virtual workspace.

[0035] 在一些实施例中,检测所述第二参照物包含基于由所述第二参照物显示的代码识别所述第二参照物。 [0035] In some embodiments, the reference object comprises detecting the second identification code based on said second reference object displayed by the second reference.

[0036] 在一些实施例中,一种用于扩增实境表面分段的系统可进一步包括在由处理器执行时经配置以使所述处理器进行以下操作的程序代码:将包括包含所述表面区段的虚拟工作空间的数据信号传输到至少一个其它装置。 [0036] In some embodiments, a method for surface augmented reality system may further include a segment when executed by the processor is configured to cause the processor to perform the following program code: including containing the virtual workspace data signal transmission section of said surface to at least one other device.

[0037] 在一些实施例中,所述虚拟工作空间由提供定义所述表面区段的所述输入的第一用户定义,且所述至少一个其它装置与不同于所述第一用户的第二用户相关联。 [0037] In some embodiments, the first virtual workspace user defined input by providing the surface defining the segment, and at least one other device and a second user different from the first associated with the user.

[0038] 在一些实施例中,呈现所述表面区段包括:呈现用于所述第一用户的所述虚拟工作空间;和确定所述用户与所述虚拟工作空间中包含的一或多个虚拟物件的互动,和基于所述第二用户与所述虚拟工作空间中包含的一或多个虚拟物件的互动,动态更新用于所述第一用户的所述虚拟工作空间的所述呈现。 [0038] In some embodiments, rendering the surface section comprises: presenting the virtual workspace for the first user; and determining one or more of the user and the virtual workspace contains interactive virtual objects, and interactive virtual object based on one or more of the user and the second virtual workspace included, for dynamically updating the first user of the virtual workspace presented.

[0039] 在一些实施例中,一种用于扩增实境表面分段的系统可进一步包括在由处理器执行时经配置以使所述处理器进行以下操作的程序代码:至少部分基于所述摄像机输入确定所述至少一个参照物的姿态,和至少部分基于所述确定的姿态确定与所述至少一个参照物分开的虚拟表面,其中所述表面区段呈现于所述虚拟表面上。 [0039] In some embodiments, a method for surface augmented reality system may further include a segment configured to, when executed by a processor, cause the processor to perform the following program code: at least in part on the said camera input determining at least one reference gesture, and at least in part on the identified orientation determining a virtual reference surface of the at least one separate section wherein the surface presented on the virtual surface.

[0040] 在一些实施例中,一种用于供具有扩增实境功能的装置使用的方法可包括检测用户的运动;和基于所述检测的运动定义虚拟工作空间。 [0040] In some embodiments, a method for method for using the apparatus having the augmented reality features may include detecting motion of a user; and based on the detected motion defined virtual workspace.

[0041] 在一些实施例中,检测所述运动包括追踪所述用户的视线。 [0041] In some embodiments, detecting comprises tracking the motion of the user's line of sight.

[0042] 在一些实施例中,检测所述运动包括追踪所述用户的至少一个手指。 [0042] In some embodiments, the motion detector comprises tracking at least one finger of the user.

[0043] 在一些实施例中,检测所述运动包括使用至少一个惯性传感器确定所述装置的运动。 [0043] In some embodiments, the detecting comprises using at least one motion sensor to determine inertial motion of the device.

[0044] 在一些实施例中,相对于虚拟物件定义所述虚拟工作空间。 [0044] In some embodiments, the virtual object with respect to defining the virtual workspace.

[0045] 在一些实施例中,所述虚拟工作空间包括用于在所述具有扩增实境功能的装置上的显示器的一或多个窗,所述窗是相对于所述具有扩增实境功能的装置的用户可见的场景中的一或多个表面显示。 [0045] In some embodiments, the virtual workspace comprising for one or more of said windows having display means on the augmented reality features, with respect to the window having the Augmented Reality one or more surfaces of the user device context functions visible in the scene displayed.

[0046] 在一些实施例中,一种用于供具有扩增实境功能的装置使用的方法可进一步包括节省所述虚拟工作空间的表示以用于传输或未来访问。 [0046] In some embodiments, a method for method for using the apparatus having the augmented reality features may further comprise saving the virtual workspace representation for transmission or future access.

[0047] 在一些实施例中,一种用于供具有扩增实境功能的装置使用的方法可包括获得描述用户定义的虚拟工作空间的信息;识别至少一个锚定物件;至少部分基于所述识别的锚定物件识别表面;和相对于所述表面呈现所述虚拟工作空间的至少一部分。 [0047] In some embodiments, a method for using the apparatus for the method having augmented reality features may include obtaining virtual workspace described user-defined information; identifying at least one anchor object; at least in part on the identifying the object identification anchoring surface; and at least a portion relative to the surface presenting the virtual workspace.

[0048] 在一些实施例中,所述获得包括接受来自摄像机的用户输入。 [0048] In some embodiments, the obtaining comprises receiving a user input from the camera.

[0049] 在一些实施例中,所述获得包括从所述锚定物件接收所述信息。 [0049] In some embodiments, the obtaining comprises receiving the object from the anchor information.

[0050] 在一些实施例中,所述获得包括从服务器下载所述信息。 [0050] In some embodiments, the obtaining the information downloaded from the server comprising a.

[0051] 在一些实施例中,一种用于供具有扩增实境功能的装置使用的方法可包括接收描述虚拟工作空间的信息以用于对第一用户显示于第一具有扩增实境功能的装置上,所述虚拟工作空间已由第二具有扩增实境功能的装置的远程用户相对于远程物件定义;识别参照物;和使所述虚拟工作空间的至少一部分对所述第一用户显示于所述第一具有扩增实境功能的装置上,所述虚拟工作空间是相对于所述参照物显示。 Method [0051] In some embodiments, a method for having means for using augmented reality features may include receiving information describing virtual workspace information for display to a first user having a first augmented reality device functions, the second virtual workspace by the remote user with augmented reality features of a remote object relative to the apparatus defined above; identifying reference; and the virtual workspace at least a portion of said first displayed on the first user device having a function of augmented reality, the virtual workspace is displayed with respect to the reference.

[0052] 在一些实施例中,将所述虚拟工作空间对所述第一用户显示,使得其对所述第一用户显得为直立的。 [0052] In some embodiments, the first virtual workspace on the user display, such that it appears to the user as a first upright.

[0053] 在一些实施例中,直立外观由所述远程用户正查看所述第一具有扩增实境功能的装置上的所述虚拟工作空间的方式定义。 [0053] In some embodiments, the upright by the remote user is the appearance of the first having a view of the virtual workspace on the augmented reality device functions define.

[0054] 在一些实施例中,所述识别的参照物包括所述远程物件。 [0054] In some embodiments, the reference object comprises identifying said remote object.

[0055] 在一些实施例中,相对于所述远程物件维持所述虚拟工作空间的元件的绝对位置,而与所述第一用户或所述远程用户的位置无关。 [0055] In some embodiments, maintaining the absolute position of the virtual workspace element of the remote object, regardless of the first user or the remote user's location.

[0056] 在一些实施例中,所述识别的参照物包括所述远程物件。 [0056] In some embodiments, the reference object comprises identifying said remote object.

[0057] 在一些实施例中,将所述虚拟工作空间的元件显示于相对于所述远程物件的位置或定向中,所述位置或定向不同于如相对于所述远程物件对所述远程用户显示的所述元件的位置或定向。 [0057] In some embodiments, the virtual workspace element is shown in relation to the position or orientation of a remote object, the position or orientation different from that as described with respect to the remote object to the remote user position or orientation of the display element.

[0058] 在一些实施例中,所述远程物件和所述识别的参照物为不同的物件。 [0058] In some embodiments, the remote identification of objects and the reference object is different.

[0059] 在一些实施例中,一种用于供具有扩增实境功能的装置使用的方法可进一步包括确定所述第一用户是否具有权限来调整所述虚拟工作空间,和如果第一用户具有权限来调整所述虚拟工作空间,那么确定是否局部调整所述虚拟工作空间或是否远程调整所述虚拟工作空间。 [0059] In some embodiments, a method for having a method for using augmented reality apparatus may further include a function determining whether the first user has the right to adjust the virtual workspace, if the first user, and It has the authority to adjust the virtual workspace, then determine whether to adjust the local virtual workspace or whether the remote to adjust the virtual workspace.

[0060] 在一些实施例中,所述虚拟工作空间的远程调整调整正将所述虚拟工作空间对所述远程用户在所述第二具有扩增实境功能的装置上显示的方式。 [0060] In some embodiments, remotely adjust the virtual workspace to adjust the timing of the virtual workspace remote user in the second embodiment having a display device function of the augmented reality.

附图说明 BRIEF DESCRIPTION

[0061] 本发明的方面是作为实例而说明。 [0061] aspect of the present invention is described as examples. 在附图中,相同参考数字指示类似元件,且: In the drawings, like reference numerals indicate like elements, and:

[0062] 图1说明可并有一或多个实施例的系统的简化图; [0062] Figure 1 illustrates a simplified diagram of a system may incorporate one or more embodiments of the embodiment;

[0063] 图2到7说明描绘根据一些实施例的使用参照物检测提供扩增实境表面分段的实例的一连串图式; [0063] Figures 2 to 7 illustrates an example of the amplification provided depict reality a series of surface segments of the drawings used in accordance with some embodiments of the reference detector;

[0064] 图8说明描绘根据一些实施例的使用参照物检测提供扩增实境表面分段的实例方法的流程图; [0064] Figure 8 illustrates a flowchart depicting an example method reality amplification of the surface segment is provided in accordance with some embodiments of the reference detector;

[0065] 图9说明描绘根据一些实施例的使用参照物检测提供扩增实境表面分段的实例方法的流程图;且 [0065] FIG 9 illustrates a flow diagram depicting an example method reality amplification segment surface provided in accordance with some embodiments of the detected reference; and

[0066] 图10说明可实施一或多个实施例的计算系统的实例。 [0066] FIG. 10 illustrates an example embodiment may be one or more of the computing system of an embodiment.

具体实施方式 Detailed ways

[0067] 现将关于形成本文的一部分的附图来描述若干说明性实施例。 [0067] will now be formed on a part of the herein described several illustrative embodiments. 虽然下文描述可实施本发明的一或多个方面的特定实施例,但可使用其它实施例,且可在不脱离本发明的范围或所附权利要求书的精神的情况下进行各种修改。 Although the following description of particular embodiments may be one or more aspects of the embodiments of the present invention embodiments, but other embodiments and various modifications may be made without departing from the scope of the appended claims of the present invention or the claims spirit.

[0068] 如上所指出,本发明的各种方面涉及与头戴式显示器单元(确切地说,能够检测例如可解译为与通过头戴式显示器单元显示的虚拟内容的互动的手移动和/或手指移动的手移动的头戴式显示器单元)互动的新方式。 [0068] As indicated above, the various aspects of the present invention relates to head-mounted display unit (specifically, for example, can be interpreted as a detected hand movement to interact with the virtual head-mounted display by the content display unit and / head-mounted display unit or finger movement hand movement) a new way to interact. 使用本文中描述的技术,可提供虚拟桌面,在所述虚拟桌面中,用户可“布局”不同段的数据,且具有通过其头戴式显示器单元呈现的这些数据紧密接近和/或另外相关于存在于用户的实际环境中的实际表面的表示。 Using the techniques described herein, may provide a virtual desktop in the virtual desktop, the user can "Layout" different segments of data, and the data presented by having a head-mounted display unit which is in close proximity to and / or otherwise associated with It represents the actual surface is present in the actual environment of the user.

[0069] 在一或多个布置中,头戴式显示器单元可相关于其上放置参照物的实际表面呈现此虚拟桌面,以及可形成虚拟桌面的一或多个表面区段。 [0069] In one or more arrangements, the head mounted display unit placed thereon may be related to the actual surface of the reference renders this virtual desktop, and may be formed of one or more virtual desktop surface section. 参照物可(例如)为可由头戴式显示器单元检测的智能电话或其它实际物件(例如,纸垫、一堆便利贴等),且可进一步在确定头戴式显示器单元的用户正查看参照物放置于其上的实际表面的当前视角和对应地用户正查看正由头戴式显示器单元呈现的虚拟工作空间的视角过程中使用。 Reference may be (e.g.) a smart phone, or other physical objects may be detected by head-mounted display unit (e.g., paper pads, sticky pile etc.), and may further determine the head-mounted display unit the user is a reference view the current perspective view and corresponding to the user is placed thereon during the actual surface being presented by the head-mounted display unit in the perspective of virtual workspaces used. 明确地说,头戴式显示器单元和/或连接到头戴式显示器单元的处理装置可使用一或多个参照物检测算法确定头戴式显示器单元的用户正查看实际表面和虚拟表面的当前视角。 In particular, head-mounted display unit and / or processing means connected to the head-mounted display unit may use one or more reference detection algorithm determines the user is a head-mounted display unit to view the current viewing angle of the virtual surface and the actual surface . 这些参照物检测算法可(例如)能够通过识别在由头戴式摄像机俘获的场景可见的一或多个矩形且通过随后基于当平视查看时这(些)矩形将各具有直角和平行边的事实确定识别的矩形的当前查看角度来确定此视角(其也可被称作“摄像机姿态”)。 The detection algorithm may reference (e.g.), and by subsequently when capable head based on this view (s) each having a rectangular straight and parallel sides of the fact that a plurality of rectangular or head-mounted camera seen from a scene captured by identifying determining recognition rectangular current perspective view of this angle is determined (which may also be referred to as "camera pose").

[0070] 作为这些和其它特征的结果,本发明的各种方面提供较之现有和常规计算装置的许多优势。 [0070] As a result of these and other features, various aspects of the present invention provides many advantages compared with existing and conventional computing devices. 举例而言,一些实施例可允许用户在大小比通常可能能够在常规计算机显示屏上显示的工作空间大的虚拟工作空间中置放、定位和/或另外布局数字内容和/或其它虚拟项目。 For example, some embodiments may allow a user to be placed in the working space is generally larger than the size that can be displayed may be a conventional computer display on the virtual workspace, the positioning and / or further distribution of digital content and / or other virtual items. 此外,如可经由头戴式显示器单元提供的可变视角和可变物件对准可允许用户体验的更好定制。 Further, variable angle and variable items, such as may be provided via a head-mounted display unit alignment may allow better customize the user experience.

[0071] 此外,可将现实世界物件用作不仅用于定位可经由头戴式显示器单元显示的接口的参照点,且也用作用于在经由头戴式显示器单元提供的一或多个会话的持续时间上访问一或多个特定虚拟工作空间的参考标识符。 [0071] Furthermore, real world objects can be used not only for positioning the reference point interface via head-mounted display unit display, and also as for the one or more sessions provided via head-mounted display unit access to one or more specific virtual workspaces reference identifier duration. 此功能性又可(例如)允许用户非常快速地打包其数字数据,而不必担心在将来需要再造其虚拟工作空间或数字数据的其它特定布局。 This functionality but also (for example) allows the user to very quickly packed their digital data without having to worry about re-layout of its other specific virtual workspace or digital data in the future.

[0072] 举例而言,根据一些实施例,当头戴式显示器单元的用户拾取正用作参照物的物件(例如,其智能电话)时,由头戴式显示器单元显示的虚拟工作空间中包含的所有窗和/ 或其它虚拟物件可自动从呈现的显示器消失。 [0072] For example, according to some embodiments, when the user pickup head mounted display unit as positive reference objects (e.g., which is a smart phone), the virtual workspaces displayed by the head-mounted display unit comprising All windows and / or other virtual objects can be rendered automatically disappear from the display. 随后,当用户将参照物向下和/或以其它方式放回头戴式显示器单元的视野中时,头戴式显示器单元可呈现与去除参照物时一样的虚拟工作空间,由此允许用户在用户离开会话的时点恢复其会话。 Subsequently, when a downward and / or otherwise back into the field of view of head-mounted display unit in reference to a user, presenting the head mounted display unit may be removed when the same reference virtual workspace, thereby allowing the user to point the user leaves the session resumes its session. 头戴式显示器单元可(例如) 使用在头戴式显示器单元中包含和/或另外通信耦合到头戴式显示器单元的摄像机检测特定参照物的此引入和/或去除。 Head-mounted display unit may (for example) used in the head-mounted display unit containing and / or otherwise incorporated herein communicatively coupled to camera head-mounted display unit detects a specific reference and / or removal. 不仅可在去除参照物与再引入参照物之间维持不同表面区段的相对位置,且也可维持与表面区段中的一或多者相关联的程序或功能性的当前状态。 Not only to maintain the relative position between different surface sections is removed and reintroduced into the reference frame of reference, and may also maintain the current state of the program or functionality associated with the surface sections associated with one or more of. 举例而言,可暂停和自动恢复在区段中的一者中播放的电影,或可以其先前状态保存和再显示区段中的一者中的文件。 For example, you can pause and resume the movie automatically in one section of the play, or you can save its previous state and then files section of one of the.

[0073] 现将参看附图(从图1开始)更详细地论述各种实施例。 [0073] Referring now to the accompanying drawings (FIG beginning from 1) discussed in greater detail various embodiments.

[0074] 图1说明可并有一或多个实施例的系统100的简化图。 [0074] Figure 1 illustrates a simplified diagram may incorporate one or more embodiments of the system 100 of the embodiment. 如图1中所见,系统100可包含存储器105以及多个子系统,包含输入/输出子系统110、参照物检测子系统115、表面区段管理子系统120、控制对象追踪子系统125和呈现子系统140。 As seen in Figure 1, system 100 may comprise a memory 105 and a plurality of subsystems, including an input / output subsystem 110, subsystem 115 detects a reference, the surface segment management subsystem 120, tracking subsystem 125 and the control object rendering sub system 140. 可提供使一或多个子系统能够相互通信和交换数据的一或多个通信路径。 May be provided so that one or more subsystems can be one or more communication paths to exchange data and communicate with each other. 此外,图1中所说明的各种子系统可以软件、 硬件或其组合来实施。 In addition, the various subsystems described in Figure 1 may be software, hardware, or a combination thereof. 在一些实施例中,系统100可并入于计算装置中,例如,通信耦合到头戴式显示器(HMD)单元的计算装置。 In some embodiments, the system 100 may be incorporated in a computing device, for example, a computing device communicatively coupled to a head-mounted display (HMD) unit. 在一些其它实施例中,系统100可直接并入到HMD单元自身或另一类型的抬头显示器内。 In some other embodiments, the system 100 may be incorporated directly into the head-up display unit itself HMD or another type. 在一些实施例中,系统100的元件可并入到一类具有扩增实境功能的装置(例如,移动电话、平板计算机和/或不同于HMD的经配置以实施扩增实境的电视)内。 In some embodiments, elements of system 100 may be incorporated into a class (e.g., a mobile phone, a tablet computer, and / or different from the TV HMD embodiment is configured to augmented reality) augmented reality apparatus having a function of Inside. 在一些实施例中,图1中展示的所有组件可并入到HMD内。 In some embodiments, all the components shown in FIG. 1 may be incorporated into the HMD. 在其他实施例中,图1中展示的组件中的一些可并入到HMD内,而其余组件可并入到通信连接到HMD的另一装置内。 In other embodiments, the components illustrated in FIG. 1 may be incorporated into some of the HMD, and the remaining component may be incorporated into a communication device connected to the other of the HMD. 例如,图1中展示的一些组件可并入HMD内,且图1中展示的组件中的其余者可并入到通信连接到HMD的例如智能电话的移动装置内。 For example, some components shown in FIG. 1 may be incorporated within the HMD, and the components shown in FIG. 1 may be incorporated into the rest of the mobile communication apparatus connected to the HMD, for example, a smart phone.

[0075] 在各种实施例中,系统100可包含不同于图1中展示的子系统的子系统。 [0075] In various embodiments, the system 100 may comprise a subsystem different from the subsystem shown in FIG. 另外,图1 中展示的实施例仅为可併有一些实施例的系统的一个实例,且在其他实施例中,系统100可具有比图1中说明的子系统多或少的子系统,可组合两个或两个以上子系统,或可具有子系统的不同配置或布置。 Further, in the illustrated embodiment of Figure 1 and may have a merely examples of some embodiments of the system of the embodiment, and in other embodiments, the system may have subsystems 100 described in FIG. 1 ratio of more or fewer subsystems may be a combination of two or more subsystems, or may have a different configuration or arrangement subsystem.

[0076] 在一些实施例中,输入/输出子系统110可提供实现待从系统100的用户接收的输入和/或待提供到系统1 〇〇的用户的输出的一或多个接口。 [0076] In some embodiments, input / output subsystems 110 may be implemented to provide the system 100 received from the user input and / or to be provided to a thousand and one or more user interfaces of the system output. 例如,输入/输出子系统11 〇可包含一或多个输入装置,例如,一或多个按钮或键、一或多个端口(例如,串口)和/或其它输入装置。 For example, input / output subsystems 11 may include a billion or more input devices, e.g., one or more buttons or keys, one or more ports (e.g., serial port), and / or other input device. 在至少一个布置中,输入/输出子系统110进一步可包含一或多个摄像机。 In at least one arrangement, input / output subsystems 110 may further comprise one or more cameras. 在一些情况下,输入/输出子系统Iio中包含的摄像机中的至少一者可(例如)由用户以作为头戴式摄像机操作的此方式戴上,且可进一步经配置以俘获由用户查看的场景的图像。 In some cases, the camera input / output subsystems Iio included in at least one may be (e.g.) by a user to operate as a head-mounted camera of this embodiment worn, and may be viewed by the user to capture further configured to image of the scene. 在其它布置中,输入/输出子系统Iio可另外或替代地包含可经配置以从系统100的用户俘获输入的一或多个其它输入系统和/或传感器,例如,一或多个惯性传感器、一或多个麦克风、一或多个视线追踪传感器、一或多个握力传感器和/或类似者。 In other arrangements, input / output subsystems Iio may additionally or alternatively be configured to contain one or more other systems input capture input from a user of the system 100 and / or sensors, e.g., one or more inertial sensors, one or more microphones, a gaze tracking or more sensors, one or more grip force sensor and / or the like. 在其他实施例中,超音波或其它音频、 红外线、紫外线、电磁辐射、微机电系统(MEMS)装置等中的一或多者可形成输入/输出子系统110的组件。 In other embodiments, the audio or other ultrasound, infrared, ultraviolet, electromagnetic radiation, a microelectromechanical system (MEMS) device and the like may be formed in one or more of component input / output subsystem 110. 此外,输入/输出子系统110可包含一或多个输出装置,例如,一或多个显不屏、一或多个音频扬声器和/或其它输出装置。 Further, input / output subsystems 110 may include one or more output devices, e.g., one or more screens are not significant, one or more audio speakers and / or other output devices. 在一些情况下,输入/输出子系统110中包含的显示屏中的至少一者可由用户以全部或部分涵盖用户的视野的方式戴上,此可由此使系统100能够作为头戴式显示器单元操作。 In some cases, the input / output subsystem 110 included in the display screen by a user to at least one field of view to cover all or part of the way a user to wear, which can thereby enable system 100 to operate as a head-mounted display unit .

[0077] 在一些实施例中,参照物检测子系统115可使系统100能够识别和/或另外检测由系统100俘获的场景的图像中的一或多个参照物。 [0077] In some embodiments, the detection subsystem 115 allows the reference system 100 can identify and / or one or more additional reference system 100 is detected by the scene captured in the image. 此外,参照物检测子系统115可使系统100 能够基于一或多个识别的参照物确定系统100的摄像机姿态,或用户对当前正被查看的场景的视角的一些其它描述。 Further, the detection reference subsystem 115 allows the system 100 to system 100 determines the camera pose based on one or more identified reference, or some other user perspective to describe the scene is currently being viewed. 如上所指出,摄像机姿态可界定系统100的用户正查看包含一或多个识别的和/或另外检测的参照物的场景的视角。 As noted above, the user may define the camera pose positive view of system 100 and / or the angle of view comprises one or more additional identified scene detection reference object. 另外,以此方式检测和/或使用一或多个参照物可提供比一些其它技术好的功率效率和/或姿态检测功能性。 Further, in this embodiment the detection and / or reference one or more than some other technique may provide good power efficiency and / or attitude detection functionality. 在一些布置中,参照物检测子系统115可另外或替代地经配置以检测形状并非矩形的其它物件(例如,通过检测由系统100俘获的场景的图像中的其它形状)。 In some arrangements, the reference detector subsystem 115 may additionally or alternatively be configured to detect other objects not rectangular shape (e.g., by detecting other shape image captured by the system 100 in the scene). 另外,在一些情况下,多个物件可经检测和/ 或用于确定摄像机姿态过程中,且参照物检测子系统115可为用户可配置的,其中用户可能能够设定或选择检测哪些物件和/或形状(例如,基于与这些物件和/或形状相关联的特征点)。 Further, in some cases, may determine a plurality of objects detected and / or the posture of a camera process, and a reference detection subsystem 115 can be configured for the user, where the user may be able to set or select an object and detect which / or shape (e.g., based on the feature points with these objects and / or associated with the shape). 例如,参照物检测子系统115可经配置以检测多个形状中的一或多者。 For example, reference detection subsystem 115 may be configured to detect a plurality of one or more of shapes. 另外,参照物检测子系统115可经配置以检测例如矩形、正方形、圆形或三角形的形状。 Further, reference detection subsystem 115 may be configured to detect, for example rectangular, square, circular or triangular. 在其他实施例中,参照物检测子系统115可经配置以检测具体物件,例如,装置、艺术品、文具、手绘图或显示于一或多个装置上的图像。 In other embodiments, the reference detection subsystem 115 may be configured to detect a particular object, for example, means, artwork, stationery, hand drawing or image displayed on one or more devices. 在一些实施例中,参照物检测子系统115可经配置以检测移动电话和/或矩形,例如,当参照物为用户的移动电话时。 In some embodiments, the reference detection subsystem 115 may be configured to detect a mobile telephone and / or rectangular, for example, reference to a user when the mobile phone. 这些实施例可为有益的,因为用户很可能将其电话随身携带且因此可能能够方便地利用此处描述的实施例中的一或多者。 These embodiments may be advantageous, because the user is likely to carry their phone and thus may be able to easily utilize the embodiments described herein in one or more embodiments. 另外,如以下更详细地描述,在一些实施例中,可高效地实施矩形检测。 Further, as described in more detail below, in some embodiments, may be implemented efficiently detected rectangle.

[0078] 在一些实施例中,表面区段管理子系统120可使系统100能够呈现虚拟工作空间和/或此虚拟工作空间中包含的一或多个表面区段。 [0078] In some embodiments, surface portion 120 allows the system management subsystem 100 to render virtual workspace and / or one or more surface sections of this virtual workspace contains. 例如,在一个实施例中,虚拟工作空间可包括与用户应用相关联的一或多个虚拟物件。 For example, in one embodiment, the virtual workspace may include one or more virtual objects associated with the user application. 在其他实施例中,虚拟工作空间可包括与用户的虚拟桌面相关联的虚拟物件。 In other embodiments, virtual workspace may include a virtual object and the virtual desktop associated with the user. 这些虚拟物件可包括用户用来完成各种任务的工具, 例如,图形软件、文字软件、演示软件或通常与工作场所相关联的其它类型的软件。 These virtual objects may include tools for users to complete a variety of tasks, such as graphics software, text, software, presentation software or other types of workplace usually associated software. 在一些实施例中,虚拟工作空间包括用户已定义和/或与特定应用或功能相关联的一或多个区段或区域。 In some embodiments, a virtual workspace comprising a user defined and / or particular application, or one or more zones or regions associated with the function. 例如,一个区段可已由用户指明为包含媒体播放器,而另一区段可已由用户指明用于供例如SMS应用程序或电子邮件程序的消息传递应用程序使用。 For example, a segment may be specified by the user to include a media player, and another section may be specified by the user for example for SMS messaging applications or application programs using email. 在一些实施例中,一或多个区段可与二维内容相关联,使得所述区段显得与表面齐平,而一或多个其它区段可与三维内容相关联,例如,使得内容可对用户显得如同其为全息图。 In some embodiments, the one or more content segments may be associated with a two-dimensional, such that the segments appear flush with the surface, while one or more other sections may be associated with three-dimensional content, e.g., such that the content It may appear to the user as if it is a hologram. 可实施任何数目个其它区段或配置。 May implement any number of other sections or configurations. 在一些实施例中,表面区段管理子系统120可经配置以产生待由系统100呈现的一或多个用户接口和/或其它虚拟物件,确定这些用户接口和/或虚拟物件应在任一特定时刻呈现的视角(例如,基于由参照物检测子系统115确定的当前视角),和/或将产生的用户接口和/或虚拟物件与任何相关视角信息一起提供到呈现子系统140。 In some embodiments, the surface segment management subsystem 120 may be configured to generate one or more user interfaces and / or other virtual objects to be rendered by the system 100, which determines a user interface and / or a virtual object to be in any particular perspective presentation time (e.g., determined based on the current viewing angle detected by the reference subsystem 115) and / or the user interface and / or the generated virtual object and any relevant information to the perspective rendering subsystem 140 together.

[0079] 在一些实施例中,控制对象追踪子系统125可使系统100能够识别和/或另外检测一或多个参照物,例如,可提供一或多个表面区段和/或一或多个虚拟工作空间所关于的一或多个参照物。 [0079] In some embodiments, the control object tracking subsystem 125 enables system 100 to identify and / or detect one or more further reference, for example, may provide one or more surface sections and / or one or more virtual work space of about one or more reference. 例如,控制对象追踪子系统125可使系统100能够基于可在包含参照物的实际场景的图像中检测到的参照物的独特特征识别特定参照物。 For example, the control object tracking subsystem 125 allows the system 100 to identify specific reference may be based on the unique features detected in the image containing the reference object in the actual scene of reference. 此外,控制对象追踪子系统125可使系统100能够基于发射到和/或接收自参照物的一或多个电子信号识别在系统100 附近的特定参照物。 Further, the control object tracking subsystem 125 allows the system 100 can be based on a transmit and / or one or more electronic identification signals received from a specific reference to a reference system in the vicinity of 100. 另外,仍然,控制对象追踪子系统125可使系统100能够基于参照物的身份和/或唯一地识别待显示(例如,当参照物在系统100的用户的视野中时)的一或多个特定虚拟工作空间和/或表面区段的由参照物显示的代码或与参照物相关联的其它俘获的信息识别和/或载入一或多个特定虚拟工作空间和/或表面区段。 Further still, the control object tracking subsystem 125 allows the system 100 can be based on the identity of the reference and / or uniquely identifying be displayed (e.g., when a user's reference when the field of view of the system 100) one or more particular code, or other identifying information associated with the captured reference and / or loading one or more specific virtual workspace and / or a reference surface segments displayed virtual workspace and / or surface segments. 例如,例如快速回应(QR)代码的视觉指示符可显示于参照物上和/或由参照物显示,且系统100的控制对象追踪子系统125可经配置以基于视觉指示符识别参照物。 For example, such a quick response (QR) code, a visual indicator may be displayed on the reference and / or displayed by reference, and the control system 100 of the object tracking subsystem 125 may identify the visual indicator is configured based on the reference. 在一些实施例中,此视觉指示符可包括另一指示符,例如,已知图案,诸如,条形码、多维条形码或已知图像。 In some embodiments, the visual indicator may further comprise an indicator, e.g., a known pattern, such as a bar code, a bar code or multi-dimensional image is known. 在其他情况下,控制对象追踪子系统125可经配置以基于由参照物传输的无线信号(例如,蓝牙信号、近场通信(NFC)信号等)识别参照物。 In other cases, the control object tracking subsystem 125 may be configured based on the radio signals transmitted by a reference (e.g., a Bluetooth signal, a near field communication (NFC) signals, etc.) to identify reference.

[0080] 在一些实施例中,存储器105可经配置以存储和/或检索可由系统100和/或系统100中包含的各种子系统使用的各种类型的信息。 [0080] In some embodiments, the memory 105 may be configured to store and / or retrieved by the system 100 in 100 and / or system comprise various types of information used by the subsystem. 例如,存储器105可存储参照物信息130 和虚拟工作空间信息135。 For example, memory 105 may store reference information 130 and the virtual workspace information 135. 参照物信息130可(例如)包含描述和/或定义一或多个参照物的各种性质(例如,唯一地识别特定参照物的性质)的信息。 Reference information 130 may be (e.g.) comprises one or more descriptions and properties of the various reference and / or defined (e.g., uniquely identifies the nature of the particular reference) information. 例如,在一个实施例中,移动装置可与HMD或其它具有扩增实境功能的装置通信,且智能电话可为参照物。 For example, in one embodiment, the mobile device may HMD or other means for communicating with augmented reality features, and smart phones may be a reference. 在此实施例中,移动装置可经配置以将自身辨识为参照物。 In this embodiment, the mobile device may be configured to identify itself as the reference. 在另一实施例中,移动装置可显示图像,例如,与参照物相关联的图形或条形码。 In another embodiment, the mobile device may display an image, e.g., associated with the reference pattern or barcode. 在此实施例中,此可使HMD或其它具有扩增实境功能的装置能够检测作为参照物的移动装置。 In this embodiment, this allows the HMD or other device having augmented reality function capable of detecting a mobile device as a reference. 此外,虚拟工作空间信息135可包含描述和/或定义可经由系统100提供的一或多个虚拟工作空间的各种性质(包含可包含于此虚拟工作空间中的一或多个表面区段、一或多个用户接口和/或一或多个其它虚拟物件的各种性质)的信息。 In addition, virtual workspace information 135 may include description and / or a plurality of virtual workspaces various properties may be defined or provided via the system 100 (comprising surfaces may comprise one or more sections of virtual workspaces thereto, one or more user interfaces and / or one or more other virtual objects of various nature) information. 虽然此处将这些类型的信息作为可由存储器105存储的信息的类型的实例列出,但在一些实施例中,替代此处论述的信息类型和/或除了此处论述的信息类型之外,存储器105也可存储一或多个其它类型的信息。 Although these types of information here listed as examples of types of information may be stored in memory 105, in some embodiments, alternative types of information discussed herein and / or in addition to types of information discussed herein, memory 105 may also store one or more other types of information.

[0081] 在一些实施例中,呈现子系统140可使系统100能够绘制、呈现和/或另外显示一或多个虚拟工作空间、一或多个表面区段和/或一或多个其它虚拟物件。 [0081] In some embodiments, rendering subsystem 140 allows the system 100 to draw, presentation and / or display one or more additional virtual workspaces, or a plurality of surface sections and / or one or more other virtual object. 例如,系统100的一或多个其它子系统可给呈现子系统140提供关于待呈现的一或多个虚拟工作空间、一或多个表面区段和/或一或多个其它虚拟物件的信息,且呈现子系统140可因此使所述一或多个虚拟工作空间、一或多个表面区段和/或一或多个其它虚拟物件由系统100显示。 For example, one or more of the other subsystems of system 100 may be provided to the rendering subsystem 140, and / or one or more of information about one or more virtual workspaces to be presented with one or more surface sections of the other virtual objects and rendering subsystem 140 can thus cause the one or more virtual workspaces, or a plurality of surface sections and / or one or more other virtual object 100 displayed by the system. 在一些情况下,提供到呈现子系统140和/或另外由呈现子系统140使用的信息可包含摄像机姿态信息和/或其它视角信息,因为此可使呈现子系统140能够以相对于系统100的实际环境的特定定向和/或角度绘制、呈现和/或另外显示各种虚拟物件。 In some cases, supplied to the rendering subsystem 140 and / or additional information used by the presentation subsystem 140 may comprise a camera posture information and / or other information viewing angle, because this allows the rendering subsystem 140 can be with respect to system 100 specific orientation of the physical environment and / or angular drawing, presentation and / or otherwise display various virtual objects.

[0082] 现将关于图2到7更详细地论述可使用例如系统100的装置的方式的实例。 [0082] will now be discussed with respect to FIGS 2-7 in more detail with examples of embodiment of the system 100, for example, an apparatus may be used. 明确地说,图2到7说明描绘根据一些实施例的使用参照物检测的扩增实境表面分段的实例的一连串图式。 In particular, FIGS. 2-7 illustrate a series of drawings depicting an example of some of the augmented reality using a reference surface segment detected embodiment.

[0083] 如图2中所说明,头戴式显示器单元210或其它具有扩增实境功能的装置的用户205可查看实际表面215 (其可为台子或桌子),例如,已将移动装置220放置于所述实际表面上。 [0083] illustrated in Figure 2, head-mounted display unit 210 or other user with augmented reality device 205 may view the function of the actual surface 215 (which may be a table or desk), e.g., the mobile device 220 has placed on the actual surface. 根据本发明的各种方面,移动装置220可(例如)由头戴式显示器单元210用作在提供虚拟工作空间过程中的参照物。 According to various aspects of the invention, mobile device 220 may be (e.g.) by a head-mounted display unit 210 used as a reference in the virtual workspace providing process. 此外,头戴式显示器单元210中包含的摄像机可特征为宽视野,且进一步可由头戴式显示器单元210在追踪视野中的矩形物件的位置和/或移动以及视野中的其它物件的位置和/或移动(例如,用户的手指的位置和/或移动)过程中使用。 Further, the head-mounted display unit 210 comprises a camera may be characterized as a wide viewing, and further by tracking a rectangular object field of view position and / or movement and position of other objects in the field of view of head-mounted display unit 210 and / or move (e.g., position of the finger of the user and / or mobile) during use. 在一些实施例中,同时执行的分开的算法可用以追踪视野中的矩形物件的位置和/或移动,和视野中的控制对象(例如,用户的手指)的位置和/或移动。 In some embodiments, a separate algorithm may be used while performing position location tracking rectangular field of view of an object and / or movement, and the field of view of the control object (e.g., user's finger) and / or movement. 此外,在一些实施例中,这些追踪算法可在头戴式显示器单元210自身上执行,而在其他实施例中,这些追踪算法可在无线地连接到头戴式显示器单元210 (例如,移动装置220)的移动计算装置上执行。 Further, in some embodiments, the tracking algorithms may be performed on a head-mounted display unit 210 itself, while in other embodiments, the tracking algorithms may be connected to the head-mounted display unit 210 in a wireless manner (e.g., the mobile device performed on 220) the mobile computing device. 在一些实施例中,移动装置220包括移动电话或平板计算机。 In some embodiments, the mobile device 220 comprises a mobile phone or a tablet computer.

[0084] 随后,如图3中所说明,正执行的追踪算法中的一或多者可检测和/或追踪移动装置220的形状。 [0084] Subsequently, as illustrated in FIG. 3, tracing algorithm being executed in one or more of a detectable and / or shape of the mobile tracking device 220. 此外,基于移动装置220的形状的检测和/或追踪,可经由头戴式显示器单元210呈现视觉突出显示305 (例如,用于由用户205查看)。 Further, based on the detection of the shape of the mobile device 220 and / or tracking, 210 may be visually highlighted presentation 305 (e.g., 205 for view by the user) via the head-mounted display unit.

[0085] 其后,如图4中所说明,用户205可将其食指405和410放置于在实际表面215上最接近移动装置220的开始点415。 [0085] Thereafter, as illustrated in FIG. 4, the user 205 may be the index finger 405 and 410 is placed on the surface 215 of the actual start point 415 closest to the mobile device 220. 随后,如图5中所说明,用户205可将其食指405和410拉开。 Subsequently, as illustrated in Figure 5, the user 205 may be the index finger 405 and 410 apart. 描绘矩形的突出显示或选取框505可沿着食指405和410的指尖的移动,其中食指405和410 的指尖中的每一者对应于由选取框505描绘的矩形的角。 Drawing a rectangle 505 may be highlighted or marquee, wherein each of the fingertip of the forefinger 405 and 410 correspond to the corners of the rectangle described by the index finger movement marquee 505 405 and 410 along. 在一或多个实施例中,由选取框505描绘的矩形可与其上已放置了移动装置220的实际表面215的平面对准。 In one or more embodiments, a rectangle drawn by a marquee 505 may have been placed on a plane with its actual surface 215 of the mobile device 220 is aligned. 此外,移动装置220和/或任一其它追踪的参照物可被用作用于由选取框505定义的矩形的参考。 In addition, the mobile device 220 and / or any other reference tracking may be used as the rectangular marquee 505 defined by reference. 在某些内容可能需要固定纵横比的一些情况下,由选取框505描绘的矩形的尺寸可按与由食指405和410的指尖从其开始点415行进的距离成比例的固定比率扩大和/或收缩。 In some cases, some content may require a fixed aspect ratio, size of the rectangular marquee 505 depicted by a fixed ratio may be enlarged in proportion to the distance from the fingertips of the index fingers 405 and 410 travel from the start point 415 and / or contraction. 另外,在一些实施例中,可使用触摸屏提供到用户接口的输入或定义区段的输入,例如,类似于可使用触控板或轨迹垫的方式,或移动装置220的其它输入,不管移动装置220自身是否为参照物。 Further, in some embodiments, may be provided to an input using a touch screen input or define a user interface section, for example, may be similar to the use of the touchpad or trackpad, or other movement of the input device 220, regardless of the mobile device 220 whether it is a reference. 例如, 在一个实施例中,参照物可包括墙壁上的油漆,且在此实施例中,用户可能能够使用移动装置220上的输入装置防卫虚拟工作空间的区段,即使移动装置220自身并非参照物。 For example, in one embodiment, a reference may include the paint on the walls, and in this embodiment, the user may be able to use the input device zone defense virtual workspace on the mobile device 220, mobile device 220 even when the reference is not itself thereof.

[0086] 虽然图4中说明且上文所论述的实例涉及在形状上为矩形的突出显示或选取框505,但在一些情况下,突出显示或选取框的形状连同可基于突出显示或选取框形成的表面区段的形状(例如,如下关于图6所论述)可能并非矩形。 [0086] Although illustrated in Figure 4 and discussed in the above example relates to a rectangular shape or highlighting marquee 505, but in some cases, the shape of the highlight or together with a marquee or highlighted based marquee shape of the surface section is formed (e.g., as discussed with respect to FIG. 6) may not be rectangular. 例如,突出显示或选取框可形状为圆形,或可具有与这些实例中论述的矩形和圆形形状有所变化的一些其它形状。 For example, highlighting or marquee may be circular in shape, or may have some other shape variations of rectangular and circular shapes of these examples are discussed. 此外,不同于如在上文所论述的实例中将其手指拉开以创造突出显示或选取框的形状,在一些额外和/或替代实施例中,用户可画出待形成的形状的轮廓。 Furthermore, unlike such a shape that a finger pulled apart to create a marquee or highlighted in the example discussed above, in some additional and / or alternative embodiment of the profile shape, the user can be formed to draw embodiment. 在其他情况下,其它输入可由用户提供以经由以上关于系统100的输入/输出子系统110论述的接口中的任何者和/或所有者定义此形状。 In other cases, other user input may be provided in such a shape defined by the above via any input on the system 100. The I / O subsystem interface 110 discussed and / or owner. 例如,在一个实施例中,用户可使用光学追踪技术绘制形状的轮廓。 For example, in one embodiment, the user may use an optical tracking technology to draw contour shape. 在此实施例中,输入/输出子系统Iio可包括眼睛追踪软件。 In this embodiment, input / output subsystems may include eye-tracking software Iio. 在此实施例中,用户可通过移动其眼睛以形成形状的轮廓来定义那个形状。 Embodiment, the user can define the shape of the eye by moving it to form the shape of the outline of this embodiment. 在另一实施例中,输入/输出子系统110可包括触摸屏。 In another embodiment, input / output subsystems 110 may include a touch screen. 在此实施例中,用户可通过在触摸屏的表面上绘制形状的轮廓来形成形状。 In this embodiment, the user may be formed by contouring the shape of the shape on the surface of the touch screen. 在再一实施例中, 输入/输出子系统Iio可包括惯性传感器。 In another embodiment, input / output subsystems may include an inertial sensor Iio. 因此,在此实施例中,用户可通过按形成形状的轮廓的图案移动装置来形成形状。 Thus, in this embodiment, the user of the mobile device by a pattern forming the shape of the contour shape is formed in this embodiment. 惯性传感器可检测此运动,且因此传输与待形成的形状的轮廓相关联的信号。 Inertial sensor may detect this motion, and thus the signal to be transmitted profile shape formed associated.

[0087] 随后,如图6中所说明,一旦用户205将其食指405和410的指尖提升离开实际表面215,即可在虚拟工作空间中创造矩形605且经由头戴式显示器单元210呈现所述矩形。 [0087] Subsequently, as illustrated in Figure 6, once the user 205 to their index fingers 405 and 410 away from the actual lifting surface 215, in the virtual workspace to create a rectangle 605 and the rendering unit 210 via the head-mounted display said rectangle. 在用户205提升其指尖远离表面的点处,矩形605的大小可(例如)对应于由选取框505描绘的矩形的大小。 At the point 205 in the user lifting their finger away from the surface, the size of the rectangle 605 may be (e.g.) corresponding to the size of the rectangle 505 drawn by the marquee. 此外,矩形605可填充有用户接口610 (其可经由头戴式显示器单元210来呈现), 以便使用户205能够查看用户接口和/或与用户接口互动。 Further, the rectangular 605 can be filled with a user interface 610 (which may be presented 210 via the head-mounted display means), so that the user can view the user interface 205 and / or interface to interact with the user. 此外,用户接口610可包含一或多个作用中接触区,用户205可使用其指尖405和410按类似于用户可与显示于触敏显示屏上的用户接口互动的方式与作用中接触区互动。 In addition, the user interface 610 may include one or more contact zones in effect, the user 205 may use their fingers 405 and 410 in a manner similar user can interact with the touch sensitive display screen displayed on a user interface action manner contacting zone interactive.

[0088] 现转到图7,在可能需要更精密或独特的参照物(例如,以实现在虚拟工作空间中的多用户合作)的实例中,动态产生的标记705可显示于移动装置220的屏幕上。 [0088] Turning now to FIG. 7, in the example may require more sophisticated or unique reference (e.g., multi-user cooperation in the virtual work space), the dynamic indicia 705 may generate a display of the mobile device 220 on the screen. 标记705可(例如)用可由另一扩增实境或头戴式显示器单元或其它连接的装置解译的独特图案编码, 由此使其它扩增实境或头戴式显示器或其它连接的装置能够起始与正呈现的一或多个其它头戴式显示器单元(例如,头戴式显示器单元210)的连接,从而促进与虚拟工作空间的互动和/或另外提供虚拟工作空间。 Tag 705 may be (e.g.) the unique coding pattern may be interpreted by another or augmented reality head-mounted display unit or other connected devices, whereby the augmented reality or other head-mounted display or other device connected possible to start with one or more other head-mounted display unit (e.g., head-mounted display unit 210) connected to facilitate interaction with the virtual workspace, and / or otherwise provide virtual workspace being presented.

[0089] 虽然以上关于图2到7论述的实例说明可完成单一分段任务的方式(例如,以在特定虚拟工作空间中创造单一表面区段,即,矩形605),但在其他情况下,多个区可类似地由同一用户使用同一参照物(例如,移动装置220,如在以上实例中)分段。 [0089] While the foregoing example discussed with respect to FIGS 2-7 illustrate the tasks to be completed as a single segmented manner (e.g., to create a single virtual surface in a specific section of the working space, i.e., rectangle 605), but in other cases, Similarly, the plurality of regions may be (e.g., mobile device 220, as in the above example) used by the same user in the same segment reference. 以此方式,可描绘许多不同虚拟窗,且跨其上放置参照物的实际表面的较宽区将虚拟窗填充于虚拟工作空间中(例如,在处于用户前的台面或桌面上)。 In this way, a number of different virtual drawing windows, and across a wider region which is placed on the actual surface of the reference object will be filled in the window virtual virtual workspace (e.g., the user is at the front desk or table).

[0090] 在一些实施例中,当用户移动其头且因此改变头戴式显示器单元中包含的摄像机的视野时,参照物的追踪可能会失去(例如,如果用户转身面向相反方向且参照物不再在摄像机的视野内)。 [0090] In some embodiments, when the user moves its head, and thus change the field of view of the camera head mounted display unit is contained within the reference tracking may be lost (e.g., if the user turned to face the opposite direction and no reference and then in the field of view of the camera). 此时,正由头戴式显示器单元呈现的虚拟工作空间中包含的用户接口和/ 或其它虚拟物件可消失。 In this case, a user interface, and / or other virtual objects virtual workspace being presented by the head-mounted display means may be included disappear. 然而,一旦参照物由摄像机重新获取(例如,如果且当用户转身以再次面向正经由头戴式显示器单元中包含的摄像机追踪的参照物),虚拟工作空间(包含其相关联的用户接口和其它虚拟物件)可以相对于参照物的相同相对大小和位置重新呈现。 However, once re-acquired by the reference camera (e.g., if and when the user once again turned to face serious tracked by the camera head mounted display unit included in the reference), virtual workspace (including its associated user interfaces and other virtual objects) with respect to the same relative size and position of the reference of re-rendered.

[0091] 在一些实施例中,可跨较宽区追踪多个参照物,且此可实现与较大表面的较大互动,且允许在参照物的追踪失去前代表使用者的头移动的较宽范围。 [0091] In some embodiments, a plurality of tracking across wider reference region, and this can achieve a greater interaction with the larger surface, and allows tracking of lost before the reference movement representing the user's head than the wide. 另外,可连结两个或两个以上头戴式显示器单元,连同可装备有摄像机且由不同用户戴和/或使用的一或多个其它连接的装置。 Further, two or more can be linked head-mounted display unit, together and may be equipped with a camera and / or one or more other connection devices used by different users to wear. 以此方式,不同用户可共享与各种参照物相关联的签名,且包含一或多个用户接口和/或其它虚拟物件的连结的虚拟工作空间可在连结的装置的各种用户当中共享和/或另外提供至连结的装置的各种用户以允许与虚拟工作空间的合作互动。 In this manner, different users can be shared with a signature associated with a variety of reference, and include one or more user interfaces and / or link a virtual workspace other virtual objects may be shared in a variety of user devices coupled to them and / or otherwise provided to the coupling means to allow various user interaction and cooperation with the virtual workspace.

[0092] 图8说明描绘根据一些实施例的使用参照物检测提供扩增实境表面分段的实例方法的流程图。 [0092] Figure 8 illustrates a flowchart depicting an example method reality amplification of the surface segment is provided in accordance with some embodiments of the detected reference. 图8中说明的处理可以可由一或多个处理器和/或其它硬件组件执行的软件(例如,计算机可读指令、代码、程序等)实施。 Treatment may be one or more processors and / or software of other hardware components illustrated in FIG. 8 (e.g., computer-readable instructions, code, programs, etc.) FIG. 另外或替代地,软件可存储于非暂时性计算机可读存储媒体上。 Additionally or alternatively, software may be stored in a non-transitory computer-readable storage medium. 在一些实施例中,图8中说明的方法可由头戴式显示器单元执行,而在其他实施例中,图8中说明的方法可由通信耦合到、连接到和/或另外连结到头戴式显示器单元的计算装置执行。 In some embodiments, the method described in FIG. 8 may be head-mounted display unit performs, while in other embodiments, the method, described in Figure 8 may be communicatively coupled to, connected to the head-mounted display and / or otherwise attached to the computing means execution units. 在再其它实施例中,图8中说明的方法可由头戴式显示器单元与通信耦合到、连接到和/或另外连结到头戴式显示器单元的计算装置组合地执行。 In still other embodiments, the method described in FIG. 8 may be head-mounted display coupled to a communication unit, connected to and / or otherwise coupled to the computing means for combining the head-mounted display unit is performed.

[0093] 如图8中所见,可在步骤805中起始方法,其中可接收摄像机输入。 [0093] as seen in Figure 8, the method may start at step 805, wherein the camera input may be received. 例如,在步骤805 中,图像和/或视频输入可由头戴式显示器单元和/或连接到头戴式显示器单元的计算装置从头戴式显示器单元中包含的一或多个摄像机接收,作为摄像机输入。 For example, in step 805, the image and / or video input by head-mounted display unit and / or the video camera connected to a plurality of computing devices or head-mounted display unit included in the head-mounted display unit receives, as a video camera input. 摄像机输入可(例如)包含在头戴式显示器单元的用户前的场景的一或多个图像。 Camera input may be (e.g.) included in a scene in front of the user's head-mounted display unit or a plurality of images. 如在上文所论述的实例中, 此场景可包含可放置一或多个参照物的实际表面,且这(些)参照物可由头戴式显示器单元在提供虚拟工作空间过程中使用。 As in the example discussed above, may be placed in this scenario may include one or more of the actual reference surface, and this (these) reference can be used in head-mounted display unit during providing virtual workspace. 在一些实施例中,在步骤805中,系统100可使用输入/输出子系统110接收摄像机输入。 In some embodiments, in step 805, the system 100 may use input / output subsystem 110 receives camera input.

[0094] 在步骤810中,可检测一或多个参照物。 [0094] In step 810, one or more detectable reference. 在一些实施例中,这些参照物可包括一或多个矩形。 In some embodiments, the reference may include one or more rectangles. 例如,在步骤810中,头戴式显示器单元和/或连接到头戴式显示器单元的计算装置可分析在步骤805中接收的摄像机输入以便检测摄像机输入中包含的一或多个参照物的存在。 For example, in step 810, the head-mounted display unit and / or head-mounted display connected to the computing device may analyze the camera input unit received in step 805 to detect the presence of one or more input reference cameras included . 在检测一或多个参照物过程中,可使用一或多个参照物检测算法,其可基于在与摄像机输入相关联的匹配参照物的预期概况(例如,例如以下的特性:矩形参照物的平行边和直角,或在其他实施例中,圆角、具体图像等)的图像数据中识别到实际物件来识别场景中包含的一或多个参照物。 Detecting one or more reference processes may be used one or more reference detection algorithm, which may be based on the expected profiles associated with the matching reference camera input (e.g., such as the following features: the reference rectangle parallel sides and right angle, or in other embodiments, the image data is rounded, in particular images, etc.) of the actual object recognition to identify one or more scenes included in the reference. 在一些实施例中,在步骤810中,系统100可使用参照物检测子系统115检测一或多个参照物。 In some embodiments, in step 810, the system 100 may use reference detection subsystem 115 detects one or more reference.

[0095] 在一些实施例中,也可基于一或多个检测到的参照物确定场景的当前视角。 [0095] In some embodiments, may also be based on one or more detected scene determined reference current perspective. 明确地说,头戴式显示器单元的用户正查看场景的视角可基于一或多个检测到的参照物和这些参照物出现的角度来确定。 In particular, head-mounted display unit of a user are viewing perspective scene may be determined based on the reference angle and the detected occurrence of these one or more reference. 例如,当参照物包括矩形时,此视角可(例如)鉴于以下事实基于这些参数来确定:当平视查看时,这(些)矩形将具有平行边和直角以及其它特性。 For example, when the reference comprises a rectangular, this viewing angle (e.g.) based on the parameters determined in view of the fact that: when a head view, this (these) rectangle having parallel sides and right angle, and other characteristics.

[0096] 在步骤815中,可识别一或多个参照物。 [0096] In step 815, one or more reference may be identified. 例如,在步骤815中,一或多个参照物可由头戴式显示器单元和/或连接到头戴式显示器单元的计算装置基于描述各种参照物的一或多个独特性质的信息识别。 For example, in step 815, one or more reference may be head-mounted display unit and / or based on a description of various reference information for identifying one or more unique properties computing device is connected to the head mounted display unit. 在一些实施例中,各种参照物可在形状上为矩形,且在摄像机输入中识别参照物可基于在步骤810中执行的参照物检测的结果。 In some embodiments, the various reference may be rectangular in shape, based on the reference detection reference and identification performed in step 810 results in the camera input. 明确地说,此参照物检测可用以识别可为参照物的现实世界物件的候选者,且随后,头戴式显示器单元和/或连接的计算装置可分析候选物件以便确定候选物件中的哪一者(哪些)为参照物。 In particular, this reference detector is usable to identify a candidate for the reference of the real world objects, and then, the head mounted display unit and / or computing devices may be connected to the analysis to determine the candidate object candidate object in which who (which) as a reference. 在一些实施例中, 在步骤815中,系统100可使用控制对象追踪子系统125识别一或多个参照物。 In some embodiments, in step 815, control system 100 may use the object tracking subsystem 125 to identify the one or more reference.

[0097] 随后,在步骤820中,可接收定义一或多个表面区段的输入。 [0097] Subsequently, in step 820, may receive one or more surfaces define input sections. 在一些实施例中,此输入可相对于场景中包含的实际表面和/或相对于可放置于实际表面上的一或多个参照物(例如,在步骤815中识别的一或多个参照物)定义一或多个表面区段。 In some embodiments, the input surface relative to the actual scene may be contained and / or with respect to one or more may be placed on the actual reference surface (e.g., one or more reference identified in step 815 ) define one or more surface sections. 在一些情况下,定义一或多个表面区段的输入可(例如)为描绘和/或另外对应于由用户在实际表面上绘出轮廓的矩形的用户输入。 In some cases, the input surface defines a plurality of sections or may be (e.g.) as depicted and / or additional user input corresponding to the rectangular contour drawn by the user on the actual surface. 例如,用户可鉴于头戴式显示器上包含的摄像机将其手指放置在开始点处,且接着将其手指向外拉以定义可呈现用户接口和/或其它虚拟物件的矩形的相对角, 如在以上关于图2到7中论述的实例中。 For example, a user may view of the camera on the head mount display comprises a finger which is placed at the starting point, and then it is pulled outwardly to define a finger may present a user interface and / or other virtual rectangle relative angular objects, as in example 2 above with respect to FIG. 7 discussed in. 在一些实施例中,在步骤820中,系统100可使用输入/输出子系统110接收定义一或多个表面区段的输入。 In some embodiments, in step 820, the system 100 may use input / output subsystem 110 receives one or more surfaces define input sections.

[0098] 再次参看图8,在步骤825中,可呈现虚拟工作空间的一或多个表面区段。 [0098] Referring again to FIG. 8, in step 825, may exhibit one or more surface sections of the virtual workspace. 例如,在步骤825中,头戴式显示器单元和/或连接的计算装置可呈现在步骤820中定义的表面区段, 连同与包含定义的表面区段的虚拟工作空间相关联的一或多个其它虚拟物件和/或其它用户接口。 For example, in step 825, the head-mounted display unit and / or the computing device may be presented on the surface of the connection portion defined in step 820, together with the virtual workspace and comprising the defined surface segment associated with the one or more other virtual objects and / or other user interface. 如上文所论述,此表面区段和/或整个虚拟工作空间可与特定参照物(例如,在步骤815中识别的参照物)相关联,使得参照物的去除和/或替换分别导致虚拟工作空间的关闭和/或打开。 As discussed above, this surface section and / or the entire virtual workspace with a particular reference (e.g., identified in the reference step 815) is associated, so that the removal and / or replacement, respectively, results in reference virtual workspace closed and / or opened. 在一些实施例中,在步骤825中,系统100可使用表面区段管理子系统120和/或呈现子系统140呈现虚拟工作空间的一或多个表面区段。 In some embodiments, in step 825, the system 100 may use surface segment management subsystem 120 and / or rendering subsystem 140 presents one or more surface sections of the virtual workspace.

[0099] 如上文所论述,一些实施例提供经配置以执行手指追踪和矩形辨识的头戴式显示器单元,且由此给此头戴式显示器单元的用户提供看现实世界物件与按匹配用户的自身视野(例如,现实世界物件的视野)的视角呈现的虚拟物件的组合的能力。 [0099] As discussed above, some embodiments provide a head-mounted display unit configured to perform a rectangular finger tracking and identification, and thus this head-mounted display unit to the user to see the real world object is provided by the user matches their field of vision (for example, the field of view of real-world objects) ability vision of a virtual object combination. 此外,某些实施例可能不需要此头戴式显示器单元的用户在与于虚拟工作空间中呈现的接口一起工作时处置物理装置。 Further, some embodiments may not require user head-mounted display unit of the process of this physical device in operation with the presentation in the virtual workspace interface.

[0100] 虽然一些常规系统可提供显示信息的其它方式,但这些常规系统通常不便于使用且需要提供大量计算能力细节。 [0100] Although some conventional systems otherwise can provide the display information, these conventional systems typically do not provide easy to use and requires a lot of computing power details. 例如,一些常规系统可能能够通过分析深度数据来执行实际表面的三维重建。 For example, some conventional systems may be able to perform the three-dimensional reconstruction of the surface by analyzing the actual depth data. 但此方法可能需要以计算方式重建完全三维场景。 However, this method may require computationally complete reconstruction of three-dimensional scene. 因此,此方法可能需要使用功率消耗较大的深度传感器,以及大量计算能力来重建三维场景。 Therefore, this method may require the use of a large power consumption of a depth sensor, and a large number of computing power to reconstruct three-dimensional scene. 另外,此些装置可较重且较昂贵,因此减小了用户将快速采用这些技术的可能性。 Further, such devices may be heavy and expensive, thus reducing the likelihood the user will quickly adopt these techniques. 相比之下,本发明提供用于确定表平面的系统和方法,其可避开对这些功率消耗大且昂贵的处理器和传感器的需求。 In contrast, the present invention provides a system for determining the plane tables and methods, which can avoid a large and expensive consumption requirements and processor power to these sensors.

[0101] 并不使用可由一些常规系统实施的三维重建技术,一些实施例取而代之可并有参照物检测(例如,当参照物包括矩形时(例如,当参照物包括移动电话时)的矩形检测)和目标追踪功能性(其可比常规技术在计算上更有效率)。 [0101] does not use three-dimensional reconstruction techniques may be implemented in some conventional systems, and some embodiments may be replaced with a reference detector (e.g., when the reference includes a rectangular (e.g., when the mobile phone comprising a reference) of the rectangle detection) and target tracking functionality (which is comparable to the conventional technique is computationally more efficient). 此外,通过使用如上文所论述的例如矩形检测的参照物检测技术,头戴式显示器单元可不需要深度数据来正确地呈现虚拟工作空间和/或此工作空间中包含的一或多个虚拟物件。 Further, as discussed above by using, for example, a rectangular detection reference detection techniques, head-mounted display unit may not require proper depth data to render a virtual object or a plurality of virtual workspaces and / or included in this workspace. 相反地,参照物单独的检测可实现摄像机姿态的判定。 Rather, reference may be implemented separate detector determines the camera pose. 明确地说,通过知晓当迎面查看时参照物看起来应像何物、知晓特定物件为(例如)矩形和知晓在当前俘获的摄像机数据中物件看起来像何物,可确定头戴式显示器单元的摄像机姿态或实际视角,且可基于这些虚拟物件应相关于何物已知为参照物而出现的方式来呈现虚拟物件。 In particular, when the head by its view reference should look like what was known as a specific object (e.g.) in a rectangle and its camera data captured in the current object looks like what, head-mounted display unit may be determined the camera pose or actual viewing angle, and can be based on these virtual objects related to the way what was known as the reference and appears to render virtual objects. 例如,可基于摄像机姿态或参照物的姿态相对于参照物定义虚拟表面,且可在那个虚拟表面内或相对于那个虚拟表面呈现虚拟工作空间。 For example, a camera-based gesture or posture relative to reference the definition of virtual reference surface, and may be in relation to the virtual surface or virtual surface that presents a virtual workspace.

[0102] 在一些实施例中,虚拟工作空间可包含置放于许多不同表面上的区段、用户接口和/或其它虚拟物件。 [0102] In some embodiments, it may comprise virtual workspaces placed on the surface of many different segments, the user interface, and / or other virtual objects. 例如,虚拟工作空间中的一个窗可与用户前的桌子对准,且虚拟工作空间中的另一窗可与在用户前且在桌子后的墙壁对准。 For example, a virtual workspace window may be aligned with the table in front of the user, and the other windows virtual workspace and aligned with the wall after the table in front of the user. 在此实例中,作为两个窗与不同现实世界物件的对准,可以不同角度显示两个窗。 In this instance, as with the alignment of two different real-world objects window, the window can display two different angles. 在其他实施例中,虚拟工作空间内的窗可不与任何现实世界物件对准。 In other embodiments, the window in the virtual workspace may not be aligned with any real-world objects. 相反地,此窗可简单地按任一角度且按任何位置相关于一或多个参照物定义于虚拟空间中。 On the contrary, this may simply press the window at any angle and in any position in relation to one or more reference defined in a virtual space.

[0103] 在一些实施例中,用户可能能够使用其手指定义虚拟工作空间中的特定窗的内容。 [0103] In some embodiments, the user may be able to use the contents of the virtual workspace which defines a specific window in the finger. 例如,用户可能能够定义虚拟工作空间中包含网络浏览器的第一窗,和虚拟工作空间中包含媒体播放器的第二窗。 For example, users may be able to define a second window of the first window, and virtual workspace virtual workspace contains a web browser included media player. 当用户用其手指定义对应于这些窗的矩形时,头戴式显示器单元可呈现所述窗,且允许用户通过指定应将何应用程序载入于空间中的每一者中来填充每一窗,例如,通过从一列潜在应用程序选择或通过执行指示特定应用的手势。 When a user with his fingers define a rectangular corresponding to these windows, head-mounted display unit may present the window, and allows each user to specify how the application should be loaded in the space filled in each window , for example, by selecting from a potential application, or by performing a gesture indicating a specific application.

[0104] 在一些实施例中,作为输入/输出子系统110的组件,可将一或多个广角摄像机并入到头戴式显示器单元内,以便增强头戴式显示器单元追踪各种参照物的能力。 [0104] In some embodiments, as the input / output subsystem component 110 may be one or more wide-angle camera unit incorporated into the head-mounted display, the head mounted display unit in order to enhance the tracking of the various reference ability. 在一些情况下,即使用户不能看到特定参照物(例如,因为参照物不在用户的视野中),头戴式显示器单元中包含的追踪摄像机中的一者仍可能能够看到参照物,且头戴式显示器单元可因此呈现虚拟工作空间。 In some cases, even if the user can not see a particular reference (e.g., because the user is not in the reference field of view), the tracking camera head mounted display unit included in one reference may still be able to see, and the head Dai display unit may therefore present a virtual workspace. 例如,在一些实施例中,头戴式显示器单元中包含的摄像机中的一或多者可特征为使这(些)摄像机能够具有比可以其他方式所达成宽的视野的鱼眼镜头。 For example, in some embodiments, the camera head mounted display unit included in one or more of which may be characterized in that the (s) can be a camera with a wide field of view can be reached by other means than a fisheye lens.

[0105] 在一些实施例中,由头戴式显示器单元使用的参照物检测算法和/或其它追踪算法可在视野中包含的各种参照物之间转变以便提供较大和扩展的虚拟工作空间。 [0105] In some embodiments, the transition between the reference detection algorithm used by the head-mounted display unit and / or a variety of other reference tracking algorithm may be included in order to provide a larger field of view and expanded virtual workspace. 例如,基于两个或两个以上参照物在头戴式显示器单元的一或多个追踪摄像机的视野中的时刻,头戴式显示器单元可能能够确定各种参照物之间的空间关系。 For example, based on two or more reference point in a head-mounted display unit or a plurality of the field of view of the video camera tracking, head-mounted display unit may be able to determine the spatial relationships between various reference. 此外,头戴式显示器单元可随后在提供虚拟工作空间过程中使用此空间关系。 Further, the head-mounted display unit may provide a virtual workspace then used during this spatial relationship.

[0106] 在一些实施例中,许多不同虚拟工作空间的特定虚拟工作空间可与多个可用参照物的特定参照物相关联。 [0106] In some embodiments, numerous specific virtual workspaces different virtual workspace may be associated with a plurality of available reference to a specific reference. 例如,用户可具有相关于其智能电话定义的一个虚拟工作空间,和相关于其平板计算机定义的另一虚拟工作空间。 For example, a user may have related to their smart phones defined a virtual work space, and another virtual workspace related to its tablet computer defined. 在一些实施例中,用户可将这些参照物中的两者相互紧挨着放置于实际表面(例如,用户的桌子)上,且头戴式显示器单元可将两个虚拟工作空间呈现为相互邻近。 In some embodiments, the user can reference both of these are placed next to each other on the actual surface (e.g., a user table), and a head-mounted display unit may be two virtual workspace adjacent to each other presents . 在其他实施例中,头戴式显示器单元可提示用户选择虚拟工作空间中的一者显示。 In other embodiments, the head-mounted display unit may prompt the user to select virtual workspaces in one display. 在多个虚拟工作空间可用的一些实施例中(例如,在以上当用户的智能电话和平板计算机是鉴于头戴式显示器单元中包含的追踪摄像机时的实例中),用户可能能够在各种虚拟工作空间之间移动用户接口和/或其它虚拟物件。 In some embodiments, the plurality of virtual workspaces available (e.g., at least when the user's smart phone and a tablet computer are examples of the camera view of the track when the head mounted display unit included), the user may be able various virtual mobile user interface and / or other objects between virtual workspaces.

[0107] 在一些实施例中,可仅当存在多个参照物(例如,在以上实例中,智能电话和桌上型计算机)时产生虚拟工作空间。 [0107] In some embodiments, it may be present only when a plurality of reference (e.g., in the above example, a smart phone and a desktop computer) generates the virtual work space. 此外,在一些实施例中,多个工作空间可与单一物件相关联。 Further, in some embodiments, multiple workspaces may be associated with a single object. 在一些此类实施例中,可提示用户选择哪一工作空间正确。 In some such embodiments, which may prompt the user to select the correct workspace. 在其他实施例中,可自动打开最近工作空间,或可使用用户的情境自动确定适当工作空间。 In other embodiments, the workspace may automatically open the latest, or may use the user context is automatically determined workspace. 例如,如果用户在工作,那么可打开包含电子邮件和文字处理区段的工作空间,但如果用户在家中,那么可打开包含媒体播放器区段和社交媒体区段的工作空间。 For example, if the user is at work, then open the workspace contains e-mail and word processing segment, but if the user is at home, you can open a workspace media player segments and social media segments. 在一些实施例中,用户滚动通过与物件相关联的不同工作空间(例如,使用具体手势或语音命令)可为可能的。 In some embodiments, the user scrolls through the different workspaces associated with the object (e.g., using a specific gesture or voice commands) may be possible. 在一些实施例中,可将特殊图标展示于参照物上,或可将其他通知给予用户以对用户警报可针对那个物件打开虚拟工作空间。 In some embodiments, a special icon will show on the reference, or other notice may be given to the user to alert the user to open the virtual work space for that object. 在此实施例中,用户可执行运动(例如,点头、具体眼睛运动、具体手运动、移动装置的移动等)或“单击”图标以指示用户想要打开可用虚拟工作空间中的具体者。 Embodiment, the user can perform the movement in this embodiment (e.g., nodding, specific eye movement, particularly hand motion, movement, etc. of the mobile device) or a "click" icon to indicate that the user who wants to open the specific virtual workspace available. 图标可由那个参照物显示,例如,当参照物为移动电话时,或可由HMD显示,以便显得位于参照物上或附近。 Icons can be a reference that show, for example, when the reference to a mobile phone, or by HMD display to appear on or near the reference.

[0108] 在一些实施例中,参照物可显示视觉指示符(例如,快速回应(QR)代码或一些其它种类的可辨识代码或图像)以便使特定虚拟工作空间由头戴式显示器单元的呈现子系统140显示和/或另外呈现。 [0108] In some embodiments, a reference display may be a visual indicator (e.g., a quick response (QR) code or some other type of recognizable images or codes) for a particular virtual workspace presented by the head-mounted display unit display subsystem 140 and / or otherwise render. 此代码可(例如)包括需要联系另一装置且实现与另一装置的虚拟共享的所有信息。 This code may be (e.g.) further comprises means to contact and realize all virtual shared with another information device. 举例来说,此代码可通告某些扩增和/或其它虚拟工作空间可用于由头戴式显示器单元显示,使得在显示代码的参照物附近的其它装置可呈现和/或另外提供虚拟工作空间,且使得此些装置的其它用户可与虚拟工作空间互动和/或在虚拟工作空间中合作。 For example, this code may advertise certain amplification and / or other virtual workspace can be used to display a head-mounted display unit, so that other devices may be present in the vicinity of the reference display code and / or otherwise provide virtual workspace and such that other users of such devices may be interactive and / or in cooperation with the virtual workspace virtual workspace. 在一些情况下,代码可由参照物作为信号传输,而非作为图像显示。 In some cases, a reference code may be transmitted as a signal, not as an image display. 例如,参照物可传输通知附近能够提供虚拟工作空间的装置此虚拟工作空间可用的蓝牙信号(或如可需要的任何其它无线信号)。 For example, reference may be transmitted near the notification means can be provided for this virtual workspace virtual workspace available Bluetooth signal (or any other radio signal as may be required). 在一些实施例中,代码可含有描述虚拟工作空间的信息。 In some embodiments, the code may contain information describing the virtual workspace. 在一些实施例中,代码可包括指示工作空间的清晰度可从何处检索的信息,或可仅指示虚拟工作空间可用,例如,从已知来源或社会联网功能。 In some embodiments, the code may include information indicative of the sharpness of the workspace can be retrieved from where, or may only indicate virtual workspaces available, e.g., from known sources or social networking.

[0109] 在一些实施例中,用户可通过隐藏可辨识代码而退出虚拟工作空间,使得其不再为参照物检测子系统115可辨识。 [0109] In some embodiments, the user can exit the code hiding recognizable virtual workspaces, such that it is no longer recognizable reference detection subsystem 115. 例如,在用户希望处于私用虚拟工作空间的实施例中,用户可将参照物与其显示一起面向下放置。 For example, in an embodiment the user desires in the private virtual workspace, the user may be displayed together with its reference face down. 在此实施例中,当可辨识代码不再可见时,可关闭虚拟工作空间。 In this embodiment, when the code is no longer recognizable visible virtual workspace may be closed. 或在一些其它实施例中,当隐藏视觉指示符时,系统可将用户置于其它用户不能访问的私用虚拟工作空间中。 In some or other embodiments, when the hidden visual indicator, the system can be placed in the user private virtual workspaces of other users can not access.

[0110] 在一些实施例中,一或多个虚拟工作空间可存储在云中(例如,在远程服务器上), 以便进一步增强在不同用户和不同装置之间共享虚拟工作空间的能力。 [0110] In some embodiments, the one or more virtual workspace may be stored in the cloud (e.g., on a remote server), to further enhance the ability to share virtual work space in between the different users and different devices. 例如,某人可将特定参照物给予到另一个人,且所述另一个人可接着在使用其自身的头戴式显示器单元时查看与参照物相关联的虚拟工作空间和/或与所述虚拟工作空间互动,其自身的头戴式显示器单元可从远程服务器载入与虚拟工作空间相关联的数据。 For example, a person may be given a particular reference to another person and the other person may then view the virtual workspace associated with the reference and / or when the head-mounted display using its own unit interactive virtual workspace, the data itself may be associated head-mounted display unit from a remote server and loading the virtual workspace. 另外或替代地,多个不同头戴式显示器单元的多个用户可在本地共享情境(例如,所有用户坐在同一台子处且查看同一参照物)中或在远程共享情境(例如,在共享会话中,用户实际上位于不同位置,但与同一虚拟工作空间互动)中同时与同一虚拟工作空间互动。 Additionally or alternatively, a plurality of head mounted display unit a plurality of different users may share the local context (e.g., all users sitting at the same table, and the same reference view) or in a remote shared context (e.g., in a shared session , the user is physically located in different locations, but interact with the same virtual workspace) simultaneously interact with the same virtual workspace.

[0111] 在于不同用户和/或不同装置之间共享虚拟工作空间的一些情况下,每一个别个别可为其对应的用户调整虚拟工作空间的查看角度。 [0111] wherein shared between different users and / or devices in some cases different virtual work space, for each individual user can individually adjust the virtual workspace corresponding to the viewing angle. 换句话说,虽然可相对于参照物定义虚拟工作空间的不同用户接口和/或其它虚拟物件的内容和布局,但呈现这些用户接口和/ 或其它虚拟物件的视角或查看角度可针对共享所述虚拟工作空间的不同用户中的每一者变化。 In other words, although with respect to different user interfaces, and / or other virtual objects define the content and layout reference virtual workspaces, but the angle of view presented user interface and / or other virtual object or viewing angle for the shared each of the different user virtual workspace changes. 另外,在一些实施例中,远程用户(例如,实际上不位于与其它用户和/或参照物相同处的装置的用户,关于所述参照物,正将虚拟工作空间提供到其它用户)可能能够选择在其自身位置处的其自身的参照物用于在提供虚拟工作空间过程中使用。 Further, in some embodiments, a remote user (e.g., a user does not actually located with other user devices and / or reference object at the same, with respect to the reference, is provided to the virtual workspaces of other users) may be able to select at its own location using its own reference in the course of providing virtual workspace. 在一些情况下,此参照物可由远程用户手动选择,而在其他情况下,远程用户的扩增实境或头戴式显示器单元可自动选择待在提供共享虚拟工作空间过程中使用的参照物。 In some cases, this reference manual selection by a remote user, while in other cases, the remote user or augmented reality head-mounted display unit may automatically select to stay in a shared virtual workspace to provide a reference during use.

[0112] 在一些实施例中,存储在云中的虚拟工作空间可由例如超链接的链路访问,所述链路可由虚拟工作空间的各种用户和/或在虚拟工作空间的各种用户之间共享(例如,经由电子邮件、经由正文消息、通过QR代码等)。 [0112] In some embodiments, virtual workspace may be stored in the cloud, for example, Link Access hyperlink, a link various user and / or various user may be in a virtual workspace is the virtual workspace Room shared (e.g., via email, via text message, by a QR code, etc.). 此外,与虚拟工作空间相关的任何和/或所有信息可直接传达到各种装置和/或其用户,例如,视觉通过显示的代码、经由传输的信号以无线方式和/或使用其它方式。 In addition, any and / or all of the information related to the virtual workspace may be communicated directly to the various devices and / or its user, e.g., via a visual display of the code, a signal transmitted via a wireless manner and / or using other means. 在一些实施例中,可针对每一工作空间定义权限,且权限可用以确定其它用户是否能够访问和/或编辑相应工作空间。 In some embodiments, may define permissions for each working space, and can be used to determine whether the rights of other users to access and / or edit the workspace. 用户可公开地与每个人共享其工作空间,可创造仅用户可访问的私人工作空间,或可将权限授予给社交圈或朋友网络内的每个人。 Users can share their workspace with everyone openly, may create private work space only accessible to the user, or to grant permissions to everyone in your social circle or network of friends.

[0113] 在一些实施例中,参照物可能并非电子装置。 [0113] In some embodiments, the electronic device may not reference. 相反地,在一些实施例中,参照物可为另一实际物件,例如,形状为矩形的实际物件(例如,记事本、电子名片、一张纸等)。 Conversely, in some embodiments, reference may be another physical objects, e.g., a rectangular shape of the actual object (e.g., notebook, electronic business cards, a paper, etc.). 不管参照物是否为电子装置,根据一或多个实施例,头戴式显示器单元可以上文所论述的各种方式提供一或多个虚拟工作空间。 Regardless of whether the reference to an electronic device, in accordance with one or more embodiments, the above head mounted display unit may provide one or more virtual workspaces discussed in various ways.

[0114] 在再其它实施例中,参照物可为任何形状的实际物件。 [0114] In still other embodiments, reference may be any shape of actual items. 例如,扩增实境或头戴式显示器单元可经配置以识别物件的独特特征,且根据上文所论述的各种特征将所述物件用作参照物。 For example, the augmented reality head-mounted display unit or may be configured to recognize the unique characteristics of objects, and in accordance with the various features discussed above, the object used as a reference. 举例来说,例如杯垫(例如,可置放于咖啡台上的杯垫)的圆形物件可用作参照物, 且头戴式显示器单元可经配置以检测所俘获图像中的杯垫的形状,选择所述形状作为参照物,且相关于所述杯垫定义一或多个虚拟工作空间,类似于可在上文所论述的实例中定义这些虚拟工作空间的方式。 For example, e.g. coaster (e.g., can be placed on the coffee table coaster) circular object may be used as a reference, and the head-mounted display unit may be configured to detect image capture coaster shape, said shape selected as a reference, and is related to the definition of a coaster or more virtual workspace can be defined similar to the way these virtual workspaces in the example discussed above.

[0115] 图9说明描绘根据一些实施例的使用参照物检测提供扩增实境表面分段的实例方法的流程图。 [0115] FIG 9 illustrates a flow diagram depicting an example method reality amplification segment surface provided in accordance with some embodiments of the detected reference. 图9中说明的处理可以可由一或多个处理器和/或其它硬件组件执行的软件(例如,计算机可读指令、代码、程序等)来实施。 Treatment may be one or more processors and / or software of other hardware components illustrated in FIG. 9 (e.g., computer-readable instructions, code, programs, etc.) FIG. 另外或替代地,所述软件可存储在非暂时性计算机可读存储媒体上。 Additionally or alternatively, the software may be stored in a non-transitory computer-readable storage medium. 在一些实施例中,图9中说明的方法可由头戴式显示器单元执行, 而在其他实施例中,图9中说明的方法可由通信耦合到、连接到和/或另外连结到头戴式显示器单元的计算装置执行。 In some embodiments, the method illustrated in Figure 9 may be head-mounted display unit performs, while in other embodiments, the method, illustrated in Figure 9 may be communicatively coupled to, connected to the head-mounted display and / or otherwise attached to the computing means execution units. 在再其它实施例中,图9中说明的方法可由头戴式显示器单元与通信耦合到、连接到和/或另外连结到头戴式显示器单元的计算装置组合地执行。 In still other embodiments, the method illustrated in Figure 9 may be head-mounted display coupled to a communication unit, connected to and / or otherwise coupled to the computing means for combining the head-mounted display unit is performed.

[0116] 如图9中所见,方法可起始于步骤905,接收场景的摄像机输入。 [0116] As seen in Figure 9, the process may be initiated at step 905, the camera receiving an input scene. 例如,在步骤905 中,图像和/或视频输入可由头戴式显示器单元和/或连接到头戴式显示器单元的计算装置从头戴式显示器单元中包含的一或多个摄像机接收,作为摄像机输入。 For example, in step 905, the image and / or video input by head-mounted display unit and / or the video camera connected to a plurality of computing devices or head-mounted display unit included in the head-mounted display unit receives, as a video camera input. 摄像机输入可(例如)包含在头戴式显示器单元的用户前的场景的一或多个图像。 Camera input may be (e.g.) included in a scene in front of the user's head-mounted display unit or a plurality of images. 如在上文所论述的实例中, 此场景可包含可放置一或多个参照物的实际表面,且这(些)参照物可由头戴式显示器单元在提供虚拟工作空间过程中使用。 As in the example discussed above, may be placed in this scenario may include one or more of the actual reference surface, and this (these) reference can be used in head-mounted display unit during providing virtual workspace. 在一些实施例中,在步骤905中,系统100可使用输入/输出子系统110接收摄像机输入。 In some embodiments, in step 905, the system 100 may use input / output subsystem 110 receives camera input.

[0117] 方法继续到步骤910,识别场景中的至少一个参照物。 [0117] The method continues to step 910, identify at least one reference scene. 在一些实施例中,这些参照物可为场景中的实际物件。 In some embodiments, the reference object may be a real scene. 例如,参照物可包括实际三维物件。 For example, reference may include an actual three-dimensional object. 例如,在步骤910中,一或多个参照物可由头戴式显示器单元和/或连接到头戴式显示器单元的计算装置基于描述各种参照物的一或多个独特性质的信息识别。 For example, in step 910, one or more reference units can be head-mounted display and / or computing device is connected to the head-mounted display unit based on the description of the various reference information for identifying one or more unique properties. 在一些实施例中,各种参照物在形状上可为矩形, 且识别摄像机输入中的参照物可基于参照物检测步骤(图9中未展示)的结果。 In some embodiments, the various reference may be rectangular in shape, and the recognition camera may be based on the reference input of reference detection step (not shown in FIG. 9) results. 明确地说,此参照物检测可用以识别可为参照物的现实世界物件的候选者,且随后,头戴式显示器单元和/或连接的计算装置可分析候选物件以便确定候选物件中的哪一者(哪些)为参照物。 In particular, this reference detector is usable to identify a candidate for the reference of the real world objects, and then, the head mounted display unit and / or computing devices may be connected to the analysis to determine the candidate object candidate object in which who (which) as a reference. 在一些实施例中,在步骤910中,系统100可使用控制对象追踪子系统125识别一或多个参照物。 In some embodiments, in step 910, control system 100 may use the object tracking subsystem 125 to identify the one or more reference.

[0118] 随后,在步骤915中,接收定义表面区段的输入。 [0118] Subsequently, in step 915, receives an input surface section of the definition. 在一些实施例中,此输入可相对于场景中包含的实际表面和/或相对于可放置于实际表面上的一或多个参照物(例如,在步骤910中识别的一或多个参照物)定义一或多个表面区段。 In some embodiments, the input surface relative to the actual scene may be contained and / or with respect to one or more may be placed on the actual reference surface (e.g., one or more reference identified in step 910 ) define one or more surface sections. 在一些情况下,定义一或多个表面区段的输入可(例如)为描绘和/或另外对应于由用户在实际表面上绘出轮廓的矩形的用户输入。 In some cases, the input surface defines a plurality of sections or may be (e.g.) as depicted and / or additional user input corresponding to the rectangular contour drawn by the user on the actual surface. 例如,用户可鉴于头戴式显示器上包含的摄像机将其手指放置在开始点处,且接着将其手指向外拉以定义可呈现用户接口和/或其它虚拟物件的矩形的相对角,如在以上关于图2到7中论述的实例中。 For example, a user may view of the camera on the head mount display comprises a finger which is placed at the starting point, and then it is pulled outwardly to define a finger may present a user interface and / or other virtual rectangle relative angular objects, as in example 2 above with respect to FIG. 7 discussed in. 在一些实施例中,在步骤915中,系统100可使用输入/输出子系统110接收定义一或多个表面区段的输入。 In some embodiments, in step 915, system 100 may use input / output subsystem 110 receives one or more surfaces define input sections.

[0119] 再次参看图9,在步骤920中,使表面区段被呈现。 [0119] Referring again to Figure 9, at step 920, the surface section is presented. 例如,在步骤920中,头戴式显示器单元和/或连接的计算装置可呈现在步骤915中定义的表面区段,连同与包含定义的表面区段的虚拟工作空间相关联的一或多个其它虚拟物件和/或其它用户接口。 For example, in step 920, head-mounted display unit and / or the computing device may be presented on the surface of the connection section as defined in step 915, together with the virtual workspace and comprising the defined surface segment associated with the one or more other virtual objects and / or other user interface. 如上文所论述, 此表面区段和/或整个虚拟工作空间可与特定参照物(例如,在步骤910中识别的参照物)相关联,使得参照物的去除和/或替换分别导致虚拟工作空间的关闭和/或打开。 As discussed above, this surface section and / or the entire virtual workspace with a particular reference (e.g., in step 910 the identified reference) is associated, so that removal and / or replacement, respectively, results in reference virtual workspace closed and / or opened. 在一些实施例中,在步骤920中,系统100可使用表面区段管理子系统120和/或呈现子系统140呈现虚拟工作空间的一或多个表面区段。 In some embodiments, in step 920, system 100 may use surface segment management subsystem 120 and / or rendering subsystem 140 presents one or more surface sections of the virtual workspace.

[0120] 图10说明可实施一或多个实施例的计算系统的实例。 [0120] FIG. 10 illustrates an example embodiment may be one or more of the computing system of an embodiment. 在一些实施例中,可并入如图10中所说明的计算机系统1000,作为计算装置的部分,所述计算装置可实施、执行和/或施行本文中描述的特征、方法和/或方法步骤中的任何者和/或所有者。 In some embodiments, the computer system may be incorporated in FIG. 10 described in 1000 as part of a computing device, the computing device may be implemented, performed, and / or administration of features described herein, a method and / or method steps any and / or owner. 例如,计算机系统1000可表示头戴式显示器单元、移动装置或任一其它计算装置(例如,膝上型计算机、平板计算机、智能电话或桌上型计算机)的组件中的一些。 For example, computer system 1000 may represent some component mounted display unit of the mobile device, or any other computing device (e.g., a laptop computer, a tablet computer, a smart phone or a desktop computer) in. 此外,计算机系统1000可表示图1的系统100的组件中的一些(例如,存储器1035可表示存储器105;输入装置1015和输出装置1020 可表示输入/输出子系统110;处理器1010和/或存储器1035可提供上文所论述的系统100 的各种子系统中的一或多者,例如,参照物检测子系统115、表面区段管理子系统120、控制对象追踪子系统125、呈现子系统140;等)。 In addition, computer system 1000 may represent a number of (e.g., memory 1035 may represent the memory components of the system 105 of FIG. 1 in 100; input means 1015 and output devices 1020 may represent an input / output subsystem 110; processor 1010 and / or memory the various subsystems 1035 may be provided as discussed above, the system 100 in one or more of, for example, reference detection subsystem 115, the surface segment management subsystem 120, the control object tracking subsystem 125, rendering subsystem 140 ;Wait). 图10提供如本文中所描述的可执行由各种其它实施例提供的方法的计算机系统1000的一个实施例的示意性图解。 Figure 10 provides a method as described herein is executable provided by various other embodiments of a computer system 1000 illustrates a schematic example of embodiment. 图10仅意味提供对各种组件的一般化说明,可在适当时利用所述组件中的任何者及/或全部。 FIG 10 is only meant to provide a generalized description of the various components may be utilized by any of the components and / or all appropriate. 因此,图10大致说明可如何以相对分离或相对更整合的方式实施个别系统元件。 Thus, FIG. 10 illustrates how in a manner substantially opposite relatively more separated or integrated embodiments individual system elements.

[0121] 展示计算机系统1000包括可经由总线1005电耦合(或可另外在适当时进行通信) 的硬件元件。 [0121] Computer system 1000 includes a display (or may otherwise communicate appropriate) electrically coupled via a bus 1005. The hardware elements. 硬件元件可包含:一或多个处理器1010,包含(但不限于)一或多个通用处理器和/或一或多个专用处理器(例如,数字信号处理芯片、图形加速处理器和/或类似者);一或多个输入装置1015,其可包含(但不限于)摄像机、鼠标、键盘和/或类似者;和一或多个输出装置1020,其可包含(但不限于)显示单元、打印机和/或类似者。 The hardware elements may include: one or more processors 1010, include (but are not limited to) one or more general purpose processors and / or one or more special-purpose processors (e.g., digital signal processing chips, processors and graphics acceleration / or the like); one or more input devices 1015, which may include (but are not limited to) camera, a mouse, a keyboard and / or the like; and one or more output devices 1020, which may include (but are not limited to) the display unit, a printer and / or the like.

[0122] 计算机系统1000可进一步包含以下各者(和/或与以下各者通信):一或多个非暂时性存储装置1025,所述非暂时性存储装置可包括(但不限于)本地和/或网络可存取的存储装置,和/或可包含(但不限于)磁盘驱动器、驱动阵列、光学存储装置、例如随机存取存储器(“RAM”)和/或只读存储器(“ROM”)的固态存储装置,其可为可编程的、可快闪更新的和/ 或类似者。 [0122] Computer system 1000 may further comprise the following persons (and / or in communication with each of the following persons): one or more non-transitory storage device 1025, a non-transitory storage device may include (but are not limited to) local and / or a network accessible storage device, and / or may include (but are not limited to) a magnetic disk drive, drive array, an optical storage device, such as a random access memory ( "RAM") and / or read only memory ( "ROM" ) solid-state storage device, which can be programmable, flash-updateable and / or the like. 这些存储装置可经配置以实施任何适当数据存储,包含(但不限于)各种文件系统、数据库结构和/或类似者。 These memory devices may be configured to implement any suitable data storage including (but not limited to) the various file systems, database structures and / or the like.

[0123] 计算机系统1000还可包含通信子系统1030,其可包含(但不限于)调制解调器、网卡(无线或有线)、红外线通信装置、无线通信装置和/或芯片组(例如,Bluetooth®装置、 802.11装置、WiFi装置、WiMax装置、蜂窝式通信设施等)和/或类似者。 [0123] Computer system 1000 may further include a communications subsystem 1030, which may include (but are not limited to) a modem, a network card (wireless or wired), an infrared communication device, a wireless communication device and / or chipsets (e.g., Bluetooth® enabled device, 802.11 devices, WiFi devices, WiMax device, cellular communication facilities, etc.) and / or the like. 通信子系统1030可准许与网络(例如,作为一个实例,下文所描述的网络)、其它计算机系统及/或本文中所描述的任何其它装置交换数据。 The communications subsystem 1030 may permit devices to exchange data with any other network (e.g., network as an example, described below), other computer systems and / or described herein. 在许多实施例中,计算机系统1000将进一步包括非暂时性工作存储器1035,其可包含RAM或ROM装置,如上文所描述。 In many embodiments, the computer system 1000 further includes a non-transitory working memory 1035, which may comprise a RAM or ROM device, as described above.

[0124] 计算机系统1000还可包括展示为当前位于工作存储器1035内的软件元件,包含操作系统1040、装置驱动器、可执行库和/或例如一或多个应用程序1045等其它代码,其可包括由各种实施例提供和/或可经设计以实施方法和/或配置系统、由其它实施例提供的计算机程序,如本文中所描述。 [0124] Computer system 1000 may also comprise software elements, shown as being currently located within a working memory 1035, including an operating system 1040, device drivers, executable libraries, and / or such as one or more application programs 1045 and other codes, which may include providing and / or may be implemented in a method and / or system configuration, a computer program provided by other embodiments, as described herein, various embodiments are designed. 仅仅作为实例,关于上文所论述的方法(例如,如关于图8所描述) 而描述的一或多个程序可实施为可由计算机(和/或计算机内的处理器)执行的代码和/或指令;一方面,接着,这些代码和/或指令可用以配置和/或调适通用计算机(或其它装置)以根据描述的方法执行一或多个操作。 By way of example only, with respect to the method discussed above (e.g., as described with respect to FIG. 8) one or more procedures described may be implemented by a computer code (and / or a processor in a computer) execute and / or instructions; in one aspect, then, the code and / or instructions can be used to configure and / or adapt a general purpose computer (or other device) to perform the method described in one or more operations.

[0125] —组这些指令和/或代码可存储在计算机可读存储媒体(例如,上文所描述的存储装置1025)上。 [0125] - the set of these instructions and / or code that may be stored in a computer-readable storage medium (e.g., the storage device 1025 described above). 在一些情况下,存储媒体可并入于例如计算机系统1000和计算机系统内。 In some cases, the storage medium may be incorporated within the computer system 1000, for example, and a computer system. 在其它实施例中,存储媒体可与计算机系统(例如,可去除式媒体,例如,压缩光盘)分开,和/ 或提供于安装包中,使得存储媒体可用以编程、配置及/或调适其上存储有指令/代码的通用计算机。 In other embodiments, the storage medium with a computer system (e.g., a removable-type media, such as a compact disc) are separated, and / or provided in the installation package, such that the storage medium can be used to program, configure, and / or adapted thereto a general purpose computer instructions stored thereon / code. 这些指令可呈可由计算机系统1000执行的可执行代码形式,和/或可呈源及/或可安装代码的形式,所述源及/或可安装代码在于计算机系统1000上编译及/或安装于计算机系统1000上(例如,使用多种通常可用编译程序、安装程序、压缩/解压缩公用程序等中的任一者)后,接着呈可执行代码的形式。 These instructions may be in the form of executable code executed by the computer system 1000, and / or may be in source and / or installable code, the source and / or code that may be mounted on the compiler wherein the computer system 1000 and / or attached to the the computer system 1000 (e.g., using a variety of generally available compilers, installation programs, compression / decompression utilities like any one), then the form of executable code.

[0126] 可根据具体要求进行实质性变化。 [0126] may be substantially changed according to specific requirements. 例如,还可使用定制硬件,和/或可将特定元件实施于硬件、软件(包含便携式软件,例如小程序等)或两者中。 For example, custom hardware may be used and / or particular elements may be implemented in hardware, software (including portable software, such as applets), or both. 另外,可使用到其它计算装置(例如,网络输入/输出装置)的连接。 Further, other computing device (e.g., a network input / output devices) connected to be used.

[0127] —些实施例可使用计算机系统(例如,计算机系统1000)来执行根据本发明的方法。 [0127] - Some embodiments may be (e.g., computer system 1000) to perform the method according to the invention using a computer system. 例如,所描述方法的程序中的一些程序或全部可由计算机系统1000响应于处理器1010 执行工作存储器1035中所含有的一或多个指令(其可能并入到操作系统1040和/或其它代码中,例如,应用程序1045)的一或多个序列来执行。 For example, the procedures described in the method of some or all of the program by the computer system 1000 in response to one or more instructions to processor 1010 executes the working memory 1035 contained (which may be incorporated into the operating system 1040 and / or other codes and , e.g., an application 1045) is to execute one or more sequences. 可将这些指令从另一计算机可读媒体读取到工作存储器1035中,另一计算机可读媒体例如存储装置1025中的一或多者。 These instructions may be read from another computer-readable medium 1035 into the work memory, another computer-readable medium, for example, one or more of the storage device 1025. 仅作为实例,工作存储器1035中含有的指令序列的执行可使处理器1010执行本文中描述的方法的一或多个程序(例如,关于图8描述的方法的一或多个步骤)。 By way of example only, execute the sequences of instructions contained in the working memory 1035 may cause one or more processors 1010 perform program methods described herein (e.g., one or more steps of the method described with respect to FIG. 8).

[0128] 如本文中所使用,术语“机器可读媒体”和“计算机可读媒体”指参与提供使机器以具体方式操作的数据的任何媒体。 [0128] As used herein, the term "machine-readable medium" and "computer readable medium" refers to the machine that participates in providing data in a particular manner any medium. 在使用计算机系统1000实施的实施例中,在将指令/代码提供到处理器1010以用于执行中可涉及各种计算机可读媒体,和/或各种计算机可读媒体可用以存储及/或携载这些指令/代码(例如,作为信号)。 In an embodiment implemented using computer system 1000, the instructions / code provided to processor 1010 for execution may be involved in a variety of computer-readable media, and / or a variety of computer-readable media used to store and / or carrying the instructions / code (e.g., as a signal). 在许多实施方案中,计算机可读媒体为物理和/或有形存储媒体。 In many embodiments, the computer readable medium is a physical and / or tangible storage medium. 此媒体可呈许多形式,包含(但不限于)非易失性媒体、易失性媒体和传输媒体。 This medium may take many forms, including (but not limited to) non-volatile media, volatile media, and transmission media. 非易失性媒体包含(例如)光盘和/或磁盘,例如,存储装置1025。 Volatile media include (e.g.) optical and / or magnetic disks, such as storage device 1025. 易失性媒体包含(但不限于)例如工作存储器1035的动态存储器。 Volatile media include (but are not limited to), for example, working memory, dynamic memory 1035. 传输媒体包含(但不限于)同轴电缆、铜线及光纤,包含包括总线1005的电线,以及通信子系统1030的各种组件(和/或通信子系统1030借以提供与其它装置的通信的媒体)。 Transmission media include (but are not limited to) coaxial cables, copper wire and fiber optics, including the wires comprising the media bus 1005, the various components and a communications subsystem (or the communication provider and with other devices / communications subsystem 1030 whereby 1030 ). 因此,传输媒体还可呈波的形式(包含(但不限于)无线电、声波和/或光波,例如,在无线电-波和红外线数据通信期间产生的那些波)。 Accordingly, the transmission medium may also be in the form of waves (including (but not limited to) radio, acoustic and / or light waves, for example, in a radio - wave period that wave and infrared data communications).

[0129] 举例来说,常见形式的物理和/或有形的计算机可读媒体包含软盘、软磁盘、硬盘、 磁带或任何其它磁性媒体、CD-ROM、任何其它光学媒体、打孔卡、纸带、具有孔图案的任何其它物理媒体、1^111?01^?1?014知>^?1?01、任何其它存储器芯片或盒带、如下文描述的载波或计算机可从其读取指令和/或代码的任何其它媒体。 [0129] For example, a common form of physical and / or tangible computer readable media include a floppy disk, hard disk, magnetic tape, or any other magnetic medium, CD-ROM, any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, 111 ^ 1? ^ 01? 1? 014 known> ^? 1? 01, any other memory chip or cartridge, a carrier wave as described hereinafter, or a computer can read instructions and / or any other medium code.

[0130] 在将一或多个指令的一或多个序列载运到处理器1010以供执行过程中可涉及各种形式的计算机可读媒体。 [0130] In one or more sequences of one or more instructions to processor 1010 for carrying the process execution may involve various forms of computer readable media. 仅作为实例,一开始可将指令携载于远程计算机的磁盘和/或光学光盘上。 By way of example only, a start command can be carried on magnetic disk of a remote computer and / or an optical disc. 远程计算机可将指令载入到其动态存储器中,并经由发射媒体将指令作为信号发送以由计算机系统1000接收和/或执行。 The remote computer can load the instructions into its dynamic memory and send the instructions as via the transmission medium to receive a signal transmitted by the computer system 1000 and / or executed. 根据本发明的各种实施例,可呈电磁信号、声学信号、光信号和/或类似形式的这些信号都是可在其上编码指令的载波的实例。 According to various embodiments of the present invention, may be in the electromagnetic signals, acoustic signals, optical signals and / or the signals may be similar type are instances in which the coded instructions carrier.

[0131] 通信子系统1030 (和/或其组件)通常将接收信号,且总线1005可接着将信号(和/ 或由信号所携载的数据、指令等)携载到处理器1010从其检索并执行指令的工作存储器1035。 [0131] The communications subsystem 1030 (and / or components thereof) generally the received signal, and then the signal bus 1005 may (and / or carried by the data signals, instructions, etc.) carrying the processor 1010 retrieves therefrom and executing instructions in a work memory 1035. 由工作存储器1035接收的指令可任选地在由处理器1010执行之前或之后存储在非暂时性存储装置1025上。 Working memory 1035 by an instruction received by optionally before or after execution by processor 1010 is stored on a non-transitory storage device 1025.

[0132] 上文所论述的方法、系统和装置为实例。 [0132] The method discussed above, the system and apparatus are examples. 各种实施例可在适当时省略、取代或添加各种程序或组件。 Embodiment can be omitted when appropriate, substitution or addition of various embodiments various programs or components. 例如,在替代配置中,所描述的方法可以不同于所描述的次序来执行,和/ 或可添加、省略和/或组合各个阶段。 For example, in alternative configurations, the methods described may be different from the order described to perform, and / or may be added, omitted, and / or combinations of the individual stages. 并且,可在各种其它实施例中组合关于某些实施例描述的特征。 Further, the features described may be combined in various embodiments of certain other embodiments. 可以类似方式组合实施例的不同方面和元件。 Different aspects and elements of the embodiments may be implemented in combination in a similar manner. 并且,技术演变,且因此许多元件为实例,其并不将本发明的范围限制于那些具体实例。 Further, the technological evolution, and therefore many of the elements are examples, which do not limit the scope of the invention to those specific examples.

[0133] 在描述中给出具体细节以提供对实施例的透彻理解。 [0133] Specific details are given in the description to provide a thorough understanding of the embodiments. 然而,可在无这些具体细节的情况下实践实施例。 However, embodiments may be practiced without these specific details. 例如,在没有不必要的细节的情况下展示熟知电路、过程、算法、结构和技术以便避免混淆所述实施例。 For example, in the case of impressions without unnecessary detail in known circuits, processes, algorithms, structures, and techniques in order to avoid obscuring the embodiments. 此描述仅提供实例实施例,且不希望限制本发明的范围、 适用性或配置。 This description provides example embodiments only, not intended to limit the scope of the present disclosure, applicability, or configuration. 相反地,实施例的前述描述将为所属领域的技术人员提供用于实施本发明的实施例的启迪性描述。 Rather, the foregoing description of the embodiments will provide those skilled in the art to provide for revealing embodiments described embodiments of the present invention. 可在不脱离本发明的精神和范围的情况下对元件的功能和布置做出各种改变。 Various changes may be made in the function and arrangement of elements without departing from the spirit and scope of the invention.

[0134] 并且,将一些实施例描述为以流程图或框图形式描绘的过程。 [0134] Moreover, some embodiments described as a process depicted in the flowchart or block diagram form. 尽管每一流程图或框图可将操作描述为依序过程,但许多操作可并行地或同时执行。 Although each flowchart or block diagrams may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. 此外,可重新排列操作的次序。 Further, the order of the operations may be rearranged. 过程可具有不包含在图中的额外步骤。 A process may have additional steps not included in the figure. 此外,可由硬件、软件、固件、中间件、微码、硬件描述语言或其任何组合来实施方法的实施例。 Further, by hardware, software, firmware, middleware, microcode, hardware description languages, or any combination of the method embodiments. 当以软件、固件、中间件或微码实施时,执行相关联任务的程序代码或代码段可存储在例如存储媒体的计算机可读媒体中。 When implemented in software, firmware, middleware or microcode, the tasks associated with the execution of program code or code segments may be stored in a computer-readable medium such as a storage medium. 处理器可执行相关联的任务。 The processor can perform the associated tasks.

[0135] 已描述若干实施例,可在不脱离本发明的精神的情况下使用各种修改、替代构造和等效物。 [0135] Several embodiments have been described, various modifications may be made without departing from the spirit of the present invention, alternative constructions, and equivalents. 例如,以上元件可仅为较大系统的组件,其中其它规则可优先于本发明的应用或另外修改本发明的应用。 For example, the above elements may merely be a component of a larger system, wherein other rules may take precedence over the application of the present invention or otherwise modify the application of the present invention. 并且,可在考虑以上元件之前、期间或之后进行许多步骤。 Further, the above elements may be considered prior to, during, or after a number of steps. 因此,以上描述并不限制本发明的范围。 Accordingly, the above description does not limit the scope of the present invention.

Claims (29)

1. 一种方法,其包括: 接收场景的摄像机输入; 识别所述场景中的至少一个参照物,其中所述至少一个参照物为实际物件; 接收相对于所述至少一个参照物定义表面区段的输入,其中定义所述表面区段的所述输入为定义所述表面区段的形状的手指移动,其中所述手指移动由使所述表面区段被呈现的装置的用户执行;以及使所述表面区段被呈现。 1. A method, comprising: receiving a scene camera input; identifying said at least one reference scene, wherein the at least one reference to the actual object; and receiving at least one reference object relative to the defined surface segment input, wherein said input section for defining the movement of the finger surface that defines the shape of the surface section, wherein the finger movement performed by the user device surface sections to be presented; and the said surface segments are presented.
2. 根据权利要求1所述的方法,其中识别所述场景中的至少一个参照物包括检测所述接收到的摄像机输入中的一或多个特征点。 2. The method according to claim 1, wherein the at least one reference object in the scene identification includes a plurality of feature points detected or received by the camera input.
3. 根据权利要求1所述的方法,其中识别所述场景中的至少一个参照物包括从所述至少一个参照物接收无线通信。 3. The method according to claim 1, wherein said at least one reference scene identification includes receiving a wireless communication from said at least one reference.
4. 根据权利要求1所述的方法,其中识别所述场景中的至少一个参照物包括检测所述接收到的摄像机输入中的一或多个矩形。 4. The method according to claim 1, wherein the at least one reference object in the scene identification includes a plurality of rectangular or camera detects the received input.
5. 根据权利要求4所述的方法,其进一步包括: 基于所述一或多个检测的矩形确定所述场景的当前视角,其中相对于所述场景的所述当前视角呈现所述表面区段。 5. The method as claimed in claim 4, further comprising: determining a current viewing angle of the scene based on the one or more rectangular detected, wherein with respect to the current viewing angle of the scene rendering the surface section .
6. 根据权利要求5所述的方法,其进一步包括: 确定所述场景的所述当前视角已改变;以及动态更新所述呈现的表面区段。 6. The method according to claim 5, further comprising: determining that the scene has changed in the current viewing angle; and a surface portion of the presentation dynamically updated.
7. 根据权利要求1所述的方法,其中使所述表面区段被呈现包含: 在虚拟工作空间中按第一角度呈现所述表面区段;以及在所述虚拟工作空间中按不同于所述第一角度的第二角度呈现由所述用户定义的第二表面区段。 7. The method according to claim 1, wherein said surface segments is presented comprising: a first angle in the virtual workspace rendering the surface section; and in the virtual workspace different from the press the second angle of said first angled surface of the second section presented by the user-defined.
8. 根据权利要求7所述的方法,其进一步包括: 确定所述至少一个参照物已从所述场景去除;以及关闭所述虚拟工作空间。 8. The method according to claim 7, further comprising: determining at least one reference object is removed from the scene; and closing the virtual workspace.
9. 根据权利要求8所述的方法,其进一步包括: 确定已将所述至少一个参照物再引入到所述场景或另一场景内;以及打开所述虚拟工作空间。 9. The method according to claim 8, further comprising: determining at least one reference object has been re-introduced into another scene or the scene; and opening the virtual workspace.
10. 根据权利要求7所述的方法,其进一步包括: 检测不同于所述至少一个参照物的第二参照物;以及打开不同于所述虚拟工作空间的第二虚拟工作空间。 10. The method according to claim 7, further comprising: detecting at least one reference object different from the second reference; and a second opening different from the virtual workspace virtual workspace.
11. 根据权利要求1所述的方法,其中所述识别所述至少一个参照物是基于由所述至少一个参照物显示的图像。 11. The method according to claim 1, wherein said identifying said at least one reference object is an image displayed by the at least based on a reference.
12. 根据权利要求1所述的方法,其进一步包括: 将包括包含所述表面区段的虚拟工作空间的数据信号传输到至少一个其它装置,其中所述虚拟工作空间由提供定义所述表面区段的所述输入的第一用户定义,且其中所述至少一个其它装置与不同于所述第一用户的第二用户相关联。 12. The method according to claim 1, further comprising: transmitting a data signal including virtual workspaces to the surface section of the at least one other device, wherein the virtual workspace is provided by defining the surface region a first segment of the user-defined input, and wherein said at least one other device is different from a second user associated with the first user.
13. 根据权利要求12所述的方法, 其中使所述表面区段被呈现包括: 呈现用于所述第一用户的所述虚拟工作空间;以及基于所述第二用户与所述虚拟工作空间中包含的一或多个虚拟物件的互动,动态更新用于所述第一用户的所述虚拟工作空间的所述呈现。 13. The method according to claim 12, wherein said surface segments is presented comprising: presenting the virtual workspace for the first user; and based on the user and the second virtual workspace interactive one or more virtual objects included, for dynamically updating the first user of the virtual workspace presented.
14. 根据权利要求1所述的方法,其进一步包括: 至少部分基于所述摄像机输入确定所述至少一个参照物的姿态;以及至少部分基于所述确定的姿态确定与所述至少一个参照物分开的虚拟表面,其中所述表面区段呈现于所述虚拟表面上。 14. The method according to claim 1, further comprising: at least in part on the at least one camera determining reference input gesture; and at least in part on the determined gesture and determining at least one of said separate reference the virtual surface, wherein said surface segments presented on the virtual surface.
15. —种系统,其包括: 光学传感器,其经配置以检测场景的图像; 显示器; 处理器,其经配置以: 识别所述场景中的至少一个参照物,其中所述至少一个参照物为实际物件; 接收相对于所述至少一个参照物定义表面区段的输入,其中定义所述表面区段的所述输入为定义所述表面区段的形状的手指移动,其中所述手指移动由使所述表面区段被呈现的装置的用户执行;以及在所述显示器中呈现所述表面区段。 15. - kind of system, comprising: an optical sensor configured to detect images of a scene; a display; a processor configured to: identify at least one reference object in the scene, wherein the at least one reference to the actual object; receiving an input with respect to the at least one defined reference surface section, wherein said input surface section defining the shape of the finger surface section defining the movement, wherein the movement of the finger so that execution means the user is presented surface section; and presenting a surface in said display section.
16. 根据权利要求15所述的系统,其中所述处理器经配置以基于检测到所述场景的所述图像中的一或多个特征点识别所述场景中的所述至少一个参照物。 16. The system according to claim 15, wherein said processor is based on the detection of the one or more feature points of the image to identify the scene of the scene in at least one reference object is configured.
17. 根据权利要求15所述的系统,其中所述处理器经配置以基于从所述至少一个参照物接收到无线通信识别所述场景中的所述至少一个参照物。 17. The system according to claim 15, wherein the processor is configured based upon the at least one reference to a wireless communication received from the identification of the at least one reference scene.
18. 根据权利要求15所述的系统,其中所述处理器经配置以基于检测到所述场景的所述图像中的一或多个矩形识别所述场景中的所述至少一个参照物。 18. The system according to claim 15, wherein said processor is based on the detection of the one or more rectangular identifying the scene to the image of the scene in at least one reference object is configured.
19. 根据权利要求18所述的系统,其中所述处理器进一步经配置以: 基于所述一或多个检测的矩形确定所述场景的当前视角, 其中相对于所述场景的所述当前视角呈现所述表面区段。 19. The system according to claim 18, wherein the processor is further configured to: determine a current angle of view of the scene based on said one or more of the rectangular detected, wherein with respect to the current viewing angle of the scene rendering the surface section.
20. 根据权利要求19所述的系统,其中所述处理器进一步经配置以: 确定所述场景的所述当前视角已改变;以及动态更新所述呈现的表面区段。 20. The system according to claim 19, wherein the processor is further configured to: determine a current angle of view of the scene has changed; and dynamically updating surface section of the presentation.
21. 根据权利要求15所述的系统,其中呈现所述表面区段包含: 在虚拟工作空间中按第一角度呈现所述表面区段;以及在所述虚拟工作空间中按不同于所述第一角度的第二角度呈现由所述用户定义的第二表面区段。 21. The system according to claim 15, wherein said surface presenting section comprises: a first angle in the virtual workspace rendering the surface section; and in the press is different from the first virtual workspace presenting a second angle angled second surface portion defined by the user.
22. 根据权利要求21所述的系统,其中所述处理器进一步经配置以: 确定所述至少一个参照物已从所述场景去除的时间;以及响应于确定所述至少一个参照物已被去除关闭所述虚拟工作空间。 22. The system according to claim 21, wherein the processor is further configured to: determine the at least one reference scene from the time of removal; and in response to determining that the at least one reference has been removed Close the virtual workspace.
23. 根据权利要求22所述的系统,其中所述处理器进一步经配置以: 确定已将所述至少一个参照物再引入到所述场景或另一场景内;以及响应于确定已将所述至少一个参照物再引入到所述场景或另一场景内,打开所述虚拟工作空间。 23. The system according to claim 22, wherein the processor is further configured to: determine the at least one reference object has been re-introduced into another scene or the scene; and in response to determining that have the reintroducing at least a reference object or scene into another scene of the opening the virtual workspace.
24. 根据权利要求21所述的系统,其中所述处理器进一步经配置以: 检测不同于所述至少一个参照物的第二参照物;以及打开不同于所述虚拟工作空间的第二虚拟工作空间。 24. The system according to claim 21, wherein the processor is further configured to: detect the second reference is different from the at least one reference object; virtual work and a second opening different from the virtual workspace space.
25. 根据权利要求15所述的系统,其中所述识别所述至少一个参照物是基于由所述至少一个参照物显示的图像。 25. The system according to claim 15, wherein said identifying is based on said at least one reference image by the display of at least a reference.
26. 根据权利要求15所述的系统,其进一步包括: 发射器,其经配置以将包括包含所述表面区段的虚拟工作空间的数据信号发射到至少一个其它装置, 其中所述虚拟工作空间由提供定义所述表面区段的所述输入的第一用户定义,且其中所述至少一个其它装置与不同于所述第一用户的第二用户相关联。 26. The system according to claim 15, further comprising: a transmitter configured to include virtual workspace data signal comprising a surface section transmitted to said at least one other device, wherein the virtual workspace providing input by said first surface section defining the user-defined, and wherein at least one other device is different from a second user associated with the first user.
27. 根据权利要求26所述的系统,其进一步包括: 接收器,其经配置以接收所述数据信号;且其中呈现所述表面区段包含: 呈现用于所述第一用户的所述虚拟工作空间;以及基于所述第二用户与所述虚拟工作空间中包含的一或多个虚拟物件的互动,动态更新用于所述第一用户的所述虚拟工作空间的所述呈现。 27. The system according to claim 26, further comprising: a receiver configured to receive the data signal; and wherein said surface presenting section comprising: presenting a user of the first virtual workspace; and interactive virtual object based on one or more of the user and the second virtual workspace included, for dynamically updating the first user of the virtual workspace presented.
28. 根据权利要求15所述的系统,其中所述处理器进一步经配置以至少部分基于所述场景的所述图像确定所述至少一个参照物的姿态,和至少部分基于所述确定的姿态确定与所述至少一个参照物分开的虚拟表面,其中所述表面区段呈现于所述虚拟表面上。 28. The system according to claim 15, wherein the processor further determines at least one reference object is configured to pose the image of the scene based at least in part, based on the determined posture and the determined at least in part the at least one separate virtual reference surface, wherein the surface section presented on the virtual surface.
29. —种系统,其包括: 用于光学感测场景的图像的装置; 用于识别所述场景中的至少一个参照物的装置,其中所述至少一个参照物为实际物件; 用于接收相对于所述至少一个参照物定义表面区段的输入的装置,其中定义所述表面区段的所述输入为定义所述表面区段的形状的手指移动,其中所述手指移动由使所述表面区段被呈现的装置的用户执行;以及用于呈现所述表面区段的装置。 29. - kind of system, comprising: means for sensing an optical image of a scene; at least one reference means for identifying the scene, wherein the at least one actual object reference; for receiving a relative input means at least one reference surface is defined in the section, wherein said input surface section defining the shape of the finger portion defining said moving surface, wherein said finger is moved by said surface user device segments are presented performed; and means for rendering said surface section.
CN201380045744.9A 2012-09-04 2013-08-07 Augmented reality display surface CN104603719B (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US201261696761P true 2012-09-04 2012-09-04
US61/696,761 2012-09-04
US13/802,194 US9530232B2 (en) 2012-09-04 2013-03-13 Augmented reality surface segmentation
PCT/US2013/053954 WO2014039201A1 (en) 2012-09-04 2013-08-07 Augmented reality surface displaying

Publications (2)

Publication Number Publication Date
CN104603719A CN104603719A (en) 2015-05-06
CN104603719B true CN104603719B (en) 2017-08-22

Family

ID=50186931

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201380045744.9A CN104603719B (en) 2012-09-04 2013-08-07 Augmented reality display surface

Country Status (5)

Country Link
US (1) US9530232B2 (en)
EP (1) EP2893416A1 (en)
KR (1) KR101784328B1 (en)
CN (1) CN104603719B (en)
WO (1) WO2014039201A1 (en)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9298008B2 (en) * 2012-12-06 2016-03-29 Cherif Atia Algreatly 3D immersion technology
US9459697B2 (en) 2013-01-15 2016-10-04 Leap Motion, Inc. Dynamic, free-space user interactions for machine control
US9501152B2 (en) 2013-01-15 2016-11-22 Leap Motion, Inc. Free-space user interface and control using virtual constructs
US9916009B2 (en) 2013-04-26 2018-03-13 Leap Motion, Inc. Non-tactile interface systems and methods
US9747696B2 (en) 2013-05-17 2017-08-29 Leap Motion, Inc. Systems and methods for providing normalized parameters of motions of objects in three-dimensional space
US10281987B1 (en) * 2013-08-09 2019-05-07 Leap Motion, Inc. Systems and methods of free-space gestural interaction
AU2014202574A1 (en) * 2014-05-13 2015-12-03 Canon Kabushiki Kaisha Positioning of projected augmented reality content
US20150348322A1 (en) * 2014-06-02 2015-12-03 Dell Products L.P. Dynamically Composited Information Handling System Augmented Reality at a Primary Display
WO2015185961A1 (en) * 2014-06-03 2015-12-10 Sony Corporation Lifelog camera and method of obtaining a digital image tagged with corrected image direction information
DE102014217961A1 (en) 2014-09-09 2016-03-10 Bayerische Motoren Werke Aktiengesellschaft Determining the pose of HMD
TWI628613B (en) * 2014-12-09 2018-07-01 財團法人工業技術研究院 Augmented reality system and method
US10088971B2 (en) * 2014-12-10 2018-10-02 Microsoft Technology Licensing, Llc Natural user interface camera calibration
US10073516B2 (en) * 2014-12-29 2018-09-11 Sony Interactive Entertainment Inc. Methods and systems for user interaction within virtual reality scene using head mounted display
WO2016119868A1 (en) * 2015-01-29 2016-08-04 Aurasma Limited Provide augmented reality content
US20170061700A1 (en) * 2015-02-13 2017-03-02 Julian Michael Urbach Intercommunication between a head mounted display and a real world object
US9898865B2 (en) * 2015-06-22 2018-02-20 Microsoft Technology Licensing, Llc System and method for spawning drawing surfaces
US20160379407A1 (en) * 2015-06-23 2016-12-29 Daryl Foster Virtual Fantasy System and Method of Use
US9520002B1 (en) 2015-06-24 2016-12-13 Microsoft Technology Licensing, Llc Virtual place-located anchor
TWI588672B (en) * 2015-08-04 2017-06-21 A motional control and interactive navigation system of virtual park and method thereof
US20170062015A1 (en) * 2015-09-01 2017-03-02 Whole Body IQ, Inc. Correlation of media with biometric sensor information
US10304247B2 (en) 2015-12-09 2019-05-28 Microsoft Technology Licensing, Llc Third party holographic portal
US10163198B2 (en) * 2016-02-26 2018-12-25 Samsung Electronics Co., Ltd. Portable image device for simulating interaction with electronic device
US10212000B1 (en) * 2017-07-25 2019-02-19 Daqri, Llc Computer vision based activation
WO2019114986A1 (en) * 2017-12-15 2019-06-20 Telefonaktiebolaget Lm Ericsson (Publ) Determining a content pose of a piece of virtual content
EP3502839A1 (en) * 2017-12-22 2019-06-26 Nokia Technologies Oy Methods, apparatus, systems, computer programs for enabling mediated reality

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103049234A (en) * 2012-12-04 2013-04-17 深圳市金立通信设备有限公司 Terminal, system and method for dual-unit cooperative work
CN103188454A (en) * 2011-12-30 2013-07-03 三星电子株式会社 Apparatus and method for displaying

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6625299B1 (en) 1998-04-08 2003-09-23 Jeffrey Meisner Augmented reality technology
US6771294B1 (en) * 1999-12-29 2004-08-03 Petri Pulli User interface
US6891518B2 (en) 2000-10-05 2005-05-10 Siemens Corporate Research, Inc. Augmented reality visualization device
US7064742B2 (en) 2001-05-31 2006-06-20 Siemens Corporate Research Inc Input devices using infrared trackers
US20050289590A1 (en) * 2004-05-28 2005-12-29 Cheok Adrian D Marketing platform
US8547401B2 (en) * 2004-08-19 2013-10-01 Sony Computer Entertainment Inc. Portable augmented reality device and method
WO2008153599A1 (en) * 2006-12-07 2008-12-18 Adapx, Inc. Systems and methods for data annotation, recordation, and communication
US20080266323A1 (en) * 2007-04-25 2008-10-30 Board Of Trustees Of Michigan State University Augmented reality user interaction system
WO2010029553A1 (en) * 2008-09-11 2010-03-18 Netanel Hagbi Method and system for compositing an augmented reality scene
US8289288B2 (en) 2009-01-15 2012-10-16 Microsoft Corporation Virtual object adjustment via physical object detection
US20100208033A1 (en) * 2009-02-13 2010-08-19 Microsoft Corporation Personal Media Landscapes in Mixed Reality
US8947455B2 (en) * 2010-02-22 2015-02-03 Nike, Inc. Augmented reality design system
US8633947B2 (en) * 2010-06-02 2014-01-21 Nintendo Co., Ltd. Computer-readable storage medium having stored therein information processing program, information processing apparatus, information processing system, and information processing method
GB2481612A (en) * 2010-06-30 2012-01-04 Skype Ltd Updating image regions in a shared image system
US8509483B2 (en) 2011-01-31 2013-08-13 Qualcomm Incorporated Context aware augmentation interactions
US9384594B2 (en) 2011-03-29 2016-07-05 Qualcomm Incorporated Anchoring virtual images to real world surfaces in augmented reality systems
US8749396B2 (en) * 2011-08-25 2014-06-10 Satorius Stedim Biotech Gmbh Assembling method, monitoring method, communication method, augmented reality system and computer program product
US10067568B2 (en) * 2012-02-28 2018-09-04 Qualcomm Incorporated Augmented reality writing system and method thereof
KR20150103723A (en) * 2013-01-03 2015-09-11 메타 컴퍼니 Extramissive spatial imaging digital eye glass for virtual or augmediated vision

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103188454A (en) * 2011-12-30 2013-07-03 三星电子株式会社 Apparatus and method for displaying
CN103049234A (en) * 2012-12-04 2013-04-17 深圳市金立通信设备有限公司 Terminal, system and method for dual-unit cooperative work

Also Published As

Publication number Publication date
KR101784328B1 (en) 2017-10-11
KR20150048881A (en) 2015-05-07
US20140063060A1 (en) 2014-03-06
WO2014039201A1 (en) 2014-03-13
CN104603719A (en) 2015-05-06
EP2893416A1 (en) 2015-07-15
US9530232B2 (en) 2016-12-27

Similar Documents

Publication Publication Date Title
JP5923184B2 (en) Apparatus and method for providing remote user interaction
US9939914B2 (en) System and method for combining three-dimensional tracking with a three-dimensional display for a user interface
KR101252169B1 (en) Mobile terminal and operation control method thereof
Kane et al. Bonfire: a nomadic system for hybrid laptop-tabletop interaction
US9274608B2 (en) Systems and methods for triggering actions based on touch-free gesture detection
CN101479693B (en) A method for interfacing a digital device with the interactive display surface and Systems
US9733752B2 (en) Mobile terminal and control method thereof
RU2684189C2 (en) Adaptive event recognition
US20160274671A1 (en) User interface interaction for transparent head-mounted displays
US20160259423A1 (en) Touch fee interface for augmented reality systems
US8896522B2 (en) User-centric three-dimensional interactive control environment
CN103890695B (en) Gesture-based interface system and method
CN104823152B (en) Using gaze tracking implement augmented reality
US9372544B2 (en) Gesture recognition techniques
CN105027033B (en) Augmented reality objects for selecting a method, apparatus and computer-readable medium
US9791920B2 (en) Apparatus and method for providing control service using head tracking technology in electronic device
JP2017513126A (en) Apparatus and method for a ring-shaped computing device
WO2013028908A1 (en) Touch and social cues as inputs into a computer
JP6046729B2 (en) All directions gesture input
US9547419B2 (en) Reduced size configuration interface
KR20100027976A (en) Gesture and motion-based navigation and interaction with three-dimensional virtual content on a mobile device
WO2015048529A1 (en) Simulating three-dimensional views using planes of content
CN105518575A (en) Two-hand interaction with natural user interface
US20140100955A1 (en) Data and user interaction based on device proximity
JP6044079B2 (en) The information processing apparatus, information processing method, and program

Legal Events

Date Code Title Description
C06 Publication
EXSB Decision made by sipo to initiate substantive examination
GR01