TWI552791B - 雷射二極體模式 - Google Patents

雷射二極體模式 Download PDF

Info

Publication number
TWI552791B
TWI552791B TW101108500A TW101108500A TWI552791B TW I552791 B TWI552791 B TW I552791B TW 101108500 A TW101108500 A TW 101108500A TW 101108500 A TW101108500 A TW 101108500A TW I552791 B TWI552791 B TW I552791B
Authority
TW
Taiwan
Prior art keywords
laser
mode
computing device
laser diodes
output
Prior art date
Application number
TW101108500A
Other languages
English (en)
Other versions
TW201242644A (en
Inventor
伊道森
Original Assignee
微軟技術授權有限責任公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 微軟技術授權有限責任公司 filed Critical 微軟技術授權有限責任公司
Publication of TW201242644A publication Critical patent/TW201242644A/zh
Application granted granted Critical
Publication of TWI552791B publication Critical patent/TWI552791B/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/002—Specific input/output arrangements not covered by G06F3/01 - G06F3/16
    • G06F3/005—Input arrangements through a video camera
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Semiconductor Lasers (AREA)
  • Position Input By Displaying (AREA)

Description

雷射二極體模式
本發明係關於雷射二極體模式。
使用者可用以與運算裝置互動的裝置數量持續增加中。舉例來說，剛開始是使用文字與運算裝置互動。因此，使用者典型地使用鍵盤輸入文字並且檢視運算裝置同樣以文字輸出。
該等技術隨後被擴展為圖形使用者介面，使用者可藉由指標控制裝置如滑鼠在圖形使用者介面中互動。技術持續擴展為配置圖形使用者介面以識別使用者的姿勢而提供輸入至電腦裝置。舉例來說，姿勢可用於選擇物體、與電玩遊戲互動等等。然而，該等技術由於所使用的環境而可面臨限制，環境可限制識別輸入的能力。因此，該等限制可限制運算裝置可支援之輸入的數量與種類。
本發明描述雷射二極體模式技術。在一或更多個實施中，使運算裝置之一或更多個雷射二極體於雷射臨界值之下操作以照亮運算裝置之實體周遭的至少一部分。運算裝置之相機擷取照亮之實體周遭的一或更多個影像，而該從擷取之一或更多個影像識別一或更多個輸入以與 運算裝置顯示之使用者介面互動。
在一或更多個實施中，運算裝置實施之方法包括在自發模式中操作一或更多個雷射二極體以使用非同調光照亮運算系統之實體周遭，以及在同調模式中操作一或更多個雷射二極體以使用同調光射出圖案至實體周遭中，用以判定該一或更多個雷射二極體以及實體周遭中一或更多個物體之間的距離。
在一或更多個實施中，設備包括相機、一或更多個雷射二極體以及一或更多個模組。配置該一或更多個模組以於第一模式操作，致使該一或更多個雷射二極體在雷射臨界值之下操作以輸出光線照亮相機之實體周遭的至少一部分，以及致使相機擷取該照亮之實體周遭的一或更多個影像。亦配置一或更多個模組以操作於第二模式，致使一或更多個雷射二極體在雷射臨界值之上操作以輸出配置為圖案之同調光，以及致使相機擷取實體周遭之同調光圖案的至少一影像以判定實體周遭中一或更多個物體的深度。
提供此摘要以利用簡化形式介紹概念之選擇，其細節將進一步被描述於以下實施方式中。此發明內容並無意識別申請專利範圍之關鍵特徵或本質特徵，且無意被使用作為判定該申請專利範圍的輔助。
概述
可用於與運算裝置的互動的輸入技術已由典型使用鍵盤實施之文字輸入技術演進為可使用相機擷取的姿勢。舉例來說，相機可偵測使用者的方位或一或更多個身體部位，以及識別源自該偵測之方位的姿勢。此姿勢隨後可被用於與運算裝置之使用者介面輸出互動。
然而，使用運算裝置之環境可具有極大差異，從光線良好的環境(例如辦公室)至相對黑暗的環境，例如使用者在家中玩電玩遊戲時典型使用之環境。因此，由於該等環境可具有極大差異，因此可能難以藉由具有成本效益之方式配置相機以識別每個環境的姿勢。
然而，本說明書中描述之技術可被用於照亮環境以使相機得以擷取影像並識別姿勢。舉例來說，技術可運用一或更多個雷射二極體以於雷射臨界值之下操作二極體，因而雷射二極體可作為發光二極體(LEDs)。此外，可設置此光線使光線不為人眼所見(例如位於近紅外線波長)，藉以最小化實體環境中的光線干擾。相機隨後可擷取使用此光線照亮的影像，藉以使用影像增進識別姿勢以及其他物體的能力。
再者，技術可運用雷射二極體供運算裝置用於其他用途。舉例來說，運算裝置可包括以圖案射出同調(例如雷射)光於實體環境中的雷射二極體。此圖案隨後可被用於判定物體於實體環境中的深度，其方法為利用相機或其他偵測器擷取圖案之影像。在此範例中，可配置雷 射二極體以支援複數個模式，包含在雷射臨界值之上操作以測量深度之操作模式以及在雷射臨界值之下操作以供照明的操作模式。藉此，雷射二極體可被用於多種目的，藉以節省運算裝置之成本。雷射二極體模式的進一步討論可見於以下段落。
在以下討論中，首先描述可供使用本文中描述之雷射模式技術的示範環境。隨後描述技術及流程的示範照明，所述示範照明可被用於示範環境以及其他環境。因此，示範環境並不限於執行示範技術及流程。類似地，示範技術及流程並不限於示範環境中的實施。
示範環境
第1圖說明可用以使用雷射模式技術的示範實施環境100。說明環境100包括可藉由多種方式配置之示範運算裝置102。舉例來說，運算裝置102可被配置為傳統電腦(例如桌上型個人電腦、筆記型電腦等等)、行動台、娛樂設備、如圖所述之連接至顯示裝置104(例如電視)的遊戲控制器、顯示裝置(例如電視)之部分、無線電話、平板電腦、連網筆記型電腦以及關於第5圖進一步描述之其他者。因此，運算裝置102可涵蓋從具有實體記憶體及處理器資源之完整資源裝置(例如個人電腦、電視遊樂器等等)到具有有限記憶體及/或處理資源之低資源裝置(例如傳統的機上盒、手持遊樂器)。運算裝置102亦可與使其執行一或更多個操作的軟體有關。
所述運算裝置102包括輸入/輸出模組106。輸入/輸出 模組106表示與輸入識別及/或運算裝置102之輸出提供有關的功能。舉例來說，可配置輸入/輸出模組106接收源自鍵盤、滑鼠的輸入，以識別姿勢並致使執行對應姿勢的操作等等。輸入可由輸入/輸出模組105以各種不同方式所偵測。
可配置輸入/輸出模組106以接收一或更多個輸入，輸入係透過與硬體裝置之觸控互動，所述硬體裝置例如所述控制器108。觸控互動可涉及按下按鈕、移動搖桿、在觸控板上移動、使用顯示裝置104之觸控螢幕(例如偵測使用者之手指或尖筆)等等。輸入/輸出模組106可運用觸控輸入的識別以與運算裝置102之使用者介面輸出互動，例如與遊戲、應用程式互動、瀏覽網際網路、改變運算裝置之一或更多個設定等等。亦已考慮涉及與裝置之觸控互動的各種其他硬體裝置。此硬體裝置之範例包括游標控制裝置(例如滑鼠)、遙控器(例如電視遙控器)、行動通信裝置(例如用於控制運算裝置102之一或更多個操作的無線電話)、以及涉及使用者身體部位或物體觸控的其他裝置。
亦可配置輸入/輸出裝置106以提供自然使用者介面(NUI)，所述自然使用者介面可識別不涉及觸控的互動。舉例來說，運算裝置102可包括NUI輸入裝置110。可利用多種方式配置NUI輸入裝置110以偵測輸入而不需要使用者觸控特定裝置，例如藉由使用麥克風而識別音訊輸入。舉例來說，可配置輸入/輸出模組106以執行 語音識別以識別特定語調(例如語音指令)以及識別提供語調的特定使用者。
在另一範例中，可配置NUI輸入裝置110使用相機識別姿勢、存在的物體、影像等等。舉例來說，可配置相機以包括多個鏡頭以擷取不同透視(perspective)並因而判斷深度。舉例來說，不同透視可被用於判定與NUI輸入裝置110之間的相對距離以及相對距離的改變。運算裝置102可運用不同透視作為深度認知。影像亦可由輸入/輸出模組106運用以提供各種其他功能，例如識別特定使用者的技術(例如透過臉部辨識)、物體等等。
輸入/輸出模組106可運用NUI輸入裝置110以執行骨骼配對(skeletal mapping)，並伴隨人體之特定點的特徵抽取(例如48個骨骼點)以追蹤一或更多個使用者以執行動作分析。舉例來說，NUI輸入裝置110可擷取輸入/輸出模組106所分析之影像以識別使用者的一或更多個動作，包括人體的哪個部分被用於做出動作以及哪個使用者做出動作。範例為識別使用者手112之一或更多個手指的位置及移動以及使用者手112整體的移動。輸入/輸出模組106可識別動作為姿勢以啟動對應操作。
可識別各種不同的姿勢類別，例如由單一輸入類型(例如動作姿勢)所識別之姿勢以及涉及多重輸入類別之姿勢，例如動作姿勢以及使用物體例如尖筆所作出之物體姿勢。因此，輸入/輸出模組106可藉由識別及運用輸入之間的分隔(division)而支援各種不同的姿勢技術。應 注意藉由區分自然使用者介面(NUI)中的各個輸入，輸入之每一者可能做出之手勢的數量也會增加。舉例來說，即使移動為相同的，可使用不同輸入類型指出不同的姿勢(或者類似指令的不同參數)。因此，輸入/輸出模組106可提供自然使用者介面，所述自然使用者介面支援各種不涉及觸控之使用者互動。
因此，即使以下討論可能僅描述特定輸入範例，但實際上亦可使用不同輸入類型而不會偏離本發明之精神與範圍。再者，即使在以下討論之實例中說明姿勢為使用NUI之輸入，但可使用各種不同技術以及各種不同裝置輸入姿勢，例如使用平板電腦的觸控螢幕功能。
進一步描述運算裝置102為包括雷射模式模組114，雷射模式模組114表示操作雷射二極體116之功能。舉例來說，NUI輸入裝置110可使用雷射二極體116以使用同調光射出圖案。輸入/輸出模組106隨後可使用此圖案110以測量運算裝置102所在之實體環境的深度。舉例來說，深度測量可被用於判定姿勢、物體於房間中的位置等等。
雷射模式模組106亦可為了照明目的在雷射臨界值之下操作雷射二極體116。可使用此照明協助擷取影像以使輸入/輸出模組106更容易用以識別姿勢、物體等等，此舉進一步討論可參照與第2圖有關之部分。
一般而言，可使用軟體、韌體、硬體(例如固定的邏輯電路)或實施之組合以實施本說明書描述的任何功 能。本說明書中使用之『模組』、『功能』及『邏輯』等術語一般表示軟體、韌體、硬體或其結合。在軟體實施之情形中，模組、功能或邏輯表示當於處理器(例如CPU)上執行時執行特定任務的程式碼。程式碼可被儲存於一或更多個電腦可讀取記憶體裝置中。以下描述之雷射模組技術的特徵為與平台無關的，意即技術可被實施於具有各種處理器之各種商業運算平台上。
舉例來說，運算裝置102亦可包括實體(例如軟體)，以使運算裝置102之硬體執行操作，例如處理器、功能方塊等等。舉例來說，運算裝置102可包括電腦可讀取媒體，可配置所述電腦可讀取媒體以維持使運算裝置-特別是運算裝置102之硬體-執行操作的指令。因此，指令之功能為配置硬體以執行操作並導致硬體之轉換以執行功能。指令可由電腦可讀取媒體透過各種不同配置提供給運算裝置102。
一種此電腦可讀取媒體的配置為信號承載媒體且因而用於例如透過網路而傳送指令(例如作為載波)至運算裝置之硬體。亦可配置電腦可讀取媒體為電腦可讀取儲存媒體而非信號承載媒體。電腦可讀取儲存媒體的範例包括隨機存取記憶體(RAM)、唯讀記憶體(ROM)、光碟、快閃記憶體、硬碟記憶體以及可使用磁性、光學以及其他儲存指令及其他資料之技術的其他記憶體裝置。
第2圖描繪系統200的示範實施，該圖更詳細地說明第1圖之雷射模式模組114。運算裝置102在此範例中 包括如第1圖所述之雷射模式模組114與雷射二極體116，以及相機202。
所述雷射模式模組114就雷射二極體116之控制支援同調模式204以及自發模式206。在同調模式204中，雷射模式模組114係於雷射臨界值之上操作雷射二極體116。此使雷射二極體116輸出同調光。此同調光可被用於各種目的，例如射出圖案(例如由一連串點構成的格線)至運算裝置102周遭的實體環境中。運算裝置102可使用此圖案以測量實體環境中包括之物體的深度，例如藉以判斷雷射二極體116及物體之間的距離。
在自發模式206中，雷射模式模組114致使雷射二極體116在雷射臨界值之下操作。此使得雷射二極體116輸出非同調光。因此，在此模式中雷射二極體116作為發光二極體116以輸出光線，光線可被用於照亮運算裝置102之實體周遭的至少一部分。此光線亦可被用於各種目的。舉例來說，自發模式206可致使雷射二極體116輸出人眼不可見的光線(例如近紅外線光)至實體環境中。在此範例中可配置相機202以擷取對應雷射二極體116輸出之波長的影像，意即人眼不可見光。在此方式中，運算裝置102之實體周遭不會受到雷射二極體116輸出之光線的影響，因而環境可保持相對陰暗但相機202仍可擷取影像而可供識別實體周遭中的姿勢、物體等等。
因此，技術可運用結構光線深度相機系統，結構光線深度相機系統使用同調(例如雷射)光以射出已知參考 圖案至實體周遭中，以同時照亮周遭以擷取影像。舉例來說，雷射模式模組114可頻繁地於模式之間切換，因而運算裝置102不需使用額外的雷射二極體或補充光線。雷射模式模組114可利用各種方式造成雷射二極體116之同調模式204以及自發模式206，例如藉由改變供給雷射二極體116的操作電流。亦已考慮各種其他範例，其他範例進一步討論請見以下程序。
示範程序
以下討論描述可利用前述系統及裝置所實施的雷射模式技術。每個程序的各種態樣可被實施於硬體、韌體、軟體或者其結合中。程序於圖中被呈現為方塊組，方塊組指出一或更多個裝置執行之操作，但執行個別方塊之操作並不必然限於方塊組顯示之順序。以下討論之部分將參照第1圖之環境100以及第2圖之系統200。
第3圖描繪示範實施中的程序300，其中雷射二極體被操作於不同模式中以提供照明或同調光。一或更多個雷射二極體被操作於自發模式中以使用非同調光照亮運算裝置之實體周遭的至少一部分(方塊302)。舉例來說，雷射模式模組114可提供操作電流至雷射二極體116而使雷射二極體116於雷射臨界值之下操作。因此，雷射二極體116可作為發光二極體(LED)。當於此模式中操作時，雷射二極體116可輸出多種波長的光線，包括可見光、人眼不可見光(例如近紅外線光)等等。
一或更多個雷射二極體亦可操作於同調模式中以使用同調光射出圖案至實體周遭中，圖案可用於判定一或更多個雷射二極體與實體周遭中一或更多個物體之間的距離(方塊304)。延續前述範例，雷射模式模組114可提供操作電流至雷射二極體116，操作電流足以使雷射二極體116於雷射臨界值之上操作。此使得雷射二極體116輸出同調光，同調光可如前文所述被用於多種目的。
舉例來說，同調光可被用於射出參考圖案，參考圖案可被用於偵測實體環境中各個部分與運算裝置102之間的深度。輸入/輸出模組106可檢查參考圖案之相機202所拍攝之影像並藉由扭曲參考圖案(例如展開圖案之各個部分)判定實體環境之各個部分的深度。藉此，雷射二極體116可被用於多種目的藉以節省運算裝置102之製造及使用的成本。亦已考慮各種其他範例，各種其他範例進一步討論將見於與以下圖示有關之描述中。
第4圖描繪示範實施之程序400，其中藉由在雷射臨界值之下操作雷射二極體照亮實體環境，並擷取實體環境之影像以識別輸入。使運算裝置之一或更多個雷射二極體在雷射臨界值之下操作以照亮運算裝置之實體周遭的至少一部分(方塊402)。如前所述，雷射模式模組114可使雷射二極體116作為發光二極體以照亮周遭，例如透過輸出人眼不可見之近紅外線光。
照亮之實體周遭的一或更多個影像被運算裝置之相機所擷取(方塊404)。舉例來說，可配置相機202以擷取 射線波長之影像，影像之波長對應至雷射二極體116於自發模式206中操作時輸出之射線的波長。
一或更多個輸入係由一或更多個擷取之影像所識別，輸入係用於與運算裝置所顯示之使用者介面互動(方塊406)。輸入/輸出模組106可處理影像以識別影像之姿勢。舉例來說，姿勢可涉及使用者之身體之一或更多個部分的方位、一或更多個物體、物體之移動等等。識別之姿勢隨後可被用於使運算裝置102執行操作，例如涉及與使用者介面的互動，使用者介面係由運算裝置102輸出供顯示裝置顯示。
使運算裝置之一或更多個雷射二極體於雷射臨界值之上操作(方塊408)。如前所述，此操作可使雷射二極體116輸出同調光，同調光可被用於各種目的。舉例來說，實體周遭中的一或更多個物體的深度可藉由相機所擷取之至少一影像加以判定(方塊410)。各種其他範例亦如前述已加以考量。
示範系統及裝置
第5圖說明示範系統500，示範系統500包括前文關於第1圖所描述之運算裝置102。示範系統500於運行應用程式於個人電腦(PC)、電視裝置及/或行動裝置上時提供無縫使用者體驗之各種環境。服務及應用程式在所有三種環境中的運行實際上為類似的，且於從一裝置轉換至另一裝置而利用應用程式、玩電玩遊戲、觀賞視 訊等等時提供共同的使用者體驗。
在示範系統500中，多個裝置透過中央運算裝置互連。中央運算裝置可與多個裝置同屬一地，或者可位於多個裝置之遠端。在一實施例中，中央運算裝置可為雲端或一或更多個伺服器電腦，雲端或一或更多個伺服器電腦透過網路、網際網路或者其他資料通信連結連接至多個裝置。在一實施例中，此互連結構使功能得以在多個裝置之間傳送以提供多個裝置之使用者共同及無縫之體驗。多個裝置之每一者可具有不同實體需求及能力，且中央運算裝置使用平台以使傳送至裝置之體驗不僅是特別適於裝置且仍然與所有裝置共同。在一實施例中，建立目標裝置類別，而體驗係特別適於一般類別之裝置。裝置類別可藉由實體特徵、使用類型或者裝置之其他共同特性加以定義。
在各種實施中，運算裝置102可假設多種不同的配置，例如用於電腦502、行動504以及電視506使用。該等配置之每一者包括一般具有不同構造及能力之裝置，因而可依據一或更多個不同裝置類別配置運算裝置102。舉例來說，運算裝置102可被實施為電腦502裝置類別，電腦502裝置類別包括個人電腦、桌上型電腦、多螢幕電腦、筆記型電腦、連網電腦等等。
運算裝置102亦可被實施為行動504裝置類別，行動504裝置類別包括行動裝置，例如手機、可攜式音樂播放器、可攜式遊戲裝置、平板電腦、多螢幕電腦等等。 運算裝置102亦可被實施為電視506裝置類別，電視506裝置類別包括具有或連接至日常收看環境中一般而言較大之螢幕的裝置。該等裝置包括電視、機上盒、電視遊樂器等等。運算裝置102之該等各種配置可支援本文中描述之技術且不限於本文中描述之技術的特定範例。
雲端508包括及/或表示內容服務512的平台510。平台510抽取硬體(例如伺服器)之底層功能以及雲端508之軟體資源。內容服務512可包括應用程式及/或資料，應用程式及/或資料可於電腦處理在運算裝置102之遠端伺服器上執行時加以利用。可提供內容服務512作為網際網路上或透過用戶網路例如蜂巢或Wi-Fi網路的服務。
平台510可抽取資源及功能以連接運算裝置102與其他運算裝置。平台510亦可作為抽取資源之尺度(scaling)以提供對應的尺度層級給藉由平台510實施之內容服務512的接觸需求。因此，在互連裝置實施例中，本文中描述之功能實施可被分散至系統500。舉例來說，功能可部分被實施於運算裝置102上以及部分藉由平台510實施，所述平台510抽取雲端508之功能。
第6圖說明示範裝置600的範例，該示範裝置可被實施為參照第1、2及5圖所描述之任何運算裝置類型以實施本文中描述之技術的實施例。裝置600包括通信裝置602，通信裝置602提供裝置資料604(例如已接收資料、正被接收之資料、將被廣播之資料、資料之資料封包等等)的有線及/或無線通信。裝置資料604或其他裝置內 容可包括裝置之配置設定、儲存於裝置之上的媒體內容、及/或關於裝置之使用者的資訊。儲存於裝置600上的媒體內容可包括任何類型之音訊、視訊及/或影像資料。裝置600包括一或更多個資料輸入606，可藉資料輸入606接收任何類型之資料、媒體內容及/或輸入，例如使用者可選擇輸入、訊息、音樂、電視媒體內容、記錄之影像內容以及任何從任何內容及/或資料來源接收之其他類型的音訊、視訊及/或影像資料。
裝置600亦包括通信介面608，通信介面608可被實施為任一或更多個之序列及/或平行介面、無線介面、任何類型之網路介面、數據機以及任何其他類型的通信介面。通信介面608提供裝置600及通信網路之間的連接及/或通信連結，藉以使其他電子、運算及通信裝置與裝置600通信資料。
裝置600包括一或更多個處理器610(例如微處理器、控制器等等)，所述處理器610處理各種電腦可執行指令以控制裝置600之操作，以及實施本文中描述之技術。替代地或額外地，可藉由硬體、韌體、或者固定邏輯電路之任一者或結合-實施上係指一般被識別於612的處理及控制電路-實施裝置600。雖然圖中並未顯示，但裝置600可包括系統匯流排或者資料傳輸系統以連結裝置中的各種元件。系統匯流排可包括不同匯流排結構之任一者或結合，例如利用各種匯流排結構之記憶體匯流排或記憶體控制器、週邊匯流排、通用序列匯流排及/或處 理器或區域匯流排。
裝置600亦包括電腦可讀取媒體614，例如一或更多個記憶體元件，一或更多個記憶體元件的範例包括隨機存取記憶體(RAM)、非揮發性記憶體(例如唯讀記憶體(ROM)、快閃記憶體、EPROM、EEPROM等等的任一或更多者)以及磁碟儲存裝置。磁碟儲存裝置可被實施為任何類型之磁性或光學儲存裝置，例如硬碟機、可讀取及/或寫入光碟(CD)、任何類型之數位多功能光碟(DVD)等等。裝置600亦可包括大容量儲存媒體裝置616。
電腦可讀取媒體614提供資料儲存機制以儲存裝置資料604以及各種裝置應用程式618與任何其他類型的資訊，及/或與裝置600之操作方面有關的資料。舉例來說，作業系統620可作為電腦可讀取媒體614上的電腦應用程式並於處理器610上執行。裝置應用程式618可包括裝置管理員(例如控制應用程式、軟體應用程式、信號處理及控制模組、特定裝置本身的編碼、特定裝置之硬體抽象層等等)。裝置應用程式618亦包括任何系統元件或模組以實施本文中描述之姿勢技術的實施例。在此範例中，裝置應用程式618包括介面應用程式622以及輸入/輸出模組624(輸入/輸出模組624可與輸入/輸出模組114相同或不同)，介面應用程式622以及輸入/輸出模組624於圖中被顯示為軟體模組及/或電腦應用程式。輸入/輸出模組624表示軟體，該軟體提供介面以及用於 擷取輸入之裝置，例如觸控螢幕、觸控板、相機、麥克風等等。替代地或額外地，介面應用程式622以及輸入/輸出模組624可被實施為硬體、軟體、韌體或者以上之任何結合。額外地，可配置輸入/輸出模組624以支援多重輸入裝置，例如分別擷取視訊及音訊輸入的獨立裝置。
裝置600亦包括音訊及/或視訊輸入-輸出系統626，音訊及/或視訊輸入-輸出系統626提供音訊資料至音訊系統628及/或提供視訊資料至顯示系統630。音訊系統628及/或顯示系統630可包括任何處理、顯示及/或以其他方式演算音訊、視訊及影像資料的裝置。裝置600可透過RF(無線電頻率)連結、S-video連結、複合視訊連結、分量視訊連結、DVI(數位視訊介面)、類比音訊連接或者其他類似的通信連結通信視訊信號及音訊信號至音訊裝置及/或顯示裝置。在一實施例中，音訊系統628及/或顯示系統630被實施為裝置600的外接元件。替代地，音訊系統628及/或顯示系統630被實施為示範裝置600的整合元件。
結論
雖然本發明已藉由結構特徵及/或方法動作的特定語言加以描述如上，但將了解本發明將被定義於附加之申請專利範圍中，而不必然限於已描述之特定特徵或動作。反之，特定特徵及動作僅被揭露為實施本發明申請專利範圍的示範形式。
100‧‧‧環境
102‧‧‧運算裝置
104‧‧‧顯示裝置
106‧‧‧輸入/輸出模組
108‧‧‧控制器
110‧‧‧自然使用者介面(NUI)輸入裝置
112‧‧‧使用者手
114‧‧‧雷射模式模組
116‧‧‧雷射二極體
200‧‧‧系統
202‧‧‧相機
204‧‧‧同調模式
206‧‧‧自發模式
300,400‧‧‧程序
302,304,402,404‧‧‧方塊
500‧‧‧系統
502‧‧‧電腦
504‧‧‧行動
506‧‧‧電視
508‧‧‧雲端
510‧‧‧平台
512‧‧‧內容裝置
600‧‧‧裝置
602‧‧‧通信裝置
604‧‧‧裝置資料
606‧‧‧資料輸入
608‧‧‧通信介面
610‧‧‧處理器
612‧‧‧處理及控制電路
614‧‧‧電腦可讀取媒體
616‧‧‧大容量儲存媒體裝置
618‧‧‧裝置應用程式
620‧‧‧作業系統
622‧‧‧介面應用程式
624‧‧‧輸入/輸出模組
626‧‧‧音訊及/或視訊輸入-輸出系統
628‧‧‧音訊系統
630‧‧‧顯示系統
該實施方式係參照附加圖示加以描述。在該圖示中，參照編號的最左邊數字識別該參照符號首先出現於何圖示。在該描述及圖示之不同情形中使用相同的參照編號可指示相似或相同的項目。
第1圖為示範實施之環境的說明，該示範實施可用於使用本說明書中描述之雷射二極體模式技術；第2圖說明示範系統，示範系統更詳細地呈現第1圖之雷射模式模組，所述雷射模式模組係用於致使雷射二極體在複數個模式中操作；第3圖為流程圖，流程圖描繪示範實施的流程，其中雷射二極體於不同模式中被操作以提供照明或同調光；第4圖為流程圖，流程圖描繪示範實施的流程，其中藉由擷取實體環境之影像而識別輸入，所述實體環境係由在雷射臨界值之下操作雷射二極體所照亮；第5圖說明示範系統，示例性系統說明參照第1圖描述之運算裝置的各種配置；及第6圖說明示範裝置的各種元件，示範裝置可被實施為關於第1、2及5圖描述之各種類型的可攜式及/或運算裝置以實施本說明書中描述之雷射二極體模式技術的實施例。
100‧‧‧環境
102‧‧‧運算裝置
104‧‧‧顯示裝置
106‧‧‧輸入/輸出模組
108‧‧‧控制器
110‧‧‧自然使用者介面(NUI)輸入裝置
112‧‧‧使用者手
114‧‧‧雷射模式模組
116‧‧‧雷射二極體

Claims (17)

  1. 一種方法，至少包含以下步驟：使一運算裝置之一或更多個雷射二極體在一雷射臨界值之下操作以照亮該運算裝置之一實體周遭的至少一部分；由該運算裝置之一相機擷取該被照亮之實體周遭的一或更多個影像；由該擷取之一或更多個影像識別一或更多個輸入，以與該運算裝置所顯示之一使用者介面互動；及使該運算裝置之該一或更多個雷射二極體於該雷射臨界值之上操作，以輸出同調光以射出一圖案至該等實體周遭中。
  2. 如申請專利範圍第1項所述之方法，其中該使運算裝置之一或更多個雷射二極體在一雷射臨界值之下操作之步驟分別使該一或更多個雷射二極體作為一或更多個發光二極體。
  3. 如申請專利範圍第1項所述之方法，其中該使運算裝置之一或更多個雷射二極體在該雷射臨界值之下操作之步驟係使該一或更多個雷射二極體提供人眼不可見的光線。
  4. 如申請專利範圍第1項所述之方法，其中該使運算裝置之一或更多個雷射二極體在該雷射臨界值之下操作之步驟係使該一或更多個雷射二極體提供近紅外線光。
  5. 如申請專利範圍第1項所述之方法，其中該擷取該被照亮之實體周遭的該一或更多個影像之步驟係對無深度影像(non-depth imaging)所執行。
  6. 如申請專利範圍第1項所述之方法，其中該識別該一或更多個輸入之步驟包括識別對該運算裝置之該等實體周遭的一改變。
  7. 如申請專利範圍第1項所述之方法，其中該識別該一或更多個輸入之步驟包括識別使用一人體之一或更多個部分所作出的一姿勢。
  8. 如申請專利範圍第1項所述之方法，其中該圖案被配置以用於透過該相機所擷取之至少一影像而判定該等實體周遭中一或更多個物體的深度。
  9. 一種由一運算裝置所實施之方法，該方法至少包含以下步驟：於一自發模式中操作一或更多個雷射二極體以 使用非同調光的一適合的量來照亮該運算裝置之一實體周遭中的至少一部分，以由使用該運算裝置之一相機來識別用於與一使用者介面互動的一或更多個輸入；及在一同調模式中操作該一或更多個雷射二極體以使用同調光射出一圖案至該等實體周遭中，該圖案可用於判定該等實體周遭中該一或更多個雷射二極體與一或更多個物體之間的一距離。
  10. 如申請專利範圍第9項所述之方法，其中該自發模式使該一或更多個雷射二極體操作為一發光二極體(LED)。
  11. 如申請專利範圍第9項所述之方法，其中該自發模式使該一或更多個雷射二極體在一雷射臨界值之下操作，而該同調模式使該一或更多個雷射二極體在該雷射臨界值之上操作。
  12. 如申請專利範圍第9項所述之方法，其中在該自發模式中操作該一或更多個雷射二極體之步驟使人眼不可見之該非同調光被輸出。
  13. 一種設備，至少包含：一或更多個雷射二極體； 一相機；及一或更多個模組，該等模組可被配置以操作於：一第一模式中，使得：該一或更多個雷射二極體於一雷射臨界值之下操作以輸出該相機之一實體周遭的至少一部分；及該相機擷取該被照亮之實體周遭的一或更多個影像；及一第二模式中，使得：該一或更多個雷射二極體在一雷射臨界值上操作以輸出被配置為一圖案的同調光；及該相機擷取該等實體周遭中該同調光圖案之至少一影像以判定該等實體周遭中一或更多個物體的深度。
  14. 如申請專利範圍第13項所述之設備，其中配置該一或更多個模組以使用該第一模式中所擷取之該等被照亮實體周遭之一或更多個影像以識別一或更多個輸入為姿勢，該等姿勢可被用於與該等設備輸出以供一顯示裝置顯示之一使用者介面互動。
  15. 如申請專利範圍第13項所述之設備，其中該一或更多個雷射二極體於該第一模式中在該雷射臨界值之 下操作以輸出人眼不可見的光線。
  16. 如申請專利範圍第13項所述之設備，其中該第一模式被用於無深度影像。
  17. 如申請專利範圍第13項所述之設備，其中該等設備被形成為一遊戲主機的至少一部分，而該一或更多個模組被配置以輸出一遊戲，一使用者可藉由該一或更多個模組使用該第一及第二模式互動。
TW101108500A 2011-04-25 2012-03-13 雷射二極體模式 TWI552791B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US13/093,621 US8620113B2 (en) 2011-04-25 2011-04-25 Laser diode modes

Publications (2)

Publication Number Publication Date
TW201242644A TW201242644A (en) 2012-11-01
TWI552791B true TWI552791B (zh) 2016-10-11

Family

ID=47020912

Family Applications (1)

Application Number Title Priority Date Filing Date
TW101108500A TWI552791B (zh) 2011-04-25 2012-03-13 雷射二極體模式

Country Status (8)

Country Link
US (1) US8620113B2 (zh)
EP (1) EP2702464B1 (zh)
JP (1) JP5976787B2 (zh)
KR (1) KR102007445B1 (zh)
CN (1) CN103502910B (zh)
AR (1) AR086175A1 (zh)
TW (1) TWI552791B (zh)
WO (1) WO2012148844A2 (zh)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8760395B2 (en) 2011-05-31 2014-06-24 Microsoft Corporation Gesture recognition techniques
US8869073B2 (en) * 2011-07-28 2014-10-21 Hewlett-Packard Development Company, L.P. Hand pose interaction
US8635637B2 (en) 2011-12-02 2014-01-21 Microsoft Corporation User interface presenting an animated avatar performing a media reaction
US9100685B2 (en) 2011-12-09 2015-08-04 Microsoft Technology Licensing, Llc Determining audience state or interest using passive sensor data
US8898687B2 (en) 2012-04-04 2014-11-25 Microsoft Corporation Controlling a media program based on a media reaction
CA2775700C (en) 2012-05-04 2013-07-23 Microsoft Corporation Determining a future portion of a currently presented media program
USD767590S1 (en) * 2013-12-30 2016-09-27 Nikolai Joukov Display screen or portion thereof with graphical user interface for displaying software cells

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1379318A (zh) * 2001-04-09 2002-11-13 华邦电子股份有限公司 撷取影像和操控光标的装置
US20110013024A1 (en) * 1999-05-11 2011-01-20 Pryor Timothy R Camera based interaction and instruction

Family Cites Families (409)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4288078A (en) 1979-11-20 1981-09-08 Lugo Julio I Game apparatus
US7831204B1 (en) 1981-11-03 2010-11-09 Personalized Media Communications, Llc Signal processing apparatus and methods
JPS58225745A (ja) * 1982-06-24 1983-12-27 Fujitsu Ltd 半導体レ−ザ送信回路
US4695953A (en) 1983-08-25 1987-09-22 Blair Preston E TV animation interactively controlled by the viewer
US4630910A (en) 1984-02-16 1986-12-23 Robotic Vision Systems, Inc. Method of measuring in three-dimensions at high speed
US4627620A (en) 1984-12-26 1986-12-09 Yang John P Electronic athlete trainer for improving skills in reflex, speed and accuracy
US4645458A (en) 1985-04-15 1987-02-24 Harald Phillip Athletic evaluation and training apparatus
US4702475A (en) 1985-08-16 1987-10-27 Innovating Training Products, Inc. Sports technique and reaction training system
US4843568A (en) 1986-04-11 1989-06-27 Krueger Myron W Real time perception of and response to the actions of an unencumbered participant/user
US4711543A (en) 1986-04-14 1987-12-08 Blair Preston E TV animation interactively controlled by the viewer
US4796997A (en) 1986-05-27 1989-01-10 Synthetic Vision Systems, Inc. Method and system for high-speed, 3-D imaging of an object at a vision station
US5184295A (en) 1986-05-30 1993-02-02 Mann Ralph V System and method for teaching physical skills
US4751642A (en) 1986-08-29 1988-06-14 Silva John M Interactive sports simulation system with physiological sensing and psychological conditioning
US4809065A (en) 1986-12-01 1989-02-28 Kabushiki Kaisha Toshiba Interactive system and related method for displaying data to produce a three-dimensional image of an object
US4817950A (en) 1987-05-08 1989-04-04 Goo Paul E Video game control unit and attitude sensor
US5239464A (en) 1988-08-04 1993-08-24 Blair Preston E Interactive video system providing repeated switching of multiple tracks of actions sequences
US5239463A (en) 1988-08-04 1993-08-24 Blair Preston E Method and apparatus for player interaction with animated characters and objects
US4901362A (en) 1988-08-08 1990-02-13 Raytheon Company Method of recognizing patterns
US4893183A (en) 1988-08-11 1990-01-09 Carnegie-Mellon University Robotic vision system
US4931865A (en) 1988-08-24 1990-06-05 Sebastiano Scarampi Apparatus and methods for monitoring television viewers
JPH02199526A (ja) 1988-10-14 1990-08-07 David G Capper 制御インターフェース装置
US4925189A (en) 1989-01-13 1990-05-15 Braeunig Thomas F Body-mounted video game exercise device
US5229756A (en) 1989-02-07 1993-07-20 Yamaha Corporation Image control apparatus
US5469740A (en) 1989-07-14 1995-11-28 Impulse Technology, Inc. Interactive video testing and training system
JPH03103822U (zh) 1990-02-13 1991-10-29
US5101444A (en) 1990-05-18 1992-03-31 Panacea, Inc. Method and apparatus for high speed object location
US5148154A (en) 1990-12-04 1992-09-15 Sony Corporation Of America Multi-dimensional user interface
US5175641A (en) 1991-04-05 1992-12-29 International Business Machines Corporation Dual-mode laser diode transmitter
US5534917A (en) 1991-05-09 1996-07-09 Very Vivid, Inc. Video image based control system
US5417210A (en) 1992-05-27 1995-05-23 International Business Machines Corporation System and method for augmentation of endoscopic surgery
US5295491A (en) 1991-09-26 1994-03-22 Sam Technology, Inc. Non-invasive human neurocognitive performance capability testing method and system
US6054991A (en) 1991-12-02 2000-04-25 Texas Instruments Incorporated Method of modeling player position and movement in a virtual reality system
US5875108A (en) 1991-12-23 1999-02-23 Hoffberg; Steven M. Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
JPH07325934A (ja) 1992-07-10 1995-12-12 Walt Disney Co:The 仮想世界に向上したグラフィックスを提供する方法および装置
US5999908A (en) 1992-08-06 1999-12-07 Abelow; Daniel H. Customer-based product design module
JP3244798B2 (ja) 1992-09-08 2002-01-07 株式会社東芝 動画像処理装置
US5320538A (en) 1992-09-23 1994-06-14 Hughes Training, Inc. Interactive aircraft training system and method
IT1257294B (it) 1992-11-20 1996-01-12 Dispositivo atto a rilevare la configurazione di un'unita' fisiologicadistale,da utilizzarsi in particolare come interfaccia avanzata per macchine e calcolatori.
US5495576A (en) 1993-01-11 1996-02-27 Ritchey; Kurtis J. Panoramic image based virtual reality/telepresence audio-visual system and method
US5690582A (en) 1993-02-02 1997-11-25 Tectrix Fitness Equipment, Inc. Interactive exercise apparatus
JP2799126B2 (ja) 1993-03-26 1998-09-17 株式会社ナムコ ビデオゲーム装置及びゲーム用入力装置
US5405152A (en) 1993-06-08 1995-04-11 The Walt Disney Company Method and apparatus for an interactive video game with physical feedback
US5454043A (en) 1993-07-30 1995-09-26 Mitsubishi Electric Research Laboratories, Inc. Dynamic and static hand gesture recognition through low-level image analysis
US5423554A (en) 1993-09-24 1995-06-13 Metamedia Ventures, Inc. Virtual reality game method and apparatus
US5980256A (en) 1993-10-29 1999-11-09 Carmein; David E. E. Virtual reality system with enhanced sensory apparatus
JP3419050B2 (ja) 1993-11-19 2003-06-23 株式会社日立製作所 入力装置
US5347306A (en) 1993-12-17 1994-09-13 Mitsubishi Electric Research Laboratories, Inc. Animated electronic meeting place
JP2552427B2 (ja) 1993-12-28 1996-11-13 コナミ株式会社 テレビ遊戯システム
US5577981A (en) 1994-01-19 1996-11-26 Jarvik; Robert Virtual reality exercise machine and computer controlled video system
US5580249A (en) 1994-02-14 1996-12-03 Sarcos Group Apparatus for simulating mobility of a human
US5597309A (en) 1994-03-28 1997-01-28 Riess; Thomas Method and apparatus for treatment of gait problems associated with parkinson's disease
US5385519A (en) 1994-04-19 1995-01-31 Hsu; Chi-Hsueh Running machine
US5528263A (en) 1994-06-15 1996-06-18 Daniel M. Platzker Interactive projected video image display system
US5524637A (en) 1994-06-29 1996-06-11 Erickson; Jon W. Interactive system for measuring physiological exertion
US5563988A (en) 1994-08-01 1996-10-08 Massachusetts Institute Of Technology Method and system for facilitating wireless, full-body, real-time user interaction with a digitally represented visual environment
JPH0863326A (ja) 1994-08-22 1996-03-08 Hitachi Ltd 画像処理装置及び方法
US6714665B1 (en) 1994-09-02 2004-03-30 Sarnoff Corporation Fully automated iris recognition system utilizing wide and narrow fields of view
US5516105A (en) 1994-10-06 1996-05-14 Exergame, Inc. Acceleration activated joystick
JP3270264B2 (ja) 1994-10-19 2002-04-02 富士写真フイルム株式会社 放射線像変換パネルおよびその製造法
US5638300A (en) 1994-12-05 1997-06-10 Johnson; Lee E. Golf swing analysis system
JPH08161292A (ja) 1994-12-09 1996-06-21 Matsushita Electric Ind Co Ltd 混雑度検知方法およびそのシステム
US5594469A (en) 1995-02-21 1997-01-14 Mitsubishi Electric Information Technology Center America Inc. Hand gesture machine control system
US5682229A (en) 1995-04-14 1997-10-28 Schwartz Electro-Optics, Inc. Laser range camera
DE19516664C1 (de) 1995-05-05 1996-08-29 Siemens Ag Verfahren zum Aufbau einer Farbtabelle in einer Computereinheit zur Klassifikation von Bildpunkten in einem Bild
US5913727A (en) 1995-06-02 1999-06-22 Ahdoot; Ned Interactive movement and contact simulation game
JP3481631B2 (ja) 1995-06-07 2003-12-22 ザ トラスティース オブ コロンビア ユニヴァーシティー イン ザ シティー オブ ニューヨーク 能動型照明及びデフォーカスに起因する画像中の相対的なぼけを用いる物体の３次元形状を決定する装置及び方法
JPH11508359A (ja) 1995-06-22 1999-07-21 ３ディブイ・システムズ・リミテッド 改善された光学測距カメラ
IL114278A (en) 1995-06-22 2010-06-16 Microsoft Internat Holdings B Camera and method
US5682196A (en) 1995-06-22 1997-10-28 Actv, Inc. Three-dimensional (3D) video presentation system providing interactive 3D presentation with personalized audio responses for multiple viewers
US7895076B2 (en) 1995-06-30 2011-02-22 Sony Computer Entertainment Inc. Advertisement insertion, profiling, impression, and feedback
US5702323A (en) 1995-07-26 1997-12-30 Poulton; Craig K. Electronic exercise enhancer
JPH0981309A (ja) 1995-09-13 1997-03-28 Toshiba Corp 入力装置
US6073489A (en) 1995-11-06 2000-06-13 French; Barry J. Testing and training system for assessing the ability of a player to complete a task
US6430997B1 (en) 1995-11-06 2002-08-13 Trazer Technologies, Inc. System and method for tracking and assessing movement skills in multidimensional space
US6308565B1 (en) 1995-11-06 2001-10-30 Impulse Technology Ltd. System and method for tracking and assessing movement skills in multidimensional space
US6098458A (en) 1995-11-06 2000-08-08 Impulse Technology, Ltd. Testing and training system for assessing movement and agility skills without a confining field
US6176782B1 (en) 1997-12-22 2001-01-23 Philips Electronics North America Corp. Motion-based command generation technology
US5933125A (en) 1995-11-27 1999-08-03 Cae Electronics, Ltd. Method and apparatus for reducing instability in the display of a virtual environment
US5641288A (en) 1996-01-11 1997-06-24 Zaenglein, Jr.; William G. Shooting simulating process and training device using a virtual reality display screen
US6115482A (en) 1996-02-13 2000-09-05 Ascent Technology, Inc. Voice-output reading system with gesture-based navigation
JP2000510013A (ja) 1996-05-08 2000-08-08 リアル ヴィジョン コーポレイション 位置検出を用いたリアルタイムシミュレーション
US6173066B1 (en) 1996-05-21 2001-01-09 Cybernet Systems Corporation Pose determination and tracking by matching 3D objects to a 2D sensor
US6002808A (en) 1996-07-26 1999-12-14 Mitsubishi Electric Information Technology Center America, Inc. Hand gesture control system
US5989157A (en) 1996-08-06 1999-11-23 Walton; Charles A. Exercising system with electronic inertial game playing
CN1168057C (zh) 1996-08-14 2004-09-22 挪拉赫梅特·挪利斯拉莫维奇·拉都包夫 追踪并显示使用者在空间的位置与取向的方法,向使用者展示虚拟环境的方法以及实现这些方法的系统
JP3064928B2 (ja) 1996-09-20 2000-07-12 日本電気株式会社 被写体抽出方式
US20020120925A1 (en) 2000-03-28 2002-08-29 Logan James D. Audio and video program recording, editing and playback systems using metadata
DE69626208T2 (de) 1996-12-20 2003-11-13 Hitachi Europe Ltd., Maidenhead Verfahren und System zur Erkennung von Handgesten
US5904484A (en) 1996-12-23 1999-05-18 Burns; Dave Interactive motion training device and method
US6009210A (en) 1997-03-05 1999-12-28 Digital Equipment Corporation Hands-free interface to a virtual reality environment using head tracking
US6100896A (en) 1997-03-24 2000-08-08 Mitsubishi Electric Information Technology Center America, Inc. System for designing graphical multi-participant environments
US5877803A (en) 1997-04-07 1999-03-02 Tritech Mircoelectronics International, Ltd. 3-D image detector
US6215898B1 (en) 1997-04-15 2001-04-10 Interval Research Corporation Data processing system and method
US6075895A (en) 1997-06-20 2000-06-13 Holoplex Methods and apparatus for gesture recognition based on templates
JP3077745B2 (ja) 1997-07-31 2000-08-14 日本電気株式会社 データ処理方法および装置、情報記憶媒体
US6188777B1 (en) 1997-08-01 2001-02-13 Interval Research Corporation Method and apparatus for personnel detection and tracking
US6750848B1 (en) 1998-11-09 2004-06-15 Timothy R. Pryor More useful man machine interfaces and applications
US6720949B1 (en) 1997-08-22 2004-04-13 Timothy R. Pryor Man machine interfaces and applications
US6289112B1 (en) 1997-08-22 2001-09-11 International Business Machines Corporation System and method for determining block direction in fingerprint images
AUPO894497A0 (en) 1997-09-02 1997-09-25 Xenotech Research Pty Ltd Image processing method and apparatus
EP0905644A3 (en) 1997-09-26 2004-02-25 Matsushita Electric Industrial Co., Ltd. Hand gesture recognizing device
US6141463A (en) 1997-10-10 2000-10-31 Electric Planet Interactive Method and system for estimating jointed-figure configurations
US6072494A (en) 1997-10-15 2000-06-06 Electric Planet, Inc. Method and apparatus for real-time gesture recognition
WO1999019828A1 (en) 1997-10-15 1999-04-22 Electric Planet, Inc. Method and apparatus for performing a clean background subtraction
US6130677A (en) 1997-10-15 2000-10-10 Electric Planet, Inc. Interactive computer vision system
US6101289A (en) 1997-10-15 2000-08-08 Electric Planet, Inc. Method and apparatus for unencumbered capture of an object
WO1999019840A1 (en) 1997-10-15 1999-04-22 Electric Planet, Inc. A system and method for generating an animatable character
US6181343B1 (en) 1997-12-23 2001-01-30 Philips Electronics North America Corp. System and method for permitting three-dimensional navigation through a virtual reality environment using camera-based gesture inputs
DE59809883D1 (de) * 1997-12-23 2003-11-13 Siemens Ag Verfahren und vorrichtung zur aufnahme eines dreidimensionalen abstandsbildes
US7196720B2 (en) 1998-03-06 2007-03-27 Intel Corporation Method and apparatus for powering on an electronic device with a video camera that detects motion
US6159100A (en) 1998-04-23 2000-12-12 Smith; Michael D. Virtual reality game
US6421453B1 (en) 1998-05-15 2002-07-16 International Business Machines Corporation Apparatus and methods for user recognition employing behavioral passwords
US6181472B1 (en) * 1998-06-10 2001-01-30 Robotic Vision Systems, Inc. Method and system for imaging an object with a plurality of optical beams
US6077201A (en) 1998-06-12 2000-06-20 Cheng; Chau-Yang Exercise bicycle
US6141010A (en) 1998-07-17 2000-10-31 B. E. Technology, Llc Computer interface method and apparatus with targeted advertising
US7121946B2 (en) 1998-08-10 2006-10-17 Cybernet Systems Corporation Real-time head tracking system for computer games and other applications
US6681031B2 (en) 1998-08-10 2004-01-20 Cybernet Systems Corporation Gesture-controlled interfaces for self-service machines and other applications
US6950534B2 (en) 1998-08-10 2005-09-27 Cybernet Systems Corporation Gesture-controlled interfaces for self-service machines and other applications
US6801637B2 (en) 1999-08-10 2004-10-05 Cybernet Systems Corporation Optical body tracker
US7036094B1 (en) 1998-08-10 2006-04-25 Cybernet Systems Corporation Behavior recognition system
US20010008561A1 (en) 1999-08-10 2001-07-19 Paul George V. Real-time object tracking system
IL126284A (en) 1998-09-17 2002-12-01 Netmor Ltd System and method for three dimensional positioning and tracking
DE69936620T2 (de) 1998-09-28 2008-05-21 Matsushita Electric Industrial Co., Ltd., Kadoma Verfahren und Vorrichtung zum Segmentieren von Handgebärden
US6501515B1 (en) 1998-10-13 2002-12-31 Sony Corporation Remote control system
WO2000034919A1 (en) 1998-12-04 2000-06-15 Interval Research Corporation Background estimation and segmentation based on range and color
US6222465B1 (en) 1998-12-09 2001-04-24 Lucent Technologies Inc. Gesture-based computer interface
US6147678A (en) 1998-12-09 2000-11-14 Lucent Technologies Inc. Video hand image-three-dimensional computer interface with multiple degrees of freedom
US7134130B1 (en) 1998-12-15 2006-11-07 Gateway Inc. Apparatus and method for user-based control of television content
DE69840608D1 (de) 1998-12-16 2009-04-09 3Dv Systems Ltd Selbsttastende photoempfindliche oberfläche
US6466232B1 (en) 1998-12-18 2002-10-15 Tangis Corporation Method and system for controlling presentation of information to a user based on the user's condition
US6570555B1 (en) 1998-12-30 2003-05-27 Fuji Xerox Co., Ltd. Method and apparatus for embodied conversational characters with multimodal input/output in an interface device
US6226388B1 (en) 1999-01-05 2001-05-01 Sharp Labs Of America, Inc. Method and apparatus for object tracking for automatic controls in video devices
US6363160B1 (en) 1999-01-22 2002-03-26 Intel Corporation Interface using pattern recognition and tracking
US6377296B1 (en) 1999-01-28 2002-04-23 International Business Machines Corporation Virtual map system and method for tracking objects
US7120880B1 (en) 1999-02-25 2006-10-10 International Business Machines Corporation Method and system for real-time determination of a subject's interest level to media content
US7003134B1 (en) 1999-03-08 2006-02-21 Vulcan Patents Llc Three dimensional object pose estimation which employs dense depth information
US6299308B1 (en) 1999-04-02 2001-10-09 Cybernet Systems Corporation Low-cost non-imaging eye tracker system for computer control
DE69942663D1 (de) 1999-04-13 2010-09-23 Sony Deutschland Gmbh Zusammenfügen von Sprachschnittstellen zur gleichzeitigen Benützung von Vorrichtungen und Anwendungen
US6591236B2 (en) 1999-04-13 2003-07-08 International Business Machines Corporation Method and system for determining available and alternative speech commands
US20030141360A1 (en) 1999-04-22 2003-07-31 De Leo Stephen L. System and method for providing information and services to and from an automated teller machine
US6503195B1 (en) 1999-05-24 2003-01-07 University Of North Carolina At Chapel Hill Methods and systems for real-time structured light depth extraction and endoscope using real-time structured light depth extraction
US20070143715A1 (en) 1999-05-25 2007-06-21 Silverbrook Research Pty Ltd Method of providing information via printed substrate and gesture recognition
US6476834B1 (en) 1999-05-28 2002-11-05 International Business Machines Corporation Dynamic creation of selectable items on surfaces
US6291816B1 (en) * 1999-06-08 2001-09-18 Robotic Vision Systems, Inc. System and method for measuring object features with coordinated two and three dimensional imaging
US6873723B1 (en) 1999-06-30 2005-03-29 Intel Corporation Segmenting three-dimensional video images using stereo
US6738066B1 (en) 1999-07-30 2004-05-18 Electric Plant, Inc. System, method and article of manufacture for detecting collisions between video images generated by a camera and an object depicted on a display
US7113918B1 (en) 1999-08-01 2006-09-26 Electric Planet, Inc. Method for video enabled electronic commerce
US6514081B1 (en) 1999-08-06 2003-02-04 Jeffrey L. Mengoli Method and apparatus for automating motion analysis
US7050606B2 (en) 1999-08-10 2006-05-23 Cybernet Systems Corporation Tracking and gesture recognition system particularly suited to vehicular control applications
WO2001018563A1 (en) 1999-09-08 2001-03-15 3Dv Systems, Ltd. 3d imaging system
US6512838B1 (en) 1999-09-22 2003-01-28 Canesta, Inc. Methods for enhancing performance and data acquired from three-dimensional image systems
US7050177B2 (en) 2002-05-22 2006-05-23 Canesta, Inc. Method and apparatus for approximating depth of an object's placement onto a monitored region with applications to virtual interface devices
US7006236B2 (en) 2002-05-22 2006-02-28 Canesta, Inc. Method and apparatus for approximating depth of an object's placement onto a monitored region with applications to virtual interface devices
DE19960180B4 (de) 1999-12-14 2006-03-09 Rheinmetall W & M Gmbh Verfahren zur Herstellung eines Sprenggeschosses
US7028001B1 (en) 1999-12-27 2006-04-11 Motorola, Inc. System and method for measuring web page advertisement impressions
TW482987B (en) 2000-01-03 2002-04-11 Amova Company Automatic media editing system
US7146329B2 (en) 2000-01-13 2006-12-05 Erinmedia, Llc Privacy compliant multiple dataset correlation and content delivery system and methods
US6674877B1 (en) 2000-02-03 2004-01-06 Microsoft Corporation System and method for visually tracking occluded objects in real time
US6663491B2 (en) 2000-02-18 2003-12-16 Namco Ltd. Game apparatus, storage medium and computer program that adjust tempo of sound
US6633294B1 (en) 2000-03-09 2003-10-14 Seth Rosenthal Method and apparatus for using captured high density motion for animation
AU2001242320A1 (en) 2000-03-30 2001-10-15 Ideogramic Aps Method for gesture based modeling
US6778171B1 (en) 2000-04-05 2004-08-17 Eagle New Media Investments, Llc Real world/virtual world correlation system using 3D graphics pipeline
US6856827B2 (en) 2000-04-28 2005-02-15 Ge Medical Systems Global Technology Company, Llc Fluoroscopic tracking and visualization system
EP1152261A1 (en) 2000-04-28 2001-11-07 CSEM Centre Suisse d'Electronique et de Microtechnique SA Device and method for spatially resolved photodetection and demodulation of modulated electromagnetic waves
US6640202B1 (en) 2000-05-25 2003-10-28 International Business Machines Corporation Elastic sensor mesh system for 3-dimensional measurement, mapping and kinematics applications
IL136432A0 (en) * 2000-05-29 2001-06-14 Vkb Ltd Data input device
WO2001093182A1 (en) 2000-05-29 2001-12-06 Vkb Inc. Virtual data entry device and method for input of alphanumeric and other data
US6731799B1 (en) 2000-06-01 2004-05-04 University Of Washington Object segmentation with background extraction and moving boundary techniques
US7042442B1 (en) 2000-06-27 2006-05-09 International Business Machines Corporation Virtual invisible keyboard
US6788809B1 (en) 2000-06-30 2004-09-07 Intel Corporation System and method for gesture recognition in three dimensions using stereo imaging and color vision
US7227526B2 (en) 2000-07-24 2007-06-05 Gesturetek, Inc. Video-based image control system
US20090234718A1 (en) 2000-09-05 2009-09-17 Novell, Inc. Predictive service systems using emotion detection
JP4432246B2 (ja) 2000-09-29 2010-03-17 ソニー株式会社 観客状況判定装置、再生出力制御システム、観客状況判定方法、再生出力制御方法、記録媒体
US7058204B2 (en) 2000-10-03 2006-06-06 Gesturetek, Inc. Multiple camera control system
JP3725460B2 (ja) 2000-10-06 2005-12-14 株式会社ソニー・コンピュータエンタテインメント 画像処理装置、画像処理方法、記録媒体、コンピュータプログラム、半導体デバイス
US20030036944A1 (en) 2000-10-11 2003-02-20 Lesandrini Jay William Extensible business method with advertisement research as an example
US7039676B1 (en) 2000-10-31 2006-05-02 International Business Machines Corporation Using video image analysis to automatically transmit gestures over a network in a chat or instant messaging session
EP1341672B1 (en) * 2000-12-15 2007-07-25 E. I. du Pont de Nemours and Company Receiver element for adjusting the focus of an imaging laser
US20020144259A1 (en) 2001-03-29 2002-10-03 Philips Electronics North America Corp. Method and apparatus for controlling a media player based on user activity
US6539931B2 (en) 2001-04-16 2003-04-01 Koninklijke Philips Electronics N.V. Ball throwing assistant
US20020174445A1 (en) 2001-05-17 2002-11-21 Koninklijke Philips Electronics N.V. Video playback device with real-time on-line viewer feedback capability and method of operation
US8035612B2 (en) 2002-05-28 2011-10-11 Intellectual Ventures Holding 67 Llc Self-contained interactive video display system
US7259747B2 (en) 2001-06-05 2007-08-21 Reactrix Systems, Inc. Interactive video display system
US6594616B2 (en) 2001-06-18 2003-07-15 Microsoft Corporation System and method for providing a mobile input device
US6795972B2 (en) 2001-06-29 2004-09-21 Scientific-Atlanta, Inc. Subscriber television system user interface with a virtual reality media space
JP3420221B2 (ja) 2001-06-29 2003-06-23 株式会社コナミコンピュータエンタテインメント東京 ゲーム装置及びプログラム
US20030007018A1 (en) 2001-07-09 2003-01-09 Giovanni Seni Handwriting user interface for personal digital assistants and the like
US6868383B1 (en) 2001-07-12 2005-03-15 At&T Corp. Systems and methods for extracting meaning from multimodal inputs using finite-state devices
GB2379017A (en) 2001-07-27 2003-02-26 Hewlett Packard Co Method and apparatus for monitoring crowds
FI115419B (fi) 2001-08-20 2005-04-29 Helsingin Kauppakorkeakoulu Informaatiopalveluiden käyttäjäkohtainen personointi
US7007236B2 (en) 2001-09-14 2006-02-28 Accenture Global Services Gmbh Lab window collaboration
US6937742B2 (en) 2001-09-28 2005-08-30 Bellsouth Intellectual Property Corporation Gesture activated home appliance
US8561095B2 (en) 2001-11-13 2013-10-15 Koninklijke Philips N.V. Affective television monitoring and control in response to physiological data
US6585521B1 (en) 2001-12-21 2003-07-01 Hewlett-Packard Development Company, L.P. Video indexing based on viewers' behavior and emotion feedback
US7340077B2 (en) 2002-02-15 2008-03-04 Canesta, Inc. Gesture recognition system using depth perceptive sensors
US6730913B2 (en) 2002-02-21 2004-05-04 Ford Global Technologies, Llc Active night vision system for vehicles employing short-pulse laser illumination and a gated camera for image capture
US7310431B2 (en) 2002-04-10 2007-12-18 Canesta, Inc. Optical methods for remotely measuring objects
WO2003089277A1 (de) 2002-04-19 2003-10-30 Iee International Electronics & Engineering S.A. Sicherheitsvorrichtung für ein fahrzeug
US7710391B2 (en) 2002-05-28 2010-05-04 Matthew Bell Processing an image utilizing a spatially varying pattern
US7348963B2 (en) 2002-05-28 2008-03-25 Reactrix Systems, Inc. Interactive video display system
US7170492B2 (en) 2002-05-28 2007-01-30 Reactrix Systems, Inc. Interactive video display system
US7489812B2 (en) 2002-06-07 2009-02-10 Dynamic Digital Depth Research Pty Ltd. Conversion and encoding techniques
US20040001616A1 (en) 2002-06-27 2004-01-01 Srinivas Gutta Measurement of content ratings through vision and speech recognition
US7623115B2 (en) 2002-07-27 2009-11-24 Sony Computer Entertainment Inc. Method and apparatus for light input device
US7646372B2 (en) 2003-09-15 2010-01-12 Sony Computer Entertainment Inc. Methods and systems for enabling direction detection when interfacing with a computer program
US7883415B2 (en) 2003-09-15 2011-02-08 Sony Computer Entertainment Inc. Method and apparatus for adjusting a view of a scene being displayed according to tracked head motion
US8019121B2 (en) 2002-07-27 2011-09-13 Sony Computer Entertainment Inc. Method and system for processing intensity from input devices for interfacing with a computer program
US7627139B2 (en) 2002-07-27 2009-12-01 Sony Computer Entertainment Inc. Computer image and audio processing of intensity and input devices for interfacing with a computer program
EP1535305A2 (en) * 2002-08-16 2005-06-01 Brown University Research Foundation Scanning magnetic microscope having improved magnetic sensor
US7151530B2 (en) 2002-08-20 2006-12-19 Canesta, Inc. System and method for determining an input selected by a user through a virtual interface
WO2004027685A2 (en) 2002-09-19 2004-04-01 The Penn State Research Foundation Prosody based audio/visual co-analysis for co-verbal gesture recognition
US7002560B2 (en) 2002-10-04 2006-02-21 Human Interface Technologies Inc. Method of combining data entry of handwritten symbols with displayed character data
DE60215504T2 (de) 2002-10-07 2007-09-06 Sony France S.A. Verfahren und Gerät zur Analyse von Gesten eines Menschen, z.B. zur Steuerung einer Maschine durch Gestik
US20040113933A1 (en) 2002-10-08 2004-06-17 Northrop Grumman Corporation Split and merge behavior analysis and understanding using Hidden Markov Models
US7576727B2 (en) 2002-12-13 2009-08-18 Matthew Bell Interactive directed light/sound system
JP4235729B2 (ja) 2003-02-03 2009-03-11 国立大学法人静岡大学 距離画像センサ
US9177387B2 (en) 2003-02-11 2015-11-03 Sony Computer Entertainment Inc. Method and apparatus for real time motion capture
US7435941B2 (en) * 2003-03-14 2008-10-14 Inphase Technologies, Inc. Methods for measuring optical characteristics by differential diffractive scanning
US8745541B2 (en) 2003-03-25 2014-06-03 Microsoft Corporation Architecture for controlling a computer using hand gestures
US7665041B2 (en) 2003-03-25 2010-02-16 Microsoft Corporation Architecture for controlling a computer using hand gestures
DE602004006190T8 (de) 2003-03-31 2008-04-10 Honda Motor Co., Ltd. Vorrichtung, Verfahren und Programm zur Gestenerkennung
WO2004107266A1 (en) 2003-05-29 2004-12-09 Honda Motor Co., Ltd. Visual tracking using depth data
US8072470B2 (en) 2003-05-29 2011-12-06 Sony Computer Entertainment Inc. System and method for providing a real-time three-dimensional interactive environment
WO2005113099A2 (en) 2003-05-30 2005-12-01 America Online, Inc. Personalizing content
EP3190546A3 (en) 2003-06-12 2017-10-04 Honda Motor Co., Ltd. Target orientation estimation using depth sensing
US7214932B2 (en) * 2003-08-20 2007-05-08 Xyratex Technology Limited Resonator method and system for distinguishing characteristics of surface features or contaminants
US7170605B2 (en) * 2003-08-25 2007-01-30 Evan Francis Cromwell Active sensor and method for optical illumination and detection
CA2536371A1 (en) 2003-08-26 2005-03-10 Redshift Systems Corporation Infrared camera system
US7874917B2 (en) 2003-09-15 2011-01-25 Sony Computer Entertainment Inc. Methods and systems for enabling depth and direction detection when interfacing with a computer program
WO2005041579A2 (en) 2003-10-24 2005-05-06 Reactrix Systems, Inc. Method and system for processing captured image information in an interactive video display system
US7155305B2 (en) 2003-11-04 2006-12-26 Universal Electronics Inc. System and methods for home appliance identification and control in a networked environment
GB2410359A (en) 2004-01-23 2005-07-27 Sony Uk Ltd Display
JP3847753B2 (ja) 2004-01-30 2006-11-22 株式会社ソニー・コンピュータエンタテインメント 画像処理装置、画像処理方法、記録媒体、コンピュータプログラム、半導体デバイス
US7706616B2 (en) 2004-02-27 2010-04-27 International Business Machines Corporation System and method for recognizing word patterns in a very large vocabulary based on a virtual keyboard layout
US8949899B2 (en) 2005-03-04 2015-02-03 Sharp Laboratories Of America, Inc. Collaborative recommendation system
US7301529B2 (en) 2004-03-23 2007-11-27 Fujitsu Limited Context dependent gesture response
US20050215319A1 (en) 2004-03-23 2005-09-29 Harmonix Music Systems, Inc. Method and apparatus for controlling a three-dimensional character in a three-dimensional gaming environment
EP1582965A1 (en) 2004-04-01 2005-10-05 Sony Deutschland Gmbh Emotion controlled system for processing multimedia data
JP4092697B2 (ja) 2004-04-07 2008-05-28 ソニー株式会社 情報処理装置および方法、プログラム並びに記録媒体
US7379563B2 (en) 2004-04-15 2008-05-27 Gesturetek, Inc. Tracking bimanual movements
US7308112B2 (en) 2004-05-14 2007-12-11 Honda Motor Co., Ltd. Sign based human-machine interaction
US20050289582A1 (en) 2004-06-24 2005-12-29 Hitachi, Ltd. System and method for capturing and using biometrics to review a product, service, creative work or thing
US7178111B2 (en) 2004-08-03 2007-02-13 Microsoft Corporation Multi-planar three-dimensional user interface
US7728821B2 (en) 2004-08-06 2010-06-01 Touchtable, Inc. Touch detecting interactive display
US7704135B2 (en) 2004-08-23 2010-04-27 Harrison Jr Shelton E Integrated game system, method, and device
US7991220B2 (en) 2004-09-01 2011-08-02 Sony Computer Entertainment Inc. Augmented reality game system using identification information to display a virtual object in association with a position of a real object
US7761814B2 (en) 2004-09-13 2010-07-20 Microsoft Corporation Flick gesture
EP1803228B1 (en) 2004-10-01 2019-07-10 Samsung Electronics Co., Ltd. Device and method for displaying event in wireless terminal
EP1645944B1 (en) 2004-10-05 2012-08-15 Sony France S.A. A content-management interface
US7212665B2 (en) 2004-11-05 2007-05-01 Honda Motor Co. Human pose estimation with data driven belief propagation
US7814518B2 (en) 2004-11-23 2010-10-12 Palo Alto Research Center Incorporated Methods, apparatus, and program products for presenting replacement content instead of a portion of a recorded content
US7870589B2 (en) 2004-11-23 2011-01-11 Palo Alto Research Center Incorporated Method for providing commentary audio and additional or replacement video content
US7217020B2 (en) 2004-11-24 2007-05-15 General Motors Corporation Headlamp assembly with integrated infrared illuminator
US20060123360A1 (en) 2004-12-03 2006-06-08 Picsel Research Limited User interfaces for data processing devices and systems
JP4449723B2 (ja) 2004-12-08 2010-04-14 ソニー株式会社 画像処理装置、画像処理方法、およびプログラム
KR20060070280A (ko) 2004-12-20 2006-06-23 한국전자통신연구원 손 제스처 인식을 이용한 사용자 인터페이스 장치 및 그방법
EP1849123A2 (en) 2005-01-07 2007-10-31 GestureTek, Inc. Optical flow based tilt sensor
WO2006074310A2 (en) 2005-01-07 2006-07-13 Gesturetek, Inc. Creating 3d images of objects by illuminating with infrared patterns
US7853041B2 (en) 2005-01-07 2010-12-14 Gesturetek, Inc. Detecting and tracking objects in images
JP3862027B2 (ja) 2005-01-25 2006-12-27 船井電機株式会社 放送信号受信システム
EP1851750A4 (en) 2005-02-08 2010-08-25 Oblong Ind Inc SYSTEM AND METHOD FOR CONTROL SYSTEM BASED ON GESTURES
US8009871B2 (en) 2005-02-08 2011-08-30 Microsoft Corporation Method and system to segment depth images and to detect shapes in three-dimensionally acquired data
GB2423808B (en) 2005-03-04 2010-02-17 Ford Global Tech Llc Motor vehicle control system for controlling one or more vehicle devices
US20060218573A1 (en) 2005-03-04 2006-09-28 Stexar Corp. Television program highlight tagging
KR100688743B1 (ko) 2005-03-11 2007-03-02 삼성전기주식회사 멀티 레이어 커패시터 내장형의 인쇄회로기판의 제조방법
US7643056B2 (en) 2005-03-14 2010-01-05 Aptina Imaging Corporation Motion detecting camera system
WO2006099597A2 (en) 2005-03-17 2006-09-21 Honda Motor Co., Ltd. Pose estimation based on critical point analysis
US8147248B2 (en) 2005-03-21 2012-04-03 Microsoft Corporation Gesture training
US7468998B2 (en) * 2005-03-25 2008-12-23 Pavilion Integration Corporation Radio frequency modulation of variable degree and automatic power control using external photodiode sensor for low-noise lasers of various wavelengths
US7487461B2 (en) 2005-05-04 2009-02-03 International Business Machines Corporation System and method for issuing commands based on pen motions on a graphical keyboard
BRPI0613165A2 (pt) 2005-05-17 2010-12-21 Gesturetek Inc saìda de sinal sensìvel à orientação
US20060262116A1 (en) 2005-05-19 2006-11-23 Hillcrest Laboratories, Inc. Global navigation objects in user interfaces
DE602005010696D1 (de) 2005-08-12 2008-12-11 Mesa Imaging Ag Hochempfindliches, schnelles Pixel für Anwendung in einem Bildsensor
US20080026838A1 (en) 2005-08-22 2008-01-31 Dunstan James E Multi-player non-role-playing virtual world games: method for two-way interaction between participants and multi-player virtual world games
TW200713060A (en) 2005-09-30 2007-04-01 Primax Electronics Ltd Adaptive input method for touch screen
US7450736B2 (en) 2005-10-28 2008-11-11 Honda Motor Co., Ltd. Monocular tracking of 3D human motion with a coordinated mixture of factor analyzers
GB2431717A (en) 2005-10-31 2007-05-02 Sony Uk Ltd Scene analysis
US20070150281A1 (en) 2005-12-22 2007-06-28 Hoff Todd M Method and system for utilizing emotion to search content
US20070150916A1 (en) 2005-12-28 2007-06-28 James Begole Using sensors to provide feedback on the access of digital content
US20070214292A1 (en) 2006-02-24 2007-09-13 Gillian Hayes System and method for archiving of continuous capture buffers
US7433024B2 (en) 2006-02-27 2008-10-07 Prime Sense Ltd. Range mapping using speckle decorrelation
US20070219430A1 (en) 2006-03-17 2007-09-20 Moore Barrett H Electricity Providing Privately Provisioned Subscription-Based Survival Supply Unit Method And Apparatus
JP4484836B2 (ja) * 2006-03-24 2010-06-16 三洋電機株式会社 ビーム照射装置
US7568116B2 (en) 2006-04-14 2009-07-28 Clever Innovations, Inc. Automated display device
US8601379B2 (en) 2006-05-07 2013-12-03 Sony Computer Entertainment Inc. Methods for interactive communications with real time effects and avatar environment interaction
US20070271580A1 (en) 2006-05-16 2007-11-22 Bellsouth Intellectual Property Corporation Methods, Apparatus and Computer Program Products for Audience-Adaptive Control of Content Presentation Based on Sensed Audience Demographics
US7721207B2 (en) 2006-05-31 2010-05-18 Sony Ericsson Mobile Communications Ab Camera based control
US7640304B1 (en) 2006-06-14 2009-12-29 Yes International Ag System and method for detecting and measuring emotional indicia
US7701439B2 (en) 2006-07-13 2010-04-20 Northrop Grumman Corporation Gesture recognition simulation system and method
TW200806029A (en) 2006-07-14 2008-01-16 Asustek Comp Inc Display system and control method thereof
US20080018591A1 (en) 2006-07-20 2008-01-24 Arkady Pittel User Interfacing
US20080027984A1 (en) 2006-07-31 2008-01-31 Motorola, Inc. Method and system for multi-dimensional action capture
US8775237B2 (en) 2006-08-02 2014-07-08 Opinionlab, Inc. System and method for measuring and reporting user reactions to advertisements on a web page
US9514436B2 (en) 2006-09-05 2016-12-06 The Nielsen Company (Us), Llc Method and system for predicting audience viewing behavior
EP2063767A4 (en) 2006-09-05 2014-05-21 Innerscope Res Inc METHOD AND SYSTEM FOR DETERMINING THE RESPONSE OF A PUBLIC TO A SENSORY STIMULUS
US7725547B2 (en) 2006-09-06 2010-05-25 International Business Machines Corporation Informing a user of gestures made by others out of the user's line of sight
US8395658B2 (en) 2006-09-07 2013-03-12 Sony Computer Entertainment Inc. Touch screen-like user interface that does not require actual touching
US8287372B2 (en) 2006-09-28 2012-10-16 Mattel, Inc. Interactive toy and display system
US8310656B2 (en) 2006-09-28 2012-11-13 Sony Computer Entertainment America Llc Mapping movements of a hand-held controller to the two-dimensional image plane of a display screen
JP5395323B2 (ja) 2006-09-29 2014-01-22 ブレインビジョン株式会社 固体撮像素子
WO2008067413A2 (en) 2006-11-28 2008-06-05 Attune Interactive, Inc. Training system using an interactive prompt character
US20080134102A1 (en) 2006-12-05 2008-06-05 Sony Ericsson Mobile Communications Ab Method and system for detecting movement of an object
CN101202994B (zh) 2006-12-14 2012-10-24 北京三星通信技术研究有限公司 辅助用户健身的方法和装置
KR100720335B1 (ko) 2006-12-20 2007-05-23 최경순 접촉 위치 이동에 따라 생성되는 상대좌표값에 대응하는텍스트를 입력하는 텍스트 입력 장치 및 그 방법
US8351646B2 (en) 2006-12-21 2013-01-08 Honda Motor Co., Ltd. Human pose estimation and tracking using label assignment
KR20080058740A (ko) 2006-12-22 2008-06-26 삼성전자주식회사 디지털 방송 수신 장치 및 시간 동기화 방법
US7412077B2 (en) 2006-12-29 2008-08-12 Motorola, Inc. Apparatus and methods for head pose estimation and head gesture detection
US9311528B2 (en) 2007-01-03 2016-04-12 Apple Inc. Gesture learning
US20080163283A1 (en) 2007-01-03 2008-07-03 Angelito Perez Tan Broadband video with synchronized highlight signals
US7770136B2 (en) 2007-01-24 2010-08-03 Microsoft Corporation Gesture recognition interactive feedback
GB0703974D0 (en) 2007-03-01 2007-04-11 Sony Comp Entertainment Europe Entertainment device
US20090070798A1 (en) 2007-03-02 2009-03-12 Lee Hans C System and Method for Detecting Viewer Attention to Media Delivery Devices
US7729530B2 (en) 2007-03-03 2010-06-01 Sergey Antonov Method and apparatus for 3-D data input to a personal computer with a multimedia oriented operating system
US20080234023A1 (en) 2007-03-23 2008-09-25 Ajmal Mullahkhel Light game
US20100007801A1 (en) 2007-04-03 2010-01-14 TTE Technology, Inc System and method for toggling between system power modes based on motion detection
US20090217315A1 (en) 2008-02-26 2009-08-27 Cognovision Solutions Inc. Method and system for audience measurement and targeting media
KR20090002809A (ko) 2007-07-04 2009-01-09 삼성전자주식회사 어플리케이션에서 생성된 데이터를 ｈｄｍｉ ｃｅｃ에 따라송수신하는 방법
US7865916B2 (en) 2007-07-20 2011-01-04 James Beser Audience determination for monetizing displayable content
US8726194B2 (en) 2007-07-27 2014-05-13 Qualcomm Incorporated Item selection using enhanced control
US7852262B2 (en) 2007-08-16 2010-12-14 Cybernet Systems Corporation Wireless mobile indoor/outdoor tracking system
US8081302B2 (en) * 2007-08-17 2011-12-20 Princeton Satellite Systems, Inc. Multimode optical sensor
US9261979B2 (en) 2007-08-20 2016-02-16 Qualcomm Incorporated Gesture-based mobile interaction
KR101182286B1 (ko) 2007-09-19 2012-09-14 삼성전자주식회사 움직임을 감지하는 리모트 컨트롤러 및, 리모트 컨트롤러에의해 포인터를 제어하는 영상디스플레이장치 및 그들의제어방법
EP2042969A1 (en) 2007-09-28 2009-04-01 Alcatel Lucent Method for determining user reaction with specific content of a displayed page.
US8151292B2 (en) 2007-10-02 2012-04-03 Emsense Corporation System for remote access to media, and reaction and survey data from viewers of the media
US7970176B2 (en) 2007-10-02 2011-06-28 Omek Interactive, Inc. Method and system for gesture classification
US8776102B2 (en) 2007-10-09 2014-07-08 At&T Intellectual Property I, Lp System and method for evaluating audience reaction to a data stream
US20090106645A1 (en) 2007-10-17 2009-04-23 Thinkingcraft, Inc. Adaptive response/interpretive expression, communication distribution, and intelligent determination system and method
US8001108B2 (en) 2007-10-24 2011-08-16 The Invention Science Fund I, Llc Returning a new content based on a person's reaction to at least two instances of previously displayed content
WO2009059065A1 (en) 2007-10-30 2009-05-07 Hewlett-Packard Development Company, L.P. Interactive display system with collaborative gesture detection
US8094891B2 (en) 2007-11-01 2012-01-10 Sony Ericsson Mobile Communications Ab Generating music playlist based on facial expression
US20090221368A1 (en) 2007-11-28 2009-09-03 Ailive Inc., Method and system for creating a shared game space for a networked game
GB2455316B (en) 2007-12-04 2012-08-15 Sony Corp Image processing apparatus and method
US20090157472A1 (en) 2007-12-14 2009-06-18 Kimberly-Clark Worldwide, Inc. Personalized Retail Information Delivery Systems and Methods
WO2009086088A1 (en) 2007-12-21 2009-07-09 Honda Motor Co., Ltd. Controlled human pose estimation from depth image streams
US9165199B2 (en) 2007-12-21 2015-10-20 Honda Motor Co., Ltd. Controlled human pose estimation from depth image streams
US8149210B2 (en) 2007-12-31 2012-04-03 Microsoft International Holdings B.V. Pointing device and method
US8090030B2 (en) 2008-01-04 2012-01-03 Silicon Image, Inc. Method, apparatus and system for generating and facilitating mobile high-definition multimedia interface
US8166421B2 (en) 2008-01-14 2012-04-24 Primesense Ltd. Three-dimensional user interface
JPWO2009093461A1 (ja) 2008-01-22 2011-05-26 新世代株式会社 撮像装置、オンラインゲームシステム、操作物、入力方法、画像解析装置、画像解析方法、及び記録媒体
US20090189858A1 (en) * 2008-01-30 2009-07-30 Jeff Lev Gesture Identification Using A Structured Light Pattern
US7889073B2 (en) 2008-01-31 2011-02-15 Sony Computer Entertainment America Llc Laugh detector and system and method for tracking an emotional response to a media presentation
WO2009099296A2 (en) * 2008-02-05 2009-08-13 Lg Electronics Inc. Virtual optical input device for providing various types of interfaces and method of controlling the same
KR101365776B1 (ko) 2008-04-08 2014-02-20 엘지디스플레이 주식회사 멀티 터치 시스템 및 그 구동 방법
CN101254344B (zh) 2008-04-18 2010-06-16 李刚 场地方位与显示屏点阵按比例相对应的游戏装置和方法
GB2459707B (en) 2008-05-01 2010-08-11 Sony Computer Entertainment Inc Media recorder, audio visual entertainment system and method
US7979590B2 (en) 2008-05-27 2011-07-12 Eyran Lida Multiple sink configuration supporting HDMI-CEC
US8477139B2 (en) 2008-06-09 2013-07-02 Apple Inc. Touch screen device, method, and graphical user interface for manipulating three-dimensional virtual objects
CN201247590Y (zh) 2008-08-01 2009-05-27 鸿富锦精密工业（深圳）有限公司 可自动切换显示模式的电子相框
US20100070987A1 (en) 2008-09-12 2010-03-18 At&T Intellectual Property I, L.P. Mining viewer responses to multimedia content
US8925001B2 (en) 2008-09-12 2014-12-30 At&T Intellectual Property I, L.P. Media stream generation based on a category of user expression
US20100070913A1 (en) 2008-09-15 2010-03-18 Apple Inc. Selecting an item of content in a graphical user interface for a portable computing device
US8769427B2 (en) 2008-09-19 2014-07-01 Google Inc. Quick gesture input
US8516561B2 (en) 2008-09-29 2013-08-20 At&T Intellectual Property I, L.P. Methods and apparatus for determining user authorization from motion of a gesture-based control unit
US20100086204A1 (en) 2008-10-03 2010-04-08 Sony Ericsson Mobile Communications Ab System and method for capturing an emotional characteristic of a user
KR20100041006A (ko) 2008-10-13 2010-04-22 엘지전자 주식회사 3차원 멀티 터치를 이용한 사용자 인터페이스 제어방법
US9399167B2 (en) 2008-10-14 2016-07-26 Microsoft Technology Licensing, Llc Virtual space mapping of a variable activity region
US20100107184A1 (en) 2008-10-23 2010-04-29 Peter Rae Shintani TV with eye detection
US20100138797A1 (en) 2008-12-01 2010-06-03 Sony Ericsson Mobile Communications Ab Portable electronic device with split vision content sharing control and method
KR101531363B1 (ko) 2008-12-10 2015-07-06 삼성전자주식회사 이차원 인터랙티브 디스플레이에서 가상 객체 또는 시점을 제어하는 방법
US20100153984A1 (en) 2008-12-12 2010-06-17 Microsoft Corporation User Feedback Based Highlights of Recorded Programs
JP5156617B2 (ja) * 2008-12-26 2013-03-06 日本システムウエア株式会社 対象物検出用画像処理装置、方法、プログラム、並びに該プログラムを格納するコンピュータ可読媒体
JP4775671B2 (ja) 2008-12-26 2011-09-21 ソニー株式会社 情報処理装置および方法、並びにプログラム
US8856829B2 (en) 2008-12-29 2014-10-07 Ngc Network Us, Llc Interactive display highlight systems, methods, and computer program products
US20100248832A1 (en) 2009-03-30 2010-09-30 Microsoft Corporation Control of video game via microphone
US9172482B2 (en) 2009-03-31 2015-10-27 At&T Intellectual Property I, L.P. Content recommendations based on personal preferences
US8942428B2 (en) 2009-05-01 2015-01-27 Microsoft Corporation Isolate extraneous motions
US8660303B2 (en) 2009-05-01 2014-02-25 Microsoft Corporation Detection of body and props
KR101567603B1 (ko) 2009-05-07 2015-11-20 엘지전자 주식회사 멀티 음성 시스템의 동작 제어 장치 및 방법
US9417700B2 (en) 2009-05-21 2016-08-16 Edge3 Technologies Gesture recognition systems and related methods
US8418085B2 (en) 2009-05-29 2013-04-09 Microsoft Corporation Gesture coach
US8255955B1 (en) 2009-06-16 2012-08-28 Tivo Inc. Dynamic item highlighting system
US20100332842A1 (en) 2009-06-30 2010-12-30 Yahoo! Inc. Determining a mood of a user based on biometric characteristic(s) of the user in an online system
US8390680B2 (en) 2009-07-09 2013-03-05 Microsoft Corporation Visual representation expression based on player expression
US20110016102A1 (en) 2009-07-20 2011-01-20 Louis Hawthorne System and method for identifying and providing user-specific psychoactive content
JP5397081B2 (ja) 2009-08-12 2014-01-22 富士通モバイルコミュニケーションズ株式会社 携帯端末
US8326002B2 (en) 2009-08-13 2012-12-04 Sensory Logic, Inc. Methods of facial coding scoring for optimally identifying consumers' responses to arrive at effective, incisive, actionable conclusions
US7873849B2 (en) 2009-09-02 2011-01-18 Apple Inc. Motion sensor data processing using various power management modes
US8903867B2 (en) 2009-09-08 2014-12-02 Telecom Italia S.P.A. Method for exploring a catalog of digital information contents
US8275834B2 (en) 2009-09-14 2012-09-25 Applied Research Associates, Inc. Multi-modal, geo-tempo communications systems
US8875167B2 (en) 2009-09-21 2014-10-28 Mobitv, Inc. Implicit mechanism for determining user response to media
US20110077719A1 (en) 2009-09-30 2011-03-31 Broadcom Corporation Electromagnetic power bio-medical unit
US20110145040A1 (en) 2009-12-16 2011-06-16 Microsoft Corporation Content recommendation
US10356465B2 (en) 2010-01-06 2019-07-16 Sony Corporation Video system demonstration
JP5609160B2 (ja) 2010-02-26 2014-10-22 ソニー株式会社 情報処理システム、コンテンツ合成装置および方法、並びに記録媒体
US9124651B2 (en) 2010-03-30 2015-09-01 Microsoft Technology Licensing, Llc Controlling media consumption privacy settings
US20110263946A1 (en) 2010-04-22 2011-10-27 Mit Media Lab Method and system for real-time and offline analysis, inference, tagging of and responding to person(s) experiences
US20110264531A1 (en) 2010-04-26 2011-10-27 Yahoo! Inc. Watching a user's online world
US9009339B2 (en) 2010-06-29 2015-04-14 Echostar Technologies L.L.C. Apparatus, systems and methods for accessing and synchronizing presentation of media content and supplemental media rich content
US9247205B2 (en) 2010-08-31 2016-01-26 Fujitsu Limited System and method for editing recorded videoconference data
US8949871B2 (en) 2010-09-08 2015-02-03 Opentv, Inc. Smart media selection based on viewer user presence
US20120084812A1 (en) 2010-10-04 2012-04-05 Mark Thompson System and Method for Integrating Interactive Advertising and Metadata Into Real Time Video Content
US20120109726A1 (en) 2010-10-30 2012-05-03 Verizon Patent And Licensing, Inc. Methods and Systems for Trigger-Based Updating of an Index File Associated with a Captured Media Content Instance
US10034034B2 (en) 2011-07-06 2018-07-24 Symphony Advanced Media Mobile remote media control platform methods
JP4945675B2 (ja) 2010-11-12 2012-06-06 株式会社東芝 音響信号処理装置、テレビジョン装置及びプログラム
US20120209715A1 (en) 2011-02-11 2012-08-16 Microsoft Corporation Interaction with networked screen content via motion sensing device in retail setting
US20110145041A1 (en) 2011-02-15 2011-06-16 InnovatioNet System for communication between users and global media-communication network
US20120226981A1 (en) 2011-03-02 2012-09-06 Microsoft Corporation Controlling electronic devices in a multimedia system through a natural user interface
US10671841B2 (en) 2011-05-02 2020-06-02 Microsoft Technology Licensing, Llc Attribute state classification
US20120304059A1 (en) 2011-05-24 2012-11-29 Microsoft Corporation Interactive Build Instructions
US8760395B2 (en) 2011-05-31 2014-06-24 Microsoft Corporation Gesture recognition techniques
US8509545B2 (en) 2011-11-29 2013-08-13 Microsoft Corporation Foreground subject detection
US8635637B2 (en) 2011-12-02 2014-01-21 Microsoft Corporation User interface presenting an animated avatar performing a media reaction
US8943526B2 (en) 2011-12-02 2015-01-27 Microsoft Corporation Estimating engagement of consumers of presented content
US20130145385A1 (en) 2011-12-02 2013-06-06 Microsoft Corporation Context-based ratings and recommendations for media
US9100685B2 (en) 2011-12-09 2015-08-04 Microsoft Technology Licensing, Llc Determining audience state or interest using passive sensor data
US20130159555A1 (en) 2011-12-20 2013-06-20 Microsoft Corporation Input commands
US20130198690A1 (en) 2012-02-01 2013-08-01 Microsoft Corporation Visual indication of graphical user interface relationship
CA2775700C (en) 2012-05-04 2013-07-23 Microsoft Corporation Determining a future portion of a currently presented media program

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110013024A1 (en) * 1999-05-11 2011-01-20 Pryor Timothy R Camera based interaction and instruction
CN1379318A (zh) * 2001-04-09 2002-11-13 华邦电子股份有限公司 撷取影像和操控光标的装置

Also Published As

Publication number Publication date
JP5976787B2 (ja) 2016-08-24
WO2012148844A2 (en) 2012-11-01
US20120268362A1 (en) 2012-10-25
EP2702464B1 (en) 2017-09-06
KR102007445B1 (ko) 2019-08-05
US8620113B2 (en) 2013-12-31
CN103502910A (zh) 2014-01-08
CN103502910B (zh) 2017-03-01
WO2012148844A3 (en) 2013-02-14
TW201242644A (en) 2012-11-01
EP2702464A4 (en) 2014-09-17
JP2014513357A (ja) 2014-05-29
EP2702464A2 (en) 2014-03-05
KR20140024876A (ko) 2014-03-03
AR086175A1 (es) 2013-11-27

Similar Documents

Publication Publication Date Title
US10761612B2 (en) Gesture recognition techniques
TWI552791B (zh) 雷射二極體模式
US10960298B2 (en) Boolean/float controller and gesture recognition system
US11775074B2 (en) Apparatuses, systems, and/or interfaces for embedding selfies into or onto images captured by mobile or wearable devices and method for implementing same
CN102541256B (zh) 具有视觉反馈的位置知晓姿势作为输入方法
CN108885521A (zh) 跨环境共享
US20130044912A1 (en) Use of association of an object detected in an image to obtain information to display to a user
US20160209968A1 (en) Mapping touch inputs to a user input module
US20110304649A1 (en) Character selection
CN105900056A (zh) 辅助显示器的悬停敏感控制
JP2004246578A (ja) 自己画像表示を用いたインタフェース方法、装置、およびプログラム
US20190339864A1 (en) Information processing system, information processing method, and program
KR20200137594A (ko) 모바일 장치 및 모바일 장치의 제어 방법
Nakhate et al. Touchless Screen Technology
KR102086181B1 (ko) 제어 노출
Nunes TANTO-tangible and touch interaction combined on a surface and above
Sangani Poetry in motion [gesture-based controllers]
MACHADO Popularization of gesture interfaces
Babaei Usability improvement of skeletal-based gesture recognition for exploring virtual environments

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees