CA2720683C - Projection of images onto tangible user interfaces - Google Patents

Projection of images onto tangible user interfaces Download PDF

Info

Publication number
CA2720683C
CA2720683C CA2720683A CA2720683A CA2720683C CA 2720683 C CA2720683 C CA 2720683C CA 2720683 A CA2720683 A CA 2720683A CA 2720683 A CA2720683 A CA 2720683A CA 2720683 C CA2720683 C CA 2720683C
Authority
CA
Canada
Prior art keywords
graphical data
onto
projected
computing device
mode
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CA2720683A
Other languages
English (en)
French (fr)
Other versions
CA2720683A1 (en
Inventor
Stuart Taylor
Shahram Izadi
Daniel A. Rosenfeld
Stephen Hodges
David Alexander Butler
James Scott
Nicolas Villar
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Technology Licensing LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Technology Licensing LLC filed Critical Microsoft Technology Licensing LLC
Publication of CA2720683A1 publication Critical patent/CA2720683A1/en
Application granted granted Critical
Publication of CA2720683C publication Critical patent/CA2720683C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141—Constructional details thereof
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00—Projectors or projection-type viewers; Accessories therefor
    • G03B21/005—Projectors using an electronic spatial light modulator but not peculiar thereto
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0421—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F19/00—Advertising or display means not otherwise provided for
    • G09F19/12—Advertising or display means not otherwise provided for using special optical effects
    • G09F19/18—Advertising or display means not otherwise provided for using special optical effects involving the use of optical projection means, e.g. projection of images on clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04109—FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Marketing (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Human Computer Interaction (AREA)
  • Position Input By Displaying (AREA)
  • Projection Apparatus (AREA)
  • Overhead Projectors And Projection Screens (AREA)
  • Transforming Electric Information Into Light Information (AREA)
  • Liquid Crystal (AREA)
CA2720683A 2008-05-02 2009-03-27 Projection of images onto tangible user interfaces Expired - Fee Related CA2720683C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US12/114,421 US8042949B2 (en) 2008-05-02 2008-05-02 Projection of images onto tangible user interfaces
US12/114,421 2008-05-02
PCT/US2009/038532 WO2009134563A2 (en) 2008-05-02 2009-03-27 Projection of images onto tangible user interfaces

Publications (2)

Publication Number Publication Date
CA2720683A1 CA2720683A1 (en) 2009-11-05
CA2720683C true CA2720683C (en) 2018-05-22

Family

ID=41255659

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2720683A Expired - Fee Related CA2720683C (en) 2008-05-02 2009-03-27 Projection of images onto tangible user interfaces

Country Status (8)

Country Link
US (2) US8042949B2 (enExample)
EP (1) EP2271965A4 (enExample)
JP (1) JP5069374B2 (enExample)
CN (1) CN102016713B (enExample)
CA (1) CA2720683C (enExample)
IL (1) IL208487A (enExample)
TW (2) TWI543038B (enExample)
WO (1) WO2009134563A2 (enExample)

Families Citing this family (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090219253A1 (en) * 2008-02-29 2009-09-03 Microsoft Corporation Interactive Surface Computer with Switchable Diffuser
US8042949B2 (en) 2008-05-02 2011-10-25 Microsoft Corporation Projection of images onto tangible user interfaces
US8237666B2 (en) * 2008-10-10 2012-08-07 At&T Intellectual Property I, L.P. Augmented I/O for limited form factor user-interfaces
US8253713B2 (en) * 2008-10-23 2012-08-28 At&T Intellectual Property I, L.P. Tracking approaching or hovering objects for user-interfaces
US20110212774A1 (en) * 2008-11-14 2011-09-01 Karl Wudtke Terminal including a button and button having projected images and method
US20100207909A1 (en) * 2009-02-13 2010-08-19 Ming-Cho Wu Detection module and an optical detection device comprising the same
US8730309B2 (en) 2010-02-23 2014-05-20 Microsoft Corporation Projectors and depth cameras for deviceless augmented reality and interaction
JP2011175110A (ja) * 2010-02-24 2011-09-08 Seiko Epson Corp 画像形成装置および背面投影型表示装置
TW201205551A (en) * 2010-07-29 2012-02-01 Hon Hai Prec Ind Co Ltd Display device assembling a camera
US8682030B2 (en) 2010-09-24 2014-03-25 Microsoft Corporation Interactive display
US9597587B2 (en) 2011-06-08 2017-03-21 Microsoft Technology Licensing, Llc Locational node device
WO2013009071A2 (en) * 2011-07-11 2013-01-17 Samsung Electronics Co., Ltd. Input device
CN102520900B (zh) * 2011-12-20 2015-03-25 Tcl集团股份有限公司 一种多层显示设备及其显示控制方法
US9354748B2 (en) 2012-02-13 2016-05-31 Microsoft Technology Licensing, Llc Optical stylus interaction
US9870066B2 (en) 2012-03-02 2018-01-16 Microsoft Technology Licensing, Llc Method of manufacturing an input device
US9075566B2 (en) 2012-03-02 2015-07-07 Microsoft Technoogy Licensing, LLC Flexible hinge spine
US9158383B2 (en) 2012-03-02 2015-10-13 Microsoft Technology Licensing, Llc Force concentrator
USD679275S1 (en) 2012-05-09 2013-04-02 TransluSense, LLC Keyboard
USD671944S1 (en) 2012-05-09 2012-12-04 TransluSense, LLC Mouse
US20130300590A1 (en) 2012-05-14 2013-11-14 Paul Henry Dietz Audio Feedback
US9256089B2 (en) * 2012-06-15 2016-02-09 Microsoft Technology Licensing, Llc Object-detecting backlight unit
JP5740370B2 (ja) * 2012-09-04 2015-06-24 株式会社東芝 領域特定装置、方法、及びプログラム
JP2014078799A (ja) * 2012-10-09 2014-05-01 Toshiba Corp 画像処理装置及び画像処理方法
US9146668B2 (en) * 2013-01-31 2015-09-29 Hewlett-Packard Development Company, L.P. Graphical element placement on a display surface
US20140247263A1 (en) * 2013-03-04 2014-09-04 Microsoft Corporation Steerable display system
US9658717B2 (en) 2013-05-14 2017-05-23 Otter Products, Llc Virtual writing surface
US9229583B2 (en) 2013-05-29 2016-01-05 Otter Products, Llc Object location determination including writing pressure information of a stylus
US9170685B2 (en) * 2013-06-20 2015-10-27 Otter Products, Llc Object location determination
US9575352B2 (en) 2013-07-23 2017-02-21 3M Innovative Properties Company Addressable switchable transparent display
US9137542B2 (en) 2013-07-23 2015-09-15 3M Innovative Properties Company Audio encoding of control signals for displays
US20150084848A1 (en) * 2013-09-25 2015-03-26 Bby Solutions, Inc. Interaction between generic interaction devices and an interactive display
US9335866B2 (en) 2013-11-20 2016-05-10 Otter Products, Llc Retractable touchscreen adapter
US9653044B2 (en) 2014-02-14 2017-05-16 Microsoft Technology Licensing, Llc Interactive display system
WO2016039713A1 (en) * 2014-09-08 2016-03-17 Hewlett-Packard Development Company, L.P. Capture and projection of an object image
US10013065B2 (en) 2015-02-13 2018-07-03 Microsoft Technology Licensing, Llc Tangible three-dimensional light display
JP5943312B2 (ja) * 2015-03-06 2016-07-05 大日本印刷株式会社 表示装置
US10901548B2 (en) * 2015-04-07 2021-01-26 Omnivision Technologies, Inc. Touch screen rear projection display
CN104793814A (zh) * 2015-05-12 2015-07-22 京东方科技集团股份有限公司 一种光学式触控装置及触控显示装置
HK1215348A2 (zh) * 2015-07-03 2016-08-19 贤纳科技有限公司 显示系统
US20180246617A1 (en) * 2015-09-03 2018-08-30 Smart Technologies Ulc Transparent interactive touch system and method
US10129510B2 (en) * 2016-02-18 2018-11-13 Samsung Electronics Co., Ltd. Initiating human-machine interaction based on visual attention
US10720082B1 (en) * 2016-09-08 2020-07-21 Ctskh, Llc Device and system to teach stem lessons using hands-on learning method
US10726233B2 (en) * 2017-08-09 2020-07-28 Fingerprint Cards Ab Providing test patterns for sensor calibration
CN108227347A (zh) * 2018-02-01 2018-06-29 珠海格力电器股份有限公司 一种具有投影功能的空调室内机和空调器
US10641942B2 (en) 2018-07-16 2020-05-05 Shenzhen Guangjian Technology Co., Ltd. Light projecting method and device
US10545275B1 (en) 2018-07-16 2020-01-28 Shenzhen Guangjian Technology Co., Ltd. Light projecting method and device
US10690752B2 (en) 2018-07-16 2020-06-23 Shenzhen Guangjian Technology Co., Ltd. Light projecting method and device
US10690846B2 (en) 2018-10-24 2020-06-23 Shenzhen Guangjian Technology Co., Ltd. Light projecting method and device
US10585173B1 (en) 2019-01-15 2020-03-10 Shenzhen Guangjian Technology Co., Ltd. Systems and methods for enhanced ToF resolution
CN111323931B (zh) 2019-01-15 2023-04-14 深圳市光鉴科技有限公司 光投射系统和方法
US10585194B1 (en) * 2019-01-15 2020-03-10 Shenzhen Guangjian Technology Co., Ltd. Switchable diffuser projection systems and methods
US10564521B1 (en) 2019-01-15 2020-02-18 Shenzhen Guangjian Technology Co., Ltd. Switchable diffuser projection systems and methods
CN210168142U (zh) 2019-01-17 2020-03-20 深圳市光鉴科技有限公司 一种具有3d摄像头模组的显示装置和电子设备
CN110456602B (zh) * 2019-08-22 2021-06-18 歌尔股份有限公司 一种投影系统的投影图案校正装置、方法及系统

Family Cites Families (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0787559B2 (ja) * 1986-06-30 1995-09-20 ソニー株式会社 背面投写装置
US5235363A (en) * 1991-05-10 1993-08-10 Nview Corporation Method and apparatus for interacting with a computer generated projected image
JP3339504B2 (ja) * 1992-03-24 2002-10-28 ソニー株式会社 液晶プロジェクタ
US5422494A (en) * 1992-10-16 1995-06-06 The Scott Fetzer Company Barrier transmission apparatus
US5644369A (en) * 1995-02-24 1997-07-01 Motorola Switchable lens/diffuser
US5729242A (en) * 1996-05-08 1998-03-17 Hughes Electronics Dual PDLC-projection head-up display
US5784138A (en) * 1996-08-22 1998-07-21 Lucent Technologies Inc. Fast transition polymer dispersed liquid crystal shutter for display screen and method of manufacture therefor
US6292295B1 (en) * 1997-12-16 2001-09-18 Kuraray Co., Ltd. Rear projection screen incorporating a prism
US6052231A (en) * 1998-01-21 2000-04-18 International Business Machines Corporation Beam dividing elements permitting projection of an image with high contrast
TW418341B (en) 1999-03-01 2001-01-11 Fresnel Optics Inc An optical element screen
US6417966B1 (en) * 1999-07-07 2002-07-09 3M Innovative Properties Company Rear projection screen using internal reflection
JP2001183994A (ja) * 1999-12-27 2001-07-06 Sony Corp 画像表示装置
US6616284B2 (en) * 2000-03-06 2003-09-09 Si Diamond Technology, Inc. Displaying an image based on proximity of observer
JP3900818B2 (ja) * 2000-10-31 2007-04-04 セイコーエプソン株式会社 プロジェクタ
JP3937767B2 (ja) * 2001-02-28 2007-06-27 富士ゼロックス株式会社 光書込装置
JP2003058071A (ja) * 2001-08-16 2003-02-28 Arisawa Optic Co Ltd 遮光透明シートおよび遮光画面装置
US6755534B2 (en) * 2001-08-24 2004-06-29 Brookhaven Science Associates Prismatic optical display
US6814443B2 (en) * 2001-09-26 2004-11-09 Digital Advertising Network Inc Image projection system and its method of use
US6724529B2 (en) * 2002-04-17 2004-04-20 Howard Sinkoff Reflection-type projection screens
US20050122308A1 (en) 2002-05-28 2005-06-09 Matthew Bell Self-contained interactive video display system
US7088507B2 (en) * 2002-08-16 2006-08-08 Infocus Corporation Rear projection display
JP2004184979A (ja) * 2002-09-03 2004-07-02 Optrex Corp 画像表示装置
US6820982B1 (en) * 2003-06-19 2004-11-23 Eastman Kodak Company Method and apparatus for forming an image on a curved diffusive surface
GB0325849D0 (en) * 2003-11-05 2003-12-10 Microsharp Corp Ltd Rear projection screen,and rear projection system using the screen
US20070024822A1 (en) * 2003-11-06 2007-02-01 Cortenraad Hubertus M R Switchable transparent display
JP4340135B2 (ja) * 2003-12-04 2009-10-07 株式会社リコー 画像表示方法及び画像表示装置
WO2005069073A1 (en) 2004-01-09 2005-07-28 Koninklijke Philips Electronics N.V. Image projection apparatus
JP2005241920A (ja) * 2004-02-26 2005-09-08 Dainippon Printing Co Ltd 光拡散性スクリーン
US7394459B2 (en) * 2004-04-29 2008-07-01 Microsoft Corporation Interaction between objects and a virtual environment display
GB0412651D0 (en) * 2004-06-07 2004-07-07 Microsharp Corp Ltd Autostereoscopic rear projection screen and associated display system
JP4713583B2 (ja) * 2004-07-06 2011-06-29 ルーミン・オズ株式会社 プロジェクションスクリーン装置およびプロジェクションテレビジョンシステム
US7576725B2 (en) * 2004-10-19 2009-08-18 Microsoft Corporation Using clear-coded, see-through objects to manipulate virtual objects
JP2007017664A (ja) * 2005-07-07 2007-01-25 Seiko Epson Corp スクリーン、プロジェクタシステム、リアプロジェクタ
JP2007081864A (ja) * 2005-09-14 2007-03-29 Fuji Xerox Co Ltd 表示記録媒体システムおよび表示記録媒体
KR20070073543A (ko) * 2006-01-05 2007-07-10 최해용 고선명 박막 반사 스크린
EP2047308A4 (en) 2006-08-03 2010-11-24 Perceptive Pixel Inc MULTILAYER DISPLAY THROUGH PREVENTIVE INTERNAL TOTAL REFLECTION
US8441467B2 (en) * 2006-08-03 2013-05-14 Perceptive Pixel Inc. Multi-touch sensing display through frustrated total internal reflection
US8328368B2 (en) * 2007-04-26 2012-12-11 Accuvein Inc. Projection system
US20090219253A1 (en) * 2008-02-29 2009-09-03 Microsoft Corporation Interactive Surface Computer with Switchable Diffuser
US8042949B2 (en) 2008-05-02 2011-10-25 Microsoft Corporation Projection of images onto tangible user interfaces

Also Published As

Publication number Publication date
TWI471769B (zh) 2015-02-01
WO2009134563A2 (en) 2009-11-05
IL208487A0 (en) 2010-12-30
TW201443744A (zh) 2014-11-16
JP2011525635A (ja) 2011-09-22
IL208487A (en) 2015-03-31
US20090276734A1 (en) 2009-11-05
US20120038891A1 (en) 2012-02-16
WO2009134563A3 (en) 2009-12-23
JP5069374B2 (ja) 2012-11-07
TWI543038B (zh) 2016-07-21
EP2271965A4 (en) 2012-11-21
US8042949B2 (en) 2011-10-25
TW200947285A (en) 2009-11-16
EP2271965A2 (en) 2011-01-12
CN102016713B (zh) 2012-11-07
US8272743B2 (en) 2012-09-25
CA2720683A1 (en) 2009-11-05
CN102016713A (zh) 2011-04-13

Similar Documents

Publication Publication Date Title
CA2720683C (en) Projection of images onto tangible user interfaces
Izadi et al. Going beyond the display: a surface technology with an electronically switchable diffuser
JP5693972B2 (ja) 切替え可能なディフューザを備える対話型サーフェイスコンピュータ
Hirsch et al. BiDi screen: a thin, depth-sensing LCD for 3D interaction using light fields
KR101247095B1 (ko) 인터랙티브 디스플레이 조명 및 개체 검출 방법과 인터랙티브 디스플레이 시스템
CN102693046B (zh) 互动显示设备中的悬停检测
US8502816B2 (en) Tabletop display providing multiple views to users
US9454265B2 (en) Integration of a light collection light-guide with a field sequential color display
US20150084994A1 (en) Touch-enabled field-sequential color (fsc) display using a light guide with light turning features
JP6327062B2 (ja) 表示装置
CN114175138A (zh) 带子显示器相机的全屏显示器
CN116457719A (zh) 空间悬浮影像显示装置
CN116530099A (zh) 空间悬浮影像显示装置
WO2023112463A1 (ja) 空間浮遊映像情報表示システム
CN116783644A (zh) 空间悬浮影像显示装置
WO2023085069A1 (ja) 空中浮遊映像表示装置
WO2022270384A1 (ja) 空中浮遊映像表示システム

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20140326

MKLA Lapsed

Effective date: 20200831