WO2008156453A1 - Pointeur laser pour affichage interactif - Google Patents

Pointeur laser pour affichage interactif Download PDF

Info

Publication number
WO2008156453A1
WO2008156453A1 PCT/US2007/014463 US2007014463W WO2008156453A1 WO 2008156453 A1 WO2008156453 A1 WO 2008156453A1 US 2007014463 W US2007014463 W US 2007014463W WO 2008156453 A1 WO2008156453 A1 WO 2008156453A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
radio frequency
devices
infrared
projection
Prior art date
Application number
PCT/US2007/014463
Other languages
English (en)
Inventor
Mark Alan Schultz
Original Assignee
Thomson Licensing
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing filed Critical Thomson Licensing
Priority to PCT/US2007/014463 priority Critical patent/WO2008156453A1/fr
Publication of WO2008156453A1 publication Critical patent/WO2008156453A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545—Pens or stylus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0386—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry for light pen

Definitions

  • the invention relates generally to projection displays and, in particular interactive projection displays.
  • Projection systems such as rear projection displays as well as segmented display systems typically include many of the components required to make an interactive display. In particular, their screen sizes make them useful for such applications as interactive displays for presentations and graphics.
  • the challenges encountered in trying to make such systems in existing displays are the feedback systems as well as the way in which the customer interacts with the display.
  • the feedback system refers to the way in which the projection system monitors interactions with a user.
  • the present invention is directed to an interactive projection display system.
  • the interactive projection display system incorporates a feedback arrangement for monitoring user interactions with the display.
  • the feedback arrangement may include one or more feedback devices that are used to obtain an image of a display screen which then may be interacted with by a user.
  • the one or more feedback devices that are used to obtain the image of the screen may include, for example, a camera or either an infrared (IR) or radio frequency (RF) receiver positioned within the projection display system. Additionally, the user may interact with the screen of the display system using a hand held pointing device.
  • the hand held pointing device transmits laser light and at least one of an infrared (IR) signal and a radio frequency (RF) signal. The laser light transmission is used to address a first mode.
  • the infrared (IR) signal or the radio frequency (RF) signal is used to address a second mode.
  • FIG. 1 illustrates a top view of an interactive projection display system, in accordance with the present invention
  • FIG. 2 illustrates a front view of the interactive projection display system shown in FIG. 1;
  • FIG. 3 illustrates user interaction with the projection display shown in FIG. 2;
  • FIG. 4 illustrates multiple users interacting with the projection display shown in FIG. 2;
  • FIG. 5 illustrates another embodiment showing multiple users interacting with the projection display shown in FIG. 2
  • FIG. 6 depicts a side view of the interactive projection display system shown in FIG. 1 ;
  • FIG. 7 is a flow chart showing user interaction commands for interacting with interactive projection display system of the present invention.
  • FIGS. 8A-8B depict front and side views of a hand held pointing device for providing user interaction commands to the interactive projection display of the present invention.
  • the present invention is directed to an interactive projection display system.
  • the interactive projection display system incorporates a feedback arrangement for monitoring user interactions with the display.
  • the feedback arrangement may include one or more feedback devices that are used to obtain an image of a display screen which then may be interacted with by a user.
  • the interactive projection display system may be a segmented display system in which the display devices are arranged, for example, in a N x 1 array, as shown in FIG. 1.
  • the present invention will be discussed primarily with reference to a segmented display system.
  • the interactive projection display system of the present invention may be incorporated into a rear projection display having a single display screen (not shown).
  • FIG. 1 there is shown a top view of an segmented interactive display system 100 of the present invention including a plurality of projection devices 110A, 110B, 110C, 110D that each project a portion of an image on a corresponding one of the display devices 111 A, 111 B, 111 C, 111D in the N x 1 array.
  • the display devices 111 A, 111B, 111 C, 111D may be screens on which the image is projected.
  • FIG. 6 is a side view of the segmented interactive display system of the present invention.
  • Each projection device 110 interacts with a lamp 120 (FIG. 1), one or more feedback devices 130 and a mirror 125.
  • the lamp 120 projects that portion of the image to be projected onto the mirror 125 and than to the corresponding one of the display devices 111 A, 111 B, 111 C, 111D in the N x 1 array.
  • the mirror 125 is typically placed in a frame that is positioned at an angle of about 45 degrees relative to the lamp 120 and the display devices 111 A, 111 B, 111 C, 111 D. Positioning the mirror at about 45 degrees with respect to the lamp 120 permits the projection system to have a more compact cabinet with a narrower width.
  • One or more feedback devices 130 may be positioned between the mirrors 125 (FIG. 1), within one or more of the projection devices 110A, 110B, 110C, 110D or in a CPU 140 (FIG. 6) coupled to one or more of the projection devices 110A, 110B, 110C, 110D.
  • suitable feedback devices include a camera, an infrared (IR) receiver and a radio frequency (RF) receiver, among others.
  • a camera 130A is positioned adjacent to an exit pupil of DLP projection device 110C (FIG. 1).
  • An IR receiver or and RF receiver may also be coupled to either of the projection devices 110A, 110B, 110C, 110D or the CPU 140, or both.
  • the camera 130A is used to obtain an image of one or more of the display devices 111 C, 111 D.
  • a camera 110B is positioned adjacent to an exit pupil of DLP projection device 111 B (FIG. 1 ).
  • the camera 13OB is used to obtain an image of one ore more display devices 111 A, 111 B. As such, the resolution of the camera does not need to be too high to still be effective.
  • the camera in its simplest form can be a low resolution camera with a filter that matches the wavelength of the laser pointer, such as a monochrome camera with a narrow band filter and a single frequency laser pointer.
  • a monochrome camera with a narrow band filter and a single frequency laser pointer This has the advantage that the laser pointer intensity is high with respect to the normal camera image and the gain of the camera image can be turned up high to respond only to an on/off state or the off/low/high states. This may have a few exceptions if multicolor laser pointers are used or other light sources are used. Multicolor laser pointers would need a system that is much more versatile in the responses to a wide band filter to include all of the laser pointer frequencies as well as a color camera. A more sensitive system could be accomplished with multiple monochrome cameras using very selective optical filters on each monochrome camera.
  • the multicolor system could also process a single color camera image by looking at the RGB components (FIG. 7, step 300) of the processing algorithm discussed below, to help determine which laser pointer color or which user(s) is(are) active.
  • the intensity of the laser pointers is also a factor in the sensitivity of the system where the brighter the laser pointer, the easier it is to distinguish the laser pointer from the video on the screen.
  • the responses for each multicolor laser pointer would also have to be characterized and optimized to the optics and processing for the specific application.
  • the camera output can be provided directly to the chassis for processing.
  • the camera input may be externally processed.
  • a DLP display typically includes all the functionality required to process the video from the camera.
  • an external processor may be desired.
  • the display system 100 may use the images from the cameras 130A,
  • the camera is very useful on segmented displays to help analyze seams, alignment and video color brightness characteristics between screens.
  • the display system 100 may interact with these images.
  • the cameras 130A, 130B may provide feedback from a person 135 holding a laser pointer 145 (FIG. 2).
  • the cameras 130A, 130B having an appropriate wavelength filter may be used to detect the wavelength of the laser pointer 145 as well as its intensity to track its movement across the display devices 111 A, 111 B, 111 C, 111 D.
  • the intensity of the laser may also be used to provide graphics onto the displayed images.
  • the intensity of the laser light from the laser pointer 145 is at a first intensity in its normal state, i.e., when a button 170 (FIGS. 8A-8B) on the laser pointer is not depressed.
  • the first intensity may be increased to a second intensity that is higher than the first intensity.
  • An IR receiver or and RF receiver may be coupled to the buttons 170 on the laser pointer so as to transmit an IR or RF signal toward the display devices 111 A, 111 B, 111C 1 111 D.
  • the IR or RF receiver in the display system receives these signals and the CPU 140 processes them.
  • the difference in magnitude of the laser light between the first intensity and the second intensity may be used to indicate to a user that a laser pointer 145 is active and positioned at a particular location on the screen.
  • the hand held pointing device includes three modes; a positioning mode, a command mode and an off mode.
  • the hand held pointing device transmits either a dim light or a brighter light intensity onto the display devices 111A 1 111 B, 111C, 111D to obtain an initial position on the display before a command button is pressed.
  • a three position button may be used in which the button is not pushed when off, softly pushed with a dim laser light transmission, and pushed all the way for a bright light transmission along with IR or RF transmission.
  • An IR receiver or and RF receiver may be coupled to the buttons 170 on the laser pointer so as to transmit an IR or RF command signal toward the display devices 111 A, 111 B, 111 C, 111 D.
  • the IR or RF receiver in the display system receives these signals and the CPU 140 processes them to add or remove graphics and text onto portions of the display devices 111 A, 111B, 111C, 111D.
  • the cameras 130A 1 130B may apply appropriate light selective filters to the image to detect the wavelength of the laser light as described in step 200. For example, a red filter may be applied to detect a ruby laser.
  • the camera tracks the light laser light movement across the display devices 111 A, 111 B, 111C 1 111D based on movement made by a user 135 holding the laser pointer 145 (FIG. 3).
  • a plurality of commands may be performed on portions of the display devices 111 A, 111B, 111 C, 111D.
  • the commands performed by buttons 170 may include, for example, color 179, width 178, select 180, zoom in 177, center 181, zoom out 176, erase 182 and power 175, among others.
  • the cameras continually 130A, 130B monitor if any of the buttons 170 are depressed. If the cameras detect that a command button is depressed the display system 100 in conjunction with the CPU 140 and IR or RF inputs, as described below, applies a graphics overlay on the display devices 111A, 111B, 111C, 111D following the laser light movement thereon, as described in step 215. The graphics of a particular command button 170 are added to the image or an image is then modified based on the command as in step 220.
  • step 225 once the camera detects that the button 170 is released, the graphics are updated to remove the command strokes or execute an end of a command algorithm as describe in step 230.
  • Special functions such as, for example the erase button 182, may define an area that moves on the screen about a center point which is used to clear the existing lines or video content within that area.
  • the laser pointer may also include an infrared (IR) light emitting diode (LED) 170 (FIGS. 8A-8B).
  • IR infrared
  • LED light emitting diode
  • the IR LED 170 may be used in conjunction with the laser light output, cameras 130A, 130B and CPU 140 to get user identification information, execute functions and attributes (FIG. 7).
  • the IR or RF receivers may apply appropriate light selective filters to look for laser pointer identification information (ID), as described in steps 300- 310.
  • ID laser pointer identification information
  • a plurality of functions and attributes may be performed on portions of the display devices 111A, 111B, 111C, 111 D.
  • the CPU 140 and IR or RF determines whether a graphics overlay is needed to help a user select attributes on the display devices 111 A, 111 B, 111C, 111 D.
  • a pop-up menu is provided so a user can toggle through desired selections, as outlined in step 330.
  • attributes may include, color selection, line width control and position indications, among others. These attributes may be applied to the graphics overlay as part of step 215 described above. While the above described embodiment has been discussed with respect to one user. More than one user may interact with the display system 100. Additionally, teleconferencing can take advantage of this system by allowing a speaker to use a laser pointer and have the highlighted portions added directly to the distributed video without requiring a mouse. Normally, the mouse is very limited in its abilities versus the juxtaposed laser pointers.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

L'invention concerne un système interactif d'affichage par projection. Ce système comprend un ensemble de rétroaction permettant de contrôler les interactions utilisateur avec l'affichage. L'ensemble de rétroaction peut inclure un ou plusieurs dispositifs de rétroaction utilisés pour obtenir une image d'écran d'affichage avec laquelle l'utilisateur peut interagir. Le ou les dispositifs de rétroaction utilisés à cet effet peuvent inclure, par exemple, une caméra ou un récepteur à infrarouges (IR) ou à radiofréquence (RF) disposé à l'intérieur du système d'affichage par projection. L'utilisateur peut par ailleurs interagir avec l'écran ou le système d'affichage au moyen d'un dispositif de pointage à tenue manuelle. Ce dispositif de pointage à tenue manuelle transmet une lumière laser et au moins un signal infrarouge (IR) ou de radiofréquence (RF). La transmission de lumière laser s'utilise dans un premier mode, le signal à infrarouges (IR) ou à radiofréquence (FR) pour un second mode.
PCT/US2007/014463 2007-06-20 2007-06-20 Pointeur laser pour affichage interactif WO2008156453A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/US2007/014463 WO2008156453A1 (fr) 2007-06-20 2007-06-20 Pointeur laser pour affichage interactif

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2007/014463 WO2008156453A1 (fr) 2007-06-20 2007-06-20 Pointeur laser pour affichage interactif

Publications (1)

Publication Number Publication Date
WO2008156453A1 true WO2008156453A1 (fr) 2008-12-24

Family

ID=39032100

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2007/014463 WO2008156453A1 (fr) 2007-06-20 2007-06-20 Pointeur laser pour affichage interactif

Country Status (1)

Country Link
WO (1) WO2008156453A1 (fr)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2256926A1 (fr) * 2009-05-29 2010-12-01 LG Electronics Inc. Dispositif de pointage multimodal et procédé de fonctionnement d'un dispositif de pointage multimodal
CN102096527A (zh) * 2010-12-18 2011-06-15 何晓 室内无线音视频全息交互式背投一体机及实现方法
CN103207706A (zh) * 2012-01-13 2013-07-17 南京先能光电科技有限公司 双光笔电子白板系统及笔区别方法
US8704958B2 (en) 2009-06-01 2014-04-22 Lg Electronics Inc. Image display device and operation method thereof
CN104020897A (zh) * 2014-05-23 2014-09-03 神画科技（深圳）有限公司 一种互动显示系统
CN105653025A (zh) * 2015-12-22 2016-06-08 联想(北京)有限公司 一种信息处理方法和电子设备
CN106547410A (zh) * 2016-11-24 2017-03-29 南京仁光电子科技有限公司 一种基于同一屏幕的多层操作的系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0515015A2 (fr) * 1991-05-10 1992-11-25 nVIEW CORPORATION Méthode et appareil interagissant avec une image de projection générée par ordinateur
WO1997041502A1 (fr) * 1996-04-27 1997-11-06 Philips Electronics N.V. Determination de la position d'un pointeur laser dans un systeme d'affichage d'images
US5793361A (en) * 1994-06-09 1998-08-11 Corporation For National Research Initiatives Unconstrained pointing interface for natural human interaction with a display-based computer system
US5914783A (en) * 1997-03-24 1999-06-22 Mistubishi Electric Information Technology Center America, Inc. Method and apparatus for detecting the location of a light source

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0515015A2 (fr) * 1991-05-10 1992-11-25 nVIEW CORPORATION Méthode et appareil interagissant avec une image de projection générée par ordinateur
US5793361A (en) * 1994-06-09 1998-08-11 Corporation For National Research Initiatives Unconstrained pointing interface for natural human interaction with a display-based computer system
WO1997041502A1 (fr) * 1996-04-27 1997-11-06 Philips Electronics N.V. Determination de la position d'un pointeur laser dans un systeme d'affichage d'images
US5914783A (en) * 1997-03-24 1999-06-22 Mistubishi Electric Information Technology Center America, Inc. Method and apparatus for detecting the location of a light source

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2256926A1 (fr) * 2009-05-29 2010-12-01 LG Electronics Inc. Dispositif de pointage multimodal et procédé de fonctionnement d'un dispositif de pointage multimodal
EP2453575A3 (fr) * 2009-05-29 2012-08-15 LG Electronics Inc. Dispositif de pointage multimodal et procédé de fonctionnement d'un dispositif de pointage multimodal
US9467119B2 (en) 2009-05-29 2016-10-11 Lg Electronics Inc. Multi-mode pointing device and method for operating a multi-mode pointing device
US8704958B2 (en) 2009-06-01 2014-04-22 Lg Electronics Inc. Image display device and operation method thereof
CN102096527A (zh) * 2010-12-18 2011-06-15 何晓 室内无线音视频全息交互式背投一体机及实现方法
CN103207706A (zh) * 2012-01-13 2013-07-17 南京先能光电科技有限公司 双光笔电子白板系统及笔区别方法
CN104020897A (zh) * 2014-05-23 2014-09-03 神画科技（深圳）有限公司 一种互动显示系统
CN104020897B (zh) * 2014-05-23 2017-01-25 神画科技（深圳）有限公司 一种互动显示系统
CN105653025A (zh) * 2015-12-22 2016-06-08 联想(北京)有限公司 一种信息处理方法和电子设备
CN106547410A (zh) * 2016-11-24 2017-03-29 南京仁光电子科技有限公司 一种基于同一屏幕的多层操作的系统
CN106547410B (zh) * 2016-11-24 2019-03-12 南京仁光电子科技有限公司 一种基于同一屏幕的多层操作的系统

Similar Documents

Publication Publication Date Title
EP0839347B1 (fr) Determination de la position d'un pointeur laser dans un systeme d'affichage d'images
US5115230A (en) Light-pen system for projected images
US8508472B1 (en) Wearable remote control with a single control button
US5914783A (en) Method and apparatus for detecting the location of a light source
WO2008156453A1 (fr) Pointeur laser pour affichage interactif
US6050690A (en) Apparatus and method for focusing a projected image
US7703926B2 (en) Projector capable of capturing images and briefing system having the same
US7862179B2 (en) Dual-mode projection apparatus and method for locating a light spot in a projected image
JPH08161114A (ja) 空間光変調器ディスプレイ指示装置
US20040169639A1 (en) Visible pointer tracking with separately detectable pointer tracking signal
US20110001701A1 (en) Projection apparatus
JP2007525699A (ja) カラーレーザの投射ディスプレイ
JPH1185395A (ja) ポインティング機能付き液晶プロジェクタ装置
JPH0895157A (ja) 表示装置
US9753558B2 (en) Pointing system and method
CN106851234A (zh) 投影仪以及投影仪的控制方法
US20160301900A1 (en) Touch screen rear projection display
JPH0980372A (ja) 投写型表示装置
US8184211B2 (en) Quasi analog knob control method and appartus using the same
TW201533475A (zh) 投影系統及其投影方法
US20060284832A1 (en) Method and apparatus for locating a laser spot
JP2000330201A (ja) 投写型画像表示装置
US20100073578A1 (en) Image display device and position detecting method
JP3278350B2 (ja) 投影表示装置
US20120268371A1 (en) Image Projection Device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07796324

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07796324

Country of ref document: EP

Kind code of ref document: A1