US20110298589A1 - Identification of devices on touch-sensitive surface - Google Patents
Identification of devices on touch-sensitive surface Download PDFInfo
- Publication number
- US20110298589A1 US20110298589A1 US13/212,663 US201113212663A US2011298589A1 US 20110298589 A1 US20110298589 A1 US 20110298589A1 US 201113212663 A US201113212663 A US 201113212663A US 2011298589 A1 US2011298589 A1 US 2011298589A1
- Authority
- US
- United States
- Prior art keywords
- data storage
- display device
- interactive display
- communications channel
- storage device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000013500 data storage Methods 0.000 claims abstract description 132
- 238000004891 communication Methods 0.000 claims abstract description 98
- 230000002452 interceptive effect Effects 0.000 claims description 129
- 238000000034 method Methods 0.000 claims description 47
- 238000012790 confirmation Methods 0.000 claims description 8
- 230000003287 optical effect Effects 0.000 description 55
- 230000007246 mechanism Effects 0.000 description 17
- 230000008569 process Effects 0.000 description 17
- 238000005516 engineering process Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 238000012546 transfer Methods 0.000 description 8
- 230000004044 response Effects 0.000 description 5
- 238000001514 detection method Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000001413 cellular effect Effects 0.000 description 3
- 239000003086 colorant Substances 0.000 description 3
- 239000011521 glass Substances 0.000 description 3
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 229920001690 polydopamine Polymers 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000004313 glare Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0421—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
Definitions
- Some mobile devices such as cellular phones, may be equipped to send photographs and other such data to other devices over a cellular network.
- per transaction costs may be high for sending such data.
- each transaction may involve multiple user steps.
- the generally small sizes of mobile device displays may limit the number of persons who can view the data on the receiving device, and therefore may reduce user satisfaction with the sharing experience.
- some mobile data storage devices equipped with wireless communications technologies such as Bluetooth (IEEE 802.15.1) and WiFi (IEEE 802.11x) may be configured to allow the sharing of data with other similarly-equipped devices.
- sharing content via such technology also may involve many user steps to connect to and transfer content between devices. Eliminating steps to improve the user experience may pose problems where more than one data storage device is detected within communication range, as it may be difficult for each device to identify which device of the detected devices data is to be transferred to or from without user input steps.
- a data storage device detected on a touch-sensitive surface of a display device is identified by detecting the data storage device on a wireless communications channel, and then confirming that the data storage device detected on the wireless communications channel is the data storage device detected on the surface of the display device by communicating with the data storage device over a second communications channel. This may allow the display device to identify the data storage device from among multiple data storage devices detected on the wireless communications channel, and thereby to receive data only from the identified data storage device.
- FIG. 1 shows an embodiment of an interactive display device according to the present disclosure.
- FIG. 2 shows a process flow of an embodiment of a method for identifying a data storage device placed on the surface of an interactive display device.
- FIG. 3 shows a schematic diagram of another embodiment of an interactive display device.
- FIG. 4 shows a schematic diagram of yet another embodiment of an interactive display device.
- FIG. 5 shows a process flow of another embodiment of a method for identifying a data storage device placed on the surface of an interactive display device.
- FIG. 6 shows a block diagram of an embodiment of a radiofrequency identification (RFID) tag comprising a secondary communications device.
- RFID radiofrequency identification
- FIG. 7 shows a block diagram of an alternative embodiment of an RFID tag comprising a secondary communications device.
- FIG. 8 shows a schematic depiction of another embodiment of an RFID tag comprising an optical emitter and a plurality of other optically readable elements.
- FIG. 9 shows a block diagram of an embodiment of a software architecture of a mobile data storage device.
- FIG. 10 shows a process flow of another embodiment of a method for identifying a data storage device placed on the surface of an interactive display device.
- FIG. 1 shows an embodiment of an interactive display device 100 configured to receive data from a mobile data storage device and to display the data to a plurality of users.
- Data that may be shared via interactive display device 100 may include, but is not limited to, photographic data, video data, music and other audio data, graphical data, documents, spreadsheets, presentations, and any other suitable type of data.
- Interactive display device 100 may also be configured to allow various operations to be performed on displayed data, including but not limited to editing, sending via email, uploading to other mobile data storage devices, printing, ordering printed copies over a network, etc.
- Interactive display device 100 may be configured to receive data from and/or to transfer data to any suitable type of mobile data storage device.
- mobile data storage devices include, but are not limited to, mobile computing devices such as laptop computers, hand-held devices, cellular phones, portable media players, personal digital assistants, cameras, video cameras, and other microprocessor-based or microcontroller-based programmable consumer electronics and/or appliances.
- computing device may include any device that electronically executes one or more programs
- data storage device may include any device with a computer-readable storage medium capable of storing computer-readable data and/or other content.
- Programs may be implemented on such devices, for example, via computer-executable instructions or code, such as programs, stored on a computer-readable storage medium and executed by the computing device.
- programs include routines, objects, components, data structures, and the like that perform particular tasks or implement particular abstract data types.
- program as used herein may connote a single program or multiple programs acting in concert, and may be used to denote applications, services, or any other type or class of program.
- Interactive display device 100 may also be configured to receive data from devices other than computing devices, including but not limited to data storage devices such as flash drives, etc. having communications capabilities.
- the depicted interactive display device 100 comprises a horizontal table-like top surface having a touch-sensitive display screen 102 .
- a user may transfer data to interactive display device 100 from a suitably enabled mobile data storage device 104 simply by placing mobile data storage device 104 on touch-sensitive display screen 102 .
- Interactive display device 100 detects the presence and location of mobile data storage device 104 on touch-sensitive display screen 102 , connects to mobile data storage device 104 via a wireless communications channel 106 , receives data from mobile data storage device 104 over the wireless communications channel, and displays the data on touch-sensitive display screen 102 .
- the data then may be viewed, and in some embodiments, manipulated, via touch-sensitive display screen 102 by a group of persons seated around interactive display device 100 .
- photographs and other data stored on mobile data storage device 104 may be shared by a group of users in a simple and intuitive manner.
- interactive display device 100 may include a display having any other suitable orientation, including but not limited to vertical and diagonal orientations.
- more than one mobile data storage device may be placed on touch-sensitive display screen 102 , as shown in FIG. 1 at 104 ′ Likewise, at times, one or more mobile data storage devices 108 may be detected on wireless communications channel 106 but not located on touch-sensitive display screen 102 .
- interactive display device 100 may be configured to distinguish mobile data storage devices 104 , 104 ′ that are placed on touch-sensitive display screen 102 from devices 108 not placed on touch-sensitive display screen 102 .
- Interactive display device 100 may also be configured to identify the specific locations on touch-sensitive display screen 102 at which each mobile data storage device 104 , 104 ′ is placed. This may allow interactive display device 100 to display data received from each device 104 , 104 ′ in a location associated with the transferor device, and also not to download and/or display data from devices 108 that are detected on wireless communication channel 106 but not placed on touch-sensitive surface 102 .
- FIG. 2 shows a process flow depicting an embodiment of a method 200 for identifying one or more data storage device(s) 104 placed on touch-sensitive display screen 102 .
- Method 200 first includes detecting, at 202 , a presence and location of a mobile data storage device 104 on touch-sensitive display screen 102 , and detecting, at 204 , the mobile data storage device 104 on a wireless communications channel 106 .
- mobile data storage device 104 may be detected on the wireless network before being placed on touch-sensitive display screen.
- interactive display device 100 may be configured to detect devices on wireless network 106 only when an object is detected on touch-sensitive display screen 102 .
- method 200 includes confirming, at 206 , that the mobile data storage device 104 detected on the wireless communications channel 106 is the data storage device 104 detected on the surface of the display device by communicating with the data storage device over a second communications channel. Once interactive display device 100 has confirmed that the data storage device detected on the wireless communications channel is the data storage device 104 detected on the touch-sensitive display, data may be transferred from mobile data storage device 104 to the interactive display device 100 for display on display surface 102 .
- touch-sensitive display screen 102 may include an electrically sensitive touch sensitive mechanism (for example, a capacitive or resistive mechanism) capable of locating an object placed on touch-sensitive display screen 102 .
- interactive display device 100 may include an image capture device configured to capture an image of touch-sensitive display screen 102 to detect infrared or visible light reflected from objects placed on touch-sensitive display screen 102 .
- motion of an object on touch-sensitive screen 102 may be detected by capturing images of touch-sensitive display screen 102 at a suitably high sample rate, for example, between 20 and 100 Hz, to track object motion on screen 102 .
- a suitably high sample rate for example, between 20 and 100 Hz
- the presence of mobile data storage device 104 on the wireless communications channel 106 may be detected in any suitable manner.
- interactive display device 100 may send an intermittent and/or periodic beacon over wireless communications channel 106 to alert mobile data storage devices within range of its presence, and devices receiving the beacon may connect to interactive display device 100 in response to the beacon.
- interactive display device 100 may send a beacon over wireless communications channel 106 only when an object is detected on touch-sensitive surface 102 .
- display 102 (as well as other electronic systems) may remain dormant until activity is detected by the wireless communications channel or the touch-screen interface. This may allow interactive display device 100 to assume a deeper power-save mode during periods of inactivity, such as during the night.
- interactive display device 100 may be configured to communicate with and receive data from mobile data storage device 104 via any suitable wireless communications technology.
- suitable wireless communications technology examples include, but are not limited to, radiofrequency technologies such as 802.11x technologies, Bluetooth technologies, active or passive radiofrequency identification (RFID) technologies, etc.
- interactive display device 100 may confirm at 206 the identification of the mobile data storage device 104 via communication with mobile data storage device 104 over any suitable second communications channel.
- Suitable channels include those channels that are sensitive to a position of mobile data storage device 104 on touch-sensitive display screen 102 . Specific examples include, but are not limited to, optical and electromagnetic second communications channels such as the touch sensitive mechanism of touch-sensitive display screen 102 .
- the electrical touch-sensing mechanism may be used to detect a modulated electrical signal emitted by mobile data storage device 104 .
- the image capture device may also be used as a second communications channel to receive an optical communication signal from mobile data storage device 104 .
- FIG. 3 shows a schematic depiction of an embodiment of an interactive display device 300 utilizing an optical touch sensing mechanism.
- Interactive display device 300 comprises a projection display system having an image source 302 , optionally one or more mirrors 304 for increasing an optical path length and image size of the projection display, and a display screen 306 onto which images are projected.
- Image source 302 includes an optical or light source 308 such as the depicted lamp, an LED array, or other suitable light source.
- Image source 302 also includes an image-producing element 310 such as the depicted LCD (liquid crystal display), an LCOS (liquid crystal on silicon) display, a DLP (digital light processing) display, or any other suitable image-producing element.
- Display screen 306 includes a clear, transparent portion 312 , such as sheet of glass, and a diffuser screen layer 314 disposed on top of the clear, transparent portion 312 .
- an additional transparent layer may be disposed over diffuser screen layer 314 to provide a smooth look and feel to the display surface.
- interactive display device 300 further includes an electronic controller 316 comprising memory 318 and a microprocessor 320 .
- controller 316 may include a wireless transmitter and receiver 322 configured to conduct two-way communication with mobile data storage devices.
- Wireless transmitter and receiver 322 may be configured to conduct wireless communications with mobile data storage device in any suitable manner, including but not limited to via 802.11x, Bluetooth, RFID or other radiofrequency communications technologies. While shown as part of controller 316 , it will be appreciated that wireless transmitter and receiver 322 may also be provided as a separate device in electrical communication with controller 316 .
- interactive display device 300 includes an image capture device 324 configured to capture an image of the entire backside of display screen 306 , and to provide the image to electronic controller 316 for the detection of objects appearing in the image.
- Diffuser screen layer 314 helps to avoid the imaging of objects that are not in contact with or positioned within a few millimeters of display screen 306 , and therefore helps to ensure that only objects that are touching display screen 306 are detected by image capture device 324 .
- Image capture device 324 may include any suitable image sensing mechanism. Examples of suitable image sensing mechanisms include but are not limited to CCD and CMOS image sensors. Further, the image sensing mechanisms may capture images of display screen 306 at a sufficient frequency to detect motion of an object across display screen 306 . Display screen 306 may alternatively or further include an optional capacitive, resistive or other electromagnetic touch-sensing mechanism, as illustrated by dashed-line connection 325 of screen 306 with controller 316 .
- Image capture device 324 may be configured to detect reflected or emitted energy of any suitable wavelength, including but not limited to infrared and visible wavelengths. To assist in detecting objects placed on display screen 306 , image capture device 324 may further include an additional optical source or emitter such as one or more light emitting diodes (LEDs) 326 configured to produce infrared or visible light. Light from LEDs 326 may be reflected by objects placed on display screen 306 and then detected by image capture device 324 . The use of infrared LEDs as opposed to visible LEDs may help to avoid washing out the appearance of projected images on display screen 306 .
- LEDs light emitting diodes
- LEDs 326 may be positioned at any suitable location within interactive display device 300 .
- a plurality of LEDs 326 are placed along a side of display screen 306 . In this location, light from the LEDs can travel through display screen 306 via internal reflection, while some can escape from display screen 306 for reflection by an object on the display screen 306 .
- one or more LEDs may be placed beneath display screen 306 so as to pass emitted light through display screen 306 .
- FIG. 3 also depicts a mobile data storage device 330 that has been placed on display screen 306 .
- Mobile data storage device 330 includes a wireless transmitter and receiver 332 configured to communicate with wireless transmitter and receiver 322 on interactive display device 300 , and also includes an electrical and/or optical emitter 334 configured to emit an electrical and/or optical signal that is detectable by display screen 306 and/or image capture device 324 .
- mobile data storage device 330 comprises an optical detector, as described in more detail below.
- FIG. 4 shows a schematic depiction of another embodiment of an interactive display device 400 that utilizes an optical touch sensing mechanism.
- Interactive display device 400 comprises a projection display system having a wide angle image source 402 and a display screen 406 onto which images are projected.
- Image source 402 includes a light source 408 and an image-producing element 410 .
- Display screen 406 includes a transparent glass structure 412 and a diffuser screen layer 414 disposed thereon.
- interactive display device 400 includes an electronic controller 416 comprising memory 418 and a microprocessor 420 . Further, interactive display device 400 includes a wireless transmitter and receiver 422 configured to conduct two-way communication with mobile data storage devices, such as device 430 via wireless transmitter and receiver 432 on device 430 .
- Interactive display device further includes a plurality of image capture devices, depicted as 424 a - 424 e , and an optical emitter such as an LED array 426 configured to illuminate a backside of display screen 406 with infrared or visible light.
- Image capture devices 424 a - e are each configured to capture an image of a portion of display screen 406 and provide the image to controller 416 , and to assemble a composite image of the entire display screen 406 from the images.
- image capture devices 424 a - d are positioned generally beneath the corners of display screen 406
- image capture device 424 e is positioned in a location such that it does not pick up glare from LED array 426 reflected by display screen 406 that may be picked up by image capture devices 424 a - d .
- images from image capture devices 424 a - e may be combined by controller 416 to produce a complete, glare-free image of the backside of display screen 406 .
- This allows detection of an object such as a mobile data storage device 430 placed on display screen 406 .
- Display screen 406 may alternatively or further include an optional capacitive, resistive or other electromagnetic touch-sensing mechanism, as illustrated by dashed-line connection 425 of screen 406 with controller 416 .
- image capture devices 324 and 424 a - e may act as a second communications channel between mobile data storage devices and interactive display device 300 .
- Either of these mechanisms may be capable of communicating with the depicted interactive display devices 300 and 400 in a manner that expresses the position of the devices on the display screen. This enables the interactive display devices 300 and 400 to conduct a locating communication session with a mobile data storage device in which the mobile data storage device sends or receives a specific message across the second communications channel in response to a specific request for that message sent by the interactive display device across the wireless communications channel.
- FIG. 5 shows a process flow depicting another embodiment of a method 500 for identifying one or more data storage device placed on touch-sensitive display screen of an interactive display device. While described herein in the context of interactive display device 400 , it will be appreciated that method 500 may be performed by any of the embodiments disclosed herein, including devices 100 and 300 , 400 , and/or by any other suitable device.
- Method 500 first includes detecting, at 502 , an object placed on display screen 406 , and detecting, at 504 , a data storage device on a wireless communications channel via wireless communications transmitter and receiver 422 .
- interactive display device 400 sends, at 506 , a request over the wireless communications channel to the data storage device for the data storage device to send a locating message over the second communications channel.
- interactive display device 400 receives, at 508 , the locating message.
- interactive display device 400 determines, at 510 , the identity of a data storage device on the surface of the display screen 406 based on receipt of the locating message. Data may then be downloaded from the data storage device for display on display screen 406 .
- the locating message sent by the data storage device over the second communications channel may take any suitable form.
- the data storage device includes an infrared emitter. Upon receipt of a request to send a locating message, the data storage device emits infrared light via the infrared light emitter. The emitted infrared light may be received by image capture devices 424 a - e and detected in the images from image capture devices 424 a - e by controller 416 .
- the data storage device includes a second electromagnetic modulator. Upon receipt of a request to send a locating message, the data storage device emits a modulated electromagnetic signal, which may be detected by a suitable detection mechanism associated with display screen 406 .
- Method 500 may also be used to locate and identify a plurality of mobile data storage devices placed on display screen 406 .
- interactive display device 400 may determine which mobile data storage device is located at which position on touch-sensitive display screen by requesting each mobile data storage device to send a locating message that is distinguishable from the locating message sent by the other data storage devices.
- the mobile data storage device may be requested to send a locating message at different times.
- each mobile data storage device may be asked to send a different locating message, for example, a different number or pattern of emitted signals. In this manner, each mobile data storage device that is detected on interactive display device 400 may be distinguished from other mobile data storage devices located on interactive display device 400 , as well as mobile data storage devices that are within wireless detection range but are not located on interactive display device 400 .
- image capture device 424 a - e may acquire images of display screen 406 at a sufficient frequency to allow the motion of objections on display screen 406 to be tracked. Therefore, once a mobile data storage device has been identified and located on display screen 406 , movements of the device on display screen 406 may be tracked, thereby allowing the device to be moved without having to repeat the identification process. If the mobile data storage device is not successfully tracked or is lifted from display screen 406 during movement, the locating process may be again performed to identify and locate the device on display screen 406 .
- interactive display device 400 may be configured to periodically and/or continuously renew device identifications, or to renew identifications whenever a device is moved.
- the wireless and second communications mechanisms described above may be implemented in any suitable manner on mobile data storage devices.
- Some mobile data storage devices may be manufactured with suitable communications mechanisms build into the devices.
- wireless technologies such as 802.11x and Bluetooth are integrated into many portable data storage devices, including but not limited to cell phones, PDAs, and cameras.
- many portable data storage devices also include infrared data ports. Therefore, such devices may be configured, via software or hardware for example, to conduct a locating communication with interactive display device 400 using standard included equipment.
- some devices may not include standard equipment that may be used for communicating over the wireless and second communications channels. Therefore, a simple communications tag may be attached to or incorporated into these devices to enable these devices to be located on and identified by interactive display device 400 .
- FIG. 6 shows a block diagram of an embodiment of an identification tag system 600 that may be attached to or incorporated into an object to allow the object to be identified by interactive display device 400 .
- Tag system 600 comprises an RFID tag 602 with a microcontroller 603 , memory 604 on which a unique identifier is stored, an RF modulator 605 , an RF antenna 606 , and a second modulation device 608 configured to emit a modulated electromagnetic or optical signal.
- Tag system 600 may be read by an RFID interrogator incorporated into wireless transmitter and receiver 422 of interactive display device 400 to transfer a unique identification of the mobile data storage device to interactive display device 400 .
- microcontroller 603 may be configured to cause second modulation device 608 to emit an optical, electrical or electromagnetic locating signal so that interactive display device 400 can locate and identify the device with tag system 600 on touch-sensitive display screen 406 .
- tag system 600 may support a large number of unique identification numbers via RFID capabilities (including 128-bit identification numbers), while second modulation device may allow a specific tagged device to be located on display screen 406 .
- tag system 600 is electronically passive and acquires all operating power from an interrogating RF field.
- tag system 600 is electronically active in that it includes a power supply. Where tag system 600 is an active tag, it may include an on-board power supply (i.e. on the tag itself), or may be connected to a power supply on the device on which tag system 600 is included.
- microcontroller 603 may be configured to receive a request from interactive display device 400 to send the modulating signal, and then may direct second modulation device 608 to emit the signal upon receipt of the request.
- microcontroller 603 may be configured to alert interactive display device 400 , via the RF identification channel, that it will send a specific locating message via second modulator 608 , and then may send the locating message after sending the alert. In either case, the locating operation is performed by two-way communication via the wireless communications channel and one-way communication from tag system 600 to interactive display device 400 via the second communications channel.
- tag system 600 may include both an optical or electrical emitter and an optical or electrical receiver.
- tag system 600 and interactive display device 400 may conduct a two-way locating communication in which each device both sends and receives a locating signal.
- Various embodiments of mobile devices with optical receivers are described in more detail below.
- tag system 600 may be used to transfer more information to interactive display device 400 than a unique identification number.
- tag system 600 may be configured to transfer data such as photographic data, video data, etc. for display on interactive display device 400 via the RFID communications channel.
- tag system 600 may have applicability beyond identifying a mobile data storage device on touch-sensitive display screen 400 .
- tag system 600 may be placed on any desired object to allow interactive display device to identify and interact with that object.
- tag system 600 may be included on a card issued to and linked specifically to a guest at a resort, amusement park, or other such entertainment facility. While the user is at the entertainment facility, photographs may be taken of the guest performing various activities, such as riding rides, participating in sports activities, etc., and may be displayed at a kiosk to the user for selection after the activity has included.
- a roller coaster may include a camera configured to photograph all of the riders as the roller coaster cars pass by the camera.
- a rider may view the photographs at a kiosk, scan the card to alert the kiosk of the identity of the person making the selection, and then select photographs in which the rider and/or the rider's friends and/or family appear. Then, at a later time and/or different location, for example, in a hotel lobby, or in a coffee house or restaurant affiliated with the resort, the rider may place the card on the surface of an interactive display device 400 .
- the device may determine the identity of the holder of the card by receiving the unique ID of the card holder via RFID tag 602 , query a database to determine those photos previously selected by the rider, and then download those photos for display on display screen 406 .
- interactive display device 400 may determine where each detected card is located on display screen 406 via second modulator 608 , and then display the downloaded photos in locations and orientations based upon the location of the cards on the table.
- tag system 600 may be used to allow interactive display device 400 to uniquely identify any other suitable object, such as drinks, glasses or plates placed on display screen 406 for enabling drink or food ordering through touch-sensitive display screen 400 , etc.
- other indication indicia may be included on tag system 600 (or elsewhere on an object) to allow an orientation of an object to be determined.
- FIG. 7 shows a schematic depiction of a tag system 700 having a second modulator 708 , and a plurality of other optical indicators 710 .
- the relative locations of the signal from second modulator 708 and the detected positions of other optical indicators 710 may be detected by interactive display device 400 .
- the orientation of the object may then be determined by comparing the positions of second modulator 708 and other optical indicators 710 to a database containing information on the location of optical indicators on tags.
- Optical indicators 710 may also serve to identify the device on which tag system 700 is located as one including a second optical or electrical communications channel. This allows the display device to ignore objects that do not possess such a communications channel. Further, optical indicators 710 also may be used to locate the secondary communications channel on large and/or complex devices, so the display surface does not have to know the location of the secondary communications channel for all present and future devices. Additionally, optical indicators 710 can act as a visual cue to a user in that the optical indicators may indicate to the user which surface of the object, such as a surface having a camera lens, should be placed in contact with the display surface.
- optical indicators 710 may simplify the tracking of devices moved on the display surface. For example, once the identity of a device has been determined and associated with the optical indicators 710 located on that device, the device may be identified at any location on the display surface simply by reading optical indicators 710 . Further, changes in the orientation of tag system 700 may be detected by tracking the changes in the positions of optical indicators 710 and/or second modulator 708 . This may allow the rotation of an object including tag system 600 on display screen 406 to be used as an input to interactive display device 400 . Such an input could be used, for example, to trigger a change in a displayed image, to cause a scrolling menu displayed on touch-sensitive display screen to scroll, or to trigger any other desired functionality in interactive display device 400 .
- optical indicators 710 may take the form of a barcode.
- optical indicators 710 may comprise optically reflecting or absorbing shapes such as circles, triangles, rectangles, etc. Different sizes and/or arrangements of shapes may be used to identify various objects.
- more than one second modulator 708 may be provided, thereby allowing tag orientation and/or object orientation to be determined via the signals from the plurality of second modulators.
- optical indicators 710 may provide sufficient bit depth to be able to uniquely identify objects within a selected environment, and may thereby be able to represent both an identity and a location of an object placed on interactive display device 400 . This may allow for the unique identification of an object via an optically reflective passive tag, without the use of any RFID or optical emitters located on the tag. For example, upon reading such an optically reflective passive tag, interactive display device 400 may query a database containing records linking each unique optical tag pattern to a specific device and/or device owner to determine the device and/or owner linked to that specific tag. In this manner, interactive display device 400 may uniquely identify a device detected on display screen 406 from the passive tag alone, without any optical or electrical signal emitted by the tag.
- FIG. 8 shows a block diagram of another embodiment of an identification tag system 800 configured to receive a locating signal sent by interactive display device 400 .
- Tag system 800 comprises an RFID tag 802 with a microcontroller 803 , memory 804 on which a unique identifier is stored, an RF modulator 805 , an RF antenna 806 , and an optical detector 808 configured to detect an optical signal emitted by interactive display device 400 .
- tag system 800 may be a passive device powered by an interrogating field, or may be an active device with an on-board power supply.
- optical detector 808 may be configured to receive any suitable optical signal from interactive display device 400 .
- optical detector 808 may comprise a simple color-sensitive or light-sensitive detector.
- interactive display device 400 may be configured to display a selected color on display screen 406 in a location adjacent to tag system 800 , to request tag system 800 to acquire an optical data sample from optical detector 808 , and then to send the optical data sample to interactive display device 400 via RFID tag 802 and antenna 806 (or via another wireless communications channel).
- Interactive display device 400 may then compare the optical sample to the color displayed on display screen 406 to determine the presence and location of tag system 800 on display screen 406 .
- interactive display device 400 may modulate a color or shades of color displayed on display screen 406 , and receive an optical sample of the modulated color from tag system 800 .
- Some mobile data storage devices may include an optical detector built into the device.
- many cell phones and PDAs include cameras configured to capture photographic images and/or video segments. Therefore, such a device may include programming that allows the devices to connect wirelessly to interactive display device 400 , and to receive a locating communication from interactive display device 400 via the use of the on-board camera as a second communications channel.
- FIG. 9 shows a block software architecture diagram 900 of an example mobile data storage device, such as a cell phone.
- Software architecture 900 includes an operating system 902 , device drivers 904 which allow the operating system to interact with the hardware components of the mobile device, and applications 906 which interact with operating system 902 via application programming interfaces 908 .
- software architecture 900 includes a sharing service 910 that allows the mobile data storage device to transfer data to and/or from interactive display device 400 .
- Sharing service 910 also may be configured to communicate with interactive display device 400 via a camera or other optical detector on the mobile data storage device.
- FIG. 10 shows a process flow of an embodiment of a method 1100 for identifying a mobile data storage device 1000 detected on a wireless network 1002 and placed on the surface of an interactive display device 400 via a camera 1004 provided on mobile data storage device 1000 .
- Processes performed by interactive display device applications 1006 are shown in a left-most portion of FIG. 10 ; communications between interactive display device applications 1006 and sharing service via wireless network 1002 are shown in a left-center portion of FIG. 10 ; processes performed by sharing service 910 running on device 1000 are shown in a right-center portion of FIG. 10 ; and processes performed by camera 1004 are shown in a right-most portion of FIG. 10 .
- Method 1100 begins at 1102 with the interactive display device application 1006 finding all mobile data storage devices enabled to share data with interactive display device 400 .
- Application 1006 may find these devices by periodically sending a beacon over wireless network 1002 , or by sending a beacon over wireless network 1002 when an object is detected on interactive display device 400 .
- sharing service 910 is enabled on a mobile device detecting the beacon
- the mobile device returns a message to display application at 1106 alerting the display application of its presence.
- Processes 1102 - 1106 are performed for each mobile data storage device that receives the beacon and that has its sharing service enabled.
- interactive display device may display a unique color or image beneath the object, as indicated at 1108 .
- display application 1006 may direct each mobile data storage device detected on wireless network 1002 to send a locating message by capturing an image and sending a message related to the captured image to the display application 1006 .
- sharing service 910 on each mobile data storage device directs camera 1004 on that device to collect an optical sample by taking a picture, as indicated at 1112 .
- camera 1004 then takes the picture and returns the picture to sharing service 910 .
- sharing service 910 may perform some processing of the optical sample or may acquire data from the optical sample, such as an average of the colors in the image, as shown at 1116 .
- sharing service 910 sends the image, data acquired from the image, or another such locating message related to the image, back to display application 1006 over wireless network 1002 , as shown at 1118 .
- display application 1006 can then match the image (or data acquired from the image) to the image that was displayed under the detected object to determine which, if any, of the mobile data storage devices detected on wireless network 1002 corresponds to the detected object.
- method 1100 may also be used to identify and locate each mobile data storage device that is placed on interactive device and distinguish those devices from other objects detected on interactive display device 400 .
- interactive display device 400 may display a timed sequence of colors under the detected object, rather than a single color.
- interactive display device 400 may be configured to modulate the output from LEDs 326 and/or 426 , and mobile data storage device 1000 may detect the modulated LED output with camera 1004 .
- display application 1006 may use different techniques for choosing and displaying the color beneath the device to determine if a color works best for a selected device.
- sharing service 910 may be configured to process the image acquired by camera 1004 to facilitate the identification of the color displayed beneath it. For example, such processing may include, but is not limited to, ignoring blown highlights, ignoring areas with no color, or clamping the color values to a specific set of colors.
- sharing service 910 may be configured to return an error message or no response if camera 1004 is unable to see a uniform enough color.
- a user may be provided with the option of disabling the secondary communications channel to prevent unauthorized or unintentional communication with the interactive display device. This may provide a user with more control over whether content from the user's device is downloaded to the interactive display device.
- the above-described embodiments utilize automatic location and identification processes to create a smooth user experience, it will be appreciated that either a portable data storage device and/or an interactive display device may be configured to require acknowledgement and/or confirmation from a user before initiating a transfer of data to the interactive display device.
- a portable data storage device with a passive tag may be configured to transmit a “confirm” signal to the display device over a radio frequency communications channel.
- This “confirm” signal may be generated in response to a specific device action by the user (i.e. pressing a specific button) in response to a prompt by the display device (i.e. “Press confirm to transmit your pictures”).
- a specific device action by the user i.e. pressing a specific button
- a prompt by the display device i.e. “Press confirm to transmit your pictures”.
- data from a user's device would be transferred to the interactive display device only upon specific authorization by the user.
- a portable data storage device may include more than one secondary communications device.
- a device may include a passive optically readable tag, an active optical or electromagnetic secondary communications channel, and/or an on-board camera.
- routines or methods described herein may represent one or more of any number of processing strategies such as event-driven, interrupt-driven, multi-tasking, multi-threading, and the like. As such, various acts illustrated may be performed in the sequence illustrated, in parallel, or in some cases omitted. Likewise, the order of any of the above-described processes is not necessarily required to achieve the features and/or results of the exemplary embodiments described herein, but is provided for ease of illustration and description.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The identification of a data storage device detected on a touch-sensitive display surface of a display device is described. In one embodiment, the presence and location of the data storage device is detected on the display surface and the data storage device is detected on a wireless communications channel. It is then confirmed that the data storage device detected on the wireless communications channel is the data storage device detected on the surface of the display device by communicating with the data storage device over a second communications channel.
Description
- This application is a continuation of U.S. patent application Ser. No. 11/708,400, filed Feb. 20, 2007 and titled “Identification of Devices on Touch-Sensitive Surface,” the entire disclosure of which is hereby incorporated by reference.
- The sharing of photographic and other data stored on mobile data storage devices, such as cell phones, cameras, personal digital assistants, etc., currently poses various difficulties. For example, currently a mobile device user may share such data by first transferring the data to a computer and then sharing the data by email, by uploading to a network server, etc. However, such sharing processes may take many user steps, and may be difficult to perform while a user is away from a home computer, for example, when on vacation, while at a restaurant, etc. Therefore, in these settings, photos are often shared by passing the mobile data storage device from person to person to view the photos on the device display. Due to the small size of such displays, it may be difficult for more than one or two people to simultaneously view a photograph.
- Some mobile devices, such as cellular phones, may be equipped to send photographs and other such data to other devices over a cellular network. However, per transaction costs may be high for sending such data. Additionally, each transaction may involve multiple user steps. Further, the generally small sizes of mobile device displays may limit the number of persons who can view the data on the receiving device, and therefore may reduce user satisfaction with the sharing experience.
- Likewise, some mobile data storage devices equipped with wireless communications technologies such as Bluetooth (IEEE 802.15.1) and WiFi (IEEE 802.11x) may be configured to allow the sharing of data with other similarly-equipped devices. However, sharing content via such technology also may involve many user steps to connect to and transfer content between devices. Eliminating steps to improve the user experience may pose problems where more than one data storage device is detected within communication range, as it may be difficult for each device to identify which device of the detected devices data is to be transferred to or from without user input steps.
- Accordingly, the automatic identification of a data storage device by a touch-sensitive interactive display device, to which data in the data storage device may be transferred for display to a plurality of users, is described below in the Detailed Description. For example, in one embodiment, a data storage device detected on a touch-sensitive surface of a display device is identified by detecting the data storage device on a wireless communications channel, and then confirming that the data storage device detected on the wireless communications channel is the data storage device detected on the surface of the display device by communicating with the data storage device over a second communications channel. This may allow the display device to identify the data storage device from among multiple data storage devices detected on the wireless communications channel, and thereby to receive data only from the identified data storage device.
- This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Furthermore, the claimed subject matter is not limited to implementations that solve any or all disadvantages noted in any part of this disclosure.
-
FIG. 1 shows an embodiment of an interactive display device according to the present disclosure. -
FIG. 2 shows a process flow of an embodiment of a method for identifying a data storage device placed on the surface of an interactive display device. -
FIG. 3 shows a schematic diagram of another embodiment of an interactive display device. -
FIG. 4 shows a schematic diagram of yet another embodiment of an interactive display device. -
FIG. 5 shows a process flow of another embodiment of a method for identifying a data storage device placed on the surface of an interactive display device. -
FIG. 6 shows a block diagram of an embodiment of a radiofrequency identification (RFID) tag comprising a secondary communications device. -
FIG. 7 shows a block diagram of an alternative embodiment of an RFID tag comprising a secondary communications device. -
FIG. 8 shows a schematic depiction of another embodiment of an RFID tag comprising an optical emitter and a plurality of other optically readable elements. -
FIG. 9 shows a block diagram of an embodiment of a software architecture of a mobile data storage device. -
FIG. 10 shows a process flow of another embodiment of a method for identifying a data storage device placed on the surface of an interactive display device. -
FIG. 1 shows an embodiment of aninteractive display device 100 configured to receive data from a mobile data storage device and to display the data to a plurality of users. Data that may be shared viainteractive display device 100 may include, but is not limited to, photographic data, video data, music and other audio data, graphical data, documents, spreadsheets, presentations, and any other suitable type of data.Interactive display device 100 may also be configured to allow various operations to be performed on displayed data, including but not limited to editing, sending via email, uploading to other mobile data storage devices, printing, ordering printed copies over a network, etc. -
Interactive display device 100 may be configured to receive data from and/or to transfer data to any suitable type of mobile data storage device. Examples of such mobile data storage devices include, but are not limited to, mobile computing devices such as laptop computers, hand-held devices, cellular phones, portable media players, personal digital assistants, cameras, video cameras, and other microprocessor-based or microcontroller-based programmable consumer electronics and/or appliances. As used herein, the term “computing device” may include any device that electronically executes one or more programs, and “data storage device” may include any device with a computer-readable storage medium capable of storing computer-readable data and/or other content. The embodiments described herein may be implemented on such devices, for example, via computer-executable instructions or code, such as programs, stored on a computer-readable storage medium and executed by the computing device. Generally, programs include routines, objects, components, data structures, and the like that perform particular tasks or implement particular abstract data types. The term “program” as used herein may connote a single program or multiple programs acting in concert, and may be used to denote applications, services, or any other type or class of program.Interactive display device 100 may also be configured to receive data from devices other than computing devices, including but not limited to data storage devices such as flash drives, etc. having communications capabilities. - Turning again to
FIG. 1 , the depictedinteractive display device 100 comprises a horizontal table-like top surface having a touch-sensitive display screen 102. As described in more detail below, a user may transfer data tointeractive display device 100 from a suitably enabled mobiledata storage device 104 simply by placing mobiledata storage device 104 on touch-sensitive display screen 102.Interactive display device 100 detects the presence and location of mobiledata storage device 104 on touch-sensitive display screen 102, connects to mobiledata storage device 104 via awireless communications channel 106, receives data from mobiledata storage device 104 over the wireless communications channel, and displays the data on touch-sensitive display screen 102. The data then may be viewed, and in some embodiments, manipulated, via touch-sensitive display screen 102 by a group of persons seated aroundinteractive display device 100. In this manner, photographs and other data stored on mobiledata storage device 104 may be shared by a group of users in a simple and intuitive manner. While described herein in the context of an interactive display device having a horizontal, table-like display surface, it will be appreciated thatinteractive display device 100 may include a display having any other suitable orientation, including but not limited to vertical and diagonal orientations. - At times, more than one mobile data storage device may be placed on touch-
sensitive display screen 102, as shown inFIG. 1 at 104′ Likewise, at times, one or more mobiledata storage devices 108 may be detected onwireless communications channel 106 but not located on touch-sensitive display screen 102. In order forinteractive display device 100 to determine the identities of those data storage devices from which to receive data as well as the appropriate location and orientation oninteractive display device 100 to display the data,interactive display device 100 may be configured to distinguish mobiledata storage devices sensitive display screen 102 fromdevices 108 not placed on touch-sensitive display screen 102.Interactive display device 100 may also be configured to identify the specific locations on touch-sensitive display screen 102 at which each mobiledata storage device interactive display device 100 to display data received from eachdevice devices 108 that are detected onwireless communication channel 106 but not placed on touch-sensitive surface 102. -
FIG. 2 shows a process flow depicting an embodiment of amethod 200 for identifying one or more data storage device(s) 104 placed on touch-sensitive display screen 102.Method 200 first includes detecting, at 202, a presence and location of a mobiledata storage device 104 on touch-sensitive display screen 102, and detecting, at 204, the mobiledata storage device 104 on awireless communications channel 106. In some embodiments, mobiledata storage device 104 may be detected on the wireless network before being placed on touch-sensitive display screen. In other embodiments,interactive display device 100 may be configured to detect devices onwireless network 106 only when an object is detected on touch-sensitive display screen 102. - Next,
method 200 includes confirming, at 206, that the mobiledata storage device 104 detected on thewireless communications channel 106 is thedata storage device 104 detected on the surface of the display device by communicating with the data storage device over a second communications channel. Onceinteractive display device 100 has confirmed that the data storage device detected on the wireless communications channel is thedata storage device 104 detected on the touch-sensitive display, data may be transferred from mobiledata storage device 104 to theinteractive display device 100 for display ondisplay surface 102. - The presence and location of mobile
data storage device 104 on the touch-sensitive display may be determined in any suitable manner. For example, in some embodiments, touch-sensitive display screen 102 may include an electrically sensitive touch sensitive mechanism (for example, a capacitive or resistive mechanism) capable of locating an object placed on touch-sensitive display screen 102. In other embodiments,interactive display device 100 may include an image capture device configured to capture an image of touch-sensitive display screen 102 to detect infrared or visible light reflected from objects placed on touch-sensitive display screen 102. In these embodiments, motion of an object on touch-sensitive screen 102 may be detected by capturing images of touch-sensitive display screen 102 at a suitably high sample rate, for example, between 20 and 100 Hz, to track object motion onscreen 102. Various embodiments ofinteractive display device 100 are described in more detail below. - Likewise, the presence of mobile
data storage device 104 on thewireless communications channel 106 may be detected in any suitable manner. For example,interactive display device 100 may send an intermittent and/or periodic beacon overwireless communications channel 106 to alert mobile data storage devices within range of its presence, and devices receiving the beacon may connect tointeractive display device 100 in response to the beacon. Alternatively,interactive display device 100 may send a beacon overwireless communications channel 106 only when an object is detected on touch-sensitive surface 102. In either these embodiments, display 102 (as well as other electronic systems) may remain dormant until activity is detected by the wireless communications channel or the touch-screen interface. This may allowinteractive display device 100 to assume a deeper power-save mode during periods of inactivity, such as during the night. It will be appreciated thatinteractive display device 100 may be configured to communicate with and receive data from mobiledata storage device 104 via any suitable wireless communications technology. Examples include, but are not limited to, radiofrequency technologies such as 802.11x technologies, Bluetooth technologies, active or passive radiofrequency identification (RFID) technologies, etc. - Continuing with
FIG. 2 ,interactive display device 100 may confirm at 206 the identification of the mobiledata storage device 104 via communication with mobiledata storage device 104 over any suitable second communications channel. Suitable channels include those channels that are sensitive to a position of mobiledata storage device 104 on touch-sensitive display screen 102. Specific examples include, but are not limited to, optical and electromagnetic second communications channels such as the touch sensitive mechanism of touch-sensitive display screen 102. For example, whereinteractive display device 100 utilizes a capacitive, resistive, or other electrical touch-sensing mechanism, the electrical touch-sensing mechanism may be used to detect a modulated electrical signal emitted by mobiledata storage device 104. Likewise, whereinteractive display device 100 utilizes an image capture device to implement the touch sensitivity ofdisplay surface 102 by detecting images of objects on display surface, the image capture device may also be used as a second communications channel to receive an optical communication signal from mobiledata storage device 104. -
FIG. 3 shows a schematic depiction of an embodiment of aninteractive display device 300 utilizing an optical touch sensing mechanism.Interactive display device 300 comprises a projection display system having animage source 302, optionally one ormore mirrors 304 for increasing an optical path length and image size of the projection display, and adisplay screen 306 onto which images are projected. -
Image source 302 includes an optical orlight source 308 such as the depicted lamp, an LED array, or other suitable light source.Image source 302 also includes an image-producingelement 310 such as the depicted LCD (liquid crystal display), an LCOS (liquid crystal on silicon) display, a DLP (digital light processing) display, or any other suitable image-producing element.Display screen 306 includes a clear,transparent portion 312, such as sheet of glass, and adiffuser screen layer 314 disposed on top of the clear,transparent portion 312. In some embodiments, an additional transparent layer (not shown) may be disposed overdiffuser screen layer 314 to provide a smooth look and feel to the display surface. - Continuing with
FIG. 3 ,interactive display device 300 further includes anelectronic controller 316 comprisingmemory 318 and amicroprocessor 320. Further,controller 316 may include a wireless transmitter andreceiver 322 configured to conduct two-way communication with mobile data storage devices. Wireless transmitter andreceiver 322 may be configured to conduct wireless communications with mobile data storage device in any suitable manner, including but not limited to via 802.11x, Bluetooth, RFID or other radiofrequency communications technologies. While shown as part ofcontroller 316, it will be appreciated that wireless transmitter andreceiver 322 may also be provided as a separate device in electrical communication withcontroller 316. - To sense objects placed on
display screen 306,interactive display device 300 includes animage capture device 324 configured to capture an image of the entire backside ofdisplay screen 306, and to provide the image toelectronic controller 316 for the detection of objects appearing in the image.Diffuser screen layer 314 helps to avoid the imaging of objects that are not in contact with or positioned within a few millimeters ofdisplay screen 306, and therefore helps to ensure that only objects that are touchingdisplay screen 306 are detected byimage capture device 324. -
Image capture device 324 may include any suitable image sensing mechanism. Examples of suitable image sensing mechanisms include but are not limited to CCD and CMOS image sensors. Further, the image sensing mechanisms may capture images ofdisplay screen 306 at a sufficient frequency to detect motion of an object acrossdisplay screen 306.Display screen 306 may alternatively or further include an optional capacitive, resistive or other electromagnetic touch-sensing mechanism, as illustrated by dashed-line connection 325 ofscreen 306 withcontroller 316. -
Image capture device 324 may be configured to detect reflected or emitted energy of any suitable wavelength, including but not limited to infrared and visible wavelengths. To assist in detecting objects placed ondisplay screen 306,image capture device 324 may further include an additional optical source or emitter such as one or more light emitting diodes (LEDs) 326 configured to produce infrared or visible light. Light fromLEDs 326 may be reflected by objects placed ondisplay screen 306 and then detected byimage capture device 324. The use of infrared LEDs as opposed to visible LEDs may help to avoid washing out the appearance of projected images ondisplay screen 306. -
LEDs 326 may be positioned at any suitable location withininteractive display device 300. In the depicted embodiment, a plurality ofLEDs 326 are placed along a side ofdisplay screen 306. In this location, light from the LEDs can travel throughdisplay screen 306 via internal reflection, while some can escape fromdisplay screen 306 for reflection by an object on thedisplay screen 306. In alternative embodiments, one or more LEDs may be placed beneathdisplay screen 306 so as to pass emitted light throughdisplay screen 306. -
FIG. 3 also depicts a mobiledata storage device 330 that has been placed ondisplay screen 306. Mobiledata storage device 330 includes a wireless transmitter andreceiver 332 configured to communicate with wireless transmitter andreceiver 322 oninteractive display device 300, and also includes an electrical and/oroptical emitter 334 configured to emit an electrical and/or optical signal that is detectable bydisplay screen 306 and/orimage capture device 324. In alternative embodiments, mobiledata storage device 330 comprises an optical detector, as described in more detail below. -
FIG. 4 shows a schematic depiction of another embodiment of aninteractive display device 400 that utilizes an optical touch sensing mechanism.Interactive display device 400 comprises a projection display system having a wideangle image source 402 and adisplay screen 406 onto which images are projected.Image source 402 includes alight source 408 and an image-producingelement 410.Display screen 406 includes atransparent glass structure 412 and adiffuser screen layer 414 disposed thereon. - Continuing with
FIG. 4 ,interactive display device 400 includes anelectronic controller 416 comprisingmemory 418 and amicroprocessor 420. Further,interactive display device 400 includes a wireless transmitter andreceiver 422 configured to conduct two-way communication with mobile data storage devices, such asdevice 430 via wireless transmitter andreceiver 432 ondevice 430. - Interactive display device further includes a plurality of image capture devices, depicted as 424 a-424 e, and an optical emitter such as an
LED array 426 configured to illuminate a backside ofdisplay screen 406 with infrared or visible light. Image capture devices 424 a-e are each configured to capture an image of a portion ofdisplay screen 406 and provide the image tocontroller 416, and to assemble a composite image of theentire display screen 406 from the images. In the depicted embodiment, image capture devices 424 a-d are positioned generally beneath the corners ofdisplay screen 406, whileimage capture device 424 e is positioned in a location such that it does not pick up glare fromLED array 426 reflected bydisplay screen 406 that may be picked up by image capture devices 424 a-d. In this manner, images from image capture devices 424 a-e may be combined bycontroller 416 to produce a complete, glare-free image of the backside ofdisplay screen 406. This allows detection of an object such as a mobiledata storage device 430 placed ondisplay screen 406.Display screen 406 may alternatively or further include an optional capacitive, resistive or other electromagnetic touch-sensing mechanism, as illustrated by dashed-line connection 425 ofscreen 406 withcontroller 416. - In the embodiments of
FIGS. 3 and 4 ,image capture devices 324 and 424 a-e, and/or an electronically sensitive touch sensing mechanism disposed within touch-sensitive display screen 306, may act as a second communications channel between mobile data storage devices andinteractive display device 300. Either of these mechanisms may be capable of communicating with the depictedinteractive display devices interactive display devices -
FIG. 5 shows a process flow depicting another embodiment of amethod 500 for identifying one or more data storage device placed on touch-sensitive display screen of an interactive display device. While described herein in the context ofinteractive display device 400, it will be appreciated thatmethod 500 may be performed by any of the embodiments disclosed herein, includingdevices -
Method 500 first includes detecting, at 502, an object placed ondisplay screen 406, and detecting, at 504, a data storage device on a wireless communications channel via wireless communications transmitter andreceiver 422. Next, to determine whether the object detected ondisplay screen 406 is the data storage device detected on the wireless communications channel,interactive display device 400 sends, at 506, a request over the wireless communications channel to the data storage device for the data storage device to send a locating message over the second communications channel. - If the object detected on
display screen 406 is the data storage device to which the request was sent, theninteractive display device 400 receives, at 508, the locating message. On the other hand, if the object ondisplay screen 406 is not the data storage device detected on the wireless communications channel, theninteractive display device 400 will not receive the locating message due to the position-sensitive nature of the second communications channel. In this manner,interactive display device 400 determines, at 510, the identity of a data storage device on the surface of thedisplay screen 406 based on receipt of the locating message. Data may then be downloaded from the data storage device for display ondisplay screen 406. - The locating message sent by the data storage device over the second communications channel may take any suitable form. For example, in some embodiments, the data storage device includes an infrared emitter. Upon receipt of a request to send a locating message, the data storage device emits infrared light via the infrared light emitter. The emitted infrared light may be received by image capture devices 424 a-e and detected in the images from image capture devices 424 a-e by
controller 416. In alternative embodiments, the data storage device includes a second electromagnetic modulator. Upon receipt of a request to send a locating message, the data storage device emits a modulated electromagnetic signal, which may be detected by a suitable detection mechanism associated withdisplay screen 406. -
Method 500 may also be used to locate and identify a plurality of mobile data storage devices placed ondisplay screen 406. For example, where four users each place a mobile data storage device ondisplay screen 406,interactive display device 400 may determine which mobile data storage device is located at which position on touch-sensitive display screen by requesting each mobile data storage device to send a locating message that is distinguishable from the locating message sent by the other data storage devices. For example, in some embodiments, the mobile data storage device may be requested to send a locating message at different times. In other embodiments, each mobile data storage device may be asked to send a different locating message, for example, a different number or pattern of emitted signals. In this manner, each mobile data storage device that is detected oninteractive display device 400 may be distinguished from other mobile data storage devices located oninteractive display device 400, as well as mobile data storage devices that are within wireless detection range but are not located oninteractive display device 400. - Further, as described above, image capture device 424 a-e may acquire images of
display screen 406 at a sufficient frequency to allow the motion of objections ondisplay screen 406 to be tracked. Therefore, once a mobile data storage device has been identified and located ondisplay screen 406, movements of the device ondisplay screen 406 may be tracked, thereby allowing the device to be moved without having to repeat the identification process. If the mobile data storage device is not successfully tracked or is lifted fromdisplay screen 406 during movement, the locating process may be again performed to identify and locate the device ondisplay screen 406. Alternatively,interactive display device 400 may be configured to periodically and/or continuously renew device identifications, or to renew identifications whenever a device is moved. - The wireless and second communications mechanisms described above may be implemented in any suitable manner on mobile data storage devices. Some mobile data storage devices may be manufactured with suitable communications mechanisms build into the devices. For example, wireless technologies such as 802.11x and Bluetooth are integrated into many portable data storage devices, including but not limited to cell phones, PDAs, and cameras. Likewise, many portable data storage devices also include infrared data ports. Therefore, such devices may be configured, via software or hardware for example, to conduct a locating communication with
interactive display device 400 using standard included equipment. On the other hand, some devices may not include standard equipment that may be used for communicating over the wireless and second communications channels. Therefore, a simple communications tag may be attached to or incorporated into these devices to enable these devices to be located on and identified byinteractive display device 400. -
FIG. 6 shows a block diagram of an embodiment of anidentification tag system 600 that may be attached to or incorporated into an object to allow the object to be identified byinteractive display device 400.Tag system 600 comprises anRFID tag 602 with amicrocontroller 603,memory 604 on which a unique identifier is stored, anRF modulator 605, anRF antenna 606, and asecond modulation device 608 configured to emit a modulated electromagnetic or optical signal.Tag system 600 may be read by an RFID interrogator incorporated into wireless transmitter andreceiver 422 ofinteractive display device 400 to transfer a unique identification of the mobile data storage device tointeractive display device 400. Further,microcontroller 603 may be configured to causesecond modulation device 608 to emit an optical, electrical or electromagnetic locating signal so thatinteractive display device 400 can locate and identify the device withtag system 600 on touch-sensitive display screen 406. In this manner,tag system 600 may support a large number of unique identification numbers via RFID capabilities (including 128-bit identification numbers), while second modulation device may allow a specific tagged device to be located ondisplay screen 406. - In some embodiments,
tag system 600 is electronically passive and acquires all operating power from an interrogating RF field. In alternative embodiments,tag system 600 is electronically active in that it includes a power supply. Wheretag system 600 is an active tag, it may include an on-board power supply (i.e. on the tag itself), or may be connected to a power supply on the device on whichtag system 600 is included. - Any suitable event may be used to trigger
microcontroller 603 to causesecond modulation device 608 to send a locating signal at any suitable time. For example, in some embodiments,microcontroller 603 may be configured to receive a request frominteractive display device 400 to send the modulating signal, and then may directsecond modulation device 608 to emit the signal upon receipt of the request. In alternative embodiments,microcontroller 603 may be configured to alertinteractive display device 400, via the RF identification channel, that it will send a specific locating message viasecond modulator 608, and then may send the locating message after sending the alert. In either case, the locating operation is performed by two-way communication via the wireless communications channel and one-way communication fromtag system 600 tointeractive display device 400 via the second communications channel. - It will be appreciated that
tag system 600 may include both an optical or electrical emitter and an optical or electrical receiver. In these embodiments,tag system 600 andinteractive display device 400 may conduct a two-way locating communication in which each device both sends and receives a locating signal. Various embodiments of mobile devices with optical receivers are described in more detail below. - In some embodiments,
tag system 600 may be used to transfer more information tointeractive display device 400 than a unique identification number. For example, in some embodiments,tag system 600 may be configured to transfer data such as photographic data, video data, etc. for display oninteractive display device 400 via the RFID communications channel. - Further, it will be appreciated that
tag system 600 may have applicability beyond identifying a mobile data storage device on touch-sensitive display screen 400. For example,tag system 600 may be placed on any desired object to allow interactive display device to identify and interact with that object. As one example,tag system 600 may be included on a card issued to and linked specifically to a guest at a resort, amusement park, or other such entertainment facility. While the user is at the entertainment facility, photographs may be taken of the guest performing various activities, such as riding rides, participating in sports activities, etc., and may be displayed at a kiosk to the user for selection after the activity has included. As a specific example, a roller coaster may include a camera configured to photograph all of the riders as the roller coaster cars pass by the camera. - Upon conclusion of the ride, a rider may view the photographs at a kiosk, scan the card to alert the kiosk of the identity of the person making the selection, and then select photographs in which the rider and/or the rider's friends and/or family appear. Then, at a later time and/or different location, for example, in a hotel lobby, or in a coffee house or restaurant affiliated with the resort, the rider may place the card on the surface of an
interactive display device 400. The device may determine the identity of the holder of the card by receiving the unique ID of the card holder viaRFID tag 602, query a database to determine those photos previously selected by the rider, and then download those photos for display ondisplay screen 406. - Furthermore, where multiple cards are placed on the table,
interactive display device 400 may determine where each detected card is located ondisplay screen 406 viasecond modulator 608, and then display the downloaded photos in locations and orientations based upon the location of the cards on the table. It will be appreciated thattag system 600 may be used to allowinteractive display device 400 to uniquely identify any other suitable object, such as drinks, glasses or plates placed ondisplay screen 406 for enabling drink or food ordering through touch-sensitive display screen 400, etc. Further, other indication indicia may be included on tag system 600 (or elsewhere on an object) to allow an orientation of an object to be determined.FIG. 7 shows a schematic depiction of atag system 700 having asecond modulator 708, and a plurality of otheroptical indicators 710. For example, the relative locations of the signal fromsecond modulator 708 and the detected positions of otheroptical indicators 710 may be detected byinteractive display device 400. The orientation of the object may then be determined by comparing the positions ofsecond modulator 708 and otheroptical indicators 710 to a database containing information on the location of optical indicators on tags. -
Optical indicators 710 may also serve to identify the device on whichtag system 700 is located as one including a second optical or electrical communications channel. This allows the display device to ignore objects that do not possess such a communications channel. Further,optical indicators 710 also may be used to locate the secondary communications channel on large and/or complex devices, so the display surface does not have to know the location of the secondary communications channel for all present and future devices. Additionally,optical indicators 710 can act as a visual cue to a user in that the optical indicators may indicate to the user which surface of the object, such as a surface having a camera lens, should be placed in contact with the display surface. - Additionally,
optical indicators 710 may simplify the tracking of devices moved on the display surface. For example, once the identity of a device has been determined and associated with theoptical indicators 710 located on that device, the device may be identified at any location on the display surface simply by readingoptical indicators 710. Further, changes in the orientation oftag system 700 may be detected by tracking the changes in the positions ofoptical indicators 710 and/orsecond modulator 708. This may allow the rotation of an object includingtag system 600 ondisplay screen 406 to be used as an input tointeractive display device 400. Such an input could be used, for example, to trigger a change in a displayed image, to cause a scrolling menu displayed on touch-sensitive display screen to scroll, or to trigger any other desired functionality ininteractive display device 400. - Any suitable optically readable symbol or arrangement of symbols may be used as
optical indicators 710. For example, in one embodiment,optical indicators 710 may take the form of a barcode. In alternative embodiments,optical indicators 710 may comprise optically reflecting or absorbing shapes such as circles, triangles, rectangles, etc. Different sizes and/or arrangements of shapes may be used to identify various objects. Furthermore, in other alternative embodiments, more than onesecond modulator 708 may be provided, thereby allowing tag orientation and/or object orientation to be determined via the signals from the plurality of second modulators. - Depending upon the configuration of
optical indicators 710,optical indicators 710 may provide sufficient bit depth to be able to uniquely identify objects within a selected environment, and may thereby be able to represent both an identity and a location of an object placed oninteractive display device 400. This may allow for the unique identification of an object via an optically reflective passive tag, without the use of any RFID or optical emitters located on the tag. For example, upon reading such an optically reflective passive tag,interactive display device 400 may query a database containing records linking each unique optical tag pattern to a specific device and/or device owner to determine the device and/or owner linked to that specific tag. In this manner,interactive display device 400 may uniquely identify a device detected ondisplay screen 406 from the passive tag alone, without any optical or electrical signal emitted by the tag. - An identification tag may also be configured to receive a locating signal from
interactive display device 400 via a second communications channel.FIG. 8 shows a block diagram of another embodiment of anidentification tag system 800 configured to receive a locating signal sent byinteractive display device 400.Tag system 800 comprises anRFID tag 802 with amicrocontroller 803,memory 804 on which a unique identifier is stored, anRF modulator 805, an RF antenna 806, and anoptical detector 808 configured to detect an optical signal emitted byinteractive display device 400. As described above fortag system 600,tag system 800 may be a passive device powered by an interrogating field, or may be an active device with an on-board power supply. - Any suitable optically sensitive structure may be used as
optical detector 808, andoptical detector 808 may be configured to receive any suitable optical signal frominteractive display device 400. For example, in some embodiments,optical detector 808 may comprise a simple color-sensitive or light-sensitive detector. In these embodiments,interactive display device 400 may be configured to display a selected color ondisplay screen 406 in a location adjacent to tagsystem 800, to requesttag system 800 to acquire an optical data sample fromoptical detector 808, and then to send the optical data sample tointeractive display device 400 viaRFID tag 802 and antenna 806 (or via another wireless communications channel).Interactive display device 400 may then compare the optical sample to the color displayed ondisplay screen 406 to determine the presence and location oftag system 800 ondisplay screen 406. Alternatively,interactive display device 400 may modulate a color or shades of color displayed ondisplay screen 406, and receive an optical sample of the modulated color fromtag system 800. - Some mobile data storage devices may include an optical detector built into the device. For example, many cell phones and PDAs include cameras configured to capture photographic images and/or video segments. Therefore, such a device may include programming that allows the devices to connect wirelessly to
interactive display device 400, and to receive a locating communication frominteractive display device 400 via the use of the on-board camera as a second communications channel. -
FIG. 9 shows a block software architecture diagram 900 of an example mobile data storage device, such as a cell phone.Software architecture 900 includes anoperating system 902,device drivers 904 which allow the operating system to interact with the hardware components of the mobile device, andapplications 906 which interact withoperating system 902 viaapplication programming interfaces 908. - Further,
software architecture 900 includes asharing service 910 that allows the mobile data storage device to transfer data to and/or frominteractive display device 400.Sharing service 910 also may be configured to communicate withinteractive display device 400 via a camera or other optical detector on the mobile data storage device. -
FIG. 10 shows a process flow of an embodiment of amethod 1100 for identifying a mobiledata storage device 1000 detected on awireless network 1002 and placed on the surface of aninteractive display device 400 via acamera 1004 provided on mobiledata storage device 1000. Processes performed by interactivedisplay device applications 1006 are shown in a left-most portion ofFIG. 10 ; communications between interactivedisplay device applications 1006 and sharing service viawireless network 1002 are shown in a left-center portion ofFIG. 10 ; processes performed by sharingservice 910 running ondevice 1000 are shown in a right-center portion ofFIG. 10 ; and processes performed bycamera 1004 are shown in a right-most portion ofFIG. 10 . -
Method 1100 begins at 1102 with the interactivedisplay device application 1006 finding all mobile data storage devices enabled to share data withinteractive display device 400.Application 1006 may find these devices by periodically sending a beacon overwireless network 1002, or by sending a beacon overwireless network 1002 when an object is detected oninteractive display device 400. Next, as indicated at 1104, if sharingservice 910 is enabled on a mobile device detecting the beacon, the mobile device returns a message to display application at 1106 alerting the display application of its presence. Processes 1102-1106 are performed for each mobile data storage device that receives the beacon and that has its sharing service enabled. - Next, at each detected object on the
display screen 406, interactive display device may display a unique color or image beneath the object, as indicated at 1108. Next, as indicated at 1110,display application 1006 may direct each mobile data storage device detected onwireless network 1002 to send a locating message by capturing an image and sending a message related to the captured image to thedisplay application 1006. - Upon receipt of this instruction,
sharing service 910 on each mobile data storage device directscamera 1004 on that device to collect an optical sample by taking a picture, as indicated at 1112. Next, as shown at 1114,camera 1004 then takes the picture and returns the picture to sharingservice 910. In some embodiments,sharing service 910 may perform some processing of the optical sample or may acquire data from the optical sample, such as an average of the colors in the image, as shown at 1116. - Next,
sharing service 910 sends the image, data acquired from the image, or another such locating message related to the image, back todisplay application 1006 overwireless network 1002, as shown at 1118. Finally, as indicated at 1120,display application 1006 can then match the image (or data acquired from the image) to the image that was displayed under the detected object to determine which, if any, of the mobile data storage devices detected onwireless network 1002 corresponds to the detected object. Where more than one object is detected oninteractive display device 400,method 1100 may also be used to identify and locate each mobile data storage device that is placed on interactive device and distinguish those devices from other objects detected oninteractive display device 400. - In some embodiments,
interactive display device 400 may display a timed sequence of colors under the detected object, rather than a single color. As another alternative,interactive display device 400 may be configured to modulate the output fromLEDs 326 and/or 426, and mobiledata storage device 1000 may detect the modulated LED output withcamera 1004. Furthermore,display application 1006 may use different techniques for choosing and displaying the color beneath the device to determine if a color works best for a selected device. Additionally,sharing service 910 may be configured to process the image acquired bycamera 1004 to facilitate the identification of the color displayed beneath it. For example, such processing may include, but is not limited to, ignoring blown highlights, ignoring areas with no color, or clamping the color values to a specific set of colors. Likewise,sharing service 910 may be configured to return an error message or no response ifcamera 1004 is unable to see a uniform enough color. Additionally, in some embodiments, a user may be provided with the option of disabling the secondary communications channel to prevent unauthorized or unintentional communication with the interactive display device. This may provide a user with more control over whether content from the user's device is downloaded to the interactive display device. Furthermore, while the above-described embodiments utilize automatic location and identification processes to create a smooth user experience, it will be appreciated that either a portable data storage device and/or an interactive display device may be configured to require acknowledgement and/or confirmation from a user before initiating a transfer of data to the interactive display device. For example, a portable data storage device with a passive tag, with or without a secondary communications channel, may be configured to transmit a “confirm” signal to the display device over a radio frequency communications channel. This “confirm” signal may be generated in response to a specific device action by the user (i.e. pressing a specific button) in response to a prompt by the display device (i.e. “Press confirm to transmit your pictures”). In this manner, data from a user's device would be transferred to the interactive display device only upon specific authorization by the user. - It will be appreciated that the configurations and/or approaches described herein are exemplary in nature, and that these specific embodiments or examples are not to be considered in a limiting sense, because numerous variations are possible. For example, while described herein in the context of an interactive display device having a horizontal, table-like display surface, it will be appreciated that the concepts described herein may also be used with displays of any other suitable orientation, including vertically arranged displays. Additionally, a portable data storage device may include more than one secondary communications device. For example, a device may include a passive optically readable tag, an active optical or electromagnetic secondary communications channel, and/or an on-board camera.
- Furthermore, the specific routines or methods described herein may represent one or more of any number of processing strategies such as event-driven, interrupt-driven, multi-tasking, multi-threading, and the like. As such, various acts illustrated may be performed in the sequence illustrated, in parallel, or in some cases omitted. Likewise, the order of any of the above-described processes is not necessarily required to achieve the features and/or results of the exemplary embodiments described herein, but is provided for ease of illustration and description.
- The subject matter of the present disclosure includes all novel and nonobvious combinations and subcombinations of the various processes, systems and configurations, and other features, functions, acts, and/or properties disclosed herein, as well as any and all equivalents thereof.
Claims (18)
1. In a mobile device, a method of communicating with an interactive display device, the method comprising:
connecting to the interactive display device via a first wireless communications channel;
conducting an identification confirmation communication with the interactive display device over a second wireless communications channel via a radiofrequency field received from the interactive display device; and
after conducting the identification confirmation communication, sending data stored on the mobile device to the interactive display device via the first wireless communication channel.
2. The method of claim 1 , wherein connecting to the interactive display device via the first wireless communications channel comprises connecting to the interactive display device via an 802.11 communications channel.
3. The method of claim 1 , further comprising receiving power for conducting the identification confirmation communication over the second wireless communications channel from the radiofrequency field.
4. The method of claim 1 , further comprising receiving power for conducting the identification confirmation communication from an on-board power supply of the mobile device.
5. The method of claim 1 , wherein communicating over a second wireless communications channel comprises communicating over an RFID channel.
6. The method of claim 1 , wherein the data comprises image data.
7. The method of claim 1 , wherein the mobile device comprises a mobile computing device.
8. The method of claim 1 , wherein the mobile device comprises an object having an RFID tag.
9. A mobile device, comprising:
a first wireless communications device comprising a first wireless transmitter/receiver operable to communicate via an 802.11 protocol;
a second wireless communications device comprising a second wireless transmitter/receiver operable to communicate via a radiofrequency field emitted by another device;
a processor; and
a computer readable storage medium comprising instructions stored thereon that are executable by the processor to
conduct an identification confirmation communication with an interactive display device via the second wireless communications device; and
after conducting the identification confirmation communication with the interactive display device, send data stored on the mobile device to the interactive display device via the first wireless communications device.
10. The mobile device of claim 9 , wherein the second radiofrequency transmitter/receiver is configured to receive operating power from the radiofrequency field.
11. The mobile device of claim 9 , wherein the second radiofrequency transmitter/receiver is configured to receive power from an on-board power supply.
12. The mobile device of claim 9 , wherein the instructions are executable not to send the data to the interactive display device if the mobile device connects to the interactive display device via the first radiofrequency transmitter/receiver but does not conduct the identification confirmation communication with the interactive display device via the second radiofrequency transmitter/receiver.
13. The mobile device of claim 9 , wherein the second radiofrequency transmitter/receiver comprises an RFID tag.
14. In an interactive display device comprising a touch-sensitive surface, a method of identifying from a plurality of detected data storage devices a selected data storage device, the method comprising:
detecting the plurality of data storage devices on a wireless communications channel;
detecting the selected data storage device on a radiofrequency communications channel comprising a radiofrequency field emitted by the interactive display device, the radiofrequency communications channel being different than the wireless communications channel;
distinguishing the selected data storage device from other data storage devices of the plurality of data storage devices by communicating with the selected data storage device over the radiofrequency communications channel;
after distinguishing the selected data storage device, receiving data from the selected data storage device; and
displaying on the display device the data received from the data storage device.
15. The method of claim 14 , wherein the radiofrequency communications channel comprises an RFID channel.
16. The method of claim 14 , wherein distinguishing the selected data storage device comprises sending a request to the selected data storage device to emit or receive an identifying signal over the identification communications channel.
17. The method of claim 14 , wherein the data comprises image data.
18. The method of claim 14 , wherein displaying the data comprises displaying the data at a location adjacent to a location of the data storage device.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/212,663 US20110298589A1 (en) | 2007-02-20 | 2011-08-18 | Identification of devices on touch-sensitive surface |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/708,400 US8063888B2 (en) | 2007-02-20 | 2007-02-20 | Identification of devices on touch-sensitive surface |
US13/212,663 US20110298589A1 (en) | 2007-02-20 | 2011-08-18 | Identification of devices on touch-sensitive surface |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/708,400 Continuation US8063888B2 (en) | 2007-02-20 | 2007-02-20 | Identification of devices on touch-sensitive surface |
Publications (1)
Publication Number | Publication Date |
---|---|
US20110298589A1 true US20110298589A1 (en) | 2011-12-08 |
Family
ID=39706233
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/708,400 Expired - Fee Related US8063888B2 (en) | 2007-02-20 | 2007-02-20 | Identification of devices on touch-sensitive surface |
US13/212,663 Abandoned US20110298589A1 (en) | 2007-02-20 | 2011-08-18 | Identification of devices on touch-sensitive surface |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/708,400 Expired - Fee Related US8063888B2 (en) | 2007-02-20 | 2007-02-20 | Identification of devices on touch-sensitive surface |
Country Status (1)
Country | Link |
---|---|
US (2) | US8063888B2 (en) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130117135A1 (en) * | 2009-11-27 | 2013-05-09 | Compurants Limited | Multi-user food and drink ordering system |
US20130183955A1 (en) * | 2008-06-24 | 2013-07-18 | Uri Ron | Mobile phone locator |
US20150149547A1 (en) * | 2013-11-27 | 2015-05-28 | Sharp Kabushiki Kaisha | Information processing system and information processing device |
US20150205434A1 (en) * | 2014-01-20 | 2015-07-23 | Canon Kabushiki Kaisha | Input control apparatus, input control method, and storage medium |
US9516151B2 (en) | 2007-02-13 | 2016-12-06 | Google Inc. | Modular wireless communicator |
US9680972B2 (en) | 2007-06-08 | 2017-06-13 | Google Inc. | SD switch box in a cellular handset |
WO2018090015A1 (en) * | 2016-11-14 | 2018-05-17 | The Museum Of The Bible, Inc. | Camera-to-screen pattern recognition system |
US10027789B2 (en) | 2007-02-13 | 2018-07-17 | Google Llc | Modular wireless communicator |
US10044790B2 (en) * | 2005-06-24 | 2018-08-07 | Microsoft Technology Licensing, Llc | Extending digital artifacts through an interactive surface to a mobile device and creating a communication channel between a mobile device and a second mobile device via the interactive surface |
US10281997B2 (en) | 2014-09-30 | 2019-05-07 | Hewlett-Packard Development Company, L.P. | Identification of an object on a touch-sensitive surface |
Families Citing this family (56)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8269746B2 (en) * | 2006-11-27 | 2012-09-18 | Microsoft Corporation | Communication with a touch screen |
US8094129B2 (en) | 2006-11-27 | 2012-01-10 | Microsoft Corporation | Touch sensing using shadow and reflective modes |
US7924272B2 (en) * | 2006-11-27 | 2011-04-12 | Microsoft Corporation | Infrared sensor integrated in a touch panel |
JP4547633B2 (en) * | 2007-03-30 | 2010-09-22 | ソニー株式会社 | Information processing apparatus, information processing method, and information processing program |
US9507375B2 (en) * | 2007-06-05 | 2016-11-29 | Samsung Electronics Co., Ltd. | Display apparatus and method for recognizing location |
US20090059175A1 (en) * | 2007-08-30 | 2009-03-05 | The Big Space Ltd. | Display arrangement |
US9953392B2 (en) | 2007-09-19 | 2018-04-24 | T1V, Inc. | Multimedia system and associated methods |
US20130219295A1 (en) * | 2007-09-19 | 2013-08-22 | Michael R. Feldman | Multimedia system and associated methods |
US8583491B2 (en) * | 2007-09-19 | 2013-11-12 | T1visions, Inc. | Multimedia display, multimedia system including the display and associated methods |
US9965067B2 (en) | 2007-09-19 | 2018-05-08 | T1V, Inc. | Multimedia, multiuser system and associated methods |
US20100179864A1 (en) * | 2007-09-19 | 2010-07-15 | Feldman Michael R | Multimedia, multiuser system and associated methods |
US8600816B2 (en) * | 2007-09-19 | 2013-12-03 | T1visions, Inc. | Multimedia, multiuser system and associated methods |
US20090094561A1 (en) * | 2007-10-05 | 2009-04-09 | International Business Machines Corporation | Displaying Personalized Documents To Users Of A Surface Computer |
US9134904B2 (en) * | 2007-10-06 | 2015-09-15 | International Business Machines Corporation | Displaying documents to a plurality of users of a surface computer |
US8139036B2 (en) * | 2007-10-07 | 2012-03-20 | International Business Machines Corporation | Non-intrusive capture and display of objects based on contact locality |
US20090091539A1 (en) * | 2007-10-08 | 2009-04-09 | International Business Machines Corporation | Sending A Document For Display To A User Of A Surface Computer |
US20090091529A1 (en) * | 2007-10-09 | 2009-04-09 | International Business Machines Corporation | Rendering Display Content On A Floor Surface Of A Surface Computer |
US8024185B2 (en) * | 2007-10-10 | 2011-09-20 | International Business Machines Corporation | Vocal command directives to compose dynamic display text |
KR101383258B1 (en) * | 2007-11-08 | 2014-04-08 | 삼성전자주식회사 | Apparatus and method for human body communication in mobile communication system |
US8917247B2 (en) | 2007-11-20 | 2014-12-23 | Samsung Electronics Co., Ltd. | External device identification method and apparatus in a device including a touch spot, and computer-readable recording mediums having recorded thereon programs for executing the external device identification method in a device including a touch spot |
US8773361B2 (en) * | 2007-11-20 | 2014-07-08 | Samsung Electronics Co., Ltd. | Device identification method and apparatus, device information provision method and apparatus, and computer-readable recording mediums having recorded thereon programs for executing the device identification method and the device information provision method |
US20090128513A1 (en) * | 2007-11-20 | 2009-05-21 | Samsung Electronics Co., Ltd | Device identification method and apparatus, device information provision method and apparatus, and computer-readable recording mediums having recorded thereon programs for executing the device identification method and the device information provision method |
KR20100009023A (en) * | 2008-07-17 | 2010-01-27 | (주)마이크로인피니티 | Apparatus and method for recognizing movement |
TWI463354B (en) * | 2008-08-13 | 2014-12-01 | Prime View Int Co Ltd | Display panel and touch-sensitive display module |
US8237666B2 (en) | 2008-10-10 | 2012-08-07 | At&T Intellectual Property I, L.P. | Augmented I/O for limited form factor user-interfaces |
US8253713B2 (en) | 2008-10-23 | 2012-08-28 | At&T Intellectual Property I, L.P. | Tracking approaching or hovering objects for user-interfaces |
JP2010152647A (en) * | 2008-12-25 | 2010-07-08 | Fujitsu Ltd | Information providing system and method |
US20100170725A1 (en) * | 2009-01-06 | 2010-07-08 | Hong Kong Applied Science And Technology Research Institute | Touch surface and system and method of detecting touch input |
US8650634B2 (en) | 2009-01-14 | 2014-02-11 | International Business Machines Corporation | Enabling access to a subset of data |
GB2468275A (en) | 2009-02-16 | 2010-09-08 | New Transducers Ltd | A method of making a touch-sensitive data entry screen with haptic feedback |
KR101542744B1 (en) * | 2009-03-18 | 2015-08-10 | 삼성전자주식회사 | Method and apparatus for controlling controlled device |
US20100237983A1 (en) * | 2009-03-20 | 2010-09-23 | Xerox Corporation | System and method for using concealed infrared identifiers to control motion-detecting social computing devices |
KR20100109686A (en) * | 2009-04-01 | 2010-10-11 | 삼성전자주식회사 | Method for providing gui and multimedia device using the same |
US8570281B2 (en) * | 2009-06-25 | 2013-10-29 | Ncr Corporation | Method and apparatus for multi-touch surface interaction for a financial application within a bank branch |
US8610924B2 (en) | 2009-11-24 | 2013-12-17 | International Business Machines Corporation | Scanning and capturing digital images using layer detection |
US8441702B2 (en) | 2009-11-24 | 2013-05-14 | International Business Machines Corporation | Scanning and capturing digital images using residue detection |
US20110181396A1 (en) * | 2010-01-25 | 2011-07-28 | Hilla Jr Ralph | Rfid information data on external memory |
US20100134679A1 (en) * | 2010-02-03 | 2010-06-03 | Peter Yuanyu Lin | Method and apparatus for synchronizing a camera flash accessory for mobile electronic device using a display and optical sensor |
JP2013041350A (en) * | 2011-08-12 | 2013-02-28 | Panasonic Corp | Touch table system |
WO2013089631A2 (en) * | 2011-12-16 | 2013-06-20 | Skärmtroll Ab | Method and system for transmitting data |
US9338517B2 (en) | 2012-04-07 | 2016-05-10 | Samsung Electronics Co., Ltd. | Method and system for reproducing contents, and computer-readable recording medium thereof |
US8682248B2 (en) | 2012-04-07 | 2014-03-25 | Samsung Electronics Co., Ltd. | Method and system for reproducing contents, and computer-readable recording medium thereof |
KR101982151B1 (en) | 2012-08-24 | 2019-05-24 | 삼성전자주식회사 | Control Method of Device having Near Field Communication And Device thereof |
FR2998389B1 (en) * | 2012-11-20 | 2016-07-08 | Immersion | DEVICE AND METHOD FOR VISUAL DATA SHARING |
KR20140065938A (en) * | 2012-11-22 | 2014-05-30 | 삼성전자주식회사 | Method of communicatioin between display devices and display devices applied the method |
US9555320B2 (en) * | 2013-05-17 | 2017-01-31 | Castar, Inc. | System and method to identify and track objects on a surface |
US20140370980A1 (en) * | 2013-06-17 | 2014-12-18 | Bally Gaming, Inc. | Electronic gaming displays, gaming tables including electronic gaming displays and related assemblies, systems and methods |
EA201300786A1 (en) * | 2013-07-17 | 2015-01-30 | Сергей Сергеевич АЗАРОВ | METHOD OF TRANSFERRING IMAGES |
CN103645833B (en) * | 2013-12-27 | 2017-06-27 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
WO2015106114A1 (en) * | 2014-01-13 | 2015-07-16 | T1visions, Inc. | Display capable of object recognition |
JP6355081B2 (en) * | 2014-03-10 | 2018-07-11 | 任天堂株式会社 | Information processing device |
EP3104262A3 (en) * | 2015-06-09 | 2017-07-26 | Wipro Limited | Systems and methods for interactive surface using custom-built translucent models for immersive experience |
IN2015CH02869A (en) * | 2015-06-09 | 2015-07-17 | Wipro Ltd | |
TWI547850B (en) * | 2015-08-12 | 2016-09-01 | 原相科技股份有限公司 | Optical detecting device capable of increasing signal-to-noise ratio and economizing power consumption |
US20190355199A1 (en) * | 2016-12-29 | 2019-11-21 | Orell Füssli Sicherheitsdruck Ag | Method for retrieving information from a security document by means of a capacitive touchscreen |
CN110221801A (en) * | 2019-06-05 | 2019-09-10 | 京东方科技集团股份有限公司 | Electronic table tablet stand terminal and control method, system, operating terminal and control method |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040135684A1 (en) * | 2002-07-19 | 2004-07-15 | Cyrano Sciences Inc. | Non-specific sensor array detectors |
US20060128408A1 (en) * | 2002-10-31 | 2006-06-15 | Marko Perttila | Method and system for selecting data items for service requests |
US20060214907A1 (en) * | 2005-03-23 | 2006-09-28 | Devos John A | Token configured to interact |
US20070024580A1 (en) * | 2005-07-29 | 2007-02-01 | Microsoft Corporation | Interactive display device, such as in context-aware environments |
US20070243851A1 (en) * | 2006-04-18 | 2007-10-18 | Radiofy Llc | Methods and systems for utilizing backscattering techniques in wireless applications |
Family Cites Families (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5461385A (en) | 1994-04-29 | 1995-10-24 | Hughes Identification Devices, Inc. | RF/ID transponder system employing multiple transponders and a sensor switch |
US5970393A (en) | 1997-02-25 | 1999-10-19 | Polytechnic University | Integrated micro-strip antenna apparatus and a system utilizing the same for wireless communications for sensing and actuation purposes |
US7034660B2 (en) | 1999-02-26 | 2006-04-25 | Sri International | Sensor devices for structural health monitoring |
US6529122B1 (en) * | 1999-12-10 | 2003-03-04 | Siemens Technology-To-Business Center, Llc | Tactile sensor apparatus and methods |
US7098793B2 (en) | 2000-10-11 | 2006-08-29 | Avante International Technology, Inc. | Tracking system and method employing plural smart tags |
US7348963B2 (en) * | 2002-05-28 | 2008-03-25 | Reactrix Systems, Inc. | Interactive video display system |
JP4500684B2 (en) * | 2002-11-13 | 2010-07-14 | パナソニック株式会社 | Remote control device and program receiving system |
WO2004090761A1 (en) * | 2003-04-07 | 2004-10-21 | Silverbrook Research Pty Ltd | Locations based promotions |
US20050219204A1 (en) * | 2004-04-05 | 2005-10-06 | Wyatt Huddleston | Interactive display system |
US20050246094A1 (en) | 2004-04-30 | 2005-11-03 | Richard Moscatiello | Smart space RFID system and method |
US7467380B2 (en) * | 2004-05-05 | 2008-12-16 | Microsoft Corporation | Invoking applications with virtual objects on an interactive display |
JPWO2005122625A1 (en) | 2004-06-10 | 2008-04-10 | 松下電器産業株式会社 | Mobile terminal for receiving data from RFID tag and mobile terminal control policy specifying method |
US7667572B2 (en) | 2004-07-30 | 2010-02-23 | Reva Systems Corporation | RFID tag data acquisition system |
US7573386B2 (en) | 2004-08-19 | 2009-08-11 | International Business Machines Corporation | System and method for smart radio frequency identification tags |
GB2422669A (en) | 2005-01-31 | 2006-08-02 | Hewlett Packard Development Co | Article and a mobile networkable device for reading navigational data from an article |
US20060202862A1 (en) | 2005-02-27 | 2006-09-14 | Nitesh Ratnakar | Smart Vehicle Identification System |
US7639231B2 (en) * | 2005-03-29 | 2009-12-29 | Hewlett-Packard Development Company, L.P. | Display of a user interface |
US7492259B2 (en) | 2005-03-29 | 2009-02-17 | Accu-Sort Systems, Inc. | RFID conveyor system and method |
US7570249B2 (en) * | 2005-03-30 | 2009-08-04 | Microsoft Corporation | Responding to change of state of control on device disposed on an interactive display surface |
US7362228B2 (en) | 2005-04-28 | 2008-04-22 | Warsaw Orthepedic, Inc. | Smart instrument tray RFID reader |
US7430398B2 (en) | 2005-05-03 | 2008-09-30 | International Business Machines Corporation | Radio frequency identification (RFID) system for dynamically and automatically establishing communication between a mobile wireless communicating device and a data processing system |
US7621415B2 (en) * | 2005-07-25 | 2009-11-24 | Microsoft Corporation | Storage for interactive display system |
US7548677B2 (en) * | 2006-10-12 | 2009-06-16 | Microsoft Corporation | Interactive display using planar radiation guide |
US7913921B2 (en) * | 2007-04-16 | 2011-03-29 | Microsoft Corporation | Optically trackable tag |
US7874496B2 (en) * | 2008-01-04 | 2011-01-25 | Microsoft Corporation | Optically readable tag |
-
2007
- 2007-02-20 US US11/708,400 patent/US8063888B2/en not_active Expired - Fee Related
-
2011
- 2011-08-18 US US13/212,663 patent/US20110298589A1/en not_active Abandoned
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040135684A1 (en) * | 2002-07-19 | 2004-07-15 | Cyrano Sciences Inc. | Non-specific sensor array detectors |
US20060128408A1 (en) * | 2002-10-31 | 2006-06-15 | Marko Perttila | Method and system for selecting data items for service requests |
US20060214907A1 (en) * | 2005-03-23 | 2006-09-28 | Devos John A | Token configured to interact |
US20070024580A1 (en) * | 2005-07-29 | 2007-02-01 | Microsoft Corporation | Interactive display device, such as in context-aware environments |
US20070243851A1 (en) * | 2006-04-18 | 2007-10-18 | Radiofy Llc | Methods and systems for utilizing backscattering techniques in wireless applications |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10044790B2 (en) * | 2005-06-24 | 2018-08-07 | Microsoft Technology Licensing, Llc | Extending digital artifacts through an interactive surface to a mobile device and creating a communication channel between a mobile device and a second mobile device via the interactive surface |
US9516151B2 (en) | 2007-02-13 | 2016-12-06 | Google Inc. | Modular wireless communicator |
US10027789B2 (en) | 2007-02-13 | 2018-07-17 | Google Llc | Modular wireless communicator |
US9680972B2 (en) | 2007-06-08 | 2017-06-13 | Google Inc. | SD switch box in a cellular handset |
US20130183955A1 (en) * | 2008-06-24 | 2013-07-18 | Uri Ron | Mobile phone locator |
US9510128B2 (en) * | 2008-06-24 | 2016-11-29 | Google Inc. | Mobile phone locator |
US20130117135A1 (en) * | 2009-11-27 | 2013-05-09 | Compurants Limited | Multi-user food and drink ordering system |
US20150149547A1 (en) * | 2013-11-27 | 2015-05-28 | Sharp Kabushiki Kaisha | Information processing system and information processing device |
US20150205434A1 (en) * | 2014-01-20 | 2015-07-23 | Canon Kabushiki Kaisha | Input control apparatus, input control method, and storage medium |
US10281997B2 (en) | 2014-09-30 | 2019-05-07 | Hewlett-Packard Development Company, L.P. | Identification of an object on a touch-sensitive surface |
WO2018090015A1 (en) * | 2016-11-14 | 2018-05-17 | The Museum Of The Bible, Inc. | Camera-to-screen pattern recognition system |
Also Published As
Publication number | Publication date |
---|---|
US8063888B2 (en) | 2011-11-22 |
US20080198138A1 (en) | 2008-08-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8063888B2 (en) | Identification of devices on touch-sensitive surface | |
US7818571B2 (en) | Securing wireless communications between devices | |
US8913885B2 (en) | Information provision system, server, terminal device, information provision method, display control method and recording medium | |
US20090176451A1 (en) | Encoded color information facilitating device pairing for wireless communication | |
US8509847B2 (en) | Connecting mobile devices via interactive input medium | |
US8446364B2 (en) | Visual pairing in an interactive display system | |
CA2796595C (en) | Approaches for device location and communication | |
US7874496B2 (en) | Optically readable tag | |
CN101971123A (en) | Interactive surface computer with switchable diffuser | |
US11797133B2 (en) | Display capable of interacting with an object | |
JP2017156856A (en) | Information processing device, server device, advertisement posting method, privilege awarding method, and program | |
TWI636381B (en) | Interactive display system and controlling method of interactive display | |
US20170329207A1 (en) | Tracking a handheld device on surfaces with optical patterns | |
US20200074172A1 (en) | Information processing device and information processing system | |
JP2005250858A (en) | Optical information reading device and automatic transaction device equipped therewith | |
US20080251584A1 (en) | Optically trackable tag | |
JP2018092659A (en) | Display unit and method for controlling display unit | |
GB2484979A (en) | Tracking and identifying physical objects in an interactive surface or vision system | |
JP2017156857A (en) | Beacon transmission device, communication device, beacon transmission method, coupon acquisition method, and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:034766/0509 Effective date: 20141014 |