WO2007023447A1 - Communication system and method, and mobile device - Google Patents

Communication system and method, and mobile device Download PDF

Info

Publication number
WO2007023447A1
WO2007023447A1 PCT/IB2006/052887 IB2006052887W WO2007023447A1 WO 2007023447 A1 WO2007023447 A1 WO 2007023447A1 IB 2006052887 W IB2006052887 W IB 2006052887W WO 2007023447 A1 WO2007023447 A1 WO 2007023447A1
Authority
WO
WIPO (PCT)
Prior art keywords
light
light emitting
emitting means
detecting means
phone
Prior art date
Application number
PCT/IB2006/052887
Other languages
French (fr)
Inventor
Paul M. Fulton
David P. Walker
Alan J. Davie
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Publication of WO2007023447A1 publication Critical patent/WO2007023447A1/en

Links

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • A63F13/12—
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/23—Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console
    • A63F13/235—Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console using a wireless connection, e.g. infrared or piconet
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/16—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using electromagnetic waves other than radio waves
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/16—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using electromagnetic waves other than radio waves
    • G01S5/163—Determination of attitude
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/02—Constructional features of telephone sets
    • H04M1/22—Illumination; Arrangements for improving the visibility of characters on dials
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72412—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72427—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting games or graphical animations
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
    • A63F2300/1093—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera using visible light
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/20—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform
    • A63F2300/204—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform the platform being a handheld device
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/30—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/40—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of platform network
    • A63F2300/404—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of platform network characterized by a local network connection
    • A63F2300/405—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of platform network characterized by a local network connection being a wireless ad hoc network, e.g. Bluetooth, Wi-Fi, Pico net
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/6045—Methods for processing data by generating or executing the game program for mapping control signals received from the input arrangement into game commands

Definitions

  • This invention relates to a communication system, a communication method and to a mobile device.
  • the invention has an application in a visual positioning system for mobile phones.
  • a major innovation driving the design of mobile phones is the integration of cameras for photography and video capture.
  • the processors in the phones are becoming much more powerful to be able to deal with these input streams, which in turn broadens the scope of applications that can be run on the phones, particularly in the gaming area.
  • Image capture systems are widely used for motion capture tasks, and generally work by attaching special tags to the objects whose motion is to be tracked. These may take the form of different shapes of barcodes, stickers showing recognisable shapes, or reflective labels. An example of this is the Augmented Reality system at the Hong Kong Polytechnic University Multimedia Innovation Centre http://www.rnic.polyu.edu.hk/ar/. In general, these tags are intended for specialised use, and would not be appropriate for integrating in CE products or mobile phones, principally for aesthetic reasons.
  • European Patent Application Publication 1340999 discloses a method and apparatus for identifying the position of an object.
  • the position of an object is identified by precisely fixing a bracket of a predetermined size to the object.
  • the bracket has a plurality of substantially point-sized light sources or reflectors affixed thereto in a predetermined arrangement.
  • the position of the light sources is sensed in two-dimensions relative to the optical axis of a sensing device.
  • the position data received from the sensing device is processed to identify relative positions of the light sources.
  • the position of the object is identified by referring to the predetermined arrangement of the light sources.
  • the system is disclosed as being applicable to the checking of aircraft parts to ensure that the parts are correctly aligned.
  • the system disclosed in this document while suitable for checking the two dimensional alignment of an object, does not support three dimensional or distance measurement, and does not provide for the identification of the object being observed.
  • a communication system comprising first and second devices, the first device comprising a body and light emitting means, the light emitting means arranged to change operation in a predefined manner, the second device comprising a body, a processor and light detecting means, the light detecting means arranged to detect the light emitted from the light emitting means of the first device, the processor arranged to receive an output from the light detecting means and to calculate accordingly the position and identity of the first device.
  • a communication method comprising emitting light from a first device, the emitting changing operation in a predefined manner, detecting the light emitted at a second device and calculating accordingly the position and identity of the first device.
  • a mobile device comprising a body, light emitting means, the light emitting means arranged to change operation in a predefined manner, a processor and light detecting means, the light detecting means, the processor arranged to receive an output from the light detecting means.
  • a mobile device can perform identification of another device through line of sight, and gather information on the orientation of the detected device.
  • the change in operation of the light emitting means in a predefined manner (such as flashing or changing colour) communicates the identity of that device to any observing device.
  • the invention improves the image recognition capabilities of phones to enable games and applications that allow the user to interact with the environment and other nearby phone users.
  • This invention provides, in one embodiment, for a type of visual identification tag that is attached to devices so that a camera equipped mobile phone may perform image recognition, depth extraction and motion tracking on them.
  • the invention allows accurate location and tracking of other phones and nearby devices.
  • it is particularly useful feature for multi-user gaming, as it allows overlay of graphics or text onto the image to indicate which phones (and therefore which people) are being used in the game.
  • This invention improves the image recognition capabilities of a mobile phone by visually tagging devices and making it far easier to extract and identify other phones from the image. Additionally, the invention makes it easier to extract depth and orientation information about the mobile phones shown in the images. This is important for making games that allow a user to interact with the environment, perhaps only allowing interaction with other phone users who are very close or facing one another.
  • a further benefit of the system is that image recognition is made more secure.
  • the visual tagging system to be described can be switched on and off at the command of the mobile phones involved. This allows the system to check that the phone that is involved in the current game running over a wireless link is actually the one highlighted on the screen. All that is necessary is for the visual identification system to be flashed on and off with an identification sequence that only the desired phone would know.
  • the invention requires some kind of visual tag to be placed on mobile phones to make them easier to spot in video images.
  • the phones themselves must have video cameras to do the image capture, processors powerful enough to perform image recognition in real time and support short range wireless links to allow convenient multi-user gaming.
  • the tag may be a system of LEDs in a particular arrangement, either point (circular LEDs) or non-point light sources, or could instead be a series of images shown on a display on the back of the phone (on the assumption that the front of the phone faces the owner of the phone whilst in use, and therefore a front view of the phone is not usually available to others).
  • the visual tag must be placed so that it is not obscured by the user in normal operation, so perhaps on the back of the case at the top.
  • the visual tag may be made obvious to the user so that they may cover it up with their hand if they want to temporarily disable it.
  • Figure 1 is a schematic perspective view of the rear of a mobile device
  • Figure 2 is a diagram of an arrangement of rectangular light sources, shown in four different positions,
  • Figure 3 is a schematic view of a communication system including the device of Figure 1 .
  • Figure 4 is a flowchart of a communication method.
  • Figure 1 shows a mobile device 10, which comprises a body 12 and light emitting means 14.
  • the light emitting means 14 is a non-point light source, and comprises a plurality of rectangular light sources 16 arranged in a predetermined triangular pattern.
  • the mobile device also has other components, omitted from Figure 1 for reasons of clarity. These components include a processor, a short-range wireless transceiver and light detecting means, the processor arranged to receive an output from the light detecting means.
  • the light sources 16 are arranged to change operation in a predefined manner, in one embodiment, the change in operation of the light emitting means 14 comprises flashing according to a predetermined pattern.
  • the three light sources 16 (LEDs) are built into the back of the phone 10 in a triangular arrangement. This allows extraction of information about the three-dimensional orientation and location of the phone 10 just from a single two-dimensional image, when another device is viewing the lighting emitting means 14. For another device to be able to determine the position of the mobile device 10, the exact dimensions of the light emitting means 14 must be known, either from standardising to a single arrangement or from data transfer of size details to the viewing device provided with a camera.
  • Figure 2 shows how the perception of the triangular arrangement 14 of light sources 16 will change according to the change in position of the mobile device 10.
  • the device that is observing the light sources 16 can use the information received to determine the position of the phone 10.
  • the rotation of the device 10, whether on the x-, y- or z-axis or any combination of these, will result in a perceived movement of one or more of the light sources 16.
  • the change in depth of the phone 10 relative to the observing device will be perceived as a change in size of the light sources 16.
  • any one of the LEDs 16 may also be used to transfer visual identification when the device with the camera wants to authenticate the phone 12 it can both see and communicate with.
  • This can be used in situations involving 2 or more mobile phones, as shown in, for example, Figure 3, where the different devices form part of a communication system.
  • the mobile device 10 with its light emitting means 14 is observed by light detecting means 20 on an observing device 18.
  • Both devices are mobile phones and include short-range wireless transceivers 22 for short-range wireless communication, which can be utilised for direct communication between the two mobile devices 10 and 18.
  • the LEDs 16 flash an identification code back towards the phone 18 containing the camera 20.
  • the blinking LEDS 14 are extracted from the image acquired by the camera 20, and the identification code contained within the sequence is checked with data from the wireless link.
  • An alternative method of operation is to have the LEDs 16 for a particular device provide a continuously available unique visual identifier. Combinations of different flashing frequencies would help devices to be distinguished from one another, as would different colours of LED. In this way, devices could be identified without any data exchange over the wireless link, and the use of the wireless link becomes completely optional in this embodiment of the communication system.
  • the second device 18 includes a processor 24 connected to the light detecting means 20, the light detecting means 20 being arranged to detect the light 26 emitted from the light emitting means 14 of the first device 10.
  • the processor 24 is arranged to receive an output from the light detecting means 20 and to calculate accordingly the position and identity of the first device 10. Multiple devices can be detected, identified and have their position determined by the device 18.
  • Figure 4 summarises the communication method that occurs when a first device has a line of sight to a second device that has the light emitting means 14 turned on and is potentially participating in the communication system.
  • a first device emits light, at step 410, which is detected by a second device, at step 412.
  • the second device uses the received information to calculate the position (via rotation and depth information) and identity of the first device (step 414).
  • step 416) a short-range wireless connection between the two devices may have been established.
  • An alternative embodiment to the use of the individual LEDs uses a second display on the back of the phone 10 to shown visual identification symbols, although this is probably only useful where the second display exists already.
  • a further possibility for a low-cost embodiment is that the light from the phone's backlight is reused to generate the visual tag, by channelling the light to create a recognisable shape of array of dots on the back of the phone. It could even be switched on and off to aid with identification, and let the user know that someone was trying to identify them. This reduces the requirement for further specific light sources to be used in the device 10.
  • the visual identification can be used for other applications such as navigation or Head-Up-Display type overlay of information.
  • the visual tagging system could be used for devices other than mobile phones. For example, it would allow phones to be easily and reliably paired to household devices like videos, hi-fis or lights for remote control applications.
  • the visual nature of the system requires a line-of-sight path to exist at the time of pairing, enhancing security.
  • a first participant launches a "Creature Battle" game on his new phone and holds his phone up.
  • the video camera is on and he can see everyone around him on the screen.
  • Leo has a virtual pet residing in his phone, and wants to find someone else to battle against to make it stronger.
  • the game tells him that there are several other creatures in the room (they have been detected using the wireless link of the phone). Now all he needs to do is find them.
  • He sees that a second participant has their phone out, and points the camera towards them.
  • the first participant can see the virtual creature superimposed on the camera image, just where the second participant's phone is.
  • the first player can initiate a challenge, and the game begins.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Electromagnetism (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Optical Communication System (AREA)
  • Telephone Function (AREA)

Abstract

A communication system comprises first and second devices. The first device comprises a body and light emitting means, the light emitting means arranged to change operation in a predefined manner. The second device comprises a body, a processor and light detecting means, the light detecting means arranged to detect the light emitted from the light emitting means of the first device, and the processor arranged to receive an output from the light detecting means and to calculate accordingly the position and identity of the first device.

Description

DESCRIPTION
COMMUNICATION SYSTEM AND METHOD, AND MOBILE DEVICE
This invention relates to a communication system, a communication method and to a mobile device. The invention has an application in a visual positioning system for mobile phones.
A major innovation driving the design of mobile phones is the integration of cameras for photography and video capture. The processors in the phones are becoming much more powerful to be able to deal with these input streams, which in turn broadens the scope of applications that can be run on the phones, particularly in the gaming area. Image capture systems are widely used for motion capture tasks, and generally work by attaching special tags to the objects whose motion is to be tracked. These may take the form of different shapes of barcodes, stickers showing recognisable shapes, or reflective labels. An example of this is the Augmented Reality system at the Hong Kong Polytechnic University Multimedia Innovation Centre http://www.rnic.polyu.edu.hk/ar/. In general, these tags are intended for specialised use, and would not be appropriate for integrating in CE products or mobile phones, principally for aesthetic reasons.
A second example of a similar system is disclosed in European Patent Application Publication 1340999, which discloses a method and apparatus for identifying the position of an object. The position of an object is identified by precisely fixing a bracket of a predetermined size to the object. The bracket has a plurality of substantially point-sized light sources or reflectors affixed thereto in a predetermined arrangement. The position of the light sources is sensed in two-dimensions relative to the optical axis of a sensing device. The position data received from the sensing device is processed to identify relative positions of the light sources. The position of the object is identified by referring to the predetermined arrangement of the light sources. The system is disclosed as being applicable to the checking of aircraft parts to ensure that the parts are correctly aligned. The system disclosed in this document, while suitable for checking the two dimensional alignment of an object, does not support three dimensional or distance measurement, and does not provide for the identification of the object being observed.
It is therefore an object of the invention to improve upon the known art. According to a first aspect of the present invention, there is provided a communication system comprising first and second devices, the first device comprising a body and light emitting means, the light emitting means arranged to change operation in a predefined manner, the second device comprising a body, a processor and light detecting means, the light detecting means arranged to detect the light emitted from the light emitting means of the first device, the processor arranged to receive an output from the light detecting means and to calculate accordingly the position and identity of the first device.
According to a second aspect of the present invention, there is provided a communication method comprising emitting light from a first device, the emitting changing operation in a predefined manner, detecting the light emitted at a second device and calculating accordingly the position and identity of the first device.
According to a third aspect of the present invention, there is provided a mobile device comprising a body, light emitting means, the light emitting means arranged to change operation in a predefined manner, a processor and light detecting means, the light detecting means, the processor arranged to receive an output from the light detecting means.
Owing to the invention, it is possible to provide a system whereby a mobile device can perform identification of another device through line of sight, and gather information on the orientation of the detected device. The change in operation of the light emitting means in a predefined manner (such as flashing or changing colour) communicates the identity of that device to any observing device. The invention improves the image recognition capabilities of phones to enable games and applications that allow the user to interact with the environment and other nearby phone users.
This invention provides, in one embodiment, for a type of visual identification tag that is attached to devices so that a camera equipped mobile phone may perform image recognition, depth extraction and motion tracking on them. As part of an overall positioning system including RF range measurement components, the invention allows accurate location and tracking of other phones and nearby devices. On its own, it is particularly useful feature for multi-user gaming, as it allows overlay of graphics or text onto the image to indicate which phones (and therefore which people) are being used in the game.
This invention improves the image recognition capabilities of a mobile phone by visually tagging devices and making it far easier to extract and identify other phones from the image. Additionally, the invention makes it easier to extract depth and orientation information about the mobile phones shown in the images. This is important for making games that allow a user to interact with the environment, perhaps only allowing interaction with other phone users who are very close or facing one another.
A further benefit of the system is that image recognition is made more secure. The visual tagging system to be described can be switched on and off at the command of the mobile phones involved. This allows the system to check that the phone that is involved in the current game running over a wireless link is actually the one highlighted on the screen. All that is necessary is for the visual identification system to be flashed on and off with an identification sequence that only the desired phone would know.
The invention requires some kind of visual tag to be placed on mobile phones to make them easier to spot in video images. The phones themselves must have video cameras to do the image capture, processors powerful enough to perform image recognition in real time and support short range wireless links to allow convenient multi-user gaming.
The tag may be a system of LEDs in a particular arrangement, either point (circular LEDs) or non-point light sources, or could instead be a series of images shown on a display on the back of the phone (on the assumption that the front of the phone faces the owner of the phone whilst in use, and therefore a front view of the phone is not usually available to others). The visual tag must be placed so that it is not obscured by the user in normal operation, so perhaps on the back of the case at the top. The visual tag may be made obvious to the user so that they may cover it up with their hand if they want to temporarily disable it.
Embodiments of the present invention will now be described, by way of example only, with reference to the accompanying drawings, in which:-
Figure 1 is a schematic perspective view of the rear of a mobile device,
Figure 2 is a diagram of an arrangement of rectangular light sources, shown in four different positions,
Figure 3 is a schematic view of a communication system including the device of Figure 1 , and
Figure 4 is a flowchart of a communication method.
Figure 1 shows a mobile device 10, which comprises a body 12 and light emitting means 14. The light emitting means 14 is a non-point light source, and comprises a plurality of rectangular light sources 16 arranged in a predetermined triangular pattern. The mobile device also has other components, omitted from Figure 1 for reasons of clarity. These components include a processor, a short-range wireless transceiver and light detecting means, the processor arranged to receive an output from the light detecting means.
The light sources 16 are arranged to change operation in a predefined manner, in one embodiment, the change in operation of the light emitting means 14 comprises flashing according to a predetermined pattern. The three light sources 16 (LEDs) are built into the back of the phone 10 in a triangular arrangement. This allows extraction of information about the three-dimensional orientation and location of the phone 10 just from a single two-dimensional image, when another device is viewing the lighting emitting means 14. For another device to be able to determine the position of the mobile device 10, the exact dimensions of the light emitting means 14 must be known, either from standardising to a single arrangement or from data transfer of size details to the viewing device provided with a camera. Figure 2 shows how the perception of the triangular arrangement 14 of light sources 16 will change according to the change in position of the mobile device 10. The device that is observing the light sources 16 can use the information received to determine the position of the phone 10. The rotation of the device 10, whether on the x-, y- or z-axis or any combination of these, will result in a perceived movement of one or more of the light sources 16. The change in depth of the phone 10 relative to the observing device will be perceived as a change in size of the light sources 16.
Any one of the LEDs 16 may also be used to transfer visual identification when the device with the camera wants to authenticate the phone 12 it can both see and communicate with. This can be used in situations involving 2 or more mobile phones, as shown in, for example, Figure 3, where the different devices form part of a communication system. Here the mobile device 10 with its light emitting means 14 is observed by light detecting means 20 on an observing device 18. Both devices are mobile phones and include short-range wireless transceivers 22 for short-range wireless communication, which can be utilised for direct communication between the two mobile devices 10 and 18.
After the phones 10 and 18 have made contact over a short range wireless link (such as Bluetooth or Zigbee, or even Near Field Communication, NFC), the LEDs 16 flash an identification code back towards the phone 18 containing the camera 20. The blinking LEDS 14 are extracted from the image acquired by the camera 20, and the identification code contained within the sequence is checked with data from the wireless link.
An alternative method of operation is to have the LEDs 16 for a particular device provide a continuously available unique visual identifier. Combinations of different flashing frequencies would help devices to be distinguished from one another, as would different colours of LED. In this way, devices could be identified without any data exchange over the wireless link, and the use of the wireless link becomes completely optional in this embodiment of the communication system.
The second device 18 includes a processor 24 connected to the light detecting means 20, the light detecting means 20 being arranged to detect the light 26 emitted from the light emitting means 14 of the first device 10. The processor 24 is arranged to receive an output from the light detecting means 20 and to calculate accordingly the position and identity of the first device 10. Multiple devices can be detected, identified and have their position determined by the device 18.
Figure 4 summarises the communication method that occurs when a first device has a line of sight to a second device that has the light emitting means 14 turned on and is potentially participating in the communication system. A first device emits light, at step 410, which is detected by a second device, at step 412. The second device uses the received information to calculate the position (via rotation and depth information) and identity of the first device (step 414). In parallel (step 416) a short-range wireless connection between the two devices may have been established.
An alternative embodiment to the use of the individual LEDs uses a second display on the back of the phone 10 to shown visual identification symbols, although this is probably only useful where the second display exists already.
A further possibility for a low-cost embodiment is that the light from the phone's backlight is reused to generate the visual tag, by channelling the light to create a recognisable shape of array of dots on the back of the phone. It could even be switched on and off to aid with identification, and let the user know that someone was trying to identify them. This reduces the requirement for further specific light sources to be used in the device 10.
This is an enhancement for mobile phones with cameras, particularly those with good gaming capabilities. The visual identification can be used for other applications such as navigation or Head-Up-Display type overlay of information. The visual tagging system could be used for devices other than mobile phones. For example, it would allow phones to be easily and reliably paired to household devices like videos, hi-fis or lights for remote control applications. The visual nature of the system requires a line-of-sight path to exist at the time of pairing, enhancing security.
An example of how the system could form part of a new mobile phone game between two people is as follows. A first participant launches a "Creature Battle" game on his new phone and holds his phone up. The video camera is on and he can see everyone around him on the screen. Leo has a virtual pet residing in his phone, and wants to find someone else to battle against to make it stronger. The game tells him that there are several other creatures in the room (they have been detected using the wireless link of the phone). Now all he needs to do is find them. He sees that a second participant has their phone out, and points the camera towards them. The first participant can see the virtual creature superimposed on the camera image, just where the second participant's phone is. The first player can initiate a challenge, and the game begins.

Claims

1. A communication system comprising first and second devices, the first device (10) comprising a body (12) and light emitting means (14), the light emitting means (14) arranged to change operation in a predefined manner, the second device (18) comprising a body (12), a processor (24) and light detecting means (20), the light detecting means (20) arranged to detect the light emitted from the light emitting means (14) of the first device (10), the processor (24) arranged to receive an output from the light detecting means (20) and to calculate accordingly the position and identity of the first device (10).
2. A system according to claim 1 , wherein the light emitting means (14) comprises a plurality of rectangular light sources (16) arranged in a predetermined pattern.
3. A system according to claim 1 , wherein the light emitting means (14) comprises a display device.
4. A system according to claim 1 , 2 or 3, wherein the change in operation of the light emitting means (14) comprises flashing according to a predetermined pattern.
5. A system according to any preceding claim, wherein the first and second devices (10, 18) are provided with respective short-range wireless transceivers (22).
6. A communication method comprising emitting (410) light from a first device (10), the emitting changing operation in a predefined manner, detecting (412) the light emitted at a second device (18) and calculating (414) accordingly the position and identity of the first device (10).
7. A method according to claim 6, wherein the light is emitted from a plurality of rectangular light sources (16) arranged in a predetermined pattern.
8. A method according to claim 6, wherein the light is emitted from a display device.
9. A method according to claim 6, 7 or 8, wherein the emitting changing operation comprises flashing according to a predetermined pattern.
10. A method according to any one of claims 6 to 9, and further comprising communicating (416) over a short-range wireless link.
1 1. A mobile device comprising a body (12), light emitting means (14), the light emitting means (14) arranged to change operation in a predefined manner, a processor (24) and light detecting means (20), the light detecting means (20), the processor (24) arranged to receive an output from the light detecting means (20).
12. A device according to claim 11 , wherein the light emitting means
(14) comprises a plurality of rectangular light sources (16) arranged in a predetermined pattern.
13. A device according to claim 11 , wherein the light emitting means (14) comprises a display device.
14. A device according to claim 1 1 , 12 or 13, wherein the change in operation of the light emitting means (14) comprises flashing according to a predetermined pattern.
15. A device according to any one of claims 1 1 to 14, and further comprising a short-range wireless transceiver (22).
PCT/IB2006/052887 2005-08-22 2006-08-21 Communication system and method, and mobile device WO2007023447A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP05107700.6 2005-08-22
EP05107700 2005-08-22

Publications (1)

Publication Number Publication Date
WO2007023447A1 true WO2007023447A1 (en) 2007-03-01

Family

ID=37478926

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2006/052887 WO2007023447A1 (en) 2005-08-22 2006-08-21 Communication system and method, and mobile device

Country Status (1)

Country Link
WO (1) WO2007023447A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009106919A1 (en) 2008-02-29 2009-09-03 Sony Ericsson Mobile Communications Ab Wireless communication terminals and methods that display relative direction and distance therebetwee responsive to acceleration data

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000029621A (en) * 1998-07-10 2000-01-28 Sony Corp Computer system
JP2000132329A (en) * 1998-10-27 2000-05-12 Sony Corp Device and method for recognizing surface and virtual image solid synthesizer
EP1324578A2 (en) * 2001-12-27 2003-07-02 Sanyo Electric Co., Ltd. Communication apparatus having a light emitting unit that emits light in a variety of colors
EP1542436A1 (en) * 2003-12-08 2005-06-15 Dialog Semiconductor GmbH Light show ASIC
EP1551171A1 (en) * 2003-12-31 2005-07-06 Mitel Networks Corporation Self-discovery method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000029621A (en) * 1998-07-10 2000-01-28 Sony Corp Computer system
JP2000132329A (en) * 1998-10-27 2000-05-12 Sony Corp Device and method for recognizing surface and virtual image solid synthesizer
EP1324578A2 (en) * 2001-12-27 2003-07-02 Sanyo Electric Co., Ltd. Communication apparatus having a light emitting unit that emits light in a variety of colors
EP1542436A1 (en) * 2003-12-08 2005-06-15 Dialog Semiconductor GmbH Light show ASIC
EP1551171A1 (en) * 2003-12-31 2005-07-06 Mitel Networks Corporation Self-discovery method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
PATENT ABSTRACTS OF JAPAN *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009106919A1 (en) 2008-02-29 2009-09-03 Sony Ericsson Mobile Communications Ab Wireless communication terminals and methods that display relative direction and distance therebetwee responsive to acceleration data
JP2011518452A (en) * 2008-02-29 2011-06-23 ソニー エリクソン モバイル コミュニケーションズ， エービー Wireless communication terminal and method for displaying relative direction and distance between wireless communication terminals according to acceleration data
US8000721B2 (en) 2008-02-29 2011-08-16 Sony Ericsson Mobile Communications Ab Wireless communication terminals and methods that display relative direction and distance therebetween responsive to acceleration data

Similar Documents

Publication Publication Date Title
US11488366B2 (en) Augmented reality lighting effects
US12115444B2 (en) System and methods for increasing guest engagement at a destination
US10395116B2 (en) Dynamically created and updated indoor positioning map
US10656731B2 (en) Peripheral device for head-mounted display
CN105264548B (en) For generating the label inconspicuous of augmented reality experience
JP6214828B1 (en) Docking system
US10663729B2 (en) Peripheral device for head-mounted display
US20180293593A1 (en) Camera based location commissioning of electronic shelf labels
US8890657B2 (en) System and method for operating an RFID system with head tracking
US20110043496A1 (en) Display device
US20130201215A1 (en) Accessing applications in a mobile augmented reality environment
US11455484B1 (en) Wearable device
US20180196505A1 (en) Head-mounted display device, computer program, and control method for head-mounted display device
US20170308157A1 (en) Head-mounted display device, display system, control method for head-mounted display device, and computer program
US10177848B1 (en) Visual light communication using starburst or haze of the light source
EP3510522B1 (en) A method of locating a mobile device in a group of mobile devices
CN109644052A (en) Data processing and certification to optic communication source
US10495450B2 (en) Imaging system, imaging device, method of imaging, and storage medium for imaging an object using at least one detector
CN108139462A (en) Ranging is imaged
JP2008026236A (en) Position and attitude measuring instrument, and position and attitude measuring method
JPWO2007013260A1 (en) Work system and work instruction method in work system
WO2017222685A1 (en) System and method for intelligent tagging and interface control
US20170004806A1 (en) Method and apparatus to enable smartphones and computer tablet devices to communicate with interactive devices
NO20120982A1 (en) Device, system and method for identifying objects in a digital image, as well as transponder device
EP2767845B1 (en) Augmented reality system with encoding beacons

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06795719

Country of ref document: EP

Kind code of ref document: A1