WO2004064420A2

WO2004064420A2 - Arrangement for wireless interaction by a user with objects

Info

Publication number: WO2004064420A2
Application number: PCT/IB2003/006274
Authority: WO
Inventors: Wolfgang Otto Budde; Oliver Schreyer; Salvador Expedito Boleko Ribas
Original assignee: Philips Intellectual Property & Standards Gmbh; Koninklijke Philips Electronics N.V.
Priority date: 2003-01-10
Filing date: 2003-12-22
Publication date: 2004-07-29
Also published as: AU2003285722A1; WO2004064420A3; AU2003285722A8

Abstract

The invention relates to an arrangement for wireless interaction by a user (3) with objects (8a-8d). The user can select one of the objects (8a-8d) with a pointing device (5), whereupon a transmitter (2) transmits a directed beam (7) of communication signals to a receiver (9a) connected to the object. The receiver is able in this way to recognize the fact that it has been selected by the user (3) and to perform appropriate actions. On a semi-transparent display device (5), the user (3) can see the real objects and, at the same time, additional information (6) inserted by a data-processing device (1).

Description

Arrangement for wireless interaction by a user with objects

The invention relates to an arrangement for wireless interaction by a user with at least one object.

Interactions of this kind take place in many areas of application. In US patent 6,351,640 Bl, for example, there is described the communication between a mobile telephone and a called party whose address is initially unknown, wherein the mobile telephone can be pointed at the called party to make the connection. Other examples of interactions are, for example, the remote control of pieces of equipment or computer games involving a plurality of fellow players.

It is a characteristic of the examples mentioned that they involve a process of aiming in space to select an object with which an interaction is to take place. The aiming process, or in other words, the focusing of interest on a point, may for example be defined by the direction in which the user is looking. The direction in which he is looking can be found by movement detectors connected to the user's head, or by cameras that look at the user's eyes and by appropriate image processing. What is disadvantageous about these techniques however is that they cannot be employed under all circumstances and that they require a considerable amount of infrastructure.

Against this background, it is an object of the present invention to provide simple and at the same time reliable means for targeted wireless interaction by a user with at least one object.

This object is achieved by an arrangement having the features given in claim 1. Advantageous embodiments are contained in the dependent claims.

The arrangement according to the invention for wireless interaction by a user with at least one object comprises the following components:

- at least one receiver of wireless communication signals, which receiver is assigned to the object. The wireless communication signals may in particular be based on electromagnetic radiation in this case, which radiation preferably lies in the radio-frequency range and/or the infrared range. - a transmitter for the directional transmission of wireless communication signals, which transmitter is assigned to the user, the transmitter and the receiver being compatible in respect of the wireless communication signals.

- at least one data-processing unit, which is coupled to the receiver and/or the transmitter and is arranged for performing actions as a function of the current wireless communication connection between transmitter and receiver. The arrangement preferably comprises a data- processing unit that is coupled to the transmitter and a data-processing unit or units that is/are each coupled to the receiver(s). Alternatively, it may also comprise a data-processing unit that is coupled both to the transmitter and to the receiver(s). By means of the transmitter of the arrangement, it is possible for communication signals to be transmitted in a specific aimed direction in space (solid angle). If in this case there is a receiver in the transmission range, a connection for communications purposes can be made between the transmitter and receiver. What is important is that the data-processing unit is notified of the existence, and preferably of the quality too, of the communication connection and of the communication signals exchanged over it, to enable it to perform given actions as a function of the current wireless communication connection between transmitter and receiver. In particular, the data-processing unit may be activated in this way as a function of the direction in which the transmitter is aimed.

In a preferred embodiment of the arrangement, the latter comprises a pointing device for determining a direction of aim by the user, which device is coupled (directly or indirectly) to the transmitter, the transmitter being arranged to transmit wireless communication signals in the direction of aim determined by the pointing device. With the help of the pointing device, the user is thus able to preset a direction in which, by definition, his attention is directed. This direction of aim by the user can be confirmed, and the data- processing unit can be notified of it, by the subsequent emission of communication signals in this direction by the transmitter and by the reception of these signals by a receiver situated in the transmission beam. What is suitable as a pointing device in this case is any device by means of which a user can preset a given direction in space. Typical examples of mobile pointing devices are a touch-pad, a stylus and touch-screen or a joystick. In a preferred embodiment of the invention, the transmitter may be directed by the user in a desired direction (of transmission). What this means is that the transmitter also acts as a pointing device in the sense explained above and there is thus no need to have a separate pointing device. In another embodiment of the arrangement, the latter comprises a semitransparent display device coupled to the data-processing unit, the data-processing unit being arranged to show additional information at the (displayed) position of an object on the display device. Because of the semi-transparent nature of a display device of this kind, the user can look through it and see the actual objects in his field of vision. This vision of reality that he has can be enhanced with virtual elements ("additional information"). For example, the name of the object at which the pointing device is directed may be inserted on the display. In the embodiment described above, the data-processing unit is preferably also arranged to show a beam of wireless communication signals emitted by the transmitter on the display device. For example, the region of space through which, according to the calculations made by the data-processing unit, the beam of communication signals extends may be shown lighter or in a particular color on the display device. The direction in which the transmitter is currently aligned is made visible to the user in this way. What is more, the objects connected by the beam of communication signals may be shown as "interacting objects", e.g. by an "envelope" that contains both objects.

The at least one receiver of the arrangement may be coupled to a further local data-processing unit that is arranged to perform actions as a function of the current wireless communication connection between the transmitter and receiver. In this way it is possible for activities to be initiated on the spot at the receiver by the transmitter. The transmitter may also be arranged to emit wireless communication signals of different strengths that can be set. When this is the case, a user may initiate different actions by means of the signal strength of the signal that reaches an object. In the context of interactive games, the signal strength may represent the hardness of a blow in this case. In this connection, the transmitter and receiver are preferably arranged to exchange calibration signals with one another to allow the current communication connection to be checked. A specially identified calibration signal may, for example, be of a standard strength, relative to which all communication signals further received are standardized.

In another embodiment of the arrangement, it comprises a position- determining means, such as a GPS (Global Positioning System) receiver for example, that is coupled to the data-processing unit and by which the position of an object in space can be determined. The data-processing unit can make use of this knowledge of the position in space to allow quicker correlation and reaction when there is a directed transmission from the transmitter. In the following the invention is explained with the aid of Figures 1 and 2 by way of example. The two Figures show schematically the components of two embodiments of an arrangement according to the invention for wireless interaction by a user with different objects. In Fig. 1 can be seen a user 3 and various objects 8a, 8b, 8c, 8d arranged in the user's neighborhood. In one hand, the user 3 holds a pointing device 4 by pointing which he is able to indicate which of the objects mentioned his attention is directed to. A data- processing unit 1 coupled to the pointing device 4 finds the direction in which the latter is pointed and actuates a transmitter 2, which is also coupled to the data-processing unit, to emit a beam 7 of radio-frequency (or infrared) signals, in the direction that has been found, to the object 8a. A receiver 9a at object 8a is able to receive and analyze the communication signals contained in the beam 7. Since the receiver 9a too is coupled to the data-processing unit, it is able to notify the latter of the receipt of the communication signals. Similar receivers 9b, 9c and 9d are also mounted at the other objects 8b-8d. When use is made of radio-frequency signals, the wireless connection between the transmitter 2 and a receiver 9a-9d via the directional beam 7 may be accomplished by using multiple-antenna techniques and signal processing. Each object reached by the directed beam 7 from the transmitter 2 can react in a given way such as, for example, by making an associated connection, performing a given action or the like. Also shown in Fig. 1 is a display device 5 coupled to the data-processing unit

1. This is intended to be a semi-transparent display through which the user 3 can look to see the actual objects 8a-8d directly. The objects may also be other users having display devices in this case. The position of these objects on the display device 5 (which depends on the angle of viewing) is shown symbolically in the Figure. By using its knowledge of the object 8a on which the attention of the user 3 is focused, the data-processing unit 1 can display additional information 6, such as for example the name of the object, on the display device 5 at the position occupied by the object and/or can ensure that the object is shown highlighted. This enhanced representation of reality is highly advantageous particularly for interactive computer games. In contrast to arrangements employing so-called virtual reality, where the various co-players are only able to see artificial players (atavars) on their displays, the co- players are able to see their real selves on the display device 5. They are then able to point to a given co-player with a pointing device 4 and in this way initiate a specific action by the co- player in question. In another embodiment of the display device 5, the signal beam 7 too may be shown on the display device 5, in a manner suitable for a game or the like. Alternatively, objects that are "connected" by the beam 7 may be marked as taking part in the interaction.

Rather than by a personal pointing device 4, the focus of attention of the user 3 may also be established implicitly by assuming a standard direction in connection with the transmitter 2 and/or the display device 5. With regard to the display device 5, the standard direction could, for example, be the direction of a direct, central view through the display device.

Because the beam 7 of communication signals can be controlled not only in respect of the angle of emission but also, by controlling the transmitted power, in respect of its range, a distinction can be made, in the context of a game for example, between a blow, an ordinary touch, a light touch and so on, which makes it possible for entirely new games to be designed. To enable the signal strengths received by the receiver 9a-9d to be correctly interpreted in this case, calibrating signals are preferably exchanged. A calibration procedure enables a reliable distinction to be made between the "in the beam" and "outside the beam" situations and the strength of an interaction to be interpreted correctly. It may also be useful in this case for steps of signal strength to be defined in order to make the system robust against fading of the signal and/or interference.

It is also conceivable for the system to be extended to comprise a position- determining means (not shown) to enable the positions of the objects 8a-8d in space to be determined. This knowledge of the position of the objects, which are, if required, homed in on with the beam, may be useful to increase the response speed.

Shown in Fig. 2 is a modification of the system of Fig. 1, identical components being identified by the same reference numerals. In contrast to Fig. 1, in this case the data- processing unit 1 is coupled only to the transmitter 2, display device 5 and pointing device 4. The receivers 9a-9d at the objects 8a-8d are each coupled to data-processing units la, lb, lc and Id of their own. Otherwise, the operation of this system is similar to that of the system shown in Fig. 1. In a further embodiment of the system, information may be exchanged between the data-processing units 1, la, lb, lc and Id via the transmitter 2 and the receivers 9a-9d or via an independent wireless connection (not shown).

The system according to the invention shown in Fig. 1 or 2 bridges the gap between virtual reality type of user interfaces (which are used for example for games but also for professional applications such as remote-controlled surgery) and reality in an inexpensive way by using permanently available wireless communication sub-systems as a transmission medium for pointing operations.

The system according to the invention may be used in many different situations: - as any kind of user interface that calls for the current focus of the user's attention to be known and interpreted,

- for specific interactive games, in which the system according to the invention allows the other player to be addressed directly,

- for special shooting games ("gotcha"), - for training in the use of weapons of all kinds such as, for example, rifles (military, police, security). In this case a person "shoots" by emitting a directed beam and the target assesses whether or not it was hit and reacts accordingly. To prevent cheating in this case, a permanent check could be made for active receivers by the use of a special signal, which is emitted by a trainer, for example.

List of reference numerals

1, la-Id Data-processing unit

2 Transmitter

3 User

4 Pointing device

5 Display device

6 Additional information

7 Beam

8a-8d Object

9a-9d Receiver

Claims

CLAIMS:

1. An arrangement for wireless interaction by a user (3) with at least one object (8a-8d), comprising

- a receiver (9a-9d), assigned to the object (8a-8d), for receiving wireless communication signals,

- a transmitter (2), assigned to the user (3), for the directional transmission of wireless communication signals,

- at least one data-processing unit (1, la, lb, lc, Id) which is coupled to the receiver (9a-9d) and/or the transmitter (2) and is arranged for performing actions as a function of the current wireless communication connection between transmitter (2) and receiver (9a-9d).

2. An arrangement as claimed in claim 1 , characterized in that it comprises a pointing device (4) coupled to the transmitter (2) for determining a direction of aim by the user (3), the transmitter (2) being arranged for transmitting wireless communication signals in the direction of aim determined by the pointing device (4).

3. An arrangement as claimed in claim 1 or 2, characterized in that the transmitter (2) may be directed by the user (3).

4. An arrangement as claimed in any one of claims 1 to 3, characterized in that it comprises a semitransparent display device (5) coupled to the data-processing unit (1) and the data-processing unit (1) is arranged for showing on the display device additional information (6) at the position of an object.

5. An arrangement as claimed in claim 4, characterized in that the data- processing unit (1) is arranged for showing a beam (7) of wireless communication signals transmitted by the transmitter (2) on the display device (5).

6. An arrangement as claimed in any one of claims 1 to 5, characterized in that the receiver (9a-9d) is coupled to a local data-processing unit (1, lb, lc, 1) that is arranged for performing actions as a function of the current wireless communication connection between transmitter (2) and receiver (9a-9d).

7. An arrangement as claimed in any one of claims 1 to 6, characterized in that the transmitter (2) is arranged for transmitting wireless communication signals of different strengths.

8. An arrangement as claimed in any one of claims 1 to 7, characterized in that the transmitter (2) and receiver (9a-9d) are arranged for exchanging calibration signals to allow the current communication connection to be checked.

9. An arrangement as claimed in any one of claims 1 to 8, characterized in that the wireless communication signals are based on electromagnetic radiation, which radiation is in particular in the radio-frequency range and/or the infrared range.

10. An arrangement as claimed in any one of claims 1 to 9, characterized in that it comprises a position-determining means, coupled to the data-processing unit (1), for determining the position of the object (8a-8d) in space.