WO2009153708A1

WO2009153708A1 - Programming system and method for programming an interactive system

Info

Publication number: WO2009153708A1
Application number: PCT/IB2009/052466
Authority: WO
Inventors: Markus G. L. M. Van Doorn
Original assignee: Koninklijke Philips Electronics N. V.
Priority date: 2008-06-18
Filing date: 2009-06-10
Publication date: 2009-12-23
Also published as: TW201005582A

Abstract

The invention describes programming system (13) for programming an interactive system (21). It comprises a tag controlarrangement (15) with a smart tag communication interface (19) and a set of individual smart tags (1a, 1a’, 1a’’; 1b, 1b’, 1b’’; 1c, 1c’, 1c’’; 1d’, 1d’’; 1e’, 1e’’; 1f’, 1f’’; 1g’, 1g’’) each comprising a control arrangement communication interface (7, 7a; 7b, 7c, 7d), an assignment interface (9) for assignment of functional properties (FP _a, FP_b, FP_c, FP_d ) to it, a display (11) for displaying information concerning the functional properties (FP _a, FP_b, FP_c, FP_d ). The programming system is realized such that a control sequence (CS) for the interactive system (21) is based on the functional properties (FP_a, FP_b, FP_c, FP_d ) assigned to the smart tags (1a, 1a’, 1a’’; 1b, 1b’, 1b’’; 1c, 1c’, 1c’’; 1d’, 1d’’; 1e’, 1e’’; 1f’, 1f’’; 1g’, 1g’’) during a programming session. Furthermore, the invention describes a method for programming an interactive system (21), a smart tag (1a, 1a’, 1a’’; 1b, 1b’, 1b’’; 1c, 1c’, 1c’’; 1d’, 1d’’; 1e’, 1e’’; 1f’, 1f’’; 1g’, 1g’’), a set of smart tags (1a, 1a’, 1a’’; 1b, 1b’, 1b’’; 1c, 1c’, 1c’’; 1d’, 1d’’; 1e’, 1e’’; 1f’, 1f’’; 1g’, 1g’’),a tag controlarrangement (15), an interactive system (21), the use of a smart tag (1a, 1a’, 1a’’; 1b, 1b’, 1b’’; 1c, 1c’, 1c’’; 1d’, 1d’’; 1e’, 1e’’; 1f’, 1f’’; 1g’, 1g’’) for programming an interactive system (21) and a computer programme product.

Description

PROGRAMMING SYSTEM AND METHOD FOR PROGRAMMING AN INTERACTIVE SYSTEM

FIELD OF THE INVENTION

The invention describes a programming system for programming an interactive system and a method for programming such system. Furthermore it describes a smart tag, a set of smart tags and a tag control arrangement which may be used in such a method as well as the use of such smart tag, an interactive system and a computer programme product.

BACKGROUND OF THE INVENTION

Programming interactive systems such as systems in which a user interacts with electric or electronic components in a home environment is usually carried out by programmers with the help of programming software using a specific programming language. The programmer, who has to have good knowledge of the programming language and systematic, would normally use a computer with a graphical user interface to generate a control sequence which represents a set of possible events and of possible reactions by the interactive system to those events. Such possible events can be may be realized for example by sensor inputs, i. e. by signals generated by sensors as a reaction to certain interactions of a user with other parts of the interactive system. Generally, an interactive system is a collection of input and output units or devices which are controlled by a central unit and which are in potential interaction with at least one user. Input units will usually be sensors of any kind which sense the actions of the user and/or the user's nature, e. g. whether the user is a customer or a shop assistant. Typical input units may be microphones, touch sensors, switches, buttons, keyboards, computer mouses, infrared sensors or cameras. The input units may also comprise suitable analysing means for analysing and/or interpreting the sensor signals, i. e. speech recognition units or image recognition units. As output units, many devices can be used, e. g. media devices such as TV screens or loudspeakers, lighting devices such as light spots or laser pointers, and other service device amongst which count heaters, ventilators and many more. The units or devices of the interactive system may be separated and connected (by wire or wireless) by suitable means to interact with each other, but an interactive system may also be a single stand alone device comprising all necessary units.

A possibility to simplify such programming of interactive system would be by the use of so-called tangible user interfaces. In this context, physical objects are used to represent functional properties. The actions performed with these physical objects are recorded by a programming system and transferred into a similar control sequence as would be generated by a programmer.

The aim in the context of such tangible user interfaces is to make it possible for the common user, i.e. a layperson in computing, to program control sequences by oneself instead of asking a specialist to do that programming for him. For that purpose, it is of utmost importance that the programming system be kept as simple and instructive as possible. In particular, the user needs to be informed about what the programming system records and what it does not record.

It is an object of the invention to provide a simpler and more instructive method and programming system for programming an interactive system.

SUMMARY OF THE INVENTION

To this end, the present invention describes a programming system for programming an interactive system, which programming system comprises a tag control arrangement with a smart tag communication interface and a set of individual smart tags each comprising:

- a control arrangement communication interface, - an assignment interface for assignment of functional properties to it,

- a display for displaying information concerning the functional properties, whereby the programming system is realized such that a control sequence for the interactive system is based on the functional properties assigned to the smart tags during a programming session.

Functional properties, as will be explained below in much more detail, may comprise a huge variety of physical and non-physical characteristics. A very typical such property would be a role, such as the role of an actor or of a particular object, which can be assigned to a smart tag. However, functional properties also include command inputs and many more characteristics as explained later.

In the context of the invention, a special focus is put on smart tags. Commonly, smart tags today are considered to be so-called RFID (radio frequency identification) tags equipped with a microchip and an antenna array by which a smart tag reader can interact with the smart tag by a wireless connection. However, smart tags in the context of the invention must be defined in a broader way: They comprise any kind of communication device which can be used to represent objects and/or subjects in an interactive system or a programming system.

To this end, a smart tag for a programming system according to the invention comprises at least

- an assignment interface for assignment of functional properties to it, - a display for displaying information concerning the functional properties,

- a control arrangement communication interface, which control arrangement communication interface is realized such that it transfers such information to the control arrangement that the control arrangement can associate the smart tag with the assigned functional properties.

Within this framework, a smart tag according to the invention comprises a special control arrangement interface. Through this interface a set of information can be transferred and this set of information is such that a tag control arrangement can associate the smart tag with functional properties. This can be realized for example by a control arrangement interface through which information concerning the functional properties is transmitted in combination with identity information of the smart tag, i.e. an identification number or code. The transmittal of both of these pieces of information can be done simultaneously or one after the other, however always in such way that a receiving unit such as the tag control arrangement can detect both pieces of information as being from the same source, i.e. the same smart tag. The invention also comprises a set of smart tags for use in the context of a programming system for programming an interactive system, whereby at least one of the smart tags is a smart tag as just described.

Such set of smart tags comprises at least one smart tag, but preferably more. Each smart tag has a connection to the tag control arrangement via its control arrangement communication interface. This way, the functional properties assigned to the smart tag can be communicated to the tag control arrangement. Functional properties comprise any characteristics or definition of a function or of several functions.

Apart from smart tags which comprise all the components described, additional simpler smart tags can be used for simpler purposes within the context of a programming session. For example, they may constitute stationary objects with a pre- assigned functionality.

The control arrangement communication interface can be part of any connection between the smart tag and the tag control arrangement, however, it is preferably a wireless transmission means such as an antenna device and thus part of an air interface.

In addition to those principal elements of smart tags, the aforementioned smart tags according to the invention also comprise an assignment interface and a display for displaying information. These two elements serve to simplify the programming system inasmuch as functional properties can be assigned to each smart tag via such assignment interface and information concerning these functional properties can be displayed on the display. For that purpose, the display is preferably a variable display, most preferably an electronic display such as a liquid crystal display (LCD), an electroluminescent film or a display based on the so-called "e-ink" technology. The assignment interface is preferably a user interface on the smart tag through which a user can directly assign functional properties to the smart card, most preferably in the form of a touch screen onto which a user can write information and/or erase such information. In this case, the assignment interface and the display of the smart tag can be combined in one field of the smart tag.

The assignment interface can, however, also be an interface to other elements of the programming system, for example the tag control arrangement, which would then assign functional properties to the smart tag, e.g. automatically.

In addition, the invention comprises a tag control arrangement for a programming system for programming an interactive system, comprising a smart tag communication interface for communication with a set of individual smart tags, whereby the tag control arrangement is realized such that - it can associate individual smart tags with functional properties assigned to them,

- it generates and transfers display information data to individual smart tags for display on those individual smart tags, and

- it derives a control sequence for the interactive system based on functional properties of the smart tags during a programming session.

The tag control arrangement can be realized in a central unit of the programming system, e.g. on a processor unit of a computer. Parts of the tag control arrangement may however also be localized on the smart tags themselves, for example data processing units which process input into the smart tags into electronically readable data.

Such tag control arrangement can be realized completely or in part in hardware or in software. As software can be adopted more easily to particular system needs, a software solution in the whole or in part is preferred. Therefore, the invention also comprises a computer programme product directly loadable into the memory of a programmable processor of a tag control arrangement comprising software code portions for performing the steps of a method according to the invention, when said programme is run on the processor.

The invention also concerns a method for programming an interactive system by a programming system comprising a tag control arrangement with a smart tag communication interface and a set of individual smart tags, whereby during a programming session - functional properties are assigned to the smart tags,

- information concerning the functional properties of at least one of the smart tags is displayed via displays of that smart tag and

- a control sequence for the interactive system is generated based on the functional properties of the smart tags.

The control sequence resulting from this method comprises context-aware ambient narrative fragments, whereby the context and the narratives are mainly set by assigning functions to the smart tags. The programming system and method according to the invention can be characterized by the following sequence of events: a smart tag with the above-mentioned elements is used by a user and functional characteristics are assigned to it via the assignment interface. These functional characteristics are stored and/or processed in the electronic memory of the smart tag and transmitted to the tag control arrangement. The tag control arrangement records a sequence of actions with respect to the functional characteristics of the smart tag. On the smart tag itself, the user can receive information about the functional characteristics and possibly other relevant sequence information, so that he gets an impression of what is currently being recorded. This gives the user the possibility to react and to learn easier how the programming system transfers his actions into control sequences. This way, the whole programming system becomes much more subtle and instructive at the same time.

Furthermore, the object of the invention is met by an interactive system comprising a programming system according to the invention and by the use of a smart tag according to the invention in a programming system for programming an interactive system.

The dependent claims and the subsequent description disclose particularly advantageous embodiments and features of the invention, whereby, in particular, the invention according to one claim category may also be further developed according to the dependent claims of another claim category. In a preferred embodiment of the programming system the smart tags are active smart tags. This means that they have a power supply for electric power which is independent of actions by the tag control arrangement. In the case of a smart tag connected to the tag control arrangement by cables this can be easily realized by a power supply through these cables. In the case of a wireless connection between the smart tags and the tag control arrangement, however, this implies preferably the use of a power capacity which is integrated into or physically connected to the smart tag. For example, a power supply can be achieved by a voltage generator such as a solar module or by a power storing means such as a battery - preferably a re-loadable battery - and/or a capacitor.

Generally, it is possible to use passive smart tags as well in the context of the invention - maybe with a slightly higher input of resources of the tag control arrangement. However, the use of active smart tags rather than passive ones makes sure that input into the smart tags and/or changes of location can be registered directly by the smart tag and an according signal can be sent to the tag control arrangement. Otherwise, the tag control arrangement would have to actively control all the smart tags simultaneously, which generates a lot more signal traffic. Apart from that, an active smart tag also has a power source for powering the display, which makes possible a much more user- friendly display: The display can automatically change the information on display without the necessity to wait for signals from the tag control arrangement. In addition, such arrangement has the potential to display more information that a display on a passive smart card.

In a very preferred embodiment, the programming system according to the invention additionally comprises a localisation system to determine a location and/or a change of location of smart tags, whereby the programming system is realized such that a control sequence for the interactive system is generated based on the location and/or the change of location of the smart tags. In this context, a part of the functional properties may be considered to be location properties, which can for example be sensed by the location system

The localisation system may be included in the tag control arrangement, but it can also be realized as an independent unit. It can use for example UWB (ultra wide band) or Ultrasound in order to localize the smart tags. Preferably, a programming system or interactive system according to the invention further comprises a device control unit for programmable technical devices, preferably media devices and/or lighting devices, such as TV screens or lamp spots. Such programmable technical devices are in potential interaction with a user. The control system thus controls the technical devices in order to support such potential interaction. To that end, the control unit preferably has an interface to the localisation system and is realized such that it can trigger an interaction between a smart tag and a programmable technical device once that smart tag comes into certain proximity of the technical device. In this context, a preferred embodiment of the method according to the invention includes the step of if a smart tag comes into a certain proximity of a technical device, an interaction of the device and the smart tag is generated. This interaction may be carried out completely between the technical device and the smart tag or via other parts of the programming system. The detection of such proximity may also be sensed by the smart tag and/or the technical device or by parts of the programming system, in particular the localisation system mentioned above.

In this context it is most preferred that the programming system further comprise displays and/or loudspeakers for output of information about possible programmes of the programmable technical devices. For that purpose, it is highly advantageous to use the display on the smart tag as such display. For example, a smart tag which comes close to a TV screen is sensed by the localisation system which triggers a signal to the control system which derives information about the TV screen such as possible TV programmes for choice and passes that information on to the smart tag which can then display the information on the display.

As briefly explained above, functional properties can be virtually any kind of characteristics of persons and/or objects and/or actions. Most preferably the functional properties include at least one of the following:

- definitions of location, i.e. a certain space within a bigger space

- definitions of time, e.g. an activation time during which a programmed interaction sequence shall be active, - definitions of temperature,

- definitions of environmental influences in a certain space, e.g. the presence of particular weather

- command inputs,

- identification properties and/or behaviour and/or information about the presence of a user and/or an object, - definitions of relationship amongst users and/or objects and/or smart tags.

For example, in order to define a location, four smart tags can be used to define the corners of a field in which actions represented by other smart tags are monitored. Once a fifth smart tag is within the field defined by the four smart tags which define the location, this fifth smart tag will be considered to represent an actor. This way, the programming system can distinguish between "inside" and "outside" a field of interest and generate an action sequence which goes as follows:

- Space A-B-C-D is defined (by smart tags 1, 2, 3, 4).

- Object E enters the space (represented by smart tag 5). - Object E is placed close to corner A (defined by smart tag 1) of the space.

The definition of space - and indeed similarly of time, temperature and other environmental influences can thus serve as a kind of stage for a certain sequence of actions to be monitored. In simple programming language, it therefore would signify the beginning of an "If-clause" such as: "If temperature is higher than X and if object E is situated in space A-B-C-D then perform this or that action."

Command inputs may also play an important role within the framework of such programming system and method: They can set the scene by giving the programming information about the character of actions which are to be expected subsequently. For example, a smart tag can be assigned the commands input "Record". Once that tag is connected to the tag control arrangement, the tag control arrangement will record the subsequent actions represented by other smart tags. In this context, it is possible to use any command input for communication with the tag control arrangement, preferably such commands which are already known from programming computers by well-established programming languages, preferably commands which are self-explicable such as "start", "stop", "input", "output", "save" etc. Identification properties can consist of a single word like "user", "shopper", "TV screen", "bed", "table" or can be more specific such as "user - mother with pram, aged 20-40 years, blonde" "second user - man, aged 50-80 years with spectacles". This way different specification levels can be chosen in order to give the programming system the input it needs for a sufficient differentiation of actors and objects in the control sequence. Behind a very detailed characterization, the words belonging to a higher abstraction level may be assigned and saved, but not necessarily, as the programming system may also add them automatically. Identification properties need not necessarily apply to objects or subjects but can also refer to other phenomena such as light beams or other non-tangible things or effects. For example a tag can be put somewhere into a room to represent a spotlight with a 1 meter beam diameter. In order to identify objects and/or subjects during the rehearsal of a control sequence, the interactive system comprises sensors and suitable analysis means to analyze the sensor signals which enable it to distinguish between different such objects and/or subjects. The degree of refinement of the sensors determines the degree to which different specification levels can be applied to objects and/or subjects.

In a preferred embodiment of the invention at least one smart tag is programmed to represent a user, i.e. any person who either programmes the control sequence or who is in interaction with the interactive system later. This means that the functional properties assigned to that smart tag are such that the programming system identifies the smart tag as a representative of a user. The actions of such a user are then represented by the smart tag so that the programming system will associate the location or changes of the location of the smart tag with a location or movements of a user. In particular, one functional property can also be the fact that a person and/or an object is present or is not present in a certain space. This way, the programming system can realize an action sequence of a user by simply monitoring the location of the smart tag and derive from this action sequence certain reaction sequences which are then represented by other smart tags which have been assigned functional properties of a different kind. Lastly, the relationship amongst users and/or objects and/or smart tags or a person's behaviour can be defined as well. For example, it can be distinguished between women entering a scene on their own or women entering together with other persons. Once these other persons are specified as a particular woman's children, they can be assembled together with her to an action entity. Umpteen other possible relationship constellations can be defined that way. The functional properties of smart tags can be assigned to them by typical programming means, i.e. by input through a computer system. Preferably, they are assigned by text input, most preferably by written text input. Such text input can be done via text input into the keyboard of a computer system, but most advantageously by directly writing a text right onto the smart tags, e.g. onto a touch panel display of the smart tags. This way, a user can again interact directly with the programming system as he would do if he did not programme a computer system but rather instruct another person. For that purpose he can leave little paper notes on objects with instructions on them - in a parallel way, the invention simulates such behaviour with electronic support in order to programme the interactive system. In order for the programming system to recognize such text input, it is particularly wished for to use a vocabulary list for filtering the text input, whereby "filtering" implies assigning certain system commands of the programming system to certain text input, whereby the commands of the programming system are to represent said text input. Such vocabulary list can serve to standardise commands and functional property data in such way that the input can be processed by the programming system in an effective way with as little comprehension mistakes as possible.

For example such list may comprise the following vocabulary, whereby commands in between brackets are optional and '|' indicates different possibilities.

This list of commands can be extended by an advanced user, e.g. to support creation of macros and can also include many more commands and vocabulary items.

BRIEF DESCRIPTION OF THE DRAWINGS

Fig. 1 shows a schematic block view of an interactive system according to the invention. Fig. 2 shows a first exemplary schematic representation of a programming environment for an interactive system with a set of smart tags and with one such smart tag in detail in a front view. Fig. 3 shows a second exemplary schematic representation of a programming environment for an interactive system

In the drawings, like numbers refer to like objects throughout. Objects in the diagrams are not necessarily drawn to scale.

DETAILED DESCRIPTION OF THE EMBODIMENTS

Figure 1 shows an interactive system 21 with a programming system 13, a programme memory 18, a device control unit 23, which is in a control connection CC with a technical device 5, in this case an LCD screen, and a number of further devices 5', 5", such as a lamp, a CD recorder etc.. In addition, four sensors 6a, 6b, 6c, 6d are part of the interactive system 21, which sensors obtain input signals for the interactive system 21. Depending on a current control sequence and on the sensor input, the device control unit 23 sends specific commands to the devices 5, 5', 5", so that the interactive system 21 reacts to user inputs and/or behaviour according to the given control sequence. Such a control sequence may be programmed in a programming sessions using the programming system 13.

The programming system 13 comprises a tag control arrangement 15 and a set of smart tags Ia, Ib, Ic, Id, each with control arrangement communication interfaces 7a, 7b, 7c, 7d. The tag control arrangement 15 is localized on a processor unit together with other parts of the interactive system 21. It comprises a smart tag communication interface 19 and a localization system 17 which serves to localize the smart tags Ia, Ib, Ic, Id, e.g. by means of UWB communication. As indicated by the dashed line the programming system 13 may also use the device control unit 23 for initiating actions of specific devices such as the LCD screen 5 during a programming session.

The smart tags Ia, Ib, Ic, Id are in communication contact with the tag control arrangement 15 by wireless connections between their control arrangement communication interfaces 7a, 7b, 7c, 7d and the smart tag communication interface 19 of the tag control arrangement.

In a programming session, functional properties are assigned to the smart tags Ia, Ib, Ic, Id. Through the contacts between the smart tags Ia, Ib, Ic, Id and the tag control arrangement 15 each smart tag Ia, Ib, Ic, Id transmits its identification data IDa, IDb, IDc, IDd and information FPa, FPb, FPc, FPd about these functional properties. In return, the tag control arrangement may transmit display information data DIDa, DIDb, DIDc, DIDd to each individual smart tag Ia, Ib, Ic, ldwhich can serve as commands for displays (compare Fig. 2) which are part of each smart tag Ia, Ib, Ic, Id. However, it is preferred that such display information data DIDa, DIDb, DIDc, DIDd are rather be created in the smart tags directly when a programmer assigns the functional properties to the smart tags Ia, Ib, Ic, Id.. The localization system 17 can monitor the location and/or a change of location of the smart tags Ia, Ib, Ic, Id. The information FPa, FPb, FPc, FPd about the functional properties assigned to each smart tag Ia, Ib, Ic, Id - if necessary in combination with the information about location and/or change of location of smart tags Ia, Ib, Ic, Id - is transferred into a control sequence CS which is saved in the memory 18 of the interactive system 21 so that it can be used as a programme sequence in an interactive setting. For that purpose, the control sequence CS may be compiled into an appropriate assembler code by an automatic compiling unit (not shown).

With the help of sensors 6a, 6b, 6c, 6d, the interactive system 21 can rehearse this control sequence CS when it recognizes via those sensors 6a, 6b, 6c, 6d all the actions represented by the functional properties and locations and/or changes of location of the smart tags Ia, Ib, Ic, Id.

In addition, the LCD screen 5 or the other devices 5 ' 5 " may be controlled by the device control unit 23. Therefore, e.g. certain actions of the LCD screen 5 such as an on/off function or an output of possible TV and/or video channels can be controlled by the interactive system 21. This output can be done by audio means such as loudspeakers (not shown) or by displays such as the displays on the smart tags Ia, Ib, Ic, Id or the LCD screen 5 itself.

Due to the localization system 17 - or through proximity sensors in the LCD screen 5 and/or the smart tags Ia, Ib, Ic, Id, it is also possible to find out if, during a programming session, a smart tag Ia, Ib, Ic, Id is close to the LCD screen 5. Then, a kind of interaction between such smart tag Ia, Ib, Ic, Id and the LCD screen 5 can be initiated, such as the aforementioned display of possible TV and/or video channels on the display of a smart tag Ia, Ib, Ic, Id. Figures 2 and 3 are used to illustrate possible examples of applications of the invention.

Figure 2 illustrates a first example of the application of the interactive system according to the invention, in which the programmer of a programming environment 3, here an intelligent retail environment, wants to programme a control sequence CC due to which whenever a customer is the proximity of an LCD display 5 in a store this LCD display 5 will start a product slideshow. For that purpose, a sensor 6 - here a camera connected to an automatic image recognition logic - will monitor the action of the programmer.

The programmer uses a set of smart tags Ia', Ib', Ic', Id', Ie', If, Ig' which are in communication with a tag control arrangement 15 (compare Figure 1). Each of the smart tags Ia', Ib', Ic', Id', Ie', If, Ig' comprises the elements which are shown exemplarily in an enlargement of smart tag Ig': a control arrangement communication interface 7, an assignment interface 9 and a display 11. As indicted by the dashed line the assignment interface 9 and the display 11 are here both combined in the form of a touch sensitive display screen on which a user can write, e.g. with a stylus pen. By writing on the touch sensitive screen 9 a user can assign functional properties to the smart tag Ig' and information concerning functional properties - preferably but not limited to the functional properties assigned to that very smart tag Ig'. The touch sensitive screen has the advantage, that the information concerning the functional properties are directly written down on the display so that the user is permanently aware of the functional properties of the tags during the programming session.

In order to programme an interactive system 21 (compare Figure 1), the programmer takes the following steps:

First the programmer writes, "create" on the touch sensitive screen 9 of a first smart tag If and places it into the programming environment 3. The tag control arrangement 15 recognizes the "create" command and may give audio or visual feedback to acknowledge this action. Next, the programmer defines an interactive area by writing "location" on four other smart tags Ib', Ic', Id', Ie'. He places them in a rectangle onto the floor and additionally gives one of these four smart tags Ib', Ic', Id', Ie' a name for future reference: He writes down "interaction area" on this smart tag's touch sensitive screen 9. The programming system 13 automatically determines the position of these four smart tags Ib', Ic', Id', Ie' as the corners of the interactive zone that is so defined.

In a next step, the programmer picks another smart tag Ig' and writes "actor" on it, added by a few extra restrictions signifying that the role of the actor must be "shopper" and that he must be inside the location just defined in order to be taken into account by the interactive system 21. The programmer uses another smart tag Ia' and walks up to the LCD screen 5 near the area marked by the location tags Ib', Ic', Id', Ie'. By holding the smart tag Ia' close to the LCD screen 5 the words "LCD display" appear on the smart tag's own display. A user interface appears on the smart tag Ia' and the programmer can choose that a slideshow of the product collection in the store should be played. The programmer sticks the smart tag Ia' onto the LCD screen 5 and walks back.

Lastly, the programmer takes the smart tag If to which the command "create" was assigned and now assigns the word "test" to it instead. On the LCD screen the slideshow starts. As soon as the programmer removes the "actor" tag Ig' and places it outside the area defined by the four smart tags Ib', Ic', Id', Ie' which define the interactive zone, the slideshow stops. The programmer puts the "actor" smart tag Ig' back into the interactive zone and the slideshow starts again. The programmer can now change again the assignment to the smart tag If to which the command "test" was assigned by writing "save" on its touch sensitive screen 9, followed by the words "slideshow on LCD when shopper stands in front". The programming system 13 acknowledges this new command with audio and/or visual feedback and stores the control sequence CC under that title into the database of control sequences. The programmer can now pick up all the smart tags Ia', Ib', Ic', Id', Ie', If, Ig' and put them into a container, which can automatically erase all assigned functional properties of the smart tags Ia', Ib', Ic', Id', Ie', If, Ig'. Figure 3 illustrates a second example of an application of the invention, in which the user of a smart home wants to program a control sequence CC defining that the lights in a room should turn off after 11 o'clock p.m. unless there is someone still present in the room.

The programming session takes place in a room 31 in which several lamps 25a, 25b, 25c are located. One lamp 25a which hangs from the ceiling of room 31 is connected by an electric wire 29 to a switch 27 by which it can be switched on and off. For programming this environment with the above-mentioned control sequence, the user uses a set of smart tags Ia", Ib", Ic", Id", Ie", If, Ig" which are again in communication with a tag control arrangement 15 (not shown - compare Figure 1). Again, the user and indeed the complete interactive environment is monitored by sensors 6, one of which is shown as an example. First the user writes, "create" on the assignment interface 9 (not shown - compare Figure 2) of a first smart tag Ia' ' and places it into the room 31. The programming system 13 recognizes the "create" command and gives audio and/or visual feedback to acknowledge it. The user now takes a second smart tag Ib" and writes "location" onto it, adding the word "room" to indicate that the entire room 31 is defined as the location of choice. The user then picks up a third smart tag Ic" and writes "environment" followed by 'time' and the words "after 23:00, before 6:00" to indicate the time frame. Next, the user picks another smart tag Id" and writes "actor" onto it, with an extra restriction "not [present]". This indicates that the above-mentioned rule only applies if there is no -one present in the room 31.

The user then uses three more smart tags Ie", If, Ig" and associates them with the lamps 25a, 25b, 25c by holding them close to the lamps 25b, 25c and to the switch 27 associated with lamp 25a. The localisation system 17 (not shown - compare Figure 1) within the programming system 13 recognizes the proximity of the smart tags Ie", If, Ig" to the lamps 25b, 25c and switch 27 and triggers a choice of functions to be displayed on the displays of the smart tags Ie", If, Ig". The user can choose between "on" and "off' and selects the latter.

He then takes the smart tag Ia" to which he had assigned the command "create" and assigns to it the word "test" instead. The lamps switch off. The user then erases the word "test" from the smart tag Ia' ' and writes down "save", followed by the words "lights off after 23:00" to give the new control sequence a name.

In addition to these two illustrated examples, a few more programming possibilities need to be mentioned:

A user can also use smart tags to manage a collection of control sequences in a database of the interactive system.

For example, by writing the word "list" on a smart tag, such list of all control sequences is presented on the display of the smart tag. If the word "active" is added, only the names of the currently active control sequences are shown.

To overwrite a control sequence, the user can create a new control sequence and use the name of the previous control sequence which he wishes to replace. Deleting control sequences from the interactive system's memory can be done by writing the word "delete" and the name of the control sequence on a smart tag. Instead of a name, the user can also use the word "all" to delete all control sequences in the interactive system. Such action by the user can, for security reasons, trigger the output of a question to user such as "Do you really want to delete all control sequences", which he can confirm or refuse.

The word "help" (possibly followed by a keyword) can be used to receive a list of (specialized) help messages.

For the commands, a vocabulary list can be used to filter the text input. If the programming system does not recognize a text input, it can give audio and/or visual feedback to notify a user.

The use of electronic, writeable smart tags with displays offers many other possibilities for programming purposes: Flipping a smart tag with the display down can temporarily remove the smart tag from view of the programming system. Thus, instead of moving a smart tag to which functional properties of an "actor" have been assigned outside an area of interest, a programmer could also turn this smart tag upside down, e.g. for test purposes of the interactive system.

Furthermore, smart tags may be assigned functional properties defining them in relationship with other actors or objects or actors, preferably with a specification how they must relate in order to fulfill certain criteria in the context of a control sequence. For example, a user could then write a smart tag to program a relationship between a shopper and an LCD screen when there is a gaze relationship between the two.

Lastly, macros can be defined, for example by writing down on a smart tag that another control sequence must be active as well in order to fulfill the criteria for carrying out the control sequence which is currently being programmed.

For the sake of clarity, it is to be understood that the use of "a" or "an" throughout this application does not exclude a plurality, and "comprising" does not exclude other steps or elements. A "unit" or "module" can comprise a number of units or modules, unless otherwise stated.

Claims

CLAIMS:

1. Programming system ( 13) for programming an interactive system (21), which programming system comprises a tag control arrangement (15) with a smart tag communication interface (19) and a set of individual smart tags (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig") each comprising - a control arrangement communication interface (7, 7a; 7b, 7c, 7d),

- an assignment interface (9) for assignment of functional properties (FP_a, FP_b, FP_C, FP_d) to it,

- a display (11) for displaying information concerning the functional properties (FP_a, FP_b, FP_C, FP_d), whereby the programming system is realized such that a control sequence (CS) for the interactive system (21) is based on the functional properties (FP_a, FP_b, FP_C, FP_d) assigned to the smart tags (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig") during a programming session.

2. A programming system according to claim 1 comprising a localisation system (17) to determine a location and/or a change of location of smart tags (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig"), whereby the programming system is realized such that a control sequence (CS) for the interactive system (21) is based on the location and/or the change of location of the smart tags (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig").

3. A programming system according to claim 1 or 2, further comprising a device control unit (23) for programmable technical devices (5, 25a, 25b, 25c, 27), preferably media devices and/or lighting devices.

4. A programming system according to any one of the preceeding claims, wherein at least one smart tag (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig") is programmed to represent a user.

5. A method for programming an interactive system (21) by a programming system (13) comprising a tag control arrangement (15) with a smart tag communication interface (19) and a set of individual smart tags (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig"), whereby during a programming session

- functional properties (FP_a, FP_b, FP_C, FP_d) are assigned to the smart tags (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig"),

- information concerning the functional properties (FP_a, FP_b, FP_C, FPa) of at least one of the smart tags (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig") is displayed via a display (11) of that smart tag (Ia, Ia', Ia"; Ib, Ib',

Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig") and

- a control sequence (CS) for the interactive system (21) is generated based on the functional properties (FP_a, FPb, FP_C, FPa) of the smart tags (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig").

6. A method according to claim 5, whereby the functional properties (FP_a, FPb, FP_C, FPd) include at least one of the following:

- definitions of location,

- definitions of time, - definitions of temperature,

- definitions of environmental influences in a certain space,

- command inputs,

7. A method according to claim 5 or 6, wherein the functional properties (FP_a, FP_b, FP_C, FP_d) are assigned to smart tags (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig") by text input.

8. A method according to claim 7, wherein a vocabulary list is used for filtering the text input.

9. A method according to any of claims 5 to 8, including the step of if a smart tag (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig") comes into a certain proximity of a technical device (5, 25a, 25b, 25c, 27), an interaction of the device (5, 25a, 25b, 25c, 27) and the smart tag (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig") is generated.

10. Smart tag (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie";

If, If; Ig', Ig") for a programming system (13) according to any one of the claims 1 to 4, comprising

- a display (11) for displaying information concerning the functional properties (FP_a, FP_b, FP_C, FP_d),

- a control arrangement communication interface (7, 7a; 7b, 7c, 7d), which control arrangement communication interface (7, 7a; 7b, 7c, 7d) is realized such that it transfers such information (ID_a; IDb; ID_C; IDd; FP_a, FPb, FP_C, FPd) to the tag control arrangement (15) that the tag control arrangement (15) can associate the smart tag (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig") with the assigned functional properties (FP_a, FPb, FP_C, FPd).

11. Set ofsmart tags (la, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie',

Ie"; If, If; Ig', Ig") for use in the context of a programming system (13) for programming an interactive system (21), whereby at least one of the smart tags (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig") is a smart tag according to claim 10.

12. A tag control arrangement (15) for a programming system (13) for programming an interactive system (21), comprising a smart tag communication interface (19) for communication with a set of individual smart tags (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig"), whereby the tag control arrangement is realized such that

- it can associate individual smart tags (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig") with functional properties (FP_a, FP_b, FP_C, FP_d) assigned to them, - it generates and transfers display information data (DID_a; DIDb; DID_C; DIDa) to individual smart tags (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig") for display on those individual smart tags (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig"), and

- it derives a control sequence (CS) for the interactive system (21) based on functional properties (FP_a, FP_b, FP_C, FP_d) of the smart tags (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig") during a programming session.

13. Interactive system (21) comprising a programming system according to any one of claims 1 to 4.

14. Use of a smart tag (Ia, Ia', Ia"; Ib, Ib', Ib"; Ic, Ic', Ic"; Id', Id"; Ie', Ie"; If, If; Ig', Ig") according to claim 10 in a programming system (13) for programming an interactive system (21).

15. A computer programme product directly loadable into the memory of a programmable processor of a tag control arrangement (15) comprising software code portions for performing the steps of a method according to claims 5 to 9, when said programme is run on the processor.