WO2002073387A1

WO2002073387A1 - Method and arrangement for importing data or selection

Info

Publication number: WO2002073387A1
Application number: PCT/FI2002/000156
Authority: WO
Inventors: Akseli Reho; Mikko Tasanen; Tapio Karinsalo; Jussi IMPIÖ
Original assignee: Clothing Plus Oy
Priority date: 2001-02-27
Filing date: 2002-02-26
Publication date: 2002-09-19
Also published as: FI20010387A0

Abstract

The invention relates to a method and arrangement for importing data. The invention especially relates to the importing of data optically without a keyboard or a similar control unit. It is characteristic of the method of the invention for importing data or selection with the help of a display device and a pointer that the display (200) is optically drawn, for example, to some surface, such as the user's hand (202), using the display device. Further, it is an idea of the invention that the selection is performed by pointing a desired point of the display (200) with the pointer (208), the beam reflected from the reflecting organ (210) of the pointer is read, and the point indicated by the pointer is located on the basis of back reflection with the help of the display device, and the selection according to the point indicated by the pointer is registered and performed.

Description

Method and arrangement for importing data or selection

The invention relates to a method and arrangement for importing data. The invention especially relates to the optical importing of data, without keyboard or a respective control unit.

The use of computers and various kinds of portable personal digital instruments, such as mobile stations and direction finders, and PDA devices (Personal Digital Assistant), has fast increased, and at present, it is possible to perform quite a lot of different functions using these. Further, the size of portable devices has become smaller, due to the technology developing to a considerable extent; and, on the basis of future outlooks, the devices will still keep on reducing in size at the same time as their performance will increase.

However, as the size of the devices becomes smaller, the problem is to maintain such a size for the data input equipment, such as keyboards, and the devices for displaying data, that it still would be possible for the users to use them. Too small keys cannot be used, and too small display units no longer meet the requirements made on the display. Especially the use of keyboard or complex control units and data input equipment is problematic, for example, with only one hand or in extreme conditions, such as when climbing, travelling in a difficult terrain or in otherwise hard natural conditions.

One solution for the problems indicated above can be found in different methods for importing data, in which data, selections or commands can be imported without keyboard, for example, with the help of speech or a joystick. Further, there are solutions in which the facial expressions, gestures or movements are filmed, and a certain function or selection is performed on the basis of the visual data obtained.

The publication US 5,767,842 discloses a solution for optically importing commands or data, in which the movements of the user's hands, fingers and fingertips are examined with the help of a special TV camera or a corresponding camera connected to a computer; with this arrangement, it is possible to simulate the function or use of different types of manually controlled devices, such as a mouse and keyboard. Further, the publication US 4,998,981 presents a solution for importing data to a computer so that the solution comprises a separate glove to be put on the user's hand, the glove including sensors for detecting the movements and motions of the user's hands. The arrangement according to the solution further comprises ultrasonic receivers for defining the location of the glove.

The problem with solutions similar to the ones mentioned above is that they are difficult to use in portable devices intended for data processing, because of the television or video camera system to be connected to a separate computer device or because of a separate glove containing motion sensors or other detectors. In the solution according to US 5,767,842, a large flat surface is further needed, on which the user can move his hands and so that the camera and computer system can inteφret the movements of the user's hands correctly. Achieving such a flat and large surface is very problematic when using a portable data processing system and especially when the user is moving. Also in the solution according to US 4,998,981, there are problems, for example, in the placing of the ultrasonic sensors to right places in cases of portable data processing devices so that it would be possible to correctly define the location of the glove. Problems are also easily caused by that, as the user is moving, his hand or some other part of his body or garment easily disturbs the signal and operation of the ultrasonic receivers. Further, the data transmission wire from the glove to the computer considerably hinders the moving.

The object of the invention is to find a solution for importing data or selection to a portable or wearable data processing device so that the said drawbacks related to the state of the art can be reduced. The invention tries to solve how data or selections can be easily imported without keyboard or without separate camera and display systems mentioned above.

The objects of the invention are achieved so that the display is drawn with the help of a display device that can be worn by the user so that the user can choose the selection he desires by pointing some point in the display drawn by the display device, in which case the detector arrangement in the display device locates the point indicated by the user and registers the data corresponding to the indicated point.

It is characteristic of the method of the invention for importing data with the help of a display device and back reflections, in which method the display is optically drawn and back reflections are read with the help of the display device, that the at least one display to be drawn with the help of the display device is a display produced by at least one device which is in data transmission contact with the display device. It is characteristic of the arrangement of the invention for importing data with the help of a display device and back reflections, in which the display device is used for optically drawing the display and for reading the back reflections, that the display device is in data transmission contact with at least one device and that the at least one display to be drawn is a display produced by at least the said one device.

It is characteristic of the display device of the invention for importing data with the help of a display device and back reflections, using the display device for optically drawing the display and for reading back reflections, that the display device is in data transmission contact with at least one device and that the at least one display to be drawn is a display produced by the said at least one device.

Some advantageous embodiments of the invention have been presented in the dependent patent claims.

With the present invention, it is possible to achieve considerable advantages as compared to the state-of-the-art solutions. The method of the invention enables an easy, simple and natural way for importing data or selections to different kinds of data processing systems. The method of the invention can effortlessly be used, for example, in situations in which the user is not able to write the commands using a separate keyboard or in situations in which it is not possible to place a separate display within a suitable distance within the user's range of vision.

Further, the present invention makes it possible to provide a light arrangement for importing data, the arrangement being easy to move and wear. With the help of the invention, the user may easily import data, commands or selections also when in the move. With the method of the invention, moving from one display or display menu to another and choosing a selection or command can be most simply performed, for example, by only pointing with a finger, by clenching one's fist, or by waving a finger.

In this patent application, for instance, the following concepts are used:

- "Display" is a picture drawn by the display device, which can be drawn, for example, to the user's hand or to some other flat surface of a suitable size. The display can also be drawn as a hologram. The display typically comprises at least one menu, in which menu one or several selections can be shown. Further, the display can comprise other data to be shown, such as the time, a reminder or some other data comprising letters, numbers and/or special characters. In addi- tion, some external device, such as a mobile station or a similar device can be connected to the display device with the help of a cable or wirelessly, in which case the display drawn to some surface with the display device can advantageously comprise the image shown by the device connected to the display device. When a mobile station is concerned, the display drawn by the display device may show, for example, an SMS message, a number to be called or some other corresponding view typically shown in the display of a mobile station.

"Display device" or projector refers here to a device, which comprises the necessary optical and electronic means for producing an image or drawing a display and menu. Further, the display device comprises means for detecting the radiation reflected from the pointer in use or for detecting the radiation emitted by the pointer and means for locating the reflection or the source of the radiation or for defining the indicated point in the display or menu. Further, the display device can include means for performing the pattern recognition and a distance gauge. In addition, the display device can be arranged so that some other data processing device can be integrated with the display device. The display device is typically a wearable display device, and it may be, for example, a resonance cavity display formed of resonance cavity LEDs (RC LED) or a micro mirror projector formed of micro mirrors.

"Data" can be any data to be shown with the help of the display device of the invention, such as data comprising letters, numbers, special characters and/or images. Data to be imported with the help of back reflections can also be a command or a selection.

"Menu" refers here to a structure, for example, in the form of a flow chart, which is drawn to the user's hand using the display device and which may consist of several different images or selections, which can be shown one or several at a time, depending on the execution mode. For example, the menu shows the function or selection, which is performed if the user decides to select the item in the menu in question. It is possible to transfer from the menu to another menu according to the exemplary execution modes mentioned below. As the first example, let us examine the method for importing data, in which the display is drawn to the user's hand with a display device that also comprises the menu. The user can choose the desired selection from the display menu drawn to his hand, for example, by pointing the place in question in the display with a finger of the other hand. For example, a small mirror or some other reflecting surface can be attached to the finger. Alternatively, there may be, for example, a glove in the user's hand, with some suitable reflecting surface at least in one finger or some other place of the glove. Thus, when reading the area drawn to the user's hand with the display device so that the display device preferably transmits some electro-magnetic radiation, such as visible light, to the drawn area, the radiation can reflect from the reflecting surface in the user's finger back to the display device. The display device typically detects the reflection and locates the place of reflection so that the place indicated by the user's finger can be defined and the data or selection according to the place indicated by the finger can be registered. The user's selection can be performed as the user points the same place, i.e. menu in the display for a certain time so that the display device can register the selection or command corresponding to the indicated place. Further, the glove can also contain an organ emitting some electro-magnetic radiation, such as visible light, at the place of the reflecting organ, in which case the display device can register the location of the reflecting organ on the basis of the radiation emitted by the organ.

According to another exemplary embodiment a menu consisting of different images or selections can be drawn to the user's hand. Images or selections are shown only one at a time. When transferring from one menu to another, it is possible to move to different directions, such as up, down, right and left. Moving is conducted by moving the hand, to which the display is drawn, to the desired direction so that the display device can register the direction of movement of the hand and update a new image or selection to the display to be drawn to the user's hand according to the direction of movement of the user's hand. Also a selection can be performed in the menu, for example, so that the user clenches his hand, to which the menu and display are drawn, for a moment at the place of the appropriate selection. Alternatively, the selection can be performed by waving or circling a finger, for example, thumb, to a sufficient extent. The display device can identify this, for example, with means based on pattern recognition in the display device and perform a command or update a new image or menu. Alternatively the display device can identify the clenching of the fist with the help of radiation emitted by an organ emitting light or some other corresponding electro-magnetic radiation, the organ being found in the finger of the hand, which is clenched, or in the glove in the hand. As the next example, one other way is examined, in which a menu consisting of different images or selections can be drawn to the user's hand and which are shown only one at a time. In this example, it is possible to transfer from one menu to another by moving the hand, to which the display and menu are drawn, in depth direction closer and farther away from the display device. The display device comprises a distance gauge, with the help of which the distance of the hand can be measured or the movement of the hand detected. In this case, the display and menu can be updated according to the movement of the hand. The selection can be performed in the same way as in the examples mentioned above.

It is also possible to move from one menu to another according to the embodiments in this specification also in a case, in which several menus and selections have been drawn to the display.

A display drawn with the display device may, for example, be a display of a mobile station connected to the device either with a cable or wirelessly, in which case the user can read, for example, an SMS message (Short Message Service) that has arrived to the mobile station from a display drawn to some surface by the display device. The user can also choose a number, move from one menu of the mobile station to another menu, answer a call, make a call or otherwise control the operation of the mobile station connected to the display device according to the embodiments mentioned in the specification. The keyboard of the mobile station can then be drawn to some surface by the display device, from which the user can perform selections, such as choose the number, to which he intends to make a call or to write an SMS message.

Also other external devices can be connected to the display device; for example, a GPS (Global Positioning System) positioning device. In this case, the display device can reflect the display of the GPS device to the user so that the user does not need to keep the GPS device in his hand and to follow the indication shown by the GPS device from the small display of the device. In addition, the user can also perform commands or selections controlling the GPS device according to the embodiments mentioned in the specification.

The display of the system according to the invention can be any kind of a display device or projector. However, the display device is preferably an RC LED display (resonance cavity LED), which typically is a very small, light, portable and wearable display or projector. In the RC LED display, the light source is a matrix formed by RC LEDs, integrated to silicon. In the RC LED matrix, typically one RC LED cor- responds to each image point in the display. Further, when using the RC LED matrix, no scanning equipment is needed for forming the image, and the image source is self-luminous and very small in size. Due to the small size of the RC LED image source, it is possible to wear the projector, for example, in the front of the user's blouse in a very small space approximately of the size of one button. Alternatively, the display device can also be a laser projector or a micro mirror projector.

Advantageous embodiments of the invention are next described in more detail, referring to the enclosed drawings, in which:

Figure 1 is a flow chart of a method of the invention for importing data;

Figure 2 presents a method of the invention for importing data;

Figures 3 a-c present a second method of the invention for importing data;

Figure 4 presents a third method of the invention for importing data;

Figure 5 shows a fourth method of the invention for importing data;

Figure 6 shows a two-dimensional menu structure;

Figure 7 shows a fifth method of the invention for importing data;

Figure 8 presents a three-dimensional menu structure;

Figure 9 presents an arrangement of the invention for locating the display device;

Figure 10 presents an arrangement of the invention of the drawing beam of the display device; and

Figure 11 shows a display device of the invention.

Figure 1 is a flow chart of a method 100 of the invention for importing data with the help of a display device. At step 102, a display and typically also at least one menu is drawn or projected with the display device. The display and menu can be projected, for example, to a surface, which is sufficiently large and flat. The surface may typically be, for example, the user's hand or palm, but the surface can also be any surface, such as the surface of a table, paper, wall, or even the surface of a street. Alternatively, according to one embodiment, the display and menu can be projected also as a hologram, in which case no special surface is needed. The display and menu are usually drawn with large frequency so that they look stable and do not flicker. The display can show different kinds of data, such as the time and date and the menus.

The menus typically include different functions or options to be performed, from which the user can choose the selection he wishes at step 104, for example, by pointing with his finger the point corresponding with the selection on the surface, to which the display and menu are drawn. In this case, the drawing beam of the display device reflects from the pointer, such as the user's finger, a mirror in the finger, or some other respective reflecting organ, back to the display device. The selection can also be made by clenching the fist for a moment, by waving a finger or by moving the hand for some direction; for example, in a plane to left, right, up and down, or closer or farther away in the direction of depth. Alternatively, the hand can be simultaneously moved also three-dimensionally. In addition, the selection can be made by pointing the selection with a pointer, such as finger or glove, the pointer containing an organ emitting light or some other similar electro-magnetic radiation, the display device being able to register the radiation emitted by the organ.

At step 106, the display device is used for reading back reflections, and at 108, the position of the reflected or otherwise transmitted beam is located, and the respective menu or selection is defined. At 108, also the pattern recognition is performed, and the direction of the movement based on it is defined and the hand or surface distance is measured. At 110, the selection or function corresponding to the menu pointed by the user or the direction of movement of the user's hand is registered. The drawing of the display and menu, as well as the reading of the back reflections and hand movements, can alternatively be performed also continuously during the other steps.

Figure 2 presents a method 100 of the invention for importing data, in which the display 200 is optically drawn to the user's hand 202 with the help of the display device. Inter alia, the clock 204 and the menu 206 can be drawn to the display, the menu showing, for example, the two selections A and B. According to one embodiment of the invention, also several menu images, or selections, can be simultaneously drawn to the display so that the user can advantageously choose the selection or option he wishes by pointing the selection in question with the pointer 208, such as a finger or a separate glove. The pointer 208 in use, for example a finger of the user's hand, typically has a reflecting organ, such as the mirror 210. As the user then points a selection, for example, the selection B in the menu 206, the drawing beam of the display device is reflected from the reflecting organ back to the display device, and the display device can register the reflection point as well as define and perform the selection or function corresponding to the reflection point, or to update a new menu to the display. Alternatively, the pointer in use can contain an organ emitting light or some other similar electro-magnetic radiation that the display device can register and perform the selection or the function according to the selection on the basis of this.

Figures 3a-c present a second method of the invention for importing data to a display device. In Figure 3a, the display 200 is drawn to the user's hand 202, containing the menu 206a and one selection or option A in the menu. If the user decides to accept the selection A, according to an embodiment of the invention, he can perform the selection by clenching his fist 300 for a moment, as is shown in Figure 3b. The display device advantageously draws the display 200 and menu continuously, and reads the back reflections, measures the distance and recognises the pattern all the time with large frequency. In this case, the display device can register the clenching of the user's fist 300, for example, based on the pattern recognition, and perform the function or command according to the selection A shown in the menu 206a of the display 200 drawn in the Figure 3a. The function or command can be, for example, such that it requires that a new menu or selection be showed. In this case, the new menu 206b and selection B are drawn to the user's hand 202, as is shown in Figure 3c.

Besides pattern recognition, the clenching of the user's fist can also be detected with the help of back reflections so that the finger or glove of the user's clenching hand contains a reflecting organ or an organ emitting electro-magnetic radiation, the display device being able to register the reflection or radiation as a command to perform the selection or the function according to the selection.

Figure 4 presents a third method of the invention for importing data to a display device. In this embodiment, the display 200 and menu 206 are drawn to the user's hand 202, the menu typically showing one selection or option at a time, such as the selection A. According to the embodiment shown, the user can perform the selection by moving one finger of his hand 202, for example, the thumb 400. In this case, the display device can register the moving or waving of the thumb, for example, based on the pattern recognition and perform the function or command corresponding to the selection or option.

It is further possible that also several menus and selections can be drawn to the display, from which the user can select the one he wishes according to the above embodiment by pointing the selection in question with the pointer, and the function ac- cording to the selection is performed only as the user clenches his fist or waves a finger of his hand.

Figure 5 presents a fourth method of the invention for importing data to the display device. In this embodiment, the display 200 and the menu 206 are drawn to the user's hand 202, the menu typically showing one selection or option at a time, such as the selection A. According to the embodiment shown here, the user can choose a new menu or selection by moving his hand 202 to some direction in the plane 500. The user can then get new displays 200, menus 206 and/or selections to his hand 202 by moving the hand 202, for example, to right, left, up or down. There may be several selections to one direction so that, when the user moves his hand 202 always a certain distance to the same direction, a new menu or selection is updated to the hand. The change in the direction of movement of the hand can also be detected so that the user waves his hand fast a short way to one direction or another. Respectively, the user can return to the previous selections by moving back the hand 202. The menu structure according to the embodiment shown is two-dimensional (Figure 6). The user can perform the selection, for example, according to the above embodiments.

Also several menus can be drawn to the user's hand two-dimensionally, in which case one menu can be active and, as the user moves his hand to one direction or another, the active menu is respectively updated from the same direction. According to the embodiment, the user can immediately see which menu is found, for example, right or up, and he can move his hand to the menu corresponding to the desired function. As the hand has been moved sufficiently to the direction of the desired menu, the display drawn to the user's hand can be updated, and the new active menu can move to be visible, for example, as the middlemost menu of the display. The active menu can also be brighter than the other menus.

Further, it has to be noted that the method of the invention can preferably also contain a function with which a certain display 200 and menu 202 can be locked visible, even though the user would move his hand 202. This facilitates the use of the method, among others, in situations, in which the user has selected a menu, which is situated, for example, furthermost in the right-hand side of the menu structure (Figure 6), and he still wishes to examine the selection. In this case the user can lock the display 200 and menu 202 using some command, for example, by waving his thumb 400 once so that the hand 202 can then be moved, for example, closer to the user or, alternatively, the hand 202 can be used for performing some other task. Figure 6 presents a two-dimensional menu structure 600, in which the user can transfer from the starting menu X to the desired direction in the plane 500. For example, the user can move to the menu 01 by moving his hand one step to the right. If the user moves his hand more to the right, he can access the menu 03. Alternatively, the user can access the menus VI, Yl, A2, etc. by moving his hand to the direction corresponding to the menu. From the menu 03, it is advantageously possible to get back to the menu 02 by moving the hand one step back to the left. It is possible to advantageously access, for example, the menu A2 from the menu 03 by moving the hand two steps down.

The two-dimensional menu structure can contain an arbitrary number of different menus both in horizontal and vertical direction. In addition, the menu structure can also have menus immediately above and below the menus in the right-hand side (01, 02, 03) and the left-hand side (VI, V2, V3), which can be accessed by moving the hand either first in the horizontal direction and then in the vertical direction, or alternatively, first in the vertical direction and then in the horizontal direction. It also has to be noted that the menu structure need not be symmetrical, but some quarter of the plane may contain more menus than some other quarter of the plane.

Figure 7 shows a fifth method of the invention for importing data to the display device. In this embodiment, a display and menu are drawn to the user's hand 202, the menu typically showing one selection or option at a time, such as the selection A. According to the embodiment shown here, the user can select a new menu or selection by moving his hand 202 to some direction in the depth direction 700. In this case, the user can get new menus and selections to his hand 202 by moving his hand, for example, closer or farther away from the display device, in which case the menu structure is one-dimensional. Alternatively, the user can select a new menu or selection by moving his hand, besides the depth direction 700, also in the plane 500, in which case the menu structure is three-dimensional (Figure 8).

Figure 8 presents a three-dimensional menu structure 800, in which the user can transfer from the starting menu XI to the desired direction in three-dimensional space 800. For example, the user can move to the menu V6 by moving his hand first one step farther away from himself or from the display device in the depth direction 700 and by then moving his hand three steps to the left in the plane 500. Alternatively, the user can access the menu V6 also by moving his hand from the starting menu XI first three steps to the left in the plane 500 and then one step farther away from himself or the display device in the depth direction 700. Also a three-dimensional menu structure can contain an arbitrary number of different menus in vertical, horizontal and depth direction. In addition, the three- dimensional menu structure can contain menus immediately above and below the menus in the right-hand side (01, 02, 03) and the left-hand side (VI, V2, V3) and also in the immediate vicinity of these menus in the depth direction, which can advantageously be accessed by moving the hand in an arbitrary order in the horizontal, vertical and depth directions. Further, it has to be noted that neither the three- dimensional menu structure needs to be symmetrical, but some part of the cube can contain more menus than some other part of the cube.

It is also possible that several menus and selections can be drawn to the display, in which case the user can move from one group of menus and selections to another according to the above embodiments by moving his hand, for example, three- dimensionally. It is further possible that the user can choose several selections by pointing with the pointer, to move to another menu or selection for a while and to still choose new selections. In this case, the display device can record the user's selections to its memory and perform them only with a separate command given by the user. For example, the command can be a command according to the above embodiments, such as clenching a fist or waving or circling a finger.

Figure 9 presents an arrangement of the invention for placing the display device 900 to the user's garment 902. The display device can advantageously be placed to the front of the user's blouse, coat or overalls so that there is a clear view from the display device to the surface to be drawn, such as the user's hand extending forwards. The display device can also be placed elsewhere in the user's body, such as the front of a hat or even to means like spectacle frames, or it can be fastened to the bare skin, such as the forehead, using separate fastening means, such as adhesive tape or glue. The display device can also be placed to a glove, to trousers, socks, shoes, belt or any other garment, which the user can put on.

Figure 10 shows from above an arrangement of the invention of the drawing beam 1000, with which the display and menu are drawn, for example, to the user's hand 202. The user can perform the selection, for example, by pointing the menu or selection with a separate pointer 208, such as his finger. In this case, the drawing beam 1000 drawing the display, menu and selection of the display device is reflected from the pointer 208 indicating the selection, such as the user's finger, back to the display device. The display device advantageously detects the back reflection 1002 and locates the selection in the menu pointed by the pointer and possibly performs the function or command corresponding to the selection or, alternatively, draws a new display and menu with selections. Alternatively, the pointer 208 can be an organ emitting some electro-magnetic radiation 1002, such as visible light, in which case the display device can detect the beam 1002 transmitted from the organ and perform the positioning and the respective function.

Alternatively, the beam 1000 drawing the display, menu and selections of the display device can reflect from the surface 202, to which surface the display, menu and selection are drawn. In this case, the display device can register the beams reflecting back from the surface 202 and detect the performed selection so that the user points the selection in the menu with an unreflecting pointer. Now, no radiation is reflected back to the display device from the point indicated by the pointer, as in the embodiment described above, but the selection in the menu pointed by the user can be registered with the help of a so-called black point. The back-reflecting radiation is reflected from all other points besides the selection pointed by the user.

Figure 11 shows the display device 900 of the invention, comprising typically at least one organ 1100, such as a resonance cavity LED emitting electro-magnetic radiation, such as visible light, and optics 1102, such as a focusing lens, for producing the drawing beam 1000. Typically also at least one light-sensitive organ 1104 is integrated in connection of the light-emitting organ for detecting the beam reflected by the pointer.

The display device 900 generally also includes means 1106 for measuring the distance of the drawing surface, such as the hand 202, and means 1108 for pattern recognition, such as recognising the movements of the user's hand 202 or fingers or the clenching of the fist. The display device 900 typically comprises means 1110 for locating the reflected beam or the beam transmitted by radiation, in which case the point in the menu indicated by the user can be positioned. In addition, the display device 900 can comprise means 1112, such as a display adapter for drawing and updating the display and/or menu to be drawn. In addition, the display device 900 can include at least one processor 1114 for processing data, at least one memory unit 1116, which can comprise both RAM (Random Access Memory), i.e. internal storage and ROM (Read Only Memory), i.e. permanent storage, and further some kind of cache memory, and means 1118 for attaching or connecting the display device, for example, electronically, to another data processing equipment, computer, PDA, mobile station or data network. The display device 900 can also include a power source 1120, a transmitter/receiver and antenna 1122 and fastening means 1124 for fastening the display device to the user's body. According to an advantageous embodiment, the display device can be detachably attached to the user's body. Alternatively, the display device 900 can be distributed to two separate display device parts that can be coupled with each other either using a wire or wirelessly; the first part preferably comprises means 1100 - 1104 for drawing the display and menu and for detecting reflections. Further, the first part of the display device can have means for coupling to the second part of the display device and means for attaching the display device part to the user's body. The second part of the display device preferably comprises means 1106 - 1124. There may be, for example, a radio frequency connection of short range between the first and second part of the display devices, such as a connection utilising the Bluetooth technology.

Above only some advantageous embodiments of the solution of the invention are shown. The principle of the invention can naturally be varied within the protective area defined by the patent claims, for example, for the part of the details and scope of the implementation. The method can especially be applied with different kinds of display devices and projectors. Further, it has to be noted that the display and/or menu can be drawn to highly different surfaces, and that the display device can also be some other kind of display device besides a wearable one. It also has to be noted that the display and/or menu can be projected as a hologram, in which case no particular surface is needed.

A method utilising the back reflection can be used also in cases of projectors to be reflected on walls, in which case the pointer used by the user, such as a pointer or some other suitable pointer, is preferably provided with a reflecting organ. Alternatively, the reflecting organ of the pointer can be replaced by some organ emitting light or some other respective electro-magnetic radiation, the display device being able to register the radiation emitted by the organ.

It also has to be noted that, according to an embodiment of the invention, an external device to be connected to the display device, such as a device using the GPS, GSM, PDA, WAP or GPRS technologies or a computer or a similar data processing device can also be integrated as part of the display device of the invention.

Claims

1. Method (100) for importing data with the help of the display device (900) and back reflections (1002), in which method the display (200) is drawn (102) optically with the help of the display device (900) and back reflections (1002) are read (106) with the help of the display device (900), characterised in that the at least one display (200) to be drawn with the help of the display device (900) is the display (200) produced by at least one device being in data transmission contact with the display device (900).

2. Method according to claim 1, characterised in that the said display (900) comprises at least one menu (206), the menu comprising at least one selection.

3. Method according to claim 1 or 2, characterised in that the said display device (900) is a display device to be attached to a garment.

4. Method according to one of the preceding claims, characterised in that the said display (200) is drawn to at least one of the following surfaces, using the said display device (900): the user's hand (202), table surface, paper, wall and street surface.

5. Method according to one of the preceding claims, characterised in that the data is imported using at least one of the following methods: by pointing at least one point (206) of the drawn display (200) with the pointer (208), by clenching the fist (202) and by moving a finger (400) of the hand (202).

6. Method according to one of the preceding claims, characterised in that it is possible to transfer from the display (200) to at least one second display (200) using at least one of the following methods: by moving the surface (202) to a certain direction in the plane (500), by moving the surface (202) to a certain direction in depth direction (700), by pointing at least one point (206) of the drawn display (200) with the pointer (208), by clenching the fist (202) and by moving a finger (400) of the hand (202).

7. Arrangement for importing data with the help of the display device (900) and back reflections (1002), the display (200) being optically drawn and back reflections (1002) being read using the display device (900), characterised in that the display device (900) is in data transmission contact with at least one device and that the at least one display (200) to be drawn is the display (200) produced by the said at least one device.

8. Arrangement according to claim 7, characterised in that the said display (200) comprises at least one menu (206), the menu comprising at least one selection.

9. Arrangement according to claim 7 or 8, characterised in that the said display device (900) is a display device to be attached to a garment.

10. Arrangement according to one of the preceding claims, characterised in that the said display device (900) is at least one of the following: resonance cavity display, micro mirror projector and laser projector.

11. Arrangement according to one of the preceding claims, characterised in that the arrangement comprises means (1110) for locating the point of the display (200) pointed by the pointer.

12. Arrangement according to one of the preceding claims, characterised in that the arrangement comprises means (1106, 1108) for registering the direction of movement of the surface (202), to which surface (202) the display (200) and menu (206) are drawn with the help of the display device (900).

13. Arrangement according to one of the preceding claims, characterised in that the said display device (900) has at least one organ (1108) for pattern recognition.

14. Display device (900) for importing data with the help of the display device (900) and back reflections (1002), the display (200) being optically drawn and back reflections (1002) being read with the help of the display device (900), characterised in that the display device (900) is in data transmission contact with at least one device and that the at least one display (200) to be drawn is the display (200) produced by the said at least one device.

15. Display device (900) according to claim 14, characterised in that the said display (200) comprises at least one menu (206), the menu comprising at least one selection.

16. Display device (900) according to one of the preceding claims, characterised in that the said display device (900) is a display device to be attached to a garment.

17. Display device (900) according to one of the preceding claims, characterised in that the said display device (900) is at least one of the following: resonance cavity display, micro mirror projector and laser projector.

18. Display device (900) according to one of the preceding claims, characterised in that the arrangement comprises means (1110) for locating the point of the display (200) pointed by the pointer.

19. Display device (900) according to one of the preceding claims, characterised in that the arrangement comprises means (1106, 1108) for registering the direction of movement of the surface (202), to which surface (202) the display (200) and menu (206) are drawn with the help of the display device (900).

20. Display device (900) according to one of the preceding claims, characterised in that the said display device (900) has at least one organ (1108) for performing pattern recognition.