EP1856594A1

EP1856594A1 - Computer-aided interface system

Info

Publication number: EP1856594A1
Application number: EP06704711A
Authority: EP
Inventors: Thomas Kienzl
Original assignee: Individual
Current assignee: Individual
Priority date: 2005-02-22
Filing date: 2006-02-21
Publication date: 2007-11-21
Also published as: AT501442B1; AT501442A1; WO2006089323A1

Abstract

Disclosed is a computer-assisted interface system for manually navigating on a navigation plane (A). Said interface system comprises a camera (D) that is designed for optically detecting the navigation plane (A) as well as at least one wireless and electronics-free control part (E) with at least one optical mark (El) located thereupon. Said control part (E) is designed so as to be manually guided on the navigation plane (A) while the at least one optical mark (El) is oriented towards the camera (D) when the control part (E) is used. In order to be able to operate the interface system in an intuitively detectable manner, the navigation parameters movement, position, and orientation of the control part (E) on the navigation plane (A) are coupled to a virtual two-dimensional or three-dimensional model which can be represented on an image output unit (L), such as a screen, in accordance with the navigation parameters.

Description

Computer-aided interface system

The invention relates to a computer-assisted interface system for manual navigation in a navigation plane having a first and a second side, comprising a camera, which is designed for optical detection of the navigation plane, at least one cable and electronic control part with at least one optical marking arranged thereon manual guidance in the navigation plane is designed on the first page and is intended that the at least one optical marking is aligned with the use of the control part towards the camera, wherein the navigation parameters movement, position and orientation of the control part in the navigation plane with a virtual two- or three-dimensional model are coupled, which model can be displayed on an image output unit, such as a screen, depending on the navigation parameters.

Such systems are usually very complex to use and difficult to understand for inexperienced users. The imagination of users is hardly supported in such systems and is more likely to be used only in the acoustic field. The application for a wide audience is therefore problematic. Moreover, it is problematic in previously known systems to detect the position of the control part at any time safely. Since the user can easily hinder the free visual contact of the camera with the control unit in these systems, error detection can not be avoided. The object of the invention is therefore to further develop a known interface system in such a way that it avoids the known disadvantages and can be operated intuitively by anyone. Furthermore, a safe operation of the system without error detection should be guaranteed at all times and the system has a small footprint. According to the invention, this is achieved in that the camera is designed for the optical detection of the navigation plane from the second side of the navigation plane, which second side is opposite this when using the at least one control part. This can cost-effective control parts for an appealing navigation in virtual SD models are used, which are easy to use even by laymen. Due to the viewing direction of the camera, either directly or via mirrors from the side opposite the user, a good visual contact between the camera and the navigation level is always ensured. This shadowing of the camera by the user himself is reliably avoided. In this way, error detections are effectively prevented. In Weiterfuhrung the invention can be provided that in the navigation level a

Plate made of glass or plastic is arranged for a wavelength range for which the

Camera is designed, is transparent.

Such a plate facilitates navigation in the navigation plane.

Furthermore, it can be provided that the navigation level is limited by a frame.

A frame makes navigation easier for the user and provides better protection for any glass plate that may be present.

In a particular embodiment of the invention can be provided that in or on the

Navigation level is arranged a real model in which the at least one control part is navigable.

A Reahnodell provides additional navigation for the user in the navigation.

In particular, it can be provided that the real model in the manner of a floor plan can be attached or attached graphically on the plate.

Such a Reahnodell is particularly easy to implement and updatable.

Alternatively, it can be provided that the real model can be attached or mounted in the manner of a raised model on the plate.

Such a real model is particularly vivid and offers an additional

Guidance for the user.

Alternatively or additionally, it can be provided that the real model by means of a

Projection system is projected to the navigation level.

This can also be used to change the real default while using the system.

This allows e.g. virtually to navigate the floor during navigation in a building, even though the user with the control part real always navigates in a plane.

In this context, it can be provided that the projection system for the projection of the real model is likewise designed from the second side of the navigation plane.

This makes a particularly compact design possible and also ensures that the

User does not shadow the projected real target.

In a further development of the invention it can be provided that the plate is arranged on a stand.

Thus, the position of a plate can be set reliably.

Alternatively, it can be provided that the frame is arranged on a stand.

Thus, the position of a frame can be set reliably. In a further development of the invention can be provided that a lighting device for

Lighting the markers of control parts, which are arranged in the navigation plane, is designed is provided.

This makes the detection of markings by the camera even more reliable.

In a particular embodiment of the invention can be provided that at least one mirror is provided for deflecting the light of the illumination device or of daylight, so that the corresponding light is deflected to the marks of control parts.

This makes detection of the markings by the camera even more reliable in a simple way.

Furthermore, it can be provided that at least one detection mirror is provided, on which the camera is aligned or alignable such that the camera is designed for optical detection of the navigation plane via the mirror.

Thus, the required geometric distance between the camera and the navigation level can be significantly reduced and the interface system therefore be made more compact.

In particular, it can be provided that the mirror is identical to the detection mirror.

This reduces the number of required components.

In a special continuation of the invention can be provided that the

Interface system can be dismantled or folded and run in disassembled or folded state for a person wearable.

For a flexible use of the interface system is given.

In a further development of the invention it can be provided that the plate is arranged on a stand, which forms a cover and / or cover for the plate and / or the mirror in the disassembled or folded state of the interface system.

This avoids breakage of the plate and / or the mirror during transport.

In a particular embodiment of the invention can be provided that the marking of the control part contains a rotationally asymmetric pattern.

Thus, the orientation of the control part in dependence of its rotational position can be determined.

In particular, it can be provided that the marking consists of at least two surfaces of different colors.

In particular, it can be provided that the two surfaces each substantially

Semicircles are, which together form a circular disk.

Such markings are particularly easy to implement, e.g. with ordinary

Color printers on adhesive film. In continuation of the invention, it may be provided that the at least two surfaces are surrounded by a frame surface in a color which is different from the colors of the two surfaces.

This will make both of the surfaces identifiable by the camera, even if the background is similar to one of the two colors.

In a particular embodiment of the invention may finally be provided that the

Marker contains additional areas within or between the at least two

Plains are arranged and differ in their color from the adjacent surfaces.

The invention will be described with reference to the accompanying drawings in which

Embodiments are shown, described in more detail. Showing:

1a to Id four embodiments of an optical marking of a control part,

FIG. 2 shows a collapsed or constructed computer-aided interface system in an oblique view; FIG.

Fig. 3 shows another embodiment of a collapsible computer-aided

Interface system in oblique view

4 shows a vertical embodiment of a computer-assisted interface system in FIG

Oblique, and

5 shows a computer-aided interface system with a navigation surface, a

User and an image output unit in oblique view.

The aim of the invention is the user's simple manual navigation of a user with the help of a cable and electronic control unit E in a navigation plane A, in which the navigation is coupled to a virtual two- or three-dimensional model, which model of an image output unit L, such as a screen, depending on the navigation parameter movement, position and orientation of the control part E can be displayed, as indicated in Fig. 5.

Fig. Ia to Id show optical marks El for a control part E. Algorithmic objective is the reading of coordinates and angle information geometrical, colored objects from the image information of a video camera D. Since the read data from a video camera D are light-dependent and always a more or less strong Noise, the design of the type and shape of the objects is crucial. The shape detected by the camera D has the following characteristics: two surfaces 1 and 2 in shape of semicircles, each with two different colors are surrounded by a different colored frame surface 3. The surfaces could also have other shapes. The outer diameter of the entire circle can be arbitrarily large, but preferably be between 4cm and 10cm. Based on this special shape can be closed both on the position and with the help of the surfaces 1 and 2 on the angle. The frame surface 3 serves the strict demarcation to the background. Note: Otherwise, for example, a user with a red sweater, for example, would disturb the detection of a red area 1 or 2 and make it impossible. The resulting video signals are initially converted from RGB to the HSV color space. The advantage of HSV space is the clear assignment of colors; Thus, by means of the H parameter, a color can be deduced, irrespective of its intensity or brightness. The obtained HSV space is then filtered through only desired color components. In the next step, all neighboring pixels are summarized and examined. This will find multiple regions - the following can be discarded. If their number of pixels is below or above a significant value, the extension width and the extension height are above or below a significant value, the region must contain both colors at a certain ratio, the density (number of pixels per surface) must not fall below a certain value. With the aid of these parameters, it is possible to safely deduce valid control parts E: coordinates and angles. To determine the coordinates of the found marks El their center of gravity is used. This allows a stable query, which allows a higher resolution than the physical resolution, since intermediate values are possible due to the weighting of the pixels. The angle is determined by the determination of the center of gravity of the two surfaces 1 and 2, it can be concluded that the angle. Since the calculated coordinates and angles of the control parts E fluctuate by a certain level due to the above-mentioned inaccuracies of the video signal, smoothing with the aid of a high-pass filter: fast-changing movements (control part E is rotated or moved quickly) are filtered only weakly in order to avoid an effect of Delay, but with slow movements is filtered more to avoid "trembling" of the control part E. Faulty eruierte control parts E, which occur briefly, are eliminated because a recognized control part E for a long time in a row (eg five times) in its position In order to be able to clearly distinguish between several control parts E in the same application, the marking El is further modified One or two, for example, point-shaped further surfaces 4 and / or 5 become in the center of gravity of the surfaces 1 and 2 arranged (see Fig. Ib to Id). By. Combination of this system gives a total of four different markers El (Fig. Ia to Id) and control parts E. Furthermore, it would be possible to recognize by increasing the number of punctiform surfaces an even larger number of different control parts.

FIG. 2 shows a computer-assisted interface system for manual navigation in a navigation plane A, comprising a camera D which is designed for optical detection of the navigation plane A. Furthermore, a cable and electronics-free control part E is shown with an optical marking El arranged thereon, which is designed for manual guidance in the navigation plane A, the optical marking El being directed toward the camera D, via the mirror as a deflection. Due to the nature of the marking El, the navigation parameters motion, position and orientation of the control part E in the navigation plane A can be detected via the camera D and coupled with a virtual two- or three-dimensional model, which model is displayed on an image output unit L, such as a screen. depending on the navigation parameter. It would also be conceivable to form the navigation plane A itself as a picture output medium.

The drawing shows a dismountable, mobile unit. It consists of a light frame C (which is closed like a box on the front), on the underside of which a hinged mirror B is mounted. This mirror reflects ambient light on the underside of the navigation surface A and thus on the optical marking El. Furthermore, a detection mirror B2 can be provided for deflecting the camera image. Through the use of the detection mirror B2, the distance between camera D and navigation surface A is widened, thus reducing the overall height, which represents a decisive advantage for transportability and mobility. The mirror B and the detection mirror B2 may be identical. Mirror B and / or detection mirror B2 can be folded during transport into the frame C, in which it is protected. On the upper inside of the frame C, a camera D is adjustably mounted. The image of the camera D detected via the mirror B2 as a deflection, the entire lower navigation surface A and thus the position and position of the control part E. The camera D is connected via USB or Firewire to the computer. On the frame C is still a hinged or attachable stand F attached, so that the unit is stable in use and can not tip over. The navigation surface A or plate Al is pushed in the construction of the unit in a slot of the frame C and is thus held in a stable position. Depending on the application, a corresponding real model K is placed on the navigation surface A. In unfavorable lighting conditions, in frame C still a lamp H are arranged to ensure the detection of the control parts E unique.

On the navigation surface A, depending on the application, a corresponding real model K, such as a raised model, a graphically attached plan or other is arranged. It can also be provided that the real model is projected onto the navigation plane by means of a projection system (not shown). For this purpose, it can be provided that the navigation plane is provided with a projection foil. This is advantageously a rear projection film, which is arranged on the second side of the navigation plane A. The projection can advantageously also take place from the lower, that is, the side facing away from the user and the control part opposite side. 3 shows a comparable computer-assisted interface system for manual navigation in a navigation plane A. It consists of a light box and a navigation surface A, here designed as a plate Al, which are connected to each other via a construction (not shown in the figure). Either the connecting rod is foldable or dismountable. Since the system is insensitive to incident light, there is no need for closed side panels, but it may be mounted in fabric or lightweight panel material if desired. The navigation surface A or disk Al need not be directly constructively connected to the lightbox, the navigation surface A or disk Al may be e.g. be suspended from the ceiling, or placed on wall brackets. Depending on the application and spatial conditions, the construction will be carried out differently. The control part E is detected by the camera D and evaluated the data. The removal of the navigation surface A from the floor should be designed so that both children, wheelchair users and adults can operate the arrangement (about 75 to 85 cm in height).

The light box consists of a frame C, brightness-adjustable lamps H, camera D, opal Plexiglas cover G. In this Plexiglas cover G, an opening I is provided so that the visual relationship camera D and navigation surface A is not obscured by the Plexiglas cover G. The camera D detects the entire navigation surface A and thus the position and position of the control part E. The camera D is connected to the computer by means of USB, Firewire or frame grabber card. Depending on the application, a corresponding real model K _5, such as a raised model (as in FIG. 5), a plan or another, is arranged on the navigation surface A. 4 shows a further essentially vertically arranged computer-assisted interface system for manual navigation in a navigation plane A, comprising a camera D which is designed for optical detection of the navigation plane A. Furthermore, a cable and electronics-free control part E is shown with an optical mark El arranged thereon, which is designed for manual guidance in the navigation plane A, with the optical marking El being aligned with the camera D. Due to the nature of the marking El, the navigation parameters motion, position and orientation of the control part E in the navigation plane A can be detected via the camera D and coupled with a virtual two- or three-dimensional model.

Fig. 4 shows a stationary vertically mounted unit. It consists of a lightbox and a vertical navigation surface A. Depending on the application and spatial conditions, the construction will be carried out differently. The lightbox consists of the following parts: frame C, brightness adjustable lamps H, camera D, opal Plexiglas cover. In this arrangement, depending on the application to the plate Al can be completely dispensed with. Since the control part E reacts very insensitive to the distance to the camera D (tolerance range +/- 20 cm), the navigation surface A may be formed as a circumferential navigation frame A2. This navigation frame A2 is only for the orientation of the user and for attaching the real model K or other real targets. In practice, the whole will be carried out as follows: A fixed to the rear wall or freely placed in space light source H (including all parts as previously described), in front of some spaced navigation surface A as a plate Al or just a navigation frame A2. The users can navigate in front of the navigation interface A in a standing position. The camera D detects the entire navigation surface A or the navigation frame A2 and thus the position and position of the control part E. The camera D is connected by USB or Firewire or Framegrabberkarte with the computer. Depending on the application, a corresponding real model K, e.g. a sublime model, plan, or otherwise arranged.

As an alternative or in combination with the sublime real model or the plan, images can be projected dynamically, that is, alternately, on the navigation surface A by means of a projection system as a real presetting. Any images, templates, navigation assistance, etc. can be projected dynamically or statically onto the navigation interface. There is always a clear link between the projected image - the "default" - virtual image or sound on an output device (For example, screen and / or speakers) and position and orientation of the control part. This allows, for example, when navigating in a building to virtually change the floor, although the user with the control part real always navigates in a plane. The navigation surface can be designed as a rear projection system. The projector may be a video / data projector, a laser projector or other projection system. It advantageously points in the same direction as the camera. The reading of the mark El on the control part E and the image projection then take place from the same direction.

Further embodiments according to the invention have only a part of the features described, wherein each feature combination, in particular also of various described embodiments, can be provided.

Claims

PATENT APPLICATIONS

Computer-assisted interface system for manual navigation in a navigation plane (A) with a first and a second side, comprising a camera (D), which is designed for optical detection of the navigation plane (A), at least one cable and electronic control part (E) with at least one optical marking (El) arranged thereon, which is designed for manual guidance in the navigation plane (A) on its first side and is provided so that the at least one optical marking (E1) is in use of the control part (E) to the camera (D) is aligned, wherein the navigation parameters motion, position and orientation of the control part (E) in the navigation plane (A) are coupled to a virtual two- or three-dimensional model, which model on an image output unit (L), such as a screen, depending on the navigation parameters can be represented, characterized in that the camera (D) for the optical detection of the Navigat ion level (A) is designed from the second side of the navigation plane (A) forth, which second side when using the at least one control part (E) opposite to this.

2. Interface system according to claim 1 or 2, characterized in that in the navigation plane (A) a plate (Al) made of glass or plastic is arranged, which is transparent to a wavelength range for which the camera (D) is designed.

3. Interface system according to one of claims 1 to 3, characterized in that the navigation plane (A) by a navigation frame (A2) is limited.

4. Interface system according to claim 3 or 4, characterized in that in or on the navigation plane (A), a real model (K) is arranged, in which the at least one control part (E) is navigable.

5. interface system according to spoke 4, characterized in that the real model (K) in the manner of a floor plan is graphically mounted or mounted on the plate (Al).

6. interface system according to claim 4, characterized in that the real model (K) in the manner of a raised model on the plate (Al) can be attached or attached.

7. interface system according to claim 4, characterized in that the real model (K) by means of a projection system on the navigation plane (A) is projected.

8. interface system according to claim 7, characterized in that the projection system for the projection of the real model (K) is also designed from the second side of the navigation plane (A) ago.

9. Interface system according to one of claims 2 to 8, characterized in that the plate (Al) is arranged on a stand (F).

10. Interface system according to one of claims 3 to 9, characterized in that the navigation frame (A2) on a stand (F) is arranged.

11. Interface system according to one of claims 1 to 10, characterized in that a lighting device (H) for illuminating the markings (El) of control parts (E), which are arranged in the navigation plane (A), is provided.

12. Interface system according to one of claims 1 to 11, characterized in that at least one mirror (B) for deflecting the light of the illumination device (H) or of daylight is provided so that the corresponding light on the markings (El) of control parts (E ) is deflected.

13. Interface system according to one of claims 1 to 12, characterized in that at least one detection mirror (B2) is provided, on which the camera (D) is oriented or alignable, that the camera (D) for the optical detection of the navigation plane (A) via the mirror (B2) is designed.

14. Interface system according to claim 13, characterized in that the mirror (B) with the detection mirror (B2) is identical.

15. Interface system according to one of claims 1 to 13, characterized in that it is dismountable or collapsible and carried out in the disassembled or folded state for a person portable.

16. Interface system according to claim 15, characterized in that the plate (Al) on a stand (F) is arranged, which in the disassembled or collapsed state of the interface system, a cover and / or shell for the plate (Al) and / or Mirror (B) forms.

17. Interface system according to one of claims 1 to 16, characterized in that the marking (El) of the control part (E) contains a rotationally asymmetric pattern.

18. interface system according to claim 17, characterized in that the marking (El) consists of at least two surfaces (1, 2) of different colors.

19. Interface system according to spoke 18, characterized in that the two surfaces (1, 2) are each substantially semicircles, which together form a circular disk.

20. Interface system according to spoke 18 or 19, characterized in that the at least two surfaces (1, 2) of a frame surface (3) in a color that is different from the colors of the two surfaces (1, 2) are surrounded.

21. Interface system according to one of claims 18 to 20, characterized in that the marking (El) further surfaces (4, 5), which are arranged within or between the at least two surfaces (1, 2) and in their color different from the adjacent areas.