AT501442A1 - COMPUTER-ASSISTED INTERFACE SYSTEM - Google Patents

Description

• 28459 / cw. • 28459 / cw

The invention relates to a computer-assisted interface system for manual navigation in a navigation plane, comprising a camera which is designed for optical detection of the navigation plane, at least one cable and elektronikfireien control part with at least one optical marking arranged thereon, which is designed for manual guidance in the navigation level and it is provided that the at least one optical marking is aligned with the use of the control part to the camera.

Such systems are usually very complex to use and difficult for experienced users to see through. The imagination of users is hardly supported in such systems and is more likely to be used only in the acoustic field. The application for a wide audience is therefore problematic.

The object of the invention is to further develop a known interface system in such a way that it avoids the known disadvantages and can be operated intuitively by anyone.

According to the invention this is achieved in that the navigation parameters motion, position and orientation of the control part are coupled in the navigation plane with a virtual two- or three-dimensional model, which model can be displayed on an image output unit, such as a screen, depending on the navigation parameters.

This allows cost-effective control parts for an appealing navigation in virtual 3D models are used, which are easy to use even by laymen.

In a particular embodiment of the invention can be provided that the camera is designed for the optical detection of the navigation plane from that side of the navigation plane ago, which is remote from the user.

This shadowing of the camera by the user himself is reliably avoided.

In a continuation of the invention can be provided that in the navigation level, a plate made of glass or plastic is arranged, which is transparent to a wavelength range for which the camera is designed.

Such a plate facilitates navigation in the navigation plane. 1 ·· ··························································· ···· · · ·

Furthermore, it can be provided that the navigation level is limited by a frame.

A frame makes navigation easier for the user and provides better protection for any glass plate that may be present.

In a particular embodiment of the invention can be provided that in or on the navigation level, a real model is arranged, in which the at least one control part is navigable.

A real model offers additional orientation for the navigation

User.

In particular, it can be provided that the real model in the manner of a floor plan can be attached or attached graphically on the plate

Such a real model is particularly easy to implement and updatable. Alternatively, it can be provided that the real model can be attached or mounted in the manner of a raised model on the plate.

Such a real model is particularly vivid and provides additional guidance to the user.

In a further development of the invention it can be provided that the plate is arranged on a stand.

Thus, the position of a plate can be set reliably.

Alternatively, it can be provided that the frame is arranged on a stand.

Thus, the position of a frame can be set reliably.

In a further development of the invention, provision can be made for a lighting device to illuminate the markings of control parts which are arranged in the navigation plane to be provided.

This makes the detection of markings by the camera even more reliable.

In a particular embodiment of the invention can be provided that at least one mirror is provided for deflecting the light of the illumination device or of daylight, so that the corresponding light is deflected to the marks of control parts.

This makes detection of the markings by the camera even more reliable in a simple way. 2 • · Μ ·· ·· • · · · · · · · · · · · · ·

• ··· · I • · · ·

Furthermore, it can be provided that at least one detection mirror is provided, on which the camera is aligned or alignable such that the camera is designed for optical detection of the navigation plane via the mirror.

Thus, the required geometric distance between the camera and the navigation level can be significantly reduced and the interface system therefore be made more compact.

In particular, it can be provided that the mirror is identical to the detection mirror.

This reduces the number of required components.

In a special embodiment of the invention, it can be provided that the interface system can be dismantled or folded and made portable for a person in the disassembled or folded state.

For a flexible use of the interface system is given.

In a further development of the invention it can be provided that the plate is arranged on a stand, which forms a cover and / or cover for the plate and / or the mirror in the disassembled or folded state of the interface system.

This avoids breakage of the plate and / or the mirror during transport.

In a particular embodiment of the invention can be provided that the marking of the control part contains a rotationally asymmetric pattern.

Thus, the orientation of the control part in dependence of its rotational position can be determined.

In particular, it can be provided that the marking consists of at least two surfaces of different colors.

In particular, it can be provided that the two surfaces are each substantially semicircles, which together form a circular disk.

Such markings are particularly easy to implement, e.g. with ordinary color printers on adhesive film.

In a continuation of the invention, it can be provided that the at least two surfaces are surrounded by a frame surface in a color that is not the same as the colors of the two surfaces. 3 • ······························································································ · · ·

This will make both of the surfaces identifiable by the camera, even if the background is similar to one of the two colors.

In a particular embodiment of the invention may finally be provided that the marking contains further surfaces which are arranged within or between the at least two surfaces and which differ in their color from the adjacent surfaces.

The invention will be further described with reference to the accompanying drawings, in which embodiments are shown. Showing:

Fig. La to ld four embodiments of an optical marking of a

Control part,

FIG. 2 shows a collapsed or constructed computer-aided interface system in an oblique view;

Fig. 3 shows another embodiment of a collapsible computer-aided interface system in an oblique view

Fig. 4 shows a vertical embodiment of a computer-aided

Interface system in oblique view, and

5 shows a computer-aided interface system with a

Navigation surface, a user and an image output unit in oblique view.

The aim of the invention is simple for a user manual navigation of a user using a cable and electronic control unit E in one

Navigation level A, in which the navigation is coupled to a virtual two- or three-dimensional model, which model can be displayed on a Bildausgäbeeinheit L, such as a screen, depending on the navigation parameter movement, position and orientation of the control part E, as shown in Fig. 5 is indicated.

Fig. La to ld show optical marks El for a control part E. Algorithmic objective is the reading of coordinates and angle information geometrical, colored objects from the image information of a video camera D. Since the read data from a video camera D are light-dependent and always a more or less strong Noise, the design of the type and shape of the objects is crucial. The shape detected by the camera D has the following properties: Two surfaces 1 and 2 in the form of semicircles, each with two different colors, are surrounded by 4 of a differently colored frame surface 3. The surfaces could also have other shapes. The outer diameter of the entire circle may be, for example, between 4cm and 10cm. Based on this special shape can be closed both on the position and with the help of the surfaces 1 and 2 on the angle. The frame surface 3 serves the strict demarcation to the background. Note: Otherwise, e.g. a user with a e.g. red sweater interfere with the detection of a red area 1 or 2 and make impossible.

The resulting video signals are initially converted from RGB to the HSV color space. The advantage of HSV space is the clear assignment of colors; Thus, by means of the H-parameter can be closed to a color, regardless of its intensity or brightness. The obtained HSV space is then filtered through only desired color components. In the next step, all neighboring pixels are summarized and examined. This will find multiple regions - the following can be discarded. If their number of pixels is below or above a significant value, the extension width and the extension height are above or below a significant value, the region must contain both colors at a certain ratio, the density (number of pixels per surface) must not fall below a certain value. With the aid of these parameters, it is very possible to conclude valid control parts E: coordinates and angles. To determine the coordinates of the found marks El their center of gravity is used. This allows a stable query, which allows a higher resolution than the physical resolution, since intermediate values are possible due to the weighting of the pixels. The angle is determined by the determination of the center of gravity of the two surfaces 1 and 2, it can be concluded that the angle. Since due to the above-mentioned inaccuracies of the video signal, the calculated coordinates and angles of Steurteile E fluctuate by a certain level, is smoothed with the help of a high pass: Fast changing movements (control part E is quickly rotated or moved) are filtered only weakly to no effect of the delay but with slow movements is filtered more to avoid "jittering" of the control part E. Faulty eruierte control parts E, which occur for a short time will be eliminated because a recognized control part E over a long period of time (for example, five times) must be recognized in its position. In order to clearly distinguish between several control parts E in one and the same application, the marking El is further modified. One or two, for example, point-shaped further surfaces 4 and / or 5 are arranged in the center of gravity of the surfaces 1 and 2 (see Fig. Lb to ld). Due to ············ · · · · · · ·

Combination of this system gives a total of four different markers El (Fig. La to ld) or control parts E.

FIG. 2 shows a computer-assisted interface system for manual navigation in a navigation plane A, comprising a camera D which is designed for optical detection of the navigation plane A. Furthermore, a cable and electronics-free control part E is shown with an optical marking El arranged thereon, which is designed for manual guidance in the navigation plane A, the optical marking El being directed toward the camera D, via the mirror as a deflection. Due to the nature of the marking E1, the navigation parameters motion, position and orientation of the control part E in the navigation plane A can be detected via the camera D and coupled with a virtual two- or three-dimensional model, which model is displayed on an image output unit L, such as a screen. depending on the navigation parameter.

The drawing shows a dismountable, mobile unit. It consists of a light frame C (which is closed like a box on the front), on the underside of which a hinged mirror B is mounted. This mirror refects ambient light on the underside of the navigation area A and thus on the optical marking El. Furthermore, a detection mirror B2 can be provided for deflecting the camera image. The distance between the camera D and the navigation surface A is widened by the use of the detection level B2 and thus the height is reduced, which represents a decisive advantage for transportability and mobility. The mirror B and the detection mirror B2 may be identical. Mirror B and / or detection mirror B2 can be folded during transport into the frame C, in which it is protected on the upper inside of the frame C, a camera D is mounted adjustable. The image of the camera D detected via the mirror B2 as a deflection, the entire lower navigation surface A and thus the position and position of the control part E. The camera D is connected via USB or Firewire to the computer. On the frame C is still a hinged or attachable stand F attached so that the unit is stable in use and can not tilt. The Naviagtionsoberfläche A or plate Al is pushed in the construction of the unit in a slot of the frame C and is thus held in a stable position. Depending on the application, a corresponding real model K is placed on the navigation surface A. In the case of unfavorable light conditions, a light H can still be arranged in frame C in order to unambiguously ensure the recognition of the control parts E. 6 years *

On the Naviagtionsoberfläche A depending on the application, a corresponding real model K, such as a raised model, a graphically mounted plan or other arranged.

3 shows a comparable computer-assisted interface system for manual navigation in a navigation plane A. It consists of a light box and a navigation surface A, here designed as a plate Al, which are connected to one another via a construction (not shown in the figure). Either the connecting rod is foldable or dismountable. Since the system is insensitive to incident light, the side surfaces need not be closed, but may be mounted on fabric or lightweight board material if desired. The Naviagtionsoberfläche A or plate Al need not be directly constructively connected to the light box, Naviagtionsoberfläche A or plate Al may, for example. be suspended from the ceiling, or placed on wall brackets. Depending on the application and spatial conditions, the construction is carried out differently.

The control part E is detected by the camera D and evaluated the data.

The removal of the Naviagtionsoberfläche A from the floor should be designed so that both children, wheelchair users and adult people can operate the arrangement (about 75 to 85 cm in height).

The light box consists of a frame C, brightness-adjustable lamps H, camera D, opal Plexiglas cover G. In this plexiglass cover G, an opening I is provided on which the visual relationship camera D and navigation surface A is not obscured by the Plexiglas cover G. The camera D detects the entire navigation surface A and thus the position and position of the control part E. The camera D is connected to the computer by means of USB, Firewire or frame grabber card. Depending on the application, a corresponding real model K, such as a raised model (as in FIG. 5), a plan or another, is arranged on the navigation surface A.

Fig. 4 shows another substantially vertically arranged computer-aided interface system for manual navigation in one

Navigation level A, comprising a camera D, which is designed for optical detection of the navigation plane A. Furthermore, a cable and electronics-free control part E is shown with an optical marking El arranged thereon, which is designed for manual guidance in the navigation plane A, with the optical marking El being aligned with the camera D. Due to the nature of the mark El, the camera D can be used for 7 • ························································· · »· · ··· ·

Navigation parameters motion, position and orientation of the control part E in the navigation level A are detected and coupled with a virtual two- or three-dimensional model.

Fig. 4 shows a stationary vertically mounted unit. It consists of a lightbox and a vertical navigation surface A. Depending on the application and spatial conditions, the construction is carried out differently. The lightbox consists of the following parts: frame C, brightness adjustable lamps H, camera D, opal Plexiglas cover. In this arrangement, j e can be completely dispensed with after application to the plate Al. Since the control part E reacts very insensitive to the distance to the camera D (tolerance range + - 20 cm), the Naviagtionsoberfläche A may be formed as a circumferential navigation frame A2. This navigation frame A2 is only for the orientation of the user and for attaching the real model K or other real targets. In practice, the whole will be carried out as follows: A fixed to the rear wall or freely placed in space light source H (including all parts as previously described), in front of some spaced navigation surface A as a plate Al or just a navigation frame A2. The users can navigate in front of the navigation interface A in a standing position. The camera D detects the entire navigation surface A or the navigation frame A2 and thus the position and position of the control part E. The camera D is connected by USB or Firewire or Framegrabberkarte with the computer. Depending on the application, a corresponding real model K, e.g. a sublime model, plan, or otherwise arranged.

Further embodiments according to the invention have only a part of the features described, wherein each feature combination, in particular also of various described embodiments, can be provided.

Claims: 8

Claims (16)

28459 / cw PATENT CLIENTS Computer-assisted interface system for manual navigation in one navigation level (A). comprising a camera (D), which is designed for optical detection of the navigation plane (A), at least one cable and electronics-free control part (E) with at least one optical marking (El) arranged thereon, for manual guidance in the navigation plane (A ) is designed and is intended that the at least one optical marking (El) in use of the control part (E) to the camera (D) is aligned, characterized in that the navigation parameters movement, position and orientation of the control part (E) in the navigation plane (A) are coupled to a virtual two- or three-dimensional model, which model of an image output unit (L), such as a screen, depending on the navigation parameters is adjustable. Interface system according to claim 1, characterized in that the camera (D) for the optical detection of the navigation plane (A) is designed from that side of the navigation plane (A), which faces away from the user. Interface system according to claim 1 or 2, characterized in that in the navigation plane (A) a plate (Al) made of glass or plastic is arranged, which is transparent for a wavelength range for which the camera (D) is designed. Interface system according to one of claims 1 to 3, characterized in that the navigation plane (A) by a navigation frame (A2) is limited. Interface system according to claim 3 or 4, characterized in that in or on the navigation plane (A) a real model (K) is arranged, in which the at least one control part (E) is navigable 9 "L. &Quot; L. · · · · · · · · · · · · · · · · · · · · · · · · · · · · ·. ·························································································· 6. interface system according to claim 5, characterized in that the real model (K) in the manner of a plan diagram on the plate (Al) can be attached or attached. 7. interface system according to claim 5, characterized in that the real model (K) in the manner of a raised model on the plate (Al) can be attached or mounted. 8. interface system according to claim 3, characterized in that the plate (Al) on a stand (F) is arranged. 9. interface system according to claim 4, characterized in that the navigation frame (A2) on a stand (F) is arranged. e * ' 10. Interface system according to one of claims 1 to 9, characterized in that a lighting device (H) for illuminating the markings (El) of control parts (E), which are arranged in the navigation plane (A), is provided. 11. Interface system according to one of claims 1 to 10, characterized in that at least one mirror (B) for deflecting the light of the illumination device (H) or of daylight is provided so that the corresponding light on the marks (El) of control parts (E ) is deflected. 12. Interface system according to one of claims 1 to 11, characterized in that at least one detection mirror (B2) is provided, on which the camera (D) is aligned or aurichtbar that the camera (D) for optical detection of the navigation plane (A ) is designed over the mirror (B2). 13. Interface system according to claim 12, characterized in that the mirror (B) with the detection mirror (B2) is identical 10 · »·· · · · ·· ·· 14. Interface system according to one of claims 1 to 13, characterized in that it can be dismantled or folded and executed in a disassembled or folded state for a person wearable. 15. Interface system according to claim 14, characterized in that the plate (Al) is arranged on a stand (F), in the disassembled or collapsed state of the interface system, a cover and / or shell for the plate (Al) and / or the Mirror (B) forms. 16. Interface system according to one of claims 1 to 15, characterized in that the marking (El) of the control part (E) contains a rotationally asymmetric pattern. 17. interface system according to claim 16, characterized in that the marking (El) consists of at least two surfaces (1, 2) of different colors. 18. Interface system according to claim 16, characterized in that the two surfaces (1, 2) are each substantially semicircles, which together form a circular disk. 19. Interface system according to one of claims 16 to 18, characterized in that the at least two surfaces (1, 2) of a frame surface (3) in a color which is different from the colors of the two surfaces (1,2) is surrounded , 20. Interface system according to one of claims 17 to 19, characterized in that the marking (El) further surfaces (4 and 5), which are arranged within or between the at least two surfaces (1, 2) and in their color different from the adjacent areas. 11