EP1370981A2 - System and method for representing information - Google Patents

System and method for representing information

Info

Publication number
EP1370981A2
EP1370981A2 EP20020704586 EP02704586A EP1370981A2 EP 1370981 A2 EP1370981 A2 EP 1370981A2 EP 20020704586 EP20020704586 EP 20020704586 EP 02704586 A EP02704586 A EP 02704586A EP 1370981 A2 EP1370981 A2 EP 1370981A2
Authority
EP
Grant status
Application
Patent type
Prior art keywords
φ
context
ß
user
sh
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP20020704586
Other languages
German (de)
French (fr)
Inventor
Andreas Beu
Gunthard TRIEBFÜRST
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens AG
Original Assignee
Siemens AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/30Information retrieval; Database structures therefor ; File system structures therefor
    • G06F17/30943Information retrieval; Database structures therefor ; File system structures therefor details of database functions independent of the retrieved data type
    • G06F17/30994Browsing or visualization

Abstract

The invention relates to a system and a method for representing information, in addition to a computer program product for carrying out the method, which improve the representation of information in terms of user-friendliness. The inventive information representation system contains a display device (1) for displaying information which is called up according to a context.

Description

description

System and method for information display

The invention relates to a system and method for information display.

Such a system and method is used for example in the field of automation technology in production and machine tools, in diagnostic / service support systems, and for complex components, devices and systems, such as vehicles and industrial machinery and equipment used, especially in the specific context of the application field " Augmented Reality in the service. "

The object of the invention is based is to improve the provision of information and functions in terms of user-friendliness.

This object is achieved by a system and a method with the specified in claims 1 and 14 features.

Many complex activities in the areas of service, maintenance and production require a high level of supporting information and functions in the right place at the right time. Mobile Augmented Reality (AR) technology enables in these areas access to a very extensive database. Information management systems provide access to a variety of information, but for the completion of a specific task, only a part is needed from this pool. What information is needed depends on the context and the responsibility of the user. In common Informationsmänagementsystemen the user must seek the interest to him at the current time information only, which often means considerable time. Traditional user interfaces typically require more or less complex search and / or navigation dialogs to the appropriate information or function to find. They are usually static in their structure and look and feel, often offer a variety of options, of which only a part is needed to accomplish a specific task, and they can be only partially adapted to the current needs of the user. Further requirements for the user interface of mobile AR systems arise from the size of the displays that are significantly less than PC monitors (so-called. "Babyface"). To overfilling of the display to avoid (screen clutter), only those information and functions as possible should be represented, which are relevant to the user in their current context. This applies even more for such Augmented Reality systems, in which computer-generated information (eg. As a head-mounted display) are displayed directly in the field of view of the user and then superimpose the reality. The difficulty is therefore to filter out of a very large data set that truly required by the user for his task information and functions and to present it in an appropriate manner on a mobile AR system.

Current information management systems have so far focused only on stationary systems. Widespread graphical user interface (desktop metaphor) allow the user customization, such as direct access to frequently needed information and functions (eg., Via shortcuts on the desktop) or hiding and modifying toolbars. In major operating systems search functions are integrated, which have extensive configurable criteria that enable you to locate information on the local workstation, the local network or the Internet. On the Internet and there is a variety of search engines, which often specialize in certain tasks. The full-text search option lets you search for criteria that have not been taken into account in establishing the appropriate information databases. Offline Search Systems lead to preferences own research on the Internet by. All current solutions described require the user a great deal of planning and hard data to the system. While the user is usually clear in what context he seeks certain information, it must inform the system via elaborate criteria specifications. For short-term tasks here is the effort required is often too high to get useful results.

The present invention provides a tool in the form of a system for providing information and functions, which is referred to hereinafter as the context Navigator, the users of mobile AR systems depends on its context (location, object, persons working object) information and / or functions offering. The context Navigator enables access to information quickly and efficiently from a large amount of data by offering the user a reasonable selection. This pre-selection is dynamically generated from the current context: depending on its spatial position, the actual work object, the work object, as well as possible communication partners of the user receives a customized selection of information and functions. Spatial context, work items (z. B. components) and communication partner (other persons present) can be detected by the system automatically AR tracking, monitoring tasks or workflow and controls a workflow engine. The user can decide which of the automatically detected objects are displayed in its mobile AR system, he can add additional elements manually (eg., Via a search), and he has constantly direct access to samples of specific objects. The mobile application of a computer system is compared to office work place increased demands in terms of an efficient and fast your access to the data they need, but also offers the opportunity to obtain from the spatial context out information about which information or functionality to the user in the current situation are important or useful.

The context Navigator detects using an AR tracking system the spatial context (location, components, people present) and using a workflow engine the work context of the user. Based on this information, the user interface adapts and displays the information and functions that in the current context - ie for. As for the current operation of the current component - are useful. The context Navigator acts as a dynamic filter on the database and is thus able to provide the available "right" information and functions at the right time. The user has the ability to directly access multiple context objects. These are presented to him in the display by context-specific menus that access to the relevant information and

enable functions. In these context-specific menus include. U. references to "related" Kontextob ects include (for. Example, on components that are operatively associated with the currently processed component). The user can presented to it context objects always remove from the display, when he no longer needed.

In the present invention, a tracking system is used which is a system that objects (z. B. spaces, machinery, components) may detect and identify. The

Detection is advantageously performed on an image capturing unit. The information collected will be evaluated in a computer unit. With the help of the tracking system, the location of the user and the context in which it is located is determined and this information to the

Computer unit passed. The term context information is to understand that are in place, time or functional relationship with the user, such. As its actual working conditions, its local environment, his sight and his eyes focus, but also the presence of external disturbances or information that may be relevant to the user. The generation of the

Reports of external interference and information takes place in the first control means. This also includes the information system, which "filters" by the given context notes and makes the information available that is relevant at the moment. If a particular context covered by Trackingsyste, it forms a so-called context object and appears symbolically in a "task bar" as "button". Through the operation of these "buttons" that is, the second control means, the user between different context objects can change. Each context object has its own menu, which among other things included the option to abandon the context object. With the aid of a standard for augmented reality applications tracking system the possibilities and potentials of context acquisition on the design, structure and organization of a user interface is transmitted to ensure an intuitive, fast and user-friendly navigation, orientation and usability. The user thus remains mobile, that the display device is constructed as a display of a mobile computer system. The navigator context and its components are implemented on one or more mobile or stationary computer systems.

In the following the invention is described in detail with reference to the embodiment illustrated in the figures and explained embodiments.

Show it:

1 shows the operation of the context navigator overview, 2 shows a context object with information

Functions and notes 3 shows the context Navigator visualized on a hand-held display,

4 shows the context Navigator visualized on a head-mounted display, FIG 5 is an illustration of the context in the navigator of granularity 1,

FIG 6 is an illustration of the context in the navigator of granularity 1 with changed spatial position with respect to FIG 5,

FIG 7 is an illustration of the context navigator with a change of the Granularitätslevels,

FIG 8 is an illustration of the context navigators at a changed on Level 3 granularity

9 shows a further embodiment of the

Context and Navigators

Figures 10 to 20 views a user interface on a display device of the

Context Navigator.

Hereinafter, the components used and their interaction will be explained with reference to FIGS. 1 to 3 First, an overview of the terms used is given. A context object 6 includes a filtered data set from a database 7, z. As a database, access to information and functions 8 9 allows. Context objects 6 are generated by the context register 21, 22 from the real-world context. The context manager 23 is the central element of the context navigator 30 and the management of context objects used 6. The context manager 23 is responsible for ensuring that new context objects are taken 6 for the user 3 in the context display 29th As an additional filter of Granularitätsregler is 24. The objects in the context display 29 are presented to the user 3 in the form of context-specific menus 20th About <£>

Φ

Φ l Φ 4 -H ß

X H Φ

Φ CQ N ß + τ-ι ß Φ Λ ιχ> Λ ^ cd ß

0 ß 4-1 -r) T φ 4 X Φ Φ r

4-1 X 13 Φ

ΛJ Φ SH 4-1 + -> 4

4J Φ Φ ß Λ

T "l & ß o -H

Λ o M Oil 4-

O t4 4-1

4-1 ß φ rH

X ß SH -H

Φ Φ Φ 13 Φ

+ J + J rH 4H ß Ö) 4J ß rH O

0 -H -H ß Φ> w Φ Φ Λ

N Φ cd ß φ Φ H -H EH Φ rH oil Φ CQ

Φ φ P SS 13

-H cd Φ Φ 13 EH

> -H -H ß φ φ £ & ß

Oil - \ Oil

-H ι-i + -> • ^ -i

-H Ä ß o

Φ N -H MH 13

• -H -H SH rH rH ß cd -r Φ φ φ a 13 -H,

Λ 4 XP and rH φ SH C ß cd Φ • SH ß RSS ro Λ ß cd 4 cd Φ

ΛJ SS 13

Φ φ Λ .sigma..sub.i N υ φ -

CM ß + J H £ 1

Φ φ CQ ß ß ß SH

Oil ß Φ Φ Φ

-H EH PQ φ g Λ φ 13 <s: ß

N SH H g o Φ 0 Φ ß ß X cd l> RSS φ O

4-1 -H -H υ l

X rQ ß CQ 4H rH φ Φ Φ SH ß

4-> --H CQ Φ cd S ß rH CQ 4->

O Φ: ß σϊ Ϊ4 rQ g ß CM o LT) O LO o IT) rH rH CM CM CO ro

their special properties and the functions associated information 8 and 9. In column A of the type of the respective context object 6 is indicated in column B associated subtypes. The columns C, D and E contain information on specific properties of the context objects 6, namely, whether it is displayed automatically generated (column C) automatically (column D) and granulated (column E). In column F are the related information 8, lists the related information 9 in column G. 0

Table 1: Types of context objects 6

ß MD in cd -. + Φ Φ J .. r- oil ß ß ß g Φ Φ Φ g g di 13 4-1

© ß oil Φ φ cd cd Φ φ φ φ 4-1 J 4-1 Φ -rl

ß © Φ Φ rH Φ 4-1 ΛJ ß ß + J 13 i H Φ 4-1 13 1 ΛJ φ SH φ

13 © ß SH PH gu O 4-1 ß g φ ro cd. 13 CQ CQ φ ß N Φ SH SH ϊ -rl U ß ß t ΛJ cd A cn MD> 1 O i- 1 4-1 ^ 13 Φ Φ ß -H 4

© ß ß Φ CQ H SH Φ cd CQ Φ SH SH CM CG φ φ r Q -rl ^^ 13 cd RSS 13 4-> ß

O -H -rl -rl 4- RSS> 13 + J SH U Di Φ Φ Φ Φ 4 - ^ O CQ φ 13 Φ + J -rl -H 4-> RSS φ

ΛJ υ M ß CQ SH -H CQ Φ oil N Φ> 4-1 CQ φ rH r 4-1 -H RSS cd φ X 4-> u CQ CQ

H Φ SH P Φ Φ 13 13 Di 4-> Di ΛJ cd cd ri X 13 13 SH ß ß RSS RSS φ rH -rl: cd

U oil cd O • 4- rQ> ß SH ß ß -H ro Φ 13 Φ A -rl ß MD φ υ 4-> φ d ß SH

Q • cd S Φ EH ß CQ Φ cd -H Φ g ß φ φ CM "ro ß £ ß 4-1 Di cd RSS ß ß CQ -H

4-1 H a

SH 13 φ φ SH cd -rl X Φ 13 φ ß N SH rQ ß -rl ΛJ ü ß 4-1 φ o 13 SH ro

4-> Φ O Φ 13 g -i ß EH SH N PQ ß cd O ri O t ß -H + J Φ ß «ß Φ φ Φ pH RSS -H 4-> g Φ D Φ cd rQ φ + - > -H φ ß "Di 4-> φ CG φ φ + J SH SH SH 4-1

-rl ri l 13: <ύ Φ SH -H ^ Φ Φ P -rl ß 4-> Oil Di X Φ rH RSS -H -rl Q SH ΛJ φ Φ φ Φ ΛJ

W • Φ Φ Φ 5 ß ß RSS Φ 13 X • ß ü 4-1 cd Φ Φ Φ 4-1 g • -H Φ 4-1 ß 4-1 RSS N φ ß MH a CQ £ Φ -rl ß • • u Di φ MH ß 4-1 CQ CQ 4-1: cd O Φ pq Φ "n φ -rl r \ 0 4> - | - ι

4-1 CQ Φ P ß: ß oil φ 4J cd 13 cd SH rH -RH 4-1 ß -rl RSS g 4-1 CQ & rQ rQ φ -rl RSS ß A rH SH S cd cd 4H oil Φ ß ΛJ 4-1 SH rH Φ Φ ß OO g 1 + g 4 U CQ CQ • O g Ü) od ß ß ß -H 4-> SH CQ -H -H 0> W 4-1 is -H -rl Φ -rl φ 13 Φ φ N φ 4-1 MD Φ

> ß. φ ß -rl -rl 4-1 -H φ Φ m X 4-1 N 3E + J pq ß CQ - - 13 13 X ß SH ffl φ ro Φ ffl RSS Φ ι + H oil 4 g Sä rQ -. Sa r \ φ φ ß cd CQ ß Φ cd Φ Φ Φ -rl ß

CQ ß and ß SH -RH -H 4-1 Φ φ A 4-1 Φ SH a 4-1 Φ Φ -rl 00 SH 4-1 ß + J 4> g φ rH H • cd Φ 4-1 • • 4-1 SH Φ 13 0 Φ -H -n + ß ß CQ J ffl X ß ß Φ 4-1 13 -rl 4J Φ Φ ß ΛJ

Φ cd w N SH H: cd ß RSS ffl X + J ß> 13 ß o Oil Oil 4-1 RSS φ X o ß oil ΛJ 4-1 φ 13

N

• ro a + -> Φ o φ cd cd ß 4> Ϊ4 ß -HX 4-> • O φ φ MH fcS ^ φ rH -ro ß

4-> SH G -H CQ CQ 13 • 4-> P Sä ß φ 13 φ ΛJ MH Φ ß ß RSS -U SH 4-1 TD d rQ ß ß φ φ Φ PH SH Φ Φ Φ N ß ß 13 cd N ß 4-> 0 U RSS ß o Φ d rQ A o Φ 13 SS 13 cd SH SH CQ Φ CQ 0 ß Di 4-1 φ Φ SH O ß ü W CQ o - l o Φ φ V 4> 13 SH

≥ O 13 Φ Φ Φ RSS Sä 13 ii SS cd SH SH φ P Φ "O -H CQ, • 4-1 ß SH CQ -rl X SH Φ pq N a ü ß 13 SH 13 cd P: ß, ß - rl X ß 4> -rl ß cd Φ Φ + J φ Φ φ Φ Sa o, -, 4-1 SH + J ß ß Φ. -. ι + 4: 13 cd • SH rH Φ cd 4-1 ß Φ g 13 13 13 Di ß 4-1 g CM ß ß SH rH φ 13 00 Φ 4H Sä 4 rH Φ 13 Φ cd g g d φ SH ß ro

Φ oil ß Φ 13 O 13 RSS rH rH 4- ß> 4H RSS Φ 13 φ S og go ri ^ cd CQ Φ 0 o + J

13 CQ Φ cd 13 ß: ß • cd cd cd ß -i SH - ß ß U O 4-1 O rH o + c 4 g: cti RSS> i J • SH cd

= ß rH ffl o ß ä φ CQ -rl ß φ Φ cd cd O ß ß ^ H CQ SH + J ß ß ß ß Φ -rl ü 4-1 Φ

A ß ß PH SH CQ φ φ Φ φ rH SH ß cd 13 cd CQ Φ φ H ß cd Φ a Φ CQ • -HN υ Φ f SH c 4 + Φ cd Di 13 φ o ß ß 4-1 4- 1 uπ Di g ß cd cd + Di J ffl S SH ri ^ μ 4-1

-HS • - - Φ CQ -rl a X O + J ß 13 -rl rH Φ ß 1 + 4 • ß O 13 A ΛJ φ 1 + Φ 4 Dl a <CM cd ß

CQ 13 o X ß ü Di: 0 Φ 4: cd ß H g O CQ ^ - cd ß ß oil • o CQ ri ß 4> ß Φ -H cd SH -rl Λ! 13th A cd Φ: 0 SH SH Φ rH ^ Φ -i cd -H Φ ß <-i 4-1. SH ß ß Φ Φ ΛJ ß X + J PH cd 4-> ß SH rQ g DI ΛJ Φ rH 13 + J • H d B 13 13 φ φ ri cd ß ß ffl

Φ Φ RSS X ß ß ß H ffl CQ SH Φ Φ ro ß O cd -rl Sä 13 E φ cn ß MH -rl ri rH φ cd ri u n cd u Φ Φ Φ + RSS RSS φ -> 0 CM Di ß ti MD MH g N 13 CM Φ SH P ß -rl oil SH rH g CQ A ΛJ: ß υ φ 13 1 + 4 13 13 + 4 lH ι Φ CQ -RH RSS rQ gg: ß SH CQ φ φ Ü

-HO Φ SH SH O c ++ Φ SH ß ß ß -rl SH Di Φ Φ υ ß Dl ro r 1] φ Φ 4-1 ß ß MH rQ cd P

4-> ι + oil 13 a ß -rl φ Φ A: cd n H Φ φ CQ 4-> CQ ß -rl -rl 13 Di O cd -rl 13 ß ß CQ

CQ -H ß cd RSS 13 g r Q CQ Sä SH Di g 13 ΛJ -H ß ß SH Φ H ß φ Φ 4-> Φ •

N SH Φ Φ 0 Φ RSS ß ß cd cd -P Φ Φ 4-1 13 4-1 ß τ ι ~ ro Φ φ SH SH g: cd 4J 4-> ft Φ rH 4-1 x SH, SH υ ß Φ ß> Φ Φ ß ro T "l cd cd ß ISI N ro ro 4-1 cd Φ rj 4J rH

90 Φ cd a ß P Φ Φ cd 4J Φ SH RSS cd cd 4-1 rQ g φ 4> ΛJ Φ CQ ß ß ι + 4 rQ Φ Φ -H rA

1 ~ - N -H CQ Φ 13 CQ SH N ß RSS O cd g ΛJ CQ SH o O Sä ß -rl -H -H cd SH rH SH SH rQ ß ß φ -H 4-> SH Φ Φ O a g ß Φ φ ü CQ rQ 4-1 ß CQ Φ 4-> 4-> ß ß ß 4-1 φ 4> Φ Φ Φ SH 0 cd 4-1 4J

© Φ Φ X ß ß ß CG Φ H -H -rl oil X ß ß NX Φ <Φ Φ ß NXN RSS 4-1 N Φ CQ ri ß

SH Φ g Φ 13 -rl SH SH O Φ CQ g • ß φ a SH 4> φ cd ffl 4J MH Φ Φ Φ 4J above 4> + J ". rQ ß φ Φ

© Φ Φ J + 4-1 Φ Φ Φ SH RSS ß ß 4 13 CQ CQ -H ß ß: ß D) CQ ι + 4

O ß CQ 4-> ft Φ ι + 9 oil cd 1 + 4 4-> + Φ J ß 4-> 4 g «ß ß SH SH ß -rl 4J ß ü d φ g: cd SH ss ss ss SH g ß ß cd cd O -H φ -rl -rl ß cd 13 φ O φ H> 1 φ O φ φ 0 ß -rl cd φ φ 0 φ φ O SH O ß φ cd cn SH -rl

PS ΛJ Φ P cd g PO PS ^ Φ P 13> N -H ffl w 13 SS 13 cd a 3 = ffl W PQ> ffl X ß CM φ a

4J ß

SH

Φ

MH

4-1 ß

Φ

SH

Φ

13

Φ

-H

Sa rl rl

Φ ß cd g

Φ

-rl

CQ ro

SH

Φ

N

4-1 ß φ ffl

SH φ

13

CQ

-rl rQ

^ φ

Oil ß cd rH

O

CQ

+ J ^ CQ

4-1 X φ A + JO SH • cd r- CQ -rl Φ rH O ß ß X rH Φ ß 13

© φ: ß ß g 4-1 rH rH cd SH SH -rl Φ 13 Φ CQ MH φ

H g ß <Φ g ß φ CQ "| - 1 Φ RSS CQ 13 CQ CQ ß + J 13

© 13 rl Φ Φ o rH φ D) 13 A 13 Φ U ß cd cd cd ß ϊ 13 g ΛJ φ • Φ rH ß 4J O 13 Φ 13 Φ • -HO -rl -rl 13 cd

© 4-1 4-1 4-1 ß + J + J Φ -rl ß. MD 4-1 4-1 4-1 CQ Sä SS 13 13> CQ a ß rH Φ φ 4J CM X -rl 4-> A SH g φ

Q ß 4-1 a 4-1 Φ CQ -rl ^ ß

-rl ro Φ SS 13 1 + 4 + rH J ß RSS N -H CQ φ g ß ü -P Φ A Φ ß -rl r) rH ß φ

H gg cd cd ß Φ ΛJ: 0 Φ u r Q 4-> CQ g 4-1 ß Φ ffl o SH ß V Sä φ φ φ H -rl

U o o X SH X 4-> cd ΛJ 4-> m -H ΛJ CQ Φ φ Φ RSS ß ß ß RSS Φ -H + J rH SH SS 13

PH ß rH Φ CQ SH ß ß φ cd 4-> O + ß J Φ Φ Φ cd -H CQ O 4> A + J o

0 CQ N 4-> g φ ß 4-> 0 Φ g SH TD a CQ -rl w ß -rl -H SH> -H CQ φ SH SH + J + J H RSS g φ 4> CQ 4- > ß Di φ φ o X ß -rl rQ> 1 A 13 φ cd N -rl 13 SH CQ φ cd PH φ ü X

-H 4 13 ß -HN SH Φ 13 o 4> 4 0 CQ φ φ U> φ g + -> ft φ MH -rl 4-> cd φ SH ß 0 SH cd 4 a CQ Φ cd 4-1 ß rH Φ CQ rQ g X ß rQ -. SH SH H 4-1 g g ß

+ J ffl CQ Φ 4> A 13 m 1 + 4 g ß> 1 g Di -H Φ rH rH Φ cd -H cd cd 4-1 SH Φ 4-1 -H ß ß SH 13

CQ ß ffl 4-1 υ ß rH oo CQ -rl SH Φ Φ £ Φ A ß ^ rQ oil CQ CQ N MH oo

-H ß ß Φ G ro w cd ΛJ Dl φ O + J ü RSS ß: ß SH MH RSS 4> CQ Φ -HK MH 4-1

Φ MH SH ffl: ß ß N rH CQ CQ MH ß ü 4J φ Φ Φ CQ U ß: cd CQ l Di oil ß SH ro Φ 13 ß ß RSS Di φ -rl ß o Φ cd ΛJ 4-1 Φ ß A ß cd -H rH rH φ φ H φ ß

P ß φ Φ CD and cd 4-1 XH 's PS cd MH RH ß Φ cd cd SH SH -rl ß φ 4-1

CQ RSS H φ 4-1 SH SH -rl g u cd RH: 0 Dl 4-1 SH Φ 13 ß SH rH rH φ υ ß • 13 CQ CQ PH 4> g cd SH Φ CQ CQ φ ß RSS << ΛJ -rl ß X cd> MD Φ φ CQ -rl rH φ SH 4-1 ß RSS CQ -rl ΉH SH Φ Φ φ rH ß c SH Φ φ φ rH in rQ ß -H φ φ MH

N ß rH φ υ cd ß ß ß 4> EH 13 SH 13 SH 13 -RH φ • φ ß ß rQ 4-> rH ^ 0 rl ß rf φ

+ J 13 CQ r RSS: cd τ3 φ CQ -H Φ φ Φ rQ rH ^^ RSS -rl ß rH g + J P -rl 4-1 4-1 oil ß Φ Φ υ ß RSS Φ CQ SH + - > rH 13 O -H RSS t $ 13 SH φ 0 o φ φ φ ΛJ A-> CQ ΛJ ß 4-> 13 4-1 φ CM 4-> φ 13 rQ cd φ φ X ß g φ φ rH SH O rh ΛJ M 4-1 ß 4> Φ cd cd H • ^

Φ SH SH CQ CQ g rH H ß 13 • 13 Φ CQ cd rQ MH Φ> A CQ CQ -rl 1-1 g of oil. -. φ

3 m Φ CQ Φ a H -rl IS! ß ß Φ rH RSS CQ O CD Sä 13 SH RSS> 1 rQ SH Φ ß MD oil

-rl CQ CQ Dl Φ ß ß RSS φ ü -H Φ cd Sä φ H Φ φ Φ ß o υ o O CQ φ rH SH cd

CQ CQ Φ SH -P. o in rQ -rl Φ υ rH rQ ß Φ Φ 13 -H -H PH ß ß 4-1 13> CQ Di 4-1 4-1 13 MH

Φ HN cd ß ^ ~. 4-1 ß rH φ rH SH rQ -H SS ß ^ 13 Φ 13 ΛJ cd ß ß r X MH CD

13 rH φ rH O 13 4 m -rl ß Φ <Φ -rl ß 4-> MH Φ Φ 4-> RSS • a -rl Φ H φ SH H rQ o rH ß: ß RSS rH SH 13 + J ß Φ cd Φ 4-> RSS ß ^ T "l SH ü ^^ ΛJ 4> 4>: ß PH cd

O ro 4-1 CQ Φ CQ PQ ß ü ß RSS -rl 4-> N φ Φ A Φ CQ -rl Φ υ ß ß RSS MH ΛJ

X rH φ Φ CD: ß CQ 13 rH Φ φ ü -rl -rl 13 -H + J Φ ß O -H CQ SH + J cd o U o φ φ ß pϊ i SH 13 H ß S ß cd O rH o di SH SH φ φ φ CQ di -H 4-> CQ CQ φ SH -rl w φ A cd

4-1 CQ Φ CD PH Φ Φ Φ s> -H -H ß CQ ffl rH - A RSS X -H 4-> rH SH EH CQ -rl φ rQ ß - PH ß φ CQ φ sg -rl -rl 13 Sä Φ cd φ ü H SH A Φ Φ φ 13 -H ß o PH MH Φ Φ Φ 4-1 4-1 4-1 N ß ß • Dl 4-1 4-1 o rH CQ CQ Φ Φ rH ß - H CQ φ

ΛJ D) rH • RSS RSS CQ g of 4-> cd ß X CQ Di 13 SH SH CQ "= Φ cd # ß o 13 PH Φ Φ rH cd 13 g 4-1

CQ ß -> CQ -rl Φ Φ Φ φ cd PS Φ φ O CQ H SH Φ φ -rl CM -rl SO g ß ß -H 13 -rl φ cd oil ß ro -HX -rl CQ CQ -rl 4J 4-> 4 cd CM rH φ -rl 4-> 13 w κ * 1: <d CQ 13 .S RSS 4-1 r- P cd CQ CQ Φ rH r Q P Φ CG ß ß O 13 SH Sä A - H CQ and CQ Φ Φ ^ CQ CQ u H

SH CQ -P - - - Di -rl φ ao pq Φ Φ Φ X - CQ ß rH 13 ro 4-> cd ro> 1 SH

4-> Φ ß rH -rl SH • 13 • ß w H .. ß ß PH Sä X φ φ ^ μ RH SH 13 ß ß CQ φ H g Φ H g 4-1 o * - ~. 4-1 • rl CQ CQ PH rH φ ^ Φ H SH SH RH cd Φ SH P CQ φ ß CQ RSS X> CM ß X φ rH rH ß Φ MH SH ro 4-> Di ß 13 cd PH CQ Φ A Φ Φ ß -rl

D) 4- ü CD> rH Φ Φ -rl d φ Q cd ß ß Φ rH O rQ Φ Φ N: cd CQ N. o 0 φ

90 ß -rl H SH 4> SH 4J A SH SH SH -rl PH P Φ CQ -rl ß MH rH 4-> g CQ 4-> ß -rl -rl -rl ß 4-1

Φ φ PH ß ß Φ: ß ß ü CD φ Φ Φ Φ cd A SH CQ ß 4-> ß A ß CQ CQ φ φ P φ CQ 4J 4-1 rH Di ​​N H o H MH Di O ß A ß 4-1 Di • Φ friend RSS RSS d cd cd -H CQ -rl ß ß S ß cd cd-H!

IΛ rH ß ß CQ 4-1 ΛJ cd PH: cd cd ΛJ H CQ ^ μ Φ X SH SH N

© υ u g Sä Φ Φ Φ φ φ ß ß cd gg

Φ Di -H -H ΛJ + J 13 - 4- SH> RSS CQ Φ rH o Φ 13 4-> φ SH -H 4-1 -H ß rH Φ SH Dl ffl ffl RSS SH rQ ß ß Sä a Φ 4-> a RSS ü cd> rH ß Sä φ ON cd X 13 -H CQ φ φ ü oo o + J N RSS 4-1 rH P g MH ß υ CQ CD MH SH SH ß A ß IM MH 4- > CQ φ SH 13 φ SH CQ MH MH Di

Λ! υ Φ φ CQ Φ cd ß -H -H cd cd SH H = ß -rl Φ Φ φ Φ MD ß Φ ro cd ß ß SH Φ H Φ ss ss ss SH cd G ffl -HX 13 cd pq X CQ £ Φ Φ MH PH PH RSS ffl ffl rH rH H n H EH pq 13 cd 13 cd P HH pq

Context query to match the main context object. In the next step the user wants to order 3 Replacement parts for the broken machine. He activates the Kontextob ect 16 "machine" (see FIG 17) and invokes the main menu with the appropriate button 19 (see FIG 18). The context-specific menu 20 (see FIG 19) now refers to the context object 16 of the machine XHC241 as new main context. In FIG 20, the displayed list 18 of the spare parts is shown. The user 3 can thus manage a lot of information without having to search long and cluttered its user interface to have. For this he uses the described dynamic and context-sensitive display surface 1 and information systems for mobile computing as the context Navigator 30th

A variety of technologies and information are available today to assist users in three tasks in maintenance, service and production. The decisive step by the context navigator 30 is the integration of different technologies and the standardization of

Information access in a user 3 active supportive way. Technologies such as AR tracking and workflow management systems offer great potential to shape demand and user friendly to the highest degree by the context collection access to information 8 and functions. 9 The context Navigator 30 ensured by the design and structuring of the user interface intuitive, fast and user-friendly navigation and orientation in information and actual rooms.

In summary, the invention thus relates to a system and method for displaying information, and a computer program product for performing the method, which improve the provision of information 8 and 9 functions in a database 7 in terms of user-friendliness. The system for displaying information includes a display device 1 for displaying in response to a context of a user wanted information 3 8 and functions. 9

Claims

claims
1. System for providing information (8) and functions (9) from a database (7), - with at least one context object (6) having a
contains record information (8) and functions (9) from the database (7) and a kontextspezi Steam menu (20) with second control means for access of a user (3) on the context object (6), - a context manager (23) to manage the
Context objects (6) and for the dynamic selection of the context objects (6) in dependence on a current user (3) context, said context manager (23) providing the user (3) the selected context objects (6) and
- having a display device (1) for displaying a
Context indicator (29) wherein the context of the user (3) by a spatial position of a work object and a task of the user (3) is intended for visualization of the context objects (6).
2. System according to claim 1, characterized in that the context objects (6) of granularity are assigned and that the context manager (23) using a Granularitätsregler (24) for selecting the context objects (6) from a selection range (43) in response to a selected level of granularity is provided, wherein the size of the selection area (43) of the selected level of granularity is dependent.
3. System according to claim 2, characterized in that an automatic or user-controlled selection of granularity is provided.
4. System according to any one of the preceding claims, characterized in that the second control means of the context-specific menu (20) for access of the user (3) to the information (8) and the functions (9) and to the user through the removal (35) of the context object ( 6) are provided in the context of display (29).
5. System according to any one of the preceding claims, characterized in that an automatic and / or manual registration context (21, 22) for the automatic or user-prompted generation of the context objects (6) is provided in the context of the user (3).
6. System according to any one of the preceding claims, characterized in that a Trackingsyste (5) for detecting and recognizing objects in space is provided, wherein the tracking system (5) at least one image acquisition unit for detecting the
contains items and a computer unit for evaluating supplied by the image capturing unit, and wherein information provided by the tracking system (5) information for automatic determination of the user (3) of the context provided.
7. System according to any one of the preceding claims, characterized in that a workflow engine (27) for monitoring and controlling the operation object of the user (3) is provided, by the workflow engine delivered (27) information for automatic determination of the context of the user (3) are provided.
8. System according to any one of the preceding claims, characterized in that a determination of the context of the user (3) in dependence of communication partners of the user (3) is provided.
9. System according to any one of the preceding claims, characterized in that the references in the form of entries in the context-specific menu (20) or in the form of markings on objects are provided in the space, the references for the generation of the context objects (6) from the context user (3) by the manual context register (22) are provided.
10. System according to any one of the preceding claims, characterized in that the display device (1) is designed as a mobile display.
11. System according to any one of the preceding claims, characterized in that the second control means for selecting on the display device (1) are provided to be visualized context objects (6) by the user (3).
12. System according to any one of the preceding claims, characterized in that first control means for generating messages are provided on external information, and that a determination of the user (3) of the context is provided in response to the messages.
13. System according to any one of the preceding claims, du rchgekennzeichnet that the database (7) for receiving the context of the user (3) linked notes (46) of the user (3) is provided, and (that a marking of the notes 46 ) is provided as private, public or data maintenance related notes.
14. A method for providing information (8) and functions (9) from a database (7), in which method
- at least one context object (6) contains a record of information (8) and functions (9) from the database (7) and a context-specific menu (20) with second control means for access of a user (3) on the context object (6),
- a context manager (23) manages the context objects (6) and the context objects (6) in dependence on a current
dynamically selects context of the user (3), said context manager (23) providing the user (3) the selected context objects (6) and
- a display device (1) indicates a context indicator (29) that visualizes the context objects (6), wherein the context of the user (3) by a spatial position of a work object and a Arbeitsaufgäbe of the user (3) is determined.
15. The method according to claim 14, characterized in that the context objects (6) of granularity are assigned and that the context manager (23) using a Granularitätsregler (24), the context objects (6) from a selection range (43) selects in response to a selected level of granularity, wherein the size of the selection area (43) of the selected level of granularity is dependent.
16. The method according to claim 15, characterized in that the granularity is automatically selected or user-prompted.
17. The method according to any one of claims 14 to 16, characterized in that the user can (3) with the second control means of the context-specific menu (20) on the information (8) and the functions (9) access and the context object (6)
can remove user out of the context indicator (29) I.
18. The method according to any one of claims 14 to 17, characterized in that with an automatic and / or manual context register (21, 22) automatically, the context objects (6) or user-performed are generated from the context of the user (3).
19. A method according to any one of claims 14 to 18, characterized in that a tracking system is detected (5) objects in the room and detects at least one imaging unit of the tracking system (5) records the objects and a computer unit provided by the image detection unit evaluates information and wherein by the tracking system (5) information supplied automatically determine the context of the user (3).
20. The method according to any one of claims 14 to 19, characterized in that a workflow engine (27) monitors the task of the user (3) and controls, wherein by the
Workflow engine (27) Information supplied automatically determine the context of the user (3).
21. The method according to any one of claims 14 to 20, characterized in that the context of the user (3) in dependence of communication partners of the user (3) is determined.
22. The method according to any one of claims 14 to 21, characterized in that there are references in the form of entries in the context-specific menu (20) or in the form of markings on objects in the space provided, with the references context objects (6) from the context of the user (3) produced by the manual context register (22).
23. The method according to any one of claims 14 to 22, as you rchgekennzeichnet that the display device (1) is designed as a mobile display.
24. The method according to any one of claims 14 to 23, characterized in that the user (3) with the second control means on the display device (1) to be visualized context objects (6) selects.
25. The method according to any one of claims 14 to 24, characterized in that messages via external information is generated with first control means, and that the context of the user (3) is determined as a function of the messages.
26. The method according to any one of claims 14 to 25, characterized in that the database (7) with the context of the user (3) linked notes (46) of the user (3) receives and that the notes (46) as a private, public or are in data maintenance relevant notes.
EP20020704586 2001-01-25 2002-01-16 System and method for representing information Ceased EP1370981A2 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
DE10103462 2001-01-25
DE10103462 2001-01-25
DE10120574 2001-04-26
DE2001120574 DE10120574A1 (en) 2001-01-25 2001-04-26 System and method for information display
PCT/DE2002/000107 WO2002059778A3 (en) 2001-01-25 2002-01-16 System and method for representing information

Publications (1)

Publication Number Publication Date
EP1370981A2 true true EP1370981A2 (en) 2003-12-17

Family

ID=26008334

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20020704586 Ceased EP1370981A2 (en) 2001-01-25 2002-01-16 System and method for representing information

Country Status (3)

Country Link
US (1) US20040209230A1 (en)
EP (1) EP1370981A2 (en)
WO (1) WO2002059778A3 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2879064B1 (en) * 2004-12-03 2007-06-01 Eastman Kodak Co data scattering method to a multimedia equipment provided with an image sensor
US7434226B2 (en) * 2004-12-14 2008-10-07 Scenera Technologies, Llc Method and system for monitoring a workflow for an object
CA2500573A1 (en) * 2005-03-14 2006-09-14 Oculus Info Inc. Advances in nspace - system and method for information analysis
US7483882B1 (en) * 2005-04-11 2009-01-27 Apple Inc. Dynamic management of multiple persistent data stores
US7376658B1 (en) 2005-04-11 2008-05-20 Apple Inc. Managing cross-store relationships to data objects
KR100792293B1 (en) * 2006-01-16 2008-01-07 삼성전자주식회사 Method for providing service considering user's context and the service providing apparatus thereof
US8631351B2 (en) * 2008-06-29 2014-01-14 Microsoft Corporation Providing multiple degrees of context for content consumed on computers and media players

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2691813B1 (en) * 1992-05-26 1997-12-19 Thomson Csf System for the identification and automatic detection of vehicles or objects.
US6437758B1 (en) * 1996-06-25 2002-08-20 Sun Microsystems, Inc. Method and apparatus for eyetrack—mediated downloading
US6075895A (en) * 1997-06-20 2000-06-13 Holoplex Methods and apparatus for gesture recognition based on templates
US6625299B1 (en) * 1998-04-08 2003-09-23 Jeffrey Meisner Augmented reality technology
US7000187B2 (en) * 1999-07-01 2006-02-14 Cisco Technology, Inc. Method and apparatus for software technical support and training
US7624356B1 (en) * 2000-06-21 2009-11-24 Microsoft Corporation Task-sensitive methods and systems for displaying command sets

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO02059778A2 *

Also Published As

Publication number Publication date Type
US20040209230A1 (en) 2004-10-21 application
WO2002059778A3 (en) 2003-10-16 application
WO2002059778A2 (en) 2002-08-01 application

Similar Documents

Publication Publication Date Title
US5909217A (en) Large scale system status map
US5838300A (en) Window sharing system
US5874958A (en) Method and apparatus for accessing information and items across workspaces
US20070143704A1 (en) Integrating user interfaces from one application into another
US20010035885A1 (en) Method of graphically presenting network information
Heer et al. Creation and collaboration: Engaging new audiences for information visualization
US20030007006A1 (en) Graphical user interface with zoom for detail-in-context presentations
US20090019397A1 (en) Widget of Graphical User Interface and Method for Navigating Amongst Related Objects
US8099395B2 (en) System level identity object
US20100138767A1 (en) Multi-Panel User Interface
US20030142139A1 (en) Automatic window representation adjustment
US20080294974A1 (en) Webpage history view
US20060010395A1 (en) Cute user interface
US7752565B2 (en) Graphical user interface for displaying objects
US6738040B2 (en) Different display types in a system-controlled, context-dependent information display
US20140028682A1 (en) Display Controller, Display Control Method And Computer-Readable Medium
US20110078625A1 (en) Graphical user interface window attachment
US5960173A (en) System and method enabling awareness of others working on similar tasks in a computer work environment
US20060080342A1 (en) Contents management system, contents management method, and computer program
US20100005421A1 (en) Terminal Device and Program
Sellen et al. The whereabouts clock: early testing of a situated awareness device
US6034684A (en) Identification of data items on a screen display using landmark and grid line graphical objects
US20010028365A1 (en) Method and apparatus for configuring sliding panels
Bauer et al. A collaborative wearable system with remote sensing
US20130288719A1 (en) Augmented reality for maintenance management, asset management, or real estate management

Legal Events

Date Code Title Description
17P Request for examination filed

Effective date: 20030602

AK Designated contracting states:

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

18R Refused

Effective date: 20080617