WO1998015964A1 - Method and device for operating at least one device - Google Patents

Method and device for operating at least one device Download PDF

Info

Publication number
WO1998015964A1
WO1998015964A1 PCT/DE1997/002304 DE9702304W WO9815964A1 WO 1998015964 A1 WO1998015964 A1 WO 1998015964A1 DE 9702304 W DE9702304 W DE 9702304W WO 9815964 A1 WO9815964 A1 WO 9815964A1
Authority
WO
WIPO (PCT)
Prior art keywords
device
output unit
input
operating
unit
Prior art date
Application number
PCT/DE1997/002304
Other languages
German (de)
French (fr)
Inventor
Peter Kleinschmidt
Luc De Vos
Original Assignee
Siemens Aktiengesellschaft
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to DE19641884 priority Critical
Priority to DE19641884.4 priority
Priority to DE19641883 priority
Priority to DE19641883.6 priority
Application filed by Siemens Aktiengesellschaft filed Critical Siemens Aktiengesellschaft
Publication of WO1998015964A1 publication Critical patent/WO1998015964A1/en

Links

Classifications

    • HELECTRICITY
    • H01BASIC ELECTRIC ELEMENTS
    • H01HELECTRIC SWITCHES; RELAYS; SELECTORS; EMERGENCY PROTECTIVE DEVICES
    • H01H9/00Details of switching devices, not covered by groups H01H1/00 - H01H7/00
    • H01H9/02Bases, casings, or covers
    • H01H9/0214Hand-held casings
    • H01H9/0235Hand-held casings specially adapted for remote control, e.g. of audio or video apparatus
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • HELECTRICITY
    • H01BASIC ELECTRIC ELEMENTS
    • H01HELECTRIC SWITCHES; RELAYS; SELECTORS; EMERGENCY PROTECTIVE DEVICES
    • H01H13/00Switches having rectilinearly-movable operating part or parts adapted for pushing or pulling in one direction only, e.g. push-button switch
    • H01H13/70Switches having rectilinearly-movable operating part or parts adapted for pushing or pulling in one direction only, e.g. push-button switch having a plurality of operating members associated with different sets of contacts, e.g. keyboard
    • H01H13/84Switches having rectilinearly-movable operating part or parts adapted for pushing or pulling in one direction only, e.g. push-button switch having a plurality of operating members associated with different sets of contacts, e.g. keyboard characterised by ergonomic functions, e.g. for miniature keyboards; characterised by operational sensory functions, e.g. sound feedback
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0138Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/014Head-up displays characterised by optical features comprising information/image processing systems
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/0179Display position adjusting means not related to the information to be displayed
    • G02B2027/0187Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye

Abstract

The invention relates to a control unit, consisting of input fields having cognitive features, by means of which it is possible to operate several devices without having to look at the control unit. An output unit displays the functional settings of the control unit visually and/or auditively through adequate optical means. This enables the control unit to operate as many devices and functions as desired. A voice recognition means that works together with the control unit makes it possible to select directly any given device and if necessary one of its functions through a voice input. The control unit is also suited for broader inputs.

Description

description

Method and arrangement for operating at least one device

The invention relates to a method and an arrangement for operating at least one device by a computer based on an operating unit which comprises a plurality of input fields, each having a cognitive character '.

Information display systems for persons or users can be widely used. An example is the provision of information for the driver of a vehicle such as a car. To inform the driver with information such as the traffic situation ^, electronic control and information systems can be mounted on the dashboard of a car, with installation positions are preferred, which are as high as possible, ie close to the windshield. Other devices for displaying information can be attached to a holder or pivot arm of the steering wheel to the right in left-hand drive as high as possible on the dashboard. All these installation measures require that the driver steers his eyes off the road to the information display system. He also has to change the focus of his eye from infinity to the short distance to the display system. Presbyopic may need for a different pair of glasses. Moreover, the displays are usually small for the display. sstudien future and show a large display that is mounted near the windshield on the dashboard console. The problem of different viewing distance is then indeed reduced but not completely eliminated. In addition, large displays are expensive.

The underlying problem is the invention to provide an information display system that can be placed so that the attention of the operator, is not unnecessarily distracted, and the operation is very simple. Another object of the invention is to provide a method and an arrangement that an operator at least one device allows by means of a control unit and / or based on voice input.

These objects are achieved by the features of independent claims 1 and 7. FIG.

Further developments of the invention arise from the dependent claims.

A method for operating at least one device specified by a computer, for which purpose an operating unit comprising a plurality of input fields, is used. The entry fields each have a cognitive nature, so that it can be detected by sensing the input field to which the box is. In this case, can form the single input field or at least one tactile marking such as at typewriter keyboards, are used to ensure the cognitive character. Functional assignments corresponding key labels in conventional entry fields are displayed on an output unit. This ensures a high flexibility of the individual fields is assured because each box can take many functional assignments unlimited and continues this versatility can be perceived economically by reprogramming the presentation on the output unit easy. The control unit thus provides a flexible for different applications (device) is usable input tool. Also, adjustment of the to-use each device are displayed on the output unit. The operation of the device is done by operating the input unit corresponding to the desired predetermined functional assignment for this device in a current menu display. A development of the invention is more D evices with the operating unit to operate, which is also selected between the devices by means of the operating unit.

An other further development is to give a visual and / or auditory information by means of the output unit.

In the context of an additional development, the operation can be performed using the voice command. These options for the implementation of voice input are displayed on the output unit. Also setting the device are displayed on the output unit. It is operated by voice input the appropriate option or adjustment.

it is also a development of the invention to design the output unit as a display or a head-up display.

It is an advantage of the invention that just the combination of actuation of the operating unit, and speech input can be a simple and economical addressing complex operating levels. So the user can use simple, direct voice commands to call a device and even a functionality of the device, eg "Müller call". It automatically selects the phone as a device, the function of this unit is "called", the number to dial is the addressee of the "Miller", which is preferably stored. In addition, if several addressees "Müller" stored in the address book, by means of the input unit a selection of the 'right' addressee. It must not be used the voice input if a more extensive selection includes using the control panel benefits in the nature of the operation. Here, the fact is used that voice input can be done easily and intuitively, but active knowledge of the type of input and the desired service requires. The operating unit, however, allows easy selection under terms and / or services that do not need to be active known but are propagated by the display unit.

Services in this case denote the perceived via the control unit functions (devices). An example of a service is "set up phone connection."

In the information display system which must be notified to the person information on an output display at a location is generated, which is uncritical for the use. With the aid of first and second optical means, the representation generated by the output display of the information in the viewing direction of the user can then be reflected, while a virtual image of the representation generated in proximity to the user. Finally, a control arrangement is conveniently provided through which the information to be displayed is simply available.

It is desired that the second optical means is a arranged in viewing direction of the user's disk, for example, is present anyway, as is the case with a windshield in a motor vehicle is.

To disturb the user's or operator's view as little as possible, it is expedient einzuspiegeln the representations of the information near the lower edge or the upper edge or vertically aligned to the right or left edge of the disk.

In order to make the location of the input reflection of the information in the disk and thus the location of the virtual image adjustable, it is expedient to arrange the output display also adjustable, and to realize the first optical means so that they are pivotable. First optical means while a concave mirror can be used, for example, which is arranged in the viewing direction of the user and reflects the appearance in the viewing direction of the user's back and also can be designed pivotable in order to make the point of origin of the virtual image adjustable. The concave mirror can then be arranged so that the output display can be closed by it.

The output display may be operated in such a way that it generates a set of at least two partial areas representation of the information, of which the one partial area not

indicates possibility of interaction with the user, the other portion with the operating arrangement addressable units or devices showing.

Then, the output display can be controlled via the control arrangement of the user and the information displayed there can be selected. The subregions may represent maps, excerpts from maps or possible settings of the operating arrangements. It can represent a selectable enlarged detail of the map and the map a portion of a map and the virtual image.

It may be expedient to carry out the second optical means such that the virtual images are recognizable for more than one person, the person can obtain the information to be displayed with the operating arrangement independently. However, it is also possible that only one person can retrieve the information to be displayed with the operating arrangement and thus, for example, can play the driver of a motor vehicle, the information he just needed without the driver having to press the operating arrangement.

To always allow the output from the output display screens fall into the consumer's eye, it is expedient to provide a focused on the person video camera that detects the location of the eyes of the person or user and tracks and the first optical means, for example, the concave mirror controls accordingly.

For the realization of the operating arrangement, there are different solutions. When operating arrangement an operating device can be provided, for example with control and / or voice input means with a blind-use Navigator, and a feedback arrangement that acknowledges the operations and provides information for other executable operating steps.

It might be appropriate to carry out the voice input means as a directional microphone. Then it is appropriate to make the directional lobe for entering commands swiveled and always align with the user's mouth, including the driver. Such a control device may further be designed such that a directed at the person video camera and image recognition software is provided by which the position of the user's mouth is determined, and accordingly, the microphone is controlled so that it is always oriented towards the user's mouth , If the operating arrangement is provided in a motor vehicle, it is expedient to arrange the video camera in the region of the windscreen and to focus on the mouth of the driver to adjust accordingly toward the maximum sensitivity of the directional characteristic of the microphone to the mouth.

To carry out the blind operating concept effectively, a feedback arrangement is provided which comprises advantageously a voice output device. Furthermore, it is advantageous that it is provided with a plurality of operable devices, for example a car and a telephone, a virtual image of the given device on a display.T he feedback arrangement may also include a visual display device in addition to the speech output, wherein the visual device can be arranged in the operating device, but also in the operated device. So with the visual display device operator controlled devices can be shown but also by the navigator operated symbolized operating elements of the operating device.

It is furthermore advantageous if the visual display device by representing the operations of the devices that the symbolized controls can change dynamically by the operator. The operating device having the Navigator may be a durable in the manual control device, such as a handset for remote control, which may additionally comprise a chip card for legitimacy functions or similar functions.

Specially trained appropriately, such a usable for remote control of the controllable device handset when required to operate the software, which is usually included in the accessible device is automatically loaded into the handset when it is first used to control the device.

But the navigator of the operating device can also act as

which is disposed in the vicinity of the hand position of the user control panel conveniently be performed. This solution is particularly useful for use in a vehicle, since the control panel, for example, can be integrated into the steering wheel here.

Furthermore, the control means may comprise a microphone with speech, and thus permit the operator by means of speech. It is expedient if the speech different, having on the device to be operated adapted speech models. The controls contained in the Navigator advantageously allow a movement in three dimensions, which are blind distinguishable by the operator. As control buttons, rollers, wheels or knobs can be used. Particularly advantageously, such a control device with Navigator, if it uses buttons as operating elements, namely, a key for voice and five binary working keys, of which four keys form two mutually orthogonal directional key pairs and the further key for confirming a selection is usable.

To run with the few controls a plurality of functions, it is advantageous to at least partially attributable controls multiple functions. The selection of the functions may then, for example be achieved in that a key is pressed different lengths. Then, an allocation of the operating elements to the devices can be realized so, that is, starting from a controlled device, depending on the requirements in any deeper levels be branched, wherein at the top level, a list of available devices in the lower levels of functions and features of these devices can be addressed.

Particular advantages of the operating arrangement are that the operations have a simple logic that are comprehensible reduced to operate with few controls or can be mapped. The operation of such a general command structure can be made blind after a short learning phase, eg if keys are used and these distinctive, tactile shapes or slightly

own head to Keep arrangement and applicable in many different situations, yet show similar or analogous action. The required assessment is achieved through the display, which is a speech in the first place, but can be supported by a visual display device. The operating concept thus combines an intuitive and operable blind Navigator to manipulate functions of the devices consisting, for example from a minimal keyboard or a voice input and the feedback arrangement realized as a voice output device or additionally as a visual display device. In this case, operation or use of populations of one or more devices are combined as virtual devices and shown symbolically on a display or textual. Due to this division in a plurality of virtual devices physically separate devices can be operated sequentially with a control unit.

By means of embodiments, which are illustrated in the figures, the invention will be further explained.

Show it

Fig.l shows an embodiment of the information display system for use in a motor vehicle as an example, where Fig. La lb the closed information display system, and FIG., The information display system in

Operating position represents 2 shows a basic representation of the

Information display system considered when used in a motor vehicle from above, Figure 3 shows a schematic representation of a

Information display system output display, the first optical means and second optical means, in which is displayed as the display is reflected in the viewing direction of the user, Figure 4 is a side view of the information display system for generating virtual images of images at different points of the windscreen in a motor vehicle, Figures 5 and

6 shows other places where virtual images can be generated 7 shows an example of the case where several people can observe the virtual images at a time, for example when used in a motor vehicle, Figure 8, an embodiment of the information display system in which the

is arranged output display steerable 9 shows a possible display on the output display and the virtual image of a plurality of

Areas are contained, 10 is a possible representation of a map as a virtual image 11 shows a basic representation of the operating arrangement, Figure 12 an embodiment of the operating device as a handheld device, 13 is a second embodiment of the operating device as a handheld device,

14 shows an image that shows how the various

Settings can be made in lower levels, starting from an upper layer, 15 is a second view of the multi-level concept, Figure 16 shows a first embodiment of the navigator, Figure 17, and

18 shows further embodiments of the navigator, Figure 19 is a block diagram showing a control concept for at least one device

20 shows an image that is a an operating concept for a minimum

Device displays.

The information display system according to Fig.la, lb, which shows as an example the application in a motor vehicle, has an output display A-DIS, on which a representation of the information to be displayed is generated, a first optical means OPL, for example a concave mirror with which the output display a-DIS emitted light beams are reflected into the viewing direction of the driver, a second optical means 0P2, realized for example as a disc WS, in which the virtual image of the display is generated and control arrangements in the steering wheel LR, executed for example as Zappkreuz ZA or as a handheld device HG , Further, a video camera CA is arranged next to the rear view mirror RS and a microphone MIC. Using the video camera CA can determine the location of the driver or the driver's eyes mouth eg, for example, to control the input reflection of the representations in the sight of the driver or the microphone MIK align more directly on the mouth of the driver.

The information display system is more fully shown in Figures 2 and 3 shows. After 2 is the output display A-DIS front of the person PE, to the driver, arranged and produces representations of the information to be displayed. These representations are from the first optical means OPL, for example, a concave mirror, projected in the viewing direction of the driver and displayed on the second optical means OP2 as a virtual image of the representation. The second optical means is realizable in the embodiment as a windscreen WS.

3 shows more clearly as can be realized, for example, the output display. This may consist of a display DP, for example, a multi-mirror chip, which is illuminated by light coming from a lamp LA and is directed by a condenser KO on the display DP. The position of the lamp LA can be changed with the help of actuators MO. The light emanating from the display DP light is focused by a lens OB, passes through an illumination lens LI, further characterized by a focusing screen MA to the first optical means OPL, for example a Spiegelokuiar, and from there in the direction of view of the person PE, as the representation virtual image VIR seen for example in the windshield.

The place where the virtual images VIR be generated by means of the second optical means, can according to Figure 4 and Figure 5 at the top or at the bottom of the windshield WS be, wherein the different location of the virtual images by a different position the first optical means OPL, for example, the concave mirror is set. It is also possible to Fig.6, to produce the virtual image at the lateral edge of the windshield, in turn caused by the location and arrangement of the first optical means OPL.

It may be appropriate that not only one person can view the virtual image, but several people. An example is shown Figure 7, can be observed in the two virtual images that are being generated in the windshield of a car. It is possible for any person to create or controlled by a person, a virtual image for both people own virtual image of a depiction of information. Thus, it is possible that, for example, the passenger retrieves the information for the driver with a control arrangement so that the driver is not charged with the operation of the information display system.

A further embodiment, be produced with the different locations of the virtual image, displays Fig.8. Here, the output display DIS is pivotally mounted, with the result that may arise at different points, for example, the windshield WS virtual images.

The first optical means may for example be a mirror, a concave mirror, but it can also be part of the windshield WS, which must then be mirrored accordingly. The first optical medium must be a medium in any case, through which the outgoing from the output display light beam is reflected into the viewing direction of the person and also be designed partly transparent, so that a virtual image for the person can be generated.

Fig. Shows may look like generated by the output display representations. Such a representation of information can consist of various components of TB. A first portion TBL may represent a portion of a map, a second portion TB2 show several controllable devices, and TB3 representing a third partial area a section of a road with directional indicators and signs. The map can be so produced as a virtual image, for example, as shown in Fig.10. There, the map a key area of ​​this map is first shown as a sphere map and using a magnifying glass LP shown enlarged.

11 shows generally an arrangement for operation of multiple devices G (I) to G (n), for example a motor vehicle and a telephone or other equipment or aggregates of devices or their functions. The operating arrangement for these devices G is denoted by BEA. The arrangement enables virtual BEA

Illustration of a straight driven device in a display DIS, and has a feedback arrangement RE on, in addition, the operating device BD, the a navigator (not shown). One of the devices G (I) to G (n) can be selected in that the operating device BD is operated accordingly. If a device has been actuated, for example, the device G (I), it is displayed on the display DIS and the selection of the device is communicated via the feedback device RE to the user.

One possible embodiment of the operating device BEA of Figure 12 can be removed. There, the operating device is implemented as a handheld device HG. It can be seen that the display DIS allows as an example the selection of different TV channels that are virtually displayed there as text.

Furthermore, an operating device BD is provided which consists of buttons and a so-called TA. Zappkreuz ZA. The TA buttons, but especially the Zappkreuz ZA, then the Navigator NV, can be selected with the among the devices. The connection with the devices can be made using infrared rays or other remote methods. In Figure 12 is an example on GSM / DECT method pointed out. The handset of Figure 12 also allows input using a speaker-microphone MI, so that even without keys, an operator of the equipment is possible. The feedback arrangement, a listener is designated H_RE. If the external device has been activated, it can be shown on the display DIS and additionally the controlled device are reported acoustically with the aid of the feedback arrangement RE.

A further embodiment of a handset HG shows Figure 13. Here, a display DIS is also provided as a navigator of the operating device a Zappkreuz ZA and feedback arrangements RE, which may include a visual display device V_RE in addition to a listener H_RE. For entering the operations a microphone MI can also be used, so that could also be dispensed with the Zappkreuz.

A structure of a Zappkreuzes ZA shows Figure 16. Here it can be seen that the operation of the devices can be made with five keys, said two keys pairs TA_R, TA_L or TA_0, TA_U perpendicular to each other and a TA_Z key is centrally located within the two pairs of keys. With the button pair TA_0, TA_U example, one of the devices can be selected which are shown on the display DIS in Figure 13. With the help of the button pair TA_R, TA_L example, functions can be selected. The confirmation of the entry is made with the central button TA_Z.

The Figure 16 shows that another key may be provided adjacent the TA_M Zappkreuz additionally, speech input can be switched on via the microphone MI with the example. The other key TA_M may also be placed elsewhere, s. Figure 13. 14 shows that various settings are possible with the apparatus, wherein, can be passed into lower levels of functions and sub-functions of a selected device from an upper layer that is assigned in Figure 13 the individual devices. The example of Figure 14 is, for example, assume that a photographic device is operated with the operating arrangement. In this case can be viewed using the handset in the display DIS, what should be done with the photographic device, such as a photograph is to be played. The setting of the handset is done with the Zappkreuz ZA namely eg with key TA_U. The photo will be displayed displayed on the display DIS. With the Zappkreuz other settings can now be triggered. For example, can be set via the button TA_R of Zappkreuzes the brightness, which is then displayed on the display V_RE. Or it can be set a special function, namely the dubbing of a photo by another button on the Zappkreuzes. In Figure 14 between three settings I to III are shown and shown how this can be achieved. The selection of the individual functions can of course also by voice via the microphone MI.

Another example of the multi-level concept can be seen from Figure 15. Here the operating arrangement shown in four different settings. In the first setting I is displayed on the display DIS which devices are selectable. With the help of Zappkreuzes, such as the TA_U button, the device can be selected "television" and that by pressing the central button TA_Z. If the device has been selected "television", then a list of addressed transmitter and the selected device on the display V_RE appears on the display DIS. For example, with the aid of TA_R keys can TA_L one of the transmitters, for example ZDF, are selected for confirmation by the central button TA_Z. This setting indicates II. Finally, a special function can be selected by operating the Zappkreuzes or an additional key. Such special functions are shown in the attitude III. For the reasons indicated in the display DIS functions, a function can be selected via the Zappkreuz, resulting from setting IV.

The multi-level concept according to Figure 15 therefore shows the way of selecting a device for selecting a special function to be performed on the selected device. The

Selection is made via the Zappkreuz ZA namely with the keys pairs and confirmation by the central button TA_Z. All selections can of course also with the help of a voice input via the microphone MI.

As the figures show, an acoustic Learning Control H_RE is used which can be supplemented by visual inspection V_RE success. Furthermore, is possible via the microphone MI to realize a control input with speech. The Navigator comes out with a minimal concept of easy to remember haptic input elements, namely keys. It is sufficient to use six easy to learn and distinguishable by touch controls.

Furthermore, the figures show that all of the devices with their functions can thereby be easier to use, that the operating input is broken down into sub-tasks. For the subtasks vivid visual operating scenes are shown on the display DIS and continue only shown what is required at the time of operation.

As Figure 16 shows, the navigator NA comes from three cognitive dimensions that are with the controls, the buttons can be selected. In this case, can be distinguished a xy plane of the display of virtual devices and the tabular representation of parameters, the depth structure or details according to the hierarchical principle, and the memory of the processed result of the temporal sequence to be processed and processes. For example, the visual dimension, the xy plane, the button pairs TA_R, TA_L or TA_O, TA_U can be assigned to the advance in the Detailierungstiefe can be achieved with the central button TA_Z, the path back through a correspondingly long pressing this key button TA_Z can be achieved. The depth extraction or detailing, takes place after the multi-level concept, which is shown in Fig.15. Finally, the temporal sequence or use of memory sequence can also be achieved through the horizontal pair of keys TA_L, TA_R example. Through language, it is solely or additionally possible to go through a chain of keywords or even a single word custom special direct more of these levels and to reach the goal without manual navigation.

The operation without visual contact is made possible by the linguistic feedback. As a navigator, it is expedient according to the Zappkreuz. use Figure 16, since one gets along here with the minimum required six tools or keys. Although this small number of control elements to be too low is displayed for the plurality of control tasks, it is sufficient for the inventive operating concept. According to the invention these six basic controls multiple functions can be assigned Namely, as shown in the figures. The multiple functions can be chosen so that the haptic control elements is assigned in different operating situations, a recurring significance.

As shown in the Figure 12 to 15, the top level or primary plane can be listed a number of different real or virtual devices on the display DIS, for example, scroll 'through by text or symbolically represented by an icon, and for example by means of a vertical pair of buttons TA_0, TA_U and by means of central button TA_Z be triggered. With the central button so a new operating level, the device level reached.

The display DIS at the device level and the respective device can be illustrated by its operating bodies, the horizontal pair of buttons for manipulating a key specific function, such as volume, can be used and the vertical pair of keys primarily for switching through text fields such as TV channels, telephone subscriber, and with the central key TA_Z the selection of the corresponding function is performed. Less frequently used special functions eg accessed via a single operating step double, as is shown the example in Figure 12, left column SPI. With the central button TA_Z leads example in each case in a new device level, wherein the return is made, for example, with a long press of the key button TA_Z, s. Column SPI. For example, perform a double click on the central button TA_Z directly to the primary selection level, s. Column SPI.

Thus, it is possible, as Figure 12, column SPI shows reach and with a different duration of the operation, such as a button or with multiple operating a button from one level to another return, or to address different functions within a plane , Each addressed plane, where each referenced function can be shown on the display DIS, whereby an additional display V_RE can be used for the feedback.

Besides the realization of the Navigator through the Zappkreuz it can, of course, other implementations, as shown in Figure 17 and Figure 18 as the. For example, knobs, wheels, rollers, joystick or similar control elements can be used. Even with these realizations of the Navigator itself functions according to the multi-level approach to Figure 14 can run. Through a combination of buttons and wheels, for example, parallel functions, multiple functions can be assigned to an input element.

12 shows an embodiment example, as carried out with actuation of keys, in particular of the Zappkreuzes and additional buttons, the selection of equipment and different functions of these devices, which can be taken by the multi-level concept of Fig.15. Indicated in Figure 12 in the columns SPI, SPII, SPIII relations of the operation of the key to key features are exemplified, another assignment of key functions for the operation of keys is of course possible.

In Figure 19 is shown an operation unit BE having a plurality of input fields TA_O, TA_R, TA_U, TA_L, TA_Z and TA_M (see also Fig.16). A computer RE processes the input from the operation unit BE and provides a corresponding functional assignment FBI or FB2 on the output unit DISP. It is ensured a high degree of flexibility, since the input fields of the service unit SU can be distinguished felt and a caption of these fields with a device function is omitted. This also eliminates the multiple assignments of input fields frequently used that require plenty of exercise for economical use and always require a visual contact with the respective input field.

The interaction of functional assignments with device-dependent options is outlined in more detail in Figure 20.

The multiple assignments of the input fields TA_O, TA_R, TA_U, TA_L, TA_Z and TA_M be displayed on the output unit DISP. In Figure 20, the output unit DISP shows a virtual device "electronic mailbox". The functional assignment of the input units are displayed on the output unit. The user can perform a corresponding interaction without looking at the fields. Each input field can be detected by feeling and from the knowledge of the arrangement is a possible operation without looking at the operating unit.

In Figure 20 is also shown how the individual fields can be assigned, depending on a representation that can be due to different virtual devices.

a device under a virtual machine understood to mean that appears only electronically, is not necessarily performed as a single unit with control options. Examples of virtual devices are a keyboard of a mobile phone which is displayed on the output unit, the above-mentioned electronic mailbox or a navigation system. The virtual device to the user uniformly displayed on the output unit, a selection of each device is also possible via the keypad.

The input field TA_Z can run on single actuation (single click) or double operation within a predetermined period (double) different functions.

The following describes possible with the input fields associated functions depending on displayed on the output unit components.

If objects or switches (engl .: buttons), so each is in the next right, left, upper or lower object with the input fields TA_R, TA_L, TA_0 or TA_U. With such a marking the user the current position of his cursor (pointer) is displayed. Switches of the just indicated (or the object) is shown to preferably with a different color, so that the user the position of his cursor at a glance (cursor) recognizes. The input field TA_Z corresponds with ease

Actuating a selection when activated twice within a definable time interval of a function which returns in the last menu or remains in the uppermost hierarchical menu. With the input field TA_M visible names are called, a speech takes such a nomination and initiates the appropriate named selection.

Are lists or tables shown, the operator by means of the input fields in the above-described manner is carried out. With the key TA_M language is recorded and it is possible to jump directly to the spoken element within the list or table.

the positioning of the cursor (cursor) applies again by means of the corresponding input fields TA_R, TA_L, TA_0 TA_U or for the display of pages or registers. With the key TA_M a direct selection is made by voice input.

If it is in the illustrated on the output unit DISP components to maps or images, the cursor is positioned by pressing the input fields TA_R, TA_L, TA_0 or TA_U also the input field TA_Z represents a zoom function. A direct navigation is alternatively via voice input by the desired name is spoken during the operation of TA_M button.

A navigating through HTML links is also possible. HTML (Hypertext Markup Language) is a language for representing Internet documents, and links in these documents (called links) can be implemented to other documents or other functionalities. A collection of HTML links corresponding entries in a phone book, in which individually with the input fields TA_L and TA_R before and you can scroll back and with the input fields TA_0 and TA_U a predetermined number of HTML_Links can each be skipped (in both directions: forward and reverse). The input field TA_Z is again used for selection at single action or jumping to the next higher menu level when activated twice within a predetermined time period. Also, while the

Box TA_M moved an HTML link to be called directly. This is, it has been recognized by the speech, called.

Claims

claims
1. A method for operating at least one device by a computer based on an operating unit comprising a plurality of input fields, each having a cognitive nature, a) in which functional assignments of the plurality of
Input fields are displayed on an output unit, b) wherein the adjustment possibilities of the device on the
Output unit are represented as functional assignments, c) in which carried out the operation of the device by the availability of functional corresponding input field is operated.
2. The method of claim 1, wherein a plurality of devices are operated by means of the control unit, wherein a selection of the device is also performed by the control unit.
3. The method of claim 1 or 2, wherein on the output unit visual and / or auditory information is output.
4. The method according to any one of the preceding claims, a) is additionally operated in the by speech recognition means, the device using a speech input) are displayed in the options for the voice input on the output unit b, c) displayed on the output unit in the adjustment of the device are, d) in which carried out the operation of the device by which the respective item or the respective adjustment corresponding to speech input is performed.
5. The method according to any one of claims 1 to 4, wherein the output unit is a display.
6. The method according to any one of claims 1 to 4, wherein the output unit is a head-up display in a vehicle.
7. An arrangement for operating at least one device on the basis of an operating unit comprising a plurality of input fields, each having a cognitive nature, having a processor unit which is set up such that a) functional assignments of the plurality of input fields are displayed on an output unit, b) setting the device on the output unit are displayed, c) is performed the operation of the device by the availability of functional corresponding input field is operated.
8. An arrangement according to claim 7, in which the processor unit is set up such that a plurality of devices are operated by means of the control unit, wherein a selection of the device is also performed by the control unit.
9. An arrangement according to claim 7 or 8, wherein on the output unit visual and / or auditory information is output.
10. An arrangement according to one of claims 7 to 9, having a processor unit which is set up such that a) is additionally operated by a speech recognition means the device using a speech input) options for a voice input on the output unit are represented b, c) setting of the device are displayed on the output unit, d) is performed the operation of the device by which the corresponding voice input option is performed.
11. An arrangement according to one of claims 7 to 10, wherein the output unit is a display.
12. An arrangement according to one of claims 7 to 10, wherein the output unit is a head-up display in a vehicle.
PCT/DE1997/002304 1996-10-10 1997-10-08 Method and device for operating at least one device WO1998015964A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
DE19641884 1996-10-10
DE19641884.4 1996-10-10
DE19641883 1996-10-10
DE19641883.6 1996-10-10

Publications (1)

Publication Number Publication Date
WO1998015964A1 true WO1998015964A1 (en) 1998-04-16

Family

ID=26030245

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/DE1997/002304 WO1998015964A1 (en) 1996-10-10 1997-10-08 Method and device for operating at least one device

Country Status (1)

Country Link
WO (1) WO1998015964A1 (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19904519A1 (en) * 1999-02-04 2000-08-10 Volkswagen Ag Operating unit, in particular multifunctional control unit
EP1043192A1 (en) * 1999-04-09 2000-10-11 Eaton Corporation System for wireless communication between components of a vehicle
WO2001094156A3 (en) * 2000-06-08 2002-05-10 A V B A Engineers & Services 9 Head-up display based safety devices for use in motor vehicles
FR2827065A1 (en) * 2001-07-09 2003-01-10 Louis Jobert Driving aid using radio or radar, uses communication between vehicle and roadside infrastructure which delivers information on traffic and vehicle behavior to alert driver and to control vehicle if driver does not respond promptly
EP1043179A3 (en) * 1999-04-09 2003-05-21 Delphi Technologies, Inc. System for monitoring tire pressure of a vehicle
US6980114B2 (en) 2002-10-09 2005-12-27 Siemens Aktiengesellschaft Remote activity controller for people
EP1526364B2 (en) 2003-10-21 2009-09-30 Mettler-Toledo AG Method for operating a weighing device and weighing device
DE102009034068A1 (en) 2008-11-10 2010-05-12 Audi Ag Control device for a motor vehicle
DE102009034069A1 (en) 2008-11-10 2010-05-12 Volkswagen Ag Control device for a motor vehicle
US7893850B2 (en) 2004-06-02 2011-02-22 Research In Motion Limited Handheld electronic device with text disambiguation
DE102012005866A1 (en) * 2012-03-22 2013-09-26 Audi Ag A method of reproducing potential or already taken place, from an input unit to be recorded or already made user inputs in a motor vehicle
US9075449B2 (en) 2004-06-02 2015-07-07 Blackberry Limited Handheld electronic device and associated method employing a multiple-axis input device and selectively disabling disambiguation
EP2822857B1 (en) 2012-03-07 2016-09-14 GEA Food Solutions Germany GmbH Packaging line

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0246472A1 (en) * 1986-05-12 1987-11-25 Siemens Aktiengesellschaft Remote control station
US4818048A (en) * 1987-01-06 1989-04-04 Hughes Aircraft Company Holographic head-up control panel
US4827520A (en) * 1987-01-16 1989-05-02 Prince Corporation Voice actuated control system for use in a vehicle
EP0366132A2 (en) * 1988-10-27 1990-05-02 Bayerische Motoren Werke Aktiengesellschaft Multifunction operating apparatus
US5088070A (en) * 1991-05-06 1992-02-11 Timex Corporation Selecting apparatus for a multimode electronic wrist instrument
WO1995003664A1 (en) * 1993-07-26 1995-02-02 Motorola Inc. Radio transceiver with interface apparatus which visually displays information and method therefor
US5555172A (en) * 1994-08-22 1996-09-10 Prince Corporation User interface for controlling accessories and entering data in a vehicle

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0246472A1 (en) * 1986-05-12 1987-11-25 Siemens Aktiengesellschaft Remote control station
US4818048A (en) * 1987-01-06 1989-04-04 Hughes Aircraft Company Holographic head-up control panel
US4827520A (en) * 1987-01-16 1989-05-02 Prince Corporation Voice actuated control system for use in a vehicle
EP0366132A2 (en) * 1988-10-27 1990-05-02 Bayerische Motoren Werke Aktiengesellschaft Multifunction operating apparatus
US5088070A (en) * 1991-05-06 1992-02-11 Timex Corporation Selecting apparatus for a multimode electronic wrist instrument
WO1995003664A1 (en) * 1993-07-26 1995-02-02 Motorola Inc. Radio transceiver with interface apparatus which visually displays information and method therefor
US5555172A (en) * 1994-08-22 1996-09-10 Prince Corporation User interface for controlling accessories and entering data in a vehicle

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19904519A1 (en) * 1999-02-04 2000-08-10 Volkswagen Ag Operating unit, in particular multifunctional control unit
EP1043192A1 (en) * 1999-04-09 2000-10-11 Eaton Corporation System for wireless communication between components of a vehicle
US6177867B1 (en) 1999-04-09 2001-01-23 Eaton Corporation System for wireless communication between components of a vehicle
EP1043179A3 (en) * 1999-04-09 2003-05-21 Delphi Technologies, Inc. System for monitoring tire pressure of a vehicle
WO2001094156A3 (en) * 2000-06-08 2002-05-10 A V B A Engineers & Services 9 Head-up display based safety devices for use in motor vehicles
US6697721B2 (en) 2000-06-08 2004-02-24 A.V.B.A. Engineers And Services (93) Ltd. Safety devices for use in motor vehicles
FR2827065A1 (en) * 2001-07-09 2003-01-10 Louis Jobert Driving aid using radio or radar, uses communication between vehicle and roadside infrastructure which delivers information on traffic and vehicle behavior to alert driver and to control vehicle if driver does not respond promptly
US6980114B2 (en) 2002-10-09 2005-12-27 Siemens Aktiengesellschaft Remote activity controller for people
EP1526364B2 (en) 2003-10-21 2009-09-30 Mettler-Toledo AG Method for operating a weighing device and weighing device
US7633018B2 (en) 2003-10-21 2009-12-15 Mettler-Toledo Ag Method of operating a balance, and balance
US7893850B2 (en) 2004-06-02 2011-02-22 Research In Motion Limited Handheld electronic device with text disambiguation
US9075449B2 (en) 2004-06-02 2015-07-07 Blackberry Limited Handheld electronic device and associated method employing a multiple-axis input device and selectively disabling disambiguation
DE102009034068A1 (en) 2008-11-10 2010-05-12 Audi Ag Control device for a motor vehicle
DE102009034069A1 (en) 2008-11-10 2010-05-12 Volkswagen Ag Control device for a motor vehicle
US8700332B2 (en) 2008-11-10 2014-04-15 Volkswagen Ag Operating device for a motor vehicle
US9108513B2 (en) 2008-11-10 2015-08-18 Volkswagen Ag Viewing direction and acoustic command based operating device for a motor vehicle
EP2822857B1 (en) 2012-03-07 2016-09-14 GEA Food Solutions Germany GmbH Packaging line
DE102012005866A1 (en) * 2012-03-22 2013-09-26 Audi Ag A method of reproducing potential or already taken place, from an input unit to be recorded or already made user inputs in a motor vehicle

Similar Documents

Publication Publication Date Title
JP3979002B2 (en) The user interface for the system and user interface providing method of a computer
KR101647848B1 (en) Multimode user interface of a driver assistance system for inputting and presentation of information
US8287374B2 (en) Reconfigurable control displays for games, toys, and other applications
US8438481B2 (en) User interface for multifunction device
US5086510A (en) Multi-choice information system for a motor vehicle
US6100476A (en) Operating device with two-dimensional dialogue movement
CN1430744B (en) Method for organizing information and displaying in graphic interface on electronic apparatus
US6073036A (en) Mobile station with touch input having automatic symbol magnification function
JP5113922B2 (en) Holographic human-machine interface
US20080161997A1 (en) Method for Representing Items of Information in a Means of Transportation and Instrument Cluster for a Motor Vehicle
US7801566B2 (en) Mobile information terminal having operation keys and a display on opposite sides
US5638060A (en) System switch device
Maguire A review of user-interface design guidelines for public information kiosk systems
US6819990B2 (en) Touch panel input for automotive devices
US20120062465A1 (en) Methods of and systems for reducing keyboard data entry errors
JP4955505B2 (en) Mobile terminal and a method for screen display
EP0990202B1 (en) Graphical user interface touch screen with an auto zoom feature
US5239700A (en) Multi-choice information system for a motor vehicle
US6812942B2 (en) Context-responsive in-vehicle display system
EP1044118B1 (en) Graphical interface components for in-dash automotive accessories
US20040176906A1 (en) Vehicular navigation device
JP5945417B2 (en) Electronics
US7274354B2 (en) Portable electronic apparatus
CN104838335B (en) Use the interactive gaze detection equipment and management
EP1307810B1 (en) User interface for telematics systems

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): JP KR US

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase