DE102019212278A1 - Control system and method for operating the control system - Google Patents

Abstract

The operating system comprises a control unit (2) which is set up to generate output data for a graphical user interface, an output unit (3) for outputting the output data and an input unit (4; 34) for detecting an actuation action. At least a first and a second operating state can be activated for the user interface. The control unit (2) is set up to generate a shape control signal as a function of the activated first or second operating state of the user interface and to transmit it to the input unit (4; 34), the input unit (4; 34) having a deformation element ( 6; 36a, 36b) which is set up to form a first form of the input unit (4; 34) based on the form control signal when the first operating state is activated and to form a second geometric form of the input unit (4; 34), when the second operating state is activated. A method for operating an operating system is also proposed.

Description

The present invention relates to an operating system, in particular for a vehicle, and a method for operating the operating system.

Techniques of augmented reality (AR) or virtual reality (English: virtual reality, VR) are increasingly finding their way into everyday life, especially in the automotive industry. In the case of augmented reality methods, for example, a perception of reality in a user's environment is supplemented by virtual objects generated by means of a computer, which for example output additional information or provide options for interaction. In the following, the terms augmented reality and virtual reality are used as essentially analog, since no clear distinction is often made in common linguistic usage.

It is assumed that AR display devices such as glasses, contact lenses or projection solutions will be available everywhere. For example, the use of AR in moving vehicles and also in other situations in road traffic, such as pedestrian navigation, is already being tested. However, there is currently no suitable operating concept for the virtual content that surrounds the user's space.

For example, during a manual drive it is difficult for the driver to control AR content using a touchscreen or similar input methods. This is also associated with distraction. In the case of autonomous driving, however, a manually operable control element, in particular a steering wheel or a center console, is no longer absolutely necessary, which means that an alternative interaction path is required, for example using a handheld device.

Therefore, intuitively accessible and innovative operating concepts are required for this technology that are socially accepted at the same time. These must be easy and quick to use and be able to cover multifunctional applications in terms of interaction with a wide variety of AR content. In particular, in the context of personal and shared mobility, these interaction devices should, at best, be usable anywhere and, for example, from any location in the vehicle. In this way, a user's own personal area is created.

In the case of known input options, for example by means of gestures or voice commands, it is felt to be disadvantageous that these are often clearly visible or audible to the environment and can have a disruptive effect.

From the US 2013/0144482 A1 a device for supplementing an instrument panel by means of augmented reality is known. Functions can be activated and certain information displayed based on the direction of view of a driver of a vehicle. Inputs can be recorded, for example, using a touchscreen or voice control.

The DE 103 49 673 A1 proposes a device for data input in a motor vehicle, in which the input data are displayed in a field of view of the driver. The input takes place, for example, by means of a touch panel for handwritten input.

In the KR 10-2013-0036934 describes a head-up display in which the display of a mobile phone is projected into the driver's field of vision.

The present invention is based on the object of providing an operating system and a method for its operation which allow particularly simple and socially acceptable operation.

According to the invention, this object is achieved by an operating system with the features of claim 1 and a method with the features of claim 10. Advantageous refinements and developments result from the dependent claims.

The operating system according to the invention comprises a control unit which is set up to generate output data for a graphical user interface, an output unit for outputting the output data and an input unit for detecting an actuation action. At least a first and a second operating state can be activated for the user interface. The control unit is set up to generate a shape control signal as a function of the activated first or second operating state of the user interface and to transmit it to the input unit, the input unit having a deformation element which is set up to generate a first shape control signal based on the shape control signal Form the shape of the input unit when the first operating state is activated, and to form a second geometric shape of the input unit when the second operating state is activated.

In this operating system, the user advantageously receives clear, in particular also haptically detectable, feedback about the operating state of the user interface by means of the input unit. In addition, new modes of operation can be provided, for example in order to be able to operate in different contexts. This is the case with the application in the area of augmented reality particularly important because the user should enter the experience of a virtually generated or expanded environment as seamlessly as possible, in which interactions with operable elements can follow very different operating modes.

In contrast to known input devices, in the operating system according to the invention certain initial functions, such as scrolling or zooming, can be carried out by means of the input unit, without first having to perform a separate operating step through which, for example, a “tool” or a mode of operation can be selected got to.

The user interface includes, in particular, a graphic representation for a man-machine interface. Technical facilities can be operated by means of control elements, for which purpose buttons or symbols of the display can be used. In particular, the user interface can include switching and control elements which represent the operation of a functionality in a manner that can be grasped by a person. For example, the amount of a parameter can be displayed and its setting can be visualized by a setting element. The user interface can also include elements for displaying information and thus enable output that can be interpreted by a human being. In particular, it is designed as a graphical user interface in a manner known per se.

In one embodiment, the deformation element of the input unit has a position relative to further elements of the input unit, and the relative position can be set in order to form the first or two geometric shape. As a result, the shape can advantageously be changed particularly easily.

In particular, when setting the geometric shape of the input unit, the shape of its surface is set. Furthermore, the position of the center of gravity of the input unit can be adjusted. For example, the deformation element can comprise an actuator or be coupled to an actuator. The relative position of the deformation element relates to its arrangement relative to the other elements of the input unit. The position can be adjusted, for example, by moving and / or rotating the deformation element. The deformation element is designed in particular in such a way that its extent changes in at least one direction. For example, the deformation element can be elongated and change its length in the longitudinal direction.

The operating state of the user interface can be defined in various ways. For example, it can relate to the availability of certain operable functionalities, so that an operating state is activated when the functionalities are available and can be operated by means of an actuation action. The operating status can relate to the user interface as a whole or to individual elements or objects.

This means that the operating status can also be defined by the status of an object within the user interface. This object can be selected, for example, either automatically or by means of a selection operator action. In such a case, the shape control signal is designed so that the shape of the input unit is formed depending on the activated state of the object.

The operating state can also be defined as a function of an active operating mode. For example, operation by scrolling along a certain direction or axis can be possible and the operating mode can be defined as a function of this direction or axis. In a further example, the operation can be carried out by means of a touch gesture, by moving or exerting pressure on a specific area of the input unit. In this case, the shape of the input unit can be set in such a way that it is possible to detect which operating mode is currently active, for example to operate a specific object or the user interface.

Furthermore, an operating state can be defined in which no interaction with an object on the operating surface can be carried out, for example in the case of a pure information display. Furthermore, an operating state can be defined in which a specific input is requested, for example to confirm, select an option or press a button.

Furthermore, for example, the first operating state can be a display state and the second operating state can be a configuration state. For example, the display state can be defined in such a way that a state for outputting specific information is activated for a specific object on the user interface. Furthermore, the configuration state can be defined in such a way that this object of the user interface is designed in such a way that settings can be made. For example, the information output in the display state can be selected or otherwise configured.

The second operating state can also be a configuration state for the user interface as a whole, wherein, for example, objects can be selected that are included in the user interface, or parameters by means of the User interface or the objects it encompasses can be set.

In particular, the input unit is set up to generate an operating state change signal when a change in position of the input unit is detected, for example a rotation of the input unit, wherein if the change in position includes a rotation or pivoting about a certain angle, the angle with a certain threshold value is compared. If the angle exceeds the threshold value, an operating state change signal is generated for changing the operating state. For example, the operating state change signal can be generated when the input unit is turned around a specific axis.

In particular, the output data can include a graphic object indicating the geometric shape of the input unit and / or the activated operating state. For example, the output includes a graphic object, the geometry of which corresponds at least schematically to a geometry of the shape of the input unit.

The operating system is set up in such a way that a control signal is generated upon the detection of an actuation action. This can be transmitted to the control unit and, for example, lead to an interaction with the user interface or an object encompassed by it. For example, an object can be selected and a function assigned to the object can be activated or deactivated. Furthermore, depending on the control signal, an adjustable parameter can be transmitted to a device for setting.

In a further embodiment, the shape of the input unit can be changed by means of an actuation, in particular by an external force, and depending on the changed shape, the first or second operating state of the input unit can be activated. In particular, the position and / or alignment of the deformation element is changed. As a result, the operating state can advantageously be set particularly easily.

The activation of the operating state can in particular relate to the entire user interface or to an object that it comprises. In particular, the graphical representation of the user interface or an object it encompasses can be changed. For example, a scrolling direction is changed, for example by tilting a representation of a scrollable list of list entries.

The shape of the input unit can be changed both actively by means of the deformation element and on the basis of the shape control signal, as well as passively by physical action from the outside, in particular by a force acting on the input unit or on the deformation element. For example, the position of the deformation element of the input unit can be changed from the outside by moving and / or rotating. Furthermore, the shape can be changed by exerting pressure on a certain area of the input unit, for example in the case of a flexible area which is designed to be deformable and whose deformation can also be detected.

When the first or second operating state is activated, a display or configuration mode is set, for example. That is, by changing the shape of the input unit by means of an external force, the operating state can be changed.

In particular, the input unit comprises at least one sensor element for detecting a change in shape and / or a force acting on the input unit. The sensor element is particularly suitable for detecting an actuation action by means of different physical detection principles. For example, touching or approaching an area of the surface of the input unit can be detected, for example by means of a capacitive sensor. Furthermore, a position of the input unit can be detected, for example by means of a gyroscopic sensor or an acceleration sensor or a sensor for determining the position.

An actuation action that can be detected by means of the input unit can take place in various ways. In particular, the actuation action is carried out in such a way that it has a specific relation to an object of the user interface or to a functionality linked to the object. An actuation action can include, for example, touching an area on the surface of the input unit, exerting pressure on the input unit or a specific orientation or positioning of the input unit. It can also include a change in the position of the touch, for example a swiping gesture that is executed on the surface of the input unit, or a change in the position and / or orientation, for example by moving the input unit along a trajectory, the speed also being taken into account can. In particular, a three-dimensional gesture is carried out. Actuation handling can include rotating or pivoting, a specific orientation, for example to point to a specific position or in a direction. The actuation action can furthermore comprise a combination of several action elements, for example a simultaneous movement along different ones Degrees of freedom or successive movements and other actuations.

The input unit can in particular be designed so that a feedback is generated when the actuation action is carried out, for example through a haptically detectable elastic deformation of the input unit and / or an acoustically perceptible click during actuation, for example when a pressure is exerted on the surface of the input unit.

In one development, the actuation action comprises a movement of the input unit along a specific trajectory, an acceleration, a change in position, a touch or a swiping gesture along a surface of the input unit. The actuation is thereby advantageously particularly simple.

In particular, the input unit is brought into a certain position during the actuation action, for example an alignment and / or positions of the input unit being detected in order to perform a pointing gesture, for example. To determine the position, an alignment in a gravitational field can be detected, for example. An actuation action can also relate to a change in position, in particular as a function of time, for example moving the input unit along a trajectory in a two- or three-dimensional space, executing a specific acceleration and / or a rotation or a tilting movement.

In one embodiment, a specific surface area of the input unit is designed as an interaction surface, wherein a contact by means of an actuation object can be detected in the specific surface area. In particular, the actuation object is a hand of a user. In this way, entries can advantageously be made in a particularly simple manner.

The interaction surface can be configured in a manner known per se and in particular comprise a sensor element for detecting a touch or approach, for example by means of capacitive or resistive sensors. For example, the position of a contact and, if necessary, a change in the position as a function of time is recorded. When the actuating object moves along the interaction surface, for example with a swiping gesture, a direction, trajectory and / or speed of the movement can be recorded.

The input unit is designed in particular in such a way that a variable surface area can be activated as an interaction surface. For this purpose, the input unit can have boundary surfaces which can be fully or partially activated as interaction surfaces. For example, the input unit can have a polyhedral shape for this purpose.

The interaction surface is formed in particular as a function of the activated operating state, for example together with the change in the shape of the input unit.

In one embodiment, the specific surface area can be highlighted by means of an optical highlight. The surface area of the interaction surface is emphasized, for example, by means of a brightness or color that is different from the surroundings. The surface area can also be highlighted optically, for example by changing the shape of the input unit in such a way that the interaction surface can be detected haptically, for example as a raised area of the surface.

In a further embodiment, the input unit is wirelessly coupled to the control unit and designed to be movable by a user. In particular, the input unit can be used without a fixed connection to another unit. The input can thereby advantageously take place in a particularly flexible manner.

For example, the input unit has dimensions that enable the user to hold it in one hand. The input unit can also have a grip area that makes it easier to hold. Furthermore, the shape of the input unit can be designed in such a way that holding it in a certain orientation relative to the hand of the user is favored, for example in the case of an elongated shape which favors an orientation essentially at an angle to the course of the user's forearm. The input unit can furthermore be designed such that it is not larger than 10 cm in any direction, preferably not larger than 7 cm, more preferably not larger than 5 cm.

A receiving unit can be provided for the input unit in which, for example, the input unit can be put down in such a way that unintentional slipping or falling is avoided. A receiving unit can also be used to charge an energy store of the input unit. For example, an inductive method can be used for charging, or an electrically conductive connection can be established between the input unit and the receiving unit.

When outputting the output data, the user interface is displayed, which can also be done in a manner known per se. For example, a display area can be used for this. Furthermore, means of augmented or virtual reality can be used for output, with For example, elements of a real environment can be enriched with virtually generated elements. For example, the output can comprise a graphic output of image or video data which reproduce the real environment, with additional graphic elements being generated and included in the output. Furthermore, the output can be generated and output in such a way that a user perceives the real environment directly, for example through a vehicle window or glasses, while at the same time the output is projected into his field of vision or into his eye, for example in a head-up display or in the case of glasses with a corresponding display or projection unit, that the virtual objects appear in the environment from the perspective of the user.

In a further development, the output unit is designed such that the output data can be output at a distance from the input unit. A particularly flexible output can thereby advantageously take place.

In particular, the output does not take place by means of a so-called touchscreen, in which inputs are recorded in the same area in which the output takes place. However, in one embodiment of the invention, a touchscreen for output can be combined with an input unit spaced therefrom. The output unit can be designed in such a way that the output takes place with means of augmented or virtual reality. The operating system can furthermore comprise a combination of different output units, for example a combination of a touchscreen with an output unit for augmented reality.

In one embodiment, the output unit comprises a head-up display or a display unit worn on the body of a user, for example glasses. The method can thereby advantageously be combined particularly easily with known methods of augmented or virtual reality.

In a further embodiment, a direction of view of a user can be recorded, with a real subset of operating objects of the user interface being selectable as a function of the recorded direction of view. In particular, a subsequent actuation action leads to a selection or actuation of an individual operating object of the subset. This advantageously facilitates a selection between a number of control objects on the user interface.

The direction of gaze can be detected in a manner known per se, in particular by following the movement of an eye and / or a head posture. The selection of the subset of operating objects takes place in such a way that operating objects arranged only in a certain sub-area of the user interface are selected, the sub-area being defined, for example, by the viewing direction and a predetermined radius or an environment defined in some other way. In particular, a preselection is thereby carried out.

In one embodiment, the input unit comprises an actuator for generating a vibration. The control unit is set up to generate a feedback signal and to transmit it to the input unit, a vibration being output as feedback for an actuation action or an event of the user interface on the basis of the feedback signal. For example, the input unit vibrates in order to confirm that an actuation action has been detected, in which case the feedback signal is formed with a vibration that is dependent on the type of actuation action detected. A vibration can also be used as a feedback signal to signal that a specific control signal has been generated, for example an actuation or selection of an object on the user interface or a setting of a specific value.

The vibration can be formed in a manner known per se. In particular, vibrations of different intensity or frequency and possibly with different vibration directions can be output in order to generate different feedback signals. For example, when a parameter is set, a feedback signal can be generated such that the greater the set value of the parameter, the greater the intensity of the vibration. Conversely, the lower the set value, the weaker the vibration.

In one embodiment, the input unit is assigned to a user. For example, the input unit can comprise a memory element on which settings and / or other personal data of a user are stored, or it can comprise identification information by means of which the user can be identified and settings and other data can be recorded. As a result, a high degree of personalization can advantageously be achieved and the input unit can be designed as a user's personal device. The user can then operate in the same or a similar manner in different contexts, in different positions and for different operating systems, for example by actuating virtual objects in an analogous manner or arranging virtual objects in a similar manner.

In particular, the input unit can be designed as a mobile device assigned to a user. The user can carry this with him, for example, when he starts a vehicle or to operate another operating system, for example in the area of home automation or in public spaces. He is then advantageously already familiar with the operation and can carry it out using an individually configured input unit.

The operating system according to the invention allows interaction with a user interface of augmented reality in various ways. A gesture control can be carried out as an actuation action, for example, wherein a gesture can be detected using a touch-sensitive surface of the input unit and / or using sensors to determine the position, speed or acceleration of the input unit in three-dimensional space. While gestures carried out with great amplitude and clarity in public space can attract attention and meet with rejection, the actuation action in the operating system can be carried out discretely by means of small movements and / or using a small-sized input unit.

In one embodiment of the operating system, an operation is implemented in which a preselection of objects of the user interface is carried out based on the direction in which the user is looking, which objects are then individually selected or operated by an operating action using the input unit, for example by scrolling, rotating, or swiping or repeated actuation. This makes use of the fact that the selection is particularly simple on the basis of the viewing direction, although a detailed and precise selection or determination of the viewing direction can be difficult. This more precise selection is therefore made by means of the input unit, the preselection based on the viewing direction saving the user a greater number of operating steps here. In further embodiments, voice control can alternatively or additionally be used in the operating system, for example to confirm an input or to carry out an actuation, preselection or selection. This avoids the disadvantages of pure voice control, which can only be used to a limited extent in public for reasons of privacy or due to disturbances in the environment.

In the method according to the invention for operating an operating system, in particular for a vehicle, output data for a graphical user interface are generated and output and an operating action is recorded. At least a first and a second operating state can be activated for the user interface. Depending on the activated first or second operating state of the user interface, a shape control signal is generated and transmitted to the input unit, a deformation element using the shape control signal to form a first shape of the input unit when the first operating state is activated, and a second geometric shape Forms the input unit when the second operating state is activated.

The method according to the invention is designed to operate the operating system according to the invention described above. The method thus has the same advantages as the operating system according to the invention.

• 1 zeigt ein Ausführungsbeispiel des erfindungsgemäßen Bediensystems in einem Fahrzeug,
• 2A und 2B zeigen Ausführungsbeispiele von bei dem erfindungsgemäßen Verfahren erzeugbaren Ausgaben,
• 3A und 3B zeigen ein erstes Ausführungsbeispiel einer Formveränderung der Eingabeeinheit des Bediensystems,
• 4A und 4B zeigen ein zweites Ausführungsbeispiel einer Formveränderung der Eingabeeinheit des Bediensystems und
• 5A bis 5E zeigen ein drittes Ausführungsbeispiel einer Formveränderung der Eingabeeinheit des Bediensystems.

The invention will now be explained on the basis of exemplary embodiments with reference to the drawings.

• 1 shows an embodiment of the control system according to the invention in a vehicle,
• 2A and 2 B show exemplary embodiments of outputs that can be generated in the method according to the invention,
• 3A and 3B show a first embodiment of a change in shape of the input unit of the operating system,
• 4A and 4B show a second embodiment of a change in shape of the input unit of the operating system and
• 5A to 5E show a third embodiment of a change in shape of the input unit of the operating system.

In reference to 1 an embodiment of the control system according to the invention is explained in a vehicle.

The vehicle 1 includes a control unit 2 , with which an output unit 3 , in the exemplary embodiment a head-up display 3 , and an input unit 4th are coupled. The input unit 4th includes a sensor 5 and a deformation element 6th . With the control unit 2 is also an institution 7th of the vehicle 1 coupled, in the exemplary embodiment a navigation unit 7th .

The input unit 4th is assigned to a specific user and the settings for the input unit are personalized for this user 4th saved. In the exemplary embodiment, the storage takes place in a memory element of the input unit 4th , alternatively or additionally, the input unit 4th store an identification based on which when using the input unit 4th the corresponding settings can be called up.

With reference to the 2A and 2 B Examples of outputs that can be generated in the method according to the invention are explained. This is based on the exemplary embodiment of the operating system according to the invention explained above, which is further specified by the description of the method.

In the exemplary embodiment, the control unit generates 2 an output generated by the output unit 3 , for example the head-up display 3 or augmented reality glasses, so in the field of vision of the driver of the vehicle 1 it is projected at the same time as the view of the surroundings of the vehicle 1 appears superimposed. In further examples the output takes place by means of a different type of output unit 3 , in particular another output unit for virtual reality. The entire display visible to the user can also be generated virtually, in particular by a real view of the surroundings by means of the output unit 3 is mapped. For example, the output in this case includes images of the surroundings captured by means of a video camera and virtual objects displayed in addition.

The in 2A The case shown is the real environment of the vehicle 1 through the lane markings 10 indicated while by the output unit 3 in addition, virtual objects 11 to 15th projected into the field of view. In the case shown here, the output as virtual objects includes an output of a speed limit 11 , which is output as a representation of a traffic sign, a numerically represented current speed 12 , a list 13 with list entries 13a , a symbol as a marker 14th as well as the marking 14th an information box 15th with a representation of text.

The in 2 B The case shown is also the real environment 20th , especially a lane marking 20th indicated. In addition, there are virtual objects projected into the user's field of vision 21st , 22nd , 23 shown the active widgets 21st , 23 as well as inactive widgets 22nd represent. There is also another virtual object 24 shown which a route display 24 represents. These are arranged vertically one above the other along an arch structure in the right and left areas. Further virtual objects can also be displayed, for example information displays about other runners on the route.

In the 2 B active widgets shown 21st , 23 are opposite the inactive widgets 22nd shown enlarged. They can also be emphasized more clearly by means of graphic highlighting that is known per se. With the active widgets 21st , 23 text information is also displayed, in particular possible actions that can be initiated by pressing the respective active widget 21st , 23 are executable. For example is an active widget 21st provided to control navigation along a running route, which is indicated by a virtual route display 24 is issued. An actuation can, for example, end navigation or trigger another action.

In the two cases in the 2A and 2 B are involved, virtual objects can be selected for interaction, for example by means of gaze control. A viewing direction of the user is recorded and it is determined which virtual object the gaze is directed at. This object is then selected, for example after the gaze has been continuously directed at the virtual object for a certain time interval. Interactions can then be carried out using the input unit 4th are executed. For example, virtual objects can be actuated in order to develop or activate an action or functionality, or the display can be changed, for example by selecting and configuring content to be displayed. The input unit 4th can be arranged in different ways; it can, for example, be in the user's hand or in the vehicle 1 be fixed in a certain position.

By actuating a virtual object or widget, a control signal for a device can be generated and output, for example for a navigation system 7th of the vehicle 1 .

In the example, provision is also made for a preselection to be made based on the user's viewing direction. The direction of view is determined and the objects arranged there are preselected in a certain radius around a point within the user interface at which the eye is directed, which is in particular a real subset of the virtual objects of the entire user interface. By means of a further operating action, for example further directing the view to a certain point or by actuating the input unit 4th , a specific virtual object can then be selected and / or operated.

With reference to the 3A and 3B a first example of a change in shape of the input unit of the operating system is explained. This is based on the examples explained above.

In this example the input unit comprises 34 a deformation element 36a , 36b that is in a horizontal configuration 36a and in a vertical configuration 36b is shown. The deformation element can be active between these configurations 36a , 36b toggle the configuration 36a , 36b but can also passively through from the outside the deformation element 36a , 36b acting forces are changed. The input unit 34 is pentagonal, while the deformation element 36 is elongated and centered on the surface of the input unit 34 is arranged.

On a surface of the input unit 34 are interaction surfaces 35a , 35b , 35c educated. Thereby is one of the interaction surfaces 35c on the deformation element 36a formed and follows its configuration. That is, with a horizontal configuration of the deformation element 36a is the interaction surface 35c also aligned elongated and horizontally, with a vertical configuration of the deformation element 36b is also the interaction surface 35c arranged vertically in the same way (not shown).

The interaction areas 35a , 35b , 35c are in the example as touch-sensitive surface areas of the input unit 34 educated. Furthermore, the input unit 35 is formed in such a way that it is in the area of one of the interaction surfaces 35a can be easily elastically deformed by pressure perpendicular to the surface, in particular in the manner of a push button. Haptic and acoustic feedback is generated by the deformation and an audible click.

In further examples are on the surface of the input unit 34 furthermore, lighting elements are arranged, and feedback on operable areas and / or surfaces is displayed on the basis of an optical parameter, for example by highlighting them by means of a brightness or color. The user can thus see in which areas an actuation can be carried out. In further examples, visual feedback can also be output during operation, for example by changing an optical parameter, for example by the lighting following the course of a swiping gesture, an area lighting up after an actuation or alternatively actuatable areas being highlighted when prompted. Different surfaces can also be illuminated in different ways, for example with different colors, brightness or flashing frequency, in order to indicate different input options, such as acceptance or rejection, activation or deactivation.

Furthermore, lighting elements on the edge of the input unit 34 be arranged. In particular, is the input unit 34 formed with two superimposed layers and has a gap at the edge, in which actuation takes place by pressure and elastic deformation of the layers in the area of the gap. Its operability can be indicated by lighting in the gap. Furthermore, the lighting can change when it is actuated, in particular to confirm this.

In the example, touches, the exertion of pressure on a position of the interaction surfaces 35a , 35b , 35c or with the input unit 34 gestures performed are recorded as actions. As a function of this, a user can interact with virtual objects of the user interface, for example by making a selection or actuation, scrolling or shifting or making an entry.

In the example are the configurations 36a , 36b different operating states assigned. In the case shown, these are defined in such a way that the user interface in the first operating state includes a menu with widgets for information output and fast operation of individual functionalities, while the user interface in the second operating state includes a selection of displayable widgets or operating options for functionalities. That is, in the first operating state, a user can use the display to capture information and, if necessary, act on the operation of functions linked to the widgets; it is therefore a display state. In contrast, it is possible for the user in the second operating state to select the information and functions displayed in the first operating state, for example by selecting from a menu or a list; it is therefore a configuration state.

In a further example, the first and second operating states differ in a direction marked for operation, in particular a direction in which a list can be searched through by scrolling or paging. If the elements of the list to be searched can be searched in a horizontal direction, for example by means of a swiping gesture carried out in a horizontal direction, the first operating state is activated and, for example, the deformation element 36a aligned in a horizontal configuration. In contrast, a vertical configuration 36b can be set if the elements of the list can be searched in a vertical direction, for example by a swiping gesture carried out in the horizontal direction.

In further examples, other definitions of the first and second operating status are provided. Furthermore, a larger number of operating states is possible, with different angles for the deformation element, for example 36a , 36b set and / or different interaction surfaces 35a , 35b , 35c can be trained.

In the example, there is an automatic switchover between the operating states when a signal to switch is detected. Such a signal can be generated automatically, for example when performing a specific function. Furthermore, the signal can be generated on the basis of a user input, for example by selecting a specific virtual object. The operating state can also be changed in that the deformation element is activated by an external force 36a , 36b is shifted, for example by a user touching the deformation element 36a , 36b rotates. In this way, the user can switch between a display and a configuration state in particular.

In a further example, the output includes a schematic display of the currently set configuration 36a , 36b the input unit 34 and / or another display of the currently activated operating mode.

With reference to the 4A and 4B a second example of a change in shape of the input unit of the operating system is explained. This is based on the examples explained above.

In this case, the input unit 41 has a triangular shape, particularly the shape of an equilateral triangle. In a central area there is a deformation element also designed as an equilateral triangle 42a , 42b arranged, the orientation of which can be rotated between a first orientation 42a at which the tips of the deformation element 42a to the sides of the triangular shape of the input unit 41 point, and a second orientation 42b , at which the sides of the deformation element 42b substantially parallel to the sides of the triangular shape of the input unit 41 run away. This rotation can be actively carried out by the input unit 41 or it can be carried out passively when a force is exerted on the deformation element 42a , 42b done from the outside.

The input unit 41 has three interaction areas in the example 43 , 44 , 45 which is essentially over the entire surface of the input unit facing the user 41 beyond the deformation element 42a , 42b extend. In the example are the interaction areas 43 , 44 , 45 designed as touch-sensitive surfaces and also by exerting pressure perpendicular to the surface of the input unit 41 operable.

With reference to the 5A to 5E a third example of a change in shape of the input unit of the operating system is explained. This is based on the examples explained above.

The input unit 51 is designed essentially analogously to the examples explained above. It has the shape of a rounded isosceles triangle, with the apex of the triangle pointing upwards and the laterally downwardly extending sides of the triangle being longer than the horizontally extending sides. It is assumed that a user is the input unit 51 from an original location as in 5A is shown, rotated about an axis perpendicular to the image surface, about an angle of 120 °. The 5A to 5E show a simultaneous change in the shape of the input unit 51 each after a certain time step, each with the earlier form 52 the input unit 51 is indicated with the previous time step.

In the example, the shape of the input unit changes 51 so that the input unit 51 at the end point of the movement, shown in 5E , compared to the original form, shown in 5A is rotated by 180 °. This means that the change in shape suggests a stronger rotation than was actually carried out. While changing the shape of the input unit 51 the proportions of the side lengths shift so that the formerly shorter side takes on the length of the two longer legs of the triangle, while one of the longer sides is shortened and is located at the top at the end of the movement. The apex of the triangle points towards the end of the movement, shown in 5E , downward.

The example shown here can also be designed so that the shape of the input unit 51 completely actively changed so that the in the 5A to 5E shown states can be achieved. In this case there is no rotation by a user, but the apparent rotation by 180 ° takes place exclusively by changing the edge lengths of the triangle. In particular, the input unit 51 while held in a holder or it is stored in another way.

In the examples explained above, it is also provided that the input units 4th , 34 , 41 , 51 sensors for detecting the position and an acceleration of the input unit 4th , 34 , 41 , 51 include. In this way it can be detected, for example, when the input unit 4th , 34 , 41 , 51 is rotated in one direction. Furthermore, an alignment of the input unit 4th , 34 , 41 , 51 are detected, in particular to implement a pointing gesture, in which based on the orientation of the input unit 4th , 34 , 41 , 51 a point is determined within the user interface, for example to mark this position or to mark, select, operate or otherwise operate a virtual object located there. In addition, gestures can be recorded in which a user is using the input unit 4th , 34 , 41 , 51 moved in three-dimensional space along a certain trajectory, possibly with a certain speed and / or acceleration.

In another example is the input unit 4th , 34 , 41 , 51 on a handlebar of the vehicle 1 arranged. It can be, for example, the handlebar or a comparable control device of a motor vehicle, a bicycle, a drone or a scooter. The input unit 4th , 34 , 41 , 51 is particularly moveable and removable. A user can use the input unit 4th , 34 , 41 , 51 , especially if it is individually personalized for him, between different vehicles 1 and thus achieve a similar operation in different contexts.

List of reference symbols

1

vehicle

2

Control unit

3

Output unit, head-up display

4th

Input unit

5

sensor

6

Deformation element

7th

Facility; Navigation unit

10

Lane marking

11

Virtual object; Speed limit

12th

Virtual object; Current speed

13

Virtual object; list

13a

Virtual object; List entries

14th

Virtual object; mark

15th

Virtual object; Information box

20th

Lane marking; real environment

21st

Virtual object; active widget

22nd

Virtual object; inactive widget

23

Virtual object; active widget

24

Virtual object; Route display

34

Input unit

35a, 35b, 35c

Interaction surface

36a

Deformation element (horizontal)

36b

Deformation element (vertical)

41

Input unit

42a, 42b

Deformation element

43, 44, 45

Interaction surface

51

Input unit (outline)

52

Input unit (previous outline)

QUOTES INCLUDED IN THE DESCRIPTION

This list of the documents listed by the applicant was generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Patent literature cited

• US 2013/0144482 A1 [0007]
• DE 10349673 A1 [0008]
• KR 1020130036934 [0009]

Claims (10)

Control system, comprehensive a control unit (2) which is set up to generate output data for a graphical user interface; an output unit (3) for outputting the output data; and an input unit (4; 34) for detecting an operating action; wherein at least a first and a second operating state can be activated for the user interface; in which the control unit (2) is set up to generate a shape control signal as a function of the activated first or second operating state of the user interface and to transmit it to the input unit (4; 34); in which the input unit (4; 34) has a deformation element (6; 36a, 36b) which is configured to use the shape control signal to form a first shape of the input unit (4; 34) when the first operating state is activated, and a second shape Form the geometric shape of the input unit (4; 34) when the second operating state is activated. Operating system according to Claim 1 , characterized in that the deformation element (6; 36a, 36b) of the input unit has a position relative to further elements of the input unit and the relative position can be set in order to form the first or two geometrical shapes Operating system according to Claim 1 or 2 , characterized in that the shape of the input unit (4; 34) can be changed by means of the actuation action and, depending on the changed shape, the first or second operating state of the input unit (4; 34) can be activated. Operating system according to one of the preceding claims, characterized in that the actuation action comprises a movement of the input unit (4; 34) along a specific trajectory, an acceleration, a change in position, a touch or a swiping gesture along a surface of the input unit (4; 34). Operating system according to one of the preceding claims, characterized in that a certain surface area of the input unit is designed as an interaction surface (35a, 35b, 35c), wherein a contact by means of an actuation object can be detected in the certain surface area. Operating system according to one of the preceding claims, characterized in that the input unit (4; 34) is coupled wirelessly to the control unit (2) and is designed to be movable by a user. Operating system according to one of the preceding claims, characterized in that the output unit (3) is formed such that the output data can be output at a distance from the input unit (4; 34). Operating system according to one of the preceding claims, characterized in that the output unit (3) comprises a head-up display or a display unit (3) worn on the body of a user. Operating system according to one of the preceding claims, characterized in that a viewing direction of a user can be recorded; a real subset of control objects of the user interface can be selected as a function of the detected viewing direction. Method for operating an operating system in which Output data for a graphical user interface are generated and output; and an operating action is detected by means of an input unit (4; 34); wherein at least a first and a second operating state can be activated for the user interface; in which Depending on the activated first or second operating state of the user interface, a shape control signal is generated and transmitted to the input unit (4; 34); in which a deformation element (6; 36a, 36b) of the input unit (4; 34) based on the shape control signal forms a first shape of the input unit (4; 34) when the first operating state is activated, and a second geometric shape of the input unit (4; 34) forms when the second operating state is activated.

Images