DE102012001583A1 - Method for controlling, monitoring and configuring motor car, involves selecting functional state of functional element in motor car by operator of control device, and making functional element into selected function state - Google Patents

Abstract

The method involves connecting a control device (6) with motor car (4) through a network. The control device is provided for receiving (30) the image of functional element (8) in motor car from a camera (14). The image of functional element is displayed on display (16), and the functional state of functional element is selected (38) by operator of control device. The selected function state is transmitted from control device to motor car through network, and the functional element is made into selected function state. Independent claims are included for the following: (1) system for controlling, monitoring and configuring motor car; and (2) computer program product for controlling, monitoring, and configuring motor car.

Description

The invention relates to a method for controlling, monitoring and / or configuring a network-capable arrangement having at least one functional element that has at least two functional states, by means of a mobile, network-capable control device having a display and a camera. The invention further relates to a corresponding system and to a computer program product.

Methods, computer program products and systems of the type mentioned are known in the art, such systems are used, for example, for the remote maintenance of arrangements. A corresponding system is for example in the DE 600 07 900 T2 discloses, in which one or more moving objects can be monitored or operated, each object being assigned an Internet address and an interface to the Internet via a wireless telecommunication unit, sensors and / or actuators for monitoring and / or influencing components and / or or states of the object are connected to the interface, further wherein a remote test application program is configured by means of a downloaded setup file for expiration of predetermined monitoring processes.

Furthermore, so-called "Augmented Reality" systems (Augmented Reality Systems) are known in which the perception of reality is computer-enhanced. Such a function can be implemented for example by so-called head-up displays, in which additional information is displayed in the field of vision of a motorist or an aircraft pilot. Another frequently encountered application is the visual presentation of information associated with an image through computer-generated additional information. For example, it is known to overlay and overlay information on sports broadcasts on television, such as distances, directions, lines, etc. Games on mobile devices, often cell phones, are also known, which are recorded by a camera mounted on the back of a display Picture supplemented by additional information. The object of the invention is to facilitate the operability of arrangements with at least one functional element.

The object is achieved by a method according to claim 1, a computer program product according to the independent claim 7 and a system according to the independent claim 8. Further developments of the invention are the subject of the dependent claims.

A method according to the invention for controlling, monitoring and / or configuring a network-capable arrangement which has at least one functional element with at least two functional states provides for the use of a mobile, network-capable control device which has a display as well as a camera. By means of the control device, an operator can select a specific functional state of a functional element of the network-capable arrangement.

• • Die Anordnung und das Steuergerät bauen eine Netzwerkverbindung auf, um Daten und Steuerbefehle zumindest unidirektional zu übermitteln.
• • Mittels der Kamera des Steuergeräts wird ein Kamerabild des wenigstens einen Funktionselements aufgenommen.
• • Das Funktionselement wird als solches aus dem Kamerabild heraus erkannt.
• • Wenigstens eine Auswahl aus den wenigstens zwei Funktionszuständen des Funktionselements wird ermittelt. Es ist möglich, dass ein entsprechendes Funktionselement noch weitere Funktionszustände aufweist, auf die der Benutzer mittels des netzwerkfähigen Steuergeräts nicht zugreifen soll, sodass es sinnvoll sein kann, eine Auswahl aus den möglichen Funktionszuständen anzuzeigen und die übrigen nicht zur Auswahl zu stellen.
• • Die Anzeige des Steuergeräts zeigt das aufgenommene Kamerabild ganz oder teilweise an und zusätzlich wenigstens die Auswahl aus den wenigstens zwei Funktionszuständen des Funktionselements, sodass ein Bediener des Steuergeräts wenigstens einen Funktionszustand des erkannten und mittels der Kamera aufgenommenen Funktionselements auswählen kann.
• • Der vom Bediener ausgewählte Funktionszustand wird von dem Steuergerät über das Netzwerk an die Anordnung übermittelt.
• • Das Funktionselement wird in den vom Bediener ausgewählten Funktionszustand gebracht. Dies kann z. B. von der Anordnung über Einstellungsänderungen oder Aktuatoren vorgenommen werden.

The process according to the invention is characterized by the following process steps:

• The device and the controller establish a network connection in order to transmit data and control commands at least unidirectionally.
• • By means of the camera of the control unit, a camera image of the at least one functional element is recorded.
• • The function element is recognized as such from the camera image.
• • At least one selection from the at least two functional states of the functional element is determined. It is possible that a corresponding functional element also has further functional states which the user should not access by means of the network-capable control device, so that it may be useful to display a selection from the possible functional states and not to select the others.
• The display of the control unit displays the recorded camera image completely or partially and additionally at least the selection from the at least two functional states of the functional element so that an operator of the control device can select at least one functional state of the recognized and recorded by the camera functional element.
• • The operator-selected health condition is transmitted from the controller to the device via the network.
• • The functional element is brought into the operating state selected by the operator. This can be z. B. from the arrangement on attitude changes or actuators are made.

A possible concrete application of the method according to the invention can provide that an operator directs a corresponding control device to an operating element of an arrangement and the operator is shown in the display the possible functional states which the operating element can assume. The operator selects a corresponding desired functional state of the operating element and the selection is transmitted to the arrangement, whereupon the operating element is brought into the selected functional state.

According to a first possible embodiment of the method according to the invention, it can be provided that the arrangement is a motor vehicle and / or the control device is a mobile telephone. A concrete application of the method according to this embodiment can provide, for example, that a driver directs his mobile phone to an operating element of the motor vehicle, for example a cruise control, and if possible states of the cruise control are displayed in the display, for example "cruise control on" or "cruise control off "," Set maximum speed "or other functionalities of the cruise control. Another concrete application could provide that the operator directs his mobile phone to a media control of the motor vehicle and there the possible configurations (media source, volume, sound, etc.) gets displayed for selection, which he can then select accordingly.

According to a first possible embodiment of the method according to the invention, provision can be made for the arrangement and the control unit to establish an immediate network connection. In this way, the arrangement and the control unit can communicate directly with one another and, for example, it can be provided that the arrangement transmit the possible selection of the functional states of the functional element or functional elements to the control unit. The network connection can be made by different means, wireless or wired as well as different protocols, such as Bluetooth, WLAN etc.

According to a first additional or alternative embodiment it can be provided that the arrangement and the control device establish a network connection via a server. Additional information can be stored on the server, for example the equipment features of a motor vehicle detected by the camera and, associated therewith, the possible functional states of the functional elements. Furthermore, further information concerning the user of the control device can be stored on the server, for example holders, holder-specific vehicle configurations, etc. In this way it is possible, for example, to configure a rental car according to the settings of the own motor vehicle, so that the owner has little own effort Has.

According to another possible embodiment of the invention, it can be provided that at least the selection from the at least two functional states of the functional element is stored on the server and the server transmits the selection to the control device. In this way, the data can be easily administered and easily maintain changes in the functional scope, for example by software updates of a vehicle component.

According to another possible embodiment of the invention can be provided that the camera image is transmitted to the server and the functional element is detected by means of the server. As a rule, servers are more powerful and can be constantly improved by software or by learning programs, so that the recognition accuracy is increased.

A first independent subject matter of the invention relates to a computer program product designed to implement the method according to one of the preceding claims. The computer program product may include a plurality of sub-computer program products that communicate with each other. Thus, a computer program product in the form of software can be installed on the mobile, network-capable control unit, which allows the superposition of a camera image with a selection and the transmission of the selection of the operator to the arrangement. Another part of the computer program product can be stored on the arrangement and / or the server and communicate with the computer program product of the control unit to exchange data. The computer program product can be stored on a data medium.

Another independent subject matter of the invention relates to a system for controlling, monitoring and / or configuring a network-capable arrangement by means of a mobile, network-capable control device, wherein the arrangement has at least one functional element with at least two functional states and at least one network interface, the control device having a display, a Camera and has a network interface. A corresponding network-capable arrangement may be a motor vehicle. A corresponding control device may be a mobile phone.

According to the invention, it is provided that the arrangement and the control unit are designed to establish a network connection, for example by providing corresponding interfaces for exchanging data. Furthermore, a recognition device is provided for recognizing the at least one functional element from an image taken by the camera of the mobile control device. In addition, a memory is provided, in which at least one selection of the at least two functional states of the corresponding functional element is stored, the memory being connected to the control device for data transmission.

This ensures that the selection from the at least two functional states of the functional element recorded by the camera is displayed on the control unit. The memory may be part of the controller, but access to the memory can also be made via the network interface or another interface. In addition, it is provided that the control unit is designed to transmit a control signal as a function of a selection of at least one functional state of the functional element by a user to the arrangement via the network. Finally, the arrangement for changing the functional state of the at least one functional element is formed as a function of the user's choice. This can be achieved, for example, by means of corresponding actuators, which actuate the relevant functional element.

According to a first possible embodiment of the system according to the invention, a server may be provided, with which the arrangement and the control unit can be connected to transfer data.

According to another possible embodiment of the invention can be provided that the memory and / or the recognition device components of the server, whereby the computational effort on the mobile control unit can be reduced.

The invention will be explained with reference to an embodiment. Here are shown schematically:

1 a system according to the invention as well

2 a flow diagram of a method according to the invention.

1 shows a system according to the invention 2 (dashed framed) with a motor vehicle 4 and (shown enlarged) a mobile phone 6 ,

The car 4 has a functional element 8th , in the present case headlights, on which several states (switched on, switched off, other comfort functions, eg afterglow after switching off the motor vehicle 4 ) having. The car 8th also has a network interface 10 on. Furthermore, a vehicle control 12 provided, which with the network interface 10 data transferring connected. The headlights 8th can be controlled by the vehicle control 12 Taxes.

The mobile phone 6 has a camera 14 , an ad 16 as well as a network interface 18 on.

The system according to the invention now allows the user of the mobile phone 6 the camera 14 on the headlights 8th of the motor vehicle 4 directed, being within the system 2 is detected in the captured image of the camera 14 the headlights 8th you can see. This can be done in the mobile phone 6 a recognition device 20 be provided, which is implemented for example in the form of software. The car 4 and the mobile phone 6 Make or have established a connection through their respective network interfaces 10 . 18 , The mobile phone shares via the network connection 6 the vehicle control 12 with that camera 14 a picture of the headlights 8th has recorded. The image may be a still image or a moving image. The vehicle control 12 reads from a memory 22 who is in the car steering system 12 connected, the possible, user-changeable functional states of the headlights 8th and transmits them to the mobile phone 6 , The selection is made to the user on the display 16 and the user can see the headlights 8th configure according to his wishes. Possible options may be to turn the headlamps on or off or to activate or configure an afterglow function, such as an afterglow period of the headlamps 8th when the motor vehicle is switched off. Furthermore, in some embodiments of the invention, a server 24 be provided with the motor vehicle 4 and mobile phone 6 data transmitting connected.

In the context of the invention numerous variants are possible. So can the recognition device 20 as well as the memory 22 be arranged at different locations. Both can, for example, in the mobile phone 6 be integrated in the server 24 or in the motor vehicle 4 ,

2 shows a sequence of the method according to the invention.

In a first step 30 is using the camera 14 an image of a functional element of the motor vehicle 4 added.

In step 32 the functional element is determined from the camera image.

In a next step 34 the selectable functional states of the functional element are determined. This can be an access to the memory 22 respectively.

In a next step 36 will be an overlay of the camera 14 recorded image with the selection of the possible functional states of the functional element on the display 16 shown.

In step 38 the user selects a corresponding functional state.

In one step 40 becomes a control command to the motor vehicle 4 transmitted.

In a last step 42 the selection is implemented.

The invention permits numerous different applications, some of which are mentioned below by way of example.

example 1

• • Aktueller Einstellung des Tempomats (aktiv/nicht aktiv);
• • Aktueller Geschwindigkeitseinstellung (z. B. 120 km/h falls aktiv);
• • Die Möglichkeit, den Tempomaten über das Smartphone zu aktivieren/deaktivieren oder die Geschwindigkeit zu ändern.

sowie der Möglichkeit, die Einstellungen zu ändern.The user directs his smartphone (mobile phone, usually with a large display and additional functions) on an operating element in the vehicle. As previously described, this may be the tempo setting. The real image taken by the camera is superimposed with information about the cruise control, but not only with static information for the description and operation, but also with:

• • Current setting of cruise control (active / not active);
• • Current speed setting (eg 120 km / h if active);
• • The ability to enable / disable the cruise control via the smartphone or to change the speed.

and the ability to change the settings.

Example 2

The user directs his smartphone to a volume control of an audio module of a motor vehicle. He can now change the volume using the smartphone, for example. In addition, he is offered the sound settings (bass, midrange, treble) for which there are no corresponding physical switches.

Example 3

The user directs his smartphone on an instrument cluster of a motor vehicle. He can now retrieve all settings and change all configurations,

Example 4

The user points his smartphone to a light in the vehicle exterior. He can now configure the persistence duration during parking.

Example 5

The user points his smartphone at a door lock. He can now lock / unlock the vehicle.

Example 6

The user points his smartphone at his vehicle. A vehicle recognition is started via this and the correct vehicle is determined and the user is offered the appropriate settings. If the vehicle is unknown, e.g. B. because it is a rental car, the user gets the opportunity to temporarily transfer his personal settings to this new vehicle and to make other settings in the usual way.

• • Der Benutzer muss ein Geheimnis kennen, das ihm bspw. von der Mietwagenfirma übergeben wurde und das nun im Fahrzeug oder dem Smartphone konfiguriert werden muss;
• • Der Benutzer muss das Fahrzeug mit einem Schlüssel entriegelt haben;

To increase security and to prevent abuse, this could only be possible with new vehicles after an authentication has taken place. Examples of authentication could be:

• • The user must know a secret that has been given to him, for example, by the rental car company and that must now be configured in the vehicle or smartphone;
• • The user must have unlocked the vehicle with a key;

The smartphone gives instructions that need to be done in a specific time and order. This could be done in the following way: "Unlock the vehicle and turn on the light to show that you have access to the vehicle".

LIST OF REFERENCE NUMBERS

2

system

4

motor vehicle

6

mobile phone

8th

headlights

10

Network Interface

12

vehicle control

14

camera

16

display

18

Network Interface

20

Erkennunsvorrichtung

22

Storage

24

server

30-44

steps

QUOTES INCLUDE IN THE DESCRIPTION

This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• DE 60007900 T2 [0002]

Claims (10)

Method for controlling, monitoring and / or configuring a network-capable arrangement ( 4 ) with at least one functional element ( 8th ), which has at least two functional states, by means of a mobile, network-capable control device ( 6 ), which is an ad ( 16 ) as well as a camera ( 14 ), characterized in that - the arrangement ( 4 ) and the control unit ( 6 ) establish a network connection, - the control unit ( 6 ) by means of the camera ( 14 ) a camera image of the at least one functional element ( 8th ), - the functional element ( 8th ), - at least one selection from the at least two functional states of the functional element ( 8th ), - the display ( 16 ) of the control unit ( 6 ) displays the recorded camera image and additionally at least the selection from the at least two functional states of the functional element ( 8th ), so that an operator of the control unit ( 6 ) at least one functional state of the functional element ( 8th ), - the operating state selected by the operator from the control device ( 6 ) over the network to the device ( 4 ) and - the functional element ( 8th ) is brought into the operator-selected functional state. Method according to Claim 1, characterized in that the arrangement is a motor vehicle ( 4 ) and / or at the controller to a mobile phone ( 6 ). Method according to claim 1 or 2, characterized in that the arrangement ( 4 ) and the control unit ( 6 ) establish an immediate network connection. Method according to one of the preceding claims, characterized in that the arrangement ( 4 ) and the control unit ( 6 ) a network connection via a server ( 24 ) produce. Method according to claim 4, characterized in that at least the selection from the at least two functional states of the functional element ( 8th ) is stored on the server and the server ( 24 ) the selection to the control unit ( 6 ) transmitted. A method according to claim 4 or 5, characterized in that the camera image to the server ( 24 ) and the functional element ( 8th ) by means of the server ( 24 ) is recognized. Computer program product, designed to implement the method according to one of the preceding claims. System for controlling, monitoring and / or configuring a network-capable arrangement ( 4 ) by means of a mobile, network-capable control device ( 6 ), the arrangement ( 4 ) at least one functional element ( 8th ) with at least two functional states and at least one network interface ( 10 ), wherein the controller displays ( 16 ), a camera ( 14 ) as well as a network interface ( 18 ), characterized in that - the arrangement ( 4 ) and the control unit ( 6 ) are designed for establishing a network connection, - a recognition device ( 20 ) for recognizing the at least one functional element ( 8th ) from one of the camera ( 14 ) image is provided, - a memory ( 22 ) is provided, in which at least one selection of the at least two functional states is stored, wherein the memory ( 22 ) with the control unit ( 6 ) is data transmitting connected, - the control unit ( 6 ) for transmitting a control signal as a function of a selection of at least one functional state of the functional element ( 8th ) by a user to the arrangement ( 4 ) is formed via the network connection and - the arrangement ( 4 ) for changing the functional state of the at least one functional element ( 8th ) is formed depending on the selection of the user. System according to claim 8, characterized in that a server ( 24 ) is provided, with which the arrangement ( 4 ) and the control unit ( 6 ) can be connected to transfer data. System according to claim 8 or 9, characterized in that the memory ( 22 ) and / or the recognition device ( 20 ) Components of the server ( 24 ) are.

Images