CN114556271A - Method and device for activating a cleaning mode of a touch-sensitive control panel - Google Patents

Method and device for activating a cleaning mode of a touch-sensitive control panel Download PDF

Info

Publication number
CN114556271A
CN114556271A CN202080073266.2A CN202080073266A CN114556271A CN 114556271 A CN114556271 A CN 114556271A CN 202080073266 A CN202080073266 A CN 202080073266A CN 114556271 A CN114556271 A CN 114556271A
Authority
CN
China
Prior art keywords
cleaning mode
cleaning
touch
activating
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202080073266.2A
Other languages
Chinese (zh)
Other versions
CN114556271B (en
Inventor
E·塔拉扬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mercedes Benz Group AG
Original Assignee
Mercedes Benz Group AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mercedes Benz Group AG filed Critical Mercedes Benz Group AG
Publication of CN114556271A publication Critical patent/CN114556271A/en
Application granted granted Critical
Publication of CN114556271B publication Critical patent/CN114556271B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/22—Display screens
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/25—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using haptic output
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/29—Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60S—SERVICING, CLEANING, REPAIRING, SUPPORTING, LIFTING, OR MANOEUVRING OF VEHICLES, NOT OTHERWISE PROVIDED FOR
    • B60S1/00—Cleaning of vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60S—SERVICING, CLEANING, REPAIRING, SUPPORTING, LIFTING, OR MANOEUVRING OF VEHICLES, NOT OTHERWISE PROVIDED FOR
    • B60S1/00—Cleaning of vehicles
    • B60S1/02—Cleaning windscreens, windows or optical devices
    • B60S1/56—Cleaning windscreens, windows or optical devices specially adapted for cleaning other parts or devices than front windows or windscreens
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G06F3/0418—Control or interface arrangements specially adapted for digitisers for error correction or compensation, e.g. based on parallax, calibration or alignment
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/143—Touch sensitive instrument input devices
    • B60K2360/1438—Touch screens
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/146—Instrument input by gesture
    • B60K2360/1468—Touch gesture
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16—Type of output information
    • B60K2360/161—Explanation of functions, e.g. instructions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/18—Information management
    • B60K2360/199—Information management for avoiding maloperation
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20—Optical features of instruments
    • B60K2360/21—Optical features of instruments using cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/26—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using acoustic output

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention relates to a method for activating a cleaning mode of a touch-operable control panel of a motor vehicle, wherein the control panel is at least partially switched to inactive mode in the cleaning mode in order to avoid incorrect operation. According to the invention, the operating screen is monitored by a camera. The operation of activating the cleaning mode is detected by recognizing the cleaning tool controlled on the operation screen by the hand of the user.

Description

Method and device for activating a cleaning mode of a touch-sensitive control panel
Technical Field
The invention relates to a method and a device for setting up a cleaning process for recognizing an operating panel and activating a cleaning mode.
Background
Functional control by means of touch-sensitive control panels is used in modern motor vehicles. The operation leaves an inevitable fingerprint on the surface of the operation panel, thereby requiring frequent cleaning.
From publication US 20180136833 a1 a device with a touch screen is known, which is designed to recognize a predetermined gesture with a finger or an input means on the touch screen. The cleaning mode is activated when a predetermined gesture is detected, in which case the touch screen is switched inactive during cleaning in order to avoid malfunction.
A disadvantage of the disclosed device is that cleaning with a cleaning tool always requires a prior explicit input of a predetermined gesture. This gesture must be made with a finger or special operator before the cleaning tool, such as a wipe, can be used for cleaning.
Disclosure of Invention
In contrast, the object of the invention is to provide a method and a device, by means of which a more comfortable activation of the cleaning mode is enabled.
This object is achieved by a method for activating a cleaning mode having the features of claim 1 and by a device according to claim 9. The dependent claims define preferred advantageous embodiments of the invention.
In the method according to the invention, the control panel is monitored by a camera and the operation of activating the cleaning mode is detected when a cleaning tool controlled or held by the hand of the user on the control panel is detected. The cleaning mode is activated when a cleaning tool controlled by the hand of the user on the control panel is recognized. The camera detects the user's hand placing a cleaning tool, i.e., such as a cleaning wipe, sponge, web, etc., on the surface of the dashboard. Upon identifying the cleaning tool on the surface of the operator screen, the cleaning mode is activated to avoid malfunction of the operator screen caused by wetting the cleaning tool on a capacitive or inductive display or by a finger slipping off the wipe. Accordingly, malfunction is avoided in the case of a pressure-sensitive display, such as a resistive display. The one or more cameras are disposed in the roof to detect object and passenger gestures. For example, a camera is arranged in the vehicle roof in the region between the driver seat and the passenger seat, so that driver gestures and passenger gestures can be detected, in particular, from above the display. The cameras, including the respective controllers, are set up to recognize learned gestures and objects. For this, for example, a neural network comprised by the controller is trained until it is ensured that gestures and objects are recognized with a sufficiently high probability. The operation screen includes operation regions such as icons assigned to the respective functions. With the activation of the cleaning mode, the operating field is at least partially switched to inactive, i.e. neither touching nor pressing the operating field performs the function assigned to the operating screen. The control screen is designed, for example, as a touch-sensitive dial, a touch-sensitive display or a touch-operable control panel. The operating panel operates, for example, according to a capacitive method, an inductive method or a resistive method. The method of the invention advantageously allows cleaning of the operating screen surface without having to explicitly switch on the cleaning mode. With the recognition of the cleaning tool, it is already possible to activate the cleaning mode in advance, i.e. before a false trigger is caused by the wiping action. In particular, when cleaning with a cleaning tool that is perhaps partially wet, an activation gesture known from the prior art may not be performed on the touch-sensitive display. According to the prior art, the user must first perform an activation gesture with his fingers before cleaning with the cleaning tool can take place.
In the design of the method, the control panel is monitored by a camera and the cleaning mode is activated as soon as a typical movement of the user's hand for cleaning is detected. Typical movements are for example a wiping movement or a rounding movement inherent to the cleaning process.
By identifying typical movements in addition to the cleaning tool by means of the camera, the recognition probability of the cleaning process is advantageously significantly increased. The higher the recognition probability, the less false activation of the cleaning mode.
In an alternative or additional embodiment, the cleaning mode is activated as a result of a typical movement of the cleaning tool controlled by the hand of the user being detected by means of a touch-sensitive control panel. The movement path of the cleaning tool is determined by a touch sensor of the control panel. When the trajectory coincides with or is similar to a predetermined typical trajectory for a wiping process, a cleaning process can be identified and a cleaning mode activated. By recognizing the typical movement by means of the contact sensor, the recognition by means of the camera can be supplemented by a further increase in the recognition probability of the cleaning process.
In other designs of the method, the activation of the cleaning mode is confirmed using tactile, visual and/or audible feedback. The haptic feedback is, for example, a vibration of the control panel constructed by the actuator. The visual feedback is done on the touch sensitive display, for example by displaying an image representing the sliding process, by displaying the operating state "clean mode", or the screen may be switched to dim.
In a further preferred embodiment, the cleaning mode is activated only within a predetermined driving speed range. If, for example, the driver starts cleaning the screen above a predetermined speed range, it is not put in the cleaning mode to avoid driver distraction. Upon detection of an intention to clean by the cleaning tool or typical action, an alert is output to the driver. The alert includes information about "cleaning mode not available" and/or a requirement about concentration on traffic. Advantageously, the method reduces the risk of traffic caused by distraction.
In a modified embodiment, different driving speed ranges are set for the driver and the copilot for activating the cleaning mode. In this case, the camera detects who holds the cleaning tool or who moves the cleaning tool to the surface of the operating screen or who performs typical hand movements. In one embodiment, the cleaning mode is activated in all speed ranges of the vehicle in the case of operation by a copilot, and is activated only when a defined speed threshold is reached in the case of driver operation. This method allows to distinguish between different operators in order to maximize the usability.
In a modified embodiment, the cleaning mode is ended as soon as the camera does not recognize the cleaning tool within a predetermined duration and/or as soon as a manipulation with a finger is recognized. The method according to the invention provides an automatic termination of the cleaning mode.
The device according to the invention comprises a camera which detects an operation of activating the cleaning mode, wherein the activation operation comprises a cleaning tool controlled by a hand of a user on a display surface. The device of the present invention allows the operation panel to be automatically switched to the cleaning mode to prevent a wrong manipulation.
Additional advantages, features and details result from the following description of at least one embodiment, optionally with reference to the drawings. The features described and/or shown in the figures can form the subject matter of the invention on their own or in any meaningful combination, as the case may be, also independently of the claims, and can in particular also be subject matter of one or more independent applications. Identical, similar and/or functionally identical components are provided with the same reference numerals.
Drawings
The figures show:
figure 1 shows a vehicle interior with a camera,
fig. 2 shows a process diagram of the method according to the invention.
Detailed Description
Fig. 1 shows a vehicle interior 1, which is monitored by a camera 3. An operating screen in the form of a touch-sensitive display 5 with a plurality of operating fields 7, only one of which is designated with a reference numeral for the sake of clarity, is provided in the center console.
A plurality of vehicle functions are associated with the operating field 7, which can be called up by contact with the hand of the user. Vehicle functions relate to, for example, volume control, entertainment systems, navigation system activation, trunk or door opening, emergency calls, etc.
Leaving a fingerprint on the display due to the finger contact. The fingerprint or other dirt is to be cleaned by the user using a cleaning tool 11, such as preferably a moist wipe.
The typical movement 13 of the cleaning tool 11, indicated by an arrow, controlled by the hand or finger of the user can result in accidental contact with the operating field 7 and undesired activation of the function. To avoid such malfunctions, the touch-sensitive display 5 is monitored by means of the camera 3.
The camera is trained to recognize typical movements of the hand 15 and/or also the cleaning tool 11 itself. The training of the cameras, i.e. the cameras and the corresponding evaluation units, is carried out according to methods known from the prior art, for example by means of a neural network. Once the typical action 11 and/or the cleaning tool 11 is recognized, the touch sensitive display 5 is switched to the cleaning mode. The cleaning mode causes the operating field 7 to be switched to inactive and touch-control with the cleaning tool 11 or with the finger of the hand 15 next to the cleaning tool 11 is inhibited.
In a further variant, the recognition probability of the cleaning process is increased, since the movement of the cleaning tool 11 is additionally evaluated by means of the sensor system of the touch-sensitive display 5. From the trajectory caused by the movement of the cleaning tool 11 and determined by the sensors of the touch-sensitive display, actions typical for the cleaning process can be deduced. The actions recognized by the touch-sensitive display 5 can advantageously be verified with the actions and objects recognized by the camera 3.
Fig. 2 shows a process diagram of a variant of the method that can be performed with the device shown in fig. 1. In step S100, the monitoring of the touch-sensitive display 5 by means of the camera 3 is activated, for example, when the vehicle is moving off. In step S103, the camera 3 identifies the cleaning tool 11 manipulated, i.e. placed, by the hand of the user on the touch-sensitive display 5 and/or the cleaning tool 11 controlled in the typical action 13. In step S104 it is checked whether the condition of the cleaning mode is fulfilled, i.e. the vehicle is travelling in a predetermined speed range and/or, for example, the driver or the passenger drive is allowed to clean in the current speed range. If the condition is not satisfied, the process jumps back to step S103. Meanwhile, a notification about "not allowing the screen to be cleaned in the current driving state" is output to the user. If these conditions are fulfilled, the touch sensitive display 5 is switched to inactive, i.e. to the cleaning mode, in step S105. The switch to the cleaning mode is visually displayed to the user on the touch sensitive display 5. It is checked in step S107 whether the condition on the cleaning mode is continuously satisfied. If the condition continues to be fulfilled, a jump is made back to step S105, whereas if the condition is no longer fulfilled, the touch-sensitive display 5 is activated again in step S109 for the prescribed manipulation. When neither a cleaning tool nor a cleaning tool controlled in the movement typical for the cleaning process is recognized within a predetermined period of time, or when the camera 3 recognizes that only the finger 9 of the user's hand 15 is manipulating the touch-sensitive display 5, i.e. that no cleaning tool 11 is present, the conditions for the cleaning mode are no longer fulfilled.
While the invention has been particularly shown and described with reference to a preferred embodiment, the invention is not limited to the disclosed embodiment, and other variations may be derived therefrom by those skilled in the art without departing from the scope of the invention. It is therefore evident that many possibilities for variation exist. The embodiments illustrated are also obviously only examples and should in no way be understood as limiting the scope of protection, the possibilities of application or the inventive arrangements. Rather, the foregoing description and drawings enable one skilled in the art to practice the embodiments, and various changes may be made in the function and arrangement of elements, e.g., parts, as set forth in the embodiments, herein, without departing from the scope of the invention as set forth in the appended claims and their legal equivalents, such as are defined by the detailed description herein, knowing the inventive concepts disclosed.

Claims (9)

1. A method for activating a cleaning mode of a touch-operable control panel of a motor vehicle, wherein the control panel is at least partially switched to inactive (S105) in the cleaning mode, in order to avoid malfunction,
it is characterized in that the utility model is characterized in that,
-monitoring (S100) the operation screen with a camera, and
-detecting an operation of activating the cleaning mode by means of the camera, wherein the activation operation comprises a cleaning tool controlled by a hand of a user on the operation screen (S103).
2. The method of claim 1, wherein the operation of activating the cleaning mode comprises a typical motion of a user' S hand (S103).
3. A method according to claim 1 or 2, wherein the operation of activating the cleaning mode is detected by recognizing a typical movement of the user's hand by means of a sensor of the touch-operable operating screen.
4. The method according to one of claims 1 to 3, characterized in that the activation of the cleaning mode of the operating screen is confirmed by means of tactile or visual feedback (S105).
5. Method according to one of claims 1 to 4, characterized in that the cleaning mode is activated only within a predefined driving speed range (S104).
6. The method according to claim 5, characterized in that different driving speed ranges are set (S104) for the driver and the copilot from each other.
7. Method according to one of claims 1 to 6, characterized in that the cleaning mode is ended as soon as no cleaning tool is recognized for a defined duration and/or as soon as a finger manipulation is recognized by means of the camera (S107).
8. A motor vehicle device which is set up to recognize an operation of an activation cleaning mode on an operating panel (5), characterized in that the device comprises a camera (3) which detects the activation operation, wherein the activation operation comprises a cleaning tool (11) which is controlled on the operating panel (5) by a hand (15) of a user.
9. Device according to claim 9, characterised in that the operating screen (5) is designed as a touch-sensitive display.
CN202080073266.2A 2019-10-21 2020-09-07 Method and device for activating a cleaning mode of a touch-operable operating screen Active CN114556271B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102019007300.2A DE102019007300A1 (en) 2019-10-21 2019-10-21 Method and device for activating a cleaning mode of a touch-operated button
DE102019007300.2 2019-10-21
PCT/EP2020/074889 WO2021078434A1 (en) 2019-10-21 2020-09-07 Method and device for activating a cleaning mode of a touch-operable command panel

Publications (2)

Publication Number Publication Date
CN114556271A true CN114556271A (en) 2022-05-27
CN114556271B CN114556271B (en) 2023-09-05

Family

ID=72422177

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080073266.2A Active CN114556271B (en) 2019-10-21 2020-09-07 Method and device for activating a cleaning mode of a touch-operable operating screen

Country Status (7)

Country Link
US (1) US11609639B2 (en)
EP (1) EP4003773B1 (en)
JP (1) JP7291997B2 (en)
KR (1) KR20220088722A (en)
CN (1) CN114556271B (en)
DE (1) DE102019007300A1 (en)
WO (1) WO2021078434A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102022117380B4 (en) 2022-07-12 2024-04-04 Cariad Se Method for operating a screen of a motor vehicle and motor vehicle

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6208331B1 (en) * 1998-07-01 2001-03-27 Ericsson Inc. Cleaning touchscreens
JP2009129406A (en) * 2007-11-28 2009-06-11 Rinnai Corp Liquid crystal display device
US20120206384A1 (en) * 2008-09-19 2012-08-16 Cleankeys Inc. Systems and methods for monitoring surface sanitation
US20160193634A1 (en) * 2015-01-06 2016-07-07 Ford Global Technologies, Llc Screen cleaning system for a motor vehicle
CN106569692A (en) * 2016-10-26 2017-04-19 青岛海信电器股份有限公司 Method and device for erasing gesture
WO2017093484A1 (en) * 2015-12-03 2017-06-08 Fresenius Medical Care Deutschland Gmbh Disinfection status monitoring for dialysis monitors
US20180136833A1 (en) * 2016-11-16 2018-05-17 Rauland-Borg Corporation Detection of cleaning gestures
CN108501827A (en) * 2018-03-02 2018-09-07 深圳市贝优通新能源技术开发有限公司 It is a kind of to show new-energy automobile navigation system that is clear and being conveniently operated
CN108973941A (en) * 2017-06-02 2018-12-11 法雷奥系统公司 Cleaning systems for motor vehicles

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007200095A (en) * 2006-01-27 2007-08-09 Matsushita Electric Ind Co Ltd Information terminal device
JP4876846B2 (en) * 2006-10-18 2012-02-15 船井電機株式会社 Navigation device and electronic device
JP2010186442A (en) * 2009-02-13 2010-08-26 Sharp Corp Input device and input control method
JP2014021748A (en) * 2012-07-19 2014-02-03 Alpine Electronics Inc Operation input device and on-vehicle equipment using the same
CA2924104A1 (en) 2012-09-17 2014-03-20 K2Invent LLC Display surface cleaning system
DE102013001332B4 (en) 2013-01-26 2017-08-10 Audi Ag Method for detecting the degree of pollution of a vehicle
DE102014005760B4 (en) 2014-04-17 2023-10-12 Audi Ag Arrangement for an interior of a motor vehicle
JP2016157335A (en) * 2015-02-25 2016-09-01 株式会社リコー Information processing apparatus and program
DE102015010722A1 (en) 2015-08-17 2017-02-23 Audi Ag Device for cleaning a surface
US9798413B2 (en) 2015-08-27 2017-10-24 Hand Held Products, Inc. Interactive display
JP2018128957A (en) 2017-02-10 2018-08-16 パナソニックＩｐマネジメント株式会社 Controller, control method, program, and display unit
US10773690B2 (en) 2017-06-28 2020-09-15 Ford Global Technologies, Llc Cleaning a vehicle display
DE102018211251B4 (en) 2018-07-09 2023-12-21 Bayerische Motoren Werke Aktiengesellschaft Vehicle with at least one cleaning robot for automatically cleaning a screen of the vehicle

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6208331B1 (en) * 1998-07-01 2001-03-27 Ericsson Inc. Cleaning touchscreens
JP2009129406A (en) * 2007-11-28 2009-06-11 Rinnai Corp Liquid crystal display device
US20120206384A1 (en) * 2008-09-19 2012-08-16 Cleankeys Inc. Systems and methods for monitoring surface sanitation
US20160193634A1 (en) * 2015-01-06 2016-07-07 Ford Global Technologies, Llc Screen cleaning system for a motor vehicle
WO2017093484A1 (en) * 2015-12-03 2017-06-08 Fresenius Medical Care Deutschland Gmbh Disinfection status monitoring for dialysis monitors
EP3384369A1 (en) * 2015-12-03 2018-10-10 Fresenius Medical Care Disinfection status monitoring for dialysis monitors
CN106569692A (en) * 2016-10-26 2017-04-19 青岛海信电器股份有限公司 Method and device for erasing gesture
US20180136833A1 (en) * 2016-11-16 2018-05-17 Rauland-Borg Corporation Detection of cleaning gestures
CN108973941A (en) * 2017-06-02 2018-12-11 法雷奥系统公司 Cleaning systems for motor vehicles
CN108501827A (en) * 2018-03-02 2018-09-07 深圳市贝优通新能源技术开发有限公司 It is a kind of to show new-energy automobile navigation system that is clear and being conveniently operated

Also Published As

Publication number Publication date
US11609639B2 (en) 2023-03-21
EP4003773B1 (en) 2023-03-08
US20220391020A1 (en) 2022-12-08
EP4003773A1 (en) 2022-06-01
DE102019007300A1 (en) 2021-04-22
CN114556271B (en) 2023-09-05
KR20220088722A (en) 2022-06-28
JP2022551120A (en) 2022-12-07
WO2021078434A1 (en) 2021-04-29
JP7291997B2 (en) 2023-06-16

Similar Documents

Publication Publication Date Title
KR101550604B1 (en) Vehicle operation device
US9143126B2 (en) Proximity switch having lockout control for controlling movable panel
US9660644B2 (en) Proximity switch assembly and activation method
US8933708B2 (en) Proximity switch assembly and activation method with exploration mode
US9965169B2 (en) Systems, methods, and apparatus for controlling gesture initiation and termination
US9065447B2 (en) Proximity switch assembly and method having adaptive time delay
CN104039582B9 (en) Method and device for operating functions displayed on a display unit of a vehicle using gestures which are carried out in a three-dimensional space, and corresponding computer program product
US10474357B2 (en) Touch sensing display device and method of detecting user input from a driver side or passenger side in a motor vehicle
CN110709273B (en) Method for operating a display device of a motor vehicle, operating device and motor vehicle
US20180134158A1 (en) Method for operating an operator control device of a motor vehicle in different operator control modes, operator control device and motor vehicle
CN203567717U (en) Operating device for motor vehicle
CN107667030B (en) Operating assembly for a motor vehicle with an operating device in and/or on the steering wheel rim, motor vehicle and method
US20160054849A1 (en) Motor vehicle operating device
US9645667B2 (en) Touch switch module which performs multiple functions based on a touch time
US10558310B2 (en) Onboard operation apparatus
KR20180095849A (en) A vehicle having an image recording unit and an operating system for operating the devices of the vehicle and a method for operating the operating system
CN114556271B (en) Method and device for activating a cleaning mode of a touch-operable operating screen
CN105584437A (en) Operating unit used for at least one electrically controllable apparatus
CN110770068A (en) Switching device for switching a drive in a motor vehicle
CN107636567B (en) Method for operating an operating device and operating device for a motor vehicle
CN113966581A (en) Method for optimizing operation of optical display device
US11880525B2 (en) Method and device for selecting input fields displayed on a screen and/or for activating input content displayed in a selected input field on the screen by means of manual inputs
JP7361230B2 (en) Control device with touch-sensitive control surface
JP2015130122A (en) Capacitive operation device
TR2023006282A2 (en) A SYSTEM THAT WILL MAKE IT EASIER FOR THE DRIVER TO USE THEIR VEHICLE

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant